2023-11-27T20:23:30.736 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-27T20:23:30.736 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095 --verbose --owner scheduled_yuriw@teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --name yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095/orig.config.yaml 2023-11-27T20:23:30.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T20:23:30.863 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095 branch: wip-yuri10-testing-2023-11-22-1112 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: yweinste@redhat.com first_in_suite: false job_id: '7468095' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri10-testing-2023-11-22-1112 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2023-11-22-1112 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 8541 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri10-testing-2023-11-22-1112 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi091.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB+aDIgyZeykydm9A9IY8KEPxFaJTJ8U9RFQ0TkOX8xkFhmbk8EZArlIfGFd1GGFr5a+7I1/leBcH/V0ZsRznPQ= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMk7sAoQg+/QFBG4CYfDi5njJ3fAiSX5DNIES7pEEhrAcS6aFaA/E64lzy/gdGHlXBSIYcSYoqCMRyS3WvywXg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-27_17:14:24 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-27T20:23:30.864 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa; will attempt to use it 2023-11-27T20:23:30.864 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks 2023-11-27T20:23:30.864 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-27T20:23:30.866 INFO:teuthology.task.internal:Checking packages... 2023-11-27T20:23:30.893 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '369173db14b6995b2bd07c60ec5f63d01cf21631' 2023-11-27T20:23:30.894 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-27T20:23:30.894 INFO:teuthology.packaging:ref: None 2023-11-27T20:23:30.894 INFO:teuthology.packaging:tag: None 2023-11-27T20:23:30.894 INFO:teuthology.packaging:branch: wip-yuri10-testing-2023-11-22-1112 2023-11-27T20:23:30.894 INFO:teuthology.packaging:sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:23:30.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri10-testing-2023-11-22-1112 2023-11-27T20:23:31.160 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7498.g369173db 2023-11-27T20:23:31.160 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-27T20:23:31.171 INFO:teuthology.task.internal:no buildpackages task found 2023-11-27T20:23:31.172 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-27T20:23:31.195 INFO:teuthology.task.internal:Saving configuration 2023-11-27T20:23:31.212 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-27T20:23:31.223 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T20:23:31.248 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 20:18:23.394811', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB+aDIgyZeykydm9A9IY8KEPxFaJTJ8U9RFQ0TkOX8xkFhmbk8EZArlIfGFd1GGFr5a+7I1/leBcH/V0ZsRznPQ='} 2023-11-27T20:23:31.273 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 20:18:23.393037', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMk7sAoQg+/QFBG4CYfDi5njJ3fAiSX5DNIES7pEEhrAcS6aFaA/E64lzy/gdGHlXBSIYcSYoqCMRyS3WvywXg='} 2023-11-27T20:23:31.274 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-27T20:23:31.282 INFO:teuthology.task.internal:roles: ubuntu@smithi091.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-11-27T20:23:31.282 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-11-27T20:23:31.282 INFO:teuthology.run_tasks:Running task console_log... 2023-11-27T20:23:31.365 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc8a9d80b80>, signals=[15]) 2023-11-27T20:23:31.366 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-27T20:23:31.377 INFO:teuthology.task.internal:Opening connections... 2023-11-27T20:23:31.378 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:23:31.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:23:31.464 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:23:31.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:23:31.546 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-27T20:23:31.554 DEBUG:teuthology.orchestra.run.smithi091:> uname -m 2023-11-27T20:23:31.572 INFO:teuthology.orchestra.run.smithi091.stdout:x86_64 2023-11-27T20:23:31.572 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release 2023-11-27T20:23:31.630 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="CentOS Stream" 2023-11-27T20:23:31.630 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="9" 2023-11-27T20:23:31.630 INFO:teuthology.orchestra.run.smithi091.stdout:ID="centos" 2023-11-27T20:23:31.630 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE="rhel fedora" 2023-11-27T20:23:31.630 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="9" 2023-11-27T20:23:31.630 INFO:teuthology.orchestra.run.smithi091.stdout:PLATFORM_ID="platform:el9" 2023-11-27T20:23:31.630 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T20:23:31.631 INFO:teuthology.orchestra.run.smithi091.stdout:ANSI_COLOR="0;31" 2023-11-27T20:23:31.631 INFO:teuthology.orchestra.run.smithi091.stdout:LOGO="fedora-logo-icon" 2023-11-27T20:23:31.631 INFO:teuthology.orchestra.run.smithi091.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T20:23:31.631 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://centos.org/" 2023-11-27T20:23:31.631 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T20:23:31.631 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T20:23:31.631 INFO:teuthology.orchestra.run.smithi091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T20:23:31.632 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server 2023-11-27T20:23:31.653 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-11-27T20:23:31.670 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-11-27T20:23:31.671 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-11-27T20:23:31.727 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2023-11-27T20:23:31.727 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2023-11-27T20:23:31.727 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2023-11-27T20:23:31.727 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2023-11-27T20:23:31.727 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2023-11-27T20:23:31.727 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2023-11-27T20:23:31.727 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T20:23:31.727 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-11-27T20:23:31.728 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2023-11-27T20:23:31.728 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T20:23:31.728 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2023-11-27T20:23:31.728 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T20:23:31.728 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T20:23:31.728 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T20:23:31.728 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-11-27T20:23:31.753 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-27T20:23:31.765 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-27T20:23:31.776 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-27T20:23:31.777 DEBUG:teuthology.orchestra.run.smithi091:> test '!' -e /home/ubuntu/cephtest 2023-11-27T20:23:31.779 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2023-11-27T20:23:31.794 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-27T20:23:31.805 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-27T20:23:31.806 DEBUG:teuthology.orchestra.run.smithi091:> test -z $(ls -A /var/lib/ceph) 2023-11-27T20:23:31.837 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2023-11-27T20:23:31.922 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-27T20:23:31.980 INFO:teuthology.run_tasks:Running task kernel... 2023-11-27T20:23:31.999 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-11-27T20:23:32.000 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-11-27T20:23:32.000 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-27T20:23:32.000 DEBUG:teuthology.orchestra.run.smithi091:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T20:23:32.001 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T20:23:32.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:23:32.016 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-11-27T20:23:32.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:23:32.021 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-11-27T20:23:32.181 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-27T20:23:32.181 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-27T20:23:32.181 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-11-27T20:23:32.183 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-27T20:23:32.184 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-27T20:23:32.184 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-11-27T20:23:32.203 INFO:teuthology.orchestra.run.smithi183.stdout:5.14.0-361.el9.x86_64 2023-11-27T20:23:32.203 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-27T20:23:32.204 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-27T20:23:32.204 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum upgrade -y linux-firmware 2023-11-27T20:23:32.206 INFO:teuthology.orchestra.run.smithi091.stdout:5.14.0-361.el9.x86_64 2023-11-27T20:23:32.206 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-27T20:23:32.206 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-27T20:23:32.207 DEBUG:teuthology.orchestra.run.smithi091:> sudo yum upgrade -y linux-firmware 2023-11-27T20:23:34.479 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS-9 - AppStream 9.7 MB/s | 6.4 MB 00:00 2023-11-27T20:23:34.486 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - AppStream 9.2 MB/s | 6.4 MB 00:00 2023-11-27T20:23:35.845 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2023-11-27T20:23:35.862 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2023-11-27T20:23:36.745 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-11-27T20:23:38.054 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 7.9 MB 00:01 2023-11-27T20:23:39.579 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-11-27T20:23:41.261 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 18 MB 00:02 2023-11-27T20:23:44.820 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 5.8 MB 00:01 2023-11-27T20:23:46.314 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 15 kB 00:00 2023-11-27T20:23:46.487 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 5.8 MB 00:01 2023-11-27T20:23:47.954 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 15 kB 00:00 2023-11-27T20:23:48.580 INFO:teuthology.orchestra.run.smithi091.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 20 MB 00:02 2023-11-27T20:23:52.505 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 20 MB 00:02 2023-11-27T20:23:53.438 INFO:teuthology.orchestra.run.smithi091.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-11-27T20:23:54.996 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2023-11-27T20:23:55.205 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:01 ago on Mon 27 Nov 2023 08:23:54 PM UTC. 2023-11-27T20:23:55.882 INFO:teuthology.orchestra.run.smithi091.stdout:Dependencies resolved. 2023-11-27T20:23:55.892 INFO:teuthology.orchestra.run.smithi091.stdout:================================================================================ 2023-11-27T20:23:55.892 INFO:teuthology.orchestra.run.smithi091.stdout: Package Arch Version Repository Size 2023-11-27T20:23:55.892 INFO:teuthology.orchestra.run.smithi091.stdout:================================================================================ 2023-11-27T20:23:55.892 INFO:teuthology.orchestra.run.smithi091.stdout:Upgrading: 2023-11-27T20:23:55.893 INFO:teuthology.orchestra.run.smithi091.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-27T20:23:55.893 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:23:55.893 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction Summary 2023-11-27T20:23:55.893 INFO:teuthology.orchestra.run.smithi091.stdout:================================================================================ 2023-11-27T20:23:55.893 INFO:teuthology.orchestra.run.smithi091.stdout:Upgrade 1 Package 2023-11-27T20:23:55.893 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:23:55.893 INFO:teuthology.orchestra.run.smithi091.stdout:Total download size: 328 M 2023-11-27T20:23:55.893 INFO:teuthology.orchestra.run.smithi091.stdout:Downloading Packages: 2023-11-27T20:23:57.364 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-11-27T20:23:57.374 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-11-27T20:23:57.374 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-11-27T20:23:57.375 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-11-27T20:23:57.375 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2023-11-27T20:23:57.375 INFO:teuthology.orchestra.run.smithi183.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-27T20:23:57.375 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:23:57.375 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-11-27T20:23:57.376 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-11-27T20:23:57.376 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 1 Package 2023-11-27T20:23:57.376 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:23:57.376 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 328 M 2023-11-27T20:23:57.376 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-11-27T20:24:07.863 INFO:teuthology.orchestra.run.smithi183.stdout:linux-firmware-20231030-141.el9.noarch.rpm 31 MB/s | 328 MB 00:10 2023-11-27T20:24:07.865 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-11-27T20:24:07.865 INFO:teuthology.orchestra.run.smithi183.stdout:Total 31 MB/s | 328 MB 00:10 2023-11-27T20:24:07.865 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-11-27T20:24:07.946 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-11-27T20:24:07.947 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-11-27T20:24:08.871 INFO:teuthology.orchestra.run.smithi091.stdout:linux-firmware-20231030-141.el9.noarch.rpm 25 MB/s | 328 MB 00:12 2023-11-27T20:24:08.872 INFO:teuthology.orchestra.run.smithi091.stdout:-------------------------------------------------------------------------------- 2023-11-27T20:24:08.872 INFO:teuthology.orchestra.run.smithi091.stdout:Total 25 MB/s | 328 MB 00:12 2023-11-27T20:24:08.873 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction check 2023-11-27T20:24:08.971 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction check succeeded. 2023-11-27T20:24:08.972 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction test 2023-11-27T20:24:10.130 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-11-27T20:24:10.131 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-11-27T20:24:11.166 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction test succeeded. 2023-11-27T20:24:11.166 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction 2023-11-27T20:24:16.085 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-11-27T20:24:16.386 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-27T20:24:16.486 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-27T20:24:17.074 INFO:teuthology.orchestra.run.smithi091.stdout: Preparing : 1/1 2023-11-27T20:24:17.343 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-27T20:24:17.417 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-27T20:24:17.448 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-27T20:24:17.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-27T20:24:17.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-27T20:24:17.835 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:24:17.835 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2023-11-27T20:24:17.835 INFO:teuthology.orchestra.run.smithi183.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-27T20:24:17.835 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:24:17.835 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-11-27T20:24:18.105 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-27T20:24:18.106 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-27T20:24:18.292 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-27T20:24:18.292 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-27T20:24:18.521 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-27T20:24:18.521 DEBUG:teuthology.orchestra.run.smithi183:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-27T20:24:18.523 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi183.front.sepia.ceph.com to complete... 2023-11-27T20:24:18.678 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-27T20:24:18.678 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:24:18.678 INFO:teuthology.orchestra.run.smithi091.stdout:Upgraded: 2023-11-27T20:24:18.678 INFO:teuthology.orchestra.run.smithi091.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-27T20:24:18.678 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:24:18.678 INFO:teuthology.orchestra.run.smithi091.stdout:Complete! 2023-11-27T20:24:18.966 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-27T20:24:18.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-27T20:24:19.366 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-27T20:24:19.366 DEBUG:teuthology.orchestra.run.smithi091:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-27T20:24:19.369 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi091.front.sepia.ceph.com to complete... 2023-11-27T20:24:31.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27 20:24:31 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-27T20:24:31.101 INFO:teuthology.orchestra.run.smithi091.stderr:FINISHED --2023-11-27 20:24:31-- 2023-11-27T20:24:31.101 INFO:teuthology.orchestra.run.smithi091.stderr:Total wall clock time: 12s 2023-11-27T20:24:31.101 INFO:teuthology.orchestra.run.smithi091.stderr:Downloaded: 1 files, 306M in 11s (26.8 MB/s) 2023-11-27T20:24:31.103 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-27T20:24:31.103 DEBUG:teuthology.orchestra.run.smithi091:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-27T20:24:32.951 INFO:teuthology.orchestra.run.smithi091.stdout:Verifying... ######################################## 2023-11-27T20:24:33.058 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing... ######################################## 2023-11-27T20:24:33.137 INFO:teuthology.orchestra.run.smithi091.stdout:Updating / installing... 2023-11-27T20:24:40.191 INFO:teuthology.orchestra.run.smithi091.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-27T20:24:55.396 INFO:teuthology.orchestra.run.smithi091.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-27T20:25:04.710 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27 20:25:04 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-27T20:25:04.711 INFO:teuthology.orchestra.run.smithi183.stderr:FINISHED --2023-11-27 20:25:04-- 2023-11-27T20:25:04.711 INFO:teuthology.orchestra.run.smithi183.stderr:Total wall clock time: 46s 2023-11-27T20:25:04.711 INFO:teuthology.orchestra.run.smithi183.stderr:Downloaded: 1 files, 306M in 46s (6.70 MB/s) 2023-11-27T20:25:04.712 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-27T20:25:04.712 DEBUG:teuthology.orchestra.run.smithi183:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-27T20:25:06.546 INFO:teuthology.orchestra.run.smithi183.stdout:Verifying... ######################################## 2023-11-27T20:25:06.635 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing... ######################################## 2023-11-27T20:25:06.714 INFO:teuthology.orchestra.run.smithi183.stdout:Updating / installing... 2023-11-27T20:25:13.812 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-27T20:25:16.591 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi091.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-27T20:25:16.591 DEBUG:teuthology.orchestra.run.smithi091:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-27T20:25:16.655 INFO:teuthology.orchestra.run.smithi091.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-27T20:25:16.655 INFO:teuthology.orchestra.run.smithi091.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-27T20:25:16.655 INFO:teuthology.orchestra.run.smithi091.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-27T20:25:16.655 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-27T20:25:16.656 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-27T20:25:16.657 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-27T20:25:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-27T20:25:16.659 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-27T20:25:16.660 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-27T20:25:16.661 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-27T20:25:16.662 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-27T20:25:16.663 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-27T20:25:16.664 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-27T20:25:16.665 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-27T20:25:16.666 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-27T20:25:16.667 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-27T20:25:16.668 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-27T20:25:16.669 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-27T20:25:16.670 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-27T20:25:16.671 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-27T20:25:16.672 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-27T20:25:16.673 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-27T20:25:16.674 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-27T20:25:16.675 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-27T20:25:16.676 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-27T20:25:16.677 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-27T20:25:16.678 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-27T20:25:16.679 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-27T20:25:16.680 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-27T20:25:16.681 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-27T20:25:16.682 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-27T20:25:16.683 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-27T20:25:16.684 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-27T20:25:16.685 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-27T20:25:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-27T20:25:16.687 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-27T20:25:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-27T20:25:16.689 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-27T20:25:16.690 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-27T20:25:16.691 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-27T20:25:16.692 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-27T20:25:16.693 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-27T20:25:16.694 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-27T20:25:16.695 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-27T20:25:16.696 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-27T20:25:16.697 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-27T20:25:16.698 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-27T20:25:16.699 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-27T20:25:16.700 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-27T20:25:16.701 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-27T20:25:16.702 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-27T20:25:16.703 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-27T20:25:16.704 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-27T20:25:16.705 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-27T20:25:16.706 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-27T20:25:16.707 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-27T20:25:16.708 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-27T20:25:16.709 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-27T20:25:16.710 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-27T20:25:16.711 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-27T20:25:16.712 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-27T20:25:16.713 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-27T20:25:16.714 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-27T20:25:16.715 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-27T20:25:16.716 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-27T20:25:16.717 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-27T20:25:16.718 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-27T20:25:16.719 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-27T20:25:16.720 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-27T20:25:16.721 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-27T20:25:16.722 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-27T20:25:16.723 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-27T20:25:16.724 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-27T20:25:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-27T20:25:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-27T20:25:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-27T20:25:16.728 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-27T20:25:16.729 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-27T20:25:16.730 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-27T20:25:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-27T20:25:16.732 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-27T20:25:16.733 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-27T20:25:16.734 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-27T20:25:16.735 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-27T20:25:16.736 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-27T20:25:16.737 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-27T20:25:16.738 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-27T20:25:16.739 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-27T20:25:16.740 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-27T20:25:16.741 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-27T20:25:16.742 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-27T20:25:16.743 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-27T20:25:16.744 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-27T20:25:16.745 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-27T20:25:16.746 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-27T20:25:16.747 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-27T20:25:16.748 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-27T20:25:16.749 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-27T20:25:16.750 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-27T20:25:16.751 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-27T20:25:16.752 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-27T20:25:16.753 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-27T20:25:16.754 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-27T20:25:16.755 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-27T20:25:16.756 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-27T20:25:16.757 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-27T20:25:16.758 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-27T20:25:16.759 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-27T20:25:16.760 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-27T20:25:16.761 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-27T20:25:16.762 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-27T20:25:16.763 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-27T20:25:16.764 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-27T20:25:16.765 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-27T20:25:16.766 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-27T20:25:16.767 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-27T20:25:16.768 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-27T20:25:16.769 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-27T20:25:16.770 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-27T20:25:16.771 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-27T20:25:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-27T20:25:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-27T20:25:16.774 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-27T20:25:16.775 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-27T20:25:16.776 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-27T20:25:16.777 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-27T20:25:16.778 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-27T20:25:16.779 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-27T20:25:16.780 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-27T20:25:16.781 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-27T20:25:16.782 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-27T20:25:16.783 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-27T20:25:16.784 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-27T20:25:16.785 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-27T20:25:16.786 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-27T20:25:16.787 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-27T20:25:16.788 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-27T20:25:16.789 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-27T20:25:16.790 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-27T20:25:16.791 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-27T20:25:16.792 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-27T20:25:16.793 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-27T20:25:16.794 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-27T20:25:16.795 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-27T20:25:16.796 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-27T20:25:16.797 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-27T20:25:16.798 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-27T20:25:16.799 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-27T20:25:16.800 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-27T20:25:16.801 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-27T20:25:16.802 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-27T20:25:16.803 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-27T20:25:16.804 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-27T20:25:16.805 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-27T20:25:16.806 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-27T20:25:16.807 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-27T20:25:16.808 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-27T20:25:16.809 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-27T20:25:16.810 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-27T20:25:16.811 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-27T20:25:16.812 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-27T20:25:16.812 INFO:teuthology.orchestra.run.smithi091.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-27T20:25:16.812 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-27T20:25:16.812 DEBUG:teuthology.orchestra.run.smithi091:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-27T20:25:16.834 INFO:teuthology.orchestra.run.smithi091.stdout:postinstall scriptlet (using /bin/sh): 2023-11-27T20:25:16.834 INFO:teuthology.orchestra.run.smithi091.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-27T20:25:16.834 INFO:teuthology.orchestra.run.smithi091.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-27T20:25:16.834 INFO:teuthology.orchestra.run.smithi091.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-27T20:25:16.834 INFO:teuthology.orchestra.run.smithi091.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:fi 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:fi 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-27T20:25:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-27T20:25:16.836 INFO:teuthology.orchestra.run.smithi091.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-27T20:25:16.836 INFO:teuthology.orchestra.run.smithi091.stdout:fi 2023-11-27T20:25:16.837 DEBUG:teuthology.orchestra.run.smithi091:> sudo rpm -qi grub2-tools 2023-11-27T20:25:16.912 INFO:teuthology.orchestra.run.smithi091.stdout:Name : grub2-tools 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Epoch : 1 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Version : 2.06 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Release : 68.el9 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Architecture: x86_64 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Group : Unspecified 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Size : 8264254 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:License : GPLv3+ 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-27T20:25:16.913 INFO:teuthology.orchestra.run.smithi091.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:Packager : builder@centos.org 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:Vendor : CentOS 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:Summary : Support tools for GRUB. 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:Description : 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:hardware devices. 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:25:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:This subpackage provides tools for support of all platforms. 2023-11-27T20:25:16.915 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-27T20:25:16.915 INFO:teuthology.task.kernel:Updating grub on smithi091 to boot 6.6.0-g8247bbb5b470 2023-11-27T20:25:16.916 DEBUG:teuthology.orchestra.run.smithi091:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-27T20:25:17.472 INFO:teuthology.orchestra.run.smithi091.stderr:Generating grub configuration file ... 2023-11-27T20:25:18.946 INFO:teuthology.orchestra.run.smithi091.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-27T20:25:18.993 INFO:teuthology.orchestra.run.smithi091.stderr:done 2023-11-27T20:25:18.995 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-27T20:25:19.009 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.b1tVHmVIYN 2023-11-27T20:25:19.009 DEBUG:teuthology.orchestra.run.smithi091:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.b1tVHmVIYN 2023-11-27T20:25:19.079 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.b1tVHmVIYN 2023-11-27T20:25:19.221 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.b1tVHmVIYN is 6KB 2023-11-27T20:25:19.269 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.b1tVHmVIYN 2023-11-27T20:25:19.284 DEBUG:teuthology.orchestra.run.smithi091:> sudo /bin/ls /boot/loader/entries || true 2023-11-27T20:25:19.352 INFO:teuthology.orchestra.run.smithi091.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-27T20:25:19.352 INFO:teuthology.orchestra.run.smithi091.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-27T20:25:19.352 INFO:teuthology.orchestra.run.smithi091.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-27T20:25:19.352 INFO:teuthology.orchestra.run.smithi091.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-27T20:25:19.353 DEBUG:teuthology.orchestra.run.smithi091:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-27T20:25:19.512 DEBUG:teuthology.orchestra.run.smithi091:> sudo shutdown -r now 2023-11-27T20:25:27.715 INFO:teuthology.orchestra.run.smithi183.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-27T20:25:49.066 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi183.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-27T20:25:49.066 DEBUG:teuthology.orchestra.run.smithi183:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-27T20:25:49.150 INFO:teuthology.orchestra.run.smithi183.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-27T20:25:49.150 INFO:teuthology.orchestra.run.smithi183.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-27T20:25:49.150 INFO:teuthology.orchestra.run.smithi183.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-27T20:25:49.150 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-27T20:25:49.150 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-27T20:25:49.150 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-27T20:25:49.150 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-27T20:25:49.150 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-27T20:25:49.150 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-27T20:25:49.151 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-27T20:25:49.152 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-27T20:25:49.153 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-27T20:25:49.154 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-27T20:25:49.155 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-27T20:25:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-27T20:25:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-27T20:25:49.158 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-27T20:25:49.159 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-27T20:25:49.160 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-27T20:25:49.161 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-27T20:25:49.162 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-27T20:25:49.163 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-27T20:25:49.163 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-27T20:25:49.163 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-27T20:25:49.163 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-27T20:25:49.163 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-27T20:25:49.163 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-27T20:25:49.163 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-27T20:25:49.163 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-27T20:25:49.164 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-27T20:25:49.164 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-27T20:25:49.164 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-27T20:25:49.164 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-27T20:25:49.164 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-27T20:25:49.164 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-27T20:25:49.164 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-27T20:25:49.165 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-27T20:25:49.165 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-27T20:25:49.165 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-27T20:25:49.165 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-27T20:25:49.165 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-27T20:25:49.165 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-27T20:25:49.165 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-27T20:25:49.166 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-27T20:25:49.166 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-27T20:25:49.166 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-27T20:25:49.166 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-27T20:25:49.166 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-27T20:25:49.167 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-27T20:25:49.167 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-27T20:25:49.167 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-27T20:25:49.167 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-27T20:25:49.167 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-27T20:25:49.167 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-27T20:25:49.167 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-27T20:25:49.168 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-27T20:25:49.168 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-27T20:25:49.168 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-27T20:25:49.168 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-27T20:25:49.168 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-27T20:25:49.168 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-27T20:25:49.169 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-27T20:25:49.169 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-27T20:25:49.169 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-27T20:25:49.169 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-27T20:25:49.169 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-27T20:25:49.169 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-27T20:25:49.169 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-27T20:25:49.170 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-27T20:25:49.170 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-27T20:25:49.170 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-27T20:25:49.170 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-27T20:25:49.170 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-27T20:25:49.170 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-27T20:25:49.171 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-27T20:25:49.171 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-27T20:25:49.171 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-27T20:25:49.171 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-27T20:25:49.171 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-27T20:25:49.171 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-27T20:25:49.172 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-27T20:25:49.172 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-27T20:25:49.172 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-27T20:25:49.172 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-27T20:25:49.172 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-27T20:25:49.172 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-27T20:25:49.173 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-27T20:25:49.174 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-27T20:25:49.174 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-27T20:25:49.174 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-27T20:25:49.174 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-27T20:25:49.174 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-27T20:25:49.174 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-27T20:25:49.174 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-27T20:25:49.174 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-27T20:25:49.174 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-27T20:25:49.174 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-27T20:25:49.175 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-27T20:25:49.176 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-27T20:25:49.177 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-27T20:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-27T20:25:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-27T20:25:49.180 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-27T20:25:49.181 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-27T20:25:49.182 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-27T20:25:49.183 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-27T20:25:49.184 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-27T20:25:49.185 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-27T20:25:49.185 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-27T20:25:49.185 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-27T20:25:49.185 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-27T20:25:49.185 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-27T20:25:49.185 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-27T20:25:49.185 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-27T20:25:49.185 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-27T20:25:49.186 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-27T20:25:49.186 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-27T20:25:49.186 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-27T20:25:49.186 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-27T20:25:49.186 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-27T20:25:49.186 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-27T20:25:49.186 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-27T20:25:49.187 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-27T20:25:49.187 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-27T20:25:49.187 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-27T20:25:49.187 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-27T20:25:49.187 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-27T20:25:49.187 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-27T20:25:49.187 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-27T20:25:49.188 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-27T20:25:49.188 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-27T20:25:49.188 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-27T20:25:49.188 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-27T20:25:49.188 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-27T20:25:49.188 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-27T20:25:49.189 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-27T20:25:49.189 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-27T20:25:49.189 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-27T20:25:49.189 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-27T20:25:49.189 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-27T20:25:49.189 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-27T20:25:49.189 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-27T20:25:49.190 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-27T20:25:49.190 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-27T20:25:49.190 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-27T20:25:49.190 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-27T20:25:49.190 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-27T20:25:49.190 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-27T20:25:49.190 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-27T20:25:49.190 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-27T20:25:49.191 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-27T20:25:49.191 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-27T20:25:49.191 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-27T20:25:49.191 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-27T20:25:49.191 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-27T20:25:49.191 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-27T20:25:49.191 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-27T20:25:49.191 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-27T20:25:49.192 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-27T20:25:49.192 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-27T20:25:49.192 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-27T20:25:49.192 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-27T20:25:49.192 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-27T20:25:49.192 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-27T20:25:49.192 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-27T20:25:49.192 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-27T20:25:49.192 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-27T20:25:49.192 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-27T20:25:49.193 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-27T20:25:49.194 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-27T20:25:49.195 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-27T20:25:49.195 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-27T20:25:49.195 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-27T20:25:49.195 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-27T20:25:49.195 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-27T20:25:49.195 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-27T20:25:49.195 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-27T20:25:49.196 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-27T20:25:49.196 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-27T20:25:49.196 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-27T20:25:49.196 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-27T20:25:49.196 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-27T20:25:49.196 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-27T20:25:49.197 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-27T20:25:49.197 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-27T20:25:49.197 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-27T20:25:49.197 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-27T20:25:49.197 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-27T20:25:49.198 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-27T20:25:49.198 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-27T20:25:49.198 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-27T20:25:49.198 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-27T20:25:49.198 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-27T20:25:49.198 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-27T20:25:49.199 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-27T20:25:49.199 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-27T20:25:49.199 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-27T20:25:49.199 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-27T20:25:49.199 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-27T20:25:49.200 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-27T20:25:49.200 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-27T20:25:49.200 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-27T20:25:49.200 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-27T20:25:49.200 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-27T20:25:49.200 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-27T20:25:49.201 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-27T20:25:49.201 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-27T20:25:49.201 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-27T20:25:49.201 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-27T20:25:49.201 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-27T20:25:49.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-27T20:25:49.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-27T20:25:49.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-27T20:25:49.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-27T20:25:49.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-27T20:25:49.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-27T20:25:49.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-27T20:25:49.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-27T20:25:49.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-27T20:25:49.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-27T20:25:49.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-27T20:25:49.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-27T20:25:49.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-27T20:25:49.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-27T20:25:49.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-27T20:25:49.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-27T20:25:49.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-27T20:25:49.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-27T20:25:49.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-27T20:25:49.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-27T20:25:49.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-27T20:25:49.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-27T20:25:49.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-27T20:25:49.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-27T20:25:49.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-27T20:25:49.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-27T20:25:49.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-27T20:25:49.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-27T20:25:49.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-27T20:25:49.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-27T20:25:49.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-27T20:25:49.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-27T20:25:49.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-27T20:25:49.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-27T20:25:49.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-27T20:25:49.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-27T20:25:49.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-27T20:25:49.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-27T20:25:49.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-27T20:25:49.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-27T20:25:49.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-27T20:25:49.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-27T20:25:49.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-27T20:25:49.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-27T20:25:49.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-27T20:25:49.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-27T20:25:49.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-27T20:25:49.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-27T20:25:49.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-27T20:25:49.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-27T20:25:49.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-27T20:25:49.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-27T20:25:49.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-27T20:25:49.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-27T20:25:49.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-27T20:25:49.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-27T20:25:49.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-27T20:25:49.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-27T20:25:49.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-27T20:25:49.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-27T20:25:49.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-27T20:25:49.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-27T20:25:49.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-27T20:25:49.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-27T20:25:49.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-27T20:25:49.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-27T20:25:49.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-27T20:25:49.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-27T20:25:49.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-27T20:25:49.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-27T20:25:49.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-27T20:25:49.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-27T20:25:49.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-27T20:25:49.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-27T20:25:49.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-27T20:25:49.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-27T20:25:49.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-27T20:25:49.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-27T20:25:49.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-27T20:25:49.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-27T20:25:49.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-27T20:25:49.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-27T20:25:49.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-27T20:25:49.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-27T20:25:49.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-27T20:25:49.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-27T20:25:49.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-27T20:25:49.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-27T20:25:49.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-27T20:25:49.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-27T20:25:49.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-27T20:25:49.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-27T20:25:49.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-27T20:25:49.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-27T20:25:49.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-27T20:25:49.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-27T20:25:49.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-27T20:25:49.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-27T20:25:49.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-27T20:25:49.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-27T20:25:49.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-27T20:25:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-27T20:25:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-27T20:25:49.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-27T20:25:49.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-27T20:25:49.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-27T20:25:49.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-27T20:25:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-27T20:25:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-27T20:25:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-27T20:25:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-27T20:25:49.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-27T20:25:49.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-27T20:25:49.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-27T20:25:49.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-27T20:25:49.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-27T20:25:49.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-27T20:25:49.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-27T20:25:49.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-27T20:25:49.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-27T20:25:49.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-27T20:25:49.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-27T20:25:49.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-27T20:25:49.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-27T20:25:49.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-27T20:25:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-27T20:25:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-27T20:25:49.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-27T20:25:49.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-27T20:25:49.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-27T20:25:49.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-27T20:25:49.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-27T20:25:49.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-27T20:25:49.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-27T20:25:49.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-27T20:25:49.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-27T20:25:49.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-27T20:25:49.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-27T20:25:49.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-27T20:25:49.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-27T20:25:49.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-27T20:25:49.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-27T20:25:49.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-27T20:25:49.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-27T20:25:49.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-27T20:25:49.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-27T20:25:49.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-27T20:25:49.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-27T20:25:49.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-27T20:25:49.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-27T20:25:49.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-27T20:25:49.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-27T20:25:49.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-27T20:25:49.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-27T20:25:49.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-27T20:25:49.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-27T20:25:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-27T20:25:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-27T20:25:49.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-27T20:25:49.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-27T20:25:49.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-27T20:25:49.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-27T20:25:49.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-27T20:25:49.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-27T20:25:49.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-27T20:25:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-27T20:25:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-27T20:25:49.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-27T20:25:49.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-27T20:25:49.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-27T20:25:49.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-27T20:25:49.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-27T20:25:49.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-27T20:25:49.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-27T20:25:49.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-27T20:25:49.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-27T20:25:49.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-27T20:25:49.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-27T20:25:49.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-27T20:25:49.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-27T20:25:49.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-27T20:25:49.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-27T20:25:49.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-27T20:25:49.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-27T20:25:49.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-27T20:25:49.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-27T20:25:49.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-27T20:25:49.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-27T20:25:49.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-27T20:25:49.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-27T20:25:49.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-27T20:25:49.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-27T20:25:49.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-27T20:25:49.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-27T20:25:49.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-27T20:25:49.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-27T20:25:49.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-27T20:25:49.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-27T20:25:49.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-27T20:25:49.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-27T20:25:49.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-27T20:25:49.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-27T20:25:49.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-27T20:25:49.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-27T20:25:49.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-27T20:25:49.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-27T20:25:49.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-27T20:25:49.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-27T20:25:49.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-27T20:25:49.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-27T20:25:49.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-27T20:25:49.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-27T20:25:49.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-27T20:25:49.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-27T20:25:49.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-27T20:25:49.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-27T20:25:49.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-27T20:25:49.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-27T20:25:49.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-27T20:25:49.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-27T20:25:49.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-27T20:25:49.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-27T20:25:49.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-27T20:25:49.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-27T20:25:49.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-27T20:25:49.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-27T20:25:49.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-27T20:25:49.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-27T20:25:49.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-27T20:25:49.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-27T20:25:49.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-27T20:25:49.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-27T20:25:49.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-27T20:25:49.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-27T20:25:49.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-27T20:25:49.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-27T20:25:49.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-27T20:25:49.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-27T20:25:49.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-27T20:25:49.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-27T20:25:49.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-27T20:25:49.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-27T20:25:49.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-27T20:25:49.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-27T20:25:49.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-27T20:25:49.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-27T20:25:49.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-27T20:25:49.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-27T20:25:49.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-27T20:25:49.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-27T20:25:49.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-27T20:25:49.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-27T20:25:49.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-27T20:25:49.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-27T20:25:49.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-27T20:25:49.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-27T20:25:49.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-27T20:25:49.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-27T20:25:49.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-27T20:25:49.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-27T20:25:49.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-27T20:25:49.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-27T20:25:49.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-27T20:25:49.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-27T20:25:49.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-27T20:25:49.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-27T20:25:49.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-27T20:25:49.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-27T20:25:49.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-27T20:25:49.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-27T20:25:49.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-27T20:25:49.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-27T20:25:49.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-27T20:25:49.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-27T20:25:49.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-27T20:25:49.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-27T20:25:49.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-27T20:25:49.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-27T20:25:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-27T20:25:49.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-27T20:25:49.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-27T20:25:49.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-27T20:25:49.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-27T20:25:49.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-27T20:25:49.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-27T20:25:49.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-27T20:25:49.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-27T20:25:49.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-27T20:25:49.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-27T20:25:49.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-27T20:25:49.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-27T20:25:49.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-27T20:25:49.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-27T20:25:49.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-27T20:25:49.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-27T20:25:49.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-27T20:25:49.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-27T20:25:49.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-27T20:25:49.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-27T20:25:49.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-27T20:25:49.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-27T20:25:49.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-27T20:25:49.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-27T20:25:49.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-27T20:25:49.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-27T20:25:49.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-27T20:25:49.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-27T20:25:49.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-27T20:25:49.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-27T20:25:49.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-27T20:25:49.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-27T20:25:49.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-27T20:25:49.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-27T20:25:49.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-27T20:25:49.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-27T20:25:49.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-27T20:25:49.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-27T20:25:49.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-27T20:25:49.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-27T20:25:49.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-27T20:25:49.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-27T20:25:49.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-27T20:25:49.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-27T20:25:49.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-27T20:25:49.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-27T20:25:49.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-27T20:25:49.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-27T20:25:49.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-27T20:25:49.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-27T20:25:49.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-27T20:25:49.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-27T20:25:49.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-27T20:25:49.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-27T20:25:49.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-27T20:25:49.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-27T20:25:49.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-27T20:25:49.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-27T20:25:49.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-27T20:25:49.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-27T20:25:49.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-27T20:25:49.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-27T20:25:49.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-27T20:25:49.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-27T20:25:49.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-27T20:25:49.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-27T20:25:49.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-27T20:25:49.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-27T20:25:49.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-27T20:25:49.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-27T20:25:49.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-27T20:25:49.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-27T20:25:49.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-27T20:25:49.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-27T20:25:49.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-27T20:25:49.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-27T20:25:49.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-27T20:25:49.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-27T20:25:49.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-27T20:25:49.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-27T20:25:49.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-27T20:25:49.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-27T20:25:49.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-27T20:25:49.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-27T20:25:49.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-27T20:25:49.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-27T20:25:49.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-27T20:25:49.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-27T20:25:49.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-27T20:25:49.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-27T20:25:49.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-27T20:25:49.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-27T20:25:49.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-27T20:25:49.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-27T20:25:49.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-27T20:25:49.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-27T20:25:49.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-27T20:25:49.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-27T20:25:49.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-27T20:25:49.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-27T20:25:49.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-27T20:25:49.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-27T20:25:49.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-27T20:25:49.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-27T20:25:49.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-27T20:25:49.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-27T20:25:49.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-27T20:25:49.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-27T20:25:49.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-27T20:25:49.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-27T20:25:49.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-27T20:25:49.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-27T20:25:49.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-27T20:25:49.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-27T20:25:49.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-27T20:25:49.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-27T20:25:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-27T20:25:49.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-27T20:25:49.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-27T20:25:49.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-27T20:25:49.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-27T20:25:49.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-27T20:25:49.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-27T20:25:49.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-27T20:25:49.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-27T20:25:49.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-27T20:25:49.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-27T20:25:49.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-27T20:25:49.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-27T20:25:49.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-27T20:25:49.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-27T20:25:49.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-27T20:25:49.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-27T20:25:49.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-27T20:25:49.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-27T20:25:49.337 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-27T20:25:49.337 DEBUG:teuthology.orchestra.run.smithi183:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-27T20:25:49.360 INFO:teuthology.orchestra.run.smithi183.stdout:postinstall scriptlet (using /bin/sh): 2023-11-27T20:25:49.360 INFO:teuthology.orchestra.run.smithi183.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-27T20:25:49.360 INFO:teuthology.orchestra.run.smithi183.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-27T20:25:49.360 INFO:teuthology.orchestra.run.smithi183.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-27T20:25:49.361 INFO:teuthology.orchestra.run.smithi183.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-27T20:25:49.361 INFO:teuthology.orchestra.run.smithi183.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-27T20:25:49.361 INFO:teuthology.orchestra.run.smithi183.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-27T20:25:49.361 INFO:teuthology.orchestra.run.smithi183.stdout:fi 2023-11-27T20:25:49.361 INFO:teuthology.orchestra.run.smithi183.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-27T20:25:49.361 INFO:teuthology.orchestra.run.smithi183.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-27T20:25:49.361 INFO:teuthology.orchestra.run.smithi183.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-27T20:25:49.362 INFO:teuthology.orchestra.run.smithi183.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-27T20:25:49.362 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-27T20:25:49.362 INFO:teuthology.orchestra.run.smithi183.stdout:fi 2023-11-27T20:25:49.362 INFO:teuthology.orchestra.run.smithi183.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-27T20:25:49.362 INFO:teuthology.orchestra.run.smithi183.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-27T20:25:49.362 INFO:teuthology.orchestra.run.smithi183.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-27T20:25:49.362 INFO:teuthology.orchestra.run.smithi183.stdout:fi 2023-11-27T20:25:49.363 DEBUG:teuthology.orchestra.run.smithi183:> sudo rpm -qi grub2-tools 2023-11-27T20:25:49.441 INFO:teuthology.orchestra.run.smithi183.stdout:Name : grub2-tools 2023-11-27T20:25:49.441 INFO:teuthology.orchestra.run.smithi183.stdout:Epoch : 1 2023-11-27T20:25:49.441 INFO:teuthology.orchestra.run.smithi183.stdout:Version : 2.06 2023-11-27T20:25:49.441 INFO:teuthology.orchestra.run.smithi183.stdout:Release : 68.el9 2023-11-27T20:25:49.441 INFO:teuthology.orchestra.run.smithi183.stdout:Architecture: x86_64 2023-11-27T20:25:49.441 INFO:teuthology.orchestra.run.smithi183.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-27T20:25:49.441 INFO:teuthology.orchestra.run.smithi183.stdout:Group : Unspecified 2023-11-27T20:25:49.441 INFO:teuthology.orchestra.run.smithi183.stdout:Size : 8264254 2023-11-27T20:25:49.441 INFO:teuthology.orchestra.run.smithi183.stdout:License : GPLv3+ 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:Packager : builder@centos.org 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:Vendor : CentOS 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:Summary : Support tools for GRUB. 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:Description : 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-27T20:25:49.442 INFO:teuthology.orchestra.run.smithi183.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-27T20:25:49.443 INFO:teuthology.orchestra.run.smithi183.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-27T20:25:49.443 INFO:teuthology.orchestra.run.smithi183.stdout:hardware devices. 2023-11-27T20:25:49.443 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:25:49.443 INFO:teuthology.orchestra.run.smithi183.stdout:This subpackage provides tools for support of all platforms. 2023-11-27T20:25:49.444 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-27T20:25:49.444 INFO:teuthology.task.kernel:Updating grub on smithi183 to boot 6.6.0-g8247bbb5b470 2023-11-27T20:25:49.444 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-27T20:25:49.515 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-27T20:25:49.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T20:25:49.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:25:50.152 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2023-11-27T20:25:51.521 INFO:teuthology.orchestra.run.smithi183.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-27T20:25:51.553 INFO:teuthology.orchestra.run.smithi183.stderr:done 2023-11-27T20:25:51.556 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-11-27T20:25:51.570 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.3v0L8MaRnt 2023-11-27T20:25:51.571 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3v0L8MaRnt 2023-11-27T20:25:51.653 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.3v0L8MaRnt 2023-11-27T20:25:51.805 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.3v0L8MaRnt is 6KB 2023-11-27T20:25:51.853 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.3v0L8MaRnt 2023-11-27T20:25:51.868 DEBUG:teuthology.orchestra.run.smithi183:> sudo /bin/ls /boot/loader/entries || true 2023-11-27T20:25:51.933 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-27T20:25:51.933 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-27T20:25:51.933 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-27T20:25:51.933 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-27T20:25:51.934 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-27T20:25:52.085 DEBUG:teuthology.orchestra.run.smithi183:> sudo shutdown -r now 2023-11-27T20:26:07.842 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-11-27T20:26:16.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T20:26:16.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:26:19.906 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-11-27T20:26:22.090 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-27T20:26:22.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-27T20:26:22.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:26:31.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T20:26:31.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:26:40.610 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-11-27T20:26:49.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-27T20:26:49.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:26:52.678 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-11-27T20:27:03.878 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-11-27T20:27:04.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T20:27:04.504 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-27T20:27:04.504 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-11-27T20:27:04.544 INFO:teuthology.orchestra.run.smithi091.stdout:6.6.0-g8247bbb5b470 2023-11-27T20:27:04.544 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-27T20:27:04.544 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-27T20:27:04.545 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-27T20:27:04.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-27T20:27:04.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:27:05.546 DEBUG:teuthology.parallel:result is None 2023-11-27T20:28:04.682 DEBUG:teuthology.orchestra.remote:timed out 2023-11-27T20:28:19.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-27T20:28:19.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:28:20.085 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-11-27T20:28:20.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-27T20:28:20.821 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-27T20:28:20.822 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-11-27T20:28:20.874 INFO:teuthology.orchestra.run.smithi183.stdout:6.6.0-g8247bbb5b470 2023-11-27T20:28:20.874 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-27T20:28:20.874 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-27T20:28:20.874 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-27T20:28:21.876 DEBUG:teuthology.parallel:result is None 2023-11-27T20:28:21.876 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-27T20:28:21.883 INFO:teuthology.task.internal:Creating test directory... 2023-11-27T20:28:21.884 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T20:28:21.894 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T20:28:21.952 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-27T20:28:21.961 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-27T20:28:21.969 INFO:teuthology.task.internal:Creating archive directory... 2023-11-27T20:28:21.969 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T20:28:21.974 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T20:28:22.054 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-27T20:28:22.061 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-27T20:28:22.061 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T20:28:22.070 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T20:28:22.206 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T20:28:22.230 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T20:28:22.281 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T20:28:22.290 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T20:28:22.294 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-27T20:28:22.302 INFO:teuthology.task.internal:Configuring sudo... 2023-11-27T20:28:22.303 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T20:28:22.309 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T20:28:22.404 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-27T20:28:22.415 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-27T20:28:22.416 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T20:28:22.424 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T20:28:22.478 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T20:28:22.564 DEBUG:teuthology.orchestra.run.smithi091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T20:28:22.667 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T20:28:22.750 DEBUG:teuthology.orchestra.run.smithi091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T20:28:22.853 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:28:22.853 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T20:28:22.954 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T20:28:23.046 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T20:28:23.168 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T20:28:23.261 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T20:28:23.363 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:28:23.363 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T20:28:23.451 DEBUG:teuthology.orchestra.run.smithi091:> sudo service rsyslog restart 2023-11-27T20:28:23.460 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2023-11-27T20:28:23.586 INFO:teuthology.orchestra.run.smithi091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T20:28:23.618 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T20:28:24.121 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-27T20:28:24.129 INFO:teuthology.task.internal:Starting timer... 2023-11-27T20:28:24.129 INFO:teuthology.run_tasks:Running task pcp... 2023-11-27T20:28:24.140 INFO:teuthology.run_tasks:Running task selinux... 2023-11-27T20:28:24.148 DEBUG:teuthology.orchestra.run.smithi091:> sudo service auditd rotate 2023-11-27T20:28:24.288 INFO:teuthology.orchestra.run.smithi091.stdout:Rotating logs: 2023-11-27T20:28:24.293 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2023-11-27T20:28:24.433 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2023-11-27T20:28:24.438 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-27T20:28:24.439 DEBUG:teuthology.orchestra.run.smithi091:> /usr/sbin/getenforce 2023-11-27T20:28:24.530 INFO:teuthology.orchestra.run.smithi091.stdout:Permissive 2023-11-27T20:28:24.531 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2023-11-27T20:28:24.597 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2023-11-27T20:28:24.597 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi091.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2023-11-27T20:28:24.598 DEBUG:teuthology.orchestra.run.smithi091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T20:28:24.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:28:24.695 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T20:28:24.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:28:24.795 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-27T20:28:24.796 DEBUG:teuthology.orchestra.run.smithi091:> sudo /usr/sbin/setenforce permissive 2023-11-27T20:28:24.927 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2023-11-27T20:28:25.044 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-27T20:28:25.054 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-27T20:28:25.054 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-27T20:28:25.070 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-27T20:28:25.071 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi091.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-27T20:38:16.526 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi091.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2023-11-27T20:38:16.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T20:38:16.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:38:16.663 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-11-27T20:38:16.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-27T20:38:16.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-27T20:38:16.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T20:38:16.956 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-11-27T20:38:17.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-27T20:38:17.109 INFO:teuthology.run_tasks:Running task clock... 2023-11-27T20:38:17.120 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-27T20:38:17.121 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T20:38:17.121 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T20:38:17.130 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T20:38:17.130 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T20:38:17.229 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-27T20:38:17.235 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-27T20:38:17.281 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-27T20:38:17.289 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-27T20:38:17.373 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: ntpd: command not found 2023-11-27T20:38:17.381 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2023-11-27T20:38:17.412 INFO:teuthology.orchestra.run.smithi091.stdout:506 Cannot talk to daemon 2023-11-27T20:38:17.422 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2023-11-27T20:38:17.462 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-27T20:38:17.469 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-27T20:38:17.515 INFO:teuthology.orchestra.run.smithi091.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-27T20:38:17.520 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-27T20:38:17.638 INFO:teuthology.orchestra.run.smithi091.stderr:bash: line 1: ntpq: command not found 2023-11-27T20:38:17.642 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2023-11-27T20:38:17.647 INFO:teuthology.orchestra.run.smithi091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T20:38:17.647 INFO:teuthology.orchestra.run.smithi091.stdout:=============================================================================== 2023-11-27T20:38:17.647 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:38:17.647 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:38:17.647 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:38:17.647 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:38:17.651 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T20:38:17.651 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-11-27T20:38:17.651 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:38:17.651 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:38:17.651 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:38:17.651 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:38:17.652 INFO:teuthology.run_tasks:Running task install... 2023-11-27T20:38:17.661 DEBUG:teuthology.task.install:project ceph 2023-11-27T20:38:17.661 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}} 2023-11-27T20:38:17.661 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'} 2023-11-27T20:38:17.661 INFO:teuthology.task.install:Using flavor: default 2023-11-27T20:38:17.667 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-27T20:38:17.668 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-27T20:38:17.668 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'tag': None, 'wait_for_package': False} 2023-11-27T20:38:17.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:38:17.670 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'tag': None, 'wait_for_package': False} 2023-11-27T20:38:17.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:38:17.812 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/ 2023-11-27T20:38:17.812 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7498.g369173db 2023-11-27T20:38:17.884 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/ 2023-11-27T20:38:17.884 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7498.g369173db 2023-11-27T20:38:17.980 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-27T20:38:17.980 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:38:17.980 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-27T20:38:18.050 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-27T20:38:18.050 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:38:18.050 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-27T20:38:18.086 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-27T20:38:18.087 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/369173db14b6995b2bd07c60ec5f63d01cf21631/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-27T20:38:18.152 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-27T20:38:18.153 DEBUG:teuthology.orchestra.run.smithi091:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/369173db14b6995b2bd07c60ec5f63d01cf21631/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-27T20:38:18.221 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-27T20:38:18.296 DEBUG:teuthology.orchestra.run.smithi091:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-27T20:38:18.356 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-27T20:38:18.429 DEBUG:teuthology.orchestra.run.smithi091:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-27T20:38:18.447 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2023-11-27T20:38:18.451 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2023-11-27T20:38:18.520 INFO:teuthology.orchestra.run.smithi091.stdout:check_obsoletes = 1 2023-11-27T20:38:18.524 DEBUG:teuthology.orchestra.run.smithi091:> sudo yum clean all 2023-11-27T20:38:18.809 INFO:teuthology.orchestra.run.smithi183.stdout:73 files removed 2023-11-27T20:38:18.848 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-27T20:38:18.869 INFO:teuthology.orchestra.run.smithi091.stdout:73 files removed 2023-11-27T20:38:18.907 DEBUG:teuthology.orchestra.run.smithi091:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-27T20:38:19.754 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 192 kB/s | 78 kB 00:00 2023-11-27T20:38:19.810 INFO:teuthology.orchestra.run.smithi091.stdout:ceph packages for x86_64 194 kB/s | 78 kB 00:00 2023-11-27T20:38:20.310 INFO:teuthology.orchestra.run.smithi091.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2023-11-27T20:38:20.312 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2023-11-27T20:38:20.805 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2023-11-27T20:38:20.869 INFO:teuthology.orchestra.run.smithi091.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2023-11-27T20:38:21.633 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - AppStream 8.5 MB/s | 6.4 MB 00:00 2023-11-27T20:38:21.673 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS-9 - AppStream 8.8 MB/s | 6.4 MB 00:00 2023-11-27T20:38:23.448 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2023-11-27T20:38:23.675 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - BaseOS 2.4 MB/s | 2.0 MB 00:00 2023-11-27T20:38:24.878 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 7.9 MB 00:01 2023-11-27T20:38:25.179 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 7.2 MB/s | 7.9 MB 00:01 2023-11-27T20:38:28.313 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 18 MB 00:01 2023-11-27T20:38:29.661 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 18 MB 00:03 2023-11-27T20:38:34.589 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 5.8 MB 00:02 2023-11-27T20:38:35.670 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 5.8 MB 00:02 2023-11-27T20:38:36.214 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 15 kB 00:00 2023-11-27T20:38:37.174 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2023-11-27T20:38:38.187 INFO:teuthology.orchestra.run.smithi091.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 15 kB 00:01 2023-11-27T20:38:39.556 INFO:teuthology.orchestra.run.smithi091.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2023-11-27T20:38:42.924 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-11-27T20:38:45.130 INFO:teuthology.orchestra.run.smithi091.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2023-11-27T20:38:45.787 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T20:38:45.788 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T20:38:45.808 INFO:teuthology.orchestra.run.smithi183.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-27T20:38:45.809 INFO:teuthology.orchestra.run.smithi183.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-27T20:38:45.811 INFO:teuthology.orchestra.run.smithi183.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-27T20:38:45.812 INFO:teuthology.orchestra.run.smithi183.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-27T20:38:45.815 INFO:teuthology.orchestra.run.smithi183.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-27T20:38:45.818 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-27T20:38:45.819 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-27T20:38:45.901 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-11-27T20:38:45.918 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================================ 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================================ 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:18.0.0-7498.g369173db.el9 ceph 6.5 k 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:18.0.0-7498.g369173db.el9 ceph 5.2 M 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 860 k 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7498.g369173db.el9 ceph 141 k 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.5 M 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 133 k 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 1.8 M 2023-11-27T20:38:45.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 7.4 M 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 50 k 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 8.6 M 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:18.0.0-7498.g369173db.el9 ceph 41 M 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 262 k 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 774 k 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 217 k 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 18 k 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-27T20:38:45.920 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 31 k 2023-11-27T20:38:45.921 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 719 k 2023-11-27T20:38:45.921 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 126 k 2023-11-27T20:38:45.921 INFO:teuthology.orchestra.run.smithi183.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-27T20:38:45.921 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-27T20:38:45.921 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-27T20:38:45.921 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-27T20:38:45.921 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-27T20:38:45.921 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-27T20:38:45.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:18.0.0-7498.g369173db.el9 ceph 162 k 2023-11-27T20:38:45.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:18.0.0-7498.g369173db.el9 ceph 320 k 2023-11-27T20:38:45.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 297 k 2023-11-27T20:38:45.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 99 k 2023-11-27T20:38:45.922 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 85 k 2023-11-27T20:38:45.922 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T20:38:45.922 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 170 k 2023-11-27T20:38:45.922 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-27T20:38:45.922 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2023-11-27T20:38:45.922 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-27T20:38:45.922 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-27T20:38:45.922 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-27T20:38:45.923 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-27T20:38:45.923 INFO:teuthology.orchestra.run.smithi183.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-27T20:38:45.923 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-27T20:38:45.923 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-27T20:38:45.923 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-27T20:38:45.923 INFO:teuthology.orchestra.run.smithi183.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-27T20:38:45.923 INFO:teuthology.orchestra.run.smithi183.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-27T20:38:45.923 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.3 M 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 19 M 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 28 k 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:18.0.0-7498.g369173db.el9 ceph 2.1 M 2023-11-27T20:38:45.924 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 243 k 2023-11-27T20:38:45.925 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.4 M 2023-11-27T20:38:45.925 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:18.0.0-7498.g369173db.el9 ceph 18 M 2023-11-27T20:38:45.925 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 15 k 2023-11-27T20:38:45.925 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:18.0.0-7498.g369173db.el9 ceph 24 k 2023-11-27T20:38:45.925 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-27T20:38:45.925 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-27T20:38:45.925 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-27T20:38:45.925 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-27T20:38:45.925 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-27T20:38:45.925 INFO:teuthology.orchestra.run.smithi183.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:18.0.0-7498.g369173db.el9 ceph 164 k 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 476 k 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-27T20:38:45.926 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.8 M 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-27T20:38:45.927 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:18.0.0-7498.g369173db.el9 ceph 45 k 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 129 k 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-27T20:38:45.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-27T20:38:45.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-27T20:38:45.930 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-27T20:38:45.931 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-27T20:38:45.931 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-27T20:38:45.931 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-27T20:38:45.931 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-27T20:38:45.931 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-27T20:38:45.931 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-27T20:38:45.931 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-27T20:38:45.931 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-27T20:38:45.931 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-27T20:38:45.932 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-27T20:38:45.933 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-27T20:38:45.933 INFO:teuthology.orchestra.run.smithi183.stdout:Installing weak dependencies: 2023-11-27T20:38:45.933 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-27T20:38:45.933 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:38:45.933 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-11-27T20:38:45.933 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================================ 2023-11-27T20:38:45.933 INFO:teuthology.orchestra.run.smithi183.stdout:Install 132 Packages 2023-11-27T20:38:45.933 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 15 Packages 2023-11-27T20:38:45.933 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:38:45.934 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 204 M 2023-11-27T20:38:45.934 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-11-27T20:38:46.626 INFO:teuthology.orchestra.run.smithi183.stdout:(1/147): ceph-18.0.0-7498.g369173db.el9.x86_64. 25 kB/s | 6.5 kB 00:00 2023-11-27T20:38:46.893 INFO:teuthology.orchestra.run.smithi183.stdout:(2/147): ceph-fuse-18.0.0-7498.g369173db.el9.x8 3.2 MB/s | 860 kB 00:00 2023-11-27T20:38:46.993 INFO:teuthology.orchestra.run.smithi183.stdout:(3/147): ceph-immutable-object-cache-18.0.0-749 1.4 MB/s | 141 kB 00:00 2023-11-27T20:38:47.135 INFO:teuthology.orchestra.run.smithi183.stdout:(4/147): ceph-base-18.0.0-7498.g369173db.el9.x8 6.8 MB/s | 5.2 MB 00:00 2023-11-27T20:38:47.410 INFO:teuthology.orchestra.run.smithi183.stdout:(5/147): ceph-mds-18.0.0-7498.g369173db.el9.x86 5.0 MB/s | 2.1 MB 00:00 2023-11-27T20:38:47.469 INFO:teuthology.orchestra.run.smithi183.stdout:(6/147): ceph-mgr-18.0.0-7498.g369173db.el9.x86 4.4 MB/s | 1.5 MB 00:00 2023-11-27T20:38:48.029 INFO:teuthology.orchestra.run.smithi091.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T20:38:48.030 INFO:teuthology.orchestra.run.smithi091.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T20:38:48.051 INFO:teuthology.orchestra.run.smithi091.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-27T20:38:48.053 INFO:teuthology.orchestra.run.smithi091.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-27T20:38:48.054 INFO:teuthology.orchestra.run.smithi091.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-27T20:38:48.055 INFO:teuthology.orchestra.run.smithi091.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-27T20:38:48.058 INFO:teuthology.orchestra.run.smithi091.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-27T20:38:48.062 INFO:teuthology.orchestra.run.smithi091.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-27T20:38:48.063 INFO:teuthology.orchestra.run.smithi091.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-27T20:38:48.142 INFO:teuthology.orchestra.run.smithi091.stdout:Dependencies resolved. 2023-11-27T20:38:48.168 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================================ 2023-11-27T20:38:48.168 INFO:teuthology.orchestra.run.smithi091.stdout: Package Arch Version Repository Size 2023-11-27T20:38:48.168 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================================ 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout:Installing: 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: ceph x86_64 2:18.0.0-7498.g369173db.el9 ceph 6.5 k 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-base x86_64 2:18.0.0-7498.g369173db.el9 ceph 5.2 M 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 860 k 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7498.g369173db.el9 ceph 141 k 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.5 M 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 133 k 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 1.8 M 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 7.4 M 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-rook noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 50 k 2023-11-27T20:38:48.169 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-radosgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 8.6 M 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-test x86_64 2:18.0.0-7498.g369173db.el9 ceph 41 M 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-volume noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 262 k 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 774 k 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: cephfs-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 217 k 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: cephfs-top noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 18 k 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 31 k 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 719 k 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: librados-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 126 k 2023-11-27T20:38:48.170 INFO:teuthology.orchestra.run.smithi091.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cephfs x86_64 2:18.0.0-7498.g369173db.el9 ceph 162 k 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rados x86_64 2:18.0.0-7498.g369173db.el9 ceph 320 k 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 297 k 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 99 k 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 85 k 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T20:38:48.171 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-nbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 170 k 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout:Upgrading: 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-27T20:38:48.172 INFO:teuthology.orchestra.run.smithi091.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: librados2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.3 M 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: librbd1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout:Installing dependencies: 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 19 M 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 28 k 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mds x86_64 2:18.0.0-7498.g369173db.el9 ceph 2.1 M 2023-11-27T20:38:48.173 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 243 k 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mon x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.4 M 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-osd x86_64 2:18.0.0-7498.g369173db.el9 ceph 18 M 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 15 k 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-selinux x86_64 2:18.0.0-7498.g369173db.el9 ceph 24 k 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-27T20:38:48.174 INFO:teuthology.orchestra.run.smithi091.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: libcephsqlite x86_64 2:18.0.0-7498.g369173db.el9 ceph 164 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: libradosstriper1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 476 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: librgw2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.8 M 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-27T20:38:48.175 INFO:teuthology.orchestra.run.smithi091.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-argparse x86_64 2:18.0.0-7498.g369173db.el9 ceph 45 k 2023-11-27T20:38:48.176 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 129 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-27T20:38:48.177 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-27T20:38:48.178 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-27T20:38:48.179 INFO:teuthology.orchestra.run.smithi091.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-27T20:38:48.180 INFO:teuthology.orchestra.run.smithi091.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout:Installing weak dependencies: 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction Summary 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================================ 2023-11-27T20:38:48.181 INFO:teuthology.orchestra.run.smithi091.stdout:Install 132 Packages 2023-11-27T20:38:48.182 INFO:teuthology.orchestra.run.smithi091.stdout:Upgrade 15 Packages 2023-11-27T20:38:48.182 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:38:48.182 INFO:teuthology.orchestra.run.smithi091.stdout:Total download size: 204 M 2023-11-27T20:38:48.182 INFO:teuthology.orchestra.run.smithi091.stdout:Downloading Packages: 2023-11-27T20:38:48.186 INFO:teuthology.orchestra.run.smithi183.stdout:(7/147): ceph-common-18.0.0-7498.g369173db.el9. 10 MB/s | 19 MB 00:01 2023-11-27T20:38:48.294 INFO:teuthology.orchestra.run.smithi183.stdout:(8/147): ceph-mon-18.0.0-7498.g369173db.el9.x86 5.0 MB/s | 4.4 MB 00:00 2023-11-27T20:38:48.369 INFO:teuthology.orchestra.run.smithi183.stdout:(9/147): ceph-selinux-18.0.0-7498.g369173db.el9 326 kB/s | 24 kB 00:00 2023-11-27T20:38:48.920 INFO:teuthology.orchestra.run.smithi183.stdout:(10/147): ceph-radosgw-18.0.0-7498.g369173db.el 12 MB/s | 8.6 MB 00:00 2023-11-27T20:38:48.995 INFO:teuthology.orchestra.run.smithi183.stdout:(11/147): cephfs-mirror-18.0.0-7498.g369173db.e 2.9 MB/s | 217 kB 00:00 2023-11-27T20:38:49.070 INFO:teuthology.orchestra.run.smithi183.stdout:(12/147): libcephfs-devel-18.0.0-7498.g369173db 420 kB/s | 31 kB 00:00 2023-11-27T20:38:49.179 INFO:teuthology.orchestra.run.smithi183.stdout:(13/147): libcephfs2-18.0.0-7498.g369173db.el9. 6.6 MB/s | 719 kB 00:00 2023-11-27T20:38:49.246 INFO:teuthology.orchestra.run.smithi183.stdout:(14/147): libcephsqlite-18.0.0-7498.g369173db.e 2.4 MB/s | 164 kB 00:00 2023-11-27T20:38:49.323 INFO:teuthology.orchestra.run.smithi091.stdout:(1/147): ceph-18.0.0-7498.g369173db.el9.x86_64. 20 kB/s | 6.5 kB 00:00 2023-11-27T20:38:49.480 INFO:teuthology.orchestra.run.smithi183.stdout:(15/147): ceph-osd-18.0.0-7498.g369173db.el9.x8 8.8 MB/s | 18 MB 00:02 2023-11-27T20:38:49.513 INFO:teuthology.orchestra.run.smithi183.stdout:(16/147): librados-devel-18.0.0-7498.g369173db. 475 kB/s | 126 kB 00:00 2023-11-27T20:38:50.048 INFO:teuthology.orchestra.run.smithi091.stdout:(2/147): ceph-fuse-18.0.0-7498.g369173db.el9.x8 1.2 MB/s | 860 kB 00:00 2023-11-27T20:38:50.155 INFO:teuthology.orchestra.run.smithi183.stdout:(17/147): libradosstriper1-18.0.0-7498.g369173d 705 kB/s | 476 kB 00:00 2023-11-27T20:38:50.165 INFO:teuthology.orchestra.run.smithi091.stdout:(3/147): ceph-immutable-object-cache-18.0.0-749 1.2 MB/s | 141 kB 00:00 2023-11-27T20:38:50.264 INFO:teuthology.orchestra.run.smithi183.stdout:(18/147): librgw2-18.0.0-7498.g369173db.el9.x86 6.4 MB/s | 4.8 MB 00:00 2023-11-27T20:38:50.289 INFO:teuthology.orchestra.run.smithi183.stdout:(19/147): python3-ceph-argparse-18.0.0-7498.g36 340 kB/s | 45 kB 00:00 2023-11-27T20:38:50.348 INFO:teuthology.orchestra.run.smithi183.stdout:(20/147): python3-ceph-common-18.0.0-7498.g3691 1.5 MB/s | 129 kB 00:00 2023-11-27T20:38:50.381 INFO:teuthology.orchestra.run.smithi183.stdout:(21/147): python3-cephfs-18.0.0-7498.g369173db. 1.7 MB/s | 162 kB 00:00 2023-11-27T20:38:50.431 INFO:teuthology.orchestra.run.smithi183.stdout:(22/147): python3-rados-18.0.0-7498.g369173db.e 3.8 MB/s | 320 kB 00:00 2023-11-27T20:38:50.482 INFO:teuthology.orchestra.run.smithi183.stdout:(23/147): python3-rbd-18.0.0-7498.g369173db.el9 2.9 MB/s | 297 kB 00:00 2023-11-27T20:38:50.516 INFO:teuthology.orchestra.run.smithi183.stdout:(24/147): python3-rgw-18.0.0-7498.g369173db.el9 1.2 MB/s | 99 kB 00:00 2023-11-27T20:38:50.588 INFO:teuthology.orchestra.run.smithi183.stdout:(25/147): rbd-fuse-18.0.0-7498.g369173db.el9.x8 812 kB/s | 85 kB 00:00 2023-11-27T20:38:50.699 INFO:teuthology.orchestra.run.smithi183.stdout:(26/147): rbd-nbd-18.0.0-7498.g369173db.el9.x86 1.5 MB/s | 170 kB 00:00 2023-11-27T20:38:50.791 INFO:teuthology.orchestra.run.smithi183.stdout:(27/147): ceph-grafana-dashboards-18.0.0-7498.g 308 kB/s | 28 kB 00:00 2023-11-27T20:38:50.858 INFO:teuthology.orchestra.run.smithi183.stdout:(28/147): ceph-mgr-cephadm-18.0.0-7498.g369173d 2.0 MB/s | 133 kB 00:00 2023-11-27T20:38:50.933 INFO:teuthology.orchestra.run.smithi183.stdout:(29/147): rbd-mirror-18.0.0-7498.g369173db.el9. 7.2 MB/s | 3.0 MB 00:00 2023-11-27T20:38:51.015 INFO:teuthology.orchestra.run.smithi091.stdout:(4/147): ceph-common-18.0.0-7498.g369173db.el9. 9.4 MB/s | 19 MB 00:02 2023-11-27T20:38:51.141 INFO:teuthology.orchestra.run.smithi091.stdout:(5/147): ceph-mds-18.0.0-7498.g369173db.el9.x86 2.1 MB/s | 2.1 MB 00:00 2023-11-27T20:38:51.167 INFO:teuthology.orchestra.run.smithi183.stdout:(30/147): ceph-mgr-dashboard-18.0.0-7498.g36917 5.7 MB/s | 1.8 MB 00:00 2023-11-27T20:38:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:(31/147): ceph-mgr-modules-core-18.0.0-7498.g36 1.9 MB/s | 243 kB 00:00 2023-11-27T20:38:51.299 INFO:teuthology.orchestra.run.smithi091.stdout:(6/147): ceph-base-18.0.0-7498.g369173db.el9.x8 2.3 MB/s | 5.2 MB 00:02 2023-11-27T20:38:51.349 INFO:teuthology.orchestra.run.smithi091.stdout:(7/147): ceph-mgr-18.0.0-7498.g369173db.el9.x86 4.4 MB/s | 1.5 MB 00:00 2023-11-27T20:38:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:(32/147): ceph-mgr-rook-18.0.0-7498.g369173db.e 745 kB/s | 50 kB 00:00 2023-11-27T20:38:51.468 INFO:teuthology.orchestra.run.smithi183.stdout:(33/147): ceph-prometheus-alerts-18.0.0-7498.g3 141 kB/s | 15 kB 00:00 2023-11-27T20:38:51.860 INFO:teuthology.orchestra.run.smithi183.stdout:(34/147): ceph-mgr-diskprediction-local-18.0.0- 8.0 MB/s | 7.4 MB 00:00 2023-11-27T20:38:52.018 INFO:teuthology.orchestra.run.smithi183.stdout:(35/147): cephadm-18.0.0-7498.g369173db.el9.noa 4.8 MB/s | 774 kB 00:00 2023-11-27T20:38:52.094 INFO:teuthology.orchestra.run.smithi183.stdout:(36/147): cephfs-top-18.0.0-7498.g369173db.el9. 246 kB/s | 18 kB 00:00 2023-11-27T20:38:52.210 INFO:teuthology.orchestra.run.smithi183.stdout:(37/147): ceph-volume-18.0.0-7498.g369173db.el9 354 kB/s | 262 kB 00:00 2023-11-27T20:38:52.283 INFO:teuthology.orchestra.run.smithi091.stdout:(8/147): ceph-radosgw-18.0.0-7498.g369173db.el9 9.2 MB/s | 8.6 MB 00:00 2023-11-27T20:38:52.336 INFO:teuthology.orchestra.run.smithi183.stdout:(38/147): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 662 kB 00:00 2023-11-27T20:38:52.369 INFO:teuthology.orchestra.run.smithi183.stdout:(39/147): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 920 kB 00:00 2023-11-27T20:38:52.400 INFO:teuthology.orchestra.run.smithi091.stdout:(9/147): ceph-mon-18.0.0-7498.g369173db.el9.x86 3.5 MB/s | 4.4 MB 00:01 2023-11-27T20:38:52.411 INFO:teuthology.orchestra.run.smithi183.stdout:(40/147): boost-program-options-1.75.0-8.el9.x8 2.6 MB/s | 106 kB 00:00 2023-11-27T20:38:52.425 INFO:teuthology.orchestra.run.smithi091.stdout:(10/147): ceph-selinux-18.0.0-7498.g369173db.el 171 kB/s | 24 kB 00:00 2023-11-27T20:38:52.436 INFO:teuthology.orchestra.run.smithi183.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 329 kB/s | 21 kB 00:00 2023-11-27T20:38:52.470 INFO:teuthology.orchestra.run.smithi183.stdout:(42/147): flexiblas-3.0.4-8.el9.x86_64.rpm 988 kB/s | 32 kB 00:00 2023-11-27T20:38:52.475 INFO:teuthology.orchestra.run.smithi091.stdout:(11/147): cephfs-mirror-18.0.0-7498.g369173db.e 4.3 MB/s | 217 kB 00:00 2023-11-27T20:38:52.504 INFO:teuthology.orchestra.run.smithi183.stdout:(43/147): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 307 kB 00:00 2023-11-27T20:38:52.525 INFO:teuthology.orchestra.run.smithi091.stdout:(12/147): libcephfs-devel-18.0.0-7498.g369173db 633 kB/s | 31 kB 00:00 2023-11-27T20:38:52.621 INFO:teuthology.orchestra.run.smithi183.stdout:(44/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2023-11-27T20:38:52.634 INFO:teuthology.orchestra.run.smithi091.stdout:(13/147): libcephfs2-18.0.0-7498.g369173db.el9. 6.6 MB/s | 719 kB 00:00 2023-11-27T20:38:52.654 INFO:teuthology.orchestra.run.smithi183.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 132 kB/s | 17 kB 00:00 2023-11-27T20:38:52.693 INFO:teuthology.orchestra.run.smithi091.stdout:(14/147): libcephsqlite-18.0.0-7498.g369173db.e 2.8 MB/s | 164 kB 00:00 2023-11-27T20:38:52.704 INFO:teuthology.orchestra.run.smithi183.stdout:(46/147): jq-1.6-16.el9.x86_64.rpm 3.7 MB/s | 186 kB 00:00 2023-11-27T20:38:52.730 INFO:teuthology.orchestra.run.smithi183.stdout:(47/147): libaio-devel-0.3.111-13.el9.x86_64.rp 136 kB/s | 10 kB 00:00 2023-11-27T20:38:52.751 INFO:teuthology.orchestra.run.smithi091.stdout:(15/147): librados-devel-18.0.0-7498.g369173db. 2.2 MB/s | 126 kB 00:00 2023-11-27T20:38:52.763 INFO:teuthology.orchestra.run.smithi183.stdout:(48/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.8 MB/s | 159 kB 00:00 2023-11-27T20:38:52.788 INFO:teuthology.orchestra.run.smithi183.stdout:(49/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 772 kB/s | 44 kB 00:00 2023-11-27T20:38:52.835 INFO:teuthology.orchestra.run.smithi091.stdout:(16/147): libradosstriper1-18.0.0-7498.g369173d 5.6 MB/s | 476 kB 00:00 2023-11-27T20:38:52.847 INFO:teuthology.orchestra.run.smithi183.stdout:(50/147): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2023-11-27T20:38:52.889 INFO:teuthology.orchestra.run.smithi183.stdout:(51/147): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 661 kB 00:00 2023-11-27T20:38:52.914 INFO:teuthology.orchestra.run.smithi183.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 401 kB/s | 24 kB 00:00 2023-11-27T20:38:52.948 INFO:teuthology.orchestra.run.smithi183.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 809 kB/s | 46 kB 00:00 2023-11-27T20:38:52.990 INFO:teuthology.orchestra.run.smithi183.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-11-27T20:38:53.024 INFO:teuthology.orchestra.run.smithi183.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.0 MB/s | 217 kB 00:00 2023-11-27T20:38:53.049 INFO:teuthology.orchestra.run.smithi183.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 607 kB/s | 34 kB 00:00 2023-11-27T20:38:53.210 INFO:teuthology.orchestra.run.smithi183.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2023-11-27T20:38:53.277 INFO:teuthology.orchestra.run.smithi091.stdout:(17/147): librgw2-18.0.0-7498.g369173db.el9.x86 11 MB/s | 4.8 MB 00:00 2023-11-27T20:38:53.282 INFO:teuthology.orchestra.run.smithi183.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 7.3 MB/s | 1.5 MB 00:00 2023-11-27T20:38:53.327 INFO:teuthology.orchestra.run.smithi091.stdout:(18/147): python3-ceph-argparse-18.0.0-7498.g36 922 kB/s | 45 kB 00:00 2023-11-27T20:38:53.332 INFO:teuthology.orchestra.run.smithi183.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 6.4 MB/s | 811 kB 00:00 2023-11-27T20:38:53.358 INFO:teuthology.orchestra.run.smithi183.stdout:(60/147): postgresql-private-libs-13.11-1.el9.x 1.9 MB/s | 134 kB 00:00 2023-11-27T20:38:53.386 INFO:teuthology.orchestra.run.smithi091.stdout:(19/147): python3-ceph-common-18.0.0-7498.g3691 2.2 MB/s | 129 kB 00:00 2023-11-27T20:38:53.453 INFO:teuthology.orchestra.run.smithi091.stdout:(20/147): python3-cephfs-18.0.0-7498.g369173db. 2.4 MB/s | 162 kB 00:00 2023-11-27T20:38:53.508 INFO:teuthology.orchestra.run.smithi183.stdout:(61/147): postgresql-server-13.11-1.el9.x86_64. 33 MB/s | 5.7 MB 00:00 2023-11-27T20:38:53.528 INFO:teuthology.orchestra.run.smithi091.stdout:(21/147): python3-rados-18.0.0-7498.g369173db.e 4.3 MB/s | 320 kB 00:00 2023-11-27T20:38:53.595 INFO:teuthology.orchestra.run.smithi091.stdout:(22/147): python3-rbd-18.0.0-7498.g369173db.el9 4.4 MB/s | 297 kB 00:00 2023-11-27T20:38:53.634 INFO:teuthology.orchestra.run.smithi183.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2023-11-27T20:38:53.653 INFO:teuthology.orchestra.run.smithi091.stdout:(23/147): python3-rgw-18.0.0-7498.g369173db.el9 1.7 MB/s | 99 kB 00:00 2023-11-27T20:38:53.659 INFO:teuthology.orchestra.run.smithi183.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.7 MB/s | 228 kB 00:00 2023-11-27T20:38:53.692 INFO:teuthology.orchestra.run.smithi183.stdout:(64/147): python3-jsonpointer-2.0-4.el9.noarch. 568 kB/s | 18 kB 00:00 2023-11-27T20:38:53.712 INFO:teuthology.orchestra.run.smithi091.stdout:(24/147): rbd-fuse-18.0.0-7498.g369173db.el9.x8 1.5 MB/s | 85 kB 00:00 2023-11-27T20:38:53.718 INFO:teuthology.orchestra.run.smithi183.stdout:(65/147): python3-jsonpatch-1.21-16.el9.noarch. 425 kB/s | 24 kB 00:00 2023-11-27T20:38:53.743 INFO:teuthology.orchestra.run.smithi183.stdout:(66/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-11-27T20:38:53.768 INFO:teuthology.orchestra.run.smithi183.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 655 kB/s | 32 kB 00:00 2023-11-27T20:38:53.919 INFO:teuthology.orchestra.run.smithi183.stdout:(68/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2023-11-27T20:38:53.944 INFO:teuthology.orchestra.run.smithi183.stdout:(69/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2023-11-27T20:38:53.979 INFO:teuthology.orchestra.run.smithi091.stdout:(25/147): rbd-mirror-18.0.0-7498.g369173db.el9. 11 MB/s | 3.0 MB 00:00 2023-11-27T20:38:53.986 INFO:teuthology.orchestra.run.smithi183.stdout:(70/147): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2023-11-27T20:38:54.019 INFO:teuthology.orchestra.run.smithi183.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 2.3 MB/s | 174 kB 00:00 2023-11-27T20:38:54.030 INFO:teuthology.orchestra.run.smithi091.stdout:(26/147): rbd-nbd-18.0.0-7498.g369173db.el9.x86 3.4 MB/s | 170 kB 00:00 2023-11-27T20:38:54.044 INFO:teuthology.orchestra.run.smithi183.stdout:(72/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2023-11-27T20:38:54.071 INFO:teuthology.orchestra.run.smithi091.stdout:(27/147): ceph-grafana-dashboards-18.0.0-7498.g 689 kB/s | 28 kB 00:00 2023-11-27T20:38:54.078 INFO:teuthology.orchestra.run.smithi183.stdout:(73/147): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2023-11-27T20:38:54.104 INFO:teuthology.orchestra.run.smithi183.stdout:(74/147): python3-pytz-2021.1-5.el9.noarch.rpm 840 kB/s | 47 kB 00:00 2023-11-27T20:38:54.122 INFO:teuthology.orchestra.run.smithi091.stdout:(28/147): ceph-mgr-cephadm-18.0.0-7498.g369173d 2.6 MB/s | 133 kB 00:00 2023-11-27T20:38:54.129 INFO:teuthology.orchestra.run.smithi183.stdout:(75/147): python3-requests-oauthlib-1.3.0-12.el 869 kB/s | 43 kB 00:00 2023-11-27T20:38:54.288 INFO:teuthology.orchestra.run.smithi091.stdout:(29/147): ceph-mgr-dashboard-18.0.0-7498.g36917 11 MB/s | 1.8 MB 00:00 2023-11-27T20:38:54.479 INFO:teuthology.orchestra.run.smithi183.stdout:(76/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2023-11-27T20:38:54.513 INFO:teuthology.orchestra.run.smithi183.stdout:(77/147): python3-toml-0.10.2-6.el9.noarch.rpm 107 kB/s | 39 kB 00:00 2023-11-27T20:38:54.572 INFO:teuthology.orchestra.run.smithi183.stdout:(78/147): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2023-11-27T20:38:54.597 INFO:teuthology.orchestra.run.smithi183.stdout:(79/147): uuid-1.6.2-55.el9.x86_64.rpm 687 kB/s | 56 kB 00:00 2023-11-27T20:38:54.639 INFO:teuthology.orchestra.run.smithi183.stdout:(80/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-11-27T20:38:54.664 INFO:teuthology.orchestra.run.smithi183.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.3 MB/s | 85 kB 00:00 2023-11-27T20:38:54.689 INFO:teuthology.orchestra.run.smithi183.stdout:(82/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 910 kB/s | 44 kB 00:00 2023-11-27T20:38:54.715 INFO:teuthology.orchestra.run.smithi183.stdout:(83/147): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-11-27T20:38:54.756 INFO:teuthology.orchestra.run.smithi183.stdout:(84/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-11-27T20:38:54.798 INFO:teuthology.orchestra.run.smithi183.stdout:(85/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2023-11-27T20:38:54.832 INFO:teuthology.orchestra.run.smithi183.stdout:(86/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2023-11-27T20:38:54.882 INFO:teuthology.orchestra.run.smithi183.stdout:(87/147): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-11-27T20:38:54.908 INFO:teuthology.orchestra.run.smithi183.stdout:(88/147): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-11-27T20:38:54.933 INFO:teuthology.orchestra.run.smithi183.stdout:(89/147): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-11-27T20:38:54.958 INFO:teuthology.orchestra.run.smithi183.stdout:(90/147): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-11-27T20:38:54.989 INFO:teuthology.orchestra.run.smithi091.stdout:(30/147): ceph-osd-18.0.0-7498.g369173db.el9.x8 4.8 MB/s | 18 MB 00:03 2023-11-27T20:38:54.992 INFO:teuthology.orchestra.run.smithi183.stdout:(91/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-11-27T20:38:55.124 INFO:teuthology.orchestra.run.smithi091.stdout:(31/147): ceph-mgr-diskprediction-local-18.0.0- 8.9 MB/s | 7.4 MB 00:00 2023-11-27T20:38:55.158 INFO:teuthology.orchestra.run.smithi091.stdout:(32/147): ceph-mgr-modules-core-18.0.0-7498.g36 1.4 MB/s | 243 kB 00:00 2023-11-27T20:38:55.183 INFO:teuthology.orchestra.run.smithi091.stdout:(33/147): ceph-mgr-rook-18.0.0-7498.g369173db.e 873 kB/s | 50 kB 00:00 2023-11-27T20:38:55.233 INFO:teuthology.orchestra.run.smithi091.stdout:(34/147): ceph-prometheus-alerts-18.0.0-7498.g3 205 kB/s | 15 kB 00:00 2023-11-27T20:38:55.284 INFO:teuthology.orchestra.run.smithi091.stdout:(35/147): ceph-volume-18.0.0-7498.g369173db.el9 2.6 MB/s | 262 kB 00:00 2023-11-27T20:38:55.334 INFO:teuthology.orchestra.run.smithi091.stdout:(36/147): cephfs-top-18.0.0-7498.g369173db.el9. 371 kB/s | 18 kB 00:00 2023-11-27T20:38:55.459 INFO:teuthology.orchestra.run.smithi091.stdout:(37/147): cephadm-18.0.0-7498.g369173db.el9.noa 3.4 MB/s | 774 kB 00:00 2023-11-27T20:38:55.476 INFO:teuthology.orchestra.run.smithi183.stdout:(92/147): ceph-test-18.0.0-7498.g369173db.el9.x 5.8 MB/s | 41 MB 00:07 2023-11-27T20:38:55.576 INFO:teuthology.orchestra.run.smithi183.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 421 kB/s | 245 kB 00:00 2023-11-27T20:38:55.701 INFO:teuthology.orchestra.run.smithi183.stdout:(94/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 5.6 MB/s | 4.1 MB 00:00 2023-11-27T20:38:55.726 INFO:teuthology.orchestra.run.smithi091.stdout:(38/147): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 662 kB 00:00 2023-11-27T20:38:55.768 INFO:teuthology.orchestra.run.smithi091.stdout:(39/147): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 920 kB 00:00 2023-11-27T20:38:55.794 INFO:teuthology.orchestra.run.smithi091.stdout:(40/147): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2023-11-27T20:38:55.819 INFO:teuthology.orchestra.run.smithi091.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 444 kB/s | 21 kB 00:00 2023-11-27T20:38:55.852 INFO:teuthology.orchestra.run.smithi091.stdout:(42/147): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-11-27T20:38:55.878 INFO:teuthology.orchestra.run.smithi091.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 572 kB/s | 32 kB 00:00 2023-11-27T20:38:55.943 INFO:teuthology.orchestra.run.smithi183.stdout:(95/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 101 kB/s | 24 kB 00:00 2023-11-27T20:38:55.978 INFO:teuthology.orchestra.run.smithi091.stdout:(44/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-11-27T20:38:56.003 INFO:teuthology.orchestra.run.smithi091.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 17 kB 00:00 2023-11-27T20:38:56.045 INFO:teuthology.orchestra.run.smithi091.stdout:(46/147): libaio-devel-0.3.111-13.el9.x86_64.rp 250 kB/s | 10 kB 00:00 2023-11-27T20:38:56.060 INFO:teuthology.orchestra.run.smithi183.stdout:(96/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 530 kB/s | 309 kB 00:00 2023-11-27T20:38:56.079 INFO:teuthology.orchestra.run.smithi091.stdout:(47/147): jq-1.6-16.el9.x86_64.rpm 2.5 MB/s | 186 kB 00:00 2023-11-27T20:38:56.110 INFO:teuthology.orchestra.run.smithi183.stdout:(97/147): liboath-2.6.7-2.el9.x86_64.rpm 292 kB/s | 49 kB 00:00 2023-11-27T20:38:56.112 INFO:teuthology.orchestra.run.smithi091.stdout:(48/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2023-11-27T20:38:56.138 INFO:teuthology.orchestra.run.smithi091.stdout:(49/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 792 kB/s | 44 kB 00:00 2023-11-27T20:38:56.160 INFO:teuthology.orchestra.run.smithi183.stdout:(98/147): libunwind-1.6.2-1.el9.x86_64.rpm 676 kB/s | 67 kB 00:00 2023-11-27T20:38:56.188 INFO:teuthology.orchestra.run.smithi091.stdout:(50/147): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 661 kB 00:00 2023-11-27T20:38:56.230 INFO:teuthology.orchestra.run.smithi091.stdout:(51/147): libtool-2.4.6-45.el9.x86_64.rpm 6.6 MB/s | 578 kB 00:00 2023-11-27T20:38:56.255 INFO:teuthology.orchestra.run.smithi091.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 399 kB/s | 24 kB 00:00 2023-11-27T20:38:56.281 INFO:teuthology.orchestra.run.smithi091.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 46 kB 00:00 2023-11-27T20:38:56.343 INFO:teuthology.orchestra.run.smithi091.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.2 MB/s | 282 kB 00:00 2023-11-27T20:38:56.344 INFO:teuthology.orchestra.run.smithi183.stdout:(99/147): python3-asyncssh-2.13.2-3.el9.noarch. 2.9 MB/s | 548 kB 00:00 2023-11-27T20:38:56.373 INFO:teuthology.orchestra.run.smithi091.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.4 MB/s | 217 kB 00:00 2023-11-27T20:38:56.398 INFO:teuthology.orchestra.run.smithi091.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 653 kB/s | 34 kB 00:00 2023-11-27T20:38:56.461 INFO:teuthology.orchestra.run.smithi183.stdout:(100/147): libarrow-9.0.0-9.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2023-11-27T20:38:56.486 INFO:teuthology.orchestra.run.smithi183.stdout:(101/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 309 kB/s | 43 kB 00:00 2023-11-27T20:38:56.548 INFO:teuthology.orchestra.run.smithi091.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2023-11-27T20:38:56.553 INFO:teuthology.orchestra.run.smithi183.stdout:(102/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.9 MB/s | 837 kB 00:00 2023-11-27T20:38:56.578 INFO:teuthology.orchestra.run.smithi183.stdout:(103/147): python3-cachetools-4.2.4-1.el9.noarc 277 kB/s | 32 kB 00:00 2023-11-27T20:38:56.599 INFO:teuthology.orchestra.run.smithi091.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 8.6 MB/s | 1.5 MB 00:00 2023-11-27T20:38:56.603 INFO:teuthology.orchestra.run.smithi183.stdout:(104/147): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2023-11-27T20:38:56.641 INFO:teuthology.orchestra.run.smithi091.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 8.7 MB/s | 811 kB 00:00 2023-11-27T20:38:56.654 INFO:teuthology.orchestra.run.smithi183.stdout:(105/147): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2023-11-27T20:38:56.666 INFO:teuthology.orchestra.run.smithi091.stdout:(60/147): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2023-11-27T20:38:56.688 INFO:teuthology.orchestra.run.smithi183.stdout:(106/147): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2023-11-27T20:38:56.721 INFO:teuthology.orchestra.run.smithi183.stdout:(107/147): python3-google-auth-2.23.4-1.el9.noa 1.7 MB/s | 197 kB 00:00 2023-11-27T20:38:56.755 INFO:teuthology.orchestra.run.smithi183.stdout:(108/147): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-11-27T20:38:56.788 INFO:teuthology.orchestra.run.smithi183.stdout:(109/147): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2023-11-27T20:38:56.814 INFO:teuthology.orchestra.run.smithi183.stdout:(110/147): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2023-11-27T20:38:56.833 INFO:teuthology.orchestra.run.smithi091.stdout:(61/147): postgresql-server-13.11-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2023-11-27T20:38:56.856 INFO:teuthology.orchestra.run.smithi183.stdout:(111/147): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2023-11-27T20:38:56.889 INFO:teuthology.orchestra.run.smithi183.stdout:(112/147): python3-jaraco-text-3.2.0-6.el9.noar 197 kB/s | 20 kB 00:00 2023-11-27T20:38:56.915 INFO:teuthology.orchestra.run.smithi183.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 90 kB/s | 9.0 kB 00:00 2023-11-27T20:38:56.956 INFO:teuthology.orchestra.run.smithi183.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 409 kB/s | 41 kB 00:00 2023-11-27T20:38:56.958 INFO:teuthology.orchestra.run.smithi091.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-11-27T20:38:56.983 INFO:teuthology.orchestra.run.smithi091.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-11-27T20:38:57.015 INFO:teuthology.orchestra.run.smithi183.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 464 kB/s | 46 kB 00:00 2023-11-27T20:38:57.017 INFO:teuthology.orchestra.run.smithi091.stdout:(64/147): python3-jsonpointer-2.0-4.el9.noarch. 567 kB/s | 18 kB 00:00 2023-11-27T20:38:57.042 INFO:teuthology.orchestra.run.smithi091.stdout:(65/147): python3-jsonpatch-1.21-16.el9.noarch. 425 kB/s | 24 kB 00:00 2023-11-27T20:38:57.057 INFO:teuthology.orchestra.run.smithi183.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 790 kB/s | 79 kB 00:00 2023-11-27T20:38:57.068 INFO:teuthology.orchestra.run.smithi091.stdout:(66/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-11-27T20:38:57.099 INFO:teuthology.orchestra.run.smithi183.stdout:(117/147): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2023-11-27T20:38:57.101 INFO:teuthology.orchestra.run.smithi091.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 557 kB/s | 32 kB 00:00 2023-11-27T20:38:57.124 INFO:teuthology.orchestra.run.smithi183.stdout:(118/147): python3-natsort-7.1.1-5.el9.noarch.r 533 kB/s | 58 kB 00:00 2023-11-27T20:38:57.191 INFO:teuthology.orchestra.run.smithi183.stdout:(119/147): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2023-11-27T20:38:57.216 INFO:teuthology.orchestra.run.smithi183.stdout:(120/147): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2023-11-27T20:38:57.235 INFO:teuthology.orchestra.run.smithi091.stdout:(68/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2023-11-27T20:38:57.242 INFO:teuthology.orchestra.run.smithi183.stdout:(121/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 770 kB/s | 90 kB 00:00 2023-11-27T20:38:57.260 INFO:teuthology.orchestra.run.smithi091.stdout:(69/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-11-27T20:38:57.292 INFO:teuthology.orchestra.run.smithi183.stdout:(122/147): python3-repoze-lru-0.7-16.el9.noarch 308 kB/s | 31 kB 00:00 2023-11-27T20:38:57.302 INFO:teuthology.orchestra.run.smithi091.stdout:(70/147): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2023-11-27T20:38:57.326 INFO:teuthology.orchestra.run.smithi183.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-11-27T20:38:57.336 INFO:teuthology.orchestra.run.smithi091.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 2.3 MB/s | 174 kB 00:00 2023-11-27T20:38:57.351 INFO:teuthology.orchestra.run.smithi183.stdout:(124/147): python3-rsa-4.9-2.el9.noarch.rpm 546 kB/s | 59 kB 00:00 2023-11-27T20:38:57.369 INFO:teuthology.orchestra.run.smithi091.stdout:(72/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-11-27T20:38:57.393 INFO:teuthology.orchestra.run.smithi183.stdout:(125/147): python3-tempora-5.0.0-2.el9.noarch.r 358 kB/s | 36 kB 00:00 2023-11-27T20:38:57.420 INFO:teuthology.orchestra.run.smithi091.stdout:(73/147): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-11-27T20:38:57.426 INFO:teuthology.orchestra.run.smithi183.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 511 kB/s | 51 kB 00:00 2023-11-27T20:38:57.445 INFO:teuthology.orchestra.run.smithi091.stdout:(74/147): python3-pytz-2021.1-5.el9.noarch.rpm 655 kB/s | 47 kB 00:00 2023-11-27T20:38:57.462 INFO:teuthology.orchestra.run.smithi091.stdout:(75/147): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 43 kB 00:00 2023-11-27T20:38:57.485 INFO:teuthology.orchestra.run.smithi183.stdout:(127/147): python3-websocket-client-1.2.3-2.el9 980 kB/s | 90 kB 00:00 2023-11-27T20:38:57.544 INFO:teuthology.orchestra.run.smithi183.stdout:(128/147): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-11-27T20:38:57.610 INFO:teuthology.orchestra.run.smithi183.stdout:(129/147): python3-zc-lockfile-2.0-10.el9.noarc 160 kB/s | 20 kB 00:00 2023-11-27T20:38:57.677 INFO:teuthology.orchestra.run.smithi183.stdout:(130/147): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2023-11-27T20:38:57.837 INFO:teuthology.orchestra.run.smithi091.stdout:(76/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2023-11-27T20:38:57.862 INFO:teuthology.orchestra.run.smithi091.stdout:(77/147): python3-toml-0.10.2-6.el9.noarch.rpm 104 kB/s | 39 kB 00:00 2023-11-27T20:38:57.903 INFO:teuthology.orchestra.run.smithi183.stdout:(131/147): thrift-0.15.0-2.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2023-11-27T20:38:57.904 INFO:teuthology.orchestra.run.smithi091.stdout:(78/147): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 56 kB 00:00 2023-11-27T20:38:57.938 INFO:teuthology.orchestra.run.smithi091.stdout:(79/147): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2023-11-27T20:38:57.963 INFO:teuthology.orchestra.run.smithi091.stdout:(80/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.5 MB/s | 85 kB 00:00 2023-11-27T20:38:57.969 INFO:teuthology.orchestra.run.smithi183.stdout:(132/147): python3-webob-1.8.7-6.el9.noarch.rpm 372 kB/s | 230 kB 00:00 2023-11-27T20:38:57.989 INFO:teuthology.orchestra.run.smithi091.stdout:(81/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-11-27T20:38:58.011 INFO:teuthology.orchestra.run.smithi183.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-11-27T20:38:58.013 INFO:teuthology.orchestra.run.smithi091.stdout:(82/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 905 kB/s | 44 kB 00:00 2023-11-27T20:38:58.039 INFO:teuthology.orchestra.run.smithi091.stdout:(83/147): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-11-27T20:38:58.089 INFO:teuthology.orchestra.run.smithi091.stdout:(84/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 11 MB/s | 803 kB 00:00 2023-11-27T20:38:58.121 INFO:teuthology.orchestra.run.smithi183.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-11-27T20:38:58.123 INFO:teuthology.orchestra.run.smithi091.stdout:(85/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2023-11-27T20:38:58.156 INFO:teuthology.orchestra.run.smithi091.stdout:(86/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-11-27T20:38:58.204 INFO:teuthology.orchestra.run.smithi183.stdout:(135/147): librados2-18.0.0-7498.g369173db.el9. 6.3 MB/s | 3.3 MB 00:00 2023-11-27T20:38:58.207 INFO:teuthology.orchestra.run.smithi091.stdout:(87/147): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-11-27T20:38:58.232 INFO:teuthology.orchestra.run.smithi091.stdout:(88/147): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-11-27T20:38:58.258 INFO:teuthology.orchestra.run.smithi091.stdout:(89/147): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-11-27T20:38:58.279 INFO:teuthology.orchestra.run.smithi183.stdout:(136/147): NetworkManager-libnm-1.45.6-1.el9.x8 11 MB/s | 1.8 MB 00:00 2023-11-27T20:38:58.283 INFO:teuthology.orchestra.run.smithi091.stdout:(90/147): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-11-27T20:38:58.305 INFO:teuthology.orchestra.run.smithi183.stdout:(137/147): NetworkManager-team-1.45.6-1.el9.x86 483 kB/s | 42 kB 00:00 2023-11-27T20:38:58.316 INFO:teuthology.orchestra.run.smithi091.stdout:(91/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-11-27T20:38:58.338 INFO:teuthology.orchestra.run.smithi183.stdout:(138/147): NetworkManager-tui-1.45.6-1.el9.x86_ 4.2 MB/s | 245 kB 00:00 2023-11-27T20:38:58.363 INFO:teuthology.orchestra.run.smithi183.stdout:(139/147): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-11-27T20:38:58.388 INFO:teuthology.orchestra.run.smithi183.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 749 kB/s | 36 kB 00:00 2023-11-27T20:38:58.444 INFO:teuthology.orchestra.run.smithi183.stdout:(141/147): elfutils-libelf-0.190-1.el9.x86_64.r 2.4 MB/s | 192 kB 00:00 2023-11-27T20:38:58.481 INFO:teuthology.orchestra.run.smithi183.stdout:(142/147): elfutils-libs-0.190-1.el9.x86_64.rpm 2.8 MB/s | 255 kB 00:00 2023-11-27T20:38:58.506 INFO:teuthology.orchestra.run.smithi183.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 370 kB/s | 22 kB 00:00 2023-11-27T20:38:58.540 INFO:teuthology.orchestra.run.smithi183.stdout:(144/147): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-11-27T20:38:58.632 INFO:teuthology.orchestra.run.smithi183.stdout:(145/147): librbd1-18.0.0-7498.g369173db.el9.x8 4.1 MB/s | 3.0 MB 00:00 2023-11-27T20:38:59.017 INFO:teuthology.orchestra.run.smithi091.stdout:(92/147): python3-devel-3.9.17-2.el9.x86_64.rpm 351 kB/s | 245 kB 00:00 2023-11-27T20:38:59.315 INFO:teuthology.orchestra.run.smithi183.stdout:(146/147): openssl-3.0.7-25.el9.x86_64.rpm 1.5 MB/s | 1.2 MB 00:00 2023-11-27T20:38:59.350 INFO:teuthology.orchestra.run.smithi091.stdout:(93/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.9 MB/s | 4.1 MB 00:01 2023-11-27T20:38:59.482 INFO:teuthology.orchestra.run.smithi183.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 2.3 MB/s | 2.2 MB 00:00 2023-11-27T20:38:59.489 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-11-27T20:38:59.490 INFO:teuthology.orchestra.run.smithi183.stdout:Total 15 MB/s | 204 MB 00:13 2023-11-27T20:38:59.716 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-11-27T20:38:59.785 INFO:teuthology.orchestra.run.smithi091.stdout:(94/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 404 kB/s | 309 kB 00:00 2023-11-27T20:38:59.901 INFO:teuthology.orchestra.run.smithi091.stdout:(95/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 210 kB/s | 24 kB 00:00 2023-11-27T20:38:59.995 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-11-27T20:38:59.996 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-11-27T20:39:00.334 INFO:teuthology.orchestra.run.smithi091.stdout:(96/147): ceph-test-18.0.0-7498.g369173db.el9.x 5.2 MB/s | 41 MB 00:07 2023-11-27T20:39:00.360 INFO:teuthology.orchestra.run.smithi091.stdout:(97/147): liboath-2.6.7-2.el9.x86_64.rpm 106 kB/s | 49 kB 00:00 2023-11-27T20:39:00.818 INFO:teuthology.orchestra.run.smithi091.stdout:(98/147): libunwind-1.6.2-1.el9.x86_64.rpm 140 kB/s | 67 kB 00:00 2023-11-27T20:39:01.443 INFO:teuthology.orchestra.run.smithi091.stdout:(99/147): libarrow-9.0.0-9.el9.x86_64.rpm 2.1 MB/s | 4.4 MB 00:02 2023-11-27T20:39:01.535 INFO:teuthology.orchestra.run.smithi091.stdout:(100/147): python3-asyncssh-2.13.2-3.el9.noarch 765 kB/s | 548 kB 00:00 2023-11-27T20:39:01.560 INFO:teuthology.orchestra.run.smithi091.stdout:(101/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 375 kB/s | 43 kB 00:00 2023-11-27T20:39:01.611 INFO:teuthology.orchestra.run.smithi091.stdout:(102/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 670 kB/s | 837 kB 00:01 2023-11-27T20:39:01.653 INFO:teuthology.orchestra.run.smithi091.stdout:(103/147): python3-cachetools-4.2.4-1.el9.noarc 276 kB/s | 32 kB 00:00 2023-11-27T20:39:01.678 INFO:teuthology.orchestra.run.smithi091.stdout:(104/147): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2023-11-27T20:39:01.728 INFO:teuthology.orchestra.run.smithi091.stdout:(105/147): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2023-11-27T20:39:01.787 INFO:teuthology.orchestra.run.smithi091.stdout:(106/147): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2023-11-27T20:39:01.854 INFO:teuthology.orchestra.run.smithi091.stdout:(107/147): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2023-11-27T20:39:01.904 INFO:teuthology.orchestra.run.smithi091.stdout:(108/147): python3-google-auth-2.23.4-1.el9.noa 877 kB/s | 197 kB 00:00 2023-11-27T20:39:01.921 INFO:teuthology.orchestra.run.smithi091.stdout:(109/147): python3-jaraco-classes-3.2.1-5.el9.n 133 kB/s | 18 kB 00:00 2023-11-27T20:39:01.963 INFO:teuthology.orchestra.run.smithi091.stdout:(110/147): python3-jaraco-collections-3.0.0-8.e 214 kB/s | 23 kB 00:00 2023-11-27T20:39:02.022 INFO:teuthology.orchestra.run.smithi091.stdout:(111/147): python3-jaraco-functools-3.5.0-2.el9 167 kB/s | 19 kB 00:00 2023-11-27T20:39:02.038 INFO:teuthology.orchestra.run.smithi091.stdout:(112/147): python3-jaraco-text-3.2.0-6.el9.noar 168 kB/s | 20 kB 00:00 2023-11-27T20:39:02.080 INFO:teuthology.orchestra.run.smithi091.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 77 kB/s | 9.0 kB 00:00 2023-11-27T20:39:02.139 INFO:teuthology.orchestra.run.smithi091.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 351 kB/s | 41 kB 00:00 2023-11-27T20:39:02.191 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-11-27T20:39:02.191 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-11-27T20:39:02.206 INFO:teuthology.orchestra.run.smithi091.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 371 kB/s | 46 kB 00:00 2023-11-27T20:39:02.264 INFO:teuthology.orchestra.run.smithi091.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 633 kB/s | 79 kB 00:00 2023-11-27T20:39:02.306 INFO:teuthology.orchestra.run.smithi091.stdout:(117/147): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2023-11-27T20:39:02.340 INFO:teuthology.orchestra.run.smithi091.stdout:(118/147): python3-natsort-7.1.1-5.el9.noarch.r 432 kB/s | 58 kB 00:00 2023-11-27T20:39:02.390 INFO:teuthology.orchestra.run.smithi091.stdout:(119/147): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2023-11-27T20:39:02.424 INFO:teuthology.orchestra.run.smithi091.stdout:(120/147): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2023-11-27T20:39:02.458 INFO:teuthology.orchestra.run.smithi091.stdout:(121/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 770 kB/s | 90 kB 00:00 2023-11-27T20:39:02.508 INFO:teuthology.orchestra.run.smithi091.stdout:(122/147): python3-repoze-lru-0.7-16.el9.noarch 263 kB/s | 31 kB 00:00 2023-11-27T20:39:02.542 INFO:teuthology.orchestra.run.smithi091.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-11-27T20:39:02.575 INFO:teuthology.orchestra.run.smithi091.stdout:(124/147): python3-rsa-4.9-2.el9.noarch.rpm 507 kB/s | 59 kB 00:00 2023-11-27T20:39:02.625 INFO:teuthology.orchestra.run.smithi091.stdout:(125/147): python3-tempora-5.0.0-2.el9.noarch.r 306 kB/s | 36 kB 00:00 2023-11-27T20:39:02.659 INFO:teuthology.orchestra.run.smithi091.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 437 kB/s | 51 kB 00:00 2023-11-27T20:39:02.701 INFO:teuthology.orchestra.run.smithi091.stdout:(127/147): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-11-27T20:39:02.743 INFO:teuthology.orchestra.run.smithi091.stdout:(128/147): python3-websocket-client-1.2.3-2.el9 768 kB/s | 90 kB 00:00 2023-11-27T20:39:02.818 INFO:teuthology.orchestra.run.smithi091.stdout:(129/147): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2023-11-27T20:39:02.877 INFO:teuthology.orchestra.run.smithi091.stdout:(130/147): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2023-11-27T20:39:02.969 INFO:teuthology.orchestra.run.smithi091.stdout:(131/147): python3-werkzeug-2.0.3-3.el9.1.noarc 1.4 MB/s | 427 kB 00:00 2023-11-27T20:39:03.452 INFO:teuthology.orchestra.run.smithi091.stdout:(132/147): librados2-18.0.0-7498.g369173db.el9. 5.8 MB/s | 3.3 MB 00:00 2023-11-27T20:39:03.494 INFO:teuthology.orchestra.run.smithi091.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-11-27T20:39:03.603 INFO:teuthology.orchestra.run.smithi091.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-11-27T20:39:03.686 INFO:teuthology.orchestra.run.smithi091.stdout:(135/147): librbd1-18.0.0-7498.g369173db.el9.x8 4.2 MB/s | 3.0 MB 00:00 2023-11-27T20:39:03.753 INFO:teuthology.orchestra.run.smithi091.stdout:(136/147): NetworkManager-libnm-1.45.6-1.el9.x8 12 MB/s | 1.8 MB 00:00 2023-11-27T20:39:03.812 INFO:teuthology.orchestra.run.smithi091.stdout:(137/147): thrift-0.15.0-2.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2023-11-27T20:39:03.837 INFO:teuthology.orchestra.run.smithi091.stdout:(138/147): NetworkManager-team-1.45.6-1.el9.x86 307 kB/s | 42 kB 00:00 2023-11-27T20:39:03.871 INFO:teuthology.orchestra.run.smithi091.stdout:(139/147): NetworkManager-tui-1.45.6-1.el9.x86_ 2.1 MB/s | 245 kB 00:00 2023-11-27T20:39:03.896 INFO:teuthology.orchestra.run.smithi091.stdout:(140/147): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-11-27T20:39:03.942 INFO:teuthology.orchestra.run.smithi091.stdout:(141/147): elfutils-debuginfod-client-0.190-1.e 360 kB/s | 36 kB 00:00 2023-11-27T20:39:03.971 INFO:teuthology.orchestra.run.smithi091.stdout:(142/147): elfutils-libelf-0.190-1.el9.x86_64.r 1.9 MB/s | 192 kB 00:00 2023-11-27T20:39:03.997 INFO:teuthology.orchestra.run.smithi091.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 427 kB/s | 22 kB 00:00 2023-11-27T20:39:04.030 INFO:teuthology.orchestra.run.smithi091.stdout:(144/147): elfutils-libs-0.190-1.el9.x86_64.rpm 2.9 MB/s | 255 kB 00:00 2023-11-27T20:39:04.064 INFO:teuthology.orchestra.run.smithi091.stdout:(145/147): xfsdump-3.1.12-4.el9.x86_64.rpm 3.4 MB/s | 321 kB 00:00 2023-11-27T20:39:04.297 INFO:teuthology.orchestra.run.smithi091.stdout:(146/147): openssl-3.0.7-25.el9.x86_64.rpm 4.1 MB/s | 1.2 MB 00:00 2023-11-27T20:39:04.381 INFO:teuthology.orchestra.run.smithi091.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 6.8 MB/s | 2.2 MB 00:00 2023-11-27T20:39:04.391 INFO:teuthology.orchestra.run.smithi091.stdout:-------------------------------------------------------------------------------- 2023-11-27T20:39:04.391 INFO:teuthology.orchestra.run.smithi091.stdout:Total 13 MB/s | 204 MB 00:16 2023-11-27T20:39:04.610 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction check 2023-11-27T20:39:04.886 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction check succeeded. 2023-11-27T20:39:04.886 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction test 2023-11-27T20:39:07.029 INFO:teuthology.orchestra.run.smithi091.stdout:Transaction test succeeded. 2023-11-27T20:39:07.029 INFO:teuthology.orchestra.run.smithi091.stdout:Running transaction 2023-11-27T20:39:08.658 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-11-27T20:39:08.827 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-27T20:39:08.873 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-27T20:39:08.951 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-27T20:39:09.001 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-27T20:39:09.031 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-27T20:39:09.121 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-27T20:39:09.547 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-27T20:39:09.596 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T20:39:09.752 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T20:39:09.789 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T20:39:09.910 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T20:39:09.955 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 10/162 2023-11-27T20:39:10.038 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-27T20:39:10.375 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-27T20:39:10.435 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-27T20:39:10.460 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 14/162 2023-11-27T20:39:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 14/162 2023-11-27T20:39:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 15/162 2023-11-27T20:39:10.753 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 15/162 2023-11-27T20:39:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-27T20:39:11.250 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-27T20:39:11.321 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-27T20:39:11.518 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T20:39:11.603 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T20:39:12.042 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T20:39:12.083 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-27T20:39:12.184 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-27T20:39:12.272 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-27T20:39:12.304 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-27T20:39:12.358 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-27T20:39:12.424 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-27T20:39:12.529 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-27T20:39:12.573 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-27T20:39:12.607 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-27T20:39:12.707 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-27T20:39:12.744 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 29/162 2023-11-27T20:39:12.794 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 30/162 2023-11-27T20:39:12.885 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 31/162 2023-11-27T20:39:13.063 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-27T20:39:13.131 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-27T20:39:13.176 INFO:teuthology.orchestra.run.smithi091.stdout: Preparing : 1/1 2023-11-27T20:39:13.328 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-27T20:39:13.363 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-27T20:39:13.443 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-27T20:39:13.501 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-27T20:39:13.539 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-27T20:39:13.625 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-27T20:39:13.839 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-27T20:39:13.938 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-27T20:39:13.993 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-27T20:39:14.054 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-27T20:39:14.102 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 38/162 2023-11-27T20:39:14.128 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-27T20:39:14.161 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-27T20:39:14.178 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : librados2-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T20:39:14.334 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librados2-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T20:39:14.371 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T20:39:14.402 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-27T20:39:14.496 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T20:39:14.537 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 10/162 2023-11-27T20:39:14.588 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-27T20:39:14.607 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-27T20:39:14.747 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-27T20:39:14.792 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-27T20:39:14.897 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-27T20:39:14.910 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-27T20:39:14.976 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-27T20:39:14.992 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-27T20:39:15.001 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 14/162 2023-11-27T20:39:15.035 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-27T20:39:15.067 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-27T20:39:15.141 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 14/162 2023-11-27T20:39:15.143 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-27T20:39:15.169 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 15/162 2023-11-27T20:39:15.200 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-27T20:39:15.251 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 15/162 2023-11-27T20:39:15.260 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-27T20:39:15.446 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-27T20:39:15.517 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-27T20:39:15.548 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-27T20:39:15.562 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-27T20:39:15.689 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-27T20:39:15.707 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-27T20:39:15.734 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-27T20:39:15.782 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-27T20:39:15.795 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-27T20:39:15.815 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-27T20:39:15.969 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-27T20:39:16.020 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-27T20:39:16.027 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T20:39:16.077 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T20:39:16.087 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-27T20:39:16.180 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-27T20:39:16.443 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-27T20:39:16.473 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T20:39:16.508 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-27T20:39:16.514 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-27T20:39:16.602 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-27T20:39:16.658 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-27T20:39:16.672 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-27T20:39:16.693 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-27T20:39:16.716 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-27T20:39:16.732 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-27T20:39:16.774 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-27T20:39:16.776 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-27T20:39:16.821 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-27T20:39:16.867 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-27T20:39:16.871 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-27T20:39:16.905 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-27T20:39:16.911 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-27T20:39:16.937 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-27T20:39:16.946 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-27T20:39:17.010 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-27T20:39:17.040 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-27T20:39:17.073 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-27T20:39:17.084 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 29/162 2023-11-27T20:39:17.122 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-27T20:39:17.134 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 30/162 2023-11-27T20:39:17.235 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 31/162 2023-11-27T20:39:17.252 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-27T20:39:17.300 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-27T20:39:17.410 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-27T20:39:17.411 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-27T20:39:17.479 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-27T20:39:17.486 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-27T20:39:17.522 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-27T20:39:17.666 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-27T20:39:17.710 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-27T20:39:17.848 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-27T20:39:17.925 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-27T20:39:18.164 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-27T20:39:18.266 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-27T20:39:18.327 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-27T20:39:18.592 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-27T20:39:18.658 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 38/162 2023-11-27T20:39:18.740 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-27T20:39:18.886 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-27T20:39:18.932 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-27T20:39:18.947 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-27T20:39:18.966 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-27T20:39:18.994 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-27T20:39:18.998 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-27T20:39:19.127 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-27T20:39:19.194 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-27T20:39:19.239 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-27T20:39:19.267 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-27T20:39:19.271 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-27T20:39:19.348 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-27T20:39:19.369 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-27T20:39:19.389 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-27T20:39:19.437 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-27T20:39:19.512 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-27T20:39:19.572 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-27T20:39:19.631 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-27T20:39:19.812 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-27T20:39:19.862 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-27T20:39:19.910 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-27T20:39:20.032 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-27T20:39:20.071 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-27T20:39:20.122 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-27T20:39:20.153 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-27T20:39:20.182 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-27T20:39:20.301 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-27T20:39:20.315 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-27T20:39:20.349 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-27T20:39:20.407 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-27T20:39:20.480 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-27T20:39:20.717 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-27T20:39:20.777 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-27T20:39:20.937 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-27T20:39:20.996 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-27T20:39:21.022 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-27T20:39:21.077 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-27T20:39:21.122 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-27T20:39:21.159 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-27T20:39:21.200 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-27T20:39:21.263 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-27T20:39:21.327 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-27T20:39:21.385 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-27T20:39:21.505 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-27T20:39:21.538 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-27T20:39:21.581 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-27T20:39:21.644 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-27T20:39:21.685 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-27T20:39:21.827 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-27T20:39:21.845 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-27T20:39:21.865 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-27T20:39:21.951 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-27T20:39:21.996 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-27T20:39:22.005 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-27T20:39:22.027 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-27T20:39:22.070 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-27T20:39:22.072 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-27T20:39:22.113 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-27T20:39:22.477 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-27T20:39:22.508 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 99/162 2023-11-27T20:39:22.627 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 99/162 2023-11-27T20:39:22.663 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 100/162 2023-11-27T20:39:22.718 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-27T20:39:22.988 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-27T20:39:23.037 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-27T20:39:23.070 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-27T20:39:23.103 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-27T20:39:23.192 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-27T20:39:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 103/162 2023-11-27T20:39:23.343 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 103/162 2023-11-27T20:39:23.351 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-27T20:39:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 104/162 2023-11-27T20:39:23.383 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-27T20:39:23.476 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-27T20:39:24.317 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-27T20:39:24.460 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-27T20:39:25.988 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-27T20:39:26.011 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T20:39:26.051 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T20:39:26.079 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-27T20:39:26.117 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-27T20:39:26.148 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-27T20:39:26.200 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-27T20:39:26.241 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-27T20:39:26.607 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-27T20:39:26.637 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 99/162 2023-11-27T20:39:26.674 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T20:39:26.721 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 106/162 2023-11-27T20:39:26.738 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 99/162 2023-11-27T20:39:26.758 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 100/162 2023-11-27T20:39:26.829 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-27T20:39:26.923 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 106/162 2023-11-27T20:39:26.923 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-27T20:39:26.923 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-27T20:39:26.924 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:26.972 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 107/162 2023-11-27T20:39:27.301 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-27T20:39:27.339 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 103/162 2023-11-27T20:39:27.430 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 103/162 2023-11-27T20:39:27.458 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 104/162 2023-11-27T20:39:29.933 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T20:39:29.971 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T20:39:30.588 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T20:39:30.633 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 106/162 2023-11-27T20:39:30.824 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 106/162 2023-11-27T20:39:30.824 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-27T20:39:30.824 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-27T20:39:30.825 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:30.867 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 107/162 2023-11-27T20:39:39.840 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 107/162 2023-11-27T20:39:39.840 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2023-11-27T20:39:39.840 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2023-11-27T20:39:39.840 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2023-11-27T20:39:39.841 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2023-11-27T20:39:39.841 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2023-11-27T20:39:39.841 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /root 2023-11-27T20:39:39.842 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2023-11-27T20:39:39.842 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:40.075 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 108/162 2023-11-27T20:39:40.120 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 108/162 2023-11-27T20:39:40.120 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:40.121 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-27T20:39:40.121 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:41.862 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 109/162 2023-11-27T20:39:41.944 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 109/162 2023-11-27T20:39:41.944 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:41.944 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-27T20:39:41.944 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T20:39:41.944 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T20:39:41.944 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:42.172 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 110/162 2023-11-27T20:39:42.244 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 110/162 2023-11-27T20:39:42.244 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:42.244 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-27T20:39:42.244 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T20:39:42.244 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T20:39:42.244 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:42.731 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 111/162 2023-11-27T20:39:43.953 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 107/162 2023-11-27T20:39:43.953 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /sys 2023-11-27T20:39:43.953 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /proc 2023-11-27T20:39:43.953 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /mnt 2023-11-27T20:39:43.953 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /var/tmp 2023-11-27T20:39:43.953 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /home 2023-11-27T20:39:43.953 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /root 2023-11-27T20:39:43.954 INFO:teuthology.orchestra.run.smithi091.stdout:skipping the directory /tmp 2023-11-27T20:39:43.954 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:43.954 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 108/162 2023-11-27T20:39:43.954 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 108/162 2023-11-27T20:39:43.954 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:43.954 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-27T20:39:43.954 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 111/162 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:18.0.0-7498.g369173db.el9.noarch 113/162 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:18.0.0-7498.g369173db.el9.noarch 113/162 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 114/162 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 115/162 2023-11-27T20:39:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 116/162 2023-11-27T20:39:44.153 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 116/162 2023-11-27T20:39:44.190 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 117/162 2023-11-27T20:39:45.326 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 117/162 2023-11-27T20:39:45.357 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 118/162 2023-11-27T20:39:45.500 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 118/162 2023-11-27T20:39:45.631 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 109/162 2023-11-27T20:39:45.672 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 119/162 2023-11-27T20:39:45.709 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 120/162 2023-11-27T20:39:45.714 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 109/162 2023-11-27T20:39:45.714 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:45.714 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-27T20:39:45.714 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T20:39:45.714 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T20:39:45.714 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:45.782 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 120/162 2023-11-27T20:39:45.782 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:45.783 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-27T20:39:45.783 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T20:39:45.783 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T20:39:45.783 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:45.842 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 121/162 2023-11-27T20:39:45.881 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 121/162 2023-11-27T20:39:45.939 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 110/162 2023-11-27T20:39:45.971 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:18.0.0-7498.g369173db.el9.x86_64 122/162 2023-11-27T20:39:46.032 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 110/162 2023-11-27T20:39:46.032 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:46.032 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-27T20:39:46.032 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T20:39:46.032 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T20:39:46.032 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:46.507 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 111/162 2023-11-27T20:39:46.597 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 111/162 2023-11-27T20:39:46.597 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:46.597 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-27T20:39:46.597 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T20:39:46.597 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T20:39:46.597 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:46.717 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-27T20:39:46.875 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-27T20:39:46.911 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 124/162 2023-11-27T20:39:46.982 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 124/162 2023-11-27T20:39:46.982 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:46.982 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-27T20:39:46.982 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T20:39:46.983 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T20:39:46.983 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:47.028 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7498.g36917 125/162 2023-11-27T20:39:47.098 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7498.g36917 125/162 2023-11-27T20:39:47.099 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:47.099 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-27T20:39:47.099 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:47.171 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 126/162 2023-11-27T20:39:47.269 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 126/162 2023-11-27T20:39:47.269 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:47.269 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-27T20:39:47.269 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T20:39:47.269 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T20:39:47.269 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:47.323 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: cephadm-2:18.0.0-7498.g369173db.el9.noarch 113/162 2023-11-27T20:39:47.359 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : cephadm-2:18.0.0-7498.g369173db.el9.noarch 113/162 2023-11-27T20:39:47.404 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 114/162 2023-11-27T20:39:47.498 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 115/162 2023-11-27T20:39:47.522 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 116/162 2023-11-27T20:39:47.646 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/162 2023-11-27T20:39:47.720 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/162 2023-11-27T20:39:47.720 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:47.720 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-27T20:39:47.720 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T20:39:47.720 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T20:39:47.720 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:47.839 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 116/162 2023-11-27T20:39:47.881 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 117/162 2023-11-27T20:39:49.008 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 117/162 2023-11-27T20:39:49.039 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 118/162 2023-11-27T20:39:49.181 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 118/162 2023-11-27T20:39:49.347 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 119/162 2023-11-27T20:39:49.375 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 120/162 2023-11-27T20:39:49.468 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 120/162 2023-11-27T20:39:49.468 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:49.468 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-27T20:39:49.468 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T20:39:49.469 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T20:39:49.469 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:49.525 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 121/162 2023-11-27T20:39:49.565 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 121/162 2023-11-27T20:39:49.634 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-2:18.0.0-7498.g369173db.el9.x86_64 122/162 2023-11-27T20:39:50.476 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-27T20:39:50.519 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 124/162 2023-11-27T20:39:50.606 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 124/162 2023-11-27T20:39:50.606 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:50.606 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-27T20:39:50.607 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T20:39:50.607 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T20:39:50.607 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:50.653 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7498.g36917 125/162 2023-11-27T20:39:50.729 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7498.g36917 125/162 2023-11-27T20:39:50.729 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:50.729 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-27T20:39:50.729 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:50.814 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 126/162 2023-11-27T20:39:50.894 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 126/162 2023-11-27T20:39:50.894 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:50.895 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-27T20:39:50.895 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T20:39:50.895 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T20:39:50.895 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:51.283 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/162 2023-11-27T20:39:51.354 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/162 2023-11-27T20:39:51.354 INFO:teuthology.orchestra.run.smithi091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T20:39:51.354 INFO:teuthology.orchestra.run.smithi091.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-27T20:39:51.355 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T20:39:51.355 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T20:39:51.355 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:39:51.859 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 128/162 2023-11-27T20:39:51.912 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 129/162 2023-11-27T20:39:51.976 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 130/162 2023-11-27T20:39:52.008 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-27T20:39:52.285 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-27T20:39:52.416 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-27T20:39:52.455 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 134/162 2023-11-27T20:39:52.489 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 135/162 2023-11-27T20:39:52.528 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-27T20:39:52.560 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-27T20:39:52.664 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-27T20:39:52.735 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-27T20:39:52.774 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-27T20:39:53.788 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T20:39:53.830 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T20:39:53.889 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T20:39:55.237 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 142/162 2023-11-27T20:39:55.360 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-27T20:39:55.417 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-27T20:39:55.479 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 128/162 2023-11-27T20:39:55.487 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-27T20:39:55.557 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 129/162 2023-11-27T20:39:55.622 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 130/162 2023-11-27T20:39:55.646 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-27T20:39:55.661 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-27T20:39:55.688 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-27T20:39:55.722 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-27T20:39:55.756 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-27T20:39:55.798 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-27T20:39:55.798 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-27T20:39:55.938 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-27T20:39:55.981 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-27T20:39:56.032 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-27T20:39:56.067 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-27T20:39:56.078 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-27T20:39:56.098 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 134/162 2023-11-27T20:39:56.131 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 135/162 2023-11-27T20:39:56.135 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-27T20:39:56.135 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-27T20:39:56.179 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-27T20:39:56.218 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-27T20:39:56.334 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-27T20:39:56.348 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-27T20:39:56.378 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-27T20:39:56.398 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-27T20:39:56.427 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T20:39:56.427 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T20:39:56.442 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-27T20:39:56.786 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T20:39:56.786 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-27T20:39:56.929 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-27T20:39:56.965 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-27T20:39:56.998 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-27T20:39:57.034 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-27T20:39:57.159 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-27T20:39:57.327 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T20:39:57.373 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T20:39:57.402 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-27T20:39:57.402 INFO:teuthology.orchestra.run.smithi183.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-27T20:39:57.402 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:39:57.429 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T20:39:58.748 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 142/162 2023-11-27T20:39:58.870 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-27T20:39:58.943 INFO:teuthology.orchestra.run.smithi091.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-27T20:39:59.018 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-27T20:39:59.166 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-27T20:39:59.206 INFO:teuthology.orchestra.run.smithi091.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-27T20:39:59.239 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-27T20:39:59.274 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-27T20:39:59.316 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-27T20:39:59.316 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-27T20:39:59.439 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-27T20:39:59.490 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-27T20:39:59.537 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-27T20:39:59.568 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-27T20:39:59.569 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-27T20:39:59.707 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-27T20:39:59.737 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-27T20:39:59.778 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T20:39:59.779 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T20:40:00.078 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T20:40:00.078 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-27T20:40:00.220 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-27T20:40:00.256 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-27T20:40:00.290 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-27T20:40:00.325 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-27T20:40:00.451 INFO:teuthology.orchestra.run.smithi091.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-27T20:40:00.704 INFO:teuthology.orchestra.run.smithi091.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-27T20:40:00.704 INFO:teuthology.orchestra.run.smithi091.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-27T20:40:00.704 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:02.005 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:18.0.0-7498.g369173db.el9.x86_64 1/162 2023-11-27T20:40:02.005 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2/162 2023-11-27T20:40:02.005 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 3/162 2023-11-27T20:40:02.005 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 4/162 2023-11-27T20:40:02.005 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7498.g36917 5/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 6/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 7/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 10/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 11/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 12/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 13/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 14/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 15/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 16/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 17/162 2023-11-27T20:40:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 18/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 19/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 20/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 21/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 22/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 23/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 24/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 25/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 26/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 27/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 28/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 29/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 30/162 2023-11-27T20:40:02.007 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 31/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 32/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 33/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 34/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 35/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 36/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:18.0.0-7498.g369173db.el9.noarch 37/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 38/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-27T20:40:02.008 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-27T20:40:02.009 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-27T20:40:02.010 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-27T20:40:02.010 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-27T20:40:02.010 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-27T20:40:02.010 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-27T20:40:02.010 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-27T20:40:02.010 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-27T20:40:02.010 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-27T20:40:02.010 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-27T20:40:02.010 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-27T20:40:02.010 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-27T20:40:02.011 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-27T20:40:02.012 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-27T20:40:02.013 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-27T20:40:02.014 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:18.0.0-7498.g369173db.el9.x86_64 133/162 2023-11-27T20:40:02.015 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 135/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-27T20:40:02.016 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-27T20:40:02.017 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-27T20:40:04.153 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-27T20:40:04.153 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: acl-2.3.1-4.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.154 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: automake-1.16.2-8.el9.noarch 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: bison-3.7.4-5.el9.x86_64 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.155 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:04.156 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: flex-2.6.4-9.el9.x86_64 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-27T20:40:04.157 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: jq-1.6-16.el9.x86_64 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-27T20:40:04.158 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-27T20:40:04.159 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-13.11-1.el9.x86_64 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-27T20:40:04.160 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-27T20:40:04.161 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-27T20:40:04.162 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply-3.11-14.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-27T20:40:04.163 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-27T20:40:04.164 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: re2-1:20211101-3.el9.x86_64 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-27T20:40:04.165 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-27T20:40:04.166 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-27T20:40:04.166 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:04.166 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-11-27T20:40:04.820 DEBUG:teuthology.parallel:result is None 2023-11-27T20:40:05.415 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-2:18.0.0-7498.g369173db.el9.x86_64 1/162 2023-11-27T20:40:05.415 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2/162 2023-11-27T20:40:05.415 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 3/162 2023-11-27T20:40:05.415 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 4/162 2023-11-27T20:40:05.415 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7498.g36917 5/162 2023-11-27T20:40:05.415 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 6/162 2023-11-27T20:40:05.415 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 7/162 2023-11-27T20:40:05.415 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T20:40:05.415 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 10/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 11/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 12/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 13/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 14/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 15/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 16/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 17/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 18/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 19/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 20/162 2023-11-27T20:40:05.416 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 21/162 2023-11-27T20:40:05.417 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 22/162 2023-11-27T20:40:05.417 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 23/162 2023-11-27T20:40:05.417 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 24/162 2023-11-27T20:40:05.417 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 25/162 2023-11-27T20:40:05.417 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 26/162 2023-11-27T20:40:05.417 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 27/162 2023-11-27T20:40:05.428 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 28/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 29/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 30/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 31/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 32/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 33/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 34/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 35/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 36/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : cephadm-2:18.0.0-7498.g369173db.el9.noarch 37/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 38/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-27T20:40:05.429 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-27T20:40:05.430 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-27T20:40:05.430 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-27T20:40:05.430 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-27T20:40:05.430 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-27T20:40:05.430 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-27T20:40:05.430 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-27T20:40:05.430 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-27T20:40:05.430 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-27T20:40:05.430 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-27T20:40:05.430 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-27T20:40:05.431 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-27T20:40:05.432 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-27T20:40:05.433 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-27T20:40:05.434 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-27T20:40:05.435 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-27T20:40:05.436 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-27T20:40:05.437 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-27T20:40:05.437 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-27T20:40:05.437 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-27T20:40:05.437 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-27T20:40:05.437 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-27T20:40:05.437 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-27T20:40:05.437 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-27T20:40:05.437 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-27T20:40:05.437 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librados2-2:18.0.0-7498.g369173db.el9.x86_64 133/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 135/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-27T20:40:05.438 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-27T20:40:05.439 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-27T20:40:05.440 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-27T20:40:05.440 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-27T20:40:05.440 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-27T20:40:05.440 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-27T20:40:05.440 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-27T20:40:05.440 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-27T20:40:05.440 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-27T20:40:07.565 INFO:teuthology.orchestra.run.smithi091.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-27T20:40:07.565 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:07.565 INFO:teuthology.orchestra.run.smithi091.stdout:Upgraded: 2023-11-27T20:40:07.565 INFO:teuthology.orchestra.run.smithi091.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-27T20:40:07.565 INFO:teuthology.orchestra.run.smithi091.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-27T20:40:07.565 INFO:teuthology.orchestra.run.smithi091.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-27T20:40:07.565 INFO:teuthology.orchestra.run.smithi091.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-27T20:40:07.565 INFO:teuthology.orchestra.run.smithi091.stdout: acl-2.3.1-4.el9.x86_64 2023-11-27T20:40:07.565 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout: librados2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout:Installed: 2023-11-27T20:40:07.566 INFO:teuthology.orchestra.run.smithi091.stdout: automake-1.16.2-8.el9.noarch 2023-11-27T20:40:07.567 INFO:teuthology.orchestra.run.smithi091.stdout: bison-3.7.4-5.el9.x86_64 2023-11-27T20:40:07.567 INFO:teuthology.orchestra.run.smithi091.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-27T20:40:07.567 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.567 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.567 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.568 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.568 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-grafana-dashboards-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:07.568 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-immutable-object-cache-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.568 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.568 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.568 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:07.569 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:07.569 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:07.569 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:07.569 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:07.569 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.570 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.570 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-prometheus-alerts-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:07.570 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.570 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.570 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.571 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:07.571 INFO:teuthology.orchestra.run.smithi091.stdout: cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:07.571 INFO:teuthology.orchestra.run.smithi091.stdout: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.571 INFO:teuthology.orchestra.run.smithi091.stdout: cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T20:40:07.571 INFO:teuthology.orchestra.run.smithi091.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-27T20:40:07.571 INFO:teuthology.orchestra.run.smithi091.stdout: flex-2.6.4-9.el9.x86_64 2023-11-27T20:40:07.572 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-27T20:40:07.572 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-27T20:40:07.572 INFO:teuthology.orchestra.run.smithi091.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-27T20:40:07.572 INFO:teuthology.orchestra.run.smithi091.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-27T20:40:07.572 INFO:teuthology.orchestra.run.smithi091.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-27T20:40:07.573 INFO:teuthology.orchestra.run.smithi091.stdout: jq-1.6-16.el9.x86_64 2023-11-27T20:40:07.573 INFO:teuthology.orchestra.run.smithi091.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-27T20:40:07.573 INFO:teuthology.orchestra.run.smithi091.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-27T20:40:07.573 INFO:teuthology.orchestra.run.smithi091.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-27T20:40:07.573 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.573 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.574 INFO:teuthology.orchestra.run.smithi091.stdout: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.574 INFO:teuthology.orchestra.run.smithi091.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-27T20:40:07.574 INFO:teuthology.orchestra.run.smithi091.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-27T20:40:07.574 INFO:teuthology.orchestra.run.smithi091.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-27T20:40:07.574 INFO:teuthology.orchestra.run.smithi091.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-27T20:40:07.574 INFO:teuthology.orchestra.run.smithi091.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-27T20:40:07.575 INFO:teuthology.orchestra.run.smithi091.stdout: librados-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.575 INFO:teuthology.orchestra.run.smithi091.stdout: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.575 INFO:teuthology.orchestra.run.smithi091.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-27T20:40:07.575 INFO:teuthology.orchestra.run.smithi091.stdout: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.575 INFO:teuthology.orchestra.run.smithi091.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-27T20:40:07.576 INFO:teuthology.orchestra.run.smithi091.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-27T20:40:07.576 INFO:teuthology.orchestra.run.smithi091.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-27T20:40:07.576 INFO:teuthology.orchestra.run.smithi091.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-27T20:40:07.576 INFO:teuthology.orchestra.run.smithi091.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-27T20:40:07.576 INFO:teuthology.orchestra.run.smithi091.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-27T20:40:07.576 INFO:teuthology.orchestra.run.smithi091.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-27T20:40:07.577 INFO:teuthology.orchestra.run.smithi091.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-27T20:40:07.577 INFO:teuthology.orchestra.run.smithi091.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-27T20:40:07.577 INFO:teuthology.orchestra.run.smithi091.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-27T20:40:07.577 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-13.11-1.el9.x86_64 2023-11-27T20:40:07.577 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-27T20:40:07.578 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-27T20:40:07.578 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-27T20:40:07.578 INFO:teuthology.orchestra.run.smithi091.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-27T20:40:07.578 INFO:teuthology.orchestra.run.smithi091.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-27T20:40:07.578 INFO:teuthology.orchestra.run.smithi091.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-27T20:40:07.578 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-27T20:40:07.579 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-argparse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.579 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.579 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.579 INFO:teuthology.orchestra.run.smithi091.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-27T20:40:07.579 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-27T20:40:07.580 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-27T20:40:07.580 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-27T20:40:07.580 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-27T20:40:07.580 INFO:teuthology.orchestra.run.smithi091.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-27T20:40:07.580 INFO:teuthology.orchestra.run.smithi091.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-27T20:40:07.580 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-27T20:40:07.581 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-27T20:40:07.581 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-27T20:40:07.581 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-27T20:40:07.581 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-27T20:40:07.581 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-27T20:40:07.581 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-27T20:40:07.582 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-27T20:40:07.582 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-27T20:40:07.582 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-27T20:40:07.582 INFO:teuthology.orchestra.run.smithi091.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-27T20:40:07.582 INFO:teuthology.orchestra.run.smithi091.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-27T20:40:07.583 INFO:teuthology.orchestra.run.smithi091.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-27T20:40:07.583 INFO:teuthology.orchestra.run.smithi091.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-27T20:40:07.583 INFO:teuthology.orchestra.run.smithi091.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-27T20:40:07.583 INFO:teuthology.orchestra.run.smithi091.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-27T20:40:07.583 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-27T20:40:07.583 INFO:teuthology.orchestra.run.smithi091.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-27T20:40:07.584 INFO:teuthology.orchestra.run.smithi091.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-27T20:40:07.584 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-27T20:40:07.584 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ply-3.11-14.el9.noarch 2023-11-27T20:40:07.584 INFO:teuthology.orchestra.run.smithi091.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-27T20:40:07.584 INFO:teuthology.orchestra.run.smithi091.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-27T20:40:07.584 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-27T20:40:07.585 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-27T20:40:07.585 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-27T20:40:07.585 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-27T20:40:07.585 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-27T20:40:07.585 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.586 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.586 INFO:teuthology.orchestra.run.smithi091.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-27T20:40:07.586 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-27T20:40:07.586 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-27T20:40:07.586 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.586 INFO:teuthology.orchestra.run.smithi091.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-27T20:40:07.586 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-27T20:40:07.586 INFO:teuthology.orchestra.run.smithi091.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-27T20:40:07.586 INFO:teuthology.orchestra.run.smithi091.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: re2-1:20211101-3.el9.x86_64 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-27T20:40:07.587 INFO:teuthology.orchestra.run.smithi091.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-27T20:40:07.588 INFO:teuthology.orchestra.run.smithi091.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-27T20:40:07.588 INFO:teuthology.orchestra.run.smithi091.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-27T20:40:07.588 INFO:teuthology.orchestra.run.smithi091.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-27T20:40:07.588 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:07.588 INFO:teuthology.orchestra.run.smithi091.stdout:Complete! 2023-11-27T20:40:08.156 DEBUG:teuthology.parallel:result is None 2023-11-27T20:40:16.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:40:17.172 DEBUG:teuthology.orchestra.run.smithi091:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-27T20:40:17.239 INFO:teuthology.orchestra.run.smithi091.stdout:18.0.0-7498.g369173db.el9 2023-11-27T20:40:17.239 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498.g369173db.el9 2023-11-27T20:40:17.239 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498.g369173db is installed. 2023-11-27T20:40:17.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T20:40:17.475 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-27T20:40:17.552 INFO:teuthology.orchestra.run.smithi183.stdout:18.0.0-7498.g369173db.el9 2023-11-27T20:40:17.552 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498.g369173db.el9 2023-11-27T20:40:17.553 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498.g369173db is installed. 2023-11-27T20:40:17.553 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-27T20:40:17.553 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:17.553 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T20:40:17.660 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:40:17.660 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T20:40:17.762 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-27T20:40:17.763 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:17.763 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T20:40:17.863 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T20:40:17.960 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:40:17.960 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T20:40:18.067 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T20:40:18.165 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-27T20:40:18.165 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:18.165 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T20:40:18.264 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T20:40:18.404 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:40:18.405 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T20:40:18.498 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T20:40:18.641 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-27T20:40:18.641 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:18.641 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T20:40:18.744 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T20:40:18.840 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:40:18.840 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T20:40:18.944 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T20:40:19.040 INFO:teuthology.run_tasks:Running task ceph... 2023-11-27T20:40:19.110 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-27T20:40:19.110 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 777 /var/log/ceph 2023-11-27T20:40:19.119 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2023-11-27T20:40:19.220 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-27T20:40:19.220 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T20:40:19.229 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T20:40:19.329 INFO:tasks.ceph:Creating extra log directories... 2023-11-27T20:40:19.329 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T20:40:19.337 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T20:40:19.469 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-27T20:40:19.470 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-27T20:40:19.470 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-27T20:40:19.470 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:19.470 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T20:40:19.530 DEBUG:teuthology.orchestra.run.smithi091:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:19.794 DEBUG:teuthology.orchestra.run.smithi091:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:19.892 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:40:19.892 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T20:40:19.950 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:20.218 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:20.318 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-27T20:40:20.318 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-27T20:40:20.318 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095', 'branch': 'wip-yuri10-testing-2023-11-22-1112', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7468095', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2023-11-22-1112'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2023-11-22-1112', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 8541, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri10-testing-2023-11-22-1112', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi091.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB+aDIgyZeykydm9A9IY8KEPxFaJTJ8U9RFQ0TkOX8xkFhmbk8EZArlIfGFd1GGFr5a+7I1/leBcH/V0ZsRznPQ=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMk7sAoQg+/QFBG4CYfDi5njJ3fAiSX5DNIES7pEEhrAcS6aFaA/E64lzy/gdGHlXBSIYcSYoqCMRyS3WvywXg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-27_17:14:24', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-27T20:40:20.319 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T20:40:20.328 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T20:40:20.382 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T20:40:20.388 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T20:40:20.481 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:20.482 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T20:40:20.538 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T20:40:20.539 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_1 2023-11-27T20:40:20.591 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T20:40:20.591 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:40:20.591 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 631 Links: 1 2023-11-27T20:40:20.591 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:40:20.592 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:40:20.592 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-27 20:40:01.174176349 +0000 2023-11-27T20:40:20.592 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-27 20:37:29.191773990 +0000 2023-11-27T20:40:20.592 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-27 20:37:29.192773964 +0000 2023-11-27T20:40:20.592 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: 2023-11-27 20:37:29.191773990 +0000 2023-11-27T20:40:20.592 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T20:40:20.681 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-27T20:40:20.681 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-27T20:40:20.681 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000328318 s, 1.6 MB/s 2023-11-27T20:40:20.685 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T20:40:20.742 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_2 2023-11-27T20:40:20.792 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T20:40:20.793 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:40:20.793 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-11-27T20:40:20.793 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:40:20.793 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:40:20.794 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-27 20:40:01.175176324 +0000 2023-11-27T20:40:20.794 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-27 20:37:30.182749117 +0000 2023-11-27T20:40:20.794 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-27 20:37:30.182749117 +0000 2023-11-27T20:40:20.794 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: 2023-11-27 20:37:30.182749117 +0000 2023-11-27T20:40:20.795 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T20:40:20.886 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-27T20:40:20.886 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-27T20:40:20.886 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000326562 s, 1.6 MB/s 2023-11-27T20:40:20.889 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T20:40:20.946 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_3 2023-11-27T20:40:20.996 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T20:40:20.997 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:40:20.997 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-11-27T20:40:20.997 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:40:20.997 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:40:20.997 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-27 20:40:01.176176298 +0000 2023-11-27T20:40:20.997 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-27 20:37:31.192723768 +0000 2023-11-27T20:40:20.997 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-27 20:37:31.192723768 +0000 2023-11-27T20:40:20.997 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: 2023-11-27 20:37:31.192723768 +0000 2023-11-27T20:40:20.997 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T20:40:21.085 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-27T20:40:21.085 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-27T20:40:21.085 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000323868 s, 1.6 MB/s 2023-11-27T20:40:21.089 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T20:40:21.148 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_4 2023-11-27T20:40:21.200 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T20:40:21.201 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:40:21.201 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-11-27T20:40:21.201 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:40:21.201 INFO:teuthology.orchestra.run.smithi091.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:40:21.201 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-27 20:40:01.176176298 +0000 2023-11-27T20:40:21.201 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-27 20:37:32.211698193 +0000 2023-11-27T20:40:21.201 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-27 20:37:32.211698193 +0000 2023-11-27T20:40:21.201 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: 2023-11-27 20:37:32.211698193 +0000 2023-11-27T20:40:21.201 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T20:40:21.284 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-27T20:40:21.284 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-27T20:40:21.284 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000307522 s, 1.7 MB/s 2023-11-27T20:40:21.287 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T20:40:21.342 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T20:40:21.343 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:40:21.343 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T20:40:21.402 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T20:40:21.402 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2023-11-27T20:40:21.456 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T20:40:21.456 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:40:21.456 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-11-27T20:40:21.456 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:40:21.456 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:40:21.457 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-11-27 20:39:57.818543725 +0000 2023-11-27T20:40:21.457 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-11-27 20:37:29.797192372 +0000 2023-11-27T20:40:21.457 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-11-27 20:37:29.797192372 +0000 2023-11-27T20:40:21.457 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-11-27 20:37:29.797192372 +0000 2023-11-27T20:40:21.457 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T20:40:21.540 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-11-27T20:40:21.540 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-11-27T20:40:21.540 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000333914 s, 1.5 MB/s 2023-11-27T20:40:21.544 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T20:40:21.601 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2023-11-27T20:40:21.651 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T20:40:21.652 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:40:21.652 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-11-27T20:40:21.652 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:40:21.652 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:40:21.652 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-11-27 20:39:57.819543699 +0000 2023-11-27T20:40:21.652 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-11-27 20:37:30.810165552 +0000 2023-11-27T20:40:21.652 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-11-27 20:37:30.810165552 +0000 2023-11-27T20:40:21.652 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-11-27 20:37:30.810165552 +0000 2023-11-27T20:40:21.652 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T20:40:21.740 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-11-27T20:40:21.741 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-11-27T20:40:21.741 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000328193 s, 1.6 MB/s 2023-11-27T20:40:21.744 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T20:40:21.799 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2023-11-27T20:40:21.849 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T20:40:21.849 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:40:21.849 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-11-27T20:40:21.849 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:40:21.849 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:40:21.850 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-11-27 20:39:57.820543673 +0000 2023-11-27T20:40:21.850 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-11-27 20:37:31.803139262 +0000 2023-11-27T20:40:21.850 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-11-27 20:37:31.803139262 +0000 2023-11-27T20:40:21.850 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-11-27 20:37:31.803139262 +0000 2023-11-27T20:40:21.851 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T20:40:21.941 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-11-27T20:40:21.941 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-11-27T20:40:21.942 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.00032439 s, 1.6 MB/s 2023-11-27T20:40:21.946 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T20:40:22.003 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2023-11-27T20:40:22.054 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T20:40:22.054 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T20:40:22.054 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 691 Links: 1 2023-11-27T20:40:22.055 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T20:40:22.055 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T20:40:22.055 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-11-27 20:39:57.820543673 +0000 2023-11-27T20:40:22.055 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-11-27 20:37:32.808112653 +0000 2023-11-27T20:40:22.055 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-11-27 20:37:32.808112653 +0000 2023-11-27T20:40:22.055 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-11-27 20:37:32.808112653 +0000 2023-11-27T20:40:22.055 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T20:40:22.140 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-11-27T20:40:22.140 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-11-27T20:40:22.141 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000335818 s, 1.5 MB/s 2023-11-27T20:40:22.144 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T20:40:22.199 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T20:40:22.200 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T20:40:22.200 INFO:tasks.ceph:Generating config... 2023-11-27T20:40:22.201 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-27T20:40:22.201 INFO:tasks.ceph:[client] debug client = 20 2023-11-27T20:40:22.201 INFO:tasks.ceph:[client] debug ms = 1 2023-11-27T20:40:22.201 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-27T20:40:22.201 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-27T20:40:22.201 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-27T20:40:22.201 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-27T20:40:22.201 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-27T20:40:22.201 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-27T20:40:22.202 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-27T20:40:22.203 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-27T20:40:22.203 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-27T20:40:22.204 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-27T20:40:22.204 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-27T20:40:22.204 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-27T20:40:22.204 INFO:tasks.ceph:Setting up mon.a... 2023-11-27T20:40:22.204 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-27T20:40:22.351 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.keyring 2023-11-27T20:40:22.359 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-27T20:40:22.491 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T20:40:22.590 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.91'), ('mon.b', '172.21.15.183'), ('mon.c', '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]')] 2023-11-27T20:40:22.590 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.91,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-27T20:40:22.591 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:22.591 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T20:40:22.648 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.91 --add b 172.21.15.183 --addv c '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:22.806 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:22.807 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: generated fsid 76812701-65a9-4deb-87af-ef00110d1601 2023-11-27T20:40:22.807 INFO:teuthology.orchestra.run.smithi091.stdout:setting min_mon_release = quincy 2023-11-27T20:40:22.807 INFO:teuthology.orchestra.run.smithi091.stdout:epoch 0 2023-11-27T20:40:22.807 INFO:teuthology.orchestra.run.smithi091.stdout:fsid 76812701-65a9-4deb-87af-ef00110d1601 2023-11-27T20:40:22.807 INFO:teuthology.orchestra.run.smithi091.stdout:last_changed 2023-11-27T20:40:22.806835+0000 2023-11-27T20:40:22.807 INFO:teuthology.orchestra.run.smithi091.stdout:created 2023-11-27T20:40:22.806835+0000 2023-11-27T20:40:22.807 INFO:teuthology.orchestra.run.smithi091.stdout:min_mon_release 17 (quincy) 2023-11-27T20:40:22.807 INFO:teuthology.orchestra.run.smithi091.stdout:election_strategy: 1 2023-11-27T20:40:22.807 INFO:teuthology.orchestra.run.smithi091.stdout:0: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.a 2023-11-27T20:40:22.807 INFO:teuthology.orchestra.run.smithi091.stdout:1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.b 2023-11-27T20:40:22.808 INFO:teuthology.orchestra.run.smithi091.stdout:2: [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] mon.c 2023-11-27T20:40:22.808 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-27T20:40:22.810 DEBUG:teuthology.orchestra.run.smithi091:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T20:40:22.859 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 76812701-65a9-4deb-87af-ef00110d1601... 2023-11-27T20:40:22.860 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T20:40:22.865 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T20:40:23.029 INFO:teuthology.orchestra.run.smithi091.stdout:[global] 2023-11-27T20:40:23.029 INFO:teuthology.orchestra.run.smithi091.stdout: chdir = "" 2023-11-27T20:40:23.029 INFO:teuthology.orchestra.run.smithi091.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T20:40:23.029 INFO:teuthology.orchestra.run.smithi091.stdout: auth supported = cephx 2023-11-27T20:40:23.029 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.029 INFO:teuthology.orchestra.run.smithi091.stdout: filestore xattr use omap = true 2023-11-27T20:40:23.029 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.029 INFO:teuthology.orchestra.run.smithi091.stdout: mon clock drift allowed = 1.000 2023-11-27T20:40:23.029 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: osd crush chooseleaf type = 0 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: auth debug = true 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on old message = true 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on bug = true 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: mon pg warn max object skew = 0 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T20:40:23.030 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default size = 2 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow primary affinity = true 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow pg remap = true 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on legacy crush tunables = false 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on crush straw calc version zero = false 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on no sortbitwise = false 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on osd down out interval zero = false 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on too few osds = false 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: mon_allow_pool_size_one = true 2023-11-27T20:40:23.031 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: osd default data pool replay window = 5 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: mon allow pool delete = true 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: mon cluster log file level = debug 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: debug asserts on shutdown = true 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: mon health detail to clog = false 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: mon host = "172.21.15.91,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on skipped message = False 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: fsid = 76812701-65a9-4deb-87af-ef00110d1601 2023-11-27T20:40:23.032 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout:[osd] 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: osd journal size = 100 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub load threshold = 5.0 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub max interval = 600 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: osd mclock profile = high_recovery_ops 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: osd recover clone overlap = true 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: osd recovery max chunk = 1048576 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug shutdown = true 2023-11-27T20:40:23.033 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug op order = true 2023-11-27T20:40:23.034 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug verify stray on activate = true 2023-11-27T20:40:23.034 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug trim objects = true 2023-11-27T20:40:23.034 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.034 INFO:teuthology.orchestra.run.smithi091.stdout: osd open classes on start = true 2023-11-27T20:40:23.034 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug pg log writeout = true 2023-11-27T20:40:23.034 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.034 INFO:teuthology.orchestra.run.smithi091.stdout: osd deep scrub update digest min age = 30 2023-11-27T20:40:23.034 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.034 INFO:teuthology.orchestra.run.smithi091.stdout: osd map max advance = 10 2023-11-27T20:40:23.034 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: journal zero on create = true 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: filestore ondisk finisher threads = 3 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: filestore apply finisher threads = 3 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: bdev debug aio = true 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug misdirected ops = true 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: bdev async discard = True 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: bdev enable discard = True 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore allocator = bitmap 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore block size = 96636764160 2023-11-27T20:40:23.035 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore fsck on mount = True 2023-11-27T20:40:23.036 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluefs = 1/20 2023-11-27T20:40:23.036 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluestore = 1/20 2023-11-27T20:40:23.036 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-27T20:40:23.036 INFO:teuthology.orchestra.run.smithi091.stdout: debug osd = 20 2023-11-27T20:40:23.036 INFO:teuthology.orchestra.run.smithi091.stdout: debug rocksdb = 4/10 2023-11-27T20:40:23.036 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T20:40:23.037 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd full ratio = 0.9 2023-11-27T20:40:23.037 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd nearfull ratio = 0.8 2023-11-27T20:40:23.037 INFO:teuthology.orchestra.run.smithi091.stdout: osd failsafe full ratio = 0.95 2023-11-27T20:40:23.037 INFO:teuthology.orchestra.run.smithi091.stdout: osd objectstore = bluestore 2023-11-27T20:40:23.037 INFO:teuthology.orchestra.run.smithi091.stdout: osd op complaint time = 180 2023-11-27T20:40:23.037 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.037 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr] 2023-11-27T20:40:23.038 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-27T20:40:23.038 INFO:teuthology.orchestra.run.smithi091.stdout: debug mgr = 20 2023-11-27T20:40:23.038 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-11-27T20:40:23.038 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-11-27T20:40:23.038 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-11-27T20:40:23.038 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-11-27T20:40:23.038 INFO:teuthology.orchestra.run.smithi091.stdout: mgr/telemetry/nag = false 2023-11-27T20:40:23.038 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.038 INFO:teuthology.orchestra.run.smithi091.stdout:[mon] 2023-11-27T20:40:23.038 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-27T20:40:23.039 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-11-27T20:40:23.039 INFO:teuthology.orchestra.run.smithi091.stdout: debug paxos = 20 2023-11-27T20:40:23.039 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-11-27T20:40:23.039 INFO:teuthology.orchestra.run.smithi091.stdout: mon data avail warn = 5 2023-11-27T20:40:23.039 INFO:teuthology.orchestra.run.smithi091.stdout: mon mgr mkfs grace = 240 2023-11-27T20:40:23.040 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-11-27T20:40:23.040 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd reporter subtree level = osd 2023-11-27T20:40:23.040 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd prime pg temp = true 2023-11-27T20:40:23.040 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-11-27T20:40:23.040 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.040 INFO:teuthology.orchestra.run.smithi091.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T20:40:23.040 INFO:teuthology.orchestra.run.smithi091.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T20:40:23.040 INFO:teuthology.orchestra.run.smithi091.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T20:40:23.040 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.040 INFO:teuthology.orchestra.run.smithi091.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout: # 1m isn't quite enough 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout: mon_down_mkfs_grace = 2m 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_filestore_osds = false 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout: mon op complaint time = 120 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout:[client] 2023-11-27T20:40:23.041 INFO:teuthology.orchestra.run.smithi091.stdout: rgw cache enabled = true 2023-11-27T20:40:23.042 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable ops log = true 2023-11-27T20:40:23.042 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable usage log = true 2023-11-27T20:40:23.042 INFO:teuthology.orchestra.run.smithi091.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T20:40:23.042 INFO:teuthology.orchestra.run.smithi091.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T20:40:23.042 INFO:teuthology.orchestra.run.smithi091.stdout: client mount timeout = 600 2023-11-27T20:40:23.042 INFO:teuthology.orchestra.run.smithi091.stdout: debug client = 20 2023-11-27T20:40:23.042 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-27T20:40:23.042 INFO:teuthology.orchestra.run.smithi091.stdout: rados mon op timeout = 900 2023-11-27T20:40:23.042 INFO:teuthology.orchestra.run.smithi091.stdout: rados osd op timeout = 900 2023-11-27T20:40:23.043 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.a] 2023-11-27T20:40:23.043 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.b] 2023-11-27T20:40:23.043 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.c] 2023-11-27T20:40:23.043 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.a] 2023-11-27T20:40:23.043 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.c] 2023-11-27T20:40:23.043 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.b] 2023-11-27T20:40:23.043 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.d] 2023-11-27T20:40:23.043 INFO:teuthology.orchestra.run.smithi091.stdout:[mds] 2023-11-27T20:40:23.043 INFO:teuthology.orchestra.run.smithi091.stdout: debug mds = 20 2023-11-27T20:40:23.043 INFO:teuthology.orchestra.run.smithi091.stdout: debug mds balancer = 20 2023-11-27T20:40:23.044 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-27T20:40:23.044 INFO:teuthology.orchestra.run.smithi091.stdout: mds debug frag = True 2023-11-27T20:40:23.044 INFO:teuthology.orchestra.run.smithi091.stdout: mds debug scatterstat = True 2023-11-27T20:40:23.044 INFO:teuthology.orchestra.run.smithi091.stdout: mds op complaint time = 180 2023-11-27T20:40:23.044 INFO:teuthology.orchestra.run.smithi091.stdout: mds verify scatter = True 2023-11-27T20:40:23.044 INFO:teuthology.orchestra.run.smithi091.stdout: osd op complaint time = 180 2023-11-27T20:40:23.044 INFO:teuthology.orchestra.run.smithi091.stdout: rados mon op timeout = 900 2023-11-27T20:40:23.044 INFO:teuthology.orchestra.run.smithi091.stdout: rados osd op timeout = 900 2023-11-27T20:40:23.047 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2023-11-27T20:40:23.048 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2023-11-27T20:40:23.048 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T20:40:23.048 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2023-11-27T20:40:23.048 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.048 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2023-11-27T20:40:23.048 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.048 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2023-11-27T20:40:23.048 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.048 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2023-11-27T20:40:23.049 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2023-11-27T20:40:23.049 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.049 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2023-11-27T20:40:23.049 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2023-11-27T20:40:23.049 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.049 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T20:40:23.049 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2023-11-27T20:40:23.049 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.049 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T20:40:23.049 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T20:40:23.050 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.050 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2023-11-27T20:40:23.050 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.050 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2023-11-27T20:40:23.050 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2023-11-27T20:40:23.050 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2023-11-27T20:40:23.050 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2023-11-27T20:40:23.050 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2023-11-27T20:40:23.051 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2023-11-27T20:40:23.051 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2023-11-27T20:40:23.051 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T20:40:23.051 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T20:40:23.051 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2023-11-27T20:40:23.051 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.051 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T20:40:23.051 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.051 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2023-11-27T20:40:23.052 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.052 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2023-11-27T20:40:23.052 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.052 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2023-11-27T20:40:23.052 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2023-11-27T20:40:23.052 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2023-11-27T20:40:23.052 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "172.21.15.91,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2023-11-27T20:40:23.052 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on skipped message = False 2023-11-27T20:40:23.052 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = 76812701-65a9-4deb-87af-ef00110d1601 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2023-11-27T20:40:23.053 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.054 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2023-11-27T20:40:23.054 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2023-11-27T20:40:23.054 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2023-11-27T20:40:23.054 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug trim objects = true 2023-11-27T20:40:23.054 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.054 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2023-11-27T20:40:23.054 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2023-11-27T20:40:23.055 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.055 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2023-11-27T20:40:23.055 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.056 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2023-11-27T20:40:23.056 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.056 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2023-11-27T20:40:23.056 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.057 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2023-11-27T20:40:23.057 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2023-11-27T20:40:23.057 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.058 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2023-11-27T20:40:23.058 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2023-11-27T20:40:23.058 INFO:teuthology.orchestra.run.smithi183.stdout: bdev async discard = True 2023-11-27T20:40:23.059 INFO:teuthology.orchestra.run.smithi183.stdout: bdev enable discard = True 2023-11-27T20:40:23.059 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore allocator = bitmap 2023-11-27T20:40:23.059 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2023-11-27T20:40:23.059 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2023-11-27T20:40:23.060 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 1/20 2023-11-27T20:40:23.060 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 1/20 2023-11-27T20:40:23.061 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-11-27T20:40:23.061 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2023-11-27T20:40:23.061 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 4/10 2023-11-27T20:40:23.061 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T20:40:23.062 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2023-11-27T20:40:23.062 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2023-11-27T20:40:23.062 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 0.95 2023-11-27T20:40:23.063 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = bluestore 2023-11-27T20:40:23.063 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2023-11-27T20:40:23.063 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.064 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2023-11-27T20:40:23.064 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-11-27T20:40:23.064 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2023-11-27T20:40:23.064 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-11-27T20:40:23.065 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-11-27T20:40:23.065 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-11-27T20:40:23.066 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-11-27T20:40:23.066 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2023-11-27T20:40:23.066 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.067 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2023-11-27T20:40:23.067 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-11-27T20:40:23.067 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-11-27T20:40:23.068 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2023-11-27T20:40:23.068 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-11-27T20:40:23.068 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2023-11-27T20:40:23.068 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2023-11-27T20:40:23.069 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-11-27T20:40:23.069 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2023-11-27T20:40:23.070 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2023-11-27T20:40:23.070 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-11-27T20:40:23.070 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.071 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T20:40:23.071 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: mon op complaint time = 120 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-27T20:40:23.072 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout: client mount timeout = 600 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2023-11-27T20:40:23.073 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout:[mds] 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds = 20 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds balancer = 20 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug frag = True 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug scatterstat = True 2023-11-27T20:40:23.074 INFO:teuthology.orchestra.run.smithi183.stdout: mds op complaint time = 180 2023-11-27T20:40:23.075 INFO:teuthology.orchestra.run.smithi183.stdout: mds verify scatter = True 2023-11-27T20:40:23.075 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2023-11-27T20:40:23.075 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2023-11-27T20:40:23.075 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2023-11-27T20:40:23.095 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-27T20:40:23.095 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-27T20:40:23.244 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-27T20:40:23.245 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:23.245 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-27T20:40:23.294 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:23.294 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-27T20:40:23.393 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:40:23.394 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:23.394 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T20:40:23.394 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T20:40:23.542 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:23.542 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:23.641 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:40:23.641 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:40:23.641 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T20:40:23.641 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T20:40:23.800 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:40:23.800 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:23.900 INFO:tasks.ceph:Setting up mon nodes... 2023-11-27T20:40:23.900 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-27T20:40:23.901 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T20:40:24.091 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T20:40:24.101 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T20:40:24.296 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T20:40:24.307 INFO:tasks.ceph:Setting up mds nodes... 2023-11-27T20:40:24.307 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T20:40:24.497 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T20:40:24.506 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-27T20:40:24.591 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T20:40:24.775 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T20:40:24.784 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-27T20:40:24.880 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T20:40:25.057 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T20:40:25.064 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-27T20:40:25.151 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-27T20:40:25.324 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-27T20:40:25.333 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-27T20:40:25.435 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-27T20:40:25.435 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-27T20:40:25.572 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-27T20:40:25.619 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-27T20:40:25.753 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-27T20:40:25.802 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-27T20:40:25.803 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T20:40:25.803 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-27T20:40:25.902 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T20:40:25.902 INFO:tasks.ceph:role: osd.0 2023-11-27T20:40:25.902 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:40:25.903 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T20:40:26.004 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:40:26.004 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:40:26.004 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:40:26.004 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:40:26.004 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:40:26.005 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:40:26.005 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:40:26.005 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:40:26.005 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:40:26.005 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:40:26.516 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-27T20:40:26.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-27T20:40:26.523 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-27T20:40:26.723 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-27T20:40:26.842 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-27T20:40:26.921 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T20:40:26.922 INFO:tasks.ceph:role: osd.1 2023-11-27T20:40:26.922 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:40:26.922 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T20:40:27.007 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:40:27.007 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:40:27.007 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:40:27.007 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:40:27.007 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:40:27.007 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:40:27.007 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:40:27.007 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:40:27.008 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:40:27.008 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:40:27.476 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-27T20:40:27.481 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-27T20:40:27.481 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-27T20:40:27.605 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-27T20:40:27.687 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-27T20:40:27.766 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T20:40:27.766 INFO:tasks.ceph:role: osd.2 2023-11-27T20:40:27.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:40:27.766 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T20:40:27.862 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:40:27.863 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:40:27.863 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:40:27.863 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:40:27.863 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:40:27.863 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:40:27.863 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:40:27.863 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:40:27.863 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:40:27.863 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:40:28.389 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-27T20:40:28.395 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-27T20:40:28.395 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-27T20:40:28.596 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-27T20:40:28.703 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-27T20:40:28.792 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T20:40:28.792 INFO:tasks.ceph:role: osd.3 2023-11-27T20:40:28.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:40:28.793 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T20:40:28.891 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:40:28.891 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:40:28.892 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:40:28.892 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:40:28.892 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:40:28.892 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:40:28.892 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:40:28.892 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:40:28.892 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:40:28.892 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:40:29.357 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-27T20:40:29.363 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-27T20:40:29.363 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-27T20:40:29.524 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-27T20:40:29.623 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:29.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:29.775+0000 7f19df416500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-27T20:40:29.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:29.778+0000 7f19df416500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-27T20:40:29.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:29.778+0000 7f19df416500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T20:40:29.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:29.778+0000 7f19df416500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T20:40:29.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:29.778+0000 7f19df416500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T20:40:29.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:29.783+0000 7f19df416500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-27T20:40:32.963 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-27T20:40:33.063 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:33.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:33.209+0000 7f23b5e16500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-27T20:40:33.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:33.210+0000 7f23b5e16500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-27T20:40:33.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:33.210+0000 7f23b5e16500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T20:40:33.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:33.210+0000 7f23b5e16500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T20:40:33.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:33.210+0000 7f23b5e16500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T20:40:33.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:33.212+0000 7f23b5e16500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-27T20:40:36.136 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-27T20:40:36.236 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:36.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:36.376+0000 7fe84e8b4500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-27T20:40:36.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:36.378+0000 7fe84e8b4500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-27T20:40:36.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:36.378+0000 7fe84e8b4500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T20:40:36.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:36.378+0000 7fe84e8b4500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T20:40:36.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:36.378+0000 7fe84e8b4500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T20:40:36.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:36.380+0000 7fe84e8b4500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-27T20:40:39.304 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-27T20:40:39.404 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:39.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:39.544+0000 7f10e7869500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-27T20:40:39.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:39.545+0000 7f10e7869500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-27T20:40:39.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:39.545+0000 7f10e7869500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T20:40:39.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:39.545+0000 7f10e7869500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T20:40:39.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:39.545+0000 7f10e7869500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T20:40:39.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:40:39.547+0000 7f10e7869500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-27T20:40:42.467 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-27T20:40:42.569 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-27T20:40:42.671 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T20:40:42.671 INFO:tasks.ceph:role: osd.4 2023-11-27T20:40:42.671 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:40:42.671 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T20:40:42.769 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:40:42.769 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:40:42.769 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:40:42.769 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:40:42.769 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:40:42.770 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:40:42.770 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:40:42.770 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:40:42.770 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:40:42.770 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:40:43.281 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-11-27T20:40:43.289 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-11-27T20:40:43.290 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-27T20:40:43.474 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-27T20:40:43.576 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-27T20:40:43.672 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T20:40:43.672 INFO:tasks.ceph:role: osd.5 2023-11-27T20:40:43.672 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:40:43.673 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T20:40:43.768 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:40:43.768 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:40:43.769 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:40:43.769 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:40:43.769 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:40:43.769 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:40:43.769 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:40:43.769 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:40:43.769 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:40:43.769 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:40:44.247 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-11-27T20:40:44.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-11-27T20:40:44.254 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-27T20:40:44.402 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-27T20:40:44.494 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-27T20:40:44.583 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T20:40:44.583 INFO:tasks.ceph:role: osd.6 2023-11-27T20:40:44.583 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:40:44.583 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T20:40:44.680 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:40:44.681 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:40:44.681 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:40:44.681 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:40:44.681 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:40:44.681 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:40:44.681 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:40:44.681 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:40:44.681 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:40:44.681 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:40:45.200 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-11-27T20:40:45.206 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-11-27T20:40:45.207 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-27T20:40:45.401 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-27T20:40:45.509 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-27T20:40:45.606 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T20:40:45.606 INFO:tasks.ceph:role: osd.7 2023-11-27T20:40:45.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:40:45.607 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T20:40:45.707 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T20:40:45.707 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T20:40:45.708 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T20:40:45.708 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T20:40:45.708 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T20:40:45.708 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-11-27T20:40:45.708 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T20:40:45.708 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T20:40:45.708 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T20:40:45.708 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T20:40:46.149 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-11-27T20:40:46.155 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-11-27T20:40:46.157 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-27T20:40:46.297 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-27T20:40:46.399 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:46.551 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:46.550+0000 7f3c8da07500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-27T20:40:46.552 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:46.551+0000 7f3c8da07500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-27T20:40:46.553 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:46.551+0000 7f3c8da07500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T20:40:46.553 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:46.552+0000 7f3c8da07500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T20:40:46.553 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:46.552+0000 7f3c8da07500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T20:40:46.557 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:46.557+0000 7f3c8da07500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-27T20:40:49.747 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-27T20:40:49.847 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:49.990 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:49.990+0000 7feffc5e0500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-27T20:40:49.991 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:49.990+0000 7feffc5e0500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-27T20:40:49.991 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:49.990+0000 7feffc5e0500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T20:40:49.992 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:49.990+0000 7feffc5e0500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T20:40:49.992 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:49.991+0000 7feffc5e0500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T20:40:49.993 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:49.993+0000 7feffc5e0500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-27T20:40:50.321 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:50.330 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:53.192 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-27T20:40:53.300 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:53.444 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:53.443+0000 7ff79e210500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-27T20:40:53.445 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:53.444+0000 7ff79e210500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-27T20:40:53.446 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:53.444+0000 7ff79e210500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T20:40:53.446 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:53.444+0000 7ff79e210500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T20:40:53.446 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:53.444+0000 7ff79e210500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T20:40:53.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:53.446+0000 7ff79e210500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-27T20:40:56.388 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-27T20:40:56.490 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:40:56.634 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:56.632+0000 7f821ec18500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-27T20:40:56.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:56.633+0000 7f821ec18500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-27T20:40:56.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:56.633+0000 7f821ec18500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T20:40:56.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:56.633+0000 7f821ec18500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T20:40:56.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:56.633+0000 7f821ec18500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T20:40:56.636 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:40:56.635+0000 7f821ec18500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-27T20:40:59.811 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-27T20:40:59.912 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-27T20:40:59.912 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:40:59.912 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-27T20:41:00.013 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:00.013 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-27T20:41:00.108 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:00.109 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-27T20:41:00.206 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:00.206 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-27T20:41:00.300 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:00.300 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-27T20:41:00.397 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:00.397 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-27T20:41:00.496 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:00.496 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-27T20:41:00.590 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:00.590 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-27T20:41:00.692 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:00.693 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-27T20:41:00.791 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:00.791 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-27T20:41:00.895 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:00.895 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-27T20:41:00.990 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:00.990 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-27T20:41:01.085 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:01.085 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-27T20:41:01.177 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:01.178 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-27T20:41:01.275 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:01.275 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-27T20:41:01.334 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:01.334 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-27T20:41:01.394 INFO:tasks.ceph:Adding keys to all mons... 2023-11-27T20:41:01.394 DEBUG:teuthology.orchestra.run.smithi091:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T20:41:01.403 DEBUG:teuthology.orchestra.run.smithi183:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T20:41:01.493 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.y] 2023-11-27T20:41:01.493 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC4/mRld4txBRAAvOUjPT9j+tXIe6B82dWA0w== 2023-11-27T20:41:01.493 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.a] 2023-11-27T20:41:01.493 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC4/mRlRwaqHRAAqer3j2kHk7wuowivepQUgw== 2023-11-27T20:41:01.493 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.c] 2023-11-27T20:41:01.493 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC4/mRlv407LhAAE6ECkLA1z27fwufNKJNIYA== 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.0] 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC9/mRlONFOLhAAYUIBkatNBD7/J4D9sfAiaw== 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.1] 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDB/mRlvE+RDBAACA+NQHmb0QQxYZgXZpslEQ== 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.2] 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDE/mRleeqGFhAAHwW2F6fQnCdomrsUsdm+8w== 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.3] 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDH/mRlYT1/IBAATkOmqpRab148FbKtb+MifA== 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.x] 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC4/mRl8E2qERAA2C9blyASELJzyHJZ3BdIUw== 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.b] 2023-11-27T20:41:01.494 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5/mRlx9BVAxAA+wJ5xix5GpiENKnZfH/iFw== 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.d] 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5/mRl+kFcExAAkuOMQ90ecoxXDkPxO6FDvw== 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.4] 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDO/mRlebvbIBAARnJZSuaKdb1vs1PoMQNDOw== 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.5] 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDR/mRl6MgQOxAAw94eeILe8F/405enQHSaiA== 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.6] 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDV/mRl5Jd9GhAAv9BxPC9a0D6l3ZBcP0ceUg== 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.7] 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDY/mRlllnNJRAAXnAoHjIq7CKkL8c6MC3byg== 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout:[client.0] 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5/mRlKBgjIhAArHSIgmH/SwVIdiUlROMOfA== 2023-11-27T20:41:01.495 INFO:teuthology.orchestra.run.smithi091.stdout:[client.1] 2023-11-27T20:41:01.496 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5/mRlsqHoLBAAzs5TAvGaf/SnzmZfDewgAg== 2023-11-27T20:41:01.496 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.y] 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQC4/mRld4txBRAAvOUjPT9j+tXIe6B82dWA0w== 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQC4/mRlRwaqHRAAqer3j2kHk7wuowivepQUgw== 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQC4/mRlv407LhAAE6ECkLA1z27fwufNKJNIYA== 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQC9/mRlONFOLhAAYUIBkatNBD7/J4D9sfAiaw== 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQDB/mRlvE+RDBAACA+NQHmb0QQxYZgXZpslEQ== 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQDE/mRleeqGFhAAHwW2F6fQnCdomrsUsdm+8w== 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.3] 2023-11-27T20:41:01.497 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQDH/mRlYT1/IBAATkOmqpRab148FbKtb+MifA== 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.x] 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQC4/mRl8E2qERAA2C9blyASELJzyHJZ3BdIUw== 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQC5/mRlx9BVAxAA+wJ5xix5GpiENKnZfH/iFw== 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQC5/mRl+kFcExAAkuOMQ90ecoxXDkPxO6FDvw== 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.4] 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQDO/mRlebvbIBAARnJZSuaKdb1vs1PoMQNDOw== 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.5] 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQDR/mRl6MgQOxAAw94eeILe8F/405enQHSaiA== 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.6] 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQDV/mRl5Jd9GhAAv9BxPC9a0D6l3ZBcP0ceUg== 2023-11-27T20:41:01.498 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.7] 2023-11-27T20:41:01.499 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQDY/mRlllnNJRAAXnAoHjIq7CKkL8c6MC3byg== 2023-11-27T20:41:01.499 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2023-11-27T20:41:01.499 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQC5/mRlKBgjIhAArHSIgmH/SwVIdiUlROMOfA== 2023-11-27T20:41:01.499 INFO:teuthology.orchestra.run.smithi183.stdout:[client.1] 2023-11-27T20:41:01.499 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQC5/mRlsqHoLBAAzs5TAvGaf/SnzmZfDewgAg== 2023-11-27T20:41:01.501 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T20:41:01.509 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T20:41:01.648 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:41:01.654 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:41:01.800 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:41:01.808 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:41:01.954 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:01.963 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:02.106 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:02.112 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:02.244 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:02.252 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:02.388 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:02.396 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:02.543 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T20:41:02.550 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T20:41:02.686 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:41:02.691 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:41:02.843 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:41:02.849 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T20:41:02.995 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:03.003 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:03.148 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:03.153 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:03.295 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:03.300 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:03.445 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:03.453 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T20:41:03.600 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T20:41:03.605 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T20:41:03.750 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T20:41:03.755 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T20:41:03.901 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-27T20:41:03.902 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-27T20:41:03.990 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T20:41:04.146 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-27T20:41:04.234 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-27T20:41:04.338 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T20:41:04.496 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-27T20:41:04.574 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-27T20:41:04.672 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T20:41:04.825 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-27T20:41:04.898 DEBUG:teuthology.orchestra.run.smithi091:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:41:04.907 DEBUG:teuthology.orchestra.run.smithi183:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T20:41:04.958 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-27T20:41:04.958 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-27T20:41:04.958 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-27T20:41:04.964 INFO:tasks.ceph.mon.a:Started 2023-11-27T20:41:04.964 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-27T20:41:04.964 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-27T20:41:04.969 INFO:tasks.ceph.mon.b:Started 2023-11-27T20:41:04.969 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-27T20:41:04.970 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-27T20:41:04.974 INFO:tasks.ceph.mon.c:Started 2023-11-27T20:41:04.975 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-27T20:41:04.975 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-27T20:41:04.975 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-27T20:41:04.980 INFO:tasks.ceph.mgr.y:Started 2023-11-27T20:41:04.980 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-27T20:41:04.980 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-27T20:41:04.986 INFO:tasks.ceph.mgr.x:Started 2023-11-27T20:41:04.986 INFO:tasks.ceph:Setting crush tunables to default 2023-11-27T20:41:04.987 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd crush tunables default 2023-11-27T20:41:05.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.162+0000 7fbdda69b640 1 Processor -- start 2023-11-27T20:41:05.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.162+0000 7fbdda69b640 1 -- start start 2023-11-27T20:41:05.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.163+0000 7fbdda69b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:05.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.163+0000 7fbdda69b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:05.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.163+0000 7fbdda69b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd41556d0 con 0x7fbdd40c7ec0 2023-11-27T20:41:05.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.163+0000 7fbdda69b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd4154740 con 0x7fbdd40c4940 2023-11-27T20:41:05.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.163+0000 7fbdda69b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd406c760 con 0x7fbdd4151cc0 2023-11-27T20:41:05.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.163+0000 7fbdcbfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fbdd40c7ec0 0x7fbdd4157d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:51638/0 (socket says 172.21.15.91:51638) 2023-11-27T20:41:05.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.163+0000 7fbdcbfff640 1 -- 172.21.15.91:0/2428532448 learned_addr learned my addr 172.21.15.91:0/2428532448 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.163+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.163+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.164+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 msgr2=0x7fbdd40c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T20:41:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.164+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 msgr2=0x7fbdd40c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.164+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.164+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:41:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.164+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 msgr2=0x7fbdd4155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:41:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.164+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 msgr2=0x7fbdd4155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.164+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.164+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:41:05.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.365+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:05.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.365+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:05.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.366+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 msgr2=0x7fbdd40c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:41:05.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.366+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 msgr2=0x7fbdd40c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:05.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.366+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:05.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.366+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 msgr2=0x7fbdd4155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T20:41:05.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.366+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 msgr2=0x7fbdd4155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:05.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.366+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:05.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.366+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:41:05.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.366+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:41:05.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.767+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:05.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.767+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:05.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.768+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 msgr2=0x7fbdd40c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T20:41:05.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.768+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 msgr2=0x7fbdd40c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:05.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.768+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:05.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.768+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:41:05.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.768+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 msgr2=0x7fbdd4155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:41:05.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.768+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 msgr2=0x7fbdd4155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:05.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.768+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:05.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:05.768+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:41:06.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:06.570+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:06.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:06.570+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:06.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:06.570+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 msgr2=0x7fbdd40c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:41:06.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:06.570+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 msgr2=0x7fbdd40c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:06.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:06.570+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:06.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:06.570+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 msgr2=0x7fbdd4155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T20:41:06.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:06.570+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 msgr2=0x7fbdd4155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:06.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:06.570+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:06.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:06.570+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:41:06.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:06.570+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:41:08.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd27fc640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 msgr2=0x7fbdd4155190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:41:08.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd27fc640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd4151cc0 0x7fbdd4155190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:08.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd27fc640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 msgr2=0x7fbdd40c4d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:41:08.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd27fc640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.183:3300/0 conn(0x7fbdd40c4940 0x7fbdd40c4d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:08.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd27fc640 1 -- 172.21.15.91:0/2428532448 >> v1:172.21.15.91:6789/0 conn(0x7fbdd40c7ec0 legacy=0x7fbdd4157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:08.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd27fc640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:08.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd27fc640 1 -- 172.21.15.91:0/2428532448 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd40c8470 con 0x7fbdb4006170 2023-11-27T20:41:08.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd27fc640 1 -- 172.21.15.91:0/2428532448 --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd4154740 con 0x7fbdb40036e0 2023-11-27T20:41:08.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:08.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 msgr2=0x7fbdb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:41:08.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 msgr2=0x7fbdb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:08.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.164+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:08.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.165+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T20:41:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.366+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.366+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 msgr2=0x7fbdb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:41:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.367+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 msgr2=0x7fbdb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.367+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:08.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.367+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T20:41:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.768+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.768+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 msgr2=0x7fbdb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:41:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.768+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 msgr2=0x7fbdb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.768+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:08.768+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T20:41:09.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:09.570+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:09.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:09.570+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 msgr2=0x7fbdb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T20:41:09.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:09.570+0000 7fbdd3fff640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 msgr2=0x7fbdb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T20:41:09.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:09.570+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T20:41:09.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:09.570+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T20:41:10.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.422+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059620861 0 0) 0x7fbdd40c8470 con 0x7fbdb4006170 2023-11-27T20:41:10.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.422+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdc0003520 con 0x7fbdb4006170 2023-11-27T20:41:10.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.428+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3321327781 0 0) 0x7fbdc0003520 con 0x7fbdb4006170 2023-11-27T20:41:10.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.428+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 msgr2=0x7fbdb4005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T20:41:10.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.428+0000 7fbdd37fe640 1 --2- 172.21.15.91:0/2428532448 >> v2:172.21.15.91:3300/0 conn(0x7fbdb40036e0 0x7fbdb4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.428+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb400af70 con 0x7fbdb4006170 2023-11-27T20:41:10.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.428+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fbdbc0016f0 con 0x7fbdb4006170 2023-11-27T20:41:10.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.428+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 >> v1:172.21.15.183:6789/0 conn(0x7fbdb4006170 legacy=0x7fbdb4008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:10.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.428+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 reap_dead start 2023-11-27T20:41:10.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.428+0000 7fbdd37fe640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc00039c0 0x7fbdc0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:10.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.428+0000 7fbdd37fe640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00047c0 0x7fbdc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:10.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.428+0000 7fbdd37fe640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc0005380 0x7fbdc000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:10.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.429+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd4154740 con 0x7fbdc00047c0 2023-11-27T20:41:10.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.429+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc000c240 con 0x7fbdc00039c0 2023-11-27T20:41:10.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.429+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc000c400 con 0x7fbdc0005380 2023-11-27T20:41:10.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.429+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc00039c0 0x7fbdc0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:10.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.429+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc0005380 0x7fbdc000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:10.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.429+0000 7fbdcbfff640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00047c0 0x7fbdc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:10.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.431+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc00039c0 msgr2=0x7fbdc0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:10.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.431+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc00039c0 0x7fbdc0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.431+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00047c0 msgr2=0x7fbdc0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:10.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.431+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00047c0 0x7fbdc0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.431+0000 7fbdd8c38640 1 -- 172.21.15.91:0/2428532448 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc0003520 con 0x7fbdc0005380 2023-11-27T20:41:10.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.432+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc0005380 0x7fbdc000b980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40c7a50 tx=0x7fbdc00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74370ee8c48d49ce server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:10.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.434+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc035410 con 0x7fbdc0005380 2023-11-27T20:41:10.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.434+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc02f030 con 0x7fbdc0005380 2023-11-27T20:41:10.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.434+0000 7fbdd37fe640 1 -- 172.21.15.91:0/2428532448 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc035830 con 0x7fbdc0005380 2023-11-27T20:41:10.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.435+0000 7fbdda69b640 1 -- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc0005380 msgr2=0x7fbdc000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:10.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.435+0000 7fbdda69b640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc0005380 0x7fbdc000b980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40c7a50 tx=0x7fbdc00057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.435+0000 7fbdda69b640 1 -- 172.21.15.91:0/2428532448 shutdown_connections 2023-11-27T20:41:10.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.435+0000 7fbdda69b640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc0005380 0x7fbdc000b980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.435+0000 7fbdda69b640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00047c0 0x7fbdc0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.435+0000 7fbdda69b640 1 --2- 172.21.15.91:0/2428532448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc00039c0 0x7fbdc0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.435+0000 7fbdda69b640 1 -- 172.21.15.91:0/2428532448 >> 172.21.15.91:0/2428532448 conn(0x7fbdd4071e10 msgr2=0x7fbdd4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:10.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.435+0000 7fbdda69b640 1 -- 172.21.15.91:0/2428532448 shutdown_connections 2023-11-27T20:41:10.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.435+0000 7fbdda69b640 1 -- 172.21.15.91:0/2428532448 wait complete. 2023-11-27T20:41:10.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.438+0000 7fbdda69b640 1 Processor -- start 2023-11-27T20:41:10.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.439+0000 7fbdda69b640 1 -- start start 2023-11-27T20:41:10.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdda69b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00039c0 0x7fbdd4150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:10.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdda69b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc00047c0 0x7fbdd4153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:10.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdda69b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc0005380 0x7fbdd41491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:10.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdda69b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40ac300 con 0x7fbdc00039c0 2023-11-27T20:41:10.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdda69b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40a99c0 con 0x7fbdc0005380 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdda69b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd4152db0 con 0x7fbdc00047c0 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdd3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00039c0 0x7fbdd4150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdd3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00039c0 0x7fbdd4150310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58122/0 (socket says 172.21.15.91:58122) 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdd3fff640 1 -- 172.21.15.91:0/689175040 learned_addr learned my addr 172.21.15.91:0/689175040 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdcbfff640 1 --2- 172.21.15.91:0/689175040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc00047c0 0x7fbdd4153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.440+0000 7fbdd8c38640 1 --2- 172.21.15.91:0/689175040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc0005380 0x7fbdd41491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.441+0000 7fbdd3fff640 1 -- 172.21.15.91:0/689175040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc00047c0 msgr2=0x7fbdd4153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.441+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/689175040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc00047c0 0x7fbdd4153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.441+0000 7fbdd3fff640 1 -- 172.21.15.91:0/689175040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc0005380 msgr2=0x7fbdd41491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.441+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/689175040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc0005380 0x7fbdd41491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.441+0000 7fbdd3fff640 1 -- 172.21.15.91:0/689175040 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd4153090 con 0x7fbdc00039c0 2023-11-27T20:41:10.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.441+0000 7fbdd3fff640 1 --2- 172.21.15.91:0/689175040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00039c0 0x7fbdd4150310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40038a0 tx=0x7fbdc4003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:10.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.442+0000 7fbdd17fa640 1 -- 172.21.15.91:0/689175040 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40179a0 con 0x7fbdc00039c0 2023-11-27T20:41:10.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.442+0000 7fbdd17fa640 1 -- 172.21.15.91:0/689175040 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc401f040 con 0x7fbdc00039c0 2023-11-27T20:41:10.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.442+0000 7fbdd17fa640 1 -- 172.21.15.91:0/689175040 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4017d20 con 0x7fbdc00039c0 2023-11-27T20:41:10.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.442+0000 7fbdda69b640 1 -- 172.21.15.91:0/689175040 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd4153370 con 0x7fbdc00039c0 2023-11-27T20:41:10.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.442+0000 7fbdda69b640 1 -- 172.21.15.91:0/689175040 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd4150850 con 0x7fbdc00039c0 2023-11-27T20:41:10.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.443+0000 7fbdd17fa640 1 -- 172.21.15.91:0/689175040 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fbdc4005990 con 0x7fbdc00039c0 2023-11-27T20:41:10.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.443+0000 7fbdd17fa640 1 -- 172.21.15.91:0/689175040 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbdc402d780 con 0x7fbdc00039c0 2023-11-27T20:41:10.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.444+0000 7fbdda69b640 1 -- 172.21.15.91:0/689175040 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd4068350 con 0x7fbdc00039c0 2023-11-27T20:41:10.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.447+0000 7fbdd17fa640 1 -- 172.21.15.91:0/689175040 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fbdc4028070 con 0x7fbdc00039c0 2023-11-27T20:41:10.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.522+0000 7fbdda69b640 1 -- 172.21.15.91:0/689175040 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbdd406c9c0 con 0x7fbdc00039c0 2023-11-27T20:41:10.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.526+0000 7fbdd17fa640 1 -- 172.21.15.91:0/689175040 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbdc4017e80 con 0x7fbdc00039c0 2023-11-27T20:41:10.527 INFO:teuthology.orchestra.run.smithi091.stderr:adjusted tunables profile to default 2023-11-27T20:41:10.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.527+0000 7fbdda69b640 1 -- 172.21.15.91:0/689175040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00039c0 msgr2=0x7fbdd4150310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:10.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.527+0000 7fbdda69b640 1 --2- 172.21.15.91:0/689175040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00039c0 0x7fbdd4150310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40038a0 tx=0x7fbdc4003ca0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.528+0000 7fbdda69b640 1 -- 172.21.15.91:0/689175040 shutdown_connections 2023-11-27T20:41:10.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.528+0000 7fbdda69b640 1 --2- 172.21.15.91:0/689175040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc0005380 0x7fbdd41491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.528+0000 7fbdda69b640 1 --2- 172.21.15.91:0/689175040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdc00047c0 0x7fbdd4153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.528+0000 7fbdda69b640 1 --2- 172.21.15.91:0/689175040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc00039c0 0x7fbdd4150310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:10.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.528+0000 7fbdda69b640 1 -- 172.21.15.91:0/689175040 >> 172.21.15.91:0/689175040 conn(0x7fbdd4071e10 msgr2=0x7fbdd40721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:10.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.528+0000 7fbdda69b640 1 -- 172.21.15.91:0/689175040 shutdown_connections 2023-11-27T20:41:10.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:10.528+0000 7fbdda69b640 1 -- 172.21.15.91:0/689175040 wait complete. 2023-11-27T20:41:10.547 INFO:tasks.ceph:check_enable_crimson: False 2023-11-27T20:41:10.547 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-27T20:41:10.547 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:10.548 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-27T20:41:10.636 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:10.636 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-27T20:41:10.764 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:10.765 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-27T20:41:10.851 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:10.851 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-27T20:41:10.963 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:10.963+0000 7f759f04a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T20:41:10.981 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:10.981 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-27T20:41:11.023 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:11.022+0000 7ff403245040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T20:41:11.024 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:11.024+0000 7f759f04a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T20:41:11.077 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:11.078 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-27T20:41:11.086 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:11.085+0000 7ff403245040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T20:41:11.208 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:11.208 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-27T20:41:11.292 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:41:11.292 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-27T20:41:11.423 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new b4830b68-3ba3-48d6-a726-baa4c1cfa2a5 0 2023-11-27T20:41:11.609 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.608+0000 7fbd28834640 1 Processor -- start 2023-11-27T20:41:11.610 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.609+0000 7fbd28834640 1 -- start start 2023-11-27T20:41:11.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.610+0000 7fbd28834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd2406a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:11.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.610+0000 7fbd28834640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbd24155fc0 0x7fbd240c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:11.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.610+0000 7fbd28834640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd240c6700 con 0x7fbd240c2700 2023-11-27T20:41:11.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.610+0000 7fbd28834640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd241522c0 con 0x7fbd24155fc0 2023-11-27T20:41:11.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.610+0000 7fbd28834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240c31a0 con 0x7fbd2406a500 2023-11-27T20:41:11.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.610+0000 7fbd23fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbd24155fc0 0x7fbd240c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:11.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.610+0000 7fbd237fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd2406a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:11.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.610+0000 7fbd23fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbd24155fc0 0x7fbd240c2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38108/0 (socket says 172.21.15.183:38108) 2023-11-27T20:41:11.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.610+0000 7fbd237fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd2406a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:46872/0 (socket says 172.21.15.183:46872) 2023-11-27T20:41:11.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.610+0000 7fbd23fff640 1 -- 172.21.15.183:0/2296285734 learned_addr learned my addr 172.21.15.183:0/2296285734 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:11.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.611+0000 7fbd23fff640 1 -- 172.21.15.183:0/2296285734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 msgr2=0x7fbd2406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:11.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.611+0000 7fbd23fff640 1 --2- 172.21.15.183:0/2296285734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd2406a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.613 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.611+0000 7fbd23fff640 1 -- 172.21.15.183:0/2296285734 >> v1:172.21.15.91:6789/0 conn(0x7fbd240c2700 legacy=0x7fbd241558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:11.613 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.611+0000 7fbd23fff640 1 -- 172.21.15.183:0/2296285734 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2414fd50 con 0x7fbd24155fc0 2023-11-27T20:41:11.613 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.611+0000 7fbd237fe640 1 --2- 172.21.15.183:0/2296285734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd2406a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:11.613 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.612+0000 7fbd23fff640 1 --2- 172.21.15.183:0/2296285734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd24155fc0 0x7fbd240c2b80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009870 tx=0x7fbd1c02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6497dcc2ca078ba server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:11.614 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.612+0000 7fbd227fc640 1 -- 172.21.15.183:0/2296285734 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0317c0 con 0x7fbd24155fc0 2023-11-27T20:41:11.614 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.612+0000 7fbd227fc640 1 -- 172.21.15.183:0/2296285734 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c031920 con 0x7fbd24155fc0 2023-11-27T20:41:11.614 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.612+0000 7fbd227fc640 1 -- 172.21.15.183:0/2296285734 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c031cb0 con 0x7fbd24155fc0 2023-11-27T20:41:11.614 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.613+0000 7fbd28834640 1 -- 172.21.15.183:0/2296285734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd24155fc0 msgr2=0x7fbd240c2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:11.614 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.613+0000 7fbd28834640 1 --2- 172.21.15.183:0/2296285734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd24155fc0 0x7fbd240c2b80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009870 tx=0x7fbd1c02b860 comp rx=0 tx=0).stop 2023-11-27T20:41:11.614 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.613+0000 7fbd28834640 1 -- 172.21.15.183:0/2296285734 shutdown_connections 2023-11-27T20:41:11.614 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.613+0000 7fbd28834640 1 --2- 172.21.15.183:0/2296285734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd24155fc0 0x7fbd240c2b80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.614 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.613+0000 7fbd28834640 1 --2- 172.21.15.183:0/2296285734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd2406a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.615 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.613+0000 7fbd28834640 1 -- 172.21.15.183:0/2296285734 >> 172.21.15.183:0/2296285734 conn(0x7fbd240a8870 msgr2=0x7fbd240a8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:11.615 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.613+0000 7fbd28834640 1 -- 172.21.15.183:0/2296285734 shutdown_connections 2023-11-27T20:41:11.615 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.613+0000 7fbd28834640 1 -- 172.21.15.183:0/2296285734 wait complete. 2023-11-27T20:41:11.616 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.616+0000 7fbd28834640 1 Processor -- start 2023-11-27T20:41:11.616 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.616+0000 7fbd28834640 1 -- start start 2023-11-27T20:41:11.621 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.617+0000 7fbd28834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd241e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:11.621 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.617+0000 7fbd28834640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd240c2700 0x7fbd240c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:11.621 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.617+0000 7fbd28834640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd240c0600 0x7fbd2414ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:11.621 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.617+0000 7fbd28834640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240bc850 con 0x7fbd240c0600 2023-11-27T20:41:11.621 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.617+0000 7fbd28834640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240a9f30 con 0x7fbd240c2700 2023-11-27T20:41:11.621 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.617+0000 7fbd28834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240aa1d0 con 0x7fbd2406a500 2023-11-27T20:41:11.621 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd237fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd241e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd22ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd240c2700 0x7fbd240c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd237fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd241e8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:46876/0 (socket says 172.21.15.183:46876) 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd237fe640 1 -- 172.21.15.183:0/2866622548 learned_addr learned my addr 172.21.15.183:0/2866622548 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd23fff640 1 --2- 172.21.15.183:0/2866622548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd240c0600 0x7fbd2414ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd237fe640 1 -- 172.21.15.183:0/2866622548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd240c2700 msgr2=0x7fbd240c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd237fe640 1 --2- 172.21.15.183:0/2866622548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd240c2700 0x7fbd240c00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd237fe640 1 -- 172.21.15.183:0/2866622548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd240c0600 msgr2=0x7fbd2414ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd237fe640 1 --2- 172.21.15.183:0/2866622548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd240c0600 0x7fbd2414ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd237fe640 1 -- 172.21.15.183:0/2866622548 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd14009a70 con 0x7fbd2406a500 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.618+0000 7fbd237fe640 1 --2- 172.21.15.183:0/2866622548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd241e8f10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400efc0 tx=0x7fbd1400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:11.622 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.619+0000 7fbd1bfff640 1 -- 172.21.15.183:0/2866622548 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14014680 con 0x7fbd2406a500 2023-11-27T20:41:11.623 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.619+0000 7fbd1bfff640 1 -- 172.21.15.183:0/2866622548 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1400f040 con 0x7fbd2406a500 2023-11-27T20:41:11.623 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.619+0000 7fbd28834640 1 -- 172.21.15.183:0/2866622548 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c0094d0 con 0x7fbd2406a500 2023-11-27T20:41:11.623 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.619+0000 7fbd1bfff640 1 -- 172.21.15.183:0/2866622548 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14014a00 con 0x7fbd2406a500 2023-11-27T20:41:11.623 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.619+0000 7fbd28834640 1 -- 172.21.15.183:0/2866622548 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd240aa790 con 0x7fbd2406a500 2023-11-27T20:41:11.623 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.619+0000 7fbd1bfff640 1 -- 172.21.15.183:0/2866622548 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fbd1401d400 con 0x7fbd2406a500 2023-11-27T20:41:11.624 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.619+0000 7fbd1bfff640 1 -- 172.21.15.183:0/2866622548 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbd14013570 con 0x7fbd2406a500 2023-11-27T20:41:11.624 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.620+0000 7fbd28834640 1 -- 172.21.15.183:0/2866622548 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd240c2ca0 con 0x7fbd2406a500 2023-11-27T20:41:11.624 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.623+0000 7fbd1bfff640 1 -- 172.21.15.183:0/2866622548 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fbd1403bce0 con 0x7fbd2406a500 2023-11-27T20:41:11.675 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:11.675+0000 7f759f04a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T20:41:11.695 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:11.694+0000 7ff403245040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T20:41:11.712 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.711+0000 7fbd28834640 1 -- 172.21.15.183:0/2866622548 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4830b68-3ba3-48d6-a726-baa4c1cfa2a5", "id": 0} v 0) v1 -- 0x7fbd2404e840 con 0x7fbd2406a500 2023-11-27T20:41:11.719 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.718+0000 7fbd1bfff640 1 -- 172.21.15.183:0/2866622548 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4830b68-3ba3-48d6-a726-baa4c1cfa2a5", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbd1402a020 con 0x7fbd2406a500 2023-11-27T20:41:11.719 INFO:teuthology.orchestra.run.smithi183.stdout:0 2023-11-27T20:41:11.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.720+0000 7fbd28834640 1 -- 172.21.15.183:0/2866622548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 msgr2=0x7fbd241e8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:11.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.720+0000 7fbd28834640 1 --2- 172.21.15.183:0/2866622548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd241e8f10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400efc0 tx=0x7fbd1400c490 comp rx=0 tx=0).stop 2023-11-27T20:41:11.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.720+0000 7fbd28834640 1 -- 172.21.15.183:0/2866622548 shutdown_connections 2023-11-27T20:41:11.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.720+0000 7fbd28834640 1 --2- 172.21.15.183:0/2866622548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd240c0600 0x7fbd2414ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.720+0000 7fbd28834640 1 --2- 172.21.15.183:0/2866622548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd240c2700 0x7fbd240c00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.720+0000 7fbd28834640 1 --2- 172.21.15.183:0/2866622548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2406a500 0x7fbd241e8f10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.720+0000 7fbd28834640 1 -- 172.21.15.183:0/2866622548 >> 172.21.15.183:0/2866622548 conn(0x7fbd240a8870 msgr2=0x7fbd24066340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:11.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.720+0000 7fbd28834640 1 -- 172.21.15.183:0/2866622548 shutdown_connections 2023-11-27T20:41:11.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.720+0000 7fbd28834640 1 -- 172.21.15.183:0/2866622548 wait complete. 2023-11-27T20:41:11.736 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 5f279b59-b626-4a73-a622-f0480bc028a2 1 2023-11-27T20:41:11.742 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:11.739+0000 7f759f04a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T20:41:11.758 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:11.756+0000 7ff403245040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T20:41:11.794 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:11.794+0000 7f759f04a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T20:41:11.808 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:11.807+0000 7ff403245040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T20:41:11.863 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:11.862+0000 7f759f04a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T20:41:11.870 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:11.869+0000 7ff403245040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T20:41:11.914 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:11.914+0000 7f759f04a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T20:41:11.920 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:11.918+0000 7ff403245040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T20:41:11.924 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.923+0000 7f81ca89b640 1 Processor -- start 2023-11-27T20:41:11.924 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.923+0000 7f81ca89b640 1 -- start start 2023-11-27T20:41:11.926 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.925+0000 7f81ca89b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c414fc20 0x7f81c40c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:11.927 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.925+0000 7f81ca89b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f81c4152560 0x7f81c41529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:11.927 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.925+0000 7f81ca89b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c4150000 con 0x7f81c4072320 2023-11-27T20:41:11.927 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.925+0000 7f81ca89b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c4156800 con 0x7f81c4152560 2023-11-27T20:41:11.927 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.925+0000 7f81ca89b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c4155bf0 con 0x7f81c414fc20 2023-11-27T20:41:11.927 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.925+0000 7f81c3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c414fc20 0x7f81c40c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:11.927 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.925+0000 7f81c8e38640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f81c4152560 0x7f81c41529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:11.927 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.925+0000 7f81c3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c414fc20 0x7f81c40c1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:46878/0 (socket says 172.21.15.183:46878) 2023-11-27T20:41:11.927 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.925+0000 7f81c3fff640 1 -- 172.21.15.183:0/90693510 learned_addr learned my addr 172.21.15.183:0/90693510 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:11.928 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.926+0000 7f81c3fff640 1 -- 172.21.15.183:0/90693510 >> v2:172.21.15.183:3300/0 conn(0x7f81c4152560 msgr2=0x7f81c41529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:11.928 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.926+0000 7f81c3fff640 1 --2- 172.21.15.183:0/90693510 >> v2:172.21.15.183:3300/0 conn(0x7f81c4152560 0x7f81c41529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.928 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.926+0000 7f81c3fff640 1 -- 172.21.15.183:0/90693510 >> v1:172.21.15.91:6789/0 conn(0x7f81c4072320 legacy=0x7f81c406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:11.928 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.926+0000 7f81c3fff640 1 -- 172.21.15.183:0/90693510 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4155ed0 con 0x7f81c414fc20 2023-11-27T20:41:11.928 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.926+0000 7f81c8e38640 1 --2- 172.21.15.183:0/90693510 >> v2:172.21.15.183:3300/0 conn(0x7f81c4152560 0x7f81c41529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:11.929 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.927+0000 7f81c3fff640 1 --2- 172.21.15.183:0/90693510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c414fc20 0x7f81c40c1970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009870 tx=0x7f81b402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=920ab965b406b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:11.930 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.927+0000 7f81c37fe640 1 -- 172.21.15.183:0/90693510 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4031640 con 0x7f81c414fc20 2023-11-27T20:41:11.930 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.927+0000 7f81c37fe640 1 -- 172.21.15.183:0/90693510 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b40317a0 con 0x7f81c414fc20 2023-11-27T20:41:11.930 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.927+0000 7f81c37fe640 1 -- 172.21.15.183:0/90693510 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4031b30 con 0x7f81c414fc20 2023-11-27T20:41:11.930 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.928+0000 7f81ca89b640 1 -- 172.21.15.183:0/90693510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c414fc20 msgr2=0x7f81c40c1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:11.930 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.928+0000 7f81ca89b640 1 --2- 172.21.15.183:0/90693510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c414fc20 0x7f81c40c1970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009870 tx=0x7f81b402b8f0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.930 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.928+0000 7f81ca89b640 1 -- 172.21.15.183:0/90693510 shutdown_connections 2023-11-27T20:41:11.930 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.928+0000 7f81ca89b640 1 --2- 172.21.15.183:0/90693510 >> v2:172.21.15.183:3300/0 conn(0x7f81c4152560 0x7f81c41529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.930 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.928+0000 7f81ca89b640 1 --2- 172.21.15.183:0/90693510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c414fc20 0x7f81c40c1970 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.931 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.928+0000 7f81ca89b640 1 -- 172.21.15.183:0/90693510 >> 172.21.15.183:0/90693510 conn(0x7f81c40c39e0 msgr2=0x7f81c40c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:11.931 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.928+0000 7f81ca89b640 1 -- 172.21.15.183:0/90693510 shutdown_connections 2023-11-27T20:41:11.931 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.928+0000 7f81ca89b640 1 -- 172.21.15.183:0/90693510 wait complete. 2023-11-27T20:41:11.933 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.930+0000 7f81ca89b640 1 Processor -- start 2023-11-27T20:41:11.933 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.930+0000 7f81ca89b640 1 -- start start 2023-11-27T20:41:11.933 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81ca89b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c4072320 0x7f81c41eb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:11.934 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81ca89b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c414fc20 0x7f81c406e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:11.934 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81ca89b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c4152560 0x7f81c414ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:11.934 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81ca89b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c406d1b0 con 0x7f81c414fc20 2023-11-27T20:41:11.934 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81ca89b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c406e560 con 0x7f81c4152560 2023-11-27T20:41:11.934 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81ca89b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40ac000 con 0x7f81c4072320 2023-11-27T20:41:11.934 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81c3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c4072320 0x7f81c41eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:11.934 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81c3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c4072320 0x7f81c41eb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:46892/0 (socket says 172.21.15.183:46892) 2023-11-27T20:41:11.934 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81c3fff640 1 -- 172.21.15.183:0/236388040 learned_addr learned my addr 172.21.15.183:0/236388040 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:11.934 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81c8e38640 1 --2- 172.21.15.183:0/236388040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c4152560 0x7f81c414ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:11.935 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81bbfff640 1 --2- 172.21.15.183:0/236388040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c414fc20 0x7f81c406e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:11.935 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81c3fff640 1 -- 172.21.15.183:0/236388040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c4152560 msgr2=0x7f81c414ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:11.935 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81c3fff640 1 --2- 172.21.15.183:0/236388040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c4152560 0x7f81c414ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.935 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81c3fff640 1 -- 172.21.15.183:0/236388040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c414fc20 msgr2=0x7f81c406e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:11.935 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81c3fff640 1 --2- 172.21.15.183:0/236388040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c414fc20 0x7f81c406e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:11.935 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81c3fff640 1 -- 172.21.15.183:0/236388040 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc009a70 con 0x7f81c4072320 2023-11-27T20:41:11.935 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.931+0000 7f81bbfff640 1 --2- 172.21.15.183:0/236388040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c414fc20 0x7f81c406e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:11.935 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.932+0000 7f81c3fff640 1 --2- 172.21.15.183:0/236388040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c4072320 0x7f81c41eb370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f81b4000c00 tx=0x7f81b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:11.935 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.932+0000 7f81c17fa640 1 -- 172.21.15.183:0/236388040 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b403a930 con 0x7f81c4072320 2023-11-27T20:41:11.936 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.932+0000 7f81c17fa640 1 -- 172.21.15.183:0/236388040 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b403aab0 con 0x7f81c4072320 2023-11-27T20:41:11.936 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.932+0000 7f81c17fa640 1 -- 172.21.15.183:0/236388040 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b403ae60 con 0x7f81c4072320 2023-11-27T20:41:11.936 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.932+0000 7f81ca89b640 1 -- 172.21.15.183:0/236388040 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b40094d0 con 0x7f81c4072320 2023-11-27T20:41:11.936 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.932+0000 7f81ca89b640 1 -- 172.21.15.183:0/236388040 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c41ed8d0 con 0x7f81c4072320 2023-11-27T20:41:11.936 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.932+0000 7f81c17fa640 1 -- 172.21.15.183:0/236388040 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f81b402f050 con 0x7f81c4072320 2023-11-27T20:41:11.936 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.933+0000 7f81c17fa640 1 -- 172.21.15.183:0/236388040 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f81b4044880 con 0x7f81c4072320 2023-11-27T20:41:11.937 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.934+0000 7f81ca89b640 1 -- 172.21.15.183:0/236388040 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c404e840 con 0x7f81c4072320 2023-11-27T20:41:11.937 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:11.936+0000 7f81c17fa640 1 -- 172.21.15.183:0/236388040 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f81b4035020 con 0x7f81c4072320 2023-11-27T20:41:12.015 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.014+0000 7f81ca89b640 1 -- 172.21.15.183:0/236388040 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5f279b59-b626-4a73-a622-f0480bc028a2", "id": 1} v 0) v1 -- 0x7f81c4068350 con 0x7f81c4072320 2023-11-27T20:41:12.021 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.021+0000 7f81c17fa640 1 -- 172.21.15.183:0/236388040 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f279b59-b626-4a73-a622-f0480bc028a2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f81b402d040 con 0x7f81c4072320 2023-11-27T20:41:12.022 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-27T20:41:12.025 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.022+0000 7f81ca89b640 1 -- 172.21.15.183:0/236388040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c4072320 msgr2=0x7f81c41eb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.025 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.022+0000 7f81ca89b640 1 --2- 172.21.15.183:0/236388040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c4072320 0x7f81c41eb370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f81b4000c00 tx=0x7f81b40046c0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.025 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.022+0000 7f81ca89b640 1 -- 172.21.15.183:0/236388040 shutdown_connections 2023-11-27T20:41:12.025 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.022+0000 7f81ca89b640 1 --2- 172.21.15.183:0/236388040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c4152560 0x7f81c414ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.025 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.022+0000 7f81ca89b640 1 --2- 172.21.15.183:0/236388040 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c414fc20 0x7f81c406e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.026 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.022+0000 7f81ca89b640 1 --2- 172.21.15.183:0/236388040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c4072320 0x7f81c41eb370 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.026 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.023+0000 7f81ca89b640 1 -- 172.21.15.183:0/236388040 >> 172.21.15.183:0/236388040 conn(0x7f81c40c39e0 msgr2=0x7f81c4145330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:12.026 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.023+0000 7f81ca89b640 1 -- 172.21.15.183:0/236388040 shutdown_connections 2023-11-27T20:41:12.026 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.023+0000 7f81ca89b640 1 -- 172.21.15.183:0/236388040 wait complete. 2023-11-27T20:41:12.035 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:12.034+0000 7ff403245040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-27T20:41:12.036 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:12.035+0000 7f759f04a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-27T20:41:12.041 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new a7ca606e-55f4-485e-bc2a-f43fe0ca007d 2 2023-11-27T20:41:12.115 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:12.113+0000 7ff403245040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T20:41:12.122 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:12.121+0000 7f759f04a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T20:41:12.168 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:12.166+0000 7ff403245040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T20:41:12.179 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:12.178+0000 7f759f04a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T20:41:12.225 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.224+0000 7f9b3296e640 1 Processor -- start 2023-11-27T20:41:12.225 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.224+0000 7f9b3296e640 1 -- start start 2023-11-27T20:41:12.226 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.225+0000 7f9b3296e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9b2c0c7e90 0x7f9b2c0c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.226 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.225+0000 7f9b3296e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2c0bd8d0 con 0x7f9b2c14e810 2023-11-27T20:41:12.226 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.225+0000 7f9b3296e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2c0c6e60 con 0x7f9b2c0c4e50 2023-11-27T20:41:12.226 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.225+0000 7f9b3296e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2c0c70d0 con 0x7f9b2c0c7e90 2023-11-27T20:41:12.226 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b30f0b640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f9b2c0c4e50 0x7f9b2c06b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:35578/0 (socket says 172.21.15.183:35578) 2023-11-27T20:41:12.227 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b30f0b640 1 -- 172.21.15.183:0/180594674 learned_addr learned my addr 172.21.15.183:0/180594674 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-11-27T20:41:12.231 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b2b7fe640 1 --2- 172.21.15.183:0/180594674 >> v2:172.21.15.91:3300/0 conn(0x7f9b2c0c7e90 0x7f9b2c0c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348582904 0 0) 0x7f9b2c0c6e60 con 0x7f9b2c0c4e50 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b14003520 con 0x7f9b2c0c4e50 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3356190232 0 0) 0x7f9b14003520 con 0x7f9b2c0c4e50 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 >> v2:172.21.15.91:3300/0 conn(0x7f9b2c0c7e90 msgr2=0x7f9b2c0c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b2affd640 1 --2- 172.21.15.183:0/180594674 >> v2:172.21.15.91:3300/0 conn(0x7f9b2c0c7e90 0x7f9b2c0c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 >> v1:172.21.15.91:6789/0 conn(0x7f9b2c14e810 legacy=0x7f9b2c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c0c73b0 con 0x7f9b2c0c4e50 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.226+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f9b240019f0 con 0x7f9b2c0c4e50 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 >> v1:172.21.15.183:6789/0 conn(0x7f9b2c0c4e50 legacy=0x7f9b2c06b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b2affd640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b14003970 0x7f9b14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.232 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b2affd640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b140047c0 0x7f9b14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b2affd640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b14005180 0x7f9b1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0c70d0 con 0x7f9b140047c0 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1400c120 con 0x7f9b14005180 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1400c2e0 con 0x7f9b14003970 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b2bfff640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b14003970 0x7f9b14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b30f0b640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b14005180 0x7f9b1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b2b7fe640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b140047c0 0x7f9b14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b30f0b640 1 -- 172.21.15.183:0/180594674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b14003970 msgr2=0x7f9b14003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b30f0b640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b14003970 0x7f9b14003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b30f0b640 1 -- 172.21.15.183:0/180594674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b140047c0 msgr2=0x7f9b14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b30f0b640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b140047c0 0x7f9b14004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.233 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.227+0000 7f9b30f0b640 1 -- 172.21.15.183:0/180594674 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14003520 con 0x7f9b14005180 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.228+0000 7f9b30f0b640 1 -- 172.21.15.183:0/180594674 reap_dead start 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.229+0000 7f9b30f0b640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b14005180 0x7f9b1400b980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400a830 tx=0x7f9b140057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be8dc3131fd02eca server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.229+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b240072d0 con 0x7f9b14005180 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.229+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2402f070 con 0x7f9b14005180 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.229+0000 7f9b2affd640 1 -- 172.21.15.183:0/180594674 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b240076b0 con 0x7f9b14005180 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.229+0000 7f9b3296e640 1 -- 172.21.15.183:0/180594674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b14005180 msgr2=0x7f9b1400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.229+0000 7f9b3296e640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b14005180 0x7f9b1400b980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400a830 tx=0x7f9b140057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.230+0000 7f9b3296e640 1 -- 172.21.15.183:0/180594674 shutdown_connections 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.230+0000 7f9b3296e640 1 --2- 172.21.15.183:0/180594674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b14005180 0x7f9b1400b980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.230+0000 7f9b3296e640 1 -- 172.21.15.183:0/180594674 >> 172.21.15.183:0/180594674 conn(0x7f9b2c0ca170 msgr2=0x7f9b2c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.230+0000 7f9b3296e640 1 -- 172.21.15.183:0/180594674 shutdown_connections 2023-11-27T20:41:12.234 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.230+0000 7f9b3296e640 1 -- 172.21.15.183:0/180594674 wait complete. 2023-11-27T20:41:12.235 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:12.227+0000 7ff403245040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T20:41:12.237 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.231+0000 7f9b3296e640 1 Processor -- start 2023-11-27T20:41:12.237 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.231+0000 7f9b3296e640 1 -- start start 2023-11-27T20:41:12.237 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.232+0000 7f9b3296e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b14005180 0x7f9b2c0bcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.237 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.232+0000 7f9b3296e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b2c1587c0 0x7f9b2c0c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.237 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.232+0000 7f9b3296e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2c1486d0 0x7f9b2c148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.237 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.232+0000 7f9b3296e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0c1b80 con 0x7f9b14005180 2023-11-27T20:41:12.237 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.232+0000 7f9b3296e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c149090 con 0x7f9b2c1587c0 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.232+0000 7f9b3296e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c151c40 con 0x7f9b2c1486d0 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b2c1587c0 0x7f9b2c0c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b30f0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2c1486d0 0x7f9b2c148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b2c1587c0 0x7f9b2c0c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38142/0 (socket says 172.21.15.183:38142) 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2b7fe640 1 -- 172.21.15.183:0/2697244787 learned_addr learned my addr 172.21.15.183:0/2697244787 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2bfff640 1 --2- 172.21.15.183:0/2697244787 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b14005180 0x7f9b2c0bcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2b7fe640 1 -- 172.21.15.183:0/2697244787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2c1486d0 msgr2=0x7f9b2c148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2b7fe640 1 --2- 172.21.15.183:0/2697244787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2c1486d0 0x7f9b2c148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2b7fe640 1 -- 172.21.15.183:0/2697244787 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b14005180 msgr2=0x7f9b2c0bcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2b7fe640 1 --2- 172.21.15.183:0/2697244787 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b14005180 0x7f9b2c0bcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.238 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2b7fe640 1 -- 172.21.15.183:0/2697244787 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c14f110 con 0x7f9b2c1587c0 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b30f0b640 1 --2- 172.21.15.183:0/2697244787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2c1486d0 0x7f9b2c148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2bfff640 1 --2- 172.21.15.183:0/2697244787 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b14005180 0x7f9b2c0bcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.233+0000 7f9b2b7fe640 1 --2- 172.21.15.183:0/2697244787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b2c1587c0 0x7f9b2c0c3750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b20011590 tx=0x7f9b20011a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.234+0000 7f9b28ff9640 1 -- 172.21.15.183:0/2697244787 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b20004220 con 0x7f9b2c1587c0 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.234+0000 7f9b28ff9640 1 -- 172.21.15.183:0/2697244787 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b20004380 con 0x7f9b2c1587c0 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.234+0000 7f9b28ff9640 1 -- 172.21.15.183:0/2697244787 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b20015930 con 0x7f9b2c1587c0 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.234+0000 7f9b3296e640 1 -- 172.21.15.183:0/2697244787 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2c151680 con 0x7f9b2c1587c0 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.234+0000 7f9b3296e640 1 -- 172.21.15.183:0/2697244787 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2c0c3c90 con 0x7f9b2c1587c0 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.234+0000 7f9b28ff9640 1 -- 172.21.15.183:0/2697244787 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f9b20005990 con 0x7f9b2c1587c0 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.234+0000 7f9b28ff9640 1 -- 172.21.15.183:0/2697244787 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9b20003cf0 con 0x7f9b2c1587c0 2023-11-27T20:41:12.239 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.235+0000 7f9b3296e640 1 -- 172.21.15.183:0/2697244787 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c0c1cf0 con 0x7f9b2c1587c0 2023-11-27T20:41:12.240 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.238+0000 7f9b28ff9640 1 -- 172.21.15.183:0/2697244787 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f9b20022060 con 0x7f9b2c1587c0 2023-11-27T20:41:12.243 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:12.243+0000 7f759f04a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T20:41:12.283 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:12.282+0000 7ff403245040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T20:41:12.301 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:12.300+0000 7f759f04a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T20:41:12.316 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.315+0000 7f9b3296e640 1 -- 172.21.15.183:0/2697244787 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a7ca606e-55f4-485e-bc2a-f43fe0ca007d", "id": 2} v 0) v1 -- 0x7f9b2c068350 con 0x7f9b2c1587c0 2023-11-27T20:41:12.323 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.323+0000 7f9b28ff9640 1 -- 172.21.15.183:0/2697244787 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7ca606e-55f4-485e-bc2a-f43fe0ca007d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b2002a020 con 0x7f9b2c1587c0 2023-11-27T20:41:12.323 INFO:teuthology.orchestra.run.smithi183.stdout:2 2023-11-27T20:41:12.324 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.324+0000 7f9b3296e640 1 -- 172.21.15.183:0/2697244787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b2c1587c0 msgr2=0x7f9b2c0c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.325 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.324+0000 7f9b3296e640 1 --2- 172.21.15.183:0/2697244787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b2c1587c0 0x7f9b2c0c3750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b20011590 tx=0x7f9b20011a50 comp rx=0 tx=0).stop 2023-11-27T20:41:12.325 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.324+0000 7f9b3296e640 1 -- 172.21.15.183:0/2697244787 shutdown_connections 2023-11-27T20:41:12.325 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.324+0000 7f9b3296e640 1 --2- 172.21.15.183:0/2697244787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2c1486d0 0x7f9b2c148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.325 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.324+0000 7f9b3296e640 1 --2- 172.21.15.183:0/2697244787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b2c1587c0 0x7f9b2c0c3750 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.325 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.324+0000 7f9b3296e640 1 --2- 172.21.15.183:0/2697244787 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b14005180 0x7f9b2c0bcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.325 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.324+0000 7f9b3296e640 1 -- 172.21.15.183:0/2697244787 >> 172.21.15.183:0/2697244787 conn(0x7f9b2c0ca170 msgr2=0x7f9b2c0ab170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:12.325 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.324+0000 7f9b3296e640 1 -- 172.21.15.183:0/2697244787 shutdown_connections 2023-11-27T20:41:12.325 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.324+0000 7f9b3296e640 1 -- 172.21.15.183:0/2697244787 wait complete. 2023-11-27T20:41:12.341 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new ff789988-5150-4465-9807-30ece471b6fa 3 2023-11-27T20:41:12.519 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.518+0000 7f0bac905640 1 Processor -- start 2023-11-27T20:41:12.519 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.519+0000 7f0bac905640 1 -- start start 2023-11-27T20:41:12.521 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0bac905640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0ba80c5ec0 0x7f0ba80c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.521 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0bac905640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ba80c45d0 0x7f0ba80c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.521 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0bac905640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba80bfdc0 con 0x7f0ba80721a0 2023-11-27T20:41:12.521 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0bac905640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba806e390 con 0x7f0ba80c5ec0 2023-11-27T20:41:12.521 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0bac905640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba806ddd0 con 0x7f0ba80c45d0 2023-11-27T20:41:12.521 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0ba659c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0ba80c5ec0 0x7f0ba80c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.521 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0ba659c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0ba80c5ec0 0x7f0ba80c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38156/0 (socket says 172.21.15.183:38156) 2023-11-27T20:41:12.521 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0ba659c640 1 -- 172.21.15.183:0/3050741803 learned_addr learned my addr 172.21.15.183:0/3050741803 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:12.521 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0b9dd9b640 1 --2- 172.21.15.183:0/3050741803 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ba80c45d0 0x7f0ba80c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.522 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0ba659c640 1 -- 172.21.15.183:0/3050741803 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ba80c45d0 msgr2=0x7f0ba80c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:12.522 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0ba659c640 1 --2- 172.21.15.183:0/3050741803 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ba80c45d0 0x7f0ba80c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.522 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0ba659c640 1 -- 172.21.15.183:0/3050741803 >> v1:172.21.15.183:6789/0 conn(0x7f0ba80721a0 legacy=0x7f0ba8155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.523 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.520+0000 7f0ba659c640 1 -- 172.21.15.183:0/3050741803 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba806e0b0 con 0x7f0ba80c5ec0 2023-11-27T20:41:12.523 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.522+0000 7f0ba659c640 1 --2- 172.21.15.183:0/3050741803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c5ec0 0x7f0ba80c2c30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009870 tx=0x7f0b9802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d18c9e9987d7b24 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:12.523 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.522+0000 7f0ba5d9b640 1 -- 172.21.15.183:0/3050741803 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b980317c0 con 0x7f0ba80c5ec0 2023-11-27T20:41:12.523 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.522+0000 7f0ba5d9b640 1 -- 172.21.15.183:0/3050741803 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b98031920 con 0x7f0ba80c5ec0 2023-11-27T20:41:12.523 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.522+0000 7f0ba5d9b640 1 -- 172.21.15.183:0/3050741803 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98031cb0 con 0x7f0ba80c5ec0 2023-11-27T20:41:12.524 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.522+0000 7f0bac905640 1 -- 172.21.15.183:0/3050741803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c5ec0 msgr2=0x7f0ba80c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.524 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.522+0000 7f0bac905640 1 --2- 172.21.15.183:0/3050741803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c5ec0 0x7f0ba80c2c30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009870 tx=0x7f0b9802b860 comp rx=0 tx=0).stop 2023-11-27T20:41:12.524 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.523+0000 7f0bac905640 1 -- 172.21.15.183:0/3050741803 shutdown_connections 2023-11-27T20:41:12.524 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.523+0000 7f0bac905640 1 --2- 172.21.15.183:0/3050741803 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ba80c45d0 0x7f0ba80c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.524 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.523+0000 7f0bac905640 1 --2- 172.21.15.183:0/3050741803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c5ec0 0x7f0ba80c2c30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.524 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.523+0000 7f0bac905640 1 -- 172.21.15.183:0/3050741803 >> 172.21.15.183:0/3050741803 conn(0x7f0ba806a500 msgr2=0x7f0ba806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:12.524 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.523+0000 7f0bac905640 1 -- 172.21.15.183:0/3050741803 shutdown_connections 2023-11-27T20:41:12.524 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.523+0000 7f0bac905640 1 -- 172.21.15.183:0/3050741803 wait complete. 2023-11-27T20:41:12.525 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.524+0000 7f0bac905640 1 Processor -- start 2023-11-27T20:41:12.525 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.525+0000 7f0bac905640 1 -- start start 2023-11-27T20:41:12.528 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.525+0000 7f0bac905640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ba80721a0 0x7f0ba81530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.528 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.525+0000 7f0bac905640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c45d0 0x7f0ba814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.528 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.525+0000 7f0bac905640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ba80c5ec0 0x7f0ba814e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.528 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.525+0000 7f0bac905640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80a61c0 con 0x7f0ba80721a0 2023-11-27T20:41:12.528 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.525+0000 7f0bac905640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80a5e70 con 0x7f0ba80c45d0 2023-11-27T20:41:12.528 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.525+0000 7f0bac905640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba8157c40 con 0x7f0ba80c5ec0 2023-11-27T20:41:12.528 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0b9dd9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c45d0 0x7f0ba814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.529 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0b9dd9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c45d0 0x7f0ba814e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38168/0 (socket says 172.21.15.183:38168) 2023-11-27T20:41:12.529 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0b9dd9b640 1 -- 172.21.15.183:0/4224637857 learned_addr learned my addr 172.21.15.183:0/4224637857 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:12.529 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0ba6d9d640 1 --2- 172.21.15.183:0/4224637857 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ba80c5ec0 0x7f0ba814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.529 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0ba659c640 1 --2- 172.21.15.183:0/4224637857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ba80721a0 0x7f0ba81530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.530 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0b9dd9b640 1 -- 172.21.15.183:0/4224637857 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ba80c5ec0 msgr2=0x7f0ba814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.530 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0b9dd9b640 1 --2- 172.21.15.183:0/4224637857 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ba80c5ec0 0x7f0ba814e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.530 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0b9dd9b640 1 -- 172.21.15.183:0/4224637857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ba80721a0 msgr2=0x7f0ba81530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.530 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0b9dd9b640 1 --2- 172.21.15.183:0/4224637857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ba80721a0 0x7f0ba81530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.530 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0b9dd9b640 1 -- 172.21.15.183:0/4224637857 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b980094d0 con 0x7f0ba80c45d0 2023-11-27T20:41:12.531 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.526+0000 7f0b9dd9b640 1 --2- 172.21.15.183:0/4224637857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c45d0 0x7f0ba814e340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000e9b0 tx=0x7f0b9000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:12.531 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.527+0000 7f0b9f7fe640 1 -- 172.21.15.183:0/4224637857 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90009670 con 0x7f0ba80c45d0 2023-11-27T20:41:12.531 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.527+0000 7f0b9f7fe640 1 -- 172.21.15.183:0/4224637857 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9000c9a0 con 0x7f0ba80c45d0 2023-11-27T20:41:12.531 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.527+0000 7f0bac905640 1 -- 172.21.15.183:0/4224637857 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba8158960 con 0x7f0ba80c45d0 2023-11-27T20:41:12.531 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.527+0000 7f0b9f7fe640 1 -- 172.21.15.183:0/4224637857 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9000cd50 con 0x7f0ba80c45d0 2023-11-27T20:41:12.531 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.527+0000 7f0bac905640 1 -- 172.21.15.183:0/4224637857 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba8153610 con 0x7f0ba80c45d0 2023-11-27T20:41:12.532 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.527+0000 7f0b9f7fe640 1 -- 172.21.15.183:0/4224637857 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f0b90013470 con 0x7f0ba80c45d0 2023-11-27T20:41:12.532 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.527+0000 7f0b9f7fe640 1 -- 172.21.15.183:0/4224637857 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0b9001cde0 con 0x7f0ba80c45d0 2023-11-27T20:41:12.532 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.528+0000 7f0bac905640 1 -- 172.21.15.183:0/4224637857 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba8068350 con 0x7f0ba80c45d0 2023-11-27T20:41:12.533 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.531+0000 7f0b9f7fe640 1 -- 172.21.15.183:0/4224637857 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f0b90021060 con 0x7f0ba80c45d0 2023-11-27T20:41:12.619 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.619+0000 7f0bac905640 1 -- 172.21.15.183:0/4224637857 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ff789988-5150-4465-9807-30ece471b6fa", "id": 3} v 0) v1 -- 0x7f0ba80bfa00 con 0x7f0ba80c45d0 2023-11-27T20:41:12.625 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.624+0000 7f0b9f7fe640 1 -- 172.21.15.183:0/4224637857 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff789988-5150-4465-9807-30ece471b6fa", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b90017070 con 0x7f0ba80c45d0 2023-11-27T20:41:12.626 INFO:teuthology.orchestra.run.smithi183.stdout:3 2023-11-27T20:41:12.627 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.626+0000 7f0bac905640 1 -- 172.21.15.183:0/4224637857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c45d0 msgr2=0x7f0ba814e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.627 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.626+0000 7f0bac905640 1 --2- 172.21.15.183:0/4224637857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c45d0 0x7f0ba814e340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000e9b0 tx=0x7f0b9000ee70 comp rx=0 tx=0).stop 2023-11-27T20:41:12.627 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.626+0000 7f0bac905640 1 -- 172.21.15.183:0/4224637857 shutdown_connections 2023-11-27T20:41:12.627 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.626+0000 7f0bac905640 1 --2- 172.21.15.183:0/4224637857 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ba80c5ec0 0x7f0ba814e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.627 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.626+0000 7f0bac905640 1 --2- 172.21.15.183:0/4224637857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ba80c45d0 0x7f0ba814e340 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.628 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.626+0000 7f0bac905640 1 --2- 172.21.15.183:0/4224637857 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ba80721a0 0x7f0ba81530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.628 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.626+0000 7f0bac905640 1 -- 172.21.15.183:0/4224637857 >> 172.21.15.183:0/4224637857 conn(0x7f0ba806a500 msgr2=0x7f0ba8153f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:12.628 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.626+0000 7f0bac905640 1 -- 172.21.15.183:0/4224637857 shutdown_connections 2023-11-27T20:41:12.628 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.626+0000 7f0bac905640 1 -- 172.21.15.183:0/4224637857 wait complete. 2023-11-27T20:41:12.643 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new b22a07a4-05e6-48d2-a771-6cae06f48ab9 4 2023-11-27T20:41:12.735 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:12.734+0000 7ff403245040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-27T20:41:12.809 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:12.808+0000 7f759f04a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-27T20:41:12.814 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.814+0000 7fa42def1640 1 Processor -- start 2023-11-27T20:41:12.815 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.814+0000 7fa42def1640 1 -- start start 2023-11-27T20:41:12.816 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.815+0000 7fa42def1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa42814f910 0x7fa4280c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.816 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.815+0000 7fa42def1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa4280c4460 0x7fa4280a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.816 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.815+0000 7fa42def1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42814fcf0 con 0x7fa4280a5260 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.815+0000 7fa42def1640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42806c4f0 con 0x7fa4280c4460 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.815+0000 7fa42def1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4280c55b0 con 0x7fa42814f910 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.815+0000 7fa42ceef640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa42814f910 0x7fa4280c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.815+0000 7fa42ceef640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa42814f910 0x7fa4280c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38170/0 (socket says 172.21.15.183:38170) 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.815+0000 7fa42ceef640 1 -- 172.21.15.183:0/136546906 learned_addr learned my addr 172.21.15.183:0/136546906 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.815+0000 7fa42d6f0640 1 --1- 172.21.15.183:0/136546906 >> v1:172.21.15.183:6789/0 conn(0x7fa4280a5260 0x7fa428152250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:35594/0 (socket says 172.21.15.183:35594) 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.816+0000 7fa427fff640 1 --2- 172.21.15.183:0/136546906 >> v2:172.21.15.91:3300/0 conn(0x7fa4280c4460 0x7fa4280a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.816+0000 7fa42ceef640 1 -- 172.21.15.183:0/136546906 >> v2:172.21.15.91:3300/0 conn(0x7fa4280c4460 msgr2=0x7fa4280a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.816+0000 7fa42ceef640 1 --2- 172.21.15.183:0/136546906 >> v2:172.21.15.91:3300/0 conn(0x7fa4280c4460 0x7fa4280a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.816+0000 7fa42ceef640 1 -- 172.21.15.183:0/136546906 >> v1:172.21.15.183:6789/0 conn(0x7fa4280a5260 legacy=0x7fa428152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.817 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.816+0000 7fa42ceef640 1 -- 172.21.15.183:0/136546906 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa428155840 con 0x7fa42814f910 2023-11-27T20:41:12.818 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.817+0000 7fa42ceef640 1 --2- 172.21.15.183:0/136546906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 0x7fa4280c4f20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa4280c32a0 tx=0x7fa41c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fd89f060dfeadb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:12.818 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.817+0000 7fa4277fe640 1 -- 172.21.15.183:0/136546906 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c031870 con 0x7fa42814f910 2023-11-27T20:41:12.818 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.817+0000 7fa4277fe640 1 -- 172.21.15.183:0/136546906 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c0319d0 con 0x7fa42814f910 2023-11-27T20:41:12.818 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.817+0000 7fa4277fe640 1 -- 172.21.15.183:0/136546906 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c031d60 con 0x7fa42814f910 2023-11-27T20:41:12.819 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.818+0000 7fa42def1640 1 -- 172.21.15.183:0/136546906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 msgr2=0x7fa4280c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.819 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.818+0000 7fa42def1640 1 --2- 172.21.15.183:0/136546906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 0x7fa4280c4f20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa4280c32a0 tx=0x7fa41c02b910 comp rx=0 tx=0).stop 2023-11-27T20:41:12.820 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.818+0000 7fa42def1640 1 -- 172.21.15.183:0/136546906 shutdown_connections 2023-11-27T20:41:12.820 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.818+0000 7fa42def1640 1 --2- 172.21.15.183:0/136546906 >> v2:172.21.15.91:3300/0 conn(0x7fa4280c4460 0x7fa4280a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.820 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.818+0000 7fa42def1640 1 --2- 172.21.15.183:0/136546906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 0x7fa4280c4f20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.820 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.818+0000 7fa42def1640 1 -- 172.21.15.183:0/136546906 >> 172.21.15.183:0/136546906 conn(0x7fa4280c5b50 msgr2=0x7fa4280c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:12.820 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.819+0000 7fa42def1640 1 -- 172.21.15.183:0/136546906 shutdown_connections 2023-11-27T20:41:12.820 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.819+0000 7fa42def1640 1 -- 172.21.15.183:0/136546906 wait complete. 2023-11-27T20:41:12.821 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.820+0000 7fa42def1640 1 Processor -- start 2023-11-27T20:41:12.821 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.820+0000 7fa42def1640 1 -- start start 2023-11-27T20:41:12.822 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.821+0000 7fa42def1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4280a5260 0x7fa428072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.822 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.821+0000 7fa42def1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4280c4460 0x7fa4280bf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.822 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.821+0000 7fa42def1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 0x7fa4280c0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:12.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.821+0000 7fa42def1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280717e0 con 0x7fa4280a5260 2023-11-27T20:41:12.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.821+0000 7fa42def1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa428150550 con 0x7fa42814f910 2023-11-27T20:41:12.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.821+0000 7fa42def1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa428071a80 con 0x7fa4280c4460 2023-11-27T20:41:12.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa42d6f0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 0x7fa4280c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa427fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4280c4460 0x7fa4280bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa42d6f0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 0x7fa4280c0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38172/0 (socket says 172.21.15.183:38172) 2023-11-27T20:41:12.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa42d6f0640 1 -- 172.21.15.183:0/2319273170 learned_addr learned my addr 172.21.15.183:0/2319273170 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:12.823 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa42ceef640 1 --2- 172.21.15.183:0/2319273170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4280a5260 0x7fa428072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:12.824 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa42d6f0640 1 -- 172.21.15.183:0/2319273170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4280c4460 msgr2=0x7fa4280bf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.824 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa42d6f0640 1 --2- 172.21.15.183:0/2319273170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4280c4460 0x7fa4280bf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.824 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa42d6f0640 1 -- 172.21.15.183:0/2319273170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4280a5260 msgr2=0x7fa428072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.824 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa42d6f0640 1 --2- 172.21.15.183:0/2319273170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4280a5260 0x7fa428072280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa42d6f0640 1 -- 172.21.15.183:0/2319273170 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0094d0 con 0x7fa42814f910 2023-11-27T20:41:12.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.822+0000 7fa42d6f0640 1 --2- 172.21.15.183:0/2319273170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 0x7fa4280c0410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa42000c730 tx=0x7fa42000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:12.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.823+0000 7fa4257fa640 1 -- 172.21.15.183:0/2319273170 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42000ce40 con 0x7fa42814f910 2023-11-27T20:41:12.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.823+0000 7fa4257fa640 1 -- 172.21.15.183:0/2319273170 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42000a640 con 0x7fa42814f910 2023-11-27T20:41:12.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.823+0000 7fa4257fa640 1 -- 172.21.15.183:0/2319273170 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42000a9f0 con 0x7fa42814f910 2023-11-27T20:41:12.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.823+0000 7fa42def1640 1 -- 172.21.15.183:0/2319273170 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa428071d60 con 0x7fa42814f910 2023-11-27T20:41:12.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.823+0000 7fa42def1640 1 -- 172.21.15.183:0/2319273170 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4281501e0 con 0x7fa42814f910 2023-11-27T20:41:12.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.823+0000 7fa4257fa640 1 -- 172.21.15.183:0/2319273170 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fa420007070 con 0x7fa42814f910 2023-11-27T20:41:12.825 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.823+0000 7fa4257fa640 1 -- 172.21.15.183:0/2319273170 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa420007830 con 0x7fa42814f910 2023-11-27T20:41:12.826 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.824+0000 7fa42def1640 1 -- 172.21.15.183:0/2319273170 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42804e840 con 0x7fa42814f910 2023-11-27T20:41:12.827 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.827+0000 7fa4257fa640 1 -- 172.21.15.183:0/2319273170 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fa420021060 con 0x7fa42814f910 2023-11-27T20:41:12.894 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:12.893+0000 7ff403245040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T20:41:12.903 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.902+0000 7fa42def1640 1 -- 172.21.15.183:0/2319273170 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b22a07a4-05e6-48d2-a771-6cae06f48ab9", "id": 4} v 0) v1 -- 0x7fa4281531f0 con 0x7fa42814f910 2023-11-27T20:41:12.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.908+0000 7fa4257fa640 1 -- 172.21.15.183:0/2319273170 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b22a07a4-05e6-48d2-a771-6cae06f48ab9", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa420017070 con 0x7fa42814f910 2023-11-27T20:41:12.909 INFO:teuthology.orchestra.run.smithi183.stdout:4 2023-11-27T20:41:12.910 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.909+0000 7fa42def1640 1 -- 172.21.15.183:0/2319273170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 msgr2=0x7fa4280c0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:12.910 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.909+0000 7fa42def1640 1 --2- 172.21.15.183:0/2319273170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 0x7fa4280c0410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa42000c730 tx=0x7fa42000cbf0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.911 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.909+0000 7fa42def1640 1 -- 172.21.15.183:0/2319273170 shutdown_connections 2023-11-27T20:41:12.911 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.909+0000 7fa42def1640 1 --2- 172.21.15.183:0/2319273170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42814f910 0x7fa4280c0410 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.911 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.909+0000 7fa42def1640 1 --2- 172.21.15.183:0/2319273170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4280c4460 0x7fa4280bf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.911 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.909+0000 7fa42def1640 1 --2- 172.21.15.183:0/2319273170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4280a5260 0x7fa428072280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:12.911 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.909+0000 7fa42def1640 1 -- 172.21.15.183:0/2319273170 >> 172.21.15.183:0/2319273170 conn(0x7fa4280c5b50 msgr2=0x7fa42814de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:12.911 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.909+0000 7fa42def1640 1 -- 172.21.15.183:0/2319273170 shutdown_connections 2023-11-27T20:41:12.911 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:12.909+0000 7fa42def1640 1 -- 172.21.15.183:0/2319273170 wait complete. 2023-11-27T20:41:12.926 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 7d558e4f-c27d-49af-91d5-9b1630c826ab 5 2023-11-27T20:41:12.983 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:12.982+0000 7f759f04a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T20:41:13.031 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:13.030+0000 7ff403245040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T20:41:13.084 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:13.083+0000 7ff403245040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T20:41:13.100 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.099+0000 7f3282d75640 1 Processor -- start 2023-11-27T20:41:13.100 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.100+0000 7f3282d75640 1 -- start start 2023-11-27T20:41:13.103 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.101+0000 7f3282d75640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c0bd530 0x7f327c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.103 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.101+0000 7f3282d75640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f327c06b890 0x7f327c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.103 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.101+0000 7f3282d75640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327c1554a0 con 0x7f327c14ae70 2023-11-27T20:41:13.103 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.101+0000 7f3282d75640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327c0c6840 con 0x7f327c06b890 2023-11-27T20:41:13.104 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.101+0000 7f3282d75640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c06b120 con 0x7f327c0bd530 2023-11-27T20:41:13.104 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.101+0000 7f3281572640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c0bd530 0x7f327c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.104 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.101+0000 7f3281572640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c0bd530 0x7f327c154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:46944/0 (socket says 172.21.15.183:46944) 2023-11-27T20:41:13.104 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.101+0000 7f3281572640 1 -- 172.21.15.183:0/505286658 learned_addr learned my addr 172.21.15.183:0/505286658 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:13.104 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.102+0000 7f3282574640 1 --2- 172.21.15.183:0/505286658 >> v2:172.21.15.91:3300/0 conn(0x7f327c06b890 0x7f327c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.105 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.102+0000 7f3281572640 1 -- 172.21.15.183:0/505286658 >> v2:172.21.15.91:3300/0 conn(0x7f327c06b890 msgr2=0x7f327c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:13.105 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.102+0000 7f3281572640 1 --2- 172.21.15.183:0/505286658 >> v2:172.21.15.91:3300/0 conn(0x7f327c06b890 0x7f327c06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.105 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.102+0000 7f3281572640 1 -- 172.21.15.183:0/505286658 >> v1:172.21.15.91:6789/0 conn(0x7f327c14ae70 legacy=0x7f327c0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:13.105 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.102+0000 7f3281572640 1 -- 172.21.15.183:0/505286658 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c06c260 con 0x7f327c0bd530 2023-11-27T20:41:13.108 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.103+0000 7f3281572640 1 --2- 172.21.15.183:0/505286658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c0bd530 0x7f327c154f60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f326c009870 tx=0x7f326c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a254f6c869bae0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:13.108 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.103+0000 7f3280d71640 1 -- 172.21.15.183:0/505286658 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c0317c0 con 0x7f327c0bd530 2023-11-27T20:41:13.108 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.103+0000 7f3280d71640 1 -- 172.21.15.183:0/505286658 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c031920 con 0x7f327c0bd530 2023-11-27T20:41:13.109 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.103+0000 7f3280d71640 1 -- 172.21.15.183:0/505286658 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c031cb0 con 0x7f327c0bd530 2023-11-27T20:41:13.109 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.104+0000 7f3282d75640 1 -- 172.21.15.183:0/505286658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c0bd530 msgr2=0x7f327c154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.109 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.104+0000 7f3282d75640 1 --2- 172.21.15.183:0/505286658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c0bd530 0x7f327c154f60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f326c009870 tx=0x7f326c02b860 comp rx=0 tx=0).stop 2023-11-27T20:41:13.109 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.104+0000 7f3282d75640 1 -- 172.21.15.183:0/505286658 shutdown_connections 2023-11-27T20:41:13.109 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.104+0000 7f3282d75640 1 --2- 172.21.15.183:0/505286658 >> v2:172.21.15.91:3300/0 conn(0x7f327c06b890 0x7f327c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.104+0000 7f3282d75640 1 --2- 172.21.15.183:0/505286658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c0bd530 0x7f327c154f60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.104+0000 7f3282d75640 1 -- 172.21.15.183:0/505286658 >> 172.21.15.183:0/505286658 conn(0x7f327c0ab9e0 msgr2=0x7f327c0abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:13.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.104+0000 7f3282d75640 1 -- 172.21.15.183:0/505286658 shutdown_connections 2023-11-27T20:41:13.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.104+0000 7f3282d75640 1 -- 172.21.15.183:0/505286658 wait complete. 2023-11-27T20:41:13.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.106+0000 7f3282d75640 1 Processor -- start 2023-11-27T20:41:13.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.106+0000 7f3282d75640 1 -- start start 2023-11-27T20:41:13.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.106+0000 7f3282d75640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c06b890 0x7f327c1559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.106+0000 7f3282d75640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f327c0bd530 0x7f327c147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.106+0000 7f3282d75640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f327c14ae70 0x7f327c1504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.112 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.106+0000 7f3282d75640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c1574d0 con 0x7f327c0bd530 2023-11-27T20:41:13.112 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.106+0000 7f3282d75640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c156860 con 0x7f327c14ae70 2023-11-27T20:41:13.112 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.106+0000 7f3282d75640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c155f20 con 0x7f327c06b890 2023-11-27T20:41:13.112 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.107+0000 7f3281d73640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c06b890 0x7f327c1559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.112 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.107+0000 7f3282574640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f327c14ae70 0x7f327c1504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.113 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.107+0000 7f3281d73640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c06b890 0x7f327c1559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:46952/0 (socket says 172.21.15.183:46952) 2023-11-27T20:41:13.113 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.107+0000 7f3281d73640 1 -- 172.21.15.183:0/3189678153 learned_addr learned my addr 172.21.15.183:0/3189678153 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:13.113 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.107+0000 7f3281572640 1 --2- 172.21.15.183:0/3189678153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f327c0bd530 0x7f327c147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.113 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.107+0000 7f3281d73640 1 -- 172.21.15.183:0/3189678153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f327c14ae70 msgr2=0x7f327c1504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.107+0000 7f3281d73640 1 --2- 172.21.15.183:0/3189678153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f327c14ae70 0x7f327c1504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.107+0000 7f3281d73640 1 -- 172.21.15.183:0/3189678153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f327c0bd530 msgr2=0x7f327c147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.107+0000 7f3281d73640 1 --2- 172.21.15.183:0/3189678153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f327c0bd530 0x7f327c147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.107+0000 7f3281d73640 1 -- 172.21.15.183:0/3189678153 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c0094d0 con 0x7f327c06b890 2023-11-27T20:41:13.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.108+0000 7f3281d73640 1 --2- 172.21.15.183:0/3189678153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c06b890 0x7f327c1559e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f327800b3f0 tx=0x7f327800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:13.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.108+0000 7f32727fc640 1 -- 172.21.15.183:0/3189678153 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278011830 con 0x7f327c06b890 2023-11-27T20:41:13.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.108+0000 7f32727fc640 1 -- 172.21.15.183:0/3189678153 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3278011990 con 0x7f327c06b890 2023-11-27T20:41:13.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.108+0000 7f32727fc640 1 -- 172.21.15.183:0/3189678153 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278011d40 con 0x7f327c06b890 2023-11-27T20:41:13.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.108+0000 7f3282d75640 1 -- 172.21.15.183:0/3189678153 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327c147a80 con 0x7f327c06b890 2023-11-27T20:41:13.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.108+0000 7f3282d75640 1 -- 172.21.15.183:0/3189678153 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327c1586c0 con 0x7f327c06b890 2023-11-27T20:41:13.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.108+0000 7f32727fc640 1 -- 172.21.15.183:0/3189678153 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f32780035f0 con 0x7f327c06b890 2023-11-27T20:41:13.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.108+0000 7f32727fc640 1 -- 172.21.15.183:0/3189678153 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3278003e20 con 0x7f327c06b890 2023-11-27T20:41:13.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.109+0000 7f3282d75640 1 -- 172.21.15.183:0/3189678153 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327c04e840 con 0x7f327c06b890 2023-11-27T20:41:13.117 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.112+0000 7f32727fc640 1 -- 172.21.15.183:0/3189678153 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f3278038ce0 con 0x7f327c06b890 2023-11-27T20:41:13.123 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:13.122+0000 7f759f04a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T20:41:13.178 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:13.178+0000 7f759f04a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T20:41:13.188 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.188+0000 7f3282d75640 1 -- 172.21.15.183:0/3189678153 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7d558e4f-c27d-49af-91d5-9b1630c826ab", "id": 5} v 0) v1 -- 0x7f327c06c720 con 0x7f327c06b890 2023-11-27T20:41:13.194 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.193+0000 7f32727fc640 1 -- 172.21.15.183:0/3189678153 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d558e4f-c27d-49af-91d5-9b1630c826ab", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3278027070 con 0x7f327c06b890 2023-11-27T20:41:13.195 INFO:teuthology.orchestra.run.smithi183.stdout:5 2023-11-27T20:41:13.195 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:13.194+0000 7ff403245040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T20:41:13.196 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.195+0000 7f3282d75640 1 -- 172.21.15.183:0/3189678153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c06b890 msgr2=0x7f327c1559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.196 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.195+0000 7f3282d75640 1 --2- 172.21.15.183:0/3189678153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c06b890 0x7f327c1559e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f327800b3f0 tx=0x7f327800b8b0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.196 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.195+0000 7f3282d75640 1 -- 172.21.15.183:0/3189678153 shutdown_connections 2023-11-27T20:41:13.196 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.195+0000 7f3282d75640 1 --2- 172.21.15.183:0/3189678153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f327c14ae70 0x7f327c1504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.196 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.195+0000 7f3282d75640 1 --2- 172.21.15.183:0/3189678153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f327c0bd530 0x7f327c147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.197 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.195+0000 7f3282d75640 1 --2- 172.21.15.183:0/3189678153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f327c06b890 0x7f327c1559e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.197 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.195+0000 7f3282d75640 1 -- 172.21.15.183:0/3189678153 >> 172.21.15.183:0/3189678153 conn(0x7f327c0ab9e0 msgr2=0x7f327c153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:13.197 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.195+0000 7f3282d75640 1 -- 172.21.15.183:0/3189678153 shutdown_connections 2023-11-27T20:41:13.197 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.195+0000 7f3282d75640 1 -- 172.21.15.183:0/3189678153 wait complete. 2023-11-27T20:41:13.211 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 23006010-5a4b-4539-8929-35cdb2adc13a 6 2023-11-27T20:41:13.295 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:13.295+0000 7f759f04a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T20:41:13.305 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:13.304+0000 7ff403245040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T20:41:13.376 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.375+0000 7fa71ded7640 1 Processor -- start 2023-11-27T20:41:13.376 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.376+0000 7fa71ded7640 1 -- start start 2023-11-27T20:41:13.378 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.377+0000 7fa71ded7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71814ae70 0x7fa718154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.377+0000 7fa71ded7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa71806b890 0x7fa71806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.377+0000 7fa71ded7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7181554a0 con 0x7fa7180bd530 2023-11-27T20:41:13.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.377+0000 7fa71ded7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7180c6840 con 0x7fa71806b890 2023-11-27T20:41:13.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.377+0000 7fa71ded7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71806b120 con 0x7fa71814ae70 2023-11-27T20:41:13.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.377+0000 7fa71ced5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71814ae70 0x7fa718154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.377+0000 7fa71d6d6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa71806b890 0x7fa71806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.377+0000 7fa71ced5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71814ae70 0x7fa718154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:46958/0 (socket says 172.21.15.183:46958) 2023-11-27T20:41:13.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.377+0000 7fa71ced5640 1 -- 172.21.15.183:0/3383362368 learned_addr learned my addr 172.21.15.183:0/3383362368 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:13.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.378+0000 7fa71d6d6640 1 -- 172.21.15.183:0/3383362368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71814ae70 msgr2=0x7fa718154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:13.379 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.378+0000 7fa71d6d6640 1 --2- 172.21.15.183:0/3383362368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71814ae70 0x7fa718154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.380 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.378+0000 7fa71d6d6640 1 -- 172.21.15.183:0/3383362368 >> v1:172.21.15.91:6789/0 conn(0x7fa7180bd530 legacy=0x7fa7180c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:13.380 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.378+0000 7fa71d6d6640 1 -- 172.21.15.183:0/3383362368 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71806c260 con 0x7fa71806b890 2023-11-27T20:41:13.381 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.379+0000 7fa71d6d6640 1 --2- 172.21.15.183:0/3383362368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa71806b890 0x7fa71806bd20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa710009d90 tx=0x7fa71002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f877b53d146fa75 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:13.381 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.379+0000 7fa7177fe640 1 -- 172.21.15.183:0/3383362368 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71002cbc0 con 0x7fa71806b890 2023-11-27T20:41:13.381 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.379+0000 7fa7177fe640 1 -- 172.21.15.183:0/3383362368 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71002cd20 con 0x7fa71806b890 2023-11-27T20:41:13.381 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.379+0000 7fa7177fe640 1 -- 172.21.15.183:0/3383362368 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa710034660 con 0x7fa71806b890 2023-11-27T20:41:13.382 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.380+0000 7fa71ded7640 1 -- 172.21.15.183:0/3383362368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa71806b890 msgr2=0x7fa71806bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.382 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.380+0000 7fa71ded7640 1 --2- 172.21.15.183:0/3383362368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa71806b890 0x7fa71806bd20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa710009d90 tx=0x7fa71002be10 comp rx=0 tx=0).stop 2023-11-27T20:41:13.382 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.380+0000 7fa71ded7640 1 -- 172.21.15.183:0/3383362368 shutdown_connections 2023-11-27T20:41:13.382 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.380+0000 7fa71ded7640 1 --2- 172.21.15.183:0/3383362368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa71806b890 0x7fa71806bd20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.382 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.380+0000 7fa71ded7640 1 --2- 172.21.15.183:0/3383362368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71814ae70 0x7fa718154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.382 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.380+0000 7fa71ded7640 1 -- 172.21.15.183:0/3383362368 >> 172.21.15.183:0/3383362368 conn(0x7fa7180ab9e0 msgr2=0x7fa7180abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:13.382 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.380+0000 7fa71ded7640 1 -- 172.21.15.183:0/3383362368 shutdown_connections 2023-11-27T20:41:13.382 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.380+0000 7fa71ded7640 1 -- 172.21.15.183:0/3383362368 wait complete. 2023-11-27T20:41:13.384 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.383+0000 7fa71ded7640 1 Processor -- start 2023-11-27T20:41:13.384 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.383+0000 7fa71ded7640 1 -- start start 2023-11-27T20:41:13.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.384+0000 7fa71ded7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71806b890 0x7fa7181edd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.384+0000 7fa71ded7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7180bd530 0x7fa718153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.384+0000 7fa71ded7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa71814ae70 0x7fa7181e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ded7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7180aefc0 con 0x7fa71814ae70 2023-11-27T20:41:13.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ded7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7180add90 con 0x7fa7180bd530 2023-11-27T20:41:13.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ded7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7181ee2b0 con 0x7fa71806b890 2023-11-27T20:41:13.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ced5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71806b890 0x7fa7181edd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa717fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7180bd530 0x7fa718153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ced5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71806b890 0x7fa7181edd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:46974/0 (socket says 172.21.15.183:46974) 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ced5640 1 -- 172.21.15.183:0/4050053925 learned_addr learned my addr 172.21.15.183:0/4050053925 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa717fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7180bd530 0x7fa718153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38202/0 (socket says 172.21.15.183:38202) 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71d6d6640 1 --2- 172.21.15.183:0/4050053925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa71814ae70 0x7fa7181e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ced5640 1 -- 172.21.15.183:0/4050053925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7180bd530 msgr2=0x7fa718153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ced5640 1 --2- 172.21.15.183:0/4050053925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7180bd530 0x7fa718153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ced5640 1 -- 172.21.15.183:0/4050053925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa71814ae70 msgr2=0x7fa7181e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ced5640 1 --2- 172.21.15.183:0/4050053925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa71814ae70 0x7fa7181e7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71ced5640 1 -- 172.21.15.183:0/4050053925 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710009a70 con 0x7fa71806b890 2023-11-27T20:41:13.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.385+0000 7fa71d6d6640 1 --2- 172.21.15.183:0/4050053925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa71814ae70 0x7fa7181e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:13.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.386+0000 7fa71ced5640 1 --2- 172.21.15.183:0/4050053925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71806b890 0x7fa7181edd70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00e840 tx=0x7fa70c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:13.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.386+0000 7fa7157fa640 1 -- 172.21.15.183:0/4050053925 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00c8e0 con 0x7fa71806b890 2023-11-27T20:41:13.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.386+0000 7fa7157fa640 1 -- 172.21.15.183:0/4050053925 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c00ca40 con 0x7fa71806b890 2023-11-27T20:41:13.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.386+0000 7fa7157fa640 1 -- 172.21.15.183:0/4050053925 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00cdf0 con 0x7fa71806b890 2023-11-27T20:41:13.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.386+0000 7fa71ded7640 1 -- 172.21.15.183:0/4050053925 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7180c0840 con 0x7fa71806b890 2023-11-27T20:41:13.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.386+0000 7fa71ded7640 1 -- 172.21.15.183:0/4050053925 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7180adfe0 con 0x7fa71806b890 2023-11-27T20:41:13.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.386+0000 7fa7157fa640 1 -- 172.21.15.183:0/4050053925 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fa70c013470 con 0x7fa71806b890 2023-11-27T20:41:13.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.386+0000 7fa7157fa640 1 -- 172.21.15.183:0/4050053925 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa70c013d10 con 0x7fa71806b890 2023-11-27T20:41:13.390 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.387+0000 7fa71ded7640 1 -- 172.21.15.183:0/4050053925 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71804e840 con 0x7fa71806b890 2023-11-27T20:41:13.390 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.389+0000 7fa7157fa640 1 -- 172.21.15.183:0/4050053925 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fa70c021060 con 0x7fa71806b890 2023-11-27T20:41:13.416 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:13.416+0000 7f759f04a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T20:41:13.468 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.467+0000 7fa71ded7640 1 -- 172.21.15.183:0/4050053925 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "23006010-5a4b-4539-8929-35cdb2adc13a", "id": 6} v 0) v1 -- 0x7fa7180c85d0 con 0x7fa71806b890 2023-11-27T20:41:13.468 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:13.466+0000 7ff403245040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T20:41:13.475 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.475+0000 7fa7157fa640 1 -- 172.21.15.183:0/4050053925 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23006010-5a4b-4539-8929-35cdb2adc13a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa70c017070 con 0x7fa71806b890 2023-11-27T20:41:13.475 INFO:teuthology.orchestra.run.smithi183.stdout:6 2023-11-27T20:41:13.476 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.476+0000 7fa71ded7640 1 -- 172.21.15.183:0/4050053925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71806b890 msgr2=0x7fa7181edd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.476 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.476+0000 7fa71ded7640 1 --2- 172.21.15.183:0/4050053925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71806b890 0x7fa7181edd70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00e840 tx=0x7fa70c00ed00 comp rx=0 tx=0).stop 2023-11-27T20:41:13.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.476+0000 7fa71ded7640 1 -- 172.21.15.183:0/4050053925 shutdown_connections 2023-11-27T20:41:13.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.476+0000 7fa71ded7640 1 --2- 172.21.15.183:0/4050053925 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa71814ae70 0x7fa7181e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.476+0000 7fa71ded7640 1 --2- 172.21.15.183:0/4050053925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7180bd530 0x7fa718153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.476+0000 7fa71ded7640 1 --2- 172.21.15.183:0/4050053925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa71806b890 0x7fa7181edd70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.476+0000 7fa71ded7640 1 -- 172.21.15.183:0/4050053925 >> 172.21.15.183:0/4050053925 conn(0x7fa7180ab9e0 msgr2=0x7fa7180c8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:13.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.476+0000 7fa71ded7640 1 -- 172.21.15.183:0/4050053925 shutdown_connections 2023-11-27T20:41:13.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.476+0000 7fa71ded7640 1 -- 172.21.15.183:0/4050053925 wait complete. 2023-11-27T20:41:13.492 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 44925a71-114e-4533-a076-0725235f9849 7 2023-11-27T20:41:13.519 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:13.518+0000 7ff403245040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T20:41:13.589 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:13.588+0000 7f759f04a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T20:41:13.641 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:13.640+0000 7f759f04a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T20:41:13.667 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.663+0000 7f8202060640 1 Processor -- start 2023-11-27T20:41:13.667 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.663+0000 7f8202060640 1 -- start start 2023-11-27T20:41:13.667 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.665+0000 7f8202060640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f81fc0bd530 0x7f81fc154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.667 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.665+0000 7f8202060640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f81fc06b890 0x7f81fc06bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.667 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.665+0000 7f8202060640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc1554a0 con 0x7f81fc14ae70 2023-11-27T20:41:13.668 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.665+0000 7f8202060640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc0c6840 con 0x7f81fc0bd530 2023-11-27T20:41:13.668 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.665+0000 7f8202060640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc06b120 con 0x7f81fc06b890 2023-11-27T20:41:13.668 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.665+0000 7f820185f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f81fc06b890 0x7f81fc06bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.668 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.665+0000 7f820185f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f81fc06b890 0x7f81fc06bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38204/0 (socket says 172.21.15.183:38204) 2023-11-27T20:41:13.668 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.665+0000 7f820185f640 1 -- 172.21.15.183:0/1562499799 learned_addr learned my addr 172.21.15.183:0/1562499799 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:13.668 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.665+0000 7f820085d640 1 --2- 172.21.15.183:0/1562499799 >> v2:172.21.15.91:3300/0 conn(0x7f81fc0bd530 0x7f81fc154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.669 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.665+0000 7f820185f640 1 -- 172.21.15.183:0/1562499799 >> v2:172.21.15.91:3300/0 conn(0x7f81fc0bd530 msgr2=0x7f81fc154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:13.669 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.666+0000 7f820185f640 1 --2- 172.21.15.183:0/1562499799 >> v2:172.21.15.91:3300/0 conn(0x7f81fc0bd530 0x7f81fc154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.669 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.666+0000 7f820185f640 1 -- 172.21.15.183:0/1562499799 >> v1:172.21.15.91:6789/0 conn(0x7f81fc14ae70 legacy=0x7f81fc0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:13.670 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.666+0000 7f820185f640 1 -- 172.21.15.183:0/1562499799 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc0c6a90 con 0x7f81fc06b890 2023-11-27T20:41:13.670 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.666+0000 7f820085d640 1 --2- 172.21.15.183:0/1562499799 >> v2:172.21.15.91:3300/0 conn(0x7f81fc0bd530 0x7f81fc154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:13.671 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.667+0000 7f820185f640 1 --2- 172.21.15.183:0/1562499799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81fc06b890 0x7f81fc06bca0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0c0e90 tx=0x7f81f402be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4c4e875e3e208aa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:13.674 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.667+0000 7f81f3fff640 1 -- 172.21.15.183:0/1562499799 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f402c9f0 con 0x7f81fc06b890 2023-11-27T20:41:13.674 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.667+0000 7f81f3fff640 1 -- 172.21.15.183:0/1562499799 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f402cb50 con 0x7f81fc06b890 2023-11-27T20:41:13.674 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.667+0000 7f81f3fff640 1 -- 172.21.15.183:0/1562499799 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40343f0 con 0x7f81fc06b890 2023-11-27T20:41:13.674 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.667+0000 7f8202060640 1 -- 172.21.15.183:0/1562499799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81fc06b890 msgr2=0x7f81fc06bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.674 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.667+0000 7f8202060640 1 --2- 172.21.15.183:0/1562499799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81fc06b890 0x7f81fc06bca0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0c0e90 tx=0x7f81f402be50 comp rx=0 tx=0).stop 2023-11-27T20:41:13.674 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.668+0000 7f8202060640 1 -- 172.21.15.183:0/1562499799 shutdown_connections 2023-11-27T20:41:13.674 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.668+0000 7f8202060640 1 --2- 172.21.15.183:0/1562499799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81fc06b890 0x7f81fc06bca0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.674 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.668+0000 7f8202060640 1 --2- 172.21.15.183:0/1562499799 >> v2:172.21.15.91:3300/0 conn(0x7f81fc0bd530 0x7f81fc154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.668+0000 7f8202060640 1 -- 172.21.15.183:0/1562499799 >> 172.21.15.183:0/1562499799 conn(0x7f81fc0ab9e0 msgr2=0x7f81fc0abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.668+0000 7f8202060640 1 -- 172.21.15.183:0/1562499799 shutdown_connections 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.668+0000 7f8202060640 1 -- 172.21.15.183:0/1562499799 wait complete. 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.669+0000 7f8202060640 1 Processor -- start 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.669+0000 7f8202060640 1 -- start start 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.670+0000 7f8202060640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81fc06b890 0x7f81fc0bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.670+0000 7f8202060640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81fc0bd530 0x7f81fc152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.670+0000 7f8202060640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81fc14ae70 0x7f81fc157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.670+0000 7f8202060640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc1e9d20 con 0x7f81fc06b890 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.670+0000 7f8202060640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0bec10 con 0x7f81fc0bd530 2023-11-27T20:41:13.675 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.670+0000 7f8202060640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0c0cd0 con 0x7f81fc14ae70 2023-11-27T20:41:13.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.670+0000 7f820085d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81fc0bd530 0x7f81fc152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.670+0000 7f820185f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81fc14ae70 0x7f81fc157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.670+0000 7f820085d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81fc0bd530 0x7f81fc152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38218/0 (socket says 172.21.15.183:38218) 2023-11-27T20:41:13.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.670+0000 7f820085d640 1 -- 172.21.15.183:0/1163633373 learned_addr learned my addr 172.21.15.183:0/1163633373 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-27T20:41:13.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.671+0000 7f820105e640 1 --2- 172.21.15.183:0/1163633373 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81fc06b890 0x7f81fc0bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:13.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.671+0000 7f820185f640 1 -- 172.21.15.183:0/1163633373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81fc0bd530 msgr2=0x7f81fc152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.671+0000 7f820185f640 1 --2- 172.21.15.183:0/1163633373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81fc0bd530 0x7f81fc152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.671+0000 7f820185f640 1 -- 172.21.15.183:0/1163633373 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81fc06b890 msgr2=0x7f81fc0bdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.671+0000 7f820185f640 1 --2- 172.21.15.183:0/1163633373 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81fc06b890 0x7f81fc0bdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.671+0000 7f820185f640 1 -- 172.21.15.183:0/1163633373 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f4009b30 con 0x7f81fc14ae70 2023-11-27T20:41:13.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.671+0000 7f820185f640 1 --2- 172.21.15.183:0/1163633373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81fc14ae70 0x7f81fc157cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f81f4032000 tx=0x7f81f4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:13.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.671+0000 7f81f1ffb640 1 -- 172.21.15.183:0/1163633373 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4009510 con 0x7f81fc14ae70 2023-11-27T20:41:13.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.671+0000 7f81f1ffb640 1 -- 172.21.15.183:0/1163633373 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f403e450 con 0x7f81fc14ae70 2023-11-27T20:41:13.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.672+0000 7f81f1ffb640 1 -- 172.21.15.183:0/1163633373 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f403e800 con 0x7f81fc14ae70 2023-11-27T20:41:13.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.672+0000 7f8202060640 1 -- 172.21.15.183:0/1163633373 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc1e9f10 con 0x7f81fc14ae70 2023-11-27T20:41:13.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.672+0000 7f8202060640 1 -- 172.21.15.183:0/1163633373 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc0be650 con 0x7f81fc14ae70 2023-11-27T20:41:13.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.672+0000 7f81f1ffb640 1 -- 172.21.15.183:0/1163633373 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f81f403e960 con 0x7f81fc14ae70 2023-11-27T20:41:13.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.672+0000 7f81f1ffb640 1 -- 172.21.15.183:0/1163633373 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f81f403ec10 con 0x7f81fc14ae70 2023-11-27T20:41:13.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.673+0000 7f8202060640 1 -- 172.21.15.183:0/1163633373 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc1ea100 con 0x7f81fc14ae70 2023-11-27T20:41:13.678 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:13.674+0000 7ff403245040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T20:41:13.678 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.675+0000 7f81f1ffb640 1 -- 172.21.15.183:0/1163633373 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f81f4043020 con 0x7f81fc14ae70 2023-11-27T20:41:13.751 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.750+0000 7f8202060640 1 -- 172.21.15.183:0/1163633373 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "44925a71-114e-4533-a076-0725235f9849", "id": 7} v 0) v1 -- 0x7f81fc04e840 con 0x7f81fc14ae70 2023-11-27T20:41:13.762 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.761+0000 7f81f1ffb640 1 -- 172.21.15.183:0/1163633373 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44925a71-114e-4533-a076-0725235f9849", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f81fc1554a0 con 0x7f81fc14ae70 2023-11-27T20:41:13.762 INFO:teuthology.orchestra.run.smithi183.stdout:7 2023-11-27T20:41:13.763 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.762+0000 7f8202060640 1 -- 172.21.15.183:0/1163633373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81fc14ae70 msgr2=0x7f81fc157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:13.763 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.762+0000 7f8202060640 1 --2- 172.21.15.183:0/1163633373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81fc14ae70 0x7f81fc157cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f81f4032000 tx=0x7f81f4004a40 comp rx=0 tx=0).stop 2023-11-27T20:41:13.763 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.762+0000 7f8202060640 1 -- 172.21.15.183:0/1163633373 shutdown_connections 2023-11-27T20:41:13.763 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.762+0000 7f8202060640 1 --2- 172.21.15.183:0/1163633373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81fc14ae70 0x7f81fc157cc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.763 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.762+0000 7f8202060640 1 --2- 172.21.15.183:0/1163633373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81fc0bd530 0x7f81fc152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.764 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.762+0000 7f8202060640 1 --2- 172.21.15.183:0/1163633373 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81fc06b890 0x7f81fc0bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:13.764 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.762+0000 7f8202060640 1 -- 172.21.15.183:0/1163633373 >> 172.21.15.183:0/1163633373 conn(0x7f81fc0ab9e0 msgr2=0x7f81fc0ab170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:13.764 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.762+0000 7f8202060640 1 -- 172.21.15.183:0/1163633373 shutdown_connections 2023-11-27T20:41:13.764 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-27T20:41:13.762+0000 7f8202060640 1 -- 172.21.15.183:0/1163633373 wait complete. 2023-11-27T20:41:13.778 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-27T20:41:13.779 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-27T20:41:13.787 INFO:tasks.ceph.osd.0:Started 2023-11-27T20:41:13.787 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-27T20:41:13.788 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-27T20:41:13.796 INFO:tasks.ceph.osd.1:Started 2023-11-27T20:41:13.796 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-27T20:41:13.796 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-27T20:41:13.802 INFO:tasks.ceph.osd.2:Started 2023-11-27T20:41:13.802 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-27T20:41:13.802 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-27T20:41:13.807 INFO:tasks.ceph.osd.3:Started 2023-11-27T20:41:13.807 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-27T20:41:13.808 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-27T20:41:13.808 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:13.808+0000 7f759f04a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T20:41:13.814 INFO:tasks.ceph.osd.4:Started 2023-11-27T20:41:13.815 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-27T20:41:13.815 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-27T20:41:13.821 INFO:tasks.ceph.osd.5:Started 2023-11-27T20:41:13.821 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-27T20:41:13.822 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-27T20:41:13.828 INFO:tasks.ceph.osd.6:Started 2023-11-27T20:41:13.828 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-27T20:41:13.829 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-27T20:41:13.834 INFO:tasks.ceph.osd.7:Started 2023-11-27T20:41:13.834 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:14.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.058+0000 7f481a7c4640 1 Processor -- start 2023-11-27T20:41:14.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.059+0000 7f481a7c4640 1 -- start start 2023-11-27T20:41:14.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.060+0000 7f481a7c4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f481414e7f0 0x7f48140c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:14.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.060+0000 7f481a7c4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48140a8380 con 0x7f481406cd20 2023-11-27T20:41:14.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.060+0000 7f481a7c4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48141510b0 con 0x7f48140c52e0 2023-11-27T20:41:14.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.060+0000 7f481a7c4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481406bf60 con 0x7f481414e7f0 2023-11-27T20:41:14.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.060+0000 7f48197c2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f481414e7f0 0x7f48140c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:14.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.060+0000 7f4819fc3640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f481406cd20 0x7f481415ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53910/0 (socket says 172.21.15.91:53910) 2023-11-27T20:41:14.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.060+0000 7f4819fc3640 1 -- 172.21.15.91:0/1689413641 learned_addr learned my addr 172.21.15.91:0/1689413641 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:14.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.060+0000 7f480bfff640 1 -- 172.21.15.91:0/1689413641 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350461425 0 0) 0x7f48140a8380 con 0x7f481406cd20 2023-11-27T20:41:14.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.060+0000 7f480bfff640 1 -- 172.21.15.91:0/1689413641 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4800003520 con 0x7f481406cd20 2023-11-27T20:41:14.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.061+0000 7f48197c2640 1 -- 172.21.15.91:0/1689413641 >> v1:172.21.15.183:6789/0 conn(0x7f48140c52e0 legacy=0x7f481406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:14.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.061+0000 7f48197c2640 1 -- 172.21.15.91:0/1689413641 >> v1:172.21.15.91:6789/0 conn(0x7f481406cd20 legacy=0x7f481415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:14.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.061+0000 7f48197c2640 1 -- 172.21.15.91:0/1689413641 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481406c240 con 0x7f481414e7f0 2023-11-27T20:41:14.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.062+0000 7f48197c2640 1 --2- 172.21.15.91:0/1689413641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f481414e7f0 0x7f48140c0440 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f48100097a0 tx=0x7f481002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2104db6b07afd319 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:14.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.062+0000 7f480bfff640 1 -- 172.21.15.91:0/1689413641 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810031830 con 0x7f481414e7f0 2023-11-27T20:41:14.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.062+0000 7f480bfff640 1 -- 172.21.15.91:0/1689413641 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4810031990 con 0x7f481414e7f0 2023-11-27T20:41:14.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.062+0000 7f480bfff640 1 -- 172.21.15.91:0/1689413641 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810031d20 con 0x7f481414e7f0 2023-11-27T20:41:14.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.063+0000 7f481a7c4640 1 -- 172.21.15.91:0/1689413641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f481414e7f0 msgr2=0x7f48140c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:14.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.063+0000 7f481a7c4640 1 --2- 172.21.15.91:0/1689413641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f481414e7f0 0x7f48140c0440 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f48100097a0 tx=0x7f481002b8d0 comp rx=0 tx=0).stop 2023-11-27T20:41:14.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.063+0000 7f481a7c4640 1 -- 172.21.15.91:0/1689413641 shutdown_connections 2023-11-27T20:41:14.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.063+0000 7f481a7c4640 1 --2- 172.21.15.91:0/1689413641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f481414e7f0 0x7f48140c0440 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:14.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.063+0000 7f481a7c4640 1 -- 172.21.15.91:0/1689413641 >> 172.21.15.91:0/1689413641 conn(0x7f48140a77f0 msgr2=0x7f48140a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:14.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.063+0000 7f481a7c4640 1 -- 172.21.15.91:0/1689413641 shutdown_connections 2023-11-27T20:41:14.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.063+0000 7f481a7c4640 1 -- 172.21.15.91:0/1689413641 wait complete. 2023-11-27T20:41:14.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.064+0000 7f481a7c4640 1 Processor -- start 2023-11-27T20:41:14.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.065+0000 7f481a7c4640 1 -- start start 2023-11-27T20:41:14.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.065+0000 7f481a7c4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f481406cd20 0x7f4814071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:14.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.065+0000 7f481a7c4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48140c52e0 0x7f4814147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:14.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.065+0000 7f481a7c4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f481414e7f0 0x7f48141478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:14.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.065+0000 7f481a7c4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4814150e30 con 0x7f48140c52e0 2023-11-27T20:41:14.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.065+0000 7f481a7c4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4814148fe0 con 0x7f481414e7f0 2023-11-27T20:41:14.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.065+0000 7f481a7c4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4814147e00 con 0x7f481406cd20 2023-11-27T20:41:14.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4818fc1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48140c52e0 0x7f4814147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:14.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4818fc1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48140c52e0 0x7f4814147380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34362/0 (socket says 172.21.15.91:34362) 2023-11-27T20:41:14.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4818fc1640 1 -- 172.21.15.91:0/513789646 learned_addr learned my addr 172.21.15.91:0/513789646 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:14.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4819fc3640 1 --2- 172.21.15.91:0/513789646 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f481414e7f0 0x7f48141478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:14.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f48197c2640 1 --2- 172.21.15.91:0/513789646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f481406cd20 0x7f4814071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:14.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4818fc1640 1 -- 172.21.15.91:0/513789646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f481406cd20 msgr2=0x7f4814071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:14.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4818fc1640 1 --2- 172.21.15.91:0/513789646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f481406cd20 0x7f4814071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:14.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4818fc1640 1 -- 172.21.15.91:0/513789646 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f481414e7f0 msgr2=0x7f48141478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:14.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4818fc1640 1 --2- 172.21.15.91:0/513789646 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f481414e7f0 0x7f48141478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:14.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4818fc1640 1 -- 172.21.15.91:0/513789646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4810009400 con 0x7f48140c52e0 2023-11-27T20:41:14.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4819fc3640 1 --2- 172.21.15.91:0/513789646 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f481414e7f0 0x7f48141478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:14.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4818fc1640 1 --2- 172.21.15.91:0/513789646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48140c52e0 0x7f4814147380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f480400c4b0 tx=0x7f480400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:14.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.066+0000 7f4809ffb640 1 -- 172.21.15.91:0/513789646 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040052d0 con 0x7f48140c52e0 2023-11-27T20:41:14.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.067+0000 7f4809ffb640 1 -- 172.21.15.91:0/513789646 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804005430 con 0x7f48140c52e0 2023-11-27T20:41:14.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.067+0000 7f4809ffb640 1 -- 172.21.15.91:0/513789646 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804012870 con 0x7f48140c52e0 2023-11-27T20:41:14.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.067+0000 7f481a7c4640 1 -- 172.21.15.91:0/513789646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4814150870 con 0x7f48140c52e0 2023-11-27T20:41:14.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.067+0000 7f481a7c4640 1 -- 172.21.15.91:0/513789646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4814148c00 con 0x7f48140c52e0 2023-11-27T20:41:14.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.067+0000 7f4809ffb640 1 -- 172.21.15.91:0/513789646 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f4804012d50 con 0x7f48140c52e0 2023-11-27T20:41:14.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.067+0000 7f4809ffb640 1 -- 172.21.15.91:0/513789646 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f480401bd50 con 0x7f48140c52e0 2023-11-27T20:41:14.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.068+0000 7f481a7c4640 1 -- 172.21.15.91:0/513789646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4814148a60 con 0x7f48140c52e0 2023-11-27T20:41:14.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.070+0000 7f4809ffb640 1 -- 172.21.15.91:0/513789646 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f4814148a60 con 0x7f48140c52e0 2023-11-27T20:41:14.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.133+0000 7f481a7c4640 1 -- 172.21.15.91:0/513789646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f481404e840 con 0x7f48140c52e0 2023-11-27T20:41:14.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.134+0000 7f4809ffb640 1 -- 172.21.15.91:0/513789646 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f480402a090 con 0x7f48140c52e0 2023-11-27T20:41:14.135 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:14.135 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":10,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:13.753096+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.135+0000 7f481a7c4640 1 -- 172.21.15.91:0/513789646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48140c52e0 msgr2=0x7f4814147380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.135+0000 7f481a7c4640 1 --2- 172.21.15.91:0/513789646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48140c52e0 0x7f4814147380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f480400c4b0 tx=0x7f480400c970 comp rx=0 tx=0).stop 2023-11-27T20:41:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.135+0000 7f481a7c4640 1 -- 172.21.15.91:0/513789646 shutdown_connections 2023-11-27T20:41:14.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.135+0000 7f481a7c4640 1 --2- 172.21.15.91:0/513789646 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f481414e7f0 0x7f48141478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:14.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.135+0000 7f481a7c4640 1 --2- 172.21.15.91:0/513789646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48140c52e0 0x7f4814147380 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:14.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.135+0000 7f481a7c4640 1 --2- 172.21.15.91:0/513789646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f481406cd20 0x7f4814071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:14.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.135+0000 7f481a7c4640 1 -- 172.21.15.91:0/513789646 >> 172.21.15.91:0/513789646 conn(0x7f48140a77f0 msgr2=0x7f48140a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:14.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.135+0000 7f481a7c4640 1 -- 172.21.15.91:0/513789646 shutdown_connections 2023-11-27T20:41:14.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:14.135+0000 7f481a7c4640 1 -- 172.21.15.91:0/513789646 wait complete. 2023-11-27T20:41:14.154 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-27T20:41:14.155 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-27T20:41:14.515 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-11-27T20:41:14.514+0000 7f08d24da500 -1 Falling back to public interface 2023-11-27T20:41:14.515 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-11-27T20:41:14.514+0000 7fdc0c40c500 -1 Falling back to public interface 2023-11-27T20:41:14.523 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-11-27T20:41:14.522+0000 7ff853449500 -1 Falling back to public interface 2023-11-27T20:41:14.524 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-11-27T20:41:14.524+0000 7f2683416500 -1 Falling back to public interface 2023-11-27T20:41:14.529 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-11-27T20:41:14.528+0000 7fe2e6a16500 -1 Falling back to public interface 2023-11-27T20:41:14.535 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-11-27T20:41:14.534+0000 7fad99372500 -1 Falling back to public interface 2023-11-27T20:41:14.538 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-11-27T20:41:14.538+0000 7fa034aa5500 -1 Falling back to public interface 2023-11-27T20:41:14.543 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-11-27T20:41:14.543+0000 7f4a9120e500 -1 Falling back to public interface 2023-11-27T20:41:14.845 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:14.844+0000 7ff403245040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T20:41:14.875 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:14.874+0000 7f759f04a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T20:41:14.960 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:15.117 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.116+0000 7feb5f367640 1 Processor -- start 2023-11-27T20:41:15.117 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.116+0000 7feb5f367640 1 -- start start 2023-11-27T20:41:15.118 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.117+0000 7feb5f367640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feb58151cf0 0x7feb580c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:15.119 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.117+0000 7feb5f367640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb580c50d0 con 0x7feb58157b10 2023-11-27T20:41:15.119 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.117+0000 7feb5f367640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb58154e30 con 0x7feb581552c0 2023-11-27T20:41:15.119 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.117+0000 7feb5f367640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb580c8710 con 0x7feb58151cf0 2023-11-27T20:41:15.119 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.117+0000 7feb5e365640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feb58151cf0 0x7feb580c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:15.119 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.118+0000 7feb5e365640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feb58151cf0 0x7feb580c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34374/0 (socket says 172.21.15.91:34374) 2023-11-27T20:41:15.119 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.118+0000 7feb5e365640 1 -- 172.21.15.91:0/3377429054 learned_addr learned my addr 172.21.15.91:0/3377429054 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:15.120 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.118+0000 7feb5e365640 1 -- 172.21.15.91:0/3377429054 >> v1:172.21.15.183:6789/0 conn(0x7feb581552c0 legacy=0x7feb580c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:15.120 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.118+0000 7feb5e365640 1 -- 172.21.15.91:0/3377429054 >> v1:172.21.15.91:6789/0 conn(0x7feb58157b10 legacy=0x7feb5815eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:15.120 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.118+0000 7feb5e365640 1 -- 172.21.15.91:0/3377429054 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58154520 con 0x7feb58151cf0 2023-11-27T20:41:15.120 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.118+0000 7feb5d363640 1 -- 172.21.15.91:0/3377429054 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112186751 0 0) 0x7feb580c50d0 con 0x7feb58157b10 2023-11-27T20:41:15.121 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.119+0000 7feb5e365640 1 --2- 172.21.15.91:0/3377429054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58151cf0 0x7feb580c46e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb54009870 tx=0x7feb5402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bda3eabbb2a8d21 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:15.121 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.119+0000 7feb5d363640 1 -- 172.21.15.91:0/3377429054 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54030860 con 0x7feb58151cf0 2023-11-27T20:41:15.121 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.119+0000 7feb5d363640 1 -- 172.21.15.91:0/3377429054 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb540309c0 con 0x7feb58151cf0 2023-11-27T20:41:15.121 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.119+0000 7feb5d363640 1 -- 172.21.15.91:0/3377429054 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54030d50 con 0x7feb58151cf0 2023-11-27T20:41:15.121 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.120+0000 7feb5f367640 1 -- 172.21.15.91:0/3377429054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58151cf0 msgr2=0x7feb580c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:15.121 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.120+0000 7feb5f367640 1 --2- 172.21.15.91:0/3377429054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58151cf0 0x7feb580c46e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb54009870 tx=0x7feb5402b9a0 comp rx=0 tx=0).stop 2023-11-27T20:41:15.122 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.120+0000 7feb5f367640 1 -- 172.21.15.91:0/3377429054 shutdown_connections 2023-11-27T20:41:15.122 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.120+0000 7feb5f367640 1 --2- 172.21.15.91:0/3377429054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58151cf0 0x7feb580c46e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:15.122 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.120+0000 7feb5f367640 1 -- 172.21.15.91:0/3377429054 >> 172.21.15.91:0/3377429054 conn(0x7feb58072000 msgr2=0x7feb58072410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:15.122 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.120+0000 7feb5f367640 1 -- 172.21.15.91:0/3377429054 shutdown_connections 2023-11-27T20:41:15.122 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.120+0000 7feb5f367640 1 -- 172.21.15.91:0/3377429054 wait complete. 2023-11-27T20:41:15.123 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.122+0000 7feb5f367640 1 Processor -- start 2023-11-27T20:41:15.123 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.122+0000 7feb5f367640 1 -- start start 2023-11-27T20:41:15.125 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5f367640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb58151cf0 0x7feb581ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:15.125 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5f367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb581552c0 0x7feb580c1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:15.125 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5f367640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58157b10 0x7feb5814a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:15.125 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5f367640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb580c24a0 con 0x7feb58157b10 2023-11-27T20:41:15.125 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5f367640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb580c0380 con 0x7feb58151cf0 2023-11-27T20:41:15.125 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5f367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb581ed920 con 0x7feb581552c0 2023-11-27T20:41:15.125 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5eb66640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58157b10 0x7feb5814a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:15.126 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5eb66640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58157b10 0x7feb5814a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34388/0 (socket says 172.21.15.91:34388) 2023-11-27T20:41:15.126 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5eb66640 1 -- 172.21.15.91:0/487216233 learned_addr learned my addr 172.21.15.91:0/487216233 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:15.126 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5e365640 1 --2- 172.21.15.91:0/487216233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb58151cf0 0x7feb581ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:15.126 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5db64640 1 --2- 172.21.15.91:0/487216233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb581552c0 0x7feb580c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:15.126 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5eb66640 1 -- 172.21.15.91:0/487216233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb581552c0 msgr2=0x7feb580c1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:15.126 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5eb66640 1 --2- 172.21.15.91:0/487216233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb581552c0 0x7feb580c1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:15.126 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5eb66640 1 -- 172.21.15.91:0/487216233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb58151cf0 msgr2=0x7feb581ed050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:15.126 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5eb66640 1 --2- 172.21.15.91:0/487216233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb58151cf0 0x7feb581ed050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:15.126 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.123+0000 7feb5eb66640 1 -- 172.21.15.91:0/487216233 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb540094d0 con 0x7feb58157b10 2023-11-27T20:41:15.127 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.124+0000 7feb5eb66640 1 --2- 172.21.15.91:0/487216233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58157b10 0x7feb5814a3c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb5000c710 tx=0x7feb5000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:15.128 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.124+0000 7feb4effd640 1 -- 172.21.15.91:0/487216233 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50003da0 con 0x7feb58157b10 2023-11-27T20:41:15.128 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.124+0000 7feb4effd640 1 -- 172.21.15.91:0/487216233 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5000ce20 con 0x7feb58157b10 2023-11-27T20:41:15.128 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.124+0000 7feb4effd640 1 -- 172.21.15.91:0/487216233 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50005290 con 0x7feb58157b10 2023-11-27T20:41:15.128 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.124+0000 7feb5f367640 1 -- 172.21.15.91:0/487216233 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb580c36c0 con 0x7feb58157b10 2023-11-27T20:41:15.128 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.124+0000 7feb5f367640 1 -- 172.21.15.91:0/487216233 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb58151130 con 0x7feb58157b10 2023-11-27T20:41:15.128 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.124+0000 7feb4effd640 1 -- 172.21.15.91:0/487216233 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7feb5000a640 con 0x7feb58157b10 2023-11-27T20:41:15.128 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.124+0000 7feb4effd640 1 -- 172.21.15.91:0/487216233 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7feb50005770 con 0x7feb58157b10 2023-11-27T20:41:15.128 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.125+0000 7feb5f367640 1 -- 172.21.15.91:0/487216233 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb580c3be0 con 0x7feb58157b10 2023-11-27T20:41:15.129 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.128+0000 7feb4effd640 1 -- 172.21.15.91:0/487216233 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7feb580c3be0 con 0x7feb58157b10 2023-11-27T20:41:15.176 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:15.175+0000 7ff403245040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T20:41:15.183 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:15.182+0000 7f759f04a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T20:41:15.195 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.194+0000 7feb5f367640 1 -- 172.21.15.91:0/487216233 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb5804e840 con 0x7feb58157b10 2023-11-27T20:41:15.196 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.195+0000 7feb4effd640 1 -- 172.21.15.91:0/487216233 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7feb50017070 con 0x7feb58157b10 2023-11-27T20:41:15.196 INFO:teuthology.misc.health.smithi091.stdout: 2023-11-27T20:41:15.196 INFO:teuthology.misc.health.smithi091.stdout:{"epoch":10,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:13.753096+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:15.197 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.196+0000 7feb5f367640 1 -- 172.21.15.91:0/487216233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58157b10 msgr2=0x7feb5814a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:15.197 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.196+0000 7feb5f367640 1 --2- 172.21.15.91:0/487216233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58157b10 0x7feb5814a3c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb5000c710 tx=0x7feb5000cbd0 comp rx=0 tx=0).stop 2023-11-27T20:41:15.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.196+0000 7feb5f367640 1 -- 172.21.15.91:0/487216233 shutdown_connections 2023-11-27T20:41:15.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.196+0000 7feb5f367640 1 --2- 172.21.15.91:0/487216233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb58157b10 0x7feb5814a3c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:15.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.196+0000 7feb5f367640 1 --2- 172.21.15.91:0/487216233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb581552c0 0x7feb580c1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:15.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.196+0000 7feb5f367640 1 --2- 172.21.15.91:0/487216233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb58151cf0 0x7feb581ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:15.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.196+0000 7feb5f367640 1 -- 172.21.15.91:0/487216233 >> 172.21.15.91:0/487216233 conn(0x7feb58072000 msgr2=0x7feb580ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:15.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.196+0000 7feb5f367640 1 -- 172.21.15.91:0/487216233 shutdown_connections 2023-11-27T20:41:15.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:15.196+0000 7feb5f367640 1 -- 172.21.15.91:0/487216233 wait complete. 2023-11-27T20:41:15.210 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-27T20:41:15.239 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:15.237+0000 7ff403245040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T20:41:15.242 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:15.241+0000 7f759f04a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T20:41:15.353 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:15.352+0000 7ff403245040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T20:41:15.355 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-27T20:41:15.354+0000 7f759f04a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T20:41:16.394 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:16.394+0000 7ff3a461a640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-27T20:41:16.395 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-11-27T20:41:16.395+0000 7ff3a461a640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-27T20:41:18.040 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-11-27T20:41:18.039+0000 7f08d24da500 -1 osd.6 0 log_to_monitors true 2023-11-27T20:41:18.093 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-11-27T20:41:18.093+0000 7fad99372500 -1 osd.2 0 log_to_monitors true 2023-11-27T20:41:18.094 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-11-27T20:41:18.094+0000 7ff853449500 -1 osd.1 0 log_to_monitors true 2023-11-27T20:41:18.109 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-11-27T20:41:18.108+0000 7fa034aa5500 -1 osd.4 0 log_to_monitors true 2023-11-27T20:41:18.115 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-11-27T20:41:18.115+0000 7fe2e6a16500 -1 osd.3 0 log_to_monitors true 2023-11-27T20:41:18.316 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-11-27T20:41:18.316+0000 7f2683416500 -1 osd.5 0 log_to_monitors true 2023-11-27T20:41:18.331 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-11-27T20:41:18.331+0000 7fdc0c40c500 -1 osd.0 0 log_to_monitors true 2023-11-27T20:41:18.353 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-11-27T20:41:18.353+0000 7f4a9120e500 -1 osd.7 0 log_to_monitors true 2023-11-27T20:41:20.771 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:41:20.777 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:41:21.702 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-11-27T20:41:21.702+0000 7fad94add640 -1 osd.2 0 waiting for initial osdmap 2023-11-27T20:41:21.713 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-11-27T20:41:21.713+0000 7fad8d115640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:41:21.740 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-11-27T20:41:21.739+0000 7fa030210640 -1 osd.4 0 waiting for initial osdmap 2023-11-27T20:41:21.747 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-11-27T20:41:21.746+0000 7fa028848640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:41:21.769 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-11-27T20:41:21.768+0000 7f08cdc45640 -1 osd.6 0 waiting for initial osdmap 2023-11-27T20:41:21.775 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-11-27T20:41:21.775+0000 7f08c627d640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:41:21.787 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-11-27T20:41:21.786+0000 7fdc08cf2640 -1 osd.0 0 waiting for initial osdmap 2023-11-27T20:41:21.789 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-11-27T20:41:21.788+0000 7f4a8c397640 -1 osd.7 0 waiting for initial osdmap 2023-11-27T20:41:21.789 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-11-27T20:41:21.789+0000 7f267fde9640 -1 osd.5 0 waiting for initial osdmap 2023-11-27T20:41:21.794 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-11-27T20:41:21.794+0000 7fdbffaf2640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:41:21.795 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-11-27T20:41:21.795+0000 7ff84ebb4640 -1 osd.1 0 waiting for initial osdmap 2023-11-27T20:41:21.798 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-11-27T20:41:21.798+0000 7f2676be9640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:41:21.805 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-11-27T20:41:21.805+0000 7fe2e1ac3640 -1 osd.3 0 waiting for initial osdmap 2023-11-27T20:41:21.807 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-11-27T20:41:21.807+0000 7ff8471ec640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:41:21.807 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-11-27T20:41:21.807+0000 7f4a849cf640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:41:21.815 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-11-27T20:41:21.815+0000 7fe2da0fb640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T20:41:22.015 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:22.196 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.195+0000 7f5855548640 1 Processor -- start 2023-11-27T20:41:22.196 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.196+0000 7f5855548640 1 -- start start 2023-11-27T20:41:22.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.197+0000 7f5855548640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f58500c52b0 0x7f585006e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:22.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.197+0000 7f5855548640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58500c5a20 con 0x7f585014fac0 2023-11-27T20:41:22.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.197+0000 7f5855548640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585014fea0 con 0x7f585006bd30 2023-11-27T20:41:22.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.197+0000 7f5855548640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500c5740 con 0x7f58500c52b0 2023-11-27T20:41:22.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584effd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f585014fac0 0x7f58500a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53922/0 (socket says 172.21.15.91:53922) 2023-11-27T20:41:22.198 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584effd640 1 -- 172.21.15.91:0/3672897380 learned_addr learned my addr 172.21.15.91:0/3672897380 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:22.200 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64441247 0 0) 0x7f58500c5a20 con 0x7f585014fac0 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f58467fc640 1 --2- 172.21.15.91:0/3672897380 >> v2:172.21.15.183:3300/0 conn(0x7f58500c52b0 0x7f585006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f583c003520 con 0x7f585014fac0 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4168236707 0 0) 0x7f583c003520 con 0x7f585014fac0 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 >> v2:172.21.15.183:3300/0 conn(0x7f58500c52b0 msgr2=0x7f585006e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584e7fc640 1 --2- 172.21.15.91:0/3672897380 >> v2:172.21.15.183:3300/0 conn(0x7f58500c52b0 0x7f585006e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 >> v1:172.21.15.183:6789/0 conn(0x7f585006bd30 legacy=0x7f58500c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850152620 con 0x7f585014fac0 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f5840001670 con 0x7f585014fac0 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 >> v1:172.21.15.91:6789/0 conn(0x7f585014fac0 legacy=0x7f58500a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.198+0000 7f584e7fc640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f583c003970 0x7f583c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584e7fc640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0047c0 0x7f583c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:22.201 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584e7fc640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f583c0052a0 0x7f583c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500c5740 con 0x7f583c0052a0 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c00c1f0 con 0x7f583c0047c0 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c00c3b0 con 0x7f583c003970 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584f7fe640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f583c0052a0 0x7f583c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f58467fc640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0047c0 0x7f583c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584f7fe640 1 -- 172.21.15.91:0/3672897380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f583c003970 msgr2=0x7f583c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584effd640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f583c003970 0x7f583c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584f7fe640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f583c003970 0x7f583c003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584f7fe640 1 -- 172.21.15.91:0/3672897380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0047c0 msgr2=0x7f583c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584f7fe640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0047c0 0x7f583c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f584f7fe640 1 -- 172.21.15.91:0/3672897380 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c003520 con 0x7f583c0052a0 2023-11-27T20:41:22.202 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.199+0000 7f58467fc640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0047c0 0x7f583c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:22.203 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.200+0000 7f584f7fe640 1 -- 172.21.15.91:0/3672897380 reap_dead start 2023-11-27T20:41:22.203 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.200+0000 7f584f7fe640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f583c0052a0 0x7f583c00b980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5848004480 tx=0x7f583c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1a8b99411d5a4e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:22.203 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.200+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848006b50 con 0x7f583c0052a0 2023-11-27T20:41:22.203 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.201+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5848006cd0 con 0x7f583c0052a0 2023-11-27T20:41:22.203 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.201+0000 7f584e7fc640 1 -- 172.21.15.91:0/3672897380 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848007260 con 0x7f583c0052a0 2023-11-27T20:41:22.205 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.201+0000 7f5855548640 1 -- 172.21.15.91:0/3672897380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f583c0052a0 msgr2=0x7f583c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:22.205 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.201+0000 7f5855548640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f583c0052a0 0x7f583c00b980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5848004480 tx=0x7f583c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.205 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.201+0000 7f5855548640 1 -- 172.21.15.91:0/3672897380 shutdown_connections 2023-11-27T20:41:22.205 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.201+0000 7f5855548640 1 --2- 172.21.15.91:0/3672897380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f583c0052a0 0x7f583c00b980 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.205 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.201+0000 7f5855548640 1 -- 172.21.15.91:0/3672897380 >> 172.21.15.91:0/3672897380 conn(0x7f58500c5cc0 msgr2=0x7f58500c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:22.205 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.201+0000 7f5855548640 1 -- 172.21.15.91:0/3672897380 shutdown_connections 2023-11-27T20:41:22.205 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.201+0000 7f5855548640 1 -- 172.21.15.91:0/3672897380 wait complete. 2023-11-27T20:41:22.205 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.203+0000 7f5855548640 1 Processor -- start 2023-11-27T20:41:22.205 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.203+0000 7f5855548640 1 -- start start 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f5855548640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0052a0 0x7f58501eb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f5855548640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f585014b060 0x7f585014b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f5855548640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5850155150 0x7f58501555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f5855548640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58501eba60 con 0x7f5850155150 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f5855548640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5850154670 con 0x7f583c0052a0 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f5855548640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5850154950 con 0x7f585014b060 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f584f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5850155150 0x7f58501555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f584f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5850155150 0x7f58501555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34516/0 (socket says 172.21.15.91:34516) 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f584f7fe640 1 -- 172.21.15.91:0/4064187638 learned_addr learned my addr 172.21.15.91:0/4064187638 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f584effd640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0052a0 0x7f58501eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.204+0000 7f584f7fe640 1 -- 172.21.15.91:0/4064187638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f585014b060 msgr2=0x7f585014b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:22.206 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f58467fc640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f585014b060 0x7f585014b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:22.207 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f584f7fe640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f585014b060 0x7f585014b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.207 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f584f7fe640 1 -- 172.21.15.91:0/4064187638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0052a0 msgr2=0x7f58501eb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:22.207 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f584f7fe640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0052a0 0x7f58501eb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.207 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f584f7fe640 1 -- 172.21.15.91:0/4064187638 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850154c30 con 0x7f5850155150 2023-11-27T20:41:22.207 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f584effd640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0052a0 0x7f58501eb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:22.207 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f584f7fe640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5850155150 0x7f58501555d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5848004480 tx=0x7f5848003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:22.208 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f5847fff640 1 -- 172.21.15.91:0/4064187638 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584803d040 con 0x7f5850155150 2023-11-27T20:41:22.208 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f5847fff640 1 -- 172.21.15.91:0/4064187638 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5848038810 con 0x7f5850155150 2023-11-27T20:41:22.208 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f5847fff640 1 -- 172.21.15.91:0/4064187638 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848038bc0 con 0x7f5850155150 2023-11-27T20:41:22.208 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f5855548640 1 -- 172.21.15.91:0/4064187638 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58500c0ec0 con 0x7f5850155150 2023-11-27T20:41:22.208 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.205+0000 7f5855548640 1 -- 172.21.15.91:0/4064187638 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5850153630 con 0x7f5850155150 2023-11-27T20:41:22.209 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.206+0000 7f5855548640 1 -- 172.21.15.91:0/4064187638 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58501544d0 con 0x7f5850155150 2023-11-27T20:41:22.209 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.207+0000 7f5847fff640 1 -- 172.21.15.91:0/4064187638 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7f5848038d20 con 0x7f5850155150 2023-11-27T20:41:22.209 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.208+0000 7f5847fff640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f583006b130 0x7f583006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:22.209 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.208+0000 7f5847fff640 1 -- 172.21.15.91:0/4064187638 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f58480aa590 con 0x7f5850155150 2023-11-27T20:41:22.209 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.208+0000 7f584effd640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f583006b130 0x7f583006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:22.209 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.209+0000 7f584effd640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f583006b130 0x7f583006d5f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f58400017a0 tx=0x7f5840009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:22.213 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.213+0000 7f5847fff640 1 -- 172.21.15.91:0/4064187638 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f58501544d0 con 0x7f5850155150 2023-11-27T20:41:22.389 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.389+0000 7f5855548640 1 -- 172.21.15.91:0/4064187638 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58501544d0 con 0x7f5850155150 2023-11-27T20:41:22.390 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.390+0000 7f5847fff640 1 -- 172.21.15.91:0/4064187638 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f58501544d0 con 0x7f5850155150 2023-11-27T20:41:22.390 INFO:teuthology.misc.health.smithi091.stdout: 2023-11-27T20:41:22.391 INFO:teuthology.misc.health.smithi091.stdout:{"epoch":12,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:19.387198+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:22.393 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.392+0000 7f5855548640 1 -- 172.21.15.91:0/4064187638 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f583006b130 msgr2=0x7f583006d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:22.393 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.392+0000 7f5855548640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f583006b130 0x7f583006d5f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f58400017a0 tx=0x7f5840009040 comp rx=0 tx=0).stop 2023-11-27T20:41:22.393 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.392+0000 7f5855548640 1 -- 172.21.15.91:0/4064187638 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5850155150 msgr2=0x7f58501555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:22.393 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.392+0000 7f5855548640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5850155150 0x7f58501555d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5848004480 tx=0x7f5848003ae0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.393 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.392+0000 7f5855548640 1 -- 172.21.15.91:0/4064187638 shutdown_connections 2023-11-27T20:41:22.393 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.392+0000 7f5855548640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5850155150 0x7f58501555d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.393 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.392+0000 7f5855548640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f585014b060 0x7f585014b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.393 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.392+0000 7f5855548640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f583006b130 0x7f583006d5f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.394 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.392+0000 7f5855548640 1 --2- 172.21.15.91:0/4064187638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f583c0052a0 0x7f58501eb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:22.394 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.392+0000 7f5855548640 1 -- 172.21.15.91:0/4064187638 >> 172.21.15.91:0/4064187638 conn(0x7f58500c5cc0 msgr2=0x7f585014f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:22.394 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.393+0000 7f5855548640 1 -- 172.21.15.91:0/4064187638 shutdown_connections 2023-11-27T20:41:22.394 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:22.393+0000 7f5855548640 1 -- 172.21.15.91:0/4064187638 wait complete. 2023-11-27T20:41:22.406 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-27T20:41:29.213 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:29.401 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.399+0000 7fd3da5f1640 1 Processor -- start 2023-11-27T20:41:29.401 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.399+0000 7fd3da5f1640 1 -- start start 2023-11-27T20:41:29.402 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.401+0000 7fd3da5f1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd3d414fac0 0x7fd3d406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.402 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.401+0000 7fd3da5f1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3d40c52b0 0x7fd3d40a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.402 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.401+0000 7fd3da5f1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40c5a20 con 0x7fd3d406bd30 2023-11-27T20:41:29.403 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.401+0000 7fd3da5f1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d414fea0 con 0x7fd3d414fac0 2023-11-27T20:41:29.403 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.401+0000 7fd3da5f1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40c5740 con 0x7fd3d40c52b0 2023-11-27T20:41:29.403 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.401+0000 7fd3d8b8e640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd3d406bd30 0x7fd3d40c20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42490/0 (socket says 172.21.15.91:42490) 2023-11-27T20:41:29.403 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.401+0000 7fd3d8b8e640 1 -- 172.21.15.91:0/479749757 learned_addr learned my addr 172.21.15.91:0/479749757 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:29.404 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d3fff640 1 --2- 172.21.15.91:0/479749757 >> v2:172.21.15.183:3300/0 conn(0x7fd3d414fac0 0x7fd3d406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d37fe640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3d40c52b0 0x7fd3d40a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751842628 0 0) 0x7fd3d40c5a20 con 0x7fd3d406bd30 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3bc003520 con 0x7fd3d406bd30 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2006701431 0 0) 0x7fd3bc003520 con 0x7fd3d406bd30 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3d40c52b0 msgr2=0x7fd3d40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3d40c52b0 0x7fd3d40a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 >> v2:172.21.15.183:3300/0 conn(0x7fd3d414fac0 msgr2=0x7fd3d406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 --2- 172.21.15.91:0/479749757 >> v2:172.21.15.183:3300/0 conn(0x7fd3d414fac0 0x7fd3d406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4152620 con 0x7fd3d406bd30 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fd3cc0019f0 con 0x7fd3d406bd30 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 >> v1:172.21.15.91:6789/0 conn(0x7fd3d406bd30 legacy=0x7fd3d40c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3bc003970 0x7fd3bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.405 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3bc0047c0 0x7fd3bc004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3bc005140 0x7fd3bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d414fea0 con 0x7fd3bc005140 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.402+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40c5740 con 0x7fd3bc003970 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.403+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc00bec0 con 0x7fd3bc0047c0 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.403+0000 7fd3d8b8e640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3bc005140 0x7fd3bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.403+0000 7fd3d3fff640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3bc003970 0x7fd3bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.403+0000 7fd3d37fe640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3bc0047c0 0x7fd3bc004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.403+0000 7fd3d8b8e640 1 -- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3bc0047c0 msgr2=0x7fd3bc004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.403+0000 7fd3d8b8e640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3bc0047c0 0x7fd3bc004c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.403+0000 7fd3d8b8e640 1 -- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3bc003970 msgr2=0x7fd3bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.403+0000 7fd3d8b8e640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3bc003970 0x7fd3bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.406 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.403+0000 7fd3d8b8e640 1 -- 172.21.15.91:0/479749757 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc003520 con 0x7fd3bc005140 2023-11-27T20:41:29.407 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.403+0000 7fd3d3fff640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3bc003970 0x7fd3bc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.404+0000 7fd3d8b8e640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3bc005140 0x7fd3bc00b980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3d406bad0 tx=0x7fd3bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73310aab64a59d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.405+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc034630 con 0x7fd3bc005140 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.405+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc02f070 con 0x7fd3bc005140 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.405+0000 7fd3d2ffd640 1 -- 172.21.15.91:0/479749757 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc0349d0 con 0x7fd3bc005140 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.405+0000 7fd3da5f1640 1 -- 172.21.15.91:0/479749757 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3bc005140 msgr2=0x7fd3bc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.405+0000 7fd3da5f1640 1 --2- 172.21.15.91:0/479749757 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3bc005140 0x7fd3bc00b980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3d406bad0 tx=0x7fd3bc0057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.405+0000 7fd3d8b8e640 1 -- 172.21.15.91:0/479749757 reap_dead start 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.405+0000 7fd3da5f1640 1 -- 172.21.15.91:0/479749757 shutdown_connections 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.405+0000 7fd3da5f1640 1 -- 172.21.15.91:0/479749757 >> 172.21.15.91:0/479749757 conn(0x7fd3d40c5cc0 msgr2=0x7fd3d40c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.405+0000 7fd3da5f1640 1 -- 172.21.15.91:0/479749757 shutdown_connections 2023-11-27T20:41:29.408 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.405+0000 7fd3da5f1640 1 -- 172.21.15.91:0/479749757 wait complete. 2023-11-27T20:41:29.409 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.407+0000 7fd3da5f1640 1 Processor -- start 2023-11-27T20:41:29.410 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.407+0000 7fd3da5f1640 1 -- start start 2023-11-27T20:41:29.410 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.408+0000 7fd3da5f1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3d40c2d50 0x7fd3d40aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.410 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.408+0000 7fd3da5f1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3d40a9920 0x7fd3d40aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.410 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.408+0000 7fd3da5f1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3d41ee590 0x7fd3d41eea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.410 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.408+0000 7fd3da5f1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40a2270 con 0x7fd3d40a9920 2023-11-27T20:41:29.410 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.408+0000 7fd3da5f1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40a4bd0 con 0x7fd3d41ee590 2023-11-27T20:41:29.410 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.408+0000 7fd3da5f1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40a24c0 con 0x7fd3d40c2d50 2023-11-27T20:41:29.410 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.408+0000 7fd3d37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3d40a9920 0x7fd3d40aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.410 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.408+0000 7fd3d37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3d40a9920 0x7fd3d40aaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54090/0 (socket says 172.21.15.91:54090) 2023-11-27T20:41:29.411 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.408+0000 7fd3d37fe640 1 -- 172.21.15.91:0/4150972694 learned_addr learned my addr 172.21.15.91:0/4150972694 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:29.411 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d3fff640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3d40c2d50 0x7fd3d40aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.411 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d37fe640 1 -- 172.21.15.91:0/4150972694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3d40c2d50 msgr2=0x7fd3d40aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:29.411 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d8b8e640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3d41ee590 0x7fd3d41eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.411 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d37fe640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3d40c2d50 0x7fd3d40aa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.411 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d37fe640 1 -- 172.21.15.91:0/4150972694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3d41ee590 msgr2=0x7fd3d41eea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:29.411 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d37fe640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3d41ee590 0x7fd3d41eea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.411 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d37fe640 1 -- 172.21.15.91:0/4150972694 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d40c2950 con 0x7fd3d40a9920 2023-11-27T20:41:29.411 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d37fe640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3d40a9920 0x7fd3d40aaaa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8010860 tx=0x7fd3c8010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:29.412 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d0ff9640 1 -- 172.21.15.91:0/4150972694 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8009610 con 0x7fd3d40a9920 2023-11-27T20:41:29.412 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d0ff9640 1 -- 172.21.15.91:0/4150972694 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c800eb60 con 0x7fd3d40a9920 2023-11-27T20:41:29.412 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3d0ff9640 1 -- 172.21.15.91:0/4150972694 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c801c400 con 0x7fd3d40a9920 2023-11-27T20:41:29.412 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3da5f1640 1 -- 172.21.15.91:0/4150972694 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d40a27a0 con 0x7fd3d40a9920 2023-11-27T20:41:29.412 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.409+0000 7fd3da5f1640 1 -- 172.21.15.91:0/4150972694 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d40a9d70 con 0x7fd3d40a9920 2023-11-27T20:41:29.412 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.410+0000 7fd3da5f1640 1 -- 172.21.15.91:0/4150972694 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d40682f0 con 0x7fd3d40a9920 2023-11-27T20:41:29.413 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.411+0000 7fd3d0ff9640 1 -- 172.21.15.91:0/4150972694 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd3c801c560 con 0x7fd3d40a9920 2023-11-27T20:41:29.413 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.412+0000 7fd3d0ff9640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3c006b1c0 0x7fd3c006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.413 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.412+0000 7fd3d0ff9640 1 -- 172.21.15.91:0/4150972694 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd3c8089c80 con 0x7fd3d40a9920 2023-11-27T20:41:29.414 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.413+0000 7fd3d3fff640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3c006b1c0 0x7fd3c006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.414 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.413+0000 7fd3d3fff640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3c006b1c0 0x7fd3c006d680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40c0350 tx=0x7fd3c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:29.419 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.418+0000 7fd3d0ff9640 1 -- 172.21.15.91:0/4150972694 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd3c8054da0 con 0x7fd3d40a9920 2023-11-27T20:41:29.613 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.612+0000 7fd3da5f1640 1 -- 172.21.15.91:0/4150972694 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3d40c5090 con 0x7fd3d40a9920 2023-11-27T20:41:29.615 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.614+0000 7fd3d0ff9640 1 -- 172.21.15.91:0/4150972694 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12815 (secure 0 0 0) 0x7fd3c80583c0 con 0x7fd3d40a9920 2023-11-27T20:41:29.615 INFO:teuthology.misc.health.smithi091.stdout: 2023-11-27T20:41:29.616 INFO:teuthology.misc.health.smithi091.stdout:{"epoch":16,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:26.154718+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:29.618 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.616+0000 7fd3da5f1640 1 -- 172.21.15.91:0/4150972694 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3c006b1c0 msgr2=0x7fd3c006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:29.618 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.616+0000 7fd3da5f1640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3c006b1c0 0x7fd3c006d680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40c0350 tx=0x7fd3c4008040 comp rx=0 tx=0).stop 2023-11-27T20:41:29.618 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.616+0000 7fd3da5f1640 1 -- 172.21.15.91:0/4150972694 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3d40a9920 msgr2=0x7fd3d40aaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:29.619 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.616+0000 7fd3da5f1640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3d40a9920 0x7fd3d40aaaa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8010860 tx=0x7fd3c8010d20 comp rx=0 tx=0).stop 2023-11-27T20:41:29.619 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.617+0000 7fd3da5f1640 1 -- 172.21.15.91:0/4150972694 shutdown_connections 2023-11-27T20:41:29.619 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.617+0000 7fd3da5f1640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3c006b1c0 0x7fd3c006d680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.619 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.617+0000 7fd3da5f1640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3d41ee590 0x7fd3d41eea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.619 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.617+0000 7fd3da5f1640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3d40a9920 0x7fd3d40aaaa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.619 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.617+0000 7fd3da5f1640 1 --2- 172.21.15.91:0/4150972694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3d40c2d50 0x7fd3d40aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.619 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.617+0000 7fd3da5f1640 1 -- 172.21.15.91:0/4150972694 >> 172.21.15.91:0/4150972694 conn(0x7fd3d40c5cc0 msgr2=0x7fd3d414f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:29.619 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.617+0000 7fd3da5f1640 1 -- 172.21.15.91:0/4150972694 shutdown_connections 2023-11-27T20:41:29.619 INFO:teuthology.misc.health.smithi091.stderr:2023-11-27T20:41:29.617+0000 7fd3da5f1640 1 -- 172.21.15.91:0/4150972694 wait complete. 2023-11-27T20:41:29.633 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-27T20:41:29.633 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-27T20:41:29.633 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T20:41:29.633 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-27T20:41:29.639 INFO:tasks.ceph.mds.a:Started 2023-11-27T20:41:29.639 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T20:41:29.639 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-27T20:41:29.643 INFO:tasks.ceph.mds.c:Started 2023-11-27T20:41:29.643 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T20:41:29.644 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-27T20:41:29.652 INFO:tasks.ceph.mds.b:Started 2023-11-27T20:41:29.653 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-27T20:41:29.653 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-27T20:41:29.662 INFO:tasks.ceph.mds.d:Started 2023-11-27T20:41:29.662 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-27T20:41:29.663 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:29.793 INFO:tasks.ceph.mds.c.smithi091.stdout:starting mds.c at 2023-11-27T20:41:29.794 INFO:tasks.ceph.mds.a.smithi091.stdout:starting mds.a at 2023-11-27T20:41:29.820 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-11-27T20:41:29.820 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-11-27T20:41:29.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.846+0000 7fbd0c9b0640 1 Processor -- start 2023-11-27T20:41:29.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.846+0000 7fbd0c9b0640 1 -- start start 2023-11-27T20:41:29.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.847+0000 7fbd0c9b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 0x7fbd081550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.847+0000 7fbd0c9b0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbd0806b7d0 0x7fbd0806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.847+0000 7fbd0c9b0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd080bd8d0 con 0x7fbd080c7e90 2023-11-27T20:41:29.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.847+0000 7fbd0c9b0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd080c6e60 con 0x7fbd0806b7d0 2023-11-27T20:41:29.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.847+0000 7fbd0c9b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd08155600 con 0x7fbd0814e810 2023-11-27T20:41:29.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.847+0000 7fbd06d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbd0806b7d0 0x7fbd0806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.847+0000 7fbd0659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 0x7fbd081550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.847+0000 7fbd06d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbd0806b7d0 0x7fbd0806bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54132/0 (socket says 172.21.15.91:54132) 2023-11-27T20:41:29.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.847+0000 7fbd06d9d640 1 -- 172.21.15.91:0/2599595142 learned_addr learned my addr 172.21.15.91:0/2599595142 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:29.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.847+0000 7fbcfffff640 1 --1- 172.21.15.91:0/2599595142 >> v1:172.21.15.183:6789/0 conn(0x7fbd080c7e90 0x7fbd080c4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:59322/0 (socket says 172.21.15.91:59322) 2023-11-27T20:41:29.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.848+0000 7fbd06d9d640 1 -- 172.21.15.91:0/2599595142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 msgr2=0x7fbd081550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:29.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.848+0000 7fbd05d9b640 1 -- 172.21.15.91:0/2599595142 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424094292 0 0) 0x7fbd080bd8d0 con 0x7fbd080c7e90 2023-11-27T20:41:29.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.848+0000 7fbd06d9d640 1 --2- 172.21.15.91:0/2599595142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 0x7fbd081550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.848+0000 7fbd06d9d640 1 -- 172.21.15.91:0/2599595142 >> v1:172.21.15.183:6789/0 conn(0x7fbd080c7e90 legacy=0x7fbd080c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:29.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.848+0000 7fbd06d9d640 1 -- 172.21.15.91:0/2599595142 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd080c70d0 con 0x7fbd0806b7d0 2023-11-27T20:41:29.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.848+0000 7fbd0659c640 1 --2- 172.21.15.91:0/2599595142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 0x7fbd081550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:29.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.849+0000 7fbd06d9d640 1 --2- 172.21.15.91:0/2599595142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd0806b7d0 0x7fbd0806bc60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009e50 tx=0x7fbd0002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776ca6c19ebefb2d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:29.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.849+0000 7fbd05d9b640 1 -- 172.21.15.91:0/2599595142 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0002ca70 con 0x7fbd0806b7d0 2023-11-27T20:41:29.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.849+0000 7fbd05d9b640 1 -- 172.21.15.91:0/2599595142 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0002cbd0 con 0x7fbd0806b7d0 2023-11-27T20:41:29.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.849+0000 7fbd05d9b640 1 -- 172.21.15.91:0/2599595142 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000343f0 con 0x7fbd0806b7d0 2023-11-27T20:41:29.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.850+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/2599595142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd0806b7d0 msgr2=0x7fbd0806bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:29.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.850+0000 7fbd0c9b0640 1 --2- 172.21.15.91:0/2599595142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd0806b7d0 0x7fbd0806bc60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009e50 tx=0x7fbd0002bed0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.850+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/2599595142 shutdown_connections 2023-11-27T20:41:29.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.850+0000 7fbd0c9b0640 1 --2- 172.21.15.91:0/2599595142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd0806b7d0 0x7fbd0806bc60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.850+0000 7fbd0c9b0640 1 --2- 172.21.15.91:0/2599595142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 0x7fbd081550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.850+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/2599595142 >> 172.21.15.91:0/2599595142 conn(0x7fbd080ca170 msgr2=0x7fbd080ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:29.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.850+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/2599595142 shutdown_connections 2023-11-27T20:41:29.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.850+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/2599595142 wait complete. 2023-11-27T20:41:29.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.852+0000 7fbd0c9b0640 1 Processor -- start 2023-11-27T20:41:29.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.852+0000 7fbd0c9b0640 1 -- start start 2023-11-27T20:41:29.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.852+0000 7fbd0c9b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0806b7d0 0x7fbd081558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbd0c9b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd080c7e90 0x7fbd080bf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbd0c9b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 0x7fbd081582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbd0c9b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080c2ab0 con 0x7fbd080c7e90 2023-11-27T20:41:29.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbd0c9b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080c3220 con 0x7fbd0806b7d0 2023-11-27T20:41:29.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbd0c9b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080c3ba0 con 0x7fbd0814e810 2023-11-27T20:41:29.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbcfffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd080c7e90 0x7fbd080bf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbd0659c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0806b7d0 0x7fbd081558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbcfffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd080c7e90 0x7fbd080bf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54136/0 (socket says 172.21.15.91:54136) 2023-11-27T20:41:29.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbcfffff640 1 -- 172.21.15.91:0/3250159222 learned_addr learned my addr 172.21.15.91:0/3250159222 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:29.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbd06d9d640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 0x7fbd081582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbcfffff640 1 -- 172.21.15.91:0/3250159222 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 msgr2=0x7fbd081582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:29.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbcfffff640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 0x7fbd081582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbcfffff640 1 -- 172.21.15.91:0/3250159222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0806b7d0 msgr2=0x7fbd081558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:29.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbcfffff640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0806b7d0 0x7fbd081558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:29.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbcfffff640 1 -- 172.21.15.91:0/3250159222 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf8009400 con 0x7fbd080c7e90 2023-11-27T20:41:29.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbd06d9d640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 0x7fbd081582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:29.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.853+0000 7fbd0659c640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0806b7d0 0x7fbd081558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:29.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.854+0000 7fbcfffff640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd080c7e90 0x7fbd080bf6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c410 tx=0x7fbcf000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:29.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.854+0000 7fbcfeffd640 1 -- 172.21.15.91:0/3250159222 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00074e0 con 0x7fbd080c7e90 2023-11-27T20:41:29.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.854+0000 7fbcfeffd640 1 -- 172.21.15.91:0/3250159222 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf0007660 con 0x7fbd080c7e90 2023-11-27T20:41:29.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.854+0000 7fbcfeffd640 1 -- 172.21.15.91:0/3250159222 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0004a20 con 0x7fbd080c7e90 2023-11-27T20:41:29.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.854+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/3250159222 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd00009b30 con 0x7fbd080c7e90 2023-11-27T20:41:29.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.854+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/3250159222 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd080c2d00 con 0x7fbd080c7e90 2023-11-27T20:41:29.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.855+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/3250159222 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd080c2f20 con 0x7fbd080c7e90 2023-11-27T20:41:29.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.856+0000 7fbcfeffd640 1 -- 172.21.15.91:0/3250159222 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbcf0004b80 con 0x7fbd080c7e90 2023-11-27T20:41:29.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.857+0000 7fbcfeffd640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbce806b1f0 0x7fbce806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:29.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.857+0000 7fbcfeffd640 1 -- 172.21.15.91:0/3250159222 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbcf0089470 con 0x7fbd080c7e90 2023-11-27T20:41:29.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.857+0000 7fbd0659c640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbce806b1f0 0x7fbce806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:29.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.858+0000 7fbd0659c640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbce806b1f0 0x7fbce806d6b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd080c2a40 tx=0x7fbcf8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:29.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:29.862+0000 7fbcfeffd640 1 -- 172.21.15.91:0/3250159222 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbcf0057ee0 con 0x7fbd080c7e90 2023-11-27T20:41:30.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.054+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/3250159222 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd08068350 con 0x7fbd080c7e90 2023-11-27T20:41:30.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.056+0000 7fbcfeffd640 1 -- 172.21.15.91:0/3250159222 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12815 (secure 0 0 0) 0x7fbcf0057a70 con 0x7fbd080c7e90 2023-11-27T20:41:30.058 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:30.058 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":16,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:26.154718+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:30.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/3250159222 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbce806b1f0 msgr2=0x7fbce806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbce806b1f0 0x7fbce806d6b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd080c2a40 tx=0x7fbcf8009190 comp rx=0 tx=0).stop 2023-11-27T20:41:30.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/3250159222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd080c7e90 msgr2=0x7fbd080bf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd080c7e90 0x7fbd080bf6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c410 tx=0x7fbcf000c8d0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/3250159222 shutdown_connections 2023-11-27T20:41:30.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0814e810 0x7fbd081582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd080c7e90 0x7fbd080bf6a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbce806b1f0 0x7fbce806d6b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 --2- 172.21.15.91:0/3250159222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0806b7d0 0x7fbd081558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/3250159222 >> 172.21.15.91:0/3250159222 conn(0x7fbd080ca170 msgr2=0x7fbd080a9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:30.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/3250159222 shutdown_connections 2023-11-27T20:41:30.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.059+0000 7fbd0c9b0640 1 -- 172.21.15.91:0/3250159222 wait complete. 2023-11-27T20:41:30.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:41:30.080 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:41:30.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.287+0000 7fd74684f640 1 Processor -- start 2023-11-27T20:41:30.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.287+0000 7fd74684f640 1 -- start start 2023-11-27T20:41:30.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.288+0000 7fd74684f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd74006d0a0 0x7fd740152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.288+0000 7fd74684f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7400c3ea0 0x7fd7400c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.288+0000 7fd74684f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7400c64a0 con 0x7fd74014fd30 2023-11-27T20:41:30.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.288+0000 7fd74684f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7400c5c00 con 0x7fd74006d0a0 2023-11-27T20:41:30.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.288+0000 7fd74684f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400c5ee0 con 0x7fd7400c3ea0 2023-11-27T20:41:30.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.289+0000 7fd73ffff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fd74014fd30 0x7fd7400a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:59332/0 (socket says 172.21.15.91:59332) 2023-11-27T20:41:30.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.289+0000 7fd73ffff640 1 -- 172.21.15.91:0/4274181778 learned_addr learned my addr 172.21.15.91:0/4274181778 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:30.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.289+0000 7fd744dec640 1 --2- 172.21.15.91:0/4274181778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7400c3ea0 0x7fd7400c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.289+0000 7fd73f7fe640 1 --2- 172.21.15.91:0/4274181778 >> v2:172.21.15.183:3300/0 conn(0x7fd74006d0a0 0x7fd740152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.290+0000 7fd744dec640 1 -- 172.21.15.91:0/4274181778 >> v2:172.21.15.183:3300/0 conn(0x7fd74006d0a0 msgr2=0x7fd740152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:30.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.290+0000 7fd744dec640 1 --2- 172.21.15.91:0/4274181778 >> v2:172.21.15.183:3300/0 conn(0x7fd74006d0a0 0x7fd740152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.290+0000 7fd744dec640 1 -- 172.21.15.91:0/4274181778 >> v1:172.21.15.183:6789/0 conn(0x7fd74014fd30 legacy=0x7fd7400a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.290+0000 7fd744dec640 1 -- 172.21.15.91:0/4274181778 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7400c61c0 con 0x7fd7400c3ea0 2023-11-27T20:41:30.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.291+0000 7fd744dec640 1 --2- 172.21.15.91:0/4274181778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7400c3ea0 0x7fd7400c4330 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd738009d90 tx=0x7fd73802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8044229df1a6eae server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:30.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.292+0000 7fd73effd640 1 -- 172.21.15.91:0/4274181778 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73802cc50 con 0x7fd7400c3ea0 2023-11-27T20:41:30.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.292+0000 7fd73effd640 1 -- 172.21.15.91:0/4274181778 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73802cdb0 con 0x7fd7400c3ea0 2023-11-27T20:41:30.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.292+0000 7fd73effd640 1 -- 172.21.15.91:0/4274181778 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738034660 con 0x7fd7400c3ea0 2023-11-27T20:41:30.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.292+0000 7fd74684f640 1 -- 172.21.15.91:0/4274181778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7400c3ea0 msgr2=0x7fd7400c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.292+0000 7fd74684f640 1 --2- 172.21.15.91:0/4274181778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7400c3ea0 0x7fd7400c4330 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd738009d90 tx=0x7fd73802bea0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.292+0000 7fd74684f640 1 -- 172.21.15.91:0/4274181778 shutdown_connections 2023-11-27T20:41:30.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.292+0000 7fd74684f640 1 --2- 172.21.15.91:0/4274181778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7400c3ea0 0x7fd7400c4330 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.292+0000 7fd74684f640 1 --2- 172.21.15.91:0/4274181778 >> v2:172.21.15.183:3300/0 conn(0x7fd74006d0a0 0x7fd740152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.292+0000 7fd74684f640 1 -- 172.21.15.91:0/4274181778 >> 172.21.15.91:0/4274181778 conn(0x7fd74006a500 msgr2=0x7fd74006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:30.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.293+0000 7fd74684f640 1 -- 172.21.15.91:0/4274181778 shutdown_connections 2023-11-27T20:41:30.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.293+0000 7fd74684f640 1 -- 172.21.15.91:0/4274181778 wait complete. 2023-11-27T20:41:30.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.294+0000 7fd74684f640 1 Processor -- start 2023-11-27T20:41:30.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.294+0000 7fd74684f640 1 -- start start 2023-11-27T20:41:30.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.295+0000 7fd74684f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74006d0a0 0x7fd7401ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.295+0000 7fd74684f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7400c3ea0 0x7fd7400a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.295+0000 7fd74684f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74014fd30 0x7fd7400a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.295+0000 7fd74684f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7401dbe50 con 0x7fd7400c3ea0 2023-11-27T20:41:30.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.295+0000 7fd74684f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74014e4c0 con 0x7fd74006d0a0 2023-11-27T20:41:30.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.295+0000 7fd74684f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7401dbb70 con 0x7fd74014fd30 2023-11-27T20:41:30.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd73f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7400c3ea0 0x7fd7400a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd73f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7400c3ea0 0x7fd7400a9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54140/0 (socket says 172.21.15.91:54140) 2023-11-27T20:41:30.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd73f7fe640 1 -- 172.21.15.91:0/2299922777 learned_addr learned my addr 172.21.15.91:0/2299922777 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd73ffff640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74006d0a0 0x7fd7401ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd744dec640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74014fd30 0x7fd7400a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd73f7fe640 1 -- 172.21.15.91:0/2299922777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74014fd30 msgr2=0x7fd7400a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd73f7fe640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74014fd30 0x7fd7400a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd73f7fe640 1 -- 172.21.15.91:0/2299922777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74006d0a0 msgr2=0x7fd7401ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd73f7fe640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74006d0a0 0x7fd7401ed610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd73f7fe640 1 -- 172.21.15.91:0/2299922777 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738009a70 con 0x7fd7400c3ea0 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.296+0000 7fd73ffff640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74006d0a0 0x7fd7401ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.297+0000 7fd73f7fe640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7400c3ea0 0x7fd7400a9570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd73400e840 tx=0x7fd73400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.297+0000 7fd73cff9640 1 -- 172.21.15.91:0/2299922777 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340094f0 con 0x7fd7400c3ea0 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.297+0000 7fd73cff9640 1 -- 172.21.15.91:0/2299922777 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73400c940 con 0x7fd7400c3ea0 2023-11-27T20:41:30.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.297+0000 7fd73cff9640 1 -- 172.21.15.91:0/2299922777 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400ccd0 con 0x7fd7400c3ea0 2023-11-27T20:41:30.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.297+0000 7fd74684f640 1 -- 172.21.15.91:0/2299922777 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7400a51e0 con 0x7fd7400c3ea0 2023-11-27T20:41:30.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.297+0000 7fd74684f640 1 -- 172.21.15.91:0/2299922777 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74014ebc0 con 0x7fd7400c3ea0 2023-11-27T20:41:30.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.298+0000 7fd74684f640 1 -- 172.21.15.91:0/2299922777 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd740068350 con 0x7fd7400c3ea0 2023-11-27T20:41:30.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.300+0000 7fd73cff9640 1 -- 172.21.15.91:0/2299922777 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd734013470 con 0x7fd7400c3ea0 2023-11-27T20:41:30.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.301+0000 7fd73cff9640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd72c06b1c0 0x7fd72c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.301+0000 7fd73cff9640 1 -- 172.21.15.91:0/2299922777 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd7340897a0 con 0x7fd7400c3ea0 2023-11-27T20:41:30.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.301+0000 7fd73ffff640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd72c06b1c0 0x7fd72c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.302+0000 7fd73ffff640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd72c06b1c0 0x7fd72c06d680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd730007fd0 tx=0x7fd730009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:30.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.307+0000 7fd73cff9640 1 -- 172.21.15.91:0/2299922777 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd734054820 con 0x7fd7400c3ea0 2023-11-27T20:41:30.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.500+0000 7fd74684f640 1 -- 172.21.15.91:0/2299922777 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7400c66d0 con 0x7fd7400c3ea0 2023-11-27T20:41:30.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.500+0000 7fd73cff9640 1 -- 172.21.15.91:0/2299922777 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd734057e40 con 0x7fd7400c3ea0 2023-11-27T20:41:30.502 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:41:30.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.502+0000 7fd74684f640 1 -- 172.21.15.91:0/2299922777 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd72c06b1c0 msgr2=0x7fd72c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.502+0000 7fd74684f640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd72c06b1c0 0x7fd72c06d680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd730007fd0 tx=0x7fd730009040 comp rx=0 tx=0).stop 2023-11-27T20:41:30.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.503+0000 7fd74684f640 1 -- 172.21.15.91:0/2299922777 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7400c3ea0 msgr2=0x7fd7400a9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.503+0000 7fd74684f640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7400c3ea0 0x7fd7400a9570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd73400e840 tx=0x7fd73400ed00 comp rx=0 tx=0).stop 2023-11-27T20:41:30.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.503+0000 7fd74684f640 1 -- 172.21.15.91:0/2299922777 shutdown_connections 2023-11-27T20:41:30.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.503+0000 7fd74684f640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74014fd30 0x7fd7400a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.503+0000 7fd74684f640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7400c3ea0 0x7fd7400a9570 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.503+0000 7fd74684f640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd72c06b1c0 0x7fd72c06d680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.503+0000 7fd74684f640 1 --2- 172.21.15.91:0/2299922777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74006d0a0 0x7fd7401ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.503+0000 7fd74684f640 1 -- 172.21.15.91:0/2299922777 >> 172.21.15.91:0/2299922777 conn(0x7fd74006a500 msgr2=0x7fd7400a5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:30.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.503+0000 7fd74684f640 1 -- 172.21.15.91:0/2299922777 shutdown_connections 2023-11-27T20:41:30.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.503+0000 7fd74684f640 1 -- 172.21.15.91:0/2299922777 wait complete. 2023-11-27T20:41:30.523 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:41:30.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.726+0000 7f8110a56640 1 Processor -- start 2023-11-27T20:41:30.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.726+0000 7f8110a56640 1 -- start start 2023-11-27T20:41:30.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.728+0000 7f8110a56640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f810c155490 0x7f810c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.728+0000 7f8110a56640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f810c0a9b40 0x7f810c0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.728+0000 7f8110a56640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0c06c0 con 0x7f810c0c1500 2023-11-27T20:41:30.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.728+0000 7f8110a56640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c0a5820 con 0x7f810c0a9b40 2023-11-27T20:41:30.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.728+0000 7f8110a56640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c0c1020 con 0x7f810c155490 2023-11-27T20:41:30.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.728+0000 7f810ad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f810c0a9b40 0x7f810c0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.728+0000 7f810ad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f810c0a9b40 0x7f810c0c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54150/0 (socket says 172.21.15.91:54150) 2023-11-27T20:41:30.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.728+0000 7f810ad9d640 1 -- 172.21.15.91:0/2060472155 learned_addr learned my addr 172.21.15.91:0/2060472155 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:30.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.729+0000 7f810a59c640 1 --2- 172.21.15.91:0/2060472155 >> v2:172.21.15.183:3300/0 conn(0x7f810c155490 0x7f810c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.729+0000 7f810ad9d640 1 -- 172.21.15.91:0/2060472155 >> v2:172.21.15.183:3300/0 conn(0x7f810c155490 msgr2=0x7f810c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:30.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.729+0000 7f810ad9d640 1 --2- 172.21.15.91:0/2060472155 >> v2:172.21.15.183:3300/0 conn(0x7f810c155490 0x7f810c0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.729+0000 7f810ad9d640 1 -- 172.21.15.91:0/2060472155 >> v1:172.21.15.183:6789/0 conn(0x7f810c0c1500 legacy=0x7f810c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:30.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.729+0000 7f810ad9d640 1 -- 172.21.15.91:0/2060472155 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c0c0910 con 0x7f810c0a9b40 2023-11-27T20:41:30.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.730+0000 7f810ad9d640 1 --2- 172.21.15.91:0/2060472155 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c0a9b40 0x7f810c0c24d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f810c06dff0 tx=0x7f810402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2330b8841cda1f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:30.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.730+0000 7f8109d9b640 1 -- 172.21.15.91:0/2060472155 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810402ca80 con 0x7f810c0a9b40 2023-11-27T20:41:30.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.730+0000 7f8109d9b640 1 -- 172.21.15.91:0/2060472155 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810402cbe0 con 0x7f810c0a9b40 2023-11-27T20:41:30.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.730+0000 7f8109d9b640 1 -- 172.21.15.91:0/2060472155 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81040343f0 con 0x7f810c0a9b40 2023-11-27T20:41:30.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.731+0000 7f8110a56640 1 -- 172.21.15.91:0/2060472155 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c0a9b40 msgr2=0x7f810c0c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.731+0000 7f8110a56640 1 --2- 172.21.15.91:0/2060472155 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c0a9b40 0x7f810c0c24d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f810c06dff0 tx=0x7f810402bee0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.731+0000 7f8110a56640 1 -- 172.21.15.91:0/2060472155 shutdown_connections 2023-11-27T20:41:30.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.731+0000 7f8110a56640 1 --2- 172.21.15.91:0/2060472155 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c0a9b40 0x7f810c0c24d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.731+0000 7f8110a56640 1 --2- 172.21.15.91:0/2060472155 >> v2:172.21.15.183:3300/0 conn(0x7f810c155490 0x7f810c0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.731+0000 7f8110a56640 1 -- 172.21.15.91:0/2060472155 >> 172.21.15.91:0/2060472155 conn(0x7f810c06a500 msgr2=0x7f810c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:30.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.731+0000 7f8110a56640 1 -- 172.21.15.91:0/2060472155 shutdown_connections 2023-11-27T20:41:30.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.731+0000 7f8110a56640 1 -- 172.21.15.91:0/2060472155 wait complete. 2023-11-27T20:41:30.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.733+0000 7f8110a56640 1 Processor -- start 2023-11-27T20:41:30.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.733+0000 7f8110a56640 1 -- start start 2023-11-27T20:41:30.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f8110a56640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f810c0c1500 0x7f810c1e8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f8110a56640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c155490 0x7f810c14ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f8110a56640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f810c153fe0 0x7f810c14d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f8110a56640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c1e8a50 con 0x7f810c155490 2023-11-27T20:41:30.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f8110a56640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c14f2a0 con 0x7f810c153fe0 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f8110a56640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c14f500 con 0x7f810c0c1500 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f8103fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c155490 0x7f810c14ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f8103fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c155490 0x7f810c14ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54152/0 (socket says 172.21.15.91:54152) 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f8103fff640 1 -- 172.21.15.91:0/89032103 learned_addr learned my addr 172.21.15.91:0/89032103 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f810a59c640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f810c0c1500 0x7f810c1e8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.734+0000 7f810ad9d640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f810c153fe0 0x7f810c14d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8103fff640 1 -- 172.21.15.91:0/89032103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f810c0c1500 msgr2=0x7f810c1e8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8103fff640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f810c0c1500 0x7f810c1e8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8103fff640 1 -- 172.21.15.91:0/89032103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f810c153fe0 msgr2=0x7f810c14d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8103fff640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f810c153fe0 0x7f810c14d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8103fff640 1 -- 172.21.15.91:0/89032103 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104009b30 con 0x7f810c155490 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f810ad9d640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f810c153fe0 0x7f810c14d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:30.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f810a59c640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f810c0c1500 0x7f810c1e8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:30.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8103fff640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c155490 0x7f810c14ed60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80f400c430 tx=0x7f80f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:30.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8102ffd640 1 -- 172.21.15.91:0/89032103 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4011790 con 0x7f810c155490 2023-11-27T20:41:30.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8102ffd640 1 -- 172.21.15.91:0/89032103 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f40118f0 con 0x7f810c155490 2023-11-27T20:41:30.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8102ffd640 1 -- 172.21.15.91:0/89032103 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4011ce0 con 0x7f810c155490 2023-11-27T20:41:30.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8110a56640 1 -- 172.21.15.91:0/89032103 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c14f7e0 con 0x7f810c155490 2023-11-27T20:41:30.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.735+0000 7f8110a56640 1 -- 172.21.15.91:0/89032103 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c14cab0 con 0x7f810c155490 2023-11-27T20:41:30.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.736+0000 7f8110a56640 1 -- 172.21.15.91:0/89032103 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c068350 con 0x7f810c155490 2023-11-27T20:41:30.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.737+0000 7f8102ffd640 1 -- 172.21.15.91:0/89032103 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f80f401c460 con 0x7f810c155490 2023-11-27T20:41:30.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.738+0000 7f8102ffd640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80ec06b1c0 0x7f80ec06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:30.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.738+0000 7f8102ffd640 1 -- 172.21.15.91:0/89032103 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f80f4089720 con 0x7f810c155490 2023-11-27T20:41:30.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.738+0000 7f810a59c640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80ec06b1c0 0x7f80ec06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:30.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.739+0000 7f810a59c640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80ec06b1c0 0x7f80ec06d680 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80fc006fd0 tx=0x7f80fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:30.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.742+0000 7f8102ffd640 1 -- 172.21.15.91:0/89032103 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f80f4054700 con 0x7f810c155490 2023-11-27T20:41:30.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.956+0000 7f8110a56640 1 -- 172.21.15.91:0/89032103 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f810c0aa9e0 con 0x7f810c155490 2023-11-27T20:41:30.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.958+0000 7f8102ffd640 1 -- 172.21.15.91:0/89032103 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f80f4057d20 con 0x7f810c155490 2023-11-27T20:41:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:30.959 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/636329462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":636329462},{"type":"v1","addr":"172.21.15.91:6836","nonce":636329462}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/433109070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":433109070},{"type":"v1","addr":"172.21.15.91:6837","nonce":433109070}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1419226381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1419226381},{"type":"v1","addr":"172.21.15.183:6835","nonce":1419226381}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4022772138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4022772138},{"type":"v1","addr":"172.21.15.183:6834","nonce":4022772138}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-27T20:41:30.959 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 3 2023-11-27T20:41:30.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 -- 172.21.15.91:0/89032103 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80ec06b1c0 msgr2=0x7f80ec06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80ec06b1c0 0x7f80ec06d680 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80fc006fd0 tx=0x7f80fc008040 comp rx=0 tx=0).stop 2023-11-27T20:41:30.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 -- 172.21.15.91:0/89032103 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c155490 msgr2=0x7f810c14ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:30.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c155490 0x7f810c14ed60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80f400c430 tx=0x7f80f400c8f0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 -- 172.21.15.91:0/89032103 shutdown_connections 2023-11-27T20:41:30.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80ec06b1c0 0x7f80ec06d680 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f810c153fe0 0x7f810c14d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810c155490 0x7f810c14ed60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 --2- 172.21.15.91:0/89032103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f810c0c1500 0x7f810c1e8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:30.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 -- 172.21.15.91:0/89032103 >> 172.21.15.91:0/89032103 conn(0x7f810c06a500 msgr2=0x7f810c0c5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:30.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 -- 172.21.15.91:0/89032103 shutdown_connections 2023-11-27T20:41:30.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:30.960+0000 7f8110a56640 1 -- 172.21.15.91:0/89032103 wait complete. 2023-11-27T20:41:30.978 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:31.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.179+0000 7f602ec9a640 1 Processor -- start 2023-11-27T20:41:31.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.179+0000 7f602ec9a640 1 -- start start 2023-11-27T20:41:31.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.181+0000 7f602ec9a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f602814e7c0 0x7f60280c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.181+0000 7f602ec9a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60281550c0 con 0x7f60280c4c00 2023-11-27T20:41:31.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.181+0000 7f602ec9a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6028158a60 con 0x7f6028154580 2023-11-27T20:41:31.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.181+0000 7f602ec9a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60280c5b10 con 0x7f602814e7c0 2023-11-27T20:41:31.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.181+0000 7f602d497640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f60280c4c00 0x7f60280ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42530/0 (socket says 172.21.15.91:42530) 2023-11-27T20:41:31.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.181+0000 7f602d497640 1 -- 172.21.15.91:0/2294097989 learned_addr learned my addr 172.21.15.91:0/2294097989 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:31.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602dc98640 1 --2- 172.21.15.91:0/2294097989 >> v2:172.21.15.183:3300/0 conn(0x7f602814e7c0 0x7f60280c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730198284 0 0) 0x7f60281550c0 con 0x7f60280c4c00 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6014003520 con 0x7f60280c4c00 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 671527453 0 0) 0x7f6014003520 con 0x7f60280c4c00 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 >> v2:172.21.15.183:3300/0 conn(0x7f602814e7c0 msgr2=0x7f60280c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 --2- 172.21.15.91:0/2294097989 >> v2:172.21.15.183:3300/0 conn(0x7f602814e7c0 0x7f60280c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 >> v1:172.21.15.183:6789/0 conn(0x7f6028154580 legacy=0x7f60281549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028157ca0 con 0x7f60280c4c00 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f601c001670 con 0x7f60280c4c00 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 >> v1:172.21.15.91:6789/0 conn(0x7f60280c4c00 legacy=0x7f60280ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 --2- 172.21.15.91:0/2294097989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f6014003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 --2- 172.21.15.91:0/2294097989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60140047c0 0x7f6014004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 --2- 172.21.15.91:0/2294097989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60140052a0 0x7f601400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601400c140 con 0x7f6014003970 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601400c2b0 con 0x7f60140052a0 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601400c470 con 0x7f60140047c0 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.182+0000 7f602dc98640 1 --2- 172.21.15.91:0/2294097989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f6014003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.183+0000 7f602dc98640 1 -- 172.21.15.91:0/2294097989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60140047c0 msgr2=0x7f6014004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.183+0000 7f602dc98640 1 --2- 172.21.15.91:0/2294097989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60140047c0 0x7f6014004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.183+0000 7f602dc98640 1 -- 172.21.15.91:0/2294097989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60140052a0 msgr2=0x7f601400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.183+0000 7f602dc98640 1 --2- 172.21.15.91:0/2294097989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60140052a0 0x7f601400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.183+0000 7f602dc98640 1 -- 172.21.15.91:0/2294097989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014003520 con 0x7f6014003970 2023-11-27T20:41:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.183+0000 7f602e499640 1 -- 172.21.15.91:0/2294097989 reap_dead start 2023-11-27T20:41:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.184+0000 7f602dc98640 1 --2- 172.21.15.91:0/2294097989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f6014003d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6024009a90 tx=0x7f60140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc3951543d37af3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.184+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602402c6b0 con 0x7f6014003970 2023-11-27T20:41:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.184+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602402c810 con 0x7f6014003970 2023-11-27T20:41:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.184+0000 7f602cc96640 1 -- 172.21.15.91:0/2294097989 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602402cba0 con 0x7f6014003970 2023-11-27T20:41:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.184+0000 7f602ec9a640 1 -- 172.21.15.91:0/2294097989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 msgr2=0x7f6014003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.184+0000 7f602ec9a640 1 --2- 172.21.15.91:0/2294097989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f6014003d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6024009a90 tx=0x7f60140057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.185+0000 7f602ec9a640 1 -- 172.21.15.91:0/2294097989 shutdown_connections 2023-11-27T20:41:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.185+0000 7f602ec9a640 1 --2- 172.21.15.91:0/2294097989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f6014003d90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.185+0000 7f602ec9a640 1 -- 172.21.15.91:0/2294097989 >> 172.21.15.91:0/2294097989 conn(0x7f60280abf00 msgr2=0x7f60280c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.185+0000 7f602ec9a640 1 -- 172.21.15.91:0/2294097989 shutdown_connections 2023-11-27T20:41:31.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.185+0000 7f602ec9a640 1 -- 172.21.15.91:0/2294097989 wait complete. 2023-11-27T20:41:31.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.186+0000 7f602ec9a640 1 Processor -- start 2023-11-27T20:41:31.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.186+0000 7f602ec9a640 1 -- start start 2023-11-27T20:41:31.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.187+0000 7f602ec9a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f60280c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.187+0000 7f602ec9a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60280aef00 0x7f60281471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.187+0000 7f602ec9a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60280af8d0 0x7f6028147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.187+0000 7f602ec9a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60280ad380 con 0x7f6014003970 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.187+0000 7f602ec9a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60280c26e0 con 0x7f60280aef00 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.187+0000 7f602ec9a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60281e9f00 con 0x7f60280af8d0 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.187+0000 7f602dc98640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f60280c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f602dc98640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f60280c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54180/0 (socket says 172.21.15.91:54180) 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f602dc98640 1 -- 172.21.15.91:0/3466279450 learned_addr learned my addr 172.21.15.91:0/3466279450 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f602dc98640 1 -- 172.21.15.91:0/3466279450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60280af8d0 msgr2=0x7f6028147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f602dc98640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60280af8d0 0x7f6028147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f602dc98640 1 -- 172.21.15.91:0/3466279450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60280aef00 msgr2=0x7f60281471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f602dc98640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60280aef00 0x7f60281471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f602dc98640 1 -- 172.21.15.91:0/3466279450 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280c28b0 con 0x7f6014003970 2023-11-27T20:41:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f602dc98640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f60280c19e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6024037040 tx=0x7f6024004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f601a7fc640 1 -- 172.21.15.91:0/3466279450 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024003810 con 0x7f6014003970 2023-11-27T20:41:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f601a7fc640 1 -- 172.21.15.91:0/3466279450 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024003970 con 0x7f6014003970 2023-11-27T20:41:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f601a7fc640 1 -- 172.21.15.91:0/3466279450 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024003ce0 con 0x7f6014003970 2023-11-27T20:41:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.188+0000 7f602ec9a640 1 -- 172.21.15.91:0/3466279450 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60280c2400 con 0x7f6014003970 2023-11-27T20:41:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.189+0000 7f602ec9a640 1 -- 172.21.15.91:0/3466279450 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60280acd80 con 0x7f6014003970 2023-11-27T20:41:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.190+0000 7f602ec9a640 1 -- 172.21.15.91:0/3466279450 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60280ac900 con 0x7f6014003970 2023-11-27T20:41:31.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.190+0000 7f601a7fc640 1 -- 172.21.15.91:0/3466279450 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6024034440 con 0x7f6014003970 2023-11-27T20:41:31.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.191+0000 7f601a7fc640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600c06b1f0 0x7f600c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.192+0000 7f601a7fc640 1 -- 172.21.15.91:0/3466279450 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60240ab600 con 0x7f6014003970 2023-11-27T20:41:31.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.192+0000 7f602d497640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600c06b1f0 0x7f600c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:31.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.192+0000 7f602d497640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600c06b1f0 0x7f600c06d6b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f601c000f60 tx=0x7f601c001520 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:31.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.195+0000 7f601a7fc640 1 -- 172.21.15.91:0/3466279450 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f60280ac900 con 0x7f6014003970 2023-11-27T20:41:31.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.374+0000 7f602ec9a640 1 -- 172.21.15.91:0/3466279450 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60280ac900 con 0x7f6014003970 2023-11-27T20:41:31.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.376+0000 7f601a7fc640 1 -- 172.21.15.91:0/3466279450 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12815 (secure 0 0 0) 0x7f60280ac900 con 0x7f6014003970 2023-11-27T20:41:31.378 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:31.378 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":16,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:26.154718+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:31.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 -- 172.21.15.91:0/3466279450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600c06b1f0 msgr2=0x7f600c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600c06b1f0 0x7f600c06d6b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f601c000f60 tx=0x7f601c001520 comp rx=0 tx=0).stop 2023-11-27T20:41:31.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 -- 172.21.15.91:0/3466279450 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 msgr2=0x7f60280c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f60280c19e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6024037040 tx=0x7f6024004730 comp rx=0 tx=0).stop 2023-11-27T20:41:31.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 -- 172.21.15.91:0/3466279450 shutdown_connections 2023-11-27T20:41:31.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60280af8d0 0x7f6028147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600c06b1f0 0x7f600c06d6b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60280aef00 0x7f60281471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 --2- 172.21.15.91:0/3466279450 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6014003970 0x7f60280c19e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 -- 172.21.15.91:0/3466279450 >> 172.21.15.91:0/3466279450 conn(0x7f60280abf00 msgr2=0x7f602806c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:31.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 -- 172.21.15.91:0/3466279450 shutdown_connections 2023-11-27T20:41:31.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.379+0000 7f602ec9a640 1 -- 172.21.15.91:0/3466279450 wait complete. 2023-11-27T20:41:31.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:41:31.399 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:41:31.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.607+0000 7f39d007c640 1 Processor -- start 2023-11-27T20:41:31.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.608+0000 7f39d007c640 1 -- start start 2023-11-27T20:41:31.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.609+0000 7f39d007c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39c80a9b40 0x7f39c80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.609+0000 7f39d007c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f39c80c1500 0x7f39c80c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.609+0000 7f39d007c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c80c06c0 con 0x7f39c8155490 2023-11-27T20:41:31.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.609+0000 7f39d007c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c80a5820 con 0x7f39c80c1500 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.609+0000 7f39d007c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80c1020 con 0x7f39c80a9b40 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.609+0000 7f39cde18640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f39c8155490 0x7f39c80a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42532/0 (socket says 172.21.15.91:42532) 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.609+0000 7f39cde18640 1 -- 172.21.15.91:0/2209649675 learned_addr learned my addr 172.21.15.91:0/2209649675 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.609+0000 7f39ce619640 1 --2- 172.21.15.91:0/2209649675 >> v2:172.21.15.91:3300/0 conn(0x7f39c80c1500 0x7f39c80c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.610+0000 7f39ce619640 1 -- 172.21.15.91:0/2209649675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39c80a9b40 msgr2=0x7f39c80a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.610+0000 7f39cd617640 1 --2- 172.21.15.91:0/2209649675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39c80a9b40 0x7f39c80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.610+0000 7f39cce16640 1 -- 172.21.15.91:0/2209649675 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303713896 0 0) 0x7f39c80c06c0 con 0x7f39c8155490 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.610+0000 7f39ce619640 1 --2- 172.21.15.91:0/2209649675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39c80a9b40 0x7f39c80a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.610+0000 7f39ce619640 1 -- 172.21.15.91:0/2209649675 >> v1:172.21.15.91:6789/0 conn(0x7f39c8155490 legacy=0x7f39c80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.610+0000 7f39ce619640 1 -- 172.21.15.91:0/2209649675 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c80c0910 con 0x7f39c80c1500 2023-11-27T20:41:31.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.610+0000 7f39cd617640 1 --2- 172.21.15.91:0/2209649675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39c80a9b40 0x7f39c80a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:31.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.611+0000 7f39ce619640 1 --2- 172.21.15.91:0/2209649675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 0x7f39c80c24d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39c00097a0 tx=0x7f39c002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f1ad1bf97217b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:31.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.611+0000 7f39cce16640 1 -- 172.21.15.91:0/2209649675 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c002d040 con 0x7f39c80c1500 2023-11-27T20:41:31.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.611+0000 7f39cce16640 1 -- 172.21.15.91:0/2209649675 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c0031810 con 0x7f39c80c1500 2023-11-27T20:41:31.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.611+0000 7f39cce16640 1 -- 172.21.15.91:0/2209649675 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0031ba0 con 0x7f39c80c1500 2023-11-27T20:41:31.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.612+0000 7f39d007c640 1 -- 172.21.15.91:0/2209649675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 msgr2=0x7f39c80c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.612+0000 7f39d007c640 1 --2- 172.21.15.91:0/2209649675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 0x7f39c80c24d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39c00097a0 tx=0x7f39c002b8b0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.612+0000 7f39d007c640 1 -- 172.21.15.91:0/2209649675 shutdown_connections 2023-11-27T20:41:31.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.612+0000 7f39d007c640 1 --2- 172.21.15.91:0/2209649675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 0x7f39c80c24d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.612+0000 7f39d007c640 1 --2- 172.21.15.91:0/2209649675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39c80a9b40 0x7f39c80a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.612+0000 7f39d007c640 1 -- 172.21.15.91:0/2209649675 >> 172.21.15.91:0/2209649675 conn(0x7f39c806a500 msgr2=0x7f39c806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:31.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.612+0000 7f39d007c640 1 -- 172.21.15.91:0/2209649675 shutdown_connections 2023-11-27T20:41:31.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.612+0000 7f39d007c640 1 -- 172.21.15.91:0/2209649675 wait complete. 2023-11-27T20:41:31.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.614+0000 7f39d007c640 1 Processor -- start 2023-11-27T20:41:31.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.614+0000 7f39d007c640 1 -- start start 2023-11-27T20:41:31.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39d007c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 0x7f39c81edac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39d007c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39c8155490 0x7f39c80a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39d007c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39c814ee00 0x7f39c814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39d007c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c809a100 con 0x7f39c80c1500 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39d007c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c8099df0 con 0x7f39c8155490 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39d007c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c81ee000 con 0x7f39c814ee00 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39cde18640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 0x7f39c81edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39cde18640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 0x7f39c81edac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54190/0 (socket says 172.21.15.91:54190) 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39cde18640 1 -- 172.21.15.91:0/654696720 learned_addr learned my addr 172.21.15.91:0/654696720 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39cde18640 1 -- 172.21.15.91:0/654696720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39c814ee00 msgr2=0x7f39c814f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39cde18640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39c814ee00 0x7f39c814f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39cde18640 1 -- 172.21.15.91:0/654696720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39c8155490 msgr2=0x7f39c80a6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39cde18640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39c8155490 0x7f39c80a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.615+0000 7f39cde18640 1 -- 172.21.15.91:0/654696720 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0009400 con 0x7f39c80c1500 2023-11-27T20:41:31.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.616+0000 7f39cde18640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 0x7f39c81edac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00c7c0 tx=0x7f39bc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:31.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.616+0000 7f39c67fc640 1 -- 172.21.15.91:0/654696720 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00a640 con 0x7f39c80c1500 2023-11-27T20:41:31.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.616+0000 7f39c67fc640 1 -- 172.21.15.91:0/654696720 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc00a7c0 con 0x7f39c80c1500 2023-11-27T20:41:31.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.616+0000 7f39c67fc640 1 -- 172.21.15.91:0/654696720 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00ab70 con 0x7f39c80c1500 2023-11-27T20:41:31.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.616+0000 7f39d007c640 1 -- 172.21.15.91:0/654696720 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c80bf550 con 0x7f39c80c1500 2023-11-27T20:41:31.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.616+0000 7f39d007c640 1 -- 172.21.15.91:0/654696720 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c80bfb10 con 0x7f39c80c1500 2023-11-27T20:41:31.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.617+0000 7f39d007c640 1 -- 172.21.15.91:0/654696720 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c8068350 con 0x7f39c80c1500 2023-11-27T20:41:31.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.618+0000 7f39c67fc640 1 -- 172.21.15.91:0/654696720 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f39bc00acd0 con 0x7f39c80c1500 2023-11-27T20:41:31.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.619+0000 7f39c67fc640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39ac06b1c0 0x7f39ac06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:31.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.619+0000 7f39c67fc640 1 -- 172.21.15.91:0/654696720 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f39bc088d50 con 0x7f39c80c1500 2023-11-27T20:41:31.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.619+0000 7f39cd617640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39ac06b1c0 0x7f39ac06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:31.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.620+0000 7f39cd617640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39ac06b1c0 0x7f39ac06d680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39b4006fd0 tx=0x7f39b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:31.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.623+0000 7f39c67fc640 1 -- 172.21.15.91:0/654696720 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f39bc053d30 con 0x7f39c80c1500 2023-11-27T20:41:31.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.809+0000 7f39d007c640 1 -- 172.21.15.91:0/654696720 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39c80a89f0 con 0x7f39c80c1500 2023-11-27T20:41:31.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.810+0000 7f39c67fc640 1 -- 172.21.15.91:0/654696720 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39bc018070 con 0x7f39c80c1500 2023-11-27T20:41:31.811 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:41:31.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.812+0000 7f39d007c640 1 -- 172.21.15.91:0/654696720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39ac06b1c0 msgr2=0x7f39ac06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.812+0000 7f39d007c640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39ac06b1c0 0x7f39ac06d680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39b4006fd0 tx=0x7f39b4008040 comp rx=0 tx=0).stop 2023-11-27T20:41:31.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.812+0000 7f39d007c640 1 -- 172.21.15.91:0/654696720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 msgr2=0x7f39c81edac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:31.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.812+0000 7f39d007c640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 0x7f39c81edac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00c7c0 tx=0x7f39bc00cc80 comp rx=0 tx=0).stop 2023-11-27T20:41:31.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.813+0000 7f39d007c640 1 -- 172.21.15.91:0/654696720 shutdown_connections 2023-11-27T20:41:31.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.813+0000 7f39d007c640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39c814ee00 0x7f39c814f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.813+0000 7f39d007c640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39ac06b1c0 0x7f39ac06d680 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.813+0000 7f39d007c640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39c8155490 0x7f39c80a6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.813+0000 7f39d007c640 1 --2- 172.21.15.91:0/654696720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39c80c1500 0x7f39c81edac0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:31.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.813+0000 7f39d007c640 1 -- 172.21.15.91:0/654696720 >> 172.21.15.91:0/654696720 conn(0x7f39c806a500 msgr2=0x7f39c806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:31.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.813+0000 7f39d007c640 1 -- 172.21.15.91:0/654696720 shutdown_connections 2023-11-27T20:41:31.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:31.813+0000 7f39d007c640 1 -- 172.21.15.91:0/654696720 wait complete. 2023-11-27T20:41:31.833 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T20:41:32.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.036+0000 7f60248bb640 1 Processor -- start 2023-11-27T20:41:32.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.036+0000 7f60248bb640 1 -- start start 2023-11-27T20:41:32.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.037+0000 7f60248bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60200c0440 0x7f60200c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.037+0000 7f60248bb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6020072310 0x7f60200a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.037+0000 7f60248bb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6020071e80 con 0x7f602014c2e0 2023-11-27T20:41:32.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.037+0000 7f60248bb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6020071470 con 0x7f6020072310 2023-11-27T20:41:32.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.037+0000 7f60248bb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602014c6c0 con 0x7f60200c0440 2023-11-27T20:41:32.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.037+0000 7f601f7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f602014c2e0 0x7f6020152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42540/0 (socket says 172.21.15.91:42540) 2023-11-27T20:41:32.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.037+0000 7f601f7fe640 1 -- 172.21.15.91:0/1092619501 learned_addr learned my addr 172.21.15.91:0/1092619501 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:32.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f6016ffd640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60200c0440 0x7f60200c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:32.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601ffff640 1 --2- 172.21.15.91:0/1092619501 >> v2:172.21.15.183:3300/0 conn(0x7f6020072310 0x7f60200a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:32.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567454615 0 0) 0x7f6020071e80 con 0x7f602014c2e0 2023-11-27T20:41:32.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f600c003520 con 0x7f602014c2e0 2023-11-27T20:41:32.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3745627045 0 0) 0x7f600c003520 con 0x7f602014c2e0 2023-11-27T20:41:32.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60200c0440 msgr2=0x7f60200c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:32.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60200c0440 0x7f60200c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 >> v2:172.21.15.183:3300/0 conn(0x7f6020072310 msgr2=0x7f60200a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:32.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 --2- 172.21.15.91:0/1092619501 >> v2:172.21.15.183:3300/0 conn(0x7f6020072310 0x7f60200a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602006fdc0 con 0x7f602014c2e0 2023-11-27T20:41:32.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f6010001670 con 0x7f602014c2e0 2023-11-27T20:41:32.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 >> v1:172.21.15.91:6789/0 conn(0x7f602014c2e0 legacy=0x7f6020152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:32.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f600c003970 0x7f600c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f600c0047c0 0x7f600c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f600c005180 0x7f600c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602014c6c0 con 0x7f600c003970 2023-11-27T20:41:32.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c00bfa0 con 0x7f600c005180 2023-11-27T20:41:32.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c00c160 con 0x7f600c0047c0 2023-11-27T20:41:32.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.038+0000 7f6016ffd640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60200c0440 0x7f60200c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:32.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.039+0000 7f601f7fe640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f600c003970 0x7f600c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:32.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.039+0000 7f601f7fe640 1 -- 172.21.15.91:0/1092619501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f600c0047c0 msgr2=0x7f600c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:32.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.039+0000 7f601f7fe640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f600c0047c0 0x7f600c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.039+0000 7f601f7fe640 1 -- 172.21.15.91:0/1092619501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f600c005180 msgr2=0x7f600c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:32.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.039+0000 7f601f7fe640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f600c005180 0x7f600c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.039+0000 7f601f7fe640 1 -- 172.21.15.91:0/1092619501 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c003520 con 0x7f600c003970 2023-11-27T20:41:32.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.040+0000 7f601f7fe640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f600c003970 0x7f600c003d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f601000c210 tx=0x7f600c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c941ba56cf5fce5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:32.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.040+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601002cae0 con 0x7f600c003970 2023-11-27T20:41:32.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.040+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601002cc40 con 0x7f600c003970 2023-11-27T20:41:32.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.040+0000 7f601effd640 1 -- 172.21.15.91:0/1092619501 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60100058d0 con 0x7f600c003970 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.041+0000 7f60248bb640 1 -- 172.21.15.91:0/1092619501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f600c003970 msgr2=0x7f600c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.041+0000 7f60248bb640 1 --2- 172.21.15.91:0/1092619501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f600c003970 0x7f600c003d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f601000c210 tx=0x7f600c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.041+0000 7f601ffff640 1 -- 172.21.15.91:0/1092619501 reap_dead start 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.041+0000 7f60248bb640 1 -- 172.21.15.91:0/1092619501 shutdown_connections 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.041+0000 7f60248bb640 1 -- 172.21.15.91:0/1092619501 >> 172.21.15.91:0/1092619501 conn(0x7f60200a77f0 msgr2=0x7f60200a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.041+0000 7f60248bb640 1 -- 172.21.15.91:0/1092619501 shutdown_connections 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.041+0000 7f60248bb640 1 -- 172.21.15.91:0/1092619501 wait complete. 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.042+0000 7f60248bb640 1 Processor -- start 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.043+0000 7f60248bb640 1 -- start start 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.043+0000 7f60248bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f600c003970 0x7f60200bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.043+0000 7f60248bb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6020147370 0x7f60201460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.043+0000 7f60248bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6020146e20 0x7f6020146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.043+0000 7f60248bb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201eaed0 con 0x7f6020147370 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.043+0000 7f60248bb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200ab130 con 0x7f600c003970 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.043+0000 7f60248bb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200c3e40 con 0x7f6020146e20 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f6016ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6020147370 0x7f60201460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f6016ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6020147370 0x7f60201460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54200/0 (socket says 172.21.15.91:54200) 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f6016ffd640 1 -- 172.21.15.91:0/3245292161 learned_addr learned my addr 172.21.15.91:0/3245292161 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f6016ffd640 1 -- 172.21.15.91:0/3245292161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6020146e20 msgr2=0x7f6020146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f6016ffd640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6020146e20 0x7f6020146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f6016ffd640 1 -- 172.21.15.91:0/3245292161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f600c003970 msgr2=0x7f60200bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f6016ffd640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f600c003970 0x7f60200bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f6016ffd640 1 -- 172.21.15.91:0/3245292161 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60201ea250 con 0x7f6020147370 2023-11-27T20:41:32.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f6016ffd640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6020147370 0x7f60201460d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6008007e20 tx=0x7f600800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:32.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f601cff9640 1 -- 172.21.15.91:0/3245292161 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008003b90 con 0x7f6020147370 2023-11-27T20:41:32.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f601cff9640 1 -- 172.21.15.91:0/3245292161 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600800f040 con 0x7f6020147370 2023-11-27T20:41:32.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.044+0000 7f601cff9640 1 -- 172.21.15.91:0/3245292161 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600800de20 con 0x7f6020147370 2023-11-27T20:41:32.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.045+0000 7f60248bb640 1 -- 172.21.15.91:0/3245292161 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60201ea530 con 0x7f6020147370 2023-11-27T20:41:32.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.045+0000 7f60248bb640 1 -- 172.21.15.91:0/3245292161 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60201eaaf0 con 0x7f6020147370 2023-11-27T20:41:32.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.046+0000 7f60248bb640 1 -- 172.21.15.91:0/3245292161 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602004e840 con 0x7f6020147370 2023-11-27T20:41:32.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.047+0000 7f601cff9640 1 -- 172.21.15.91:0/3245292161 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6008004030 con 0x7f6020147370 2023-11-27T20:41:32.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.047+0000 7f601cff9640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600006b1f0 0x7f600006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.048+0000 7f601cff9640 1 -- 172.21.15.91:0/3245292161 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6008089960 con 0x7f6020147370 2023-11-27T20:41:32.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.048+0000 7f601f7fe640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600006b1f0 0x7f600006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:32.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.048+0000 7f601f7fe640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600006b1f0 0x7f600006d6b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6010034000 tx=0x7f601002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:32.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.052+0000 7f601cff9640 1 -- 172.21.15.91:0/3245292161 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f60080549d0 con 0x7f6020147370 2023-11-27T20:41:32.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.228+0000 7f60248bb640 1 -- 172.21.15.91:0/3245292161 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6020153390 con 0x7f6020147370 2023-11-27T20:41:32.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.229+0000 7f601cff9640 1 -- 172.21.15.91:0/3245292161 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f600801a090 con 0x7f6020147370 2023-11-27T20:41:32.230 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:32.230 INFO:teuthology.orchestra.run.smithi091.stdout:[ 2023-11-27T20:41:32.230 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:41:32.230 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 1, 2023-11-27T20:41:32.231 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": ".mgr" 2023-11-27T20:41:32.231 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:41:32.231 INFO:teuthology.orchestra.run.smithi091.stdout:] 2023-11-27T20:41:32.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 -- 172.21.15.91:0/3245292161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600006b1f0 msgr2=0x7f600006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:32.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600006b1f0 0x7f600006d6b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6010034000 tx=0x7f601002e000 comp rx=0 tx=0).stop 2023-11-27T20:41:32.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 -- 172.21.15.91:0/3245292161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6020147370 msgr2=0x7f60201460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:32.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6020147370 0x7f60201460d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6008007e20 tx=0x7f600800d4a0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 -- 172.21.15.91:0/3245292161 shutdown_connections 2023-11-27T20:41:32.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6020146e20 0x7f6020146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6020147370 0x7f60201460d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f600006b1f0 0x7f600006d6b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 --2- 172.21.15.91:0/3245292161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f600c003970 0x7f60200bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 -- 172.21.15.91:0/3245292161 >> 172.21.15.91:0/3245292161 conn(0x7f60200a77f0 msgr2=0x7f6020149670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:32.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 -- 172.21.15.91:0/3245292161 shutdown_connections 2023-11-27T20:41:32.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.231+0000 7f60248bb640 1 -- 172.21.15.91:0/3245292161 wait complete. 2023-11-27T20:41:32.250 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T20:41:32.251 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T20:41:32.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.445+0000 7f19e2fc5640 1 Processor -- start 2023-11-27T20:41:32.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.445+0000 7f19e2fc5640 1 -- start start 2023-11-27T20:41:32.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.447+0000 7f19e2fc5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc14fa80 0x7f19dc06d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.447+0000 7f19e2fc5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f19dc071f70 0x7f19dc0c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.447+0000 7f19e2fc5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc0c0980 con 0x7f19dc072530 2023-11-27T20:41:32.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.447+0000 7f19e2fc5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc06d160 con 0x7f19dc071f70 2023-11-27T20:41:32.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.447+0000 7f19e2fc5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc06c070 con 0x7f19dc14fa80 2023-11-27T20:41:32.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.447+0000 7f19e0d61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc14fa80 0x7f19dc06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:32.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.448+0000 7f19e0d61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc14fa80 0x7f19dc06d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:53322/0 (socket says 172.21.15.91:53322) 2023-11-27T20:41:32.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.448+0000 7f19e0d61640 1 -- 172.21.15.91:0/3197502819 learned_addr learned my addr 172.21.15.91:0/3197502819 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:32.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.448+0000 7f19e1562640 1 --2- 172.21.15.91:0/3197502819 >> v2:172.21.15.183:3300/0 conn(0x7f19dc071f70 0x7f19dc0c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:32.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.448+0000 7f19e0d61640 1 -- 172.21.15.91:0/3197502819 >> v2:172.21.15.183:3300/0 conn(0x7f19dc071f70 msgr2=0x7f19dc0c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:32.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.448+0000 7f19e0d61640 1 --2- 172.21.15.91:0/3197502819 >> v2:172.21.15.183:3300/0 conn(0x7f19dc071f70 0x7f19dc0c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.448+0000 7f19e0d61640 1 -- 172.21.15.91:0/3197502819 >> v1:172.21.15.183:6789/0 conn(0x7f19dc072530 legacy=0x7f19dc0c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:32.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.448+0000 7f19e0d61640 1 -- 172.21.15.91:0/3197502819 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc06dc70 con 0x7f19dc14fa80 2023-11-27T20:41:32.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.449+0000 7f19e0d61640 1 --2- 172.21.15.91:0/3197502819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc14fa80 0x7f19dc06d730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009870 tx=0x7f19d002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1382393ec6f01ee0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:32.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.450+0000 7f19db7fe640 1 -- 172.21.15.91:0/3197502819 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0031640 con 0x7f19dc14fa80 2023-11-27T20:41:32.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.450+0000 7f19db7fe640 1 -- 172.21.15.91:0/3197502819 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d00317a0 con 0x7f19dc14fa80 2023-11-27T20:41:32.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.450+0000 7f19db7fe640 1 -- 172.21.15.91:0/3197502819 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0031b30 con 0x7f19dc14fa80 2023-11-27T20:41:32.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.451+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3197502819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc14fa80 msgr2=0x7f19dc06d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:32.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.451+0000 7f19e2fc5640 1 --2- 172.21.15.91:0/3197502819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc14fa80 0x7f19dc06d730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009870 tx=0x7f19d002b8f0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.451+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3197502819 shutdown_connections 2023-11-27T20:41:32.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.451+0000 7f19e2fc5640 1 --2- 172.21.15.91:0/3197502819 >> v2:172.21.15.183:3300/0 conn(0x7f19dc071f70 0x7f19dc0c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.451+0000 7f19e2fc5640 1 --2- 172.21.15.91:0/3197502819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc14fa80 0x7f19dc06d730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.451+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3197502819 >> 172.21.15.91:0/3197502819 conn(0x7f19dc0c5bc0 msgr2=0x7f19dc0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:32.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.451+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3197502819 shutdown_connections 2023-11-27T20:41:32.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.451+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3197502819 wait complete. 2023-11-27T20:41:32.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.453+0000 7f19e2fc5640 1 Processor -- start 2023-11-27T20:41:32.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.454+0000 7f19e2fc5640 1 -- start start 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e2fc5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19dc071f70 0x7f19dc1482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e2fc5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc072530 0x7f19dc150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e2fc5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19dc14fa80 0x7f19dc1e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e2fc5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0a6930 con 0x7f19dc14fa80 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e2fc5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc1ea830 con 0x7f19dc071f70 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e2fc5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0a6b80 con 0x7f19dc072530 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e1562640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19dc14fa80 0x7f19dc1e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e1562640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19dc14fa80 0x7f19dc1e6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54202/0 (socket says 172.21.15.91:54202) 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e1562640 1 -- 172.21.15.91:0/3179961055 learned_addr learned my addr 172.21.15.91:0/3179961055 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19dbfff640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc072530 0x7f19dc150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e1562640 1 -- 172.21.15.91:0/3179961055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc072530 msgr2=0x7f19dc150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e1562640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc072530 0x7f19dc150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e1562640 1 -- 172.21.15.91:0/3179961055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19dc071f70 msgr2=0x7f19dc1482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e1562640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19dc071f70 0x7f19dc1482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19e1562640 1 -- 172.21.15.91:0/3179961055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d00094d0 con 0x7f19dc14fa80 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.455+0000 7f19dbfff640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc072530 0x7f19dc150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.456+0000 7f19e1562640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19dc14fa80 0x7f19dc1e6d50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19d4007e40 tx=0x7f19d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.456+0000 7f19d97fa640 1 -- 172.21.15.91:0/3179961055 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4014620 con 0x7f19dc14fa80 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.456+0000 7f19d97fa640 1 -- 172.21.15.91:0/3179961055 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d400ee90 con 0x7f19dc14fa80 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.456+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3179961055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc0a6e60 con 0x7f19dc14fa80 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.456+0000 7f19d97fa640 1 -- 172.21.15.91:0/3179961055 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d40149e0 con 0x7f19dc14fa80 2023-11-27T20:41:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.456+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3179961055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc148800 con 0x7f19dc14fa80 2023-11-27T20:41:32.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.457+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3179961055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc0a7380 con 0x7f19dc14fa80 2023-11-27T20:41:32.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.458+0000 7f19d97fa640 1 -- 172.21.15.91:0/3179961055 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f19d4014b40 con 0x7f19dc14fa80 2023-11-27T20:41:32.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.459+0000 7f19d97fa640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19c806b1c0 0x7f19c806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:32.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.459+0000 7f19d97fa640 1 -- 172.21.15.91:0/3179961055 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f19d408a090 con 0x7f19dc14fa80 2023-11-27T20:41:32.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.459+0000 7f19e0d61640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19c806b1c0 0x7f19c806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:32.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.460+0000 7f19e0d61640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19c806b1c0 0x7f19c806d680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19d0036000 tx=0x7f19d0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:32.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.463+0000 7f19d97fa640 1 -- 172.21.15.91:0/3179961055 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f19dc0a7380 con 0x7f19dc14fa80 2023-11-27T20:41:32.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:32.652+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3179961055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f19dc0a7380 con 0x7f19dc14fa80 2023-11-27T20:41:33.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.334+0000 7f19d97fa640 1 -- 172.21.15.91:0/3179961055 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f19dc0a7380 con 0x7f19dc14fa80 2023-11-27T20:41:33.336 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' created 2023-11-27T20:41:33.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3179961055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19c806b1c0 msgr2=0x7f19c806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:33.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19c806b1c0 0x7f19c806d680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19d0036000 tx=0x7f19d0030000 comp rx=0 tx=0).stop 2023-11-27T20:41:33.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3179961055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19dc14fa80 msgr2=0x7f19dc1e6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:33.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19dc14fa80 0x7f19dc1e6d50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19d4007e40 tx=0x7f19d400e4b0 comp rx=0 tx=0).stop 2023-11-27T20:41:33.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3179961055 shutdown_connections 2023-11-27T20:41:33.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19dc14fa80 0x7f19dc1e6d50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:33.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19dc072530 0x7f19dc150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:33.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19c806b1c0 0x7f19c806d680 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:33.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 --2- 172.21.15.91:0/3179961055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19dc071f70 0x7f19dc1482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:33.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3179961055 >> 172.21.15.91:0/3179961055 conn(0x7f19dc0c5bc0 msgr2=0x7f19dc0c1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:33.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3179961055 shutdown_connections 2023-11-27T20:41:33.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.338+0000 7f19e2fc5640 1 -- 172.21.15.91:0/3179961055 wait complete. 2023-11-27T20:41:33.365 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T20:41:33.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.563+0000 7fa935fbc640 1 Processor -- start 2023-11-27T20:41:33.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.563+0000 7fa935fbc640 1 -- start start 2023-11-27T20:41:33.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.565+0000 7fa935fbc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa930155260 0x7fa9300c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:33.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.565+0000 7fa935fbc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa9300c2ea0 0x7fa93006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:33.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.565+0000 7fa935fbc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa930157bb0 con 0x7fa93006aa40 2023-11-27T20:41:33.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.565+0000 7fa935fbc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9300c5d30 con 0x7fa930155260 2023-11-27T20:41:33.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.565+0000 7fa935fbc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa930158a10 con 0x7fa9300c2ea0 2023-11-27T20:41:33.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.565+0000 7fa934fba640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa930155260 0x7fa9300c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:33.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.565+0000 7fa934fba640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa930155260 0x7fa9300c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54212/0 (socket says 172.21.15.91:54212) 2023-11-27T20:41:33.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.565+0000 7fa934fba640 1 -- 172.21.15.91:0/3448345354 learned_addr learned my addr 172.21.15.91:0/3448345354 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:33.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.565+0000 7fa9357bb640 1 --1- 172.21.15.91:0/3448345354 >> v1:172.21.15.91:6789/0 conn(0x7fa93006aa40 0x7fa9300c4bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42550/0 (socket says 172.21.15.91:42550) 2023-11-27T20:41:33.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.566+0000 7fa934fba640 1 -- 172.21.15.91:0/3448345354 >> v2:172.21.15.183:3300/0 conn(0x7fa9300c2ea0 msgr2=0x7fa93006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:33.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.566+0000 7fa934fba640 1 --2- 172.21.15.91:0/3448345354 >> v2:172.21.15.183:3300/0 conn(0x7fa9300c2ea0 0x7fa93006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:33.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.566+0000 7fa934fba640 1 -- 172.21.15.91:0/3448345354 >> v1:172.21.15.91:6789/0 conn(0x7fa93006aa40 legacy=0x7fa9300c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:33.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.566+0000 7fa934fba640 1 -- 172.21.15.91:0/3448345354 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930157e00 con 0x7fa930155260 2023-11-27T20:41:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.567+0000 7fa934fba640 1 --2- 172.21.15.91:0/3448345354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa930155260 0x7fa9300c2640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9300c6a20 tx=0x7fa92c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af833f8e65790bea server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.567+0000 7fa9277fe640 1 -- 172.21.15.91:0/3448345354 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c02c9f0 con 0x7fa930155260 2023-11-27T20:41:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.567+0000 7fa9277fe640 1 -- 172.21.15.91:0/3448345354 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c02cb50 con 0x7fa930155260 2023-11-27T20:41:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.567+0000 7fa9277fe640 1 -- 172.21.15.91:0/3448345354 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0343f0 con 0x7fa930155260 2023-11-27T20:41:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.567+0000 7fa935fbc640 1 -- 172.21.15.91:0/3448345354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa930155260 msgr2=0x7fa9300c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:33.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.567+0000 7fa935fbc640 1 --2- 172.21.15.91:0/3448345354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa930155260 0x7fa9300c2640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9300c6a20 tx=0x7fa92c02be50 comp rx=0 tx=0).stop 2023-11-27T20:41:33.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.568+0000 7fa935fbc640 1 -- 172.21.15.91:0/3448345354 shutdown_connections 2023-11-27T20:41:33.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.568+0000 7fa935fbc640 1 --2- 172.21.15.91:0/3448345354 >> v2:172.21.15.183:3300/0 conn(0x7fa9300c2ea0 0x7fa93006a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:33.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.568+0000 7fa935fbc640 1 --2- 172.21.15.91:0/3448345354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa930155260 0x7fa9300c2640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:33.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.568+0000 7fa935fbc640 1 -- 172.21.15.91:0/3448345354 >> 172.21.15.91:0/3448345354 conn(0x7fa9300a8870 msgr2=0x7fa9300a8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:33.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.568+0000 7fa935fbc640 1 -- 172.21.15.91:0/3448345354 shutdown_connections 2023-11-27T20:41:33.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.568+0000 7fa935fbc640 1 -- 172.21.15.91:0/3448345354 wait complete. 2023-11-27T20:41:33.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.569+0000 7fa935fbc640 1 Processor -- start 2023-11-27T20:41:33.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.570+0000 7fa935fbc640 1 -- start start 2023-11-27T20:41:33.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.570+0000 7fa935fbc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa93006aa40 0x7fa93014de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:33.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.570+0000 7fa935fbc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9300c2ea0 0x7fa9300aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:33.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa935fbc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa930155260 0x7fa9300aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:33.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa935fbc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9300acb70 con 0x7fa9300c2ea0 2023-11-27T20:41:33.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa935fbc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9300ac4f0 con 0x7fa930155260 2023-11-27T20:41:33.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa935fbc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93006de90 con 0x7fa93006aa40 2023-11-27T20:41:33.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa927fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9300c2ea0 0x7fa9300aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:33.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa927fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9300c2ea0 0x7fa9300aa610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54218/0 (socket says 172.21.15.91:54218) 2023-11-27T20:41:33.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa927fff640 1 -- 172.21.15.91:0/486393506 learned_addr learned my addr 172.21.15.91:0/486393506 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:33.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa927fff640 1 -- 172.21.15.91:0/486393506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa93006aa40 msgr2=0x7fa93014de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:33.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa927fff640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa93006aa40 0x7fa93014de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:33.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa927fff640 1 -- 172.21.15.91:0/486393506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa930155260 msgr2=0x7fa9300aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:33.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa927fff640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa930155260 0x7fa9300aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:33.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa927fff640 1 -- 172.21.15.91:0/486393506 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c009b30 con 0x7fa9300c2ea0 2023-11-27T20:41:33.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.571+0000 7fa927fff640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9300c2ea0 0x7fa9300aa610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa92000b410 tx=0x7fa92000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:33.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.572+0000 7fa9257fa640 1 -- 172.21.15.91:0/486393506 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920011830 con 0x7fa9300c2ea0 2023-11-27T20:41:33.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.572+0000 7fa9257fa640 1 -- 172.21.15.91:0/486393506 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa920011990 con 0x7fa9300c2ea0 2023-11-27T20:41:33.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.572+0000 7fa9257fa640 1 -- 172.21.15.91:0/486393506 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920011d40 con 0x7fa9300c2ea0 2023-11-27T20:41:33.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.572+0000 7fa935fbc640 1 -- 172.21.15.91:0/486393506 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9300ac790 con 0x7fa9300c2ea0 2023-11-27T20:41:33.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.572+0000 7fa935fbc640 1 -- 172.21.15.91:0/486393506 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93014e390 con 0x7fa9300c2ea0 2023-11-27T20:41:33.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.573+0000 7fa935fbc640 1 -- 172.21.15.91:0/486393506 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9300accb0 con 0x7fa9300c2ea0 2023-11-27T20:41:33.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.574+0000 7fa9257fa640 1 -- 172.21.15.91:0/486393506 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa92001a400 con 0x7fa9300c2ea0 2023-11-27T20:41:33.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.575+0000 7fa9257fa640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa91c06b1c0 0x7fa91c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:33.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.575+0000 7fa9257fa640 1 -- 172.21.15.91:0/486393506 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa920089960 con 0x7fa9300c2ea0 2023-11-27T20:41:33.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.575+0000 7fa934fba640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa91c06b1c0 0x7fa91c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:33.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.576+0000 7fa934fba640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa91c06b1c0 0x7fa91c06d680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa92c035000 tx=0x7fa92c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:33.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.580+0000 7fa9257fa640 1 -- 172.21.15.91:0/486393506 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa9300accb0 con 0x7fa9300c2ea0 2023-11-27T20:41:33.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:33.769+0000 7fa935fbc640 1 -- 172.21.15.91:0/486393506 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa9300accb0 con 0x7fa9300c2ea0 2023-11-27T20:41:34.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.340+0000 7fa9257fa640 1 -- 172.21.15.91:0/486393506 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa9300accb0 con 0x7fa9300c2ea0 2023-11-27T20:41:34.342 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' created 2023-11-27T20:41:34.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 -- 172.21.15.91:0/486393506 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa91c06b1c0 msgr2=0x7fa91c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:34.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa91c06b1c0 0x7fa91c06d680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa92c035000 tx=0x7fa92c02e000 comp rx=0 tx=0).stop 2023-11-27T20:41:34.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 -- 172.21.15.91:0/486393506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9300c2ea0 msgr2=0x7fa9300aa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:34.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9300c2ea0 0x7fa9300aa610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa92000b410 tx=0x7fa92000b8d0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 -- 172.21.15.91:0/486393506 shutdown_connections 2023-11-27T20:41:34.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa91c06b1c0 0x7fa91c06d680 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa930155260 0x7fa9300aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9300c2ea0 0x7fa9300aa610 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 --2- 172.21.15.91:0/486393506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa93006aa40 0x7fa93014de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 -- 172.21.15.91:0/486393506 >> 172.21.15.91:0/486393506 conn(0x7fa9300a8870 msgr2=0x7fa9300c1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:34.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 -- 172.21.15.91:0/486393506 shutdown_connections 2023-11-27T20:41:34.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.344+0000 7fa935fbc640 1 -- 172.21.15.91:0/486393506 wait complete. 2023-11-27T20:41:34.376 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T20:41:34.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.564+0000 7f102692c640 1 Processor -- start 2023-11-27T20:41:34.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.564+0000 7f102692c640 1 -- start start 2023-11-27T20:41:34.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.565+0000 7f102692c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f10200c5ec0 0x7f10200c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:34.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.566+0000 7f102692c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10200c45d0 0x7f10200c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:34.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.566+0000 7f102692c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f10200721a0 0x7f1020155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:34.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.566+0000 7f102692c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102006e390 con 0x7f10200721a0 2023-11-27T20:41:34.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.566+0000 7f102692c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10200bfdc0 con 0x7f10200c5ec0 2023-11-27T20:41:34.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.566+0000 7f102692c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102006ddd0 con 0x7f10200c45d0 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.566+0000 7f1024ec9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f10200721a0 0x7f1020155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.566+0000 7f1024ec9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f10200721a0 0x7f1020155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51910/0 (socket says 172.21.15.91:51910) 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.566+0000 7f1024ec9640 1 -- 172.21.15.91:0/1901464337 learned_addr learned my addr 172.21.15.91:0/1901464337 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.566+0000 7f101ffff640 1 --2- 172.21.15.91:0/1901464337 >> v2:172.21.15.183:3300/0 conn(0x7f10200c5ec0 0x7f10200c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.566+0000 7f10177fe640 1 --2- 172.21.15.91:0/1901464337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10200c45d0 0x7f10200c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.567+0000 7f1024ec9640 1 -- 172.21.15.91:0/1901464337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10200c45d0 msgr2=0x7f10200c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.567+0000 7f1024ec9640 1 --2- 172.21.15.91:0/1901464337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10200c45d0 0x7f10200c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.567+0000 7f1024ec9640 1 -- 172.21.15.91:0/1901464337 >> v2:172.21.15.183:3300/0 conn(0x7f10200c5ec0 msgr2=0x7f10200c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.567+0000 7f1024ec9640 1 --2- 172.21.15.91:0/1901464337 >> v2:172.21.15.183:3300/0 conn(0x7f10200c5ec0 0x7f10200c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.567+0000 7f1024ec9640 1 -- 172.21.15.91:0/1901464337 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102006e0b0 con 0x7f10200721a0 2023-11-27T20:41:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.568+0000 7f1024ec9640 1 --2- 172.21.15.91:0/1901464337 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200721a0 0x7f1020155e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1018009870 tx=0x7f101802b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afac0a10d0e45d4d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.568+0000 7f101f7fe640 1 -- 172.21.15.91:0/1901464337 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018033620 con 0x7f10200721a0 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.568+0000 7f101f7fe640 1 -- 172.21.15.91:0/1901464337 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1018033780 con 0x7f10200721a0 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.568+0000 7f101f7fe640 1 -- 172.21.15.91:0/1901464337 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018033b10 con 0x7f10200721a0 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.569+0000 7f102692c640 1 -- 172.21.15.91:0/1901464337 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200721a0 msgr2=0x7f1020155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.569+0000 7f102692c640 1 --2- 172.21.15.91:0/1901464337 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200721a0 0x7f1020155e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1018009870 tx=0x7f101802b7d0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.569+0000 7f102692c640 1 -- 172.21.15.91:0/1901464337 shutdown_connections 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.569+0000 7f102692c640 1 --2- 172.21.15.91:0/1901464337 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200721a0 0x7f1020155e30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.569+0000 7f102692c640 1 --2- 172.21.15.91:0/1901464337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10200c45d0 0x7f10200c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.569+0000 7f102692c640 1 --2- 172.21.15.91:0/1901464337 >> v2:172.21.15.183:3300/0 conn(0x7f10200c5ec0 0x7f10200c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.569+0000 7f102692c640 1 -- 172.21.15.91:0/1901464337 >> 172.21.15.91:0/1901464337 conn(0x7f102006a500 msgr2=0x7f102006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.569+0000 7f102692c640 1 -- 172.21.15.91:0/1901464337 shutdown_connections 2023-11-27T20:41:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.569+0000 7f102692c640 1 -- 172.21.15.91:0/1901464337 wait complete. 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.571+0000 7f102692c640 1 Processor -- start 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.571+0000 7f102692c640 1 -- start start 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f102692c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10200721a0 0x7f10200a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f102692c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200c45d0 0x7f10201eb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f102692c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10200c5ec0 0x7f10201ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f102692c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10200a82f0 con 0x7f10200c45d0 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f102692c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1020155650 con 0x7f10200c5ec0 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f102692c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10201558a0 con 0x7f10200721a0 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f10177fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200c45d0 0x7f10201eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f10177fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200c45d0 0x7f10201eb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51924/0 (socket says 172.21.15.91:51924) 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f10177fe640 1 -- 172.21.15.91:0/907903971 learned_addr learned my addr 172.21.15.91:0/907903971 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:34.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f101ffff640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10200721a0 0x7f10200a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f1024ec9640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10200c5ec0 0x7f10201ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f10177fe640 1 -- 172.21.15.91:0/907903971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10200721a0 msgr2=0x7f10200a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f10177fe640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10200721a0 0x7f10200a7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f10177fe640 1 -- 172.21.15.91:0/907903971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10200c5ec0 msgr2=0x7f10201ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f10177fe640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10200c5ec0 0x7f10201ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f10177fe640 1 -- 172.21.15.91:0/907903971 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10180094d0 con 0x7f10200c45d0 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.572+0000 7f1024ec9640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10200c5ec0 0x7f10201ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.573+0000 7f10177fe640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200c45d0 0x7f10201eb060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f100800d800 tx=0x7f100800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.573+0000 7f101d7fa640 1 -- 172.21.15.91:0/907903971 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080096a0 con 0x7f10200c45d0 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.573+0000 7f101d7fa640 1 -- 172.21.15.91:0/907903971 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008009800 con 0x7f10200c45d0 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.573+0000 7f102692c640 1 -- 172.21.15.91:0/907903971 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1020155b80 con 0x7f10200c45d0 2023-11-27T20:41:34.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.573+0000 7f101d7fa640 1 -- 172.21.15.91:0/907903971 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008009b90 con 0x7f10200c45d0 2023-11-27T20:41:34.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.573+0000 7f102692c640 1 -- 172.21.15.91:0/907903971 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10200a75b0 con 0x7f10200c45d0 2023-11-27T20:41:34.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.574+0000 7f102692c640 1 -- 172.21.15.91:0/907903971 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1020068350 con 0x7f10200c45d0 2023-11-27T20:41:34.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.575+0000 7f101d7fa640 1 -- 172.21.15.91:0/907903971 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1008009cf0 con 0x7f10200c45d0 2023-11-27T20:41:34.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.576+0000 7f101d7fa640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f100006b1c0 0x7f100006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:34.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.576+0000 7f101d7fa640 1 -- 172.21.15.91:0/907903971 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f100808a180 con 0x7f10200c45d0 2023-11-27T20:41:34.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.577+0000 7f101ffff640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f100006b1c0 0x7f100006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:34.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.577+0000 7f101ffff640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f100006b1c0 0x7f100006d680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1010009e90 tx=0x7f101000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:34.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.581+0000 7f101d7fa640 1 -- 172.21.15.91:0/907903971 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1008054e70 con 0x7f10200c45d0 2023-11-27T20:41:34.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:34.812+0000 7f102692c640 1 -- 172.21.15.91:0/907903971 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f102006ada0 con 0x7f10200c45d0 2023-11-27T20:41:35.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.374+0000 7f101d7fa640 1 -- 172.21.15.91:0/907903971 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f100800b440 con 0x7f10200c45d0 2023-11-27T20:41:35.376 INFO:teuthology.orchestra.run.smithi091.stderr:new fs with metadata pool 2 and data pool 3 2023-11-27T20:41:35.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.378+0000 7f102692c640 1 -- 172.21.15.91:0/907903971 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f100006b1c0 msgr2=0x7f100006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:35.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.378+0000 7f102692c640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f100006b1c0 0x7f100006d680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1010009e90 tx=0x7f101000b040 comp rx=0 tx=0).stop 2023-11-27T20:41:35.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.378+0000 7f102692c640 1 -- 172.21.15.91:0/907903971 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200c45d0 msgr2=0x7f10201eb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:35.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.378+0000 7f102692c640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200c45d0 0x7f10201eb060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f100800d800 tx=0x7f100800dcc0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.379+0000 7f102692c640 1 -- 172.21.15.91:0/907903971 shutdown_connections 2023-11-27T20:41:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.379+0000 7f102692c640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f100006b1c0 0x7f100006d680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.379+0000 7f102692c640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10200c5ec0 0x7f10201ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.379+0000 7f102692c640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10200c45d0 0x7f10201eb060 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.379+0000 7f102692c640 1 --2- 172.21.15.91:0/907903971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10200721a0 0x7f10200a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.379+0000 7f102692c640 1 -- 172.21.15.91:0/907903971 >> 172.21.15.91:0/907903971 conn(0x7f102006a500 msgr2=0x7f10200c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:35.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.379+0000 7f102692c640 1 -- 172.21.15.91:0/907903971 shutdown_connections 2023-11-27T20:41:35.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.379+0000 7f102692c640 1 -- 172.21.15.91:0/907903971 wait complete. 2023-11-27T20:41:35.406 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:35.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.601+0000 7fc8b749f640 1 Processor -- start 2023-11-27T20:41:35.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.601+0000 7fc8b749f640 1 -- start start 2023-11-27T20:41:35.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b749f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc8b00ca8d0 0x7fc8b0154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:35.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b749f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b0158a60 con 0x7fc8b014e7c0 2023-11-27T20:41:35.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b749f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b00c4dd0 con 0x7fc8b00ca450 2023-11-27T20:41:35.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b749f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b00c5b10 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b6c9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc8b00ca8d0 0x7fc8b0154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:35.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b6c9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc8b00ca8d0 0x7fc8b0154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51936/0 (socket says 172.21.15.91:51936) 2023-11-27T20:41:35.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b6c9e640 1 -- 172.21.15.91:0/44940753 learned_addr learned my addr 172.21.15.91:0/44940753 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:35.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b6c9e640 1 -- 172.21.15.91:0/44940753 >> v1:172.21.15.183:6789/0 conn(0x7fc8b00ca450 legacy=0x7fc8b0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:35.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b6c9e640 1 -- 172.21.15.91:0/44940753 >> v1:172.21.15.91:6789/0 conn(0x7fc8b014e7c0 legacy=0x7fc8b00c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:35.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b549b640 1 -- 172.21.15.91:0/44940753 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683061261 0 0) 0x7fc8b0158a60 con 0x7fc8b014e7c0 2023-11-27T20:41:35.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.603+0000 7fc8b6c9e640 1 -- 172.21.15.91:0/44940753 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b0157ca0 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.604+0000 7fc8b6c9e640 1 --2- 172.21.15.91:0/44940753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 0x7fc8b0154c90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009e50 tx=0x7fc8a802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578d2212873cb140 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:35.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.605+0000 7fc8b549b640 1 -- 172.21.15.91:0/44940753 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a802c9f0 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.605+0000 7fc8b549b640 1 -- 172.21.15.91:0/44940753 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a802cb50 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.605+0000 7fc8b549b640 1 -- 172.21.15.91:0/44940753 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80343f0 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.605+0000 7fc8b749f640 1 -- 172.21.15.91:0/44940753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 msgr2=0x7fc8b0154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:35.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.605+0000 7fc8b749f640 1 --2- 172.21.15.91:0/44940753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 0x7fc8b0154c90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009e50 tx=0x7fc8a802be50 comp rx=0 tx=0).stop 2023-11-27T20:41:35.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.605+0000 7fc8b749f640 1 -- 172.21.15.91:0/44940753 shutdown_connections 2023-11-27T20:41:35.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.605+0000 7fc8b749f640 1 --2- 172.21.15.91:0/44940753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 0x7fc8b0154c90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.605+0000 7fc8b749f640 1 -- 172.21.15.91:0/44940753 >> 172.21.15.91:0/44940753 conn(0x7fc8b00abf00 msgr2=0x7fc8b00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:35.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.606+0000 7fc8b749f640 1 -- 172.21.15.91:0/44940753 shutdown_connections 2023-11-27T20:41:35.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.606+0000 7fc8b749f640 1 -- 172.21.15.91:0/44940753 wait complete. 2023-11-27T20:41:35.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.607+0000 7fc8b749f640 1 Processor -- start 2023-11-27T20:41:35.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.607+0000 7fc8b749f640 1 -- start start 2023-11-27T20:41:35.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.608+0000 7fc8b749f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b00ca450 0x7fc8b0156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:35.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.608+0000 7fc8b749f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 0x7fc8b0152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:35.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.608+0000 7fc8b749f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b014e7c0 0x7fc8b0152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:35.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.608+0000 7fc8b749f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b014da40 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.608+0000 7fc8b749f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b014ce30 con 0x7fc8b014e7c0 2023-11-27T20:41:35.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.608+0000 7fc8b749f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b014d110 con 0x7fc8b00ca450 2023-11-27T20:41:35.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.608+0000 7fc8b5c9c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 0x7fc8b0152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:35.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.608+0000 7fc8b5c9c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 0x7fc8b0152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51950/0 (socket says 172.21.15.91:51950) 2023-11-27T20:41:35.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.608+0000 7fc8b5c9c640 1 -- 172.21.15.91:0/1227883689 learned_addr learned my addr 172.21.15.91:0/1227883689 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:35.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8b6c9e640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b014e7c0 0x7fc8b0152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:35.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8b649d640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b00ca450 0x7fc8b0156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:35.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8b5c9c640 1 -- 172.21.15.91:0/1227883689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b00ca450 msgr2=0x7fc8b0156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:35.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8b5c9c640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b00ca450 0x7fc8b0156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8b5c9c640 1 -- 172.21.15.91:0/1227883689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b014e7c0 msgr2=0x7fc8b0152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:35.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8b5c9c640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b014e7c0 0x7fc8b0152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8b5c9c640 1 -- 172.21.15.91:0/1227883689 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a8009b30 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8b6c9e640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b014e7c0 0x7fc8b0152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:35.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8b5c9c640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 0x7fc8b0152020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000b3f0 tx=0x7fc8a000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:35.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8a6ffd640 1 -- 172.21.15.91:0/1227883689 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0011830 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8a6ffd640 1 -- 172.21.15.91:0/1227883689 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a0011990 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8a6ffd640 1 -- 172.21.15.91:0/1227883689 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0011d40 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.609+0000 7fc8b749f640 1 -- 172.21.15.91:0/1227883689 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b014d3f0 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.610+0000 7fc8b749f640 1 -- 172.21.15.91:0/1227883689 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b01572b0 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.611+0000 7fc8b749f640 1 -- 172.21.15.91:0/1227883689 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b014dbb0 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.612+0000 7fc8a6ffd640 1 -- 172.21.15.91:0/1227883689 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc8a001a400 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.612+0000 7fc8a6ffd640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc89406b1f0 0x7fc89406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:35.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.612+0000 7fc8a6ffd640 1 -- 172.21.15.91:0/1227883689 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8a00897a0 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.613+0000 7fc8b649d640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc89406b1f0 0x7fc89406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:35.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.613+0000 7fc8b649d640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc89406b1f0 0x7fc89406d6b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac000f60 tx=0x7fc8ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:35.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.617+0000 7fc8a6ffd640 1 -- 172.21.15.91:0/1227883689 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc8a0054560 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.806+0000 7fc8b749f640 1 -- 172.21.15.91:0/1227883689 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8b004e840 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.808+0000 7fc8a6ffd640 1 -- 172.21.15.91:0/1227883689 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16483 (secure 0 0 0) 0x7fc8a0057b80 con 0x7fc8b00ca8d0 2023-11-27T20:41:35.810 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:35.810 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":19,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:34.814594+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:35.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.810+0000 7fc8b749f640 1 -- 172.21.15.91:0/1227883689 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc89406b1f0 msgr2=0x7fc89406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:35.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.810+0000 7fc8b749f640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc89406b1f0 0x7fc89406d6b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac000f60 tx=0x7fc8ac009040 comp rx=0 tx=0).stop 2023-11-27T20:41:35.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.810+0000 7fc8b749f640 1 -- 172.21.15.91:0/1227883689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 msgr2=0x7fc8b0152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:35.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.810+0000 7fc8b749f640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 0x7fc8b0152020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000b3f0 tx=0x7fc8a000b8b0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.811+0000 7fc8b749f640 1 -- 172.21.15.91:0/1227883689 shutdown_connections 2023-11-27T20:41:35.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.811+0000 7fc8b749f640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc89406b1f0 0x7fc89406d6b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.811+0000 7fc8b749f640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b014e7c0 0x7fc8b0152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.811+0000 7fc8b749f640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8b00ca8d0 0x7fc8b0152020 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.811+0000 7fc8b749f640 1 --2- 172.21.15.91:0/1227883689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b00ca450 0x7fc8b0156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:35.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.811+0000 7fc8b749f640 1 -- 172.21.15.91:0/1227883689 >> 172.21.15.91:0/1227883689 conn(0x7fc8b00abf00 msgr2=0x7fc8b0154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:35.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.811+0000 7fc8b749f640 1 -- 172.21.15.91:0/1227883689 shutdown_connections 2023-11-27T20:41:35.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:35.811+0000 7fc8b749f640 1 -- 172.21.15.91:0/1227883689 wait complete. 2023-11-27T20:41:35.832 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:36.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.045+0000 7f1e16d05640 1 Processor -- start 2023-11-27T20:41:36.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.045+0000 7f1e16d05640 1 -- start start 2023-11-27T20:41:36.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.046+0000 7f1e16d05640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1e1014fd30 0x7f1e10152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e16d05640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1e1006d0a0 0x7f1e100a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e16d05640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 0x7f1e100c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e16d05640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e100c64a0 con 0x7f1e1014fd30 2023-11-27T20:41:36.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e16d05640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e100c5c00 con 0x7f1e1006d0a0 2023-11-27T20:41:36.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e16d05640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100c5ee0 con 0x7f1e100a5260 2023-11-27T20:41:36.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e14aa1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1e1014fd30 0x7f1e10152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:36.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e14aa1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1e1014fd30 0x7f1e10152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51964/0 (socket says 172.21.15.91:51964) 2023-11-27T20:41:36.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e14aa1640 1 -- 172.21.15.91:0/4081497023 learned_addr learned my addr 172.21.15.91:0/4081497023 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:36.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e152a2640 1 --2- 172.21.15.91:0/4081497023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 0x7f1e100c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:36.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e0ffff640 1 --2- 172.21.15.91:0/4081497023 >> v2:172.21.15.183:3300/0 conn(0x7f1e1006d0a0 0x7f1e100a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:36.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e14aa1640 1 -- 172.21.15.91:0/4081497023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 msgr2=0x7f1e100c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:36.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e14aa1640 1 --2- 172.21.15.91:0/4081497023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 0x7f1e100c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e14aa1640 1 -- 172.21.15.91:0/4081497023 >> v2:172.21.15.183:3300/0 conn(0x7f1e1006d0a0 msgr2=0x7f1e100a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:36.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e14aa1640 1 --2- 172.21.15.91:0/4081497023 >> v2:172.21.15.183:3300/0 conn(0x7f1e1006d0a0 0x7f1e100a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e14aa1640 1 -- 172.21.15.91:0/4081497023 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e100c61c0 con 0x7f1e1014fd30 2023-11-27T20:41:36.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.047+0000 7f1e152a2640 1 --2- 172.21.15.91:0/4081497023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 0x7f1e100c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:36.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.049+0000 7f1e14aa1640 1 --2- 172.21.15.91:0/4081497023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 0x7f1e10152f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e1006b460 tx=0x7f1e0402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f85d71919c4a90c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:36.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.049+0000 7f1e0f7fe640 1 -- 172.21.15.91:0/4081497023 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04031870 con 0x7f1e1014fd30 2023-11-27T20:41:36.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.049+0000 7f1e0f7fe640 1 -- 172.21.15.91:0/4081497023 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e040319d0 con 0x7f1e1014fd30 2023-11-27T20:41:36.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.049+0000 7f1e0f7fe640 1 -- 172.21.15.91:0/4081497023 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04031d60 con 0x7f1e1014fd30 2023-11-27T20:41:36.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.049+0000 7f1e16d05640 1 -- 172.21.15.91:0/4081497023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 msgr2=0x7f1e10152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:36.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.049+0000 7f1e16d05640 1 --2- 172.21.15.91:0/4081497023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 0x7f1e10152f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e1006b460 tx=0x7f1e0402b910 comp rx=0 tx=0).stop 2023-11-27T20:41:36.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.050+0000 7f1e16d05640 1 -- 172.21.15.91:0/4081497023 shutdown_connections 2023-11-27T20:41:36.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.050+0000 7f1e16d05640 1 --2- 172.21.15.91:0/4081497023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 0x7f1e100c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.050+0000 7f1e16d05640 1 --2- 172.21.15.91:0/4081497023 >> v2:172.21.15.183:3300/0 conn(0x7f1e1006d0a0 0x7f1e100a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.050+0000 7f1e16d05640 1 --2- 172.21.15.91:0/4081497023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 0x7f1e10152f20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.050+0000 7f1e16d05640 1 -- 172.21.15.91:0/4081497023 >> 172.21.15.91:0/4081497023 conn(0x7f1e1006a500 msgr2=0x7f1e1006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:36.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.050+0000 7f1e16d05640 1 -- 172.21.15.91:0/4081497023 shutdown_connections 2023-11-27T20:41:36.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.050+0000 7f1e16d05640 1 -- 172.21.15.91:0/4081497023 wait complete. 2023-11-27T20:41:36.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.051+0000 7f1e16d05640 1 Processor -- start 2023-11-27T20:41:36.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.051+0000 7f1e16d05640 1 -- start start 2023-11-27T20:41:36.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.052+0000 7f1e16d05640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e1006d0a0 0x7f1e101ee460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.052+0000 7f1e16d05640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 0x7f1e100a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.052+0000 7f1e16d05640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 0x7f1e101eaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.052+0000 7f1e16d05640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10151d90 con 0x7f1e1014fd30 2023-11-27T20:41:36.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.052+0000 7f1e16d05640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e101525a0 con 0x7f1e1006d0a0 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.052+0000 7f1e16d05640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10151fe0 con 0x7f1e100a5260 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.052+0000 7f1e152a2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 0x7f1e101eaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.053+0000 7f1e152a2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 0x7f1e101eaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51968/0 (socket says 172.21.15.91:51968) 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.053+0000 7f1e152a2640 1 -- 172.21.15.91:0/170859511 learned_addr learned my addr 172.21.15.91:0/170859511 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.053+0000 7f1e14aa1640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e1006d0a0 0x7f1e101ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.053+0000 7f1e0ffff640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 0x7f1e100a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.053+0000 7f1e152a2640 1 -- 172.21.15.91:0/170859511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 msgr2=0x7f1e100a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.053+0000 7f1e152a2640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 0x7f1e100a5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.053+0000 7f1e152a2640 1 -- 172.21.15.91:0/170859511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e1006d0a0 msgr2=0x7f1e101ee460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.053+0000 7f1e152a2640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e1006d0a0 0x7f1e101ee460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.053+0000 7f1e152a2640 1 -- 172.21.15.91:0/170859511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040094d0 con 0x7f1e1014fd30 2023-11-27T20:41:36.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.053+0000 7f1e152a2640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 0x7f1e101eaba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800cef0 tx=0x7f1e0800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:36.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.054+0000 7f1e0d7fa640 1 -- 172.21.15.91:0/170859511 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800d840 con 0x7f1e1014fd30 2023-11-27T20:41:36.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.054+0000 7f1e0d7fa640 1 -- 172.21.15.91:0/170859511 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0800d9c0 con 0x7f1e1014fd30 2023-11-27T20:41:36.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.054+0000 7f1e16d05640 1 -- 172.21.15.91:0/170859511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e101522c0 con 0x7f1e1014fd30 2023-11-27T20:41:36.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.054+0000 7f1e0d7fa640 1 -- 172.21.15.91:0/170859511 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800dd70 con 0x7f1e1014fd30 2023-11-27T20:41:36.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.054+0000 7f1e16d05640 1 -- 172.21.15.91:0/170859511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e100a6330 con 0x7f1e1014fd30 2023-11-27T20:41:36.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.055+0000 7f1e16d05640 1 -- 172.21.15.91:0/170859511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e101ea4e0 con 0x7f1e1014fd30 2023-11-27T20:41:36.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.056+0000 7f1e0d7fa640 1 -- 172.21.15.91:0/170859511 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1e0801e3b0 con 0x7f1e1014fd30 2023-11-27T20:41:36.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.057+0000 7f1e0d7fa640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1dfc06b1f0 0x7f1dfc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.057+0000 7f1e0d7fa640 1 -- 172.21.15.91:0/170859511 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e0808a430 con 0x7f1e1014fd30 2023-11-27T20:41:36.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.057+0000 7f1e14aa1640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1dfc06b1f0 0x7f1dfc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:36.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.058+0000 7f1e14aa1640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1dfc06b1f0 0x7f1dfc06d6b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1e04036000 tx=0x7f1e0403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:36.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.061+0000 7f1e0d7fa640 1 -- 172.21.15.91:0/170859511 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1e101ea4e0 con 0x7f1e1014fd30 2023-11-27T20:41:36.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.253+0000 7f1e16d05640 1 -- 172.21.15.91:0/170859511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e101ea8c0 con 0x7f1e1014fd30 2023-11-27T20:41:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.256+0000 7f1e0d7fa640 1 -- 172.21.15.91:0/170859511 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f1e101ea8c0 con 0x7f1e1014fd30 2023-11-27T20:41:36.258 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:36.258 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:36.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 -- 172.21.15.91:0/170859511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1dfc06b1f0 msgr2=0x7f1dfc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:36.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1dfc06b1f0 0x7f1dfc06d6b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1e04036000 tx=0x7f1e0403c040 comp rx=0 tx=0).stop 2023-11-27T20:41:36.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 -- 172.21.15.91:0/170859511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 msgr2=0x7f1e101eaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:36.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 0x7f1e101eaba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800cef0 tx=0x7f1e0800a710 comp rx=0 tx=0).stop 2023-11-27T20:41:36.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 -- 172.21.15.91:0/170859511 shutdown_connections 2023-11-27T20:41:36.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1e1014fd30 0x7f1e101eaba0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e100a5260 0x7f1e100a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1dfc06b1f0 0x7f1dfc06d6b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 --2- 172.21.15.91:0/170859511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e1006d0a0 0x7f1e101ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 -- 172.21.15.91:0/170859511 >> 172.21.15.91:0/170859511 conn(0x7f1e1006a500 msgr2=0x7f1e100a9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:36.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 -- 172.21.15.91:0/170859511 shutdown_connections 2023-11-27T20:41:36.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.259+0000 7f1e16d05640 1 -- 172.21.15.91:0/170859511 wait complete. 2023-11-27T20:41:36.280 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T20:41:36.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.498+0000 7f1647a4f640 1 Processor -- start 2023-11-27T20:41:36.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.498+0000 7f1647a4f640 1 -- start start 2023-11-27T20:41:36.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.499+0000 7f1647a4f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f16400c3340 0x7f1640156540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.499+0000 7f1647a4f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16400bfdc0 con 0x7f16400c45d0 2023-11-27T20:41:36.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.499+0000 7f1647a4f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1640156a80 con 0x7f16400c5ec0 2023-11-27T20:41:36.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.499+0000 7f1647a4f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164006e390 con 0x7f16400c3340 2023-11-27T20:41:36.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.499+0000 7f1645fec640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f16400c3340 0x7f1640156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:36.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.500+0000 7f1645fec640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f16400c3340 0x7f1640156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51970/0 (socket says 172.21.15.91:51970) 2023-11-27T20:41:36.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.500+0000 7f1645fec640 1 -- 172.21.15.91:0/155766535 learned_addr learned my addr 172.21.15.91:0/155766535 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:36.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.500+0000 7f1644fea640 1 --1- 172.21.15.91:0/155766535 >> v1:172.21.15.91:6789/0 conn(0x7f16400c45d0 0x7f1640155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56038/0 (socket says 172.21.15.91:56038) 2023-11-27T20:41:36.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.500+0000 7f1645fec640 1 -- 172.21.15.91:0/155766535 >> v1:172.21.15.183:6789/0 conn(0x7f16400c5ec0 legacy=0x7f16400c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:36.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.500+0000 7f1645fec640 1 -- 172.21.15.91:0/155766535 >> v1:172.21.15.91:6789/0 conn(0x7f16400c45d0 legacy=0x7f1640155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:36.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.500+0000 7f1645fec640 1 -- 172.21.15.91:0/155766535 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164006ddd0 con 0x7f16400c3340 2023-11-27T20:41:36.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.501+0000 7f1645fec640 1 --2- 172.21.15.91:0/155766535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c3340 0x7f1640156540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1638009e80 tx=0x7f163802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165e1c599fb656f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:36.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.501+0000 7f1637fff640 1 -- 172.21.15.91:0/155766535 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163802c9e0 con 0x7f16400c3340 2023-11-27T20:41:36.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.501+0000 7f1637fff640 1 -- 172.21.15.91:0/155766535 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163802cb40 con 0x7f16400c3340 2023-11-27T20:41:36.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.501+0000 7f1637fff640 1 -- 172.21.15.91:0/155766535 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380343f0 con 0x7f16400c3340 2023-11-27T20:41:36.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.502+0000 7f1647a4f640 1 -- 172.21.15.91:0/155766535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c3340 msgr2=0x7f1640156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:36.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.502+0000 7f1647a4f640 1 --2- 172.21.15.91:0/155766535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c3340 0x7f1640156540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1638009e80 tx=0x7f163802be40 comp rx=0 tx=0).stop 2023-11-27T20:41:36.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.502+0000 7f1647a4f640 1 -- 172.21.15.91:0/155766535 shutdown_connections 2023-11-27T20:41:36.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.502+0000 7f1647a4f640 1 --2- 172.21.15.91:0/155766535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c3340 0x7f1640156540 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.502+0000 7f1647a4f640 1 -- 172.21.15.91:0/155766535 >> 172.21.15.91:0/155766535 conn(0x7f164006a500 msgr2=0x7f164006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:36.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.502+0000 7f1647a4f640 1 -- 172.21.15.91:0/155766535 shutdown_connections 2023-11-27T20:41:36.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.502+0000 7f1647a4f640 1 -- 172.21.15.91:0/155766535 wait complete. 2023-11-27T20:41:36.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.504+0000 7f1647a4f640 1 Processor -- start 2023-11-27T20:41:36.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.504+0000 7f1647a4f640 1 -- start start 2023-11-27T20:41:36.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1647a4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16400c3340 0x7f16400a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1647a4f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16400c45d0 0x7f16400a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1647a4f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c5ec0 0x7f16400a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1647a4f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400a5ae0 con 0x7f16400c5ec0 2023-11-27T20:41:36.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1647a4f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400a8220 con 0x7f16400c45d0 2023-11-27T20:41:36.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1647a4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164014ee70 con 0x7f16400c3340 2023-11-27T20:41:36.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1645fec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c5ec0 0x7f16400a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:36.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1645fec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c5ec0 0x7f16400a9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51978/0 (socket says 172.21.15.91:51978) 2023-11-27T20:41:36.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1645fec640 1 -- 172.21.15.91:0/140512055 learned_addr learned my addr 172.21.15.91:0/140512055 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:36.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1645fec640 1 -- 172.21.15.91:0/140512055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16400c3340 msgr2=0x7f16400a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:36.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1645fec640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16400c3340 0x7f16400a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1645fec640 1 -- 172.21.15.91:0/140512055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16400c45d0 msgr2=0x7f16400a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:36.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1645fec640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16400c45d0 0x7f16400a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:36.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.505+0000 7f1645fec640 1 -- 172.21.15.91:0/140512055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638009b30 con 0x7f16400c5ec0 2023-11-27T20:41:36.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.506+0000 7f1645fec640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c5ec0 0x7f16400a9c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1638036040 tx=0x7f1638004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:36.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.506+0000 7f1635ffb640 1 -- 172.21.15.91:0/140512055 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163803e450 con 0x7f16400c5ec0 2023-11-27T20:41:36.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.506+0000 7f1635ffb640 1 -- 172.21.15.91:0/140512055 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163803e5d0 con 0x7f16400c5ec0 2023-11-27T20:41:36.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.506+0000 7f1635ffb640 1 -- 172.21.15.91:0/140512055 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163803e980 con 0x7f16400c5ec0 2023-11-27T20:41:36.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.506+0000 7f1647a4f640 1 -- 172.21.15.91:0/140512055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16400a7360 con 0x7f16400c5ec0 2023-11-27T20:41:36.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.506+0000 7f1647a4f640 1 -- 172.21.15.91:0/140512055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16400a8470 con 0x7f16400c5ec0 2023-11-27T20:41:36.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.507+0000 7f1647a4f640 1 -- 172.21.15.91:0/140512055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16400a5c20 con 0x7f16400c5ec0 2023-11-27T20:41:36.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.508+0000 7f1635ffb640 1 -- 172.21.15.91:0/140512055 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f163803eae0 con 0x7f16400c5ec0 2023-11-27T20:41:36.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.509+0000 7f1635ffb640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f162406b1c0 0x7f162406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:36.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.509+0000 7f1635ffb640 1 -- 172.21.15.91:0/140512055 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16380ac900 con 0x7f16400c5ec0 2023-11-27T20:41:36.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.509+0000 7f16457eb640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f162406b1c0 0x7f162406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:36.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.510+0000 7f16457eb640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f162406b1c0 0x7f162406d680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f163c006fd0 tx=0x7f163c006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:36.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.513+0000 7f1635ffb640 1 -- 172.21.15.91:0/140512055 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f16400a5c20 con 0x7f16400c5ec0 2023-11-27T20:41:36.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:36.740+0000 7f1647a4f640 1 -- 172.21.15.91:0/140512055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f16400a5c20 con 0x7f16400c5ec0 2023-11-27T20:41:37.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.392+0000 7f1635ffb640 1 -- 172.21.15.91:0/140512055 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f16400a5c20 con 0x7f16400c5ec0 2023-11-27T20:41:37.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.396+0000 7f1647a4f640 1 -- 172.21.15.91:0/140512055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f162406b1c0 msgr2=0x7f162406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:37.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.396+0000 7f1647a4f640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f162406b1c0 0x7f162406d680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f163c006fd0 tx=0x7f163c006bc0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.396+0000 7f1647a4f640 1 -- 172.21.15.91:0/140512055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c5ec0 msgr2=0x7f16400a9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:37.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.396+0000 7f1647a4f640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c5ec0 0x7f16400a9c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1638036040 tx=0x7f1638004a40 comp rx=0 tx=0).stop 2023-11-27T20:41:37.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.397+0000 7f1647a4f640 1 -- 172.21.15.91:0/140512055 shutdown_connections 2023-11-27T20:41:37.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.397+0000 7f1647a4f640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16400c5ec0 0x7f16400a9c60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.397+0000 7f1647a4f640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f162406b1c0 0x7f162406d680 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.397+0000 7f1647a4f640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16400c45d0 0x7f16400a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.397+0000 7f1647a4f640 1 --2- 172.21.15.91:0/140512055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16400c3340 0x7f16400a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.397+0000 7f1647a4f640 1 -- 172.21.15.91:0/140512055 >> 172.21.15.91:0/140512055 conn(0x7f164006a500 msgr2=0x7f164006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:37.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.397+0000 7f1647a4f640 1 -- 172.21.15.91:0/140512055 shutdown_connections 2023-11-27T20:41:37.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.397+0000 7f1647a4f640 1 -- 172.21.15.91:0/140512055 wait complete. 2023-11-27T20:41:37.418 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T20:41:37.419 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T20:41:37.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.637+0000 7fa9b75d0640 1 Processor -- start 2023-11-27T20:41:37.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.637+0000 7fa9b75d0640 1 -- start start 2023-11-27T20:41:37.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.638+0000 7fa9b75d0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa9b006d0a0 0x7fa9b0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:37.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.638+0000 7fa9b75d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b00c3ea0 0x7fa9b00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:37.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.638+0000 7fa9b75d0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b00c64a0 con 0x7fa9b014fd30 2023-11-27T20:41:37.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.638+0000 7fa9b75d0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b00c5c00 con 0x7fa9b006d0a0 2023-11-27T20:41:37.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.638+0000 7fa9b75d0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b00c5ee0 con 0x7fa9b00c3ea0 2023-11-27T20:41:37.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.639+0000 7fa9b536c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa9b014fd30 0x7fa9b00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56044/0 (socket says 172.21.15.91:56044) 2023-11-27T20:41:37.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.639+0000 7fa9b536c640 1 -- 172.21.15.91:0/1730320893 learned_addr learned my addr 172.21.15.91:0/1730320893 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:37.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.639+0000 7fa9b4b6b640 1 --2- 172.21.15.91:0/1730320893 >> v2:172.21.15.91:3300/0 conn(0x7fa9b006d0a0 0x7fa9b0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:37.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.639+0000 7fa9b5b6d640 1 --2- 172.21.15.91:0/1730320893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b00c3ea0 0x7fa9b00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:37.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.639+0000 7fa9a7fff640 1 -- 172.21.15.91:0/1730320893 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516023426 0 0) 0x7fa9b00c64a0 con 0x7fa9b014fd30 2023-11-27T20:41:37.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.639+0000 7fa9b4b6b640 1 -- 172.21.15.91:0/1730320893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b00c3ea0 msgr2=0x7fa9b00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:37.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.639+0000 7fa9b4b6b640 1 --2- 172.21.15.91:0/1730320893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b00c3ea0 0x7fa9b00c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.639+0000 7fa9b4b6b640 1 -- 172.21.15.91:0/1730320893 >> v1:172.21.15.91:6789/0 conn(0x7fa9b014fd30 legacy=0x7fa9b00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:37.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.639+0000 7fa9b4b6b640 1 -- 172.21.15.91:0/1730320893 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b00c61c0 con 0x7fa9b006d0a0 2023-11-27T20:41:37.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.640+0000 7fa9b4b6b640 1 --2- 172.21.15.91:0/1730320893 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b006d0a0 0x7fa9b0152f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00097a0 tx=0x7fa9a002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f566fb7aa29901d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:37.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.640+0000 7fa9a7fff640 1 -- 172.21.15.91:0/1730320893 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a002d040 con 0x7fa9b006d0a0 2023-11-27T20:41:37.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.640+0000 7fa9a7fff640 1 -- 172.21.15.91:0/1730320893 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a0031810 con 0x7fa9b006d0a0 2023-11-27T20:41:37.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.641+0000 7fa9a7fff640 1 -- 172.21.15.91:0/1730320893 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0031ba0 con 0x7fa9b006d0a0 2023-11-27T20:41:37.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.641+0000 7fa9b75d0640 1 -- 172.21.15.91:0/1730320893 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b006d0a0 msgr2=0x7fa9b0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:37.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.641+0000 7fa9b75d0640 1 --2- 172.21.15.91:0/1730320893 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b006d0a0 0x7fa9b0152f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00097a0 tx=0x7fa9a002b8b0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.641+0000 7fa9b75d0640 1 -- 172.21.15.91:0/1730320893 shutdown_connections 2023-11-27T20:41:37.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.641+0000 7fa9b75d0640 1 --2- 172.21.15.91:0/1730320893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b00c3ea0 0x7fa9b00c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.641+0000 7fa9b75d0640 1 --2- 172.21.15.91:0/1730320893 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b006d0a0 0x7fa9b0152f20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.641+0000 7fa9b75d0640 1 -- 172.21.15.91:0/1730320893 >> 172.21.15.91:0/1730320893 conn(0x7fa9b006a500 msgr2=0x7fa9b006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:37.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.641+0000 7fa9b75d0640 1 -- 172.21.15.91:0/1730320893 shutdown_connections 2023-11-27T20:41:37.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.641+0000 7fa9b75d0640 1 -- 172.21.15.91:0/1730320893 wait complete. 2023-11-27T20:41:37.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.643+0000 7fa9b75d0640 1 Processor -- start 2023-11-27T20:41:37.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.643+0000 7fa9b75d0640 1 -- start start 2023-11-27T20:41:37.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.644+0000 7fa9b75d0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b006d0a0 0x7fa9b00aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:37.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.644+0000 7fa9b75d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b00c3ea0 0x7fa9b01ea7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:37.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.644+0000 7fa9b75d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b014fd30 0x7fa9b01eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:37.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.644+0000 7fa9b75d0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b01de5a0 con 0x7fa9b014fd30 2023-11-27T20:41:37.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.644+0000 7fa9b75d0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b01dc2a0 con 0x7fa9b006d0a0 2023-11-27T20:41:37.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.644+0000 7fa9b75d0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b01de820 con 0x7fa9b00c3ea0 2023-11-27T20:41:37.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.644+0000 7fa9b5b6d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b014fd30 0x7fa9b01eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:37.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.644+0000 7fa9b5b6d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b014fd30 0x7fa9b01eacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52002/0 (socket says 172.21.15.91:52002) 2023-11-27T20:41:37.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.644+0000 7fa9b5b6d640 1 -- 172.21.15.91:0/3412881197 learned_addr learned my addr 172.21.15.91:0/3412881197 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:37.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9b536c640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b006d0a0 0x7fa9b00aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:37.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9b5b6d640 1 -- 172.21.15.91:0/3412881197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b00c3ea0 msgr2=0x7fa9b01ea7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:37.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9b4b6b640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b00c3ea0 0x7fa9b01ea7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:37.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9b5b6d640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b00c3ea0 0x7fa9b01ea7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9b5b6d640 1 -- 172.21.15.91:0/3412881197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b006d0a0 msgr2=0x7fa9b00aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:37.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9b5b6d640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b006d0a0 0x7fa9b00aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:37.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9b5b6d640 1 -- 172.21.15.91:0/3412881197 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0009400 con 0x7fa9b014fd30 2023-11-27T20:41:37.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9b536c640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b006d0a0 0x7fa9b00aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:37.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9b5b6d640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b014fd30 0x7fa9b01eacf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800cd70 tx=0x7fa9a800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:37.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9a5ffb640 1 -- 172.21.15.91:0/3412881197 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8003b90 con 0x7fa9b014fd30 2023-11-27T20:41:37.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9a5ffb640 1 -- 172.21.15.91:0/3412881197 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a8003cf0 con 0x7fa9b014fd30 2023-11-27T20:41:37.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9b75d0640 1 -- 172.21.15.91:0/3412881197 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b01dbce0 con 0x7fa9b014fd30 2023-11-27T20:41:37.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.645+0000 7fa9a5ffb640 1 -- 172.21.15.91:0/3412881197 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8004240 con 0x7fa9b014fd30 2023-11-27T20:41:37.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.646+0000 7fa9b75d0640 1 -- 172.21.15.91:0/3412881197 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b01ea290 con 0x7fa9b014fd30 2023-11-27T20:41:37.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.647+0000 7fa9b75d0640 1 -- 172.21.15.91:0/3412881197 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b0068350 con 0x7fa9b014fd30 2023-11-27T20:41:37.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.648+0000 7fa9a5ffb640 1 -- 172.21.15.91:0/3412881197 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa9a80043a0 con 0x7fa9b014fd30 2023-11-27T20:41:37.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.649+0000 7fa9a5ffb640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa99406b1c0 0x7fa99406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:37.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.649+0000 7fa9a5ffb640 1 -- 172.21.15.91:0/3412881197 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9a8012070 con 0x7fa9b014fd30 2023-11-27T20:41:37.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.649+0000 7fa9b536c640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa99406b1c0 0x7fa99406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:37.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.650+0000 7fa9b536c640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa99406b1c0 0x7fa99406d680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000f60 tx=0x7fa9ac007c30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:37.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.653+0000 7fa9a5ffb640 1 -- 172.21.15.91:0/3412881197 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa9a8055180 con 0x7fa9b014fd30 2023-11-27T20:41:37.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:37.880+0000 7fa9b75d0640 1 -- 172.21.15.91:0/3412881197 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa9b01ea480 con 0x7fa9b014fd30 2023-11-27T20:41:38.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.395+0000 7fa9a5ffb640 1 -- 172.21.15.91:0/3412881197 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa9a80587a0 con 0x7fa9b014fd30 2023-11-27T20:41:38.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.399+0000 7fa9b75d0640 1 -- 172.21.15.91:0/3412881197 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa99406b1c0 msgr2=0x7fa99406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:38.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.399+0000 7fa9b75d0640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa99406b1c0 0x7fa99406d680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000f60 tx=0x7fa9ac007c30 comp rx=0 tx=0).stop 2023-11-27T20:41:38.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.399+0000 7fa9b75d0640 1 -- 172.21.15.91:0/3412881197 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b014fd30 msgr2=0x7fa9b01eacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:38.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.399+0000 7fa9b75d0640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b014fd30 0x7fa9b01eacf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800cd70 tx=0x7fa9a800a660 comp rx=0 tx=0).stop 2023-11-27T20:41:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.400+0000 7fa9b75d0640 1 -- 172.21.15.91:0/3412881197 shutdown_connections 2023-11-27T20:41:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.400+0000 7fa9b75d0640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa9b014fd30 0x7fa9b01eacf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.400+0000 7fa9b75d0640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b00c3ea0 0x7fa9b01ea7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.400+0000 7fa9b75d0640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa99406b1c0 0x7fa99406d680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.400+0000 7fa9b75d0640 1 --2- 172.21.15.91:0/3412881197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b006d0a0 0x7fa9b00aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.400+0000 7fa9b75d0640 1 -- 172.21.15.91:0/3412881197 >> 172.21.15.91:0/3412881197 conn(0x7fa9b006a500 msgr2=0x7fa9b00c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.400+0000 7fa9b75d0640 1 -- 172.21.15.91:0/3412881197 shutdown_connections 2023-11-27T20:41:38.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.400+0000 7fa9b75d0640 1 -- 172.21.15.91:0/3412881197 wait complete. 2023-11-27T20:41:38.421 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T20:41:38.422 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:41:38.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.633+0000 7fe6492d0640 1 Processor -- start 2023-11-27T20:41:38.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.633+0000 7fe6492d0640 1 -- start start 2023-11-27T20:41:38.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.634+0000 7fe6492d0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe64414fd30 0x7fe644152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:38.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.634+0000 7fe6492d0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe64406d0a0 0x7fe6440a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.634+0000 7fe6492d0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6440c64a0 con 0x7fe6440a5260 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.634+0000 7fe6492d0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6440c5c00 con 0x7fe64414fd30 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.634+0000 7fe6492d0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6440c5ee0 con 0x7fe64406d0a0 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.635+0000 7fe642ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe64414fd30 0x7fe644152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.635+0000 7fe642ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe64414fd30 0x7fe644152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52014/0 (socket says 172.21.15.91:52014) 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.635+0000 7fe642ffd640 1 -- 172.21.15.91:0/531309932 learned_addr learned my addr 172.21.15.91:0/531309932 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.635+0000 7fe6427fc640 1 --2- 172.21.15.91:0/531309932 >> v2:172.21.15.183:3300/0 conn(0x7fe64406d0a0 0x7fe6440a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.635+0000 7fe642ffd640 1 -- 172.21.15.91:0/531309932 >> v2:172.21.15.183:3300/0 conn(0x7fe64406d0a0 msgr2=0x7fe6440a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.635+0000 7fe642ffd640 1 --2- 172.21.15.91:0/531309932 >> v2:172.21.15.183:3300/0 conn(0x7fe64406d0a0 0x7fe6440a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.635+0000 7fe642ffd640 1 -- 172.21.15.91:0/531309932 >> v1:172.21.15.183:6789/0 conn(0x7fe6440a5260 legacy=0x7fe6440c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.635+0000 7fe642ffd640 1 -- 172.21.15.91:0/531309932 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6440c61c0 con 0x7fe64414fd30 2023-11-27T20:41:38.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.635+0000 7fe6427fc640 1 --2- 172.21.15.91:0/531309932 >> v2:172.21.15.183:3300/0 conn(0x7fe64406d0a0 0x7fe6440a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:38.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.636+0000 7fe642ffd640 1 --2- 172.21.15.91:0/531309932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64414fd30 0x7fe644152f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe64406b460 tx=0x7fe63402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584f83b3b7628f37 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:38.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.636+0000 7fe641ffb640 1 -- 172.21.15.91:0/531309932 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63402ca80 con 0x7fe64414fd30 2023-11-27T20:41:38.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.637+0000 7fe641ffb640 1 -- 172.21.15.91:0/531309932 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63402cbe0 con 0x7fe64414fd30 2023-11-27T20:41:38.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.637+0000 7fe641ffb640 1 -- 172.21.15.91:0/531309932 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340343f0 con 0x7fe64414fd30 2023-11-27T20:41:38.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.637+0000 7fe6492d0640 1 -- 172.21.15.91:0/531309932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64414fd30 msgr2=0x7fe644152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:38.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.637+0000 7fe6492d0640 1 --2- 172.21.15.91:0/531309932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64414fd30 0x7fe644152f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe64406b460 tx=0x7fe63402bee0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.637+0000 7fe6492d0640 1 -- 172.21.15.91:0/531309932 shutdown_connections 2023-11-27T20:41:38.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.637+0000 7fe6492d0640 1 --2- 172.21.15.91:0/531309932 >> v2:172.21.15.183:3300/0 conn(0x7fe64406d0a0 0x7fe6440a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.637+0000 7fe6492d0640 1 --2- 172.21.15.91:0/531309932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64414fd30 0x7fe644152f20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.637+0000 7fe6492d0640 1 -- 172.21.15.91:0/531309932 >> 172.21.15.91:0/531309932 conn(0x7fe64406a500 msgr2=0x7fe64406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:38.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.637+0000 7fe6492d0640 1 -- 172.21.15.91:0/531309932 shutdown_connections 2023-11-27T20:41:38.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.637+0000 7fe6492d0640 1 -- 172.21.15.91:0/531309932 wait complete. 2023-11-27T20:41:38.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.639+0000 7fe6492d0640 1 Processor -- start 2023-11-27T20:41:38.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.639+0000 7fe6492d0640 1 -- start start 2023-11-27T20:41:38.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe6492d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64406d0a0 0x7fe644155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:38.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe6492d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6440a5260 0x7fe6441561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:38.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe6492d0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe64414fd30 0x7fe6441ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:38.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe6492d0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440aa800 con 0x7fe64406d0a0 2023-11-27T20:41:38.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe6492d0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6441dc350 con 0x7fe64414fd30 2023-11-27T20:41:38.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe6492d0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6441dbbb0 con 0x7fe6440a5260 2023-11-27T20:41:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe642ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64406d0a0 0x7fe644155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe642ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64406d0a0 0x7fe644155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52030/0 (socket says 172.21.15.91:52030) 2023-11-27T20:41:38.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe642ffd640 1 -- 172.21.15.91:0/3909814527 learned_addr learned my addr 172.21.15.91:0/3909814527 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe642ffd640 1 -- 172.21.15.91:0/3909814527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6440a5260 msgr2=0x7fe6441561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe642ffd640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6440a5260 0x7fe6441561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe642ffd640 1 -- 172.21.15.91:0/3909814527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe64414fd30 msgr2=0x7fe6441ea300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe642ffd640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe64414fd30 0x7fe6441ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.640+0000 7fe642ffd640 1 -- 172.21.15.91:0/3909814527 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe634009b30 con 0x7fe64406d0a0 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.641+0000 7fe642ffd640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64406d0a0 0x7fe644155ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe634036040 tx=0x7fe634004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.641+0000 7fe63b7fe640 1 -- 172.21.15.91:0/3909814527 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63403e450 con 0x7fe64406d0a0 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.641+0000 7fe63b7fe640 1 -- 172.21.15.91:0/3909814527 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63403e5f0 con 0x7fe64406d0a0 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.641+0000 7fe63b7fe640 1 -- 172.21.15.91:0/3909814527 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63403e9a0 con 0x7fe64406d0a0 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.641+0000 7fe6492d0640 1 -- 172.21.15.91:0/3909814527 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6441ee5d0 con 0x7fe64406d0a0 2023-11-27T20:41:38.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.641+0000 7fe6492d0640 1 -- 172.21.15.91:0/3909814527 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6440aacf0 con 0x7fe64406d0a0 2023-11-27T20:41:38.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.642+0000 7fe6492d0640 1 -- 172.21.15.91:0/3909814527 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6441dc4c0 con 0x7fe64406d0a0 2023-11-27T20:41:38.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.643+0000 7fe63b7fe640 1 -- 172.21.15.91:0/3909814527 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe63402cd50 con 0x7fe64406d0a0 2023-11-27T20:41:38.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.644+0000 7fe63b7fe640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe62406b1c0 0x7fe62406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:38.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.644+0000 7fe63b7fe640 1 -- 172.21.15.91:0/3909814527 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6340ac620 con 0x7fe64406d0a0 2023-11-27T20:41:38.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.644+0000 7fe6427fc640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe62406b1c0 0x7fe62406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:38.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.645+0000 7fe6427fc640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe62406b1c0 0x7fe62406d680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe62c006fd0 tx=0x7fe62c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:38.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.648+0000 7fe63b7fe640 1 -- 172.21.15.91:0/3909814527 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe6441dc4c0 con 0x7fe64406d0a0 2023-11-27T20:41:38.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.876+0000 7fe6492d0640 1 -- 172.21.15.91:0/3909814527 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6441dc4c0 con 0x7fe64406d0a0 2023-11-27T20:41:38.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.876+0000 7fe63b7fe640 1 -- 172.21.15.91:0/3909814527 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fe6441dc4c0 con 0x7fe64406d0a0 2023-11-27T20:41:38.878 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:38.879 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/636329462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":636329462},{"type":"v1","addr":"172.21.15.91:6836","nonce":636329462}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/433109070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":433109070},{"type":"v1","addr":"172.21.15.91:6837","nonce":433109070}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1419226381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1419226381},{"type":"v1","addr":"172.21.15.183:6835","nonce":1419226381}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:41:34.815589+0000","modified":"2023-11-27T20:41:37.881858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/4022772138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4022772138},{"type":"v1","addr":"172.21.15.183:6834","nonce":4022772138}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:41:38.879 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 8 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 -- 172.21.15.91:0/3909814527 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe62406b1c0 msgr2=0x7fe62406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe62406b1c0 0x7fe62406d680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe62c006fd0 tx=0x7fe62c008040 comp rx=0 tx=0).stop 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 -- 172.21.15.91:0/3909814527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64406d0a0 msgr2=0x7fe644155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64406d0a0 0x7fe644155ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe634036040 tx=0x7fe634004a40 comp rx=0 tx=0).stop 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 -- 172.21.15.91:0/3909814527 shutdown_connections 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe62406b1c0 0x7fe62406d680 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe64414fd30 0x7fe6441ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6440a5260 0x7fe6441561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 --2- 172.21.15.91:0/3909814527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe64406d0a0 0x7fe644155ca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 -- 172.21.15.91:0/3909814527 >> 172.21.15.91:0/3909814527 conn(0x7fe64406a500 msgr2=0x7fe6440c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:38.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 -- 172.21.15.91:0/3909814527 shutdown_connections 2023-11-27T20:41:38.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:38.879+0000 7fe6492d0640 1 -- 172.21.15.91:0/3909814527 wait complete. 2023-11-27T20:41:38.898 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:39.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.103+0000 7f1d9e6d7640 1 Processor -- start 2023-11-27T20:41:39.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.104+0000 7f1d9e6d7640 1 -- start start 2023-11-27T20:41:39.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.105+0000 7f1d9e6d7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1d980c1ca0 0x7f1d980c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.105+0000 7f1d9e6d7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9806d580 con 0x7f1d98071e30 2023-11-27T20:41:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.105+0000 7f1d9e6d7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d980726d0 con 0x7f1d98155fc0 2023-11-27T20:41:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.105+0000 7f1d9e6d7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9806dd60 con 0x7f1d980c1ca0 2023-11-27T20:41:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.105+0000 7f1d8f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1d980c1ca0 0x7f1d980c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.105+0000 7f1d9cc74640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f1d98071e30 0x7f1d98163370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56052/0 (socket says 172.21.15.91:56052) 2023-11-27T20:41:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.105+0000 7f1d9cc74640 1 -- 172.21.15.91:0/1919612107 learned_addr learned my addr 172.21.15.91:0/1919612107 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.105+0000 7f1d8f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1d980c1ca0 0x7f1d980c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52038/0 (socket says 172.21.15.91:52038) 2023-11-27T20:41:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.106+0000 7f1d8f7fe640 1 -- 172.21.15.91:0/1919612107 >> v1:172.21.15.183:6789/0 conn(0x7f1d98155fc0 legacy=0x7f1d98159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.106+0000 7f1d977fe640 1 -- 172.21.15.91:0/1919612107 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623298005 0 0) 0x7f1d9806d580 con 0x7f1d98071e30 2023-11-27T20:41:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.106+0000 7f1d8f7fe640 1 -- 172.21.15.91:0/1919612107 >> v1:172.21.15.91:6789/0 conn(0x7f1d98071e30 legacy=0x7f1d98163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.106+0000 7f1d8f7fe640 1 -- 172.21.15.91:0/1919612107 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9806da80 con 0x7f1d980c1ca0 2023-11-27T20:41:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.107+0000 7f1d8f7fe640 1 --2- 172.21.15.91:0/1919612107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d980c1ca0 0x7f1d980c2750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1d800097a0 tx=0x7f1d8002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d4dab965757560 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.107+0000 7f1d977fe640 1 -- 172.21.15.91:0/1919612107 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8002e070 con 0x7f1d980c1ca0 2023-11-27T20:41:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.107+0000 7f1d977fe640 1 -- 172.21.15.91:0/1919612107 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d800315a0 con 0x7f1d980c1ca0 2023-11-27T20:41:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.107+0000 7f1d977fe640 1 -- 172.21.15.91:0/1919612107 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80031930 con 0x7f1d980c1ca0 2023-11-27T20:41:39.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.108+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/1919612107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d980c1ca0 msgr2=0x7f1d980c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.108+0000 7f1d9e6d7640 1 --2- 172.21.15.91:0/1919612107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d980c1ca0 0x7f1d980c2750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1d800097a0 tx=0x7f1d8002b840 comp rx=0 tx=0).stop 2023-11-27T20:41:39.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.108+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/1919612107 shutdown_connections 2023-11-27T20:41:39.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.108+0000 7f1d9e6d7640 1 --2- 172.21.15.91:0/1919612107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d980c1ca0 0x7f1d980c2750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.108+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/1919612107 >> 172.21.15.91:0/1919612107 conn(0x7f1d9806a500 msgr2=0x7f1d9806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:39.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.108+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/1919612107 shutdown_connections 2023-11-27T20:41:39.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.108+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/1919612107 wait complete. 2023-11-27T20:41:39.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.110+0000 7f1d9e6d7640 1 Processor -- start 2023-11-27T20:41:39.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.110+0000 7f1d9e6d7640 1 -- start start 2023-11-27T20:41:39.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d9e6d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d98071e30 0x7f1d9815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d9e6d7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d980c1ca0 0x7f1d981ef4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d9e6d7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d98155fc0 0x7f1d980a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d9e6d7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9815bd80 con 0x7f1d98071e30 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d9e6d7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98159eb0 con 0x7f1d980c1ca0 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d9e6d7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d981596e0 con 0x7f1d98155fc0 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d97fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d98071e30 0x7f1d9815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d97fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d98071e30 0x7f1d9815b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52042/0 (socket says 172.21.15.91:52042) 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d97fff640 1 -- 172.21.15.91:0/2240187044 learned_addr learned my addr 172.21.15.91:0/2240187044 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d9cc74640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d98155fc0 0x7f1d980a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d97fff640 1 -- 172.21.15.91:0/2240187044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d98155fc0 msgr2=0x7f1d980a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d8f7fe640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d980c1ca0 0x7f1d981ef4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d97fff640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d98155fc0 0x7f1d980a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d97fff640 1 -- 172.21.15.91:0/2240187044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d980c1ca0 msgr2=0x7f1d981ef4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d97fff640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d980c1ca0 0x7f1d981ef4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d97fff640 1 -- 172.21.15.91:0/2240187044 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80009400 con 0x7f1d98071e30 2023-11-27T20:41:39.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.111+0000 7f1d8f7fe640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d980c1ca0 0x7f1d981ef4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:39.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.112+0000 7f1d97fff640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d98071e30 0x7f1d9815b840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800c730 tx=0x7f1d8800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:39.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.112+0000 7f1d957fa640 1 -- 172.21.15.91:0/2240187044 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88003b70 con 0x7f1d98071e30 2023-11-27T20:41:39.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.112+0000 7f1d957fa640 1 -- 172.21.15.91:0/2240187044 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88003cf0 con 0x7f1d98071e30 2023-11-27T20:41:39.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.112+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/2240187044 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9815ad10 con 0x7f1d98071e30 2023-11-27T20:41:39.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.112+0000 7f1d957fa640 1 -- 172.21.15.91:0/2240187044 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8800aa90 con 0x7f1d98071e30 2023-11-27T20:41:39.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.112+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/2240187044 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d98159330 con 0x7f1d98071e30 2023-11-27T20:41:39.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.113+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/2240187044 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9815ab70 con 0x7f1d98071e30 2023-11-27T20:41:39.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.114+0000 7f1d957fa640 1 -- 172.21.15.91:0/2240187044 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1d8800abf0 con 0x7f1d98071e30 2023-11-27T20:41:39.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.115+0000 7f1d957fa640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1d7806b1c0 0x7f1d7806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.115+0000 7f1d957fa640 1 -- 172.21.15.91:0/2240187044 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d880897c0 con 0x7f1d98071e30 2023-11-27T20:41:39.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.115+0000 7f1d8f7fe640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1d7806b1c0 0x7f1d7806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.116+0000 7f1d8f7fe640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1d7806b1c0 0x7f1d7806d680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d80036000 tx=0x7f1d8003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:39.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.120+0000 7f1d957fa640 1 -- 172.21.15.91:0/2240187044 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1d9815ab70 con 0x7f1d98071e30 2023-11-27T20:41:39.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.309+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/2240187044 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d9815ab70 con 0x7f1d98071e30 2023-11-27T20:41:39.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.311+0000 7f1d957fa640 1 -- 172.21.15.91:0/2240187044 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f1d9815ab70 con 0x7f1d98071e30 2023-11-27T20:41:39.313 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:39.313 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:39.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.313+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/2240187044 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1d7806b1c0 msgr2=0x7f1d7806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.313+0000 7f1d9e6d7640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1d7806b1c0 0x7f1d7806d680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d80036000 tx=0x7f1d8003d040 comp rx=0 tx=0).stop 2023-11-27T20:41:39.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.313+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/2240187044 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d98071e30 msgr2=0x7f1d9815b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.313+0000 7f1d9e6d7640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d98071e30 0x7f1d9815b840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800c730 tx=0x7f1d8800cbf0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.313+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/2240187044 shutdown_connections 2023-11-27T20:41:39.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.313+0000 7f1d9e6d7640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d98155fc0 0x7f1d980a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.313+0000 7f1d9e6d7640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1d7806b1c0 0x7f1d7806d680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.313+0000 7f1d9e6d7640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d980c1ca0 0x7f1d981ef4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.314+0000 7f1d9e6d7640 1 --2- 172.21.15.91:0/2240187044 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d98071e30 0x7f1d9815b840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.314+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/2240187044 >> 172.21.15.91:0/2240187044 conn(0x7f1d9806a500 msgr2=0x7f1d9806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:39.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.314+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/2240187044 shutdown_connections 2023-11-27T20:41:39.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.314+0000 7f1d9e6d7640 1 -- 172.21.15.91:0/2240187044 wait complete. 2023-11-27T20:41:39.333 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T20:41:39.334 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:41:39.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.547+0000 7f80569b5640 1 Processor -- start 2023-11-27T20:41:39.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.547+0000 7f80569b5640 1 -- start start 2023-11-27T20:41:39.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.549+0000 7f80569b5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f805006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.549+0000 7f80569b5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f805006cd20 0x7f805015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.549+0000 7f80569b5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80500a8380 con 0x7f805014e7f0 2023-11-27T20:41:39.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.549+0000 7f80569b5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80501510b0 con 0x7f805006cd20 2023-11-27T20:41:39.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.549+0000 7f80569b5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805006bf60 con 0x7f80500c52e0 2023-11-27T20:41:39.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.549+0000 7f80551b2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f805006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.549+0000 7f80551b2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f805006d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:58956/0 (socket says 172.21.15.91:58956) 2023-11-27T20:41:39.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.549+0000 7f80551b2640 1 -- 172.21.15.91:0/3173020363 learned_addr learned my addr 172.21.15.91:0/3173020363 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:39.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.549+0000 7f80561b4640 1 --2- 172.21.15.91:0/3173020363 >> v2:172.21.15.183:3300/0 conn(0x7f805006cd20 0x7f805015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.550+0000 7f80551b2640 1 -- 172.21.15.91:0/3173020363 >> v2:172.21.15.183:3300/0 conn(0x7f805006cd20 msgr2=0x7f805015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:39.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.550+0000 7f80551b2640 1 --2- 172.21.15.91:0/3173020363 >> v2:172.21.15.183:3300/0 conn(0x7f805006cd20 0x7f805015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.550+0000 7f80551b2640 1 -- 172.21.15.91:0/3173020363 >> v1:172.21.15.183:6789/0 conn(0x7f805014e7f0 legacy=0x7f80500c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.551+0000 7f80551b2640 1 -- 172.21.15.91:0/3173020363 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805006c240 con 0x7f80500c52e0 2023-11-27T20:41:39.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.551+0000 7f80549b1640 1 -- 172.21.15.91:0/3173020363 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153697829 0 0) 0x7f80500a8380 con 0x7f805014e7f0 2023-11-27T20:41:39.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.551+0000 7f80561b4640 1 --2- 172.21.15.91:0/3173020363 >> v2:172.21.15.183:3300/0 conn(0x7f805006cd20 0x7f805015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:39.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.552+0000 7f80551b2640 1 --2- 172.21.15.91:0/3173020363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f805006d1e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f804000bb10 tx=0x7f804002e0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f4ad69ab77576af server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:39.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.552+0000 7f80549b1640 1 -- 172.21.15.91:0/3173020363 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804002ee70 con 0x7f80500c52e0 2023-11-27T20:41:39.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.552+0000 7f80549b1640 1 -- 172.21.15.91:0/3173020363 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8040036440 con 0x7f80500c52e0 2023-11-27T20:41:39.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.552+0000 7f80549b1640 1 -- 172.21.15.91:0/3173020363 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80400367d0 con 0x7f80500c52e0 2023-11-27T20:41:39.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.553+0000 7f80569b5640 1 -- 172.21.15.91:0/3173020363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 msgr2=0x7f805006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.553+0000 7f80569b5640 1 --2- 172.21.15.91:0/3173020363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f805006d1e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f804000bb10 tx=0x7f804002e0c0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.553+0000 7f80569b5640 1 -- 172.21.15.91:0/3173020363 shutdown_connections 2023-11-27T20:41:39.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.553+0000 7f80569b5640 1 --2- 172.21.15.91:0/3173020363 >> v2:172.21.15.183:3300/0 conn(0x7f805006cd20 0x7f805015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.553+0000 7f80569b5640 1 --2- 172.21.15.91:0/3173020363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f805006d1e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.553+0000 7f80569b5640 1 -- 172.21.15.91:0/3173020363 >> 172.21.15.91:0/3173020363 conn(0x7f80500a77f0 msgr2=0x7f80500a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:39.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.553+0000 7f80569b5640 1 -- 172.21.15.91:0/3173020363 shutdown_connections 2023-11-27T20:41:39.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.553+0000 7f80569b5640 1 -- 172.21.15.91:0/3173020363 wait complete. 2023-11-27T20:41:39.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.555+0000 7f80569b5640 1 Processor -- start 2023-11-27T20:41:39.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.555+0000 7f80569b5640 1 -- start start 2023-11-27T20:41:39.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.556+0000 7f80569b5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f805006cd20 0x7f805014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.556+0000 7f80569b5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f80501ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.556+0000 7f80569b5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f805014e7f0 0x7f805014cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.556+0000 7f80569b5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8050150ec0 con 0x7f805006cd20 2023-11-27T20:41:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.556+0000 7f80569b5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805014ba70 con 0x7f805014e7f0 2023-11-27T20:41:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.556+0000 7f80569b5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80501eddb0 con 0x7f80500c52e0 2023-11-27T20:41:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.556+0000 7f80559b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f805006cd20 0x7f805014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.556+0000 7f80559b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f805006cd20 0x7f805014ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52050/0 (socket says 172.21.15.91:52050) 2023-11-27T20:41:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.556+0000 7f80559b3640 1 -- 172.21.15.91:0/965866524 learned_addr learned my addr 172.21.15.91:0/965866524 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:39.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80561b4640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f805014e7f0 0x7f805014cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80551b2640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f80501ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80559b3640 1 -- 172.21.15.91:0/965866524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 msgr2=0x7f80501ed4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80559b3640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f80501ed4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80559b3640 1 -- 172.21.15.91:0/965866524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f805014e7f0 msgr2=0x7f805014cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80559b3640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f805014e7f0 0x7f805014cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80559b3640 1 -- 172.21.15.91:0/965866524 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8048009a70 con 0x7f805006cd20 2023-11-27T20:41:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80551b2640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f80501ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80559b3640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f805006cd20 0x7f805014ef20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c410 tx=0x7f804c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80467fc640 1 -- 172.21.15.91:0/965866524 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c0035f0 con 0x7f805006cd20 2023-11-27T20:41:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80467fc640 1 -- 172.21.15.91:0/965866524 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c003770 con 0x7f805006cd20 2023-11-27T20:41:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80569b5640 1 -- 172.21.15.91:0/965866524 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804000b770 con 0x7f805006cd20 2023-11-27T20:41:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.557+0000 7f80467fc640 1 -- 172.21.15.91:0/965866524 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c003b20 con 0x7f805006cd20 2023-11-27T20:41:39.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.558+0000 7f80569b5640 1 -- 172.21.15.91:0/965866524 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805014b420 con 0x7f805006cd20 2023-11-27T20:41:39.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.559+0000 7f80569b5640 1 -- 172.21.15.91:0/965866524 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805004e840 con 0x7f805006cd20 2023-11-27T20:41:39.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.559+0000 7f80467fc640 1 -- 172.21.15.91:0/965866524 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f804c003c80 con 0x7f805006cd20 2023-11-27T20:41:39.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.560+0000 7f80467fc640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f803406b1f0 0x7f803406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:39.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.560+0000 7f80467fc640 1 -- 172.21.15.91:0/965866524 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f804c088ff0 con 0x7f805006cd20 2023-11-27T20:41:39.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.561+0000 7f80551b2640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f803406b1f0 0x7f803406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:39.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.561+0000 7f80551b2640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f803406b1f0 0x7f803406d6b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8040038000 tx=0x7f8040008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:39.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.565+0000 7f80467fc640 1 -- 172.21.15.91:0/965866524 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f804c0bbe90 con 0x7f805006cd20 2023-11-27T20:41:39.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.753+0000 7f80569b5640 1 -- 172.21.15.91:0/965866524 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8050151370 con 0x7f803406b1f0 2023-11-27T20:41:39.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.763+0000 7f80467fc640 1 -- 172.21.15.91:0/965866524 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264468 (secure 0 0 0) 0x7f804003e3b0 con 0x7f803406b1f0 2023-11-27T20:41:39.769 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:39.770 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:41:39.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.769+0000 7f80569b5640 1 -- 172.21.15.91:0/965866524 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f803406b1f0 msgr2=0x7f803406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.769+0000 7f80569b5640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f803406b1f0 0x7f803406d6b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8040038000 tx=0x7f8040008040 comp rx=0 tx=0).stop 2023-11-27T20:41:39.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.769+0000 7f80569b5640 1 -- 172.21.15.91:0/965866524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f805006cd20 msgr2=0x7f805014ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:39.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.769+0000 7f80569b5640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f805006cd20 0x7f805014ef20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c410 tx=0x7f804c00c8d0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.770+0000 7f80569b5640 1 -- 172.21.15.91:0/965866524 shutdown_connections 2023-11-27T20:41:39.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.770+0000 7f80569b5640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f803406b1f0 0x7f803406d6b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.770+0000 7f80569b5640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f805014e7f0 0x7f805014cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.770+0000 7f80569b5640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80500c52e0 0x7f80501ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.770+0000 7f80569b5640 1 --2- 172.21.15.91:0/965866524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f805006cd20 0x7f805014ef20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:39.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.770+0000 7f80569b5640 1 -- 172.21.15.91:0/965866524 >> 172.21.15.91:0/965866524 conn(0x7f80500a77f0 msgr2=0x7f80500bee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:39.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.770+0000 7f80569b5640 1 -- 172.21.15.91:0/965866524 shutdown_connections 2023-11-27T20:41:39.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:39.770+0000 7f80569b5640 1 -- 172.21.15.91:0/965866524 wait complete. 2023-11-27T20:41:39.791 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-27T20:41:39.373784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001741"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568422+0000","last_change":"2023-11-27T20:41:35.210030+0000","last_active":"2023-11-27T20:41:36.568422+0000","last_peered":"2023-11-27T20:41:36.568422+0000","last_clean":"2023-11-27T20:41:36.568422+0000","last_became_active":"2023-11-27T20:41:35.209584+0000","last_became_peered":"2023-11-27T20:41:35.209584+0000","last_unstale":"2023-11-27T20:41:36.568422+0000","last_undegraded":"2023-11-27T20:41:36.568422+0000","last_fullsized":"2023-11-27T20:41:36.568422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:25:37.197535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169518+0000","last_change":"2023-11-27T20:41:35.204048+0000","last_active":"2023-11-27T20:41:36.169518+0000","last_peered":"2023-11-27T20:41:36.169518+0000","last_clean":"2023-11-27T20:41:36.169518+0000","last_became_active":"2023-11-27T20:41:35.203609+0000","last_became_peered":"2023-11-27T20:41:35.203609+0000","last_unstale":"2023-11-27T20:41:36.169518+0000","last_undegraded":"2023-11-27T20:41:36.169518+0000","last_fullsized":"2023-11-27T20:41:36.169518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907501+0000","last_change":"2023-11-27T20:41:35.196593+0000","last_active":"2023-11-27T20:41:36.907501+0000","last_peered":"2023-11-27T20:41:36.907501+0000","last_clean":"2023-11-27T20:41:36.907501+0000","last_became_active":"2023-11-27T20:41:35.196245+0000","last_became_peered":"2023-11-27T20:41:35.196245+0000","last_unstale":"2023-11-27T20:41:36.907501+0000","last_undegraded":"2023-11-27T20:41:36.907501+0000","last_fullsized":"2023-11-27T20:41:36.907501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907385+0000","last_change":"2023-11-27T20:41:35.196161+0000","last_active":"2023-11-27T20:41:36.907385+0000","last_peered":"2023-11-27T20:41:36.907385+0000","last_clean":"2023-11-27T20:41:36.907385+0000","last_became_active":"2023-11-27T20:41:35.195574+0000","last_became_peered":"2023-11-27T20:41:35.195574+0000","last_unstale":"2023-11-27T20:41:36.907385+0000","last_undegraded":"2023-11-27T20:41:36.907385+0000","last_fullsized":"2023-11-27T20:41:36.907385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567605+0000","last_change":"2023-11-27T20:41:35.188022+0000","last_active":"2023-11-27T20:41:36.567605+0000","last_peered":"2023-11-27T20:41:36.567605+0000","last_clean":"2023-11-27T20:41:36.567605+0000","last_became_active":"2023-11-27T20:41:35.187210+0000","last_became_peered":"2023-11-27T20:41:35.187210+0000","last_unstale":"2023-11-27T20:41:36.567605+0000","last_undegraded":"2023-11-27T20:41:36.567605+0000","last_fullsized":"2023-11-27T20:41:36.567605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906752+0000","last_change":"2023-11-27T20:41:35.203796+0000","last_active":"2023-11-27T20:41:36.906752+0000","last_peered":"2023-11-27T20:41:36.906752+0000","last_clean":"2023-11-27T20:41:36.906752+0000","last_became_active":"2023-11-27T20:41:35.203512+0000","last_became_peered":"2023-11-27T20:41:35.203512+0000","last_unstale":"2023-11-27T20:41:36.906752+0000","last_undegraded":"2023-11-27T20:41:36.906752+0000","last_fullsized":"2023-11-27T20:41:36.906752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567353+0000","last_change":"2023-11-27T20:41:35.209043+0000","last_active":"2023-11-27T20:41:36.567353+0000","last_peered":"2023-11-27T20:41:36.567353+0000","last_clean":"2023-11-27T20:41:36.567353+0000","last_became_active":"2023-11-27T20:41:35.205308+0000","last_became_peered":"2023-11-27T20:41:35.205308+0000","last_unstale":"2023-11-27T20:41:36.567353+0000","last_undegraded":"2023-11-27T20:41:36.567353+0000","last_fullsized":"2023-11-27T20:41:36.567353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827128+0000","last_change":"2023-11-27T20:41:35.196320+0000","last_active":"2023-11-27T20:41:36.827128+0000","last_peered":"2023-11-27T20:41:36.827128+0000","last_clean":"2023-11-27T20:41:36.827128+0000","last_became_active":"2023-11-27T20:41:35.193843+0000","last_became_peered":"2023-11-27T20:41:35.193843+0000","last_unstale":"2023-11-27T20:41:36.827128+0000","last_undegraded":"2023-11-27T20:41:36.827128+0000","last_fullsized":"2023-11-27T20:41:36.827128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568420+0000","last_change":"2023-11-27T20:41:35.211496+0000","last_active":"2023-11-27T20:41:36.568420+0000","last_peered":"2023-11-27T20:41:36.568420+0000","last_clean":"2023-11-27T20:41:36.568420+0000","last_became_active":"2023-11-27T20:41:35.211125+0000","last_became_peered":"2023-11-27T20:41:35.211125+0000","last_unstale":"2023-11-27T20:41:36.568420+0000","last_undegraded":"2023-11-27T20:41:36.568420+0000","last_fullsized":"2023-11-27T20:41:36.568420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:13.910143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752742+0000","last_change":"2023-11-27T20:41:35.198670+0000","last_active":"2023-11-27T20:41:36.752742+0000","last_peered":"2023-11-27T20:41:36.752742+0000","last_clean":"2023-11-27T20:41:36.752742+0000","last_became_active":"2023-11-27T20:41:35.198295+0000","last_became_peered":"2023-11-27T20:41:35.198295+0000","last_unstale":"2023-11-27T20:41:36.752742+0000","last_undegraded":"2023-11-27T20:41:36.752742+0000","last_fullsized":"2023-11-27T20:41:36.752742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752376+0000","last_change":"2023-11-27T20:41:35.197788+0000","last_active":"2023-11-27T20:41:36.752376+0000","last_peered":"2023-11-27T20:41:36.752376+0000","last_clean":"2023-11-27T20:41:36.752376+0000","last_became_active":"2023-11-27T20:41:35.195764+0000","last_became_peered":"2023-11-27T20:41:35.195764+0000","last_unstale":"2023-11-27T20:41:36.752376+0000","last_undegraded":"2023-11-27T20:41:36.752376+0000","last_fullsized":"2023-11-27T20:41:36.752376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169976+0000","last_change":"2023-11-27T20:41:35.189694+0000","last_active":"2023-11-27T20:41:36.169976+0000","last_peered":"2023-11-27T20:41:36.169976+0000","last_clean":"2023-11-27T20:41:36.169976+0000","last_became_active":"2023-11-27T20:41:35.189217+0000","last_became_peered":"2023-11-27T20:41:35.189217+0000","last_unstale":"2023-11-27T20:41:36.169976+0000","last_undegraded":"2023-11-27T20:41:36.169976+0000","last_fullsized":"2023-11-27T20:41:36.169976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:50.810907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827472+0000","last_change":"2023-11-27T20:41:35.201904+0000","last_active":"2023-11-27T20:41:36.827472+0000","last_peered":"2023-11-27T20:41:36.827472+0000","last_clean":"2023-11-27T20:41:36.827472+0000","last_became_active":"2023-11-27T20:41:35.201580+0000","last_became_peered":"2023-11-27T20:41:35.201580+0000","last_unstale":"2023-11-27T20:41:36.827472+0000","last_undegraded":"2023-11-27T20:41:36.827472+0000","last_fullsized":"2023-11-27T20:41:36.827472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906514+0000","last_change":"2023-11-27T20:41:35.193681+0000","last_active":"2023-11-27T20:41:36.906514+0000","last_peered":"2023-11-27T20:41:36.906514+0000","last_clean":"2023-11-27T20:41:36.906514+0000","last_became_active":"2023-11-27T20:41:35.193411+0000","last_became_peered":"2023-11-27T20:41:35.193411+0000","last_unstale":"2023-11-27T20:41:36.906514+0000","last_undegraded":"2023-11-27T20:41:36.906514+0000","last_fullsized":"2023-11-27T20:41:36.906514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:23.300382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167585+0000","last_change":"2023-11-27T20:41:35.180375+0000","last_active":"2023-11-27T20:41:36.167585+0000","last_peered":"2023-11-27T20:41:36.167585+0000","last_clean":"2023-11-27T20:41:36.167585+0000","last_became_active":"2023-11-27T20:41:35.177730+0000","last_became_peered":"2023-11-27T20:41:35.177730+0000","last_unstale":"2023-11-27T20:41:36.167585+0000","last_undegraded":"2023-11-27T20:41:36.167585+0000","last_fullsized":"2023-11-27T20:41:36.167585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906675+0000","last_change":"2023-11-27T20:41:35.203805+0000","last_active":"2023-11-27T20:41:36.906675+0000","last_peered":"2023-11-27T20:41:36.906675+0000","last_clean":"2023-11-27T20:41:36.906675+0000","last_became_active":"2023-11-27T20:41:35.203287+0000","last_became_peered":"2023-11-27T20:41:35.203287+0000","last_unstale":"2023-11-27T20:41:36.906675+0000","last_undegraded":"2023-11-27T20:41:36.906675+0000","last_fullsized":"2023-11-27T20:41:36.906675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907572+0000","last_change":"2023-11-27T20:41:35.207783+0000","last_active":"2023-11-27T20:41:36.907572+0000","last_peered":"2023-11-27T20:41:36.907572+0000","last_clean":"2023-11-27T20:41:36.907572+0000","last_became_active":"2023-11-27T20:41:35.207485+0000","last_became_peered":"2023-11-27T20:41:35.207485+0000","last_unstale":"2023-11-27T20:41:36.907572+0000","last_undegraded":"2023-11-27T20:41:36.907572+0000","last_fullsized":"2023-11-27T20:41:36.907572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:30.836331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169370+0000","last_change":"2023-11-27T20:41:35.201010+0000","last_active":"2023-11-27T20:41:36.169370+0000","last_peered":"2023-11-27T20:41:36.169370+0000","last_clean":"2023-11-27T20:41:36.169370+0000","last_became_active":"2023-11-27T20:41:35.200679+0000","last_became_peered":"2023-11-27T20:41:35.200679+0000","last_unstale":"2023-11-27T20:41:36.169370+0000","last_undegraded":"2023-11-27T20:41:36.169370+0000","last_fullsized":"2023-11-27T20:41:36.169370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:04.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568398+0000","last_change":"2023-11-27T20:41:35.206268+0000","last_active":"2023-11-27T20:41:36.568398+0000","last_peered":"2023-11-27T20:41:36.568398+0000","last_clean":"2023-11-27T20:41:36.568398+0000","last_became_active":"2023-11-27T20:41:35.204792+0000","last_became_peered":"2023-11-27T20:41:35.204792+0000","last_unstale":"2023-11-27T20:41:36.568398+0000","last_undegraded":"2023-11-27T20:41:36.568398+0000","last_fullsized":"2023-11-27T20:41:36.568398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:03:54.961052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752345+0000","last_change":"2023-11-27T20:41:35.193226+0000","last_active":"2023-11-27T20:41:36.752345+0000","last_peered":"2023-11-27T20:41:36.752345+0000","last_clean":"2023-11-27T20:41:36.752345+0000","last_became_active":"2023-11-27T20:41:35.192897+0000","last_became_peered":"2023-11-27T20:41:35.192897+0000","last_unstale":"2023-11-27T20:41:36.752345+0000","last_undegraded":"2023-11-27T20:41:36.752345+0000","last_fullsized":"2023-11-27T20:41:36.752345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907015+0000","last_change":"2023-11-27T20:41:35.213004+0000","last_active":"2023-11-27T20:41:36.907015+0000","last_peered":"2023-11-27T20:41:36.907015+0000","last_clean":"2023-11-27T20:41:36.907015+0000","last_became_active":"2023-11-27T20:41:35.212784+0000","last_became_peered":"2023-11-27T20:41:35.212784+0000","last_unstale":"2023-11-27T20:41:36.907015+0000","last_undegraded":"2023-11-27T20:41:36.907015+0000","last_fullsized":"2023-11-27T20:41:36.907015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907089+0000","last_change":"2023-11-27T20:41:35.199481+0000","last_active":"2023-11-27T20:41:36.907089+0000","last_peered":"2023-11-27T20:41:36.907089+0000","last_clean":"2023-11-27T20:41:36.907089+0000","last_became_active":"2023-11-27T20:41:35.193493+0000","last_became_peered":"2023-11-27T20:41:35.193493+0000","last_unstale":"2023-11-27T20:41:36.907089+0000","last_undegraded":"2023-11-27T20:41:36.907089+0000","last_fullsized":"2023-11-27T20:41:36.907089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827405+0000","last_change":"2023-11-27T20:41:35.198176+0000","last_active":"2023-11-27T20:41:36.827405+0000","last_peered":"2023-11-27T20:41:36.827405+0000","last_clean":"2023-11-27T20:41:36.827405+0000","last_became_active":"2023-11-27T20:41:35.197867+0000","last_became_peered":"2023-11-27T20:41:35.197867+0000","last_unstale":"2023-11-27T20:41:36.827405+0000","last_undegraded":"2023-11-27T20:41:36.827405+0000","last_fullsized":"2023-11-27T20:41:36.827405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906931+0000","last_change":"2023-11-27T20:41:35.190147+0000","last_active":"2023-11-27T20:41:36.906931+0000","last_peered":"2023-11-27T20:41:36.906931+0000","last_clean":"2023-11-27T20:41:36.906931+0000","last_became_active":"2023-11-27T20:41:35.189833+0000","last_became_peered":"2023-11-27T20:41:35.189833+0000","last_unstale":"2023-11-27T20:41:36.906931+0000","last_undegraded":"2023-11-27T20:41:36.906931+0000","last_fullsized":"2023-11-27T20:41:36.906931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827821+0000","last_change":"2023-11-27T20:41:35.207689+0000","last_active":"2023-11-27T20:41:36.827821+0000","last_peered":"2023-11-27T20:41:36.827821+0000","last_clean":"2023-11-27T20:41:36.827821+0000","last_became_active":"2023-11-27T20:41:35.207388+0000","last_became_peered":"2023-11-27T20:41:35.207388+0000","last_unstale":"2023-11-27T20:41:36.827821+0000","last_undegraded":"2023-11-27T20:41:36.827821+0000","last_fullsized":"2023-11-27T20:41:36.827821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752892+0000","last_change":"2023-11-27T20:41:35.210588+0000","last_active":"2023-11-27T20:41:36.752892+0000","last_peered":"2023-11-27T20:41:36.752892+0000","last_clean":"2023-11-27T20:41:36.752892+0000","last_became_active":"2023-11-27T20:41:35.210373+0000","last_became_peered":"2023-11-27T20:41:35.210373+0000","last_unstale":"2023-11-27T20:41:36.752892+0000","last_undegraded":"2023-11-27T20:41:36.752892+0000","last_fullsized":"2023-11-27T20:41:36.752892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168202+0000","last_change":"2023-11-27T20:41:35.196031+0000","last_active":"2023-11-27T20:41:36.168202+0000","last_peered":"2023-11-27T20:41:36.168202+0000","last_clean":"2023-11-27T20:41:36.168202+0000","last_became_active":"2023-11-27T20:41:35.195780+0000","last_became_peered":"2023-11-27T20:41:35.195780+0000","last_unstale":"2023-11-27T20:41:36.168202+0000","last_undegraded":"2023-11-27T20:41:36.168202+0000","last_fullsized":"2023-11-27T20:41:36.168202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.828241+0000","last_change":"2023-11-27T20:41:35.195475+0000","last_active":"2023-11-27T20:41:36.828241+0000","last_peered":"2023-11-27T20:41:36.828241+0000","last_clean":"2023-11-27T20:41:36.828241+0000","last_became_active":"2023-11-27T20:41:35.194921+0000","last_became_peered":"2023-11-27T20:41:35.194921+0000","last_unstale":"2023-11-27T20:41:36.828241+0000","last_undegraded":"2023-11-27T20:41:36.828241+0000","last_fullsized":"2023-11-27T20:41:36.828241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906986+0000","last_change":"2023-11-27T20:41:35.200027+0000","last_active":"2023-11-27T20:41:36.906986+0000","last_peered":"2023-11-27T20:41:36.906986+0000","last_clean":"2023-11-27T20:41:36.906986+0000","last_became_active":"2023-11-27T20:41:35.199693+0000","last_became_peered":"2023-11-27T20:41:35.199693+0000","last_unstale":"2023-11-27T20:41:36.906986+0000","last_undegraded":"2023-11-27T20:41:36.906986+0000","last_fullsized":"2023-11-27T20:41:36.906986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907975+0000","last_change":"2023-11-27T20:41:35.200037+0000","last_active":"2023-11-27T20:41:36.907975+0000","last_peered":"2023-11-27T20:41:36.907975+0000","last_clean":"2023-11-27T20:41:36.907975+0000","last_became_active":"2023-11-27T20:41:35.199783+0000","last_became_peered":"2023-11-27T20:41:35.199783+0000","last_unstale":"2023-11-27T20:41:36.907975+0000","last_undegraded":"2023-11-27T20:41:36.907975+0000","last_fullsized":"2023-11-27T20:41:36.907975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:13.910143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168723+0000","last_change":"2023-11-27T20:41:35.191018+0000","last_active":"2023-11-27T20:41:36.168723+0000","last_peered":"2023-11-27T20:41:36.168723+0000","last_clean":"2023-11-27T20:41:36.168723+0000","last_became_active":"2023-11-27T20:41:35.189851+0000","last_became_peered":"2023-11-27T20:41:35.189851+0000","last_unstale":"2023-11-27T20:41:36.168723+0000","last_undegraded":"2023-11-27T20:41:36.168723+0000","last_fullsized":"2023-11-27T20:41:36.168723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:03.587578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751906+0000","last_change":"2023-11-27T20:41:35.200143+0000","last_active":"2023-11-27T20:41:36.751906+0000","last_peered":"2023-11-27T20:41:36.751906+0000","last_clean":"2023-11-27T20:41:36.751906+0000","last_became_active":"2023-11-27T20:41:35.199787+0000","last_became_peered":"2023-11-27T20:41:35.199787+0000","last_unstale":"2023-11-27T20:41:36.751906+0000","last_undegraded":"2023-11-27T20:41:36.751906+0000","last_fullsized":"2023-11-27T20:41:36.751906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169985+0000","last_change":"2023-11-27T20:41:35.191668+0000","last_active":"2023-11-27T20:41:36.169985+0000","last_peered":"2023-11-27T20:41:36.169985+0000","last_clean":"2023-11-27T20:41:36.169985+0000","last_became_active":"2023-11-27T20:41:35.191402+0000","last_became_peered":"2023-11-27T20:41:35.191402+0000","last_unstale":"2023-11-27T20:41:36.169985+0000","last_undegraded":"2023-11-27T20:41:36.169985+0000","last_fullsized":"2023-11-27T20:41:36.169985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:37:56.420323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.391181+0000","last_change":"2023-11-27T20:41:34.379346+0000","last_active":"2023-11-27T20:41:35.391181+0000","last_peered":"2023-11-27T20:41:35.391181+0000","last_clean":"2023-11-27T20:41:35.391181+0000","last_became_active":"2023-11-27T20:41:34.379070+0000","last_became_peered":"2023-11-27T20:41:34.379070+0000","last_unstale":"2023-11-27T20:41:35.391181+0000","last_undegraded":"2023-11-27T20:41:35.391181+0000","last_fullsized":"2023-11-27T20:41:35.391181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:30.381280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907378+0000","last_change":"2023-11-27T20:41:35.208886+0000","last_active":"2023-11-27T20:41:36.907378+0000","last_peered":"2023-11-27T20:41:36.907378+0000","last_clean":"2023-11-27T20:41:36.907378+0000","last_became_active":"2023-11-27T20:41:35.208443+0000","last_became_peered":"2023-11-27T20:41:35.208443+0000","last_unstale":"2023-11-27T20:41:36.907378+0000","last_undegraded":"2023-11-27T20:41:36.907378+0000","last_fullsized":"2023-11-27T20:41:36.907378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.394357+0000","last_change":"2023-11-27T20:41:34.376598+0000","last_active":"2023-11-27T20:41:35.394357+0000","last_peered":"2023-11-27T20:41:35.394357+0000","last_clean":"2023-11-27T20:41:35.394357+0000","last_became_active":"2023-11-27T20:41:34.375938+0000","last_became_peered":"2023-11-27T20:41:34.375938+0000","last_unstale":"2023-11-27T20:41:35.394357+0000","last_undegraded":"2023-11-27T20:41:35.394357+0000","last_fullsized":"2023-11-27T20:41:35.394357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.189265+0000","last_change":"2023-11-27T20:41:34.365856+0000","last_active":"2023-11-27T20:41:35.189265+0000","last_peered":"2023-11-27T20:41:35.189265+0000","last_clean":"2023-11-27T20:41:35.189265+0000","last_became_active":"2023-11-27T20:41:34.365263+0000","last_became_peered":"2023-11-27T20:41:34.365263+0000","last_unstale":"2023-11-27T20:41:35.189265+0000","last_undegraded":"2023-11-27T20:41:35.189265+0000","last_fullsized":"2023-11-27T20:41:35.189265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:22.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827358+0000","last_change":"2023-11-27T20:41:35.194411+0000","last_active":"2023-11-27T20:41:36.827358+0000","last_peered":"2023-11-27T20:41:36.827358+0000","last_clean":"2023-11-27T20:41:36.827358+0000","last_became_active":"2023-11-27T20:41:35.193870+0000","last_became_peered":"2023-11-27T20:41:35.193870+0000","last_unstale":"2023-11-27T20:41:36.827358+0000","last_undegraded":"2023-11-27T20:41:36.827358+0000","last_fullsized":"2023-11-27T20:41:36.827358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.184215+0000","last_change":"2023-11-27T20:41:34.384607+0000","last_active":"2023-11-27T20:41:35.184215+0000","last_peered":"2023-11-27T20:41:35.184215+0000","last_clean":"2023-11-27T20:41:35.184215+0000","last_became_active":"2023-11-27T20:41:34.384325+0000","last_became_peered":"2023-11-27T20:41:34.384325+0000","last_unstale":"2023-11-27T20:41:35.184215+0000","last_undegraded":"2023-11-27T20:41:35.184215+0000","last_fullsized":"2023-11-27T20:41:35.184215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:56.618777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167329+0000","last_change":"2023-11-27T20:41:35.186364+0000","last_active":"2023-11-27T20:41:36.167329+0000","last_peered":"2023-11-27T20:41:36.167329+0000","last_clean":"2023-11-27T20:41:36.167329+0000","last_became_active":"2023-11-27T20:41:35.185990+0000","last_became_peered":"2023-11-27T20:41:35.185990+0000","last_unstale":"2023-11-27T20:41:36.167329+0000","last_undegraded":"2023-11-27T20:41:36.167329+0000","last_fullsized":"2023-11-27T20:41:36.167329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.182202+0000","last_change":"2023-11-27T20:41:34.386881+0000","last_active":"2023-11-27T20:41:35.182202+0000","last_peered":"2023-11-27T20:41:35.182202+0000","last_clean":"2023-11-27T20:41:35.182202+0000","last_became_active":"2023-11-27T20:41:34.385617+0000","last_became_peered":"2023-11-27T20:41:34.385617+0000","last_unstale":"2023-11-27T20:41:35.182202+0000","last_undegraded":"2023-11-27T20:41:35.182202+0000","last_fullsized":"2023-11-27T20:41:35.182202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:04:42.284326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907976+0000","last_change":"2023-11-27T20:41:35.213263+0000","last_active":"2023-11-27T20:41:36.907976+0000","last_peered":"2023-11-27T20:41:36.907976+0000","last_clean":"2023-11-27T20:41:36.907976+0000","last_became_active":"2023-11-27T20:41:35.212945+0000","last_became_peered":"2023-11-27T20:41:35.212945+0000","last_unstale":"2023-11-27T20:41:36.907976+0000","last_undegraded":"2023-11-27T20:41:36.907976+0000","last_fullsized":"2023-11-27T20:41:36.907976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:31:23.723316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.188149+0000","last_change":"2023-11-27T20:41:34.390261+0000","last_active":"2023-11-27T20:41:35.188149+0000","last_peered":"2023-11-27T20:41:35.188149+0000","last_clean":"2023-11-27T20:41:35.188149+0000","last_became_active":"2023-11-27T20:41:34.389520+0000","last_became_peered":"2023-11-27T20:41:34.389520+0000","last_unstale":"2023-11-27T20:41:35.188149+0000","last_undegraded":"2023-11-27T20:41:35.188149+0000","last_fullsized":"2023-11-27T20:41:35.188149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:10.528078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907207+0000","last_change":"2023-11-27T20:41:35.203369+0000","last_active":"2023-11-27T20:41:36.907207+0000","last_peered":"2023-11-27T20:41:36.907207+0000","last_clean":"2023-11-27T20:41:36.907207+0000","last_became_active":"2023-11-27T20:41:35.203042+0000","last_became_peered":"2023-11-27T20:41:35.203042+0000","last_unstale":"2023-11-27T20:41:36.907207+0000","last_undegraded":"2023-11-27T20:41:36.907207+0000","last_fullsized":"2023-11-27T20:41:36.907207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399508+0000","last_change":"2023-11-27T20:41:34.385832+0000","last_active":"2023-11-27T20:41:35.399508+0000","last_peered":"2023-11-27T20:41:35.399508+0000","last_clean":"2023-11-27T20:41:35.399508+0000","last_became_active":"2023-11-27T20:41:34.384636+0000","last_became_peered":"2023-11-27T20:41:34.384636+0000","last_unstale":"2023-11-27T20:41:35.399508+0000","last_undegraded":"2023-11-27T20:41:35.399508+0000","last_fullsized":"2023-11-27T20:41:35.399508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:03.773317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.170135+0000","last_change":"2023-11-27T20:41:35.188819+0000","last_active":"2023-11-27T20:41:36.170135+0000","last_peered":"2023-11-27T20:41:36.170135+0000","last_clean":"2023-11-27T20:41:36.170135+0000","last_became_active":"2023-11-27T20:41:35.188292+0000","last_became_peered":"2023-11-27T20:41:35.188292+0000","last_unstale":"2023-11-27T20:41:36.170135+0000","last_undegraded":"2023-11-27T20:41:36.170135+0000","last_fullsized":"2023-11-27T20:41:36.170135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:04.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399033+0000","last_change":"2023-11-27T20:41:34.363549+0000","last_active":"2023-11-27T20:41:35.399033+0000","last_peered":"2023-11-27T20:41:35.399033+0000","last_clean":"2023-11-27T20:41:35.399033+0000","last_became_active":"2023-11-27T20:41:34.361181+0000","last_became_peered":"2023-11-27T20:41:34.361181+0000","last_unstale":"2023-11-27T20:41:35.399033+0000","last_undegraded":"2023-11-27T20:41:35.399033+0000","last_fullsized":"2023-11-27T20:41:35.399033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:03.773317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567699+0000","last_change":"2023-11-27T20:41:35.211117+0000","last_active":"2023-11-27T20:41:36.567699+0000","last_peered":"2023-11-27T20:41:36.567699+0000","last_clean":"2023-11-27T20:41:36.567699+0000","last_became_active":"2023-11-27T20:41:35.206668+0000","last_became_peered":"2023-11-27T20:41:35.206668+0000","last_unstale":"2023-11-27T20:41:36.567699+0000","last_undegraded":"2023-11-27T20:41:36.567699+0000","last_fullsized":"2023-11-27T20:41:36.567699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399355+0000","last_change":"2023-11-27T20:41:34.375628+0000","last_active":"2023-11-27T20:41:35.399355+0000","last_peered":"2023-11-27T20:41:35.399355+0000","last_clean":"2023-11-27T20:41:35.399355+0000","last_became_active":"2023-11-27T20:41:34.375164+0000","last_became_peered":"2023-11-27T20:41:34.375164+0000","last_unstale":"2023-11-27T20:41:35.399355+0000","last_undegraded":"2023-11-27T20:41:35.399355+0000","last_fullsized":"2023-11-27T20:41:35.399355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907003+0000","last_change":"2023-11-27T20:41:35.206246+0000","last_active":"2023-11-27T20:41:36.907003+0000","last_peered":"2023-11-27T20:41:36.907003+0000","last_clean":"2023-11-27T20:41:36.907003+0000","last_became_active":"2023-11-27T20:41:35.205741+0000","last_became_peered":"2023-11-27T20:41:35.205741+0000","last_unstale":"2023-11-27T20:41:36.907003+0000","last_undegraded":"2023-11-27T20:41:36.907003+0000","last_fullsized":"2023-11-27T20:41:36.907003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.186433+0000","last_change":"2023-11-27T20:41:34.383993+0000","last_active":"2023-11-27T20:41:35.186433+0000","last_peered":"2023-11-27T20:41:35.186433+0000","last_clean":"2023-11-27T20:41:35.186433+0000","last_became_active":"2023-11-27T20:41:34.383739+0000","last_became_peered":"2023-11-27T20:41:34.383739+0000","last_unstale":"2023-11-27T20:41:35.186433+0000","last_undegraded":"2023-11-27T20:41:35.186433+0000","last_fullsized":"2023-11-27T20:41:35.186433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:17.468682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567699+0000","last_change":"2023-11-27T20:41:35.193841+0000","last_active":"2023-11-27T20:41:36.567699+0000","last_peered":"2023-11-27T20:41:36.567699+0000","last_clean":"2023-11-27T20:41:36.567699+0000","last_became_active":"2023-11-27T20:41:35.192848+0000","last_became_peered":"2023-11-27T20:41:35.192848+0000","last_unstale":"2023-11-27T20:41:36.567699+0000","last_undegraded":"2023-11-27T20:41:36.567699+0000","last_fullsized":"2023-11-27T20:41:36.567699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:09.396414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.173511+0000","last_change":"2023-11-27T20:41:34.376129+0000","last_active":"2023-11-27T20:41:35.173511+0000","last_peered":"2023-11-27T20:41:35.173511+0000","last_clean":"2023-11-27T20:41:35.173511+0000","last_became_active":"2023-11-27T20:41:34.375804+0000","last_became_peered":"2023-11-27T20:41:34.375804+0000","last_unstale":"2023-11-27T20:41:35.173511+0000","last_undegraded":"2023-11-27T20:41:35.173511+0000","last_fullsized":"2023-11-27T20:41:35.173511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:45:59.175653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751925+0000","last_change":"2023-11-27T20:41:35.196670+0000","last_active":"2023-11-27T20:41:36.751925+0000","last_peered":"2023-11-27T20:41:36.751925+0000","last_clean":"2023-11-27T20:41:36.751925+0000","last_became_active":"2023-11-27T20:41:35.196378+0000","last_became_peered":"2023-11-27T20:41:35.196378+0000","last_unstale":"2023-11-27T20:41:36.751925+0000","last_undegraded":"2023-11-27T20:41:36.751925+0000","last_fullsized":"2023-11-27T20:41:36.751925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399674+0000","last_change":"2023-11-27T20:41:34.372374+0000","last_active":"2023-11-27T20:41:35.399674+0000","last_peered":"2023-11-27T20:41:35.399674+0000","last_clean":"2023-11-27T20:41:35.399674+0000","last_became_active":"2023-11-27T20:41:34.371956+0000","last_became_peered":"2023-11-27T20:41:34.371956+0000","last_unstale":"2023-11-27T20:41:35.399674+0000","last_undegraded":"2023-11-27T20:41:35.399674+0000","last_fullsized":"2023-11-27T20:41:35.399674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:09:02.084275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567520+0000","last_change":"2023-11-27T20:41:35.209749+0000","last_active":"2023-11-27T20:41:36.567520+0000","last_peered":"2023-11-27T20:41:36.567520+0000","last_clean":"2023-11-27T20:41:36.567520+0000","last_became_active":"2023-11-27T20:41:35.209421+0000","last_became_peered":"2023-11-27T20:41:35.209421+0000","last_unstale":"2023-11-27T20:41:36.567520+0000","last_undegraded":"2023-11-27T20:41:36.567520+0000","last_fullsized":"2023-11-27T20:41:36.567520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.397573+0000","last_change":"2023-11-27T20:41:34.381268+0000","last_active":"2023-11-27T20:41:35.397573+0000","last_peered":"2023-11-27T20:41:35.397573+0000","last_clean":"2023-11-27T20:41:35.397573+0000","last_became_active":"2023-11-27T20:41:34.379765+0000","last_became_peered":"2023-11-27T20:41:34.379765+0000","last_unstale":"2023-11-27T20:41:35.397573+0000","last_undegraded":"2023-11-27T20:41:35.397573+0000","last_fullsized":"2023-11-27T20:41:35.397573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:07.467417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568439+0000","last_change":"2023-11-27T20:41:35.210232+0000","last_active":"2023-11-27T20:41:36.568439+0000","last_peered":"2023-11-27T20:41:36.568439+0000","last_clean":"2023-11-27T20:41:36.568439+0000","last_became_active":"2023-11-27T20:41:35.209143+0000","last_became_peered":"2023-11-27T20:41:35.209143+0000","last_unstale":"2023-11-27T20:41:36.568439+0000","last_undegraded":"2023-11-27T20:41:36.568439+0000","last_fullsized":"2023-11-27T20:41:36.568439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:31:23.723316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395121+0000","last_change":"2023-11-27T20:41:34.380235+0000","last_active":"2023-11-27T20:41:35.395121+0000","last_peered":"2023-11-27T20:41:35.395121+0000","last_clean":"2023-11-27T20:41:35.395121+0000","last_became_active":"2023-11-27T20:41:34.379940+0000","last_became_peered":"2023-11-27T20:41:34.379940+0000","last_unstale":"2023-11-27T20:41:35.395121+0000","last_undegraded":"2023-11-27T20:41:35.395121+0000","last_fullsized":"2023-11-27T20:41:35.395121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568652+0000","last_change":"2023-11-27T20:41:35.214260+0000","last_active":"2023-11-27T20:41:36.568652+0000","last_peered":"2023-11-27T20:41:36.568652+0000","last_clean":"2023-11-27T20:41:36.568652+0000","last_became_active":"2023-11-27T20:41:35.213814+0000","last_became_peered":"2023-11-27T20:41:35.213814+0000","last_unstale":"2023-11-27T20:41:36.568652+0000","last_undegraded":"2023-11-27T20:41:36.568652+0000","last_fullsized":"2023-11-27T20:41:36.568652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:03.051157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.396870+0000","last_change":"2023-11-27T20:41:34.383025+0000","last_active":"2023-11-27T20:41:35.396870+0000","last_peered":"2023-11-27T20:41:35.396870+0000","last_clean":"2023-11-27T20:41:35.396870+0000","last_became_active":"2023-11-27T20:41:34.382672+0000","last_became_peered":"2023-11-27T20:41:34.382672+0000","last_unstale":"2023-11-27T20:41:35.396870+0000","last_undegraded":"2023-11-27T20:41:35.396870+0000","last_fullsized":"2023-11-27T20:41:35.396870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907802+0000","last_change":"2023-11-27T20:41:35.195935+0000","last_active":"2023-11-27T20:41:36.907802+0000","last_peered":"2023-11-27T20:41:36.907802+0000","last_clean":"2023-11-27T20:41:36.907802+0000","last_became_active":"2023-11-27T20:41:35.195208+0000","last_became_peered":"2023-11-27T20:41:35.195208+0000","last_unstale":"2023-11-27T20:41:36.907802+0000","last_undegraded":"2023-11-27T20:41:36.907802+0000","last_fullsized":"2023-11-27T20:41:36.907802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:03:54.961052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.166681+0000","last_change":"2023-11-27T20:41:34.386973+0000","last_active":"2023-11-27T20:41:35.166681+0000","last_peered":"2023-11-27T20:41:35.166681+0000","last_clean":"2023-11-27T20:41:35.166681+0000","last_became_active":"2023-11-27T20:41:34.386649+0000","last_became_peered":"2023-11-27T20:41:34.386649+0000","last_unstale":"2023-11-27T20:41:35.166681+0000","last_undegraded":"2023-11-27T20:41:35.166681+0000","last_fullsized":"2023-11-27T20:41:35.166681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:07.467417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568068+0000","last_change":"2023-11-27T20:41:35.211346+0000","last_active":"2023-11-27T20:41:36.568068+0000","last_peered":"2023-11-27T20:41:36.568068+0000","last_clean":"2023-11-27T20:41:36.568068+0000","last_became_active":"2023-11-27T20:41:35.210844+0000","last_became_peered":"2023-11-27T20:41:35.210844+0000","last_unstale":"2023-11-27T20:41:36.568068+0000","last_undegraded":"2023-11-27T20:41:36.568068+0000","last_fullsized":"2023-11-27T20:41:36.568068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:30.836331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177748+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:41:35.177748+0000","last_peered":"2023-11-27T20:41:35.177748+0000","last_clean":"2023-11-27T20:41:35.177748+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:41:35.177748+0000","last_undegraded":"2023-11-27T20:41:35.177748+0000","last_fullsized":"2023-11-27T20:41:35.177748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.185862+0000","last_change":"2023-11-27T20:41:34.388453+0000","last_active":"2023-11-27T20:41:35.185862+0000","last_peered":"2023-11-27T20:41:35.185862+0000","last_clean":"2023-11-27T20:41:35.185862+0000","last_became_active":"2023-11-27T20:41:34.388237+0000","last_became_peered":"2023-11-27T20:41:34.388237+0000","last_unstale":"2023-11-27T20:41:35.185862+0000","last_undegraded":"2023-11-27T20:41:35.185862+0000","last_fullsized":"2023-11-27T20:41:35.185862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:49.304546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827823+0000","last_change":"2023-11-27T20:41:35.192084+0000","last_active":"2023-11-27T20:41:36.827823+0000","last_peered":"2023-11-27T20:41:36.827823+0000","last_clean":"2023-11-27T20:41:36.827823+0000","last_became_active":"2023-11-27T20:41:35.190701+0000","last_became_peered":"2023-11-27T20:41:35.190701+0000","last_unstale":"2023-11-27T20:41:36.827823+0000","last_undegraded":"2023-11-27T20:41:36.827823+0000","last_fullsized":"2023-11-27T20:41:36.827823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177479+0000","last_change":"2023-11-27T20:41:34.388350+0000","last_active":"2023-11-27T20:41:35.177479+0000","last_peered":"2023-11-27T20:41:35.177479+0000","last_clean":"2023-11-27T20:41:35.177479+0000","last_became_active":"2023-11-27T20:41:34.388078+0000","last_became_peered":"2023-11-27T20:41:34.388078+0000","last_unstale":"2023-11-27T20:41:35.177479+0000","last_undegraded":"2023-11-27T20:41:35.177479+0000","last_fullsized":"2023-11-27T20:41:35.177479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906804+0000","last_change":"2023-11-27T20:41:35.208870+0000","last_active":"2023-11-27T20:41:36.906804+0000","last_peered":"2023-11-27T20:41:36.906804+0000","last_clean":"2023-11-27T20:41:36.906804+0000","last_became_active":"2023-11-27T20:41:35.208454+0000","last_became_peered":"2023-11-27T20:41:35.208454+0000","last_unstale":"2023-11-27T20:41:36.906804+0000","last_undegraded":"2023-11-27T20:41:36.906804+0000","last_fullsized":"2023-11-27T20:41:36.906804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:31.394309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.166972+0000","last_change":"2023-11-27T20:41:34.379312+0000","last_active":"2023-11-27T20:41:35.166972+0000","last_peered":"2023-11-27T20:41:35.166972+0000","last_clean":"2023-11-27T20:41:35.166972+0000","last_became_active":"2023-11-27T20:41:34.379064+0000","last_became_peered":"2023-11-27T20:41:34.379064+0000","last_unstale":"2023-11-27T20:41:35.166972+0000","last_undegraded":"2023-11-27T20:41:35.166972+0000","last_fullsized":"2023-11-27T20:41:35.166972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:37:55.407294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167324+0000","last_change":"2023-11-27T20:41:35.180034+0000","last_active":"2023-11-27T20:41:36.167324+0000","last_peered":"2023-11-27T20:41:36.167324+0000","last_clean":"2023-11-27T20:41:36.167324+0000","last_became_active":"2023-11-27T20:41:35.178994+0000","last_became_peered":"2023-11-27T20:41:35.178994+0000","last_unstale":"2023-11-27T20:41:36.167324+0000","last_undegraded":"2023-11-27T20:41:36.167324+0000","last_fullsized":"2023-11-27T20:41:36.167324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.192457+0000","last_change":"2023-11-27T20:41:34.383948+0000","last_active":"2023-11-27T20:41:35.192457+0000","last_peered":"2023-11-27T20:41:35.192457+0000","last_clean":"2023-11-27T20:41:35.192457+0000","last_became_active":"2023-11-27T20:41:34.383355+0000","last_became_peered":"2023-11-27T20:41:34.383355+0000","last_unstale":"2023-11-27T20:41:35.192457+0000","last_undegraded":"2023-11-27T20:41:35.192457+0000","last_fullsized":"2023-11-27T20:41:35.192457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:38.370465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169931+0000","last_change":"2023-11-27T20:41:35.204870+0000","last_active":"2023-11-27T20:41:36.169931+0000","last_peered":"2023-11-27T20:41:36.169931+0000","last_clean":"2023-11-27T20:41:36.169931+0000","last_became_active":"2023-11-27T20:41:35.204425+0000","last_became_peered":"2023-11-27T20:41:35.204425+0000","last_unstale":"2023-11-27T20:41:36.169931+0000","last_undegraded":"2023-11-27T20:41:36.169931+0000","last_fullsized":"2023-11-27T20:41:36.169931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:21.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.169452+0000","last_change":"2023-11-27T20:41:34.376734+0000","last_active":"2023-11-27T20:41:35.169452+0000","last_peered":"2023-11-27T20:41:35.169452+0000","last_clean":"2023-11-27T20:41:35.169452+0000","last_became_active":"2023-11-27T20:41:34.376427+0000","last_became_peered":"2023-11-27T20:41:34.376427+0000","last_unstale":"2023-11-27T20:41:35.169452+0000","last_undegraded":"2023-11-27T20:41:35.169452+0000","last_fullsized":"2023-11-27T20:41:35.169452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907828+0000","last_change":"2023-11-27T20:41:35.198109+0000","last_active":"2023-11-27T20:41:36.907828+0000","last_peered":"2023-11-27T20:41:36.907828+0000","last_clean":"2023-11-27T20:41:36.907828+0000","last_became_active":"2023-11-27T20:41:35.197772+0000","last_became_peered":"2023-11-27T20:41:35.197772+0000","last_unstale":"2023-11-27T20:41:36.907828+0000","last_undegraded":"2023-11-27T20:41:36.907828+0000","last_fullsized":"2023-11-27T20:41:36.907828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:25:37.197535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.185525+0000","last_change":"2023-11-27T20:41:34.387255+0000","last_active":"2023-11-27T20:41:35.185525+0000","last_peered":"2023-11-27T20:41:35.185525+0000","last_clean":"2023-11-27T20:41:35.185525+0000","last_became_active":"2023-11-27T20:41:34.386911+0000","last_became_peered":"2023-11-27T20:41:34.386911+0000","last_unstale":"2023-11-27T20:41:35.185525+0000","last_undegraded":"2023-11-27T20:41:35.185525+0000","last_fullsized":"2023-11-27T20:41:35.185525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:17.468682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168166+0000","last_change":"2023-11-27T20:41:35.179788+0000","last_active":"2023-11-27T20:41:36.168166+0000","last_peered":"2023-11-27T20:41:36.168166+0000","last_clean":"2023-11-27T20:41:36.168166+0000","last_became_active":"2023-11-27T20:41:35.179071+0000","last_became_peered":"2023-11-27T20:41:35.179071+0000","last_unstale":"2023-11-27T20:41:36.168166+0000","last_undegraded":"2023-11-27T20:41:36.168166+0000","last_fullsized":"2023-11-27T20:41:36.168166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.173101+0000","last_change":"2023-11-27T20:41:34.383651+0000","last_active":"2023-11-27T20:41:35.173101+0000","last_peered":"2023-11-27T20:41:35.173101+0000","last_clean":"2023-11-27T20:41:35.173101+0000","last_became_active":"2023-11-27T20:41:34.383295+0000","last_became_peered":"2023-11-27T20:41:34.383295+0000","last_unstale":"2023-11-27T20:41:35.173101+0000","last_undegraded":"2023-11-27T20:41:35.173101+0000","last_fullsized":"2023-11-27T20:41:35.173101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827815+0000","last_change":"2023-11-27T20:41:35.211366+0000","last_active":"2023-11-27T20:41:36.827815+0000","last_peered":"2023-11-27T20:41:36.827815+0000","last_clean":"2023-11-27T20:41:36.827815+0000","last_became_active":"2023-11-27T20:41:35.211001+0000","last_became_peered":"2023-11-27T20:41:35.211001+0000","last_unstale":"2023-11-27T20:41:36.827815+0000","last_undegraded":"2023-11-27T20:41:36.827815+0000","last_fullsized":"2023-11-27T20:41:36.827815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.394474+0000","last_change":"2023-11-27T20:41:34.385226+0000","last_active":"2023-11-27T20:41:35.394474+0000","last_peered":"2023-11-27T20:41:35.394474+0000","last_clean":"2023-11-27T20:41:35.394474+0000","last_became_active":"2023-11-27T20:41:34.384361+0000","last_became_peered":"2023-11-27T20:41:34.384361+0000","last_unstale":"2023-11-27T20:41:35.394474+0000","last_undegraded":"2023-11-27T20:41:35.394474+0000","last_fullsized":"2023-11-27T20:41:35.394474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:22.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906972+0000","last_change":"2023-11-27T20:41:35.201432+0000","last_active":"2023-11-27T20:41:36.906972+0000","last_peered":"2023-11-27T20:41:36.906972+0000","last_clean":"2023-11-27T20:41:36.906972+0000","last_became_active":"2023-11-27T20:41:35.201065+0000","last_became_peered":"2023-11-27T20:41:35.201065+0000","last_unstale":"2023-11-27T20:41:36.906972+0000","last_undegraded":"2023-11-27T20:41:36.906972+0000","last_fullsized":"2023-11-27T20:41:36.906972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177113+0000","last_change":"2023-11-27T20:41:34.389439+0000","last_active":"2023-11-27T20:41:35.177113+0000","last_peered":"2023-11-27T20:41:35.177113+0000","last_clean":"2023-11-27T20:41:35.177113+0000","last_became_active":"2023-11-27T20:41:34.389145+0000","last_became_peered":"2023-11-27T20:41:34.389145+0000","last_unstale":"2023-11-27T20:41:35.177113+0000","last_undegraded":"2023-11-27T20:41:35.177113+0000","last_fullsized":"2023-11-27T20:41:35.177113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169999+0000","last_change":"2023-11-27T20:41:35.189837+0000","last_active":"2023-11-27T20:41:36.169999+0000","last_peered":"2023-11-27T20:41:36.169999+0000","last_clean":"2023-11-27T20:41:36.169999+0000","last_became_active":"2023-11-27T20:41:35.189208+0000","last_became_peered":"2023-11-27T20:41:35.189208+0000","last_unstale":"2023-11-27T20:41:36.169999+0000","last_undegraded":"2023-11-27T20:41:36.169999+0000","last_fullsized":"2023-11-27T20:41:36.169999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:03.587578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.167206+0000","last_change":"2023-11-27T20:41:34.387256+0000","last_active":"2023-11-27T20:41:35.167206+0000","last_peered":"2023-11-27T20:41:35.167206+0000","last_clean":"2023-11-27T20:41:35.167206+0000","last_became_active":"2023-11-27T20:41:34.386923+0000","last_became_peered":"2023-11-27T20:41:34.386923+0000","last_unstale":"2023-11-27T20:41:35.167206+0000","last_undegraded":"2023-11-27T20:41:35.167206+0000","last_fullsized":"2023-11-27T20:41:35.167206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:20.494221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827602+0000","last_change":"2023-11-27T20:41:35.186083+0000","last_active":"2023-11-27T20:41:36.827602+0000","last_peered":"2023-11-27T20:41:36.827602+0000","last_clean":"2023-11-27T20:41:36.827602+0000","last_became_active":"2023-11-27T20:41:35.184168+0000","last_became_peered":"2023-11-27T20:41:35.184168+0000","last_unstale":"2023-11-27T20:41:36.827602+0000","last_undegraded":"2023-11-27T20:41:36.827602+0000","last_fullsized":"2023-11-27T20:41:36.827602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.168762+0000","last_change":"2023-11-27T20:41:34.378248+0000","last_active":"2023-11-27T20:41:35.168762+0000","last_peered":"2023-11-27T20:41:35.168762+0000","last_clean":"2023-11-27T20:41:35.168762+0000","last_became_active":"2023-11-27T20:41:34.376972+0000","last_became_peered":"2023-11-27T20:41:34.376972+0000","last_unstale":"2023-11-27T20:41:35.168762+0000","last_undegraded":"2023-11-27T20:41:35.168762+0000","last_fullsized":"2023-11-27T20:41:35.168762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827902+0000","last_change":"2023-11-27T20:41:35.199694+0000","last_active":"2023-11-27T20:41:36.827902+0000","last_peered":"2023-11-27T20:41:36.827902+0000","last_clean":"2023-11-27T20:41:36.827902+0000","last_became_active":"2023-11-27T20:41:35.198540+0000","last_became_peered":"2023-11-27T20:41:35.198540+0000","last_unstale":"2023-11-27T20:41:36.827902+0000","last_undegraded":"2023-11-27T20:41:36.827902+0000","last_fullsized":"2023-11-27T20:41:36.827902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.391944+0000","last_change":"2023-11-27T20:41:34.387556+0000","last_active":"2023-11-27T20:41:35.391944+0000","last_peered":"2023-11-27T20:41:35.391944+0000","last_clean":"2023-11-27T20:41:35.391944+0000","last_became_active":"2023-11-27T20:41:34.387316+0000","last_became_peered":"2023-11-27T20:41:34.387316+0000","last_unstale":"2023-11-27T20:41:35.391944+0000","last_undegraded":"2023-11-27T20:41:35.391944+0000","last_fullsized":"2023-11-27T20:41:35.391944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751980+0000","last_change":"2023-11-27T20:41:35.195068+0000","last_active":"2023-11-27T20:41:36.751980+0000","last_peered":"2023-11-27T20:41:36.751980+0000","last_clean":"2023-11-27T20:41:36.751980+0000","last_became_active":"2023-11-27T20:41:35.194784+0000","last_became_peered":"2023-11-27T20:41:35.194784+0000","last_unstale":"2023-11-27T20:41:36.751980+0000","last_undegraded":"2023-11-27T20:41:36.751980+0000","last_fullsized":"2023-11-27T20:41:36.751980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907555+0000","last_change":"2023-11-27T20:41:35.207667+0000","last_active":"2023-11-27T20:41:36.907555+0000","last_peered":"2023-11-27T20:41:36.907555+0000","last_clean":"2023-11-27T20:41:36.907555+0000","last_became_active":"2023-11-27T20:41:35.207323+0000","last_became_peered":"2023-11-27T20:41:35.207323+0000","last_unstale":"2023-11-27T20:41:36.907555+0000","last_undegraded":"2023-11-27T20:41:36.907555+0000","last_fullsized":"2023-11-27T20:41:36.907555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:09.396414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.396809+0000","last_change":"2023-11-27T20:41:34.386983+0000","last_active":"2023-11-27T20:41:35.396809+0000","last_peered":"2023-11-27T20:41:35.396809+0000","last_clean":"2023-11-27T20:41:35.396809+0000","last_became_active":"2023-11-27T20:41:34.386656+0000","last_became_peered":"2023-11-27T20:41:34.386656+0000","last_unstale":"2023-11-27T20:41:35.396809+0000","last_undegraded":"2023-11-27T20:41:35.396809+0000","last_fullsized":"2023-11-27T20:41:35.396809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907496+0000","last_change":"2023-11-27T20:41:35.191267+0000","last_active":"2023-11-27T20:41:36.907496+0000","last_peered":"2023-11-27T20:41:36.907496+0000","last_clean":"2023-11-27T20:41:36.907496+0000","last_became_active":"2023-11-27T20:41:35.190866+0000","last_became_peered":"2023-11-27T20:41:35.190866+0000","last_unstale":"2023-11-27T20:41:36.907496+0000","last_undegraded":"2023-11-27T20:41:36.907496+0000","last_fullsized":"2023-11-27T20:41:36.907496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395054+0000","last_change":"2023-11-27T20:41:34.390257+0000","last_active":"2023-11-27T20:41:35.395054+0000","last_peered":"2023-11-27T20:41:35.395054+0000","last_clean":"2023-11-27T20:41:35.395054+0000","last_became_active":"2023-11-27T20:41:34.389874+0000","last_became_peered":"2023-11-27T20:41:34.389874+0000","last_unstale":"2023-11-27T20:41:35.395054+0000","last_undegraded":"2023-11-27T20:41:35.395054+0000","last_fullsized":"2023-11-27T20:41:35.395054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:30.381280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907171+0000","last_change":"2023-11-27T20:41:35.202070+0000","last_active":"2023-11-27T20:41:36.907171+0000","last_peered":"2023-11-27T20:41:36.907171+0000","last_clean":"2023-11-27T20:41:36.907171+0000","last_became_active":"2023-11-27T20:41:35.201756+0000","last_became_peered":"2023-11-27T20:41:35.201756+0000","last_unstale":"2023-11-27T20:41:36.907171+0000","last_undegraded":"2023-11-27T20:41:36.907171+0000","last_fullsized":"2023-11-27T20:41:36.907171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395132+0000","last_change":"2023-11-27T20:41:34.378008+0000","last_active":"2023-11-27T20:41:35.395132+0000","last_peered":"2023-11-27T20:41:35.395132+0000","last_clean":"2023-11-27T20:41:35.395132+0000","last_became_active":"2023-11-27T20:41:34.377741+0000","last_became_peered":"2023-11-27T20:41:34.377741+0000","last_unstale":"2023-11-27T20:41:35.395132+0000","last_undegraded":"2023-11-27T20:41:35.395132+0000","last_fullsized":"2023-11-27T20:41:35.395132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:04:42.284326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827818+0000","last_change":"2023-11-27T20:41:35.205383+0000","last_active":"2023-11-27T20:41:36.827818+0000","last_peered":"2023-11-27T20:41:36.827818+0000","last_clean":"2023-11-27T20:41:36.827818+0000","last_became_active":"2023-11-27T20:41:35.203522+0000","last_became_peered":"2023-11-27T20:41:35.203522+0000","last_unstale":"2023-11-27T20:41:36.827818+0000","last_undegraded":"2023-11-27T20:41:36.827818+0000","last_fullsized":"2023-11-27T20:41:36.827818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399023+0000","last_change":"2023-11-27T20:41:34.384751+0000","last_active":"2023-11-27T20:41:35.399023+0000","last_peered":"2023-11-27T20:41:35.399023+0000","last_clean":"2023-11-27T20:41:35.399023+0000","last_became_active":"2023-11-27T20:41:34.384460+0000","last_became_peered":"2023-11-27T20:41:34.384460+0000","last_unstale":"2023-11-27T20:41:35.399023+0000","last_undegraded":"2023-11-27T20:41:35.399023+0000","last_fullsized":"2023-11-27T20:41:35.399023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.901}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0329999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8009999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.837}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9530000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.756}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0979999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.696}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.651}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.758}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:41:39.796 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:41:40.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.044+0000 7fd4c7fff640 1 Processor -- start 2023-11-27T20:41:40.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.044+0000 7fd4c7fff640 1 -- start start 2023-11-27T20:41:40.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.046+0000 7fd4c7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd4c80c1100 0x7fd4c81641c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.046+0000 7fd4c7fff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c8159800 con 0x7fd4c806e000 2023-11-27T20:41:40.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.046+0000 7fd4c7fff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c8158a40 con 0x7fd4c8155f60 2023-11-27T20:41:40.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.046+0000 7fd4c7fff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c806c440 con 0x7fd4c80c1100 2023-11-27T20:41:40.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.046+0000 7fd4c77fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd4c80c1100 0x7fd4c81641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.046+0000 7fd4c77fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd4c80c1100 0x7fd4c81641c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52064/0 (socket says 172.21.15.91:52064) 2023-11-27T20:41:40.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.046+0000 7fd4c77fe640 1 -- 172.21.15.91:0/4163044499 learned_addr learned my addr 172.21.15.91:0/4163044499 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:40.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.047+0000 7fd4c77fe640 1 -- 172.21.15.91:0/4163044499 >> v1:172.21.15.183:6789/0 conn(0x7fd4c8155f60 legacy=0x7fd4c80c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:40.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.047+0000 7fd4c77fe640 1 -- 172.21.15.91:0/4163044499 >> v1:172.21.15.91:6789/0 conn(0x7fd4c806e000 legacy=0x7fd4c80c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.047+0000 7fd4c77fe640 1 -- 172.21.15.91:0/4163044499 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8158d20 con 0x7fd4c80c1100 2023-11-27T20:41:40.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.047+0000 7fd4c67fc640 1 -- 172.21.15.91:0/4163044499 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905755301 0 0) 0x7fd4c8159800 con 0x7fd4c806e000 2023-11-27T20:41:40.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.048+0000 7fd4c77fe640 1 --2- 172.21.15.91:0/4163044499 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 0x7fd4c81641c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009e50 tx=0x7fd4c002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29dada5b1739ced server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:40.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.048+0000 7fd4c67fc640 1 -- 172.21.15.91:0/4163044499 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c002cb20 con 0x7fd4c80c1100 2023-11-27T20:41:40.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.048+0000 7fd4c67fc640 1 -- 172.21.15.91:0/4163044499 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c002cc80 con 0x7fd4c80c1100 2023-11-27T20:41:40.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.048+0000 7fd4c67fc640 1 -- 172.21.15.91:0/4163044499 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c00343f0 con 0x7fd4c80c1100 2023-11-27T20:41:40.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.049+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4163044499 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 msgr2=0x7fd4c81641c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.049+0000 7fd4c7fff640 1 --2- 172.21.15.91:0/4163044499 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 0x7fd4c81641c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009e50 tx=0x7fd4c002bf80 comp rx=0 tx=0).stop 2023-11-27T20:41:40.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.049+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4163044499 shutdown_connections 2023-11-27T20:41:40.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.049+0000 7fd4c7fff640 1 --2- 172.21.15.91:0/4163044499 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 0x7fd4c81641c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.049+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4163044499 >> 172.21.15.91:0/4163044499 conn(0x7fd4c80a77f0 msgr2=0x7fd4c80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:40.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.049+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4163044499 shutdown_connections 2023-11-27T20:41:40.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.049+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4163044499 wait complete. 2023-11-27T20:41:40.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.051+0000 7fd4c7fff640 1 Processor -- start 2023-11-27T20:41:40.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.051+0000 7fd4c7fff640 1 -- start start 2023-11-27T20:41:40.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.051+0000 7fd4c7fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4c806e000 0x7fd4c81f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4c7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 0x7fd4c80a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4c7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c8155f60 0x7fd4c80a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4c7fff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c80a49d0 con 0x7fd4c80c1100 2023-11-27T20:41:40.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4c7fff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81f2390 con 0x7fd4c806e000 2023-11-27T20:41:40.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4c7fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81f2670 con 0x7fd4c8155f60 2023-11-27T20:41:40.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4bffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 0x7fd4c80a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4bffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 0x7fd4c80a2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52068/0 (socket says 172.21.15.91:52068) 2023-11-27T20:41:40.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4bffff640 1 -- 172.21.15.91:0/4105756412 learned_addr learned my addr 172.21.15.91:0/4105756412 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:40.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4c6ffd640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4c806e000 0x7fd4c81f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4c77fe640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c8155f60 0x7fd4c80a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4bffff640 1 -- 172.21.15.91:0/4105756412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c8155f60 msgr2=0x7fd4c80a32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4bffff640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c8155f60 0x7fd4c80a32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4bffff640 1 -- 172.21.15.91:0/4105756412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4c806e000 msgr2=0x7fd4c81f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4bffff640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4c806e000 0x7fd4c81f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.052+0000 7fd4bffff640 1 -- 172.21.15.91:0/4105756412 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c0009b30 con 0x7fd4c80c1100 2023-11-27T20:41:40.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.053+0000 7fd4bffff640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 0x7fd4c80a2d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000c4b0 tx=0x7fd4b000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:40.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.053+0000 7fd4c4ff9640 1 -- 172.21.15.91:0/4105756412 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0005480 con 0x7fd4c80c1100 2023-11-27T20:41:40.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.053+0000 7fd4c4ff9640 1 -- 172.21.15.91:0/4105756412 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b00035f0 con 0x7fd4c80c1100 2023-11-27T20:41:40.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.053+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4105756412 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c80a4c20 con 0x7fd4c80c1100 2023-11-27T20:41:40.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.053+0000 7fd4c4ff9640 1 -- 172.21.15.91:0/4105756412 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00039e0 con 0x7fd4c80c1100 2023-11-27T20:41:40.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.053+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4105756412 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c80a3dd0 con 0x7fd4c80c1100 2023-11-27T20:41:40.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.054+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4105756412 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c80c09c0 con 0x7fd4c80c1100 2023-11-27T20:41:40.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.055+0000 7fd4c4ff9640 1 -- 172.21.15.91:0/4105756412 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd4b0003b40 con 0x7fd4c80c1100 2023-11-27T20:41:40.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.056+0000 7fd4c4ff9640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd4a806b1f0 0x7fd4a806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.056+0000 7fd4c4ff9640 1 -- 172.21.15.91:0/4105756412 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4b0088fc0 con 0x7fd4c80c1100 2023-11-27T20:41:40.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.056+0000 7fd4c6ffd640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd4a806b1f0 0x7fd4a806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.057+0000 7fd4c6ffd640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd4a806b1f0 0x7fd4a806d6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8006fd0 tx=0x7fd4b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:40.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.060+0000 7fd4c4ff9640 1 -- 172.21.15.91:0/4105756412 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd4b0053ce0 con 0x7fd4c80c1100 2023-11-27T20:41:40.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.247+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4105756412 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4c80a5ee0 con 0x7fd4a806b1f0 2023-11-27T20:41:40.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.267+0000 7fd4c4ff9640 1 -- 172.21.15.91:0/4105756412 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264468 (secure 0 0 0) 0x7fd4c80a5ee0 con 0x7fd4a806b1f0 2023-11-27T20:41:40.273 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:40.274 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:41:40.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.273+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4105756412 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd4a806b1f0 msgr2=0x7fd4a806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.273+0000 7fd4c7fff640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd4a806b1f0 0x7fd4a806d6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8006fd0 tx=0x7fd4b8008040 comp rx=0 tx=0).stop 2023-11-27T20:41:40.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.273+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4105756412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 msgr2=0x7fd4c80a2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.273+0000 7fd4c7fff640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 0x7fd4c80a2d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000c4b0 tx=0x7fd4b000c970 comp rx=0 tx=0).stop 2023-11-27T20:41:40.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.273+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4105756412 shutdown_connections 2023-11-27T20:41:40.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.273+0000 7fd4c7fff640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c8155f60 0x7fd4c80a32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.273+0000 7fd4c7fff640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4c80c1100 0x7fd4c80a2d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.273+0000 7fd4c7fff640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd4a806b1f0 0x7fd4a806d6b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.273+0000 7fd4c7fff640 1 --2- 172.21.15.91:0/4105756412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4c806e000 0x7fd4c81f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.273+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4105756412 >> 172.21.15.91:0/4105756412 conn(0x7fd4c80a77f0 msgr2=0x7fd4c80a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:40.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.274+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4105756412 shutdown_connections 2023-11-27T20:41:40.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.274+0000 7fd4c7fff640 1 -- 172.21.15.91:0/4105756412 wait complete. 2023-11-27T20:41:40.295 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-27T20:41:39.373784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001741"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568422+0000","last_change":"2023-11-27T20:41:35.210030+0000","last_active":"2023-11-27T20:41:36.568422+0000","last_peered":"2023-11-27T20:41:36.568422+0000","last_clean":"2023-11-27T20:41:36.568422+0000","last_became_active":"2023-11-27T20:41:35.209584+0000","last_became_peered":"2023-11-27T20:41:35.209584+0000","last_unstale":"2023-11-27T20:41:36.568422+0000","last_undegraded":"2023-11-27T20:41:36.568422+0000","last_fullsized":"2023-11-27T20:41:36.568422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:25:37.197535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169518+0000","last_change":"2023-11-27T20:41:35.204048+0000","last_active":"2023-11-27T20:41:36.169518+0000","last_peered":"2023-11-27T20:41:36.169518+0000","last_clean":"2023-11-27T20:41:36.169518+0000","last_became_active":"2023-11-27T20:41:35.203609+0000","last_became_peered":"2023-11-27T20:41:35.203609+0000","last_unstale":"2023-11-27T20:41:36.169518+0000","last_undegraded":"2023-11-27T20:41:36.169518+0000","last_fullsized":"2023-11-27T20:41:36.169518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907501+0000","last_change":"2023-11-27T20:41:35.196593+0000","last_active":"2023-11-27T20:41:36.907501+0000","last_peered":"2023-11-27T20:41:36.907501+0000","last_clean":"2023-11-27T20:41:36.907501+0000","last_became_active":"2023-11-27T20:41:35.196245+0000","last_became_peered":"2023-11-27T20:41:35.196245+0000","last_unstale":"2023-11-27T20:41:36.907501+0000","last_undegraded":"2023-11-27T20:41:36.907501+0000","last_fullsized":"2023-11-27T20:41:36.907501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907385+0000","last_change":"2023-11-27T20:41:35.196161+0000","last_active":"2023-11-27T20:41:36.907385+0000","last_peered":"2023-11-27T20:41:36.907385+0000","last_clean":"2023-11-27T20:41:36.907385+0000","last_became_active":"2023-11-27T20:41:35.195574+0000","last_became_peered":"2023-11-27T20:41:35.195574+0000","last_unstale":"2023-11-27T20:41:36.907385+0000","last_undegraded":"2023-11-27T20:41:36.907385+0000","last_fullsized":"2023-11-27T20:41:36.907385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567605+0000","last_change":"2023-11-27T20:41:35.188022+0000","last_active":"2023-11-27T20:41:36.567605+0000","last_peered":"2023-11-27T20:41:36.567605+0000","last_clean":"2023-11-27T20:41:36.567605+0000","last_became_active":"2023-11-27T20:41:35.187210+0000","last_became_peered":"2023-11-27T20:41:35.187210+0000","last_unstale":"2023-11-27T20:41:36.567605+0000","last_undegraded":"2023-11-27T20:41:36.567605+0000","last_fullsized":"2023-11-27T20:41:36.567605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906752+0000","last_change":"2023-11-27T20:41:35.203796+0000","last_active":"2023-11-27T20:41:36.906752+0000","last_peered":"2023-11-27T20:41:36.906752+0000","last_clean":"2023-11-27T20:41:36.906752+0000","last_became_active":"2023-11-27T20:41:35.203512+0000","last_became_peered":"2023-11-27T20:41:35.203512+0000","last_unstale":"2023-11-27T20:41:36.906752+0000","last_undegraded":"2023-11-27T20:41:36.906752+0000","last_fullsized":"2023-11-27T20:41:36.906752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567353+0000","last_change":"2023-11-27T20:41:35.209043+0000","last_active":"2023-11-27T20:41:36.567353+0000","last_peered":"2023-11-27T20:41:36.567353+0000","last_clean":"2023-11-27T20:41:36.567353+0000","last_became_active":"2023-11-27T20:41:35.205308+0000","last_became_peered":"2023-11-27T20:41:35.205308+0000","last_unstale":"2023-11-27T20:41:36.567353+0000","last_undegraded":"2023-11-27T20:41:36.567353+0000","last_fullsized":"2023-11-27T20:41:36.567353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827128+0000","last_change":"2023-11-27T20:41:35.196320+0000","last_active":"2023-11-27T20:41:36.827128+0000","last_peered":"2023-11-27T20:41:36.827128+0000","last_clean":"2023-11-27T20:41:36.827128+0000","last_became_active":"2023-11-27T20:41:35.193843+0000","last_became_peered":"2023-11-27T20:41:35.193843+0000","last_unstale":"2023-11-27T20:41:36.827128+0000","last_undegraded":"2023-11-27T20:41:36.827128+0000","last_fullsized":"2023-11-27T20:41:36.827128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568420+0000","last_change":"2023-11-27T20:41:35.211496+0000","last_active":"2023-11-27T20:41:36.568420+0000","last_peered":"2023-11-27T20:41:36.568420+0000","last_clean":"2023-11-27T20:41:36.568420+0000","last_became_active":"2023-11-27T20:41:35.211125+0000","last_became_peered":"2023-11-27T20:41:35.211125+0000","last_unstale":"2023-11-27T20:41:36.568420+0000","last_undegraded":"2023-11-27T20:41:36.568420+0000","last_fullsized":"2023-11-27T20:41:36.568420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:13.910143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752742+0000","last_change":"2023-11-27T20:41:35.198670+0000","last_active":"2023-11-27T20:41:36.752742+0000","last_peered":"2023-11-27T20:41:36.752742+0000","last_clean":"2023-11-27T20:41:36.752742+0000","last_became_active":"2023-11-27T20:41:35.198295+0000","last_became_peered":"2023-11-27T20:41:35.198295+0000","last_unstale":"2023-11-27T20:41:36.752742+0000","last_undegraded":"2023-11-27T20:41:36.752742+0000","last_fullsized":"2023-11-27T20:41:36.752742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752376+0000","last_change":"2023-11-27T20:41:35.197788+0000","last_active":"2023-11-27T20:41:36.752376+0000","last_peered":"2023-11-27T20:41:36.752376+0000","last_clean":"2023-11-27T20:41:36.752376+0000","last_became_active":"2023-11-27T20:41:35.195764+0000","last_became_peered":"2023-11-27T20:41:35.195764+0000","last_unstale":"2023-11-27T20:41:36.752376+0000","last_undegraded":"2023-11-27T20:41:36.752376+0000","last_fullsized":"2023-11-27T20:41:36.752376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169976+0000","last_change":"2023-11-27T20:41:35.189694+0000","last_active":"2023-11-27T20:41:36.169976+0000","last_peered":"2023-11-27T20:41:36.169976+0000","last_clean":"2023-11-27T20:41:36.169976+0000","last_became_active":"2023-11-27T20:41:35.189217+0000","last_became_peered":"2023-11-27T20:41:35.189217+0000","last_unstale":"2023-11-27T20:41:36.169976+0000","last_undegraded":"2023-11-27T20:41:36.169976+0000","last_fullsized":"2023-11-27T20:41:36.169976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:50.810907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827472+0000","last_change":"2023-11-27T20:41:35.201904+0000","last_active":"2023-11-27T20:41:36.827472+0000","last_peered":"2023-11-27T20:41:36.827472+0000","last_clean":"2023-11-27T20:41:36.827472+0000","last_became_active":"2023-11-27T20:41:35.201580+0000","last_became_peered":"2023-11-27T20:41:35.201580+0000","last_unstale":"2023-11-27T20:41:36.827472+0000","last_undegraded":"2023-11-27T20:41:36.827472+0000","last_fullsized":"2023-11-27T20:41:36.827472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906514+0000","last_change":"2023-11-27T20:41:35.193681+0000","last_active":"2023-11-27T20:41:36.906514+0000","last_peered":"2023-11-27T20:41:36.906514+0000","last_clean":"2023-11-27T20:41:36.906514+0000","last_became_active":"2023-11-27T20:41:35.193411+0000","last_became_peered":"2023-11-27T20:41:35.193411+0000","last_unstale":"2023-11-27T20:41:36.906514+0000","last_undegraded":"2023-11-27T20:41:36.906514+0000","last_fullsized":"2023-11-27T20:41:36.906514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:23.300382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167585+0000","last_change":"2023-11-27T20:41:35.180375+0000","last_active":"2023-11-27T20:41:36.167585+0000","last_peered":"2023-11-27T20:41:36.167585+0000","last_clean":"2023-11-27T20:41:36.167585+0000","last_became_active":"2023-11-27T20:41:35.177730+0000","last_became_peered":"2023-11-27T20:41:35.177730+0000","last_unstale":"2023-11-27T20:41:36.167585+0000","last_undegraded":"2023-11-27T20:41:36.167585+0000","last_fullsized":"2023-11-27T20:41:36.167585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906675+0000","last_change":"2023-11-27T20:41:35.203805+0000","last_active":"2023-11-27T20:41:36.906675+0000","last_peered":"2023-11-27T20:41:36.906675+0000","last_clean":"2023-11-27T20:41:36.906675+0000","last_became_active":"2023-11-27T20:41:35.203287+0000","last_became_peered":"2023-11-27T20:41:35.203287+0000","last_unstale":"2023-11-27T20:41:36.906675+0000","last_undegraded":"2023-11-27T20:41:36.906675+0000","last_fullsized":"2023-11-27T20:41:36.906675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907572+0000","last_change":"2023-11-27T20:41:35.207783+0000","last_active":"2023-11-27T20:41:36.907572+0000","last_peered":"2023-11-27T20:41:36.907572+0000","last_clean":"2023-11-27T20:41:36.907572+0000","last_became_active":"2023-11-27T20:41:35.207485+0000","last_became_peered":"2023-11-27T20:41:35.207485+0000","last_unstale":"2023-11-27T20:41:36.907572+0000","last_undegraded":"2023-11-27T20:41:36.907572+0000","last_fullsized":"2023-11-27T20:41:36.907572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:30.836331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169370+0000","last_change":"2023-11-27T20:41:35.201010+0000","last_active":"2023-11-27T20:41:36.169370+0000","last_peered":"2023-11-27T20:41:36.169370+0000","last_clean":"2023-11-27T20:41:36.169370+0000","last_became_active":"2023-11-27T20:41:35.200679+0000","last_became_peered":"2023-11-27T20:41:35.200679+0000","last_unstale":"2023-11-27T20:41:36.169370+0000","last_undegraded":"2023-11-27T20:41:36.169370+0000","last_fullsized":"2023-11-27T20:41:36.169370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:04.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568398+0000","last_change":"2023-11-27T20:41:35.206268+0000","last_active":"2023-11-27T20:41:36.568398+0000","last_peered":"2023-11-27T20:41:36.568398+0000","last_clean":"2023-11-27T20:41:36.568398+0000","last_became_active":"2023-11-27T20:41:35.204792+0000","last_became_peered":"2023-11-27T20:41:35.204792+0000","last_unstale":"2023-11-27T20:41:36.568398+0000","last_undegraded":"2023-11-27T20:41:36.568398+0000","last_fullsized":"2023-11-27T20:41:36.568398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:03:54.961052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752345+0000","last_change":"2023-11-27T20:41:35.193226+0000","last_active":"2023-11-27T20:41:36.752345+0000","last_peered":"2023-11-27T20:41:36.752345+0000","last_clean":"2023-11-27T20:41:36.752345+0000","last_became_active":"2023-11-27T20:41:35.192897+0000","last_became_peered":"2023-11-27T20:41:35.192897+0000","last_unstale":"2023-11-27T20:41:36.752345+0000","last_undegraded":"2023-11-27T20:41:36.752345+0000","last_fullsized":"2023-11-27T20:41:36.752345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907015+0000","last_change":"2023-11-27T20:41:35.213004+0000","last_active":"2023-11-27T20:41:36.907015+0000","last_peered":"2023-11-27T20:41:36.907015+0000","last_clean":"2023-11-27T20:41:36.907015+0000","last_became_active":"2023-11-27T20:41:35.212784+0000","last_became_peered":"2023-11-27T20:41:35.212784+0000","last_unstale":"2023-11-27T20:41:36.907015+0000","last_undegraded":"2023-11-27T20:41:36.907015+0000","last_fullsized":"2023-11-27T20:41:36.907015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907089+0000","last_change":"2023-11-27T20:41:35.199481+0000","last_active":"2023-11-27T20:41:36.907089+0000","last_peered":"2023-11-27T20:41:36.907089+0000","last_clean":"2023-11-27T20:41:36.907089+0000","last_became_active":"2023-11-27T20:41:35.193493+0000","last_became_peered":"2023-11-27T20:41:35.193493+0000","last_unstale":"2023-11-27T20:41:36.907089+0000","last_undegraded":"2023-11-27T20:41:36.907089+0000","last_fullsized":"2023-11-27T20:41:36.907089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827405+0000","last_change":"2023-11-27T20:41:35.198176+0000","last_active":"2023-11-27T20:41:36.827405+0000","last_peered":"2023-11-27T20:41:36.827405+0000","last_clean":"2023-11-27T20:41:36.827405+0000","last_became_active":"2023-11-27T20:41:35.197867+0000","last_became_peered":"2023-11-27T20:41:35.197867+0000","last_unstale":"2023-11-27T20:41:36.827405+0000","last_undegraded":"2023-11-27T20:41:36.827405+0000","last_fullsized":"2023-11-27T20:41:36.827405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906931+0000","last_change":"2023-11-27T20:41:35.190147+0000","last_active":"2023-11-27T20:41:36.906931+0000","last_peered":"2023-11-27T20:41:36.906931+0000","last_clean":"2023-11-27T20:41:36.906931+0000","last_became_active":"2023-11-27T20:41:35.189833+0000","last_became_peered":"2023-11-27T20:41:35.189833+0000","last_unstale":"2023-11-27T20:41:36.906931+0000","last_undegraded":"2023-11-27T20:41:36.906931+0000","last_fullsized":"2023-11-27T20:41:36.906931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827821+0000","last_change":"2023-11-27T20:41:35.207689+0000","last_active":"2023-11-27T20:41:36.827821+0000","last_peered":"2023-11-27T20:41:36.827821+0000","last_clean":"2023-11-27T20:41:36.827821+0000","last_became_active":"2023-11-27T20:41:35.207388+0000","last_became_peered":"2023-11-27T20:41:35.207388+0000","last_unstale":"2023-11-27T20:41:36.827821+0000","last_undegraded":"2023-11-27T20:41:36.827821+0000","last_fullsized":"2023-11-27T20:41:36.827821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752892+0000","last_change":"2023-11-27T20:41:35.210588+0000","last_active":"2023-11-27T20:41:36.752892+0000","last_peered":"2023-11-27T20:41:36.752892+0000","last_clean":"2023-11-27T20:41:36.752892+0000","last_became_active":"2023-11-27T20:41:35.210373+0000","last_became_peered":"2023-11-27T20:41:35.210373+0000","last_unstale":"2023-11-27T20:41:36.752892+0000","last_undegraded":"2023-11-27T20:41:36.752892+0000","last_fullsized":"2023-11-27T20:41:36.752892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168202+0000","last_change":"2023-11-27T20:41:35.196031+0000","last_active":"2023-11-27T20:41:36.168202+0000","last_peered":"2023-11-27T20:41:36.168202+0000","last_clean":"2023-11-27T20:41:36.168202+0000","last_became_active":"2023-11-27T20:41:35.195780+0000","last_became_peered":"2023-11-27T20:41:35.195780+0000","last_unstale":"2023-11-27T20:41:36.168202+0000","last_undegraded":"2023-11-27T20:41:36.168202+0000","last_fullsized":"2023-11-27T20:41:36.168202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.828241+0000","last_change":"2023-11-27T20:41:35.195475+0000","last_active":"2023-11-27T20:41:36.828241+0000","last_peered":"2023-11-27T20:41:36.828241+0000","last_clean":"2023-11-27T20:41:36.828241+0000","last_became_active":"2023-11-27T20:41:35.194921+0000","last_became_peered":"2023-11-27T20:41:35.194921+0000","last_unstale":"2023-11-27T20:41:36.828241+0000","last_undegraded":"2023-11-27T20:41:36.828241+0000","last_fullsized":"2023-11-27T20:41:36.828241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906986+0000","last_change":"2023-11-27T20:41:35.200027+0000","last_active":"2023-11-27T20:41:36.906986+0000","last_peered":"2023-11-27T20:41:36.906986+0000","last_clean":"2023-11-27T20:41:36.906986+0000","last_became_active":"2023-11-27T20:41:35.199693+0000","last_became_peered":"2023-11-27T20:41:35.199693+0000","last_unstale":"2023-11-27T20:41:36.906986+0000","last_undegraded":"2023-11-27T20:41:36.906986+0000","last_fullsized":"2023-11-27T20:41:36.906986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907975+0000","last_change":"2023-11-27T20:41:35.200037+0000","last_active":"2023-11-27T20:41:36.907975+0000","last_peered":"2023-11-27T20:41:36.907975+0000","last_clean":"2023-11-27T20:41:36.907975+0000","last_became_active":"2023-11-27T20:41:35.199783+0000","last_became_peered":"2023-11-27T20:41:35.199783+0000","last_unstale":"2023-11-27T20:41:36.907975+0000","last_undegraded":"2023-11-27T20:41:36.907975+0000","last_fullsized":"2023-11-27T20:41:36.907975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:13.910143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168723+0000","last_change":"2023-11-27T20:41:35.191018+0000","last_active":"2023-11-27T20:41:36.168723+0000","last_peered":"2023-11-27T20:41:36.168723+0000","last_clean":"2023-11-27T20:41:36.168723+0000","last_became_active":"2023-11-27T20:41:35.189851+0000","last_became_peered":"2023-11-27T20:41:35.189851+0000","last_unstale":"2023-11-27T20:41:36.168723+0000","last_undegraded":"2023-11-27T20:41:36.168723+0000","last_fullsized":"2023-11-27T20:41:36.168723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:03.587578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751906+0000","last_change":"2023-11-27T20:41:35.200143+0000","last_active":"2023-11-27T20:41:36.751906+0000","last_peered":"2023-11-27T20:41:36.751906+0000","last_clean":"2023-11-27T20:41:36.751906+0000","last_became_active":"2023-11-27T20:41:35.199787+0000","last_became_peered":"2023-11-27T20:41:35.199787+0000","last_unstale":"2023-11-27T20:41:36.751906+0000","last_undegraded":"2023-11-27T20:41:36.751906+0000","last_fullsized":"2023-11-27T20:41:36.751906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169985+0000","last_change":"2023-11-27T20:41:35.191668+0000","last_active":"2023-11-27T20:41:36.169985+0000","last_peered":"2023-11-27T20:41:36.169985+0000","last_clean":"2023-11-27T20:41:36.169985+0000","last_became_active":"2023-11-27T20:41:35.191402+0000","last_became_peered":"2023-11-27T20:41:35.191402+0000","last_unstale":"2023-11-27T20:41:36.169985+0000","last_undegraded":"2023-11-27T20:41:36.169985+0000","last_fullsized":"2023-11-27T20:41:36.169985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:37:56.420323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.391181+0000","last_change":"2023-11-27T20:41:34.379346+0000","last_active":"2023-11-27T20:41:35.391181+0000","last_peered":"2023-11-27T20:41:35.391181+0000","last_clean":"2023-11-27T20:41:35.391181+0000","last_became_active":"2023-11-27T20:41:34.379070+0000","last_became_peered":"2023-11-27T20:41:34.379070+0000","last_unstale":"2023-11-27T20:41:35.391181+0000","last_undegraded":"2023-11-27T20:41:35.391181+0000","last_fullsized":"2023-11-27T20:41:35.391181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:30.381280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907378+0000","last_change":"2023-11-27T20:41:35.208886+0000","last_active":"2023-11-27T20:41:36.907378+0000","last_peered":"2023-11-27T20:41:36.907378+0000","last_clean":"2023-11-27T20:41:36.907378+0000","last_became_active":"2023-11-27T20:41:35.208443+0000","last_became_peered":"2023-11-27T20:41:35.208443+0000","last_unstale":"2023-11-27T20:41:36.907378+0000","last_undegraded":"2023-11-27T20:41:36.907378+0000","last_fullsized":"2023-11-27T20:41:36.907378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.394357+0000","last_change":"2023-11-27T20:41:34.376598+0000","last_active":"2023-11-27T20:41:35.394357+0000","last_peered":"2023-11-27T20:41:35.394357+0000","last_clean":"2023-11-27T20:41:35.394357+0000","last_became_active":"2023-11-27T20:41:34.375938+0000","last_became_peered":"2023-11-27T20:41:34.375938+0000","last_unstale":"2023-11-27T20:41:35.394357+0000","last_undegraded":"2023-11-27T20:41:35.394357+0000","last_fullsized":"2023-11-27T20:41:35.394357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.189265+0000","last_change":"2023-11-27T20:41:34.365856+0000","last_active":"2023-11-27T20:41:35.189265+0000","last_peered":"2023-11-27T20:41:35.189265+0000","last_clean":"2023-11-27T20:41:35.189265+0000","last_became_active":"2023-11-27T20:41:34.365263+0000","last_became_peered":"2023-11-27T20:41:34.365263+0000","last_unstale":"2023-11-27T20:41:35.189265+0000","last_undegraded":"2023-11-27T20:41:35.189265+0000","last_fullsized":"2023-11-27T20:41:35.189265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:22.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827358+0000","last_change":"2023-11-27T20:41:35.194411+0000","last_active":"2023-11-27T20:41:36.827358+0000","last_peered":"2023-11-27T20:41:36.827358+0000","last_clean":"2023-11-27T20:41:36.827358+0000","last_became_active":"2023-11-27T20:41:35.193870+0000","last_became_peered":"2023-11-27T20:41:35.193870+0000","last_unstale":"2023-11-27T20:41:36.827358+0000","last_undegraded":"2023-11-27T20:41:36.827358+0000","last_fullsized":"2023-11-27T20:41:36.827358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.184215+0000","last_change":"2023-11-27T20:41:34.384607+0000","last_active":"2023-11-27T20:41:35.184215+0000","last_peered":"2023-11-27T20:41:35.184215+0000","last_clean":"2023-11-27T20:41:35.184215+0000","last_became_active":"2023-11-27T20:41:34.384325+0000","last_became_peered":"2023-11-27T20:41:34.384325+0000","last_unstale":"2023-11-27T20:41:35.184215+0000","last_undegraded":"2023-11-27T20:41:35.184215+0000","last_fullsized":"2023-11-27T20:41:35.184215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:56.618777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167329+0000","last_change":"2023-11-27T20:41:35.186364+0000","last_active":"2023-11-27T20:41:36.167329+0000","last_peered":"2023-11-27T20:41:36.167329+0000","last_clean":"2023-11-27T20:41:36.167329+0000","last_became_active":"2023-11-27T20:41:35.185990+0000","last_became_peered":"2023-11-27T20:41:35.185990+0000","last_unstale":"2023-11-27T20:41:36.167329+0000","last_undegraded":"2023-11-27T20:41:36.167329+0000","last_fullsized":"2023-11-27T20:41:36.167329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.182202+0000","last_change":"2023-11-27T20:41:34.386881+0000","last_active":"2023-11-27T20:41:35.182202+0000","last_peered":"2023-11-27T20:41:35.182202+0000","last_clean":"2023-11-27T20:41:35.182202+0000","last_became_active":"2023-11-27T20:41:34.385617+0000","last_became_peered":"2023-11-27T20:41:34.385617+0000","last_unstale":"2023-11-27T20:41:35.182202+0000","last_undegraded":"2023-11-27T20:41:35.182202+0000","last_fullsized":"2023-11-27T20:41:35.182202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:04:42.284326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907976+0000","last_change":"2023-11-27T20:41:35.213263+0000","last_active":"2023-11-27T20:41:36.907976+0000","last_peered":"2023-11-27T20:41:36.907976+0000","last_clean":"2023-11-27T20:41:36.907976+0000","last_became_active":"2023-11-27T20:41:35.212945+0000","last_became_peered":"2023-11-27T20:41:35.212945+0000","last_unstale":"2023-11-27T20:41:36.907976+0000","last_undegraded":"2023-11-27T20:41:36.907976+0000","last_fullsized":"2023-11-27T20:41:36.907976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:31:23.723316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.188149+0000","last_change":"2023-11-27T20:41:34.390261+0000","last_active":"2023-11-27T20:41:35.188149+0000","last_peered":"2023-11-27T20:41:35.188149+0000","last_clean":"2023-11-27T20:41:35.188149+0000","last_became_active":"2023-11-27T20:41:34.389520+0000","last_became_peered":"2023-11-27T20:41:34.389520+0000","last_unstale":"2023-11-27T20:41:35.188149+0000","last_undegraded":"2023-11-27T20:41:35.188149+0000","last_fullsized":"2023-11-27T20:41:35.188149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:10.528078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907207+0000","last_change":"2023-11-27T20:41:35.203369+0000","last_active":"2023-11-27T20:41:36.907207+0000","last_peered":"2023-11-27T20:41:36.907207+0000","last_clean":"2023-11-27T20:41:36.907207+0000","last_became_active":"2023-11-27T20:41:35.203042+0000","last_became_peered":"2023-11-27T20:41:35.203042+0000","last_unstale":"2023-11-27T20:41:36.907207+0000","last_undegraded":"2023-11-27T20:41:36.907207+0000","last_fullsized":"2023-11-27T20:41:36.907207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399508+0000","last_change":"2023-11-27T20:41:34.385832+0000","last_active":"2023-11-27T20:41:35.399508+0000","last_peered":"2023-11-27T20:41:35.399508+0000","last_clean":"2023-11-27T20:41:35.399508+0000","last_became_active":"2023-11-27T20:41:34.384636+0000","last_became_peered":"2023-11-27T20:41:34.384636+0000","last_unstale":"2023-11-27T20:41:35.399508+0000","last_undegraded":"2023-11-27T20:41:35.399508+0000","last_fullsized":"2023-11-27T20:41:35.399508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:03.773317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.170135+0000","last_change":"2023-11-27T20:41:35.188819+0000","last_active":"2023-11-27T20:41:36.170135+0000","last_peered":"2023-11-27T20:41:36.170135+0000","last_clean":"2023-11-27T20:41:36.170135+0000","last_became_active":"2023-11-27T20:41:35.188292+0000","last_became_peered":"2023-11-27T20:41:35.188292+0000","last_unstale":"2023-11-27T20:41:36.170135+0000","last_undegraded":"2023-11-27T20:41:36.170135+0000","last_fullsized":"2023-11-27T20:41:36.170135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:04.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399033+0000","last_change":"2023-11-27T20:41:34.363549+0000","last_active":"2023-11-27T20:41:35.399033+0000","last_peered":"2023-11-27T20:41:35.399033+0000","last_clean":"2023-11-27T20:41:35.399033+0000","last_became_active":"2023-11-27T20:41:34.361181+0000","last_became_peered":"2023-11-27T20:41:34.361181+0000","last_unstale":"2023-11-27T20:41:35.399033+0000","last_undegraded":"2023-11-27T20:41:35.399033+0000","last_fullsized":"2023-11-27T20:41:35.399033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:03.773317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567699+0000","last_change":"2023-11-27T20:41:35.211117+0000","last_active":"2023-11-27T20:41:36.567699+0000","last_peered":"2023-11-27T20:41:36.567699+0000","last_clean":"2023-11-27T20:41:36.567699+0000","last_became_active":"2023-11-27T20:41:35.206668+0000","last_became_peered":"2023-11-27T20:41:35.206668+0000","last_unstale":"2023-11-27T20:41:36.567699+0000","last_undegraded":"2023-11-27T20:41:36.567699+0000","last_fullsized":"2023-11-27T20:41:36.567699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399355+0000","last_change":"2023-11-27T20:41:34.375628+0000","last_active":"2023-11-27T20:41:35.399355+0000","last_peered":"2023-11-27T20:41:35.399355+0000","last_clean":"2023-11-27T20:41:35.399355+0000","last_became_active":"2023-11-27T20:41:34.375164+0000","last_became_peered":"2023-11-27T20:41:34.375164+0000","last_unstale":"2023-11-27T20:41:35.399355+0000","last_undegraded":"2023-11-27T20:41:35.399355+0000","last_fullsized":"2023-11-27T20:41:35.399355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907003+0000","last_change":"2023-11-27T20:41:35.206246+0000","last_active":"2023-11-27T20:41:36.907003+0000","last_peered":"2023-11-27T20:41:36.907003+0000","last_clean":"2023-11-27T20:41:36.907003+0000","last_became_active":"2023-11-27T20:41:35.205741+0000","last_became_peered":"2023-11-27T20:41:35.205741+0000","last_unstale":"2023-11-27T20:41:36.907003+0000","last_undegraded":"2023-11-27T20:41:36.907003+0000","last_fullsized":"2023-11-27T20:41:36.907003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.186433+0000","last_change":"2023-11-27T20:41:34.383993+0000","last_active":"2023-11-27T20:41:35.186433+0000","last_peered":"2023-11-27T20:41:35.186433+0000","last_clean":"2023-11-27T20:41:35.186433+0000","last_became_active":"2023-11-27T20:41:34.383739+0000","last_became_peered":"2023-11-27T20:41:34.383739+0000","last_unstale":"2023-11-27T20:41:35.186433+0000","last_undegraded":"2023-11-27T20:41:35.186433+0000","last_fullsized":"2023-11-27T20:41:35.186433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:17.468682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567699+0000","last_change":"2023-11-27T20:41:35.193841+0000","last_active":"2023-11-27T20:41:36.567699+0000","last_peered":"2023-11-27T20:41:36.567699+0000","last_clean":"2023-11-27T20:41:36.567699+0000","last_became_active":"2023-11-27T20:41:35.192848+0000","last_became_peered":"2023-11-27T20:41:35.192848+0000","last_unstale":"2023-11-27T20:41:36.567699+0000","last_undegraded":"2023-11-27T20:41:36.567699+0000","last_fullsized":"2023-11-27T20:41:36.567699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:09.396414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.173511+0000","last_change":"2023-11-27T20:41:34.376129+0000","last_active":"2023-11-27T20:41:35.173511+0000","last_peered":"2023-11-27T20:41:35.173511+0000","last_clean":"2023-11-27T20:41:35.173511+0000","last_became_active":"2023-11-27T20:41:34.375804+0000","last_became_peered":"2023-11-27T20:41:34.375804+0000","last_unstale":"2023-11-27T20:41:35.173511+0000","last_undegraded":"2023-11-27T20:41:35.173511+0000","last_fullsized":"2023-11-27T20:41:35.173511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:45:59.175653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751925+0000","last_change":"2023-11-27T20:41:35.196670+0000","last_active":"2023-11-27T20:41:36.751925+0000","last_peered":"2023-11-27T20:41:36.751925+0000","last_clean":"2023-11-27T20:41:36.751925+0000","last_became_active":"2023-11-27T20:41:35.196378+0000","last_became_peered":"2023-11-27T20:41:35.196378+0000","last_unstale":"2023-11-27T20:41:36.751925+0000","last_undegraded":"2023-11-27T20:41:36.751925+0000","last_fullsized":"2023-11-27T20:41:36.751925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399674+0000","last_change":"2023-11-27T20:41:34.372374+0000","last_active":"2023-11-27T20:41:35.399674+0000","last_peered":"2023-11-27T20:41:35.399674+0000","last_clean":"2023-11-27T20:41:35.399674+0000","last_became_active":"2023-11-27T20:41:34.371956+0000","last_became_peered":"2023-11-27T20:41:34.371956+0000","last_unstale":"2023-11-27T20:41:35.399674+0000","last_undegraded":"2023-11-27T20:41:35.399674+0000","last_fullsized":"2023-11-27T20:41:35.399674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:09:02.084275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567520+0000","last_change":"2023-11-27T20:41:35.209749+0000","last_active":"2023-11-27T20:41:36.567520+0000","last_peered":"2023-11-27T20:41:36.567520+0000","last_clean":"2023-11-27T20:41:36.567520+0000","last_became_active":"2023-11-27T20:41:35.209421+0000","last_became_peered":"2023-11-27T20:41:35.209421+0000","last_unstale":"2023-11-27T20:41:36.567520+0000","last_undegraded":"2023-11-27T20:41:36.567520+0000","last_fullsized":"2023-11-27T20:41:36.567520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.397573+0000","last_change":"2023-11-27T20:41:34.381268+0000","last_active":"2023-11-27T20:41:35.397573+0000","last_peered":"2023-11-27T20:41:35.397573+0000","last_clean":"2023-11-27T20:41:35.397573+0000","last_became_active":"2023-11-27T20:41:34.379765+0000","last_became_peered":"2023-11-27T20:41:34.379765+0000","last_unstale":"2023-11-27T20:41:35.397573+0000","last_undegraded":"2023-11-27T20:41:35.397573+0000","last_fullsized":"2023-11-27T20:41:35.397573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:07.467417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568439+0000","last_change":"2023-11-27T20:41:35.210232+0000","last_active":"2023-11-27T20:41:36.568439+0000","last_peered":"2023-11-27T20:41:36.568439+0000","last_clean":"2023-11-27T20:41:36.568439+0000","last_became_active":"2023-11-27T20:41:35.209143+0000","last_became_peered":"2023-11-27T20:41:35.209143+0000","last_unstale":"2023-11-27T20:41:36.568439+0000","last_undegraded":"2023-11-27T20:41:36.568439+0000","last_fullsized":"2023-11-27T20:41:36.568439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:31:23.723316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395121+0000","last_change":"2023-11-27T20:41:34.380235+0000","last_active":"2023-11-27T20:41:35.395121+0000","last_peered":"2023-11-27T20:41:35.395121+0000","last_clean":"2023-11-27T20:41:35.395121+0000","last_became_active":"2023-11-27T20:41:34.379940+0000","last_became_peered":"2023-11-27T20:41:34.379940+0000","last_unstale":"2023-11-27T20:41:35.395121+0000","last_undegraded":"2023-11-27T20:41:35.395121+0000","last_fullsized":"2023-11-27T20:41:35.395121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568652+0000","last_change":"2023-11-27T20:41:35.214260+0000","last_active":"2023-11-27T20:41:36.568652+0000","last_peered":"2023-11-27T20:41:36.568652+0000","last_clean":"2023-11-27T20:41:36.568652+0000","last_became_active":"2023-11-27T20:41:35.213814+0000","last_became_peered":"2023-11-27T20:41:35.213814+0000","last_unstale":"2023-11-27T20:41:36.568652+0000","last_undegraded":"2023-11-27T20:41:36.568652+0000","last_fullsized":"2023-11-27T20:41:36.568652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:03.051157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.396870+0000","last_change":"2023-11-27T20:41:34.383025+0000","last_active":"2023-11-27T20:41:35.396870+0000","last_peered":"2023-11-27T20:41:35.396870+0000","last_clean":"2023-11-27T20:41:35.396870+0000","last_became_active":"2023-11-27T20:41:34.382672+0000","last_became_peered":"2023-11-27T20:41:34.382672+0000","last_unstale":"2023-11-27T20:41:35.396870+0000","last_undegraded":"2023-11-27T20:41:35.396870+0000","last_fullsized":"2023-11-27T20:41:35.396870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907802+0000","last_change":"2023-11-27T20:41:35.195935+0000","last_active":"2023-11-27T20:41:36.907802+0000","last_peered":"2023-11-27T20:41:36.907802+0000","last_clean":"2023-11-27T20:41:36.907802+0000","last_became_active":"2023-11-27T20:41:35.195208+0000","last_became_peered":"2023-11-27T20:41:35.195208+0000","last_unstale":"2023-11-27T20:41:36.907802+0000","last_undegraded":"2023-11-27T20:41:36.907802+0000","last_fullsized":"2023-11-27T20:41:36.907802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:03:54.961052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.166681+0000","last_change":"2023-11-27T20:41:34.386973+0000","last_active":"2023-11-27T20:41:35.166681+0000","last_peered":"2023-11-27T20:41:35.166681+0000","last_clean":"2023-11-27T20:41:35.166681+0000","last_became_active":"2023-11-27T20:41:34.386649+0000","last_became_peered":"2023-11-27T20:41:34.386649+0000","last_unstale":"2023-11-27T20:41:35.166681+0000","last_undegraded":"2023-11-27T20:41:35.166681+0000","last_fullsized":"2023-11-27T20:41:35.166681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:07.467417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568068+0000","last_change":"2023-11-27T20:41:35.211346+0000","last_active":"2023-11-27T20:41:36.568068+0000","last_peered":"2023-11-27T20:41:36.568068+0000","last_clean":"2023-11-27T20:41:36.568068+0000","last_became_active":"2023-11-27T20:41:35.210844+0000","last_became_peered":"2023-11-27T20:41:35.210844+0000","last_unstale":"2023-11-27T20:41:36.568068+0000","last_undegraded":"2023-11-27T20:41:36.568068+0000","last_fullsized":"2023-11-27T20:41:36.568068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:30.836331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177748+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:41:35.177748+0000","last_peered":"2023-11-27T20:41:35.177748+0000","last_clean":"2023-11-27T20:41:35.177748+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:41:35.177748+0000","last_undegraded":"2023-11-27T20:41:35.177748+0000","last_fullsized":"2023-11-27T20:41:35.177748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.185862+0000","last_change":"2023-11-27T20:41:34.388453+0000","last_active":"2023-11-27T20:41:35.185862+0000","last_peered":"2023-11-27T20:41:35.185862+0000","last_clean":"2023-11-27T20:41:35.185862+0000","last_became_active":"2023-11-27T20:41:34.388237+0000","last_became_peered":"2023-11-27T20:41:34.388237+0000","last_unstale":"2023-11-27T20:41:35.185862+0000","last_undegraded":"2023-11-27T20:41:35.185862+0000","last_fullsized":"2023-11-27T20:41:35.185862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:49.304546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827823+0000","last_change":"2023-11-27T20:41:35.192084+0000","last_active":"2023-11-27T20:41:36.827823+0000","last_peered":"2023-11-27T20:41:36.827823+0000","last_clean":"2023-11-27T20:41:36.827823+0000","last_became_active":"2023-11-27T20:41:35.190701+0000","last_became_peered":"2023-11-27T20:41:35.190701+0000","last_unstale":"2023-11-27T20:41:36.827823+0000","last_undegraded":"2023-11-27T20:41:36.827823+0000","last_fullsized":"2023-11-27T20:41:36.827823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177479+0000","last_change":"2023-11-27T20:41:34.388350+0000","last_active":"2023-11-27T20:41:35.177479+0000","last_peered":"2023-11-27T20:41:35.177479+0000","last_clean":"2023-11-27T20:41:35.177479+0000","last_became_active":"2023-11-27T20:41:34.388078+0000","last_became_peered":"2023-11-27T20:41:34.388078+0000","last_unstale":"2023-11-27T20:41:35.177479+0000","last_undegraded":"2023-11-27T20:41:35.177479+0000","last_fullsized":"2023-11-27T20:41:35.177479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906804+0000","last_change":"2023-11-27T20:41:35.208870+0000","last_active":"2023-11-27T20:41:36.906804+0000","last_peered":"2023-11-27T20:41:36.906804+0000","last_clean":"2023-11-27T20:41:36.906804+0000","last_became_active":"2023-11-27T20:41:35.208454+0000","last_became_peered":"2023-11-27T20:41:35.208454+0000","last_unstale":"2023-11-27T20:41:36.906804+0000","last_undegraded":"2023-11-27T20:41:36.906804+0000","last_fullsized":"2023-11-27T20:41:36.906804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:31.394309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.166972+0000","last_change":"2023-11-27T20:41:34.379312+0000","last_active":"2023-11-27T20:41:35.166972+0000","last_peered":"2023-11-27T20:41:35.166972+0000","last_clean":"2023-11-27T20:41:35.166972+0000","last_became_active":"2023-11-27T20:41:34.379064+0000","last_became_peered":"2023-11-27T20:41:34.379064+0000","last_unstale":"2023-11-27T20:41:35.166972+0000","last_undegraded":"2023-11-27T20:41:35.166972+0000","last_fullsized":"2023-11-27T20:41:35.166972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:37:55.407294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167324+0000","last_change":"2023-11-27T20:41:35.180034+0000","last_active":"2023-11-27T20:41:36.167324+0000","last_peered":"2023-11-27T20:41:36.167324+0000","last_clean":"2023-11-27T20:41:36.167324+0000","last_became_active":"2023-11-27T20:41:35.178994+0000","last_became_peered":"2023-11-27T20:41:35.178994+0000","last_unstale":"2023-11-27T20:41:36.167324+0000","last_undegraded":"2023-11-27T20:41:36.167324+0000","last_fullsized":"2023-11-27T20:41:36.167324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.192457+0000","last_change":"2023-11-27T20:41:34.383948+0000","last_active":"2023-11-27T20:41:35.192457+0000","last_peered":"2023-11-27T20:41:35.192457+0000","last_clean":"2023-11-27T20:41:35.192457+0000","last_became_active":"2023-11-27T20:41:34.383355+0000","last_became_peered":"2023-11-27T20:41:34.383355+0000","last_unstale":"2023-11-27T20:41:35.192457+0000","last_undegraded":"2023-11-27T20:41:35.192457+0000","last_fullsized":"2023-11-27T20:41:35.192457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:38.370465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169931+0000","last_change":"2023-11-27T20:41:35.204870+0000","last_active":"2023-11-27T20:41:36.169931+0000","last_peered":"2023-11-27T20:41:36.169931+0000","last_clean":"2023-11-27T20:41:36.169931+0000","last_became_active":"2023-11-27T20:41:35.204425+0000","last_became_peered":"2023-11-27T20:41:35.204425+0000","last_unstale":"2023-11-27T20:41:36.169931+0000","last_undegraded":"2023-11-27T20:41:36.169931+0000","last_fullsized":"2023-11-27T20:41:36.169931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:21.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.169452+0000","last_change":"2023-11-27T20:41:34.376734+0000","last_active":"2023-11-27T20:41:35.169452+0000","last_peered":"2023-11-27T20:41:35.169452+0000","last_clean":"2023-11-27T20:41:35.169452+0000","last_became_active":"2023-11-27T20:41:34.376427+0000","last_became_peered":"2023-11-27T20:41:34.376427+0000","last_unstale":"2023-11-27T20:41:35.169452+0000","last_undegraded":"2023-11-27T20:41:35.169452+0000","last_fullsized":"2023-11-27T20:41:35.169452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907828+0000","last_change":"2023-11-27T20:41:35.198109+0000","last_active":"2023-11-27T20:41:36.907828+0000","last_peered":"2023-11-27T20:41:36.907828+0000","last_clean":"2023-11-27T20:41:36.907828+0000","last_became_active":"2023-11-27T20:41:35.197772+0000","last_became_peered":"2023-11-27T20:41:35.197772+0000","last_unstale":"2023-11-27T20:41:36.907828+0000","last_undegraded":"2023-11-27T20:41:36.907828+0000","last_fullsized":"2023-11-27T20:41:36.907828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:25:37.197535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.185525+0000","last_change":"2023-11-27T20:41:34.387255+0000","last_active":"2023-11-27T20:41:35.185525+0000","last_peered":"2023-11-27T20:41:35.185525+0000","last_clean":"2023-11-27T20:41:35.185525+0000","last_became_active":"2023-11-27T20:41:34.386911+0000","last_became_peered":"2023-11-27T20:41:34.386911+0000","last_unstale":"2023-11-27T20:41:35.185525+0000","last_undegraded":"2023-11-27T20:41:35.185525+0000","last_fullsized":"2023-11-27T20:41:35.185525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:17.468682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168166+0000","last_change":"2023-11-27T20:41:35.179788+0000","last_active":"2023-11-27T20:41:36.168166+0000","last_peered":"2023-11-27T20:41:36.168166+0000","last_clean":"2023-11-27T20:41:36.168166+0000","last_became_active":"2023-11-27T20:41:35.179071+0000","last_became_peered":"2023-11-27T20:41:35.179071+0000","last_unstale":"2023-11-27T20:41:36.168166+0000","last_undegraded":"2023-11-27T20:41:36.168166+0000","last_fullsized":"2023-11-27T20:41:36.168166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.173101+0000","last_change":"2023-11-27T20:41:34.383651+0000","last_active":"2023-11-27T20:41:35.173101+0000","last_peered":"2023-11-27T20:41:35.173101+0000","last_clean":"2023-11-27T20:41:35.173101+0000","last_became_active":"2023-11-27T20:41:34.383295+0000","last_became_peered":"2023-11-27T20:41:34.383295+0000","last_unstale":"2023-11-27T20:41:35.173101+0000","last_undegraded":"2023-11-27T20:41:35.173101+0000","last_fullsized":"2023-11-27T20:41:35.173101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827815+0000","last_change":"2023-11-27T20:41:35.211366+0000","last_active":"2023-11-27T20:41:36.827815+0000","last_peered":"2023-11-27T20:41:36.827815+0000","last_clean":"2023-11-27T20:41:36.827815+0000","last_became_active":"2023-11-27T20:41:35.211001+0000","last_became_peered":"2023-11-27T20:41:35.211001+0000","last_unstale":"2023-11-27T20:41:36.827815+0000","last_undegraded":"2023-11-27T20:41:36.827815+0000","last_fullsized":"2023-11-27T20:41:36.827815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.394474+0000","last_change":"2023-11-27T20:41:34.385226+0000","last_active":"2023-11-27T20:41:35.394474+0000","last_peered":"2023-11-27T20:41:35.394474+0000","last_clean":"2023-11-27T20:41:35.394474+0000","last_became_active":"2023-11-27T20:41:34.384361+0000","last_became_peered":"2023-11-27T20:41:34.384361+0000","last_unstale":"2023-11-27T20:41:35.394474+0000","last_undegraded":"2023-11-27T20:41:35.394474+0000","last_fullsized":"2023-11-27T20:41:35.394474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:22.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906972+0000","last_change":"2023-11-27T20:41:35.201432+0000","last_active":"2023-11-27T20:41:36.906972+0000","last_peered":"2023-11-27T20:41:36.906972+0000","last_clean":"2023-11-27T20:41:36.906972+0000","last_became_active":"2023-11-27T20:41:35.201065+0000","last_became_peered":"2023-11-27T20:41:35.201065+0000","last_unstale":"2023-11-27T20:41:36.906972+0000","last_undegraded":"2023-11-27T20:41:36.906972+0000","last_fullsized":"2023-11-27T20:41:36.906972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177113+0000","last_change":"2023-11-27T20:41:34.389439+0000","last_active":"2023-11-27T20:41:35.177113+0000","last_peered":"2023-11-27T20:41:35.177113+0000","last_clean":"2023-11-27T20:41:35.177113+0000","last_became_active":"2023-11-27T20:41:34.389145+0000","last_became_peered":"2023-11-27T20:41:34.389145+0000","last_unstale":"2023-11-27T20:41:35.177113+0000","last_undegraded":"2023-11-27T20:41:35.177113+0000","last_fullsized":"2023-11-27T20:41:35.177113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169999+0000","last_change":"2023-11-27T20:41:35.189837+0000","last_active":"2023-11-27T20:41:36.169999+0000","last_peered":"2023-11-27T20:41:36.169999+0000","last_clean":"2023-11-27T20:41:36.169999+0000","last_became_active":"2023-11-27T20:41:35.189208+0000","last_became_peered":"2023-11-27T20:41:35.189208+0000","last_unstale":"2023-11-27T20:41:36.169999+0000","last_undegraded":"2023-11-27T20:41:36.169999+0000","last_fullsized":"2023-11-27T20:41:36.169999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:03.587578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.167206+0000","last_change":"2023-11-27T20:41:34.387256+0000","last_active":"2023-11-27T20:41:35.167206+0000","last_peered":"2023-11-27T20:41:35.167206+0000","last_clean":"2023-11-27T20:41:35.167206+0000","last_became_active":"2023-11-27T20:41:34.386923+0000","last_became_peered":"2023-11-27T20:41:34.386923+0000","last_unstale":"2023-11-27T20:41:35.167206+0000","last_undegraded":"2023-11-27T20:41:35.167206+0000","last_fullsized":"2023-11-27T20:41:35.167206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:20.494221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827602+0000","last_change":"2023-11-27T20:41:35.186083+0000","last_active":"2023-11-27T20:41:36.827602+0000","last_peered":"2023-11-27T20:41:36.827602+0000","last_clean":"2023-11-27T20:41:36.827602+0000","last_became_active":"2023-11-27T20:41:35.184168+0000","last_became_peered":"2023-11-27T20:41:35.184168+0000","last_unstale":"2023-11-27T20:41:36.827602+0000","last_undegraded":"2023-11-27T20:41:36.827602+0000","last_fullsized":"2023-11-27T20:41:36.827602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.168762+0000","last_change":"2023-11-27T20:41:34.378248+0000","last_active":"2023-11-27T20:41:35.168762+0000","last_peered":"2023-11-27T20:41:35.168762+0000","last_clean":"2023-11-27T20:41:35.168762+0000","last_became_active":"2023-11-27T20:41:34.376972+0000","last_became_peered":"2023-11-27T20:41:34.376972+0000","last_unstale":"2023-11-27T20:41:35.168762+0000","last_undegraded":"2023-11-27T20:41:35.168762+0000","last_fullsized":"2023-11-27T20:41:35.168762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827902+0000","last_change":"2023-11-27T20:41:35.199694+0000","last_active":"2023-11-27T20:41:36.827902+0000","last_peered":"2023-11-27T20:41:36.827902+0000","last_clean":"2023-11-27T20:41:36.827902+0000","last_became_active":"2023-11-27T20:41:35.198540+0000","last_became_peered":"2023-11-27T20:41:35.198540+0000","last_unstale":"2023-11-27T20:41:36.827902+0000","last_undegraded":"2023-11-27T20:41:36.827902+0000","last_fullsized":"2023-11-27T20:41:36.827902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.391944+0000","last_change":"2023-11-27T20:41:34.387556+0000","last_active":"2023-11-27T20:41:35.391944+0000","last_peered":"2023-11-27T20:41:35.391944+0000","last_clean":"2023-11-27T20:41:35.391944+0000","last_became_active":"2023-11-27T20:41:34.387316+0000","last_became_peered":"2023-11-27T20:41:34.387316+0000","last_unstale":"2023-11-27T20:41:35.391944+0000","last_undegraded":"2023-11-27T20:41:35.391944+0000","last_fullsized":"2023-11-27T20:41:35.391944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751980+0000","last_change":"2023-11-27T20:41:35.195068+0000","last_active":"2023-11-27T20:41:36.751980+0000","last_peered":"2023-11-27T20:41:36.751980+0000","last_clean":"2023-11-27T20:41:36.751980+0000","last_became_active":"2023-11-27T20:41:35.194784+0000","last_became_peered":"2023-11-27T20:41:35.194784+0000","last_unstale":"2023-11-27T20:41:36.751980+0000","last_undegraded":"2023-11-27T20:41:36.751980+0000","last_fullsized":"2023-11-27T20:41:36.751980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907555+0000","last_change":"2023-11-27T20:41:35.207667+0000","last_active":"2023-11-27T20:41:36.907555+0000","last_peered":"2023-11-27T20:41:36.907555+0000","last_clean":"2023-11-27T20:41:36.907555+0000","last_became_active":"2023-11-27T20:41:35.207323+0000","last_became_peered":"2023-11-27T20:41:35.207323+0000","last_unstale":"2023-11-27T20:41:36.907555+0000","last_undegraded":"2023-11-27T20:41:36.907555+0000","last_fullsized":"2023-11-27T20:41:36.907555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:09.396414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.396809+0000","last_change":"2023-11-27T20:41:34.386983+0000","last_active":"2023-11-27T20:41:35.396809+0000","last_peered":"2023-11-27T20:41:35.396809+0000","last_clean":"2023-11-27T20:41:35.396809+0000","last_became_active":"2023-11-27T20:41:34.386656+0000","last_became_peered":"2023-11-27T20:41:34.386656+0000","last_unstale":"2023-11-27T20:41:35.396809+0000","last_undegraded":"2023-11-27T20:41:35.396809+0000","last_fullsized":"2023-11-27T20:41:35.396809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907496+0000","last_change":"2023-11-27T20:41:35.191267+0000","last_active":"2023-11-27T20:41:36.907496+0000","last_peered":"2023-11-27T20:41:36.907496+0000","last_clean":"2023-11-27T20:41:36.907496+0000","last_became_active":"2023-11-27T20:41:35.190866+0000","last_became_peered":"2023-11-27T20:41:35.190866+0000","last_unstale":"2023-11-27T20:41:36.907496+0000","last_undegraded":"2023-11-27T20:41:36.907496+0000","last_fullsized":"2023-11-27T20:41:36.907496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395054+0000","last_change":"2023-11-27T20:41:34.390257+0000","last_active":"2023-11-27T20:41:35.395054+0000","last_peered":"2023-11-27T20:41:35.395054+0000","last_clean":"2023-11-27T20:41:35.395054+0000","last_became_active":"2023-11-27T20:41:34.389874+0000","last_became_peered":"2023-11-27T20:41:34.389874+0000","last_unstale":"2023-11-27T20:41:35.395054+0000","last_undegraded":"2023-11-27T20:41:35.395054+0000","last_fullsized":"2023-11-27T20:41:35.395054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:30.381280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907171+0000","last_change":"2023-11-27T20:41:35.202070+0000","last_active":"2023-11-27T20:41:36.907171+0000","last_peered":"2023-11-27T20:41:36.907171+0000","last_clean":"2023-11-27T20:41:36.907171+0000","last_became_active":"2023-11-27T20:41:35.201756+0000","last_became_peered":"2023-11-27T20:41:35.201756+0000","last_unstale":"2023-11-27T20:41:36.907171+0000","last_undegraded":"2023-11-27T20:41:36.907171+0000","last_fullsized":"2023-11-27T20:41:36.907171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395132+0000","last_change":"2023-11-27T20:41:34.378008+0000","last_active":"2023-11-27T20:41:35.395132+0000","last_peered":"2023-11-27T20:41:35.395132+0000","last_clean":"2023-11-27T20:41:35.395132+0000","last_became_active":"2023-11-27T20:41:34.377741+0000","last_became_peered":"2023-11-27T20:41:34.377741+0000","last_unstale":"2023-11-27T20:41:35.395132+0000","last_undegraded":"2023-11-27T20:41:35.395132+0000","last_fullsized":"2023-11-27T20:41:35.395132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:04:42.284326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827818+0000","last_change":"2023-11-27T20:41:35.205383+0000","last_active":"2023-11-27T20:41:36.827818+0000","last_peered":"2023-11-27T20:41:36.827818+0000","last_clean":"2023-11-27T20:41:36.827818+0000","last_became_active":"2023-11-27T20:41:35.203522+0000","last_became_peered":"2023-11-27T20:41:35.203522+0000","last_unstale":"2023-11-27T20:41:36.827818+0000","last_undegraded":"2023-11-27T20:41:36.827818+0000","last_fullsized":"2023-11-27T20:41:36.827818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399023+0000","last_change":"2023-11-27T20:41:34.384751+0000","last_active":"2023-11-27T20:41:35.399023+0000","last_peered":"2023-11-27T20:41:35.399023+0000","last_clean":"2023-11-27T20:41:35.399023+0000","last_became_active":"2023-11-27T20:41:34.384460+0000","last_became_peered":"2023-11-27T20:41:34.384460+0000","last_unstale":"2023-11-27T20:41:35.399023+0000","last_undegraded":"2023-11-27T20:41:35.399023+0000","last_fullsized":"2023-11-27T20:41:35.399023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.901}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0329999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8009999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.837}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9530000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.756}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0979999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.696}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.651}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.758}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:41:40.300 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T20:41:40.300 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-27T20:41:40.300 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-27T20:41:40.300 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-27T20:41:40.301 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-27T20:41:40.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.553+0000 7f75adb8f640 1 Processor -- start 2023-11-27T20:41:40.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.553+0000 7f75adb8f640 1 -- start start 2023-11-27T20:41:40.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.554+0000 7f75adb8f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f75a80c0440 0x7f75a80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.554+0000 7f75adb8f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f75a8072310 0x7f75a80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.554+0000 7f75adb8f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a8071e80 con 0x7f75a814c2e0 2023-11-27T20:41:40.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.554+0000 7f75adb8f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a8071470 con 0x7f75a8072310 2023-11-27T20:41:40.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.554+0000 7f75adb8f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a814c6c0 con 0x7f75a80c0440 2023-11-27T20:41:40.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.554+0000 7f75acb8d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f75a814c2e0 0x7f75a8152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56062/0 (socket says 172.21.15.91:56062) 2023-11-27T20:41:40.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.554+0000 7f75acb8d640 1 -- 172.21.15.91:0/3003654960 learned_addr learned my addr 172.21.15.91:0/3003654960 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:40.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.554+0000 7f75ad38e640 1 --2- 172.21.15.91:0/3003654960 >> v2:172.21.15.91:3300/0 conn(0x7f75a8072310 0x7f75a80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.555+0000 7f75a7fff640 1 --2- 172.21.15.91:0/3003654960 >> v2:172.21.15.183:3300/0 conn(0x7f75a80c0440 0x7f75a80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.555+0000 7f75ad38e640 1 -- 172.21.15.91:0/3003654960 >> v2:172.21.15.183:3300/0 conn(0x7f75a80c0440 msgr2=0x7f75a80c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.555+0000 7f75ad38e640 1 --2- 172.21.15.91:0/3003654960 >> v2:172.21.15.183:3300/0 conn(0x7f75a80c0440 0x7f75a80c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.555+0000 7f75ad38e640 1 -- 172.21.15.91:0/3003654960 >> v1:172.21.15.91:6789/0 conn(0x7f75a814c2e0 legacy=0x7f75a8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.555+0000 7f75ad38e640 1 -- 172.21.15.91:0/3003654960 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a806fdc0 con 0x7f75a8072310 2023-11-27T20:41:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.555+0000 7f75a77fe640 1 -- 172.21.15.91:0/3003654960 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557285914 0 0) 0x7f75a8071e80 con 0x7f75a814c2e0 2023-11-27T20:41:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.556+0000 7f75ad38e640 1 --2- 172.21.15.91:0/3003654960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 0x7f75a80a4d20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75a80678c0 tx=0x7f75a002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6988d0b787f1fe server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.556+0000 7f75a77fe640 1 -- 172.21.15.91:0/3003654960 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a002cb60 con 0x7f75a8072310 2023-11-27T20:41:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.556+0000 7f75a77fe640 1 -- 172.21.15.91:0/3003654960 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a002ccc0 con 0x7f75a8072310 2023-11-27T20:41:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.556+0000 7f75a77fe640 1 -- 172.21.15.91:0/3003654960 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0034660 con 0x7f75a8072310 2023-11-27T20:41:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.557+0000 7f75adb8f640 1 -- 172.21.15.91:0/3003654960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 msgr2=0x7f75a80a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.557+0000 7f75adb8f640 1 --2- 172.21.15.91:0/3003654960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 0x7f75a80a4d20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75a80678c0 tx=0x7f75a002bdb0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.557+0000 7f75adb8f640 1 -- 172.21.15.91:0/3003654960 shutdown_connections 2023-11-27T20:41:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.557+0000 7f75adb8f640 1 --2- 172.21.15.91:0/3003654960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 0x7f75a80a4d20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.557+0000 7f75adb8f640 1 --2- 172.21.15.91:0/3003654960 >> v2:172.21.15.183:3300/0 conn(0x7f75a80c0440 0x7f75a80c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.557+0000 7f75adb8f640 1 -- 172.21.15.91:0/3003654960 >> 172.21.15.91:0/3003654960 conn(0x7f75a80a77f0 msgr2=0x7f75a80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.557+0000 7f75adb8f640 1 -- 172.21.15.91:0/3003654960 shutdown_connections 2023-11-27T20:41:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.557+0000 7f75adb8f640 1 -- 172.21.15.91:0/3003654960 wait complete. 2023-11-27T20:41:40.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.559+0000 7f75adb8f640 1 Processor -- start 2023-11-27T20:41:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.559+0000 7f75adb8f640 1 -- start start 2023-11-27T20:41:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.560+0000 7f75adb8f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 0x7f75a81527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.560+0000 7f75adb8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a80c0440 0x7f75a81eba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.560+0000 7f75adb8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a814c2e0 0x7f75a8148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.560+0000 7f75adb8f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80ab250 con 0x7f75a8072310 2023-11-27T20:41:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.560+0000 7f75adb8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a81e7a80 con 0x7f75a814c2e0 2023-11-27T20:41:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.560+0000 7f75adb8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a81e82e0 con 0x7f75a80c0440 2023-11-27T20:41:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.560+0000 7f75acb8d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 0x7f75a81527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.560+0000 7f75acb8d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 0x7f75a81527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52086/0 (socket says 172.21.15.91:52086) 2023-11-27T20:41:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.560+0000 7f75acb8d640 1 -- 172.21.15.91:0/1650699948 learned_addr learned my addr 172.21.15.91:0/1650699948 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75a7fff640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a80c0440 0x7f75a81eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75ad38e640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a814c2e0 0x7f75a8148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75acb8d640 1 -- 172.21.15.91:0/1650699948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a80c0440 msgr2=0x7f75a81eba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75acb8d640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a80c0440 0x7f75a81eba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75acb8d640 1 -- 172.21.15.91:0/1650699948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a814c2e0 msgr2=0x7f75a8148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75acb8d640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a814c2e0 0x7f75a8148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75acb8d640 1 -- 172.21.15.91:0/1650699948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0009a70 con 0x7f75a8072310 2023-11-27T20:41:40.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75acb8d640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 0x7f75a81527c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f759800c4d0 tx=0x7f759800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:40.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75a57fa640 1 -- 172.21.15.91:0/1650699948 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75980074e0 con 0x7f75a8072310 2023-11-27T20:41:40.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75a57fa640 1 -- 172.21.15.91:0/1650699948 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598007660 con 0x7f75a8072310 2023-11-27T20:41:40.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75adb8f640 1 -- 172.21.15.91:0/1650699948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a81ebfc0 con 0x7f75a8072310 2023-11-27T20:41:40.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.561+0000 7f75a57fa640 1 -- 172.21.15.91:0/1650699948 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598004a20 con 0x7f75a8072310 2023-11-27T20:41:40.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.562+0000 7f75adb8f640 1 -- 172.21.15.91:0/1650699948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a81e7c90 con 0x7f75a8072310 2023-11-27T20:41:40.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.563+0000 7f75adb8f640 1 -- 172.21.15.91:0/1650699948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a804e840 con 0x7f75a8072310 2023-11-27T20:41:40.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.564+0000 7f75a57fa640 1 -- 172.21.15.91:0/1650699948 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7598004b80 con 0x7f75a8072310 2023-11-27T20:41:40.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.564+0000 7f75a57fa640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f758806b1c0 0x7f758806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:40.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.564+0000 7f75a57fa640 1 -- 172.21.15.91:0/1650699948 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7598088ed0 con 0x7f75a8072310 2023-11-27T20:41:40.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.565+0000 7f75a7fff640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f758806b1c0 0x7f758806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:40.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.565+0000 7f75a7fff640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f758806b1c0 0x7f758806d680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75a80a8800 tx=0x7f7590008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:40.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.569+0000 7f75a57fa640 1 -- 172.21.15.91:0/1650699948 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7598053c90 con 0x7f75a8072310 2023-11-27T20:41:40.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.800+0000 7f75adb8f640 1 -- 172.21.15.91:0/1650699948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f75a80c5380 con 0x7f75a8072310 2023-11-27T20:41:40.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.805+0000 7f75a57fa640 1 -- 172.21.15.91:0/1650699948 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171157 (secure 0 0 0) 0x7f7598018020 con 0x7f75a8072310 2023-11-27T20:41:40.808 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:40.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 -- 172.21.15.91:0/1650699948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f758806b1c0 msgr2=0x7f758806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f758806b1c0 0x7f758806d680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75a80a8800 tx=0x7f7590008040 comp rx=0 tx=0).stop 2023-11-27T20:41:40.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 -- 172.21.15.91:0/1650699948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 msgr2=0x7f75a81527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:40.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 0x7f75a81527c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f759800c4d0 tx=0x7f759800c990 comp rx=0 tx=0).stop 2023-11-27T20:41:40.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 -- 172.21.15.91:0/1650699948 shutdown_connections 2023-11-27T20:41:40.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f758806b1c0 0x7f758806d680 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a814c2e0 0x7f75a8148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a80c0440 0x7f75a81eba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 --2- 172.21.15.91:0/1650699948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a8072310 0x7f75a81527c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:40.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 -- 172.21.15.91:0/1650699948 >> 172.21.15.91:0/1650699948 conn(0x7f75a80a77f0 msgr2=0x7f75a80c24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:40.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 -- 172.21.15.91:0/1650699948 shutdown_connections 2023-11-27T20:41:40.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:40.810+0000 7f75adb8f640 1 -- 172.21.15.91:0/1650699948 wait complete. 2023-11-27T20:41:40.819 INFO:tasks.ceph.mds.d.smithi183.stderr:2023-11-27T20:41:40.818+0000 7fc63f67c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:41:40.827 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":70399081},{"type":"v1","addr":"172.21.15.91:6833","nonce":70399081}]},"active_addr":"172.21.15.91:6833/70399081","active_change":"2023-11-27T20:41:15.356057+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":4106534288}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":2738140742}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":1568783412}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":2634819562}]}]} 2023-11-27T20:41:40.831 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-27T20:41:40.831 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-27T20:41:40.831 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:41.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.032+0000 7f4d0b1b0640 1 Processor -- start 2023-11-27T20:41:41.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.032+0000 7f4d0b1b0640 1 -- start start 2023-11-27T20:41:41.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d0b1b0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4d040c1500 0x7f4d040c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d0b1b0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d040c06c0 con 0x7f4d040a9b40 2023-11-27T20:41:41.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d0b1b0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d040c1020 con 0x7f4d04155490 2023-11-27T20:41:41.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d0b1b0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d040a5820 con 0x7f4d040c1500 2023-11-27T20:41:41.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d03fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f4d040a9b40 0x7f4d040c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56066/0 (socket says 172.21.15.91:56066) 2023-11-27T20:41:41.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d03fff640 1 -- 172.21.15.91:0/2860026336 learned_addr learned my addr 172.21.15.91:0/2860026336 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:41.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d0974d640 1 --2- 172.21.15.91:0/2860026336 >> v2:172.21.15.91:3300/0 conn(0x7f4d040c1500 0x7f4d040c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d037fe640 1 -- 172.21.15.91:0/2860026336 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132295731 0 0) 0x7f4d040c06c0 con 0x7f4d040a9b40 2023-11-27T20:41:41.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d037fe640 1 -- 172.21.15.91:0/2860026336 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf4003520 con 0x7f4d040a9b40 2023-11-27T20:41:41.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d0974d640 1 -- 172.21.15.91:0/2860026336 >> v1:172.21.15.183:6789/0 conn(0x7f4d04155490 legacy=0x7f4d040a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d0974d640 1 -- 172.21.15.91:0/2860026336 >> v1:172.21.15.91:6789/0 conn(0x7f4d040a9b40 legacy=0x7f4d040c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.034+0000 7f4d0974d640 1 -- 172.21.15.91:0/2860026336 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040c0910 con 0x7f4d040c1500 2023-11-27T20:41:41.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.035+0000 7f4d0974d640 1 --2- 172.21.15.91:0/2860026336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d040c1500 0x7f4d040c2be0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009d90 tx=0x7f4cfc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c31c696ff040167 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:41.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.036+0000 7f4d037fe640 1 -- 172.21.15.91:0/2860026336 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc02cd00 con 0x7f4d040c1500 2023-11-27T20:41:41.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.036+0000 7f4d037fe640 1 -- 172.21.15.91:0/2860026336 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc02ce60 con 0x7f4d040c1500 2023-11-27T20:41:41.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.036+0000 7f4d037fe640 1 -- 172.21.15.91:0/2860026336 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc034660 con 0x7f4d040c1500 2023-11-27T20:41:41.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.036+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/2860026336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d040c1500 msgr2=0x7f4d040c2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.036+0000 7f4d0b1b0640 1 --2- 172.21.15.91:0/2860026336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d040c1500 0x7f4d040c2be0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009d90 tx=0x7f4cfc02bf50 comp rx=0 tx=0).stop 2023-11-27T20:41:41.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.036+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/2860026336 shutdown_connections 2023-11-27T20:41:41.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.036+0000 7f4d0b1b0640 1 --2- 172.21.15.91:0/2860026336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d040c1500 0x7f4d040c2be0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.036+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/2860026336 >> 172.21.15.91:0/2860026336 conn(0x7f4d0406a500 msgr2=0x7f4d0406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:41.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.036+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/2860026336 shutdown_connections 2023-11-27T20:41:41.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.036+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/2860026336 wait complete. 2023-11-27T20:41:41.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.038+0000 7f4d0b1b0640 1 Processor -- start 2023-11-27T20:41:41.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.038+0000 7f4d0b1b0640 1 -- start start 2023-11-27T20:41:41.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.039+0000 7f4d0b1b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d040c1500 0x7f4d0414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.039+0000 7f4d0b1b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d04155490 0x7f4d04151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.039+0000 7f4d0b1b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d0414a440 0x7f4d041515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.039+0000 7f4d0b1b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04152990 con 0x7f4d04155490 2023-11-27T20:41:41.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.039+0000 7f4d0b1b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04151af0 con 0x7f4d040c1500 2023-11-27T20:41:41.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.039+0000 7f4d0b1b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041eab70 con 0x7f4d0414a440 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.039+0000 7f4d03fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d04155490 0x7f4d04151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.039+0000 7f4d03fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d04155490 0x7f4d04151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52112/0 (socket says 172.21.15.91:52112) 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.039+0000 7f4d03fff640 1 -- 172.21.15.91:0/1643856917 learned_addr learned my addr 172.21.15.91:0/1643856917 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.039+0000 7f4d08f4c640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d040c1500 0x7f4d0414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d0974d640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d0414a440 0x7f4d041515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d03fff640 1 -- 172.21.15.91:0/1643856917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d0414a440 msgr2=0x7f4d041515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d03fff640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d0414a440 0x7f4d041515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d03fff640 1 -- 172.21.15.91:0/1643856917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d040c1500 msgr2=0x7f4d0414b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d03fff640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d040c1500 0x7f4d0414b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d03fff640 1 -- 172.21.15.91:0/1643856917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc009a70 con 0x7f4d04155490 2023-11-27T20:41:41.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d03fff640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d04155490 0x7f4d04151070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000c530 tx=0x7f4cf000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:41.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d017fa640 1 -- 172.21.15.91:0/1643856917 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0005ce0 con 0x7f4d04155490 2023-11-27T20:41:41.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d017fa640 1 -- 172.21.15.91:0/1643856917 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf0005e40 con 0x7f4d04155490 2023-11-27T20:41:41.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/1643856917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d041eae50 con 0x7f4d04155490 2023-11-27T20:41:41.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d017fa640 1 -- 172.21.15.91:0/1643856917 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00072b0 con 0x7f4d04155490 2023-11-27T20:41:41.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.040+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/1643856917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d04152ec0 con 0x7f4d04155490 2023-11-27T20:41:41.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.042+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/1643856917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d041530b0 con 0x7f4d04155490 2023-11-27T20:41:41.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.043+0000 7f4d017fa640 1 -- 172.21.15.91:0/1643856917 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4cf0007410 con 0x7f4d04155490 2023-11-27T20:41:41.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.044+0000 7f4d017fa640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4ce806b1c0 0x7f4ce806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.044+0000 7f4d017fa640 1 -- 172.21.15.91:0/1643856917 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cf0088fe0 con 0x7f4d04155490 2023-11-27T20:41:41.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.044+0000 7f4d08f4c640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4ce806b1c0 0x7f4ce806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.044+0000 7f4d08f4c640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4ce806b1c0 0x7f4ce806d680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000f60 tx=0x7f4cf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:41.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.048+0000 7f4d017fa640 1 -- 172.21.15.91:0/1643856917 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4cf0053e00 con 0x7f4d04155490 2023-11-27T20:41:41.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.239+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/1643856917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d04068350 con 0x7f4d04155490 2023-11-27T20:41:41.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.244+0000 7f4d017fa640 1 -- 172.21.15.91:0/1643856917 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f4cf0017020 con 0x7f4d04155490 2023-11-27T20:41:41.245 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:41.246 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.246+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/1643856917 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4ce806b1c0 msgr2=0x7f4ce806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.246+0000 7f4d0b1b0640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4ce806b1c0 0x7f4ce806d680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000f60 tx=0x7f4cf8009040 comp rx=0 tx=0).stop 2023-11-27T20:41:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.246+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/1643856917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d04155490 msgr2=0x7f4d04151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.246+0000 7f4d0b1b0640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d04155490 0x7f4d04151070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000c530 tx=0x7f4cf000c9f0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.246+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/1643856917 shutdown_connections 2023-11-27T20:41:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.246+0000 7f4d0b1b0640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d0414a440 0x7f4d041515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.246+0000 7f4d0b1b0640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d04155490 0x7f4d04151070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.247+0000 7f4d0b1b0640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4ce806b1c0 0x7f4ce806d680 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.247+0000 7f4d0b1b0640 1 --2- 172.21.15.91:0/1643856917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d040c1500 0x7f4d0414b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.247+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/1643856917 >> 172.21.15.91:0/1643856917 conn(0x7f4d0406a500 msgr2=0x7f4d040aa870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.247+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/1643856917 shutdown_connections 2023-11-27T20:41:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.247+0000 7f4d0b1b0640 1 -- 172.21.15.91:0/1643856917 wait complete. 2023-11-27T20:41:41.266 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-27T20:41:41.266 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:41.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.468+0000 7f8b4db90640 1 Processor -- start 2023-11-27T20:41:41.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.469+0000 7f8b4db90640 1 -- start start 2023-11-27T20:41:41.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.470+0000 7f8b4db90640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8b4806d0a0 0x7f8b48152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.470+0000 7f8b4db90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b480c3ea0 0x7f8b480c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.470+0000 7f8b4db90640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480c64a0 con 0x7f8b4814fd30 2023-11-27T20:41:41.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.470+0000 7f8b4db90640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b480c5c00 con 0x7f8b4806d0a0 2023-11-27T20:41:41.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.470+0000 7f8b4db90640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480c5ee0 con 0x7f8b480c3ea0 2023-11-27T20:41:41.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.470+0000 7f8b3effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8b4806d0a0 0x7f8b48152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.470+0000 7f8b3effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8b4806d0a0 0x7f8b48152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52124/0 (socket says 172.21.15.91:52124) 2023-11-27T20:41:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.470+0000 7f8b3effd640 1 -- 172.21.15.91:0/1550839351 learned_addr learned my addr 172.21.15.91:0/1550839351 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.471+0000 7f8b47fff640 1 --2- 172.21.15.91:0/1550839351 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b480c3ea0 0x7f8b480c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.471+0000 7f8b3effd640 1 -- 172.21.15.91:0/1550839351 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b480c3ea0 msgr2=0x7f8b480c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.471+0000 7f8b3effd640 1 --2- 172.21.15.91:0/1550839351 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b480c3ea0 0x7f8b480c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.471+0000 7f8b3effd640 1 -- 172.21.15.91:0/1550839351 >> v1:172.21.15.91:6789/0 conn(0x7f8b4814fd30 legacy=0x7f8b480a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.471+0000 7f8b3effd640 1 -- 172.21.15.91:0/1550839351 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480c61c0 con 0x7f8b4806d0a0 2023-11-27T20:41:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.471+0000 7f8b46ffd640 1 -- 172.21.15.91:0/1550839351 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823167072 0 0) 0x7f8b480c64a0 con 0x7f8b4814fd30 2023-11-27T20:41:41.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.472+0000 7f8b3effd640 1 --2- 172.21.15.91:0/1550839351 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4806d0a0 0x7f8b48152f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009870 tx=0x7f8b3002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4048e64962eb34a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:41.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.472+0000 7f8b46ffd640 1 -- 172.21.15.91:0/1550839351 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30030840 con 0x7f8b4806d0a0 2023-11-27T20:41:41.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.472+0000 7f8b46ffd640 1 -- 172.21.15.91:0/1550839351 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b300309a0 con 0x7f8b4806d0a0 2023-11-27T20:41:41.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.472+0000 7f8b46ffd640 1 -- 172.21.15.91:0/1550839351 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30030d30 con 0x7f8b4806d0a0 2023-11-27T20:41:41.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.473+0000 7f8b4db90640 1 -- 172.21.15.91:0/1550839351 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4806d0a0 msgr2=0x7f8b48152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.473+0000 7f8b4db90640 1 --2- 172.21.15.91:0/1550839351 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4806d0a0 0x7f8b48152f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009870 tx=0x7f8b3002b980 comp rx=0 tx=0).stop 2023-11-27T20:41:41.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.473+0000 7f8b4db90640 1 -- 172.21.15.91:0/1550839351 shutdown_connections 2023-11-27T20:41:41.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.473+0000 7f8b4db90640 1 --2- 172.21.15.91:0/1550839351 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b480c3ea0 0x7f8b480c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.473+0000 7f8b4db90640 1 --2- 172.21.15.91:0/1550839351 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4806d0a0 0x7f8b48152f20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.473+0000 7f8b4db90640 1 -- 172.21.15.91:0/1550839351 >> 172.21.15.91:0/1550839351 conn(0x7f8b4806a500 msgr2=0x7f8b4806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:41.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.473+0000 7f8b4db90640 1 -- 172.21.15.91:0/1550839351 shutdown_connections 2023-11-27T20:41:41.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.473+0000 7f8b4db90640 1 -- 172.21.15.91:0/1550839351 wait complete. 2023-11-27T20:41:41.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.475+0000 7f8b4db90640 1 Processor -- start 2023-11-27T20:41:41.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.475+0000 7f8b4db90640 1 -- start start 2023-11-27T20:41:41.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b4db90640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b4806d0a0 0x7f8b480bf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b4db90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b480c3ea0 0x7f8b4814ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b4db90640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4814fd30 0x7f8b4814f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b4db90640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b481dca50 con 0x7f8b4814fd30 2023-11-27T20:41:41.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b4db90640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480aae80 con 0x7f8b4806d0a0 2023-11-27T20:41:41.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b4db90640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b481dc2e0 con 0x7f8b480c3ea0 2023-11-27T20:41:41.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b47fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4814fd30 0x7f8b4814f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b47fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4814fd30 0x7f8b4814f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52138/0 (socket says 172.21.15.91:52138) 2023-11-27T20:41:41.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b47fff640 1 -- 172.21.15.91:0/3233569241 learned_addr learned my addr 172.21.15.91:0/3233569241 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:41.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b3effd640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b480c3ea0 0x7f8b4814ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b477fe640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b4806d0a0 0x7f8b480bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b47fff640 1 -- 172.21.15.91:0/3233569241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b480c3ea0 msgr2=0x7f8b4814ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b47fff640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b480c3ea0 0x7f8b4814ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b47fff640 1 -- 172.21.15.91:0/3233569241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b4806d0a0 msgr2=0x7f8b480bf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.476+0000 7f8b47fff640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b4806d0a0 0x7f8b480bf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.477+0000 7f8b47fff640 1 -- 172.21.15.91:0/3233569241 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b300094d0 con 0x7f8b4814fd30 2023-11-27T20:41:41.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.477+0000 7f8b47fff640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4814fd30 0x7f8b4814f490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b40007e40 tx=0x7f8b4000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:41.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.477+0000 7f8b44ff9640 1 -- 172.21.15.91:0/3233569241 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40014620 con 0x7f8b4814fd30 2023-11-27T20:41:41.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.477+0000 7f8b44ff9640 1 -- 172.21.15.91:0/3233569241 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000ee90 con 0x7f8b4814fd30 2023-11-27T20:41:41.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.477+0000 7f8b44ff9640 1 -- 172.21.15.91:0/3233569241 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400149e0 con 0x7f8b4814fd30 2023-11-27T20:41:41.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.477+0000 7f8b4db90640 1 -- 172.21.15.91:0/3233569241 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b481dc000 con 0x7f8b4814fd30 2023-11-27T20:41:41.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.477+0000 7f8b4db90640 1 -- 172.21.15.91:0/3233569241 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b481ee390 con 0x7f8b4814fd30 2023-11-27T20:41:41.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.478+0000 7f8b4db90640 1 -- 172.21.15.91:0/3233569241 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b481567e0 con 0x7f8b4814fd30 2023-11-27T20:41:41.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.479+0000 7f8b44ff9640 1 -- 172.21.15.91:0/3233569241 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8b40014b40 con 0x7f8b4814fd30 2023-11-27T20:41:41.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.480+0000 7f8b44ff9640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8b2806b1c0 0x7f8b2806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.480+0000 7f8b44ff9640 1 -- 172.21.15.91:0/3233569241 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b4008a450 con 0x7f8b4814fd30 2023-11-27T20:41:41.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.480+0000 7f8b477fe640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8b2806b1c0 0x7f8b2806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.481+0000 7f8b477fe640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8b2806b1c0 0x7f8b2806d680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b38000f60 tx=0x7f8b38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:41.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.485+0000 7f8b44ff9640 1 -- 172.21.15.91:0/3233569241 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8b481567e0 con 0x7f8b4814fd30 2023-11-27T20:41:41.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.662+0000 7f8b4db90640 1 -- 172.21.15.91:0/3233569241 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b481567e0 con 0x7f8b4814fd30 2023-11-27T20:41:41.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.664+0000 7f8b44ff9640 1 -- 172.21.15.91:0/3233569241 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f8b481567e0 con 0x7f8b4814fd30 2023-11-27T20:41:41.665 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:41.666 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:41.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 -- 172.21.15.91:0/3233569241 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8b2806b1c0 msgr2=0x7f8b2806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8b2806b1c0 0x7f8b2806d680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b38000f60 tx=0x7f8b38009040 comp rx=0 tx=0).stop 2023-11-27T20:41:41.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 -- 172.21.15.91:0/3233569241 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4814fd30 msgr2=0x7f8b4814f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4814fd30 0x7f8b4814f490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b40007e40 tx=0x7f8b4000e4b0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 -- 172.21.15.91:0/3233569241 shutdown_connections 2023-11-27T20:41:41.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8b4814fd30 0x7f8b4814f490 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b480c3ea0 0x7f8b4814ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8b2806b1c0 0x7f8b2806d680 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 --2- 172.21.15.91:0/3233569241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b4806d0a0 0x7f8b480bf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 -- 172.21.15.91:0/3233569241 >> 172.21.15.91:0/3233569241 conn(0x7f8b4806a500 msgr2=0x7f8b4806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:41.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.666+0000 7f8b4db90640 1 -- 172.21.15.91:0/3233569241 shutdown_connections 2023-11-27T20:41:41.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.667+0000 7f8b4db90640 1 -- 172.21.15.91:0/3233569241 wait complete. 2023-11-27T20:41:41.686 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-27T20:41:41.687 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-27T20:41:41.687 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-27T20:41:41.688 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-27T20:41:41.689 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-27T20:41:41.689 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-27T20:41:41.689 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-27T20:41:41.690 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-27T20:41:41.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.981+0000 7f3069d90640 1 Processor -- start 2023-11-27T20:41:41.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.981+0000 7f3069d90640 1 -- start start 2023-11-27T20:41:41.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.983+0000 7f3069d90640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3064155dc0 0x7f30640c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.983+0000 7f3069d90640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306415c5a0 con 0x7f306406bcd0 2023-11-27T20:41:41.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.983+0000 7f3069d90640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306406c290 con 0x7f306415ca30 2023-11-27T20:41:41.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.983+0000 7f3069d90640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306415bf50 con 0x7f3064155dc0 2023-11-27T20:41:41.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.983+0000 7feeb62ea640 1 Processor -- start 2023-11-27T20:41:41.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.984+0000 7f3063fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f306406bcd0 0x7f306406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56090/0 (socket says 172.21.15.91:56090) 2023-11-27T20:41:41.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.984+0000 7f3063fff640 1 -- 172.21.15.91:0/3133619914 learned_addr learned my addr 172.21.15.91:0/3133619914 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:41.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.984+0000 7feeb62ea640 1 -- start start 2023-11-27T20:41:41.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.985+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560385809 0 0) 0x7f306415c5a0 con 0x7f306406bcd0 2023-11-27T20:41:41.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.985+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3050003520 con 0x7f306406bcd0 2023-11-27T20:41:41.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.985+0000 7f30637fe640 1 --2- 172.21.15.91:0/3133619914 >> v2:172.21.15.183:3300/0 conn(0x7f3064155dc0 0x7f30640c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.985+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2391152179 0 0) 0x7f3050003520 con 0x7f306406bcd0 2023-11-27T20:41:41.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.985+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 >> v2:172.21.15.183:3300/0 conn(0x7f3064155dc0 msgr2=0x7f30640c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:41.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.985+0000 7f30627fc640 1 --2- 172.21.15.91:0/3133619914 >> v2:172.21.15.183:3300/0 conn(0x7f3064155dc0 0x7f30640c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.985+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 >> v1:172.21.15.183:6789/0 conn(0x7f306415ca30 legacy=0x7f30640c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.986+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306415c230 con 0x7f306406bcd0 2023-11-27T20:41:41.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.986+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f304c0019f0 con 0x7f306406bcd0 2023-11-27T20:41:41.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.986+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 >> v1:172.21.15.91:6789/0 conn(0x7f306406bcd0 legacy=0x7f306406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.986+0000 7f30627fc640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3050003990 0x7f3050003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.986+0000 7f30627fc640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30500047c0 0x7f3050004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.988+0000 7feeb62ea640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 0x7feea8006e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.986+0000 7f30627fc640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30500051d0 0x7f305000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.986+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306415bf50 con 0x7f30500047c0 2023-11-27T20:41:41.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.988+0000 7feeb62ea640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea80d9c30 con 0x7feea80073b0 2023-11-27T20:41:41.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7feeb52e8640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7feea80d3b10 0x7feea8046ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:35814/0 (socket says 172.21.15.91:35814) 2023-11-27T20:41:41.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7feeb52e8640 1 -- 172.21.15.91:0/2296984934 learned_addr learned my addr 172.21.15.91:0/2296984934 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:41.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7feeb62ea640 1 -- 172.21.15.91:0/2296984934 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea80d9f10 con 0x7feea80d3b10 2023-11-27T20:41:41.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7feeb62ea640 1 -- 172.21.15.91:0/2296984934 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80da1f0 con 0x7feea804b0e0 2023-11-27T20:41:41.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.986+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305000c100 con 0x7f30500051d0 2023-11-27T20:41:41.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.986+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305000c2c0 con 0x7f3050003990 2023-11-27T20:41:41.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.987+0000 7f3062ffd640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30500047c0 0x7f3050004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.987+0000 7f30637fe640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3050003990 0x7f3050003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.988+0000 7f3063fff640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30500051d0 0x7f305000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793429861 0 0) 0x7feea80d9f10 con 0x7feea80d3b10 2023-11-27T20:41:41.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee9c003520 con 0x7feea80d3b10 2023-11-27T20:41:41.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7f30637fe640 1 -- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30500051d0 msgr2=0x7f305000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:41.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7f30637fe640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30500051d0 0x7f305000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7f30637fe640 1 -- 172.21.15.91:0/3133619914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30500047c0 msgr2=0x7f3050004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:41.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7f30637fe640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30500047c0 0x7f3050004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.989+0000 7f30637fe640 1 -- 172.21.15.91:0/3133619914 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306415c5a0 con 0x7f3050003990 2023-11-27T20:41:41.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feeb4ae7640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 0x7feea8006e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1980848228 0 0) 0x7fee9c003520 con 0x7feea80d3b10 2023-11-27T20:41:41.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7f3062ffd640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30500047c0 0x7f3050004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:41.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 msgr2=0x7feea8006e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:41.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 0x7feea8006e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7f3063fff640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30500051d0 0x7f305000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:41.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7f3063fff640 1 -- 172.21.15.91:0/3133619914 reap_dead start 2023-11-27T20:41:41.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 >> v1:172.21.15.91:6789/0 conn(0x7feea80073b0 legacy=0x7feea80d66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80da4d0 con 0x7feea80d3b10 2023-11-27T20:41:41.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7feeac001670 con 0x7feea80d3b10 2023-11-27T20:41:41.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 >> v1:172.21.15.183:6789/0 conn(0x7feea80d3b10 legacy=0x7feea8046ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.992+0000 7f30637fe640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3050003990 0x7f3050003dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f305c009a90 tx=0x7f30500057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc0004495a35a7c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:41.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 0x7fee9c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.992+0000 7f7f5496e640 1 Processor -- start 2023-11-27T20:41:41.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee9c003f60 0x7fee9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee9c009970 0x7fee9c004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80da1f0 con 0x7fee9c009970 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0054c0 con 0x7fee9c003f60 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.990+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c005680 con 0x7feea804b0e0 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.991+0000 7feeb52e8640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 0x7fee9c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.991+0000 7feeb4ae7640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee9c003f60 0x7fee9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.991+0000 7feeb5ae9640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee9c009970 0x7fee9c004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.992+0000 7feeb52e8640 1 -- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee9c003f60 msgr2=0x7fee9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.992+0000 7feeb52e8640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee9c003f60 0x7fee9c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.992+0000 7feeb52e8640 1 -- 172.21.15.91:0/2296984934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee9c009970 msgr2=0x7fee9c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.992+0000 7feeb52e8640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee9c009970 0x7fee9c004d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.992+0000 7feeb52e8640 1 -- 172.21.15.91:0/2296984934 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80da4d0 con 0x7feea804b0e0 2023-11-27T20:41:41.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.993+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c02c690 con 0x7f3050003990 2023-11-27T20:41:41.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.993+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c02c7f0 con 0x7f3050003990 2023-11-27T20:41:41.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.993+0000 7f30627fc640 1 -- 172.21.15.91:0/3133619914 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c02cb80 con 0x7f3050003990 2023-11-27T20:41:41.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.992+0000 7f7f5496e640 1 -- start start 2023-11-27T20:41:41.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.994+0000 7f3069d90640 1 -- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3050003990 msgr2=0x7f3050003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:41.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.994+0000 7f3069d90640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3050003990 0x7f3050003dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f305c009a90 tx=0x7f30500057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:41.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.994+0000 7feeb52e8640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 0x7fee9c003970 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feeac00c290 tx=0x7fee9c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57e5b6f3f5071f4a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:41.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.994+0000 7f3069d90640 1 -- 172.21.15.91:0/3133619914 shutdown_connections 2023-11-27T20:41:41.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.994+0000 7f3069d90640 1 --2- 172.21.15.91:0/3133619914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3050003990 0x7f3050003dd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.994+0000 7f3069d90640 1 -- 172.21.15.91:0/3133619914 >> 172.21.15.91:0/3133619914 conn(0x7f30640a7900 msgr2=0x7f30640a7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.994+0000 7f3069d90640 1 -- 172.21.15.91:0/3133619914 shutdown_connections 2023-11-27T20:41:42.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.994+0000 7f3069d90640 1 -- 172.21.15.91:0/3133619914 wait complete. 2023-11-27T20:41:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.994+0000 7f7f5496e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7f480506f0 0x7f7f48006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.995+0000 7f7f5496e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f4800fcc0 0x7f7f480067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.995+0000 7f7f5496e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f480d7cd0 con 0x7f7f480d78f0 2023-11-27T20:41:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.995+0000 7f7f5496e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f480db220 con 0x7f7f480506f0 2023-11-27T20:41:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.995+0000 7f7f5496e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4804b9d0 con 0x7f7f4800fcc0 2023-11-27T20:41:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.995+0000 7f7f4f7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f7f480d78f0 0x7f7f4800ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56106/0 (socket says 172.21.15.91:56106) 2023-11-27T20:41:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.995+0000 7f7f4f7fe640 1 -- 172.21.15.91:0/327643835 learned_addr learned my addr 172.21.15.91:0/327643835 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.996+0000 7f7f4effd640 1 --2- 172.21.15.91:0/327643835 >> v2:172.21.15.183:3300/0 conn(0x7f7f480506f0 0x7f7f48006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.996+0000 7f7f4ffff640 1 --2- 172.21.15.91:0/327643835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f4800fcc0 0x7f7f480067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.996+0000 7f7f4e7fc640 1 -- 172.21.15.91:0/327643835 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510078299 0 0) 0x7f7f480d7cd0 con 0x7f7f480d78f0 2023-11-27T20:41:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.997+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac02cb40 con 0x7feea804b0e0 2023-11-27T20:41:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.997+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac02cca0 con 0x7feea804b0e0 2023-11-27T20:41:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.997+0000 7feea7fff640 1 -- 172.21.15.91:0/2296984934 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac005b10 con 0x7feea804b0e0 2023-11-27T20:41:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.996+0000 7f7f4e7fc640 1 -- 172.21.15.91:0/327643835 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f38003520 con 0x7f7f480d78f0 2023-11-27T20:41:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.997+0000 7f3069d90640 1 Processor -- start 2023-11-27T20:41:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.997+0000 7f7f4effd640 1 -- 172.21.15.91:0/327643835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f4800fcc0 msgr2=0x7f7f480067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.997+0000 7f7f4effd640 1 --2- 172.21.15.91:0/327643835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f4800fcc0 0x7f7f480067d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.997+0000 7f7f4effd640 1 -- 172.21.15.91:0/327643835 >> v1:172.21.15.91:6789/0 conn(0x7f7f480d78f0 legacy=0x7f7f4800ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.997+0000 7f3069d90640 1 -- start start 2023-11-27T20:41:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.998+0000 7feeb62ea640 1 -- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 msgr2=0x7fee9c003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.998+0000 7feeb62ea640 1 --2- 172.21.15.91:0/2296984934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 0x7fee9c003970 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feeac00c290 tx=0x7fee9c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.998+0000 7feeb5ae9640 1 -- 172.21.15.91:0/2296984934 reap_dead start 2023-11-27T20:41:42.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.998+0000 7f7f4effd640 1 -- 172.21.15.91:0/327643835 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4804bcb0 con 0x7f7f480506f0 2023-11-27T20:41:42.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.999+0000 7f3069d90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3050003990 0x7f30641f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.999+0000 7f3069d90640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30640a5770 0x7f3064070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.999+0000 7f3069d90640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3064070da0 0x7f3064147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.999+0000 7f3069d90640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640a71e0 con 0x7f30640a5770 2023-11-27T20:41:42.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.999+0000 7f3069d90640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640a6f40 con 0x7f3064070da0 2023-11-27T20:41:42.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:41.999+0000 7f3069d90640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30641f2210 con 0x7f3050003990 2023-11-27T20:41:42.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.000+0000 7feeb62ea640 1 -- 172.21.15.91:0/2296984934 shutdown_connections 2023-11-27T20:41:42.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.000+0000 7feeb62ea640 1 -- 172.21.15.91:0/2296984934 >> 172.21.15.91:0/2296984934 conn(0x7feea8048220 msgr2=0x7feea8048630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.000+0000 7feeb62ea640 1 -- 172.21.15.91:0/2296984934 shutdown_connections 2023-11-27T20:41:42.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.000+0000 7f30637fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3050003990 0x7f30641f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.000+0000 7f3063fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3064070da0 0x7f3064147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.000+0000 7f3063fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3064070da0 0x7f3064147d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:49232/0 (socket says 172.21.15.91:49232) 2023-11-27T20:41:42.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.000+0000 7f3063fff640 1 -- 172.21.15.91:0/1476348735 learned_addr learned my addr 172.21.15.91:0/1476348735 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.000+0000 7f3062ffd640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30640a5770 0x7f3064070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.000+0000 7f7f4effd640 1 --2- 172.21.15.91:0/327643835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f480506f0 0x7f7f48006290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f400097a0 tx=0x7f7f4002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b438a913170493e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.001+0000 7f7f4e7fc640 1 -- 172.21.15.91:0/327643835 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4002e070 con 0x7f7f480506f0 2023-11-27T20:41:42.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.001+0000 7f3062ffd640 1 -- 172.21.15.91:0/1476348735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3050003990 msgr2=0x7f30641f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.001+0000 7f3062ffd640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3050003990 0x7f30641f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.001+0000 7f3062ffd640 1 -- 172.21.15.91:0/1476348735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3064070da0 msgr2=0x7f3064147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.001+0000 7f3062ffd640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3064070da0 0x7f3064147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.001+0000 7f3062ffd640 1 -- 172.21.15.91:0/1476348735 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640727a0 con 0x7f30640a5770 2023-11-27T20:41:42.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.002+0000 7f3062ffd640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30640a5770 0x7f3064070860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f305400e4d0 tx=0x7f305400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.001+0000 7f7f4e7fc640 1 -- 172.21.15.91:0/327643835 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f400315a0 con 0x7f7f480506f0 2023-11-27T20:41:42.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.001+0000 7f7f4e7fc640 1 -- 172.21.15.91:0/327643835 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40031910 con 0x7f7f480506f0 2023-11-27T20:41:42.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.002+0000 7f305bfff640 1 -- 172.21.15.91:0/1476348735 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540053a0 con 0x7f30640a5770 2023-11-27T20:41:42.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.002+0000 7f305bfff640 1 -- 172.21.15.91:0/1476348735 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30540035f0 con 0x7f30640a5770 2023-11-27T20:41:42.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.003+0000 7f305bfff640 1 -- 172.21.15.91:0/1476348735 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054003980 con 0x7f30640a5770 2023-11-27T20:41:42.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.003+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3064072a80 con 0x7f30640a5770 2023-11-27T20:41:42.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.003+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30640a75c0 con 0x7f30640a5770 2023-11-27T20:41:42.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.004+0000 7fd56fa90640 1 Processor -- start 2023-11-27T20:41:42.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.001+0000 7feeb62ea640 1 -- 172.21.15.91:0/2296984934 wait complete. 2023-11-27T20:41:42.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.003+0000 7feeb62ea640 1 Processor -- start 2023-11-27T20:41:42.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.004+0000 7feeb62ea640 1 -- start start 2023-11-27T20:41:42.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.002+0000 7f7f5496e640 1 -- 172.21.15.91:0/327643835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f480506f0 msgr2=0x7f7f48006290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.004+0000 7fd56fa90640 1 -- start start 2023-11-27T20:41:42.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.002+0000 7f7f5496e640 1 --2- 172.21.15.91:0/327643835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f480506f0 0x7f7f48006290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f400097a0 tx=0x7f7f4002b840 comp rx=0 tx=0).stop 2023-11-27T20:41:42.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.004+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30641f20a0 con 0x7f30640a5770 2023-11-27T20:41:42.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.005+0000 7feeb62ea640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 0x7feea80ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.005+0000 7feeb62ea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea802c270 0x7feea802c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.005+0000 7feeb62ea640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feea80d7c20 0x7feea80d80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.005+0000 7feeb62ea640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80d7800 con 0x7feea802c270 2023-11-27T20:41:42.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.005+0000 7feeb62ea640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea8049ec0 con 0x7feea80d7c20 2023-11-27T20:41:42.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7f7f5496e640 1 -- 172.21.15.91:0/327643835 shutdown_connections 2023-11-27T20:41:42.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7f7f5496e640 1 --2- 172.21.15.91:0/327643835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f4800fcc0 0x7f7f480067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7f7f5496e640 1 --2- 172.21.15.91:0/327643835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f480506f0 0x7f7f48006290 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7f7f5496e640 1 -- 172.21.15.91:0/327643835 >> 172.21.15.91:0/327643835 conn(0x7f7f4804fbd0 msgr2=0x7f7f4804ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7f7f5496e640 1 -- 172.21.15.91:0/327643835 shutdown_connections 2023-11-27T20:41:42.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7f7f5496e640 1 -- 172.21.15.91:0/327643835 wait complete. 2023-11-27T20:41:42.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.007+0000 7fd56fa90640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd56806e2f0 0x7fd5680c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.007+0000 7fd56d82c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd5680c4f60 0x7fd5681546f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56112/0 (socket says 172.21.15.91:56112) 2023-11-27T20:41:42.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.007+0000 7fd56fa90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5680c21b0 0x7fd5680aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.007+0000 7fd56d02b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd56806e2f0 0x7fd5680c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7feeb62ea640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea802f0c0 con 0x7feea804b0e0 2023-11-27T20:41:42.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7feeb4ae7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea802c270 0x7feea802c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7feeb4ae7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea802c270 0x7feea802c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52168/0 (socket says 172.21.15.91:52168) 2023-11-27T20:41:42.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7feeb4ae7640 1 -- 172.21.15.91:0/3152399544 learned_addr learned my addr 172.21.15.91:0/3152399544 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7feeb5ae9640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feea80d7c20 0x7feea80d80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7feeb4ae7640 1 -- 172.21.15.91:0/3152399544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 msgr2=0x7feea80ca680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-27T20:41:42.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7feeb4ae7640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea804b0e0 0x7feea80ca680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7feeb4ae7640 1 -- 172.21.15.91:0/3152399544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feea80d7c20 msgr2=0x7feea80d80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7feeb4ae7640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feea80d7c20 0x7feea80d80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.006+0000 7feeb4ae7640 1 -- 172.21.15.91:0/3152399544 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80d4070 con 0x7feea802c270 2023-11-27T20:41:42.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.008+0000 7feeb4ae7640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea802c270 0x7feea802c6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feea000ead0 tx=0x7feea000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.008+0000 7fd56d02b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd56806e2f0 0x7fd5680c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52174/0 (socket says 172.21.15.91:52174) 2023-11-27T20:41:42.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.008+0000 7fd56fa90640 1 -- 172.21.15.91:0/3603436448 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd568154e00 con 0x7fd5680c4f60 2023-11-27T20:41:42.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.008+0000 7fd56fa90640 1 -- 172.21.15.91:0/3603436448 --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680c10d0 con 0x7fd56806e2f0 2023-11-27T20:41:42.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.008+0000 7fd56fa90640 1 -- 172.21.15.91:0/3603436448 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5681542d0 con 0x7fd5680c21b0 2023-11-27T20:41:42.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.008+0000 7fd56d82c640 1 -- 172.21.15.91:0/3603436448 learned_addr learned my addr 172.21.15.91:0/3603436448 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:42.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.008+0000 7fd56e02d640 1 --2- 172.21.15.91:0/3603436448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5680c21b0 0x7fd5680aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.008+0000 7feea5ffb640 1 -- 172.21.15.91:0/3152399544 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0010040 con 0x7feea802c270 2023-11-27T20:41:42.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea80cabc0 con 0x7feea802c270 2023-11-27T20:41:42.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea80d9020 con 0x7feea802c270 2023-11-27T20:41:42.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7feea5ffb640 1 -- 172.21.15.91:0/3152399544 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0008b40 con 0x7feea802c270 2023-11-27T20:41:42.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7feea5ffb640 1 -- 172.21.15.91:0/3152399544 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0010040 con 0x7feea802c270 2023-11-27T20:41:42.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.007+0000 7f305bfff640 1 -- 172.21.15.91:0/1476348735 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3054003ae0 con 0x7f30640a5770 2023-11-27T20:41:42.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7f305bfff640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f304406b210 0x7f304406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7f305bfff640 1 -- 172.21.15.91:0/1476348735 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3054058b80 con 0x7f30640a5770 2023-11-27T20:41:42.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7f305bfff640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] conn(0x7f3044074110 0x7f30440765b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7f7f5496e640 1 Processor -- start 2023-11-27T20:41:42.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.010+0000 7f305bfff640 1 -- 172.21.15.91:0/1476348735 --> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3044076c80 con 0x7f3044074110 2023-11-27T20:41:42.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.010+0000 7f305bfff640 1 -- 172.21.15.91:0/1476348735 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3054007930 con 0x7f30640a5770 2023-11-27T20:41:42.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7fd56d02b640 1 -- 172.21.15.91:0/3603436448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5680c21b0 msgr2=0x7fd5680aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7fd56d02b640 1 --2- 172.21.15.91:0/3603436448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5680c21b0 0x7fd5680aaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7fd56d02b640 1 -- 172.21.15.91:0/3603436448 >> v1:172.21.15.91:6789/0 conn(0x7fd5680c4f60 legacy=0x7fd5681546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.009+0000 7fd56d02b640 1 -- 172.21.15.91:0/3603436448 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680c0860 con 0x7fd56806e2f0 2023-11-27T20:41:42.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.010+0000 7f7f5496e640 1 -- start start 2023-11-27T20:41:42.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.010+0000 7f3063fff640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] conn(0x7f3044074110 0x7f30440765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.011+0000 7fd56d02b640 1 --2- 172.21.15.91:0/3603436448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd56806e2f0 0x7fd5680c42b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd5580071d0 tx=0x7fd55802db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db56dd45da5a39b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.011+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee90000fc0 con 0x7feea802c270 2023-11-27T20:41:42.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.011+0000 7f040302e640 1 Processor -- start 2023-11-27T20:41:42.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.011+0000 7f040302e640 1 -- start start 2023-11-27T20:41:42.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.012+0000 7f30637fe640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f304406b210 0x7f304406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.012+0000 7fd56c82a640 1 -- 172.21.15.91:0/3603436448 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558008df0 con 0x7fd56806e2f0 2023-11-27T20:41:42.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.012+0000 7fd56c82a640 1 -- 172.21.15.91:0/3603436448 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55800a0d0 con 0x7fd56806e2f0 2023-11-27T20:41:42.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.012+0000 7fd56c82a640 1 -- 172.21.15.91:0/3603436448 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55800a4a0 con 0x7fd56806e2f0 2023-11-27T20:41:42.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f7f5496e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4800fcc0 0x7f7f480d5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f7f5496e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f480506f0 0x7f7f480d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f7f5496e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f480d78f0 0x7f7f480343d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7fb4f465d640 1 Processor -- start 2023-11-27T20:41:42.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7fb4f465d640 1 -- start start 2023-11-27T20:41:42.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f040302e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f03f400b0a0 0x7f03f40d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f040302e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f03f404ac40 0x7f03f404b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f040302e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03f40d6a30 0x7f03f40d6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f040302e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f4046550 con 0x7f03f404ac40 2023-11-27T20:41:42.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f040302e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f40d7400 con 0x7f03f400b0a0 2023-11-27T20:41:42.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f040302e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40d3ee0 con 0x7f03f40d6a30 2023-11-27T20:41:42.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7fd56fa90640 1 -- 172.21.15.91:0/3603436448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd56806e2f0 msgr2=0x7fd5680c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7fd56fa90640 1 --2- 172.21.15.91:0/3603436448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd56806e2f0 0x7fd5680c42b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd5580071d0 tx=0x7fd55802db10 comp rx=0 tx=0).stop 2023-11-27T20:41:42.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7fd56fa90640 1 -- 172.21.15.91:0/3603436448 shutdown_connections 2023-11-27T20:41:42.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7fd56fa90640 1 --2- 172.21.15.91:0/3603436448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5680c21b0 0x7fd5680aaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7fd56fa90640 1 --2- 172.21.15.91:0/3603436448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd56806e2f0 0x7fd5680c42b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7fd56fa90640 1 -- 172.21.15.91:0/3603436448 >> 172.21.15.91:0/3603436448 conn(0x7fd5680c5cc0 msgr2=0x7fd5680c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7f040282d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03f40d6a30 0x7f03f40d6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f3063fff640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] conn(0x7f3044074110 0x7f30440765b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.013+0000 7f30637fe640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f304406b210 0x7f304406d6d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f305c036000 tx=0x7f305c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7f305bfff640 1 -- 172.21.15.91:0/1476348735 <== osd.1 v2:172.21.15.91:6808/906632887 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3044076c80 con 0x7f3044074110 2023-11-27T20:41:42.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7f040282d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03f40d6a30 0x7f03f40d6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59064/0 (socket says 172.21.15.91:59064) 2023-11-27T20:41:42.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7f040282d640 1 -- 172.21.15.91:0/2265022441 learned_addr learned my addr 172.21.15.91:0/2265022441 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7fb4f465d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb4ec1515e0 0x7fb4ec0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7fd56fa90640 1 -- 172.21.15.91:0/3603436448 shutdown_connections 2023-11-27T20:41:42.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f040182b640 1 --2- 172.21.15.91:0/2265022441 >> v2:172.21.15.91:3300/0 conn(0x7f03f404ac40 0x7f03f404b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7f7f4f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4800fcc0 0x7f7f480d5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.014+0000 7f7f4f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4800fcc0 0x7f7f480d5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:49246/0 (socket says 172.21.15.91:49246) 2023-11-27T20:41:42.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f7f4ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f480d78f0 0x7f7f480343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f7f4ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f480d78f0 0x7f7f480343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52180/0 (socket says 172.21.15.91:52180) 2023-11-27T20:41:42.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f7f4effd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f480506f0 0x7f7f480d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f7f4effd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f480506f0 0x7f7f480d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59074/0 (socket says 172.21.15.91:59074) 2023-11-27T20:41:42.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f7f4f7fe640 1 -- 172.21.15.91:0/4293207786 learned_addr learned my addr 172.21.15.91:0/4293207786 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4804fa90 con 0x7f7f480d78f0 2023-11-27T20:41:42.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48178080 con 0x7f7f4800fcc0 2023-11-27T20:41:42.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7fb4f465d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb4ec06d480 0x7fb4ec153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7fb4f465d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec0c3d80 con 0x7fb4ec0c6130 2023-11-27T20:41:42.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7fb4f465d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ec0c2580 con 0x7fb4ec06d480 2023-11-27T20:41:42.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7fb4f465d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ec0c2090 con 0x7fb4ec1515e0 2023-11-27T20:41:42.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f480d3c40 con 0x7f7f480506f0 2023-11-27T20:41:42.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7fb4f1bf8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb4ec06d480 0x7fb4ec153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7fb4f1bf8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb4ec06d480 0x7fb4ec153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52194/0 (socket says 172.21.15.91:52194) 2023-11-27T20:41:42.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7fb4f1bf8640 1 -- 172.21.15.91:0/2946866611 learned_addr learned my addr 172.21.15.91:0/2946866611 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.016+0000 7fb4f23f9640 1 --2- 172.21.15.91:0/2946866611 >> v2:172.21.15.183:3300/0 conn(0x7fb4ec1515e0 0x7fb4ec0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f040282d640 1 -- 172.21.15.91:0/2265022441 >> v2:172.21.15.183:3300/0 conn(0x7f03f400b0a0 msgr2=0x7f03f40d39a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T20:41:42.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f040282d640 1 --2- 172.21.15.91:0/2265022441 >> v2:172.21.15.183:3300/0 conn(0x7f03f400b0a0 0x7f03f40d39a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f040282d640 1 -- 172.21.15.91:0/2265022441 >> v2:172.21.15.91:3300/0 conn(0x7f03f404ac40 msgr2=0x7f03f404b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f040282d640 1 --2- 172.21.15.91:0/2265022441 >> v2:172.21.15.91:3300/0 conn(0x7f03f404ac40 0x7f03f404b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7f040282d640 1 -- 172.21.15.91:0/2265022441 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f4047630 con 0x7f03f40d6a30 2023-11-27T20:41:42.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.016+0000 7feea5ffb640 1 -- 172.21.15.91:0/3152399544 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7feea0008cb0 con 0x7feea802c270 2023-11-27T20:41:42.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.016+0000 7fb4f1bf8640 1 -- 172.21.15.91:0/2946866611 >> v2:172.21.15.183:3300/0 conn(0x7fb4ec1515e0 msgr2=0x7fb4ec0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.016+0000 7fb4f13f7640 1 -- 172.21.15.91:0/2946866611 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116448971 0 0) 0x7fb4ec0c3d80 con 0x7fb4ec0c6130 2023-11-27T20:41:42.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.015+0000 7fd56fa90640 1 -- 172.21.15.91:0/3603436448 wait complete. 2023-11-27T20:41:42.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7fb4f1bf8640 1 --2- 172.21.15.91:0/2946866611 >> v2:172.21.15.183:3300/0 conn(0x7fb4ec1515e0 0x7fb4ec0c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7fb4f1bf8640 1 -- 172.21.15.91:0/2946866611 >> v1:172.21.15.91:6789/0 conn(0x7fb4ec0c6130 legacy=0x7fb4ec0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7fb4f1bf8640 1 -- 172.21.15.91:0/2946866611 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec0c22a0 con 0x7fb4ec06d480 2023-11-27T20:41:42.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7f12ba897640 1 Processor -- start 2023-11-27T20:41:42.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7f040282d640 1 --2- 172.21.15.91:0/2265022441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03f40d6a30 0x7f03f40d6ec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0620a0 tx=0x7f03fc0a5f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd532d0bca1af8dc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7f7f4effd640 1 -- 172.21.15.91:0/4293207786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4800fcc0 msgr2=0x7f7f480d5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7f7f4effd640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4800fcc0 0x7f7f480d5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7fb4f23f9640 1 --2- 172.21.15.91:0/2946866611 >> v2:172.21.15.183:3300/0 conn(0x7fb4ec1515e0 0x7fb4ec0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:42.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7fd56fa90640 1 Processor -- start 2023-11-27T20:41:42.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7f7f4effd640 1 -- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f480d78f0 msgr2=0x7f7f480343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.018+0000 7f040102a640 1 -- 172.21.15.91:0/2265022441 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0a6d10 con 0x7f03f40d6a30 2023-11-27T20:41:42.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.018+0000 7f040102a640 1 -- 172.21.15.91:0/2265022441 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc0a6e70 con 0x7f03f40d6a30 2023-11-27T20:41:42.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.018+0000 7f040102a640 1 -- 172.21.15.91:0/2265022441 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0ae640 con 0x7f03f40d6a30 2023-11-27T20:41:42.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7f12ba897640 1 -- start start 2023-11-27T20:41:42.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.018+0000 7feea5ffb640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee9406b220 0x7fee9406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.018+0000 7fb4f1bf8640 1 --2- 172.21.15.91:0/2946866611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4ec06d480 0x7fb4ec153ef0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec06b440 tx=0x7fb4dc02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be50cb98db8cf5a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.018+0000 7feea5ffb640 1 -- 172.21.15.91:0/3152399544 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feea008a1a0 con 0x7feea802c270 2023-11-27T20:41:42.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7feea5ffb640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] conn(0x7fee94073440 0x7fee94075860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7feea5ffb640 1 -- 172.21.15.91:0/3152399544 --> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee94075f10 con 0x7fee94073440 2023-11-27T20:41:42.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7feea5ffb640 1 -- 172.21.15.91:0/3152399544 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7feea008a550 con 0x7feea802c270 2023-11-27T20:41:42.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.017+0000 7fd56fa90640 1 -- start start 2023-11-27T20:41:42.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7fb4f13f7640 1 -- 172.21.15.91:0/2946866611 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc031880 con 0x7fb4ec06d480 2023-11-27T20:41:42.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7fb4f13f7640 1 -- 172.21.15.91:0/2946866611 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc0319e0 con 0x7fb4ec06d480 2023-11-27T20:41:42.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7fb4f13f7640 1 -- 172.21.15.91:0/2946866611 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc031d70 con 0x7fb4ec06d480 2023-11-27T20:41:42.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7f040302e640 1 -- 172.21.15.91:0/2265022441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03f40d6a30 msgr2=0x7f03f40d6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7feeb52e8640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee9406b220 0x7fee9406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7f040302e640 1 --2- 172.21.15.91:0/2265022441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03f40d6a30 0x7f03f40d6ec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0620a0 tx=0x7f03fc0a5f60 comp rx=0 tx=0).stop 2023-11-27T20:41:42.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7fd56fa90640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd56806e2f0 0x7fd56814d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7f040302e640 1 -- 172.21.15.91:0/2265022441 shutdown_connections 2023-11-27T20:41:42.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7fd56fa90640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5680c21b0 0x7fd5680bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7f040302e640 1 --2- 172.21.15.91:0/2265022441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03f40d6a30 0x7f03f40d6ec0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7fd56fa90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5680c4f60 0x7fd5680bf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7fd56fa90640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568153710 con 0x7fd5680c21b0 2023-11-27T20:41:42.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7fd56fa90640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568148020 con 0x7fd56806e2f0 2023-11-27T20:41:42.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.019+0000 7fd56fa90640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd568148300 con 0x7fd5680c4f60 2023-11-27T20:41:42.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f040302e640 1 --2- 172.21.15.91:0/2265022441 >> v2:172.21.15.91:3300/0 conn(0x7f03f404ac40 0x7f03f404b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7fd56d02b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5680c21b0 0x7fd5680bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7fd56d02b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5680c21b0 0x7fd5680bf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52200/0 (socket says 172.21.15.91:52200) 2023-11-27T20:41:42.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7fd56d02b640 1 -- 172.21.15.91:0/2219532014 learned_addr learned my addr 172.21.15.91:0/2219532014 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7feeb5ae9640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] conn(0x7fee94073440 0x7fee94075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.018+0000 7f7f4effd640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f480d78f0 0x7f7f480343d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.018+0000 7f7f4effd640 1 -- 172.21.15.91:0/4293207786 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40009400 con 0x7f7f480506f0 2023-11-27T20:41:42.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.018+0000 7f7f4f7fe640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4800fcc0 0x7f7f480d5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:42.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.018+0000 7f7f4ffff640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f480d78f0 0x7f7f480343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:42.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f040302e640 1 --2- 172.21.15.91:0/2265022441 >> v2:172.21.15.183:3300/0 conn(0x7f03f400b0a0 0x7f03f40d39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f040302e640 1 -- 172.21.15.91:0/2265022441 >> 172.21.15.91:0/2265022441 conn(0x7f03f4005e60 msgr2=0x7f03f4006270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f12ba897640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f12b40c7e90 0x7f12b40c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f12ba897640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f12b40c4e50 0x7f12b406b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f12ba897640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b40bd8d0 con 0x7f12b414e810 2023-11-27T20:41:42.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f12ba897640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b40c6e60 con 0x7f12b40c4e50 2023-11-27T20:41:42.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f12ba897640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b40c70d0 con 0x7f12b40c7e90 2023-11-27T20:41:42.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7fd56d82c640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd56806e2f0 0x7fd56814d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7fb4f465d640 1 -- 172.21.15.91:0/2946866611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4ec06d480 msgr2=0x7fb4ec153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7fb4f465d640 1 --2- 172.21.15.91:0/2946866611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4ec06d480 0x7fb4ec153ef0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec06b440 tx=0x7fb4dc02b920 comp rx=0 tx=0).stop 2023-11-27T20:41:42.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f040302e640 1 -- 172.21.15.91:0/2265022441 shutdown_connections 2023-11-27T20:41:42.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f040302e640 1 -- 172.21.15.91:0/2265022441 wait complete. 2023-11-27T20:41:42.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7fd56e02d640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5680c4f60 0x7fd5680bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.020+0000 7f12b3fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f12b414e810 0x7f12b41550c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56130/0 (socket says 172.21.15.91:56130) 2023-11-27T20:41:42.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7f12b3fff640 1 -- 172.21.15.91:0/3292502174 learned_addr learned my addr 172.21.15.91:0/3292502174 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:42.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7f12b37fe640 1 --2- 172.21.15.91:0/3292502174 >> v2:172.21.15.183:3300/0 conn(0x7f12b40c7e90 0x7f12b40c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7f7f4effd640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f480506f0 0x7f7f480d2f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7f40033000 tx=0x7f7f400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7fb4f465d640 1 -- 172.21.15.91:0/2946866611 shutdown_connections 2023-11-27T20:41:42.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7fb4f465d640 1 --2- 172.21.15.91:0/2946866611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4ec06d480 0x7fb4ec153ef0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7fb4f465d640 1 --2- 172.21.15.91:0/2946866611 >> v2:172.21.15.183:3300/0 conn(0x7fb4ec1515e0 0x7fb4ec0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7fb4f465d640 1 -- 172.21.15.91:0/2946866611 >> 172.21.15.91:0/2946866611 conn(0x7fb4ec06a500 msgr2=0x7fb4ec06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7f12b8e34640 1 --2- 172.21.15.91:0/3292502174 >> v2:172.21.15.91:3300/0 conn(0x7f12b40c4e50 0x7f12b406b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7feeb5ae9640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] conn(0x7fee94073440 0x7fee94075860 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7fd56d02b640 1 -- 172.21.15.91:0/2219532014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5680c4f60 msgr2=0x7fd5680bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7fd56d02b640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5680c4f60 0x7fd5680bf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7fd56d02b640 1 -- 172.21.15.91:0/2219532014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd56806e2f0 msgr2=0x7fd56814d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7fd56d02b640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd56806e2f0 0x7fd56814d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7fd56d02b640 1 -- 172.21.15.91:0/2219532014 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55800ae30 con 0x7fd5680c21b0 2023-11-27T20:41:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.021+0000 7f7f37fff640 1 -- 172.21.15.91:0/4293207786 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40003810 con 0x7f7f480506f0 2023-11-27T20:41:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.022+0000 7f7f37fff640 1 -- 172.21.15.91:0/4293207786 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f40040070 con 0x7f7f480506f0 2023-11-27T20:41:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.022+0000 7f7f37fff640 1 -- 172.21.15.91:0/4293207786 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40003b90 con 0x7f7f480506f0 2023-11-27T20:41:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.022+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4804f7b0 con 0x7f7f480506f0 2023-11-27T20:41:42.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.022+0000 7feeb52e8640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee9406b220 0x7fee9406d6e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feeac034000 tx=0x7feeac009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.022+0000 7f12b2ffd640 1 -- 172.21.15.91:0/3292502174 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203890029 0 0) 0x7f12b40bd8d0 con 0x7f12b414e810 2023-11-27T20:41:42.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.022+0000 7f12b2ffd640 1 -- 172.21.15.91:0/3292502174 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a0003520 con 0x7f12b414e810 2023-11-27T20:41:42.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.022+0000 7f12b37fe640 1 -- 172.21.15.91:0/3292502174 >> v2:172.21.15.91:3300/0 conn(0x7f12b40c4e50 msgr2=0x7f12b406b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.023+0000 7f040302e640 1 Processor -- start 2023-11-27T20:41:42.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.023+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f48178550 con 0x7f7f480506f0 2023-11-27T20:41:42.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.023+0000 7feea5ffb640 1 -- 172.21.15.91:0/3152399544 <== osd.0 v2:172.21.15.91:6800/941562544 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fee94075f10 con 0x7fee94073440 2023-11-27T20:41:42.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.023+0000 7f040302e640 1 -- start start 2023-11-27T20:41:42.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.023+0000 7fb4f465d640 1 -- 172.21.15.91:0/2946866611 shutdown_connections 2023-11-27T20:41:42.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.023+0000 7fb4f465d640 1 -- 172.21.15.91:0/2946866611 wait complete. 2023-11-27T20:41:42.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.022+0000 7f12b37fe640 1 --2- 172.21.15.91:0/3292502174 >> v2:172.21.15.91:3300/0 conn(0x7f12b40c4e50 0x7f12b406b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.023+0000 7f12b37fe640 1 -- 172.21.15.91:0/3292502174 >> v1:172.21.15.91:6789/0 conn(0x7f12b414e810 legacy=0x7f12b41550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.023+0000 7f12b37fe640 1 -- 172.21.15.91:0/3292502174 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b40c73b0 con 0x7f12b40c7e90 2023-11-27T20:41:42.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.023+0000 7f12b8e34640 1 --2- 172.21.15.91:0/3292502174 >> v2:172.21.15.91:3300/0 conn(0x7f12b40c4e50 0x7f12b406b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:42.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.024+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f4804a3e0 con 0x7f7f480506f0 2023-11-27T20:41:42.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.022+0000 7fd56d02b640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5680c21b0 0x7fd5680bf0e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd5580071d0 tx=0x7fd5580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7fd55e7fc640 1 -- 172.21.15.91:0/2219532014 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55803c070 con 0x7fd5680c21b0 2023-11-27T20:41:42.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f040302e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03f400b0a0 0x7f03f4043500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f040302e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f404ac40 0x7f03f40d2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f040302e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03f40d6a30 0x7f03f402bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f040302e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40cc4b0 con 0x7f03f404ac40 2023-11-27T20:41:42.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f040302e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4177d40 con 0x7f03f40d6a30 2023-11-27T20:41:42.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f040302e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4176e50 con 0x7f03f400b0a0 2023-11-27T20:41:42.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f12b37fe640 1 --2- 172.21.15.91:0/3292502174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12b40c7e90 0x7f12b40c4910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f12b406d730 tx=0x7f129c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5edc200e103b128 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5681485e0 con 0x7fd5680c21b0 2023-11-27T20:41:42.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7fb4f465d640 1 Processor -- start 2023-11-27T20:41:42.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f040182b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f404ac40 0x7f03f40d2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7fb4f465d640 1 -- start start 2023-11-27T20:41:42.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f040182b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f404ac40 0x7f03f40d2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52220/0 (socket says 172.21.15.91:52220) 2023-11-27T20:41:42.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f040182b640 1 -- 172.21.15.91:0/1620775525 learned_addr learned my addr 172.21.15.91:0/1620775525 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f12b2ffd640 1 -- 172.21.15.91:0/3292502174 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c02e070 con 0x7f12b40c7e90 2023-11-27T20:41:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7f12b2ffd640 1 -- 172.21.15.91:0/3292502174 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c0315a0 con 0x7f12b40c7e90 2023-11-27T20:41:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.026+0000 7f12b2ffd640 1 -- 172.21.15.91:0/3292502174 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c031910 con 0x7f12b40c7e90 2023-11-27T20:41:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.025+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd568148ba0 con 0x7fd5680c21b0 2023-11-27T20:41:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.026+0000 7fd55e7fc640 1 -- 172.21.15.91:0/2219532014 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55800a870 con 0x7fd5680c21b0 2023-11-27T20:41:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.026+0000 7fd55e7fc640 1 -- 172.21.15.91:0/2219532014 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55803c070 con 0x7fd5680c21b0 2023-11-27T20:41:42.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.026+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd568153ef0 con 0x7fd5680c21b0 2023-11-27T20:41:42.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.026+0000 7fb4f465d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4ec06d480 0x7fb4ec0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7fb4f465d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ec0c6130 0x7fb4ec143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7fb4f23f9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4ec06d480 0x7fb4ec0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7fb4f465d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ec1515e0 0x7fb4ec0a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.026+0000 7f040182b640 1 -- 172.21.15.91:0/1620775525 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03f400b0a0 msgr2=0x7f03f4043500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T20:41:42.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.026+0000 7f040182b640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03f400b0a0 0x7f03f4043500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7fb4f465d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec153780 con 0x7fb4ec06d480 2023-11-27T20:41:42.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7fb4f465d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec1545e0 con 0x7fb4ec0c6130 2023-11-27T20:41:42.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7fb4f465d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec154a70 con 0x7fb4ec1515e0 2023-11-27T20:41:42.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7fb4f23f9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4ec06d480 0x7fb4ec0a5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52232/0 (socket says 172.21.15.91:52232) 2023-11-27T20:41:42.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7fb4f23f9640 1 -- 172.21.15.91:0/1945384388 learned_addr learned my addr 172.21.15.91:0/1945384388 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.026+0000 7f040182b640 1 -- 172.21.15.91:0/1620775525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03f40d6a30 msgr2=0x7f03f402bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.026+0000 7f040182b640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03f40d6a30 0x7f03f402bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.026+0000 7f040182b640 1 -- 172.21.15.91:0/1620775525 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc04f730 con 0x7f03f404ac40 2023-11-27T20:41:42.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7fb4f1bf8640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ec0c6130 0x7fb4ec143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7fb4f2bfa640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ec1515e0 0x7fb4ec0a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7f7f37fff640 1 -- 172.21.15.91:0/4293207786 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7f40003cf0 con 0x7f7f480506f0 2023-11-27T20:41:42.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7fb4f23f9640 1 -- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ec1515e0 msgr2=0x7fb4ec0a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7fb4f23f9640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ec1515e0 0x7fb4ec0a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7fb4f23f9640 1 -- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ec0c6130 msgr2=0x7fb4ec143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7fb4f23f9640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ec0c6130 0x7fb4ec143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.027+0000 7f040182b640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f404ac40 0x7f03f40d2c60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00d800 tx=0x7f03ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7f03f2ffd640 1 -- 172.21.15.91:0/1620775525 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00b6c0 con 0x7f03f404ac40 2023-11-27T20:41:42.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7f03f2ffd640 1 -- 172.21.15.91:0/1620775525 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec00b820 con 0x7f03f404ac40 2023-11-27T20:41:42.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7f03f2ffd640 1 -- 172.21.15.91:0/1620775525 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00bb90 con 0x7f03f404ac40 2023-11-27T20:41:42.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7fb4f23f9640 1 -- 172.21.15.91:0/1945384388 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc0094d0 con 0x7fb4ec06d480 2023-11-27T20:41:42.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f4177130 con 0x7f03f404ac40 2023-11-27T20:41:42.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f41776f0 con 0x7f03f404ac40 2023-11-27T20:41:42.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7fb4f23f9640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4ec06d480 0x7fb4ec0a5b50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800c7f0 tx=0x7fb4e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7f12ba897640 1 -- 172.21.15.91:0/3292502174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12b40c7e90 msgr2=0x7f12b40c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.028+0000 7f12ba897640 1 --2- 172.21.15.91:0/3292502174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12b40c7e90 0x7f12b40c4910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f12b406d730 tx=0x7f129c02b840 comp rx=0 tx=0).stop 2023-11-27T20:41:42.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7fb4e2ffd640 1 -- 172.21.15.91:0/1945384388 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8007820 con 0x7fb4ec06d480 2023-11-27T20:41:42.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7fb4e2ffd640 1 -- 172.21.15.91:0/1945384388 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e8007980 con 0x7fb4ec06d480 2023-11-27T20:41:42.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7fb4e2ffd640 1 -- 172.21.15.91:0/1945384388 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8007cf0 con 0x7fb4ec06d480 2023-11-27T20:41:42.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ec1539d0 con 0x7fb4ec06d480 2023-11-27T20:41:42.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7f12ba897640 1 -- 172.21.15.91:0/3292502174 shutdown_connections 2023-11-27T20:41:42.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7f12ba897640 1 --2- 172.21.15.91:0/3292502174 >> v2:172.21.15.91:3300/0 conn(0x7f12b40c4e50 0x7f12b406b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7f12ba897640 1 --2- 172.21.15.91:0/3292502174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12b40c7e90 0x7f12b40c4910 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f12b406d730 tx=0x7f129c02b840 comp rx=0 tx=0).stop 2023-11-27T20:41:42.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7f12ba897640 1 -- 172.21.15.91:0/3292502174 >> 172.21.15.91:0/3292502174 conn(0x7f12b40ca170 msgr2=0x7f12b40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec153f90 con 0x7fb4ec06d480 2023-11-27T20:41:42.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7f12ba897640 1 -- 172.21.15.91:0/3292502174 shutdown_connections 2023-11-27T20:41:42.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.030+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03e4000fc0 con 0x7f03f404ac40 2023-11-27T20:41:42.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.029+0000 7f7f37fff640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7f3c06b290 0x7f7f3c06d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.030+0000 7f7f37fff640 1 -- 172.21.15.91:0/4293207786 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f40042070 con 0x7f7f480506f0 2023-11-27T20:41:42.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.030+0000 7f7f37fff640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] conn(0x7f7f3c0734b0 0x7f7f3c0758d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.030+0000 7f7f37fff640 1 -- 172.21.15.91:0/4293207786 --> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f3c075f80 con 0x7f7f3c0734b0 2023-11-27T20:41:42.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.030+0000 7f7f37fff640 1 -- 172.21.15.91:0/4293207786 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f400ac170 con 0x7f7f480506f0 2023-11-27T20:41:42.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.030+0000 7f7f4ffff640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] conn(0x7f7f3c0734b0 0x7f7f3c0758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.030+0000 7f12ba897640 1 -- 172.21.15.91:0/3292502174 wait complete. 2023-11-27T20:41:42.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.031+0000 7f7f4ffff640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] conn(0x7f7f3c0734b0 0x7f7f3c0758d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.031+0000 7fd55e7fc640 1 -- 172.21.15.91:0/2219532014 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd55802f6d0 con 0x7fd5680c21b0 2023-11-27T20:41:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.032+0000 7f12ba897640 1 Processor -- start 2023-11-27T20:41:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.033+0000 7fd55e7fc640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd54c06b220 0x7fd54c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.033+0000 7fd55e7fc640 1 -- 172.21.15.91:0/2219532014 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd558033070 con 0x7fd5680c21b0 2023-11-27T20:41:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.033+0000 7fd55e7fc640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] conn(0x7fd54c073440 0x7fd54c075860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.033+0000 7fd55e7fc640 1 -- 172.21.15.91:0/2219532014 --> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd54c075f10 con 0x7fd54c073440 2023-11-27T20:41:42.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.033+0000 7fd55e7fc640 1 -- 172.21.15.91:0/2219532014 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5580ab260 con 0x7fd5680c21b0 2023-11-27T20:41:42.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.033+0000 7f12ba897640 1 -- start start 2023-11-27T20:41:42.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7fd56d82c640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd54c06b220 0x7fd54c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7fd56e02d640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] conn(0x7fd54c073440 0x7fd54c075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.033+0000 7f12ba897640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12b40c4e50 0x7f12b40bf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f12ba897640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12b414e810 0x7f12b4148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f12ba897640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12b41558b0 0x7f12b4148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f12ba897640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b4153d30 con 0x7f12b40c4e50 2023-11-27T20:41:42.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f12ba897640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40c34b0 con 0x7f12b41558b0 2023-11-27T20:41:42.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f12ba897640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40c2de0 con 0x7f12b414e810 2023-11-27T20:41:42.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.032+0000 7f23f33ce640 1 Processor -- start 2023-11-27T20:41:42.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.033+0000 7f23f33ce640 1 -- start start 2023-11-27T20:41:42.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f23f33ce640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f23ec156460 0x7f23ec0c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f12b3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12b40c4e50 0x7f12b40bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f12b3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12b40c4e50 0x7f12b40bf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52234/0 (socket says 172.21.15.91:52234) 2023-11-27T20:41:42.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f12b3fff640 1 -- 172.21.15.91:0/2195446511 learned_addr learned my addr 172.21.15.91:0/2195446511 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f23f33ce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23ec15cbb0 0x7f23ec159690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f23f33ce640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ec15d0b0 con 0x7f23ec0c7f00 2023-11-27T20:41:42.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f23f33ce640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec159bd0 con 0x7f23ec156460 2023-11-27T20:41:42.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f23f33ce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0c77d0 con 0x7f23ec15cbb0 2023-11-27T20:41:42.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f7f4f7fe640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7f3c06b290 0x7f7f3c06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f12b8e34640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12b41558b0 0x7f12b4148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f12b3fff640 1 -- 172.21.15.91:0/2195446511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12b414e810 msgr2=0x7f12b4148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f12b3fff640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12b414e810 0x7f12b4148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f12b3fff640 1 -- 172.21.15.91:0/2195446511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12b41558b0 msgr2=0x7f12b4148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f12b3fff640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12b41558b0 0x7f12b4148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f12b3fff640 1 -- 172.21.15.91:0/2195446511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4009a70 con 0x7f12b40c4e50 2023-11-27T20:41:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7fd56d82c640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd54c06b220 0x7fd54c06d6e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd560005880 tx=0x7fd560009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7fd56e02d640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] conn(0x7fd54c073440 0x7fd54c075860 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f7f37fff640 1 -- 172.21.15.91:0/4293207786 <== osd.2 v2:172.21.15.91:6820/3602897358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7f3c075f80 con 0x7f7f3c0734b0 2023-11-27T20:41:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f23f116a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f23ec156460 0x7f23ec0c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f23f116a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f23ec156460 0x7f23ec0c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:49316/0 (socket says 172.21.15.91:49316) 2023-11-27T20:41:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f23f116a640 1 -- 172.21.15.91:0/2733370531 learned_addr learned my addr 172.21.15.91:0/2733370531 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f23f116a640 1 -- 172.21.15.91:0/2733370531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23ec15cbb0 msgr2=0x7f23ec159690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T20:41:42.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f23f116a640 1 --2- 172.21.15.91:0/2733370531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23ec15cbb0 0x7f23ec159690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f23f116a640 1 -- 172.21.15.91:0/2733370531 >> v1:172.21.15.91:6789/0 conn(0x7f23ec0c7f00 legacy=0x7f23ec158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7f23f116a640 1 -- 172.21.15.91:0/2733370531 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec0c6ea0 con 0x7f23ec156460 2023-11-27T20:41:42.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.035+0000 7fb4e2ffd640 1 -- 172.21.15.91:0/1945384388 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb4e80113f0 con 0x7fb4ec06d480 2023-11-27T20:41:42.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.036+0000 7fb4e2ffd640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4d006b1f0 0x7fb4d006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.036+0000 7fb4e2ffd640 1 -- 172.21.15.91:0/1945384388 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e8089a90 con 0x7fb4ec06d480 2023-11-27T20:41:42.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.034+0000 7f03f2ffd640 1 -- 172.21.15.91:0/1620775525 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f03ec00bcf0 con 0x7f03f404ac40 2023-11-27T20:41:42.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.036+0000 7f12b3fff640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12b40c4e50 0x7f12b40bf710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c440 tx=0x7f12ac00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.036+0000 7f03f2ffd640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03e006b1f0 0x7f03e006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7fb4f1bf8640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4d006b1f0 0x7fb4d006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7fb4f465d640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] conn(0x7fb4d40015e0 0x7fb4d4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 --> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4d4006b40 con 0x7fb4d40015e0 2023-11-27T20:41:42.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7f12b0ff9640 1 -- 172.21.15.91:0/2195446511 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac005ce0 con 0x7f12b40c4e50 2023-11-27T20:41:42.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7f03f2ffd640 1 -- 172.21.15.91:0/1620775525 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03ec089f90 con 0x7f03f404ac40 2023-11-27T20:41:42.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7f12b0ff9640 1 -- 172.21.15.91:0/2195446511 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac005e40 con 0x7f12b40c4e50 2023-11-27T20:41:42.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c009400 con 0x7f12b40c4e50 2023-11-27T20:41:42.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7f12b0ff9640 1 -- 172.21.15.91:0/2195446511 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0072b0 con 0x7f12b40c4e50 2023-11-27T20:41:42.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b40c39e0 con 0x7f12b40c4e50 2023-11-27T20:41:42.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7fb4f2bfa640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] conn(0x7fb4d40015e0 0x7fb4d4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.037+0000 7f03f2ffd640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] conn(0x7f03e0073410 0x7f03e0075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.038+0000 7f03f2ffd640 1 -- 172.21.15.91:0/1620775525 --> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03e0075ee0 con 0x7f03e0073410 2023-11-27T20:41:42.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.038+0000 7f03f2ffd640 1 -- 172.21.15.91:0/1620775525 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03ec08c5b0 con 0x7f03f404ac40 2023-11-27T20:41:42.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.039+0000 7fb4f2bfa640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] conn(0x7fb4d40015e0 0x7fb4d4003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.039+0000 7f7f4f7fe640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7f3c06b290 0x7f7f3c06d750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7f440011e0 tx=0x7f7f44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.039+0000 7f040282d640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] conn(0x7f03e0073410 0x7f03e0075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.039+0000 7f040202c640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03e006b1f0 0x7f03e006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.038+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12b415fe60 con 0x7f12b40c4e50 2023-11-27T20:41:42.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.039+0000 7fd55e7fc640 1 -- 172.21.15.91:0/2219532014 <== osd.3 v2:172.21.15.91:6815/367212639 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd54c075f10 con 0x7fd54c073440 2023-11-27T20:41:42.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.039+0000 7fb4f1bf8640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4d006b1f0 0x7fb4d006d6b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc036000 tx=0x7fb4dc03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.040+0000 7f040202c640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03e006b1f0 0x7f03e006d6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009670 tx=0x7f03f8006bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.040+0000 7f12b0ff9640 1 -- 172.21.15.91:0/2195446511 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f12ac007410 con 0x7f12b40c4e50 2023-11-27T20:41:42.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.041+0000 7f23f116a640 1 --2- 172.21.15.91:0/2733370531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23ec156460 0x7f23ec0c4910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23e80098a0 tx=0x7f23e802b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e44be05ad1c0e5f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.041+0000 7fb4e2ffd640 1 -- 172.21.15.91:0/1945384388 <== osd.4 v2:172.21.15.183:6816/3858237641 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb4d4006b40 con 0x7fb4d40015e0 2023-11-27T20:41:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.041+0000 7f040282d640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] conn(0x7f03e0073410 0x7f03e0075830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.042+0000 7f23e3fff640 1 -- 172.21.15.91:0/2733370531 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e8031750 con 0x7f23ec156460 2023-11-27T20:41:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.042+0000 7f23e3fff640 1 -- 172.21.15.91:0/2733370531 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e80318b0 con 0x7f23ec156460 2023-11-27T20:41:42.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.042+0000 7f23e3fff640 1 -- 172.21.15.91:0/2733370531 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e8031c40 con 0x7f23ec156460 2023-11-27T20:41:42.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.041+0000 7f12b0ff9640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f129406b290 0x7f129406d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.041+0000 7f12b0ff9640 1 -- 172.21.15.91:0/2195446511 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12ac0894a0 con 0x7f12b40c4e50 2023-11-27T20:41:42.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.042+0000 7f12b0ff9640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] conn(0x7f12940734b0 0x7f12940758d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.042+0000 7f12b0ff9640 1 -- 172.21.15.91:0/2195446511 --> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1294075f80 con 0x7f12940734b0 2023-11-27T20:41:42.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.042+0000 7f12b0ff9640 1 -- 172.21.15.91:0/2195446511 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12ac089850 con 0x7f12b40c4e50 2023-11-27T20:41:42.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.042+0000 7f12b37fe640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f129406b290 0x7f129406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.042+0000 7f12b8e34640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] conn(0x7f12940734b0 0x7f12940758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.043+0000 7f23f33ce640 1 -- 172.21.15.91:0/2733370531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23ec156460 msgr2=0x7f23ec0c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.043+0000 7f23f33ce640 1 --2- 172.21.15.91:0/2733370531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23ec156460 0x7f23ec0c4910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23e80098a0 tx=0x7f23e802b7f0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.043+0000 7f12b37fe640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f129406b290 0x7f129406d750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f129c036000 tx=0x7f129c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.043+0000 7f23f33ce640 1 -- 172.21.15.91:0/2733370531 shutdown_connections 2023-11-27T20:41:42.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.043+0000 7f23f33ce640 1 --2- 172.21.15.91:0/2733370531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23ec15cbb0 0x7f23ec159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.043+0000 7f23f33ce640 1 --2- 172.21.15.91:0/2733370531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23ec156460 0x7f23ec0c4910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.043+0000 7f23f33ce640 1 -- 172.21.15.91:0/2733370531 >> 172.21.15.91:0/2733370531 conn(0x7f23ec0ca170 msgr2=0x7f23ec0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.043+0000 7f23f33ce640 1 -- 172.21.15.91:0/2733370531 shutdown_connections 2023-11-27T20:41:42.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.043+0000 7f23f33ce640 1 -- 172.21.15.91:0/2733370531 wait complete. 2023-11-27T20:41:42.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.044+0000 7f12b8e34640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] conn(0x7f12940734b0 0x7f12940758d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.043+0000 7f03f2ffd640 1 -- 172.21.15.91:0/1620775525 <== osd.5 v2:172.21.15.183:6808/1862351799 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f03e0075ee0 con 0x7f03e0073410 2023-11-27T20:41:42.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.046+0000 7f12b0ff9640 1 -- 172.21.15.91:0/2195446511 <== osd.6 v2:172.21.15.183:6800/953643252 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1294075f80 con 0x7f12940734b0 2023-11-27T20:41:42.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.046+0000 7f23f33ce640 1 Processor -- start 2023-11-27T20:41:42.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.046+0000 7f23f33ce640 1 -- start start 2023-11-27T20:41:42.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.047+0000 7f23f33ce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23ec0c7f00 0x7f23ec141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.047+0000 7f23f33ce640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23ec156460 0x7f23ec143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.047+0000 7f23f33ce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23ec15cbb0 0x7f23ec145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.047+0000 7f23f33ce640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0ad200 con 0x7f23ec156460 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.047+0000 7f23f33ce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0acc10 con 0x7f23ec15cbb0 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.047+0000 7f23f33ce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0ad470 con 0x7f23ec0c7f00 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.048+0000 7f23f0969640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23ec156460 0x7f23ec143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.048+0000 7f23f196b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23ec15cbb0 0x7f23ec145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.048+0000 7f23f196b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23ec15cbb0 0x7f23ec145230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:49324/0 (socket says 172.21.15.91:49324) 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.049+0000 7f23f196b640 1 -- 172.21.15.91:0/2670295886 learned_addr learned my addr 172.21.15.91:0/2670295886 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.049+0000 7f23f116a640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23ec0c7f00 0x7f23ec141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.050+0000 7f23f116a640 1 -- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23ec15cbb0 msgr2=0x7f23ec145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.050+0000 7f23f116a640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23ec15cbb0 0x7f23ec145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.050+0000 7f23f116a640 1 -- 172.21.15.91:0/2670295886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23ec156460 msgr2=0x7f23ec143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.050+0000 7f23f116a640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23ec156460 0x7f23ec143500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.050+0000 7f23f116a640 1 -- 172.21.15.91:0/2670295886 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e80094d0 con 0x7f23ec0c7f00 2023-11-27T20:41:42.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.051+0000 7f23f116a640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23ec0c7f00 0x7f23ec141fe0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f23ec08b480 tx=0x7f23e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.051+0000 7f23e1ffb640 1 -- 172.21.15.91:0/2670295886 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e8033c80 con 0x7f23ec0c7f00 2023-11-27T20:41:42.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.051+0000 7f23e1ffb640 1 -- 172.21.15.91:0/2670295886 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e8033de0 con 0x7f23ec0c7f00 2023-11-27T20:41:42.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.051+0000 7f23e1ffb640 1 -- 172.21.15.91:0/2670295886 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e8033c80 con 0x7f23ec0c7f00 2023-11-27T20:41:42.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.052+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ec0ae480 con 0x7f23ec0c7f00 2023-11-27T20:41:42.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.053+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ec0ace20 con 0x7f23ec0c7f00 2023-11-27T20:41:42.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.054+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 --> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f30640c1700 con 0x7f3044074110 2023-11-27T20:41:42.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.054+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23ec0c7460 con 0x7f23ec0c7f00 2023-11-27T20:41:42.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.057+0000 7f23e1ffb640 1 -- 172.21.15.91:0/2670295886 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f23e803a040 con 0x7f23ec0c7f00 2023-11-27T20:41:42.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.057+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 --> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee90002cb0 con 0x7fee94073440 2023-11-27T20:41:42.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.058+0000 7f305bfff640 1 -- 172.21.15.91:0/1476348735 <== osd.1 v2:172.21.15.91:6808/906632887 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f304c00d040 con 0x7f3044074110 2023-11-27T20:41:42.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.058+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] conn(0x7f3044074110 msgr2=0x7f30440765b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.058+0000 7f3069d90640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] conn(0x7f3044074110 0x7f30440765b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.058+0000 7feea5ffb640 1 -- 172.21.15.91:0/3152399544 <== osd.0 v2:172.21.15.91:6800/941562544 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee90002cb0 con 0x7fee94073440 2023-11-27T20:41:42.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.058+0000 7f23e1ffb640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f23d006b220 0x7f23d006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.058+0000 7f23e1ffb640 1 -- 172.21.15.91:0/2670295886 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23e80aba70 con 0x7f23ec0c7f00 2023-11-27T20:41:42.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.059+0000 7f23e1ffb640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] conn(0x7f23d00733c0 0x7f23d00757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.059+0000 7f23e1ffb640 1 -- 172.21.15.91:0/2670295886 --> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23d0075e90 con 0x7f23d00733c0 2023-11-27T20:41:42.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.059+0000 7f23e1ffb640 1 -- 172.21.15.91:0/2670295886 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23e80abec0 con 0x7f23ec0c7f00 2023-11-27T20:41:42.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.059+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f304406b210 msgr2=0x7f304406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.059+0000 7f3069d90640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f304406b210 0x7f304406d6d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f305c036000 tx=0x7f305c030000 comp rx=0 tx=0).stop 2023-11-27T20:41:42.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.059+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30640a5770 msgr2=0x7f3064070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.059+0000 7f3069d90640 1 --2- 172.21.15.91:0/1476348735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30640a5770 0x7f3064070860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f305400e4d0 tx=0x7f305400e990 comp rx=0 tx=0).stop 2023-11-27T20:41:42.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.059+0000 7f23f0969640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f23d006b220 0x7f23d006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.059+0000 7f3063fff640 1 -- 172.21.15.91:0/1476348735 reap_dead start 2023-11-27T20:41:42.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.059+0000 7f23f196b640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] conn(0x7f23d00733c0 0x7f23d00757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.060+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 shutdown_connections 2023-11-27T20:41:42.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.060+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 >> 172.21.15.91:0/1476348735 conn(0x7f30640a7900 msgr2=0x7f306414e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.060+0000 7f23f0969640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f23d006b220 0x7f23d006d6e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f23ec14a7f0 tx=0x7f23dc009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.060+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 shutdown_connections 2023-11-27T20:41:42.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.060+0000 7f3069d90640 1 -- 172.21.15.91:0/1476348735 wait complete. 2023-11-27T20:41:42.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.061+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] conn(0x7fee94073440 msgr2=0x7fee94075860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.061+0000 7feeb62ea640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] conn(0x7fee94073440 0x7fee94075860 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.061+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee9406b220 msgr2=0x7fee9406d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.061+0000 7feeb62ea640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee9406b220 0x7fee9406d6e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feeac034000 tx=0x7feeac009030 comp rx=0 tx=0).stop 2023-11-27T20:41:42.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.061+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea802c270 msgr2=0x7feea802c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.061+0000 7feeb62ea640 1 --2- 172.21.15.91:0/3152399544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feea802c270 0x7feea802c6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feea000ead0 tx=0x7feea000ef90 comp rx=0 tx=0).stop 2023-11-27T20:41:42.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.061+0000 7feeb5ae9640 1 -- 172.21.15.91:0/3152399544 reap_dead start 2023-11-27T20:41:42.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.061+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 shutdown_connections 2023-11-27T20:41:42.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.061+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 >> 172.21.15.91:0/3152399544 conn(0x7feea8048220 msgr2=0x7feea80049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.061+0000 7f23f196b640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] conn(0x7f23d00733c0 0x7f23d00757e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.062+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 shutdown_connections 2023-11-27T20:41:42.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.062+0000 7feeb62ea640 1 -- 172.21.15.91:0/3152399544 wait complete. 2023-11-27T20:41:42.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.063+0000 7f23e1ffb640 1 -- 172.21.15.91:0/2670295886 <== osd.7 v2:172.21.15.183:6822/3877780549 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f23d0075e90 con 0x7f23d00733c0 2023-11-27T20:41:42.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.067+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 --> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd56806b9b0 con 0x7fd54c073440 2023-11-27T20:41:42.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.069+0000 7fd55e7fc640 1 -- 172.21.15.91:0/2219532014 <== osd.3 v2:172.21.15.91:6815/367212639 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd56806b9b0 con 0x7fd54c073440 2023-11-27T20:41:42.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.070+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] conn(0x7fd54c073440 msgr2=0x7fd54c075860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.070+0000 7fd56fa90640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] conn(0x7fd54c073440 0x7fd54c075860 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.070+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd54c06b220 msgr2=0x7fd54c06d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.070+0000 7fd56fa90640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd54c06b220 0x7fd54c06d6e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd560005880 tx=0x7fd560009040 comp rx=0 tx=0).stop 2023-11-27T20:41:42.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.071+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5680c21b0 msgr2=0x7fd5680bf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.071+0000 7fd56fa90640 1 --2- 172.21.15.91:0/2219532014 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5680c21b0 0x7fd5680bf0e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd5580071d0 tx=0x7fd5580046c0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.071+0000 7fd56e02d640 1 -- 172.21.15.91:0/2219532014 reap_dead start 2023-11-27T20:41:42.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.071+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 shutdown_connections 2023-11-27T20:41:42.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.071+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 >> 172.21.15.91:0/2219532014 conn(0x7fd5680c5cc0 msgr2=0x7fd5680a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.072+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 shutdown_connections 2023-11-27T20:41:42.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.072+0000 7fd56fa90640 1 -- 172.21.15.91:0/2219532014 wait complete. 2023-11-27T20:41:42.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.075+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 --> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb4d4005c20 con 0x7fb4d40015e0 2023-11-27T20:41:42.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.076+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 --> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f03e4002cb0 con 0x7f03e0073410 2023-11-27T20:41:42.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.076+0000 7fb4e2ffd640 1 -- 172.21.15.91:0/1945384388 <== osd.4 v2:172.21.15.183:6816/3858237641 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb4d4005c20 con 0x7fb4d40015e0 2023-11-27T20:41:42.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.077+0000 7f03f2ffd640 1 -- 172.21.15.91:0/1620775525 <== osd.5 v2:172.21.15.183:6808/1862351799 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f03e4002cb0 con 0x7f03e0073410 2023-11-27T20:41:42.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.077+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] conn(0x7fb4d40015e0 msgr2=0x7fb4d4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.077+0000 7fb4f465d640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] conn(0x7fb4d40015e0 0x7fb4d4003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.077+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4d006b1f0 msgr2=0x7fb4d006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7fb4f465d640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4d006b1f0 0x7fb4d006d6b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc036000 tx=0x7fb4dc03c040 comp rx=0 tx=0).stop 2023-11-27T20:41:42.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4ec06d480 msgr2=0x7fb4ec0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7fb4f465d640 1 --2- 172.21.15.91:0/1945384388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4ec06d480 0x7fb4ec0a5b50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800c7f0 tx=0x7fb4e800ccb0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7fb4f2bfa640 1 -- 172.21.15.91:0/1945384388 reap_dead start 2023-11-27T20:41:42.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 --> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f4804c270 con 0x7f7f3c0734b0 2023-11-27T20:41:42.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 shutdown_connections 2023-11-27T20:41:42.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 >> 172.21.15.91:0/1945384388 conn(0x7fb4ec06a500 msgr2=0x7fb4ec06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 shutdown_connections 2023-11-27T20:41:42.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7fb4f465d640 1 -- 172.21.15.91:0/1945384388 wait complete. 2023-11-27T20:41:42.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 >> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] conn(0x7f03e0073410 msgr2=0x7f03e0075830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.078+0000 7f040302e640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] conn(0x7f03e0073410 0x7f03e0075830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03e006b1f0 msgr2=0x7f03e006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f040302e640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03e006b1f0 0x7f03e006d6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009670 tx=0x7f03f8006bd0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f404ac40 msgr2=0x7f03f40d2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f040302e640 1 --2- 172.21.15.91:0/1620775525 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f404ac40 0x7f03f40d2c60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00d800 tx=0x7f03ec00dcc0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f040282d640 1 -- 172.21.15.91:0/1620775525 reap_dead start 2023-11-27T20:41:42.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f7f37fff640 1 -- 172.21.15.91:0/4293207786 <== osd.2 v2:172.21.15.91:6820/3602897358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f500008d0 con 0x7f7f3c0734b0 2023-11-27T20:41:42.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 shutdown_connections 2023-11-27T20:41:42.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 >> 172.21.15.91:0/1620775525 conn(0x7f03f4005e60 msgr2=0x7f03f4030a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 shutdown_connections 2023-11-27T20:41:42.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 --> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f12b40c2f20 con 0x7f12940734b0 2023-11-27T20:41:42.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.079+0000 7f040302e640 1 -- 172.21.15.91:0/1620775525 wait complete. 2023-11-27T20:41:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.080+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] conn(0x7f7f3c0734b0 msgr2=0x7f7f3c0758d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.080+0000 7f7f5496e640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] conn(0x7f7f3c0734b0 0x7f7f3c0758d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.080+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7f3c06b290 msgr2=0x7f7f3c06d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.080+0000 7f7f5496e640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7f3c06b290 0x7f7f3c06d750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7f440011e0 tx=0x7f7f44009040 comp rx=0 tx=0).stop 2023-11-27T20:41:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.080+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f480506f0 msgr2=0x7f7f480d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.080+0000 7f7f5496e640 1 --2- 172.21.15.91:0/4293207786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f480506f0 0x7f7f480d2f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7f40033000 tx=0x7f7f400046c0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.080+0000 7f7f4ffff640 1 -- 172.21.15.91:0/4293207786 reap_dead start 2023-11-27T20:41:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.081+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 shutdown_connections 2023-11-27T20:41:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.081+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 >> 172.21.15.91:0/4293207786 conn(0x7f7f4804fbd0 msgr2=0x7f7f48030950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.081+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 shutdown_connections 2023-11-27T20:41:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.081+0000 7f7f5496e640 1 -- 172.21.15.91:0/4293207786 wait complete. 2023-11-27T20:41:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.080+0000 7f12b0ff9640 1 -- 172.21.15.91:0/2195446511 <== osd.6 v2:172.21.15.183:6800/953643252 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f12a400f040 con 0x7f12940734b0 2023-11-27T20:41:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.081+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 >> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] conn(0x7f12940734b0 msgr2=0x7f12940758d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.081+0000 7f12ba897640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] conn(0x7f12940734b0 0x7f12940758d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.081+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f129406b290 msgr2=0x7f129406d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.081+0000 7f12ba897640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f129406b290 0x7f129406d750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f129c036000 tx=0x7f129c030000 comp rx=0 tx=0).stop 2023-11-27T20:41:42.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.081+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12b40c4e50 msgr2=0x7f12b40bf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.081+0000 7f12ba897640 1 --2- 172.21.15.91:0/2195446511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12b40c4e50 0x7f12b40bf710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c440 tx=0x7f12ac00c900 comp rx=0 tx=0).stop 2023-11-27T20:41:42.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.082+0000 7f12b8e34640 1 -- 172.21.15.91:0/2195446511 reap_dead start 2023-11-27T20:41:42.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.082+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 shutdown_connections 2023-11-27T20:41:42.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.082+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 >> 172.21.15.91:0/2195446511 conn(0x7f12b40ca170 msgr2=0x7f12b415f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.082+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 shutdown_connections 2023-11-27T20:41:42.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.082+0000 7f12ba897640 1 -- 172.21.15.91:0/2195446511 wait complete. 2023-11-27T20:41:42.113 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:42.113 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T20:41:42.114 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:42.114 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T20:41:42.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.091+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 --> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f23ec0c43a0 con 0x7f23d00733c0 2023-11-27T20:41:42.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.093+0000 7f23e1ffb640 1 -- 172.21.15.91:0/2670295886 <== osd.7 v2:172.21.15.183:6822/3877780549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f23ec0c43a0 con 0x7f23d00733c0 2023-11-27T20:41:42.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.094+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] conn(0x7f23d00733c0 msgr2=0x7f23d00757e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.094+0000 7f23f33ce640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] conn(0x7f23d00733c0 0x7f23d00757e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.094+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f23d006b220 msgr2=0x7f23d006d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.094+0000 7f23f33ce640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f23d006b220 0x7f23d006d6e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f23ec14a7f0 tx=0x7f23dc009060 comp rx=0 tx=0).stop 2023-11-27T20:41:42.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.094+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23ec0c7f00 msgr2=0x7f23ec141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.094+0000 7f23f33ce640 1 --2- 172.21.15.91:0/2670295886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23ec0c7f00 0x7f23ec141fe0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f23ec08b480 tx=0x7f23e80046c0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.094+0000 7f23f196b640 1 -- 172.21.15.91:0/2670295886 reap_dead start 2023-11-27T20:41:42.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.094+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 shutdown_connections 2023-11-27T20:41:42.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.094+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 >> 172.21.15.91:0/2670295886 conn(0x7f23ec0ca170 msgr2=0x7f23ec163d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.094+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 shutdown_connections 2023-11-27T20:41:42.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.095+0000 7f23f33ce640 1 -- 172.21.15.91:0/2670295886 wait complete. 2023-11-27T20:41:42.117 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:42.118 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T20:41:42.118 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:42.119 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T20:41:42.119 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:42.120 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T20:41:42.120 INFO:teuthology.orchestra.run.smithi091.stdout:55834574853 2023-11-27T20:41:42.121 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T20:41:42.121 INFO:teuthology.orchestra.run.smithi091.stdout:55834574855 2023-11-27T20:41:42.122 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T20:41:42.122 INFO:teuthology.orchestra.run.smithi091.stdout:55834574856 2023-11-27T20:41:42.123 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T20:41:42.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.453+0000 7f57741ea640 1 Processor -- start 2023-11-27T20:41:42.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.453+0000 7f57741ea640 1 -- start start 2023-11-27T20:41:42.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.455+0000 7f57741ea640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f57640d78e0 0x7f576400ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.455+0000 7f57741ea640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f57640506e0 0x7f5764006280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.455+0000 7f57741ea640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57640d7cc0 con 0x7f576400fcb0 2023-11-27T20:41:42.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.455+0000 7f57741ea640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640db210 con 0x7f57640d78e0 2023-11-27T20:41:42.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.455+0000 7f57741ea640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576404b9c0 con 0x7f57640506e0 2023-11-27T20:41:42.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.456+0000 7f5771f86640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f57640d78e0 0x7f576400ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.456+0000 7f5771f86640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f57640d78e0 0x7f576400ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52264/0 (socket says 172.21.15.91:52264) 2023-11-27T20:41:42.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.456+0000 7f5771f86640 1 -- 172.21.15.91:0/2918632514 learned_addr learned my addr 172.21.15.91:0/2918632514 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.458+0000 7f5771785640 1 --2- 172.21.15.91:0/2918632514 >> v2:172.21.15.183:3300/0 conn(0x7f57640506e0 0x7f5764006280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.458+0000 7f028ffff640 1 Processor -- start 2023-11-27T20:41:42.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.458+0000 7f5771f86640 1 -- 172.21.15.91:0/2918632514 >> v2:172.21.15.183:3300/0 conn(0x7f57640506e0 msgr2=0x7f5764006280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.458+0000 7f5771f86640 1 --2- 172.21.15.91:0/2918632514 >> v2:172.21.15.183:3300/0 conn(0x7f57640506e0 0x7f5764006280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.458+0000 7f5771f86640 1 -- 172.21.15.91:0/2918632514 >> v1:172.21.15.183:6789/0 conn(0x7f576400fcb0 legacy=0x7f57640067c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.458+0000 7f5770f84640 1 -- 172.21.15.91:0/2918632514 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353975183 0 0) 0x7f57640d7cc0 con 0x7f576400fcb0 2023-11-27T20:41:42.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.458+0000 7f5771f86640 1 -- 172.21.15.91:0/2918632514 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576404bca0 con 0x7f57640d78e0 2023-11-27T20:41:42.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.458+0000 7f028ffff640 1 -- start start 2023-11-27T20:41:42.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.459+0000 7f5771f86640 1 --2- 172.21.15.91:0/2918632514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f57640d78e0 0x7f576400ed70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f576c04f5f0 tx=0x7f576c0a6140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda8ec9d03ec303d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.460+0000 7f028ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f02880d78f0 0x7f028800ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.460+0000 7f028ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f028800fcc0 0x7f02880069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.460+0000 7f028ffff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02880d7cd0 con 0x7f02880506f0 2023-11-27T20:41:42.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.460+0000 7f028ffff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02880db220 con 0x7f028800fcc0 2023-11-27T20:41:42.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.460+0000 7f028ffff640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028804b9d0 con 0x7f02880d78f0 2023-11-27T20:41:42.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.460+0000 7f5770f84640 1 -- 172.21.15.91:0/2918632514 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c0a6d40 con 0x7f57640d78e0 2023-11-27T20:41:42.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.460+0000 7f5770f84640 1 -- 172.21.15.91:0/2918632514 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c0ae440 con 0x7f57640d78e0 2023-11-27T20:41:42.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.461+0000 7f028e7fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f02880506f0 0x7f0288006290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56142/0 (socket says 172.21.15.91:56142) 2023-11-27T20:41:42.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.461+0000 7f028f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f028800fcc0 0x7f02880069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.461+0000 7f028e7fc640 1 -- 172.21.15.91:0/260543786 learned_addr learned my addr 172.21.15.91:0/260543786 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:42.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.461+0000 7f028effd640 1 --2- 172.21.15.91:0/260543786 >> v2:172.21.15.183:3300/0 conn(0x7f02880d78f0 0x7f028800ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.461+0000 7f5770f84640 1 -- 172.21.15.91:0/2918632514 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c0a6d40 con 0x7f57640d78e0 2023-11-27T20:41:42.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.461+0000 7f028f7fe640 1 -- 172.21.15.91:0/260543786 >> v2:172.21.15.183:3300/0 conn(0x7f02880d78f0 msgr2=0x7f028800ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.461+0000 7f028f7fe640 1 --2- 172.21.15.91:0/260543786 >> v2:172.21.15.183:3300/0 conn(0x7f02880d78f0 0x7f028800ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.461+0000 7f028dffb640 1 -- 172.21.15.91:0/260543786 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921970197 0 0) 0x7f02880d7cd0 con 0x7f02880506f0 2023-11-27T20:41:42.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.461+0000 7f028f7fe640 1 -- 172.21.15.91:0/260543786 >> v1:172.21.15.91:6789/0 conn(0x7f02880506f0 legacy=0x7f0288006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.462+0000 7f57741ea640 1 -- 172.21.15.91:0/2918632514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f57640d78e0 msgr2=0x7f576400ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.462+0000 7f57741ea640 1 --2- 172.21.15.91:0/2918632514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f57640d78e0 0x7f576400ed70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f576c04f5f0 tx=0x7f576c0a6140 comp rx=0 tx=0).stop 2023-11-27T20:41:42.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.462+0000 7ffb4f753640 1 Processor -- start 2023-11-27T20:41:42.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.462+0000 7f028f7fe640 1 -- 172.21.15.91:0/260543786 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028804bcb0 con 0x7f028800fcc0 2023-11-27T20:41:42.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.463+0000 7f028f7fe640 1 --2- 172.21.15.91:0/260543786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f028800fcc0 0x7f02880069a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02900641d0 tx=0x7f02900a5f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ba4946d95a99ab server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.463+0000 7f028dffb640 1 -- 172.21.15.91:0/260543786 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900a6cb0 con 0x7f028800fcc0 2023-11-27T20:41:42.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.463+0000 7f028dffb640 1 -- 172.21.15.91:0/260543786 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02900a6e10 con 0x7f028800fcc0 2023-11-27T20:41:42.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.463+0000 7f028dffb640 1 -- 172.21.15.91:0/260543786 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900ae640 con 0x7f028800fcc0 2023-11-27T20:41:42.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.463+0000 7ffb4f753640 1 -- start start 2023-11-27T20:41:42.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.464+0000 7ffb4f753640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffb48155fc0 0x7ffb48159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.464+0000 7ffb4f753640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffb480c1ca0 0x7ffb480c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.464+0000 7ffb4f753640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 0x7ffb480c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.464+0000 7ffb4f753640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4806dd60 con 0x7ffb48155fc0 2023-11-27T20:41:42.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.464+0000 7ffb4f753640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb480c6580 con 0x7ffb480c1ca0 2023-11-27T20:41:42.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.464+0000 7ffb4f753640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb480c3670 con 0x7ffb48071e30 2023-11-27T20:41:42.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.464+0000 7f028ffff640 1 -- 172.21.15.91:0/260543786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f028800fcc0 msgr2=0x7f02880069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.464+0000 7f028ffff640 1 --2- 172.21.15.91:0/260543786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f028800fcc0 0x7f02880069a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02900641d0 tx=0x7f02900a5f00 comp rx=0 tx=0).stop 2023-11-27T20:41:42.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7f2e71f39640 1 Processor -- start 2023-11-27T20:41:42.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7ffb4ccee640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffb480c1ca0 0x7ffb480c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7ffb4ccee640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffb480c1ca0 0x7ffb480c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:49344/0 (socket says 172.21.15.91:49344) 2023-11-27T20:41:42.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7ffb4ccee640 1 -- 172.21.15.91:0/1182232054 learned_addr learned my addr 172.21.15.91:0/1182232054 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7ffb4d4ef640 1 --2- 172.21.15.91:0/1182232054 >> v2:172.21.15.91:3300/0 conn(0x7ffb48155fc0 0x7ffb48159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7f028ffff640 1 -- 172.21.15.91:0/260543786 shutdown_connections 2023-11-27T20:41:42.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7f2e71f39640 1 -- start start 2023-11-27T20:41:42.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7f028ffff640 1 --2- 172.21.15.91:0/260543786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f028800fcc0 0x7f02880069a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7f028ffff640 1 --2- 172.21.15.91:0/260543786 >> v2:172.21.15.183:3300/0 conn(0x7f02880d78f0 0x7f028800ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7f028ffff640 1 -- 172.21.15.91:0/260543786 >> 172.21.15.91:0/260543786 conn(0x7f028804fbd0 msgr2=0x7f028804ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7ffb4dcf0640 1 --2- 172.21.15.91:0/1182232054 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 0x7ffb480c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7f028ffff640 1 -- 172.21.15.91:0/260543786 shutdown_connections 2023-11-27T20:41:42.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.465+0000 7f028ffff640 1 -- 172.21.15.91:0/260543786 wait complete. 2023-11-27T20:41:42.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.466+0000 7ffb4ccee640 1 -- 172.21.15.91:0/1182232054 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 msgr2=0x7ffb480c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.466+0000 7ffb4ccee640 1 --2- 172.21.15.91:0/1182232054 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 0x7ffb480c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.466+0000 7ffb4ccee640 1 -- 172.21.15.91:0/1182232054 >> v2:172.21.15.91:3300/0 conn(0x7ffb48155fc0 msgr2=0x7ffb48159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.466+0000 7ffb4ccee640 1 --2- 172.21.15.91:0/1182232054 >> v2:172.21.15.91:3300/0 conn(0x7ffb48155fc0 0x7ffb48159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.466+0000 7ffb4ccee640 1 -- 172.21.15.91:0/1182232054 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4806d580 con 0x7ffb480c1ca0 2023-11-27T20:41:42.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.466+0000 7ffb4d4ef640 1 --2- 172.21.15.91:0/1182232054 >> v2:172.21.15.91:3300/0 conn(0x7ffb48155fc0 0x7ffb48159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:42.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f2e71f39640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e640cda10 0x7f2e640d7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f2e71f39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2e64006e60 0x7f2e64007280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f2e71f39640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2e640daa70 0x7f2e640daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f2e71f39640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6402f220 con 0x7f2e64006e60 2023-11-27T20:41:42.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f2e71f39640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e640d7eb0 con 0x7f2e640daa70 2023-11-27T20:41:42.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f2e71f39640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e640cddf0 con 0x7f2e640cda10 2023-11-27T20:41:42.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f028ffff640 1 Processor -- start 2023-11-27T20:41:42.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f2e6affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2e64006e60 0x7f2e64007280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f2e6b7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e640cda10 0x7f2e640d7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f2e6affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2e64006e60 0x7f2e64007280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52292/0 (socket says 172.21.15.91:52292) 2023-11-27T20:41:42.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f2e6affd640 1 -- 172.21.15.91:0/856562312 learned_addr learned my addr 172.21.15.91:0/856562312 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f2e6bfff640 1 --2- 172.21.15.91:0/856562312 >> v2:172.21.15.183:3300/0 conn(0x7f2e640daa70 0x7f2e640daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7ffb4ccee640 1 --2- 172.21.15.91:0/1182232054 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb480c1ca0 0x7ffb480c2750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffb48067220 tx=0x7ffb3802b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d69ef3fb60f5583 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f028ffff640 1 -- start start 2023-11-27T20:41:42.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f57741ea640 1 -- 172.21.15.91:0/2918632514 shutdown_connections 2023-11-27T20:41:42.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f57741ea640 1 --2- 172.21.15.91:0/2918632514 >> v2:172.21.15.183:3300/0 conn(0x7f57640506e0 0x7f5764006280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f57741ea640 1 --2- 172.21.15.91:0/2918632514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f57640d78e0 0x7f576400ed70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.467+0000 7f57741ea640 1 -- 172.21.15.91:0/2918632514 >> 172.21.15.91:0/2918632514 conn(0x7f576404fbc0 msgr2=0x7f576404ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f2e6affd640 1 -- 172.21.15.91:0/856562312 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e640cda10 msgr2=0x7f2e640d7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f2e6affd640 1 --2- 172.21.15.91:0/856562312 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e640cda10 0x7f2e640d7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f2e6affd640 1 -- 172.21.15.91:0/856562312 >> v2:172.21.15.183:3300/0 conn(0x7f2e640daa70 msgr2=0x7f2e640daeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f2e6affd640 1 --2- 172.21.15.91:0/856562312 >> v2:172.21.15.183:3300/0 conn(0x7f2e640daa70 0x7f2e640daeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.468+0000 7f2e6affd640 1 -- 172.21.15.91:0/856562312 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6404abd0 con 0x7f2e64006e60 2023-11-27T20:41:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.469+0000 7ffb3ffff640 1 -- 172.21.15.91:0/1182232054 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38031750 con 0x7ffb480c1ca0 2023-11-27T20:41:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.469+0000 7ffb3ffff640 1 -- 172.21.15.91:0/1182232054 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb380318b0 con 0x7ffb480c1ca0 2023-11-27T20:41:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.469+0000 7ffb3ffff640 1 -- 172.21.15.91:0/1182232054 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38031c40 con 0x7ffb480c1ca0 2023-11-27T20:41:42.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.469+0000 7ffb4f753640 1 -- 172.21.15.91:0/1182232054 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb480c1ca0 msgr2=0x7ffb480c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.469+0000 7ffb4f753640 1 --2- 172.21.15.91:0/1182232054 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb480c1ca0 0x7ffb480c2750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffb48067220 tx=0x7ffb3802b7f0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.469+0000 7f2e6affd640 1 --2- 172.21.15.91:0/856562312 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 0x7f2e64007280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400be90 tx=0x7f2e6002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb415b6992af3cdb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7ffb4f753640 1 -- 172.21.15.91:0/1182232054 shutdown_connections 2023-11-27T20:41:42.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7ffb4f753640 1 --2- 172.21.15.91:0/1182232054 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 0x7ffb480c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7ffb4f753640 1 --2- 172.21.15.91:0/1182232054 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb480c1ca0 0x7ffb480c2750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7ffb4f753640 1 --2- 172.21.15.91:0/1182232054 >> v2:172.21.15.91:3300/0 conn(0x7ffb48155fc0 0x7ffb48159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7ffb4f753640 1 -- 172.21.15.91:0/1182232054 >> 172.21.15.91:0/1182232054 conn(0x7ffb4806a500 msgr2=0x7ffb4806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f028ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f028800fcc0 0x7f028804e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f57741ea640 1 -- 172.21.15.91:0/2918632514 shutdown_connections 2023-11-27T20:41:42.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f028ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02880506f0 0x7f028804e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f2e6a7fc640 1 -- 172.21.15.91:0/856562312 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60031880 con 0x7f2e64006e60 2023-11-27T20:41:42.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f028ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02880d78f0 0x7f0288034210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f028ffff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0288032840 con 0x7f02880d78f0 2023-11-27T20:41:42.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f2e6a7fc640 1 -- 172.21.15.91:0/856562312 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e600319e0 con 0x7f2e64006e60 2023-11-27T20:41:42.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f2e6a7fc640 1 -- 172.21.15.91:0/856562312 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60031d70 con 0x7f2e64006e60 2023-11-27T20:41:42.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f57741ea640 1 -- 172.21.15.91:0/2918632514 wait complete. 2023-11-27T20:41:42.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f028ffff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028804ee60 con 0x7f02880506f0 2023-11-27T20:41:42.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7f028ffff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880c6e10 con 0x7f028800fcc0 2023-11-27T20:41:42.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7ffb4f753640 1 -- 172.21.15.91:0/1182232054 shutdown_connections 2023-11-27T20:41:42.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f028effd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f028800fcc0 0x7f028804e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f028effd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f028800fcc0 0x7f028804e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59154/0 (socket says 172.21.15.91:59154) 2023-11-27T20:41:42.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f028effd640 1 -- 172.21.15.91:0/3984082839 learned_addr learned my addr 172.21.15.91:0/3984082839 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f028e7fc640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02880506f0 0x7f028804e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f2e71f39640 1 -- 172.21.15.91:0/856562312 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 msgr2=0x7f2e64007280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f2e71f39640 1 --2- 172.21.15.91:0/856562312 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 0x7f2e64007280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400be90 tx=0x7f2e6002b920 comp rx=0 tx=0).stop 2023-11-27T20:41:42.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f028effd640 1 -- 172.21.15.91:0/3984082839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02880506f0 msgr2=0x7f028804e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f028effd640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02880506f0 0x7f028804e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f028effd640 1 -- 172.21.15.91:0/3984082839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02880d78f0 msgr2=0x7f0288034210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-27T20:41:42.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f028effd640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02880d78f0 0x7f0288034210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.471+0000 7f028effd640 1 -- 172.21.15.91:0/3984082839 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029004f730 con 0x7f028800fcc0 2023-11-27T20:41:42.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.470+0000 7ffb4f753640 1 -- 172.21.15.91:0/1182232054 wait complete. 2023-11-27T20:41:42.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.472+0000 7f2e71f39640 1 -- 172.21.15.91:0/856562312 shutdown_connections 2023-11-27T20:41:42.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.472+0000 7f2e71f39640 1 --2- 172.21.15.91:0/856562312 >> v2:172.21.15.183:3300/0 conn(0x7f2e640daa70 0x7f2e640daeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.472+0000 7f2e71f39640 1 --2- 172.21.15.91:0/856562312 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 0x7f2e64007280 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.472+0000 7f2e71f39640 1 --2- 172.21.15.91:0/856562312 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e640cda10 0x7f2e640d7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.472+0000 7f2e71f39640 1 -- 172.21.15.91:0/856562312 >> 172.21.15.91:0/856562312 conn(0x7f2e64048210 msgr2=0x7f2e64048620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.472+0000 7f028effd640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f028800fcc0 0x7f028804e3e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f028000e870 tx=0x7f028000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.472+0000 7f2e71f39640 1 -- 172.21.15.91:0/856562312 shutdown_connections 2023-11-27T20:41:42.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.472+0000 7fb2b72a6640 1 Processor -- start 2023-11-27T20:41:42.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.473+0000 7f57741ea640 1 Processor -- start 2023-11-27T20:41:42.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.473+0000 7f02777fe640 1 -- 172.21.15.91:0/3984082839 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02800094f0 con 0x7f028800fcc0 2023-11-27T20:41:42.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.473+0000 7f02777fe640 1 -- 172.21.15.91:0/3984082839 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028000c940 con 0x7f028800fcc0 2023-11-27T20:41:42.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.473+0000 7f02777fe640 1 -- 172.21.15.91:0/3984082839 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028000ccf0 con 0x7f028800fcc0 2023-11-27T20:41:42.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.473+0000 7f028ffff640 1 -- 172.21.15.91:0/3984082839 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0288030b50 con 0x7f028800fcc0 2023-11-27T20:41:42.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.473+0000 7f2e71f39640 1 -- 172.21.15.91:0/856562312 wait complete. 2023-11-27T20:41:42.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.473+0000 7ffb4f753640 1 Processor -- start 2023-11-27T20:41:42.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.473+0000 7ffb4f753640 1 -- start start 2023-11-27T20:41:42.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.474+0000 7f57741ea640 1 -- start start 2023-11-27T20:41:42.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.474+0000 7ffb4f753640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 0x7ffb4815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7ffb4f753640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb480c1ca0 0x7ffb4815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.473+0000 7fb2b72a6640 1 -- start start 2023-11-27T20:41:42.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7fb2b72a6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb2b00c21b0 0x7fb2b00c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7fb2b72a6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b0154e00 con 0x7fb2b00c4f60 2023-11-27T20:41:42.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7fb2b72a6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b00c0860 con 0x7fb2b006e2f0 2023-11-27T20:41:42.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7fb2b72a6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b00c10d0 con 0x7fb2b00c21b0 2023-11-27T20:41:42.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7f8949b83640 1 Processor -- start 2023-11-27T20:41:42.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7f8949b83640 1 -- start start 2023-11-27T20:41:42.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7fb2b5042640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb2b00c4f60 0x7fb2b01546f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56146/0 (socket says 172.21.15.91:56146) 2023-11-27T20:41:42.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7fb2b5843640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb2b00c21b0 0x7fb2b00c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7fb2b5843640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb2b00c21b0 0x7fb2b00c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52306/0 (socket says 172.21.15.91:52306) 2023-11-27T20:41:42.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7fb2b5843640 1 -- 172.21.15.91:0/2706410013 learned_addr learned my addr 172.21.15.91:0/2706410013 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7f2e71f39640 1 Processor -- start 2023-11-27T20:41:42.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7f028ffff640 1 -- 172.21.15.91:0/3984082839 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0288032a50 con 0x7f028800fcc0 2023-11-27T20:41:42.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7f2e71f39640 1 -- start start 2023-11-27T20:41:42.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7f57741ea640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576400fcb0 0x7f57640d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.477+0000 7fb2b5843640 1 -- 172.21.15.91:0/2706410013 >> v1:172.21.15.183:6789/0 conn(0x7fb2b006e2f0 legacy=0x7fb2b00aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.477+0000 7f57741ea640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57640506e0 0x7f576404ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.477+0000 7fb2b5843640 1 -- 172.21.15.91:0/2706410013 >> v1:172.21.15.91:6789/0 conn(0x7fb2b00c4f60 legacy=0x7fb2b01546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.477+0000 7f57741ea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f57640d78e0 0x7f576417cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7ffb4d4ef640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 0x7ffb4815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.475+0000 7ffb4d4ef640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 0x7ffb4815c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59168/0 (socket says 172.21.15.91:59168) 2023-11-27T20:41:42.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7ffb4f753640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb48155fc0 0x7ffb48151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7ffb4f753640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb481ee7a0 con 0x7ffb48155fc0 2023-11-27T20:41:42.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7ffb4f753640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb480a28b0 con 0x7ffb480c1ca0 2023-11-27T20:41:42.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7ffb4f753640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb481f1eb0 con 0x7ffb48071e30 2023-11-27T20:41:42.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7ffb4dcf0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb48155fc0 0x7ffb48151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7ffb4dcf0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb48155fc0 0x7ffb48151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52310/0 (socket says 172.21.15.91:52310) 2023-11-27T20:41:42.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.476+0000 7ffb4dcf0640 1 -- 172.21.15.91:0/1059764743 learned_addr learned my addr 172.21.15.91:0/1059764743 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.477+0000 7f5771f86640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576400fcb0 0x7f57640d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f5771f86640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576400fcb0 0x7f57640d13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:49382/0 (socket says 172.21.15.91:49382) 2023-11-27T20:41:42.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7fb2b5843640 1 -- 172.21.15.91:0/2706410013 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00c0b40 con 0x7fb2b00c21b0 2023-11-27T20:41:42.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.477+0000 7f8949b83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 0x7f89440c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f8949b83640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f89440c4e50 0x7f894406b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f2e71f39640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 0x7f2e64177fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f8949b83640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89440bd8d0 con 0x7f894414e810 2023-11-27T20:41:42.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f5772787640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f57640d78e0 0x7f576417cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f2e71f39640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e640cda10 0x7f2e640cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f5771f86640 1 -- 172.21.15.91:0/1665996339 learned_addr learned my addr 172.21.15.91:0/1665996339 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f5771785640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57640506e0 0x7f576404ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f8949b83640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89440c6e60 con 0x7f89440c4e50 2023-11-27T20:41:42.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f8949b83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440c70d0 con 0x7f89440c7e90 2023-11-27T20:41:42.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f8942ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 0x7f89440c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5764180f10 con 0x7f57640d78e0 2023-11-27T20:41:42.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7ffb4dcf0640 1 -- 172.21.15.91:0/1059764743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 msgr2=0x7ffb4815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7ffb4dcf0640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 0x7ffb4815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640de310 con 0x7f576400fcb0 2023-11-27T20:41:42.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7ffb4dcf0640 1 -- 172.21.15.91:0/1059764743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb480c1ca0 msgr2=0x7ffb4815aa50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T20:41:42.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7ffb4dcf0640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb480c1ca0 0x7ffb4815aa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7f8942ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 0x7f89440c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59174/0 (socket says 172.21.15.91:59174) 2023-11-27T20:41:42.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5764180ba0 con 0x7f57640506e0 2023-11-27T20:41:42.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7ffb4dcf0640 1 -- 172.21.15.91:0/1059764743 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44009400 con 0x7ffb48155fc0 2023-11-27T20:41:42.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7f8942ffd640 1 -- 172.21.15.91:0/614565570 learned_addr learned my addr 172.21.15.91:0/614565570 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7fbc9de56640 1 Processor -- start 2023-11-27T20:41:42.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f2e71f39640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e640daa70 0x7f2e640ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7f2e6b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 0x7f2e64177fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7f8943fff640 1 --2- 172.21.15.91:0/614565570 >> v2:172.21.15.183:3300/0 conn(0x7f89440c4e50 0x7f894406b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7fbc9de56640 1 -- start start 2023-11-27T20:41:42.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7f2e71f39640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64044d70 con 0x7f2e64006e60 2023-11-27T20:41:42.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7ffb4dcf0640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb48155fc0 0x7ffb48151ae0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000efc0 tx=0x7ffb4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7f2e71f39640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64045050 con 0x7f2e640daa70 2023-11-27T20:41:42.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.479+0000 7f2e71f39640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64045330 con 0x7f2e640cda10 2023-11-27T20:41:42.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f2e6b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 0x7f2e64177fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52338/0 (socket says 172.21.15.91:52338) 2023-11-27T20:41:42.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f5772787640 1 -- 172.21.15.91:0/1665996339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57640506e0 msgr2=0x7f576404ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f5772787640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57640506e0 0x7f576404ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f5772787640 1 -- 172.21.15.91:0/1665996339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576400fcb0 msgr2=0x7f57640d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f5772787640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576400fcb0 0x7f57640d13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f5772787640 1 -- 172.21.15.91:0/1665996339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c04f730 con 0x7f57640d78e0 2023-11-27T20:41:42.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f2e6b7fe640 1 -- 172.21.15.91:0/2111571834 learned_addr learned my addr 172.21.15.91:0/2111571834 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f2e6bfff640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e640daa70 0x7f2e640ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f2e6affd640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e640cda10 0x7f2e640cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7ffb3dffb640 1 -- 172.21.15.91:0/1059764743 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40014480 con 0x7ffb48155fc0 2023-11-27T20:41:42.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7ffb3dffb640 1 -- 172.21.15.91:0/1059764743 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4000f040 con 0x7ffb48155fc0 2023-11-27T20:41:42.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7ffb3dffb640 1 -- 172.21.15.91:0/1059764743 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40014820 con 0x7ffb48155fc0 2023-11-27T20:41:42.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7ffb4f753640 1 -- 172.21.15.91:0/1059764743 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb380094d0 con 0x7ffb48155fc0 2023-11-27T20:41:42.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f5772787640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f57640d78e0 0x7f576417cf40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f575c007fd0 tx=0x7f575c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7ffb4f753640 1 -- 172.21.15.91:0/1059764743 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb480a3da0 con 0x7ffb48155fc0 2023-11-27T20:41:42.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f57627fc640 1 -- 172.21.15.91:0/1665996339 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0035f0 con 0x7f57640d78e0 2023-11-27T20:41:42.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576404f1c0 con 0x7f57640d78e0 2023-11-27T20:41:42.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57640d4400 con 0x7f57640d78e0 2023-11-27T20:41:42.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f57627fc640 1 -- 172.21.15.91:0/1665996339 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c003770 con 0x7f57640d78e0 2023-11-27T20:41:42.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.482+0000 7f57627fc640 1 -- 172.21.15.91:0/1665996339 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c003b20 con 0x7f57640d78e0 2023-11-27T20:41:42.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.478+0000 7f02777fe640 1 -- 172.21.15.91:0/3984082839 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0280013470 con 0x7f028800fcc0 2023-11-27T20:41:42.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.482+0000 7f028ffff640 1 -- 172.21.15.91:0/3984082839 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0288005360 con 0x7f028800fcc0 2023-11-27T20:41:42.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f2e6b7fe640 1 -- 172.21.15.91:0/2111571834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e640cda10 msgr2=0x7f2e640cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f2e6b7fe640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e640cda10 0x7f2e640cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f2e6b7fe640 1 -- 172.21.15.91:0/2111571834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e640daa70 msgr2=0x7f2e640ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f2e6b7fe640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e640daa70 0x7f2e640ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f2e6b7fe640 1 -- 172.21.15.91:0/2111571834 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600094d0 con 0x7f2e64006e60 2023-11-27T20:41:42.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.482+0000 7ffb4f753640 1 -- 172.21.15.91:0/1059764743 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb481eeca0 con 0x7ffb48155fc0 2023-11-27T20:41:42.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7fbc9de56640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7fbc9de56640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbc980c7e90 0x7fbc980c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7fbc9de56640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc980bd8d0 con 0x7fbc980c4e50 2023-11-27T20:41:42.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7fbc9de56640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc980c6e60 con 0x7fbc980c7e90 2023-11-27T20:41:42.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7fbc9de56640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98155600 con 0x7fbc9814e810 2023-11-27T20:41:42.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.482+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f41c9ea2640 1 Processor -- start 2023-11-27T20:41:42.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.482+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59182/0 (socket says 172.21.15.91:59182) 2023-11-27T20:41:42.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.482+0000 7fbc977fe640 1 -- 172.21.15.91:0/1256988772 learned_addr learned my addr 172.21.15.91:0/1256988772 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.483+0000 7f02777fe640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f027c06b1f0 0x7f027c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f8943fff640 1 -- 172.21.15.91:0/614565570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 msgr2=0x7f89440c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f8943fff640 1 --2- 172.21.15.91:0/614565570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 0x7f89440c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f8943fff640 1 -- 172.21.15.91:0/614565570 >> v1:172.21.15.183:6789/0 conn(0x7f894414e810 legacy=0x7f89441550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.483+0000 7f2e6b7fe640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 0x7f2e64177fa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c069c30 tx=0x7f2e6c067f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.480+0000 7f8943fff640 1 -- 172.21.15.91:0/614565570 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440c73b0 con 0x7f89440c4e50 2023-11-27T20:41:42.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7f41c9ea2640 1 -- start start 2023-11-27T20:41:42.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.483+0000 7f02777fe640 1 -- 172.21.15.91:0/3984082839 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02800890d0 con 0x7f028800fcc0 2023-11-27T20:41:42.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.481+0000 7fb2b5843640 1 --2- 172.21.15.91:0/2706410013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 0x7fb2b00c42b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8006030 tx=0x7fb2a802e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346b104470467a5e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.483+0000 7ffb3dffb640 1 -- 172.21.15.91:0/1059764743 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ffb40014980 con 0x7ffb48155fc0 2023-11-27T20:41:42.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.483+0000 7fbc96ffd640 1 --2- 172.21.15.91:0/1256988772 >> v2:172.21.15.91:3300/0 conn(0x7fbc980c7e90 0x7fbc980c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7f8943fff640 1 --2- 172.21.15.91:0/614565570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89440c4e50 0x7f894406b7d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f893c009d90 tx=0x7f893c02bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85cdf5da1259f3cf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7fbc977fe640 1 -- 172.21.15.91:0/1256988772 >> v2:172.21.15.91:3300/0 conn(0x7fbc980c7e90 msgr2=0x7fbc980c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:42.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7fbc977fe640 1 --2- 172.21.15.91:0/1256988772 >> v2:172.21.15.91:3300/0 conn(0x7fbc980c7e90 0x7fbc980c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7f41c37fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f41c40c4f60 0x7f41c41546f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:35846/0 (socket says 172.21.15.91:35846) 2023-11-27T20:41:42.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7fbc977fe640 1 -- 172.21.15.91:0/1256988772 >> v1:172.21.15.183:6789/0 conn(0x7fbc980c4e50 legacy=0x7fbc9806b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7fbc977fe640 1 -- 172.21.15.91:0/1256988772 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc980c70d0 con 0x7fbc9814e810 2023-11-27T20:41:42.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7f41c37fe640 1 -- 172.21.15.91:0/1840918829 learned_addr learned my addr 172.21.15.91:0/1840918829 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:42.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7f41c9ea2640 1 --2- 172.21.15.91:0/1840918829 >> v2:172.21.15.91:3300/0 conn(0x7f41c40c21b0 0x7f41c40c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7f028e7fc640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f027c06b1f0 0x7f027c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7f41c9ea2640 1 -- 172.21.15.91:0/1840918829 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c4154e00 con 0x7f41c406e2f0 2023-11-27T20:41:42.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.484+0000 7f89427fc640 1 -- 172.21.15.91:0/614565570 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c02cb40 con 0x7f89440c4e50 2023-11-27T20:41:42.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5754005250 con 0x7f57640d78e0 2023-11-27T20:41:42.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7f89427fc640 1 -- 172.21.15.91:0/614565570 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c02cca0 con 0x7f89440c4e50 2023-11-27T20:41:42.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7f41c9ea2640 1 -- 172.21.15.91:0/1840918829 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c40c0860 con 0x7f41c40c4f60 2023-11-27T20:41:42.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7f41c9ea2640 1 -- 172.21.15.91:0/1840918829 --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c40c10d0 con 0x7f41c40c21b0 2023-11-27T20:41:42.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7f89427fc640 1 -- 172.21.15.91:0/614565570 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c034660 con 0x7f89440c4e50 2023-11-27T20:41:42.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7f028e7fc640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f027c06b1f0 0x7f027c06d6b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0284007f70 tx=0x7f0284007f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7fb2a3fff640 1 -- 172.21.15.91:0/2706410013 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8038400 con 0x7fb2b00c21b0 2023-11-27T20:41:42.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7fb2a3fff640 1 -- 172.21.15.91:0/2706410013 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8032070 con 0x7fb2b00c21b0 2023-11-27T20:41:42.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7fb2a3fff640 1 -- 172.21.15.91:0/2706410013 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8038780 con 0x7fb2b00c21b0 2023-11-27T20:41:42.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7f41c27fc640 1 -- 172.21.15.91:0/1840918829 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100549053 0 0) 0x7f41c40c0860 con 0x7f41c40c4f60 2023-11-27T20:41:42.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.485+0000 7f41c27fc640 1 -- 172.21.15.91:0/1840918829 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41ac003520 con 0x7f41c40c4f60 2023-11-27T20:41:42.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7ffb3dffb640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb2c06b290 0x7ffb2c06d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f41c3fff640 1 --2- 172.21.15.91:0/1840918829 >> v2:172.21.15.91:3300/0 conn(0x7f41c40c21b0 0x7f41c40c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7ffb3dffb640 1 -- 172.21.15.91:0/1059764743 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb4008a4c0 con 0x7ffb48155fc0 2023-11-27T20:41:42.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f8949b83640 1 -- 172.21.15.91:0/614565570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89440c4e50 msgr2=0x7f894406b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f8949b83640 1 --2- 172.21.15.91:0/614565570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89440c4e50 0x7f894406b7d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f893c009d90 tx=0x7f893c02bd90 comp rx=0 tx=0).stop 2023-11-27T20:41:42.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7ffb4d4ef640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb2c06b290 0x7ffb2c06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7fbc977fe640 1 --2- 172.21.15.91:0/1256988772 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981550c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009870 tx=0x7fbc8802b740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b97da5d06a2e6b3a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f41c27fc640 1 -- 172.21.15.91:0/1840918829 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 501335359 0 0) 0x7f41ac003520 con 0x7f41c40c4f60 2023-11-27T20:41:42.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f41c3fff640 1 -- 172.21.15.91:0/1840918829 >> v1:172.21.15.183:6789/0 conn(0x7f41c40c4f60 legacy=0x7f41c41546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f41c3fff640 1 -- 172.21.15.91:0/1840918829 >> v1:172.21.15.91:6789/0 conn(0x7f41c406e2f0 legacy=0x7f41c40aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f41c3fff640 1 -- 172.21.15.91:0/1840918829 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c40c0b40 con 0x7f41c40c21b0 2023-11-27T20:41:42.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7fb2b72a6640 1 -- 172.21.15.91:0/2706410013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 msgr2=0x7fb2b00c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7fb2b72a6640 1 --2- 172.21.15.91:0/2706410013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 0x7fb2b00c42b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8006030 tx=0x7fb2a802e120 comp rx=0 tx=0).stop 2023-11-27T20:41:42.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f8949b83640 1 -- 172.21.15.91:0/614565570 shutdown_connections 2023-11-27T20:41:42.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f8949b83640 1 --2- 172.21.15.91:0/614565570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89440c4e50 0x7f894406b7d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f8949b83640 1 --2- 172.21.15.91:0/614565570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 0x7f89440c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f8949b83640 1 -- 172.21.15.91:0/614565570 >> 172.21.15.91:0/614565570 conn(0x7f89440ca170 msgr2=0x7f89440ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.486+0000 7f57627fc640 1 -- 172.21.15.91:0/1665996339 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f575c003c80 con 0x7f57640d78e0 2023-11-27T20:41:42.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.487+0000 7fb2b72a6640 1 -- 172.21.15.91:0/2706410013 shutdown_connections 2023-11-27T20:41:42.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.487+0000 7fb2b72a6640 1 --2- 172.21.15.91:0/2706410013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 0x7fb2b00c42b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.487+0000 7fb2b72a6640 1 -- 172.21.15.91:0/2706410013 >> 172.21.15.91:0/2706410013 conn(0x7fb2b00c5cc0 msgr2=0x7fb2b00c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.487+0000 7f8949b83640 1 -- 172.21.15.91:0/614565570 shutdown_connections 2023-11-27T20:41:42.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.487+0000 7f8949b83640 1 -- 172.21.15.91:0/614565570 wait complete. 2023-11-27T20:41:42.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.487+0000 7ffb4d4ef640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb2c06b290 0x7ffb2c06d750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009c00 tx=0x7ffb44009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.487+0000 7fb2b72a6640 1 -- 172.21.15.91:0/2706410013 shutdown_connections 2023-11-27T20:41:42.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.487+0000 7fb2b72a6640 1 -- 172.21.15.91:0/2706410013 wait complete. 2023-11-27T20:41:42.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.487+0000 7f41c3fff640 1 --2- 172.21.15.91:0/1840918829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c21b0 0x7f41c40c42b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009d90 tx=0x7f41bc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4f8f3f514e4a17 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.488+0000 7f57627fc640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f575006b1c0 0x7f575006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.488+0000 7f57627fc640 1 -- 172.21.15.91:0/1665996339 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f575c088ef0 con 0x7f57640d78e0 2023-11-27T20:41:42.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.488+0000 7f8949b83640 1 Processor -- start 2023-11-27T20:41:42.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.489+0000 7f5771f86640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f575006b1c0 0x7f575006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.489+0000 7f8949b83640 1 -- start start 2023-11-27T20:41:42.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.489+0000 7f5771f86640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f575006b1c0 0x7f575006d680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f576c050140 tx=0x7f576c0aa000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.489+0000 7f8949b83640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89440c4e50 0x7f89441f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.489+0000 7f8949b83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 0x7f8944154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7f8949b83640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f894414e810 0x7f8944154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7f8949b83640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8944155480 con 0x7f894414e810 2023-11-27T20:41:42.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7f8949b83640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8944155c20 con 0x7f89440c4e50 2023-11-27T20:41:42.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7f8949b83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440bd2b0 con 0x7f89440c7e90 2023-11-27T20:41:42.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7f8943fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f894414e810 0x7f8944154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7f8943fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f894414e810 0x7f8944154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52356/0 (socket says 172.21.15.91:52356) 2023-11-27T20:41:42.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7f8943fff640 1 -- 172.21.15.91:0/39972420 learned_addr learned my addr 172.21.15.91:0/39972420 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7f8942ffd640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 0x7f8944154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7fb2b72a6640 1 Processor -- start 2023-11-27T20:41:42.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7f89437fe640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89440c4e50 0x7f89441f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.490+0000 7f41c27fc640 1 -- 172.21.15.91:0/1840918829 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4001670 con 0x7f41c40c21b0 2023-11-27T20:41:42.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7fb2b72a6640 1 -- start start 2023-11-27T20:41:42.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7f8943fff640 1 -- 172.21.15.91:0/39972420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 msgr2=0x7f8944154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7f8943fff640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 0x7f8944154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7f8943fff640 1 -- 172.21.15.91:0/39972420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89440c4e50 msgr2=0x7f89441f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7ffb3dffb640 1 -- 172.21.15.91:0/1059764743 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ffb481eeca0 con 0x7ffb48155fc0 2023-11-27T20:41:42.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7f8943fff640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89440c4e50 0x7f89441f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7f8943fff640 1 -- 172.21.15.91:0/39972420 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c009a70 con 0x7f894414e810 2023-11-27T20:41:42.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7f2e57fff640 1 -- 172.21.15.91:0/2111571834 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0721c0 con 0x7f2e64006e60 2023-11-27T20:41:42.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7f2e71f39640 1 -- 172.21.15.91:0/2111571834 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e64045610 con 0x7f2e64006e60 2023-11-27T20:41:42.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7f2e71f39640 1 -- 172.21.15.91:0/2111571834 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e640cecd0 con 0x7f2e64006e60 2023-11-27T20:41:42.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.491+0000 7f8943fff640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f894414e810 0x7f8944154660 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f893c02c3a0 tx=0x7f893c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.492+0000 7fb2b72a6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2b006e2f0 0x7fb2b014e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.492+0000 7fb2b72a6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 0x7fb2b0146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.492+0000 7fb2b72a6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2b00c4f60 0x7fb2b0147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.492+0000 7fb2b72a6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b01542d0 con 0x7fb2b00c21b0 2023-11-27T20:41:42.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.492+0000 7fb2b72a6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0147990 con 0x7fb2b00c4f60 2023-11-27T20:41:42.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.492+0000 7fb2b72a6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b01ef600 con 0x7fb2b006e2f0 2023-11-27T20:41:42.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.492+0000 7f2e71f39640 1 -- 172.21.15.91:0/2111571834 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e64005350 con 0x7f2e64006e60 2023-11-27T20:41:42.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.492+0000 7fb2b4841640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 0x7fb2b0146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.493+0000 7fb2b4841640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 0x7fb2b0146f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52362/0 (socket says 172.21.15.91:52362) 2023-11-27T20:41:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.493+0000 7fb2b4841640 1 -- 172.21.15.91:0/3383342909 learned_addr learned my addr 172.21.15.91:0/3383342909 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.493+0000 7fb2b5042640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2b006e2f0 0x7fb2b014e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.493+0000 7fb2b5843640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2b00c4f60 0x7fb2b0147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.493+0000 7fb2b4841640 1 -- 172.21.15.91:0/3383342909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2b006e2f0 msgr2=0x7fb2b014e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.493+0000 7fb2b4841640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2b006e2f0 0x7fb2b014e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.493+0000 7fb2b4841640 1 -- 172.21.15.91:0/3383342909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2b00c4f60 msgr2=0x7fb2b0147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.493+0000 7fb2b4841640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2b00c4f60 0x7fb2b0147450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.493+0000 7fb2b4841640 1 -- 172.21.15.91:0/3383342909 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8005d10 con 0x7fb2b00c21b0 2023-11-27T20:41:42.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.493+0000 7fb2b4841640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 0x7fb2b0146f10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c750 tx=0x7fb2a400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.496+0000 7f2e57fff640 1 -- 172.21.15.91:0/2111571834 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c071050 con 0x7f2e64006e60 2023-11-27T20:41:42.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.496+0000 7f2e57fff640 1 -- 172.21.15.91:0/2111571834 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c072520 con 0x7f2e64006e60 2023-11-27T20:41:42.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.496+0000 7f41c27fc640 1 -- 172.21.15.91:0/1840918829 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc02c970 con 0x7f41c40c21b0 2023-11-27T20:41:42.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.496+0000 7fb2a1ffb640 1 -- 172.21.15.91:0/3383342909 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005270 con 0x7fb2b00c21b0 2023-11-27T20:41:42.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.496+0000 7f892bfff640 1 -- 172.21.15.91:0/39972420 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c03e610 con 0x7f894414e810 2023-11-27T20:41:42.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.496+0000 7f8949b83640 1 -- 172.21.15.91:0/39972420 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8944152cc0 con 0x7f894414e810 2023-11-27T20:41:42.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.497+0000 7f8949b83640 1 -- 172.21.15.91:0/39972420 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8944154ec0 con 0x7f894414e810 2023-11-27T20:41:42.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.497+0000 7fb2b72a6640 1 -- 172.21.15.91:0/3383342909 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b014b250 con 0x7fb2b00c21b0 2023-11-27T20:41:42.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.497+0000 7fb2b72a6640 1 -- 172.21.15.91:0/3383342909 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b014b6d0 con 0x7fb2b00c21b0 2023-11-27T20:41:42.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.497+0000 7f41c9ea2640 1 -- 172.21.15.91:0/1840918829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c21b0 msgr2=0x7f41c40c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.497+0000 7f41c9ea2640 1 --2- 172.21.15.91:0/1840918829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c21b0 0x7f41c40c42b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009d90 tx=0x7f41bc02be40 comp rx=0 tx=0).stop 2023-11-27T20:41:42.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.497+0000 7f892bfff640 1 -- 172.21.15.91:0/39972420 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c03e770 con 0x7f894414e810 2023-11-27T20:41:42.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.497+0000 7f892bfff640 1 -- 172.21.15.91:0/39972420 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c03eae0 con 0x7f894414e810 2023-11-27T20:41:42.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.498+0000 7f41c9ea2640 1 -- 172.21.15.91:0/1840918829 shutdown_connections 2023-11-27T20:41:42.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.498+0000 7f41c9ea2640 1 --2- 172.21.15.91:0/1840918829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c21b0 0x7f41c40c42b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.498+0000 7f41c9ea2640 1 -- 172.21.15.91:0/1840918829 >> 172.21.15.91:0/1840918829 conn(0x7f41c40c5cc0 msgr2=0x7f41c40c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.498+0000 7f41c9ea2640 1 -- 172.21.15.91:0/1840918829 shutdown_connections 2023-11-27T20:41:42.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.498+0000 7f41c9ea2640 1 -- 172.21.15.91:0/1840918829 wait complete. 2023-11-27T20:41:42.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.498+0000 7f57627fc640 1 -- 172.21.15.91:0/1665996339 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f575c053ce0 con 0x7f57640d78e0 2023-11-27T20:41:42.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.498+0000 7fb2b72a6640 1 -- 172.21.15.91:0/3383342909 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b014b890 con 0x7fb2b00c21b0 2023-11-27T20:41:42.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.499+0000 7fb2a1ffb640 1 -- 172.21.15.91:0/3383342909 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4001330 con 0x7fb2b00c21b0 2023-11-27T20:41:42.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.499+0000 7fb2a1ffb640 1 -- 172.21.15.91:0/3383342909 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400a640 con 0x7fb2b00c21b0 2023-11-27T20:41:42.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.499+0000 7f8949b83640 1 -- 172.21.15.91:0/39972420 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8924005250 con 0x7f894414e810 2023-11-27T20:41:42.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.499+0000 7f2e57fff640 1 -- 172.21.15.91:0/2111571834 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2e6c072680 con 0x7f2e64006e60 2023-11-27T20:41:42.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.501+0000 7f41c9ea2640 1 Processor -- start 2023-11-27T20:41:42.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.501+0000 7f41c9ea2640 1 -- start start 2023-11-27T20:41:42.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.501+0000 7f02777fe640 1 -- 172.21.15.91:0/3984082839 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f028008e060 con 0x7f028800fcc0 2023-11-27T20:41:42.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.501+0000 7f2e57fff640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2e5006b1f0 0x7f2e5006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.501+0000 7f2e57fff640 1 -- 172.21.15.91:0/2111571834 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e6c103980 con 0x7f2e64006e60 2023-11-27T20:41:42.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.502+0000 7fbc967fc640 1 -- 172.21.15.91:0/1256988772 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc88030710 con 0x7fbc9814e810 2023-11-27T20:41:42.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.502+0000 7fbc967fc640 1 -- 172.21.15.91:0/1256988772 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8802e050 con 0x7fbc9814e810 2023-11-27T20:41:42.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.502+0000 7fbc967fc640 1 -- 172.21.15.91:0/1256988772 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc88030a90 con 0x7fbc9814e810 2023-11-27T20:41:42.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.502+0000 7f2e6affd640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2e5006b1f0 0x7f2e5006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.502+0000 7f41c9ea2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41c406e2f0 0x7f41c41f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.502+0000 7f41c9ea2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41c40c21b0 0x7f41c4148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.502+0000 7f41c9ea2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c4f60 0x7f41c4144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.502+0000 7f41c9ea2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c41542d0 con 0x7f41c40c4f60 2023-11-27T20:41:42.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.502+0000 7f41c9ea2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c41ef690 con 0x7f41c406e2f0 2023-11-27T20:41:42.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.502+0000 7f41c9ea2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40bf600 con 0x7f41c40c21b0 2023-11-27T20:41:42.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.503+0000 7f2e6affd640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2e5006b1f0 0x7f2e5006d6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e60036000 tx=0x7f2e6003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.503+0000 7f41c3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c4f60 0x7f41c4144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.503+0000 7f41c3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c4f60 0x7f41c4144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52364/0 (socket says 172.21.15.91:52364) 2023-11-27T20:41:42.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.503+0000 7f41c3fff640 1 -- 172.21.15.91:0/208316420 learned_addr learned my addr 172.21.15.91:0/208316420 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.503+0000 7f41c37fe640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41c406e2f0 0x7f41c41f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.503+0000 7f41c2ffd640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41c40c21b0 0x7f41c4148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7fbc9de56640 1 -- 172.21.15.91:0/1256988772 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 msgr2=0x7fbc981550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7fbc9de56640 1 --2- 172.21.15.91:0/1256988772 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981550c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009870 tx=0x7fbc8802b740 comp rx=0 tx=0).stop 2023-11-27T20:41:42.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7f41c3fff640 1 -- 172.21.15.91:0/208316420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41c40c21b0 msgr2=0x7f41c4148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7f41c3fff640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41c40c21b0 0x7f41c4148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7f41c3fff640 1 -- 172.21.15.91:0/208316420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41c406e2f0 msgr2=0x7f41c41f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7f41c3fff640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41c406e2f0 0x7f41c41f2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7f41c3fff640 1 -- 172.21.15.91:0/208316420 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc009a70 con 0x7f41c40c4f60 2023-11-27T20:41:42.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7fbc9de56640 1 -- 172.21.15.91:0/1256988772 shutdown_connections 2023-11-27T20:41:42.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7fbc9de56640 1 --2- 172.21.15.91:0/1256988772 >> v2:172.21.15.91:3300/0 conn(0x7fbc980c7e90 0x7fbc980c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7fbc9de56640 1 --2- 172.21.15.91:0/1256988772 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981550c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7fbc9de56640 1 -- 172.21.15.91:0/1256988772 >> 172.21.15.91:0/1256988772 conn(0x7fbc980ca170 msgr2=0x7fbc980ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7fbc9de56640 1 -- 172.21.15.91:0/1256988772 shutdown_connections 2023-11-27T20:41:42.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7fbc9de56640 1 -- 172.21.15.91:0/1256988772 wait complete. 2023-11-27T20:41:42.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.504+0000 7f41c3fff640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c4f60 0x7f41c4144310 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41bc02c450 tx=0x7f41bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.506+0000 7f2e57fff640 1 -- 172.21.15.91:0/2111571834 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2e6c0ce7d0 con 0x7f2e64006e60 2023-11-27T20:41:42.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.507+0000 7f41abfff640 1 -- 172.21.15.91:0/208316420 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc03e8e0 con 0x7f41c40c4f60 2023-11-27T20:41:42.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.507+0000 7f41abfff640 1 -- 172.21.15.91:0/208316420 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc03ea40 con 0x7f41c40c4f60 2023-11-27T20:41:42.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.507+0000 7f41abfff640 1 -- 172.21.15.91:0/208316420 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc03ee10 con 0x7f41c40c4f60 2023-11-27T20:41:42.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.507+0000 7f41c9ea2640 1 -- 172.21.15.91:0/208316420 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c40bc170 con 0x7f41c40c4f60 2023-11-27T20:41:42.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.507+0000 7f41c9ea2640 1 -- 172.21.15.91:0/208316420 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c40bc6a0 con 0x7f41c40c4f60 2023-11-27T20:41:42.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.508+0000 7f892bfff640 1 -- 172.21.15.91:0/39972420 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f893c03b050 con 0x7f894414e810 2023-11-27T20:41:42.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.508+0000 7fbc9de56640 1 Processor -- start 2023-11-27T20:41:42.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.509+0000 7fb2a1ffb640 1 -- 172.21.15.91:0/3383342909 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb2a400a860 con 0x7fb2b00c21b0 2023-11-27T20:41:42.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.509+0000 7fbc9de56640 1 -- start start 2023-11-27T20:41:42.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.509+0000 7f892bfff640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f893006b1c0 0x7f893006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.509+0000 7f892bfff640 1 -- 172.21.15.91:0/39972420 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f893c0ac290 con 0x7f894414e810 2023-11-27T20:41:42.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.510+0000 7f89437fe640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f893006b1c0 0x7f893006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.510+0000 7fb2a1ffb640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb29406b1c0 0x7fb29406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.511+0000 7fb2a1ffb640 1 -- 172.21.15.91:0/3383342909 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2a408a030 con 0x7fb2b00c21b0 2023-11-27T20:41:42.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.511+0000 7f89437fe640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f893006b1c0 0x7f893006d680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f89440b00b0 tx=0x7f8934009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.510+0000 7fbc9de56640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc980c4e50 0x7fbc98156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.511+0000 7fbc9de56640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc980c7e90 0x7fbc981e9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.511+0000 7fbc9de56640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981ea4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.511+0000 7fbc9de56640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc981eab00 con 0x7fbc980c4e50 2023-11-27T20:41:42.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.511+0000 7fbc9de56640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98150de0 con 0x7fbc980c7e90 2023-11-27T20:41:42.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.511+0000 7fbc9de56640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98157e60 con 0x7fbc9814e810 2023-11-27T20:41:42.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.511+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981ea4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.511+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981ea4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59208/0 (socket says 172.21.15.91:59208) 2023-11-27T20:41:42.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.511+0000 7fbc97fff640 1 -- 172.21.15.91:0/3760116345 learned_addr learned my addr 172.21.15.91:0/3760116345 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:42.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.512+0000 7fbc977fe640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc980c4e50 0x7fbc98156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.512+0000 7f41c9ea2640 1 -- 172.21.15.91:0/208316420 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a4005250 con 0x7f41c40c4f60 2023-11-27T20:41:42.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.512+0000 7fbc96ffd640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc980c7e90 0x7fbc981e9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.512+0000 7fb2b5042640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb29406b1c0 0x7fb29406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.512+0000 7fbc97fff640 1 -- 172.21.15.91:0/3760116345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc980c7e90 msgr2=0x7fbc981e9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.512+0000 7fbc97fff640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc980c7e90 0x7fbc981e9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.512+0000 7fbc97fff640 1 -- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc980c4e50 msgr2=0x7fbc98156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.513+0000 7fbc97fff640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc980c4e50 0x7fbc98156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.513+0000 7fbc97fff640 1 -- 172.21.15.91:0/3760116345 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc880094d0 con 0x7fbc9814e810 2023-11-27T20:41:42.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.513+0000 7fbc977fe640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc980c4e50 0x7fbc98156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:42.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.513+0000 7fbc97fff640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981ea4e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc9000cb20 tx=0x7fbc90002080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.514+0000 7fbc7ffff640 1 -- 172.21.15.91:0/3760116345 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90003da0 con 0x7fbc9814e810 2023-11-27T20:41:42.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.514+0000 7fbc7ffff640 1 -- 172.21.15.91:0/3760116345 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9000a700 con 0x7fbc9814e810 2023-11-27T20:41:42.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.514+0000 7fbc7ffff640 1 -- 172.21.15.91:0/3760116345 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9000aa90 con 0x7fbc9814e810 2023-11-27T20:41:42.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.514+0000 7fbc9de56640 1 -- 172.21.15.91:0/3760116345 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9814ee00 con 0x7fbc9814e810 2023-11-27T20:41:42.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.514+0000 7fb2b5042640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb29406b1c0 0x7fb29406d680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac005df0 tx=0x7fb2ac007c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.515+0000 7f892bfff640 1 -- 172.21.15.91:0/39972420 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f893c077170 con 0x7f894414e810 2023-11-27T20:41:42.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.515+0000 7fbc9de56640 1 -- 172.21.15.91:0/3760116345 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc981583b0 con 0x7fbc9814e810 2023-11-27T20:41:42.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.520+0000 7fb2a1ffb640 1 -- 172.21.15.91:0/3383342909 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb2a4054dd0 con 0x7fb2b00c21b0 2023-11-27T20:41:42.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.520+0000 7fbc9de56640 1 -- 172.21.15.91:0/3760116345 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc980bd6b0 con 0x7fbc9814e810 2023-11-27T20:41:42.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.520+0000 7fbc7ffff640 1 -- 172.21.15.91:0/3760116345 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbc9000abf0 con 0x7fbc9814e810 2023-11-27T20:41:42.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.522+0000 7fbc7ffff640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbc8406b210 0x7fbc8406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.522+0000 7fbc7ffff640 1 -- 172.21.15.91:0/3760116345 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc90057bd0 con 0x7fbc9814e810 2023-11-27T20:41:42.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.522+0000 7fbc977fe640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbc8406b210 0x7fbc8406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.524+0000 7fbc977fe640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbc8406b210 0x7fbc8406d6d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbc88034000 tx=0x7fbc88008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.523+0000 7f41abfff640 1 -- 172.21.15.91:0/208316420 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f41bc03b050 con 0x7f41c40c4f60 2023-11-27T20:41:42.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.524+0000 7f41abfff640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41b006b210 0x7f41b006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:42.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.524+0000 7f41abfff640 1 -- 172.21.15.91:0/208316420 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41bc02ce40 con 0x7f41c40c4f60 2023-11-27T20:41:42.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.525+0000 7f41c37fe640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41b006b210 0x7f41b006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:42.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.526+0000 7f41c37fe640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41b006b210 0x7f41b006d6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41b4007860 tx=0x7f41b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:42.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.530+0000 7f41abfff640 1 -- 172.21.15.91:0/208316420 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f41bc077600 con 0x7f41c40c4f60 2023-11-27T20:41:42.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.535+0000 7fbc7ffff640 1 -- 172.21.15.91:0/3760116345 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbc9008e060 con 0x7fbc9814e810 2023-11-27T20:41:42.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.907+0000 7ffb4f753640 1 -- 172.21.15.91:0/1059764743 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ffb481eeca0 con 0x7ffb48155fc0 2023-11-27T20:41:42.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.908+0000 7ffb3dffb640 1 -- 172.21.15.91:0/1059764743 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb481eeca0 con 0x7ffb48155fc0 2023-11-27T20:41:42.909 INFO:teuthology.orchestra.run.smithi091.stdout:55834574853 2023-11-27T20:41:42.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.911+0000 7ffb4f753640 1 -- 172.21.15.91:0/1059764743 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb2c06b290 msgr2=0x7ffb2c06d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.911+0000 7ffb4f753640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb2c06b290 0x7ffb2c06d750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009c00 tx=0x7ffb44009190 comp rx=0 tx=0).stop 2023-11-27T20:41:42.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.911+0000 7ffb4f753640 1 -- 172.21.15.91:0/1059764743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb48155fc0 msgr2=0x7ffb48151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.911+0000 7ffb4f753640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb48155fc0 0x7ffb48151ae0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000efc0 tx=0x7ffb4000c490 comp rx=0 tx=0).stop 2023-11-27T20:41:42.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.912+0000 7ffb4f753640 1 -- 172.21.15.91:0/1059764743 shutdown_connections 2023-11-27T20:41:42.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.912+0000 7ffb4f753640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb48155fc0 0x7ffb48151ae0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.912+0000 7ffb4f753640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb2c06b290 0x7ffb2c06d750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.912+0000 7ffb4f753640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb480c1ca0 0x7ffb4815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.912+0000 7ffb4f753640 1 --2- 172.21.15.91:0/1059764743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb48071e30 0x7ffb4815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.912+0000 7ffb4f753640 1 -- 172.21.15.91:0/1059764743 >> 172.21.15.91:0/1059764743 conn(0x7ffb4806a500 msgr2=0x7ffb4806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.912+0000 7ffb4f753640 1 -- 172.21.15.91:0/1059764743 shutdown_connections 2023-11-27T20:41:42.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.912+0000 7ffb4f753640 1 -- 172.21.15.91:0/1059764743 wait complete. 2023-11-27T20:41:42.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.916+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57540057d0 con 0x7f57640d78e0 2023-11-27T20:41:42.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.917+0000 7f028ffff640 1 -- 172.21.15.91:0/3984082839 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0288049a40 con 0x7f028800fcc0 2023-11-27T20:41:42.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.917+0000 7f57627fc640 1 -- 172.21.15.91:0/1665996339 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f575c017020 con 0x7f57640d78e0 2023-11-27T20:41:42.918 INFO:teuthology.orchestra.run.smithi091.stdout:55834574853 2023-11-27T20:41:42.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.918+0000 7f02777fe640 1 -- 172.21.15.91:0/3984082839 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0280053f40 con 0x7f028800fcc0 2023-11-27T20:41:42.920 INFO:teuthology.orchestra.run.smithi091.stdout:55834574853 2023-11-27T20:41:42.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.921+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f575006b1c0 msgr2=0x7f575006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.921+0000 7f57741ea640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f575006b1c0 0x7f575006d680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f576c050140 tx=0x7f576c0aa000 comp rx=0 tx=0).stop 2023-11-27T20:41:42.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.921+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f57640d78e0 msgr2=0x7f576417cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.921+0000 7f028ffff640 1 -- 172.21.15.91:0/3984082839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f027c06b1f0 msgr2=0x7f027c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f028ffff640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f027c06b1f0 0x7f027c06d6b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0284007f70 tx=0x7f0284007f00 comp rx=0 tx=0).stop 2023-11-27T20:41:42.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.921+0000 7f57741ea640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f57640d78e0 0x7f576417cf40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f575c007fd0 tx=0x7f575c00c870 comp rx=0 tx=0).stop 2023-11-27T20:41:42.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f028ffff640 1 -- 172.21.15.91:0/3984082839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f028800fcc0 msgr2=0x7f028804e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f028ffff640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f028800fcc0 0x7f028804e3e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f028000e870 tx=0x7f028000ed30 comp rx=0 tx=0).stop 2023-11-27T20:41:42.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 shutdown_connections 2023-11-27T20:41:42.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f57741ea640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f57640d78e0 0x7f576417cf40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f028ffff640 1 -- 172.21.15.91:0/3984082839 shutdown_connections 2023-11-27T20:41:42.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f028ffff640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02880d78f0 0x7f0288034210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f028ffff640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f027c06b1f0 0x7f027c06d6b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f028ffff640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02880506f0 0x7f028804e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f028ffff640 1 --2- 172.21.15.91:0/3984082839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f028800fcc0 0x7f028804e3e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f028ffff640 1 -- 172.21.15.91:0/3984082839 >> 172.21.15.91:0/3984082839 conn(0x7f028804fbd0 msgr2=0x7f02880d8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f57741ea640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57640506e0 0x7f576404ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f57741ea640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f575006b1c0 0x7f575006d680 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f57741ea640 1 --2- 172.21.15.91:0/1665996339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576400fcb0 0x7f57640d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.923+0000 7f028ffff640 1 -- 172.21.15.91:0/3984082839 shutdown_connections 2023-11-27T20:41:42.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.922+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 >> 172.21.15.91:0/1665996339 conn(0x7f576404fbc0 msgr2=0x7f57640061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.923+0000 7f028ffff640 1 -- 172.21.15.91:0/3984082839 wait complete. 2023-11-27T20:41:42.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.923+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 shutdown_connections 2023-11-27T20:41:42.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.923+0000 7f57741ea640 1 -- 172.21.15.91:0/1665996339 wait complete. 2023-11-27T20:41:42.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.930+0000 7f2e71f39640 1 -- 172.21.15.91:0/2111571834 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e64047000 con 0x7f2e64006e60 2023-11-27T20:41:42.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.930+0000 7fb2b72a6640 1 -- 172.21.15.91:0/3383342909 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb2b014b250 con 0x7fb2b00c21b0 2023-11-27T20:41:42.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.931+0000 7f2e57fff640 1 -- 172.21.15.91:0/2111571834 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e6c08f090 con 0x7f2e64006e60 2023-11-27T20:41:42.932 INFO:teuthology.orchestra.run.smithi091.stdout:55834574853 2023-11-27T20:41:42.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.931+0000 7fb2a1ffb640 1 -- 172.21.15.91:0/3383342909 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2b014b250 con 0x7fb2b00c21b0 2023-11-27T20:41:42.935 INFO:teuthology.orchestra.run.smithi091.stdout:55834574853 2023-11-27T20:41:42.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.934+0000 7f8949b83640 1 -- 172.21.15.91:0/39972420 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f89240057d0 con 0x7f894414e810 2023-11-27T20:41:42.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.935+0000 7f2e71f39640 1 -- 172.21.15.91:0/2111571834 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2e5006b1f0 msgr2=0x7f2e5006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.935+0000 7f2e71f39640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2e5006b1f0 0x7f2e5006d6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e60036000 tx=0x7f2e6003c040 comp rx=0 tx=0).stop 2023-11-27T20:41:42.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.935+0000 7f2e71f39640 1 -- 172.21.15.91:0/2111571834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 msgr2=0x7f2e64177fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.935+0000 7f2e71f39640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 0x7f2e64177fa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c069c30 tx=0x7f2e6c067f10 comp rx=0 tx=0).stop 2023-11-27T20:41:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.935+0000 7fb2b72a6640 1 -- 172.21.15.91:0/3383342909 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb29406b1c0 msgr2=0x7fb29406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.935+0000 7fb2b72a6640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb29406b1c0 0x7fb29406d680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac005df0 tx=0x7fb2ac007c60 comp rx=0 tx=0).stop 2023-11-27T20:41:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.935+0000 7fb2b72a6640 1 -- 172.21.15.91:0/3383342909 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 msgr2=0x7fb2b0146f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.935+0000 7fb2b72a6640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 0x7fb2b0146f10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c750 tx=0x7fb2a400cc10 comp rx=0 tx=0).stop 2023-11-27T20:41:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.936+0000 7fb2b72a6640 1 -- 172.21.15.91:0/3383342909 shutdown_connections 2023-11-27T20:41:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.936+0000 7fb2b72a6640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb29406b1c0 0x7fb29406d680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.936+0000 7fb2b72a6640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2b00c4f60 0x7fb2b0147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.936+0000 7fb2b72a6640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2b00c21b0 0x7fb2b0146f10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.936+0000 7fb2b72a6640 1 --2- 172.21.15.91:0/3383342909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2b006e2f0 0x7fb2b014e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.936+0000 7fb2b72a6640 1 -- 172.21.15.91:0/3383342909 >> 172.21.15.91:0/3383342909 conn(0x7fb2b00c5cc0 msgr2=0x7fb2b00a83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.940 INFO:teuthology.orchestra.run.smithi091.stdout:55834574852 2023-11-27T20:41:42.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.935+0000 7f892bfff640 1 -- 172.21.15.91:0/39972420 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f893c039020 con 0x7f894414e810 2023-11-27T20:41:42.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.936+0000 7fb2b72a6640 1 -- 172.21.15.91:0/3383342909 shutdown_connections 2023-11-27T20:41:42.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.937+0000 7fb2b72a6640 1 -- 172.21.15.91:0/3383342909 wait complete. 2023-11-27T20:41:42.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.938+0000 7f2e71f39640 1 -- 172.21.15.91:0/2111571834 shutdown_connections 2023-11-27T20:41:42.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.938+0000 7f2e71f39640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2e5006b1f0 0x7f2e5006d6b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.938+0000 7f2e71f39640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e640daa70 0x7f2e640ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.938+0000 7f2e71f39640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e640cda10 0x7f2e640cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.938+0000 7f2e71f39640 1 --2- 172.21.15.91:0/2111571834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e64006e60 0x7f2e64177fa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.938+0000 7f2e71f39640 1 -- 172.21.15.91:0/2111571834 >> 172.21.15.91:0/2111571834 conn(0x7f2e64048210 msgr2=0x7f2e640064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.939+0000 7f8949b83640 1 -- 172.21.15.91:0/39972420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f893006b1c0 msgr2=0x7f893006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.939+0000 7f8949b83640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f893006b1c0 0x7f893006d680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f89440b00b0 tx=0x7f8934009060 comp rx=0 tx=0).stop 2023-11-27T20:41:42.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.939+0000 7f8949b83640 1 -- 172.21.15.91:0/39972420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f894414e810 msgr2=0x7f8944154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.939+0000 7f8949b83640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f894414e810 0x7f8944154660 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f893c02c3a0 tx=0x7f893c004a40 comp rx=0 tx=0).stop 2023-11-27T20:41:42.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.941+0000 7f8949b83640 1 -- 172.21.15.91:0/39972420 shutdown_connections 2023-11-27T20:41:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.941+0000 7f8949b83640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f894414e810 0x7f8944154660 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.941+0000 7f8949b83640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89440c7e90 0x7f8944154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.941+0000 7f8949b83640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f893006b1c0 0x7f893006d680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.941+0000 7f8949b83640 1 --2- 172.21.15.91:0/39972420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89440c4e50 0x7f89441f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.941+0000 7f8949b83640 1 -- 172.21.15.91:0/39972420 >> 172.21.15.91:0/39972420 conn(0x7f89440ca170 msgr2=0x7f89440a9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.941+0000 7f8949b83640 1 -- 172.21.15.91:0/39972420 shutdown_connections 2023-11-27T20:41:42.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-11-27T20:41:42.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.941+0000 7f8949b83640 1 -- 172.21.15.91:0/39972420 wait complete. 2023-11-27T20:41:42.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.941+0000 7f2e71f39640 1 -- 172.21.15.91:0/2111571834 shutdown_connections 2023-11-27T20:41:42.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.941+0000 7f2e71f39640 1 -- 172.21.15.91:0/2111571834 wait complete. 2023-11-27T20:41:42.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-27T20:41:42.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-11-27T20:41:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.951+0000 7f41c9ea2640 1 -- 172.21.15.91:0/208316420 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f41a40057d0 con 0x7f41c40c4f60 2023-11-27T20:41:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.951+0000 7f41abfff640 1 -- 172.21.15.91:0/208316420 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41bc07ac20 con 0x7f41c40c4f60 2023-11-27T20:41:42.953 INFO:teuthology.orchestra.run.smithi091.stdout:55834574855 2023-11-27T20:41:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.953+0000 7f41c9ea2640 1 -- 172.21.15.91:0/208316420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41b006b210 msgr2=0x7f41b006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41b006b210 0x7f41b006d6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41b4007860 tx=0x7f41b4009040 comp rx=0 tx=0).stop 2023-11-27T20:41:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 -- 172.21.15.91:0/208316420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c4f60 msgr2=0x7f41c4144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c4f60 0x7f41c4144310 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41bc02c450 tx=0x7f41bc004a40 comp rx=0 tx=0).stop 2023-11-27T20:41:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 -- 172.21.15.91:0/208316420 shutdown_connections 2023-11-27T20:41:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41c40c4f60 0x7f41c4144310 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41c40c21b0 0x7f41c4148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41b006b210 0x7f41b006d6d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 --2- 172.21.15.91:0/208316420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41c406e2f0 0x7f41c41f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 -- 172.21.15.91:0/208316420 >> 172.21.15.91:0/208316420 conn(0x7f41c40c5cc0 msgr2=0x7f41c40aa070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 -- 172.21.15.91:0/208316420 shutdown_connections 2023-11-27T20:41:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7f41c9ea2640 1 -- 172.21.15.91:0/208316420 wait complete. 2023-11-27T20:41:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.954+0000 7fbc9de56640 1 -- 172.21.15.91:0/3760116345 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbc98068350 con 0x7fbc9814e810 2023-11-27T20:41:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.955+0000 7fbc7ffff640 1 -- 172.21.15.91:0/3760116345 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc90053f10 con 0x7fbc9814e810 2023-11-27T20:41:42.957 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.958+0000 7fbc9de56640 1 -- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbc8406b210 msgr2=0x7fbc8406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.958+0000 7fbc9de56640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbc8406b210 0x7fbc8406d6d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbc88034000 tx=0x7fbc88008030 comp rx=0 tx=0).stop 2023-11-27T20:41:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.958+0000 7fbc9de56640 1 -- 172.21.15.91:0/3760116345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 msgr2=0x7fbc981ea4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.958+0000 7fbc9de56640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981ea4e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc9000cb20 tx=0x7fbc90002080 comp rx=0 tx=0).stop 2023-11-27T20:41:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.958+0000 7fbc9de56640 1 -- 172.21.15.91:0/3760116345 shutdown_connections 2023-11-27T20:41:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.958+0000 7fbc9de56640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc9814e810 0x7fbc981ea4e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.958+0000 7fbc9de56640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbc8406b210 0x7fbc8406d6d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.958+0000 7fbc9de56640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc980c7e90 0x7fbc981e9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.958+0000 7fbc9de56640 1 --2- 172.21.15.91:0/3760116345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc980c4e50 0x7fbc98156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:42.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.958+0000 7fbc9de56640 1 -- 172.21.15.91:0/3760116345 >> 172.21.15.91:0/3760116345 conn(0x7fbc980ca170 msgr2=0x7fbc98151f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:42.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.959+0000 7fbc9de56640 1 -- 172.21.15.91:0/3760116345 shutdown_connections 2023-11-27T20:41:42.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:42.959+0000 7fbc9de56640 1 -- 172.21.15.91:0/3760116345 wait complete. 2023-11-27T20:41:42.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-27T20:41:42.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-11-27T20:41:42.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-11-27T20:41:42.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-11-27T20:41:42.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-11-27T20:41:43.946 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T20:41:43.949 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T20:41:43.953 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T20:41:43.966 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T20:41:43.967 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T20:41:43.970 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T20:41:43.976 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T20:41:43.978 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T20:41:44.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.220+0000 7ffa9fc2b640 1 Processor -- start 2023-11-27T20:41:44.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.221+0000 7ffa9fc2b640 1 -- start start 2023-11-27T20:41:44.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.223+0000 7ffa9fc2b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffa900d78e0 0x7ffa9000ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.224+0000 7ffa9d9c7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffa900d78e0 0x7ffa9000ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.224+0000 7ffa9d9c7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffa900d78e0 0x7ffa9000ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49380/0 (socket says 172.21.15.91:49380) 2023-11-27T20:41:44.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.224+0000 7ffa9d9c7640 1 -- 172.21.15.91:0/2743874389 learned_addr learned my addr 172.21.15.91:0/2743874389 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.225+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/2743874389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 0x7ffa90006990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.225+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/2743874389 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa900d7cc0 con 0x7ffa900506e0 2023-11-27T20:41:44.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.226+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/2743874389 --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa900db210 con 0x7ffa900d78e0 2023-11-27T20:41:44.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.226+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/2743874389 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9004b9c0 con 0x7ffa9000fcb0 2023-11-27T20:41:44.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.226+0000 7ffa9e1c8640 1 --2- 172.21.15.91:0/2743874389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 0x7ffa90006990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.226+0000 7ffa9c9c5640 1 -- 172.21.15.91:0/2743874389 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694863760 0 0) 0x7ffa900d7cc0 con 0x7ffa900506e0 2023-11-27T20:41:44.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.227+0000 7ffa9d9c7640 1 -- 172.21.15.91:0/2743874389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 msgr2=0x7ffa90006990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.228+0000 7ffa9d9c7640 1 --2- 172.21.15.91:0/2743874389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 0x7ffa90006990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.228+0000 7ffa9d9c7640 1 -- 172.21.15.91:0/2743874389 >> v1:172.21.15.91:6789/0 conn(0x7ffa900506e0 legacy=0x7ffa90006280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.228+0000 7ffa9d9c7640 1 -- 172.21.15.91:0/2743874389 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9004bca0 con 0x7ffa900d78e0 2023-11-27T20:41:44.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.228+0000 7ffa9e1c8640 1 --2- 172.21.15.91:0/2743874389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 0x7ffa90006990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:44.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.230+0000 7ffa9d9c7640 1 --2- 172.21.15.91:0/2743874389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900d78e0 0x7ffa9000ed70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c009870 tx=0x7ffa8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f21ca8e8a9899f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.231+0000 7ffa9c9c5640 1 -- 172.21.15.91:0/2743874389 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c031870 con 0x7ffa900d78e0 2023-11-27T20:41:44.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.231+0000 7ffa9c9c5640 1 -- 172.21.15.91:0/2743874389 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c0319d0 con 0x7ffa900d78e0 2023-11-27T20:41:44.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.231+0000 7ffa9c9c5640 1 -- 172.21.15.91:0/2743874389 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c031870 con 0x7ffa900d78e0 2023-11-27T20:41:44.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.232+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/2743874389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900d78e0 msgr2=0x7ffa9000ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.232+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/2743874389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900d78e0 0x7ffa9000ed70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c009870 tx=0x7ffa8c02b910 comp rx=0 tx=0).stop 2023-11-27T20:41:44.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.233+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/2743874389 shutdown_connections 2023-11-27T20:41:44.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.233+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/2743874389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 0x7ffa90006990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.233+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/2743874389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900d78e0 0x7ffa9000ed70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.233+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/2743874389 >> 172.21.15.91:0/2743874389 conn(0x7ffa9004fbc0 msgr2=0x7ffa9004ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.233+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/2743874389 shutdown_connections 2023-11-27T20:41:44.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.234+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/2743874389 wait complete. 2023-11-27T20:41:44.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.237+0000 7ffa9fc2b640 1 Processor -- start 2023-11-27T20:41:44.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.237+0000 7ffa9fc2b640 1 -- start start 2023-11-27T20:41:44.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.239+0000 7ffa9fc2b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 0x7ffa900cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.240+0000 7ffa9fc2b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900506e0 0x7ffa9016b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.241+0000 7ffa9d1c6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900506e0 0x7ffa9016b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.241+0000 7ffa9d1c6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900506e0 0x7ffa9016b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49390/0 (socket says 172.21.15.91:49390) 2023-11-27T20:41:44.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.241+0000 7ffa9d9c7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 0x7ffa900cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.241+0000 7ffa9d9c7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 0x7ffa900cffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:35998/0 (socket says 172.21.15.91:35998) 2023-11-27T20:41:44.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.241+0000 7ffa9d1c6640 1 -- 172.21.15.91:0/1017494251 learned_addr learned my addr 172.21.15.91:0/1017494251 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.241+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa900d78e0 0x7ffa900d42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.241+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900d0500 con 0x7ffa900506e0 2023-11-27T20:41:44.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.242+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900d2280 con 0x7ffa900d78e0 2023-11-27T20:41:44.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.242+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900d07d0 con 0x7ffa9000fcb0 2023-11-27T20:41:44.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.242+0000 7ffa9e1c8640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa900d78e0 0x7ffa900d42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.243+0000 7ffa9e1c8640 1 -- 172.21.15.91:0/1017494251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 msgr2=0x7ffa900cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.243+0000 7ffa9e1c8640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 0x7ffa900cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.243+0000 7ffa9e1c8640 1 -- 172.21.15.91:0/1017494251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900506e0 msgr2=0x7ffa9016b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.244+0000 7ffa9e1c8640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900506e0 0x7ffa9016b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.244+0000 7ffa9e1c8640 1 -- 172.21.15.91:0/1017494251 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c0094d0 con 0x7ffa900d78e0 2023-11-27T20:41:44.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.244+0000 7ffa9d1c6640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900506e0 0x7ffa9016b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:44.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.245+0000 7ffa9e1c8640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa900d78e0 0x7ffa900d42e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa980641d0 tx=0x7ffa98067f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.245+0000 7ffa8a7fc640 1 -- 172.21.15.91:0/1017494251 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9806be70 con 0x7ffa900d78e0 2023-11-27T20:41:44.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.246+0000 7ffa8a7fc640 1 -- 172.21.15.91:0/1017494251 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98071050 con 0x7ffa900d78e0 2023-11-27T20:41:44.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.246+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa90177f70 con 0x7ffa900d78e0 2023-11-27T20:41:44.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.246+0000 7ffa8a7fc640 1 -- 172.21.15.91:0/1017494251 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98072420 con 0x7ffa900d78e0 2023-11-27T20:41:44.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.247+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9016b790 con 0x7ffa900d78e0 2023-11-27T20:41:44.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.249+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa90005350 con 0x7ffa900d78e0 2023-11-27T20:41:44.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.251+0000 7ffa8a7fc640 1 -- 172.21.15.91:0/1017494251 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ffa98072640 con 0x7ffa900d78e0 2023-11-27T20:41:44.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.252+0000 7ffa8a7fc640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa7c06b1c0 0x7ffa7c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.253+0000 7ffa8a7fc640 1 -- 172.21.15.91:0/1017494251 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa98103df0 con 0x7ffa900d78e0 2023-11-27T20:41:44.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.254+0000 7ffa9d9c7640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa7c06b1c0 0x7ffa7c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.255+0000 7ffa9d9c7640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa7c06b1c0 0x7ffa7c06d680 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c036000 tx=0x7ffa8c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.264+0000 7efe569c9640 1 Processor -- start 2023-11-27T20:41:44.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.264+0000 7effb5690640 1 Processor -- start 2023-11-27T20:41:44.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.264+0000 7effb5690640 1 -- start start 2023-11-27T20:41:44.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.264+0000 7efe569c9640 1 -- start start 2023-11-27T20:41:44.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.266+0000 7efe569c9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efe4804db10 0x7efe48007550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.266+0000 7efe569c9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efe480e26f0 0x7efe480e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.266+0000 7efe569c9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4800e4f0 con 0x7efe48007170 2023-11-27T20:41:44.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.266+0000 7efe569c9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4804a520 con 0x7efe4804db10 2023-11-27T20:41:44.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.266+0000 7efe569c9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4800e1c0 con 0x7efe480e26f0 2023-11-27T20:41:44.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.266+0000 7effb5690640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb01550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.266+0000 7effb5690640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7effb00c7e90 0x7effb00c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.267+0000 7effb5690640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb00bd8d0 con 0x7effb00c4e50 2023-11-27T20:41:44.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.267+0000 7effb5690640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00c6e60 con 0x7effb00c7e90 2023-11-27T20:41:44.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.267+0000 7effb5690640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb0155600 con 0x7effb014e810 2023-11-27T20:41:44.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.267+0000 7effaeffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb01550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.267+0000 7efe551c6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efe4804db10 0x7efe48007550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.267+0000 7efe551c6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efe4804db10 0x7efe48007550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49398/0 (socket says 172.21.15.91:49398) 2023-11-27T20:41:44.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.267+0000 7effaeffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb01550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:36006/0 (socket says 172.21.15.91:36006) 2023-11-27T20:41:44.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.267+0000 7effaeffd640 1 -- 172.21.15.91:0/4099103964 learned_addr learned my addr 172.21.15.91:0/4099103964 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.267+0000 7efe561c8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efe480e26f0 0x7efe480e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.268+0000 7efe561c8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efe480e26f0 0x7efe480e90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:39634/0 (socket says 172.21.15.91:39634) 2023-11-27T20:41:44.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.268+0000 7efe561c8640 1 -- 172.21.15.91:0/256176740 learned_addr learned my addr 172.21.15.91:0/256176740 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.267+0000 7effae7fc640 1 --2- 172.21.15.91:0/4099103964 >> v2:172.21.15.183:3300/0 conn(0x7effb00c7e90 0x7effb00c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.268+0000 7effaeffd640 1 -- 172.21.15.91:0/4099103964 >> v2:172.21.15.183:3300/0 conn(0x7effb00c7e90 msgr2=0x7effb00c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.268+0000 7effaeffd640 1 --2- 172.21.15.91:0/4099103964 >> v2:172.21.15.183:3300/0 conn(0x7effb00c7e90 0x7effb00c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.268+0000 7effaeffd640 1 -- 172.21.15.91:0/4099103964 >> v1:172.21.15.91:6789/0 conn(0x7effb00c4e50 legacy=0x7effb006b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.269+0000 7ffa8a7fc640 1 -- 172.21.15.91:0/1017494251 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ffa980cec40 con 0x7ffa900d78e0 2023-11-27T20:41:44.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.268+0000 7efe561c8640 1 -- 172.21.15.91:0/256176740 >> v2:172.21.15.91:3300/0 conn(0x7efe4804db10 msgr2=0x7efe48007550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.268+0000 7efe561c8640 1 --2- 172.21.15.91:0/256176740 >> v2:172.21.15.91:3300/0 conn(0x7efe4804db10 0x7efe48007550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.268+0000 7efe561c8640 1 -- 172.21.15.91:0/256176740 >> v1:172.21.15.183:6789/0 conn(0x7efe48007170 legacy=0x7efe4800e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.269+0000 7efe561c8640 1 -- 172.21.15.91:0/256176740 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4804a7c0 con 0x7efe480e26f0 2023-11-27T20:41:44.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.269+0000 7efe551c6640 1 --2- 172.21.15.91:0/256176740 >> v2:172.21.15.91:3300/0 conn(0x7efe4804db10 0x7efe48007550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:44.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.268+0000 7effaeffd640 1 -- 172.21.15.91:0/4099103964 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00c70d0 con 0x7effb014e810 2023-11-27T20:41:44.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.270+0000 7efe561c8640 1 --2- 172.21.15.91:0/256176740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe480e26f0 0x7efe480e90c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe50064320 tx=0x7efe500a5fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bcbe405de9f59e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.270+0000 7effaeffd640 1 --2- 172.21.15.91:0/4099103964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb01550c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7effa0009870 tx=0x7effa002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c9b447718fba93 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.271+0000 7efe549c5640 1 -- 172.21.15.91:0/256176740 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500a6de0 con 0x7efe480e26f0 2023-11-27T20:41:44.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.271+0000 7efe549c5640 1 -- 172.21.15.91:0/256176740 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe500ae440 con 0x7efe480e26f0 2023-11-27T20:41:44.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.271+0000 7effadffb640 1 -- 172.21.15.91:0/4099103964 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0031640 con 0x7effb014e810 2023-11-27T20:41:44.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.271+0000 7effadffb640 1 -- 172.21.15.91:0/4099103964 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa00317a0 con 0x7effb014e810 2023-11-27T20:41:44.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.271+0000 7effadffb640 1 -- 172.21.15.91:0/4099103964 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0031b30 con 0x7effb014e810 2023-11-27T20:41:44.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.271+0000 7efe549c5640 1 -- 172.21.15.91:0/256176740 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500ae870 con 0x7efe480e26f0 2023-11-27T20:41:44.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.272+0000 7efe569c9640 1 -- 172.21.15.91:0/256176740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe480e26f0 msgr2=0x7efe480e90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.272+0000 7efe569c9640 1 --2- 172.21.15.91:0/256176740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe480e26f0 0x7efe480e90c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe50064320 tx=0x7efe500a5fd0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.272+0000 7effb5690640 1 -- 172.21.15.91:0/4099103964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 msgr2=0x7effb01550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.272+0000 7effb5690640 1 --2- 172.21.15.91:0/4099103964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb01550c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7effa0009870 tx=0x7effa002b8f0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.272+0000 7efe569c9640 1 -- 172.21.15.91:0/256176740 shutdown_connections 2023-11-27T20:41:44.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.272+0000 7efe569c9640 1 --2- 172.21.15.91:0/256176740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe480e26f0 0x7efe480e90c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.272+0000 7efe569c9640 1 --2- 172.21.15.91:0/256176740 >> v2:172.21.15.91:3300/0 conn(0x7efe4804db10 0x7efe48007550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.273+0000 7efe569c9640 1 -- 172.21.15.91:0/256176740 >> 172.21.15.91:0/256176740 conn(0x7efe4804c620 msgr2=0x7efe4804ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.272+0000 7effb5690640 1 -- 172.21.15.91:0/4099103964 shutdown_connections 2023-11-27T20:41:44.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.273+0000 7effb5690640 1 --2- 172.21.15.91:0/4099103964 >> v2:172.21.15.183:3300/0 conn(0x7effb00c7e90 0x7effb00c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.273+0000 7effb5690640 1 --2- 172.21.15.91:0/4099103964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb01550c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.273+0000 7effb5690640 1 -- 172.21.15.91:0/4099103964 >> 172.21.15.91:0/4099103964 conn(0x7effb00ca170 msgr2=0x7effb00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.273+0000 7efe569c9640 1 -- 172.21.15.91:0/256176740 shutdown_connections 2023-11-27T20:41:44.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.273+0000 7efe569c9640 1 -- 172.21.15.91:0/256176740 wait complete. 2023-11-27T20:41:44.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.275+0000 7efe569c9640 1 Processor -- start 2023-11-27T20:41:44.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.273+0000 7effb5690640 1 -- 172.21.15.91:0/4099103964 shutdown_connections 2023-11-27T20:41:44.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.273+0000 7effb5690640 1 -- 172.21.15.91:0/4099103964 wait complete. 2023-11-27T20:41:44.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.276+0000 7efe569c9640 1 -- start start 2023-11-27T20:41:44.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.275+0000 7effb5690640 1 Processor -- start 2023-11-27T20:41:44.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.276+0000 7effb5690640 1 -- start start 2023-11-27T20:41:44.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.277+0000 7efe569c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe48007170 0x7efe480cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.278+0000 7efe569c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe4804db10 0x7efe480435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.278+0000 7effb5690640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effb00c4e50 0x7effb0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7effb5690640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effb00c7e90 0x7effb01ede00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7effb5690640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb00c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.278+0000 7efe569c9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe480e26f0 0x7efe48043b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.278+0000 7efe559c7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe48007170 0x7efe480cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7efe559c7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe48007170 0x7efe480cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:39638/0 (socket says 172.21.15.91:39638) 2023-11-27T20:41:44.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7efe561c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe480e26f0 0x7efe48043b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7effb5690640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb0156ea0 con 0x7effb00c4e50 2023-11-27T20:41:44.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7efe561c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe480e26f0 0x7efe48043b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49412/0 (socket says 172.21.15.91:49412) 2023-11-27T20:41:44.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7effae7fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effb00c7e90 0x7effb01ede00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7effaf7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb00c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.280+0000 7effae7fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effb00c7e90 0x7effb01ede00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:39640/0 (socket says 172.21.15.91:39640) 2023-11-27T20:41:44.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.280+0000 7effae7fc640 1 -- 172.21.15.91:0/825310846 learned_addr learned my addr 172.21.15.91:0/825310846 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7efe559c7640 1 -- 172.21.15.91:0/3458565452 learned_addr learned my addr 172.21.15.91:0/3458565452 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.280+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb00c1060 con 0x7effb00c7e90 2023-11-27T20:41:44.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.280+0000 7effaeffd640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effb00c4e50 0x7effb0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.280+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb00c1620 con 0x7effb014e810 2023-11-27T20:41:44.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe480dc5d0 con 0x7efe480e26f0 2023-11-27T20:41:44.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.281+0000 7effaf7fe640 1 -- 172.21.15.91:0/825310846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effb00c7e90 msgr2=0x7effb01ede00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.281+0000 7effaf7fe640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effb00c7e90 0x7effb01ede00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.281+0000 7effaf7fe640 1 -- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effb00c4e50 msgr2=0x7effb0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe480dc820 con 0x7efe48007170 2023-11-27T20:41:44.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.279+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe480dcb00 con 0x7efe4804db10 2023-11-27T20:41:44.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.281+0000 7efe561c8640 1 -- 172.21.15.91:0/3458565452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe4804db10 msgr2=0x7efe480435e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T20:41:44.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.281+0000 7efe561c8640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe4804db10 0x7efe480435e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.281+0000 7efe561c8640 1 -- 172.21.15.91:0/3458565452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe48007170 msgr2=0x7efe480cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.281+0000 7efe561c8640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe48007170 0x7efe480cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.281+0000 7efe561c8640 1 -- 172.21.15.91:0/3458565452 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe40009400 con 0x7efe480e26f0 2023-11-27T20:41:44.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.281+0000 7efe561c8640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe480e26f0 0x7efe48043b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efe500641d0 tx=0x7efe50068ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.282+0000 7effaf7fe640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effb00c4e50 0x7effb0156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.282+0000 7effaf7fe640 1 -- 172.21.15.91:0/825310846 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00094d0 con 0x7effb014e810 2023-11-27T20:41:44.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.282+0000 7effaeffd640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effb00c4e50 0x7effb0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:41:44.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.282+0000 7efe467fc640 1 -- 172.21.15.91:0/3458565452 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500b7610 con 0x7efe480e26f0 2023-11-27T20:41:44.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.282+0000 7efe467fc640 1 -- 172.21.15.91:0/3458565452 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe500b7770 con 0x7efe480e26f0 2023-11-27T20:41:44.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.282+0000 7efe467fc640 1 -- 172.21.15.91:0/3458565452 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500b7b20 con 0x7efe480e26f0 2023-11-27T20:41:44.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.282+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5004f730 con 0x7efe480e26f0 2023-11-27T20:41:44.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.283+0000 7effaf7fe640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb00c38a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7effa800c730 tx=0x7effa800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.283+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe480dd0c0 con 0x7efe480e26f0 2023-11-27T20:41:44.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.284+0000 7eff977fe640 1 -- 172.21.15.91:0/825310846 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8003b70 con 0x7effb014e810 2023-11-27T20:41:44.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.284+0000 7eff977fe640 1 -- 172.21.15.91:0/825310846 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa8003cf0 con 0x7effb014e810 2023-11-27T20:41:44.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.284+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb01ee640 con 0x7effb014e810 2023-11-27T20:41:44.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.285+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb00c12b0 con 0x7effb014e810 2023-11-27T20:41:44.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.285+0000 7eff977fe640 1 -- 172.21.15.91:0/825310846 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8005310 con 0x7effb014e810 2023-11-27T20:41:44.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.287+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb00c5970 con 0x7effb014e810 2023-11-27T20:41:44.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.287+0000 7efe467fc640 1 -- 172.21.15.91:0/3458565452 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efe500b5040 con 0x7efe480e26f0 2023-11-27T20:41:44.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.288+0000 7efe467fc640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe3406b210 0x7efe3406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.289+0000 7eff977fe640 1 -- 172.21.15.91:0/825310846 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7effa800a640 con 0x7effb014e810 2023-11-27T20:41:44.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.290+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe480057a0 con 0x7efe480e26f0 2023-11-27T20:41:44.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.290+0000 7efe559c7640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe3406b210 0x7efe3406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.291+0000 7eff977fe640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff9c06b240 0x7eff9c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.292+0000 7eff977fe640 1 -- 172.21.15.91:0/825310846 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effa8089710 con 0x7effb014e810 2023-11-27T20:41:44.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.293+0000 7effaeffd640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff9c06b240 0x7eff9c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.294+0000 7effaeffd640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff9c06b240 0x7eff9c06d700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7effa0036000 tx=0x7effa003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.294+0000 7efe467fc640 1 -- 172.21.15.91:0/3458565452 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe500f51c0 con 0x7efe480e26f0 2023-11-27T20:41:44.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.294+0000 7efe559c7640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe3406b210 0x7efe3406d6d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0017a0 tx=0x7efe4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.301+0000 7efe467fc640 1 -- 172.21.15.91:0/3458565452 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efe500b3020 con 0x7efe480e26f0 2023-11-27T20:41:44.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.306+0000 7eff977fe640 1 -- 172.21.15.91:0/825310846 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7effa8054660 con 0x7effb014e810 2023-11-27T20:41:44.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.334+0000 7fdb5516e640 1 Processor -- start 2023-11-27T20:41:44.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.335+0000 7fdb5516e640 1 -- start start 2023-11-27T20:41:44.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.337+0000 7fdb5516e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb480d8760 0x7fdb480df120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.337+0000 7fdb5516e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdb48049f70 0x7fdb4800ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.337+0000 7fdb5516e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdb4800f2c0 0x7fdb48006470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.337+0000 7fdb5516e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4804c470 con 0x7fdb4800f2c0 2023-11-27T20:41:44.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.337+0000 7fdb5516e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4804b8a0 con 0x7fdb48049f70 2023-11-27T20:41:44.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.337+0000 7fdb5516e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480d8b40 con 0x7fdb480d8760 2023-11-27T20:41:44.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.337+0000 7fdb5496d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdb4800f2c0 0x7fdb48006470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.337+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb480d8760 0x7fdb480df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.338+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb480d8760 0x7fdb480df120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:36034/0 (socket says 172.21.15.91:36034) 2023-11-27T20:41:44.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.338+0000 7fdb4ffff640 1 -- 172.21.15.91:0/2178191917 learned_addr learned my addr 172.21.15.91:0/2178191917 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.338+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/2178191917 >> v2:172.21.15.183:3300/0 conn(0x7fdb48049f70 0x7fdb4800ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.338+0000 7fb2579b6640 1 Processor -- start 2023-11-27T20:41:44.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.338+0000 7fdb4ffff640 1 -- 172.21.15.91:0/2178191917 >> v2:172.21.15.183:3300/0 conn(0x7fdb48049f70 msgr2=0x7fdb4800ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.338+0000 7fdb4ffff640 1 --2- 172.21.15.91:0/2178191917 >> v2:172.21.15.183:3300/0 conn(0x7fdb48049f70 0x7fdb4800ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.338+0000 7fdb4ffff640 1 -- 172.21.15.91:0/2178191917 >> v2:172.21.15.91:3300/0 conn(0x7fdb4800f2c0 msgr2=0x7fdb48006470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.338+0000 7fdb4ffff640 1 --2- 172.21.15.91:0/2178191917 >> v2:172.21.15.91:3300/0 conn(0x7fdb4800f2c0 0x7fdb48006470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.339+0000 7fb2579b6640 1 -- start start 2023-11-27T20:41:44.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.341+0000 7fb2579b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500c57a0 0x7fb2500a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.341+0000 7fb2579b6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2500c4e80 con 0x7fb2500c06c0 2023-11-27T20:41:44.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.341+0000 7fb2579b6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2500c4ba0 con 0x7fb2500aaf90 2023-11-27T20:41:44.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.341+0000 7fb2579b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500c1150 con 0x7fb2500c57a0 2023-11-27T20:41:44.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.338+0000 7fdb4ffff640 1 -- 172.21.15.91:0/2178191917 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4804bb40 con 0x7fdb480d8760 2023-11-27T20:41:44.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.338+0000 7fdb5496d640 1 --2- 172.21.15.91:0/2178191917 >> v2:172.21.15.91:3300/0 conn(0x7fdb4800f2c0 0x7fdb48006470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:44.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.340+0000 7fdb4ffff640 1 --2- 172.21.15.91:0/2178191917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb480d8760 0x7fdb480df120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb480117d0 tx=0x7fdb4402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd38ce83641c5f82 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.341+0000 7fdb4effd640 1 -- 172.21.15.91:0/2178191917 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4402d040 con 0x7fdb480d8760 2023-11-27T20:41:44.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.341+0000 7fdb4effd640 1 -- 172.21.15.91:0/2178191917 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb44031810 con 0x7fdb480d8760 2023-11-27T20:41:44.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.341+0000 7fdb4effd640 1 -- 172.21.15.91:0/2178191917 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44031ba0 con 0x7fdb480d8760 2023-11-27T20:41:44.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.341+0000 7fb255f53640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb2500c06c0 0x7fb2500a9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:33936/0 (socket says 172.21.15.91:33936) 2023-11-27T20:41:44.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.341+0000 7fb255f53640 1 -- 172.21.15.91:0/1269154672 learned_addr learned my addr 172.21.15.91:0/1269154672 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:44.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fb254f51640 1 --2- 172.21.15.91:0/1269154672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500c57a0 0x7fb2500a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fbf49664640 1 Processor -- start 2023-11-27T20:41:44.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fdb5516e640 1 -- 172.21.15.91:0/2178191917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb480d8760 msgr2=0x7fdb480df120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fdb5516e640 1 --2- 172.21.15.91:0/2178191917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb480d8760 0x7fdb480df120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb480117d0 tx=0x7fdb4402b8b0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fdb5516e640 1 -- 172.21.15.91:0/2178191917 shutdown_connections 2023-11-27T20:41:44.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fb254f51640 1 -- 172.21.15.91:0/1269154672 >> v1:172.21.15.183:6789/0 conn(0x7fb2500aaf90 legacy=0x7fb25006df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fb254f51640 1 -- 172.21.15.91:0/1269154672 >> v1:172.21.15.91:6789/0 conn(0x7fb2500c06c0 legacy=0x7fb2500a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fdb5516e640 1 --2- 172.21.15.91:0/2178191917 >> v2:172.21.15.91:3300/0 conn(0x7fdb4800f2c0 0x7fdb48006470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fdb5516e640 1 --2- 172.21.15.91:0/2178191917 >> v2:172.21.15.183:3300/0 conn(0x7fdb48049f70 0x7fdb4800ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fdb5516e640 1 --2- 172.21.15.91:0/2178191917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb480d8760 0x7fdb480df120 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fdb5516e640 1 -- 172.21.15.91:0/2178191917 >> 172.21.15.91:0/2178191917 conn(0x7fdb4804fbd0 msgr2=0x7fdb4804ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.342+0000 7fbf49664640 1 -- start start 2023-11-27T20:41:44.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.343+0000 7fb254f51640 1 -- 172.21.15.91:0/1269154672 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500c1430 con 0x7fb2500c57a0 2023-11-27T20:41:44.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.343+0000 7fdb5516e640 1 -- 172.21.15.91:0/2178191917 shutdown_connections 2023-11-27T20:41:44.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.343+0000 7fdb5516e640 1 -- 172.21.15.91:0/2178191917 wait complete. 2023-11-27T20:41:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.343+0000 7fbf49664640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbf4414e810 0x7fbf441550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.343+0000 7fbf49664640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 0x7fbf440c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.344+0000 7fbf49664640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf440bd8d0 con 0x7fbf440c4e50 2023-11-27T20:41:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.344+0000 7fbf49664640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf440c6e60 con 0x7fbf4414e810 2023-11-27T20:41:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.344+0000 7fbf49664640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf44155600 con 0x7fbf440c7e90 2023-11-27T20:41:44.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.344+0000 7fbf427fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 0x7fbf440c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.344+0000 7fbf42ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbf4414e810 0x7fbf441550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.344+0000 7fbf42ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbf4414e810 0x7fbf441550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:39664/0 (socket says 172.21.15.91:39664) 2023-11-27T20:41:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.344+0000 7fbf42ffd640 1 -- 172.21.15.91:0/1710476090 learned_addr learned my addr 172.21.15.91:0/1710476090 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.345+0000 7fbf42ffd640 1 -- 172.21.15.91:0/1710476090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 msgr2=0x7fbf440c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.345+0000 7fbf42ffd640 1 --2- 172.21.15.91:0/1710476090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 0x7fbf440c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.345+0000 7fbf42ffd640 1 -- 172.21.15.91:0/1710476090 >> v1:172.21.15.91:6789/0 conn(0x7fbf440c4e50 legacy=0x7fbf4406b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.345+0000 7fbf42ffd640 1 -- 172.21.15.91:0/1710476090 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440c70d0 con 0x7fbf4414e810 2023-11-27T20:41:44.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.345+0000 7fb254f51640 1 --2- 172.21.15.91:0/1269154672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500c57a0 0x7fb2500a9760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00d7e0 tx=0x7fb24c02dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac41e54b838be47 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.346+0000 7fbf42ffd640 1 --2- 172.21.15.91:0/1710476090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf4414e810 0x7fbf441550c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009870 tx=0x7fbf3402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c84167d4db0d1ed3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.347+0000 7fbf41ffb640 1 -- 172.21.15.91:0/1710476090 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf340317c0 con 0x7fbf4414e810 2023-11-27T20:41:44.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.347+0000 7fbf41ffb640 1 -- 172.21.15.91:0/1710476090 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34031920 con 0x7fbf4414e810 2023-11-27T20:41:44.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.347+0000 7fbf41ffb640 1 -- 172.21.15.91:0/1710476090 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34031cb0 con 0x7fbf4414e810 2023-11-27T20:41:44.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.348+0000 7fbf49664640 1 -- 172.21.15.91:0/1710476090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf4414e810 msgr2=0x7fbf441550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.348+0000 7fbf49664640 1 --2- 172.21.15.91:0/1710476090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf4414e810 0x7fbf441550c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009870 tx=0x7fbf3402b860 comp rx=0 tx=0).stop 2023-11-27T20:41:44.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.349+0000 7fb247fff640 1 -- 172.21.15.91:0/1269154672 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c02eaf0 con 0x7fb2500c57a0 2023-11-27T20:41:44.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.349+0000 7fb247fff640 1 -- 172.21.15.91:0/1269154672 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c02ec50 con 0x7fb2500c57a0 2023-11-27T20:41:44.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.349+0000 7fb247fff640 1 -- 172.21.15.91:0/1269154672 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c036440 con 0x7fb2500c57a0 2023-11-27T20:41:44.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fb2579b6640 1 -- 172.21.15.91:0/1269154672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500c57a0 msgr2=0x7fb2500a9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fb2579b6640 1 --2- 172.21.15.91:0/1269154672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500c57a0 0x7fb2500a9760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00d7e0 tx=0x7fb24c02dd40 comp rx=0 tx=0).stop 2023-11-27T20:41:44.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fbf49664640 1 -- 172.21.15.91:0/1710476090 shutdown_connections 2023-11-27T20:41:44.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.346+0000 7fdb5516e640 1 Processor -- start 2023-11-27T20:41:44.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fb2579b6640 1 -- 172.21.15.91:0/1269154672 shutdown_connections 2023-11-27T20:41:44.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fb2579b6640 1 --2- 172.21.15.91:0/1269154672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500c57a0 0x7fb2500a9760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fb2579b6640 1 -- 172.21.15.91:0/1269154672 >> 172.21.15.91:0/1269154672 conn(0x7fb2500c5cc0 msgr2=0x7fb2500c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fbf49664640 1 --2- 172.21.15.91:0/1710476090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 0x7fbf440c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fbf49664640 1 --2- 172.21.15.91:0/1710476090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf4414e810 0x7fbf441550c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fbf49664640 1 -- 172.21.15.91:0/1710476090 >> 172.21.15.91:0/1710476090 conn(0x7fbf440ca170 msgr2=0x7fbf440ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fbf49664640 1 -- 172.21.15.91:0/1710476090 shutdown_connections 2023-11-27T20:41:44.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fb2579b6640 1 -- 172.21.15.91:0/1269154672 shutdown_connections 2023-11-27T20:41:44.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fbf49664640 1 -- 172.21.15.91:0/1710476090 wait complete. 2023-11-27T20:41:44.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.350+0000 7fb2579b6640 1 -- 172.21.15.91:0/1269154672 wait complete. 2023-11-27T20:41:44.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.351+0000 7fdb5516e640 1 -- start start 2023-11-27T20:41:44.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.353+0000 7fbf49664640 1 Processor -- start 2023-11-27T20:41:44.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.353+0000 7fb2579b6640 1 Processor -- start 2023-11-27T20:41:44.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.353+0000 7fbf49664640 1 -- start start 2023-11-27T20:41:44.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.353+0000 7fb2579b6640 1 -- start start 2023-11-27T20:41:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.353+0000 7fdb5516e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb4800f2c0 0x7fdb4804f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.353+0000 7fdb5516e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb48049f70 0x7fdb48179590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.353+0000 7fdb5516e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb480d8760 0x7fdb48179ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.353+0000 7fdb5516e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48034cc0 con 0x7fdb4800f2c0 2023-11-27T20:41:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.353+0000 7fdb5516e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4817c710 con 0x7fdb480d8760 2023-11-27T20:41:44.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.353+0000 7fdb5516e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4817d250 con 0x7fdb48049f70 2023-11-27T20:41:44.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fbf49664640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf440c4e50 0x7fbf441545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.354+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb4800f2c0 0x7fdb4804f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.354+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb4800f2c0 0x7fdb4804f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49448/0 (socket says 172.21.15.91:49448) 2023-11-27T20:41:44.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.354+0000 7fdb4ffff640 1 -- 172.21.15.91:0/2009493936 learned_addr learned my addr 172.21.15.91:0/2009493936 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb48049f70 0x7fdb48179590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fdb5496d640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb480d8760 0x7fdb48179ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fb2579b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500aaf90 0x7fb2501dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fb2579b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2500c06c0 0x7fb250152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fb2579b6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2500c57a0 0x7fb250153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fdb4ffff640 1 -- 172.21.15.91:0/2009493936 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb48049f70 msgr2=0x7fdb48179590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fdb4ffff640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb48049f70 0x7fdb48179590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fdb4ffff640 1 -- 172.21.15.91:0/2009493936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb480d8760 msgr2=0x7fdb48179ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fdb4ffff640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb480d8760 0x7fdb48179ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fb2579b6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2501daab0 con 0x7fb2500c57a0 2023-11-27T20:41:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fb2579b6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb250153a00 con 0x7fb2500c06c0 2023-11-27T20:41:44.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fb2579b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2501537a0 con 0x7fb2500aaf90 2023-11-27T20:41:44.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fbf49664640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 0x7fbf441470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.355+0000 7fdb4ffff640 1 -- 172.21.15.91:0/2009493936 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440094d0 con 0x7fdb4800f2c0 2023-11-27T20:41:44.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fbf49664640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf4414e810 0x7fbf44147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fb255752640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500aaf90 0x7fb2501dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fb255752640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500aaf90 0x7fb2501dcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:36062/0 (socket says 172.21.15.91:36062) 2023-11-27T20:41:44.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fb255752640 1 -- 172.21.15.91:0/1208291254 learned_addr learned my addr 172.21.15.91:0/1208291254 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fb255f53640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2500c57a0 0x7fb250153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fb254f51640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2500c06c0 0x7fb250152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fbf42ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf440c4e50 0x7fbf441545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fbf42ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf440c4e50 0x7fbf441545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49480/0 (socket says 172.21.15.91:49480) 2023-11-27T20:41:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fbf42ffd640 1 -- 172.21.15.91:0/3393324829 learned_addr learned my addr 172.21.15.91:0/3393324829 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf44148380 con 0x7fbf440c4e50 2023-11-27T20:41:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4414ebf0 con 0x7fbf4414e810 2023-11-27T20:41:44.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf44148d20 con 0x7fbf440c7e90 2023-11-27T20:41:44.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fbf427fc640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 0x7fbf441470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fbf437fe640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf4414e810 0x7fbf44147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.356+0000 7fdb4ffff640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb4800f2c0 0x7fdb4804f230 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdb440090b0 tx=0x7fdb440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.357+0000 7f141e193640 1 Processor -- start 2023-11-27T20:41:44.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.357+0000 7fb255f53640 1 -- 172.21.15.91:0/1208291254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500aaf90 msgr2=0x7fb2501dcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.357+0000 7fb255f53640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500aaf90 0x7fb2501dcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.357+0000 7fb255f53640 1 -- 172.21.15.91:0/1208291254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2500c06c0 msgr2=0x7fb250152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.357+0000 7fb255f53640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2500c06c0 0x7fb250152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.357+0000 7fb255f53640 1 -- 172.21.15.91:0/1208291254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c00d410 con 0x7fb2500c57a0 2023-11-27T20:41:44.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.357+0000 7fb255f53640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2500c57a0 0x7fb250153260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c440 tx=0x7fb24000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fb245ffb640 1 -- 172.21.15.91:0/1208291254 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240005ce0 con 0x7fb2500c57a0 2023-11-27T20:41:44.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fb245ffb640 1 -- 172.21.15.91:0/1208291254 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb240005e60 con 0x7fb2500c57a0 2023-11-27T20:41:44.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fb245ffb640 1 -- 172.21.15.91:0/1208291254 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240007310 con 0x7fb2500c57a0 2023-11-27T20:41:44.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fb2579b6640 1 -- 172.21.15.91:0/1208291254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2501dc6c0 con 0x7fb2500c57a0 2023-11-27T20:41:44.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.359+0000 7fb2579b6640 1 -- 172.21.15.91:0/1208291254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2501dafe0 con 0x7fb2500c57a0 2023-11-27T20:41:44.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.357+0000 7fdb4cff9640 1 -- 172.21.15.91:0/2009493936 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44031e20 con 0x7fdb4800f2c0 2023-11-27T20:41:44.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fdb4cff9640 1 -- 172.21.15.91:0/2009493936 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4403ad60 con 0x7fdb4800f2c0 2023-11-27T20:41:44.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fdb4cff9640 1 -- 172.21.15.91:0/2009493936 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44044630 con 0x7fdb4800f2c0 2023-11-27T20:41:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fdb5516e640 1 -- 172.21.15.91:0/2009493936 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4817c920 con 0x7fdb4800f2c0 2023-11-27T20:41:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fdb5516e640 1 -- 172.21.15.91:0/2009493936 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4817cee0 con 0x7fdb4800f2c0 2023-11-27T20:41:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fbf427fc640 1 -- 172.21.15.91:0/3393324829 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf4414e810 msgr2=0x7fbf44147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fbf427fc640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf4414e810 0x7fbf44147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fbf427fc640 1 -- 172.21.15.91:0/3393324829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf440c4e50 msgr2=0x7fbf441545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fbf427fc640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf440c4e50 0x7fbf441545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fbf427fc640 1 -- 172.21.15.91:0/3393324829 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340094d0 con 0x7fbf440c7e90 2023-11-27T20:41:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.358+0000 7fbf42ffd640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf440c4e50 0x7fbf441545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.360+0000 7fbf427fc640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 0x7fbf441470c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800d5f0 tx=0x7fbf3800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.357+0000 7f141e193640 1 -- start start 2023-11-27T20:41:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.359+0000 7f141e193640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f141814e570 0x7f14180c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.359+0000 7f141e193640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14180c7d10 0x7f1418157b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.359+0000 7f141e193640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14180c4830 con 0x7f14180c6d60 2023-11-27T20:41:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.359+0000 7f141e193640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141814e950 con 0x7f141814e570 2023-11-27T20:41:44.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.359+0000 7f141e193640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1418155060 con 0x7f14180c7d10 2023-11-27T20:41:44.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.359+0000 7f432e993640 1 Processor -- start 2023-11-27T20:41:44.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.359+0000 7f432e993640 1 -- start start 2023-11-27T20:41:44.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.360+0000 7fdb5516e640 1 -- 172.21.15.91:0/2009493936 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb48005360 con 0x7fdb4800f2c0 2023-11-27T20:41:44.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.360+0000 7f141d191640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f141814e570 0x7f14180c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.360+0000 7f141d191640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f141814e570 0x7f14180c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:39692/0 (socket says 172.21.15.91:39692) 2023-11-27T20:41:44.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7f432e993640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4328158240 0x7f432815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7f432e993640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43280c4830 con 0x7f432814e570 2023-11-27T20:41:44.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7f432e993640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432814e950 con 0x7f43280c7d10 2023-11-27T20:41:44.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7f432e993640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4328155060 con 0x7f4328158240 2023-11-27T20:41:44.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7fbf2b7fe640 1 -- 172.21.15.91:0/3393324829 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380125f0 con 0x7fbf440c7e90 2023-11-27T20:41:44.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf44150990 con 0x7fbf440c7e90 2023-11-27T20:41:44.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf44150460 con 0x7fbf440c7e90 2023-11-27T20:41:44.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.360+0000 7f141d191640 1 -- 172.21.15.91:0/3605381854 learned_addr learned my addr 172.21.15.91:0/3605381854 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7f141c990640 1 --2- 172.21.15.91:0/3605381854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14180c7d10 0x7f1418157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7f141d191640 1 -- 172.21.15.91:0/3605381854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14180c7d10 msgr2=0x7f1418157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7f141d191640 1 --2- 172.21.15.91:0/3605381854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14180c7d10 0x7f1418157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7f141d191640 1 -- 172.21.15.91:0/3605381854 >> v1:172.21.15.183:6789/0 conn(0x7f14180c6d60 legacy=0x7f1418158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.361+0000 7f141d191640 1 -- 172.21.15.91:0/3605381854 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14180c4ad0 con 0x7f141814e570 2023-11-27T20:41:44.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.362+0000 7f432e192640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4328158240 0x7f432815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.362+0000 7f432e192640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4328158240 0x7f432815fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:39700/0 (socket says 172.21.15.91:39700) 2023-11-27T20:41:44.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.362+0000 7f432e192640 1 -- 172.21.15.91:0/3083611224 learned_addr learned my addr 172.21.15.91:0/3083611224 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.362+0000 7fbf2b7fe640 1 -- 172.21.15.91:0/3393324829 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38012750 con 0x7fbf440c7e90 2023-11-27T20:41:44.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.362+0000 7f432e192640 1 -- 172.21.15.91:0/3083611224 >> v1:172.21.15.183:6789/0 conn(0x7f43280c7d10 legacy=0x7f4328157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.362+0000 7fb2579b6640 1 -- 172.21.15.91:0/1208291254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb230005250 con 0x7fb2500c57a0 2023-11-27T20:41:44.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.362+0000 7f432e192640 1 -- 172.21.15.91:0/3083611224 >> v1:172.21.15.91:6789/0 conn(0x7f432814e570 legacy=0x7f43280c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.362+0000 7f432e192640 1 -- 172.21.15.91:0/3083611224 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43280c4ad0 con 0x7f4328158240 2023-11-27T20:41:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.364+0000 7f432e192640 1 --2- 172.21.15.91:0/3083611224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4328158240 0x7f432815fe40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4320009e50 tx=0x7f432002bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9b7714cee03e289 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.364+0000 7f432c98f640 1 -- 172.21.15.91:0/3083611224 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432002cb20 con 0x7f4328158240 2023-11-27T20:41:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.364+0000 7f432c98f640 1 -- 172.21.15.91:0/3083611224 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432002cc80 con 0x7f4328158240 2023-11-27T20:41:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.364+0000 7f432c98f640 1 -- 172.21.15.91:0/3083611224 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200343f0 con 0x7f4328158240 2023-11-27T20:41:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.365+0000 7f432e993640 1 -- 172.21.15.91:0/3083611224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4328158240 msgr2=0x7f432815fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.365+0000 7f432e993640 1 --2- 172.21.15.91:0/3083611224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4328158240 0x7f432815fe40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4320009e50 tx=0x7f432002bf80 comp rx=0 tx=0).stop 2023-11-27T20:41:44.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.365+0000 7f432e993640 1 -- 172.21.15.91:0/3083611224 shutdown_connections 2023-11-27T20:41:44.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.365+0000 7f432e993640 1 --2- 172.21.15.91:0/3083611224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4328158240 0x7f432815fe40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.365+0000 7f432e993640 1 -- 172.21.15.91:0/3083611224 >> 172.21.15.91:0/3083611224 conn(0x7f43280ab9e0 msgr2=0x7f43280abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.365+0000 7fb245ffb640 1 -- 172.21.15.91:0/1208291254 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb240007470 con 0x7fb2500c57a0 2023-11-27T20:41:44.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.366+0000 7f432e993640 1 -- 172.21.15.91:0/3083611224 shutdown_connections 2023-11-27T20:41:44.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.366+0000 7f432e993640 1 -- 172.21.15.91:0/3083611224 wait complete. 2023-11-27T20:41:44.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.362+0000 7fbf2b7fe640 1 -- 172.21.15.91:0/3393324829 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38012ae0 con 0x7fbf440c7e90 2023-11-27T20:41:44.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.366+0000 7fbf2b7fe640 1 -- 172.21.15.91:0/3393324829 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbf38012c40 con 0x7fbf440c7e90 2023-11-27T20:41:44.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.366+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf24005250 con 0x7fbf440c7e90 2023-11-27T20:41:44.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.367+0000 7fb245ffb640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb23406b210 0x7fb23406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.367+0000 7fbf2b7fe640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf3006b1c0 0x7fbf3006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.367+0000 7fbf2b7fe640 1 -- 172.21.15.91:0/3393324829 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf38089d00 con 0x7fbf440c7e90 2023-11-27T20:41:44.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.368+0000 7f432e993640 1 Processor -- start 2023-11-27T20:41:44.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.367+0000 7fb245ffb640 1 -- 172.21.15.91:0/1208291254 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb240088d50 con 0x7fb2500c57a0 2023-11-27T20:41:44.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.368+0000 7f432e993640 1 -- start start 2023-11-27T20:41:44.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.368+0000 7fbf42ffd640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf3006b1c0 0x7fbf3006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.368+0000 7fb255752640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb23406b210 0x7fb23406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.369+0000 7fbf42ffd640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf3006b1c0 0x7fbf3006d680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbf440ab490 tx=0x7fbf3403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.363+0000 7f141d191640 1 --2- 172.21.15.91:0/3605381854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f141814e570 0x7f14180c6820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1414009870 tx=0x7f141402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b415bfe02f7bdca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.364+0000 7f140ffff640 1 -- 172.21.15.91:0/3605381854 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414030840 con 0x7f141814e570 2023-11-27T20:41:44.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.364+0000 7f140ffff640 1 -- 172.21.15.91:0/3605381854 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14140309a0 con 0x7f141814e570 2023-11-27T20:41:44.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.364+0000 7f140ffff640 1 -- 172.21.15.91:0/3605381854 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414030d30 con 0x7f141814e570 2023-11-27T20:41:44.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.365+0000 7f141e193640 1 -- 172.21.15.91:0/3605381854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f141814e570 msgr2=0x7f14180c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.365+0000 7f141e193640 1 --2- 172.21.15.91:0/3605381854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f141814e570 0x7f14180c6820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1414009870 tx=0x7f141402b980 comp rx=0 tx=0).stop 2023-11-27T20:41:44.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.369+0000 7f141e193640 1 -- 172.21.15.91:0/3605381854 shutdown_connections 2023-11-27T20:41:44.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.369+0000 7f141e193640 1 --2- 172.21.15.91:0/3605381854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14180c7d10 0x7f1418157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.369+0000 7f141e193640 1 --2- 172.21.15.91:0/3605381854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f141814e570 0x7f14180c6820 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.369+0000 7f141e193640 1 -- 172.21.15.91:0/3605381854 >> 172.21.15.91:0/3605381854 conn(0x7f14180ab9e0 msgr2=0x7f14180abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.369+0000 7f141e193640 1 -- 172.21.15.91:0/3605381854 shutdown_connections 2023-11-27T20:41:44.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.368+0000 7fdb4cff9640 1 -- 172.21.15.91:0/2009493936 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdb4404d450 con 0x7fdb4800f2c0 2023-11-27T20:41:44.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.370+0000 7f141e193640 1 -- 172.21.15.91:0/3605381854 wait complete. 2023-11-27T20:41:44.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.370+0000 7fb255752640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb23406b210 0x7fb23406d6d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb248001fe0 tx=0x7fb248009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.370+0000 7f432e993640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43280c7d10 0x7f43281508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.370+0000 7f432e993640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f432814e570 0x7f4328151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.370+0000 7fdb4cff9640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb3406b2c0 0x7fdb3406d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.370+0000 7fdb4cff9640 1 -- 172.21.15.91:0/2009493936 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb440abdd0 con 0x7fdb4800f2c0 2023-11-27T20:41:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.371+0000 7f432e993640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4328158240 0x7f4328153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.370+0000 7f432d991640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43280c7d10 0x7f43281508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.371+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb3406b2c0 0x7fdb3406d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.371+0000 7f432d991640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43280c7d10 0x7f43281508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49488/0 (socket says 172.21.15.91:49488) 2023-11-27T20:41:44.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.371+0000 7f432d991640 1 -- 172.21.15.91:0/2508099441 learned_addr learned my addr 172.21.15.91:0/2508099441 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.371+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280c3cb0 con 0x7f43280c7d10 2023-11-27T20:41:44.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.371+0000 7f432e192640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4328158240 0x7f4328153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.371+0000 7f432d190640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f432814e570 0x7f4328151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.372+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432814fbd0 con 0x7f4328158240 2023-11-27T20:41:44.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.372+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43280c3890 con 0x7f432814e570 2023-11-27T20:41:44.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.372+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb3406b2c0 0x7fdb3406d780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb4817a550 tx=0x7fdb3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.372+0000 7f141e193640 1 Processor -- start 2023-11-27T20:41:44.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.373+0000 7f141e193640 1 -- start start 2023-11-27T20:41:44.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.373+0000 7fdb4cff9640 1 -- 172.21.15.91:0/2009493936 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdb44076ae0 con 0x7fdb4800f2c0 2023-11-27T20:41:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.373+0000 7f432d991640 1 -- 172.21.15.91:0/2508099441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f432814e570 msgr2=0x7f4328151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.373+0000 7f432d991640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f432814e570 0x7f4328151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.373+0000 7f432d991640 1 -- 172.21.15.91:0/2508099441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4328158240 msgr2=0x7f4328153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.373+0000 7f432d991640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4328158240 0x7f4328153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.373+0000 7f432d991640 1 -- 172.21.15.91:0/2508099441 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320009b30 con 0x7f43280c7d10 2023-11-27T20:41:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.374+0000 7f432d991640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43280c7d10 0x7f43281508a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f432400c440 tx=0x7f432400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.374+0000 7f141e193640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14180c6d60 0x7f14181ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.375+0000 7f141e193640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c7d10 0x7f14181532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.375+0000 7f141e193640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f141814e570 0x7f1418153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.375+0000 7f141d992640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f141814e570 0x7f1418153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.375+0000 7f141d992640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f141814e570 0x7f1418153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49500/0 (socket says 172.21.15.91:49500) 2023-11-27T20:41:44.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.375+0000 7f141d992640 1 -- 172.21.15.91:0/2534108585 learned_addr learned my addr 172.21.15.91:0/2534108585 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:44.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.375+0000 7f141d191640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14180c6d60 0x7f14181ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.375+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14180c12b0 con 0x7f141814e570 2023-11-27T20:41:44.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.376+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14180c1010 con 0x7f14180c7d10 2023-11-27T20:41:44.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.376+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14181edbf0 con 0x7f14180c6d60 2023-11-27T20:41:44.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.376+0000 7f141c990640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c7d10 0x7f14181532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.376+0000 7f141d992640 1 -- 172.21.15.91:0/2534108585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14180c6d60 msgr2=0x7f14181ecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.376+0000 7f141d992640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14180c6d60 0x7f14181ecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.376+0000 7f141d992640 1 -- 172.21.15.91:0/2534108585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c7d10 msgr2=0x7f14181532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.376+0000 7f141d992640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c7d10 0x7f14181532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.376+0000 7f141d992640 1 -- 172.21.15.91:0/2534108585 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14140094d0 con 0x7f141814e570 2023-11-27T20:41:44.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.377+0000 7f141d992640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f141814e570 0x7f1418153830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f141000c780 tx=0x7f141000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.378+0000 7f140dffb640 1 -- 172.21.15.91:0/2534108585 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410004b60 con 0x7f141814e570 2023-11-27T20:41:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.378+0000 7f431e7fc640 1 -- 172.21.15.91:0/2508099441 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324005480 con 0x7f43280c7d10 2023-11-27T20:41:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.378+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43280c3ee0 con 0x7f43280c7d10 2023-11-27T20:41:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.378+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432814f580 con 0x7f43280c7d10 2023-11-27T20:41:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.379+0000 7f140dffb640 1 -- 172.21.15.91:0/2534108585 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141000ce90 con 0x7f141814e570 2023-11-27T20:41:44.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.379+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14181ed910 con 0x7f141814e570 2023-11-27T20:41:44.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.379+0000 7f140dffb640 1 -- 172.21.15.91:0/2534108585 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410004b60 con 0x7f141814e570 2023-11-27T20:41:44.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.379+0000 7f431e7fc640 1 -- 172.21.15.91:0/2508099441 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43240035f0 con 0x7f43280c7d10 2023-11-27T20:41:44.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.379+0000 7f431e7fc640 1 -- 172.21.15.91:0/2508099441 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240039c0 con 0x7f43280c7d10 2023-11-27T20:41:44.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.379+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14181578c0 con 0x7f141814e570 2023-11-27T20:41:44.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.380+0000 7fb245ffb640 1 -- 172.21.15.91:0/1208291254 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb240053ca0 con 0x7fb2500c57a0 2023-11-27T20:41:44.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.381+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1418153010 con 0x7f141814e570 2023-11-27T20:41:44.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.383+0000 7f140dffb640 1 -- 172.21.15.91:0/2534108585 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1410004cc0 con 0x7f141814e570 2023-11-27T20:41:44.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.384+0000 7fbf2b7fe640 1 -- 172.21.15.91:0/3393324829 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbf38054ad0 con 0x7fbf440c7e90 2023-11-27T20:41:44.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.382+0000 7f431e7fc640 1 -- 172.21.15.91:0/2508099441 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4324003b20 con 0x7f43280c7d10 2023-11-27T20:41:44.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.382+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4310005250 con 0x7f43280c7d10 2023-11-27T20:41:44.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.383+0000 7f431e7fc640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f430c06b1c0 0x7f430c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.383+0000 7f431e7fc640 1 -- 172.21.15.91:0/2508099441 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4324088f80 con 0x7f43280c7d10 2023-11-27T20:41:44.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.384+0000 7f432d190640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f430c06b1c0 0x7f430c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.385+0000 7f140dffb640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f13fc06b220 0x7f13fc06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:44.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.385+0000 7f140dffb640 1 -- 172.21.15.91:0/2534108585 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1410089a30 con 0x7f141814e570 2023-11-27T20:41:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.386+0000 7f432d190640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f430c06b1c0 0x7f430c06d680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4318007fd0 tx=0x7f4318009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.388+0000 7f141d191640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f13fc06b220 0x7f13fc06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.389+0000 7f141d191640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f13fc06b220 0x7f13fc06d6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1414036000 tx=0x7f1414008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.392+0000 7f431e7fc640 1 -- 172.21.15.91:0/2508099441 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4324053ce0 con 0x7f43280c7d10 2023-11-27T20:41:44.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.402+0000 7f140dffb640 1 -- 172.21.15.91:0/2534108585 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1418153010 con 0x7f141814e570 2023-11-27T20:41:44.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.679+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ffa900d23c0 con 0x7ffa900d78e0 2023-11-27T20:41:44.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.680+0000 7ffa8a7fc640 1 -- 172.21.15.91:0/1017494251 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa980d2260 con 0x7ffa900d78e0 2023-11-27T20:41:44.681 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:44.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.683+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa7c06b1c0 msgr2=0x7ffa7c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.683+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa7c06b1c0 0x7ffa7c06d680 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c036000 tx=0x7ffa8c03c040 comp rx=0 tx=0).stop 2023-11-27T20:41:44.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.684+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa900d78e0 msgr2=0x7ffa900d42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.684+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa900d78e0 0x7ffa900d42e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa980641d0 tx=0x7ffa98067f10 comp rx=0 tx=0).stop 2023-11-27T20:41:44.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.684+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 shutdown_connections 2023-11-27T20:41:44.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.684+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa7c06b1c0 0x7ffa7c06d680 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.684+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa900d78e0 0x7ffa900d42e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.685+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa900506e0 0x7ffa9016b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.685+0000 7ffa9fc2b640 1 --2- 172.21.15.91:0/1017494251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa9000fcb0 0x7ffa900cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.685+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 >> 172.21.15.91:0/1017494251 conn(0x7ffa9004fbc0 msgr2=0x7ffa90005560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.685+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 shutdown_connections 2023-11-27T20:41:44.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.685+0000 7ffa9fc2b640 1 -- 172.21.15.91:0/1017494251 wait complete. 2023-11-27T20:41:44.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.709+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7effb0066cd0 con 0x7effb014e810 2023-11-27T20:41:44.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.710+0000 7eff977fe640 1 -- 172.21.15.91:0/825310846 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effa8003e60 con 0x7effb014e810 2023-11-27T20:41:44.713 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:44.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-11-27T20:41:44.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.712+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe4800fb60 con 0x7efe480e26f0 2023-11-27T20:41:44.714 DEBUG:teuthology.parallel:result is None 2023-11-27T20:41:44.715 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:44.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.713+0000 7efe467fc640 1 -- 172.21.15.91:0/3458565452 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe500f0e00 con 0x7efe480e26f0 2023-11-27T20:41:44.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff9c06b240 msgr2=0x7eff9c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff9c06b240 0x7eff9c06d700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7effa0036000 tx=0x7effa003c040 comp rx=0 tx=0).stop 2023-11-27T20:41:44.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 msgr2=0x7effb00c38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb00c38a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7effa800c730 tx=0x7effa800cbf0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 shutdown_connections 2023-11-27T20:41:44.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effb014e810 0x7effb00c38a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff9c06b240 0x7eff9c06d700 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effb00c7e90 0x7effb01ede00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 --2- 172.21.15.91:0/825310846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effb00c4e50 0x7effb0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 >> 172.21.15.91:0/825310846 conn(0x7effb00ca170 msgr2=0x7effb0154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 shutdown_connections 2023-11-27T20:41:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.714+0000 7effb5690640 1 -- 172.21.15.91:0/825310846 wait complete. 2023-11-27T20:41:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.716+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe3406b210 msgr2=0x7efe3406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.716+0000 7efe569c9640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe3406b210 0x7efe3406d6d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0017a0 tx=0x7efe4c009040 comp rx=0 tx=0).stop 2023-11-27T20:41:44.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.716+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe480e26f0 msgr2=0x7efe48043b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.716+0000 7efe569c9640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe480e26f0 0x7efe48043b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efe500641d0 tx=0x7efe50068ad0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.717+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 shutdown_connections 2023-11-27T20:41:44.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.717+0000 7efe569c9640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe480e26f0 0x7efe48043b20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.717+0000 7efe569c9640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe4804db10 0x7efe480435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.717+0000 7efe569c9640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe3406b210 0x7efe3406d6d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.717+0000 7efe569c9640 1 --2- 172.21.15.91:0/3458565452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe48007170 0x7efe480cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.717+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 >> 172.21.15.91:0/3458565452 conn(0x7efe4804c620 msgr2=0x7efe4804f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.717+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 shutdown_connections 2023-11-27T20:41:44.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.717+0000 7efe569c9640 1 -- 172.21.15.91:0/3458565452 wait complete. 2023-11-27T20:41:44.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-11-27T20:41:44.743 DEBUG:teuthology.parallel:result is None 2023-11-27T20:41:44.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-11-27T20:41:44.745 DEBUG:teuthology.parallel:result is None 2023-11-27T20:41:44.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.754+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf24005500 con 0x7fbf440c7e90 2023-11-27T20:41:44.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.755+0000 7fbf2b7fe640 1 -- 172.21.15.91:0/3393324829 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf38054ad0 con 0x7fbf440c7e90 2023-11-27T20:41:44.757 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:44.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.758+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf3006b1c0 msgr2=0x7fbf3006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.758+0000 7fbf49664640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf3006b1c0 0x7fbf3006d680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbf440ab490 tx=0x7fbf3403d040 comp rx=0 tx=0).stop 2023-11-27T20:41:44.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.758+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 msgr2=0x7fbf441470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.758+0000 7fbf49664640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 0x7fbf441470c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800d5f0 tx=0x7fbf3800dab0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.758+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 shutdown_connections 2023-11-27T20:41:44.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.758+0000 7fbf49664640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf3006b1c0 0x7fbf3006d680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.758+0000 7fbf49664640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf4414e810 0x7fbf44147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.758+0000 7fbf49664640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf440c7e90 0x7fbf441470c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.758+0000 7fbf49664640 1 --2- 172.21.15.91:0/3393324829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf440c4e50 0x7fbf441545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.758+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 >> 172.21.15.91:0/3393324829 conn(0x7fbf440ca170 msgr2=0x7fbf441524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.759+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 shutdown_connections 2023-11-27T20:41:44.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.759+0000 7fbf49664640 1 -- 172.21.15.91:0/3393324829 wait complete. 2023-11-27T20:41:44.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.762+0000 7fdb5516e640 1 -- 172.21.15.91:0/2009493936 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdb4800e030 con 0x7fdb4800f2c0 2023-11-27T20:41:44.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.762+0000 7fdb4cff9640 1 -- 172.21.15.91:0/2009493936 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb44035020 con 0x7fdb4800f2c0 2023-11-27T20:41:44.764 INFO:teuthology.orchestra.run.smithi091.stdout:55834574853 2023-11-27T20:41:44.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.764+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f43100050c0 con 0x7f43280c7d10 2023-11-27T20:41:44.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.764+0000 7f431e7fc640 1 -- 172.21.15.91:0/2508099441 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4324017090 con 0x7f43280c7d10 2023-11-27T20:41:44.766 INFO:teuthology.orchestra.run.smithi091.stdout:55834574855 2023-11-27T20:41:44.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 -- 172.21.15.91:0/2009493936 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb3406b2c0 msgr2=0x7fdb3406d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb3406b2c0 0x7fdb3406d780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb4817a550 tx=0x7fdb3c008040 comp rx=0 tx=0).stop 2023-11-27T20:41:44.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 -- 172.21.15.91:0/2009493936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb4800f2c0 msgr2=0x7fdb4804f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb4800f2c0 0x7fdb4804f230 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdb440090b0 tx=0x7fdb440046c0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 -- 172.21.15.91:0/2009493936 shutdown_connections 2023-11-27T20:41:44.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb3406b2c0 0x7fdb3406d780 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb4817a550 tx=0x7fdb3c008040 comp rx=0 tx=0).stop 2023-11-27T20:41:44.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb480d8760 0x7fdb48179ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb48049f70 0x7fdb48179590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 --2- 172.21.15.91:0/2009493936 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb4800f2c0 0x7fdb4804f230 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 -- 172.21.15.91:0/2009493936 >> 172.21.15.91:0/2009493936 conn(0x7fdb4804fbd0 msgr2=0x7fdb480d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.765+0000 7fdb5516e640 1 -- 172.21.15.91:0/2009493936 shutdown_connections 2023-11-27T20:41:44.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.766+0000 7fdb5516e640 1 -- 172.21.15.91:0/2009493936 wait complete. 2023-11-27T20:41:44.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.767+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f430c06b1c0 msgr2=0x7f430c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.767+0000 7f432e993640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f430c06b1c0 0x7f430c06d680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4318007fd0 tx=0x7f4318009040 comp rx=0 tx=0).stop 2023-11-27T20:41:44.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.767+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43280c7d10 msgr2=0x7f43281508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.767+0000 7f432e993640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43280c7d10 0x7f43281508a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f432400c440 tx=0x7f432400c900 comp rx=0 tx=0).stop 2023-11-27T20:41:44.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.767+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 shutdown_connections 2023-11-27T20:41:44.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.767+0000 7f432e993640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f430c06b1c0 0x7f430c06d680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.767+0000 7f432e993640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4328158240 0x7f4328153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.767+0000 7f432e993640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f432814e570 0x7f4328151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.767+0000 7f432e993640 1 --2- 172.21.15.91:0/2508099441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43280c7d10 0x7f43281508a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.767+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 >> 172.21.15.91:0/2508099441 conn(0x7f43280ab9e0 msgr2=0x7f4328157b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.768+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 shutdown_connections 2023-11-27T20:41:44.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.768+0000 7f432e993640 1 -- 172.21.15.91:0/2508099441 wait complete. 2023-11-27T20:41:44.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-11-27T20:41:44.779 DEBUG:teuthology.parallel:result is None 2023-11-27T20:41:44.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-11-27T20:41:44.785 DEBUG:teuthology.parallel:result is None 2023-11-27T20:41:44.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-11-27T20:41:44.786 DEBUG:teuthology.parallel:result is None 2023-11-27T20:41:44.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.794+0000 7fb2579b6640 1 -- 172.21.15.91:0/1208291254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb2300057d0 con 0x7fb2500c57a0 2023-11-27T20:41:44.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.794+0000 7fb245ffb640 1 -- 172.21.15.91:0/1208291254 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb240017090 con 0x7fb2500c57a0 2023-11-27T20:41:44.796 INFO:teuthology.orchestra.run.smithi091.stdout:55834574854 2023-11-27T20:41:44.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.797+0000 7fb2579b6640 1 -- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb23406b210 msgr2=0x7fb23406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.797+0000 7fb2579b6640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb23406b210 0x7fb23406d6d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb248001fe0 tx=0x7fb248009040 comp rx=0 tx=0).stop 2023-11-27T20:41:44.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.797+0000 7fb2579b6640 1 -- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2500c57a0 msgr2=0x7fb250153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.797+0000 7fb2579b6640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2500c57a0 0x7fb250153260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c440 tx=0x7fb24000c840 comp rx=0 tx=0).stop 2023-11-27T20:41:44.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.797+0000 7fb2579b6640 1 -- 172.21.15.91:0/1208291254 shutdown_connections 2023-11-27T20:41:44.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.797+0000 7fb2579b6640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2500c57a0 0x7fb250153260 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.797+0000 7fb2579b6640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb23406b210 0x7fb23406d6d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.797+0000 7fb2579b6640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2500c06c0 0x7fb250152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.798+0000 7fb2579b6640 1 --2- 172.21.15.91:0/1208291254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2500aaf90 0x7fb2501dcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.798+0000 7fb2579b6640 1 -- 172.21.15.91:0/1208291254 >> 172.21.15.91:0/1208291254 conn(0x7fb2500c5cc0 msgr2=0x7fb2500a5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.798+0000 7fb2579b6640 1 -- 172.21.15.91:0/1208291254 shutdown_connections 2023-11-27T20:41:44.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.798+0000 7fb2579b6640 1 -- 172.21.15.91:0/1208291254 wait complete. 2023-11-27T20:41:44.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.815+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1418153010 con 0x7f141814e570 2023-11-27T20:41:44.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.816+0000 7f140dffb640 1 -- 172.21.15.91:0/2534108585 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1418153010 con 0x7f141814e570 2023-11-27T20:41:44.817 INFO:teuthology.orchestra.run.smithi091.stdout:55834574856 2023-11-27T20:41:44.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f13fc06b220 msgr2=0x7f13fc06d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f13fc06b220 0x7f13fc06d6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1414036000 tx=0x7f1414008030 comp rx=0 tx=0).stop 2023-11-27T20:41:44.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f141814e570 msgr2=0x7f1418153830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:44.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f141814e570 0x7f1418153830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f141000c780 tx=0x7f141000cc40 comp rx=0 tx=0).stop 2023-11-27T20:41:44.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 shutdown_connections 2023-11-27T20:41:44.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f141814e570 0x7f1418153830 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f13fc06b220 0x7f13fc06d6e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c7d10 0x7f14181532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 --2- 172.21.15.91:0/2534108585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14180c6d60 0x7f14181ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:44.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 >> 172.21.15.91:0/2534108585 conn(0x7f14180ab9e0 msgr2=0x7f141806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:44.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 shutdown_connections 2023-11-27T20:41:44.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:44.819+0000 7f141e193640 1 -- 172.21.15.91:0/2534108585 wait complete. 2023-11-27T20:41:44.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-11-27T20:41:44.823 DEBUG:teuthology.parallel:result is None 2023-11-27T20:41:44.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-11-27T20:41:44.837 DEBUG:teuthology.parallel:result is None 2023-11-27T20:41:44.837 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-27T20:41:44.838 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:41:45.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.077+0000 7f5d5ffff640 1 Processor -- start 2023-11-27T20:41:45.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.077+0000 7f5d5ffff640 1 -- start start 2023-11-27T20:41:45.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.079+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d6014e7c0 0x7f5d600c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.079+0000 7f5d5ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5d600c4c00 0x7f5d600ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.079+0000 7f5d5ffff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d60158a60 con 0x7f5d600ca990 2023-11-27T20:41:45.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.079+0000 7f5d5ffff640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d600c5b10 con 0x7f5d600c4c00 2023-11-27T20:41:45.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.079+0000 7f5d5ffff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60157ca0 con 0x7f5d6014e7c0 2023-11-27T20:41:45.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.079+0000 7f5d5effd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d6014e7c0 0x7f5d600c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:45.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.079+0000 7f5d5effd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d6014e7c0 0x7f5d600c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:36120/0 (socket says 172.21.15.91:36120) 2023-11-27T20:41:45.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.079+0000 7f5d5effd640 1 -- 172.21.15.91:0/1648283070 learned_addr learned my addr 172.21.15.91:0/1648283070 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:45.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.080+0000 7f5d5e7fc640 1 --2- 172.21.15.91:0/1648283070 >> v2:172.21.15.183:3300/0 conn(0x7f5d600c4c00 0x7f5d600ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:45.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.080+0000 7f5d5effd640 1 -- 172.21.15.91:0/1648283070 >> v2:172.21.15.183:3300/0 conn(0x7f5d600c4c00 msgr2=0x7f5d600ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:45.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.080+0000 7f5d5effd640 1 --2- 172.21.15.91:0/1648283070 >> v2:172.21.15.183:3300/0 conn(0x7f5d600c4c00 0x7f5d600ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.080+0000 7f5d5effd640 1 -- 172.21.15.91:0/1648283070 >> v1:172.21.15.183:6789/0 conn(0x7f5d600ca990 legacy=0x7f5d60154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.080+0000 7f5d5effd640 1 -- 172.21.15.91:0/1648283070 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d60157f80 con 0x7f5d6014e7c0 2023-11-27T20:41:45.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.081+0000 7f5d5effd640 1 --2- 172.21.15.91:0/1648283070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d6014e7c0 0x7f5d600c46c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009870 tx=0x7f5d5002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c81e565f61ce1b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:45.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.082+0000 7f5d5dffb640 1 -- 172.21.15.91:0/1648283070 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d500317c0 con 0x7f5d6014e7c0 2023-11-27T20:41:45.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.082+0000 7f5d5dffb640 1 -- 172.21.15.91:0/1648283070 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d50031920 con 0x7f5d6014e7c0 2023-11-27T20:41:45.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.082+0000 7f5d5dffb640 1 -- 172.21.15.91:0/1648283070 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50031cb0 con 0x7f5d6014e7c0 2023-11-27T20:41:45.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.082+0000 7f5d5ffff640 1 -- 172.21.15.91:0/1648283070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d6014e7c0 msgr2=0x7f5d600c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.082+0000 7f5d5ffff640 1 --2- 172.21.15.91:0/1648283070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d6014e7c0 0x7f5d600c46c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009870 tx=0x7f5d5002b860 comp rx=0 tx=0).stop 2023-11-27T20:41:45.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.082+0000 7f5d5ffff640 1 -- 172.21.15.91:0/1648283070 shutdown_connections 2023-11-27T20:41:45.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.082+0000 7f5d5ffff640 1 --2- 172.21.15.91:0/1648283070 >> v2:172.21.15.183:3300/0 conn(0x7f5d600c4c00 0x7f5d600ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.082+0000 7f5d5ffff640 1 --2- 172.21.15.91:0/1648283070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d6014e7c0 0x7f5d600c46c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.083+0000 7f5d5ffff640 1 -- 172.21.15.91:0/1648283070 >> 172.21.15.91:0/1648283070 conn(0x7f5d600abf00 msgr2=0x7f5d600c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:45.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.083+0000 7f5d5ffff640 1 -- 172.21.15.91:0/1648283070 shutdown_connections 2023-11-27T20:41:45.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.083+0000 7f5d5ffff640 1 -- 172.21.15.91:0/1648283070 wait complete. 2023-11-27T20:41:45.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.085+0000 7f5d5ffff640 1 Processor -- start 2023-11-27T20:41:45.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.085+0000 7f5d5ffff640 1 -- start start 2023-11-27T20:41:45.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d600c4c00 0x7f5d601e9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d600ca990 0x7f5d6014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6014e7c0 0x7f5d600c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5ffff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600c2610 con 0x7f5d6014e7c0 2023-11-27T20:41:45.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5ffff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600bdd70 con 0x7f5d600c4c00 2023-11-27T20:41:45.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5ffff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600be050 con 0x7f5d600ca990 2023-11-27T20:41:45.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6014e7c0 0x7f5d600c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:45.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6014e7c0 0x7f5d600c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49508/0 (socket says 172.21.15.91:49508) 2023-11-27T20:41:45.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3478741598 learned_addr learned my addr 172.21.15.91:0/3478741598 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:45.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5e7fc640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d600ca990 0x7f5d6014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:45.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5effd640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d600c4c00 0x7f5d601e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:45.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3478741598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d600ca990 msgr2=0x7f5d6014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5f7fe640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d600ca990 0x7f5d6014ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.086+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3478741598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d600c4c00 msgr2=0x7f5d601e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.087+0000 7f5d5f7fe640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d600c4c00 0x7f5d601e9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.087+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3478741598 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d500094d0 con 0x7f5d6014e7c0 2023-11-27T20:41:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.087+0000 7f5d5effd640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d600c4c00 0x7f5d601e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.087+0000 7f5d5f7fe640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6014e7c0 0x7f5d600c2a30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800c7a0 tx=0x7f5d5800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.087+0000 7f5d47fff640 1 -- 172.21.15.91:0/3478741598 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58003b70 con 0x7f5d6014e7c0 2023-11-27T20:41:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.087+0000 7f5d47fff640 1 -- 172.21.15.91:0/3478741598 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d58003cf0 con 0x7f5d6014e7c0 2023-11-27T20:41:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.087+0000 7f5d5ffff640 1 -- 172.21.15.91:0/3478741598 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d600be330 con 0x7f5d6014e7c0 2023-11-27T20:41:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.087+0000 7f5d47fff640 1 -- 172.21.15.91:0/3478741598 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58003ea0 con 0x7f5d6014e7c0 2023-11-27T20:41:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.087+0000 7f5d5ffff640 1 -- 172.21.15.91:0/3478741598 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6014b0b0 con 0x7f5d6014e7c0 2023-11-27T20:41:45.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.088+0000 7f5d5ffff640 1 -- 172.21.15.91:0/3478741598 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6004e840 con 0x7f5d6014e7c0 2023-11-27T20:41:45.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.089+0000 7f5d47fff640 1 -- 172.21.15.91:0/3478741598 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5d5800aa90 con 0x7f5d6014e7c0 2023-11-27T20:41:45.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.091+0000 7f5d47fff640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4c06b1c0 0x7f5d4c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.091+0000 7f5d47fff640 1 -- 172.21.15.91:0/3478741598 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d58089920 con 0x7f5d6014e7c0 2023-11-27T20:41:45.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.091+0000 7f5d5effd640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4c06b1c0 0x7f5d4c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:45.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.091+0000 7f5d5effd640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4c06b1c0 0x7f5d4c06d680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d50036000 tx=0x7f5d5003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:45.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.096+0000 7f5d47fff640 1 -- 172.21.15.91:0/3478741598 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5d580545b0 con 0x7f5d6014e7c0 2023-11-27T20:41:45.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.274+0000 7f5d5ffff640 1 -- 172.21.15.91:0/3478741598 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d600c50a0 con 0x7f5d4c06b1c0 2023-11-27T20:41:45.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.282+0000 7f5d47fff640 1 -- 172.21.15.91:0/3478741598 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264394 (secure 0 0 0) 0x7f5d50031b10 con 0x7f5d4c06b1c0 2023-11-27T20:41:45.286 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:45.288 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:41:45.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 -- 172.21.15.91:0/3478741598 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4c06b1c0 msgr2=0x7f5d4c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4c06b1c0 0x7f5d4c06d680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d50036000 tx=0x7f5d5003d040 comp rx=0 tx=0).stop 2023-11-27T20:41:45.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 -- 172.21.15.91:0/3478741598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6014e7c0 msgr2=0x7f5d600c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6014e7c0 0x7f5d600c2a30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800c7a0 tx=0x7f5d5800cc60 comp rx=0 tx=0).stop 2023-11-27T20:41:45.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 -- 172.21.15.91:0/3478741598 shutdown_connections 2023-11-27T20:41:45.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6014e7c0 0x7f5d600c2a30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d600ca990 0x7f5d6014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4c06b1c0 0x7f5d4c06d680 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 --2- 172.21.15.91:0/3478741598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d600c4c00 0x7f5d601e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 -- 172.21.15.91:0/3478741598 >> 172.21.15.91:0/3478741598 conn(0x7f5d600abf00 msgr2=0x7f5d6006c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:45.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 -- 172.21.15.91:0/3478741598 shutdown_connections 2023-11-27T20:41:45.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.287+0000 7f5d5ffff640 1 -- 172.21.15.91:0/3478741598 wait complete. 2023-11-27T20:41:45.305 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-27T20:41:43.374787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.213718"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568422+0000","last_change":"2023-11-27T20:41:35.210030+0000","last_active":"2023-11-27T20:41:36.568422+0000","last_peered":"2023-11-27T20:41:36.568422+0000","last_clean":"2023-11-27T20:41:36.568422+0000","last_became_active":"2023-11-27T20:41:35.209584+0000","last_became_peered":"2023-11-27T20:41:35.209584+0000","last_unstale":"2023-11-27T20:41:36.568422+0000","last_undegraded":"2023-11-27T20:41:36.568422+0000","last_fullsized":"2023-11-27T20:41:36.568422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:25:37.197535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169518+0000","last_change":"2023-11-27T20:41:35.204048+0000","last_active":"2023-11-27T20:41:36.169518+0000","last_peered":"2023-11-27T20:41:36.169518+0000","last_clean":"2023-11-27T20:41:36.169518+0000","last_became_active":"2023-11-27T20:41:35.203609+0000","last_became_peered":"2023-11-27T20:41:35.203609+0000","last_unstale":"2023-11-27T20:41:36.169518+0000","last_undegraded":"2023-11-27T20:41:36.169518+0000","last_fullsized":"2023-11-27T20:41:36.169518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907501+0000","last_change":"2023-11-27T20:41:35.196593+0000","last_active":"2023-11-27T20:41:36.907501+0000","last_peered":"2023-11-27T20:41:36.907501+0000","last_clean":"2023-11-27T20:41:36.907501+0000","last_became_active":"2023-11-27T20:41:35.196245+0000","last_became_peered":"2023-11-27T20:41:35.196245+0000","last_unstale":"2023-11-27T20:41:36.907501+0000","last_undegraded":"2023-11-27T20:41:36.907501+0000","last_fullsized":"2023-11-27T20:41:36.907501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907385+0000","last_change":"2023-11-27T20:41:35.196161+0000","last_active":"2023-11-27T20:41:36.907385+0000","last_peered":"2023-11-27T20:41:36.907385+0000","last_clean":"2023-11-27T20:41:36.907385+0000","last_became_active":"2023-11-27T20:41:35.195574+0000","last_became_peered":"2023-11-27T20:41:35.195574+0000","last_unstale":"2023-11-27T20:41:36.907385+0000","last_undegraded":"2023-11-27T20:41:36.907385+0000","last_fullsized":"2023-11-27T20:41:36.907385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567605+0000","last_change":"2023-11-27T20:41:35.188022+0000","last_active":"2023-11-27T20:41:36.567605+0000","last_peered":"2023-11-27T20:41:36.567605+0000","last_clean":"2023-11-27T20:41:36.567605+0000","last_became_active":"2023-11-27T20:41:35.187210+0000","last_became_peered":"2023-11-27T20:41:35.187210+0000","last_unstale":"2023-11-27T20:41:36.567605+0000","last_undegraded":"2023-11-27T20:41:36.567605+0000","last_fullsized":"2023-11-27T20:41:36.567605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906752+0000","last_change":"2023-11-27T20:41:35.203796+0000","last_active":"2023-11-27T20:41:36.906752+0000","last_peered":"2023-11-27T20:41:36.906752+0000","last_clean":"2023-11-27T20:41:36.906752+0000","last_became_active":"2023-11-27T20:41:35.203512+0000","last_became_peered":"2023-11-27T20:41:35.203512+0000","last_unstale":"2023-11-27T20:41:36.906752+0000","last_undegraded":"2023-11-27T20:41:36.906752+0000","last_fullsized":"2023-11-27T20:41:36.906752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567353+0000","last_change":"2023-11-27T20:41:35.209043+0000","last_active":"2023-11-27T20:41:36.567353+0000","last_peered":"2023-11-27T20:41:36.567353+0000","last_clean":"2023-11-27T20:41:36.567353+0000","last_became_active":"2023-11-27T20:41:35.205308+0000","last_became_peered":"2023-11-27T20:41:35.205308+0000","last_unstale":"2023-11-27T20:41:36.567353+0000","last_undegraded":"2023-11-27T20:41:36.567353+0000","last_fullsized":"2023-11-27T20:41:36.567353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827128+0000","last_change":"2023-11-27T20:41:35.196320+0000","last_active":"2023-11-27T20:41:36.827128+0000","last_peered":"2023-11-27T20:41:36.827128+0000","last_clean":"2023-11-27T20:41:36.827128+0000","last_became_active":"2023-11-27T20:41:35.193843+0000","last_became_peered":"2023-11-27T20:41:35.193843+0000","last_unstale":"2023-11-27T20:41:36.827128+0000","last_undegraded":"2023-11-27T20:41:36.827128+0000","last_fullsized":"2023-11-27T20:41:36.827128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568420+0000","last_change":"2023-11-27T20:41:35.211496+0000","last_active":"2023-11-27T20:41:36.568420+0000","last_peered":"2023-11-27T20:41:36.568420+0000","last_clean":"2023-11-27T20:41:36.568420+0000","last_became_active":"2023-11-27T20:41:35.211125+0000","last_became_peered":"2023-11-27T20:41:35.211125+0000","last_unstale":"2023-11-27T20:41:36.568420+0000","last_undegraded":"2023-11-27T20:41:36.568420+0000","last_fullsized":"2023-11-27T20:41:36.568420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:13.910143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752742+0000","last_change":"2023-11-27T20:41:35.198670+0000","last_active":"2023-11-27T20:41:36.752742+0000","last_peered":"2023-11-27T20:41:36.752742+0000","last_clean":"2023-11-27T20:41:36.752742+0000","last_became_active":"2023-11-27T20:41:35.198295+0000","last_became_peered":"2023-11-27T20:41:35.198295+0000","last_unstale":"2023-11-27T20:41:36.752742+0000","last_undegraded":"2023-11-27T20:41:36.752742+0000","last_fullsized":"2023-11-27T20:41:36.752742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752376+0000","last_change":"2023-11-27T20:41:35.197788+0000","last_active":"2023-11-27T20:41:36.752376+0000","last_peered":"2023-11-27T20:41:36.752376+0000","last_clean":"2023-11-27T20:41:36.752376+0000","last_became_active":"2023-11-27T20:41:35.195764+0000","last_became_peered":"2023-11-27T20:41:35.195764+0000","last_unstale":"2023-11-27T20:41:36.752376+0000","last_undegraded":"2023-11-27T20:41:36.752376+0000","last_fullsized":"2023-11-27T20:41:36.752376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169976+0000","last_change":"2023-11-27T20:41:35.189694+0000","last_active":"2023-11-27T20:41:36.169976+0000","last_peered":"2023-11-27T20:41:36.169976+0000","last_clean":"2023-11-27T20:41:36.169976+0000","last_became_active":"2023-11-27T20:41:35.189217+0000","last_became_peered":"2023-11-27T20:41:35.189217+0000","last_unstale":"2023-11-27T20:41:36.169976+0000","last_undegraded":"2023-11-27T20:41:36.169976+0000","last_fullsized":"2023-11-27T20:41:36.169976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:50.810907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827472+0000","last_change":"2023-11-27T20:41:35.201904+0000","last_active":"2023-11-27T20:41:36.827472+0000","last_peered":"2023-11-27T20:41:36.827472+0000","last_clean":"2023-11-27T20:41:36.827472+0000","last_became_active":"2023-11-27T20:41:35.201580+0000","last_became_peered":"2023-11-27T20:41:35.201580+0000","last_unstale":"2023-11-27T20:41:36.827472+0000","last_undegraded":"2023-11-27T20:41:36.827472+0000","last_fullsized":"2023-11-27T20:41:36.827472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906514+0000","last_change":"2023-11-27T20:41:35.193681+0000","last_active":"2023-11-27T20:41:36.906514+0000","last_peered":"2023-11-27T20:41:36.906514+0000","last_clean":"2023-11-27T20:41:36.906514+0000","last_became_active":"2023-11-27T20:41:35.193411+0000","last_became_peered":"2023-11-27T20:41:35.193411+0000","last_unstale":"2023-11-27T20:41:36.906514+0000","last_undegraded":"2023-11-27T20:41:36.906514+0000","last_fullsized":"2023-11-27T20:41:36.906514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:23.300382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167585+0000","last_change":"2023-11-27T20:41:35.180375+0000","last_active":"2023-11-27T20:41:36.167585+0000","last_peered":"2023-11-27T20:41:36.167585+0000","last_clean":"2023-11-27T20:41:36.167585+0000","last_became_active":"2023-11-27T20:41:35.177730+0000","last_became_peered":"2023-11-27T20:41:35.177730+0000","last_unstale":"2023-11-27T20:41:36.167585+0000","last_undegraded":"2023-11-27T20:41:36.167585+0000","last_fullsized":"2023-11-27T20:41:36.167585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906675+0000","last_change":"2023-11-27T20:41:35.203805+0000","last_active":"2023-11-27T20:41:36.906675+0000","last_peered":"2023-11-27T20:41:36.906675+0000","last_clean":"2023-11-27T20:41:36.906675+0000","last_became_active":"2023-11-27T20:41:35.203287+0000","last_became_peered":"2023-11-27T20:41:35.203287+0000","last_unstale":"2023-11-27T20:41:36.906675+0000","last_undegraded":"2023-11-27T20:41:36.906675+0000","last_fullsized":"2023-11-27T20:41:36.906675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907572+0000","last_change":"2023-11-27T20:41:35.207783+0000","last_active":"2023-11-27T20:41:36.907572+0000","last_peered":"2023-11-27T20:41:36.907572+0000","last_clean":"2023-11-27T20:41:36.907572+0000","last_became_active":"2023-11-27T20:41:35.207485+0000","last_became_peered":"2023-11-27T20:41:35.207485+0000","last_unstale":"2023-11-27T20:41:36.907572+0000","last_undegraded":"2023-11-27T20:41:36.907572+0000","last_fullsized":"2023-11-27T20:41:36.907572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:30.836331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169370+0000","last_change":"2023-11-27T20:41:35.201010+0000","last_active":"2023-11-27T20:41:36.169370+0000","last_peered":"2023-11-27T20:41:36.169370+0000","last_clean":"2023-11-27T20:41:36.169370+0000","last_became_active":"2023-11-27T20:41:35.200679+0000","last_became_peered":"2023-11-27T20:41:35.200679+0000","last_unstale":"2023-11-27T20:41:36.169370+0000","last_undegraded":"2023-11-27T20:41:36.169370+0000","last_fullsized":"2023-11-27T20:41:36.169370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:04.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568398+0000","last_change":"2023-11-27T20:41:35.206268+0000","last_active":"2023-11-27T20:41:36.568398+0000","last_peered":"2023-11-27T20:41:36.568398+0000","last_clean":"2023-11-27T20:41:36.568398+0000","last_became_active":"2023-11-27T20:41:35.204792+0000","last_became_peered":"2023-11-27T20:41:35.204792+0000","last_unstale":"2023-11-27T20:41:36.568398+0000","last_undegraded":"2023-11-27T20:41:36.568398+0000","last_fullsized":"2023-11-27T20:41:36.568398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:03:54.961052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752345+0000","last_change":"2023-11-27T20:41:35.193226+0000","last_active":"2023-11-27T20:41:36.752345+0000","last_peered":"2023-11-27T20:41:36.752345+0000","last_clean":"2023-11-27T20:41:36.752345+0000","last_became_active":"2023-11-27T20:41:35.192897+0000","last_became_peered":"2023-11-27T20:41:35.192897+0000","last_unstale":"2023-11-27T20:41:36.752345+0000","last_undegraded":"2023-11-27T20:41:36.752345+0000","last_fullsized":"2023-11-27T20:41:36.752345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907015+0000","last_change":"2023-11-27T20:41:35.213004+0000","last_active":"2023-11-27T20:41:36.907015+0000","last_peered":"2023-11-27T20:41:36.907015+0000","last_clean":"2023-11-27T20:41:36.907015+0000","last_became_active":"2023-11-27T20:41:35.212784+0000","last_became_peered":"2023-11-27T20:41:35.212784+0000","last_unstale":"2023-11-27T20:41:36.907015+0000","last_undegraded":"2023-11-27T20:41:36.907015+0000","last_fullsized":"2023-11-27T20:41:36.907015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907089+0000","last_change":"2023-11-27T20:41:35.199481+0000","last_active":"2023-11-27T20:41:36.907089+0000","last_peered":"2023-11-27T20:41:36.907089+0000","last_clean":"2023-11-27T20:41:36.907089+0000","last_became_active":"2023-11-27T20:41:35.193493+0000","last_became_peered":"2023-11-27T20:41:35.193493+0000","last_unstale":"2023-11-27T20:41:36.907089+0000","last_undegraded":"2023-11-27T20:41:36.907089+0000","last_fullsized":"2023-11-27T20:41:36.907089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827405+0000","last_change":"2023-11-27T20:41:35.198176+0000","last_active":"2023-11-27T20:41:36.827405+0000","last_peered":"2023-11-27T20:41:36.827405+0000","last_clean":"2023-11-27T20:41:36.827405+0000","last_became_active":"2023-11-27T20:41:35.197867+0000","last_became_peered":"2023-11-27T20:41:35.197867+0000","last_unstale":"2023-11-27T20:41:36.827405+0000","last_undegraded":"2023-11-27T20:41:36.827405+0000","last_fullsized":"2023-11-27T20:41:36.827405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906931+0000","last_change":"2023-11-27T20:41:35.190147+0000","last_active":"2023-11-27T20:41:36.906931+0000","last_peered":"2023-11-27T20:41:36.906931+0000","last_clean":"2023-11-27T20:41:36.906931+0000","last_became_active":"2023-11-27T20:41:35.189833+0000","last_became_peered":"2023-11-27T20:41:35.189833+0000","last_unstale":"2023-11-27T20:41:36.906931+0000","last_undegraded":"2023-11-27T20:41:36.906931+0000","last_fullsized":"2023-11-27T20:41:36.906931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827821+0000","last_change":"2023-11-27T20:41:35.207689+0000","last_active":"2023-11-27T20:41:36.827821+0000","last_peered":"2023-11-27T20:41:36.827821+0000","last_clean":"2023-11-27T20:41:36.827821+0000","last_became_active":"2023-11-27T20:41:35.207388+0000","last_became_peered":"2023-11-27T20:41:35.207388+0000","last_unstale":"2023-11-27T20:41:36.827821+0000","last_undegraded":"2023-11-27T20:41:36.827821+0000","last_fullsized":"2023-11-27T20:41:36.827821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752892+0000","last_change":"2023-11-27T20:41:35.210588+0000","last_active":"2023-11-27T20:41:36.752892+0000","last_peered":"2023-11-27T20:41:36.752892+0000","last_clean":"2023-11-27T20:41:36.752892+0000","last_became_active":"2023-11-27T20:41:35.210373+0000","last_became_peered":"2023-11-27T20:41:35.210373+0000","last_unstale":"2023-11-27T20:41:36.752892+0000","last_undegraded":"2023-11-27T20:41:36.752892+0000","last_fullsized":"2023-11-27T20:41:36.752892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168202+0000","last_change":"2023-11-27T20:41:35.196031+0000","last_active":"2023-11-27T20:41:36.168202+0000","last_peered":"2023-11-27T20:41:36.168202+0000","last_clean":"2023-11-27T20:41:36.168202+0000","last_became_active":"2023-11-27T20:41:35.195780+0000","last_became_peered":"2023-11-27T20:41:35.195780+0000","last_unstale":"2023-11-27T20:41:36.168202+0000","last_undegraded":"2023-11-27T20:41:36.168202+0000","last_fullsized":"2023-11-27T20:41:36.168202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.828241+0000","last_change":"2023-11-27T20:41:35.195475+0000","last_active":"2023-11-27T20:41:36.828241+0000","last_peered":"2023-11-27T20:41:36.828241+0000","last_clean":"2023-11-27T20:41:36.828241+0000","last_became_active":"2023-11-27T20:41:35.194921+0000","last_became_peered":"2023-11-27T20:41:35.194921+0000","last_unstale":"2023-11-27T20:41:36.828241+0000","last_undegraded":"2023-11-27T20:41:36.828241+0000","last_fullsized":"2023-11-27T20:41:36.828241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906986+0000","last_change":"2023-11-27T20:41:35.200027+0000","last_active":"2023-11-27T20:41:36.906986+0000","last_peered":"2023-11-27T20:41:36.906986+0000","last_clean":"2023-11-27T20:41:36.906986+0000","last_became_active":"2023-11-27T20:41:35.199693+0000","last_became_peered":"2023-11-27T20:41:35.199693+0000","last_unstale":"2023-11-27T20:41:36.906986+0000","last_undegraded":"2023-11-27T20:41:36.906986+0000","last_fullsized":"2023-11-27T20:41:36.906986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907975+0000","last_change":"2023-11-27T20:41:35.200037+0000","last_active":"2023-11-27T20:41:36.907975+0000","last_peered":"2023-11-27T20:41:36.907975+0000","last_clean":"2023-11-27T20:41:36.907975+0000","last_became_active":"2023-11-27T20:41:35.199783+0000","last_became_peered":"2023-11-27T20:41:35.199783+0000","last_unstale":"2023-11-27T20:41:36.907975+0000","last_undegraded":"2023-11-27T20:41:36.907975+0000","last_fullsized":"2023-11-27T20:41:36.907975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:13.910143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168723+0000","last_change":"2023-11-27T20:41:35.191018+0000","last_active":"2023-11-27T20:41:36.168723+0000","last_peered":"2023-11-27T20:41:36.168723+0000","last_clean":"2023-11-27T20:41:36.168723+0000","last_became_active":"2023-11-27T20:41:35.189851+0000","last_became_peered":"2023-11-27T20:41:35.189851+0000","last_unstale":"2023-11-27T20:41:36.168723+0000","last_undegraded":"2023-11-27T20:41:36.168723+0000","last_fullsized":"2023-11-27T20:41:36.168723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:03.587578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751906+0000","last_change":"2023-11-27T20:41:35.200143+0000","last_active":"2023-11-27T20:41:36.751906+0000","last_peered":"2023-11-27T20:41:36.751906+0000","last_clean":"2023-11-27T20:41:36.751906+0000","last_became_active":"2023-11-27T20:41:35.199787+0000","last_became_peered":"2023-11-27T20:41:35.199787+0000","last_unstale":"2023-11-27T20:41:36.751906+0000","last_undegraded":"2023-11-27T20:41:36.751906+0000","last_fullsized":"2023-11-27T20:41:36.751906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169985+0000","last_change":"2023-11-27T20:41:35.191668+0000","last_active":"2023-11-27T20:41:36.169985+0000","last_peered":"2023-11-27T20:41:36.169985+0000","last_clean":"2023-11-27T20:41:36.169985+0000","last_became_active":"2023-11-27T20:41:35.191402+0000","last_became_peered":"2023-11-27T20:41:35.191402+0000","last_unstale":"2023-11-27T20:41:36.169985+0000","last_undegraded":"2023-11-27T20:41:36.169985+0000","last_fullsized":"2023-11-27T20:41:36.169985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:37:56.420323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.391181+0000","last_change":"2023-11-27T20:41:34.379346+0000","last_active":"2023-11-27T20:41:35.391181+0000","last_peered":"2023-11-27T20:41:35.391181+0000","last_clean":"2023-11-27T20:41:35.391181+0000","last_became_active":"2023-11-27T20:41:34.379070+0000","last_became_peered":"2023-11-27T20:41:34.379070+0000","last_unstale":"2023-11-27T20:41:35.391181+0000","last_undegraded":"2023-11-27T20:41:35.391181+0000","last_fullsized":"2023-11-27T20:41:35.391181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:30.381280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907378+0000","last_change":"2023-11-27T20:41:35.208886+0000","last_active":"2023-11-27T20:41:36.907378+0000","last_peered":"2023-11-27T20:41:36.907378+0000","last_clean":"2023-11-27T20:41:36.907378+0000","last_became_active":"2023-11-27T20:41:35.208443+0000","last_became_peered":"2023-11-27T20:41:35.208443+0000","last_unstale":"2023-11-27T20:41:36.907378+0000","last_undegraded":"2023-11-27T20:41:36.907378+0000","last_fullsized":"2023-11-27T20:41:36.907378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.394357+0000","last_change":"2023-11-27T20:41:34.376598+0000","last_active":"2023-11-27T20:41:35.394357+0000","last_peered":"2023-11-27T20:41:35.394357+0000","last_clean":"2023-11-27T20:41:35.394357+0000","last_became_active":"2023-11-27T20:41:34.375938+0000","last_became_peered":"2023-11-27T20:41:34.375938+0000","last_unstale":"2023-11-27T20:41:35.394357+0000","last_undegraded":"2023-11-27T20:41:35.394357+0000","last_fullsized":"2023-11-27T20:41:35.394357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.189265+0000","last_change":"2023-11-27T20:41:34.365856+0000","last_active":"2023-11-27T20:41:35.189265+0000","last_peered":"2023-11-27T20:41:35.189265+0000","last_clean":"2023-11-27T20:41:35.189265+0000","last_became_active":"2023-11-27T20:41:34.365263+0000","last_became_peered":"2023-11-27T20:41:34.365263+0000","last_unstale":"2023-11-27T20:41:35.189265+0000","last_undegraded":"2023-11-27T20:41:35.189265+0000","last_fullsized":"2023-11-27T20:41:35.189265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:22.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827358+0000","last_change":"2023-11-27T20:41:35.194411+0000","last_active":"2023-11-27T20:41:36.827358+0000","last_peered":"2023-11-27T20:41:36.827358+0000","last_clean":"2023-11-27T20:41:36.827358+0000","last_became_active":"2023-11-27T20:41:35.193870+0000","last_became_peered":"2023-11-27T20:41:35.193870+0000","last_unstale":"2023-11-27T20:41:36.827358+0000","last_undegraded":"2023-11-27T20:41:36.827358+0000","last_fullsized":"2023-11-27T20:41:36.827358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.184215+0000","last_change":"2023-11-27T20:41:34.384607+0000","last_active":"2023-11-27T20:41:35.184215+0000","last_peered":"2023-11-27T20:41:35.184215+0000","last_clean":"2023-11-27T20:41:35.184215+0000","last_became_active":"2023-11-27T20:41:34.384325+0000","last_became_peered":"2023-11-27T20:41:34.384325+0000","last_unstale":"2023-11-27T20:41:35.184215+0000","last_undegraded":"2023-11-27T20:41:35.184215+0000","last_fullsized":"2023-11-27T20:41:35.184215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:56.618777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167329+0000","last_change":"2023-11-27T20:41:35.186364+0000","last_active":"2023-11-27T20:41:36.167329+0000","last_peered":"2023-11-27T20:41:36.167329+0000","last_clean":"2023-11-27T20:41:36.167329+0000","last_became_active":"2023-11-27T20:41:35.185990+0000","last_became_peered":"2023-11-27T20:41:35.185990+0000","last_unstale":"2023-11-27T20:41:36.167329+0000","last_undegraded":"2023-11-27T20:41:36.167329+0000","last_fullsized":"2023-11-27T20:41:36.167329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.182202+0000","last_change":"2023-11-27T20:41:34.386881+0000","last_active":"2023-11-27T20:41:35.182202+0000","last_peered":"2023-11-27T20:41:35.182202+0000","last_clean":"2023-11-27T20:41:35.182202+0000","last_became_active":"2023-11-27T20:41:34.385617+0000","last_became_peered":"2023-11-27T20:41:34.385617+0000","last_unstale":"2023-11-27T20:41:35.182202+0000","last_undegraded":"2023-11-27T20:41:35.182202+0000","last_fullsized":"2023-11-27T20:41:35.182202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:04:42.284326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907976+0000","last_change":"2023-11-27T20:41:35.213263+0000","last_active":"2023-11-27T20:41:36.907976+0000","last_peered":"2023-11-27T20:41:36.907976+0000","last_clean":"2023-11-27T20:41:36.907976+0000","last_became_active":"2023-11-27T20:41:35.212945+0000","last_became_peered":"2023-11-27T20:41:35.212945+0000","last_unstale":"2023-11-27T20:41:36.907976+0000","last_undegraded":"2023-11-27T20:41:36.907976+0000","last_fullsized":"2023-11-27T20:41:36.907976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:31:23.723316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.188149+0000","last_change":"2023-11-27T20:41:34.390261+0000","last_active":"2023-11-27T20:41:35.188149+0000","last_peered":"2023-11-27T20:41:35.188149+0000","last_clean":"2023-11-27T20:41:35.188149+0000","last_became_active":"2023-11-27T20:41:34.389520+0000","last_became_peered":"2023-11-27T20:41:34.389520+0000","last_unstale":"2023-11-27T20:41:35.188149+0000","last_undegraded":"2023-11-27T20:41:35.188149+0000","last_fullsized":"2023-11-27T20:41:35.188149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:10.528078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907207+0000","last_change":"2023-11-27T20:41:35.203369+0000","last_active":"2023-11-27T20:41:36.907207+0000","last_peered":"2023-11-27T20:41:36.907207+0000","last_clean":"2023-11-27T20:41:36.907207+0000","last_became_active":"2023-11-27T20:41:35.203042+0000","last_became_peered":"2023-11-27T20:41:35.203042+0000","last_unstale":"2023-11-27T20:41:36.907207+0000","last_undegraded":"2023-11-27T20:41:36.907207+0000","last_fullsized":"2023-11-27T20:41:36.907207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399508+0000","last_change":"2023-11-27T20:41:34.385832+0000","last_active":"2023-11-27T20:41:35.399508+0000","last_peered":"2023-11-27T20:41:35.399508+0000","last_clean":"2023-11-27T20:41:35.399508+0000","last_became_active":"2023-11-27T20:41:34.384636+0000","last_became_peered":"2023-11-27T20:41:34.384636+0000","last_unstale":"2023-11-27T20:41:35.399508+0000","last_undegraded":"2023-11-27T20:41:35.399508+0000","last_fullsized":"2023-11-27T20:41:35.399508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:03.773317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.170135+0000","last_change":"2023-11-27T20:41:35.188819+0000","last_active":"2023-11-27T20:41:36.170135+0000","last_peered":"2023-11-27T20:41:36.170135+0000","last_clean":"2023-11-27T20:41:36.170135+0000","last_became_active":"2023-11-27T20:41:35.188292+0000","last_became_peered":"2023-11-27T20:41:35.188292+0000","last_unstale":"2023-11-27T20:41:36.170135+0000","last_undegraded":"2023-11-27T20:41:36.170135+0000","last_fullsized":"2023-11-27T20:41:36.170135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:04.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399033+0000","last_change":"2023-11-27T20:41:34.363549+0000","last_active":"2023-11-27T20:41:35.399033+0000","last_peered":"2023-11-27T20:41:35.399033+0000","last_clean":"2023-11-27T20:41:35.399033+0000","last_became_active":"2023-11-27T20:41:34.361181+0000","last_became_peered":"2023-11-27T20:41:34.361181+0000","last_unstale":"2023-11-27T20:41:35.399033+0000","last_undegraded":"2023-11-27T20:41:35.399033+0000","last_fullsized":"2023-11-27T20:41:35.399033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:03.773317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567699+0000","last_change":"2023-11-27T20:41:35.211117+0000","last_active":"2023-11-27T20:41:36.567699+0000","last_peered":"2023-11-27T20:41:36.567699+0000","last_clean":"2023-11-27T20:41:36.567699+0000","last_became_active":"2023-11-27T20:41:35.206668+0000","last_became_peered":"2023-11-27T20:41:35.206668+0000","last_unstale":"2023-11-27T20:41:36.567699+0000","last_undegraded":"2023-11-27T20:41:36.567699+0000","last_fullsized":"2023-11-27T20:41:36.567699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399355+0000","last_change":"2023-11-27T20:41:34.375628+0000","last_active":"2023-11-27T20:41:35.399355+0000","last_peered":"2023-11-27T20:41:35.399355+0000","last_clean":"2023-11-27T20:41:35.399355+0000","last_became_active":"2023-11-27T20:41:34.375164+0000","last_became_peered":"2023-11-27T20:41:34.375164+0000","last_unstale":"2023-11-27T20:41:35.399355+0000","last_undegraded":"2023-11-27T20:41:35.399355+0000","last_fullsized":"2023-11-27T20:41:35.399355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907003+0000","last_change":"2023-11-27T20:41:35.206246+0000","last_active":"2023-11-27T20:41:36.907003+0000","last_peered":"2023-11-27T20:41:36.907003+0000","last_clean":"2023-11-27T20:41:36.907003+0000","last_became_active":"2023-11-27T20:41:35.205741+0000","last_became_peered":"2023-11-27T20:41:35.205741+0000","last_unstale":"2023-11-27T20:41:36.907003+0000","last_undegraded":"2023-11-27T20:41:36.907003+0000","last_fullsized":"2023-11-27T20:41:36.907003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.186433+0000","last_change":"2023-11-27T20:41:34.383993+0000","last_active":"2023-11-27T20:41:35.186433+0000","last_peered":"2023-11-27T20:41:35.186433+0000","last_clean":"2023-11-27T20:41:35.186433+0000","last_became_active":"2023-11-27T20:41:34.383739+0000","last_became_peered":"2023-11-27T20:41:34.383739+0000","last_unstale":"2023-11-27T20:41:35.186433+0000","last_undegraded":"2023-11-27T20:41:35.186433+0000","last_fullsized":"2023-11-27T20:41:35.186433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:17.468682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567699+0000","last_change":"2023-11-27T20:41:35.193841+0000","last_active":"2023-11-27T20:41:36.567699+0000","last_peered":"2023-11-27T20:41:36.567699+0000","last_clean":"2023-11-27T20:41:36.567699+0000","last_became_active":"2023-11-27T20:41:35.192848+0000","last_became_peered":"2023-11-27T20:41:35.192848+0000","last_unstale":"2023-11-27T20:41:36.567699+0000","last_undegraded":"2023-11-27T20:41:36.567699+0000","last_fullsized":"2023-11-27T20:41:36.567699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:09.396414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.173511+0000","last_change":"2023-11-27T20:41:34.376129+0000","last_active":"2023-11-27T20:41:35.173511+0000","last_peered":"2023-11-27T20:41:35.173511+0000","last_clean":"2023-11-27T20:41:35.173511+0000","last_became_active":"2023-11-27T20:41:34.375804+0000","last_became_peered":"2023-11-27T20:41:34.375804+0000","last_unstale":"2023-11-27T20:41:35.173511+0000","last_undegraded":"2023-11-27T20:41:35.173511+0000","last_fullsized":"2023-11-27T20:41:35.173511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:45:59.175653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751925+0000","last_change":"2023-11-27T20:41:35.196670+0000","last_active":"2023-11-27T20:41:36.751925+0000","last_peered":"2023-11-27T20:41:36.751925+0000","last_clean":"2023-11-27T20:41:36.751925+0000","last_became_active":"2023-11-27T20:41:35.196378+0000","last_became_peered":"2023-11-27T20:41:35.196378+0000","last_unstale":"2023-11-27T20:41:36.751925+0000","last_undegraded":"2023-11-27T20:41:36.751925+0000","last_fullsized":"2023-11-27T20:41:36.751925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399674+0000","last_change":"2023-11-27T20:41:34.372374+0000","last_active":"2023-11-27T20:41:35.399674+0000","last_peered":"2023-11-27T20:41:35.399674+0000","last_clean":"2023-11-27T20:41:35.399674+0000","last_became_active":"2023-11-27T20:41:34.371956+0000","last_became_peered":"2023-11-27T20:41:34.371956+0000","last_unstale":"2023-11-27T20:41:35.399674+0000","last_undegraded":"2023-11-27T20:41:35.399674+0000","last_fullsized":"2023-11-27T20:41:35.399674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:09:02.084275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567520+0000","last_change":"2023-11-27T20:41:35.209749+0000","last_active":"2023-11-27T20:41:36.567520+0000","last_peered":"2023-11-27T20:41:36.567520+0000","last_clean":"2023-11-27T20:41:36.567520+0000","last_became_active":"2023-11-27T20:41:35.209421+0000","last_became_peered":"2023-11-27T20:41:35.209421+0000","last_unstale":"2023-11-27T20:41:36.567520+0000","last_undegraded":"2023-11-27T20:41:36.567520+0000","last_fullsized":"2023-11-27T20:41:36.567520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.397573+0000","last_change":"2023-11-27T20:41:34.381268+0000","last_active":"2023-11-27T20:41:35.397573+0000","last_peered":"2023-11-27T20:41:35.397573+0000","last_clean":"2023-11-27T20:41:35.397573+0000","last_became_active":"2023-11-27T20:41:34.379765+0000","last_became_peered":"2023-11-27T20:41:34.379765+0000","last_unstale":"2023-11-27T20:41:35.397573+0000","last_undegraded":"2023-11-27T20:41:35.397573+0000","last_fullsized":"2023-11-27T20:41:35.397573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:07.467417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568439+0000","last_change":"2023-11-27T20:41:35.210232+0000","last_active":"2023-11-27T20:41:36.568439+0000","last_peered":"2023-11-27T20:41:36.568439+0000","last_clean":"2023-11-27T20:41:36.568439+0000","last_became_active":"2023-11-27T20:41:35.209143+0000","last_became_peered":"2023-11-27T20:41:35.209143+0000","last_unstale":"2023-11-27T20:41:36.568439+0000","last_undegraded":"2023-11-27T20:41:36.568439+0000","last_fullsized":"2023-11-27T20:41:36.568439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:31:23.723316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395121+0000","last_change":"2023-11-27T20:41:34.380235+0000","last_active":"2023-11-27T20:41:35.395121+0000","last_peered":"2023-11-27T20:41:35.395121+0000","last_clean":"2023-11-27T20:41:35.395121+0000","last_became_active":"2023-11-27T20:41:34.379940+0000","last_became_peered":"2023-11-27T20:41:34.379940+0000","last_unstale":"2023-11-27T20:41:35.395121+0000","last_undegraded":"2023-11-27T20:41:35.395121+0000","last_fullsized":"2023-11-27T20:41:35.395121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568652+0000","last_change":"2023-11-27T20:41:35.214260+0000","last_active":"2023-11-27T20:41:36.568652+0000","last_peered":"2023-11-27T20:41:36.568652+0000","last_clean":"2023-11-27T20:41:36.568652+0000","last_became_active":"2023-11-27T20:41:35.213814+0000","last_became_peered":"2023-11-27T20:41:35.213814+0000","last_unstale":"2023-11-27T20:41:36.568652+0000","last_undegraded":"2023-11-27T20:41:36.568652+0000","last_fullsized":"2023-11-27T20:41:36.568652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:03.051157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.396870+0000","last_change":"2023-11-27T20:41:34.383025+0000","last_active":"2023-11-27T20:41:35.396870+0000","last_peered":"2023-11-27T20:41:35.396870+0000","last_clean":"2023-11-27T20:41:35.396870+0000","last_became_active":"2023-11-27T20:41:34.382672+0000","last_became_peered":"2023-11-27T20:41:34.382672+0000","last_unstale":"2023-11-27T20:41:35.396870+0000","last_undegraded":"2023-11-27T20:41:35.396870+0000","last_fullsized":"2023-11-27T20:41:35.396870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907802+0000","last_change":"2023-11-27T20:41:35.195935+0000","last_active":"2023-11-27T20:41:36.907802+0000","last_peered":"2023-11-27T20:41:36.907802+0000","last_clean":"2023-11-27T20:41:36.907802+0000","last_became_active":"2023-11-27T20:41:35.195208+0000","last_became_peered":"2023-11-27T20:41:35.195208+0000","last_unstale":"2023-11-27T20:41:36.907802+0000","last_undegraded":"2023-11-27T20:41:36.907802+0000","last_fullsized":"2023-11-27T20:41:36.907802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:03:54.961052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.166681+0000","last_change":"2023-11-27T20:41:34.386973+0000","last_active":"2023-11-27T20:41:35.166681+0000","last_peered":"2023-11-27T20:41:35.166681+0000","last_clean":"2023-11-27T20:41:35.166681+0000","last_became_active":"2023-11-27T20:41:34.386649+0000","last_became_peered":"2023-11-27T20:41:34.386649+0000","last_unstale":"2023-11-27T20:41:35.166681+0000","last_undegraded":"2023-11-27T20:41:35.166681+0000","last_fullsized":"2023-11-27T20:41:35.166681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:07.467417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568068+0000","last_change":"2023-11-27T20:41:35.211346+0000","last_active":"2023-11-27T20:41:36.568068+0000","last_peered":"2023-11-27T20:41:36.568068+0000","last_clean":"2023-11-27T20:41:36.568068+0000","last_became_active":"2023-11-27T20:41:35.210844+0000","last_became_peered":"2023-11-27T20:41:35.210844+0000","last_unstale":"2023-11-27T20:41:36.568068+0000","last_undegraded":"2023-11-27T20:41:36.568068+0000","last_fullsized":"2023-11-27T20:41:36.568068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:30.836331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177748+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:41:35.177748+0000","last_peered":"2023-11-27T20:41:35.177748+0000","last_clean":"2023-11-27T20:41:35.177748+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:41:35.177748+0000","last_undegraded":"2023-11-27T20:41:35.177748+0000","last_fullsized":"2023-11-27T20:41:35.177748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.185862+0000","last_change":"2023-11-27T20:41:34.388453+0000","last_active":"2023-11-27T20:41:35.185862+0000","last_peered":"2023-11-27T20:41:35.185862+0000","last_clean":"2023-11-27T20:41:35.185862+0000","last_became_active":"2023-11-27T20:41:34.388237+0000","last_became_peered":"2023-11-27T20:41:34.388237+0000","last_unstale":"2023-11-27T20:41:35.185862+0000","last_undegraded":"2023-11-27T20:41:35.185862+0000","last_fullsized":"2023-11-27T20:41:35.185862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:49.304546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827823+0000","last_change":"2023-11-27T20:41:35.192084+0000","last_active":"2023-11-27T20:41:36.827823+0000","last_peered":"2023-11-27T20:41:36.827823+0000","last_clean":"2023-11-27T20:41:36.827823+0000","last_became_active":"2023-11-27T20:41:35.190701+0000","last_became_peered":"2023-11-27T20:41:35.190701+0000","last_unstale":"2023-11-27T20:41:36.827823+0000","last_undegraded":"2023-11-27T20:41:36.827823+0000","last_fullsized":"2023-11-27T20:41:36.827823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177479+0000","last_change":"2023-11-27T20:41:34.388350+0000","last_active":"2023-11-27T20:41:35.177479+0000","last_peered":"2023-11-27T20:41:35.177479+0000","last_clean":"2023-11-27T20:41:35.177479+0000","last_became_active":"2023-11-27T20:41:34.388078+0000","last_became_peered":"2023-11-27T20:41:34.388078+0000","last_unstale":"2023-11-27T20:41:35.177479+0000","last_undegraded":"2023-11-27T20:41:35.177479+0000","last_fullsized":"2023-11-27T20:41:35.177479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906804+0000","last_change":"2023-11-27T20:41:35.208870+0000","last_active":"2023-11-27T20:41:36.906804+0000","last_peered":"2023-11-27T20:41:36.906804+0000","last_clean":"2023-11-27T20:41:36.906804+0000","last_became_active":"2023-11-27T20:41:35.208454+0000","last_became_peered":"2023-11-27T20:41:35.208454+0000","last_unstale":"2023-11-27T20:41:36.906804+0000","last_undegraded":"2023-11-27T20:41:36.906804+0000","last_fullsized":"2023-11-27T20:41:36.906804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:31.394309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.166972+0000","last_change":"2023-11-27T20:41:34.379312+0000","last_active":"2023-11-27T20:41:35.166972+0000","last_peered":"2023-11-27T20:41:35.166972+0000","last_clean":"2023-11-27T20:41:35.166972+0000","last_became_active":"2023-11-27T20:41:34.379064+0000","last_became_peered":"2023-11-27T20:41:34.379064+0000","last_unstale":"2023-11-27T20:41:35.166972+0000","last_undegraded":"2023-11-27T20:41:35.166972+0000","last_fullsized":"2023-11-27T20:41:35.166972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:37:55.407294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167324+0000","last_change":"2023-11-27T20:41:35.180034+0000","last_active":"2023-11-27T20:41:36.167324+0000","last_peered":"2023-11-27T20:41:36.167324+0000","last_clean":"2023-11-27T20:41:36.167324+0000","last_became_active":"2023-11-27T20:41:35.178994+0000","last_became_peered":"2023-11-27T20:41:35.178994+0000","last_unstale":"2023-11-27T20:41:36.167324+0000","last_undegraded":"2023-11-27T20:41:36.167324+0000","last_fullsized":"2023-11-27T20:41:36.167324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.192457+0000","last_change":"2023-11-27T20:41:34.383948+0000","last_active":"2023-11-27T20:41:35.192457+0000","last_peered":"2023-11-27T20:41:35.192457+0000","last_clean":"2023-11-27T20:41:35.192457+0000","last_became_active":"2023-11-27T20:41:34.383355+0000","last_became_peered":"2023-11-27T20:41:34.383355+0000","last_unstale":"2023-11-27T20:41:35.192457+0000","last_undegraded":"2023-11-27T20:41:35.192457+0000","last_fullsized":"2023-11-27T20:41:35.192457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:38.370465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169931+0000","last_change":"2023-11-27T20:41:35.204870+0000","last_active":"2023-11-27T20:41:36.169931+0000","last_peered":"2023-11-27T20:41:36.169931+0000","last_clean":"2023-11-27T20:41:36.169931+0000","last_became_active":"2023-11-27T20:41:35.204425+0000","last_became_peered":"2023-11-27T20:41:35.204425+0000","last_unstale":"2023-11-27T20:41:36.169931+0000","last_undegraded":"2023-11-27T20:41:36.169931+0000","last_fullsized":"2023-11-27T20:41:36.169931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:21.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.169452+0000","last_change":"2023-11-27T20:41:34.376734+0000","last_active":"2023-11-27T20:41:35.169452+0000","last_peered":"2023-11-27T20:41:35.169452+0000","last_clean":"2023-11-27T20:41:35.169452+0000","last_became_active":"2023-11-27T20:41:34.376427+0000","last_became_peered":"2023-11-27T20:41:34.376427+0000","last_unstale":"2023-11-27T20:41:35.169452+0000","last_undegraded":"2023-11-27T20:41:35.169452+0000","last_fullsized":"2023-11-27T20:41:35.169452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907828+0000","last_change":"2023-11-27T20:41:35.198109+0000","last_active":"2023-11-27T20:41:36.907828+0000","last_peered":"2023-11-27T20:41:36.907828+0000","last_clean":"2023-11-27T20:41:36.907828+0000","last_became_active":"2023-11-27T20:41:35.197772+0000","last_became_peered":"2023-11-27T20:41:35.197772+0000","last_unstale":"2023-11-27T20:41:36.907828+0000","last_undegraded":"2023-11-27T20:41:36.907828+0000","last_fullsized":"2023-11-27T20:41:36.907828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:25:37.197535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.185525+0000","last_change":"2023-11-27T20:41:34.387255+0000","last_active":"2023-11-27T20:41:35.185525+0000","last_peered":"2023-11-27T20:41:35.185525+0000","last_clean":"2023-11-27T20:41:35.185525+0000","last_became_active":"2023-11-27T20:41:34.386911+0000","last_became_peered":"2023-11-27T20:41:34.386911+0000","last_unstale":"2023-11-27T20:41:35.185525+0000","last_undegraded":"2023-11-27T20:41:35.185525+0000","last_fullsized":"2023-11-27T20:41:35.185525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:17.468682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168166+0000","last_change":"2023-11-27T20:41:35.179788+0000","last_active":"2023-11-27T20:41:36.168166+0000","last_peered":"2023-11-27T20:41:36.168166+0000","last_clean":"2023-11-27T20:41:36.168166+0000","last_became_active":"2023-11-27T20:41:35.179071+0000","last_became_peered":"2023-11-27T20:41:35.179071+0000","last_unstale":"2023-11-27T20:41:36.168166+0000","last_undegraded":"2023-11-27T20:41:36.168166+0000","last_fullsized":"2023-11-27T20:41:36.168166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168894+0000","last_change":"2023-11-27T20:41:34.383651+0000","last_active":"2023-11-27T20:41:36.168894+0000","last_peered":"2023-11-27T20:41:36.168894+0000","last_clean":"2023-11-27T20:41:36.168894+0000","last_became_active":"2023-11-27T20:41:34.383295+0000","last_became_peered":"2023-11-27T20:41:34.383295+0000","last_unstale":"2023-11-27T20:41:36.168894+0000","last_undegraded":"2023-11-27T20:41:36.168894+0000","last_fullsized":"2023-11-27T20:41:36.168894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827815+0000","last_change":"2023-11-27T20:41:35.211366+0000","last_active":"2023-11-27T20:41:36.827815+0000","last_peered":"2023-11-27T20:41:36.827815+0000","last_clean":"2023-11-27T20:41:36.827815+0000","last_became_active":"2023-11-27T20:41:35.211001+0000","last_became_peered":"2023-11-27T20:41:35.211001+0000","last_unstale":"2023-11-27T20:41:36.827815+0000","last_undegraded":"2023-11-27T20:41:36.827815+0000","last_fullsized":"2023-11-27T20:41:36.827815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.394474+0000","last_change":"2023-11-27T20:41:34.385226+0000","last_active":"2023-11-27T20:41:35.394474+0000","last_peered":"2023-11-27T20:41:35.394474+0000","last_clean":"2023-11-27T20:41:35.394474+0000","last_became_active":"2023-11-27T20:41:34.384361+0000","last_became_peered":"2023-11-27T20:41:34.384361+0000","last_unstale":"2023-11-27T20:41:35.394474+0000","last_undegraded":"2023-11-27T20:41:35.394474+0000","last_fullsized":"2023-11-27T20:41:35.394474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:22.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906972+0000","last_change":"2023-11-27T20:41:35.201432+0000","last_active":"2023-11-27T20:41:36.906972+0000","last_peered":"2023-11-27T20:41:36.906972+0000","last_clean":"2023-11-27T20:41:36.906972+0000","last_became_active":"2023-11-27T20:41:35.201065+0000","last_became_peered":"2023-11-27T20:41:35.201065+0000","last_unstale":"2023-11-27T20:41:36.906972+0000","last_undegraded":"2023-11-27T20:41:36.906972+0000","last_fullsized":"2023-11-27T20:41:36.906972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177113+0000","last_change":"2023-11-27T20:41:34.389439+0000","last_active":"2023-11-27T20:41:35.177113+0000","last_peered":"2023-11-27T20:41:35.177113+0000","last_clean":"2023-11-27T20:41:35.177113+0000","last_became_active":"2023-11-27T20:41:34.389145+0000","last_became_peered":"2023-11-27T20:41:34.389145+0000","last_unstale":"2023-11-27T20:41:35.177113+0000","last_undegraded":"2023-11-27T20:41:35.177113+0000","last_fullsized":"2023-11-27T20:41:35.177113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169999+0000","last_change":"2023-11-27T20:41:35.189837+0000","last_active":"2023-11-27T20:41:36.169999+0000","last_peered":"2023-11-27T20:41:36.169999+0000","last_clean":"2023-11-27T20:41:36.169999+0000","last_became_active":"2023-11-27T20:41:35.189208+0000","last_became_peered":"2023-11-27T20:41:35.189208+0000","last_unstale":"2023-11-27T20:41:36.169999+0000","last_undegraded":"2023-11-27T20:41:36.169999+0000","last_fullsized":"2023-11-27T20:41:36.169999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:03.587578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.167206+0000","last_change":"2023-11-27T20:41:34.387256+0000","last_active":"2023-11-27T20:41:35.167206+0000","last_peered":"2023-11-27T20:41:35.167206+0000","last_clean":"2023-11-27T20:41:35.167206+0000","last_became_active":"2023-11-27T20:41:34.386923+0000","last_became_peered":"2023-11-27T20:41:34.386923+0000","last_unstale":"2023-11-27T20:41:35.167206+0000","last_undegraded":"2023-11-27T20:41:35.167206+0000","last_fullsized":"2023-11-27T20:41:35.167206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:20.494221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827602+0000","last_change":"2023-11-27T20:41:35.186083+0000","last_active":"2023-11-27T20:41:36.827602+0000","last_peered":"2023-11-27T20:41:36.827602+0000","last_clean":"2023-11-27T20:41:36.827602+0000","last_became_active":"2023-11-27T20:41:35.184168+0000","last_became_peered":"2023-11-27T20:41:35.184168+0000","last_unstale":"2023-11-27T20:41:36.827602+0000","last_undegraded":"2023-11-27T20:41:36.827602+0000","last_fullsized":"2023-11-27T20:41:36.827602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.168762+0000","last_change":"2023-11-27T20:41:34.378248+0000","last_active":"2023-11-27T20:41:35.168762+0000","last_peered":"2023-11-27T20:41:35.168762+0000","last_clean":"2023-11-27T20:41:35.168762+0000","last_became_active":"2023-11-27T20:41:34.376972+0000","last_became_peered":"2023-11-27T20:41:34.376972+0000","last_unstale":"2023-11-27T20:41:35.168762+0000","last_undegraded":"2023-11-27T20:41:35.168762+0000","last_fullsized":"2023-11-27T20:41:35.168762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827902+0000","last_change":"2023-11-27T20:41:35.199694+0000","last_active":"2023-11-27T20:41:36.827902+0000","last_peered":"2023-11-27T20:41:36.827902+0000","last_clean":"2023-11-27T20:41:36.827902+0000","last_became_active":"2023-11-27T20:41:35.198540+0000","last_became_peered":"2023-11-27T20:41:35.198540+0000","last_unstale":"2023-11-27T20:41:36.827902+0000","last_undegraded":"2023-11-27T20:41:36.827902+0000","last_fullsized":"2023-11-27T20:41:36.827902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.391944+0000","last_change":"2023-11-27T20:41:34.387556+0000","last_active":"2023-11-27T20:41:35.391944+0000","last_peered":"2023-11-27T20:41:35.391944+0000","last_clean":"2023-11-27T20:41:35.391944+0000","last_became_active":"2023-11-27T20:41:34.387316+0000","last_became_peered":"2023-11-27T20:41:34.387316+0000","last_unstale":"2023-11-27T20:41:35.391944+0000","last_undegraded":"2023-11-27T20:41:35.391944+0000","last_fullsized":"2023-11-27T20:41:35.391944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751980+0000","last_change":"2023-11-27T20:41:35.195068+0000","last_active":"2023-11-27T20:41:36.751980+0000","last_peered":"2023-11-27T20:41:36.751980+0000","last_clean":"2023-11-27T20:41:36.751980+0000","last_became_active":"2023-11-27T20:41:35.194784+0000","last_became_peered":"2023-11-27T20:41:35.194784+0000","last_unstale":"2023-11-27T20:41:36.751980+0000","last_undegraded":"2023-11-27T20:41:36.751980+0000","last_fullsized":"2023-11-27T20:41:36.751980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907555+0000","last_change":"2023-11-27T20:41:35.207667+0000","last_active":"2023-11-27T20:41:36.907555+0000","last_peered":"2023-11-27T20:41:36.907555+0000","last_clean":"2023-11-27T20:41:36.907555+0000","last_became_active":"2023-11-27T20:41:35.207323+0000","last_became_peered":"2023-11-27T20:41:35.207323+0000","last_unstale":"2023-11-27T20:41:36.907555+0000","last_undegraded":"2023-11-27T20:41:36.907555+0000","last_fullsized":"2023-11-27T20:41:36.907555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:09.396414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.396809+0000","last_change":"2023-11-27T20:41:34.386983+0000","last_active":"2023-11-27T20:41:35.396809+0000","last_peered":"2023-11-27T20:41:35.396809+0000","last_clean":"2023-11-27T20:41:35.396809+0000","last_became_active":"2023-11-27T20:41:34.386656+0000","last_became_peered":"2023-11-27T20:41:34.386656+0000","last_unstale":"2023-11-27T20:41:35.396809+0000","last_undegraded":"2023-11-27T20:41:35.396809+0000","last_fullsized":"2023-11-27T20:41:35.396809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907496+0000","last_change":"2023-11-27T20:41:35.191267+0000","last_active":"2023-11-27T20:41:36.907496+0000","last_peered":"2023-11-27T20:41:36.907496+0000","last_clean":"2023-11-27T20:41:36.907496+0000","last_became_active":"2023-11-27T20:41:35.190866+0000","last_became_peered":"2023-11-27T20:41:35.190866+0000","last_unstale":"2023-11-27T20:41:36.907496+0000","last_undegraded":"2023-11-27T20:41:36.907496+0000","last_fullsized":"2023-11-27T20:41:36.907496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395054+0000","last_change":"2023-11-27T20:41:34.390257+0000","last_active":"2023-11-27T20:41:35.395054+0000","last_peered":"2023-11-27T20:41:35.395054+0000","last_clean":"2023-11-27T20:41:35.395054+0000","last_became_active":"2023-11-27T20:41:34.389874+0000","last_became_peered":"2023-11-27T20:41:34.389874+0000","last_unstale":"2023-11-27T20:41:35.395054+0000","last_undegraded":"2023-11-27T20:41:35.395054+0000","last_fullsized":"2023-11-27T20:41:35.395054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:30.381280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907171+0000","last_change":"2023-11-27T20:41:35.202070+0000","last_active":"2023-11-27T20:41:36.907171+0000","last_peered":"2023-11-27T20:41:36.907171+0000","last_clean":"2023-11-27T20:41:36.907171+0000","last_became_active":"2023-11-27T20:41:35.201756+0000","last_became_peered":"2023-11-27T20:41:35.201756+0000","last_unstale":"2023-11-27T20:41:36.907171+0000","last_undegraded":"2023-11-27T20:41:36.907171+0000","last_fullsized":"2023-11-27T20:41:36.907171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395132+0000","last_change":"2023-11-27T20:41:34.378008+0000","last_active":"2023-11-27T20:41:35.395132+0000","last_peered":"2023-11-27T20:41:35.395132+0000","last_clean":"2023-11-27T20:41:35.395132+0000","last_became_active":"2023-11-27T20:41:34.377741+0000","last_became_peered":"2023-11-27T20:41:34.377741+0000","last_unstale":"2023-11-27T20:41:35.395132+0000","last_undegraded":"2023-11-27T20:41:35.395132+0000","last_fullsized":"2023-11-27T20:41:35.395132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:04:42.284326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827818+0000","last_change":"2023-11-27T20:41:35.205383+0000","last_active":"2023-11-27T20:41:36.827818+0000","last_peered":"2023-11-27T20:41:36.827818+0000","last_clean":"2023-11-27T20:41:36.827818+0000","last_became_active":"2023-11-27T20:41:35.203522+0000","last_became_peered":"2023-11-27T20:41:35.203522+0000","last_unstale":"2023-11-27T20:41:36.827818+0000","last_undegraded":"2023-11-27T20:41:36.827818+0000","last_fullsized":"2023-11-27T20:41:36.827818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399023+0000","last_change":"2023-11-27T20:41:34.384751+0000","last_active":"2023-11-27T20:41:35.399023+0000","last_peered":"2023-11-27T20:41:35.399023+0000","last_clean":"2023-11-27T20:41:35.399023+0000","last_became_active":"2023-11-27T20:41:34.384460+0000","last_became_peered":"2023-11-27T20:41:34.384460+0000","last_unstale":"2023-11-27T20:41:35.399023+0000","last_undegraded":"2023-11-27T20:41:35.399023+0000","last_fullsized":"2023-11-27T20:41:35.399023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8720000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.99}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1339999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1070000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.282}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3559999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.571}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6659999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.651}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.764}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:41:45.310 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:41:45.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.557+0000 7f79d5056640 1 Processor -- start 2023-11-27T20:41:45.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.557+0000 7f79d5056640 1 -- start start 2023-11-27T20:41:45.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.558+0000 7f79d5056640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f79d0155490 0x7f79d00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.558+0000 7f79d5056640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d00c06c0 con 0x7f79d00c1500 2023-11-27T20:41:45.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.558+0000 7f79d5056640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d00c1020 con 0x7f79d00a9b40 2023-11-27T20:41:45.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.559+0000 7f79d5056640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d00a5820 con 0x7f79d0155490 2023-11-27T20:41:45.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.559+0000 7f79ced9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f79d0155490 0x7f79d00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:45.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.559+0000 7f79ced9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f79d0155490 0x7f79d00a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49510/0 (socket says 172.21.15.91:49510) 2023-11-27T20:41:45.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.559+0000 7f79ced9d640 1 -- 172.21.15.91:0/3397215956 learned_addr learned my addr 172.21.15.91:0/3397215956 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:45.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.559+0000 7f79c7fff640 1 --1- 172.21.15.91:0/3397215956 >> v1:172.21.15.91:6789/0 conn(0x7f79d00c1500 0x7f79d00a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:33978/0 (socket says 172.21.15.91:33978) 2023-11-27T20:41:45.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.559+0000 7f79ced9d640 1 -- 172.21.15.91:0/3397215956 >> v1:172.21.15.183:6789/0 conn(0x7f79d00a9b40 legacy=0x7f79d00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:45.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.559+0000 7f79ced9d640 1 -- 172.21.15.91:0/3397215956 >> v1:172.21.15.91:6789/0 conn(0x7f79d00c1500 legacy=0x7f79d00a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.559+0000 7f79ced9d640 1 -- 172.21.15.91:0/3397215956 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00c0910 con 0x7f79d0155490 2023-11-27T20:41:45.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.560+0000 7f79ced9d640 1 --2- 172.21.15.91:0/3397215956 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 0x7f79d00a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009870 tx=0x7f79c002dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdc0b61916fe697 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:45.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.560+0000 7f79ce59c640 1 -- 172.21.15.91:0/3397215956 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c002e960 con 0x7f79d0155490 2023-11-27T20:41:45.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.561+0000 7f79ce59c640 1 -- 172.21.15.91:0/3397215956 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c002eac0 con 0x7f79d0155490 2023-11-27T20:41:45.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.561+0000 7f79ce59c640 1 -- 172.21.15.91:0/3397215956 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c002ee50 con 0x7f79d0155490 2023-11-27T20:41:45.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.561+0000 7f79d5056640 1 -- 172.21.15.91:0/3397215956 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 msgr2=0x7f79d00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.561+0000 7f79d5056640 1 --2- 172.21.15.91:0/3397215956 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 0x7f79d00a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009870 tx=0x7f79c002dbb0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.561+0000 7f79d5056640 1 -- 172.21.15.91:0/3397215956 shutdown_connections 2023-11-27T20:41:45.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.561+0000 7f79d5056640 1 --2- 172.21.15.91:0/3397215956 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 0x7f79d00a51b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.561+0000 7f79d5056640 1 -- 172.21.15.91:0/3397215956 >> 172.21.15.91:0/3397215956 conn(0x7f79d006a500 msgr2=0x7f79d006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:45.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.561+0000 7f79d5056640 1 -- 172.21.15.91:0/3397215956 shutdown_connections 2023-11-27T20:41:45.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.561+0000 7f79d5056640 1 -- 172.21.15.91:0/3397215956 wait complete. 2023-11-27T20:41:45.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.563+0000 7f79d5056640 1 Processor -- start 2023-11-27T20:41:45.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.564+0000 7f79d5056640 1 -- start start 2023-11-27T20:41:45.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.564+0000 7f79d5056640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79d00c1500 0x7f79d0154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79d5056640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 0x7f79d0070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79d5056640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79d01ed540 0x7f79d01ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79d5056640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d0145de0 con 0x7f79d0155490 2023-11-27T20:41:45.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79d5056640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d01534c0 con 0x7f79d01ed540 2023-11-27T20:41:45.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79d5056640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d01537a0 con 0x7f79d00c1500 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79c7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 0x7f79d0070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79c7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 0x7f79d0070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49524/0 (socket says 172.21.15.91:49524) 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79c7fff640 1 -- 172.21.15.91:0/4149419353 learned_addr learned my addr 172.21.15.91:0/4149419353 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79c7fff640 1 -- 172.21.15.91:0/4149419353 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79d00c1500 msgr2=0x7f79d0154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79c7fff640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79d00c1500 0x7f79d0154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79c7fff640 1 -- 172.21.15.91:0/4149419353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79d01ed540 msgr2=0x7f79d01ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79c7fff640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79d01ed540 0x7f79d01ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79c7fff640 1 -- 172.21.15.91:0/4149419353 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00094d0 con 0x7f79d0155490 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.565+0000 7f79c7fff640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 0x7f79d0070700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f79b800c400 tx=0x7f79b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.566+0000 7f79c77fe640 1 -- 172.21.15.91:0/4149419353 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80074e0 con 0x7f79d0155490 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.566+0000 7f79c77fe640 1 -- 172.21.15.91:0/4149419353 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b8007640 con 0x7f79d0155490 2023-11-27T20:41:45.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.566+0000 7f79d5056640 1 -- 172.21.15.91:0/4149419353 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d0153a80 con 0x7f79d0155490 2023-11-27T20:41:45.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.566+0000 7f79c77fe640 1 -- 172.21.15.91:0/4149419353 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8004a00 con 0x7f79d0155490 2023-11-27T20:41:45.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.566+0000 7f79d5056640 1 -- 172.21.15.91:0/4149419353 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d0070c40 con 0x7f79d0155490 2023-11-27T20:41:45.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.567+0000 7f79d5056640 1 -- 172.21.15.91:0/4149419353 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d0068350 con 0x7f79d0155490 2023-11-27T20:41:45.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.568+0000 7f79c77fe640 1 -- 172.21.15.91:0/4149419353 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f79b8004b60 con 0x7f79d0155490 2023-11-27T20:41:45.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.569+0000 7f79c77fe640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79b006b1c0 0x7f79b006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:45.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.569+0000 7f79c77fe640 1 -- 172.21.15.91:0/4149419353 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79b80894c0 con 0x7f79d0155490 2023-11-27T20:41:45.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.569+0000 7f79ced9d640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79b006b1c0 0x7f79b006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:45.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.570+0000 7f79ced9d640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79b006b1c0 0x7f79b006d680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f79c0038000 tx=0x7f79c0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:45.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.574+0000 7f79c77fe640 1 -- 172.21.15.91:0/4149419353 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f79b8054200 con 0x7f79d0155490 2023-11-27T20:41:45.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.745+0000 7f79d5056640 1 -- 172.21.15.91:0/4149419353 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79d0155870 con 0x7f79b006b1c0 2023-11-27T20:41:45.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.755+0000 7f79c77fe640 1 -- 172.21.15.91:0/4149419353 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264320 (secure 0 0 0) 0x7f79c003e3b0 con 0x7f79b006b1c0 2023-11-27T20:41:45.761 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:45.762 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:41:45.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.760+0000 7f79d5056640 1 -- 172.21.15.91:0/4149419353 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79b006b1c0 msgr2=0x7f79b006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.760+0000 7f79d5056640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79b006b1c0 0x7f79b006d680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f79c0038000 tx=0x7f79c0030000 comp rx=0 tx=0).stop 2023-11-27T20:41:45.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.760+0000 7f79d5056640 1 -- 172.21.15.91:0/4149419353 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 msgr2=0x7f79d0070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:45.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.760+0000 7f79d5056640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 0x7f79d0070700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f79b800c400 tx=0x7f79b800c8c0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.761+0000 7f79d5056640 1 -- 172.21.15.91:0/4149419353 shutdown_connections 2023-11-27T20:41:45.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.761+0000 7f79d5056640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79b006b1c0 0x7f79b006d680 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.761+0000 7f79d5056640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79d01ed540 0x7f79d01ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.761+0000 7f79d5056640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d0155490 0x7f79d0070700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.761+0000 7f79d5056640 1 --2- 172.21.15.91:0/4149419353 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79d00c1500 0x7f79d0154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:45.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.761+0000 7f79d5056640 1 -- 172.21.15.91:0/4149419353 >> 172.21.15.91:0/4149419353 conn(0x7f79d006a500 msgr2=0x7f79d006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:45.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.761+0000 7f79d5056640 1 -- 172.21.15.91:0/4149419353 shutdown_connections 2023-11-27T20:41:45.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:45.761+0000 7f79d5056640 1 -- 172.21.15.91:0/4149419353 wait complete. 2023-11-27T20:41:45.780 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-27T20:41:45.375992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003461"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568422+0000","last_change":"2023-11-27T20:41:35.210030+0000","last_active":"2023-11-27T20:41:36.568422+0000","last_peered":"2023-11-27T20:41:36.568422+0000","last_clean":"2023-11-27T20:41:36.568422+0000","last_became_active":"2023-11-27T20:41:35.209584+0000","last_became_peered":"2023-11-27T20:41:35.209584+0000","last_unstale":"2023-11-27T20:41:36.568422+0000","last_undegraded":"2023-11-27T20:41:36.568422+0000","last_fullsized":"2023-11-27T20:41:36.568422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:25:37.197535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169518+0000","last_change":"2023-11-27T20:41:35.204048+0000","last_active":"2023-11-27T20:41:36.169518+0000","last_peered":"2023-11-27T20:41:36.169518+0000","last_clean":"2023-11-27T20:41:36.169518+0000","last_became_active":"2023-11-27T20:41:35.203609+0000","last_became_peered":"2023-11-27T20:41:35.203609+0000","last_unstale":"2023-11-27T20:41:36.169518+0000","last_undegraded":"2023-11-27T20:41:36.169518+0000","last_fullsized":"2023-11-27T20:41:36.169518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907501+0000","last_change":"2023-11-27T20:41:35.196593+0000","last_active":"2023-11-27T20:41:36.907501+0000","last_peered":"2023-11-27T20:41:36.907501+0000","last_clean":"2023-11-27T20:41:36.907501+0000","last_became_active":"2023-11-27T20:41:35.196245+0000","last_became_peered":"2023-11-27T20:41:35.196245+0000","last_unstale":"2023-11-27T20:41:36.907501+0000","last_undegraded":"2023-11-27T20:41:36.907501+0000","last_fullsized":"2023-11-27T20:41:36.907501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907385+0000","last_change":"2023-11-27T20:41:35.196161+0000","last_active":"2023-11-27T20:41:36.907385+0000","last_peered":"2023-11-27T20:41:36.907385+0000","last_clean":"2023-11-27T20:41:36.907385+0000","last_became_active":"2023-11-27T20:41:35.195574+0000","last_became_peered":"2023-11-27T20:41:35.195574+0000","last_unstale":"2023-11-27T20:41:36.907385+0000","last_undegraded":"2023-11-27T20:41:36.907385+0000","last_fullsized":"2023-11-27T20:41:36.907385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567605+0000","last_change":"2023-11-27T20:41:35.188022+0000","last_active":"2023-11-27T20:41:36.567605+0000","last_peered":"2023-11-27T20:41:36.567605+0000","last_clean":"2023-11-27T20:41:36.567605+0000","last_became_active":"2023-11-27T20:41:35.187210+0000","last_became_peered":"2023-11-27T20:41:35.187210+0000","last_unstale":"2023-11-27T20:41:36.567605+0000","last_undegraded":"2023-11-27T20:41:36.567605+0000","last_fullsized":"2023-11-27T20:41:36.567605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906752+0000","last_change":"2023-11-27T20:41:35.203796+0000","last_active":"2023-11-27T20:41:36.906752+0000","last_peered":"2023-11-27T20:41:36.906752+0000","last_clean":"2023-11-27T20:41:36.906752+0000","last_became_active":"2023-11-27T20:41:35.203512+0000","last_became_peered":"2023-11-27T20:41:35.203512+0000","last_unstale":"2023-11-27T20:41:36.906752+0000","last_undegraded":"2023-11-27T20:41:36.906752+0000","last_fullsized":"2023-11-27T20:41:36.906752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567353+0000","last_change":"2023-11-27T20:41:35.209043+0000","last_active":"2023-11-27T20:41:36.567353+0000","last_peered":"2023-11-27T20:41:36.567353+0000","last_clean":"2023-11-27T20:41:36.567353+0000","last_became_active":"2023-11-27T20:41:35.205308+0000","last_became_peered":"2023-11-27T20:41:35.205308+0000","last_unstale":"2023-11-27T20:41:36.567353+0000","last_undegraded":"2023-11-27T20:41:36.567353+0000","last_fullsized":"2023-11-27T20:41:36.567353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827128+0000","last_change":"2023-11-27T20:41:35.196320+0000","last_active":"2023-11-27T20:41:36.827128+0000","last_peered":"2023-11-27T20:41:36.827128+0000","last_clean":"2023-11-27T20:41:36.827128+0000","last_became_active":"2023-11-27T20:41:35.193843+0000","last_became_peered":"2023-11-27T20:41:35.193843+0000","last_unstale":"2023-11-27T20:41:36.827128+0000","last_undegraded":"2023-11-27T20:41:36.827128+0000","last_fullsized":"2023-11-27T20:41:36.827128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568420+0000","last_change":"2023-11-27T20:41:35.211496+0000","last_active":"2023-11-27T20:41:36.568420+0000","last_peered":"2023-11-27T20:41:36.568420+0000","last_clean":"2023-11-27T20:41:36.568420+0000","last_became_active":"2023-11-27T20:41:35.211125+0000","last_became_peered":"2023-11-27T20:41:35.211125+0000","last_unstale":"2023-11-27T20:41:36.568420+0000","last_undegraded":"2023-11-27T20:41:36.568420+0000","last_fullsized":"2023-11-27T20:41:36.568420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:13.910143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752742+0000","last_change":"2023-11-27T20:41:35.198670+0000","last_active":"2023-11-27T20:41:36.752742+0000","last_peered":"2023-11-27T20:41:36.752742+0000","last_clean":"2023-11-27T20:41:36.752742+0000","last_became_active":"2023-11-27T20:41:35.198295+0000","last_became_peered":"2023-11-27T20:41:35.198295+0000","last_unstale":"2023-11-27T20:41:36.752742+0000","last_undegraded":"2023-11-27T20:41:36.752742+0000","last_fullsized":"2023-11-27T20:41:36.752742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752376+0000","last_change":"2023-11-27T20:41:35.197788+0000","last_active":"2023-11-27T20:41:36.752376+0000","last_peered":"2023-11-27T20:41:36.752376+0000","last_clean":"2023-11-27T20:41:36.752376+0000","last_became_active":"2023-11-27T20:41:35.195764+0000","last_became_peered":"2023-11-27T20:41:35.195764+0000","last_unstale":"2023-11-27T20:41:36.752376+0000","last_undegraded":"2023-11-27T20:41:36.752376+0000","last_fullsized":"2023-11-27T20:41:36.752376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169976+0000","last_change":"2023-11-27T20:41:35.189694+0000","last_active":"2023-11-27T20:41:36.169976+0000","last_peered":"2023-11-27T20:41:36.169976+0000","last_clean":"2023-11-27T20:41:36.169976+0000","last_became_active":"2023-11-27T20:41:35.189217+0000","last_became_peered":"2023-11-27T20:41:35.189217+0000","last_unstale":"2023-11-27T20:41:36.169976+0000","last_undegraded":"2023-11-27T20:41:36.169976+0000","last_fullsized":"2023-11-27T20:41:36.169976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:50.810907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827472+0000","last_change":"2023-11-27T20:41:35.201904+0000","last_active":"2023-11-27T20:41:36.827472+0000","last_peered":"2023-11-27T20:41:36.827472+0000","last_clean":"2023-11-27T20:41:36.827472+0000","last_became_active":"2023-11-27T20:41:35.201580+0000","last_became_peered":"2023-11-27T20:41:35.201580+0000","last_unstale":"2023-11-27T20:41:36.827472+0000","last_undegraded":"2023-11-27T20:41:36.827472+0000","last_fullsized":"2023-11-27T20:41:36.827472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906514+0000","last_change":"2023-11-27T20:41:35.193681+0000","last_active":"2023-11-27T20:41:36.906514+0000","last_peered":"2023-11-27T20:41:36.906514+0000","last_clean":"2023-11-27T20:41:36.906514+0000","last_became_active":"2023-11-27T20:41:35.193411+0000","last_became_peered":"2023-11-27T20:41:35.193411+0000","last_unstale":"2023-11-27T20:41:36.906514+0000","last_undegraded":"2023-11-27T20:41:36.906514+0000","last_fullsized":"2023-11-27T20:41:36.906514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:23.300382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167585+0000","last_change":"2023-11-27T20:41:35.180375+0000","last_active":"2023-11-27T20:41:36.167585+0000","last_peered":"2023-11-27T20:41:36.167585+0000","last_clean":"2023-11-27T20:41:36.167585+0000","last_became_active":"2023-11-27T20:41:35.177730+0000","last_became_peered":"2023-11-27T20:41:35.177730+0000","last_unstale":"2023-11-27T20:41:36.167585+0000","last_undegraded":"2023-11-27T20:41:36.167585+0000","last_fullsized":"2023-11-27T20:41:36.167585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906675+0000","last_change":"2023-11-27T20:41:35.203805+0000","last_active":"2023-11-27T20:41:36.906675+0000","last_peered":"2023-11-27T20:41:36.906675+0000","last_clean":"2023-11-27T20:41:36.906675+0000","last_became_active":"2023-11-27T20:41:35.203287+0000","last_became_peered":"2023-11-27T20:41:35.203287+0000","last_unstale":"2023-11-27T20:41:36.906675+0000","last_undegraded":"2023-11-27T20:41:36.906675+0000","last_fullsized":"2023-11-27T20:41:36.906675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907572+0000","last_change":"2023-11-27T20:41:35.207783+0000","last_active":"2023-11-27T20:41:36.907572+0000","last_peered":"2023-11-27T20:41:36.907572+0000","last_clean":"2023-11-27T20:41:36.907572+0000","last_became_active":"2023-11-27T20:41:35.207485+0000","last_became_peered":"2023-11-27T20:41:35.207485+0000","last_unstale":"2023-11-27T20:41:36.907572+0000","last_undegraded":"2023-11-27T20:41:36.907572+0000","last_fullsized":"2023-11-27T20:41:36.907572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:30.836331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169370+0000","last_change":"2023-11-27T20:41:35.201010+0000","last_active":"2023-11-27T20:41:36.169370+0000","last_peered":"2023-11-27T20:41:36.169370+0000","last_clean":"2023-11-27T20:41:36.169370+0000","last_became_active":"2023-11-27T20:41:35.200679+0000","last_became_peered":"2023-11-27T20:41:35.200679+0000","last_unstale":"2023-11-27T20:41:36.169370+0000","last_undegraded":"2023-11-27T20:41:36.169370+0000","last_fullsized":"2023-11-27T20:41:36.169370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:04.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568398+0000","last_change":"2023-11-27T20:41:35.206268+0000","last_active":"2023-11-27T20:41:36.568398+0000","last_peered":"2023-11-27T20:41:36.568398+0000","last_clean":"2023-11-27T20:41:36.568398+0000","last_became_active":"2023-11-27T20:41:35.204792+0000","last_became_peered":"2023-11-27T20:41:35.204792+0000","last_unstale":"2023-11-27T20:41:36.568398+0000","last_undegraded":"2023-11-27T20:41:36.568398+0000","last_fullsized":"2023-11-27T20:41:36.568398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:03:54.961052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752345+0000","last_change":"2023-11-27T20:41:35.193226+0000","last_active":"2023-11-27T20:41:36.752345+0000","last_peered":"2023-11-27T20:41:36.752345+0000","last_clean":"2023-11-27T20:41:36.752345+0000","last_became_active":"2023-11-27T20:41:35.192897+0000","last_became_peered":"2023-11-27T20:41:35.192897+0000","last_unstale":"2023-11-27T20:41:36.752345+0000","last_undegraded":"2023-11-27T20:41:36.752345+0000","last_fullsized":"2023-11-27T20:41:36.752345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907015+0000","last_change":"2023-11-27T20:41:35.213004+0000","last_active":"2023-11-27T20:41:36.907015+0000","last_peered":"2023-11-27T20:41:36.907015+0000","last_clean":"2023-11-27T20:41:36.907015+0000","last_became_active":"2023-11-27T20:41:35.212784+0000","last_became_peered":"2023-11-27T20:41:35.212784+0000","last_unstale":"2023-11-27T20:41:36.907015+0000","last_undegraded":"2023-11-27T20:41:36.907015+0000","last_fullsized":"2023-11-27T20:41:36.907015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907089+0000","last_change":"2023-11-27T20:41:35.199481+0000","last_active":"2023-11-27T20:41:36.907089+0000","last_peered":"2023-11-27T20:41:36.907089+0000","last_clean":"2023-11-27T20:41:36.907089+0000","last_became_active":"2023-11-27T20:41:35.193493+0000","last_became_peered":"2023-11-27T20:41:35.193493+0000","last_unstale":"2023-11-27T20:41:36.907089+0000","last_undegraded":"2023-11-27T20:41:36.907089+0000","last_fullsized":"2023-11-27T20:41:36.907089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827405+0000","last_change":"2023-11-27T20:41:35.198176+0000","last_active":"2023-11-27T20:41:36.827405+0000","last_peered":"2023-11-27T20:41:36.827405+0000","last_clean":"2023-11-27T20:41:36.827405+0000","last_became_active":"2023-11-27T20:41:35.197867+0000","last_became_peered":"2023-11-27T20:41:35.197867+0000","last_unstale":"2023-11-27T20:41:36.827405+0000","last_undegraded":"2023-11-27T20:41:36.827405+0000","last_fullsized":"2023-11-27T20:41:36.827405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906931+0000","last_change":"2023-11-27T20:41:35.190147+0000","last_active":"2023-11-27T20:41:36.906931+0000","last_peered":"2023-11-27T20:41:36.906931+0000","last_clean":"2023-11-27T20:41:36.906931+0000","last_became_active":"2023-11-27T20:41:35.189833+0000","last_became_peered":"2023-11-27T20:41:35.189833+0000","last_unstale":"2023-11-27T20:41:36.906931+0000","last_undegraded":"2023-11-27T20:41:36.906931+0000","last_fullsized":"2023-11-27T20:41:36.906931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827821+0000","last_change":"2023-11-27T20:41:35.207689+0000","last_active":"2023-11-27T20:41:36.827821+0000","last_peered":"2023-11-27T20:41:36.827821+0000","last_clean":"2023-11-27T20:41:36.827821+0000","last_became_active":"2023-11-27T20:41:35.207388+0000","last_became_peered":"2023-11-27T20:41:35.207388+0000","last_unstale":"2023-11-27T20:41:36.827821+0000","last_undegraded":"2023-11-27T20:41:36.827821+0000","last_fullsized":"2023-11-27T20:41:36.827821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:48.041529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.752892+0000","last_change":"2023-11-27T20:41:35.210588+0000","last_active":"2023-11-27T20:41:36.752892+0000","last_peered":"2023-11-27T20:41:36.752892+0000","last_clean":"2023-11-27T20:41:36.752892+0000","last_became_active":"2023-11-27T20:41:35.210373+0000","last_became_peered":"2023-11-27T20:41:35.210373+0000","last_unstale":"2023-11-27T20:41:36.752892+0000","last_undegraded":"2023-11-27T20:41:36.752892+0000","last_fullsized":"2023-11-27T20:41:36.752892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168202+0000","last_change":"2023-11-27T20:41:35.196031+0000","last_active":"2023-11-27T20:41:36.168202+0000","last_peered":"2023-11-27T20:41:36.168202+0000","last_clean":"2023-11-27T20:41:36.168202+0000","last_became_active":"2023-11-27T20:41:35.195780+0000","last_became_peered":"2023-11-27T20:41:35.195780+0000","last_unstale":"2023-11-27T20:41:36.168202+0000","last_undegraded":"2023-11-27T20:41:36.168202+0000","last_fullsized":"2023-11-27T20:41:36.168202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.828241+0000","last_change":"2023-11-27T20:41:35.195475+0000","last_active":"2023-11-27T20:41:36.828241+0000","last_peered":"2023-11-27T20:41:36.828241+0000","last_clean":"2023-11-27T20:41:36.828241+0000","last_became_active":"2023-11-27T20:41:35.194921+0000","last_became_peered":"2023-11-27T20:41:35.194921+0000","last_unstale":"2023-11-27T20:41:36.828241+0000","last_undegraded":"2023-11-27T20:41:36.828241+0000","last_fullsized":"2023-11-27T20:41:36.828241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906986+0000","last_change":"2023-11-27T20:41:35.200027+0000","last_active":"2023-11-27T20:41:36.906986+0000","last_peered":"2023-11-27T20:41:36.906986+0000","last_clean":"2023-11-27T20:41:36.906986+0000","last_became_active":"2023-11-27T20:41:35.199693+0000","last_became_peered":"2023-11-27T20:41:35.199693+0000","last_unstale":"2023-11-27T20:41:36.906986+0000","last_undegraded":"2023-11-27T20:41:36.906986+0000","last_fullsized":"2023-11-27T20:41:36.906986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907975+0000","last_change":"2023-11-27T20:41:35.200037+0000","last_active":"2023-11-27T20:41:36.907975+0000","last_peered":"2023-11-27T20:41:36.907975+0000","last_clean":"2023-11-27T20:41:36.907975+0000","last_became_active":"2023-11-27T20:41:35.199783+0000","last_became_peered":"2023-11-27T20:41:35.199783+0000","last_unstale":"2023-11-27T20:41:36.907975+0000","last_undegraded":"2023-11-27T20:41:36.907975+0000","last_fullsized":"2023-11-27T20:41:36.907975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:04:13.910143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168723+0000","last_change":"2023-11-27T20:41:35.191018+0000","last_active":"2023-11-27T20:41:36.168723+0000","last_peered":"2023-11-27T20:41:36.168723+0000","last_clean":"2023-11-27T20:41:36.168723+0000","last_became_active":"2023-11-27T20:41:35.189851+0000","last_became_peered":"2023-11-27T20:41:35.189851+0000","last_unstale":"2023-11-27T20:41:36.168723+0000","last_undegraded":"2023-11-27T20:41:36.168723+0000","last_fullsized":"2023-11-27T20:41:36.168723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:03.587578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751906+0000","last_change":"2023-11-27T20:41:35.200143+0000","last_active":"2023-11-27T20:41:36.751906+0000","last_peered":"2023-11-27T20:41:36.751906+0000","last_clean":"2023-11-27T20:41:36.751906+0000","last_became_active":"2023-11-27T20:41:35.199787+0000","last_became_peered":"2023-11-27T20:41:35.199787+0000","last_unstale":"2023-11-27T20:41:36.751906+0000","last_undegraded":"2023-11-27T20:41:36.751906+0000","last_fullsized":"2023-11-27T20:41:36.751906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169985+0000","last_change":"2023-11-27T20:41:35.191668+0000","last_active":"2023-11-27T20:41:36.169985+0000","last_peered":"2023-11-27T20:41:36.169985+0000","last_clean":"2023-11-27T20:41:36.169985+0000","last_became_active":"2023-11-27T20:41:35.191402+0000","last_became_peered":"2023-11-27T20:41:35.191402+0000","last_unstale":"2023-11-27T20:41:36.169985+0000","last_undegraded":"2023-11-27T20:41:36.169985+0000","last_fullsized":"2023-11-27T20:41:36.169985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:37:56.420323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.391181+0000","last_change":"2023-11-27T20:41:34.379346+0000","last_active":"2023-11-27T20:41:35.391181+0000","last_peered":"2023-11-27T20:41:35.391181+0000","last_clean":"2023-11-27T20:41:35.391181+0000","last_became_active":"2023-11-27T20:41:34.379070+0000","last_became_peered":"2023-11-27T20:41:34.379070+0000","last_unstale":"2023-11-27T20:41:35.391181+0000","last_undegraded":"2023-11-27T20:41:35.391181+0000","last_fullsized":"2023-11-27T20:41:35.391181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:30.381280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907378+0000","last_change":"2023-11-27T20:41:35.208886+0000","last_active":"2023-11-27T20:41:36.907378+0000","last_peered":"2023-11-27T20:41:36.907378+0000","last_clean":"2023-11-27T20:41:36.907378+0000","last_became_active":"2023-11-27T20:41:35.208443+0000","last_became_peered":"2023-11-27T20:41:35.208443+0000","last_unstale":"2023-11-27T20:41:36.907378+0000","last_undegraded":"2023-11-27T20:41:36.907378+0000","last_fullsized":"2023-11-27T20:41:36.907378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.394357+0000","last_change":"2023-11-27T20:41:34.376598+0000","last_active":"2023-11-27T20:41:35.394357+0000","last_peered":"2023-11-27T20:41:35.394357+0000","last_clean":"2023-11-27T20:41:35.394357+0000","last_became_active":"2023-11-27T20:41:34.375938+0000","last_became_peered":"2023-11-27T20:41:34.375938+0000","last_unstale":"2023-11-27T20:41:35.394357+0000","last_undegraded":"2023-11-27T20:41:35.394357+0000","last_fullsized":"2023-11-27T20:41:35.394357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.189265+0000","last_change":"2023-11-27T20:41:34.365856+0000","last_active":"2023-11-27T20:41:35.189265+0000","last_peered":"2023-11-27T20:41:35.189265+0000","last_clean":"2023-11-27T20:41:35.189265+0000","last_became_active":"2023-11-27T20:41:34.365263+0000","last_became_peered":"2023-11-27T20:41:34.365263+0000","last_unstale":"2023-11-27T20:41:35.189265+0000","last_undegraded":"2023-11-27T20:41:35.189265+0000","last_fullsized":"2023-11-27T20:41:35.189265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:22.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827358+0000","last_change":"2023-11-27T20:41:35.194411+0000","last_active":"2023-11-27T20:41:36.827358+0000","last_peered":"2023-11-27T20:41:36.827358+0000","last_clean":"2023-11-27T20:41:36.827358+0000","last_became_active":"2023-11-27T20:41:35.193870+0000","last_became_peered":"2023-11-27T20:41:35.193870+0000","last_unstale":"2023-11-27T20:41:36.827358+0000","last_undegraded":"2023-11-27T20:41:36.827358+0000","last_fullsized":"2023-11-27T20:41:36.827358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.184215+0000","last_change":"2023-11-27T20:41:34.384607+0000","last_active":"2023-11-27T20:41:35.184215+0000","last_peered":"2023-11-27T20:41:35.184215+0000","last_clean":"2023-11-27T20:41:35.184215+0000","last_became_active":"2023-11-27T20:41:34.384325+0000","last_became_peered":"2023-11-27T20:41:34.384325+0000","last_unstale":"2023-11-27T20:41:35.184215+0000","last_undegraded":"2023-11-27T20:41:35.184215+0000","last_fullsized":"2023-11-27T20:41:35.184215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:56.618777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167329+0000","last_change":"2023-11-27T20:41:35.186364+0000","last_active":"2023-11-27T20:41:36.167329+0000","last_peered":"2023-11-27T20:41:36.167329+0000","last_clean":"2023-11-27T20:41:36.167329+0000","last_became_active":"2023-11-27T20:41:35.185990+0000","last_became_peered":"2023-11-27T20:41:35.185990+0000","last_unstale":"2023-11-27T20:41:36.167329+0000","last_undegraded":"2023-11-27T20:41:36.167329+0000","last_fullsized":"2023-11-27T20:41:36.167329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.182202+0000","last_change":"2023-11-27T20:41:34.386881+0000","last_active":"2023-11-27T20:41:35.182202+0000","last_peered":"2023-11-27T20:41:35.182202+0000","last_clean":"2023-11-27T20:41:35.182202+0000","last_became_active":"2023-11-27T20:41:34.385617+0000","last_became_peered":"2023-11-27T20:41:34.385617+0000","last_unstale":"2023-11-27T20:41:35.182202+0000","last_undegraded":"2023-11-27T20:41:35.182202+0000","last_fullsized":"2023-11-27T20:41:35.182202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:04:42.284326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907976+0000","last_change":"2023-11-27T20:41:35.213263+0000","last_active":"2023-11-27T20:41:36.907976+0000","last_peered":"2023-11-27T20:41:36.907976+0000","last_clean":"2023-11-27T20:41:36.907976+0000","last_became_active":"2023-11-27T20:41:35.212945+0000","last_became_peered":"2023-11-27T20:41:35.212945+0000","last_unstale":"2023-11-27T20:41:36.907976+0000","last_undegraded":"2023-11-27T20:41:36.907976+0000","last_fullsized":"2023-11-27T20:41:36.907976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:31:23.723316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.188149+0000","last_change":"2023-11-27T20:41:34.390261+0000","last_active":"2023-11-27T20:41:35.188149+0000","last_peered":"2023-11-27T20:41:35.188149+0000","last_clean":"2023-11-27T20:41:35.188149+0000","last_became_active":"2023-11-27T20:41:34.389520+0000","last_became_peered":"2023-11-27T20:41:34.389520+0000","last_unstale":"2023-11-27T20:41:35.188149+0000","last_undegraded":"2023-11-27T20:41:35.188149+0000","last_fullsized":"2023-11-27T20:41:35.188149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:10.528078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907207+0000","last_change":"2023-11-27T20:41:35.203369+0000","last_active":"2023-11-27T20:41:36.907207+0000","last_peered":"2023-11-27T20:41:36.907207+0000","last_clean":"2023-11-27T20:41:36.907207+0000","last_became_active":"2023-11-27T20:41:35.203042+0000","last_became_peered":"2023-11-27T20:41:35.203042+0000","last_unstale":"2023-11-27T20:41:36.907207+0000","last_undegraded":"2023-11-27T20:41:36.907207+0000","last_fullsized":"2023-11-27T20:41:36.907207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399508+0000","last_change":"2023-11-27T20:41:34.385832+0000","last_active":"2023-11-27T20:41:35.399508+0000","last_peered":"2023-11-27T20:41:35.399508+0000","last_clean":"2023-11-27T20:41:35.399508+0000","last_became_active":"2023-11-27T20:41:34.384636+0000","last_became_peered":"2023-11-27T20:41:34.384636+0000","last_unstale":"2023-11-27T20:41:35.399508+0000","last_undegraded":"2023-11-27T20:41:35.399508+0000","last_fullsized":"2023-11-27T20:41:35.399508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:03.773317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.170135+0000","last_change":"2023-11-27T20:41:35.188819+0000","last_active":"2023-11-27T20:41:36.170135+0000","last_peered":"2023-11-27T20:41:36.170135+0000","last_clean":"2023-11-27T20:41:36.170135+0000","last_became_active":"2023-11-27T20:41:35.188292+0000","last_became_peered":"2023-11-27T20:41:35.188292+0000","last_unstale":"2023-11-27T20:41:36.170135+0000","last_undegraded":"2023-11-27T20:41:36.170135+0000","last_fullsized":"2023-11-27T20:41:36.170135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:04.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399033+0000","last_change":"2023-11-27T20:41:34.363549+0000","last_active":"2023-11-27T20:41:35.399033+0000","last_peered":"2023-11-27T20:41:35.399033+0000","last_clean":"2023-11-27T20:41:35.399033+0000","last_became_active":"2023-11-27T20:41:34.361181+0000","last_became_peered":"2023-11-27T20:41:34.361181+0000","last_unstale":"2023-11-27T20:41:35.399033+0000","last_undegraded":"2023-11-27T20:41:35.399033+0000","last_fullsized":"2023-11-27T20:41:35.399033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:25:03.773317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567699+0000","last_change":"2023-11-27T20:41:35.211117+0000","last_active":"2023-11-27T20:41:36.567699+0000","last_peered":"2023-11-27T20:41:36.567699+0000","last_clean":"2023-11-27T20:41:36.567699+0000","last_became_active":"2023-11-27T20:41:35.206668+0000","last_became_peered":"2023-11-27T20:41:35.206668+0000","last_unstale":"2023-11-27T20:41:36.567699+0000","last_undegraded":"2023-11-27T20:41:36.567699+0000","last_fullsized":"2023-11-27T20:41:36.567699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399355+0000","last_change":"2023-11-27T20:41:34.375628+0000","last_active":"2023-11-27T20:41:35.399355+0000","last_peered":"2023-11-27T20:41:35.399355+0000","last_clean":"2023-11-27T20:41:35.399355+0000","last_became_active":"2023-11-27T20:41:34.375164+0000","last_became_peered":"2023-11-27T20:41:34.375164+0000","last_unstale":"2023-11-27T20:41:35.399355+0000","last_undegraded":"2023-11-27T20:41:35.399355+0000","last_fullsized":"2023-11-27T20:41:35.399355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907003+0000","last_change":"2023-11-27T20:41:35.206246+0000","last_active":"2023-11-27T20:41:36.907003+0000","last_peered":"2023-11-27T20:41:36.907003+0000","last_clean":"2023-11-27T20:41:36.907003+0000","last_became_active":"2023-11-27T20:41:35.205741+0000","last_became_peered":"2023-11-27T20:41:35.205741+0000","last_unstale":"2023-11-27T20:41:36.907003+0000","last_undegraded":"2023-11-27T20:41:36.907003+0000","last_fullsized":"2023-11-27T20:41:36.907003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.186433+0000","last_change":"2023-11-27T20:41:34.383993+0000","last_active":"2023-11-27T20:41:35.186433+0000","last_peered":"2023-11-27T20:41:35.186433+0000","last_clean":"2023-11-27T20:41:35.186433+0000","last_became_active":"2023-11-27T20:41:34.383739+0000","last_became_peered":"2023-11-27T20:41:34.383739+0000","last_unstale":"2023-11-27T20:41:35.186433+0000","last_undegraded":"2023-11-27T20:41:35.186433+0000","last_fullsized":"2023-11-27T20:41:35.186433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:17.468682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567699+0000","last_change":"2023-11-27T20:41:35.193841+0000","last_active":"2023-11-27T20:41:36.567699+0000","last_peered":"2023-11-27T20:41:36.567699+0000","last_clean":"2023-11-27T20:41:36.567699+0000","last_became_active":"2023-11-27T20:41:35.192848+0000","last_became_peered":"2023-11-27T20:41:35.192848+0000","last_unstale":"2023-11-27T20:41:36.567699+0000","last_undegraded":"2023-11-27T20:41:36.567699+0000","last_fullsized":"2023-11-27T20:41:36.567699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:09.396414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.173511+0000","last_change":"2023-11-27T20:41:34.376129+0000","last_active":"2023-11-27T20:41:35.173511+0000","last_peered":"2023-11-27T20:41:35.173511+0000","last_clean":"2023-11-27T20:41:35.173511+0000","last_became_active":"2023-11-27T20:41:34.375804+0000","last_became_peered":"2023-11-27T20:41:34.375804+0000","last_unstale":"2023-11-27T20:41:35.173511+0000","last_undegraded":"2023-11-27T20:41:35.173511+0000","last_fullsized":"2023-11-27T20:41:35.173511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:45:59.175653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751925+0000","last_change":"2023-11-27T20:41:35.196670+0000","last_active":"2023-11-27T20:41:36.751925+0000","last_peered":"2023-11-27T20:41:36.751925+0000","last_clean":"2023-11-27T20:41:36.751925+0000","last_became_active":"2023-11-27T20:41:35.196378+0000","last_became_peered":"2023-11-27T20:41:35.196378+0000","last_unstale":"2023-11-27T20:41:36.751925+0000","last_undegraded":"2023-11-27T20:41:36.751925+0000","last_fullsized":"2023-11-27T20:41:36.751925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:50.317575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399674+0000","last_change":"2023-11-27T20:41:34.372374+0000","last_active":"2023-11-27T20:41:35.399674+0000","last_peered":"2023-11-27T20:41:35.399674+0000","last_clean":"2023-11-27T20:41:35.399674+0000","last_became_active":"2023-11-27T20:41:34.371956+0000","last_became_peered":"2023-11-27T20:41:34.371956+0000","last_unstale":"2023-11-27T20:41:35.399674+0000","last_undegraded":"2023-11-27T20:41:35.399674+0000","last_fullsized":"2023-11-27T20:41:35.399674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:09:02.084275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.567520+0000","last_change":"2023-11-27T20:41:35.209749+0000","last_active":"2023-11-27T20:41:36.567520+0000","last_peered":"2023-11-27T20:41:36.567520+0000","last_clean":"2023-11-27T20:41:36.567520+0000","last_became_active":"2023-11-27T20:41:35.209421+0000","last_became_peered":"2023-11-27T20:41:35.209421+0000","last_unstale":"2023-11-27T20:41:36.567520+0000","last_undegraded":"2023-11-27T20:41:36.567520+0000","last_fullsized":"2023-11-27T20:41:36.567520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.397573+0000","last_change":"2023-11-27T20:41:34.381268+0000","last_active":"2023-11-27T20:41:35.397573+0000","last_peered":"2023-11-27T20:41:35.397573+0000","last_clean":"2023-11-27T20:41:35.397573+0000","last_became_active":"2023-11-27T20:41:34.379765+0000","last_became_peered":"2023-11-27T20:41:34.379765+0000","last_unstale":"2023-11-27T20:41:35.397573+0000","last_undegraded":"2023-11-27T20:41:35.397573+0000","last_fullsized":"2023-11-27T20:41:35.397573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:07.467417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568439+0000","last_change":"2023-11-27T20:41:35.210232+0000","last_active":"2023-11-27T20:41:36.568439+0000","last_peered":"2023-11-27T20:41:36.568439+0000","last_clean":"2023-11-27T20:41:36.568439+0000","last_became_active":"2023-11-27T20:41:35.209143+0000","last_became_peered":"2023-11-27T20:41:35.209143+0000","last_unstale":"2023-11-27T20:41:36.568439+0000","last_undegraded":"2023-11-27T20:41:36.568439+0000","last_fullsized":"2023-11-27T20:41:36.568439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:31:23.723316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395121+0000","last_change":"2023-11-27T20:41:34.380235+0000","last_active":"2023-11-27T20:41:35.395121+0000","last_peered":"2023-11-27T20:41:35.395121+0000","last_clean":"2023-11-27T20:41:35.395121+0000","last_became_active":"2023-11-27T20:41:34.379940+0000","last_became_peered":"2023-11-27T20:41:34.379940+0000","last_unstale":"2023-11-27T20:41:35.395121+0000","last_undegraded":"2023-11-27T20:41:35.395121+0000","last_fullsized":"2023-11-27T20:41:35.395121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568652+0000","last_change":"2023-11-27T20:41:35.214260+0000","last_active":"2023-11-27T20:41:36.568652+0000","last_peered":"2023-11-27T20:41:36.568652+0000","last_clean":"2023-11-27T20:41:36.568652+0000","last_became_active":"2023-11-27T20:41:35.213814+0000","last_became_peered":"2023-11-27T20:41:35.213814+0000","last_unstale":"2023-11-27T20:41:36.568652+0000","last_undegraded":"2023-11-27T20:41:36.568652+0000","last_fullsized":"2023-11-27T20:41:36.568652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:30:03.051157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.396870+0000","last_change":"2023-11-27T20:41:34.383025+0000","last_active":"2023-11-27T20:41:35.396870+0000","last_peered":"2023-11-27T20:41:35.396870+0000","last_clean":"2023-11-27T20:41:35.396870+0000","last_became_active":"2023-11-27T20:41:34.382672+0000","last_became_peered":"2023-11-27T20:41:34.382672+0000","last_unstale":"2023-11-27T20:41:35.396870+0000","last_undegraded":"2023-11-27T20:41:35.396870+0000","last_fullsized":"2023-11-27T20:41:35.396870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907802+0000","last_change":"2023-11-27T20:41:35.195935+0000","last_active":"2023-11-27T20:41:36.907802+0000","last_peered":"2023-11-27T20:41:36.907802+0000","last_clean":"2023-11-27T20:41:36.907802+0000","last_became_active":"2023-11-27T20:41:35.195208+0000","last_became_peered":"2023-11-27T20:41:35.195208+0000","last_unstale":"2023-11-27T20:41:36.907802+0000","last_undegraded":"2023-11-27T20:41:36.907802+0000","last_fullsized":"2023-11-27T20:41:36.907802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:03:54.961052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.166681+0000","last_change":"2023-11-27T20:41:34.386973+0000","last_active":"2023-11-27T20:41:35.166681+0000","last_peered":"2023-11-27T20:41:35.166681+0000","last_clean":"2023-11-27T20:41:35.166681+0000","last_became_active":"2023-11-27T20:41:34.386649+0000","last_became_peered":"2023-11-27T20:41:34.386649+0000","last_unstale":"2023-11-27T20:41:35.166681+0000","last_undegraded":"2023-11-27T20:41:35.166681+0000","last_fullsized":"2023-11-27T20:41:35.166681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:07.467417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.568068+0000","last_change":"2023-11-27T20:41:35.211346+0000","last_active":"2023-11-27T20:41:36.568068+0000","last_peered":"2023-11-27T20:41:36.568068+0000","last_clean":"2023-11-27T20:41:36.568068+0000","last_became_active":"2023-11-27T20:41:35.210844+0000","last_became_peered":"2023-11-27T20:41:35.210844+0000","last_unstale":"2023-11-27T20:41:36.568068+0000","last_undegraded":"2023-11-27T20:41:36.568068+0000","last_fullsized":"2023-11-27T20:41:36.568068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:31:30.836331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177748+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:41:35.177748+0000","last_peered":"2023-11-27T20:41:35.177748+0000","last_clean":"2023-11-27T20:41:35.177748+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:41:35.177748+0000","last_undegraded":"2023-11-27T20:41:35.177748+0000","last_fullsized":"2023-11-27T20:41:35.177748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.185862+0000","last_change":"2023-11-27T20:41:34.388453+0000","last_active":"2023-11-27T20:41:35.185862+0000","last_peered":"2023-11-27T20:41:35.185862+0000","last_clean":"2023-11-27T20:41:35.185862+0000","last_became_active":"2023-11-27T20:41:34.388237+0000","last_became_peered":"2023-11-27T20:41:34.388237+0000","last_unstale":"2023-11-27T20:41:35.185862+0000","last_undegraded":"2023-11-27T20:41:35.185862+0000","last_fullsized":"2023-11-27T20:41:35.185862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:27:49.304546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827823+0000","last_change":"2023-11-27T20:41:35.192084+0000","last_active":"2023-11-27T20:41:36.827823+0000","last_peered":"2023-11-27T20:41:36.827823+0000","last_clean":"2023-11-27T20:41:36.827823+0000","last_became_active":"2023-11-27T20:41:35.190701+0000","last_became_peered":"2023-11-27T20:41:35.190701+0000","last_unstale":"2023-11-27T20:41:36.827823+0000","last_undegraded":"2023-11-27T20:41:36.827823+0000","last_fullsized":"2023-11-27T20:41:36.827823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.915287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177479+0000","last_change":"2023-11-27T20:41:34.388350+0000","last_active":"2023-11-27T20:41:35.177479+0000","last_peered":"2023-11-27T20:41:35.177479+0000","last_clean":"2023-11-27T20:41:35.177479+0000","last_became_active":"2023-11-27T20:41:34.388078+0000","last_became_peered":"2023-11-27T20:41:34.388078+0000","last_unstale":"2023-11-27T20:41:35.177479+0000","last_undegraded":"2023-11-27T20:41:35.177479+0000","last_fullsized":"2023-11-27T20:41:35.177479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906804+0000","last_change":"2023-11-27T20:41:35.208870+0000","last_active":"2023-11-27T20:41:36.906804+0000","last_peered":"2023-11-27T20:41:36.906804+0000","last_clean":"2023-11-27T20:41:36.906804+0000","last_became_active":"2023-11-27T20:41:35.208454+0000","last_became_peered":"2023-11-27T20:41:35.208454+0000","last_unstale":"2023-11-27T20:41:36.906804+0000","last_undegraded":"2023-11-27T20:41:36.906804+0000","last_fullsized":"2023-11-27T20:41:36.906804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:31.394309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.166972+0000","last_change":"2023-11-27T20:41:34.379312+0000","last_active":"2023-11-27T20:41:35.166972+0000","last_peered":"2023-11-27T20:41:35.166972+0000","last_clean":"2023-11-27T20:41:35.166972+0000","last_became_active":"2023-11-27T20:41:34.379064+0000","last_became_peered":"2023-11-27T20:41:34.379064+0000","last_unstale":"2023-11-27T20:41:35.166972+0000","last_undegraded":"2023-11-27T20:41:35.166972+0000","last_fullsized":"2023-11-27T20:41:35.166972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:37:55.407294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.167324+0000","last_change":"2023-11-27T20:41:35.180034+0000","last_active":"2023-11-27T20:41:36.167324+0000","last_peered":"2023-11-27T20:41:36.167324+0000","last_clean":"2023-11-27T20:41:36.167324+0000","last_became_active":"2023-11-27T20:41:35.178994+0000","last_became_peered":"2023-11-27T20:41:35.178994+0000","last_unstale":"2023-11-27T20:41:36.167324+0000","last_undegraded":"2023-11-27T20:41:36.167324+0000","last_fullsized":"2023-11-27T20:41:36.167324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.192457+0000","last_change":"2023-11-27T20:41:34.383948+0000","last_active":"2023-11-27T20:41:35.192457+0000","last_peered":"2023-11-27T20:41:35.192457+0000","last_clean":"2023-11-27T20:41:35.192457+0000","last_became_active":"2023-11-27T20:41:34.383355+0000","last_became_peered":"2023-11-27T20:41:34.383355+0000","last_unstale":"2023-11-27T20:41:35.192457+0000","last_undegraded":"2023-11-27T20:41:35.192457+0000","last_fullsized":"2023-11-27T20:41:35.192457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:38.370465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169931+0000","last_change":"2023-11-27T20:41:35.204870+0000","last_active":"2023-11-27T20:41:36.169931+0000","last_peered":"2023-11-27T20:41:36.169931+0000","last_clean":"2023-11-27T20:41:36.169931+0000","last_became_active":"2023-11-27T20:41:35.204425+0000","last_became_peered":"2023-11-27T20:41:35.204425+0000","last_unstale":"2023-11-27T20:41:36.169931+0000","last_undegraded":"2023-11-27T20:41:36.169931+0000","last_fullsized":"2023-11-27T20:41:36.169931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:21.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.169452+0000","last_change":"2023-11-27T20:41:34.376734+0000","last_active":"2023-11-27T20:41:35.169452+0000","last_peered":"2023-11-27T20:41:35.169452+0000","last_clean":"2023-11-27T20:41:35.169452+0000","last_became_active":"2023-11-27T20:41:34.376427+0000","last_became_peered":"2023-11-27T20:41:34.376427+0000","last_unstale":"2023-11-27T20:41:35.169452+0000","last_undegraded":"2023-11-27T20:41:35.169452+0000","last_fullsized":"2023-11-27T20:41:35.169452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:02.574549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907828+0000","last_change":"2023-11-27T20:41:35.198109+0000","last_active":"2023-11-27T20:41:36.907828+0000","last_peered":"2023-11-27T20:41:36.907828+0000","last_clean":"2023-11-27T20:41:36.907828+0000","last_became_active":"2023-11-27T20:41:35.197772+0000","last_became_peered":"2023-11-27T20:41:35.197772+0000","last_unstale":"2023-11-27T20:41:36.907828+0000","last_undegraded":"2023-11-27T20:41:36.907828+0000","last_fullsized":"2023-11-27T20:41:36.907828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:25:37.197535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.185525+0000","last_change":"2023-11-27T20:41:34.387255+0000","last_active":"2023-11-27T20:41:35.185525+0000","last_peered":"2023-11-27T20:41:35.185525+0000","last_clean":"2023-11-27T20:41:35.185525+0000","last_became_active":"2023-11-27T20:41:34.386911+0000","last_became_peered":"2023-11-27T20:41:34.386911+0000","last_unstale":"2023-11-27T20:41:35.185525+0000","last_undegraded":"2023-11-27T20:41:35.185525+0000","last_fullsized":"2023-11-27T20:41:35.185525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:17.468682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168166+0000","last_change":"2023-11-27T20:41:35.179788+0000","last_active":"2023-11-27T20:41:36.168166+0000","last_peered":"2023-11-27T20:41:36.168166+0000","last_clean":"2023-11-27T20:41:36.168166+0000","last_became_active":"2023-11-27T20:41:35.179071+0000","last_became_peered":"2023-11-27T20:41:35.179071+0000","last_unstale":"2023-11-27T20:41:36.168166+0000","last_undegraded":"2023-11-27T20:41:36.168166+0000","last_fullsized":"2023-11-27T20:41:36.168166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:11.541107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.168894+0000","last_change":"2023-11-27T20:41:34.383651+0000","last_active":"2023-11-27T20:41:36.168894+0000","last_peered":"2023-11-27T20:41:36.168894+0000","last_clean":"2023-11-27T20:41:36.168894+0000","last_became_active":"2023-11-27T20:41:34.383295+0000","last_became_peered":"2023-11-27T20:41:34.383295+0000","last_unstale":"2023-11-27T20:41:36.168894+0000","last_undegraded":"2023-11-27T20:41:36.168894+0000","last_fullsized":"2023-11-27T20:41:36.168894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827815+0000","last_change":"2023-11-27T20:41:35.211366+0000","last_active":"2023-11-27T20:41:36.827815+0000","last_peered":"2023-11-27T20:41:36.827815+0000","last_clean":"2023-11-27T20:41:36.827815+0000","last_became_active":"2023-11-27T20:41:35.211001+0000","last_became_peered":"2023-11-27T20:41:35.211001+0000","last_unstale":"2023-11-27T20:41:36.827815+0000","last_undegraded":"2023-11-27T20:41:36.827815+0000","last_fullsized":"2023-11-27T20:41:36.827815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:03:05.609276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.394474+0000","last_change":"2023-11-27T20:41:34.385226+0000","last_active":"2023-11-27T20:41:35.394474+0000","last_peered":"2023-11-27T20:41:35.394474+0000","last_clean":"2023-11-27T20:41:35.394474+0000","last_became_active":"2023-11-27T20:41:34.384361+0000","last_became_peered":"2023-11-27T20:41:34.384361+0000","last_unstale":"2023-11-27T20:41:35.394474+0000","last_undegraded":"2023-11-27T20:41:35.394474+0000","last_fullsized":"2023-11-27T20:41:35.394474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:22.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.906972+0000","last_change":"2023-11-27T20:41:35.201432+0000","last_active":"2023-11-27T20:41:36.906972+0000","last_peered":"2023-11-27T20:41:36.906972+0000","last_clean":"2023-11-27T20:41:36.906972+0000","last_became_active":"2023-11-27T20:41:35.201065+0000","last_became_peered":"2023-11-27T20:41:35.201065+0000","last_unstale":"2023-11-27T20:41:36.906972+0000","last_undegraded":"2023-11-27T20:41:36.906972+0000","last_fullsized":"2023-11-27T20:41:36.906972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:44:57.631806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.177113+0000","last_change":"2023-11-27T20:41:34.389439+0000","last_active":"2023-11-27T20:41:35.177113+0000","last_peered":"2023-11-27T20:41:35.177113+0000","last_clean":"2023-11-27T20:41:35.177113+0000","last_became_active":"2023-11-27T20:41:34.389145+0000","last_became_peered":"2023-11-27T20:41:34.389145+0000","last_unstale":"2023-11-27T20:41:35.177113+0000","last_undegraded":"2023-11-27T20:41:35.177113+0000","last_fullsized":"2023-11-27T20:41:35.177113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.169999+0000","last_change":"2023-11-27T20:41:35.189837+0000","last_active":"2023-11-27T20:41:36.169999+0000","last_peered":"2023-11-27T20:41:36.169999+0000","last_clean":"2023-11-27T20:41:36.169999+0000","last_became_active":"2023-11-27T20:41:35.189208+0000","last_became_peered":"2023-11-27T20:41:35.189208+0000","last_unstale":"2023-11-27T20:41:36.169999+0000","last_undegraded":"2023-11-27T20:41:36.169999+0000","last_fullsized":"2023-11-27T20:41:36.169999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:42:03.587578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.167206+0000","last_change":"2023-11-27T20:41:34.387256+0000","last_active":"2023-11-27T20:41:35.167206+0000","last_peered":"2023-11-27T20:41:35.167206+0000","last_clean":"2023-11-27T20:41:35.167206+0000","last_became_active":"2023-11-27T20:41:34.386923+0000","last_became_peered":"2023-11-27T20:41:34.386923+0000","last_unstale":"2023-11-27T20:41:35.167206+0000","last_undegraded":"2023-11-27T20:41:35.167206+0000","last_fullsized":"2023-11-27T20:41:35.167206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:20.494221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827602+0000","last_change":"2023-11-27T20:41:35.186083+0000","last_active":"2023-11-27T20:41:36.827602+0000","last_peered":"2023-11-27T20:41:36.827602+0000","last_clean":"2023-11-27T20:41:36.827602+0000","last_became_active":"2023-11-27T20:41:35.184168+0000","last_became_peered":"2023-11-27T20:41:35.184168+0000","last_unstale":"2023-11-27T20:41:36.827602+0000","last_undegraded":"2023-11-27T20:41:36.827602+0000","last_fullsized":"2023-11-27T20:41:36.827602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:23:45.532563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.168762+0000","last_change":"2023-11-27T20:41:34.378248+0000","last_active":"2023-11-27T20:41:35.168762+0000","last_peered":"2023-11-27T20:41:35.168762+0000","last_clean":"2023-11-27T20:41:35.168762+0000","last_became_active":"2023-11-27T20:41:34.376972+0000","last_became_peered":"2023-11-27T20:41:34.376972+0000","last_unstale":"2023-11-27T20:41:35.168762+0000","last_undegraded":"2023-11-27T20:41:35.168762+0000","last_fullsized":"2023-11-27T20:41:35.168762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:25:49.797878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827902+0000","last_change":"2023-11-27T20:41:35.199694+0000","last_active":"2023-11-27T20:41:36.827902+0000","last_peered":"2023-11-27T20:41:36.827902+0000","last_clean":"2023-11-27T20:41:36.827902+0000","last_became_active":"2023-11-27T20:41:35.198540+0000","last_became_peered":"2023-11-27T20:41:35.198540+0000","last_unstale":"2023-11-27T20:41:36.827902+0000","last_undegraded":"2023-11-27T20:41:36.827902+0000","last_fullsized":"2023-11-27T20:41:36.827902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:39:23.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.391944+0000","last_change":"2023-11-27T20:41:34.387556+0000","last_active":"2023-11-27T20:41:35.391944+0000","last_peered":"2023-11-27T20:41:35.391944+0000","last_clean":"2023-11-27T20:41:35.391944+0000","last_became_active":"2023-11-27T20:41:34.387316+0000","last_became_peered":"2023-11-27T20:41:34.387316+0000","last_unstale":"2023-11-27T20:41:35.391944+0000","last_undegraded":"2023-11-27T20:41:35.391944+0000","last_fullsized":"2023-11-27T20:41:35.391944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.751980+0000","last_change":"2023-11-27T20:41:35.195068+0000","last_active":"2023-11-27T20:41:36.751980+0000","last_peered":"2023-11-27T20:41:36.751980+0000","last_clean":"2023-11-27T20:41:36.751980+0000","last_became_active":"2023-11-27T20:41:35.194784+0000","last_became_peered":"2023-11-27T20:41:35.194784+0000","last_unstale":"2023-11-27T20:41:36.751980+0000","last_undegraded":"2023-11-27T20:41:36.751980+0000","last_fullsized":"2023-11-27T20:41:36.751980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:18.481711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907555+0000","last_change":"2023-11-27T20:41:35.207667+0000","last_active":"2023-11-27T20:41:36.907555+0000","last_peered":"2023-11-27T20:41:36.907555+0000","last_clean":"2023-11-27T20:41:36.907555+0000","last_became_active":"2023-11-27T20:41:35.207323+0000","last_became_peered":"2023-11-27T20:41:35.207323+0000","last_unstale":"2023-11-27T20:41:36.907555+0000","last_undegraded":"2023-11-27T20:41:36.907555+0000","last_fullsized":"2023-11-27T20:41:36.907555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:09.396414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.396809+0000","last_change":"2023-11-27T20:41:34.386983+0000","last_active":"2023-11-27T20:41:35.396809+0000","last_peered":"2023-11-27T20:41:35.396809+0000","last_clean":"2023-11-27T20:41:35.396809+0000","last_became_active":"2023-11-27T20:41:34.386656+0000","last_became_peered":"2023-11-27T20:41:34.386656+0000","last_unstale":"2023-11-27T20:41:35.396809+0000","last_undegraded":"2023-11-27T20:41:35.396809+0000","last_fullsized":"2023-11-27T20:41:35.396809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:50.639159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907496+0000","last_change":"2023-11-27T20:41:35.191267+0000","last_active":"2023-11-27T20:41:36.907496+0000","last_peered":"2023-11-27T20:41:36.907496+0000","last_clean":"2023-11-27T20:41:36.907496+0000","last_became_active":"2023-11-27T20:41:35.190866+0000","last_became_peered":"2023-11-27T20:41:35.190866+0000","last_unstale":"2023-11-27T20:41:36.907496+0000","last_undegraded":"2023-11-27T20:41:36.907496+0000","last_fullsized":"2023-11-27T20:41:36.907496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:57.356109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395054+0000","last_change":"2023-11-27T20:41:34.390257+0000","last_active":"2023-11-27T20:41:35.395054+0000","last_peered":"2023-11-27T20:41:35.395054+0000","last_clean":"2023-11-27T20:41:35.395054+0000","last_became_active":"2023-11-27T20:41:34.389874+0000","last_became_peered":"2023-11-27T20:41:34.389874+0000","last_unstale":"2023-11-27T20:41:35.395054+0000","last_undegraded":"2023-11-27T20:41:35.395054+0000","last_fullsized":"2023-11-27T20:41:35.395054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:50:30.381280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.907171+0000","last_change":"2023-11-27T20:41:35.202070+0000","last_active":"2023-11-27T20:41:36.907171+0000","last_peered":"2023-11-27T20:41:36.907171+0000","last_clean":"2023-11-27T20:41:36.907171+0000","last_became_active":"2023-11-27T20:41:35.201756+0000","last_became_peered":"2023-11-27T20:41:35.201756+0000","last_unstale":"2023-11-27T20:41:36.907171+0000","last_undegraded":"2023-11-27T20:41:36.907171+0000","last_fullsized":"2023-11-27T20:41:36.907171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:39.383494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.395132+0000","last_change":"2023-11-27T20:41:34.378008+0000","last_active":"2023-11-27T20:41:35.395132+0000","last_peered":"2023-11-27T20:41:35.395132+0000","last_clean":"2023-11-27T20:41:35.395132+0000","last_became_active":"2023-11-27T20:41:34.377741+0000","last_became_peered":"2023-11-27T20:41:34.377741+0000","last_unstale":"2023-11-27T20:41:35.395132+0000","last_undegraded":"2023-11-27T20:41:35.395132+0000","last_fullsized":"2023-11-27T20:41:35.395132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:04:42.284326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T20:41:36.827818+0000","last_change":"2023-11-27T20:41:35.205383+0000","last_active":"2023-11-27T20:41:36.827818+0000","last_peered":"2023-11-27T20:41:36.827818+0000","last_clean":"2023-11-27T20:41:36.827818+0000","last_became_active":"2023-11-27T20:41:35.203522+0000","last_became_peered":"2023-11-27T20:41:35.203522+0000","last_unstale":"2023-11-27T20:41:36.827818+0000","last_undegraded":"2023-11-27T20:41:36.827818+0000","last_fullsized":"2023-11-27T20:41:36.827818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:34.335040+0000","last_clean_scrub_stamp":"2023-11-27T20:41:34.335040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:15:09.490574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T20:41:35.399023+0000","last_change":"2023-11-27T20:41:34.384751+0000","last_active":"2023-11-27T20:41:35.399023+0000","last_peered":"2023-11-27T20:41:35.399023+0000","last_clean":"2023-11-27T20:41:35.399023+0000","last_became_active":"2023-11-27T20:41:34.384460+0000","last_became_peered":"2023-11-27T20:41:34.384460+0000","last_unstale":"2023-11-27T20:41:35.399023+0000","last_undegraded":"2023-11-27T20:41:35.399023+0000","last_fullsized":"2023-11-27T20:41:35.399023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:33.322011+0000","last_clean_scrub_stamp":"2023-11-27T20:41:33.322011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:31:53.844539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.573}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.764}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:41:45.785 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-27T20:41:45.785 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-27T20:41:45.786 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-27T20:41:45.786 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-27T20:41:46.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.025+0000 7f8feb84f640 1 Processor -- start 2023-11-27T20:41:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.025+0000 7f8feb84f640 1 -- start start 2023-11-27T20:41:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.027+0000 7f8feb84f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8fe4152f20 0x7f8fe40c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.027+0000 7f8feb84f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe40c64a0 con 0x7f8fe406d0a0 2023-11-27T20:41:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.027+0000 7f8feb84f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe40c5c00 con 0x7f8fe414fd30 2023-11-27T20:41:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.027+0000 7f8feb84f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe40c5ee0 con 0x7f8fe4152f20 2023-11-27T20:41:46.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.027+0000 7f8fe8dea640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8fe406d0a0 0x7f8fe40c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:33988/0 (socket says 172.21.15.91:33988) 2023-11-27T20:41:46.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.027+0000 7f8fe8dea640 1 -- 172.21.15.91:0/2834478328 learned_addr learned my addr 172.21.15.91:0/2834478328 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:46.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.027+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277399450 0 0) 0x7f8fe40c64a0 con 0x7f8fe406d0a0 2023-11-27T20:41:46.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.027+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd0003520 con 0x7f8fe406d0a0 2023-11-27T20:41:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.027+0000 7f8fe9dec640 1 --2- 172.21.15.91:0/2834478328 >> v2:172.21.15.183:3300/0 conn(0x7f8fe4152f20 0x7f8fe40c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4030682195 0 0) 0x7f8fd0003520 con 0x7f8fe406d0a0 2023-11-27T20:41:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 >> v2:172.21.15.183:3300/0 conn(0x7f8fe4152f20 msgr2=0x7f8fe40c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 --2- 172.21.15.91:0/2834478328 >> v2:172.21.15.183:3300/0 conn(0x7f8fe4152f20 0x7f8fe40c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 >> v1:172.21.15.183:6789/0 conn(0x7f8fe414fd30 legacy=0x7f8fe40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe40c61c0 con 0x7f8fe406d0a0 2023-11-27T20:41:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f8fd4001670 con 0x7f8fe406d0a0 2023-11-27T20:41:46.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 >> v1:172.21.15.91:6789/0 conn(0x7f8fe406d0a0 legacy=0x7f8fe40c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd0003970 0x7f8fd0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd00047c0 0x7f8fd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd0005180 0x7f8fd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40c5ee0 con 0x7f8fd0003970 2023-11-27T20:41:46.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd000c020 con 0x7f8fd0005180 2023-11-27T20:41:46.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd000c1e0 con 0x7f8fd00047c0 2023-11-27T20:41:46.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fe95eb640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd0003970 0x7f8fd0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fe8dea640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd00047c0 0x7f8fd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.028+0000 7f8fe9dec640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd0005180 0x7f8fd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.029+0000 7f8fe95eb640 1 -- 172.21.15.91:0/2834478328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd00047c0 msgr2=0x7f8fd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.029+0000 7f8fe95eb640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd00047c0 0x7f8fd0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.029+0000 7f8fe95eb640 1 -- 172.21.15.91:0/2834478328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd0005180 msgr2=0x7f8fd000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.029+0000 7f8fe95eb640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd0005180 0x7f8fd000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.029+0000 7f8fe95eb640 1 -- 172.21.15.91:0/2834478328 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd0003520 con 0x7f8fd0003970 2023-11-27T20:41:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.029+0000 7f8fe9dec640 1 -- 172.21.15.91:0/2834478328 reap_dead start 2023-11-27T20:41:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.030+0000 7f8fe95eb640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd0003970 0x7f8fd0003d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0001750 tx=0x7f8fd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2e5d42b521b2e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.030+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00052d0 con 0x7f8fd0003970 2023-11-27T20:41:46.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.030+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe002e050 con 0x7f8fd0003970 2023-11-27T20:41:46.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.030+0000 7f8fdbfff640 1 -- 172.21.15.91:0/2834478328 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0003830 con 0x7f8fd0003970 2023-11-27T20:41:46.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.031+0000 7f8feb84f640 1 -- 172.21.15.91:0/2834478328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd0003970 msgr2=0x7f8fd0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.031+0000 7f8feb84f640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd0003970 0x7f8fd0003d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0001750 tx=0x7f8fd00057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.031+0000 7f8feb84f640 1 -- 172.21.15.91:0/2834478328 shutdown_connections 2023-11-27T20:41:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.031+0000 7f8feb84f640 1 --2- 172.21.15.91:0/2834478328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd0003970 0x7f8fd0003d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.031+0000 7f8feb84f640 1 -- 172.21.15.91:0/2834478328 >> 172.21.15.91:0/2834478328 conn(0x7f8fe406a500 msgr2=0x7f8fe406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.031+0000 7f8feb84f640 1 -- 172.21.15.91:0/2834478328 shutdown_connections 2023-11-27T20:41:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.031+0000 7f8feb84f640 1 -- 172.21.15.91:0/2834478328 wait complete. 2023-11-27T20:41:46.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.033+0000 7f8feb84f640 1 Processor -- start 2023-11-27T20:41:46.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.033+0000 7f8feb84f640 1 -- start start 2023-11-27T20:41:46.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.033+0000 7f8feb84f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd0003970 0x7f8fe41518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.033+0000 7f8feb84f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fe4151e00 0x7f8fe414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.033+0000 7f8feb84f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fe414d240 0x7f8fe40a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.033+0000 7f8feb84f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe4153860 con 0x7f8fe4151e00 2023-11-27T20:41:46.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.033+0000 7f8feb84f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe41546c0 con 0x7f8fe414d240 2023-11-27T20:41:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.033+0000 7f8feb84f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe41e17f0 con 0x7f8fd0003970 2023-11-27T20:41:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.034+0000 7f8fe8dea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fe4151e00 0x7f8fe414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.034+0000 7f8fe8dea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fe4151e00 0x7f8fe414cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49544/0 (socket says 172.21.15.91:49544) 2023-11-27T20:41:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.034+0000 7f8fe8dea640 1 -- 172.21.15.91:0/3757338628 learned_addr learned my addr 172.21.15.91:0/3757338628 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.034+0000 7f8fe8dea640 1 -- 172.21.15.91:0/3757338628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd0003970 msgr2=0x7f8fe41518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.034+0000 7f8fe8dea640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd0003970 0x7f8fe41518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.034+0000 7f8fe8dea640 1 -- 172.21.15.91:0/3757338628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fe414d240 msgr2=0x7f8fe40a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.034+0000 7f8fe8dea640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fe414d240 0x7f8fe40a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.034+0000 7f8fe8dea640 1 -- 172.21.15.91:0/3757338628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe414d6c0 con 0x7f8fe4151e00 2023-11-27T20:41:46.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.034+0000 7f8fe8dea640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fe4151e00 0x7f8fe414cd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400e700 tx=0x7f8fd400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:46.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.034+0000 7f8fd9ffb640 1 -- 172.21.15.91:0/3757338628 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400c640 con 0x7f8fe4151e00 2023-11-27T20:41:46.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.035+0000 7f8fd9ffb640 1 -- 172.21.15.91:0/3757338628 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd400c7a0 con 0x7f8fe4151e00 2023-11-27T20:41:46.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.035+0000 7f8fd9ffb640 1 -- 172.21.15.91:0/3757338628 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400cb50 con 0x7f8fe4151e00 2023-11-27T20:41:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.035+0000 7f8feb84f640 1 -- 172.21.15.91:0/3757338628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe4153ab0 con 0x7f8fe4151e00 2023-11-27T20:41:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.035+0000 7f8feb84f640 1 -- 172.21.15.91:0/3757338628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe4154070 con 0x7f8fe4151e00 2023-11-27T20:41:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.036+0000 7f8feb84f640 1 -- 172.21.15.91:0/3757338628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe40a4d00 con 0x7f8fe4151e00 2023-11-27T20:41:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.037+0000 7f8fd9ffb640 1 -- 172.21.15.91:0/3757338628 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8fd400ccb0 con 0x7f8fe4151e00 2023-11-27T20:41:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.037+0000 7f8fd9ffb640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fc806b1c0 0x7f8fc806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.037+0000 7f8fd9ffb640 1 -- 172.21.15.91:0/3757338628 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fd4089800 con 0x7f8fe4151e00 2023-11-27T20:41:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.038+0000 7f8fe95eb640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fc806b1c0 0x7f8fc806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.038+0000 7f8fe95eb640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fc806b1c0 0x7f8fc806d680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0033000 tx=0x7f8fe002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:46.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.042+0000 7f8fd9ffb640 1 -- 172.21.15.91:0/3757338628 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8fe40a4d00 con 0x7f8fe4151e00 2023-11-27T20:41:46.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.250+0000 7f8feb84f640 1 -- 172.21.15.91:0/3757338628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8fe40a4d00 con 0x7f8fe4151e00 2023-11-27T20:41:46.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.251+0000 7f8fd9ffb640 1 -- 172.21.15.91:0/3757338628 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8fe40a4d00 con 0x7f8fe4151e00 2023-11-27T20:41:46.252 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:46.252 INFO:teuthology.orchestra.run.smithi091.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-27T20:41:46.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.253+0000 7f8feb84f640 1 -- 172.21.15.91:0/3757338628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fc806b1c0 msgr2=0x7f8fc806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.253+0000 7f8feb84f640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fc806b1c0 0x7f8fc806d680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0033000 tx=0x7f8fe002f000 comp rx=0 tx=0).stop 2023-11-27T20:41:46.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.253+0000 7f8feb84f640 1 -- 172.21.15.91:0/3757338628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fe4151e00 msgr2=0x7f8fe414cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.253+0000 7f8feb84f640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fe4151e00 0x7f8fe414cd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400e700 tx=0x7f8fd400ebc0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.254+0000 7f8feb84f640 1 -- 172.21.15.91:0/3757338628 shutdown_connections 2023-11-27T20:41:46.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.254+0000 7f8feb84f640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fc806b1c0 0x7f8fc806d680 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.254+0000 7f8feb84f640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fe414d240 0x7f8fe40a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.254+0000 7f8feb84f640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fe4151e00 0x7f8fe414cd00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.254+0000 7f8feb84f640 1 --2- 172.21.15.91:0/3757338628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd0003970 0x7f8fe41518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.254+0000 7f8feb84f640 1 -- 172.21.15.91:0/3757338628 >> 172.21.15.91:0/3757338628 conn(0x7f8fe406a500 msgr2=0x7f8fe414dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:46.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.254+0000 7f8feb84f640 1 -- 172.21.15.91:0/3757338628 shutdown_connections 2023-11-27T20:41:46.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.254+0000 7f8feb84f640 1 -- 172.21.15.91:0/3757338628 wait complete. 2023-11-27T20:41:46.274 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-27T20:41:46.274 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:46.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.487+0000 7ff60ef0f640 1 Processor -- start 2023-11-27T20:41:46.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.487+0000 7ff60ef0f640 1 -- start start 2023-11-27T20:41:46.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.488+0000 7ff60ef0f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff6080c45d0 0x7ff608155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.488+0000 7ff60ef0f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff6080c3340 0x7ff608156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.488+0000 7ff60ef0f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6080bfdc0 con 0x7ff6080c5ec0 2023-11-27T20:41:46.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.488+0000 7ff60ef0f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60806e390 con 0x7ff6080c3340 2023-11-27T20:41:46.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.489+0000 7ff60ef0f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60806ddd0 con 0x7ff6080c45d0 2023-11-27T20:41:46.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.489+0000 7ff60d4ac640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff6080c3340 0x7ff608156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.489+0000 7ff60d4ac640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff6080c3340 0x7ff608156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49552/0 (socket says 172.21.15.91:49552) 2023-11-27T20:41:46.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.489+0000 7ff60d4ac640 1 -- 172.21.15.91:0/1211644467 learned_addr learned my addr 172.21.15.91:0/1211644467 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:46.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.489+0000 7ff60ccab640 1 --1- 172.21.15.91:0/1211644467 >> v1:172.21.15.91:6789/0 conn(0x7ff6080c5ec0 0x7ff6080c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34004/0 (socket says 172.21.15.91:34004) 2023-11-27T20:41:46.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.489+0000 7ff5fffff640 1 --2- 172.21.15.91:0/1211644467 >> v2:172.21.15.183:3300/0 conn(0x7ff6080c45d0 0x7ff608155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.489+0000 7ff60d4ac640 1 -- 172.21.15.91:0/1211644467 >> v2:172.21.15.183:3300/0 conn(0x7ff6080c45d0 msgr2=0x7ff608155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:46.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.489+0000 7ff60d4ac640 1 --2- 172.21.15.91:0/1211644467 >> v2:172.21.15.183:3300/0 conn(0x7ff6080c45d0 0x7ff608155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.489+0000 7ff60d4ac640 1 -- 172.21.15.91:0/1211644467 >> v1:172.21.15.91:6789/0 conn(0x7ff6080c5ec0 legacy=0x7ff6080c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.490+0000 7ff60d4ac640 1 -- 172.21.15.91:0/1211644467 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60806e0b0 con 0x7ff6080c3340 2023-11-27T20:41:46.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.489+0000 7ff5ff7fe640 1 -- 172.21.15.91:0/1211644467 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442610935 0 0) 0x7ff6080bfdc0 con 0x7ff6080c5ec0 2023-11-27T20:41:46.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.491+0000 7ff60d4ac640 1 --2- 172.21.15.91:0/1211644467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c3340 0x7ff608156370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff600009e50 tx=0x7ff60002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581e03935482e41f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:46.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.491+0000 7ff5ff7fe640 1 -- 172.21.15.91:0/1211644467 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60002c9f0 con 0x7ff6080c3340 2023-11-27T20:41:46.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.491+0000 7ff5ff7fe640 1 -- 172.21.15.91:0/1211644467 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60002cb50 con 0x7ff6080c3340 2023-11-27T20:41:46.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.491+0000 7ff5ff7fe640 1 -- 172.21.15.91:0/1211644467 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6000343f0 con 0x7ff6080c3340 2023-11-27T20:41:46.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.492+0000 7ff60ef0f640 1 -- 172.21.15.91:0/1211644467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c3340 msgr2=0x7ff608156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.492+0000 7ff60ef0f640 1 --2- 172.21.15.91:0/1211644467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c3340 0x7ff608156370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff600009e50 tx=0x7ff60002be50 comp rx=0 tx=0).stop 2023-11-27T20:41:46.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.492+0000 7ff60ef0f640 1 -- 172.21.15.91:0/1211644467 shutdown_connections 2023-11-27T20:41:46.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.492+0000 7ff60ef0f640 1 --2- 172.21.15.91:0/1211644467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c3340 0x7ff608156370 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.492+0000 7ff60ef0f640 1 --2- 172.21.15.91:0/1211644467 >> v2:172.21.15.183:3300/0 conn(0x7ff6080c45d0 0x7ff608155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.492+0000 7ff60ef0f640 1 -- 172.21.15.91:0/1211644467 >> 172.21.15.91:0/1211644467 conn(0x7ff60806a500 msgr2=0x7ff60806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:46.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.492+0000 7ff60ef0f640 1 -- 172.21.15.91:0/1211644467 shutdown_connections 2023-11-27T20:41:46.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.492+0000 7ff60ef0f640 1 -- 172.21.15.91:0/1211644467 wait complete. 2023-11-27T20:41:46.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.494+0000 7ff60ef0f640 1 Processor -- start 2023-11-27T20:41:46.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.494+0000 7ff60ef0f640 1 -- start start 2023-11-27T20:41:46.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60ef0f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6080c3340 0x7ff608154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60ef0f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6080c45d0 0x7ff60814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60ef0f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c5ec0 0x7ff60814e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60ef0f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6081edd20 con 0x7ff6080c5ec0 2023-11-27T20:41:46.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60ef0f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60814eb00 con 0x7ff6080c45d0 2023-11-27T20:41:46.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60ef0f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6081ed0a0 con 0x7ff6080c3340 2023-11-27T20:41:46.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60d4ac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c5ec0 0x7ff60814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60d4ac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c5ec0 0x7ff60814e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49554/0 (socket says 172.21.15.91:49554) 2023-11-27T20:41:46.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60d4ac640 1 -- 172.21.15.91:0/2925202725 learned_addr learned my addr 172.21.15.91:0/2925202725 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:46.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff5fffff640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6080c45d0 0x7ff60814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60d4ac640 1 -- 172.21.15.91:0/2925202725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6080c3340 msgr2=0x7ff608154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60d4ac640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6080c3340 0x7ff608154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60d4ac640 1 -- 172.21.15.91:0/2925202725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6080c45d0 msgr2=0x7ff60814dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60d4ac640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6080c45d0 0x7ff60814dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff60d4ac640 1 -- 172.21.15.91:0/2925202725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600009b30 con 0x7ff6080c5ec0 2023-11-27T20:41:46.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.495+0000 7ff5fffff640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6080c45d0 0x7ff60814dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:46.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.496+0000 7ff60d4ac640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c5ec0 0x7ff60814e530 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff600036040 tx=0x7ff600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:46.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.496+0000 7ff5fd7fa640 1 -- 172.21.15.91:0/2925202725 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60003e450 con 0x7ff6080c5ec0 2023-11-27T20:41:46.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.496+0000 7ff5fd7fa640 1 -- 172.21.15.91:0/2925202725 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60003e5d0 con 0x7ff6080c5ec0 2023-11-27T20:41:46.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.496+0000 7ff5fd7fa640 1 -- 172.21.15.91:0/2925202725 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60003e980 con 0x7ff6080c5ec0 2023-11-27T20:41:46.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.496+0000 7ff60ef0f640 1 -- 172.21.15.91:0/2925202725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6081ed380 con 0x7ff6080c5ec0 2023-11-27T20:41:46.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.496+0000 7ff60ef0f640 1 -- 172.21.15.91:0/2925202725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6081ed940 con 0x7ff6080c5ec0 2023-11-27T20:41:46.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.497+0000 7ff60ef0f640 1 -- 172.21.15.91:0/2925202725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6081ede60 con 0x7ff6080c5ec0 2023-11-27T20:41:46.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.498+0000 7ff5fd7fa640 1 -- 172.21.15.91:0/2925202725 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff60003eae0 con 0x7ff6080c5ec0 2023-11-27T20:41:46.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.499+0000 7ff5fd7fa640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff5f406b1c0 0x7ff5f406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.499+0000 7ff5fd7fa640 1 -- 172.21.15.91:0/2925202725 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6000ac8f0 con 0x7ff6080c5ec0 2023-11-27T20:41:46.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.499+0000 7ff60ccab640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff5f406b1c0 0x7ff5f406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.500+0000 7ff60ccab640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff5f406b1c0 0x7ff5f406d680 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff604007fd0 tx=0x7ff604007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:46.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.503+0000 7ff5fd7fa640 1 -- 172.21.15.91:0/2925202725 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff6081ede60 con 0x7ff6080c5ec0 2023-11-27T20:41:46.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.693+0000 7ff60ef0f640 1 -- 172.21.15.91:0/2925202725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6081ede60 con 0x7ff6080c5ec0 2023-11-27T20:41:46.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.696+0000 7ff5fd7fa640 1 -- 172.21.15.91:0/2925202725 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7ff6081ede60 con 0x7ff6080c5ec0 2023-11-27T20:41:46.697 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:46.698 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:46.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 -- 172.21.15.91:0/2925202725 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff5f406b1c0 msgr2=0x7ff5f406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff5f406b1c0 0x7ff5f406d680 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff604007fd0 tx=0x7ff604007960 comp rx=0 tx=0).stop 2023-11-27T20:41:46.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 -- 172.21.15.91:0/2925202725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c5ec0 msgr2=0x7ff60814e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c5ec0 0x7ff60814e530 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff600036040 tx=0x7ff600004a40 comp rx=0 tx=0).stop 2023-11-27T20:41:46.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 -- 172.21.15.91:0/2925202725 shutdown_connections 2023-11-27T20:41:46.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6080c5ec0 0x7ff60814e530 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff5f406b1c0 0x7ff5f406d680 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6080c45d0 0x7ff60814dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 --2- 172.21.15.91:0/2925202725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6080c3340 0x7ff608154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 -- 172.21.15.91:0/2925202725 >> 172.21.15.91:0/2925202725 conn(0x7ff60806a500 msgr2=0x7ff6080c11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:46.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.698+0000 7ff60ef0f640 1 -- 172.21.15.91:0/2925202725 shutdown_connections 2023-11-27T20:41:46.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.699+0000 7ff60ef0f640 1 -- 172.21.15.91:0/2925202725 wait complete. 2023-11-27T20:41:46.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:41:32.704555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:41:33.818847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:41:46.723 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:41:46.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.939+0000 7fe9deb97640 1 Processor -- start 2023-11-27T20:41:46.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.940+0000 7fe9deb97640 1 -- start start 2023-11-27T20:41:46.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.941+0000 7fe9deb97640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d80c7ec0 0x7fe9d8155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.941+0000 7fe9deb97640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe9d80c4940 0x7fe9d80c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.941+0000 7fe9deb97640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d81556d0 con 0x7fe9d8151cc0 2023-11-27T20:41:46.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.941+0000 7fe9deb97640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d8154740 con 0x7fe9d80c4940 2023-11-27T20:41:46.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.941+0000 7fe9deb97640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d806c760 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.941+0000 7fe9dd134640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe9d80c4940 0x7fe9d80c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.942+0000 7fe9dd134640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe9d80c4940 0x7fe9d80c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49556/0 (socket says 172.21.15.91:49556) 2023-11-27T20:41:46.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.942+0000 7fe9dd134640 1 -- 172.21.15.91:0/1325867174 learned_addr learned my addr 172.21.15.91:0/1325867174 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:46.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.942+0000 7fe9d7fff640 1 --2- 172.21.15.91:0/1325867174 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d80c7ec0 0x7fe9d8155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.942+0000 7fe9dd134640 1 -- 172.21.15.91:0/1325867174 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d80c7ec0 msgr2=0x7fe9d8155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:46.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.942+0000 7fe9dd134640 1 --2- 172.21.15.91:0/1325867174 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d80c7ec0 0x7fe9d8155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.942+0000 7fe9dd134640 1 -- 172.21.15.91:0/1325867174 >> v1:172.21.15.183:6789/0 conn(0x7fe9d8151cc0 legacy=0x7fe9d8157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.942+0000 7fe9dd134640 1 -- 172.21.15.91:0/1325867174 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d80c8470 con 0x7fe9d80c4940 2023-11-27T20:41:46.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.943+0000 7fe9dd134640 1 --2- 172.21.15.91:0/1325867174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c4940 0x7fe9d80c4d50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009870 tx=0x7fe9d002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a18abb24aff6c86 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:46.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9d77fe640 1 -- 172.21.15.91:0/1325867174 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0030840 con 0x7fe9d80c4940 2023-11-27T20:41:46.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9d77fe640 1 -- 172.21.15.91:0/1325867174 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d00309a0 con 0x7fe9d80c4940 2023-11-27T20:41:46.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9d77fe640 1 -- 172.21.15.91:0/1325867174 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0030d30 con 0x7fe9d80c4940 2023-11-27T20:41:46.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9deb97640 1 -- 172.21.15.91:0/1325867174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c4940 msgr2=0x7fe9d80c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9deb97640 1 --2- 172.21.15.91:0/1325867174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c4940 0x7fe9d80c4d50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009870 tx=0x7fe9d002b980 comp rx=0 tx=0).stop 2023-11-27T20:41:46.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9deb97640 1 -- 172.21.15.91:0/1325867174 shutdown_connections 2023-11-27T20:41:46.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9deb97640 1 --2- 172.21.15.91:0/1325867174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c4940 0x7fe9d80c4d50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9deb97640 1 --2- 172.21.15.91:0/1325867174 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d80c7ec0 0x7fe9d8155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9deb97640 1 -- 172.21.15.91:0/1325867174 >> 172.21.15.91:0/1325867174 conn(0x7fe9d8071e10 msgr2=0x7fe9d8072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:46.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9deb97640 1 -- 172.21.15.91:0/1325867174 shutdown_connections 2023-11-27T20:41:46.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.944+0000 7fe9deb97640 1 -- 172.21.15.91:0/1325867174 wait complete. 2023-11-27T20:41:46.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.946+0000 7fe9deb97640 1 Processor -- start 2023-11-27T20:41:46.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.946+0000 7fe9deb97640 1 -- start start 2023-11-27T20:41:46.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.947+0000 7fe9deb97640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9d80c4940 0x7fe9d81486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.947+0000 7fe9deb97640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c7ec0 0x7fe9d80ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.947+0000 7fe9deb97640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d8151cc0 0x7fe9d81479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.947+0000 7fe9deb97640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81edfc0 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.947+0000 7fe9deb97640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80a9aa0 con 0x7fe9d80c4940 2023-11-27T20:41:46.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.947+0000 7fe9deb97640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81ed3b0 con 0x7fe9d8151cc0 2023-11-27T20:41:46.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.947+0000 7fe9d7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c7ec0 0x7fe9d80ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.947+0000 7fe9d7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c7ec0 0x7fe9d80ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49572/0 (socket says 172.21.15.91:49572) 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.947+0000 7fe9d7fff640 1 -- 172.21.15.91:0/4099226161 learned_addr learned my addr 172.21.15.91:0/4099226161 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9dc933640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9d80c4940 0x7fe9d81486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9dd134640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d8151cc0 0x7fe9d81479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9d7fff640 1 -- 172.21.15.91:0/4099226161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d8151cc0 msgr2=0x7fe9d81479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9d7fff640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d8151cc0 0x7fe9d81479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9d7fff640 1 -- 172.21.15.91:0/4099226161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9d80c4940 msgr2=0x7fe9d81486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9d7fff640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9d80c4940 0x7fe9d81486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9d7fff640 1 -- 172.21.15.91:0/4099226161 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d00094d0 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9dd134640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d8151cc0 0x7fe9d81479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:46.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9d7fff640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c7ec0 0x7fe9d80ca1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00d7d0 tx=0x7fe9cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:46.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9d57fa640 1 -- 172.21.15.91:0/4099226161 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00b6c0 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9d57fa640 1 -- 172.21.15.91:0/4099226161 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc00b840 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.948+0000 7fe9deb97640 1 -- 172.21.15.91:0/4099226161 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d81ed690 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.949+0000 7fe9d57fa640 1 -- 172.21.15.91:0/4099226161 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00bbf0 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.949+0000 7fe9deb97640 1 -- 172.21.15.91:0/4099226161 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d81edc50 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.950+0000 7fe9deb97640 1 -- 172.21.15.91:0/4099226161 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d81ede10 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.951+0000 7fe9d57fa640 1 -- 172.21.15.91:0/4099226161 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe9cc00bd50 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.951+0000 7fe9d57fa640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe9c406b1f0 0x7fe9c406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:46.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.952+0000 7fe9d57fa640 1 -- 172.21.15.91:0/4099226161 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9cc089f60 con 0x7fe9d80c7ec0 2023-11-27T20:41:46.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.952+0000 7fe9dc933640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe9c406b1f0 0x7fe9c406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:46.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.952+0000 7fe9dc933640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe9c406b1f0 0x7fe9c406d6b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80012e0 tx=0x7fe9c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:46.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:46.956+0000 7fe9d57fa640 1 -- 172.21.15.91:0/4099226161 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe9cc054c80 con 0x7fe9d80c7ec0 2023-11-27T20:41:47.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.139+0000 7fe9deb97640 1 -- 172.21.15.91:0/4099226161 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9d8068350 con 0x7fe9d80c7ec0 2023-11-27T20:41:47.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.140+0000 7fe9d57fa640 1 -- 172.21.15.91:0/4099226161 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9cc0582a0 con 0x7fe9d80c7ec0 2023-11-27T20:41:47.142 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:41:47.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.142+0000 7fe9deb97640 1 -- 172.21.15.91:0/4099226161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe9c406b1f0 msgr2=0x7fe9c406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.142+0000 7fe9deb97640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe9c406b1f0 0x7fe9c406d6b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80012e0 tx=0x7fe9c8009040 comp rx=0 tx=0).stop 2023-11-27T20:41:47.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.142+0000 7fe9deb97640 1 -- 172.21.15.91:0/4099226161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c7ec0 msgr2=0x7fe9d80ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.142+0000 7fe9deb97640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c7ec0 0x7fe9d80ca1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00d7d0 tx=0x7fe9cc00dc90 comp rx=0 tx=0).stop 2023-11-27T20:41:47.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.143+0000 7fe9deb97640 1 -- 172.21.15.91:0/4099226161 shutdown_connections 2023-11-27T20:41:47.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.143+0000 7fe9deb97640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9d8151cc0 0x7fe9d81479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.143+0000 7fe9deb97640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe9d80c7ec0 0x7fe9d80ca1c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.143+0000 7fe9deb97640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe9c406b1f0 0x7fe9c406d6b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.143+0000 7fe9deb97640 1 --2- 172.21.15.91:0/4099226161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9d80c4940 0x7fe9d81486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.143+0000 7fe9deb97640 1 -- 172.21.15.91:0/4099226161 >> 172.21.15.91:0/4099226161 conn(0x7fe9d8071e10 msgr2=0x7fe9d80c08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:47.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.143+0000 7fe9deb97640 1 -- 172.21.15.91:0/4099226161 shutdown_connections 2023-11-27T20:41:47.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.143+0000 7fe9deb97640 1 -- 172.21.15.91:0/4099226161 wait complete. 2023-11-27T20:41:47.160 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:41:47.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.369+0000 7f32ab4e7640 1 Processor -- start 2023-11-27T20:41:47.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.369+0000 7f32ab4e7640 1 -- start start 2023-11-27T20:41:47.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.371+0000 7f32ab4e7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f32a406b1d0 0x7f32a40c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.371+0000 7f32ab4e7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a4155230 0x7f32a40c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.371+0000 7f32ab4e7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a4155730 con 0x7f32a40c6300 2023-11-27T20:41:47.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.371+0000 7f32ab4e7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a406c9f0 con 0x7f32a406b1d0 2023-11-27T20:41:47.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.371+0000 7f32ab4e7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40c5650 con 0x7f32a4155230 2023-11-27T20:41:47.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.371+0000 7f32a9a84640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f32a40c6300 0x7f32a4151a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34014/0 (socket says 172.21.15.91:34014) 2023-11-27T20:41:47.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.371+0000 7f32a9a84640 1 -- 172.21.15.91:0/2999012827 learned_addr learned my addr 172.21.15.91:0/2999012827 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:47.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.371+0000 7f32a9283640 1 --2- 172.21.15.91:0/2999012827 >> v2:172.21.15.183:3300/0 conn(0x7f32a406b1d0 0x7f32a40c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.371+0000 7f32a8a82640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a4155230 0x7f32a40c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322005199 0 0) 0x7f32a4155730 con 0x7f32a40c6300 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3290003520 con 0x7f32a40c6300 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449938288 0 0) 0x7f3290003520 con 0x7f32a40c6300 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a4155230 msgr2=0x7f32a40c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a4155230 0x7f32a40c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 >> v2:172.21.15.183:3300/0 conn(0x7f32a406b1d0 msgr2=0x7f32a40c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 --2- 172.21.15.91:0/2999012827 >> v2:172.21.15.183:3300/0 conn(0x7f32a406b1d0 0x7f32a40c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a40c9c70 con 0x7f32a40c6300 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f329c0019f0 con 0x7f32a40c6300 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 >> v1:172.21.15.91:6789/0 conn(0x7f32a40c6300 legacy=0x7f32a4151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3290003970 0x7f3290003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a4155230 0x7f32900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3290004d00 0x7f3290005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a406c9f0 con 0x7f3290004d00 2023-11-27T20:41:47.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40c5650 con 0x7f3290003970 2023-11-27T20:41:47.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.372+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329000ba00 con 0x7f32a4155230 2023-11-27T20:41:47.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.373+0000 7f32a9a84640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3290004d00 0x7f3290005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.373+0000 7f32a8a82640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a4155230 0x7f32900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.373+0000 7f32a9a84640 1 -- 172.21.15.91:0/2999012827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a4155230 msgr2=0x7f32900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:47.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.373+0000 7f32a9a84640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a4155230 0x7f32900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.373+0000 7f32a9a84640 1 -- 172.21.15.91:0/2999012827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3290003970 msgr2=0x7f3290003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:47.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.373+0000 7f32a9a84640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3290003970 0x7f3290003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.373+0000 7f32a9a84640 1 -- 172.21.15.91:0/2999012827 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290003520 con 0x7f3290004d00 2023-11-27T20:41:47.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.374+0000 7f32a9a84640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3290004d00 0x7f3290005180 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f329c00a830 tx=0x7f32900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11865f5dd3a4fecd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:47.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.374+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c034630 con 0x7f3290004d00 2023-11-27T20:41:47.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.374+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c02f070 con 0x7f3290004d00 2023-11-27T20:41:47.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.374+0000 7f329bfff640 1 -- 172.21.15.91:0/2999012827 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c0349f0 con 0x7f3290004d00 2023-11-27T20:41:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.375+0000 7f32ab4e7640 1 -- 172.21.15.91:0/2999012827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3290004d00 msgr2=0x7f3290005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.375+0000 7f32ab4e7640 1 --2- 172.21.15.91:0/2999012827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3290004d00 0x7f3290005180 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f329c00a830 tx=0x7f32900057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.375+0000 7f32a9a84640 1 -- 172.21.15.91:0/2999012827 reap_dead start 2023-11-27T20:41:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.375+0000 7f32ab4e7640 1 -- 172.21.15.91:0/2999012827 shutdown_connections 2023-11-27T20:41:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.375+0000 7f32ab4e7640 1 -- 172.21.15.91:0/2999012827 >> 172.21.15.91:0/2999012827 conn(0x7f32a40ca100 msgr2=0x7f32a40ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.375+0000 7f32ab4e7640 1 -- 172.21.15.91:0/2999012827 shutdown_connections 2023-11-27T20:41:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.375+0000 7f32ab4e7640 1 -- 172.21.15.91:0/2999012827 wait complete. 2023-11-27T20:41:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.377+0000 7f32ab4e7640 1 Processor -- start 2023-11-27T20:41:47.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.377+0000 7f32ab4e7640 1 -- start start 2023-11-27T20:41:47.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.378+0000 7f32ab4e7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a414bf70 0x7f32a41ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.378+0000 7f32ab4e7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a41585b0 0x7f32a41ea800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.378+0000 7f32ab4e7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a40afc20 0x7f32a4149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.378+0000 7f32ab4e7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40ad610 con 0x7f32a41585b0 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.378+0000 7f32ab4e7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a41ea070 con 0x7f32a40afc20 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.378+0000 7f32ab4e7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40ad860 con 0x7f32a414bf70 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.378+0000 7f32a8a82640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a41585b0 0x7f32a41ea800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.378+0000 7f32a8a82640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a41585b0 0x7f32a41ea800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49592/0 (socket says 172.21.15.91:49592) 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.378+0000 7f32a8a82640 1 -- 172.21.15.91:0/216281455 learned_addr learned my addr 172.21.15.91:0/216281455 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f32a9283640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a414bf70 0x7f32a41ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f32a8a82640 1 -- 172.21.15.91:0/216281455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a414bf70 msgr2=0x7f32a41ed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f32a8a82640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a414bf70 0x7f32a41ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f32a9a84640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a40afc20 0x7f32a4149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f32a8a82640 1 -- 172.21.15.91:0/216281455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a40afc20 msgr2=0x7f32a4149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f32a8a82640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a40afc20 0x7f32a4149b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f32a8a82640 1 -- 172.21.15.91:0/216281455 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a41ea2e0 con 0x7f32a41585b0 2023-11-27T20:41:47.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f32a8a82640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a41585b0 0x7f32a41ea800 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3294011600 tx=0x7f3294011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:47.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f3299ffb640 1 -- 172.21.15.91:0/216281455 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329400f920 con 0x7f32a41585b0 2023-11-27T20:41:47.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f3299ffb640 1 -- 172.21.15.91:0/216281455 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329400fa80 con 0x7f32a41585b0 2023-11-27T20:41:47.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f32ab4e7640 1 -- 172.21.15.91:0/216281455 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a40adb40 con 0x7f32a41585b0 2023-11-27T20:41:47.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.379+0000 7f3299ffb640 1 -- 172.21.15.91:0/216281455 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329400fdf0 con 0x7f32a41585b0 2023-11-27T20:41:47.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.380+0000 7f32ab4e7640 1 -- 172.21.15.91:0/216281455 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a4156a20 con 0x7f32a41585b0 2023-11-27T20:41:47.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.380+0000 7f32ab4e7640 1 -- 172.21.15.91:0/216281455 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a404e840 con 0x7f32a41585b0 2023-11-27T20:41:47.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.381+0000 7f3299ffb640 1 -- 172.21.15.91:0/216281455 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3294015460 con 0x7f32a41585b0 2023-11-27T20:41:47.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.382+0000 7f3299ffb640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f328806b1f0 0x7f328806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.383+0000 7f3299ffb640 1 -- 172.21.15.91:0/216281455 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f329408a0e0 con 0x7f32a41585b0 2023-11-27T20:41:47.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.383+0000 7f32a9283640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f328806b1f0 0x7f328806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.383+0000 7f32a9283640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f328806b1f0 0x7f328806d6b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32a0004770 tx=0x7f32a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:47.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.387+0000 7f3299ffb640 1 -- 172.21.15.91:0/216281455 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3294054e00 con 0x7f32a41585b0 2023-11-27T20:41:47.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.576+0000 7f32ab4e7640 1 -- 172.21.15.91:0/216281455 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32a4067950 con 0x7f32a41585b0 2023-11-27T20:41:47.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.577+0000 7f3299ffb640 1 -- 172.21.15.91:0/216281455 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3294058420 con 0x7f32a41585b0 2023-11-27T20:41:47.579 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:41:47.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 -- 172.21.15.91:0/216281455 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f328806b1f0 msgr2=0x7f328806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f328806b1f0 0x7f328806d6b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32a0004770 tx=0x7f32a0008040 comp rx=0 tx=0).stop 2023-11-27T20:41:47.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 -- 172.21.15.91:0/216281455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a41585b0 msgr2=0x7f32a41ea800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a41585b0 0x7f32a41ea800 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3294011600 tx=0x7f3294011ac0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 -- 172.21.15.91:0/216281455 shutdown_connections 2023-11-27T20:41:47.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f328806b1f0 0x7f328806d6b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a40afc20 0x7f32a4149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a41585b0 0x7f32a41ea800 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 --2- 172.21.15.91:0/216281455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32a414bf70 0x7f32a41ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 -- 172.21.15.91:0/216281455 >> 172.21.15.91:0/216281455 conn(0x7f32a40ca100 msgr2=0x7f32a40c86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:47.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 -- 172.21.15.91:0/216281455 shutdown_connections 2023-11-27T20:41:47.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.580+0000 7f32ab4e7640 1 -- 172.21.15.91:0/216281455 wait complete. 2023-11-27T20:41:47.598 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:41:47.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.806+0000 7f8c6dd16640 1 Processor -- start 2023-11-27T20:41:47.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.807+0000 7f8c6dd16640 1 -- start start 2023-11-27T20:41:47.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.808+0000 7f8c6dd16640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8c680c1500 0x7f8c680c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.808+0000 7f8c6dd16640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680c06c0 con 0x7f8c680a9b40 2023-11-27T20:41:47.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.808+0000 7f8c6dd16640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680c1020 con 0x7f8c68155490 2023-11-27T20:41:47.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.808+0000 7f8c6dd16640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c680a5820 con 0x7f8c680c1500 2023-11-27T20:41:47.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.808+0000 7f8c5ffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8c680a9b40 0x7f8c680c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34030/0 (socket says 172.21.15.91:34030) 2023-11-27T20:41:47.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.808+0000 7f8c5ffff640 1 -- 172.21.15.91:0/3665744853 learned_addr learned my addr 172.21.15.91:0/3665744853 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167268826 0 0) 0x7f8c680c06c0 con 0x7f8c680a9b40 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c67fff640 1 --2- 172.21.15.91:0/3665744853 >> v2:172.21.15.183:3300/0 conn(0x7f8c680c1500 0x7f8c680c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c54003520 con 0x7f8c680a9b40 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 146968214 0 0) 0x7f8c54003520 con 0x7f8c680a9b40 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 >> v2:172.21.15.183:3300/0 conn(0x7f8c680c1500 msgr2=0x7f8c680c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 --2- 172.21.15.91:0/3665744853 >> v2:172.21.15.183:3300/0 conn(0x7f8c680c1500 0x7f8c680c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 >> v1:172.21.15.183:6789/0 conn(0x7f8c68155490 legacy=0x7f8c680a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680c0910 con 0x7f8c680a9b40 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f8c50001670 con 0x7f8c680a9b40 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 >> v1:172.21.15.91:6789/0 conn(0x7f8c680a9b40 legacy=0x7f8c680c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c54003970 0x7f8c54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c540047c0 0x7f8c54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c54005180 0x7f8c5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5400bff0 con 0x7f8c54005180 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.809+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5400c160 con 0x7f8c54003970 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.810+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5400c320 con 0x7f8c540047c0 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.810+0000 7f8c67fff640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c54005180 0x7f8c5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.810+0000 7f8c677fe640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c54003970 0x7f8c54003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.810+0000 7f8c5ffff640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c540047c0 0x7f8c54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.810+0000 7f8c67fff640 1 -- 172.21.15.91:0/3665744853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c540047c0 msgr2=0x7f8c54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.810+0000 7f8c67fff640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c540047c0 0x7f8c54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.810+0000 7f8c67fff640 1 -- 172.21.15.91:0/3665744853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c54003970 msgr2=0x7f8c54003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.810+0000 7f8c67fff640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c54003970 0x7f8c54003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.810+0000 7f8c67fff640 1 -- 172.21.15.91:0/3665744853 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c54003520 con 0x7f8c54005180 2023-11-27T20:41:47.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.810+0000 7f8c5ffff640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c540047c0 0x7f8c54004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:47.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.811+0000 7f8c67fff640 1 -- 172.21.15.91:0/3665744853 reap_dead start 2023-11-27T20:41:47.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.812+0000 7f8c67fff640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c54005180 0x7f8c5400b980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009fc0 tx=0x7f8c540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb319b291ec035c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:47.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.812+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6002cc60 con 0x7f8c54005180 2023-11-27T20:41:47.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.812+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6000f040 con 0x7f8c54005180 2023-11-27T20:41:47.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.812+0000 7f8c66ffd640 1 -- 172.21.15.91:0/3665744853 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60003990 con 0x7f8c54005180 2023-11-27T20:41:47.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.813+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3665744853 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c54005180 msgr2=0x7f8c5400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.813+0000 7f8c6dd16640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c54005180 0x7f8c5400b980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009fc0 tx=0x7f8c540057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.813+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3665744853 shutdown_connections 2023-11-27T20:41:47.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.813+0000 7f8c6dd16640 1 --2- 172.21.15.91:0/3665744853 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c54005180 0x7f8c5400b980 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.813+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3665744853 >> 172.21.15.91:0/3665744853 conn(0x7f8c6806a500 msgr2=0x7f8c6806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:47.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.813+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3665744853 shutdown_connections 2023-11-27T20:41:47.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.813+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3665744853 wait complete. 2023-11-27T20:41:47.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.814+0000 7f8c6dd16640 1 Processor -- start 2023-11-27T20:41:47.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.815+0000 7f8c6dd16640 1 -- start start 2023-11-27T20:41:47.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.815+0000 7f8c6dd16640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c54005180 0x7f8c6806d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.815+0000 7f8c6dd16640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c681480c0 0x7f8c68148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.815+0000 7f8c6dd16640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c680bace0 0x7f8c680bb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.815+0000 7f8c6dd16640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680bb990 con 0x7f8c681480c0 2023-11-27T20:41:47.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.815+0000 7f8c6dd16640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c681eb100 con 0x7f8c54005180 2023-11-27T20:41:47.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.815+0000 7f8c6dd16640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c681eb3e0 con 0x7f8c680bace0 2023-11-27T20:41:47.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.816+0000 7f8c5ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c681480c0 0x7f8c68148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.816+0000 7f8c5ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c681480c0 0x7f8c68148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49600/0 (socket says 172.21.15.91:49600) 2023-11-27T20:41:47.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.816+0000 7f8c5ffff640 1 -- 172.21.15.91:0/3106576614 learned_addr learned my addr 172.21.15.91:0/3106576614 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.816+0000 7f8c5ffff640 1 -- 172.21.15.91:0/3106576614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c680bace0 msgr2=0x7f8c680bb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.816+0000 7f8c5ffff640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c680bace0 0x7f8c680bb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.816+0000 7f8c5ffff640 1 -- 172.21.15.91:0/3106576614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c54005180 msgr2=0x7f8c6806d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.816+0000 7f8c5ffff640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c54005180 0x7f8c6806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.816+0000 7f8c5ffff640 1 -- 172.21.15.91:0/3106576614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c681eb6c0 con 0x7f8c681480c0 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.816+0000 7f8c5ffff640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c681480c0 0x7f8c68148520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000ff0 tx=0x7f8c5000dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.816+0000 7f8c64ff9640 1 -- 172.21.15.91:0/3106576614 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c500074e0 con 0x7f8c681480c0 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.817+0000 7f8c64ff9640 1 -- 172.21.15.91:0/3106576614 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c50007640 con 0x7f8c681480c0 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.817+0000 7f8c64ff9640 1 -- 172.21.15.91:0/3106576614 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c500049e0 con 0x7f8c681480c0 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.817+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3106576614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c681eb9a0 con 0x7f8c681480c0 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.817+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3106576614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6806d5d0 con 0x7f8c681480c0 2023-11-27T20:41:47.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.818+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3106576614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c68068350 con 0x7f8c681480c0 2023-11-27T20:41:47.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.819+0000 7f8c64ff9640 1 -- 172.21.15.91:0/3106576614 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8c50004b40 con 0x7f8c681480c0 2023-11-27T20:41:47.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.819+0000 7f8c64ff9640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8c4806b1c0 0x7f8c4806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:47.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.819+0000 7f8c64ff9640 1 -- 172.21.15.91:0/3106576614 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c50089380 con 0x7f8c681480c0 2023-11-27T20:41:47.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.820+0000 7f8c677fe640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8c4806b1c0 0x7f8c4806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:47.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.820+0000 7f8c677fe640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8c4806b1c0 0x7f8c4806d680 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c580014f0 tx=0x7f8c58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:47.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.824+0000 7f8c64ff9640 1 -- 172.21.15.91:0/3106576614 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8c50054020 con 0x7f8c681480c0 2023-11-27T20:41:47.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.997+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3106576614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c6814f720 con 0x7f8c681480c0 2023-11-27T20:41:47.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:47.997+0000 7f8c64ff9640 1 -- 172.21.15.91:0/3106576614 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c500190a0 con 0x7f8c681480c0 2023-11-27T20:41:47.999 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:41:48.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3106576614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8c4806b1c0 msgr2=0x7f8c4806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8c4806b1c0 0x7f8c4806d680 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c580014f0 tx=0x7f8c58009040 comp rx=0 tx=0).stop 2023-11-27T20:41:48.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3106576614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c681480c0 msgr2=0x7f8c68148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c681480c0 0x7f8c68148520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000ff0 tx=0x7f8c5000dc70 comp rx=0 tx=0).stop 2023-11-27T20:41:48.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3106576614 shutdown_connections 2023-11-27T20:41:48.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c680bace0 0x7f8c680bb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8c681480c0 0x7f8c68148520 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8c4806b1c0 0x7f8c4806d680 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 --2- 172.21.15.91:0/3106576614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c54005180 0x7f8c6806d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3106576614 >> 172.21.15.91:0/3106576614 conn(0x7f8c6806a500 msgr2=0x7f8c68152c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:48.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3106576614 shutdown_connections 2023-11-27T20:41:48.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.000+0000 7f8c6dd16640 1 -- 172.21.15.91:0/3106576614 wait complete. 2023-11-27T20:41:48.019 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:41:48.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.221+0000 7f906d1de640 1 Processor -- start 2023-11-27T20:41:48.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.221+0000 7f906d1de640 1 -- start start 2023-11-27T20:41:48.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.223+0000 7f906d1de640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9068151cc0 0x7f9068155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.223+0000 7f906d1de640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f90680c4940 0x7f90680c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.223+0000 7f906d1de640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90681556d0 con 0x7f90680c7ec0 2023-11-27T20:41:48.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.223+0000 7f906d1de640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9068154740 con 0x7f90680c4940 2023-11-27T20:41:48.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.223+0000 7f906d1de640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906806c760 con 0x7f9068151cc0 2023-11-27T20:41:48.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.223+0000 7f906759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f90680c4940 0x7f90680c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.223+0000 7f906759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f90680c4940 0x7f90680c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49614/0 (socket says 172.21.15.91:49614) 2023-11-27T20:41:48.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.223+0000 7f906759e640 1 -- 172.21.15.91:0/2221621046 learned_addr learned my addr 172.21.15.91:0/2221621046 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:48.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.223+0000 7f9066d9d640 1 --2- 172.21.15.91:0/2221621046 >> v2:172.21.15.183:3300/0 conn(0x7f9068151cc0 0x7f9068155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.224+0000 7f906759e640 1 -- 172.21.15.91:0/2221621046 >> v2:172.21.15.183:3300/0 conn(0x7f9068151cc0 msgr2=0x7f9068155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:48.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.224+0000 7f906759e640 1 --2- 172.21.15.91:0/2221621046 >> v2:172.21.15.183:3300/0 conn(0x7f9068151cc0 0x7f9068155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.224+0000 7f906759e640 1 -- 172.21.15.91:0/2221621046 >> v1:172.21.15.91:6789/0 conn(0x7f90680c7ec0 legacy=0x7f9068157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.224+0000 7f906759e640 1 -- 172.21.15.91:0/2221621046 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680c8470 con 0x7f90680c4940 2023-11-27T20:41:48.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.225+0000 7f906759e640 1 --2- 172.21.15.91:0/2221621046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90680c4940 0x7f90680c4d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f90680cb030 tx=0x7f906002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68a8b9e89812f56 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:48.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.225+0000 7f906659c640 1 -- 172.21.15.91:0/2221621046 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906002cb20 con 0x7f90680c4940 2023-11-27T20:41:48.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.225+0000 7f906659c640 1 -- 172.21.15.91:0/2221621046 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906002cc80 con 0x7f90680c4940 2023-11-27T20:41:48.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.225+0000 7f906659c640 1 -- 172.21.15.91:0/2221621046 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600343f0 con 0x7f90680c4940 2023-11-27T20:41:48.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.226+0000 7f906d1de640 1 -- 172.21.15.91:0/2221621046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90680c4940 msgr2=0x7f90680c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.226+0000 7f906d1de640 1 --2- 172.21.15.91:0/2221621046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90680c4940 0x7f90680c4d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f90680cb030 tx=0x7f906002bf80 comp rx=0 tx=0).stop 2023-11-27T20:41:48.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.226+0000 7f906d1de640 1 -- 172.21.15.91:0/2221621046 shutdown_connections 2023-11-27T20:41:48.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.226+0000 7f906d1de640 1 --2- 172.21.15.91:0/2221621046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90680c4940 0x7f90680c4d90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.226+0000 7f906d1de640 1 --2- 172.21.15.91:0/2221621046 >> v2:172.21.15.183:3300/0 conn(0x7f9068151cc0 0x7f9068155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.226+0000 7f906d1de640 1 -- 172.21.15.91:0/2221621046 >> 172.21.15.91:0/2221621046 conn(0x7f9068071e10 msgr2=0x7f9068072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:48.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.226+0000 7f906d1de640 1 -- 172.21.15.91:0/2221621046 shutdown_connections 2023-11-27T20:41:48.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.226+0000 7f906d1de640 1 -- 172.21.15.91:0/2221621046 wait complete. 2023-11-27T20:41:48.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.228+0000 7f906d1de640 1 Processor -- start 2023-11-27T20:41:48.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.228+0000 7f906d1de640 1 -- start start 2023-11-27T20:41:48.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.229+0000 7f906d1de640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90680c4940 0x7f906814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.229+0000 7f906d1de640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90680c7ec0 0x7f906814a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.229+0000 7f906d1de640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9068151cc0 0x7f906814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.229+0000 7f906d1de640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680aeab0 con 0x7f9068151cc0 2023-11-27T20:41:48.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.229+0000 7f906d1de640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90681ee190 con 0x7f90680c7ec0 2023-11-27T20:41:48.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.229+0000 7f906d1de640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906814f020 con 0x7f90680c4940 2023-11-27T20:41:48.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.230+0000 7f906759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9068151cc0 0x7f906814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.230+0000 7f906759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9068151cc0 0x7f906814a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49616/0 (socket says 172.21.15.91:49616) 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.230+0000 7f906759e640 1 -- 172.21.15.91:0/1555776316 learned_addr learned my addr 172.21.15.91:0/1555776316 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.230+0000 7f9066d9d640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90680c4940 0x7f906814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.230+0000 7f905ffff640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90680c7ec0 0x7f906814a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.230+0000 7f906759e640 1 -- 172.21.15.91:0/1555776316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90680c4940 msgr2=0x7f906814e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.230+0000 7f906759e640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90680c4940 0x7f906814e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.230+0000 7f906759e640 1 -- 172.21.15.91:0/1555776316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90680c7ec0 msgr2=0x7f906814a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.230+0000 7f906759e640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90680c7ec0 0x7f906814a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.230+0000 7f906759e640 1 -- 172.21.15.91:0/1555776316 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060009b30 con 0x7f9068151cc0 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.231+0000 7f906759e640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9068151cc0 0x7f906814a8b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9060036040 tx=0x7f9060004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.231+0000 7f905f7fe640 1 -- 172.21.15.91:0/1555776316 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060007e70 con 0x7f9068151cc0 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.231+0000 7f905f7fe640 1 -- 172.21.15.91:0/1555776316 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060009510 con 0x7f9068151cc0 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.231+0000 7f906d1de640 1 -- 172.21.15.91:0/1555776316 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90681ed580 con 0x7f9068151cc0 2023-11-27T20:41:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.231+0000 7f905f7fe640 1 -- 172.21.15.91:0/1555776316 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906003e690 con 0x7f9068151cc0 2023-11-27T20:41:48.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.231+0000 7f906d1de640 1 -- 172.21.15.91:0/1555776316 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90681edb40 con 0x7f9068151cc0 2023-11-27T20:41:48.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.232+0000 7f906d1de640 1 -- 172.21.15.91:0/1555776316 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90681e9d30 con 0x7f9068151cc0 2023-11-27T20:41:48.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.233+0000 7f905f7fe640 1 -- 172.21.15.91:0/1555776316 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f906003e7f0 con 0x7f9068151cc0 2023-11-27T20:41:48.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.234+0000 7f905f7fe640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f904806b210 0x7f904806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.234+0000 7f905f7fe640 1 -- 172.21.15.91:0/1555776316 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90600ac510 con 0x7f9068151cc0 2023-11-27T20:41:48.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.234+0000 7f9066d9d640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f904806b210 0x7f904806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.235+0000 7f9066d9d640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f904806b210 0x7f904806d6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9058006fd0 tx=0x7f9058008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:48.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.238+0000 7f905f7fe640 1 -- 172.21.15.91:0/1555776316 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f90681e9d30 con 0x7f9068151cc0 2023-11-27T20:41:48.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.469+0000 7f906d1de640 1 -- 172.21.15.91:0/1555776316 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90681e9d30 con 0x7f9068151cc0 2023-11-27T20:41:48.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.470+0000 7f905f7fe640 1 -- 172.21.15.91:0/1555776316 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f90681e9d30 con 0x7f9068151cc0 2023-11-27T20:41:48.471 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:48.471 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/636329462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":636329462},{"type":"v1","addr":"172.21.15.91:6836","nonce":636329462}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/433109070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":433109070},{"type":"v1","addr":"172.21.15.91:6837","nonce":433109070}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1419226381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1419226381},{"type":"v1","addr":"172.21.15.183:6835","nonce":1419226381}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:41:34.815589+0000","modified":"2023-11-27T20:41:37.881858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/4022772138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4022772138},{"type":"v1","addr":"172.21.15.183:6834","nonce":4022772138}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:41:48.472 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 8 2023-11-27T20:41:48.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.472+0000 7f906d1de640 1 -- 172.21.15.91:0/1555776316 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f904806b210 msgr2=0x7f904806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.472+0000 7f906d1de640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f904806b210 0x7f904806d6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9058006fd0 tx=0x7f9058008040 comp rx=0 tx=0).stop 2023-11-27T20:41:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.472+0000 7f906d1de640 1 -- 172.21.15.91:0/1555776316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9068151cc0 msgr2=0x7f906814a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.472+0000 7f906d1de640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9068151cc0 0x7f906814a8b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9060036040 tx=0x7f9060004a40 comp rx=0 tx=0).stop 2023-11-27T20:41:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.473+0000 7f906d1de640 1 -- 172.21.15.91:0/1555776316 shutdown_connections 2023-11-27T20:41:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.473+0000 7f906d1de640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9068151cc0 0x7f906814a8b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.473+0000 7f906d1de640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f904806b210 0x7f904806d6d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.473+0000 7f906d1de640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90680c7ec0 0x7f906814a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.473+0000 7f906d1de640 1 --2- 172.21.15.91:0/1555776316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90680c4940 0x7f906814e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.473+0000 7f906d1de640 1 -- 172.21.15.91:0/1555776316 >> 172.21.15.91:0/1555776316 conn(0x7f9068071e10 msgr2=0x7f906814ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:48.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.473+0000 7f906d1de640 1 -- 172.21.15.91:0/1555776316 shutdown_connections 2023-11-27T20:41:48.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.473+0000 7f906d1de640 1 -- 172.21.15.91:0/1555776316 wait complete. 2023-11-27T20:41:48.494 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:48.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.684+0000 7fb2290a6640 1 Processor -- start 2023-11-27T20:41:48.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.685+0000 7fb2290a6640 1 -- start start 2023-11-27T20:41:48.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.686+0000 7fb2290a6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb22414fd30 0x7fb224152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.686+0000 7fb2290a6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2240c3ea0 0x7fb2240c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.686+0000 7fb2290a6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240c64a0 con 0x7fb22406d0a0 2023-11-27T20:41:48.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.686+0000 7fb2290a6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240c5c00 con 0x7fb22414fd30 2023-11-27T20:41:48.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.686+0000 7fb2290a6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240c5ee0 con 0x7fb2240c3ea0 2023-11-27T20:41:48.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.686+0000 7fb222d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb22414fd30 0x7fb224152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.686+0000 7fb222d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb22414fd30 0x7fb224152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49626/0 (socket says 172.21.15.91:49626) 2023-11-27T20:41:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.686+0000 7fb222d9d640 1 -- 172.21.15.91:0/779042692 learned_addr learned my addr 172.21.15.91:0/779042692 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.687+0000 7fb222d9d640 1 -- 172.21.15.91:0/779042692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2240c3ea0 msgr2=0x7fb2240c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.687+0000 7fb22359e640 1 --2- 172.21.15.91:0/779042692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2240c3ea0 0x7fb2240c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.687+0000 7fb222d9d640 1 --2- 172.21.15.91:0/779042692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2240c3ea0 0x7fb2240c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.687+0000 7fb222d9d640 1 -- 172.21.15.91:0/779042692 >> v1:172.21.15.91:6789/0 conn(0x7fb22406d0a0 legacy=0x7fb2240a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.687+0000 7fb222d9d640 1 -- 172.21.15.91:0/779042692 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240c61c0 con 0x7fb22414fd30 2023-11-27T20:41:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.687+0000 7fb22259c640 1 -- 172.21.15.91:0/779042692 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571105494 0 0) 0x7fb2240c64a0 con 0x7fb22406d0a0 2023-11-27T20:41:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.687+0000 7fb22359e640 1 --2- 172.21.15.91:0/779042692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2240c3ea0 0x7fb2240c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:48.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.688+0000 7fb222d9d640 1 --2- 172.21.15.91:0/779042692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb22414fd30 0x7fb224152f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb214009870 tx=0x7fb21402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686b59dc9e058297 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:48.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.688+0000 7fb22259c640 1 -- 172.21.15.91:0/779042692 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214030840 con 0x7fb22414fd30 2023-11-27T20:41:48.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.688+0000 7fb22259c640 1 -- 172.21.15.91:0/779042692 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2140309a0 con 0x7fb22414fd30 2023-11-27T20:41:48.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.688+0000 7fb22259c640 1 -- 172.21.15.91:0/779042692 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214030d30 con 0x7fb22414fd30 2023-11-27T20:41:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.689+0000 7fb2290a6640 1 -- 172.21.15.91:0/779042692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb22414fd30 msgr2=0x7fb224152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.689+0000 7fb2290a6640 1 --2- 172.21.15.91:0/779042692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb22414fd30 0x7fb224152f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb214009870 tx=0x7fb21402b980 comp rx=0 tx=0).stop 2023-11-27T20:41:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.689+0000 7fb2290a6640 1 -- 172.21.15.91:0/779042692 shutdown_connections 2023-11-27T20:41:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.689+0000 7fb2290a6640 1 --2- 172.21.15.91:0/779042692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2240c3ea0 0x7fb2240c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.689+0000 7fb2290a6640 1 --2- 172.21.15.91:0/779042692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb22414fd30 0x7fb224152f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.689+0000 7fb2290a6640 1 -- 172.21.15.91:0/779042692 >> 172.21.15.91:0/779042692 conn(0x7fb22406a500 msgr2=0x7fb22406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.689+0000 7fb2290a6640 1 -- 172.21.15.91:0/779042692 shutdown_connections 2023-11-27T20:41:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.689+0000 7fb2290a6640 1 -- 172.21.15.91:0/779042692 wait complete. 2023-11-27T20:41:48.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.690+0000 7fb2290a6640 1 Processor -- start 2023-11-27T20:41:48.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.691+0000 7fb2290a6640 1 -- start start 2023-11-27T20:41:48.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.691+0000 7fb2290a6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb22406d0a0 0x7fb2240a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb2290a6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2240c3ea0 0x7fb2241ea220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb2290a6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb22414fd30 0x7fb2240a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb2290a6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22414f290 con 0x7fb2240c3ea0 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb2290a6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2241ddd40 con 0x7fb22406d0a0 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb2290a6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2241eaae0 con 0x7fb22414fd30 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb21bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2240c3ea0 0x7fb2241ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb21bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2240c3ea0 0x7fb2241ea220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49638/0 (socket says 172.21.15.91:49638) 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb21bfff640 1 -- 172.21.15.91:0/1152641912 learned_addr learned my addr 172.21.15.91:0/1152641912 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb222d9d640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb22406d0a0 0x7fb2240a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb22359e640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb22414fd30 0x7fb2240a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb21bfff640 1 -- 172.21.15.91:0/1152641912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb22414fd30 msgr2=0x7fb2240a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb21bfff640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb22414fd30 0x7fb2240a8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb21bfff640 1 -- 172.21.15.91:0/1152641912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb22406d0a0 msgr2=0x7fb2240a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb21bfff640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb22406d0a0 0x7fb2240a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb21bfff640 1 -- 172.21.15.91:0/1152641912 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2140094d0 con 0x7fb2240c3ea0 2023-11-27T20:41:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.692+0000 7fb222d9d640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb22406d0a0 0x7fb2240a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.693+0000 7fb21bfff640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2240c3ea0 0x7fb2241ea220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00c3e0 tx=0x7fb20c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:48.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.693+0000 7fb21b7fe640 1 -- 172.21.15.91:0/1152641912 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0035f0 con 0x7fb2240c3ea0 2023-11-27T20:41:48.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.693+0000 7fb21b7fe640 1 -- 172.21.15.91:0/1152641912 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c003750 con 0x7fb2240c3ea0 2023-11-27T20:41:48.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.693+0000 7fb21b7fe640 1 -- 172.21.15.91:0/1152641912 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c003b20 con 0x7fb2240c3ea0 2023-11-27T20:41:48.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.693+0000 7fb2290a6640 1 -- 172.21.15.91:0/1152641912 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2241eadc0 con 0x7fb2240c3ea0 2023-11-27T20:41:48.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.693+0000 7fb2290a6640 1 -- 172.21.15.91:0/1152641912 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2241dd940 con 0x7fb2240c3ea0 2023-11-27T20:41:48.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.694+0000 7fb2290a6640 1 -- 172.21.15.91:0/1152641912 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2241ddb00 con 0x7fb2240c3ea0 2023-11-27T20:41:48.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.695+0000 7fb21b7fe640 1 -- 172.21.15.91:0/1152641912 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb20c003c80 con 0x7fb2240c3ea0 2023-11-27T20:41:48.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.696+0000 7fb21b7fe640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb20406b1c0 0x7fb20406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:48.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.696+0000 7fb21b7fe640 1 -- 172.21.15.91:0/1152641912 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb20c089040 con 0x7fb2240c3ea0 2023-11-27T20:41:48.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.696+0000 7fb222d9d640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb20406b1c0 0x7fb20406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:48.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.697+0000 7fb222d9d640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb20406b1c0 0x7fb20406d680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb214036000 tx=0x7fb21403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:48.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.700+0000 7fb21b7fe640 1 -- 172.21.15.91:0/1152641912 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb20c053d70 con 0x7fb2240c3ea0 2023-11-27T20:41:48.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.891+0000 7fb2290a6640 1 -- 172.21.15.91:0/1152641912 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb224068350 con 0x7fb2240c3ea0 2023-11-27T20:41:48.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.893+0000 7fb21b7fe640 1 -- 172.21.15.91:0/1152641912 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fb20c017090 con 0x7fb2240c3ea0 2023-11-27T20:41:48.894 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:48.895 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:48.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.895+0000 7fb2290a6640 1 -- 172.21.15.91:0/1152641912 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb20406b1c0 msgr2=0x7fb20406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.895+0000 7fb2290a6640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb20406b1c0 0x7fb20406d680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb214036000 tx=0x7fb21403b040 comp rx=0 tx=0).stop 2023-11-27T20:41:48.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.895+0000 7fb2290a6640 1 -- 172.21.15.91:0/1152641912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2240c3ea0 msgr2=0x7fb2241ea220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:48.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.895+0000 7fb2290a6640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2240c3ea0 0x7fb2241ea220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00c3e0 tx=0x7fb20c00c8a0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.895+0000 7fb2290a6640 1 -- 172.21.15.91:0/1152641912 shutdown_connections 2023-11-27T20:41:48.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.895+0000 7fb2290a6640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb22414fd30 0x7fb2240a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.895+0000 7fb2290a6640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2240c3ea0 0x7fb2241ea220 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.895+0000 7fb2290a6640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb20406b1c0 0x7fb20406d680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.895+0000 7fb2290a6640 1 --2- 172.21.15.91:0/1152641912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb22406d0a0 0x7fb2240a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.895+0000 7fb2290a6640 1 -- 172.21.15.91:0/1152641912 >> 172.21.15.91:0/1152641912 conn(0x7fb22406a500 msgr2=0x7fb22406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.896+0000 7fb2290a6640 1 -- 172.21.15.91:0/1152641912 shutdown_connections 2023-11-27T20:41:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:48.896+0000 7fb2290a6640 1 -- 172.21.15.91:0/1152641912 wait complete. 2023-11-27T20:41:48.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:41:32.704555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:41:33.818847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:41:48.917 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:41:49.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.131+0000 7f90a2f05640 1 Processor -- start 2023-11-27T20:41:49.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.132+0000 7f90a2f05640 1 -- start start 2023-11-27T20:41:49.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.133+0000 7f90a2f05640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f909c14fd30 0x7f909c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.133+0000 7f90a2f05640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f909c0c3ea0 0x7f909c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.133+0000 7f90a2f05640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c0c64a0 con 0x7f909c06d0a0 2023-11-27T20:41:49.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.133+0000 7f90a2f05640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c0c5c00 con 0x7f909c14fd30 2023-11-27T20:41:49.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.133+0000 7f90a2f05640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0c5ee0 con 0x7f909c0c3ea0 2023-11-27T20:41:49.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.133+0000 7f90a0ca1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f909c14fd30 0x7f909c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.133+0000 7f90a0ca1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f909c14fd30 0x7f909c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49648/0 (socket says 172.21.15.91:49648) 2023-11-27T20:41:49.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.133+0000 7f90a0ca1640 1 -- 172.21.15.91:0/3058704425 learned_addr learned my addr 172.21.15.91:0/3058704425 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:49.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.134+0000 7f90a0ca1640 1 -- 172.21.15.91:0/3058704425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f909c0c3ea0 msgr2=0x7f909c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:49.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.134+0000 7f90a0ca1640 1 --2- 172.21.15.91:0/3058704425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f909c0c3ea0 0x7f909c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.134+0000 7f90a0ca1640 1 -- 172.21.15.91:0/3058704425 >> v1:172.21.15.183:6789/0 conn(0x7f909c06d0a0 legacy=0x7f909c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:49.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.134+0000 7f90a0ca1640 1 -- 172.21.15.91:0/3058704425 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c0c61c0 con 0x7f909c14fd30 2023-11-27T20:41:49.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.135+0000 7f90a0ca1640 1 --2- 172.21.15.91:0/3058704425 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c14fd30 0x7f909c152f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f908c009e50 tx=0x7f908c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5a0d7852ecfb6d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:49.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.135+0000 7f909b7fe640 1 -- 172.21.15.91:0/3058704425 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c02ca80 con 0x7f909c14fd30 2023-11-27T20:41:49.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.135+0000 7f909b7fe640 1 -- 172.21.15.91:0/3058704425 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c02cbe0 con 0x7f909c14fd30 2023-11-27T20:41:49.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.135+0000 7f909b7fe640 1 -- 172.21.15.91:0/3058704425 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0343f0 con 0x7f909c14fd30 2023-11-27T20:41:49.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.136+0000 7f90a2f05640 1 -- 172.21.15.91:0/3058704425 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c14fd30 msgr2=0x7f909c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.136+0000 7f90a2f05640 1 --2- 172.21.15.91:0/3058704425 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c14fd30 0x7f909c152f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f908c009e50 tx=0x7f908c02bee0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.136+0000 7f90a2f05640 1 -- 172.21.15.91:0/3058704425 shutdown_connections 2023-11-27T20:41:49.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.136+0000 7f90a2f05640 1 --2- 172.21.15.91:0/3058704425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f909c0c3ea0 0x7f909c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.136+0000 7f90a2f05640 1 --2- 172.21.15.91:0/3058704425 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c14fd30 0x7f909c152f20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.136+0000 7f90a2f05640 1 -- 172.21.15.91:0/3058704425 >> 172.21.15.91:0/3058704425 conn(0x7f909c06a500 msgr2=0x7f909c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:49.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.136+0000 7f90a2f05640 1 -- 172.21.15.91:0/3058704425 shutdown_connections 2023-11-27T20:41:49.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.136+0000 7f90a2f05640 1 -- 172.21.15.91:0/3058704425 wait complete. 2023-11-27T20:41:49.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.138+0000 7f90a2f05640 1 Processor -- start 2023-11-27T20:41:49.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.138+0000 7f90a2f05640 1 -- start start 2023-11-27T20:41:49.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a2f05640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c06d0a0 0x7f909c0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a2f05640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f909c0c3ea0 0x7f909c0bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a2f05640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f909c14fd30 0x7f909c14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a2f05640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c1dcb20 con 0x7f909c06d0a0 2023-11-27T20:41:49.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a2f05640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c1dce00 con 0x7f909c0c3ea0 2023-11-27T20:41:49.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a2f05640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c14f270 con 0x7f909c14fd30 2023-11-27T20:41:49.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a0ca1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c06d0a0 0x7f909c0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a0ca1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c06d0a0 0x7f909c0bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49664/0 (socket says 172.21.15.91:49664) 2023-11-27T20:41:49.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a0ca1640 1 -- 172.21.15.91:0/2758835481 learned_addr learned my addr 172.21.15.91:0/2758835481 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:49.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a0ca1640 1 -- 172.21.15.91:0/2758835481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f909c14fd30 msgr2=0x7f909c14e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f90a14a2640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f909c14fd30 0x7f909c14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.139+0000 7f909bfff640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f909c0c3ea0 0x7f909c0bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90a0ca1640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f909c14fd30 0x7f909c14e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90a0ca1640 1 -- 172.21.15.91:0/2758835481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f909c0c3ea0 msgr2=0x7f909c0bf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90a0ca1640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f909c0c3ea0 0x7f909c0bf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90a0ca1640 1 -- 172.21.15.91:0/2758835481 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c009b30 con 0x7f909c06d0a0 2023-11-27T20:41:49.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f909bfff640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f909c0c3ea0 0x7f909c0bf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:49.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90a14a2640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f909c14fd30 0x7f909c14e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:49.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90a0ca1640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c06d0a0 0x7f909c0bf360 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f908c036040 tx=0x7f908c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:49.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90997fa640 1 -- 172.21.15.91:0/2758835481 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c03e450 con 0x7f909c06d0a0 2023-11-27T20:41:49.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90997fa640 1 -- 172.21.15.91:0/2758835481 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c03e5f0 con 0x7f909c06d0a0 2023-11-27T20:41:49.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90997fa640 1 -- 172.21.15.91:0/2758835481 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c03e9a0 con 0x7f909c06d0a0 2023-11-27T20:41:49.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90a2f05640 1 -- 172.21.15.91:0/2758835481 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c14ef90 con 0x7f909c06d0a0 2023-11-27T20:41:49.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.140+0000 7f90a2f05640 1 -- 172.21.15.91:0/2758835481 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c1eb0e0 con 0x7f909c06d0a0 2023-11-27T20:41:49.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.142+0000 7f90a2f05640 1 -- 172.21.15.91:0/2758835481 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c068350 con 0x7f909c06d0a0 2023-11-27T20:41:49.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.142+0000 7f90997fa640 1 -- 172.21.15.91:0/2758835481 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f908c02cd50 con 0x7f909c06d0a0 2023-11-27T20:41:49.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.143+0000 7f90997fa640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f907c06b1f0 0x7f907c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.143+0000 7f90997fa640 1 -- 172.21.15.91:0/2758835481 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f908c0ac4e0 con 0x7f909c06d0a0 2023-11-27T20:41:49.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.143+0000 7f909bfff640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f907c06b1f0 0x7f907c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.144+0000 7f909bfff640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f907c06b1f0 0x7f907c06d6b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f909c0a4da0 tx=0x7f9084008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:49.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.147+0000 7f90997fa640 1 -- 172.21.15.91:0/2758835481 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f908c077320 con 0x7f909c06d0a0 2023-11-27T20:41:49.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.336+0000 7f90a2f05640 1 -- 172.21.15.91:0/2758835481 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f909c0a8900 con 0x7f909c06d0a0 2023-11-27T20:41:49.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.336+0000 7f90997fa640 1 -- 172.21.15.91:0/2758835481 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f908c047e90 con 0x7f909c06d0a0 2023-11-27T20:41:49.338 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:41:49.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 -- 172.21.15.91:0/2758835481 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f907c06b1f0 msgr2=0x7f907c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f907c06b1f0 0x7f907c06d6b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f909c0a4da0 tx=0x7f9084008040 comp rx=0 tx=0).stop 2023-11-27T20:41:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 -- 172.21.15.91:0/2758835481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c06d0a0 msgr2=0x7f909c0bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c06d0a0 0x7f909c0bf360 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f908c036040 tx=0x7f908c004a40 comp rx=0 tx=0).stop 2023-11-27T20:41:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 -- 172.21.15.91:0/2758835481 shutdown_connections 2023-11-27T20:41:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f909c14fd30 0x7f909c14e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f907c06b1f0 0x7f907c06d6b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f909c0c3ea0 0x7f909c0bf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 --2- 172.21.15.91:0/2758835481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f909c06d0a0 0x7f909c0bf360 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 -- 172.21.15.91:0/2758835481 >> 172.21.15.91:0/2758835481 conn(0x7f909c06a500 msgr2=0x7f909c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 -- 172.21.15.91:0/2758835481 shutdown_connections 2023-11-27T20:41:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.339+0000 7f90a2f05640 1 -- 172.21.15.91:0/2758835481 wait complete. 2023-11-27T20:41:49.358 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:41:49.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.577+0000 7f9903690640 1 Processor -- start 2023-11-27T20:41:49.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.577+0000 7f9903690640 1 -- start start 2023-11-27T20:41:49.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.578+0000 7f9903690640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f98fc14fd30 0x7f98fc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9903690640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f98fc0c3ea0 0x7f98fc0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9903690640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98fc0c64a0 con 0x7f98fc06d0a0 2023-11-27T20:41:49.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9903690640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc0c5c00 con 0x7f98fc0c3ea0 2023-11-27T20:41:49.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9903690640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc0c5ee0 con 0x7f98fc14fd30 2023-11-27T20:41:49.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9901c2d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f98fc0c3ea0 0x7f98fc0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9901c2d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f98fc0c3ea0 0x7f98fc0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49668/0 (socket says 172.21.15.91:49668) 2023-11-27T20:41:49.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9901c2d640 1 -- 172.21.15.91:0/3755548024 learned_addr learned my addr 172.21.15.91:0/3755548024 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:49.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9900c2b640 1 --1- 172.21.15.91:0/3755548024 >> v1:172.21.15.91:6789/0 conn(0x7f98fc06d0a0 0x7f98fc0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34056/0 (socket says 172.21.15.91:34056) 2023-11-27T20:41:49.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f990142c640 1 --2- 172.21.15.91:0/3755548024 >> v2:172.21.15.183:3300/0 conn(0x7f98fc14fd30 0x7f98fc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9901c2d640 1 -- 172.21.15.91:0/3755548024 >> v2:172.21.15.183:3300/0 conn(0x7f98fc14fd30 msgr2=0x7f98fc152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:49.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9901c2d640 1 --2- 172.21.15.91:0/3755548024 >> v2:172.21.15.183:3300/0 conn(0x7f98fc14fd30 0x7f98fc152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9901c2d640 1 -- 172.21.15.91:0/3755548024 >> v1:172.21.15.91:6789/0 conn(0x7f98fc06d0a0 legacy=0x7f98fc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.579+0000 7f9901c2d640 1 -- 172.21.15.91:0/3755548024 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0c61c0 con 0x7f98fc0c3ea0 2023-11-27T20:41:49.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.580+0000 7f9901c2d640 1 --2- 172.21.15.91:0/3755548024 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc0c3ea0 0x7f98fc0c4330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f98fc06b200 tx=0x7f98f402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a4b32bff4e1534 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:49.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.581+0000 7f98f3fff640 1 -- 172.21.15.91:0/3755548024 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f402cb10 con 0x7f98fc0c3ea0 2023-11-27T20:41:49.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.581+0000 7f98f3fff640 1 -- 172.21.15.91:0/3755548024 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f402cc70 con 0x7f98fc0c3ea0 2023-11-27T20:41:49.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.581+0000 7f98f3fff640 1 -- 172.21.15.91:0/3755548024 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40343f0 con 0x7f98fc0c3ea0 2023-11-27T20:41:49.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.581+0000 7f9903690640 1 -- 172.21.15.91:0/3755548024 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc0c3ea0 msgr2=0x7f98fc0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.581+0000 7f9903690640 1 --2- 172.21.15.91:0/3755548024 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc0c3ea0 0x7f98fc0c4330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f98fc06b200 tx=0x7f98f402bf70 comp rx=0 tx=0).stop 2023-11-27T20:41:49.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.582+0000 7f9903690640 1 -- 172.21.15.91:0/3755548024 shutdown_connections 2023-11-27T20:41:49.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.582+0000 7f9903690640 1 --2- 172.21.15.91:0/3755548024 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc0c3ea0 0x7f98fc0c4330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.582+0000 7f9903690640 1 --2- 172.21.15.91:0/3755548024 >> v2:172.21.15.183:3300/0 conn(0x7f98fc14fd30 0x7f98fc152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.582+0000 7f9903690640 1 -- 172.21.15.91:0/3755548024 >> 172.21.15.91:0/3755548024 conn(0x7f98fc06a500 msgr2=0x7f98fc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:49.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.582+0000 7f9903690640 1 -- 172.21.15.91:0/3755548024 shutdown_connections 2023-11-27T20:41:49.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.582+0000 7f9903690640 1 -- 172.21.15.91:0/3755548024 wait complete. 2023-11-27T20:41:49.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.584+0000 7f9903690640 1 Processor -- start 2023-11-27T20:41:49.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.584+0000 7f9903690640 1 -- start start 2023-11-27T20:41:49.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.585+0000 7f9903690640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98fc06d0a0 0x7f98fc14e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.585+0000 7f9903690640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98fc0c3ea0 0x7f98fc14ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.585+0000 7f9903690640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc14fd30 0x7f98fc1eb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.585+0000 7f9903690640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc14f3a0 con 0x7f98fc14fd30 2023-11-27T20:41:49.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.585+0000 7f9903690640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0bb960 con 0x7f98fc0c3ea0 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.585+0000 7f9903690640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc1e8f50 con 0x7f98fc06d0a0 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.585+0000 7f9901c2d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc14fd30 0x7f98fc1eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.585+0000 7f9901c2d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc14fd30 0x7f98fc1eb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49674/0 (socket says 172.21.15.91:49674) 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.585+0000 7f9901c2d640 1 -- 172.21.15.91:0/916168950 learned_addr learned my addr 172.21.15.91:0/916168950 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.586+0000 7f990142c640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98fc06d0a0 0x7f98fc14e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.586+0000 7f9900c2b640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98fc0c3ea0 0x7f98fc14ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.586+0000 7f9901c2d640 1 -- 172.21.15.91:0/916168950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98fc06d0a0 msgr2=0x7f98fc14e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.586+0000 7f9901c2d640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98fc06d0a0 0x7f98fc14e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.586+0000 7f9901c2d640 1 -- 172.21.15.91:0/916168950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98fc0c3ea0 msgr2=0x7f98fc14ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.586+0000 7f9901c2d640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98fc0c3ea0 0x7f98fc14ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.586+0000 7f9901c2d640 1 -- 172.21.15.91:0/916168950 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f4009b30 con 0x7f98fc14fd30 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.586+0000 7f9900c2b640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98fc0c3ea0 0x7f98fc14ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:49.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.586+0000 7f9901c2d640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc14fd30 0x7f98fc1eb220 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f98f4036040 tx=0x7f98f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:49.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.587+0000 7f98f1ffb640 1 -- 172.21.15.91:0/916168950 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4009510 con 0x7f98fc14fd30 2023-11-27T20:41:49.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.587+0000 7f98f1ffb640 1 -- 172.21.15.91:0/916168950 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f403e450 con 0x7f98fc14fd30 2023-11-27T20:41:49.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.587+0000 7f98f1ffb640 1 -- 172.21.15.91:0/916168950 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f403e7e0 con 0x7f98fc14fd30 2023-11-27T20:41:49.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.587+0000 7f9903690640 1 -- 172.21.15.91:0/916168950 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc1dccc0 con 0x7f98fc14fd30 2023-11-27T20:41:49.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.587+0000 7f9903690640 1 -- 172.21.15.91:0/916168950 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc1e94d0 con 0x7f98fc14fd30 2023-11-27T20:41:49.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.588+0000 7f9903690640 1 -- 172.21.15.91:0/916168950 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc1e96c0 con 0x7f98fc14fd30 2023-11-27T20:41:49.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.589+0000 7f98f1ffb640 1 -- 172.21.15.91:0/916168950 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f98f403e940 con 0x7f98fc14fd30 2023-11-27T20:41:49.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.590+0000 7f98f1ffb640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98e006b1f0 0x7f98e006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:49.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.590+0000 7f98f1ffb640 1 -- 172.21.15.91:0/916168950 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98f40ac610 con 0x7f98fc14fd30 2023-11-27T20:41:49.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.590+0000 7f990142c640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98e006b1f0 0x7f98e006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:49.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.590+0000 7f990142c640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98e006b1f0 0x7f98e006d6b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f98f8006fd0 tx=0x7f98f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:49.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.594+0000 7f98f1ffb640 1 -- 172.21.15.91:0/916168950 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f98f40772a0 con 0x7f98fc14fd30 2023-11-27T20:41:49.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.783+0000 7f9903690640 1 -- 172.21.15.91:0/916168950 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98fc068350 con 0x7f98fc14fd30 2023-11-27T20:41:49.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.784+0000 7f98f1ffb640 1 -- 172.21.15.91:0/916168950 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98f4047e90 con 0x7f98fc14fd30 2023-11-27T20:41:49.786 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:41:49.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 -- 172.21.15.91:0/916168950 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98e006b1f0 msgr2=0x7f98e006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98e006b1f0 0x7f98e006d6b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f98f8006fd0 tx=0x7f98f8008040 comp rx=0 tx=0).stop 2023-11-27T20:41:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 -- 172.21.15.91:0/916168950 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc14fd30 msgr2=0x7f98fc1eb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc14fd30 0x7f98fc1eb220 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f98f4036040 tx=0x7f98f4004a40 comp rx=0 tx=0).stop 2023-11-27T20:41:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 -- 172.21.15.91:0/916168950 shutdown_connections 2023-11-27T20:41:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f98fc14fd30 0x7f98fc1eb220 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98e006b1f0 0x7f98e006d6b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98fc0c3ea0 0x7f98fc14ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 --2- 172.21.15.91:0/916168950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98fc06d0a0 0x7f98fc14e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:49.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 -- 172.21.15.91:0/916168950 >> 172.21.15.91:0/916168950 conn(0x7f98fc06a500 msgr2=0x7f98fc0c2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:49.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.786+0000 7f9903690640 1 -- 172.21.15.91:0/916168950 shutdown_connections 2023-11-27T20:41:49.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:49.787+0000 7f9903690640 1 -- 172.21.15.91:0/916168950 wait complete. 2023-11-27T20:41:49.807 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:41:50.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.021+0000 7fbd451d7640 1 Processor -- start 2023-11-27T20:41:50.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.021+0000 7fbd451d7640 1 -- start start 2023-11-27T20:41:50.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.023+0000 7fbd451d7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd400c7fc0 0x7fbd400c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.023+0000 7fbd451d7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd400c1da0 con 0x7fbd40155790 2023-11-27T20:41:50.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.023+0000 7fbd451d7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd400c2080 con 0x7fbd400c7700 2023-11-27T20:41:50.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.023+0000 7fbd451d7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400c3ee0 con 0x7fbd400c7fc0 2023-11-27T20:41:50.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.023+0000 7fbd3f59e640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fbd40155790 0x7fbd400c6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34070/0 (socket says 172.21.15.91:34070) 2023-11-27T20:41:50.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.023+0000 7fbd3f59e640 1 -- 172.21.15.91:0/795267295 learned_addr learned my addr 172.21.15.91:0/795267295 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:50.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3ed9d640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd400c7fc0 0x7fbd400c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762166916 0 0) 0x7fbd400c1da0 con 0x7fbd40155790 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd2c003520 con 0x7fbd40155790 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 561720073 0 0) 0x7fbd2c003520 con 0x7fbd40155790 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd400c7fc0 msgr2=0x7fbd400c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd400c7fc0 0x7fbd400c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 >> v1:172.21.15.183:6789/0 conn(0x7fbd400c7700 legacy=0x7fbd40155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd400c5d60 con 0x7fbd40155790 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fbd38001670 con 0x7fbd40155790 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 >> v1:172.21.15.91:6789/0 conn(0x7fbd40155790 legacy=0x7fbd400c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd2c0039a0 0x7fbd2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd400c7fc0 0x7fbd2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd2c004d00 0x7fbd2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400c3ee0 con 0x7fbd2c004d00 2023-11-27T20:41:50.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c00bab0 con 0x7fbd2c0039a0 2023-11-27T20:41:50.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.024+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c00bc70 con 0x7fbd400c7fc0 2023-11-27T20:41:50.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.025+0000 7fbd3f59e640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd2c004d00 0x7fbd2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.025+0000 7fbd3e59c640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd400c7fc0 0x7fbd2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.025+0000 7fbd3ed9d640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd2c0039a0 0x7fbd2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.025+0000 7fbd3f59e640 1 -- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd400c7fc0 msgr2=0x7fbd2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:50.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.025+0000 7fbd3f59e640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd400c7fc0 0x7fbd2c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.025+0000 7fbd3f59e640 1 -- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd2c0039a0 msgr2=0x7fbd2c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:50.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.025+0000 7fbd3f59e640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd2c0039a0 0x7fbd2c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.025+0000 7fbd3f59e640 1 -- 172.21.15.91:0/795267295 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c003520 con 0x7fbd2c004d00 2023-11-27T20:41:50.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.026+0000 7fbd3f59e640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd2c004d00 0x7fbd2c005180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800c240 tx=0x7fbd2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ed14bcd627263f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:50.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.026+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38005ad0 con 0x7fbd2c004d00 2023-11-27T20:41:50.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.026+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd38005c30 con 0x7fbd2c004d00 2023-11-27T20:41:50.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.026+0000 7fbd3dd9b640 1 -- 172.21.15.91:0/795267295 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3802c8b0 con 0x7fbd2c004d00 2023-11-27T20:41:50.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.027+0000 7fbd451d7640 1 -- 172.21.15.91:0/795267295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd2c004d00 msgr2=0x7fbd2c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.027+0000 7fbd451d7640 1 --2- 172.21.15.91:0/795267295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd2c004d00 0x7fbd2c005180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800c240 tx=0x7fbd2c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.027+0000 7fbd3f59e640 1 -- 172.21.15.91:0/795267295 reap_dead start 2023-11-27T20:41:50.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.027+0000 7fbd451d7640 1 -- 172.21.15.91:0/795267295 shutdown_connections 2023-11-27T20:41:50.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.027+0000 7fbd451d7640 1 -- 172.21.15.91:0/795267295 >> 172.21.15.91:0/795267295 conn(0x7fbd400a9b70 msgr2=0x7fbd400a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:50.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.027+0000 7fbd451d7640 1 -- 172.21.15.91:0/795267295 shutdown_connections 2023-11-27T20:41:50.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.027+0000 7fbd451d7640 1 -- 172.21.15.91:0/795267295 wait complete. 2023-11-27T20:41:50.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.029+0000 7fbd451d7640 1 Processor -- start 2023-11-27T20:41:50.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.029+0000 7fbd451d7640 1 -- start start 2023-11-27T20:41:50.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd451d7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2c004d00 0x7fbd401e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd451d7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd40155cd0 0x7fbd4006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd451d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd401ee1e0 0x7fbd40156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd451d7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400c7b90 con 0x7fbd401ee1e0 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd451d7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401e7c10 con 0x7fbd40155cd0 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd451d7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401ed4f0 con 0x7fbd2c004d00 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3f59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd401ee1e0 0x7fbd40156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3f59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd401ee1e0 0x7fbd40156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49686/0 (socket says 172.21.15.91:49686) 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3f59e640 1 -- 172.21.15.91:0/292091286 learned_addr learned my addr 172.21.15.91:0/292091286 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3ed9d640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2c004d00 0x7fbd401e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3e59c640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd40155cd0 0x7fbd4006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3f59e640 1 -- 172.21.15.91:0/292091286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2c004d00 msgr2=0x7fbd401e76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3f59e640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2c004d00 0x7fbd401e76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3f59e640 1 -- 172.21.15.91:0/292091286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd40155cd0 msgr2=0x7fbd4006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3f59e640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd40155cd0 0x7fbd4006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3f59e640 1 -- 172.21.15.91:0/292091286 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd401e9ed0 con 0x7fbd401ee1e0 2023-11-27T20:41:50.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3ed9d640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2c004d00 0x7fbd401e76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:50.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.030+0000 7fbd3e59c640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd40155cd0 0x7fbd4006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:50.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.031+0000 7fbd3f59e640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd401ee1e0 0x7fbd40156860 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000c00 tx=0x7fbd3802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:50.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.031+0000 7fbd377fe640 1 -- 172.21.15.91:0/292091286 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3803c040 con 0x7fbd401ee1e0 2023-11-27T20:41:50.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.031+0000 7fbd377fe640 1 -- 172.21.15.91:0/292091286 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3802ccc0 con 0x7fbd401ee1e0 2023-11-27T20:41:50.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.031+0000 7fbd377fe640 1 -- 172.21.15.91:0/292091286 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38007290 con 0x7fbd401ee1e0 2023-11-27T20:41:50.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.031+0000 7fbd451d7640 1 -- 172.21.15.91:0/292091286 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd401ea130 con 0x7fbd401ee1e0 2023-11-27T20:41:50.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.031+0000 7fbd451d7640 1 -- 172.21.15.91:0/292091286 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd401ed9e0 con 0x7fbd401ee1e0 2023-11-27T20:41:50.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.032+0000 7fbd451d7640 1 -- 172.21.15.91:0/292091286 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd40068350 con 0x7fbd401ee1e0 2023-11-27T20:41:50.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.033+0000 7fbd377fe640 1 -- 172.21.15.91:0/292091286 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbd38032070 con 0x7fbd401ee1e0 2023-11-27T20:41:50.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.034+0000 7fbd377fe640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbd2006b1c0 0x7fbd2006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.034+0000 7fbd377fe640 1 -- 172.21.15.91:0/292091286 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd380aa5b0 con 0x7fbd401ee1e0 2023-11-27T20:41:50.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.034+0000 7fbd3ed9d640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbd2006b1c0 0x7fbd2006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.035+0000 7fbd3ed9d640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbd2006b1c0 0x7fbd2006d680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd4014d1b0 tx=0x7fbd3000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:50.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.039+0000 7fbd377fe640 1 -- 172.21.15.91:0/292091286 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbd380752d0 con 0x7fbd401ee1e0 2023-11-27T20:41:50.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.228+0000 7fbd451d7640 1 -- 172.21.15.91:0/292091286 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd4014d1e0 con 0x7fbd401ee1e0 2023-11-27T20:41:50.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.229+0000 7fbd377fe640 1 -- 172.21.15.91:0/292091286 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd380a8e60 con 0x7fbd401ee1e0 2023-11-27T20:41:50.231 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:41:50.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.232+0000 7fbd451d7640 1 -- 172.21.15.91:0/292091286 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbd2006b1c0 msgr2=0x7fbd2006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.232+0000 7fbd451d7640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbd2006b1c0 0x7fbd2006d680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd4014d1b0 tx=0x7fbd3000b040 comp rx=0 tx=0).stop 2023-11-27T20:41:50.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.232+0000 7fbd451d7640 1 -- 172.21.15.91:0/292091286 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd401ee1e0 msgr2=0x7fbd40156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.232+0000 7fbd451d7640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd401ee1e0 0x7fbd40156860 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000c00 tx=0x7fbd3802e070 comp rx=0 tx=0).stop 2023-11-27T20:41:50.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.232+0000 7fbd451d7640 1 -- 172.21.15.91:0/292091286 shutdown_connections 2023-11-27T20:41:50.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.232+0000 7fbd451d7640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd401ee1e0 0x7fbd40156860 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.232+0000 7fbd451d7640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbd2006b1c0 0x7fbd2006d680 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.232+0000 7fbd451d7640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd40155cd0 0x7fbd4006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.233+0000 7fbd451d7640 1 --2- 172.21.15.91:0/292091286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2c004d00 0x7fbd401e76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.233+0000 7fbd451d7640 1 -- 172.21.15.91:0/292091286 >> 172.21.15.91:0/292091286 conn(0x7fbd400a9b70 msgr2=0x7fbd4006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:50.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.233+0000 7fbd451d7640 1 -- 172.21.15.91:0/292091286 shutdown_connections 2023-11-27T20:41:50.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.233+0000 7fbd451d7640 1 -- 172.21.15.91:0/292091286 wait complete. 2023-11-27T20:41:50.251 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:41:50.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.453+0000 7fedd161c640 1 Processor -- start 2023-11-27T20:41:50.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.453+0000 7fedd161c640 1 -- start start 2023-11-27T20:41:50.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedd161c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedcc155490 0x7fedcc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedd161c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fedcc0c1500 0x7fedcc0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedd161c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fedcc0c4080 0x7fedcc0a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedd161c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc0a5820 con 0x7fedcc0c4080 2023-11-27T20:41:50.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedd161c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc0c06c0 con 0x7fedcc0c1500 2023-11-27T20:41:50.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedd161c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc0c1020 con 0x7fedcc155490 2023-11-27T20:41:50.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedcb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fedcc0c4080 0x7fedcc0a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedcb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fedcc0c4080 0x7fedcc0a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49702/0 (socket says 172.21.15.91:49702) 2023-11-27T20:41:50.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedcb7fe640 1 -- 172.21.15.91:0/3006233304 learned_addr learned my addr 172.21.15.91:0/3006233304 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:50.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedcaffd640 1 --2- 172.21.15.91:0/3006233304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedcc155490 0x7fedcc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedcb7fe640 1 -- 172.21.15.91:0/3006233304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedcc155490 msgr2=0x7fedcc0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:50.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedcb7fe640 1 --2- 172.21.15.91:0/3006233304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedcc155490 0x7fedcc0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedc3fff640 1 --2- 172.21.15.91:0/3006233304 >> v2:172.21.15.183:3300/0 conn(0x7fedcc0c1500 0x7fedcc0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.455+0000 7fedcb7fe640 1 -- 172.21.15.91:0/3006233304 >> v2:172.21.15.183:3300/0 conn(0x7fedcc0c1500 msgr2=0x7fedcc0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:50.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.456+0000 7fedcb7fe640 1 --2- 172.21.15.91:0/3006233304 >> v2:172.21.15.183:3300/0 conn(0x7fedcc0c1500 0x7fedcc0a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.456+0000 7fedcb7fe640 1 -- 172.21.15.91:0/3006233304 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc0c0910 con 0x7fedcc0c4080 2023-11-27T20:41:50.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.456+0000 7fedcaffd640 1 --2- 172.21.15.91:0/3006233304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedcc155490 0x7fedcc0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:50.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.456+0000 7fedc3fff640 1 --2- 172.21.15.91:0/3006233304 >> v2:172.21.15.183:3300/0 conn(0x7fedcc0c1500 0x7fedcc0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:50.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.457+0000 7fedcb7fe640 1 --2- 172.21.15.91:0/3006233304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc0c4080 0x7fedcc0a9970 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fedcc06b280 tx=0x7fedc402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3e8d78b67da5e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:50.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.457+0000 7fedca7fc640 1 -- 172.21.15.91:0/3006233304 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc402c9e0 con 0x7fedcc0c4080 2023-11-27T20:41:50.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.457+0000 7fedca7fc640 1 -- 172.21.15.91:0/3006233304 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc402cb40 con 0x7fedcc0c4080 2023-11-27T20:41:50.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.457+0000 7fedca7fc640 1 -- 172.21.15.91:0/3006233304 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40343f0 con 0x7fedcc0c4080 2023-11-27T20:41:50.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.457+0000 7fedd161c640 1 -- 172.21.15.91:0/3006233304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc0c4080 msgr2=0x7fedcc0a9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.458+0000 7fedd161c640 1 --2- 172.21.15.91:0/3006233304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc0c4080 0x7fedcc0a9970 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fedcc06b280 tx=0x7fedc402be40 comp rx=0 tx=0).stop 2023-11-27T20:41:50.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.458+0000 7fedd161c640 1 -- 172.21.15.91:0/3006233304 shutdown_connections 2023-11-27T20:41:50.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.458+0000 7fedd161c640 1 --2- 172.21.15.91:0/3006233304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc0c4080 0x7fedcc0a9970 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.458+0000 7fedd161c640 1 --2- 172.21.15.91:0/3006233304 >> v2:172.21.15.183:3300/0 conn(0x7fedcc0c1500 0x7fedcc0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.458+0000 7fedd161c640 1 --2- 172.21.15.91:0/3006233304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedcc155490 0x7fedcc0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.458+0000 7fedd161c640 1 -- 172.21.15.91:0/3006233304 >> 172.21.15.91:0/3006233304 conn(0x7fedcc06a500 msgr2=0x7fedcc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:50.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.458+0000 7fedd161c640 1 -- 172.21.15.91:0/3006233304 shutdown_connections 2023-11-27T20:41:50.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.458+0000 7fedd161c640 1 -- 172.21.15.91:0/3006233304 wait complete. 2023-11-27T20:41:50.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.459+0000 7fedd161c640 1 Processor -- start 2023-11-27T20:41:50.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.460+0000 7fedd161c640 1 -- start start 2023-11-27T20:41:50.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.460+0000 7fedd161c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedcc0c1500 0x7fedcc15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.460+0000 7fedd161c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedcc0c4080 0x7fedcc0a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedd161c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc155490 0x7fedcc152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedd161c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc15a810 con 0x7fedcc155490 2023-11-27T20:41:50.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedd161c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1ee370 con 0x7fedcc0c1500 2023-11-27T20:41:50.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedd161c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1ed760 con 0x7fedcc0c4080 2023-11-27T20:41:50.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedcb7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc155490 0x7fedcc152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedcb7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc155490 0x7fedcc152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49706/0 (socket says 172.21.15.91:49706) 2023-11-27T20:41:50.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedcb7fe640 1 -- 172.21.15.91:0/418964194 learned_addr learned my addr 172.21.15.91:0/418964194 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:50.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedcb7fe640 1 -- 172.21.15.91:0/418964194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedcc0c4080 msgr2=0x7fedcc0a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedcb7fe640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedcc0c4080 0x7fedcc0a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedcb7fe640 1 -- 172.21.15.91:0/418964194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedcc0c1500 msgr2=0x7fedcc15a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedcaffd640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedcc0c1500 0x7fedcc15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedcb7fe640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedcc0c1500 0x7fedcc15a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.461+0000 7fedcb7fe640 1 -- 172.21.15.91:0/418964194 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4009b30 con 0x7fedcc155490 2023-11-27T20:41:50.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.462+0000 7fedcb7fe640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc155490 0x7fedcc152160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fedc4036040 tx=0x7fedc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:50.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.462+0000 7fedc37fe640 1 -- 172.21.15.91:0/418964194 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc403e450 con 0x7fedcc155490 2023-11-27T20:41:50.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.462+0000 7fedc37fe640 1 -- 172.21.15.91:0/418964194 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc403e5b0 con 0x7fedcc155490 2023-11-27T20:41:50.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.462+0000 7fedd161c640 1 -- 172.21.15.91:0/418964194 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc1eda40 con 0x7fedcc155490 2023-11-27T20:41:50.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.462+0000 7fedc37fe640 1 -- 172.21.15.91:0/418964194 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc403e960 con 0x7fedcc155490 2023-11-27T20:41:50.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.462+0000 7fedd161c640 1 -- 172.21.15.91:0/418964194 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc1ee000 con 0x7fedcc155490 2023-11-27T20:41:50.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.463+0000 7fedd161c640 1 -- 172.21.15.91:0/418964194 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc0ac060 con 0x7fedcc155490 2023-11-27T20:41:50.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.464+0000 7fedc37fe640 1 -- 172.21.15.91:0/418964194 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fedc403eac0 con 0x7fedcc155490 2023-11-27T20:41:50.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.465+0000 7fedc37fe640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fedac06b1f0 0x7fedac06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.466+0000 7fedc37fe640 1 -- 172.21.15.91:0/418964194 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedc40ac6c0 con 0x7fedcc155490 2023-11-27T20:41:50.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.466+0000 7fedcaffd640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fedac06b1f0 0x7fedac06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.466+0000 7fedcaffd640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fedac06b1f0 0x7fedac06d6b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00b840 tx=0x7fedbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:50.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.470+0000 7fedc37fe640 1 -- 172.21.15.91:0/418964194 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fedc40773e0 con 0x7fedcc155490 2023-11-27T20:41:50.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.695+0000 7fedd161c640 1 -- 172.21.15.91:0/418964194 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedcc067430 con 0x7fedcc155490 2023-11-27T20:41:50.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.696+0000 7fedc37fe640 1 -- 172.21.15.91:0/418964194 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fedc4047e90 con 0x7fedcc155490 2023-11-27T20:41:50.698 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:50.698 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/636329462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":636329462},{"type":"v1","addr":"172.21.15.91:6836","nonce":636329462}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/433109070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":433109070},{"type":"v1","addr":"172.21.15.91:6837","nonce":433109070}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1419226381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1419226381},{"type":"v1","addr":"172.21.15.183:6835","nonce":1419226381}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:41:34.815589+0000","modified":"2023-11-27T20:41:37.881858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/4022772138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4022772138},{"type":"v1","addr":"172.21.15.183:6834","nonce":4022772138}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:41:50.698 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 8 2023-11-27T20:41:50.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 -- 172.21.15.91:0/418964194 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fedac06b1f0 msgr2=0x7fedac06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fedac06b1f0 0x7fedac06d6b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00b840 tx=0x7fedbc008040 comp rx=0 tx=0).stop 2023-11-27T20:41:50.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 -- 172.21.15.91:0/418964194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc155490 msgr2=0x7fedcc152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc155490 0x7fedcc152160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fedc4036040 tx=0x7fedc4004a40 comp rx=0 tx=0).stop 2023-11-27T20:41:50.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 -- 172.21.15.91:0/418964194 shutdown_connections 2023-11-27T20:41:50.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedcc155490 0x7fedcc152160 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedcc0c4080 0x7fedcc0a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fedac06b1f0 0x7fedac06d6b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 --2- 172.21.15.91:0/418964194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedcc0c1500 0x7fedcc15a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 -- 172.21.15.91:0/418964194 >> 172.21.15.91:0/418964194 conn(0x7fedcc06a500 msgr2=0x7fedcc0c5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:50.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 -- 172.21.15.91:0/418964194 shutdown_connections 2023-11-27T20:41:50.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.699+0000 7fedd161c640 1 -- 172.21.15.91:0/418964194 wait complete. 2023-11-27T20:41:50.720 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:41:50.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.921+0000 7f9f9e0fc640 1 Processor -- start 2023-11-27T20:41:50.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.921+0000 7f9f9e0fc640 1 -- start start 2023-11-27T20:41:50.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.923+0000 7f9f9e0fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f980a9b40 0x7f9f980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.923+0000 7f9f9e0fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9f980c1500 0x7f9f980c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.923+0000 7f9f9e0fc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f980c06c0 con 0x7f9f98155490 2023-11-27T20:41:50.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.923+0000 7f9f9e0fc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f980a5820 con 0x7f9f980c1500 2023-11-27T20:41:50.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.923+0000 7f9f9e0fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980c1020 con 0x7f9f980a9b40 2023-11-27T20:41:50.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.923+0000 7f9f977fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f9f98155490 0x7f9f980a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34078/0 (socket says 172.21.15.91:34078) 2023-11-27T20:41:50.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.923+0000 7f9f97fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9f980c1500 0x7f9f980c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.923+0000 7f9f977fe640 1 -- 172.21.15.91:0/613163405 learned_addr learned my addr 172.21.15.91:0/613163405 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.924+0000 7f9f96ffd640 1 --2- 172.21.15.91:0/613163405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f980a9b40 0x7f9f980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.924+0000 7f9f97fff640 1 -- 172.21.15.91:0/613163405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f980a9b40 msgr2=0x7f9f980a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.924+0000 7f9f97fff640 1 --2- 172.21.15.91:0/613163405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f980a9b40 0x7f9f980a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.924+0000 7f9f97fff640 1 -- 172.21.15.91:0/613163405 >> v1:172.21.15.91:6789/0 conn(0x7f9f98155490 legacy=0x7f9f980a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.924+0000 7f9f97fff640 1 -- 172.21.15.91:0/613163405 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980c0910 con 0x7f9f980c1500 2023-11-27T20:41:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.924+0000 7f9f967fc640 1 -- 172.21.15.91:0/613163405 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235842451 0 0) 0x7f9f980c06c0 con 0x7f9f98155490 2023-11-27T20:41:50.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.925+0000 7f9f97fff640 1 --2- 172.21.15.91:0/613163405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f980c1500 0x7f9f980c24d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009d90 tx=0x7f9f9002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39fe88fc03eb5a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:50.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.925+0000 7f9f967fc640 1 -- 172.21.15.91:0/613163405 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9002cc50 con 0x7f9f980c1500 2023-11-27T20:41:50.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.925+0000 7f9f967fc640 1 -- 172.21.15.91:0/613163405 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9002cdb0 con 0x7f9f980c1500 2023-11-27T20:41:50.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.925+0000 7f9f967fc640 1 -- 172.21.15.91:0/613163405 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90034660 con 0x7f9f980c1500 2023-11-27T20:41:50.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.926+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/613163405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f980c1500 msgr2=0x7f9f980c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.926+0000 7f9f9e0fc640 1 --2- 172.21.15.91:0/613163405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f980c1500 0x7f9f980c24d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009d90 tx=0x7f9f9002bea0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.926+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/613163405 shutdown_connections 2023-11-27T20:41:50.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.926+0000 7f9f9e0fc640 1 --2- 172.21.15.91:0/613163405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f980c1500 0x7f9f980c24d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.926+0000 7f9f9e0fc640 1 --2- 172.21.15.91:0/613163405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f980a9b40 0x7f9f980a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.926+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/613163405 >> 172.21.15.91:0/613163405 conn(0x7f9f9806a500 msgr2=0x7f9f9806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.926+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/613163405 shutdown_connections 2023-11-27T20:41:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.926+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/613163405 wait complete. 2023-11-27T20:41:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.928+0000 7f9f9e0fc640 1 Processor -- start 2023-11-27T20:41:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.928+0000 7f9f9e0fc640 1 -- start start 2023-11-27T20:41:50.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f9e0fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f980c1500 0x7f9f9809a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f9e0fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f98155490 0x7f9f9809aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f9e0fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f98153720 0x7f9f98153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f9e0fc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9809b020 con 0x7f9f98155490 2023-11-27T20:41:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f9e0fc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f981e99d0 con 0x7f9f980c1500 2023-11-27T20:41:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f9e0fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f981e9c90 con 0x7f9f98153720 2023-11-27T20:41:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f96ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f98155490 0x7f9f9809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f96ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f98155490 0x7f9f9809aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49726/0 (socket says 172.21.15.91:49726) 2023-11-27T20:41:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f96ffd640 1 -- 172.21.15.91:0/1989456086 learned_addr learned my addr 172.21.15.91:0/1989456086 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f977fe640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f980c1500 0x7f9f9809a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.929+0000 7f9f97fff640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f98153720 0x7f9f98153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f96ffd640 1 -- 172.21.15.91:0/1989456086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f98153720 msgr2=0x7f9f98153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f96ffd640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f98153720 0x7f9f98153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f96ffd640 1 -- 172.21.15.91:0/1989456086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f980c1500 msgr2=0x7f9f9809a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:50.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f96ffd640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f980c1500 0x7f9f9809a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:50.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f96ffd640 1 -- 172.21.15.91:0/1989456086 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f90009a70 con 0x7f9f98155490 2023-11-27T20:41:50.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f96ffd640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f98155490 0x7f9f9809aae0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00d800 tx=0x7f9f8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:50.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f7ffff640 1 -- 172.21.15.91:0/1989456086 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c00b6c0 con 0x7f9f98155490 2023-11-27T20:41:50.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f7ffff640 1 -- 172.21.15.91:0/1989456086 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c00b820 con 0x7f9f98155490 2023-11-27T20:41:50.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f7ffff640 1 -- 172.21.15.91:0/1989456086 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c00bbb0 con 0x7f9f98155490 2023-11-27T20:41:50.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/1989456086 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f98152c40 con 0x7f9f98155490 2023-11-27T20:41:50.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.930+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/1989456086 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f98153200 con 0x7f9f98155490 2023-11-27T20:41:50.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.932+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/1989456086 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f981533c0 con 0x7f9f98155490 2023-11-27T20:41:50.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.932+0000 7f9f7ffff640 1 -- 172.21.15.91:0/1989456086 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9f8c00bd10 con 0x7f9f98155490 2023-11-27T20:41:50.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.933+0000 7f9f7ffff640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f8406b1c0 0x7f9f8406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:50.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.933+0000 7f9f7ffff640 1 -- 172.21.15.91:0/1989456086 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f8c089fb0 con 0x7f9f98155490 2023-11-27T20:41:50.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.934+0000 7f9f977fe640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f8406b1c0 0x7f9f8406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:50.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.934+0000 7f9f977fe640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f8406b1c0 0x7f9f8406d680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f88000f60 tx=0x7f9f88007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:50.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:50.937+0000 7f9f7ffff640 1 -- 172.21.15.91:0/1989456086 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9f8c054cd0 con 0x7f9f98155490 2023-11-27T20:41:51.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.114+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/1989456086 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f98068350 con 0x7f9f98155490 2023-11-27T20:41:51.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.116+0000 7f9f7ffff640 1 -- 172.21.15.91:0/1989456086 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f9f8c0582f0 con 0x7f9f98155490 2023-11-27T20:41:51.118 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:51.118 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:41:51.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.118+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/1989456086 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f8406b1c0 msgr2=0x7f9f8406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:51.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.118+0000 7f9f9e0fc640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f8406b1c0 0x7f9f8406d680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f88000f60 tx=0x7f9f88007c00 comp rx=0 tx=0).stop 2023-11-27T20:41:51.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.118+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/1989456086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f98155490 msgr2=0x7f9f9809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:51.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.118+0000 7f9f9e0fc640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f98155490 0x7f9f9809aae0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00d800 tx=0x7f9f8c00dcc0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.119+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/1989456086 shutdown_connections 2023-11-27T20:41:51.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.119+0000 7f9f9e0fc640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f98153720 0x7f9f98153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.119+0000 7f9f9e0fc640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f98155490 0x7f9f9809aae0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.119+0000 7f9f9e0fc640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f8406b1c0 0x7f9f8406d680 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.119+0000 7f9f9e0fc640 1 --2- 172.21.15.91:0/1989456086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f980c1500 0x7f9f9809a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.119+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/1989456086 >> 172.21.15.91:0/1989456086 conn(0x7f9f9806a500 msgr2=0x7f9f980a9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:51.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.119+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/1989456086 shutdown_connections 2023-11-27T20:41:51.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.119+0000 7f9f9e0fc640 1 -- 172.21.15.91:0/1989456086 wait complete. 2023-11-27T20:41:51.137 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:41:51.193 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:41:51.203 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:41:51.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.332+0000 7f92a8300640 1 Processor -- start 2023-11-27T20:41:51.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.332+0000 7f92a8300640 1 -- start start 2023-11-27T20:41:51.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.333+0000 7f92a8300640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a014fd30 0x7f92a0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:51.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.333+0000 7f92a8300640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a00c64a0 con 0x7f92a00c3ea0 2023-11-27T20:41:51.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.333+0000 7f92a8300640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a00c5c00 con 0x7f92a006d0a0 2023-11-27T20:41:51.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.333+0000 7f92a8300640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00c5ee0 con 0x7f92a014fd30 2023-11-27T20:41:51.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.334+0000 7f92a689d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f92a00c3ea0 0x7f92a00c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34094/0 (socket says 172.21.15.91:34094) 2023-11-27T20:41:51.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.334+0000 7f92a689d640 1 -- 172.21.15.91:0/1363148597 learned_addr learned my addr 172.21.15.91:0/1363148597 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:51.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.334+0000 7f92a609c640 1 --2- 172.21.15.91:0/1363148597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a014fd30 0x7f92a0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:51.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.334+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755569439 0 0) 0x7f92a00c64a0 con 0x7f92a00c3ea0 2023-11-27T20:41:51.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.334+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f928c003520 con 0x7f92a00c3ea0 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469146558 0 0) 0x7f928c003520 con 0x7f92a00c3ea0 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a014fd30 msgr2=0x7f92a0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 --2- 172.21.15.91:0/1363148597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a014fd30 0x7f92a0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 >> v1:172.21.15.183:6789/0 conn(0x7f92a006d0a0 legacy=0x7f92a00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a00c61c0 con 0x7f92a00c3ea0 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f92980019f0 con 0x7f92a00c3ea0 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 >> v1:172.21.15.91:6789/0 conn(0x7f92a00c3ea0 legacy=0x7f92a00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 --2- 172.21.15.91:0/1363148597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f928c0039a0 0x7f928c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 --2- 172.21.15.91:0/1363148597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f928c0047c0 0x7f928c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 --2- 172.21.15.91:0/1363148597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a014fd30 0x7f928c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00c5ee0 con 0x7f928c0039a0 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c00ba30 con 0x7f928c0047c0 2023-11-27T20:41:51.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c00bbf0 con 0x7f92a014fd30 2023-11-27T20:41:51.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a609c640 1 --2- 172.21.15.91:0/1363148597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f928c0039a0 0x7f928c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:51.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a609c640 1 -- 172.21.15.91:0/1363148597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a014fd30 msgr2=0x7f928c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:51.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a609c640 1 --2- 172.21.15.91:0/1363148597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a014fd30 0x7f928c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a609c640 1 -- 172.21.15.91:0/1363148597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f928c0047c0 msgr2=0x7f928c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:51.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a609c640 1 --2- 172.21.15.91:0/1363148597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f928c0047c0 0x7f928c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.335+0000 7f92a609c640 1 -- 172.21.15.91:0/1363148597 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c003520 con 0x7f928c0039a0 2023-11-27T20:41:51.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.336+0000 7f92a609c640 1 --2- 172.21.15.91:0/1363148597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f928c0039a0 0x7f928c003dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f929c009a90 tx=0x7f928c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5696b8cfa8253b8b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:51.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.337+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c02c6b0 con 0x7f928c0039a0 2023-11-27T20:41:51.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.337+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c02c810 con 0x7f928c0039a0 2023-11-27T20:41:51.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.337+0000 7f92a509a640 1 -- 172.21.15.91:0/1363148597 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c02cba0 con 0x7f928c0039a0 2023-11-27T20:41:51.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.337+0000 7f92a8300640 1 -- 172.21.15.91:0/1363148597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f928c0039a0 msgr2=0x7f928c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:51.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.337+0000 7f92a8300640 1 --2- 172.21.15.91:0/1363148597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f928c0039a0 0x7f928c003dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f929c009a90 tx=0x7f928c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.337+0000 7f92a689d640 1 -- 172.21.15.91:0/1363148597 reap_dead start 2023-11-27T20:41:51.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.337+0000 7f92a8300640 1 -- 172.21.15.91:0/1363148597 shutdown_connections 2023-11-27T20:41:51.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.337+0000 7f92a8300640 1 -- 172.21.15.91:0/1363148597 >> 172.21.15.91:0/1363148597 conn(0x7f92a006a500 msgr2=0x7f92a006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:51.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.337+0000 7f92a8300640 1 -- 172.21.15.91:0/1363148597 shutdown_connections 2023-11-27T20:41:51.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.337+0000 7f92a8300640 1 -- 172.21.15.91:0/1363148597 wait complete. 2023-11-27T20:41:51.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.339+0000 7f92a8300640 1 Processor -- start 2023-11-27T20:41:51.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.339+0000 7f92a8300640 1 -- start start 2023-11-27T20:41:51.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.340+0000 7f92a8300640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f928c0039a0 0x7f92a0156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:51.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.340+0000 7f92a8300640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92a01ec470 0x7f92a014ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:51.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.340+0000 7f92a8300640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92a01dd270 0x7f92a014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:51.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.340+0000 7f92a8300640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a01dbad0 con 0x7f92a01ec470 2023-11-27T20:41:51.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.340+0000 7f92a8300640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00bad80 con 0x7f92a01dd270 2023-11-27T20:41:51.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.340+0000 7f92a8300640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00c0110 con 0x7f928c0039a0 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.340+0000 7f92a589b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92a01ec470 0x7f92a014ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.340+0000 7f92a589b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92a01ec470 0x7f92a014ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49736/0 (socket says 172.21.15.91:49736) 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.340+0000 7f92a589b640 1 -- 172.21.15.91:0/600950283 learned_addr learned my addr 172.21.15.91:0/600950283 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.340+0000 7f92a609c640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f928c0039a0 0x7f92a0156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f92a689d640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92a01dd270 0x7f92a014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f92a589b640 1 -- 172.21.15.91:0/600950283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f928c0039a0 msgr2=0x7f92a0156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f92a589b640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f928c0039a0 0x7f92a0156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f92a589b640 1 -- 172.21.15.91:0/600950283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92a01dd270 msgr2=0x7f92a014f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f92a589b640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92a01dd270 0x7f92a014f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f92a589b640 1 -- 172.21.15.91:0/600950283 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a00baff0 con 0x7f92a01ec470 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f92a689d640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92a01dd270 0x7f92a014f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f92a589b640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92a01ec470 0x7f92a014ee00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f929000c4d0 tx=0x7f929000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:51.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f9296ffd640 1 -- 172.21.15.91:0/600950283 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900052d0 con 0x7f92a01ec470 2023-11-27T20:41:51.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f9296ffd640 1 -- 172.21.15.91:0/600950283 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9290005430 con 0x7f92a01ec470 2023-11-27T20:41:51.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f9296ffd640 1 -- 172.21.15.91:0/600950283 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290012850 con 0x7f92a01ec470 2023-11-27T20:41:51.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f92a8300640 1 -- 172.21.15.91:0/600950283 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a00bb2d0 con 0x7f92a01ec470 2023-11-27T20:41:51.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.341+0000 7f92a8300640 1 -- 172.21.15.91:0/600950283 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a0072230 con 0x7f92a01ec470 2023-11-27T20:41:51.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.343+0000 7f92a8300640 1 -- 172.21.15.91:0/600950283 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a00bb4c0 con 0x7f92a01ec470 2023-11-27T20:41:51.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.343+0000 7f9296ffd640 1 -- 172.21.15.91:0/600950283 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f92900129b0 con 0x7f92a01ec470 2023-11-27T20:41:51.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.344+0000 7f9296ffd640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f928406b1f0 0x7f928406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:51.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.344+0000 7f9296ffd640 1 -- 172.21.15.91:0/600950283 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92900894f0 con 0x7f92a01ec470 2023-11-27T20:41:51.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.345+0000 7f92a609c640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f928406b1f0 0x7f928406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:51.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.345+0000 7f92a609c640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f928406b1f0 0x7f928406d6b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f929c036000 tx=0x7f929c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:51.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.348+0000 7f9296ffd640 1 -- 172.21.15.91:0/600950283 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f92900542b0 con 0x7f92a01ec470 2023-11-27T20:41:51.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.579+0000 7f92a8300640 1 -- 172.21.15.91:0/600950283 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92a0068350 con 0x7f92a01ec470 2023-11-27T20:41:51.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.580+0000 7f9296ffd640 1 -- 172.21.15.91:0/600950283 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f92900578d0 con 0x7f92a01ec470 2023-11-27T20:41:51.581 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:41:51.581 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/636329462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":636329462},{"type":"v1","addr":"172.21.15.91:6836","nonce":636329462}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/433109070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":433109070},{"type":"v1","addr":"172.21.15.91:6837","nonce":433109070}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1419226381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1419226381},{"type":"v1","addr":"172.21.15.183:6835","nonce":1419226381}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:41:34.815589+0000","modified":"2023-11-27T20:41:37.881858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/4022772138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4022772138},{"type":"v1","addr":"172.21.15.183:6834","nonce":4022772138}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:41:51.581 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 8 2023-11-27T20:41:51.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 -- 172.21.15.91:0/600950283 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f928406b1f0 msgr2=0x7f928406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f928406b1f0 0x7f928406d6b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f929c036000 tx=0x7f929c030000 comp rx=0 tx=0).stop 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 -- 172.21.15.91:0/600950283 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92a01ec470 msgr2=0x7f92a014ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92a01ec470 0x7f92a014ee00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f929000c4d0 tx=0x7f929000c990 comp rx=0 tx=0).stop 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 -- 172.21.15.91:0/600950283 shutdown_connections 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f928406b1f0 0x7f928406d6b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92a01dd270 0x7f92a014f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92a01ec470 0x7f92a014ee00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 --2- 172.21.15.91:0/600950283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f928c0039a0 0x7f92a0156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 -- 172.21.15.91:0/600950283 >> 172.21.15.91:0/600950283 conn(0x7f92a006a500 msgr2=0x7f92a00a81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 -- 172.21.15.91:0/600950283 shutdown_connections 2023-11-27T20:41:51.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:51.582+0000 7f92a8300640 1 -- 172.21.15.91:0/600950283 wait complete. 2023-11-27T20:41:52.005 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T20:41:34.815589+0000', 'modified': '2023-11-27T20:41:37.881858+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6834/4022772138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6832', 'nonce': 4022772138}, {'type': 'v1', 'addr': '172.21.15.183:6834', 'nonce': 4022772138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T20:41:52.006 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T20:41:52.006 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-27T20:41:52.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.233+0000 7fdf8d087640 1 Processor -- start 2023-11-27T20:41:52.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.233+0000 7fdf8d087640 1 -- start start 2023-11-27T20:41:52.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.234+0000 7fdf8d087640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdf880c3340 0x7fdf88156540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.234+0000 7fdf8d087640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf880bfdc0 con 0x7fdf880c45d0 2023-11-27T20:41:52.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.234+0000 7fdf8d087640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf88156a80 con 0x7fdf880c5ec0 2023-11-27T20:41:52.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.234+0000 7fdf8d087640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8806e390 con 0x7fdf880c3340 2023-11-27T20:41:52.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf7ffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fdf880c45d0 0x7fdf88155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34110/0 (socket says 172.21.15.91:34110) 2023-11-27T20:41:52.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf7ffff640 1 -- 172.21.15.91:0/1120802738 learned_addr learned my addr 172.21.15.91:0/1120802738 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:52.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964149510 0 0) 0x7fdf880bfdc0 con 0x7fdf880c45d0 2023-11-27T20:41:52.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf74003520 con 0x7fdf880c45d0 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf8759e640 1 --2- 172.21.15.91:0/1120802738 >> v2:172.21.15.183:3300/0 conn(0x7fdf880c3340 0x7fdf88156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2921893775 0 0) 0x7fdf74003520 con 0x7fdf880c45d0 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 >> v2:172.21.15.183:3300/0 conn(0x7fdf880c3340 msgr2=0x7fdf88156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf8659c640 1 --2- 172.21.15.91:0/1120802738 >> v2:172.21.15.183:3300/0 conn(0x7fdf880c3340 0x7fdf88156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 >> v1:172.21.15.183:6789/0 conn(0x7fdf880c5ec0 legacy=0x7fdf880c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8806ddd0 con 0x7fdf880c45d0 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fdf70001670 con 0x7fdf880c45d0 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.235+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 >> v1:172.21.15.91:6789/0 conn(0x7fdf880c45d0 legacy=0x7fdf88155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf8659c640 1 --2- 172.21.15.91:0/1120802738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf8659c640 1 --2- 172.21.15.91:0/1120802738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf740047c0 0x7fdf74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf8659c640 1 --2- 172.21.15.91:0/1120802738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf74005380 0x7fdf7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8806e390 con 0x7fdf74003970 2023-11-27T20:41:52.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7400c210 con 0x7fdf74005380 2023-11-27T20:41:52.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7400c3d0 con 0x7fdf740047c0 2023-11-27T20:41:52.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1120802738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf8759e640 1 --2- 172.21.15.91:0/1120802738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf74005380 0x7fdf7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf86d9d640 1 -- 172.21.15.91:0/1120802738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf740047c0 msgr2=0x7fdf74004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1120802738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf740047c0 0x7fdf74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf86d9d640 1 -- 172.21.15.91:0/1120802738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf74005380 msgr2=0x7fdf7400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1120802738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf74005380 0x7fdf7400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf86d9d640 1 -- 172.21.15.91:0/1120802738 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf74003520 con 0x7fdf74003970 2023-11-27T20:41:52.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.236+0000 7fdf8759e640 1 -- 172.21.15.91:0/1120802738 reap_dead start 2023-11-27T20:41:52.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.237+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1120802738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf74003d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf78001750 tx=0x7fdf740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3a634f49b531bf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:52.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.238+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf780052d0 con 0x7fdf74003970 2023-11-27T20:41:52.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.238+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7802e050 con 0x7fdf74003970 2023-11-27T20:41:52.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.238+0000 7fdf8659c640 1 -- 172.21.15.91:0/1120802738 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78003830 con 0x7fdf74003970 2023-11-27T20:41:52.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.238+0000 7fdf8d087640 1 -- 172.21.15.91:0/1120802738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 msgr2=0x7fdf74003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.238+0000 7fdf8d087640 1 --2- 172.21.15.91:0/1120802738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf74003d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf78001750 tx=0x7fdf740057f0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.238+0000 7fdf8d087640 1 -- 172.21.15.91:0/1120802738 shutdown_connections 2023-11-27T20:41:52.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.238+0000 7fdf8d087640 1 --2- 172.21.15.91:0/1120802738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf74003d90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.238+0000 7fdf8d087640 1 -- 172.21.15.91:0/1120802738 >> 172.21.15.91:0/1120802738 conn(0x7fdf8806a500 msgr2=0x7fdf8806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:52.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.238+0000 7fdf8d087640 1 -- 172.21.15.91:0/1120802738 shutdown_connections 2023-11-27T20:41:52.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.238+0000 7fdf8d087640 1 -- 172.21.15.91:0/1120802738 wait complete. 2023-11-27T20:41:52.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.240+0000 7fdf8d087640 1 Processor -- start 2023-11-27T20:41:52.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.240+0000 7fdf8d087640 1 -- start start 2023-11-27T20:41:52.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.241+0000 7fdf8d087640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf88157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.241+0000 7fdf8d087640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf88099a60 0x7fdf88152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.241+0000 7fdf8d087640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf881526a0 0x7fdf881ea140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.241+0000 7fdf8d087640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880aa450 con 0x7fdf74003970 2023-11-27T20:41:52.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.241+0000 7fdf8d087640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880aa940 con 0x7fdf881526a0 2023-11-27T20:41:52.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.241+0000 7fdf8d087640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8809a030 con 0x7fdf88099a60 2023-11-27T20:41:52.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.241+0000 7fdf86d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf88157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.241+0000 7fdf86d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf88157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49762/0 (socket says 172.21.15.91:49762) 2023-11-27T20:41:52.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.241+0000 7fdf86d9d640 1 -- 172.21.15.91:0/971424475 learned_addr learned my addr 172.21.15.91:0/971424475 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:52.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf8759e640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf881526a0 0x7fdf881ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf7ffff640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf88099a60 0x7fdf88152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf86d9d640 1 -- 172.21.15.91:0/971424475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf88099a60 msgr2=0x7fdf88152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf88099a60 0x7fdf88152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf86d9d640 1 -- 172.21.15.91:0/971424475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf881526a0 msgr2=0x7fdf881ea140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf881526a0 0x7fdf881ea140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf86d9d640 1 -- 172.21.15.91:0/971424475 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf880aa660 con 0x7fdf74003970 2023-11-27T20:41:52.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf7ffff640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf88099a60 0x7fdf88152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:52.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf88157f60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdf7802bc00 tx=0x7fdf78001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:52.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf7f7fe640 1 -- 172.21.15.91:0/971424475 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf780076c0 con 0x7fdf74003970 2023-11-27T20:41:52.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf7f7fe640 1 -- 172.21.15.91:0/971424475 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf78007a30 con 0x7fdf74003970 2023-11-27T20:41:52.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf7f7fe640 1 -- 172.21.15.91:0/971424475 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78006c20 con 0x7fdf74003970 2023-11-27T20:41:52.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.242+0000 7fdf8d087640 1 -- 172.21.15.91:0/971424475 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf881584a0 con 0x7fdf74003970 2023-11-27T20:41:52.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.243+0000 7fdf8d087640 1 -- 172.21.15.91:0/971424475 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf880aab30 con 0x7fdf74003970 2023-11-27T20:41:52.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.245+0000 7fdf7f7fe640 1 -- 172.21.15.91:0/971424475 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdf780035f0 con 0x7fdf74003970 2023-11-27T20:41:52.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.246+0000 7fdf7f7fe640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdf6806b1f0 0x7fdf6806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.246+0000 7fdf7f7fe640 1 -- 172.21.15.91:0/971424475 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf780ab630 con 0x7fdf74003970 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.247+0000 7fdf7ffff640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdf6806b1f0 0x7fdf6806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.247+0000 7fdf8fc1a740 1 Processor -- start 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.247+0000 7fdf7ffff640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdf6806b1f0 0x7fdf6806d6b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf88099e60 tx=0x7fdf70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.247+0000 7fdf8fc1a740 1 -- start start 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.248+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f85fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.248+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f862c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.248+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f81fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.248+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f783880 con 0x555f5f85f960 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.248+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f792ae0 con 0x555f5f8266b0 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.248+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5f7901d0 con 0x555f5f863170 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.248+0000 7fdf86d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f85fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.248+0000 7fdf86d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f85fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49774/0 (socket says 172.21.15.91:49774) 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.248+0000 7fdf86d9d640 1 -- 172.21.15.91:0/2674231667 learned_addr learned my addr 172.21.15.91:0/2674231667 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf8759e640 1 --2- 172.21.15.91:0/2674231667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f81fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf7ffff640 1 --2- 172.21.15.91:0/2674231667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f862c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf86d9d640 1 -- 172.21.15.91:0/2674231667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 msgr2=0x555f5f81fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/2674231667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f81fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf86d9d640 1 -- 172.21.15.91:0/2674231667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 msgr2=0x555f5f862c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/2674231667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f862c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf86d9d640 1 -- 172.21.15.91:0/2674231667 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f5f753860 con 0x555f5f85f960 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf7ffff640 1 --2- 172.21.15.91:0/2674231667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f862c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/2674231667 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f85fd40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdf78081de0 tx=0x7fdf7807a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa812200fdbe2a61 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf7cff9640 1 -- 172.21.15.91:0/2674231667 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7807eea0 con 0x555f5f85f960 2023-11-27T20:41:52.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf7cff9640 1 -- 172.21.15.91:0/2674231667 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf780783b0 con 0x555f5f85f960 2023-11-27T20:41:52.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.249+0000 7fdf7cff9640 1 -- 172.21.15.91:0/2674231667 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78001370 con 0x555f5f85f960 2023-11-27T20:41:52.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.250+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2674231667 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 msgr2=0x555f5f85fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.250+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/2674231667 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f85fd40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdf78081de0 tx=0x7fdf7807a0d0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.250+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2674231667 shutdown_connections 2023-11-27T20:41:52.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.250+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/2674231667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f81fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.250+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/2674231667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f862c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.250+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/2674231667 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f85fd40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.250+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2674231667 >> 172.21.15.91:0/2674231667 conn(0x555f5f7e6c70 msgr2=0x555f5f846700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:52.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.250+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2674231667 shutdown_connections 2023-11-27T20:41:52.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.250+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2674231667 wait complete. 2023-11-27T20:41:52.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.251+0000 7fdf8fc1a740 1 -- start start 2023-11-27T20:41:52.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.251+0000 7fdf8fc1a740 1 Processor -- start 2023-11-27T20:41:52.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.252+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f8693c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.252+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f865f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.252+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f842f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.252+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f78bac0 con 0x555f5f85f960 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.252+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f7282f0 con 0x555f5f8266b0 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.252+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5f745c70 con 0x555f5f863170 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.252+0000 7fdf8fc1a740 10 client.0 _ll_register_callbacks cb 0x555f5f74a3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.252+0000 7fdf7ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f865f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.252+0000 7fdf7ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f865f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49786/0 (socket says 172.21.15.91:49786) 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.252+0000 7fdf7ffff640 1 -- 172.21.15.91:0/1499715392 learned_addr learned my addr 172.21.15.91:0/1499715392 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f8693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf8759e640 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f842f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf7ffff640 1 -- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 msgr2=0x555f5f842f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf7ffff640 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f842f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf7ffff640 1 -- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 msgr2=0x555f5f8693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf7ffff640 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f8693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf7ffff640 1 -- 172.21.15.91:0/1499715392 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf880aab30 con 0x555f5f85f960 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f8693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf7ffff640 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f865f70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdf88069c30 tx=0x7fdf70001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4187cc5d7249a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf65ffb640 1 -- 172.21.15.91:0/1499715392 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7001f670 con 0x555f5f85f960 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf65ffb640 1 -- 172.21.15.91:0/1499715392 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf7001f7d0 con 0x555f5f85f960 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.253+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1499715392 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f5f784aa0 con 0x555f5f85f960 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf65ffb640 1 -- 172.21.15.91:0/1499715392 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf7001f990 con 0x555f5f85f960 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf8fc1a740 10 client.4668 fetch_fsmap learned FSMap version 8 2023-11-27T20:41:52.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1499715392 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x555f5f78a140 con 0x555f5f85f960 2023-11-27T20:41:52.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf65ffb640 1 -- 172.21.15.91:0/1499715392 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f5f784aa0 con 0x555f5f85f960 2023-11-27T20:41:52.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf65ffb640 1 -- 172.21.15.91:0/1499715392 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdf70012410 con 0x555f5f85f960 2023-11-27T20:41:52.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf8fc1a740 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2023-11-27T20:41:52.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf8fc1a740 10 client.4668 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T20:41:52.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf8fc1a740 20 client.4668 populate_metadata read hostname 'smithi091' 2023-11-27T20:41:52.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:6832/4022772138,v1:172.21.15.183:6834/4022772138] conn(0x555f5f843b80 0x555f5f874460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf8fc1a740 4 client.4668 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T20:41:52.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.254+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1499715392 --> [v2:172.21.15.183:6832/4022772138,v1:172.21.15.183:6834/4022772138] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f5f7847c0 con 0x555f5f843b80 2023-11-27T20:41:52.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.255+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:6832/4022772138,v1:172.21.15.183:6834/4022772138] conn(0x555f5f843b80 0x555f5f874460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.255+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:6832/4022772138,v1:172.21.15.183:6834/4022772138] conn(0x555f5f843b80 0x555f5f874460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a4005ead98a5a1a server_cookie=fc20f7a540451b19 in_seq=0 out_seq=0 2023-11-27T20:41:52.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.255+0000 7fdf65ffb640 10 client.4668 ms_handle_connect on v2:172.21.15.183:6832/4022772138 2023-11-27T20:41:52.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf65ffb640 1 -- 172.21.15.91:0/1499715392 <== mds.0 v2:172.21.15.183:6832/4022772138 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555f5f7847c0 con 0x555f5f843b80 2023-11-27T20:41:52.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf65ffb640 10 client.4668 handle_command_reply: tid=0 2023-11-27T20:41:52.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 client.4668 shutdown 2023-11-27T20:41:52.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1499715392 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 msgr2=0x555f5f865f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f865f70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdf88069c30 tx=0x7fdf70001150 comp rx=0 tx=0).stop 2023-11-27T20:41:52.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1499715392 shutdown_connections 2023-11-27T20:41:52.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:6832/4022772138,v1:172.21.15.183:6834/4022772138] conn(0x555f5f843b80 0x555f5f874460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f842f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f85f960 0x555f5f865f70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf65ffb640 0 client.4668 ms_handle_reset on v2:172.21.15.183:6832/4022772138 2023-11-27T20:41:52.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/1499715392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f8693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1499715392 >> 172.21.15.91:0/1499715392 conn(0x555f5f7e6c70 msgr2=0x555f5f864aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:52.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1499715392 shutdown_connections 2023-11-27T20:41:52.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1499715392 wait complete. 2023-11-27T20:41:52.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.258+0000 7fdf8fc1a740 20 client.4668 trim_cache size 0 max 16384 2023-11-27T20:41:52.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.275+0000 7fdf8fc1a740 1 Processor -- start 2023-11-27T20:41:52.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.275+0000 7fdf8fc1a740 1 -- start start 2023-11-27T20:41:52.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.276+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f8266b0 0x555f5f8431e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.276+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f85f960 0x555f5f883d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.276+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f864aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.276+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f4eef20 con 0x555f5f8266b0 2023-11-27T20:41:52.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.276+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f8408f0 con 0x555f5f85f960 2023-11-27T20:41:52.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.276+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5f871ea0 con 0x555f5f863170 2023-11-27T20:41:52.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.276+0000 7fdf86d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f8266b0 0x555f5f8431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf86d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f8266b0 0x555f5f8431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49802/0 (socket says 172.21.15.91:49802) 2023-11-27T20:41:52.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf86d9d640 1 -- 172.21.15.91:0/1516541343 learned_addr learned my addr 172.21.15.91:0/1516541343 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:52.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf8759e640 1 --2- 172.21.15.91:0/1516541343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f864aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf7ffff640 1 --2- 172.21.15.91:0/1516541343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f85f960 0x555f5f883d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf86d9d640 1 -- 172.21.15.91:0/1516541343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 msgr2=0x555f5f864aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1516541343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f864aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf86d9d640 1 -- 172.21.15.91:0/1516541343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f85f960 msgr2=0x555f5f883d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1516541343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f85f960 0x555f5f883d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf86d9d640 1 -- 172.21.15.91:0/1516541343 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f5f727b80 con 0x555f5f8266b0 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/1516541343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f8266b0 0x555f5f8431e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf7807e320 tx=0x7fdf7807c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6149b108d79c1f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.277+0000 7fdf7d7fa640 1 -- 172.21.15.91:0/1516541343 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7807eea0 con 0x555f5f8266b0 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf7d7fa640 1 -- 172.21.15.91:0/1516541343 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf78006d80 con 0x555f5f8266b0 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf7d7fa640 1 -- 172.21.15.91:0/1516541343 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78076720 con 0x555f5f8266b0 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1516541343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f8266b0 msgr2=0x555f5f8431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/1516541343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f8266b0 0x555f5f8431e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf7807e320 tx=0x7fdf7807c000 comp rx=0 tx=0).stop 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1516541343 shutdown_connections 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/1516541343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f863170 0x555f5f864aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/1516541343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f85f960 0x555f5f883d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/1516541343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f8266b0 0x555f5f8431e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1516541343 >> 172.21.15.91:0/1516541343 conn(0x555f5f7e6c70 msgr2=0x555f5f857db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:52.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1516541343 shutdown_connections 2023-11-27T20:41:52.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.278+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/1516541343 wait complete. 2023-11-27T20:41:52.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.279+0000 7fdf8fc1a740 1 -- start start 2023-11-27T20:41:52.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.279+0000 7fdf8fc1a740 1 Processor -- start 2023-11-27T20:41:52.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.280+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f884100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.280+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f85f960 0x555f5f868280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.280+0000 7fdf8fc1a740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f863170 0x555f5f844520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.280+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f85e2f0 con 0x555f5f863170 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.280+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f85da10 con 0x555f5f8266b0 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.280+0000 7fdf8fc1a740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5f83f840 con 0x555f5f85f960 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.280+0000 7fdf8fc1a740 10 client.0 _ll_register_callbacks cb 0x555f5f8638d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.280+0000 7fdf8759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f863170 0x555f5f844520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.280+0000 7fdf8759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f863170 0x555f5f844520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49808/0 (socket says 172.21.15.91:49808) 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.280+0000 7fdf8759e640 1 -- 172.21.15.91:0/2789915202 learned_addr learned my addr 172.21.15.91:0/2789915202 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f884100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf8759e640 1 -- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f85f960 msgr2=0x555f5f868280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf8759e640 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f85f960 0x555f5f868280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf8759e640 1 -- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 msgr2=0x555f5f884100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf8759e640 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f884100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf8759e640 1 -- 172.21.15.91:0/2789915202 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf780a7040 con 0x555f5f863170 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf8759e640 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f863170 0x555f5f844520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf880c5800 tx=0x7fdf800099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24695b997054af85 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf65ffb640 1 -- 172.21.15.91:0/2789915202 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80017680 con 0x555f5f863170 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf65ffb640 1 -- 172.21.15.91:0/2789915202 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf800177e0 con 0x555f5f863170 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2789915202 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf780783b0 con 0x555f5f863170 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf65ffb640 1 -- 172.21.15.91:0/2789915202 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf800179a0 con 0x555f5f863170 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf8fc1a740 10 client.4674 fetch_fsmap learned FSMap version 8 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.281+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2789915202 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x555f5f74d170 con 0x555f5f863170 2023-11-27T20:41:52.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.282+0000 7fdf65ffb640 1 -- 172.21.15.91:0/2789915202 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf780783b0 con 0x555f5f863170 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.282+0000 7fdf65ffb640 1 -- 172.21.15.91:0/2789915202 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdf80017b00 con 0x555f5f863170 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.282+0000 7fdf8fc1a740 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.282+0000 7fdf8fc1a740 10 client.4674 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.282+0000 7fdf8fc1a740 20 client.4674 populate_metadata read hostname 'smithi091' 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.282+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:6832/4022772138,v1:172.21.15.183:6834/4022772138] conn(0x555f5f844d90 0x555f5f8c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.282+0000 7fdf8fc1a740 4 client.4674 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.282+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2789915202 --> [v2:172.21.15.183:6832/4022772138,v1:172.21.15.183:6834/4022772138] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555f5f48c6c0 con 0x555f5f844d90 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.282+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:6832/4022772138,v1:172.21.15.183:6834/4022772138] conn(0x555f5f844d90 0x555f5f8c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.283+0000 7fdf86d9d640 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:6832/4022772138,v1:172.21.15.183:6834/4022772138] conn(0x555f5f844d90 0x555f5f8c80e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db82ad8e52998858 server_cookie=c81859484cbd048c in_seq=0 out_seq=0 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.283+0000 7fdf65ffb640 10 client.4674 ms_handle_connect on v2:172.21.15.183:6832/4022772138 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf65ffb640 1 -- 172.21.15.91:0/2789915202 <== mds.0 v2:172.21.15.183:6832/4022772138 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x555f5f48c6c0 con 0x555f5f844d90 2023-11-27T20:41:52.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf65ffb640 10 client.4674 handle_command_reply: tid=0 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 client.4674 shutdown 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2789915202 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f863170 msgr2=0x555f5f844520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f863170 0x555f5f844520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf880c5800 tx=0x7fdf800099e0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2789915202 shutdown_connections 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:6832/4022772138,v1:172.21.15.183:6834/4022772138] conn(0x555f5f844d90 0x555f5f8c80e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555f5f863170 0x555f5f844520 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555f5f85f960 0x555f5f868280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 --2- 172.21.15.91:0/2789915202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f5f8266b0 0x555f5f884100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf65ffb640 0 client.4674 ms_handle_reset on v2:172.21.15.183:6832/4022772138 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2789915202 >> 172.21.15.91:0/2789915202 conn(0x555f5f7e6c70 msgr2=0x555f5f8431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2789915202 shutdown_connections 2023-11-27T20:41:52.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.284+0000 7fdf8fc1a740 1 -- 172.21.15.91:0/2789915202 wait complete. 2023-11-27T20:41:52.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8fc1a740 20 client.4674 trim_cache size 0 max 16384 2023-11-27T20:41:52.292 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:41:52.292 INFO:teuthology.orchestra.run.smithi091.stdout: "cluster_fsid": "76812701-65a9-4deb-87af-ef00110d1601", 2023-11-27T20:41:52.292 INFO:teuthology.orchestra.run.smithi091.stdout: "whoami": 0, 2023-11-27T20:41:52.293 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4276, 2023-11-27T20:41:52.293 INFO:teuthology.orchestra.run.smithi091.stdout: "want_state": "up:active", 2023-11-27T20:41:52.293 INFO:teuthology.orchestra.run.smithi091.stdout: "state": "up:active", 2023-11-27T20:41:52.293 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs", 2023-11-27T20:41:52.293 INFO:teuthology.orchestra.run.smithi091.stdout: "rank_uptime": 16.907285047999999, 2023-11-27T20:41:52.293 INFO:teuthology.orchestra.run.smithi091.stdout: "mdsmap_epoch": 8, 2023-11-27T20:41:52.293 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch": 20, 2023-11-27T20:41:52.294 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch_barrier": 20, 2023-11-27T20:41:52.294 INFO:teuthology.orchestra.run.smithi091.stdout: "uptime": 22.461632024 2023-11-27T20:41:52.294 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:41:52.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 -- 172.21.15.91:0/971424475 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdf6806b1f0 msgr2=0x7fdf6806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdf6806b1f0 0x7fdf6806d6b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf88099e60 tx=0x7fdf70009040 comp rx=0 tx=0).stop 2023-11-27T20:41:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 -- 172.21.15.91:0/971424475 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 msgr2=0x7fdf88157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf88157f60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdf7802bc00 tx=0x7fdf78001120 comp rx=0 tx=0).stop 2023-11-27T20:41:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 -- 172.21.15.91:0/971424475 shutdown_connections 2023-11-27T20:41:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdf6806b1f0 0x7fdf6806d6b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf881526a0 0x7fdf881ea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf88099a60 0x7fdf88152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 --2- 172.21.15.91:0/971424475 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf74003970 0x7fdf88157f60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 -- 172.21.15.91:0/971424475 >> 172.21.15.91:0/971424475 conn(0x7fdf8806a500 msgr2=0x7fdf88071420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 -- 172.21.15.91:0/971424475 shutdown_connections 2023-11-27T20:41:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.285+0000 7fdf8d087640 1 -- 172.21.15.91:0/971424475 wait complete. 2023-11-27T20:41:52.303 INFO:teuthology.run_tasks:Running task kclient... 2023-11-27T20:41:52.328 INFO:tasks.kclient:Mounting kernel clients... 2023-11-27T20:41:52.328 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-11-27T20:41:52.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:52.329 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T20:41:52.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:52.384 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link delete ceph-brx 2023-11-27T20:41:52.483 INFO:teuthology.orchestra.run.smithi091.stderr:Cannot find device "ceph-brx" 2023-11-27T20:41:52.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:41:52.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:52.487 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-27T20:41:52.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:52.548 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2023-11-27T20:41:52.654 INFO:teuthology.orchestra.run.smithi183.stderr:Cannot find device "ceph-brx" 2023-11-27T20:41:52.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:41:52.659 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-27T20:41:52.659 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T20:41:52.659 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:41:52.660 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:41:52.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.885+0000 7fe52e983640 1 Processor -- start 2023-11-27T20:41:52.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.885+0000 7fe52e983640 1 -- start start 2023-11-27T20:41:52.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe52e983640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5280c45d0 0x7fe528155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe52e983640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe5280c3340 0x7fe528156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe52e983640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5280bfdc0 con 0x7fe5280c5ec0 2023-11-27T20:41:52.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe52e983640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52806e390 con 0x7fe5280c3340 2023-11-27T20:41:52.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe52e983640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52806ddd0 con 0x7fe5280c45d0 2023-11-27T20:41:52.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe52cf20640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe5280c3340 0x7fe528156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe52cf20640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe5280c3340 0x7fe528156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49812/0 (socket says 172.21.15.91:49812) 2023-11-27T20:41:52.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe52cf20640 1 -- 172.21.15.91:0/3776032982 learned_addr learned my addr 172.21.15.91:0/3776032982 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:52.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe527fff640 1 --1- 172.21.15.91:0/3776032982 >> v1:172.21.15.91:6789/0 conn(0x7fe5280c5ec0 0x7fe5280c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:34126/0 (socket says 172.21.15.91:34126) 2023-11-27T20:41:52.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe5277fe640 1 --2- 172.21.15.91:0/3776032982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5280c45d0 0x7fe528155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.887+0000 7fe52cf20640 1 -- 172.21.15.91:0/3776032982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5280c45d0 msgr2=0x7fe528155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:52.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.888+0000 7fe52cf20640 1 --2- 172.21.15.91:0/3776032982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5280c45d0 0x7fe528155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.888+0000 7fe52cf20640 1 -- 172.21.15.91:0/3776032982 >> v1:172.21.15.91:6789/0 conn(0x7fe5280c5ec0 legacy=0x7fe5280c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.888+0000 7fe52cf20640 1 -- 172.21.15.91:0/3776032982 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52806e0b0 con 0x7fe5280c3340 2023-11-27T20:41:52.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.889+0000 7fe52cf20640 1 --2- 172.21.15.91:0/3776032982 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c3340 0x7fe528156370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe520009e50 tx=0x7fe52002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad92814aa4853e44 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:52.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.889+0000 7fe526ffd640 1 -- 172.21.15.91:0/3776032982 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52002c9f0 con 0x7fe5280c3340 2023-11-27T20:41:52.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.889+0000 7fe526ffd640 1 -- 172.21.15.91:0/3776032982 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52002cb50 con 0x7fe5280c3340 2023-11-27T20:41:52.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.889+0000 7fe526ffd640 1 -- 172.21.15.91:0/3776032982 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5200343f0 con 0x7fe5280c3340 2023-11-27T20:41:52.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.889+0000 7fe52e983640 1 -- 172.21.15.91:0/3776032982 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c3340 msgr2=0x7fe528156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.889+0000 7fe52e983640 1 --2- 172.21.15.91:0/3776032982 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c3340 0x7fe528156370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe520009e50 tx=0x7fe52002be50 comp rx=0 tx=0).stop 2023-11-27T20:41:52.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.890+0000 7fe52e983640 1 -- 172.21.15.91:0/3776032982 shutdown_connections 2023-11-27T20:41:52.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.890+0000 7fe52e983640 1 --2- 172.21.15.91:0/3776032982 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c3340 0x7fe528156370 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.890+0000 7fe52e983640 1 --2- 172.21.15.91:0/3776032982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5280c45d0 0x7fe528155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.890+0000 7fe52e983640 1 -- 172.21.15.91:0/3776032982 >> 172.21.15.91:0/3776032982 conn(0x7fe52806a500 msgr2=0x7fe52806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:52.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.890+0000 7fe52e983640 1 -- 172.21.15.91:0/3776032982 shutdown_connections 2023-11-27T20:41:52.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.890+0000 7fe52e983640 1 -- 172.21.15.91:0/3776032982 wait complete. 2023-11-27T20:41:52.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.891+0000 7fe52e983640 1 Processor -- start 2023-11-27T20:41:52.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.892+0000 7fe52e983640 1 -- start start 2023-11-27T20:41:52.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.892+0000 7fe52e983640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5280c3340 0x7fe528152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.892+0000 7fe52e983640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c45d0 0x7fe52814e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe52e983640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5280c5ec0 0x7fe52814e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe52e983640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52814eba0 con 0x7fe5280c45d0 2023-11-27T20:41:52.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe52e983640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5281e9e70 con 0x7fe5280c3340 2023-11-27T20:41:52.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe52e983640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5281eae40 con 0x7fe5280c5ec0 2023-11-27T20:41:52.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe5277fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c45d0 0x7fe52814e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe5277fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c45d0 0x7fe52814e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:49814/0 (socket says 172.21.15.91:49814) 2023-11-27T20:41:52.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe5277fe640 1 -- 172.21.15.91:0/2063218139 learned_addr learned my addr 172.21.15.91:0/2063218139 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:52.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe5277fe640 1 -- 172.21.15.91:0/2063218139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5280c5ec0 msgr2=0x7fe52814e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe5277fe640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5280c5ec0 0x7fe52814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe5277fe640 1 -- 172.21.15.91:0/2063218139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5280c3340 msgr2=0x7fe528152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:52.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe5277fe640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5280c3340 0x7fe528152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:52.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe5277fe640 1 -- 172.21.15.91:0/2063218139 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe520009b30 con 0x7fe5280c45d0 2023-11-27T20:41:52.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.893+0000 7fe5277fe640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c45d0 0x7fe52814e120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00d800 tx=0x7fe51c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:52.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.894+0000 7fe524ff9640 1 -- 172.21.15.91:0/2063218139 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00b6c0 con 0x7fe5280c45d0 2023-11-27T20:41:52.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.894+0000 7fe524ff9640 1 -- 172.21.15.91:0/2063218139 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c00b820 con 0x7fe5280c45d0 2023-11-27T20:41:52.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.894+0000 7fe52e983640 1 -- 172.21.15.91:0/2063218139 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5280c1e90 con 0x7fe5280c45d0 2023-11-27T20:41:52.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.894+0000 7fe524ff9640 1 -- 172.21.15.91:0/2063218139 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00bbb0 con 0x7fe5280c45d0 2023-11-27T20:41:52.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.894+0000 7fe52e983640 1 -- 172.21.15.91:0/2063218139 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5281ea360 con 0x7fe5280c45d0 2023-11-27T20:41:52.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.895+0000 7fe52e983640 1 -- 172.21.15.91:0/2063218139 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe528068350 con 0x7fe5280c45d0 2023-11-27T20:41:52.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.896+0000 7fe524ff9640 1 -- 172.21.15.91:0/2063218139 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe51c00bd10 con 0x7fe5280c45d0 2023-11-27T20:41:52.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.897+0000 7fe524ff9640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe51406b1c0 0x7fe51406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:52.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.897+0000 7fe524ff9640 1 -- 172.21.15.91:0/2063218139 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe51c089ef0 con 0x7fe5280c45d0 2023-11-27T20:41:52.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.897+0000 7fe527fff640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe51406b1c0 0x7fe51406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:52.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.898+0000 7fe527fff640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe51406b1c0 0x7fe51406d680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe518001540 tx=0x7fe5180079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:52.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:52.901+0000 7fe524ff9640 1 -- 172.21.15.91:0/2063218139 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe51c054cb0 con 0x7fe5280c45d0 2023-11-27T20:41:53.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.129+0000 7fe52e983640 1 -- 172.21.15.91:0/2063218139 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe5280ab270 con 0x7fe5280c45d0 2023-11-27T20:41:53.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.130+0000 7fe524ff9640 1 -- 172.21.15.91:0/2063218139 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe51c0582d0 con 0x7fe5280c45d0 2023-11-27T20:41:53.132 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:41:53.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.132+0000 7fe52e983640 1 -- 172.21.15.91:0/2063218139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe51406b1c0 msgr2=0x7fe51406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:53.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.132+0000 7fe52e983640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe51406b1c0 0x7fe51406d680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe518001540 tx=0x7fe5180079c0 comp rx=0 tx=0).stop 2023-11-27T20:41:53.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.132+0000 7fe52e983640 1 -- 172.21.15.91:0/2063218139 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c45d0 msgr2=0x7fe52814e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:53.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.133+0000 7fe52e983640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c45d0 0x7fe52814e120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00d800 tx=0x7fe51c00dcc0 comp rx=0 tx=0).stop 2023-11-27T20:41:53.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.133+0000 7fe52e983640 1 -- 172.21.15.91:0/2063218139 shutdown_connections 2023-11-27T20:41:53.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.133+0000 7fe52e983640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5280c5ec0 0x7fe52814e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:53.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.133+0000 7fe52e983640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5280c45d0 0x7fe52814e120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:53.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.133+0000 7fe52e983640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe51406b1c0 0x7fe51406d680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:53.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.133+0000 7fe52e983640 1 --2- 172.21.15.91:0/2063218139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5280c3340 0x7fe528152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:53.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.133+0000 7fe52e983640 1 -- 172.21.15.91:0/2063218139 >> 172.21.15.91:0/2063218139 conn(0x7fe52806a500 msgr2=0x7fe5280c14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:53.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.133+0000 7fe52e983640 1 -- 172.21.15.91:0/2063218139 shutdown_connections 2023-11-27T20:41:53.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:53.133+0000 7fe52e983640 1 -- 172.21.15.91:0/2063218139 wait complete. 2023-11-27T20:41:53.153 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T20:41:53.154 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:41:53.154 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-27T20:41:53.154 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T20:41:53.154 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:41:53.154 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T20:41:53.154 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T20:41:53.154 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:41:53.154 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:41:53.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:53.155 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-27T20:41:53.207 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:41:53.207 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:41:53.207 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:41:53.207 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:41:53.208 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:41:53.209 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 42309sec preferred_lft 42309sec 2023-11-27T20:41:53.209 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-27T20:41:53.209 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:41:53.209 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T20:41:53.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:53.209 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:41:53.209 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:41:53.210 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add name ceph-brx type bridge 2023-11-27T20:41:53.210 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr flush dev ceph-brx 2023-11-27T20:41:53.210 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set ceph-brx up 2023-11-27T20:41:53.210 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T20:41:53.210 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:41:53.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:53.667 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:41:53.752 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-27T20:41:53.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:53.755 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-27T20:41:53.845 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-27T20:41:53.845 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:41:53.846 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:41:53.846 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:41:53.846 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:41:53.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:53.848 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:41:53.848 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:41:53.848 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:41:53.848 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:41:53.848 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:41:53.849 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:41:54.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:54.535 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T20:41:54.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:54.593 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list-id 2023-11-27T20:41:54.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:54.648 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:41:54.648 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:41:54.648 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:41:54.649 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-27T20:41:54.649 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:41:54.794 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-27T20:41:54.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:54.794 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:41:54.794 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:41:54.794 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-27T20:41:54.795 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T20:41:54.795 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-27T20:41:54.795 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-27T20:41:54.795 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-27T20:41:54.795 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:41:55.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:55.079 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:41:55.079 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:41:55.079 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-11-27T20:41:55.079 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T20:41:55.079 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:41:55.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:41:55.242 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T20:41:55.288 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:41:55.289 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:41:55.289 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:41:55.388 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:41:55.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:55.389 DEBUG:teuthology.orchestra.run.smithi091:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:41:55.536 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:41:55.537 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:41:55.537 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:41:55.957 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:41:55.957 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:41:55.957 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:41:55.957 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:41:55.957 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:41:55.992 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:41:55.993 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:41:55.993 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:41:55.993 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:41:55.993 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:41:55.993 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:41:55.993 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:41:55.993 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:41:55.995 INFO:teuthology.orchestra.run.smithi091.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-27T20:41:55.996 INFO:teuthology.orchestra.run.smithi091.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:41:55.996 INFO:teuthology.orchestra.run.smithi091.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:41:55.996 INFO:teuthology.orchestra.run.smithi091.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:41:55.996 INFO:teuthology.orchestra.run.smithi091.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:41:56.001 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:41:56.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:56.001 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:41:56.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:56.100 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:41:56.177 INFO:teuthology.orchestra.run.smithi091.stdout:client4540 2023-11-27T20:41:56.177 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:41:56.178 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:41:56.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:56.235 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:41:56.309 INFO:teuthology.orchestra.run.smithi091.stdout:client4540 2023-11-27T20:41:56.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:56.309 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:41:56.395 INFO:teuthology.orchestra.run.smithi091.stdout:client4540 2023-11-27T20:41:56.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:56.395 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/76812701-65a9-4deb-87af-ef00110d1601.client4540/status') 2023-11-27T20:41:56.515 INFO:teuthology.orchestra.run.smithi091.stdout:instance: client.4540 (3)172.21.15.91:0/837656095 2023-11-27T20:41:56.515 INFO:teuthology.orchestra.run.smithi091.stdout:blocklisted: false 2023-11-27T20:41:56.516 INFO:teuthology.orchestra.run.smithi091.stderr:0+1 records in 2023-11-27T20:41:56.516 INFO:teuthology.orchestra.run.smithi091.stderr:0+1 records out 2023-11-27T20:41:56.516 INFO:teuthology.orchestra.run.smithi091.stderr:69 bytes copied, 7.2677e-05 s, 949 kB/s 2023-11-27T20:41:56.520 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-27T20:41:56.520 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T20:41:56.520 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T20:41:56.521 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:41:56.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.726+0000 7fa5de139640 1 Processor -- start 2023-11-27T20:41:56.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.726+0000 7fa5de139640 1 -- start start 2023-11-27T20:41:56.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.727+0000 7fa5de139640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa5d8155490 0x7fa5d80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:56.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.727+0000 7fa5de139640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d80c06c0 con 0x7fa5d80c1500 2023-11-27T20:41:56.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.728+0000 7fa5de139640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d80c1020 con 0x7fa5d80a9b40 2023-11-27T20:41:56.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.728+0000 7fa5de139640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d80a5820 con 0x7fa5d8155490 2023-11-27T20:41:56.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.728+0000 7fa5cffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa5d80c1500 0x7fa5d80a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54586/0 (socket says 172.21.15.91:54586) 2023-11-27T20:41:56.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.728+0000 7fa5cffff640 1 -- 172.21.15.91:0/1909199243 learned_addr learned my addr 172.21.15.91:0/1909199243 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:41:56.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.728+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740970059 0 0) 0x7fa5d80c06c0 con 0x7fa5d80c1500 2023-11-27T20:41:56.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.728+0000 7fa5d77fe640 1 --2- 172.21.15.91:0/1909199243 >> v2:172.21.15.183:3300/0 conn(0x7fa5d8155490 0x7fa5d80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.728+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5c4005730 con 0x7fa5d80c1500 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1516845369 0 0) 0x7fa5c4005730 con 0x7fa5d80c1500 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 >> v2:172.21.15.183:3300/0 conn(0x7fa5d8155490 msgr2=0x7fa5d80a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 --2- 172.21.15.91:0/1909199243 >> v2:172.21.15.183:3300/0 conn(0x7fa5d8155490 0x7fa5d80a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 >> v1:172.21.15.183:6789/0 conn(0x7fa5d80a9b40 legacy=0x7fa5d80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d80c0910 con 0x7fa5d80c1500 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fa5c0001670 con 0x7fa5d80c1500 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 >> v1:172.21.15.91:6789/0 conn(0x7fa5d80c1500 legacy=0x7fa5d80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5c4005b80 0x7fa5c4005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5c40069d0 0x7fa5c4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5c4007390 0x7fa5c400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:56.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c400e2b0 con 0x7fa5c4007390 2023-11-27T20:41:56.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c400e420 con 0x7fa5c4005b80 2023-11-27T20:41:56.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c400e5e0 con 0x7fa5c40069d0 2023-11-27T20:41:56.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d7fff640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5c4007390 0x7fa5c400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:56.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5d77fe640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5c4005b80 0x7fa5c4005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:56.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.729+0000 7fa5cffff640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5c40069d0 0x7fa5c4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:56.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.730+0000 7fa5d7fff640 1 -- 172.21.15.91:0/1909199243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5c40069d0 msgr2=0x7fa5c4006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:56.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.730+0000 7fa5d7fff640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5c40069d0 0x7fa5c4006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.730+0000 7fa5d7fff640 1 -- 172.21.15.91:0/1909199243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5c4005b80 msgr2=0x7fa5c4005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:41:56.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.730+0000 7fa5d7fff640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5c4005b80 0x7fa5c4005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.730+0000 7fa5d7fff640 1 -- 172.21.15.91:0/1909199243 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c4005730 con 0x7fa5c4007390 2023-11-27T20:41:56.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.730+0000 7fa5d77fe640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5c4005b80 0x7fa5c4005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:41:56.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.731+0000 7fa5d7fff640 1 -- 172.21.15.91:0/1909199243 reap_dead start 2023-11-27T20:41:56.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.731+0000 7fa5d7fff640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5c4007390 0x7fa5c400db90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0001e50 tx=0x7fa5c4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723c5960672ff4d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:56.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.731+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0003b70 con 0x7fa5c4007390 2023-11-27T20:41:56.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.731+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d0003d10 con 0x7fa5c4007390 2023-11-27T20:41:56.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.731+0000 7fa5d6ffd640 1 -- 172.21.15.91:0/1909199243 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0005310 con 0x7fa5c4007390 2023-11-27T20:41:56.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.731+0000 7fa5de139640 1 -- 172.21.15.91:0/1909199243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5c4007390 msgr2=0x7fa5c400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:56.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.731+0000 7fa5de139640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5c4007390 0x7fa5c400db90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0001e50 tx=0x7fa5c4007a00 comp rx=0 tx=0).stop 2023-11-27T20:41:56.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.732+0000 7fa5de139640 1 -- 172.21.15.91:0/1909199243 shutdown_connections 2023-11-27T20:41:56.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.732+0000 7fa5de139640 1 --2- 172.21.15.91:0/1909199243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5c4007390 0x7fa5c400db90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.732+0000 7fa5de139640 1 -- 172.21.15.91:0/1909199243 >> 172.21.15.91:0/1909199243 conn(0x7fa5d806a500 msgr2=0x7fa5d806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:56.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.732+0000 7fa5de139640 1 -- 172.21.15.91:0/1909199243 shutdown_connections 2023-11-27T20:41:56.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.732+0000 7fa5de139640 1 -- 172.21.15.91:0/1909199243 wait complete. 2023-11-27T20:41:56.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.733+0000 7fa5de139640 1 Processor -- start 2023-11-27T20:41:56.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.733+0000 7fa5de139640 1 -- start start 2023-11-27T20:41:56.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.734+0000 7fa5de139640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5c4007390 0x7fa5d81ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:56.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.734+0000 7fa5de139640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5d8151100 0x7fa5d8151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:56.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.734+0000 7fa5de139640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5d80aa3d0 0x7fa5d80aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:56.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.734+0000 7fa5de139640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d81dc5a0 con 0x7fa5d8151100 2023-11-27T20:41:56.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.734+0000 7fa5de139640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d81dc880 con 0x7fa5d80aa3d0 2023-11-27T20:41:56.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.734+0000 7fa5de139640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d81db230 con 0x7fa5c4007390 2023-11-27T20:41:56.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5cffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5d8151100 0x7fa5d8151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:56.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5cffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5d8151100 0x7fa5d8151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40198/0 (socket says 172.21.15.91:40198) 2023-11-27T20:41:56.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5cffff640 1 -- 172.21.15.91:0/1830281602 learned_addr learned my addr 172.21.15.91:0/1830281602 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:41:56.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5d77fe640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5c4007390 0x7fa5d81ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:56.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5d7fff640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5d80aa3d0 0x7fa5d80aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:56.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5cffff640 1 -- 172.21.15.91:0/1830281602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5c4007390 msgr2=0x7fa5d81ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:56.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5cffff640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5c4007390 0x7fa5d81ed960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5cffff640 1 -- 172.21.15.91:0/1830281602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5d80aa3d0 msgr2=0x7fa5d80aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:56.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5cffff640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5d80aa3d0 0x7fa5d80aa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5cffff640 1 -- 172.21.15.91:0/1830281602 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d81db510 con 0x7fa5d8151100 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.735+0000 7fa5cffff640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5d8151100 0x7fa5d8151580 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000e7f0 tx=0x7fa5c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.736+0000 7fa5d4ff9640 1 -- 172.21.15.91:0/1830281602 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000eea0 con 0x7fa5d8151100 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.736+0000 7fa5d4ff9640 1 -- 172.21.15.91:0/1830281602 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c000c870 con 0x7fa5d8151100 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.736+0000 7fa5d4ff9640 1 -- 172.21.15.91:0/1830281602 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000cc00 con 0x7fa5d8151100 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.736+0000 7fa5de139640 1 -- 172.21.15.91:0/1830281602 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d81db7f0 con 0x7fa5d8151100 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.736+0000 7fa5de139640 1 -- 172.21.15.91:0/1830281602 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d81dcd10 con 0x7fa5d8151100 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.737+0000 7fa5de139640 1 -- 172.21.15.91:0/1830281602 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d81dca30 con 0x7fa5d8151100 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.738+0000 7fa5d4ff9640 1 -- 172.21.15.91:0/1830281602 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa5c001d460 con 0x7fa5d8151100 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.739+0000 7fa5d4ff9640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa5b806b1c0 0x7fa5b806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.739+0000 7fa5d4ff9640 1 -- 172.21.15.91:0/1830281602 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5c0089900 con 0x7fa5d8151100 2023-11-27T20:41:56.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.739+0000 7fa5d77fe640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa5b806b1c0 0x7fa5b806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:41:56.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.740+0000 7fa5d77fe640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa5b806b1c0 0x7fa5b806d680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80c58c0 tx=0x7fa5c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:41:56.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.743+0000 7fa5d4ff9640 1 -- 172.21.15.91:0/1830281602 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa5d81dca30 con 0x7fa5d8151100 2023-11-27T20:41:56.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.969+0000 7fa5de139640 1 -- 172.21.15.91:0/1830281602 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5d81db9e0 con 0x7fa5d8151100 2023-11-27T20:41:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.970+0000 7fa5d4ff9640 1 -- 172.21.15.91:0/1830281602 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa5c00546c0 con 0x7fa5d8151100 2023-11-27T20:41:56.971 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:41:56.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.972+0000 7fa5de139640 1 -- 172.21.15.91:0/1830281602 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa5b806b1c0 msgr2=0x7fa5b806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:56.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.972+0000 7fa5de139640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa5b806b1c0 0x7fa5b806d680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80c58c0 tx=0x7fa5c8008040 comp rx=0 tx=0).stop 2023-11-27T20:41:56.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.973+0000 7fa5de139640 1 -- 172.21.15.91:0/1830281602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5d8151100 msgr2=0x7fa5d8151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:41:56.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.973+0000 7fa5de139640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5d8151100 0x7fa5d8151580 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000e7f0 tx=0x7fa5c000ecb0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.973+0000 7fa5de139640 1 -- 172.21.15.91:0/1830281602 shutdown_connections 2023-11-27T20:41:56.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.973+0000 7fa5de139640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa5b806b1c0 0x7fa5b806d680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.973+0000 7fa5de139640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5d80aa3d0 0x7fa5d80aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.973+0000 7fa5de139640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5d8151100 0x7fa5d8151580 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.973+0000 7fa5de139640 1 --2- 172.21.15.91:0/1830281602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5c4007390 0x7fa5d81ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:41:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.973+0000 7fa5de139640 1 -- 172.21.15.91:0/1830281602 >> 172.21.15.91:0/1830281602 conn(0x7fa5d806a500 msgr2=0x7fa5d80c5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:41:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.973+0000 7fa5de139640 1 -- 172.21.15.91:0/1830281602 shutdown_connections 2023-11-27T20:41:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:41:56.973+0000 7fa5de139640 1 -- 172.21.15.91:0/1830281602 wait complete. 2023-11-27T20:41:56.990 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T20:41:56.990 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:41:56.990 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-27T20:41:56.990 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-27T20:41:56.990 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T20:41:56.990 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T20:41:56.990 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T20:41:56.990 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:41:56.990 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:41:56.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:56.991 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-27T20:41:57.052 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:41:57.052 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:41:57.053 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:41:57.053 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:41:57.053 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-27T20:41:57.054 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:41:57.054 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:41:57.054 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-27T20:41:57.054 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-27T20:41:57.055 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:41:57.055 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-27T20:41:57.055 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-27T20:41:57.055 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:41:57.056 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:41:57.056 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:41:57.056 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:41:57.057 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:41:57.057 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42341sec preferred_lft 42341sec 2023-11-27T20:41:57.057 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-27T20:41:57.057 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:41:57.058 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T20:41:57.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:57.059 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:41:57.059 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:41:57.059 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add name ceph-brx type bridge 2023-11-27T20:41:57.059 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr flush dev ceph-brx 2023-11-27T20:41:57.060 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set ceph-brx up 2023-11-27T20:41:57.060 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T20:41:57.060 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:41:57.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:57.524 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:41:57.608 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-27T20:41:57.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:57.612 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-27T20:41:57.674 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-27T20:41:57.674 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:41:57.674 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:41:57.674 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:41:57.674 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:41:57.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:57.675 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:41:57.675 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:41:57.676 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:41:57.676 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:41:57.676 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:41:57.676 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:41:58.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:58.429 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-27T20:41:58.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:58.482 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list-id 2023-11-27T20:41:58.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:58.531 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:41:58.531 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:41:58.531 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T20:41:58.531 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-27T20:41:58.531 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:41:58.667 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-27T20:41:58.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:58.668 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:41:58.668 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:41:58.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-27T20:41:58.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T20:41:58.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-27T20:41:58.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-27T20:41:58.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-27T20:41:58.668 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:41:58.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:58.989 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:41:58.989 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:41:58.989 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-11-27T20:41:58.989 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T20:41:58.989 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:41:59.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:41:59.160 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-27T20:41:59.211 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:41:59.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:41:59.212 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:41:59.259 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:41:59.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:41:59.259 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:41:59.468 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:41:59.468 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:41:59.468 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:41:59.951 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:41:59.951 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:41:59.951 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:41:59.951 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:41:59.951 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:41:59.990 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:41:59.990 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:41:59.990 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:41:59.990 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:41:59.990 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:41:59.990 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:41:59.990 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:41:59.991 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:41:59.997 INFO:teuthology.orchestra.run.smithi183.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-27T20:41:59.998 INFO:teuthology.orchestra.run.smithi183.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:41:59.998 INFO:teuthology.orchestra.run.smithi183.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:41:59.998 INFO:teuthology.orchestra.run.smithi183.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:41:59.998 INFO:teuthology.orchestra.run.smithi183.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:42:00.003 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:42:00.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:00.004 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:42:00.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:00.095 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:42:00.153 INFO:teuthology.orchestra.run.smithi183.stdout:client4692 2023-11-27T20:42:00.153 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:42:00.153 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:42:00.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:00.207 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:42:00.309 INFO:teuthology.orchestra.run.smithi183.stdout:client4692 2023-11-27T20:42:00.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:00.309 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:42:00.369 INFO:teuthology.orchestra.run.smithi183.stdout:client4692 2023-11-27T20:42:00.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:00.369 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/76812701-65a9-4deb-87af-ef00110d1601.client4692/status') 2023-11-27T20:42:00.464 INFO:teuthology.orchestra.run.smithi183.stdout:instance: client.4692 (3)172.21.15.183:0/1621526666 2023-11-27T20:42:00.464 INFO:teuthology.orchestra.run.smithi183.stdout:blocklisted: false 2023-11-27T20:42:00.464 INFO:teuthology.orchestra.run.smithi183.stderr:0+1 records in 2023-11-27T20:42:00.464 INFO:teuthology.orchestra.run.smithi183.stderr:0+1 records out 2023-11-27T20:42:00.464 INFO:teuthology.orchestra.run.smithi183.stderr:71 bytes copied, 9.6557e-05 s, 735 kB/s 2023-11-27T20:42:00.467 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-27T20:42:00.483 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:00.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.704+0000 7f0306e64640 1 Processor -- start 2023-11-27T20:42:00.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.704+0000 7f0306e64640 1 -- start start 2023-11-27T20:42:00.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.705+0000 7f0306e64640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f030014c2e0 0x7f03000c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:00.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.705+0000 7f0306e64640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03000c0440 0x7f0300152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:00.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.705+0000 7f0306e64640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0300071e80 con 0x7f0300072310 2023-11-27T20:42:00.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.705+0000 7f0306e64640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0300071470 con 0x7f030014c2e0 2023-11-27T20:42:00.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.705+0000 7f0306e64640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030014c6c0 con 0x7f03000c0440 2023-11-27T20:42:00.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.706+0000 7f0306663640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f0300072310 0x7f03000a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54598/0 (socket says 172.21.15.91:54598) 2023-11-27T20:42:00.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.706+0000 7f0306663640 1 -- 172.21.15.91:0/1427691495 learned_addr learned my addr 172.21.15.91:0/1427691495 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:00.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.706+0000 7f0305e62640 1 --2- 172.21.15.91:0/1427691495 >> v2:172.21.15.183:3300/0 conn(0x7f030014c2e0 0x7f03000c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:00.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.706+0000 7f0305661640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03000c0440 0x7f0300152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:00.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.706+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983927054 0 0) 0x7f0300071e80 con 0x7f0300072310 2023-11-27T20:42:00.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.706+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02ec003520 con 0x7f0300072310 2023-11-27T20:42:00.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1026589430 0 0) 0x7f02ec003520 con 0x7f0300072310 2023-11-27T20:42:00.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03000c0440 msgr2=0x7f0300152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:00.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03000c0440 0x7f0300152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 >> v2:172.21.15.183:3300/0 conn(0x7f030014c2e0 msgr2=0x7f03000c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 --2- 172.21.15.91:0/1427691495 >> v2:172.21.15.183:3300/0 conn(0x7f030014c2e0 0x7f03000c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300153180 con 0x7f0300072310 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f02f80019f0 con 0x7f0300072310 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 >> v1:172.21.15.91:6789/0 conn(0x7f0300072310 legacy=0x7f03000a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03000c0440 0x7f02ec003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02ec003ef0 0x7f02ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 0x7f02ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030014c6c0 con 0x7f02ec004d00 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec00ba90 con 0x7f02ec003ef0 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec00bc50 con 0x7f03000c0440 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0306663640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 0x7f02ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0305e62640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03000c0440 0x7f02ec003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:00.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0306663640 1 -- 172.21.15.91:0/1427691495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03000c0440 msgr2=0x7f02ec003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:00.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0306663640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03000c0440 0x7f02ec003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0306663640 1 -- 172.21.15.91:0/1427691495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02ec003ef0 msgr2=0x7f02ec0047c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T20:42:00.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0306663640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02ec003ef0 0x7f02ec0047c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.707+0000 7f0306663640 1 -- 172.21.15.91:0/1427691495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec003520 con 0x7f02ec004d00 2023-11-27T20:42:00.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.709+0000 7f0306663640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 0x7f02ec005180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02f800a840 tx=0x7f02ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1085b04fafddf814 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:00.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.709+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8034630 con 0x7f02ec004d00 2023-11-27T20:42:00.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.709+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f802f070 con 0x7f02ec004d00 2023-11-27T20:42:00.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.709+0000 7f0304e60640 1 -- 172.21.15.91:0/1427691495 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8034a30 con 0x7f02ec004d00 2023-11-27T20:42:00.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.709+0000 7f0306e64640 1 -- 172.21.15.91:0/1427691495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 msgr2=0x7f02ec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:00.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.709+0000 7f0306e64640 1 --2- 172.21.15.91:0/1427691495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 0x7f02ec005180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02f800a840 tx=0x7f02ec0057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.709+0000 7f0306663640 1 -- 172.21.15.91:0/1427691495 reap_dead start 2023-11-27T20:42:00.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.709+0000 7f0306e64640 1 -- 172.21.15.91:0/1427691495 shutdown_connections 2023-11-27T20:42:00.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.709+0000 7f0306e64640 1 -- 172.21.15.91:0/1427691495 >> 172.21.15.91:0/1427691495 conn(0x7f03000a77f0 msgr2=0x7f03000a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:00.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.710+0000 7f0306e64640 1 -- 172.21.15.91:0/1427691495 shutdown_connections 2023-11-27T20:42:00.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.710+0000 7f0306e64640 1 -- 172.21.15.91:0/1427691495 wait complete. 2023-11-27T20:42:00.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.711+0000 7f0306e64640 1 Processor -- start 2023-11-27T20:42:00.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.711+0000 7f0306e64640 1 -- start start 2023-11-27T20:42:00.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.712+0000 7f0306e64640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 0x7f0300144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:00.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.712+0000 7f0306e64640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03000a96c0 0x7f0300145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:00.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.712+0000 7f0306e64640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03001eadc0 0x7f03001eb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.712+0000 7f0306e64640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03001eb7b0 con 0x7f02ec004d00 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.712+0000 7f0306e64640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03000aa810 con 0x7f03000a96c0 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.712+0000 7f0306e64640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03000aaa90 con 0x7f03001eadc0 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.712+0000 7f0305e62640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 0x7f0300144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.712+0000 7f0305e62640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 0x7f0300144ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40228/0 (socket says 172.21.15.91:40228) 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.712+0000 7f0305e62640 1 -- 172.21.15.91:0/449379177 learned_addr learned my addr 172.21.15.91:0/449379177 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f0305e62640 1 -- 172.21.15.91:0/449379177 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03001eadc0 msgr2=0x7f03001eb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f0305e62640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03001eadc0 0x7f03001eb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f0305e62640 1 -- 172.21.15.91:0/449379177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03000a96c0 msgr2=0x7f0300145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f0305661640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03000a96c0 0x7f0300145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:00.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f0305e62640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03000a96c0 0x7f0300145220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f0305e62640 1 -- 172.21.15.91:0/449379177 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03000aad70 con 0x7f02ec004d00 2023-11-27T20:42:00.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f0305e62640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 0x7f0300144ce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f02fc011650 tx=0x7f02fc011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:00.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f02f67fc640 1 -- 172.21.15.91:0/449379177 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc00f9c0 con 0x7f02ec004d00 2023-11-27T20:42:00.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f02f67fc640 1 -- 172.21.15.91:0/449379177 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc00fb20 con 0x7f02ec004d00 2023-11-27T20:42:00.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f0306e64640 1 -- 172.21.15.91:0/449379177 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03000ab050 con 0x7f02ec004d00 2023-11-27T20:42:00.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.713+0000 7f02f67fc640 1 -- 172.21.15.91:0/449379177 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc00fe90 con 0x7f02ec004d00 2023-11-27T20:42:00.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.714+0000 7f0306e64640 1 -- 172.21.15.91:0/449379177 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03000a8750 con 0x7f02ec004d00 2023-11-27T20:42:00.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.715+0000 7f0306e64640 1 -- 172.21.15.91:0/449379177 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030004e840 con 0x7f02ec004d00 2023-11-27T20:42:00.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.716+0000 7f02f67fc640 1 -- 172.21.15.91:0/449379177 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f02fc015460 con 0x7f02ec004d00 2023-11-27T20:42:00.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.717+0000 7f02f67fc640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02e406b1f0 0x7f02e406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:00.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.717+0000 7f02f67fc640 1 -- 172.21.15.91:0/449379177 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02fc08a2a0 con 0x7f02ec004d00 2023-11-27T20:42:00.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.717+0000 7f0305661640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02e406b1f0 0x7f02e406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:00.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.718+0000 7f0305661640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02e406b1f0 0x7f02e406d6b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f02f0006fd0 tx=0x7f02f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:00.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.721+0000 7f02f67fc640 1 -- 172.21.15.91:0/449379177 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f02fc054fc0 con 0x7f02ec004d00 2023-11-27T20:42:00.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.914+0000 7f0306e64640 1 -- 172.21.15.91:0/449379177 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03000bfab0 con 0x7f02ec004d00 2023-11-27T20:42:00.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.916+0000 7f02f67fc640 1 -- 172.21.15.91:0/449379177 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f02fc0585e0 con 0x7f02ec004d00 2023-11-27T20:42:00.917 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:00.917 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:00.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 -- 172.21.15.91:0/449379177 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02e406b1f0 msgr2=0x7f02e406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:00.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02e406b1f0 0x7f02e406d6b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f02f0006fd0 tx=0x7f02f0008040 comp rx=0 tx=0).stop 2023-11-27T20:42:00.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 -- 172.21.15.91:0/449379177 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 msgr2=0x7f0300144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:00.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 0x7f0300144ce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f02fc011650 tx=0x7f02fc011b10 comp rx=0 tx=0).stop 2023-11-27T20:42:00.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 -- 172.21.15.91:0/449379177 shutdown_connections 2023-11-27T20:42:00.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03001eadc0 0x7f03001eb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02e406b1f0 0x7f02e406d6b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03000a96c0 0x7f0300145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 --2- 172.21.15.91:0/449379177 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02ec004d00 0x7f0300144ce0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:00.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 -- 172.21.15.91:0/449379177 >> 172.21.15.91:0/449379177 conn(0x7f03000a77f0 msgr2=0x7f03000c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:00.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 -- 172.21.15.91:0/449379177 shutdown_connections 2023-11-27T20:42:00.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:00.919+0000 7f0306e64640 1 -- 172.21.15.91:0/449379177 wait complete. 2023-11-27T20:42:00.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:41:32.704555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:41:33.818847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:42:00.938 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:42:01.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.153+0000 7f70f5506640 1 Processor -- start 2023-11-27T20:42:01.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.153+0000 7f70f5506640 1 -- start start 2023-11-27T20:42:01.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.155+0000 7f70f5506640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f70f014e7c0 0x7f70f00c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.155+0000 7f70f5506640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f70f00c4c00 0x7f70f00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.155+0000 7f70f5506640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f00ca990 0x7f70f0154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.155+0000 7f70f5506640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f00c5b10 con 0x7f70f014e7c0 2023-11-27T20:42:01.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.155+0000 7f70f5506640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f0158a60 con 0x7f70f00c4c00 2023-11-27T20:42:01.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.155+0000 7f70f5506640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0157ca0 con 0x7f70f00ca990 2023-11-27T20:42:01.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.155+0000 7f70effff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f70f014e7c0 0x7f70f00c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.155+0000 7f70effff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f70f014e7c0 0x7f70f00c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40234/0 (socket says 172.21.15.91:40234) 2023-11-27T20:42:01.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.155+0000 7f70effff640 1 -- 172.21.15.91:0/702953203 learned_addr learned my addr 172.21.15.91:0/702953203 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:01.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.156+0000 7f70f4d05640 1 --2- 172.21.15.91:0/702953203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f00ca990 0x7f70f0154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.156+0000 7f70ef7fe640 1 --2- 172.21.15.91:0/702953203 >> v2:172.21.15.183:3300/0 conn(0x7f70f00c4c00 0x7f70f00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.156+0000 7f70effff640 1 -- 172.21.15.91:0/702953203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f00ca990 msgr2=0x7f70f0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:01.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.156+0000 7f70effff640 1 --2- 172.21.15.91:0/702953203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f00ca990 0x7f70f0154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.156+0000 7f70effff640 1 -- 172.21.15.91:0/702953203 >> v2:172.21.15.183:3300/0 conn(0x7f70f00c4c00 msgr2=0x7f70f00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:01.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.156+0000 7f70effff640 1 --2- 172.21.15.91:0/702953203 >> v2:172.21.15.183:3300/0 conn(0x7f70f00c4c00 0x7f70f00ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.156+0000 7f70effff640 1 -- 172.21.15.91:0/702953203 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f0157f80 con 0x7f70f014e7c0 2023-11-27T20:42:01.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.156+0000 7f70ef7fe640 1 --2- 172.21.15.91:0/702953203 >> v2:172.21.15.183:3300/0 conn(0x7f70f00c4c00 0x7f70f00ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:01.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.157+0000 7f70effff640 1 --2- 172.21.15.91:0/702953203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f014e7c0 0x7f70f00c46c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f70f00ac990 tx=0x7f70e002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0d0de927e4e380 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:01.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.157+0000 7f70eeffd640 1 -- 172.21.15.91:0/702953203 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e002c950 con 0x7f70f014e7c0 2023-11-27T20:42:01.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.157+0000 7f70eeffd640 1 -- 172.21.15.91:0/702953203 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e002cab0 con 0x7f70f014e7c0 2023-11-27T20:42:01.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.157+0000 7f70eeffd640 1 -- 172.21.15.91:0/702953203 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e002ce40 con 0x7f70f014e7c0 2023-11-27T20:42:01.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.158+0000 7f70f5506640 1 -- 172.21.15.91:0/702953203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f014e7c0 msgr2=0x7f70f00c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:01.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.158+0000 7f70f5506640 1 --2- 172.21.15.91:0/702953203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f014e7c0 0x7f70f00c46c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f70f00ac990 tx=0x7f70e002bdb0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.158+0000 7f70f5506640 1 -- 172.21.15.91:0/702953203 shutdown_connections 2023-11-27T20:42:01.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.158+0000 7f70f5506640 1 --2- 172.21.15.91:0/702953203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f00ca990 0x7f70f0154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.158+0000 7f70f5506640 1 --2- 172.21.15.91:0/702953203 >> v2:172.21.15.183:3300/0 conn(0x7f70f00c4c00 0x7f70f00ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.158+0000 7f70f5506640 1 --2- 172.21.15.91:0/702953203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f014e7c0 0x7f70f00c46c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.158+0000 7f70f5506640 1 -- 172.21.15.91:0/702953203 >> 172.21.15.91:0/702953203 conn(0x7f70f00abf00 msgr2=0x7f70f00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:01.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.158+0000 7f70f5506640 1 -- 172.21.15.91:0/702953203 shutdown_connections 2023-11-27T20:42:01.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.158+0000 7f70f5506640 1 -- 172.21.15.91:0/702953203 wait complete. 2023-11-27T20:42:01.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.160+0000 7f70f5506640 1 Processor -- start 2023-11-27T20:42:01.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.161+0000 7f70f5506640 1 -- start start 2023-11-27T20:42:01.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70f5506640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f00c4c00 0x7f70f00ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70f5506640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f00ca990 0x7f70f014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70f5506640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f014e7c0 0x7f70f014cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70f5506640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0150480 con 0x7f70f00ca990 2023-11-27T20:42:01.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70f5506640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f014ef20 con 0x7f70f00c4c00 2023-11-27T20:42:01.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70f5506640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0151570 con 0x7f70f014e7c0 2023-11-27T20:42:01.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70ef7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f00ca990 0x7f70f014fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70ef7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f00ca990 0x7f70f014fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40236/0 (socket says 172.21.15.91:40236) 2023-11-27T20:42:01.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70ef7fe640 1 -- 172.21.15.91:0/4095710171 learned_addr learned my addr 172.21.15.91:0/4095710171 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:01.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70effff640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f00c4c00 0x7f70f00ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70f4d05640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f014e7c0 0x7f70f014cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70ef7fe640 1 -- 172.21.15.91:0/4095710171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f014e7c0 msgr2=0x7f70f014cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:01.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70ef7fe640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f014e7c0 0x7f70f014cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70ef7fe640 1 -- 172.21.15.91:0/4095710171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f00c4c00 msgr2=0x7f70f00ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:01.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70ef7fe640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f00c4c00 0x7f70f00ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.162+0000 7f70ef7fe640 1 -- 172.21.15.91:0/4095710171 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0009b30 con 0x7f70f00ca990 2023-11-27T20:42:01.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.163+0000 7f70effff640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f00c4c00 0x7f70f00ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:01.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.163+0000 7f70ef7fe640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f00ca990 0x7f70f014fa40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c7c0 tx=0x7f70d800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:01.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.163+0000 7f70ecff9640 1 -- 172.21.15.91:0/4095710171 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8007a30 con 0x7f70f00ca990 2023-11-27T20:42:01.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.163+0000 7f70ecff9640 1 -- 172.21.15.91:0/4095710171 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8007b90 con 0x7f70f00ca990 2023-11-27T20:42:01.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.163+0000 7f70ecff9640 1 -- 172.21.15.91:0/4095710171 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800ce70 con 0x7f70f00ca990 2023-11-27T20:42:01.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.163+0000 7f70f5506640 1 -- 172.21.15.91:0/4095710171 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f014cab0 con 0x7f70f00ca990 2023-11-27T20:42:01.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.163+0000 7f70f5506640 1 -- 172.21.15.91:0/4095710171 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f0151780 con 0x7f70f00ca990 2023-11-27T20:42:01.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.164+0000 7f70f5506640 1 -- 172.21.15.91:0/4095710171 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f014cc60 con 0x7f70f00ca990 2023-11-27T20:42:01.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.165+0000 7f70ecff9640 1 -- 172.21.15.91:0/4095710171 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f70d80113f0 con 0x7f70f00ca990 2023-11-27T20:42:01.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.166+0000 7f70ecff9640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f70d006b1c0 0x7f70d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.166+0000 7f70ecff9640 1 -- 172.21.15.91:0/4095710171 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70d8089c70 con 0x7f70f00ca990 2023-11-27T20:42:01.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.166+0000 7f70effff640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f70d006b1c0 0x7f70d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.167+0000 7f70effff640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f70d006b1c0 0x7f70d006d680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70e0035000 tx=0x7f70e0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:01.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.171+0000 7f70ecff9640 1 -- 172.21.15.91:0/4095710171 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f70f014cc60 con 0x7f70f00ca990 2023-11-27T20:42:01.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.361+0000 7f70f5506640 1 -- 172.21.15.91:0/4095710171 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70f014cc60 con 0x7f70f00ca990 2023-11-27T20:42:01.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.362+0000 7f70ecff9640 1 -- 172.21.15.91:0/4095710171 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70f014cc60 con 0x7f70f00ca990 2023-11-27T20:42:01.362 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:42:01.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 -- 172.21.15.91:0/4095710171 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f70d006b1c0 msgr2=0x7f70d006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:01.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f70d006b1c0 0x7f70d006d680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70e0035000 tx=0x7f70e0030000 comp rx=0 tx=0).stop 2023-11-27T20:42:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 -- 172.21.15.91:0/4095710171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f00ca990 msgr2=0x7f70f014fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f00ca990 0x7f70f014fa40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c7c0 tx=0x7f70d800cc80 comp rx=0 tx=0).stop 2023-11-27T20:42:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 -- 172.21.15.91:0/4095710171 shutdown_connections 2023-11-27T20:42:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f014e7c0 0x7f70f014cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70f00ca990 0x7f70f014fa40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f70d006b1c0 0x7f70d006d680 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 --2- 172.21.15.91:0/4095710171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f00c4c00 0x7f70f00ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 -- 172.21.15.91:0/4095710171 >> 172.21.15.91:0/4095710171 conn(0x7f70f00abf00 msgr2=0x7f70f0066400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 -- 172.21.15.91:0/4095710171 shutdown_connections 2023-11-27T20:42:01.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.365+0000 7f70f5506640 1 -- 172.21.15.91:0/4095710171 wait complete. 2023-11-27T20:42:01.385 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:42:01.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.600+0000 7fe106e4f640 1 Processor -- start 2023-11-27T20:42:01.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.600+0000 7fe106e4f640 1 -- start start 2023-11-27T20:42:01.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.601+0000 7fe106e4f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe10006d0a0 0x7fe100152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.601+0000 7fe106e4f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe1000c3ea0 0x7fe1000c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe106e4f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1000c64a0 con 0x7fe10014fd30 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe106e4f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1000c5c00 con 0x7fe1000c3ea0 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe106e4f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1000c5ee0 con 0x7fe10006d0a0 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe1053ec640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe1000c3ea0 0x7fe1000c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe1053ec640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe1000c3ea0 0x7fe1000c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40250/0 (socket says 172.21.15.91:40250) 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe1053ec640 1 -- 172.21.15.91:0/3283307349 learned_addr learned my addr 172.21.15.91:0/3283307349 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe0fffff640 1 --2- 172.21.15.91:0/3283307349 >> v2:172.21.15.183:3300/0 conn(0x7fe10006d0a0 0x7fe100152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe1053ec640 1 -- 172.21.15.91:0/3283307349 >> v2:172.21.15.183:3300/0 conn(0x7fe10006d0a0 msgr2=0x7fe100152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe1053ec640 1 --2- 172.21.15.91:0/3283307349 >> v2:172.21.15.183:3300/0 conn(0x7fe10006d0a0 0x7fe100152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe1053ec640 1 -- 172.21.15.91:0/3283307349 >> v1:172.21.15.183:6789/0 conn(0x7fe10014fd30 legacy=0x7fe1000a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:01.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.602+0000 7fe1053ec640 1 -- 172.21.15.91:0/3283307349 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1000c61c0 con 0x7fe1000c3ea0 2023-11-27T20:42:01.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.603+0000 7fe1053ec640 1 --2- 172.21.15.91:0/3283307349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1000c3ea0 0x7fe1000c4330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe10006b460 tx=0x7fe0f802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b473f62d0080f64c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:01.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.604+0000 7fe0ff7fe640 1 -- 172.21.15.91:0/3283307349 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f802ca80 con 0x7fe1000c3ea0 2023-11-27T20:42:01.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.604+0000 7fe0ff7fe640 1 -- 172.21.15.91:0/3283307349 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f802cbe0 con 0x7fe1000c3ea0 2023-11-27T20:42:01.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.604+0000 7fe0ff7fe640 1 -- 172.21.15.91:0/3283307349 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80343f0 con 0x7fe1000c3ea0 2023-11-27T20:42:01.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.604+0000 7fe106e4f640 1 -- 172.21.15.91:0/3283307349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1000c3ea0 msgr2=0x7fe1000c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:01.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.604+0000 7fe106e4f640 1 --2- 172.21.15.91:0/3283307349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1000c3ea0 0x7fe1000c4330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe10006b460 tx=0x7fe0f802bee0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.605+0000 7fe106e4f640 1 -- 172.21.15.91:0/3283307349 shutdown_connections 2023-11-27T20:42:01.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.605+0000 7fe106e4f640 1 --2- 172.21.15.91:0/3283307349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1000c3ea0 0x7fe1000c4330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.605+0000 7fe106e4f640 1 --2- 172.21.15.91:0/3283307349 >> v2:172.21.15.183:3300/0 conn(0x7fe10006d0a0 0x7fe100152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.605+0000 7fe106e4f640 1 -- 172.21.15.91:0/3283307349 >> 172.21.15.91:0/3283307349 conn(0x7fe10006a500 msgr2=0x7fe10006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:01.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.605+0000 7fe106e4f640 1 -- 172.21.15.91:0/3283307349 shutdown_connections 2023-11-27T20:42:01.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.605+0000 7fe106e4f640 1 -- 172.21.15.91:0/3283307349 wait complete. 2023-11-27T20:42:01.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.607+0000 7fe106e4f640 1 Processor -- start 2023-11-27T20:42:01.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.607+0000 7fe106e4f640 1 -- start start 2023-11-27T20:42:01.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.608+0000 7fe106e4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe10006d0a0 0x7fe100070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.608+0000 7fe106e4f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1000c3ea0 0x7fe1000711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.608+0000 7fe106e4f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe10014fd30 0x7fe10014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.608+0000 7fe106e4f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe100071af0 con 0x7fe10014fd30 2023-11-27T20:42:01.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.608+0000 7fe106e4f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe100070840 con 0x7fe1000c3ea0 2023-11-27T20:42:01.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.608+0000 7fe106e4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1001ee5c0 con 0x7fe10006d0a0 2023-11-27T20:42:01.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.608+0000 7fe1053ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe10014fd30 0x7fe10014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.608+0000 7fe1053ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe10014fd30 0x7fe10014af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40266/0 (socket says 172.21.15.91:40266) 2023-11-27T20:42:01.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.608+0000 7fe1053ec640 1 -- 172.21.15.91:0/3758981549 learned_addr learned my addr 172.21.15.91:0/3758981549 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:01.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.609+0000 7fe104beb640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe10006d0a0 0x7fe100070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.609+0000 7fe0fffff640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1000c3ea0 0x7fe1000711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.609+0000 7fe1053ec640 1 -- 172.21.15.91:0/3758981549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe10006d0a0 msgr2=0x7fe100070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:01.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.609+0000 7fe1053ec640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe10006d0a0 0x7fe100070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.609+0000 7fe1053ec640 1 -- 172.21.15.91:0/3758981549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1000c3ea0 msgr2=0x7fe1000711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:01.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.609+0000 7fe1053ec640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1000c3ea0 0x7fe1000711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.609+0000 7fe1053ec640 1 -- 172.21.15.91:0/3758981549 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f8009b30 con 0x7fe10014fd30 2023-11-27T20:42:01.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.609+0000 7fe1053ec640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe10014fd30 0x7fe10014af10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8036040 tx=0x7fe0f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:01.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.610+0000 7fe0fd7fa640 1 -- 172.21.15.91:0/3758981549 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8009510 con 0x7fe10014fd30 2023-11-27T20:42:01.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.610+0000 7fe0fd7fa640 1 -- 172.21.15.91:0/3758981549 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f803e450 con 0x7fe10014fd30 2023-11-27T20:42:01.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.610+0000 7fe0fd7fa640 1 -- 172.21.15.91:0/3758981549 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f803e7e0 con 0x7fe10014fd30 2023-11-27T20:42:01.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.610+0000 7fe106e4f640 1 -- 172.21.15.91:0/3758981549 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe100153cf0 con 0x7fe10014fd30 2023-11-27T20:42:01.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.610+0000 7fe106e4f640 1 -- 172.21.15.91:0/3758981549 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1001542b0 con 0x7fe10014fd30 2023-11-27T20:42:01.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.611+0000 7fe106e4f640 1 -- 172.21.15.91:0/3758981549 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1000709b0 con 0x7fe10014fd30 2023-11-27T20:42:01.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.612+0000 7fe0fd7fa640 1 -- 172.21.15.91:0/3758981549 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe0f802cd50 con 0x7fe10014fd30 2023-11-27T20:42:01.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.613+0000 7fe0fd7fa640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe0e406b1c0 0x7fe0e406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:01.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.613+0000 7fe0fd7fa640 1 -- 172.21.15.91:0/3758981549 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0f80ac510 con 0x7fe10014fd30 2023-11-27T20:42:01.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.613+0000 7fe104beb640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe0e406b1c0 0x7fe0e406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:01.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.614+0000 7fe104beb640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe0e406b1c0 0x7fe0e406d680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4007fd0 tx=0x7fe0f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:01.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.617+0000 7fe0fd7fa640 1 -- 172.21.15.91:0/3758981549 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe1000709b0 con 0x7fe10014fd30 2023-11-27T20:42:01.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.806+0000 7fe106e4f640 1 -- 172.21.15.91:0/3758981549 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1000709b0 con 0x7fe10014fd30 2023-11-27T20:42:01.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.807+0000 7fe0fd7fa640 1 -- 172.21.15.91:0/3758981549 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1000709b0 con 0x7fe10014fd30 2023-11-27T20:42:01.807 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:42:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 -- 172.21.15.91:0/3758981549 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe0e406b1c0 msgr2=0x7fe0e406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe0e406b1c0 0x7fe0e406d680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4007fd0 tx=0x7fe0f4009040 comp rx=0 tx=0).stop 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 -- 172.21.15.91:0/3758981549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe10014fd30 msgr2=0x7fe10014af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe10014fd30 0x7fe10014af10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8036040 tx=0x7fe0f8004a40 comp rx=0 tx=0).stop 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 -- 172.21.15.91:0/3758981549 shutdown_connections 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe10014fd30 0x7fe10014af10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe0e406b1c0 0x7fe0e406d680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1000c3ea0 0x7fe1000711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 --2- 172.21.15.91:0/3758981549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe10006d0a0 0x7fe100070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 -- 172.21.15.91:0/3758981549 >> 172.21.15.91:0/3758981549 conn(0x7fe10006a500 msgr2=0x7fe1000c1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 -- 172.21.15.91:0/3758981549 shutdown_connections 2023-11-27T20:42:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:01.809+0000 7fe106e4f640 1 -- 172.21.15.91:0/3758981549 wait complete. 2023-11-27T20:42:01.829 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:42:02.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.044+0000 7f853d67c640 1 Processor -- start 2023-11-27T20:42:02.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.044+0000 7f853d67c640 1 -- start start 2023-11-27T20:42:02.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.045+0000 7f853d67c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8538155490 0x7f85380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.045+0000 7f853d67c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85380a9b40 0x7f85380c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.045+0000 7f853d67c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85380c06c0 con 0x7f85380c1500 2023-11-27T20:42:02.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.045+0000 7f853d67c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85380a5820 con 0x7f8538155490 2023-11-27T20:42:02.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.045+0000 7f853d67c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85380c1020 con 0x7f85380a9b40 2023-11-27T20:42:02.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.045+0000 7f852ffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f85380c1500 0x7f85380a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54612/0 (socket says 172.21.15.91:54612) 2023-11-27T20:42:02.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f852ffff640 1 -- 172.21.15.91:0/454091294 learned_addr learned my addr 172.21.15.91:0/454091294 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:02.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f8536ffd640 1 --2- 172.21.15.91:0/454091294 >> v2:172.21.15.183:3300/0 conn(0x7f8538155490 0x7f85380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85377fe640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85380a9b40 0x7f85380c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498205817 0 0) 0x7f85380c06c0 con 0x7f85380c1500 2023-11-27T20:42:02.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8524003520 con 0x7f85380c1500 2023-11-27T20:42:02.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1845325491 0 0) 0x7f8524003520 con 0x7f85380c1500 2023-11-27T20:42:02.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85380a9b40 msgr2=0x7f85380c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:02.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85380a9b40 0x7f85380c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 >> v2:172.21.15.183:3300/0 conn(0x7f8538155490 msgr2=0x7f85380a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:02.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 --2- 172.21.15.91:0/454091294 >> v2:172.21.15.183:3300/0 conn(0x7f8538155490 0x7f85380a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85380c0910 con 0x7f85380c1500 2023-11-27T20:42:02.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f8520001670 con 0x7f85380c1500 2023-11-27T20:42:02.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 >> v1:172.21.15.91:6789/0 conn(0x7f85380c1500 legacy=0x7f85380a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.046+0000 7f85367fc640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8524003970 0x7f8524003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f85367fc640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 0x7f8524004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f85367fc640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8524005180 0x7f852400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85380c1020 con 0x7f85240047c0 2023-11-27T20:42:02.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85240044e0 con 0x7f8524003970 2023-11-27T20:42:02.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852400bec0 con 0x7f8524005180 2023-11-27T20:42:02.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f852ffff640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 0x7f8524004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f85377fe640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8524005180 0x7f852400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f8536ffd640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8524003970 0x7f8524003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f852ffff640 1 -- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8524005180 msgr2=0x7f852400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:02.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f852ffff640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8524005180 0x7f852400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f852ffff640 1 -- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8524003970 msgr2=0x7f8524003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:02.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f852ffff640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8524003970 0x7f8524003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.047+0000 7f852ffff640 1 -- 172.21.15.91:0/454091294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524003520 con 0x7f85240047c0 2023-11-27T20:42:02.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.048+0000 7f852ffff640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 0x7f8524004c40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f852000c290 tx=0x7f85240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17ed0ee7395d7d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:02.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.049+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520005ad0 con 0x7f85240047c0 2023-11-27T20:42:02.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.049+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520005c30 con 0x7f85240047c0 2023-11-27T20:42:02.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.049+0000 7f85367fc640 1 -- 172.21.15.91:0/454091294 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852002c8d0 con 0x7f85240047c0 2023-11-27T20:42:02.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.049+0000 7f853d67c640 1 -- 172.21.15.91:0/454091294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 msgr2=0x7f8524004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.049+0000 7f853d67c640 1 --2- 172.21.15.91:0/454091294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 0x7f8524004c40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f852000c290 tx=0x7f85240057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.049+0000 7f85377fe640 1 -- 172.21.15.91:0/454091294 reap_dead start 2023-11-27T20:42:02.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.049+0000 7f853d67c640 1 -- 172.21.15.91:0/454091294 shutdown_connections 2023-11-27T20:42:02.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.049+0000 7f853d67c640 1 -- 172.21.15.91:0/454091294 >> 172.21.15.91:0/454091294 conn(0x7f853806a500 msgr2=0x7f853806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:02.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.049+0000 7f853d67c640 1 -- 172.21.15.91:0/454091294 shutdown_connections 2023-11-27T20:42:02.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.050+0000 7f853d67c640 1 -- 172.21.15.91:0/454091294 wait complete. 2023-11-27T20:42:02.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.051+0000 7f853d67c640 1 Processor -- start 2023-11-27T20:42:02.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.051+0000 7f853d67c640 1 -- start start 2023-11-27T20:42:02.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.052+0000 7f853d67c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 0x7f8538070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.052+0000 7f853d67c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8538151600 0x7f85381ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.052+0000 7f853d67c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85381510b0 0x7f8538071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.052+0000 7f853d67c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85381edae0 con 0x7f85240047c0 2023-11-27T20:42:02.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.052+0000 7f853d67c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85381dd160 con 0x7f85381510b0 2023-11-27T20:42:02.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.052+0000 7f853d67c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85381dce80 con 0x7f8538151600 2023-11-27T20:42:02.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.053+0000 7f8536ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 0x7f8538070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.053+0000 7f8536ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 0x7f8538070780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40272/0 (socket says 172.21.15.91:40272) 2023-11-27T20:42:02.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.053+0000 7f8536ffd640 1 -- 172.21.15.91:0/1569387390 learned_addr learned my addr 172.21.15.91:0/1569387390 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:02.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.053+0000 7f8536ffd640 1 -- 172.21.15.91:0/1569387390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8538151600 msgr2=0x7f85381ed1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.053+0000 7f8536ffd640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8538151600 0x7f85381ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.053+0000 7f8536ffd640 1 -- 172.21.15.91:0/1569387390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85381510b0 msgr2=0x7f8538071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.053+0000 7f8536ffd640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85381510b0 0x7f8538071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.053+0000 7f8536ffd640 1 -- 172.21.15.91:0/1569387390 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85381dd8e0 con 0x7f85240047c0 2023-11-27T20:42:02.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.053+0000 7f8536ffd640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 0x7f8538070780 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8528011600 tx=0x7f8528011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.053+0000 7f852f7fe640 1 -- 172.21.15.91:0/1569387390 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528015870 con 0x7f85240047c0 2023-11-27T20:42:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.054+0000 7f852f7fe640 1 -- 172.21.15.91:0/1569387390 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85280159d0 con 0x7f85240047c0 2023-11-27T20:42:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.054+0000 7f852f7fe640 1 -- 172.21.15.91:0/1569387390 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528015d40 con 0x7f85240047c0 2023-11-27T20:42:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.054+0000 7f853d67c640 1 -- 172.21.15.91:0/1569387390 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85381ddbc0 con 0x7f85240047c0 2023-11-27T20:42:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.054+0000 7f853d67c640 1 -- 172.21.15.91:0/1569387390 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8538071ba0 con 0x7f85240047c0 2023-11-27T20:42:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.055+0000 7f853d67c640 1 -- 172.21.15.91:0/1569387390 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85381edd50 con 0x7f85240047c0 2023-11-27T20:42:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.056+0000 7f852f7fe640 1 -- 172.21.15.91:0/1569387390 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f852800f490 con 0x7f85240047c0 2023-11-27T20:42:02.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.057+0000 7f852f7fe640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f851806b1f0 0x7f851806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.057+0000 7f852f7fe640 1 -- 172.21.15.91:0/1569387390 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8528089df0 con 0x7f85240047c0 2023-11-27T20:42:02.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.057+0000 7f852ffff640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f851806b1f0 0x7f851806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.058+0000 7f852ffff640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f851806b1f0 0x7f851806d6b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f852000c290 tx=0x7f852002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:02.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.061+0000 7f852f7fe640 1 -- 172.21.15.91:0/1569387390 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8528054bb0 con 0x7f85240047c0 2023-11-27T20:42:02.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.250+0000 7f853d67c640 1 -- 172.21.15.91:0/1569387390 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8538068350 con 0x7f85240047c0 2023-11-27T20:42:02.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.251+0000 7f852f7fe640 1 -- 172.21.15.91:0/1569387390 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85280581d0 con 0x7f85240047c0 2023-11-27T20:42:02.251 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:42:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.253+0000 7f853d67c640 1 -- 172.21.15.91:0/1569387390 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f851806b1f0 msgr2=0x7f851806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.253+0000 7f853d67c640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f851806b1f0 0x7f851806d6b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f852000c290 tx=0x7f852002e000 comp rx=0 tx=0).stop 2023-11-27T20:42:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.253+0000 7f853d67c640 1 -- 172.21.15.91:0/1569387390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 msgr2=0x7f8538070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.253+0000 7f853d67c640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 0x7f8538070780 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8528011600 tx=0x7f8528011ac0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.254+0000 7f853d67c640 1 -- 172.21.15.91:0/1569387390 shutdown_connections 2023-11-27T20:42:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.254+0000 7f853d67c640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f851806b1f0 0x7f851806d6b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.254+0000 7f853d67c640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85381510b0 0x7f8538071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.254+0000 7f853d67c640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8538151600 0x7f85381ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.254+0000 7f853d67c640 1 --2- 172.21.15.91:0/1569387390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85240047c0 0x7f8538070780 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.254+0000 7f853d67c640 1 -- 172.21.15.91:0/1569387390 >> 172.21.15.91:0/1569387390 conn(0x7f853806a500 msgr2=0x7f85381df8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.254+0000 7f853d67c640 1 -- 172.21.15.91:0/1569387390 shutdown_connections 2023-11-27T20:42:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.254+0000 7f853d67c640 1 -- 172.21.15.91:0/1569387390 wait complete. 2023-11-27T20:42:02.273 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:02.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.486+0000 7f1893fff640 1 Processor -- start 2023-11-27T20:42:02.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.486+0000 7f1893fff640 1 -- start start 2023-11-27T20:42:02.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.488+0000 7f1893fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f18940a4d20 0x7f18940a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.488+0000 7f1893fff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1894157ad0 con 0x7f1894154430 2023-11-27T20:42:02.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.488+0000 7f1893fff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1894157db0 con 0x7f18940c1450 2023-11-27T20:42:02.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.488+0000 7f1893fff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1894154fd0 con 0x7f18940a4d20 2023-11-27T20:42:02.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.488+0000 7f188a7fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f1894154430 0x7f18941548c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54622/0 (socket says 172.21.15.91:54622) 2023-11-27T20:42:02.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.488+0000 7f188a7fc640 1 -- 172.21.15.91:0/4208054051 learned_addr learned my addr 172.21.15.91:0/4208054051 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:02.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.488+0000 7f1892ffd640 1 --2- 172.21.15.91:0/4208054051 >> v2:172.21.15.91:3300/0 conn(0x7f18940a4d20 0x7f18940a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.489+0000 7f18927fc640 1 -- 172.21.15.91:0/4208054051 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222264811 0 0) 0x7f1894157ad0 con 0x7f1894154430 2023-11-27T20:42:02.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.489+0000 7f18927fc640 1 -- 172.21.15.91:0/4208054051 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1874003520 con 0x7f1894154430 2023-11-27T20:42:02.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.489+0000 7f1892ffd640 1 -- 172.21.15.91:0/4208054051 >> v1:172.21.15.183:6789/0 conn(0x7f18940c1450 legacy=0x7f189415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:02.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.489+0000 7f1892ffd640 1 -- 172.21.15.91:0/4208054051 >> v1:172.21.15.91:6789/0 conn(0x7f1894154430 legacy=0x7f18941548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.489+0000 7f1892ffd640 1 -- 172.21.15.91:0/4208054051 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894158090 con 0x7f18940a4d20 2023-11-27T20:42:02.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.490+0000 7f1892ffd640 1 --2- 172.21.15.91:0/4208054051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 0x7f18940a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f18840097a0 tx=0x7f188402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2789e8f5016c0a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:02.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.490+0000 7f18927fc640 1 -- 172.21.15.91:0/4208054051 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188402e070 con 0x7f18940a4d20 2023-11-27T20:42:02.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.490+0000 7f18927fc640 1 -- 172.21.15.91:0/4208054051 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18840315a0 con 0x7f18940a4d20 2023-11-27T20:42:02.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.490+0000 7f18927fc640 1 -- 172.21.15.91:0/4208054051 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884031930 con 0x7f18940a4d20 2023-11-27T20:42:02.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.491+0000 7f1893fff640 1 -- 172.21.15.91:0/4208054051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 msgr2=0x7f18940a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.491+0000 7f1893fff640 1 --2- 172.21.15.91:0/4208054051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 0x7f18940a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f18840097a0 tx=0x7f188402b840 comp rx=0 tx=0).stop 2023-11-27T20:42:02.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.491+0000 7f1893fff640 1 -- 172.21.15.91:0/4208054051 shutdown_connections 2023-11-27T20:42:02.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.491+0000 7f1893fff640 1 --2- 172.21.15.91:0/4208054051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 0x7f18940a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.491+0000 7f1893fff640 1 -- 172.21.15.91:0/4208054051 >> 172.21.15.91:0/4208054051 conn(0x7f18940a77f0 msgr2=0x7f18940a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:02.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.491+0000 7f1893fff640 1 -- 172.21.15.91:0/4208054051 shutdown_connections 2023-11-27T20:42:02.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.491+0000 7f1893fff640 1 -- 172.21.15.91:0/4208054051 wait complete. 2023-11-27T20:42:02.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.493+0000 7f1893fff640 1 Processor -- start 2023-11-27T20:42:02.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.493+0000 7f1893fff640 1 -- start start 2023-11-27T20:42:02.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.494+0000 7f1893fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 0x7f1894150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.494+0000 7f1893fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18940c1450 0x7f189414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.494+0000 7f1893fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1894154430 0x7f189414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.494+0000 7f1893fff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189414cef0 con 0x7f18940a4d20 2023-11-27T20:42:02.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.494+0000 7f1893fff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18940ab200 con 0x7f1894154430 2023-11-27T20:42:02.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.494+0000 7f1893fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18940ab780 con 0x7f18940c1450 2023-11-27T20:42:02.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.494+0000 7f1892ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 0x7f1894150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f1892ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 0x7f1894150510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40290/0 (socket says 172.21.15.91:40290) 2023-11-27T20:42:02.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f1892ffd640 1 -- 172.21.15.91:0/3620421115 learned_addr learned my addr 172.21.15.91:0/3620421115 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:02.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f18937fe640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1894154430 0x7f189414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f188a7fc640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18940c1450 0x7f189414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f1892ffd640 1 -- 172.21.15.91:0/3620421115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18940c1450 msgr2=0x7f189414bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f1892ffd640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18940c1450 0x7f189414bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f1892ffd640 1 -- 172.21.15.91:0/3620421115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1894154430 msgr2=0x7f189414c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f1892ffd640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1894154430 0x7f189414c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f1892ffd640 1 -- 172.21.15.91:0/3620421115 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884009400 con 0x7f18940a4d20 2023-11-27T20:42:02.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f188a7fc640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18940c1450 0x7f189414bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:02.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.495+0000 7f1892ffd640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 0x7f1894150510 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1884034040 tx=0x7f18840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:02.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.496+0000 7f188bfff640 1 -- 172.21.15.91:0/3620421115 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884032840 con 0x7f18940a4d20 2023-11-27T20:42:02.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.496+0000 7f188bfff640 1 -- 172.21.15.91:0/3620421115 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18840329c0 con 0x7f18940a4d20 2023-11-27T20:42:02.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.496+0000 7f188bfff640 1 -- 172.21.15.91:0/3620421115 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884032d70 con 0x7f18940a4d20 2023-11-27T20:42:02.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.496+0000 7f1893fff640 1 -- 172.21.15.91:0/3620421115 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189414c740 con 0x7f18940a4d20 2023-11-27T20:42:02.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.496+0000 7f1893fff640 1 -- 172.21.15.91:0/3620421115 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1894150a50 con 0x7f18940a4d20 2023-11-27T20:42:02.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.497+0000 7f1893fff640 1 -- 172.21.15.91:0/3620421115 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189404e840 con 0x7f18940a4d20 2023-11-27T20:42:02.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.498+0000 7f188bfff640 1 -- 172.21.15.91:0/3620421115 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f188404d3f0 con 0x7f18940a4d20 2023-11-27T20:42:02.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.499+0000 7f188bfff640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f187806b1c0 0x7f187806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.499+0000 7f188bfff640 1 -- 172.21.15.91:0/3620421115 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18840ab520 con 0x7f18940a4d20 2023-11-27T20:42:02.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.499+0000 7f188a7fc640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f187806b1c0 0x7f187806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.500+0000 7f188a7fc640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f187806b1c0 0x7f187806d680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f187c007fd0 tx=0x7f187c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:02.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.503+0000 7f188bfff640 1 -- 172.21.15.91:0/3620421115 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1884076240 con 0x7f18940a4d20 2023-11-27T20:42:02.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.693+0000 7f1893fff640 1 -- 172.21.15.91:0/3620421115 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18940bfc70 con 0x7f18940a4d20 2023-11-27T20:42:02.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.695+0000 7f188bfff640 1 -- 172.21.15.91:0/3620421115 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f1884079860 con 0x7f18940a4d20 2023-11-27T20:42:02.698 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:02.698 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:02.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 -- 172.21.15.91:0/3620421115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f187806b1c0 msgr2=0x7f187806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f187806b1c0 0x7f187806d680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f187c007fd0 tx=0x7f187c009040 comp rx=0 tx=0).stop 2023-11-27T20:42:02.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 -- 172.21.15.91:0/3620421115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 msgr2=0x7f1894150510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 0x7f1894150510 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1884034040 tx=0x7f18840046c0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 -- 172.21.15.91:0/3620421115 shutdown_connections 2023-11-27T20:42:02.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f187806b1c0 0x7f187806d680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1894154430 0x7f189414c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18940c1450 0x7f189414bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 --2- 172.21.15.91:0/3620421115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18940a4d20 0x7f1894150510 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 -- 172.21.15.91:0/3620421115 >> 172.21.15.91:0/3620421115 conn(0x7f18940a77f0 msgr2=0x7f18940c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:02.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 -- 172.21.15.91:0/3620421115 shutdown_connections 2023-11-27T20:42:02.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.698+0000 7f1893fff640 1 -- 172.21.15.91:0/3620421115 wait complete. 2023-11-27T20:42:02.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:41:32.704555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:41:33.818847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:42:02.720 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:42:02.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.936+0000 7f46b6eda640 1 Processor -- start 2023-11-27T20:42:02.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.936+0000 7f46b6eda640 1 -- start start 2023-11-27T20:42:02.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.938+0000 7f46b6eda640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f46b014e7c0 0x7f46b00c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.938+0000 7f46b6eda640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b01550c0 con 0x7f46b00c4c00 2023-11-27T20:42:02.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.938+0000 7f46b6eda640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b0158a60 con 0x7f46b0154580 2023-11-27T20:42:02.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.938+0000 7f46b6eda640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b00c5b10 con 0x7f46b014e7c0 2023-11-27T20:42:02.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.938+0000 7f46b5ed8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f46b014e7c0 0x7f46b00c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.938+0000 7f46b56d7640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f46b00c4c00 0x7f46b00ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54626/0 (socket says 172.21.15.91:54626) 2023-11-27T20:42:02.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.938+0000 7f46b56d7640 1 -- 172.21.15.91:0/1015423374 learned_addr learned my addr 172.21.15.91:0/1015423374 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:02.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.939+0000 7f46b5ed8640 1 -- 172.21.15.91:0/1015423374 >> v1:172.21.15.183:6789/0 conn(0x7f46b0154580 legacy=0x7f46b01549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:02.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.939+0000 7f46b5ed8640 1 -- 172.21.15.91:0/1015423374 >> v1:172.21.15.91:6789/0 conn(0x7f46b00c4c00 legacy=0x7f46b00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.939+0000 7f46b5ed8640 1 -- 172.21.15.91:0/1015423374 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b0157ca0 con 0x7f46b014e7c0 2023-11-27T20:42:02.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.940+0000 7f46b5ed8640 1 --2- 172.21.15.91:0/1015423374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 0x7f46b00c46c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0097a0 tx=0x7f46ac02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941d0d472e338efe server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:02.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.940+0000 7f46b4ed6640 1 -- 172.21.15.91:0/1015423374 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac02f050 con 0x7f46b014e7c0 2023-11-27T20:42:02.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.940+0000 7f46b4ed6640 1 -- 172.21.15.91:0/1015423374 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac031700 con 0x7f46b014e7c0 2023-11-27T20:42:02.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.940+0000 7f46b4ed6640 1 -- 172.21.15.91:0/1015423374 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac031a90 con 0x7f46b014e7c0 2023-11-27T20:42:02.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.941+0000 7f46b6eda640 1 -- 172.21.15.91:0/1015423374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 msgr2=0x7f46b00c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.941+0000 7f46b6eda640 1 --2- 172.21.15.91:0/1015423374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 0x7f46b00c46c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0097a0 tx=0x7f46ac02b7a0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.941+0000 7f46b6eda640 1 -- 172.21.15.91:0/1015423374 shutdown_connections 2023-11-27T20:42:02.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.941+0000 7f46b6eda640 1 --2- 172.21.15.91:0/1015423374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 0x7f46b00c46c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.941+0000 7f46b6eda640 1 -- 172.21.15.91:0/1015423374 >> 172.21.15.91:0/1015423374 conn(0x7f46b00abf00 msgr2=0x7f46b00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:02.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.941+0000 7f46b6eda640 1 -- 172.21.15.91:0/1015423374 shutdown_connections 2023-11-27T20:42:02.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.941+0000 7f46b6eda640 1 -- 172.21.15.91:0/1015423374 wait complete. 2023-11-27T20:42:02.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.942+0000 7f46b6eda640 1 Processor -- start 2023-11-27T20:42:02.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.943+0000 7f46b6eda640 1 -- start start 2023-11-27T20:42:02.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.943+0000 7f46b6eda640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b00c4c00 0x7f46b006c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.943+0000 7f46b6eda640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 0x7f46b00ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.943+0000 7f46b6eda640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b0154580 0x7f46b00acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.944+0000 7f46b6eda640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b014d310 con 0x7f46b014e7c0 2023-11-27T20:42:02.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.944+0000 7f46b6eda640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b01489b0 con 0x7f46b00c4c00 2023-11-27T20:42:02.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.944+0000 7f46b6eda640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b01edc70 con 0x7f46b0154580 2023-11-27T20:42:02.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.944+0000 7f46b56d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 0x7f46b00ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.944+0000 7f46b56d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 0x7f46b00ac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40312/0 (socket says 172.21.15.91:40312) 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.944+0000 7f46b56d7640 1 -- 172.21.15.91:0/2515218625 learned_addr learned my addr 172.21.15.91:0/2515218625 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.944+0000 7f46b5ed8640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b00c4c00 0x7f46b006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.944+0000 7f46b66d9640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b0154580 0x7f46b00acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46b56d7640 1 -- 172.21.15.91:0/2515218625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b0154580 msgr2=0x7f46b00acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46b56d7640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b0154580 0x7f46b00acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46b56d7640 1 -- 172.21.15.91:0/2515218625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b00c4c00 msgr2=0x7f46b006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46b56d7640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b00c4c00 0x7f46b006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46b56d7640 1 -- 172.21.15.91:0/2515218625 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac009400 con 0x7f46b014e7c0 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46b56d7640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 0x7f46b00ac9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46a000c480 tx=0x7f46a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46a67fc640 1 -- 172.21.15.91:0/2515218625 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0005ce0 con 0x7f46b014e7c0 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46a67fc640 1 -- 172.21.15.91:0/2515218625 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a0005e40 con 0x7f46b014e7c0 2023-11-27T20:42:02.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46a67fc640 1 -- 172.21.15.91:0/2515218625 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a00072d0 con 0x7f46b014e7c0 2023-11-27T20:42:02.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46b6eda640 1 -- 172.21.15.91:0/2515218625 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b01edf50 con 0x7f46b014e7c0 2023-11-27T20:42:02.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.945+0000 7f46b6eda640 1 -- 172.21.15.91:0/2515218625 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b006cb70 con 0x7f46b014e7c0 2023-11-27T20:42:02.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.946+0000 7f46b6eda640 1 -- 172.21.15.91:0/2515218625 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b014d4c0 con 0x7f46b014e7c0 2023-11-27T20:42:02.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.948+0000 7f46a67fc640 1 -- 172.21.15.91:0/2515218625 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f46a00074f0 con 0x7f46b014e7c0 2023-11-27T20:42:02.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.949+0000 7f46a67fc640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f469406b1c0 0x7f469406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:02.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.949+0000 7f46a67fc640 1 -- 172.21.15.91:0/2515218625 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46a0088ae0 con 0x7f46b014e7c0 2023-11-27T20:42:02.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.949+0000 7f46b5ed8640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f469406b1c0 0x7f469406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:02.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.950+0000 7f46b5ed8640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f469406b1c0 0x7f469406d680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46ac035000 tx=0x7f46ac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:02.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:02.956+0000 7f46a67fc640 1 -- 172.21.15.91:0/2515218625 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f46b014d4c0 con 0x7f46b014e7c0 2023-11-27T20:42:03.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.147+0000 7f46b6eda640 1 -- 172.21.15.91:0/2515218625 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46b01ee190 con 0x7f46b014e7c0 2023-11-27T20:42:03.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.148+0000 7f46a67fc640 1 -- 172.21.15.91:0/2515218625 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46a00180a0 con 0x7f46b014e7c0 2023-11-27T20:42:03.149 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:42:03.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 -- 172.21.15.91:0/2515218625 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f469406b1c0 msgr2=0x7f469406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f469406b1c0 0x7f469406d680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46ac035000 tx=0x7f46ac008030 comp rx=0 tx=0).stop 2023-11-27T20:42:03.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 -- 172.21.15.91:0/2515218625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 msgr2=0x7f46b00ac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 0x7f46b00ac9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46a000c480 tx=0x7f46a000c940 comp rx=0 tx=0).stop 2023-11-27T20:42:03.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 -- 172.21.15.91:0/2515218625 shutdown_connections 2023-11-27T20:42:03.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b0154580 0x7f46b00acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46b014e7c0 0x7f46b00ac9c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f469406b1c0 0x7f469406d680 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 --2- 172.21.15.91:0/2515218625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b00c4c00 0x7f46b006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 -- 172.21.15.91:0/2515218625 >> 172.21.15.91:0/2515218625 conn(0x7f46b00abf00 msgr2=0x7f46b00c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:03.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 -- 172.21.15.91:0/2515218625 shutdown_connections 2023-11-27T20:42:03.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.151+0000 7f46b6eda640 1 -- 172.21.15.91:0/2515218625 wait complete. 2023-11-27T20:42:03.171 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:42:03.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.373+0000 7f877d836640 1 Processor -- start 2023-11-27T20:42:03.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.373+0000 7f877d836640 1 -- start start 2023-11-27T20:42:03.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.375+0000 7f877d836640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8778152f20 0x7f87780c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.375+0000 7f877d836640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87780c64a0 con 0x7f877806d0a0 2023-11-27T20:42:03.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.375+0000 7f877d836640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87780c5c00 con 0x7f877814fd30 2023-11-27T20:42:03.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.375+0000 7f877d836640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87780c5ee0 con 0x7f8778152f20 2023-11-27T20:42:03.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.376+0000 7f87777fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8778152f20 0x7f87780c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:03.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.376+0000 7f876e7fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f877806d0a0 0x7f87780c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54640/0 (socket says 172.21.15.91:54640) 2023-11-27T20:42:03.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.376+0000 7f876e7fc640 1 -- 172.21.15.91:0/1137441848 learned_addr learned my addr 172.21.15.91:0/1137441848 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:03.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.376+0000 7f87777fe640 1 -- 172.21.15.91:0/1137441848 >> v1:172.21.15.183:6789/0 conn(0x7f877814fd30 legacy=0x7f87780a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:03.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.376+0000 7f87777fe640 1 -- 172.21.15.91:0/1137441848 >> v1:172.21.15.91:6789/0 conn(0x7f877806d0a0 legacy=0x7f87780c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.376+0000 7f87777fe640 1 -- 172.21.15.91:0/1137441848 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780c61c0 con 0x7f8778152f20 2023-11-27T20:42:03.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.377+0000 7f87777fe640 1 --2- 172.21.15.91:0/1137441848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8778152f20 0x7f87780c45b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8770009d90 tx=0x7f877002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c180baf2ceef02c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:03.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.377+0000 7f87767fc640 1 -- 172.21.15.91:0/1137441848 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877002cc60 con 0x7f8778152f20 2023-11-27T20:42:03.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.377+0000 7f87767fc640 1 -- 172.21.15.91:0/1137441848 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877002cdc0 con 0x7f8778152f20 2023-11-27T20:42:03.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.377+0000 7f87767fc640 1 -- 172.21.15.91:0/1137441848 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770034660 con 0x7f8778152f20 2023-11-27T20:42:03.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.378+0000 7f877d836640 1 -- 172.21.15.91:0/1137441848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8778152f20 msgr2=0x7f87780c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.378+0000 7f877d836640 1 --2- 172.21.15.91:0/1137441848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8778152f20 0x7f87780c45b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8770009d90 tx=0x7f877002beb0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.378+0000 7f877d836640 1 -- 172.21.15.91:0/1137441848 shutdown_connections 2023-11-27T20:42:03.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.378+0000 7f877d836640 1 --2- 172.21.15.91:0/1137441848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8778152f20 0x7f87780c45b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.378+0000 7f877d836640 1 -- 172.21.15.91:0/1137441848 >> 172.21.15.91:0/1137441848 conn(0x7f877806a500 msgr2=0x7f877806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:03.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.378+0000 7f877d836640 1 -- 172.21.15.91:0/1137441848 shutdown_connections 2023-11-27T20:42:03.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.378+0000 7f877d836640 1 -- 172.21.15.91:0/1137441848 wait complete. 2023-11-27T20:42:03.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.380+0000 7f877d836640 1 Processor -- start 2023-11-27T20:42:03.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.380+0000 7f877d836640 1 -- start start 2023-11-27T20:42:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f877d836640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f877806d0a0 0x7f8778070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f877d836640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f877814fd30 0x7f87781edd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f877d836640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8778152f20 0x7f877814e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f877d836640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877814f870 con 0x7f877806d0a0 2023-11-27T20:42:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f877d836640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87781ed830 con 0x7f8778152f20 2023-11-27T20:42:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f877d836640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877814f590 con 0x7f877814fd30 2023-11-27T20:42:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f8776ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f877806d0a0 0x7f8778070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f8776ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f877806d0a0 0x7f8778070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40328/0 (socket says 172.21.15.91:40328) 2023-11-27T20:42:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f8776ffd640 1 -- 172.21.15.91:0/3274790952 learned_addr learned my addr 172.21.15.91:0/3274790952 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f8776ffd640 1 -- 172.21.15.91:0/3274790952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f877814fd30 msgr2=0x7f87781edd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f8776ffd640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f877814fd30 0x7f87781edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f8776ffd640 1 -- 172.21.15.91:0/3274790952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8778152f20 msgr2=0x7f877814e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f8776ffd640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8778152f20 0x7f877814e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.381+0000 7f8776ffd640 1 -- 172.21.15.91:0/3274790952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770009a70 con 0x7f877806d0a0 2023-11-27T20:42:03.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.382+0000 7f8776ffd640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f877806d0a0 0x7f8778070b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f876800c430 tx=0x7f876800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:03.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.382+0000 7f8774ff9640 1 -- 172.21.15.91:0/3274790952 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768011790 con 0x7f877806d0a0 2023-11-27T20:42:03.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.382+0000 7f8774ff9640 1 -- 172.21.15.91:0/3274790952 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87680118f0 con 0x7f877806d0a0 2023-11-27T20:42:03.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.382+0000 7f877d836640 1 -- 172.21.15.91:0/3274790952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877814f0d0 con 0x7f877806d0a0 2023-11-27T20:42:03.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.382+0000 7f8774ff9640 1 -- 172.21.15.91:0/3274790952 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768011ce0 con 0x7f877806d0a0 2023-11-27T20:42:03.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.382+0000 7f877d836640 1 -- 172.21.15.91:0/3274790952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87780bf4b0 con 0x7f877806d0a0 2023-11-27T20:42:03.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.383+0000 7f877d836640 1 -- 172.21.15.91:0/3274790952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877814f310 con 0x7f877806d0a0 2023-11-27T20:42:03.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.384+0000 7f8774ff9640 1 -- 172.21.15.91:0/3274790952 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f876801c460 con 0x7f877806d0a0 2023-11-27T20:42:03.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.385+0000 7f8774ff9640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f875806b1c0 0x7f875806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.385+0000 7f8774ff9640 1 -- 172.21.15.91:0/3274790952 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87680899c0 con 0x7f877806d0a0 2023-11-27T20:42:03.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.385+0000 7f876e7fc640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f875806b1c0 0x7f875806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:03.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.386+0000 7f876e7fc640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f875806b1c0 0x7f875806d680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8778156ad0 tx=0x7f8760007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:03.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.389+0000 7f8774ff9640 1 -- 172.21.15.91:0/3274790952 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f87680546e0 con 0x7f877806d0a0 2023-11-27T20:42:03.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.569+0000 7f877d836640 1 -- 172.21.15.91:0/3274790952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8778068350 con 0x7f877806d0a0 2023-11-27T20:42:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.569+0000 7f8774ff9640 1 -- 172.21.15.91:0/3274790952 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8768057d00 con 0x7f877806d0a0 2023-11-27T20:42:03.570 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:42:03.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 -- 172.21.15.91:0/3274790952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f875806b1c0 msgr2=0x7f875806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f875806b1c0 0x7f875806d680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8778156ad0 tx=0x7f8760007a40 comp rx=0 tx=0).stop 2023-11-27T20:42:03.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 -- 172.21.15.91:0/3274790952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f877806d0a0 msgr2=0x7f8778070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f877806d0a0 0x7f8778070b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f876800c430 tx=0x7f876800c8f0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 -- 172.21.15.91:0/3274790952 shutdown_connections 2023-11-27T20:42:03.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f875806b1c0 0x7f875806d680 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8778152f20 0x7f877814e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f877814fd30 0x7f87781edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 --2- 172.21.15.91:0/3274790952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f877806d0a0 0x7f8778070b10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 -- 172.21.15.91:0/3274790952 >> 172.21.15.91:0/3274790952 conn(0x7f877806a500 msgr2=0x7f87780c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:03.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 -- 172.21.15.91:0/3274790952 shutdown_connections 2023-11-27T20:42:03.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.572+0000 7f877d836640 1 -- 172.21.15.91:0/3274790952 wait complete. 2023-11-27T20:42:03.589 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:42:03.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.794+0000 7fc9be1f5640 1 Processor -- start 2023-11-27T20:42:03.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.795+0000 7fc9be1f5640 1 -- start start 2023-11-27T20:42:03.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.796+0000 7fc9be1f5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc9b80c7100 0x7fc9b8155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.796+0000 7fc9be1f5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc9b80c4fa0 0x7fc9b81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.796+0000 7fc9be1f5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b80c3180 con 0x7fc9b80a6da0 2023-11-27T20:42:03.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.796+0000 7fc9be1f5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b8155ae0 con 0x7fc9b80c7100 2023-11-27T20:42:03.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.796+0000 7fc9be1f5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b80c33d0 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.796+0000 7fc9b77fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc9b80c7100 0x7fc9b8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:03.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.796+0000 7fc9b77fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc9b80c7100 0x7fc9b8155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40334/0 (socket says 172.21.15.91:40334) 2023-11-27T20:42:03.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.796+0000 7fc9b77fe640 1 -- 172.21.15.91:0/2711267555 learned_addr learned my addr 172.21.15.91:0/2711267555 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:03.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.797+0000 7fc9b77fe640 1 -- 172.21.15.91:0/2711267555 >> v2:172.21.15.183:3300/0 conn(0x7fc9b80c4fa0 msgr2=0x7fc9b81555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:03.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.797+0000 7fc9b77fe640 1 --2- 172.21.15.91:0/2711267555 >> v2:172.21.15.183:3300/0 conn(0x7fc9b80c4fa0 0x7fc9b81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.797+0000 7fc9b77fe640 1 -- 172.21.15.91:0/2711267555 >> v1:172.21.15.183:6789/0 conn(0x7fc9b80a6da0 legacy=0x7fc9b8157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:03.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.797+0000 7fc9b77fe640 1 -- 172.21.15.91:0/2711267555 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80c36b0 con 0x7fc9b80c7100 2023-11-27T20:42:03.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.798+0000 7fc9b77fe640 1 --2- 172.21.15.91:0/2711267555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c7100 0x7fc9b8155060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80c3e40 tx=0x7fc9a802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b86b08481448a57 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:03.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.798+0000 7fc9b6ffd640 1 -- 172.21.15.91:0/2711267555 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a80317e0 con 0x7fc9b80c7100 2023-11-27T20:42:03.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.798+0000 7fc9b6ffd640 1 -- 172.21.15.91:0/2711267555 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a8031940 con 0x7fc9b80c7100 2023-11-27T20:42:03.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.798+0000 7fc9b6ffd640 1 -- 172.21.15.91:0/2711267555 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8031cd0 con 0x7fc9b80c7100 2023-11-27T20:42:03.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.799+0000 7fc9be1f5640 1 -- 172.21.15.91:0/2711267555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c7100 msgr2=0x7fc9b8155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.799+0000 7fc9be1f5640 1 --2- 172.21.15.91:0/2711267555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c7100 0x7fc9b8155060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80c3e40 tx=0x7fc9a802b880 comp rx=0 tx=0).stop 2023-11-27T20:42:03.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.799+0000 7fc9be1f5640 1 -- 172.21.15.91:0/2711267555 shutdown_connections 2023-11-27T20:42:03.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.799+0000 7fc9be1f5640 1 --2- 172.21.15.91:0/2711267555 >> v2:172.21.15.183:3300/0 conn(0x7fc9b80c4fa0 0x7fc9b81555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.799+0000 7fc9be1f5640 1 --2- 172.21.15.91:0/2711267555 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c7100 0x7fc9b8155060 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.799+0000 7fc9be1f5640 1 -- 172.21.15.91:0/2711267555 >> 172.21.15.91:0/2711267555 conn(0x7fc9b80c7dc0 msgr2=0x7fc9b80c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:03.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.799+0000 7fc9be1f5640 1 -- 172.21.15.91:0/2711267555 shutdown_connections 2023-11-27T20:42:03.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.799+0000 7fc9be1f5640 1 -- 172.21.15.91:0/2711267555 wait complete. 2023-11-27T20:42:03.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.801+0000 7fc9be1f5640 1 Processor -- start 2023-11-27T20:42:03.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.801+0000 7fc9be1f5640 1 -- start start 2023-11-27T20:42:03.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9be1f5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9b80a6da0 0x7fc9b81ed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9be1f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c4fa0 0x7fc9b8148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9be1f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9b80c7100 0x7fc9b81492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9be1f5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b81ee650 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9be1f5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8150730 con 0x7fc9b80a6da0 2023-11-27T20:42:03.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9be1f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b81576b0 con 0x7fc9b80c7100 2023-11-27T20:42:03.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9affff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c4fa0 0x7fc9b8148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:03.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9affff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c4fa0 0x7fc9b8148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40340/0 (socket says 172.21.15.91:40340) 2023-11-27T20:42:03.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9affff640 1 -- 172.21.15.91:0/399215073 learned_addr learned my addr 172.21.15.91:0/399215073 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:03.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9affff640 1 -- 172.21.15.91:0/399215073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9b80c7100 msgr2=0x7fc9b81492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9affff640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9b80c7100 0x7fc9b81492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9affff640 1 -- 172.21.15.91:0/399215073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9b80a6da0 msgr2=0x7fc9b81ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9affff640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9b80a6da0 0x7fc9b81ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.802+0000 7fc9affff640 1 -- 172.21.15.91:0/399215073 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80094d0 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.803+0000 7fc9affff640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c4fa0 0x7fc9b8148d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000b3e0 tx=0x7fc9a000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:03.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.803+0000 7fc9b4ff9640 1 -- 172.21.15.91:0/399215073 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0011830 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.803+0000 7fc9b4ff9640 1 -- 172.21.15.91:0/399215073 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a00119b0 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.803+0000 7fc9b4ff9640 1 -- 172.21.15.91:0/399215073 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0011d60 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.803+0000 7fc9be1f5640 1 -- 172.21.15.91:0/399215073 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b8149800 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.803+0000 7fc9be1f5640 1 -- 172.21.15.91:0/399215073 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b81eb740 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.804+0000 7fc9be1f5640 1 -- 172.21.15.91:0/399215073 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b8068350 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.805+0000 7fc9b4ff9640 1 -- 172.21.15.91:0/399215073 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc9a001a400 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.806+0000 7fc9b4ff9640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc99806b1f0 0x7fc99806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:03.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.806+0000 7fc9b4ff9640 1 -- 172.21.15.91:0/399215073 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9a0089ae0 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.806+0000 7fc9b77fe640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc99806b1f0 0x7fc99806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:03.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.807+0000 7fc9b77fe640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc99806b1f0 0x7fc99806d6b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8036000 tx=0x7fc9a8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:03.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.810+0000 7fc9b4ff9640 1 -- 172.21.15.91:0/399215073 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc9a00548a0 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.985+0000 7fc9be1f5640 1 -- 172.21.15.91:0/399215073 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9b80c5ea0 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.986+0000 7fc9b4ff9640 1 -- 172.21.15.91:0/399215073 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9a0015020 con 0x7fc9b80c4fa0 2023-11-27T20:42:03.986 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:42:03.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.988+0000 7fc9be1f5640 1 -- 172.21.15.91:0/399215073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc99806b1f0 msgr2=0x7fc99806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.988+0000 7fc9be1f5640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc99806b1f0 0x7fc99806d6b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8036000 tx=0x7fc9a8030000 comp rx=0 tx=0).stop 2023-11-27T20:42:03.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.988+0000 7fc9be1f5640 1 -- 172.21.15.91:0/399215073 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c4fa0 msgr2=0x7fc9b8148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:03.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.988+0000 7fc9be1f5640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c4fa0 0x7fc9b8148d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000b3e0 tx=0x7fc9a000b8a0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.989+0000 7fc9be1f5640 1 -- 172.21.15.91:0/399215073 shutdown_connections 2023-11-27T20:42:03.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.989+0000 7fc9be1f5640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9b80c7100 0x7fc9b81492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.989+0000 7fc9be1f5640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9b80c4fa0 0x7fc9b8148d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.989+0000 7fc9be1f5640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc99806b1f0 0x7fc99806d6b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.989+0000 7fc9be1f5640 1 --2- 172.21.15.91:0/399215073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9b80a6da0 0x7fc9b81ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:03.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.989+0000 7fc9be1f5640 1 -- 172.21.15.91:0/399215073 >> 172.21.15.91:0/399215073 conn(0x7fc9b80c7dc0 msgr2=0x7fc9b80a7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:03.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.989+0000 7fc9be1f5640 1 -- 172.21.15.91:0/399215073 shutdown_connections 2023-11-27T20:42:03.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:03.989+0000 7fc9be1f5640 1 -- 172.21.15.91:0/399215073 wait complete. 2023-11-27T20:42:04.006 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:04.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.211+0000 7f84862ad640 1 Processor -- start 2023-11-27T20:42:04.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.211+0000 7f84862ad640 1 -- start start 2023-11-27T20:42:04.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.212+0000 7f84862ad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f848006d0a0 0x7f8480152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.212+0000 7f84862ad640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84800c64a0 con 0x7f84800c3ea0 2023-11-27T20:42:04.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.212+0000 7f84862ad640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84800c5c00 con 0x7f848014fd30 2023-11-27T20:42:04.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.212+0000 7f84862ad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84800c5ee0 con 0x7f848006d0a0 2023-11-27T20:42:04.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f848484a640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f84800c3ea0 0x7f84800c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54000/0 (socket says 172.21.15.91:54000) 2023-11-27T20:42:04.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f848484a640 1 -- 172.21.15.91:0/244838350 learned_addr learned my addr 172.21.15.91:0/244838350 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:04.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569172987 0 0) 0x7f84800c64a0 con 0x7f84800c3ea0 2023-11-27T20:42:04.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f846c003520 con 0x7f84800c3ea0 2023-11-27T20:42:04.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f8477fff640 1 --2- 172.21.15.91:0/244838350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f848006d0a0 0x7f8480152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:04.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2233587962 0 0) 0x7f846c003520 con 0x7f84800c3ea0 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f848006d0a0 msgr2=0x7f8480152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f847f7fe640 1 --2- 172.21.15.91:0/244838350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f848006d0a0 0x7f8480152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 >> v1:172.21.15.183:6789/0 conn(0x7f848014fd30 legacy=0x7f84800a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84800c61c0 con 0x7f84800c3ea0 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f84780019f0 con 0x7f84800c3ea0 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.213+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 >> v1:172.21.15.91:6789/0 conn(0x7f84800c3ea0 legacy=0x7f84800c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f847f7fe640 1 --2- 172.21.15.91:0/244838350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f848006d0a0 0x7f846c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f847f7fe640 1 --2- 172.21.15.91:0/244838350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f846c003fb0 0x7f846c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f847f7fe640 1 --2- 172.21.15.91:0/244838350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f846c004d00 0x7f846c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84800c5ee0 con 0x7f846c003fb0 2023-11-27T20:42:04.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c00bb10 con 0x7f846c004d00 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c00bcd0 con 0x7f848006d0a0 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f8477fff640 1 --2- 172.21.15.91:0/244838350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f846c003fb0 0x7f846c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f8477fff640 1 -- 172.21.15.91:0/244838350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f848006d0a0 msgr2=0x7f846c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f8477fff640 1 --2- 172.21.15.91:0/244838350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f848006d0a0 0x7f846c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f8477fff640 1 -- 172.21.15.91:0/244838350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f846c004d00 msgr2=0x7f846c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f8477fff640 1 --2- 172.21.15.91:0/244838350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f846c004d00 0x7f846c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.214+0000 7f8477fff640 1 -- 172.21.15.91:0/244838350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c003520 con 0x7f846c003fb0 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.215+0000 7f8477fff640 1 --2- 172.21.15.91:0/244838350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f846c003fb0 0x7f846c0047c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f848006d4e0 tx=0x7f846c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede5a524c7e73035 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.216+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468032620 con 0x7f846c003fb0 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.216+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468032780 con 0x7f846c003fb0 2023-11-27T20:42:04.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.216+0000 7f847f7fe640 1 -- 172.21.15.91:0/244838350 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468032b10 con 0x7f846c003fb0 2023-11-27T20:42:04.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.216+0000 7f84862ad640 1 -- 172.21.15.91:0/244838350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f846c003fb0 msgr2=0x7f846c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.216+0000 7f84862ad640 1 --2- 172.21.15.91:0/244838350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f846c003fb0 0x7f846c0047c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f848006d4e0 tx=0x7f846c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.216+0000 7f848484a640 1 -- 172.21.15.91:0/244838350 reap_dead start 2023-11-27T20:42:04.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.216+0000 7f84862ad640 1 -- 172.21.15.91:0/244838350 shutdown_connections 2023-11-27T20:42:04.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.216+0000 7f84862ad640 1 -- 172.21.15.91:0/244838350 >> 172.21.15.91:0/244838350 conn(0x7f848006a500 msgr2=0x7f848006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:04.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.216+0000 7f84862ad640 1 -- 172.21.15.91:0/244838350 shutdown_connections 2023-11-27T20:42:04.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.216+0000 7f84862ad640 1 -- 172.21.15.91:0/244838350 wait complete. 2023-11-27T20:42:04.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.218+0000 7f84862ad640 1 Processor -- start 2023-11-27T20:42:04.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.218+0000 7f84862ad640 1 -- start start 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.219+0000 7f84862ad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f846c003fb0 0x7f84800bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.219+0000 7f84862ad640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8480154bf0 0x7f8480155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.219+0000 7f84862ad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84801ed790 0x7f84801edc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.219+0000 7f84862ad640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84801eabc0 con 0x7f8480154bf0 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.219+0000 7f84862ad640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84801555b0 con 0x7f84801ed790 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.219+0000 7f84862ad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84800a91c0 con 0x7f846c003fb0 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.219+0000 7f8477fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8480154bf0 0x7f8480155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.219+0000 7f8477fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8480154bf0 0x7f8480155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57998/0 (socket says 172.21.15.91:57998) 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.219+0000 7f8477fff640 1 -- 172.21.15.91:0/2251020408 learned_addr learned my addr 172.21.15.91:0/2251020408 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f847ffff640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f846c003fb0 0x7f84800bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:04.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f8477fff640 1 -- 172.21.15.91:0/2251020408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f846c003fb0 msgr2=0x7f84800bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f8477fff640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f846c003fb0 0x7f84800bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f8477fff640 1 -- 172.21.15.91:0/2251020408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84801ed790 msgr2=0x7f84801edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f8477fff640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84801ed790 0x7f84801edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f8477fff640 1 -- 172.21.15.91:0/2251020408 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84801ea570 con 0x7f8480154bf0 2023-11-27T20:42:04.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f8477fff640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8480154bf0 0x7f8480155070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f846800baf0 tx=0x7f8468004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:04.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f847d7fa640 1 -- 172.21.15.91:0/2251020408 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846803b420 con 0x7f8480154bf0 2023-11-27T20:42:04.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f847d7fa640 1 -- 172.21.15.91:0/2251020408 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846803b5a0 con 0x7f8480154bf0 2023-11-27T20:42:04.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f847d7fa640 1 -- 172.21.15.91:0/2251020408 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846803b950 con 0x7f8480154bf0 2023-11-27T20:42:04.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.220+0000 7f84862ad640 1 -- 172.21.15.91:0/2251020408 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84801ea850 con 0x7f8480154bf0 2023-11-27T20:42:04.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.221+0000 7f84862ad640 1 -- 172.21.15.91:0/2251020408 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84800a8e70 con 0x7f8480154bf0 2023-11-27T20:42:04.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.221+0000 7f84862ad640 1 -- 172.21.15.91:0/2251020408 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84801eaa10 con 0x7f8480154bf0 2023-11-27T20:42:04.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.222+0000 7f847d7fa640 1 -- 172.21.15.91:0/2251020408 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f846803bab0 con 0x7f8480154bf0 2023-11-27T20:42:04.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.224+0000 7f847d7fa640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f846006b1f0 0x7f846006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.224+0000 7f847d7fa640 1 -- 172.21.15.91:0/2251020408 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84680ab480 con 0x7f8480154bf0 2023-11-27T20:42:04.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.224+0000 7f847ffff640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f846006b1f0 0x7f846006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:04.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.225+0000 7f847ffff640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f846006b1f0 0x7f846006d6b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84801561c0 tx=0x7f8470009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:04.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.228+0000 7f847d7fa640 1 -- 172.21.15.91:0/2251020408 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8468076240 con 0x7f8480154bf0 2023-11-27T20:42:04.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.419+0000 7f84862ad640 1 -- 172.21.15.91:0/2251020408 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8480068350 con 0x7f8480154bf0 2023-11-27T20:42:04.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.421+0000 7f847d7fa640 1 -- 172.21.15.91:0/2251020408 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f8468079860 con 0x7f8480154bf0 2023-11-27T20:42:04.422 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:04.422 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:04.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 -- 172.21.15.91:0/2251020408 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f846006b1f0 msgr2=0x7f846006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f846006b1f0 0x7f846006d6b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84801561c0 tx=0x7f8470009040 comp rx=0 tx=0).stop 2023-11-27T20:42:04.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 -- 172.21.15.91:0/2251020408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8480154bf0 msgr2=0x7f8480155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8480154bf0 0x7f8480155070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f846800baf0 tx=0x7f8468004730 comp rx=0 tx=0).stop 2023-11-27T20:42:04.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 -- 172.21.15.91:0/2251020408 shutdown_connections 2023-11-27T20:42:04.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f846006b1f0 0x7f846006d6b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84801ed790 0x7f84801edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8480154bf0 0x7f8480155070 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 --2- 172.21.15.91:0/2251020408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f846c003fb0 0x7f84800bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 -- 172.21.15.91:0/2251020408 >> 172.21.15.91:0/2251020408 conn(0x7f848006a500 msgr2=0x7f848006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:04.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 -- 172.21.15.91:0/2251020408 shutdown_connections 2023-11-27T20:42:04.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.424+0000 7f84862ad640 1 -- 172.21.15.91:0/2251020408 wait complete. 2023-11-27T20:42:04.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:41:32.704555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:41:33.818847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:42:04.445 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:42:04.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.655+0000 7f5c3f6d4640 1 Processor -- start 2023-11-27T20:42:04.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.655+0000 7f5c3f6d4640 1 -- start start 2023-11-27T20:42:04.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.656+0000 7f5c3f6d4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5c380a9b40 0x7f5c380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.656+0000 7f5c3f6d4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5c380c1500 0x7f5c380c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.656+0000 7f5c3f6d4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c380c06c0 con 0x7f5c38155490 2023-11-27T20:42:04.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.656+0000 7f5c3f6d4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c380a5820 con 0x7f5c380a9b40 2023-11-27T20:42:04.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.656+0000 7f5c3f6d4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c380c1020 con 0x7f5c380c1500 2023-11-27T20:42:04.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.656+0000 7f5c3cc6f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5c380a9b40 0x7f5c380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:04.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.656+0000 7f5c3cc6f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5c380a9b40 0x7f5c380a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58010/0 (socket says 172.21.15.91:58010) 2023-11-27T20:42:04.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.656+0000 7f5c3cc6f640 1 -- 172.21.15.91:0/1496838303 learned_addr learned my addr 172.21.15.91:0/1496838303 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:04.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.657+0000 7f5c3cc6f640 1 -- 172.21.15.91:0/1496838303 >> v2:172.21.15.183:3300/0 conn(0x7f5c380c1500 msgr2=0x7f5c380c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:04.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.657+0000 7f5c3cc6f640 1 --2- 172.21.15.91:0/1496838303 >> v2:172.21.15.183:3300/0 conn(0x7f5c380c1500 0x7f5c380c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.657+0000 7f5c3cc6f640 1 -- 172.21.15.91:0/1496838303 >> v1:172.21.15.183:6789/0 conn(0x7f5c38155490 legacy=0x7f5c380a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:04.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.657+0000 7f5c3cc6f640 1 -- 172.21.15.91:0/1496838303 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c380c0910 con 0x7f5c380a9b40 2023-11-27T20:42:04.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.658+0000 7f5c3cc6f640 1 --2- 172.21.15.91:0/1496838303 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380a9b40 0x7f5c380a51b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5c380ab420 tx=0x7f5c2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401a1851e1fe0468 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:04.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.658+0000 7f5c2ffff640 1 -- 172.21.15.91:0/1496838303 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28031870 con 0x7f5c380a9b40 2023-11-27T20:42:04.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.658+0000 7f5c2ffff640 1 -- 172.21.15.91:0/1496838303 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c280319d0 con 0x7f5c380a9b40 2023-11-27T20:42:04.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.658+0000 7f5c2ffff640 1 -- 172.21.15.91:0/1496838303 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28031d60 con 0x7f5c380a9b40 2023-11-27T20:42:04.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.659+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/1496838303 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380a9b40 msgr2=0x7f5c380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.659+0000 7f5c3f6d4640 1 --2- 172.21.15.91:0/1496838303 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380a9b40 0x7f5c380a51b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5c380ab420 tx=0x7f5c2802b910 comp rx=0 tx=0).stop 2023-11-27T20:42:04.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.659+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/1496838303 shutdown_connections 2023-11-27T20:42:04.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.659+0000 7f5c3f6d4640 1 --2- 172.21.15.91:0/1496838303 >> v2:172.21.15.183:3300/0 conn(0x7f5c380c1500 0x7f5c380c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.659+0000 7f5c3f6d4640 1 --2- 172.21.15.91:0/1496838303 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380a9b40 0x7f5c380a51b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.659+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/1496838303 >> 172.21.15.91:0/1496838303 conn(0x7f5c3806a500 msgr2=0x7f5c3806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:04.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.659+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/1496838303 shutdown_connections 2023-11-27T20:42:04.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.659+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/1496838303 wait complete. 2023-11-27T20:42:04.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.661+0000 7f5c3f6d4640 1 Processor -- start 2023-11-27T20:42:04.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.661+0000 7f5c3f6d4640 1 -- start start 2023-11-27T20:42:04.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3f6d4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c380c1500 0x7f5c380bce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3f6d4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c38155490 0x7f5c381df0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3f6d4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380bace0 0x7f5c380bb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3f6d4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c380bc9b0 con 0x7f5c380bace0 2023-11-27T20:42:04.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3f6d4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c381e77e0 con 0x7f5c38155490 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3f6d4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38071630 con 0x7f5c380c1500 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3dc71640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380bace0 0x7f5c380bb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3dc71640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380bace0 0x7f5c380bb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58018/0 (socket says 172.21.15.91:58018) 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3dc71640 1 -- 172.21.15.91:0/2607812058 learned_addr learned my addr 172.21.15.91:0/2607812058 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3cc6f640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c38155490 0x7f5c381df0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3d470640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c380c1500 0x7f5c380bce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3dc71640 1 -- 172.21.15.91:0/2607812058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c380c1500 msgr2=0x7f5c380bce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3dc71640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c380c1500 0x7f5c380bce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3dc71640 1 -- 172.21.15.91:0/2607812058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c38155490 msgr2=0x7f5c381df0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.662+0000 7f5c3dc71640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c38155490 0x7f5c381df0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.663+0000 7f5c3dc71640 1 -- 172.21.15.91:0/2607812058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c280094d0 con 0x7f5c380bace0 2023-11-27T20:42:04.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.663+0000 7f5c3cc6f640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c38155490 0x7f5c381df0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:04.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.663+0000 7f5c3dc71640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380bace0 0x7f5c380bb580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000b9a0 tx=0x7f5c3000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:04.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.663+0000 7f5c2dffb640 1 -- 172.21.15.91:0/2607812058 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000cba0 con 0x7f5c380bace0 2023-11-27T20:42:04.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.663+0000 7f5c2dffb640 1 -- 172.21.15.91:0/2607812058 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3000cd20 con 0x7f5c380bace0 2023-11-27T20:42:04.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.663+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/2607812058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c381eded0 con 0x7f5c380bace0 2023-11-27T20:42:04.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.663+0000 7f5c2dffb640 1 -- 172.21.15.91:0/2607812058 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30014680 con 0x7f5c380bace0 2023-11-27T20:42:04.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.663+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/2607812058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c38071b80 con 0x7f5c380bace0 2023-11-27T20:42:04.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.664+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/2607812058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c38071d70 con 0x7f5c380bace0 2023-11-27T20:42:04.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.665+0000 7f5c2dffb640 1 -- 172.21.15.91:0/2607812058 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5c3001d3b0 con 0x7f5c380bace0 2023-11-27T20:42:04.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.666+0000 7f5c2dffb640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5c1c06b1c0 0x7f5c1c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:04.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.666+0000 7f5c2dffb640 1 -- 172.21.15.91:0/2607812058 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c300899d0 con 0x7f5c380bace0 2023-11-27T20:42:04.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.666+0000 7f5c3d470640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5c1c06b1c0 0x7f5c1c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:04.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.667+0000 7f5c3d470640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5c1c06b1c0 0x7f5c1c06d680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5c34006fd0 tx=0x7f5c34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:04.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.670+0000 7f5c2dffb640 1 -- 172.21.15.91:0/2607812058 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5c300546f0 con 0x7f5c380bace0 2023-11-27T20:42:04.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.846+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/2607812058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c38068350 con 0x7f5c380bace0 2023-11-27T20:42:04.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.847+0000 7f5c2dffb640 1 -- 172.21.15.91:0/2607812058 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c30019020 con 0x7f5c380bace0 2023-11-27T20:42:04.847 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:42:04.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/2607812058 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5c1c06b1c0 msgr2=0x7f5c1c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5c1c06b1c0 0x7f5c1c06d680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5c34006fd0 tx=0x7f5c34008040 comp rx=0 tx=0).stop 2023-11-27T20:42:04.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/2607812058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380bace0 msgr2=0x7f5c380bb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:04.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380bace0 0x7f5c380bb580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000b9a0 tx=0x7f5c3000be60 comp rx=0 tx=0).stop 2023-11-27T20:42:04.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/2607812058 shutdown_connections 2023-11-27T20:42:04.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c380bace0 0x7f5c380bb580 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5c1c06b1c0 0x7f5c1c06d680 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c38155490 0x7f5c381df0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 --2- 172.21.15.91:0/2607812058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c380c1500 0x7f5c380bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:04.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/2607812058 >> 172.21.15.91:0/2607812058 conn(0x7f5c3806a500 msgr2=0x7f5c380c4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:04.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/2607812058 shutdown_connections 2023-11-27T20:42:04.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:04.849+0000 7f5c3f6d4640 1 -- 172.21.15.91:0/2607812058 wait complete. 2023-11-27T20:42:04.867 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:42:05.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.081+0000 7f8ebc4ad640 1 Processor -- start 2023-11-27T20:42:05.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.081+0000 7f8ebc4ad640 1 -- start start 2023-11-27T20:42:05.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.083+0000 7f8ebc4ad640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8eb40c2e60 0x7f8eb4164380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.083+0000 7f8ebc4ad640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb406d580 con 0x7f8eb4155fc0 2023-11-27T20:42:05.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.083+0000 7f8ebc4ad640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb40726d0 con 0x7f8eb40c1ca0 2023-11-27T20:42:05.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.083+0000 7f8ebc4ad640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb406dd60 con 0x7f8eb40c2e60 2023-11-27T20:42:05.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.083+0000 7f8eba249640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8eb4155fc0 0x7f8eb4159470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54004/0 (socket says 172.21.15.91:54004) 2023-11-27T20:42:05.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.083+0000 7f8eba249640 1 -- 172.21.15.91:0/772787047 learned_addr learned my addr 172.21.15.91:0/772787047 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:05.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.083+0000 7f8ebaa4a640 1 --2- 172.21.15.91:0/772787047 >> v2:172.21.15.91:3300/0 conn(0x7f8eb40c2e60 0x7f8eb4164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.084+0000 7f8eb9247640 1 -- 172.21.15.91:0/772787047 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366843920 0 0) 0x7f8eb406d580 con 0x7f8eb4155fc0 2023-11-27T20:42:05.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.084+0000 7f8eb9247640 1 -- 172.21.15.91:0/772787047 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea0003520 con 0x7f8eb4155fc0 2023-11-27T20:42:05.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.084+0000 7f8ebaa4a640 1 -- 172.21.15.91:0/772787047 >> v1:172.21.15.183:6789/0 conn(0x7f8eb40c1ca0 legacy=0x7f8eb40c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:05.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.084+0000 7f8ebaa4a640 1 -- 172.21.15.91:0/772787047 >> v1:172.21.15.91:6789/0 conn(0x7f8eb4155fc0 legacy=0x7f8eb4159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.084+0000 7f8ebaa4a640 1 -- 172.21.15.91:0/772787047 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb406da80 con 0x7f8eb40c2e60 2023-11-27T20:42:05.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.085+0000 7f8ebaa4a640 1 --2- 172.21.15.91:0/772787047 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 0x7f8eb4164380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009dc0 tx=0x7f8eac02be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a78df0c213cd0d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:05.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.085+0000 7f8eb9247640 1 -- 172.21.15.91:0/772787047 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac02cbb0 con 0x7f8eb40c2e60 2023-11-27T20:42:05.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.085+0000 7f8eb9247640 1 -- 172.21.15.91:0/772787047 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac02cd10 con 0x7f8eb40c2e60 2023-11-27T20:42:05.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.085+0000 7f8eb9247640 1 -- 172.21.15.91:0/772787047 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac034660 con 0x7f8eb40c2e60 2023-11-27T20:42:05.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.086+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/772787047 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 msgr2=0x7f8eb4164380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.086+0000 7f8ebc4ad640 1 --2- 172.21.15.91:0/772787047 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 0x7f8eb4164380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009dc0 tx=0x7f8eac02be00 comp rx=0 tx=0).stop 2023-11-27T20:42:05.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.086+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/772787047 shutdown_connections 2023-11-27T20:42:05.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.086+0000 7f8ebc4ad640 1 --2- 172.21.15.91:0/772787047 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 0x7f8eb4164380 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.086+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/772787047 >> 172.21.15.91:0/772787047 conn(0x7f8eb406a500 msgr2=0x7f8eb406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:05.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.086+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/772787047 shutdown_connections 2023-11-27T20:42:05.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.086+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/772787047 wait complete. 2023-11-27T20:42:05.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.088+0000 7f8ebc4ad640 1 Processor -- start 2023-11-27T20:42:05.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.088+0000 7f8ebc4ad640 1 -- start start 2023-11-27T20:42:05.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.089+0000 7f8ebc4ad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eb40c1ca0 0x7f8eb40a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.089+0000 7f8ebc4ad640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 0x7f8eb415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.089+0000 7f8ebc4ad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eb4155fc0 0x7f8eb4150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.089+0000 7f8ebc4ad640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40a52d0 con 0x7f8eb40c2e60 2023-11-27T20:42:05.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.089+0000 7f8ebc4ad640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40a4ff0 con 0x7f8eb4155fc0 2023-11-27T20:42:05.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.089+0000 7f8ebc4ad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb41ef250 con 0x7f8eb40c1ca0 2023-11-27T20:42:05.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.089+0000 7f8eb9a48640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 0x7f8eb415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.089+0000 7f8eb9a48640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 0x7f8eb415a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58044/0 (socket says 172.21.15.91:58044) 2023-11-27T20:42:05.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.089+0000 7f8eb9a48640 1 -- 172.21.15.91:0/1740376163 learned_addr learned my addr 172.21.15.91:0/1740376163 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:05.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8eba249640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eb40c1ca0 0x7f8eb40a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8eb9a48640 1 -- 172.21.15.91:0/1740376163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eb40c1ca0 msgr2=0x7f8eb40a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8eb9a48640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eb40c1ca0 0x7f8eb40a4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8eb9a48640 1 -- 172.21.15.91:0/1740376163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eb4155fc0 msgr2=0x7f8eb4150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8ebaa4a640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eb4155fc0 0x7f8eb4150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8eb9a48640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eb4155fc0 0x7f8eb4150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8eb9a48640 1 -- 172.21.15.91:0/1740376163 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac009a70 con 0x7f8eb40c2e60 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8ebaa4a640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eb4155fc0 0x7f8eb4150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8eb9a48640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 0x7f8eb415a8b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400c450 tx=0x7f8ea400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8eaaffd640 1 -- 172.21.15.91:0/1740376163 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40052d0 con 0x7f8eb40c2e60 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8eaaffd640 1 -- 172.21.15.91:0/1740376163 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea4005430 con 0x7f8eb40c2e60 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/1740376163 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb41ef530 con 0x7f8eb40c2e60 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8eaaffd640 1 -- 172.21.15.91:0/1740376163 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4012870 con 0x7f8eb40c2e60 2023-11-27T20:42:05.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.090+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/1740376163 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb40a3d40 con 0x7f8eb40c2e60 2023-11-27T20:42:05.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.091+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/1740376163 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb41ef0b0 con 0x7f8eb40c2e60 2023-11-27T20:42:05.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.092+0000 7f8eaaffd640 1 -- 172.21.15.91:0/1740376163 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8ea40129d0 con 0x7f8eb40c2e60 2023-11-27T20:42:05.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.093+0000 7f8eaaffd640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e9806b1c0 0x7f8e9806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.093+0000 7f8eaaffd640 1 -- 172.21.15.91:0/1740376163 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ea40894c0 con 0x7f8eb40c2e60 2023-11-27T20:42:05.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.093+0000 7f8eba249640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e9806b1c0 0x7f8e9806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.094+0000 7f8eba249640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e9806b1c0 0x7f8e9806d680 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00011e0 tx=0x7f8eb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:05.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.098+0000 7f8eaaffd640 1 -- 172.21.15.91:0/1740376163 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8eb41ef0b0 con 0x7f8eb40c2e60 2023-11-27T20:42:05.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.289+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/1740376163 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8eb41ef0b0 con 0x7f8eb40c2e60 2023-11-27T20:42:05.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.290+0000 7f8eaaffd640 1 -- 172.21.15.91:0/1740376163 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8eb41ef0b0 con 0x7f8eb40c2e60 2023-11-27T20:42:05.290 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:42:05.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.292+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/1740376163 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e9806b1c0 msgr2=0x7f8e9806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.292+0000 7f8ebc4ad640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e9806b1c0 0x7f8e9806d680 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00011e0 tx=0x7f8eb0009040 comp rx=0 tx=0).stop 2023-11-27T20:42:05.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.292+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/1740376163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 msgr2=0x7f8eb415a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.292+0000 7f8ebc4ad640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 0x7f8eb415a8b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400c450 tx=0x7f8ea400c910 comp rx=0 tx=0).stop 2023-11-27T20:42:05.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.293+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/1740376163 shutdown_connections 2023-11-27T20:42:05.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.293+0000 7f8ebc4ad640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e9806b1c0 0x7f8e9806d680 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.293+0000 7f8ebc4ad640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eb4155fc0 0x7f8eb4150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.293+0000 7f8ebc4ad640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb40c2e60 0x7f8eb415a8b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.293+0000 7f8ebc4ad640 1 --2- 172.21.15.91:0/1740376163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eb40c1ca0 0x7f8eb40a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.293+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/1740376163 >> 172.21.15.91:0/1740376163 conn(0x7f8eb406a500 msgr2=0x7f8eb4071820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:05.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.293+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/1740376163 shutdown_connections 2023-11-27T20:42:05.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.293+0000 7f8ebc4ad640 1 -- 172.21.15.91:0/1740376163 wait complete. 2023-11-27T20:42:05.310 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:42:05.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.519+0000 7f96a487e640 1 Processor -- start 2023-11-27T20:42:05.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.519+0000 7f96a487e640 1 -- start start 2023-11-27T20:42:05.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.520+0000 7f96a487e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f96a014e170 0x7f96a0154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.520+0000 7f96a487e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f96a00a4eb0 0x7f96a006bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.520+0000 7f96a487e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a00c1d30 con 0x7f96a01512d0 2023-11-27T20:42:05.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.520+0000 7f96a487e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a00c51f0 con 0x7f96a014e170 2023-11-27T20:42:05.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.521+0000 7f96a487e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a00c54d0 con 0x7f96a00a4eb0 2023-11-27T20:42:05.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.521+0000 7f969f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f96a014e170 0x7f96a0154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.521+0000 7f969ffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f96a01512d0 0x7f96a00c41d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54012/0 (socket says 172.21.15.91:54012) 2023-11-27T20:42:05.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.521+0000 7f969ffff640 1 -- 172.21.15.91:0/3454569818 learned_addr learned my addr 172.21.15.91:0/3454569818 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:05.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.521+0000 7f9697fff640 1 --2- 172.21.15.91:0/3454569818 >> v2:172.21.15.183:3300/0 conn(0x7f96a00a4eb0 0x7f96a006bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.521+0000 7f969f7fe640 1 -- 172.21.15.91:0/3454569818 >> v2:172.21.15.183:3300/0 conn(0x7f96a00a4eb0 msgr2=0x7f96a006bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:05.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.521+0000 7f969f7fe640 1 --2- 172.21.15.91:0/3454569818 >> v2:172.21.15.183:3300/0 conn(0x7f96a00a4eb0 0x7f96a006bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.521+0000 7f969f7fe640 1 -- 172.21.15.91:0/3454569818 >> v1:172.21.15.91:6789/0 conn(0x7f96a01512d0 legacy=0x7f96a00c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.521+0000 7f969f7fe640 1 -- 172.21.15.91:0/3454569818 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a00c57b0 con 0x7f96a014e170 2023-11-27T20:42:05.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.522+0000 7f969f7fe640 1 --2- 172.21.15.91:0/3454569818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a014e170 0x7f96a0154910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96a00c0080 tx=0x7f969002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec7d56e67fc0123 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:05.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.523+0000 7f969effd640 1 -- 172.21.15.91:0/3454569818 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969002e070 con 0x7f96a014e170 2023-11-27T20:42:05.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.523+0000 7f969effd640 1 -- 172.21.15.91:0/3454569818 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96900315a0 con 0x7f96a014e170 2023-11-27T20:42:05.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.523+0000 7f969effd640 1 -- 172.21.15.91:0/3454569818 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690031930 con 0x7f96a014e170 2023-11-27T20:42:05.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.523+0000 7f96a487e640 1 -- 172.21.15.91:0/3454569818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a014e170 msgr2=0x7f96a0154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.523+0000 7f96a487e640 1 --2- 172.21.15.91:0/3454569818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a014e170 0x7f96a0154910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96a00c0080 tx=0x7f969002b840 comp rx=0 tx=0).stop 2023-11-27T20:42:05.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.523+0000 7f96a487e640 1 -- 172.21.15.91:0/3454569818 shutdown_connections 2023-11-27T20:42:05.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.523+0000 7f96a487e640 1 --2- 172.21.15.91:0/3454569818 >> v2:172.21.15.183:3300/0 conn(0x7f96a00a4eb0 0x7f96a006bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.523+0000 7f96a487e640 1 --2- 172.21.15.91:0/3454569818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a014e170 0x7f96a0154910 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.523+0000 7f96a487e640 1 -- 172.21.15.91:0/3454569818 >> 172.21.15.91:0/3454569818 conn(0x7f96a00a77f0 msgr2=0x7f96a00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:05.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.523+0000 7f96a487e640 1 -- 172.21.15.91:0/3454569818 shutdown_connections 2023-11-27T20:42:05.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.524+0000 7f96a487e640 1 -- 172.21.15.91:0/3454569818 wait complete. 2023-11-27T20:42:05.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.525+0000 7f96a487e640 1 Processor -- start 2023-11-27T20:42:05.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.525+0000 7f96a487e640 1 -- start start 2023-11-27T20:42:05.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.526+0000 7f96a487e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a00a4eb0 0x7f96a01ea720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.526+0000 7f96a487e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a014e170 0x7f96a00bee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.526+0000 7f96a487e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96a01512d0 0x7f96a01db620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.526+0000 7f96a487e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00bf3b0 con 0x7f96a00a4eb0 2023-11-27T20:42:05.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.526+0000 7f96a487e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0151c70 con 0x7f96a014e170 2023-11-27T20:42:05.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.526+0000 7f96a487e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00bf5e0 con 0x7f96a01512d0 2023-11-27T20:42:05.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.527+0000 7f969f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a00a4eb0 0x7f96a01ea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.527+0000 7f969f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a00a4eb0 0x7f96a01ea720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58068/0 (socket says 172.21.15.91:58068) 2023-11-27T20:42:05.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.527+0000 7f969f7fe640 1 -- 172.21.15.91:0/2331931112 learned_addr learned my addr 172.21.15.91:0/2331931112 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.527+0000 7f969f7fe640 1 -- 172.21.15.91:0/2331931112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96a01512d0 msgr2=0x7f96a01db620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.527+0000 7f969f7fe640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96a01512d0 0x7f96a01db620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.527+0000 7f969f7fe640 1 -- 172.21.15.91:0/2331931112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a014e170 msgr2=0x7f96a00bee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.527+0000 7f969f7fe640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a014e170 0x7f96a00bee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.527+0000 7f969f7fe640 1 -- 172.21.15.91:0/2331931112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690009400 con 0x7f96a00a4eb0 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.527+0000 7f969f7fe640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a00a4eb0 0x7f96a01ea720 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9690009890 tx=0x7f96900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.528+0000 7f969cff9640 1 -- 172.21.15.91:0/2331931112 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690032900 con 0x7f96a00a4eb0 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.528+0000 7f969cff9640 1 -- 172.21.15.91:0/2331931112 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9690032a60 con 0x7f96a00a4eb0 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.528+0000 7f96a487e640 1 -- 172.21.15.91:0/2331931112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a01e9c40 con 0x7f96a00a4eb0 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.528+0000 7f969cff9640 1 -- 172.21.15.91:0/2331931112 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690032e10 con 0x7f96a00a4eb0 2023-11-27T20:42:05.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.528+0000 7f96a487e640 1 -- 172.21.15.91:0/2331931112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a01ea200 con 0x7f96a00a4eb0 2023-11-27T20:42:05.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.529+0000 7f96a487e640 1 -- 172.21.15.91:0/2331931112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a01ea3f0 con 0x7f96a00a4eb0 2023-11-27T20:42:05.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.530+0000 7f969cff9640 1 -- 172.21.15.91:0/2331931112 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f969003b3f0 con 0x7f96a00a4eb0 2023-11-27T20:42:05.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.530+0000 7f969cff9640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f968006b1f0 0x7f968006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.531+0000 7f969cff9640 1 -- 172.21.15.91:0/2331931112 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96900abb40 con 0x7f96a00a4eb0 2023-11-27T20:42:05.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.531+0000 7f9697fff640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f968006b1f0 0x7f968006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.532+0000 7f9697fff640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f968006b1f0 0x7f968006d6b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9688006fd0 tx=0x7f9688008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:05.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.536+0000 7f969cff9640 1 -- 172.21.15.91:0/2331931112 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9690076860 con 0x7f96a00a4eb0 2023-11-27T20:42:05.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.728+0000 7f96a487e640 1 -- 172.21.15.91:0/2331931112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96a004e840 con 0x7f96a00a4eb0 2023-11-27T20:42:05.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.729+0000 7f969cff9640 1 -- 172.21.15.91:0/2331931112 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9690079e80 con 0x7f96a00a4eb0 2023-11-27T20:42:05.729 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:42:05.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 -- 172.21.15.91:0/2331931112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f968006b1f0 msgr2=0x7f968006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f968006b1f0 0x7f968006d6b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9688006fd0 tx=0x7f9688008040 comp rx=0 tx=0).stop 2023-11-27T20:42:05.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 -- 172.21.15.91:0/2331931112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a00a4eb0 msgr2=0x7f96a01ea720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a00a4eb0 0x7f96a01ea720 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9690009890 tx=0x7f96900046c0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 -- 172.21.15.91:0/2331931112 shutdown_connections 2023-11-27T20:42:05.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96a01512d0 0x7f96a01db620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f968006b1f0 0x7f968006d6b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a014e170 0x7f96a00bee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 --2- 172.21.15.91:0/2331931112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a00a4eb0 0x7f96a01ea720 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 -- 172.21.15.91:0/2331931112 >> 172.21.15.91:0/2331931112 conn(0x7f96a00a77f0 msgr2=0x7f96a00a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:05.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 -- 172.21.15.91:0/2331931112 shutdown_connections 2023-11-27T20:42:05.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.732+0000 7f96a487e640 1 -- 172.21.15.91:0/2331931112 wait complete. 2023-11-27T20:42:05.751 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:05.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.961+0000 7ff0cc935640 1 Processor -- start 2023-11-27T20:42:05.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.961+0000 7ff0cc935640 1 -- start start 2023-11-27T20:42:05.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0cc935640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c814e7f0 0x7ff0c80c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0cc935640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff0c806cd20 0x7ff0c815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0cc935640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c80a8380 con 0x7ff0c80c52e0 2023-11-27T20:42:05.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0cc935640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c81510b0 con 0x7ff0c806cd20 2023-11-27T20:42:05.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0cc935640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c806bf60 con 0x7ff0c814e7f0 2023-11-27T20:42:05.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0bffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff0c80c52e0 0x7ff0c806d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54014/0 (socket says 172.21.15.91:54014) 2023-11-27T20:42:05.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0bffff640 1 -- 172.21.15.91:0/2621314304 learned_addr learned my addr 172.21.15.91:0/2621314304 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:05.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0c77fe640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c814e7f0 0x7ff0c80c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0c7fff640 1 --2- 172.21.15.91:0/2621314304 >> v2:172.21.15.183:3300/0 conn(0x7ff0c806cd20 0x7ff0c815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460111230 0 0) 0x7ff0c80a8380 con 0x7ff0c80c52e0 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.963+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b4003520 con 0x7ff0c80c52e0 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3061494021 0 0) 0x7ff0b4003520 con 0x7ff0c80c52e0 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c814e7f0 msgr2=0x7ff0c80c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c814e7f0 0x7ff0c80c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 >> v2:172.21.15.183:3300/0 conn(0x7ff0c806cd20 msgr2=0x7ff0c815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 --2- 172.21.15.91:0/2621314304 >> v2:172.21.15.183:3300/0 conn(0x7ff0c806cd20 0x7ff0c815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c806c240 con 0x7ff0c80c52e0 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7ff0b0001670 con 0x7ff0c80c52e0 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 >> v1:172.21.15.91:6789/0 conn(0x7ff0c80c52e0 legacy=0x7ff0c806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c814e7f0 0x7ff0b4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0b4003ef0 0x7ff0b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0b4004d00 0x7ff0b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c81510b0 con 0x7ff0b4004d00 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c806bf60 con 0x7ff0b4003ef0 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b400dbe0 con 0x7ff0c814e7f0 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c7fff640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0b4004d00 0x7ff0b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.964+0000 7ff0c77fe640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c814e7f0 0x7ff0b4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.965+0000 7ff0bffff640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0b4003ef0 0x7ff0b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.965+0000 7ff0c7fff640 1 -- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c814e7f0 msgr2=0x7ff0b4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.965+0000 7ff0c7fff640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c814e7f0 0x7ff0b4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.965+0000 7ff0c7fff640 1 -- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0b4003ef0 msgr2=0x7ff0b40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.965+0000 7ff0c7fff640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0b4003ef0 0x7ff0b40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.965+0000 7ff0c7fff640 1 -- 172.21.15.91:0/2621314304 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b4003520 con 0x7ff0b4004d00 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.966+0000 7ff0c7fff640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0b4004d00 0x7ff0b4005180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009f90 tx=0x7ff0b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c81dd9e91f38064 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.966+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c002cbd0 con 0x7ff0b4004d00 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.966+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c000f040 con 0x7ff0b4004d00 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.966+0000 7ff0c6ffd640 1 -- 172.21.15.91:0/2621314304 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0034440 con 0x7ff0b4004d00 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.967+0000 7ff0cc935640 1 -- 172.21.15.91:0/2621314304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0b4004d00 msgr2=0x7ff0b4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.967+0000 7ff0cc935640 1 --2- 172.21.15.91:0/2621314304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0b4004d00 0x7ff0b4005180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009f90 tx=0x7ff0b40057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.967+0000 7ff0c7fff640 1 -- 172.21.15.91:0/2621314304 reap_dead start 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.967+0000 7ff0cc935640 1 -- 172.21.15.91:0/2621314304 shutdown_connections 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.967+0000 7ff0cc935640 1 -- 172.21.15.91:0/2621314304 >> 172.21.15.91:0/2621314304 conn(0x7ff0c80a77f0 msgr2=0x7ff0c80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.967+0000 7ff0cc935640 1 -- 172.21.15.91:0/2621314304 shutdown_connections 2023-11-27T20:42:05.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.967+0000 7ff0cc935640 1 -- 172.21.15.91:0/2621314304 wait complete. 2023-11-27T20:42:05.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.969+0000 7ff0cc935640 1 Processor -- start 2023-11-27T20:42:05.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.969+0000 7ff0cc935640 1 -- start start 2023-11-27T20:42:05.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0cc935640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0b4004d00 0x7ff0c814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0cc935640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c8148a90 0x7ff0c81e5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0cc935640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0c80719d0 0x7ff0c8071e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0cc935640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c81e5b10 con 0x7ff0c80719d0 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0cc935640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c814ad60 con 0x7ff0b4004d00 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0cc935640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c81506e0 con 0x7ff0c8148a90 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0c7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0c80719d0 0x7ff0c8071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0c7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0c80719d0 0x7ff0c8071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58080/0 (socket says 172.21.15.91:58080) 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0c7fff640 1 -- 172.21.15.91:0/1443843027 learned_addr learned my addr 172.21.15.91:0/1443843027 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0bffff640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c8148a90 0x7ff0c81e5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0c7fff640 1 -- 172.21.15.91:0/1443843027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c8148a90 msgr2=0x7ff0c81e5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0c7fff640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c8148a90 0x7ff0c81e5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0c7fff640 1 -- 172.21.15.91:0/1443843027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0b4004d00 msgr2=0x7ff0c814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.970+0000 7ff0c7fff640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0b4004d00 0x7ff0c814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.971+0000 7ff0c7fff640 1 -- 172.21.15.91:0/1443843027 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c81509c0 con 0x7ff0c80719d0 2023-11-27T20:42:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.971+0000 7ff0c7fff640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0c80719d0 0x7ff0c8071e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0002230 tx=0x7ff0c0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.971+0000 7ff0c4ff9640 1 -- 172.21.15.91:0/1443843027 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0034bc0 con 0x7ff0c80719d0 2023-11-27T20:42:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.971+0000 7ff0c4ff9640 1 -- 172.21.15.91:0/1443843027 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c0034d40 con 0x7ff0c80719d0 2023-11-27T20:42:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.971+0000 7ff0c4ff9640 1 -- 172.21.15.91:0/1443843027 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c003e680 con 0x7ff0c80719d0 2023-11-27T20:42:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.971+0000 7ff0cc935640 1 -- 172.21.15.91:0/1443843027 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c8150ca0 con 0x7ff0c80719d0 2023-11-27T20:42:05.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.971+0000 7ff0cc935640 1 -- 172.21.15.91:0/1443843027 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c81e64e0 con 0x7ff0c80719d0 2023-11-27T20:42:05.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.972+0000 7ff0cc935640 1 -- 172.21.15.91:0/1443843027 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c804e840 con 0x7ff0c80719d0 2023-11-27T20:42:05.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.973+0000 7ff0c4ff9640 1 -- 172.21.15.91:0/1443843027 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff0c003e7e0 con 0x7ff0c80719d0 2023-11-27T20:42:05.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.974+0000 7ff0c4ff9640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff0a806b1c0 0x7ff0a806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:05.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.974+0000 7ff0c4ff9640 1 -- 172.21.15.91:0/1443843027 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0c00abdc0 con 0x7ff0c80719d0 2023-11-27T20:42:05.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.974+0000 7ff0c77fe640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff0a806b1c0 0x7ff0a806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:05.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.975+0000 7ff0c77fe640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff0a806b1c0 0x7ff0a806d680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009ab0 tx=0x7ff0b80095d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:05.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:05.978+0000 7ff0c4ff9640 1 -- 172.21.15.91:0/1443843027 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff0c0076ae0 con 0x7ff0c80719d0 2023-11-27T20:42:06.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.169+0000 7ff0cc935640 1 -- 172.21.15.91:0/1443843027 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0c80c3c70 con 0x7ff0c80719d0 2023-11-27T20:42:06.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.171+0000 7ff0c4ff9640 1 -- 172.21.15.91:0/1443843027 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7ff0c0039090 con 0x7ff0c80719d0 2023-11-27T20:42:06.172 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:06.173 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:06.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.174+0000 7ff0cc935640 1 -- 172.21.15.91:0/1443843027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff0a806b1c0 msgr2=0x7ff0a806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.174+0000 7ff0cc935640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff0a806b1c0 0x7ff0a806d680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009ab0 tx=0x7ff0b80095d0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.174+0000 7ff0cc935640 1 -- 172.21.15.91:0/1443843027 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0c80719d0 msgr2=0x7ff0c8071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.174+0000 7ff0cc935640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0c80719d0 0x7ff0c8071e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0002230 tx=0x7ff0c0009750 comp rx=0 tx=0).stop 2023-11-27T20:42:06.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.175+0000 7ff0cc935640 1 -- 172.21.15.91:0/1443843027 shutdown_connections 2023-11-27T20:42:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.175+0000 7ff0cc935640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0c80719d0 0x7ff0c8071e50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.175+0000 7ff0cc935640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c8148a90 0x7ff0c81e5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.175+0000 7ff0cc935640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff0a806b1c0 0x7ff0a806d680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.175+0000 7ff0cc935640 1 --2- 172.21.15.91:0/1443843027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0b4004d00 0x7ff0c814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.175+0000 7ff0cc935640 1 -- 172.21.15.91:0/1443843027 >> 172.21.15.91:0/1443843027 conn(0x7ff0c80a77f0 msgr2=0x7ff0c80a5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.175+0000 7ff0cc935640 1 -- 172.21.15.91:0/1443843027 shutdown_connections 2023-11-27T20:42:06.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.175+0000 7ff0cc935640 1 -- 172.21.15.91:0/1443843027 wait complete. 2023-11-27T20:42:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:41:32.704555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:41:33.818847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:42:06.195 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:42:06.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.407+0000 7f9619d5a640 1 Processor -- start 2023-11-27T20:42:06.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.407+0000 7f9619d5a640 1 -- start start 2023-11-27T20:42:06.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.409+0000 7f9619d5a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f96140c3400 0x7f961406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.409+0000 7f9619d5a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9614071fd0 con 0x7f9614151fd0 2023-11-27T20:42:06.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.409+0000 7f9619d5a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9614072220 con 0x7f9614157fe0 2023-11-27T20:42:06.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.409+0000 7f9619d5a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961406ee50 con 0x7f96140c3400 2023-11-27T20:42:06.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.409+0000 7f96137fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f9614151fd0 0x7f961406a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54024/0 (socket says 172.21.15.91:54024) 2023-11-27T20:42:06.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.409+0000 7f96137fe640 1 -- 172.21.15.91:0/1922106948 learned_addr learned my addr 172.21.15.91:0/1922106948 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:06.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.409+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715280053 0 0) 0x7f9614071fd0 con 0x7f9614151fd0 2023-11-27T20:42:06.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.409+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9600003520 con 0x7f9614151fd0 2023-11-27T20:42:06.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.409+0000 7f960affd640 1 --2- 172.21.15.91:0/1922106948 >> v2:172.21.15.183:3300/0 conn(0x7f96140c3400 0x7f961406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1327658333 0 0) 0x7f9600003520 con 0x7f9614151fd0 2023-11-27T20:42:06.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 >> v2:172.21.15.183:3300/0 conn(0x7f96140c3400 msgr2=0x7f961406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:06.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 --2- 172.21.15.91:0/1922106948 >> v2:172.21.15.183:3300/0 conn(0x7f96140c3400 0x7f961406e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 >> v1:172.21.15.183:6789/0 conn(0x7f9614157fe0 legacy=0x7f9614158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:06.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961406e0d0 con 0x7f9614151fd0 2023-11-27T20:42:06.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f9604001670 con 0x7f9614151fd0 2023-11-27T20:42:06.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 >> v1:172.21.15.91:6789/0 conn(0x7f9614151fd0 legacy=0x7f961406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f9600003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96000047c0 0x7f9600004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96000052a0 0x7f960000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961406ee50 con 0x7f9600003970 2023-11-27T20:42:06.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960000c150 con 0x7f96000047c0 2023-11-27T20:42:06.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960000c310 con 0x7f96000052a0 2023-11-27T20:42:06.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.410+0000 7f96137fe640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f9600003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.411+0000 7f960affd640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96000047c0 0x7f9600004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.411+0000 7f96137fe640 1 -- 172.21.15.91:0/1922106948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96000052a0 msgr2=0x7f960000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:06.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.411+0000 7f9613fff640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96000052a0 0x7f960000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.411+0000 7f96137fe640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96000052a0 0x7f960000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.411+0000 7f96137fe640 1 -- 172.21.15.91:0/1922106948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96000047c0 msgr2=0x7f9600004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:06.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.411+0000 7f96137fe640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96000047c0 0x7f9600004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.411+0000 7f96137fe640 1 -- 172.21.15.91:0/1922106948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600003520 con 0x7f9600003970 2023-11-27T20:42:06.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.411+0000 7f9613fff640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96000052a0 0x7f960000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:06.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.411+0000 7f960affd640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96000047c0 0x7f9600004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:06.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.411+0000 7f9613fff640 1 -- 172.21.15.91:0/1922106948 reap_dead start 2023-11-27T20:42:06.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.412+0000 7f96137fe640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f9600003d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9604001eb0 tx=0x7f96000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436192c0e84e38db server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:06.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.412+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604005ad0 con 0x7f9600003970 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.412+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9604005c50 con 0x7f9600003970 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.412+0000 7f9612ffd640 1 -- 172.21.15.91:0/1922106948 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960402c890 con 0x7f9600003970 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.413+0000 7f9619d5a640 1 -- 172.21.15.91:0/1922106948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 msgr2=0x7f9600003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.413+0000 7f9619d5a640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f9600003d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9604001eb0 tx=0x7f96000057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.413+0000 7f9619d5a640 1 -- 172.21.15.91:0/1922106948 shutdown_connections 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.413+0000 7f9619d5a640 1 --2- 172.21.15.91:0/1922106948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f9600003d70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.413+0000 7f9619d5a640 1 -- 172.21.15.91:0/1922106948 >> 172.21.15.91:0/1922106948 conn(0x7f96140c6ee0 msgr2=0x7f96140c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.413+0000 7f9619d5a640 1 -- 172.21.15.91:0/1922106948 shutdown_connections 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.413+0000 7f9619d5a640 1 -- 172.21.15.91:0/1922106948 wait complete. 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.414+0000 7f9619d5a640 1 Processor -- start 2023-11-27T20:42:06.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.415+0000 7f9619d5a640 1 -- start start 2023-11-27T20:42:06.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.415+0000 7f9619d5a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f961414d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f9619d5a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9614144e60 0x7f9614143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f9619d5a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9614144200 0x7f96141ea200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f9619d5a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9614144c80 con 0x7f9600003970 2023-11-27T20:42:06.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f9619d5a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9614146540 con 0x7f9614144200 2023-11-27T20:42:06.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f9619d5a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9614145c10 con 0x7f9614144e60 2023-11-27T20:42:06.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f96137fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f961414d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f96137fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f961414d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58096/0 (socket says 172.21.15.91:58096) 2023-11-27T20:42:06.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f96137fe640 1 -- 172.21.15.91:0/2583895374 learned_addr learned my addr 172.21.15.91:0/2583895374 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:06.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f96137fe640 1 -- 172.21.15.91:0/2583895374 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9614144e60 msgr2=0x7f9614143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f96137fe640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9614144e60 0x7f9614143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f96137fe640 1 -- 172.21.15.91:0/2583895374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9614144200 msgr2=0x7f96141ea200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f9613fff640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9614144200 0x7f96141ea200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f96137fe640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9614144200 0x7f96141ea200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.416+0000 7f96137fe640 1 -- 172.21.15.91:0/2583895374 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614145ef0 con 0x7f9600003970 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.417+0000 7f96137fe640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f961414d630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f960402c430 tx=0x7f960402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.417+0000 7f9610ff9640 1 -- 172.21.15.91:0/2583895374 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960403c040 con 0x7f9600003970 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.417+0000 7f9610ff9640 1 -- 172.21.15.91:0/2583895374 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960402cd60 con 0x7f9600003970 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.417+0000 7f9610ff9640 1 -- 172.21.15.91:0/2583895374 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604007270 con 0x7f9600003970 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.417+0000 7f9619d5a640 1 -- 172.21.15.91:0/2583895374 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96141461d0 con 0x7f9600003970 2023-11-27T20:42:06.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.417+0000 7f9619d5a640 1 -- 172.21.15.91:0/2583895374 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961414db70 con 0x7f9600003970 2023-11-27T20:42:06.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.418+0000 7f9619d5a640 1 -- 172.21.15.91:0/2583895374 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96141517e0 con 0x7f9600003970 2023-11-27T20:42:06.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.419+0000 7f9610ff9640 1 -- 172.21.15.91:0/2583895374 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9604032070 con 0x7f9600003970 2023-11-27T20:42:06.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.420+0000 7f9610ff9640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95f406b1c0 0x7f95f406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.420+0000 7f9610ff9640 1 -- 172.21.15.91:0/2583895374 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96040aaea0 con 0x7f9600003970 2023-11-27T20:42:06.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.420+0000 7f960affd640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95f406b1c0 0x7f95f406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.421+0000 7f960affd640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95f406b1c0 0x7f95f406d680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9614071f00 tx=0x7f95fc0092f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:06.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.425+0000 7f9610ff9640 1 -- 172.21.15.91:0/2583895374 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9604075be0 con 0x7f9600003970 2023-11-27T20:42:06.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.614+0000 7f9619d5a640 1 -- 172.21.15.91:0/2583895374 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9614068350 con 0x7f9600003970 2023-11-27T20:42:06.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.615+0000 7f9610ff9640 1 -- 172.21.15.91:0/2583895374 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9604079200 con 0x7f9600003970 2023-11-27T20:42:06.618 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:42:06.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 -- 172.21.15.91:0/2583895374 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95f406b1c0 msgr2=0x7f95f406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95f406b1c0 0x7f95f406d680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9614071f00 tx=0x7f95fc0092f0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 -- 172.21.15.91:0/2583895374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 msgr2=0x7f961414d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f961414d630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f960402c430 tx=0x7f960402e070 comp rx=0 tx=0).stop 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 -- 172.21.15.91:0/2583895374 shutdown_connections 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95f406b1c0 0x7f95f406d680 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9614144200 0x7f96141ea200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9614144e60 0x7f9614143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 --2- 172.21.15.91:0/2583895374 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9600003970 0x7f961414d630 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 -- 172.21.15.91:0/2583895374 >> 172.21.15.91:0/2583895374 conn(0x7f96140c6ee0 msgr2=0x7f9614150940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 -- 172.21.15.91:0/2583895374 shutdown_connections 2023-11-27T20:42:06.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.618+0000 7f9619d5a640 1 -- 172.21.15.91:0/2583895374 wait complete. 2023-11-27T20:42:06.639 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:42:06.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.851+0000 7fa2326da640 1 Processor -- start 2023-11-27T20:42:06.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.851+0000 7fa2326da640 1 -- start start 2023-11-27T20:42:06.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.852+0000 7fa2326da640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa22c06e000 0x7fa22c0c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.852+0000 7fa2326da640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 0x7fa22c0c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.853+0000 7fa2326da640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c159800 con 0x7fa22c155f60 2023-11-27T20:42:06.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.853+0000 7fa2326da640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22c06c440 con 0x7fa22c06e000 2023-11-27T20:42:06.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.853+0000 7fa2326da640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c156340 con 0x7fa22c0c1100 2023-11-27T20:42:06.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.853+0000 7fa230ed7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa22c06e000 0x7fa22c0c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.853+0000 7fa231ed9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 0x7fa22c0c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.854+0000 7fa230ed7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa22c06e000 0x7fa22c0c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:36722/0 (socket says 172.21.15.91:36722) 2023-11-27T20:42:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.854+0000 7fa2316d8640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fa22c155f60 0x7fa22c0c18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:47298/0 (socket says 172.21.15.91:47298) 2023-11-27T20:42:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.854+0000 7fa230ed7640 1 -- 172.21.15.91:0/3137639833 learned_addr learned my addr 172.21.15.91:0/3137639833 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.854+0000 7fa231ed9640 1 -- 172.21.15.91:0/3137639833 >> v2:172.21.15.183:3300/0 conn(0x7fa22c06e000 msgr2=0x7fa22c0c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.854+0000 7fa231ed9640 1 --2- 172.21.15.91:0/3137639833 >> v2:172.21.15.183:3300/0 conn(0x7fa22c06e000 0x7fa22c0c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.854+0000 7fa231ed9640 1 -- 172.21.15.91:0/3137639833 >> v1:172.21.15.183:6789/0 conn(0x7fa22c155f60 legacy=0x7fa22c0c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.854+0000 7fa231ed9640 1 -- 172.21.15.91:0/3137639833 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c158a40 con 0x7fa22c0c1100 2023-11-27T20:42:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.854+0000 7fa230ed7640 1 --2- 172.21.15.91:0/3137639833 >> v2:172.21.15.183:3300/0 conn(0x7fa22c06e000 0x7fa22c0c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:42:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.856+0000 7fa231ed9640 1 --2- 172.21.15.91:0/3137639833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 0x7fa22c0c3e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa224009d90 tx=0x7fa22402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df0f99df76568a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.856+0000 7fa223fff640 1 -- 172.21.15.91:0/3137639833 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22402cc50 con 0x7fa22c0c1100 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.857+0000 7fa223fff640 1 -- 172.21.15.91:0/3137639833 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22402cdb0 con 0x7fa22c0c1100 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.857+0000 7fa223fff640 1 -- 172.21.15.91:0/3137639833 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224034660 con 0x7fa22c0c1100 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.857+0000 7fa2326da640 1 -- 172.21.15.91:0/3137639833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 msgr2=0x7fa22c0c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.857+0000 7fa2326da640 1 --2- 172.21.15.91:0/3137639833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 0x7fa22c0c3e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa224009d90 tx=0x7fa22402bea0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.857+0000 7fa2326da640 1 -- 172.21.15.91:0/3137639833 shutdown_connections 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.857+0000 7fa2326da640 1 --2- 172.21.15.91:0/3137639833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 0x7fa22c0c3e80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.857+0000 7fa2326da640 1 --2- 172.21.15.91:0/3137639833 >> v2:172.21.15.183:3300/0 conn(0x7fa22c06e000 0x7fa22c0c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.857+0000 7fa2326da640 1 -- 172.21.15.91:0/3137639833 >> 172.21.15.91:0/3137639833 conn(0x7fa22c0a77f0 msgr2=0x7fa22c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.858+0000 7fa2326da640 1 -- 172.21.15.91:0/3137639833 shutdown_connections 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.858+0000 7fa2326da640 1 -- 172.21.15.91:0/3137639833 wait complete. 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.860+0000 7fa2326da640 1 Processor -- start 2023-11-27T20:42:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.860+0000 7fa2326da640 1 -- start start 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.861+0000 7fa2326da640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa22c06e000 0x7fa22c0ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.861+0000 7fa2326da640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 0x7fa22c1f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.861+0000 7fa2326da640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa22c155f60 0x7fa22c0a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.861+0000 7fa2326da640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c15ba60 con 0x7fa22c06e000 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.861+0000 7fa2326da640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c15bd40 con 0x7fa22c155f60 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.861+0000 7fa2326da640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c15c1d0 con 0x7fa22c0c1100 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.861+0000 7fa2316d8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa22c06e000 0x7fa22c0ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.861+0000 7fa2316d8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa22c06e000 0x7fa22c0ab1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58102/0 (socket says 172.21.15.91:58102) 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.861+0000 7fa2316d8640 1 -- 172.21.15.91:0/1031869431 learned_addr learned my addr 172.21.15.91:0/1031869431 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.862+0000 7fa231ed9640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa22c155f60 0x7fa22c0a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.862+0000 7fa230ed7640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 0x7fa22c1f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.862+0000 7fa2316d8640 1 -- 172.21.15.91:0/1031869431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 msgr2=0x7fa22c1f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.862+0000 7fa2316d8640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 0x7fa22c1f1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.862+0000 7fa2316d8640 1 -- 172.21.15.91:0/1031869431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa22c155f60 msgr2=0x7fa22c0a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.862+0000 7fa2316d8640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa22c155f60 0x7fa22c0a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.862+0000 7fa2316d8640 1 -- 172.21.15.91:0/1031869431 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c0094d0 con 0x7fa22c06e000 2023-11-27T20:42:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.862+0000 7fa2316d8640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa22c06e000 0x7fa22c0ab1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa22800c410 tx=0x7fa22800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.862+0000 7fa221ffb640 1 -- 172.21.15.91:0/1031869431 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2280074e0 con 0x7fa22c06e000 2023-11-27T20:42:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.863+0000 7fa221ffb640 1 -- 172.21.15.91:0/1031869431 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa228007640 con 0x7fa22c06e000 2023-11-27T20:42:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.863+0000 7fa221ffb640 1 -- 172.21.15.91:0/1031869431 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2280049e0 con 0x7fa22c06e000 2023-11-27T20:42:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.863+0000 7fa2326da640 1 -- 172.21.15.91:0/1031869431 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa224009a70 con 0x7fa22c06e000 2023-11-27T20:42:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.863+0000 7fa2326da640 1 -- 172.21.15.91:0/1031869431 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c0ab710 con 0x7fa22c06e000 2023-11-27T20:42:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.864+0000 7fa2326da640 1 -- 172.21.15.91:0/1031869431 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c04e840 con 0x7fa22c06e000 2023-11-27T20:42:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.865+0000 7fa221ffb640 1 -- 172.21.15.91:0/1031869431 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa228004b40 con 0x7fa22c06e000 2023-11-27T20:42:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.866+0000 7fa221ffb640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa21006b1c0 0x7fa21006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.866+0000 7fa221ffb640 1 -- 172.21.15.91:0/1031869431 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa228089330 con 0x7fa22c06e000 2023-11-27T20:42:06.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.866+0000 7fa230ed7640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa21006b1c0 0x7fa21006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:06.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.867+0000 7fa230ed7640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa21006b1c0 0x7fa21006d680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0a6a60 tx=0x7fa21c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:06.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:06.870+0000 7fa221ffb640 1 -- 172.21.15.91:0/1031869431 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa2280540f0 con 0x7fa22c06e000 2023-11-27T20:42:07.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.058+0000 7fa2326da640 1 -- 172.21.15.91:0/1031869431 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa22c0c5750 con 0x7fa22c06e000 2023-11-27T20:42:07.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.059+0000 7fa221ffb640 1 -- 172.21.15.91:0/1031869431 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa228057710 con 0x7fa22c06e000 2023-11-27T20:42:07.061 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:42:07.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 -- 172.21.15.91:0/1031869431 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa21006b1c0 msgr2=0x7fa21006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa21006b1c0 0x7fa21006d680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0a6a60 tx=0x7fa21c008040 comp rx=0 tx=0).stop 2023-11-27T20:42:07.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 -- 172.21.15.91:0/1031869431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa22c06e000 msgr2=0x7fa22c0ab1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa22c06e000 0x7fa22c0ab1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa22800c410 tx=0x7fa22800c8d0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 -- 172.21.15.91:0/1031869431 shutdown_connections 2023-11-27T20:42:07.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa21006b1c0 0x7fa21006d680 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa22c155f60 0x7fa22c0a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa22c0c1100 0x7fa22c1f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 --2- 172.21.15.91:0/1031869431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa22c06e000 0x7fa22c0ab1d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 -- 172.21.15.91:0/1031869431 >> 172.21.15.91:0/1031869431 conn(0x7fa22c0a77f0 msgr2=0x7fa22c1566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:07.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 -- 172.21.15.91:0/1031869431 shutdown_connections 2023-11-27T20:42:07.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.062+0000 7fa2326da640 1 -- 172.21.15.91:0/1031869431 wait complete. 2023-11-27T20:42:07.082 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:42:07.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.293+0000 7f7e77597640 1 Processor -- start 2023-11-27T20:42:07.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.293+0000 7f7e77597640 1 -- start start 2023-11-27T20:42:07.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.294+0000 7f7e77597640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7e7006d0a0 0x7f7e70152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.294+0000 7f7e77597640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e700c64a0 con 0x7f7e700c3ea0 2023-11-27T20:42:07.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.294+0000 7f7e77597640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e700c5c00 con 0x7f7e7014fd30 2023-11-27T20:42:07.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.294+0000 7f7e77597640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e700c5ee0 con 0x7f7e7006d0a0 2023-11-27T20:42:07.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e75b34640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f7e700c3ea0 0x7f7e700c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54028/0 (socket says 172.21.15.91:54028) 2023-11-27T20:42:07.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e75b34640 1 -- 172.21.15.91:0/3997432830 learned_addr learned my addr 172.21.15.91:0/3997432830 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:07.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e74b32640 1 --2- 172.21.15.91:0/3997432830 >> v2:172.21.15.183:3300/0 conn(0x7f7e7006d0a0 0x7f7e70152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584846498 0 0) 0x7f7e700c64a0 con 0x7f7e700c3ea0 2023-11-27T20:42:07.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e5c003520 con 0x7f7e700c3ea0 2023-11-27T20:42:07.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2862777975 0 0) 0x7f7e5c003520 con 0x7f7e700c3ea0 2023-11-27T20:42:07.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 >> v2:172.21.15.183:3300/0 conn(0x7f7e7006d0a0 msgr2=0x7f7e70152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:07.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e67fff640 1 --2- 172.21.15.91:0/3997432830 >> v2:172.21.15.183:3300/0 conn(0x7f7e7006d0a0 0x7f7e70152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 >> v1:172.21.15.183:6789/0 conn(0x7f7e7014fd30 legacy=0x7f7e700a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700c61c0 con 0x7f7e700c3ea0 2023-11-27T20:42:07.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.295+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f7e680019f0 con 0x7f7e700c3ea0 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 >> v1:172.21.15.91:6789/0 conn(0x7f7e700c3ea0 legacy=0x7f7e700c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e67fff640 1 --2- 172.21.15.91:0/3997432830 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c003970 0x7f7e5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e67fff640 1 --2- 172.21.15.91:0/3997432830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c0047c0 0x7f7e5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e67fff640 1 --2- 172.21.15.91:0/3997432830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700c5ee0 con 0x7f7e5c005180 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c00c020 con 0x7f7e5c0047c0 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c00c1e0 con 0x7f7e5c003970 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e75b34640 1 --2- 172.21.15.91:0/3997432830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e74b32640 1 --2- 172.21.15.91:0/3997432830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c0047c0 0x7f7e5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e75b34640 1 -- 172.21.15.91:0/3997432830 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c003970 msgr2=0x7f7e5c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e75b34640 1 --2- 172.21.15.91:0/3997432830 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c003970 0x7f7e5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e75b34640 1 -- 172.21.15.91:0/3997432830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c0047c0 msgr2=0x7f7e5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:07.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e75b34640 1 --2- 172.21.15.91:0/3997432830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c0047c0 0x7f7e5c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.296+0000 7f7e75b34640 1 -- 172.21.15.91:0/3997432830 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c003520 con 0x7f7e5c005180 2023-11-27T20:42:07.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.297+0000 7f7e75b34640 1 -- 172.21.15.91:0/3997432830 reap_dead start 2023-11-27T20:42:07.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.297+0000 7f7e75b34640 1 --2- 172.21.15.91:0/3997432830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e5c00b980 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800a830 tx=0x7f7e5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b0a301867c51c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:07.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.298+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680072d0 con 0x7f7e5c005180 2023-11-27T20:42:07.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.298+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6802f070 con 0x7f7e5c005180 2023-11-27T20:42:07.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.298+0000 7f7e67fff640 1 -- 172.21.15.91:0/3997432830 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68007690 con 0x7f7e5c005180 2023-11-27T20:42:07.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.298+0000 7f7e77597640 1 -- 172.21.15.91:0/3997432830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 msgr2=0x7f7e5c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.298+0000 7f7e77597640 1 --2- 172.21.15.91:0/3997432830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e5c00b980 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800a830 tx=0x7f7e5c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.298+0000 7f7e77597640 1 -- 172.21.15.91:0/3997432830 shutdown_connections 2023-11-27T20:42:07.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.298+0000 7f7e77597640 1 --2- 172.21.15.91:0/3997432830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e5c00b980 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.298+0000 7f7e77597640 1 -- 172.21.15.91:0/3997432830 >> 172.21.15.91:0/3997432830 conn(0x7f7e7006a500 msgr2=0x7f7e7006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:07.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.298+0000 7f7e77597640 1 -- 172.21.15.91:0/3997432830 shutdown_connections 2023-11-27T20:42:07.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.298+0000 7f7e77597640 1 -- 172.21.15.91:0/3997432830 wait complete. 2023-11-27T20:42:07.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.300+0000 7f7e77597640 1 Processor -- start 2023-11-27T20:42:07.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.300+0000 7f7e77597640 1 -- start start 2023-11-27T20:42:07.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.301+0000 7f7e77597640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e701ec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.301+0000 7f7e77597640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e701df5f0 0x7f7e70155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.301+0000 7f7e77597640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e7014bf60 0x7f7e7014c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.301+0000 7f7e77597640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701ec830 con 0x7f7e5c005180 2023-11-27T20:42:07.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.301+0000 7f7e77597640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701e9090 con 0x7f7e7014bf60 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.301+0000 7f7e77597640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701e8480 con 0x7f7e701df5f0 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.301+0000 7f7e75333640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e701ec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.301+0000 7f7e75333640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e701ec2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58108/0 (socket says 172.21.15.91:58108) 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.301+0000 7f7e75333640 1 -- 172.21.15.91:0/377777238 learned_addr learned my addr 172.21.15.91:0/377777238 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e75b34640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e7014bf60 0x7f7e7014c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e74b32640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e701df5f0 0x7f7e70155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e75333640 1 -- 172.21.15.91:0/377777238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e701df5f0 msgr2=0x7f7e70155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e75333640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e701df5f0 0x7f7e70155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e75333640 1 -- 172.21.15.91:0/377777238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e7014bf60 msgr2=0x7f7e7014c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e75333640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e7014bf60 0x7f7e7014c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e75333640 1 -- 172.21.15.91:0/377777238 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e701e8760 con 0x7f7e5c005180 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e74b32640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e701df5f0 0x7f7e70155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:07.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e75333640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e701ec2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c500 tx=0x7f7e6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:07.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e65ffb640 1 -- 172.21.15.91:0/377777238 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0052d0 con 0x7f7e5c005180 2023-11-27T20:42:07.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e65ffb640 1 -- 172.21.15.91:0/377777238 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c005430 con 0x7f7e5c005180 2023-11-27T20:42:07.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e65ffb640 1 -- 172.21.15.91:0/377777238 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c012870 con 0x7f7e5c005180 2023-11-27T20:42:07.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e77597640 1 -- 172.21.15.91:0/377777238 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e701e8a40 con 0x7f7e5c005180 2023-11-27T20:42:07.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.302+0000 7f7e77597640 1 -- 172.21.15.91:0/377777238 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e701561e0 con 0x7f7e5c005180 2023-11-27T20:42:07.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.303+0000 7f7e77597640 1 -- 172.21.15.91:0/377777238 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e70068350 con 0x7f7e5c005180 2023-11-27T20:42:07.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.304+0000 7f7e65ffb640 1 -- 172.21.15.91:0/377777238 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7e6c0129d0 con 0x7f7e5c005180 2023-11-27T20:42:07.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.305+0000 7f7e65ffb640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7e5406b1f0 0x7f7e5406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.305+0000 7f7e65ffb640 1 -- 172.21.15.91:0/377777238 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e6c089620 con 0x7f7e5c005180 2023-11-27T20:42:07.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.306+0000 7f7e74b32640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7e5406b1f0 0x7f7e5406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.306+0000 7f7e74b32640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7e5406b1f0 0x7f7e5406d6b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e700c52b0 tx=0x7f7e60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:07.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.310+0000 7f7e65ffb640 1 -- 172.21.15.91:0/377777238 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7e6c054340 con 0x7f7e5c005180 2023-11-27T20:42:07.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.503+0000 7f7e77597640 1 -- 172.21.15.91:0/377777238 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e700c04a0 con 0x7f7e5c005180 2023-11-27T20:42:07.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.504+0000 7f7e65ffb640 1 -- 172.21.15.91:0/377777238 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e6c057960 con 0x7f7e5c005180 2023-11-27T20:42:07.506 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:42:07.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.507+0000 7f7e77597640 1 -- 172.21.15.91:0/377777238 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7e5406b1f0 msgr2=0x7f7e5406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.507+0000 7f7e77597640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7e5406b1f0 0x7f7e5406d6b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e700c52b0 tx=0x7f7e60008040 comp rx=0 tx=0).stop 2023-11-27T20:42:07.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.507+0000 7f7e77597640 1 -- 172.21.15.91:0/377777238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 msgr2=0x7f7e701ec2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.507+0000 7f7e77597640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e701ec2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c500 tx=0x7f7e6c00c9c0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.507+0000 7f7e77597640 1 -- 172.21.15.91:0/377777238 shutdown_connections 2023-11-27T20:42:07.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.507+0000 7f7e77597640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7e5406b1f0 0x7f7e5406d6b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.507+0000 7f7e77597640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e7014bf60 0x7f7e7014c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.507+0000 7f7e77597640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e701df5f0 0x7f7e70155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.507+0000 7f7e77597640 1 --2- 172.21.15.91:0/377777238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e5c005180 0x7f7e701ec2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.507+0000 7f7e77597640 1 -- 172.21.15.91:0/377777238 >> 172.21.15.91:0/377777238 conn(0x7f7e7006a500 msgr2=0x7f7e7006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:07.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.508+0000 7f7e77597640 1 -- 172.21.15.91:0/377777238 shutdown_connections 2023-11-27T20:42:07.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.508+0000 7f7e77597640 1 -- 172.21.15.91:0/377777238 wait complete. 2023-11-27T20:42:07.568 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-11-27T20:42:07.569 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:07.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.790+0000 7f5394e1e640 1 Processor -- start 2023-11-27T20:42:07.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.791+0000 7f5394e1e640 1 -- start start 2023-11-27T20:42:07.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.792+0000 7f5394e1e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f539014f9f0 0x7f539006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.792+0000 7f5394e1e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5390152600 0x7f5390152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.792+0000 7f5394e1e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53900a6de0 con 0x7f53900c7540 2023-11-27T20:42:07.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.792+0000 7f5394e1e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53900a7740 con 0x7f539014f9f0 2023-11-27T20:42:07.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.792+0000 7f5394e1e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53900a7080 con 0x7f5390152600 2023-11-27T20:42:07.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.792+0000 7f538dd9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f53900c7540 0x7f53900c47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54034/0 (socket says 172.21.15.91:54034) 2023-11-27T20:42:07.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.792+0000 7f538dd9b640 1 -- 172.21.15.91:0/4218743952 learned_addr learned my addr 172.21.15.91:0/4218743952 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:07.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.792+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240953714 0 0) 0x7f53900a6de0 con 0x7f53900c7540 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f537c003520 con 0x7f53900c7540 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538e59c640 1 --2- 172.21.15.91:0/4218743952 >> v2:172.21.15.183:3300/0 conn(0x7f539014f9f0 0x7f539006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538ed9d640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5390152600 0x7f5390152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 172899326 0 0) 0x7f537c003520 con 0x7f53900c7540 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5390152600 msgr2=0x7f5390152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5390152600 0x7f5390152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 >> v2:172.21.15.183:3300/0 conn(0x7f539014f9f0 msgr2=0x7f539006dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 --2- 172.21.15.91:0/4218743952 >> v2:172.21.15.183:3300/0 conn(0x7f539014f9f0 0x7f539006dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900a7360 con 0x7f53900c7540 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f5378001670 con 0x7f53900c7540 2023-11-27T20:42:07.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538e59c640 1 --2- 172.21.15.91:0/4218743952 >> v2:172.21.15.183:3300/0 conn(0x7f539014f9f0 0x7f539006dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 >> v1:172.21.15.91:6789/0 conn(0x7f53900c7540 legacy=0x7f53900c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f537c003970 0x7f537c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f537c0047c0 0x7f537c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5390152600 0x7f537c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900a7740 con 0x7f537c003970 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900a7080 con 0x7f537c0047c0 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c00bb10 con 0x7f5390152600 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.793+0000 7f538e59c640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f537c003970 0x7f537c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.794+0000 7f538e59c640 1 -- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5390152600 msgr2=0x7f537c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.794+0000 7f538e59c640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5390152600 0x7f537c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.794+0000 7f538dd9b640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f537c0047c0 0x7f537c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.794+0000 7f538e59c640 1 -- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f537c0047c0 msgr2=0x7f537c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:07.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.794+0000 7f538e59c640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f537c0047c0 0x7f537c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.794+0000 7f538e59c640 1 -- 172.21.15.91:0/4218743952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c003520 con 0x7f537c003970 2023-11-27T20:42:07.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.794+0000 7f538dd9b640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f537c0047c0 0x7f537c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:07.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.795+0000 7f538e59c640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f537c003970 0x7f537c003d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5380006fd0 tx=0x7f537c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80dad491ba0a3646 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:07.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.795+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380004230 con 0x7f537c003970 2023-11-27T20:42:07.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.795+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5380004390 con 0x7f537c003970 2023-11-27T20:42:07.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.795+0000 7f538d59a640 1 -- 172.21.15.91:0/4218743952 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380003830 con 0x7f537c003970 2023-11-27T20:42:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.796+0000 7f5394e1e640 1 -- 172.21.15.91:0/4218743952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f537c003970 msgr2=0x7f537c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.796+0000 7f5394e1e640 1 --2- 172.21.15.91:0/4218743952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f537c003970 0x7f537c003d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5380006fd0 tx=0x7f537c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.796+0000 7f538ed9d640 1 -- 172.21.15.91:0/4218743952 reap_dead start 2023-11-27T20:42:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.796+0000 7f5394e1e640 1 -- 172.21.15.91:0/4218743952 shutdown_connections 2023-11-27T20:42:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.796+0000 7f5394e1e640 1 -- 172.21.15.91:0/4218743952 >> 172.21.15.91:0/4218743952 conn(0x7f53900c7dc0 msgr2=0x7f53900c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.796+0000 7f5394e1e640 1 -- 172.21.15.91:0/4218743952 shutdown_connections 2023-11-27T20:42:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.796+0000 7f5394e1e640 1 -- 172.21.15.91:0/4218743952 wait complete. 2023-11-27T20:42:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.798+0000 7f5394e1e640 1 Processor -- start 2023-11-27T20:42:07.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.798+0000 7f5394e1e640 1 -- start start 2023-11-27T20:42:07.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f5394e1e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f537c003970 0x7f5390154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f5394e1e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53901538f0 0x7f53901486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f5394e1e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53901eb8d0 0x7f53901ebd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f5394e1e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5390153e60 con 0x7f53901eb8d0 2023-11-27T20:42:07.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f5394e1e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5390154140 con 0x7f53901538f0 2023-11-27T20:42:07.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f5394e1e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5390154420 con 0x7f537c003970 2023-11-27T20:42:07.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f538ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53901eb8d0 0x7f53901ebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f538ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53901eb8d0 0x7f53901ebd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58126/0 (socket says 172.21.15.91:58126) 2023-11-27T20:42:07.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f538ed9d640 1 -- 172.21.15.91:0/1761088081 learned_addr learned my addr 172.21.15.91:0/1761088081 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f538ed9d640 1 -- 172.21.15.91:0/1761088081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f537c003970 msgr2=0x7f5390154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f538ed9d640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f537c003970 0x7f5390154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f538ed9d640 1 -- 172.21.15.91:0/1761088081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53901538f0 msgr2=0x7f53901486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f538ed9d640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53901538f0 0x7f53901486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.799+0000 7f538ed9d640 1 -- 172.21.15.91:0/1761088081 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5390154700 con 0x7f53901eb8d0 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.800+0000 7f538ed9d640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53901eb8d0 0x7f53901ebd80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f53900c8ae0 tx=0x7f538800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.800+0000 7f5386ffd640 1 -- 172.21.15.91:0/1761088081 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800ed10 con 0x7f53901eb8d0 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.800+0000 7f5386ffd640 1 -- 172.21.15.91:0/1761088081 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538800ee90 con 0x7f53901eb8d0 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.800+0000 7f5386ffd640 1 -- 172.21.15.91:0/1761088081 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388014660 con 0x7f53901eb8d0 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.800+0000 7f5394e1e640 1 -- 172.21.15.91:0/1761088081 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53901549e0 con 0x7f53901eb8d0 2023-11-27T20:42:07.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.800+0000 7f5394e1e640 1 -- 172.21.15.91:0/1761088081 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5390156840 con 0x7f53901eb8d0 2023-11-27T20:42:07.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.801+0000 7f5394e1e640 1 -- 172.21.15.91:0/1761088081 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5390154bd0 con 0x7f53901eb8d0 2023-11-27T20:42:07.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.802+0000 7f5386ffd640 1 -- 172.21.15.91:0/1761088081 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f53880147c0 con 0x7f53901eb8d0 2023-11-27T20:42:07.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.803+0000 7f5386ffd640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f537006b1c0 0x7f537006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:07.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.803+0000 7f5386ffd640 1 -- 172.21.15.91:0/1761088081 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5388089e60 con 0x7f53901eb8d0 2023-11-27T20:42:07.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.803+0000 7f538e59c640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f537006b1c0 0x7f537006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:07.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.804+0000 7f538e59c640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f537006b1c0 0x7f537006d680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5380035000 tx=0x7f5380030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:07.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.807+0000 7f5386ffd640 1 -- 172.21.15.91:0/1761088081 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5388054b80 con 0x7f53901eb8d0 2023-11-27T20:42:07.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.997+0000 7f5394e1e640 1 -- 172.21.15.91:0/1761088081 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5390068350 con 0x7f53901eb8d0 2023-11-27T20:42:08.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:07.999+0000 7f5386ffd640 1 -- 172.21.15.91:0/1761088081 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f53880581a0 con 0x7f53901eb8d0 2023-11-27T20:42:08.001 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:08.001 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:08.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.001+0000 7f5394e1e640 1 -- 172.21.15.91:0/1761088081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f537006b1c0 msgr2=0x7f537006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.001+0000 7f5394e1e640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f537006b1c0 0x7f537006d680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5380035000 tx=0x7f5380030000 comp rx=0 tx=0).stop 2023-11-27T20:42:08.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.001+0000 7f5394e1e640 1 -- 172.21.15.91:0/1761088081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53901eb8d0 msgr2=0x7f53901ebd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.001+0000 7f5394e1e640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53901eb8d0 0x7f53901ebd80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f53900c8ae0 tx=0x7f538800e4b0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.002+0000 7f5394e1e640 1 -- 172.21.15.91:0/1761088081 shutdown_connections 2023-11-27T20:42:08.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.002+0000 7f5394e1e640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53901eb8d0 0x7f53901ebd80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.002+0000 7f5394e1e640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f537006b1c0 0x7f537006d680 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.002+0000 7f5394e1e640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53901538f0 0x7f53901486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.002+0000 7f5394e1e640 1 --2- 172.21.15.91:0/1761088081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f537c003970 0x7f5390154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.002+0000 7f5394e1e640 1 -- 172.21.15.91:0/1761088081 >> 172.21.15.91:0/1761088081 conn(0x7f53900c7dc0 msgr2=0x7f53901515b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:08.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.002+0000 7f5394e1e640 1 -- 172.21.15.91:0/1761088081 shutdown_connections 2023-11-27T20:42:08.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.002+0000 7f5394e1e640 1 -- 172.21.15.91:0/1761088081 wait complete. 2023-11-27T20:42:08.021 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:41:32.704555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:41:33.818847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:42:08.021 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:42:08.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.238+0000 7fba15026640 1 Processor -- start 2023-11-27T20:42:08.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.238+0000 7fba15026640 1 -- start start 2023-11-27T20:42:08.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba15026640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fba1014fd30 0x7fba10152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba15026640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fba1006d0a0 0x7fba100a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba15026640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba100c64a0 con 0x7fba100a5260 2023-11-27T20:42:08.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba15026640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100c5c00 con 0x7fba1006d0a0 2023-11-27T20:42:08.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba15026640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100c5ee0 con 0x7fba1014fd30 2023-11-27T20:42:08.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba0e59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fba1006d0a0 0x7fba100a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:08.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba0e59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fba1006d0a0 0x7fba100a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58138/0 (socket says 172.21.15.91:58138) 2023-11-27T20:42:08.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba0e59c640 1 -- 172.21.15.91:0/3689943375 learned_addr learned my addr 172.21.15.91:0/3689943375 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:08.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba0ed9d640 1 --2- 172.21.15.91:0/3689943375 >> v2:172.21.15.183:3300/0 conn(0x7fba1014fd30 0x7fba10152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:08.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba0e59c640 1 -- 172.21.15.91:0/3689943375 >> v2:172.21.15.183:3300/0 conn(0x7fba1014fd30 msgr2=0x7fba10152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:08.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba0e59c640 1 --2- 172.21.15.91:0/3689943375 >> v2:172.21.15.183:3300/0 conn(0x7fba1014fd30 0x7fba10152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.240+0000 7fba0e59c640 1 -- 172.21.15.91:0/3689943375 >> v1:172.21.15.183:6789/0 conn(0x7fba100a5260 legacy=0x7fba100c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:08.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.241+0000 7fba0e59c640 1 -- 172.21.15.91:0/3689943375 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100c61c0 con 0x7fba1006d0a0 2023-11-27T20:42:08.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.242+0000 7fba0e59c640 1 --2- 172.21.15.91:0/3689943375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 0x7fba100a4d20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fba1006b200 tx=0x7fba0402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b697a64a62639b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:08.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.242+0000 7fba0dd9b640 1 -- 172.21.15.91:0/3689943375 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04031870 con 0x7fba1006d0a0 2023-11-27T20:42:08.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.242+0000 7fba0dd9b640 1 -- 172.21.15.91:0/3689943375 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba040319d0 con 0x7fba1006d0a0 2023-11-27T20:42:08.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.242+0000 7fba0dd9b640 1 -- 172.21.15.91:0/3689943375 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04031d60 con 0x7fba1006d0a0 2023-11-27T20:42:08.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.242+0000 7fba15026640 1 -- 172.21.15.91:0/3689943375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 msgr2=0x7fba100a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.243+0000 7fba15026640 1 --2- 172.21.15.91:0/3689943375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 0x7fba100a4d20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fba1006b200 tx=0x7fba0402b910 comp rx=0 tx=0).stop 2023-11-27T20:42:08.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.243+0000 7fba15026640 1 -- 172.21.15.91:0/3689943375 shutdown_connections 2023-11-27T20:42:08.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.243+0000 7fba15026640 1 --2- 172.21.15.91:0/3689943375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 0x7fba100a4d20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.243+0000 7fba15026640 1 --2- 172.21.15.91:0/3689943375 >> v2:172.21.15.183:3300/0 conn(0x7fba1014fd30 0x7fba10152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.243+0000 7fba15026640 1 -- 172.21.15.91:0/3689943375 >> 172.21.15.91:0/3689943375 conn(0x7fba1006a500 msgr2=0x7fba1006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:08.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.243+0000 7fba15026640 1 -- 172.21.15.91:0/3689943375 shutdown_connections 2023-11-27T20:42:08.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.243+0000 7fba15026640 1 -- 172.21.15.91:0/3689943375 wait complete. 2023-11-27T20:42:08.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.244+0000 7fba15026640 1 Processor -- start 2023-11-27T20:42:08.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.245+0000 7fba15026640 1 -- start start 2023-11-27T20:42:08.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.245+0000 7fba15026640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 0x7fba100a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.245+0000 7fba15026640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba100a5260 0x7fba101edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.245+0000 7fba15026640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba1014fd30 0x7fba100bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.245+0000 7fba15026640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101dd060 con 0x7fba1006d0a0 2023-11-27T20:42:08.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.245+0000 7fba15026640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101ee050 con 0x7fba100a5260 2023-11-27T20:42:08.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.245+0000 7fba15026640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba101ea5a0 con 0x7fba1014fd30 2023-11-27T20:42:08.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.246+0000 7fba0ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 0x7fba100a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:08.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.246+0000 7fba0ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 0x7fba100a9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58142/0 (socket says 172.21.15.91:58142) 2023-11-27T20:42:08.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.246+0000 7fba0ed9d640 1 -- 172.21.15.91:0/3181469869 learned_addr learned my addr 172.21.15.91:0/3181469869 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.246+0000 7fba0ed9d640 1 -- 172.21.15.91:0/3181469869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba1014fd30 msgr2=0x7fba100bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.246+0000 7fba0ed9d640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba1014fd30 0x7fba100bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.246+0000 7fba0ed9d640 1 -- 172.21.15.91:0/3181469869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba100a5260 msgr2=0x7fba101edb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.246+0000 7fba0ed9d640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba100a5260 0x7fba101edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.246+0000 7fba0ed9d640 1 -- 172.21.15.91:0/3181469869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba040094d0 con 0x7fba1006d0a0 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.246+0000 7fba0ed9d640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 0x7fba100a9180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c7f0 tx=0x7fba0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.247+0000 7fb9f77fe640 1 -- 172.21.15.91:0/3181469869 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00004220 con 0x7fba1006d0a0 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.247+0000 7fb9f77fe640 1 -- 172.21.15.91:0/3181469869 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba00004380 con 0x7fba1006d0a0 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.247+0000 7fb9f77fe640 1 -- 172.21.15.91:0/3181469869 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00007860 con 0x7fba1006d0a0 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.247+0000 7fba15026640 1 -- 172.21.15.91:0/3181469869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba101ee2f0 con 0x7fba1006d0a0 2023-11-27T20:42:08.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.247+0000 7fba15026640 1 -- 172.21.15.91:0/3181469869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba101ee8b0 con 0x7fba1006d0a0 2023-11-27T20:42:08.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.248+0000 7fba15026640 1 -- 172.21.15.91:0/3181469869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba100a8900 con 0x7fba1006d0a0 2023-11-27T20:42:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.249+0000 7fb9f77fe640 1 -- 172.21.15.91:0/3181469869 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fba00007bd0 con 0x7fba1006d0a0 2023-11-27T20:42:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.250+0000 7fb9f77fe640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9fc06b1c0 0x7fb9fc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.250+0000 7fb9f77fe640 1 -- 172.21.15.91:0/3181469869 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba000898f0 con 0x7fba1006d0a0 2023-11-27T20:42:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.250+0000 7fba0e59c640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9fc06b1c0 0x7fb9fc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.251+0000 7fba0e59c640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9fc06b1c0 0x7fb9fc06d680 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fba04036000 tx=0x7fba04030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.254+0000 7fb9f77fe640 1 -- 172.21.15.91:0/3181469869 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fba000546b0 con 0x7fba1006d0a0 2023-11-27T20:42:08.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.450+0000 7fba15026640 1 -- 172.21.15.91:0/3181469869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba101531e0 con 0x7fba1006d0a0 2023-11-27T20:42:08.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.451+0000 7fb9f77fe640 1 -- 172.21.15.91:0/3181469869 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba00057cd0 con 0x7fba1006d0a0 2023-11-27T20:42:08.453 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:42:08.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 -- 172.21.15.91:0/3181469869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9fc06b1c0 msgr2=0x7fb9fc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9fc06b1c0 0x7fb9fc06d680 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fba04036000 tx=0x7fba04030000 comp rx=0 tx=0).stop 2023-11-27T20:42:08.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 -- 172.21.15.91:0/3181469869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 msgr2=0x7fba100a9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 0x7fba100a9180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c7f0 tx=0x7fba0000ccb0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 -- 172.21.15.91:0/3181469869 shutdown_connections 2023-11-27T20:42:08.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba1014fd30 0x7fba100bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9fc06b1c0 0x7fb9fc06d680 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba100a5260 0x7fba101edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 --2- 172.21.15.91:0/3181469869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba1006d0a0 0x7fba100a9180 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 -- 172.21.15.91:0/3181469869 >> 172.21.15.91:0/3181469869 conn(0x7fba1006a500 msgr2=0x7fba1006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:08.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 -- 172.21.15.91:0/3181469869 shutdown_connections 2023-11-27T20:42:08.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.454+0000 7fba15026640 1 -- 172.21.15.91:0/3181469869 wait complete. 2023-11-27T20:42:08.474 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:42:08.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.687+0000 7ff81ac4f640 1 Processor -- start 2023-11-27T20:42:08.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.688+0000 7ff81ac4f640 1 -- start start 2023-11-27T20:42:08.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.689+0000 7ff81ac4f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff81406b7d0 0x7ff81406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.689+0000 7ff81ac4f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8140bd8d0 con 0x7ff8140c7e90 2023-11-27T20:42:08.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.689+0000 7ff81ac4f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8140c6e60 con 0x7ff81414e810 2023-11-27T20:42:08.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.689+0000 7ff81ac4f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8140c70d0 con 0x7ff81406b7d0 2023-11-27T20:42:08.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.689+0000 7ff8191ec640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff81406b7d0 0x7ff81406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:08.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.689+0000 7ff80bfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff8140c7e90 0x7ff8140c4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54044/0 (socket says 172.21.15.91:54044) 2023-11-27T20:42:08.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.689+0000 7ff80bfff640 1 -- 172.21.15.91:0/835934700 learned_addr learned my addr 172.21.15.91:0/835934700 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:08.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.690+0000 7ff8191ec640 1 -- 172.21.15.91:0/835934700 >> v1:172.21.15.183:6789/0 conn(0x7ff81414e810 legacy=0x7ff8141550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:08.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.690+0000 7ff8191ec640 1 -- 172.21.15.91:0/835934700 >> v1:172.21.15.91:6789/0 conn(0x7ff8140c7e90 legacy=0x7ff8140c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.690+0000 7ff8191ec640 1 -- 172.21.15.91:0/835934700 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8140c73b0 con 0x7ff81406b7d0 2023-11-27T20:42:08.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.690+0000 7ff80b7fe640 1 -- 172.21.15.91:0/835934700 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846498403 0 0) 0x7ff8140bd8d0 con 0x7ff8140c7e90 2023-11-27T20:42:08.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.691+0000 7ff8191ec640 1 --2- 172.21.15.91:0/835934700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81406b7d0 0x7ff81406bc20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009d90 tx=0x7ff80c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c339e1ed8d5b2fe5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:08.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.691+0000 7ff80b7fe640 1 -- 172.21.15.91:0/835934700 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c02cbd0 con 0x7ff81406b7d0 2023-11-27T20:42:08.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.691+0000 7ff80b7fe640 1 -- 172.21.15.91:0/835934700 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c02cd30 con 0x7ff81406b7d0 2023-11-27T20:42:08.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.691+0000 7ff80b7fe640 1 -- 172.21.15.91:0/835934700 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c02cea0 con 0x7ff81406b7d0 2023-11-27T20:42:08.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.692+0000 7ff81ac4f640 1 -- 172.21.15.91:0/835934700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81406b7d0 msgr2=0x7ff81406bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.692+0000 7ff81ac4f640 1 --2- 172.21.15.91:0/835934700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81406b7d0 0x7ff81406bc20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009d90 tx=0x7ff80c02be20 comp rx=0 tx=0).stop 2023-11-27T20:42:08.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.692+0000 7ff81ac4f640 1 -- 172.21.15.91:0/835934700 shutdown_connections 2023-11-27T20:42:08.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.692+0000 7ff81ac4f640 1 --2- 172.21.15.91:0/835934700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81406b7d0 0x7ff81406bc20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.692+0000 7ff81ac4f640 1 -- 172.21.15.91:0/835934700 >> 172.21.15.91:0/835934700 conn(0x7ff8140ca170 msgr2=0x7ff8140ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:08.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.692+0000 7ff81ac4f640 1 -- 172.21.15.91:0/835934700 shutdown_connections 2023-11-27T20:42:08.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.692+0000 7ff81ac4f640 1 -- 172.21.15.91:0/835934700 wait complete. 2023-11-27T20:42:08.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.694+0000 7ff81ac4f640 1 Processor -- start 2023-11-27T20:42:08.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.694+0000 7ff81ac4f640 1 -- start start 2023-11-27T20:42:08.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff81ac4f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff81406b7d0 0x7ff8141ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff81ac4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140c7e90 0x7ff8141ecbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff81ac4f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81414e810 0x7ff8140c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff81ac4f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff814154dd0 con 0x7ff81414e810 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff81ac4f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141550b0 con 0x7ff81406b7d0 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff81ac4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff814155390 con 0x7ff8140c7e90 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff8191ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81414e810 0x7ff8140c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff8191ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81414e810 0x7ff8140c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58164/0 (socket says 172.21.15.91:58164) 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff8191ec640 1 -- 172.21.15.91:0/3279337546 learned_addr learned my addr 172.21.15.91:0/3279337546 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff8191ec640 1 -- 172.21.15.91:0/3279337546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140c7e90 msgr2=0x7ff8141ecbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff8191ec640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140c7e90 0x7ff8141ecbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff8191ec640 1 -- 172.21.15.91:0/3279337546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff81406b7d0 msgr2=0x7ff8141ec680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff8191ec640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff81406b7d0 0x7ff8141ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.695+0000 7ff8191ec640 1 -- 172.21.15.91:0/3279337546 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c009a70 con 0x7ff81414e810 2023-11-27T20:42:08.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.696+0000 7ff8191ec640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81414e810 0x7ff8140c3360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009d90 tx=0x7ff80c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:08.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.696+0000 7ff8097fa640 1 -- 172.21.15.91:0/3279337546 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c02cea0 con 0x7ff81414e810 2023-11-27T20:42:08.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.696+0000 7ff8097fa640 1 -- 172.21.15.91:0/3279337546 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c040450 con 0x7ff81414e810 2023-11-27T20:42:08.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.696+0000 7ff8097fa640 1 -- 172.21.15.91:0/3279337546 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0407e0 con 0x7ff81414e810 2023-11-27T20:42:08.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.696+0000 7ff81ac4f640 1 -- 172.21.15.91:0/3279337546 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8140c2b60 con 0x7ff81414e810 2023-11-27T20:42:08.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.696+0000 7ff81ac4f640 1 -- 172.21.15.91:0/3279337546 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff81406c790 con 0x7ff81414e810 2023-11-27T20:42:08.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.697+0000 7ff81ac4f640 1 -- 172.21.15.91:0/3279337546 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8140c3080 con 0x7ff81414e810 2023-11-27T20:42:08.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.698+0000 7ff8097fa640 1 -- 172.21.15.91:0/3279337546 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff80c040940 con 0x7ff81414e810 2023-11-27T20:42:08.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.699+0000 7ff8097fa640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff80006b1f0 0x7ff80006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:08.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.699+0000 7ff8097fa640 1 -- 172.21.15.91:0/3279337546 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff80c0abde0 con 0x7ff81414e810 2023-11-27T20:42:08.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.700+0000 7ff8189eb640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff80006b1f0 0x7ff80006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:08.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.700+0000 7ff8189eb640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff80006b1f0 0x7ff80006d6b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff810003cc0 tx=0x7ff8100079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:08.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.704+0000 7ff8097fa640 1 -- 172.21.15.91:0/3279337546 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff8140c3080 con 0x7ff81414e810 2023-11-27T20:42:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.893+0000 7ff81ac4f640 1 -- 172.21.15.91:0/3279337546 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8140c3080 con 0x7ff81414e810 2023-11-27T20:42:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.894+0000 7ff8097fa640 1 -- 172.21.15.91:0/3279337546 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8140c3080 con 0x7ff81414e810 2023-11-27T20:42:08.895 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:42:08.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.897+0000 7ff81ac4f640 1 -- 172.21.15.91:0/3279337546 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff80006b1f0 msgr2=0x7ff80006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.897+0000 7ff81ac4f640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff80006b1f0 0x7ff80006d6b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff810003cc0 tx=0x7ff8100079b0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.897+0000 7ff81ac4f640 1 -- 172.21.15.91:0/3279337546 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81414e810 msgr2=0x7ff8140c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:08.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.897+0000 7ff81ac4f640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81414e810 0x7ff8140c3360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009d90 tx=0x7ff80c004a40 comp rx=0 tx=0).stop 2023-11-27T20:42:08.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.897+0000 7ff81ac4f640 1 -- 172.21.15.91:0/3279337546 shutdown_connections 2023-11-27T20:42:08.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.897+0000 7ff81ac4f640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff81414e810 0x7ff8140c3360 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.897+0000 7ff81ac4f640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140c7e90 0x7ff8141ecbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.897+0000 7ff81ac4f640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff80006b1f0 0x7ff80006d6b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.897+0000 7ff81ac4f640 1 --2- 172.21.15.91:0/3279337546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff81406b7d0 0x7ff8141ec680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.897+0000 7ff81ac4f640 1 -- 172.21.15.91:0/3279337546 >> 172.21.15.91:0/3279337546 conn(0x7ff8140ca170 msgr2=0x7ff8140ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.898+0000 7ff81ac4f640 1 -- 172.21.15.91:0/3279337546 shutdown_connections 2023-11-27T20:42:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:08.898+0000 7ff81ac4f640 1 -- 172.21.15.91:0/3279337546 wait complete. 2023-11-27T20:42:08.918 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:42:09.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.126+0000 7fd67d49b640 1 Processor -- start 2023-11-27T20:42:09.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.126+0000 7fd67d49b640 1 -- start start 2023-11-27T20:42:09.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.128+0000 7fd67d49b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780724f0 0x7fd678154c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.128+0000 7fd67d49b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6780aadc0 con 0x7fd6780a5240 2023-11-27T20:42:09.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.128+0000 7fd67d49b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6780c4170 con 0x7fd6780c3bc0 2023-11-27T20:42:09.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.128+0000 7fd67d49b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd678151be0 con 0x7fd6780724f0 2023-11-27T20:42:09.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.128+0000 7fd676ffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd6780a5240 0x7fd6780c2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54056/0 (socket says 172.21.15.91:54056) 2023-11-27T20:42:09.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.128+0000 7fd676ffd640 1 -- 172.21.15.91:0/3932107819 learned_addr learned my addr 172.21.15.91:0/3932107819 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd6777fe640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780724f0 0x7fd678154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550491677 0 0) 0x7fd6780aadc0 con 0x7fd6780a5240 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd664003520 con 0x7fd6780a5240 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232696592 0 0) 0x7fd664003520 con 0x7fd6780a5240 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780724f0 msgr2=0x7fd678154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780724f0 0x7fd678154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 >> v1:172.21.15.183:6789/0 conn(0x7fd6780c3bc0 legacy=0x7fd678154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780c4450 con 0x7fd6780a5240 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fd6680019f0 con 0x7fd6780a5240 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 >> v1:172.21.15.91:6789/0 conn(0x7fd6780a5240 legacy=0x7fd6780c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6640039a0 0x7fd664003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780724f0 0x7fd6640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 0x7fd664005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66400cc70 con 0x7fd664004d00 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66400cde0 con 0x7fd6640039a0 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.129+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66400cfa0 con 0x7fd6780724f0 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.130+0000 7fd6777fe640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 0x7fd664005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.130+0000 7fd676ffd640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6640039a0 0x7fd664003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.130+0000 7fd6767fc640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780724f0 0x7fd6640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.130+0000 7fd6777fe640 1 -- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780724f0 msgr2=0x7fd6640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.130+0000 7fd6777fe640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780724f0 0x7fd6640047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.130+0000 7fd6777fe640 1 -- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6640039a0 msgr2=0x7fd664003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.130+0000 7fd6777fe640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6640039a0 0x7fd664003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.130+0000 7fd6777fe640 1 -- 172.21.15.91:0/3932107819 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd664003520 con 0x7fd664004d00 2023-11-27T20:42:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.131+0000 7fd6777fe640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 0x7fd664005180 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd67000ba30 tx=0x7fd6640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e6e4d1dbd7adf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.131+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670032640 con 0x7fd664004d00 2023-11-27T20:42:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.131+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6700327a0 con 0x7fd664004d00 2023-11-27T20:42:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.131+0000 7fd675ffb640 1 -- 172.21.15.91:0/3932107819 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670032b30 con 0x7fd664004d00 2023-11-27T20:42:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.132+0000 7fd67d49b640 1 -- 172.21.15.91:0/3932107819 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 msgr2=0x7fd664005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.132+0000 7fd67d49b640 1 --2- 172.21.15.91:0/3932107819 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 0x7fd664005180 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd67000ba30 tx=0x7fd6640057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.132+0000 7fd6777fe640 1 -- 172.21.15.91:0/3932107819 reap_dead start 2023-11-27T20:42:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.132+0000 7fd67d49b640 1 -- 172.21.15.91:0/3932107819 shutdown_connections 2023-11-27T20:42:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.132+0000 7fd67d49b640 1 -- 172.21.15.91:0/3932107819 >> 172.21.15.91:0/3932107819 conn(0x7fd67806a500 msgr2=0x7fd67806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:09.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.132+0000 7fd67d49b640 1 -- 172.21.15.91:0/3932107819 shutdown_connections 2023-11-27T20:42:09.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.132+0000 7fd67d49b640 1 -- 172.21.15.91:0/3932107819 wait complete. 2023-11-27T20:42:09.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.134+0000 7fd67d49b640 1 Processor -- start 2023-11-27T20:42:09.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.134+0000 7fd67d49b640 1 -- start start 2023-11-27T20:42:09.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd67d49b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 0x7fd678149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd67d49b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd678153da0 0x7fd6781e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd67d49b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6781e9ca0 0x7fd678147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd67d49b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd678071e60 con 0x7fd664004d00 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd67d49b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6781eccd0 con 0x7fd6781e9ca0 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd67d49b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6781ed850 con 0x7fd678153da0 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd676ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 0x7fd678149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd676ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 0x7fd678149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58178/0 (socket says 172.21.15.91:58178) 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd676ffd640 1 -- 172.21.15.91:0/315732858 learned_addr learned my addr 172.21.15.91:0/315732858 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd676ffd640 1 -- 172.21.15.91:0/315732858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd678153da0 msgr2=0x7fd6781e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd676ffd640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd678153da0 0x7fd6781e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd676ffd640 1 -- 172.21.15.91:0/315732858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6781e9ca0 msgr2=0x7fd678147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:09.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.135+0000 7fd676ffd640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6781e9ca0 0x7fd678147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.136+0000 7fd676ffd640 1 -- 172.21.15.91:0/315732858 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6781ecf20 con 0x7fd664004d00 2023-11-27T20:42:09.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.136+0000 7fd676ffd640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 0x7fd678149200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd668007a80 tx=0x7fd66800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:09.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.136+0000 7fd66f7fe640 1 -- 172.21.15.91:0/315732858 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66800ee30 con 0x7fd664004d00 2023-11-27T20:42:09.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.136+0000 7fd66f7fe640 1 -- 172.21.15.91:0/315732858 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd668013420 con 0x7fd664004d00 2023-11-27T20:42:09.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.136+0000 7fd66f7fe640 1 -- 172.21.15.91:0/315732858 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6680137b0 con 0x7fd664004d00 2023-11-27T20:42:09.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.136+0000 7fd67d49b640 1 -- 172.21.15.91:0/315732858 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6781ed200 con 0x7fd664004d00 2023-11-27T20:42:09.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.136+0000 7fd67d49b640 1 -- 172.21.15.91:0/315732858 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd678149740 con 0x7fd664004d00 2023-11-27T20:42:09.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.137+0000 7fd67d49b640 1 -- 172.21.15.91:0/315732858 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd678068350 con 0x7fd664004d00 2023-11-27T20:42:09.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.138+0000 7fd66f7fe640 1 -- 172.21.15.91:0/315732858 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd668013910 con 0x7fd664004d00 2023-11-27T20:42:09.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.139+0000 7fd66f7fe640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd65806b1c0 0x7fd65806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.139+0000 7fd66f7fe640 1 -- 172.21.15.91:0/315732858 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd66808a1a0 con 0x7fd664004d00 2023-11-27T20:42:09.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.139+0000 7fd6767fc640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd65806b1c0 0x7fd65806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.140+0000 7fd6767fc640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd65806b1c0 0x7fd65806d680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd678149bf0 tx=0x7fd660009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:09.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.143+0000 7fd66f7fe640 1 -- 172.21.15.91:0/315732858 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd668054ec0 con 0x7fd664004d00 2023-11-27T20:42:09.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.334+0000 7fd67d49b640 1 -- 172.21.15.91:0/315732858 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6780c6770 con 0x7fd664004d00 2023-11-27T20:42:09.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.335+0000 7fd66f7fe640 1 -- 172.21.15.91:0/315732858 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6680584e0 con 0x7fd664004d00 2023-11-27T20:42:09.336 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:42:09.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.337+0000 7fd67d49b640 1 -- 172.21.15.91:0/315732858 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd65806b1c0 msgr2=0x7fd65806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:09.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.337+0000 7fd67d49b640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd65806b1c0 0x7fd65806d680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd678149bf0 tx=0x7fd660009040 comp rx=0 tx=0).stop 2023-11-27T20:42:09.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.337+0000 7fd67d49b640 1 -- 172.21.15.91:0/315732858 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 msgr2=0x7fd678149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:09.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.337+0000 7fd67d49b640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 0x7fd678149200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd668007a80 tx=0x7fd66800e530 comp rx=0 tx=0).stop 2023-11-27T20:42:09.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.338+0000 7fd67d49b640 1 -- 172.21.15.91:0/315732858 shutdown_connections 2023-11-27T20:42:09.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.338+0000 7fd67d49b640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd65806b1c0 0x7fd65806d680 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.338+0000 7fd67d49b640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6781e9ca0 0x7fd678147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.338+0000 7fd67d49b640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd678153da0 0x7fd6781e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.338+0000 7fd67d49b640 1 --2- 172.21.15.91:0/315732858 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd664004d00 0x7fd678149200 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.338+0000 7fd67d49b640 1 -- 172.21.15.91:0/315732858 >> 172.21.15.91:0/315732858 conn(0x7fd67806a500 msgr2=0x7fd6780c4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:09.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.338+0000 7fd67d49b640 1 -- 172.21.15.91:0/315732858 shutdown_connections 2023-11-27T20:42:09.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.338+0000 7fd67d49b640 1 -- 172.21.15.91:0/315732858 wait complete. 2023-11-27T20:42:09.358 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-11-27T20:42:09.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.564+0000 7f182da09640 1 Processor -- start 2023-11-27T20:42:09.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.564+0000 7f182da09640 1 -- start start 2023-11-27T20:42:09.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.565+0000 7f182da09640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f18280a9b40 0x7f18280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.565+0000 7f182da09640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f18280c1500 0x7f18280c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.565+0000 7f182da09640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18280c06c0 con 0x7f1828155490 2023-11-27T20:42:09.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.565+0000 7f182da09640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18280a5820 con 0x7f18280c1500 2023-11-27T20:42:09.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.566+0000 7f182da09640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18280c1020 con 0x7f18280a9b40 2023-11-27T20:42:09.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.566+0000 7f18277fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f18280c1500 0x7f18280c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.566+0000 7f18277fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f18280c1500 0x7f18280c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58182/0 (socket says 172.21.15.91:58182) 2023-11-27T20:42:09.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.566+0000 7f18277fe640 1 -- 172.21.15.91:0/3480076677 learned_addr learned my addr 172.21.15.91:0/3480076677 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:09.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.566+0000 7f18267fc640 1 --2- 172.21.15.91:0/3480076677 >> v2:172.21.15.183:3300/0 conn(0x7f18280a9b40 0x7f18280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.566+0000 7f18277fe640 1 -- 172.21.15.91:0/3480076677 >> v2:172.21.15.183:3300/0 conn(0x7f18280a9b40 msgr2=0x7f18280a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:09.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.566+0000 7f18277fe640 1 --2- 172.21.15.91:0/3480076677 >> v2:172.21.15.183:3300/0 conn(0x7f18280a9b40 0x7f18280a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.566+0000 7f18277fe640 1 -- 172.21.15.91:0/3480076677 >> v1:172.21.15.183:6789/0 conn(0x7f1828155490 legacy=0x7f18280a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:09.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.566+0000 7f18277fe640 1 -- 172.21.15.91:0/3480076677 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280c0910 con 0x7f18280c1500 2023-11-27T20:42:09.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.567+0000 7f18277fe640 1 --2- 172.21.15.91:0/3480076677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18280c1500 0x7f18280c24d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f18280a5160 tx=0x7f182002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b6efdd51a0b5dc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:09.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f1825ffb640 1 -- 172.21.15.91:0/3480076677 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820031870 con 0x7f18280c1500 2023-11-27T20:42:09.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f1825ffb640 1 -- 172.21.15.91:0/3480076677 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18200319d0 con 0x7f18280c1500 2023-11-27T20:42:09.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f1825ffb640 1 -- 172.21.15.91:0/3480076677 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820031d60 con 0x7f18280c1500 2023-11-27T20:42:09.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f182da09640 1 -- 172.21.15.91:0/3480076677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18280c1500 msgr2=0x7f18280c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:09.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f182da09640 1 --2- 172.21.15.91:0/3480076677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18280c1500 0x7f18280c24d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f18280a5160 tx=0x7f182002b910 comp rx=0 tx=0).stop 2023-11-27T20:42:09.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f182da09640 1 -- 172.21.15.91:0/3480076677 shutdown_connections 2023-11-27T20:42:09.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f182da09640 1 --2- 172.21.15.91:0/3480076677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18280c1500 0x7f18280c24d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f182da09640 1 --2- 172.21.15.91:0/3480076677 >> v2:172.21.15.183:3300/0 conn(0x7f18280a9b40 0x7f18280a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f182da09640 1 -- 172.21.15.91:0/3480076677 >> 172.21.15.91:0/3480076677 conn(0x7f182806a500 msgr2=0x7f182806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:09.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f182da09640 1 -- 172.21.15.91:0/3480076677 shutdown_connections 2023-11-27T20:42:09.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.568+0000 7f182da09640 1 -- 172.21.15.91:0/3480076677 wait complete. 2023-11-27T20:42:09.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.570+0000 7f182da09640 1 Processor -- start 2023-11-27T20:42:09.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.570+0000 7f182da09640 1 -- start start 2023-11-27T20:42:09.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.571+0000 7f182da09640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18280c1500 0x7f1828147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.571+0000 7f182da09640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1828155490 0x7f18281eb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.571+0000 7f182da09640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18281ede50 0x7f1828145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.571+0000 7f182da09640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182815d7a0 con 0x7f1828155490 2023-11-27T20:42:09.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.571+0000 7f182da09640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18281527e0 con 0x7f18280c1500 2023-11-27T20:42:09.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.571+0000 7f182da09640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18281ed9c0 con 0x7f18281ede50 2023-11-27T20:42:09.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.571+0000 7f18267fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1828155490 0x7f18281eb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.571+0000 7f18267fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1828155490 0x7f18281eb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58188/0 (socket says 172.21.15.91:58188) 2023-11-27T20:42:09.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.571+0000 7f18267fc640 1 -- 172.21.15.91:0/1119246179 learned_addr learned my addr 172.21.15.91:0/1119246179 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:09.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f1826ffd640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18280c1500 0x7f1828147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f18277fe640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18281ede50 0x7f1828145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f18267fc640 1 -- 172.21.15.91:0/1119246179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18281ede50 msgr2=0x7f1828145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:09.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f18267fc640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18281ede50 0x7f1828145a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f18267fc640 1 -- 172.21.15.91:0/1119246179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18280c1500 msgr2=0x7f1828147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:09.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f18267fc640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18280c1500 0x7f1828147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:09.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f18267fc640 1 -- 172.21.15.91:0/1119246179 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200094d0 con 0x7f1828155490 2023-11-27T20:42:09.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f1826ffd640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18280c1500 0x7f1828147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:09.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f18267fc640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1828155490 0x7f18281eb0f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f181000c820 tx=0x7f181000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:09.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f181ffff640 1 -- 172.21.15.91:0/1119246179 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810004220 con 0x7f1828155490 2023-11-27T20:42:09.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f181ffff640 1 -- 172.21.15.91:0/1119246179 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18100043a0 con 0x7f1828155490 2023-11-27T20:42:09.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f181ffff640 1 -- 172.21.15.91:0/1119246179 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810007a70 con 0x7f1828155490 2023-11-27T20:42:09.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f182da09640 1 -- 172.21.15.91:0/1119246179 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1828152a30 con 0x7f1828155490 2023-11-27T20:42:09.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.572+0000 7f182da09640 1 -- 172.21.15.91:0/1119246179 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18281ed650 con 0x7f1828155490 2023-11-27T20:42:09.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.573+0000 7f182da09640 1 -- 172.21.15.91:0/1119246179 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18281edb50 con 0x7f1828155490 2023-11-27T20:42:09.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.574+0000 7f181ffff640 1 -- 172.21.15.91:0/1119246179 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1810007bd0 con 0x7f1828155490 2023-11-27T20:42:09.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.575+0000 7f181ffff640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f180806b1c0 0x7f180806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:09.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.575+0000 7f181ffff640 1 -- 172.21.15.91:0/1119246179 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1810089880 con 0x7f1828155490 2023-11-27T20:42:09.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.576+0000 7f1826ffd640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f180806b1c0 0x7f180806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:09.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.576+0000 7f1826ffd640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f180806b1c0 0x7f180806d680 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1818007eb0 tx=0x7f18180073c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:09.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.580+0000 7f181ffff640 1 -- 172.21.15.91:0/1119246179 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1810054510 con 0x7f1828155490 2023-11-27T20:42:09.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:09.845+0000 7f182da09640 1 -- 172.21.15.91:0/1119246179 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f1828068350 con 0x7f1828155490 2023-11-27T20:42:10.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.488+0000 7f181ffff640 1 -- 172.21.15.91:0/1119246179 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v57) v1 ==== 162+0+0 (secure 0 0 0) 0x7f181001e0e0 con 0x7f1828155490 2023-11-27T20:42:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.491+0000 7f182da09640 1 -- 172.21.15.91:0/1119246179 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f180806b1c0 msgr2=0x7f180806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.491+0000 7f182da09640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f180806b1c0 0x7f180806d680 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1818007eb0 tx=0x7f18180073c0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.491+0000 7f182da09640 1 -- 172.21.15.91:0/1119246179 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1828155490 msgr2=0x7f18281eb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.491+0000 7f182da09640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1828155490 0x7f18281eb0f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f181000c820 tx=0x7f181000cce0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.492+0000 7f182da09640 1 -- 172.21.15.91:0/1119246179 shutdown_connections 2023-11-27T20:42:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.492+0000 7f182da09640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18281ede50 0x7f1828145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.492+0000 7f182da09640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1828155490 0x7f18281eb0f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.492+0000 7f182da09640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f180806b1c0 0x7f180806d680 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.492+0000 7f182da09640 1 --2- 172.21.15.91:0/1119246179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18280c1500 0x7f1828147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.492+0000 7f182da09640 1 -- 172.21.15.91:0/1119246179 >> 172.21.15.91:0/1119246179 conn(0x7f182806a500 msgr2=0x7f182806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.492+0000 7f182da09640 1 -- 172.21.15.91:0/1119246179 shutdown_connections 2023-11-27T20:42:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.492+0000 7f182da09640 1 -- 172.21.15.91:0/1119246179 wait complete. 2023-11-27T20:42:10.515 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-27T20:42:10.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.726+0000 7fe17150f640 1 Processor -- start 2023-11-27T20:42:10.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.726+0000 7fe17150f640 1 -- start start 2023-11-27T20:42:10.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.728+0000 7fe17150f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe16c0a5240 0x7fe16c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:10.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.728+0000 7fe17150f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe16c0c3bc0 0x7fe16c154500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:10.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.728+0000 7fe17150f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16c0aadc0 con 0x7fe16c0c2c90 2023-11-27T20:42:10.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.728+0000 7fe17150f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c151be0 con 0x7fe16c0a5240 2023-11-27T20:42:10.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.728+0000 7fe17150f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c0c4170 con 0x7fe16c0c3bc0 2023-11-27T20:42:10.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.728+0000 7fe16affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe16c0a5240 0x7fe16c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:10.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.728+0000 7fe16affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe16c0a5240 0x7fe16c0c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58204/0 (socket says 172.21.15.91:58204) 2023-11-27T20:42:10.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.728+0000 7fe16affd640 1 -- 172.21.15.91:0/202190545 learned_addr learned my addr 172.21.15.91:0/202190545 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:10.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.729+0000 7fe163fff640 1 --2- 172.21.15.91:0/202190545 >> v2:172.21.15.183:3300/0 conn(0x7fe16c0c3bc0 0x7fe16c154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:10.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.729+0000 7fe16affd640 1 -- 172.21.15.91:0/202190545 >> v2:172.21.15.183:3300/0 conn(0x7fe16c0c3bc0 msgr2=0x7fe16c154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:10.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.729+0000 7fe16affd640 1 --2- 172.21.15.91:0/202190545 >> v2:172.21.15.183:3300/0 conn(0x7fe16c0c3bc0 0x7fe16c154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.729+0000 7fe16affd640 1 -- 172.21.15.91:0/202190545 >> v1:172.21.15.183:6789/0 conn(0x7fe16c0c2c90 legacy=0x7fe16c154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:10.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.729+0000 7fe16affd640 1 -- 172.21.15.91:0/202190545 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c0c4450 con 0x7fe16c0a5240 2023-11-27T20:42:10.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.730+0000 7fe16affd640 1 --2- 172.21.15.91:0/202190545 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0a5240 0x7fe16c0c2750 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0c5c90 tx=0x7fe15c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73b9ca9d868be39 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:10.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.730+0000 7fe16a7fc640 1 -- 172.21.15.91:0/202190545 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c0317e0 con 0x7fe16c0a5240 2023-11-27T20:42:10.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.730+0000 7fe16a7fc640 1 -- 172.21.15.91:0/202190545 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15c031940 con 0x7fe16c0a5240 2023-11-27T20:42:10.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.730+0000 7fe16a7fc640 1 -- 172.21.15.91:0/202190545 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c031cd0 con 0x7fe16c0a5240 2023-11-27T20:42:10.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.731+0000 7fe17150f640 1 -- 172.21.15.91:0/202190545 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0a5240 msgr2=0x7fe16c0c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:10.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.731+0000 7fe17150f640 1 --2- 172.21.15.91:0/202190545 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0a5240 0x7fe16c0c2750 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0c5c90 tx=0x7fe15c02b880 comp rx=0 tx=0).stop 2023-11-27T20:42:10.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.731+0000 7fe17150f640 1 -- 172.21.15.91:0/202190545 shutdown_connections 2023-11-27T20:42:10.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.731+0000 7fe17150f640 1 --2- 172.21.15.91:0/202190545 >> v2:172.21.15.183:3300/0 conn(0x7fe16c0c3bc0 0x7fe16c154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.731+0000 7fe17150f640 1 --2- 172.21.15.91:0/202190545 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0a5240 0x7fe16c0c2750 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.731+0000 7fe17150f640 1 -- 172.21.15.91:0/202190545 >> 172.21.15.91:0/202190545 conn(0x7fe16c06a500 msgr2=0x7fe16c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:10.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.731+0000 7fe17150f640 1 -- 172.21.15.91:0/202190545 shutdown_connections 2023-11-27T20:42:10.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.731+0000 7fe17150f640 1 -- 172.21.15.91:0/202190545 wait complete. 2023-11-27T20:42:10.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.732+0000 7fe17150f640 1 Processor -- start 2023-11-27T20:42:10.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.733+0000 7fe17150f640 1 -- start start 2023-11-27T20:42:10.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.733+0000 7fe17150f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe16c0a5240 0x7fe16c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:10.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.733+0000 7fe17150f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0c2c90 0x7fe16c0a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:10.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.733+0000 7fe17150f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe16c0c3bc0 0x7fe16c1495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:10.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe17150f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c1ee1a0 con 0x7fe16c0c2c90 2023-11-27T20:42:10.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe17150f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c14c270 con 0x7fe16c0c3bc0 2023-11-27T20:42:10.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe17150f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c148830 con 0x7fe16c0a5240 2023-11-27T20:42:10.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe163fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0c2c90 0x7fe16c0a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:10.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe163fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0c2c90 0x7fe16c0a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58220/0 (socket says 172.21.15.91:58220) 2023-11-27T20:42:10.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe163fff640 1 -- 172.21.15.91:0/164594263 learned_addr learned my addr 172.21.15.91:0/164594263 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:10.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe163fff640 1 -- 172.21.15.91:0/164594263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe16c0a5240 msgr2=0x7fe16c0a5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:10.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe163fff640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe16c0a5240 0x7fe16c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe163fff640 1 -- 172.21.15.91:0/164594263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe16c0c3bc0 msgr2=0x7fe16c1495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:10.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe163fff640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe16c0c3bc0 0x7fe16c1495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe163fff640 1 -- 172.21.15.91:0/164594263 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0094d0 con 0x7fe16c0c2c90 2023-11-27T20:42:10.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.734+0000 7fe163fff640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0c2c90 0x7fe16c0a8140 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe15400c7f0 tx=0x7fe15400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:10.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.735+0000 7fe1637fe640 1 -- 172.21.15.91:0/164594263 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154004220 con 0x7fe16c0c2c90 2023-11-27T20:42:10.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.735+0000 7fe1637fe640 1 -- 172.21.15.91:0/164594263 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe154004380 con 0x7fe16c0c2c90 2023-11-27T20:42:10.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.735+0000 7fe1637fe640 1 -- 172.21.15.91:0/164594263 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154007860 con 0x7fe16c0c2c90 2023-11-27T20:42:10.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.735+0000 7fe17150f640 1 -- 172.21.15.91:0/164594263 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c148b10 con 0x7fe16c0c2c90 2023-11-27T20:42:10.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.735+0000 7fe17150f640 1 -- 172.21.15.91:0/164594263 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c1490d0 con 0x7fe16c0c2c90 2023-11-27T20:42:10.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.736+0000 7fe17150f640 1 -- 172.21.15.91:0/164594263 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16c149290 con 0x7fe16c0c2c90 2023-11-27T20:42:10.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.737+0000 7fe1637fe640 1 -- 172.21.15.91:0/164594263 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe154007bd0 con 0x7fe16c0c2c90 2023-11-27T20:42:10.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.738+0000 7fe1637fe640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe14c06b1f0 0x7fe14c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:10.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.738+0000 7fe1637fe640 1 -- 172.21.15.91:0/164594263 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe154089910 con 0x7fe16c0c2c90 2023-11-27T20:42:10.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.738+0000 7fe16affd640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe14c06b1f0 0x7fe14c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:10.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.739+0000 7fe16affd640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe14c06b1f0 0x7fe14c06d6b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe15c036000 tx=0x7fe15c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:10.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.743+0000 7fe1637fe640 1 -- 172.21.15.91:0/164594263 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe154054630 con 0x7fe16c0c2c90 2023-11-27T20:42:10.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.930+0000 7fe17150f640 1 -- 172.21.15.91:0/164594263 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe16c072b80 con 0x7fe16c0c2c90 2023-11-27T20:42:10.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.937+0000 7fe1637fe640 1 -- 172.21.15.91:0/164594263 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe15401e020 con 0x7fe16c0c2c90 2023-11-27T20:42:10.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.939+0000 7fe17150f640 1 -- 172.21.15.91:0/164594263 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe14c06b1f0 msgr2=0x7fe14c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:10.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.939+0000 7fe17150f640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe14c06b1f0 0x7fe14c06d6b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe15c036000 tx=0x7fe15c030000 comp rx=0 tx=0).stop 2023-11-27T20:42:10.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.939+0000 7fe17150f640 1 -- 172.21.15.91:0/164594263 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0c2c90 msgr2=0x7fe16c0a8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:10.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.939+0000 7fe17150f640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0c2c90 0x7fe16c0a8140 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe15400c7f0 tx=0x7fe15400ccb0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.940+0000 7fe17150f640 1 -- 172.21.15.91:0/164594263 shutdown_connections 2023-11-27T20:42:10.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.940+0000 7fe17150f640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe14c06b1f0 0x7fe14c06d6b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.940+0000 7fe17150f640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe16c0c3bc0 0x7fe16c1495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.940+0000 7fe17150f640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0c2c90 0x7fe16c0a8140 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.940+0000 7fe17150f640 1 --2- 172.21.15.91:0/164594263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe16c0a5240 0x7fe16c0a5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:10.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.940+0000 7fe17150f640 1 -- 172.21.15.91:0/164594263 >> 172.21.15.91:0/164594263 conn(0x7fe16c06a500 msgr2=0x7fe16c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:10.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.940+0000 7fe17150f640 1 -- 172.21.15.91:0/164594263 shutdown_connections 2023-11-27T20:42:10.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:10.940+0000 7fe17150f640 1 -- 172.21.15.91:0/164594263 wait complete. 2023-11-27T20:42:10.960 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-27T20:42:10.960 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:42:11.073 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:42:11.203 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-27T20:42:11.203 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:42:11.203 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:42:11.260 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:42:11.260 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:42:11.311 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:42:11.311 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:42:11.413 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:11.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.623+0000 7fe0a6f8a640 1 Processor -- start 2023-11-27T20:42:11.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.624+0000 7fe0a6f8a640 1 -- start start 2023-11-27T20:42:11.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.625+0000 7fe0a6f8a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe0a00c5ec0 0x7fe0a00c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:11.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.625+0000 7fe0a6f8a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe0a00c45d0 0x7fe0a00c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:11.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.625+0000 7fe0a6f8a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a00bfdc0 con 0x7fe0a00721a0 2023-11-27T20:42:11.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.625+0000 7fe0a6f8a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a006e390 con 0x7fe0a00c5ec0 2023-11-27T20:42:11.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.625+0000 7fe0a6f8a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a006ddd0 con 0x7fe0a00c45d0 2023-11-27T20:42:11.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.625+0000 7fe0a5527640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fe0a00721a0 0x7fe0a0155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54064/0 (socket says 172.21.15.91:54064) 2023-11-27T20:42:11.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.625+0000 7fe0a4d26640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe0a00c5ec0 0x7fe0a00c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:11.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.625+0000 7fe0a5527640 1 -- 172.21.15.91:0/3380946356 learned_addr learned my addr 172.21.15.91:0/3380946356 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:11.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.626+0000 7fe09ffff640 1 --2- 172.21.15.91:0/3380946356 >> v2:172.21.15.183:3300/0 conn(0x7fe0a00c45d0 0x7fe0a00c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:11.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.626+0000 7fe09f7fe640 1 -- 172.21.15.91:0/3380946356 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647502390 0 0) 0x7fe0a00bfdc0 con 0x7fe0a00721a0 2023-11-27T20:42:11.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.626+0000 7fe09f7fe640 1 -- 172.21.15.91:0/3380946356 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe090003520 con 0x7fe0a00721a0 2023-11-27T20:42:11.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.626+0000 7fe0a4d26640 1 -- 172.21.15.91:0/3380946356 >> v2:172.21.15.183:3300/0 conn(0x7fe0a00c45d0 msgr2=0x7fe0a00c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:11.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.626+0000 7fe0a4d26640 1 --2- 172.21.15.91:0/3380946356 >> v2:172.21.15.183:3300/0 conn(0x7fe0a00c45d0 0x7fe0a00c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.626+0000 7fe0a4d26640 1 -- 172.21.15.91:0/3380946356 >> v1:172.21.15.91:6789/0 conn(0x7fe0a00721a0 legacy=0x7fe0a0155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:11.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.626+0000 7fe0a4d26640 1 -- 172.21.15.91:0/3380946356 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a006e0b0 con 0x7fe0a00c5ec0 2023-11-27T20:42:11.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.627+0000 7fe0a4d26640 1 --2- 172.21.15.91:0/3380946356 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00c5ec0 0x7fe0a00c2c30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe0a006b430 tx=0x7fe09402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37c5b2f649e1d78 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:11.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.627+0000 7fe09f7fe640 1 -- 172.21.15.91:0/3380946356 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094031520 con 0x7fe0a00c5ec0 2023-11-27T20:42:11.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.627+0000 7fe09f7fe640 1 -- 172.21.15.91:0/3380946356 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094031680 con 0x7fe0a00c5ec0 2023-11-27T20:42:11.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.627+0000 7fe09f7fe640 1 -- 172.21.15.91:0/3380946356 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094031a10 con 0x7fe0a00c5ec0 2023-11-27T20:42:11.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.628+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/3380946356 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00c5ec0 msgr2=0x7fe0a00c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:11.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.628+0000 7fe0a6f8a640 1 --2- 172.21.15.91:0/3380946356 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00c5ec0 0x7fe0a00c2c30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe0a006b430 tx=0x7fe09402b7c0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.628+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/3380946356 shutdown_connections 2023-11-27T20:42:11.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.628+0000 7fe0a6f8a640 1 --2- 172.21.15.91:0/3380946356 >> v2:172.21.15.183:3300/0 conn(0x7fe0a00c45d0 0x7fe0a00c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.628+0000 7fe0a6f8a640 1 --2- 172.21.15.91:0/3380946356 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00c5ec0 0x7fe0a00c2c30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.628+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/3380946356 >> 172.21.15.91:0/3380946356 conn(0x7fe0a006a500 msgr2=0x7fe0a006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:11.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.629+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/3380946356 shutdown_connections 2023-11-27T20:42:11.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.629+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/3380946356 wait complete. 2023-11-27T20:42:11.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.630+0000 7fe0a6f8a640 1 Processor -- start 2023-11-27T20:42:11.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.630+0000 7fe0a6f8a640 1 -- start start 2023-11-27T20:42:11.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.631+0000 7fe0a6f8a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00721a0 0x7fe0a01578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:11.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.631+0000 7fe0a6f8a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a00c45d0 0x7fe0a01eb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:11.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.631+0000 7fe0a6f8a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0a00c5ec0 0x7fe0a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:11.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.631+0000 7fe0a6f8a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0157df0 con 0x7fe0a00721a0 2023-11-27T20:42:11.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.631+0000 7fe0a6f8a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0156530 con 0x7fe0a00c5ec0 2023-11-27T20:42:11.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.631+0000 7fe0a6f8a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0156810 con 0x7fe0a00c45d0 2023-11-27T20:42:11.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.631+0000 7fe0a4d26640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00721a0 0x7fe0a01578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:11.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.631+0000 7fe0a4d26640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00721a0 0x7fe0a01578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58242/0 (socket says 172.21.15.91:58242) 2023-11-27T20:42:11.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe0a4d26640 1 -- 172.21.15.91:0/1250350121 learned_addr learned my addr 172.21.15.91:0/1250350121 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:11.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe0a4d26640 1 -- 172.21.15.91:0/1250350121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a00c45d0 msgr2=0x7fe0a01eb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:11.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe0a4d26640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a00c45d0 0x7fe0a01eb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe0a4d26640 1 -- 172.21.15.91:0/1250350121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0a00c5ec0 msgr2=0x7fe0a00a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:11.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe0a4d26640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0a00c5ec0 0x7fe0a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe0a4d26640 1 -- 172.21.15.91:0/1250350121 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094009400 con 0x7fe0a00721a0 2023-11-27T20:42:11.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe0a4d26640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00721a0 0x7fe0a01578b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe094000c00 tx=0x7fe0940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:11.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe09d7fa640 1 -- 172.21.15.91:0/1250350121 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094031520 con 0x7fe0a00721a0 2023-11-27T20:42:11.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe09d7fa640 1 -- 172.21.15.91:0/1250350121 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094033c70 con 0x7fe0a00721a0 2023-11-27T20:42:11.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe09d7fa640 1 -- 172.21.15.91:0/1250350121 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094006e10 con 0x7fe0a00721a0 2023-11-27T20:42:11.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.632+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/1250350121 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a0156af0 con 0x7fe0a00721a0 2023-11-27T20:42:11.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.633+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/1250350121 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a01570b0 con 0x7fe0a00721a0 2023-11-27T20:42:11.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.634+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/1250350121 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a0068350 con 0x7fe0a00721a0 2023-11-27T20:42:11.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.635+0000 7fe09d7fa640 1 -- 172.21.15.91:0/1250350121 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe09403a040 con 0x7fe0a00721a0 2023-11-27T20:42:11.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.635+0000 7fe09d7fa640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe08406b1c0 0x7fe08406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:11.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.636+0000 7fe09d7fa640 1 -- 172.21.15.91:0/1250350121 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0940ab180 con 0x7fe0a00721a0 2023-11-27T20:42:11.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.636+0000 7fe09ffff640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe08406b1c0 0x7fe08406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:11.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.637+0000 7fe09ffff640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe08406b1c0 0x7fe08406d680 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0151790 tx=0x7fe08c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:11.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.640+0000 7fe09d7fa640 1 -- 172.21.15.91:0/1250350121 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe094075f40 con 0x7fe0a00721a0 2023-11-27T20:42:11.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.829+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/1250350121 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0a00bf320 con 0x7fe0a00721a0 2023-11-27T20:42:11.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.832+0000 7fe09d7fa640 1 -- 172.21.15.91:0/1250350121 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fe094079560 con 0x7fe0a00721a0 2023-11-27T20:42:11.834 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:11.834 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:11.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/1250350121 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe08406b1c0 msgr2=0x7fe08406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:11.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe08406b1c0 0x7fe08406d680 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0151790 tx=0x7fe08c008040 comp rx=0 tx=0).stop 2023-11-27T20:42:11.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/1250350121 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00721a0 msgr2=0x7fe0a01578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:11.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00721a0 0x7fe0a01578b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe094000c00 tx=0x7fe0940046c0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/1250350121 shutdown_connections 2023-11-27T20:42:11.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe08406b1c0 0x7fe08406d680 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0a00c5ec0 0x7fe0a00a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a00c45d0 0x7fe0a01eb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 --2- 172.21.15.91:0/1250350121 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0a00721a0 0x7fe0a01578b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:11.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/1250350121 >> 172.21.15.91:0/1250350121 conn(0x7fe0a006a500 msgr2=0x7fe0a00c2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:11.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/1250350121 shutdown_connections 2023-11-27T20:42:11.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:11.835+0000 7fe0a6f8a640 1 -- 172.21.15.91:0/1250350121 wait complete. 2023-11-27T20:42:11.854 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:41:32.704555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:41:33.818847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:42:11.854 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:42:12.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.072+0000 7f2a103be640 1 Processor -- start 2023-11-27T20:42:12.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.072+0000 7f2a103be640 1 -- start start 2023-11-27T20:42:12.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.074+0000 7f2a103be640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2a080c6680 0x7f2a080c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.074+0000 7f2a103be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080c7950 0x7f2a080c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.074+0000 7f2a103be640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a080c4220 con 0x7f2a080a6bc0 2023-11-27T20:42:12.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.074+0000 7f2a103be640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a080c2e80 con 0x7f2a080c6680 2023-11-27T20:42:12.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.074+0000 7f2a103be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080c2ba0 con 0x7f2a080c7950 2023-11-27T20:42:12.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.075+0000 7f2a0e15a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2a080c6680 0x7f2a080c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.075+0000 7f2a0e95b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080c7950 0x7f2a080c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.075+0000 7f2a0e95b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080c7950 0x7f2a080c1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:35258/0 (socket says 172.21.15.91:35258) 2023-11-27T20:42:12.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.075+0000 7f2a0e95b640 1 -- 172.21.15.91:0/1859873628 learned_addr learned my addr 172.21.15.91:0/1859873628 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.075+0000 7f2a0e95b640 1 -- 172.21.15.91:0/1859873628 >> v2:172.21.15.183:3300/0 conn(0x7f2a080c6680 msgr2=0x7f2a080c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.075+0000 7f2a0e95b640 1 --2- 172.21.15.91:0/1859873628 >> v2:172.21.15.183:3300/0 conn(0x7f2a080c6680 0x7f2a080c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.075+0000 7f2a0e95b640 1 -- 172.21.15.91:0/1859873628 >> v1:172.21.15.183:6789/0 conn(0x7f2a080a6bc0 legacy=0x7f2a080c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.075+0000 7f2a0e95b640 1 -- 172.21.15.91:0/1859873628 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a080c32e0 con 0x7f2a080c7950 2023-11-27T20:42:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.075+0000 7f2a0e15a640 1 --2- 172.21.15.91:0/1859873628 >> v2:172.21.15.183:3300/0 conn(0x7f2a080c6680 0x7f2a080c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:42:12.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.077+0000 7f2a0e95b640 1 --2- 172.21.15.91:0/1859873628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080c7950 0x7f2a080c1ce0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009870 tx=0x7f2a0002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66dd8bfd1ad5dc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:12.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.077+0000 7f2a0d158640 1 -- 172.21.15.91:0/1859873628 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a000317c0 con 0x7f2a080c7950 2023-11-27T20:42:12.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.077+0000 7f2a0d158640 1 -- 172.21.15.91:0/1859873628 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a00031920 con 0x7f2a080c7950 2023-11-27T20:42:12.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.077+0000 7f2a0d158640 1 -- 172.21.15.91:0/1859873628 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00031cb0 con 0x7f2a080c7950 2023-11-27T20:42:12.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.078+0000 7f2a103be640 1 -- 172.21.15.91:0/1859873628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080c7950 msgr2=0x7f2a080c1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.078+0000 7f2a103be640 1 --2- 172.21.15.91:0/1859873628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080c7950 0x7f2a080c1ce0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009870 tx=0x7f2a0002b860 comp rx=0 tx=0).stop 2023-11-27T20:42:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.078+0000 7f2a103be640 1 -- 172.21.15.91:0/1859873628 shutdown_connections 2023-11-27T20:42:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.078+0000 7f2a103be640 1 --2- 172.21.15.91:0/1859873628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080c7950 0x7f2a080c1ce0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.078+0000 7f2a103be640 1 --2- 172.21.15.91:0/1859873628 >> v2:172.21.15.183:3300/0 conn(0x7f2a080c6680 0x7f2a080c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.078+0000 7f2a103be640 1 -- 172.21.15.91:0/1859873628 >> 172.21.15.91:0/1859873628 conn(0x7f2a080c7e30 msgr2=0x7f2a080c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.078+0000 7f2a103be640 1 -- 172.21.15.91:0/1859873628 shutdown_connections 2023-11-27T20:42:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.078+0000 7f2a103be640 1 -- 172.21.15.91:0/1859873628 wait complete. 2023-11-27T20:42:12.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.080+0000 7f2a103be640 1 Processor -- start 2023-11-27T20:42:12.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.081+0000 7f2a103be640 1 -- start start 2023-11-27T20:42:12.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a103be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080a6bc0 0x7f2a080a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a103be640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a080c6680 0x7f2a08146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a103be640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a080c7950 0x7f2a08153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a103be640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08152ac0 con 0x7f2a080c6680 2023-11-27T20:42:12.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a103be640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081568b0 con 0x7f2a080c7950 2023-11-27T20:42:12.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a103be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08156cd0 con 0x7f2a080a6bc0 2023-11-27T20:42:12.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a0d959640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a080c6680 0x7f2a08146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a0d959640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a080c6680 0x7f2a08146b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58252/0 (socket says 172.21.15.91:58252) 2023-11-27T20:42:12.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a0d959640 1 -- 172.21.15.91:0/1620139499 learned_addr learned my addr 172.21.15.91:0/1620139499 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a0e15a640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080a6bc0 0x7f2a080a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.082+0000 7f2a0e95b640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a080c7950 0x7f2a08153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a0d959640 1 -- 172.21.15.91:0/1620139499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080a6bc0 msgr2=0x7f2a080a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a0d959640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080a6bc0 0x7f2a080a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a0d959640 1 -- 172.21.15.91:0/1620139499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a080c7950 msgr2=0x7f2a08153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a0d959640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a080c7950 0x7f2a08153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a0d959640 1 -- 172.21.15.91:0/1620139499 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f8009a70 con 0x7f2a080c6680 2023-11-27T20:42:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a0d959640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a080c6680 0x7f2a08146b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00c400 tx=0x7f29fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:12.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a06ffd640 1 -- 172.21.15.91:0/1620139499 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0052d0 con 0x7f2a080c6680 2023-11-27T20:42:12.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a06ffd640 1 -- 172.21.15.91:0/1620139499 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc005430 con 0x7f2a080c6680 2023-11-27T20:42:12.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a06ffd640 1 -- 172.21.15.91:0/1620139499 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc003830 con 0x7f2a080c6680 2023-11-27T20:42:12.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a103be640 1 -- 172.21.15.91:0/1620139499 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a000094d0 con 0x7f2a080c6680 2023-11-27T20:42:12.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.083+0000 7f2a103be640 1 -- 172.21.15.91:0/1620139499 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a081ee560 con 0x7f2a080c6680 2023-11-27T20:42:12.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.085+0000 7f2a103be640 1 -- 172.21.15.91:0/1620139499 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a08156e90 con 0x7f2a080c6680 2023-11-27T20:42:12.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.086+0000 7f2a06ffd640 1 -- 172.21.15.91:0/1620139499 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f29fc003990 con 0x7f2a080c6680 2023-11-27T20:42:12.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.086+0000 7f2a06ffd640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f29f406b1c0 0x7f29f406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.086+0000 7f2a06ffd640 1 -- 172.21.15.91:0/1620139499 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29fc088d70 con 0x7f2a080c6680 2023-11-27T20:42:12.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.087+0000 7f2a0e15a640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f29f406b1c0 0x7f29f406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.087+0000 7f2a0e15a640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f29f406b1c0 0x7f29f406d680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29f8007560 tx=0x7f29f800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:12.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.091+0000 7f2a06ffd640 1 -- 172.21.15.91:0/1620139499 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f29fc053b30 con 0x7f2a080c6680 2023-11-27T20:42:12.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.280+0000 7f2a103be640 1 -- 172.21.15.91:0/1620139499 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a080c4220 con 0x7f2a080c6680 2023-11-27T20:42:12.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.282+0000 7f2a06ffd640 1 -- 172.21.15.91:0/1620139499 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a080c4220 con 0x7f2a080c6680 2023-11-27T20:42:12.283 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:42:12.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 -- 172.21.15.91:0/1620139499 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f29f406b1c0 msgr2=0x7f29f406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f29f406b1c0 0x7f29f406d680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29f8007560 tx=0x7f29f800b040 comp rx=0 tx=0).stop 2023-11-27T20:42:12.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 -- 172.21.15.91:0/1620139499 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a080c6680 msgr2=0x7f2a08146b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a080c6680 0x7f2a08146b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00c400 tx=0x7f29fc00c8c0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 -- 172.21.15.91:0/1620139499 shutdown_connections 2023-11-27T20:42:12.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f29f406b1c0 0x7f29f406d680 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a080c7950 0x7f2a08153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a080c6680 0x7f2a08146b80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 --2- 172.21.15.91:0/1620139499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a080a6bc0 0x7f2a080a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 -- 172.21.15.91:0/1620139499 >> 172.21.15.91:0/1620139499 conn(0x7f2a080c7e30 msgr2=0x7f2a08157c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:12.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 -- 172.21.15.91:0/1620139499 shutdown_connections 2023-11-27T20:42:12.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.284+0000 7f2a103be640 1 -- 172.21.15.91:0/1620139499 wait complete. 2023-11-27T20:42:12.304 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:42:12.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.517+0000 7fa6d8b6e640 1 Processor -- start 2023-11-27T20:42:12.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.517+0000 7fa6d8b6e640 1 -- start start 2023-11-27T20:42:12.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.518+0000 7fa6d8b6e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6d4155490 0x7fa6d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d8b6e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa6d40a9b40 0x7fa6d40c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d8b6e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d40c06c0 con 0x7fa6d40c1500 2023-11-27T20:42:12.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d8b6e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d40a5820 con 0x7fa6d40a9b40 2023-11-27T20:42:12.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d8b6e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40c1020 con 0x7fa6d4155490 2023-11-27T20:42:12.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6cbfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa6d40c1500 0x7fa6d40a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54066/0 (socket says 172.21.15.91:54066) 2023-11-27T20:42:12.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6cbfff640 1 -- 172.21.15.91:0/2592333538 learned_addr learned my addr 172.21.15.91:0/2592333538 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:12.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d2d9d640 1 --2- 172.21.15.91:0/2592333538 >> v2:172.21.15.91:3300/0 conn(0x7fa6d40a9b40 0x7fa6d40c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d1d9b640 1 -- 172.21.15.91:0/2592333538 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386536942 0 0) 0x7fa6d40c06c0 con 0x7fa6d40c1500 2023-11-27T20:42:12.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d259c640 1 --2- 172.21.15.91:0/2592333538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6d4155490 0x7fa6d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d2d9d640 1 -- 172.21.15.91:0/2592333538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6d4155490 msgr2=0x7fa6d40a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:12.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d2d9d640 1 --2- 172.21.15.91:0/2592333538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6d4155490 0x7fa6d40a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d2d9d640 1 -- 172.21.15.91:0/2592333538 >> v1:172.21.15.91:6789/0 conn(0x7fa6d40c1500 legacy=0x7fa6d40a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.519+0000 7fa6d2d9d640 1 -- 172.21.15.91:0/2592333538 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40c0910 con 0x7fa6d40a9b40 2023-11-27T20:42:12.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.521+0000 7fa6d2d9d640 1 --2- 172.21.15.91:0/2592333538 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40a9b40 0x7fa6d40c24d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009d90 tx=0x7fa6cc02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6399c96bfc882ba1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.521+0000 7fa6d1d9b640 1 -- 172.21.15.91:0/2592333538 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc02cc50 con 0x7fa6d40a9b40 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.521+0000 7fa6d1d9b640 1 -- 172.21.15.91:0/2592333538 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc02cdb0 con 0x7fa6d40a9b40 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.521+0000 7fa6d1d9b640 1 -- 172.21.15.91:0/2592333538 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc034660 con 0x7fa6d40a9b40 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.521+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2592333538 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40a9b40 msgr2=0x7fa6d40c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.521+0000 7fa6d8b6e640 1 --2- 172.21.15.91:0/2592333538 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40a9b40 0x7fa6d40c24d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009d90 tx=0x7fa6cc02bea0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.521+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2592333538 shutdown_connections 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.521+0000 7fa6d8b6e640 1 --2- 172.21.15.91:0/2592333538 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40a9b40 0x7fa6d40c24d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.521+0000 7fa6d8b6e640 1 --2- 172.21.15.91:0/2592333538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6d4155490 0x7fa6d40a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.521+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2592333538 >> 172.21.15.91:0/2592333538 conn(0x7fa6d406a500 msgr2=0x7fa6d406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.522+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2592333538 shutdown_connections 2023-11-27T20:42:12.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.522+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2592333538 wait complete. 2023-11-27T20:42:12.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.523+0000 7fa6d8b6e640 1 Processor -- start 2023-11-27T20:42:12.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.523+0000 7fa6d8b6e640 1 -- start start 2023-11-27T20:42:12.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.524+0000 7fa6d8b6e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40c1500 0x7fa6d4148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.524+0000 7fa6d8b6e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6d4155490 0x7fa6d4150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.524+0000 7fa6d8b6e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6d4071420 0x7fa6d41e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.524+0000 7fa6d8b6e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41edf30 con 0x7fa6d40c1500 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.524+0000 7fa6d8b6e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41eda00 con 0x7fa6d4071420 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.524+0000 7fa6d8b6e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41edc50 con 0x7fa6d4155490 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.525+0000 7fa6d259c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40c1500 0x7fa6d4148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.525+0000 7fa6d259c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40c1500 0x7fa6d4148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58260/0 (socket says 172.21.15.91:58260) 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.525+0000 7fa6d259c640 1 -- 172.21.15.91:0/2357867796 learned_addr learned my addr 172.21.15.91:0/2357867796 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.525+0000 7fa6d259c640 1 -- 172.21.15.91:0/2357867796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6d4155490 msgr2=0x7fa6d4150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.525+0000 7fa6d259c640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6d4155490 0x7fa6d4150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.525+0000 7fa6d259c640 1 -- 172.21.15.91:0/2357867796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6d4071420 msgr2=0x7fa6d41e9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.525+0000 7fa6d259c640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6d4071420 0x7fa6d41e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.525+0000 7fa6d259c640 1 -- 172.21.15.91:0/2357867796 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc009a70 con 0x7fa6d40c1500 2023-11-27T20:42:12.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.525+0000 7fa6d259c640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40c1500 0x7fa6d4148330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c820 tx=0x7fa6c400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:12.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.526+0000 7fa6caffd640 1 -- 172.21.15.91:0/2357867796 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4004020 con 0x7fa6d40c1500 2023-11-27T20:42:12.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.526+0000 7fa6caffd640 1 -- 172.21.15.91:0/2357867796 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4004180 con 0x7fa6d40c1500 2023-11-27T20:42:12.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.526+0000 7fa6caffd640 1 -- 172.21.15.91:0/2357867796 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4007830 con 0x7fa6d40c1500 2023-11-27T20:42:12.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.526+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2357867796 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d4149730 con 0x7fa6d40c1500 2023-11-27T20:42:12.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.526+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2357867796 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d4148870 con 0x7fa6d40c1500 2023-11-27T20:42:12.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.527+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2357867796 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d4149590 con 0x7fa6d40c1500 2023-11-27T20:42:12.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.528+0000 7fa6caffd640 1 -- 172.21.15.91:0/2357867796 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa6c4007990 con 0x7fa6d40c1500 2023-11-27T20:42:12.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.529+0000 7fa6caffd640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa6b406b1c0 0x7fa6b406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.529+0000 7fa6caffd640 1 -- 172.21.15.91:0/2357867796 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6c4089680 con 0x7fa6d40c1500 2023-11-27T20:42:12.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.529+0000 7fa6cbfff640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa6b406b1c0 0x7fa6b406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.529+0000 7fa6cbfff640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa6b406b1c0 0x7fa6b406d680 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0011e0 tx=0x7fa6bc007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:12.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.533+0000 7fa6caffd640 1 -- 172.21.15.91:0/2357867796 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa6d4149590 con 0x7fa6d40c1500 2023-11-27T20:42:12.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.724+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2357867796 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6d4149c50 con 0x7fa6d40c1500 2023-11-27T20:42:12.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.725+0000 7fa6caffd640 1 -- 172.21.15.91:0/2357867796 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6d4149c50 con 0x7fa6d40c1500 2023-11-27T20:42:12.727 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:42:12.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2357867796 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa6b406b1c0 msgr2=0x7fa6b406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa6b406b1c0 0x7fa6b406d680 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0011e0 tx=0x7fa6bc007940 comp rx=0 tx=0).stop 2023-11-27T20:42:12.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2357867796 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40c1500 msgr2=0x7fa6d4148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40c1500 0x7fa6d4148330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c820 tx=0x7fa6c400cce0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2357867796 shutdown_connections 2023-11-27T20:42:12.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa6b406b1c0 0x7fa6b406d680 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6d4071420 0x7fa6d41e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6d4155490 0x7fa6d4150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 --2- 172.21.15.91:0/2357867796 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d40c1500 0x7fa6d4148330 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2357867796 >> 172.21.15.91:0/2357867796 conn(0x7fa6d406a500 msgr2=0x7fa6d40c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:12.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.728+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2357867796 shutdown_connections 2023-11-27T20:42:12.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.729+0000 7fa6d8b6e640 1 -- 172.21.15.91:0/2357867796 wait complete. 2023-11-27T20:42:12.747 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:42:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.964+0000 7fc3b0753640 1 Processor -- start 2023-11-27T20:42:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.964+0000 7fc3b0753640 1 -- start start 2023-11-27T20:42:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.966+0000 7fc3b0753640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc3a80c1500 0x7fc3a80c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.966+0000 7fc3b0753640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a80c06c0 con 0x7fc3a80a9b40 2023-11-27T20:42:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.966+0000 7fc3b0753640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a80c1020 con 0x7fc3a8155490 2023-11-27T20:42:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.966+0000 7fc3b0753640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a80a5820 con 0x7fc3a80c1500 2023-11-27T20:42:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.966+0000 7fc3adcee640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fc3a80a9b40 0x7fc3a80c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54074/0 (socket says 172.21.15.91:54074) 2023-11-27T20:42:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.966+0000 7fc3adcee640 1 -- 172.21.15.91:0/4139250262 learned_addr learned my addr 172.21.15.91:0/4139250262 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.966+0000 7fc3aecf0640 1 --2- 172.21.15.91:0/4139250262 >> v2:172.21.15.183:3300/0 conn(0x7fc3a80c1500 0x7fc3a80c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.966+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214633333 0 0) 0x7fc3a80c06c0 con 0x7fc3a80a9b40 2023-11-27T20:42:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc394003520 con 0x7fc3a80a9b40 2023-11-27T20:42:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2000760674 0 0) 0x7fc394003520 con 0x7fc3a80a9b40 2023-11-27T20:42:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 >> v2:172.21.15.183:3300/0 conn(0x7fc3a80c1500 msgr2=0x7fc3a80c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 --2- 172.21.15.91:0/4139250262 >> v2:172.21.15.183:3300/0 conn(0x7fc3a80c1500 0x7fc3a80c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 >> v1:172.21.15.183:6789/0 conn(0x7fc3a8155490 legacy=0x7fc3a80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a80c0910 con 0x7fc3a80a9b40 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fc398001670 con 0x7fc3a80a9b40 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 >> v1:172.21.15.91:6789/0 conn(0x7fc3a80a9b40 legacy=0x7fc3a80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc394003970 0x7fc394003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3940047c0 0x7fc394004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc394005180 0x7fc39400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39400bff0 con 0x7fc394003970 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39400c160 con 0x7fc3940047c0 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39400c320 con 0x7fc394005180 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.967+0000 7fc3ae4ef640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc394003970 0x7fc394003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.968+0000 7fc3adcee640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3940047c0 0x7fc394004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.968+0000 7fc3aecf0640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc394005180 0x7fc39400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.968+0000 7fc3ae4ef640 1 -- 172.21.15.91:0/4139250262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc394005180 msgr2=0x7fc39400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.968+0000 7fc3ae4ef640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc394005180 0x7fc39400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.968+0000 7fc3ae4ef640 1 -- 172.21.15.91:0/4139250262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3940047c0 msgr2=0x7fc394004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.968+0000 7fc3ae4ef640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3940047c0 0x7fc394004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.968+0000 7fc3ae4ef640 1 -- 172.21.15.91:0/4139250262 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394003520 con 0x7fc394003970 2023-11-27T20:42:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.968+0000 7fc3aecf0640 1 -- 172.21.15.91:0/4139250262 reap_dead start 2023-11-27T20:42:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.969+0000 7fc3ae4ef640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc394003970 0x7fc394003d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4001750 tx=0x7fc3940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b82eefc54370eb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.969+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40052d0 con 0x7fc394003970 2023-11-27T20:42:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.969+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a402e050 con 0x7fc394003970 2023-11-27T20:42:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.969+0000 7fc3ad4ed640 1 -- 172.21.15.91:0/4139250262 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4003830 con 0x7fc394003970 2023-11-27T20:42:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.970+0000 7fc3b0753640 1 -- 172.21.15.91:0/4139250262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc394003970 msgr2=0x7fc394003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.970+0000 7fc3b0753640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc394003970 0x7fc394003d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4001750 tx=0x7fc3940057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.970+0000 7fc3b0753640 1 -- 172.21.15.91:0/4139250262 shutdown_connections 2023-11-27T20:42:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.970+0000 7fc3b0753640 1 --2- 172.21.15.91:0/4139250262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc394003970 0x7fc394003d90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.970+0000 7fc3b0753640 1 -- 172.21.15.91:0/4139250262 >> 172.21.15.91:0/4139250262 conn(0x7fc3a806a500 msgr2=0x7fc3a806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.970+0000 7fc3b0753640 1 -- 172.21.15.91:0/4139250262 shutdown_connections 2023-11-27T20:42:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.970+0000 7fc3b0753640 1 -- 172.21.15.91:0/4139250262 wait complete. 2023-11-27T20:42:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.972+0000 7fc3b0753640 1 Processor -- start 2023-11-27T20:42:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.972+0000 7fc3b0753640 1 -- start start 2023-11-27T20:42:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3b0753640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc394003970 0x7fc3a8151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3b0753640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a8150ad0 0x7fc3a8150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3b0753640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3a81ece50 0x7fc3a81ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3b0753640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a81eab50 con 0x7fc3a81ece50 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3b0753640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a8151c70 con 0x7fc3a8150ad0 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3b0753640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a8151470 con 0x7fc394003970 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3aecf0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3a81ece50 0x7fc3a81ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3aecf0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3a81ece50 0x7fc3a81ed2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58274/0 (socket says 172.21.15.91:58274) 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3aecf0640 1 -- 172.21.15.91:0/1283271247 learned_addr learned my addr 172.21.15.91:0/1283271247 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3adcee640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a8150ad0 0x7fc3a8150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3aecf0640 1 -- 172.21.15.91:0/1283271247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc394003970 msgr2=0x7fc3a8151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3aecf0640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc394003970 0x7fc3a8151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3aecf0640 1 -- 172.21.15.91:0/1283271247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a8150ad0 msgr2=0x7fc3a8150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3aecf0640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a8150ad0 0x7fc3a8150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.973+0000 7fc3aecf0640 1 -- 172.21.15.91:0/1283271247 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8099f60 con 0x7fc3a81ece50 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.974+0000 7fc3aecf0640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3a81ece50 0x7fc3a81ed2d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80c1950 tx=0x7fc3a000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.974+0000 7fc39effd640 1 -- 172.21.15.91:0/1283271247 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a001a070 con 0x7fc3a81ece50 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.974+0000 7fc39effd640 1 -- 172.21.15.91:0/1283271247 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a000fe50 con 0x7fc3a81ece50 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.974+0000 7fc3b0753640 1 -- 172.21.15.91:0/1283271247 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a809a240 con 0x7fc3a81ece50 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.974+0000 7fc39effd640 1 -- 172.21.15.91:0/1283271247 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0003bb0 con 0x7fc3a81ece50 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.974+0000 7fc3b0753640 1 -- 172.21.15.91:0/1283271247 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a80c5280 con 0x7fc3a81ece50 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.975+0000 7fc3b0753640 1 -- 172.21.15.91:0/1283271247 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a8068350 con 0x7fc3a81ece50 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.976+0000 7fc39effd640 1 -- 172.21.15.91:0/1283271247 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc3a0016420 con 0x7fc3a81ece50 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.978+0000 7fc39effd640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc38c06b1f0 0x7fc38c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.978+0000 7fc39effd640 1 -- 172.21.15.91:0/1283271247 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3a008a300 con 0x7fc3a81ece50 2023-11-27T20:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.978+0000 7fc3ae4ef640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc38c06b1f0 0x7fc38c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.979+0000 7fc3ae4ef640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc38c06b1f0 0x7fc38c06d6b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4033000 tx=0x7fc3a402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:12.982+0000 7fc39effd640 1 -- 172.21.15.91:0/1283271247 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc3a0055020 con 0x7fc3a81ece50 2023-11-27T20:42:13.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.173+0000 7fc3b0753640 1 -- 172.21.15.91:0/1283271247 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3a806b510 con 0x7fc3a81ece50 2023-11-27T20:42:13.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.174+0000 7fc39effd640 1 -- 172.21.15.91:0/1283271247 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3a0058640 con 0x7fc3a81ece50 2023-11-27T20:42:13.175 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:42:13.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.176+0000 7fc3b0753640 1 -- 172.21.15.91:0/1283271247 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc38c06b1f0 msgr2=0x7fc38c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:13.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.176+0000 7fc3b0753640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc38c06b1f0 0x7fc38c06d6b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4033000 tx=0x7fc3a402f000 comp rx=0 tx=0).stop 2023-11-27T20:42:13.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.176+0000 7fc3b0753640 1 -- 172.21.15.91:0/1283271247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3a81ece50 msgr2=0x7fc3a81ed2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:13.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.176+0000 7fc3b0753640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3a81ece50 0x7fc3a81ed2d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80c1950 tx=0x7fc3a000f520 comp rx=0 tx=0).stop 2023-11-27T20:42:13.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.177+0000 7fc3b0753640 1 -- 172.21.15.91:0/1283271247 shutdown_connections 2023-11-27T20:42:13.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.177+0000 7fc3b0753640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3a81ece50 0x7fc3a81ed2d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.177+0000 7fc3b0753640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc38c06b1f0 0x7fc38c06d6b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.177+0000 7fc3b0753640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a8150ad0 0x7fc3a8150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.177+0000 7fc3b0753640 1 --2- 172.21.15.91:0/1283271247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc394003970 0x7fc3a8151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.177+0000 7fc3b0753640 1 -- 172.21.15.91:0/1283271247 >> 172.21.15.91:0/1283271247 conn(0x7fc3a806a500 msgr2=0x7fc3a80c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:13.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.177+0000 7fc3b0753640 1 -- 172.21.15.91:0/1283271247 shutdown_connections 2023-11-27T20:42:13.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.177+0000 7fc3b0753640 1 -- 172.21.15.91:0/1283271247 wait complete. 2023-11-27T20:42:13.196 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:42:13.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.398+0000 7f70b759e640 1 Processor -- start 2023-11-27T20:42:13.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.398+0000 7f70b759e640 1 -- start start 2023-11-27T20:42:13.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.399+0000 7f70b759e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f70b814e7f0 0x7f70b80c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:13.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.399+0000 7f70b759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f70b80c52e0 0x7f70b806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:13.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70b759e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b80a8380 con 0x7f70b806cd20 2023-11-27T20:42:13.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70b759e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b81510b0 con 0x7f70b80c52e0 2023-11-27T20:42:13.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70b759e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b806bf60 con 0x7f70b814e7f0 2023-11-27T20:42:13.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70affff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f70b80c52e0 0x7f70b806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:13.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70affff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f70b80c52e0 0x7f70b806d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58278/0 (socket says 172.21.15.91:58278) 2023-11-27T20:42:13.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70affff640 1 -- 172.21.15.91:0/1793499668 learned_addr learned my addr 172.21.15.91:0/1793499668 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:13.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70b659c640 1 --2- 172.21.15.91:0/1793499668 >> v2:172.21.15.183:3300/0 conn(0x7f70b814e7f0 0x7f70b80c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:13.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70affff640 1 -- 172.21.15.91:0/1793499668 >> v2:172.21.15.183:3300/0 conn(0x7f70b814e7f0 msgr2=0x7f70b80c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:13.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70affff640 1 --2- 172.21.15.91:0/1793499668 >> v2:172.21.15.183:3300/0 conn(0x7f70b814e7f0 0x7f70b80c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70affff640 1 -- 172.21.15.91:0/1793499668 >> v1:172.21.15.183:6789/0 conn(0x7f70b806cd20 legacy=0x7f70b81546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:13.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.400+0000 7f70affff640 1 -- 172.21.15.91:0/1793499668 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b806c240 con 0x7f70b80c52e0 2023-11-27T20:42:13.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.401+0000 7f70affff640 1 --2- 172.21.15.91:0/1793499668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 0x7f70b806d1e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70b8067910 tx=0x7f70a002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2808406fcb6033e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:13.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.402+0000 7f70b5d9b640 1 -- 172.21.15.91:0/1793499668 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a00317e0 con 0x7f70b80c52e0 2023-11-27T20:42:13.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.402+0000 7f70b5d9b640 1 -- 172.21.15.91:0/1793499668 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a0031940 con 0x7f70b80c52e0 2023-11-27T20:42:13.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.402+0000 7f70b5d9b640 1 -- 172.21.15.91:0/1793499668 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0031cd0 con 0x7f70b80c52e0 2023-11-27T20:42:13.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.402+0000 7f70b759e640 1 -- 172.21.15.91:0/1793499668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 msgr2=0x7f70b806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:13.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.402+0000 7f70b759e640 1 --2- 172.21.15.91:0/1793499668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 0x7f70b806d1e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70b8067910 tx=0x7f70a002b880 comp rx=0 tx=0).stop 2023-11-27T20:42:13.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.403+0000 7f70b759e640 1 -- 172.21.15.91:0/1793499668 shutdown_connections 2023-11-27T20:42:13.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.403+0000 7f70b759e640 1 --2- 172.21.15.91:0/1793499668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 0x7f70b806d1e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.403+0000 7f70b759e640 1 --2- 172.21.15.91:0/1793499668 >> v2:172.21.15.183:3300/0 conn(0x7f70b814e7f0 0x7f70b80c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.403+0000 7f70b759e640 1 -- 172.21.15.91:0/1793499668 >> 172.21.15.91:0/1793499668 conn(0x7f70b80a77f0 msgr2=0x7f70b80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:13.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.403+0000 7f70b759e640 1 -- 172.21.15.91:0/1793499668 shutdown_connections 2023-11-27T20:42:13.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.403+0000 7f70b759e640 1 -- 172.21.15.91:0/1793499668 wait complete. 2023-11-27T20:42:13.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.405+0000 7f70b759e640 1 Processor -- start 2023-11-27T20:42:13.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.405+0000 7f70b759e640 1 -- start start 2023-11-27T20:42:13.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70b759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70b806cd20 0x7f70b81507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:13.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70b759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 0x7f70b8147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:13.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70b759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70b814e7f0 0x7f70b8148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:13.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70b759e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b814c670 con 0x7f70b80c52e0 2023-11-27T20:42:13.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70b759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8070980 con 0x7f70b814e7f0 2023-11-27T20:42:13.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70b759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b814c8c0 con 0x7f70b806cd20 2023-11-27T20:42:13.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70affff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 0x7f70b8147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:13.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70affff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 0x7f70b8147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58288/0 (socket says 172.21.15.91:58288) 2023-11-27T20:42:13.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70affff640 1 -- 172.21.15.91:0/2591127720 learned_addr learned my addr 172.21.15.91:0/2591127720 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:13.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70b659c640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70b806cd20 0x7f70b81507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:13.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70affff640 1 -- 172.21.15.91:0/2591127720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70b806cd20 msgr2=0x7f70b81507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:13.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70affff640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70b806cd20 0x7f70b81507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70affff640 1 -- 172.21.15.91:0/2591127720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70b814e7f0 msgr2=0x7f70b8148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:13.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70affff640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70b814e7f0 0x7f70b8148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.406+0000 7f70affff640 1 -- 172.21.15.91:0/2591127720 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00094d0 con 0x7f70b80c52e0 2023-11-27T20:42:13.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.407+0000 7f70affff640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 0x7f70b8147b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f70a0000c00 tx=0x7f70a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:13.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.407+0000 7f70aeffd640 1 -- 172.21.15.91:0/2591127720 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0032980 con 0x7f70b80c52e0 2023-11-27T20:42:13.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.407+0000 7f70aeffd640 1 -- 172.21.15.91:0/2591127720 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a0032ae0 con 0x7f70b80c52e0 2023-11-27T20:42:13.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.407+0000 7f70aeffd640 1 -- 172.21.15.91:0/2591127720 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0032e90 con 0x7f70b80c52e0 2023-11-27T20:42:13.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.407+0000 7f70b759e640 1 -- 172.21.15.91:0/2591127720 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b814cba0 con 0x7f70b80c52e0 2023-11-27T20:42:13.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.407+0000 7f70b759e640 1 -- 172.21.15.91:0/2591127720 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b8148590 con 0x7f70b80c52e0 2023-11-27T20:42:13.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.408+0000 7f70b759e640 1 -- 172.21.15.91:0/2591127720 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b814ca00 con 0x7f70b80c52e0 2023-11-27T20:42:13.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.409+0000 7f70aeffd640 1 -- 172.21.15.91:0/2591127720 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f70a004d3f0 con 0x7f70b80c52e0 2023-11-27T20:42:13.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.410+0000 7f70aeffd640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f709806b1c0 0x7f709806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:13.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.410+0000 7f70aeffd640 1 -- 172.21.15.91:0/2591127720 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70a00abad0 con 0x7f70b80c52e0 2023-11-27T20:42:13.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.411+0000 7f70b659c640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f709806b1c0 0x7f709806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:13.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.411+0000 7f70b659c640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f709806b1c0 0x7f709806d680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f70a800b7c0 tx=0x7f70a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:13.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.415+0000 7f70aeffd640 1 -- 172.21.15.91:0/2591127720 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f70b814ca00 con 0x7f70b80c52e0 2023-11-27T20:42:13.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.622+0000 7f70b759e640 1 -- 172.21.15.91:0/2591127720 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f70b814ca00 con 0x7f70b80c52e0 2023-11-27T20:42:13.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.622+0000 7f70aeffd640 1 -- 172.21.15.91:0/2591127720 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f70b814ca00 con 0x7f70b80c52e0 2023-11-27T20:42:13.624 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:42:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.625+0000 7f70b759e640 1 -- 172.21.15.91:0/2591127720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f709806b1c0 msgr2=0x7f709806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.625+0000 7f70b759e640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f709806b1c0 0x7f709806d680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f70a800b7c0 tx=0x7f70a8008040 comp rx=0 tx=0).stop 2023-11-27T20:42:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.625+0000 7f70b759e640 1 -- 172.21.15.91:0/2591127720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 msgr2=0x7f70b8147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.625+0000 7f70b759e640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 0x7f70b8147b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f70a0000c00 tx=0x7f70a00046c0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.625+0000 7f70b759e640 1 -- 172.21.15.91:0/2591127720 shutdown_connections 2023-11-27T20:42:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.625+0000 7f70b759e640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f709806b1c0 0x7f709806d680 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.625+0000 7f70b759e640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70b814e7f0 0x7f70b8148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.625+0000 7f70b759e640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70b80c52e0 0x7f70b8147b10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.625+0000 7f70b759e640 1 --2- 172.21.15.91:0/2591127720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70b806cd20 0x7f70b81507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:13.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.625+0000 7f70b759e640 1 -- 172.21.15.91:0/2591127720 >> 172.21.15.91:0/2591127720 conn(0x7f70b80a77f0 msgr2=0x7f70b80662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:13.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.626+0000 7f70b759e640 1 -- 172.21.15.91:0/2591127720 shutdown_connections 2023-11-27T20:42:13.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:13.626+0000 7f70b759e640 1 -- 172.21.15.91:0/2591127720 wait complete. 2023-11-27T20:42:13.647 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-27T20:42:13.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:13.647 DEBUG:teuthology.orchestra.run.smithi091:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-27T20:42:13.751 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:42:13.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:13.752 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-27T20:42:13.810 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:42:13.811 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:42:13.871 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:42:13.871 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:42:13.926 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:42:13.926 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:42:13.979 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:14.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.199+0000 7f30d1861640 1 Processor -- start 2023-11-27T20:42:14.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.199+0000 7f30d1861640 1 -- start start 2023-11-27T20:42:14.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.200+0000 7f30d1861640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f30cc155490 0x7f30cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.200+0000 7f30d1861640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30cc0a9b40 0x7f30cc0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.200+0000 7f30d1861640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc0c06c0 con 0x7f30cc0c1500 2023-11-27T20:42:14.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.200+0000 7f30d1861640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc0a5820 con 0x7f30cc155490 2023-11-27T20:42:14.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.200+0000 7f30d1861640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0c1020 con 0x7f30cc0a9b40 2023-11-27T20:42:14.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30c27fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f30cc0c1500 0x7f30cc0a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53920/0 (socket says 172.21.15.91:53920) 2023-11-27T20:42:14.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30c27fc640 1 -- 172.21.15.91:0/4078120874 learned_addr learned my addr 172.21.15.91:0/4078120874 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:14.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128708070 0 0) 0x7f30cc0c06c0 con 0x7f30cc0c1500 2023-11-27T20:42:14.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30cb7fe640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30cc0a9b40 0x7f30cc0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ac005730 con 0x7f30cc0c1500 2023-11-27T20:42:14.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30caffd640 1 --2- 172.21.15.91:0/4078120874 >> v2:172.21.15.183:3300/0 conn(0x7f30cc155490 0x7f30cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2421794478 0 0) 0x7f30ac005730 con 0x7f30cc0c1500 2023-11-27T20:42:14.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30cc0a9b40 msgr2=0x7f30cc0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:14.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30cc0a9b40 0x7f30cc0c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 >> v2:172.21.15.183:3300/0 conn(0x7f30cc155490 msgr2=0x7f30cc0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:14.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 --2- 172.21.15.91:0/4078120874 >> v2:172.21.15.183:3300/0 conn(0x7f30cc155490 0x7f30cc0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0c0910 con 0x7f30cc0c1500 2023-11-27T20:42:14.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f30b4001670 con 0x7f30cc0c1500 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 >> v1:172.21.15.91:6789/0 conn(0x7f30cc0c1500 legacy=0x7f30cc0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.201+0000 7f30ca7fc640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30ac005b80 0x7f30ac005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30ca7fc640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30ac0069d0 0x7f30ac006e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30ca7fc640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30ac007350 0x7f30ac00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0c1020 con 0x7f30ac005b80 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0078a0 con 0x7f30ac007350 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac00e150 con 0x7f30ac0069d0 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30caffd640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30ac005b80 0x7f30ac005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30caffd640 1 -- 172.21.15.91:0/4078120874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30ac0069d0 msgr2=0x7f30ac006e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30c27fc640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30ac0069d0 0x7f30ac006e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30caffd640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30ac0069d0 0x7f30ac006e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30caffd640 1 -- 172.21.15.91:0/4078120874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30ac007350 msgr2=0x7f30ac00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30caffd640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30ac007350 0x7f30ac00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.202+0000 7f30caffd640 1 -- 172.21.15.91:0/4078120874 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac005730 con 0x7f30ac005b80 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.203+0000 7f30caffd640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30ac005b80 0x7f30ac005fa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00ba30 tx=0x7f30ac007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d611d44100d97a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.204+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc032680 con 0x7f30ac005b80 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.204+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc0327e0 con 0x7f30ac005b80 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.204+0000 7f30ca7fc640 1 -- 172.21.15.91:0/4078120874 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc032b70 con 0x7f30ac005b80 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.204+0000 7f30d1861640 1 -- 172.21.15.91:0/4078120874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30ac005b80 msgr2=0x7f30ac005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.204+0000 7f30d1861640 1 --2- 172.21.15.91:0/4078120874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30ac005b80 0x7f30ac005fa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00ba30 tx=0x7f30ac007a00 comp rx=0 tx=0).stop 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.204+0000 7f30cb7fe640 1 -- 172.21.15.91:0/4078120874 reap_dead start 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.204+0000 7f30d1861640 1 -- 172.21.15.91:0/4078120874 shutdown_connections 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.204+0000 7f30d1861640 1 -- 172.21.15.91:0/4078120874 >> 172.21.15.91:0/4078120874 conn(0x7f30cc06a500 msgr2=0x7f30cc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:14.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.204+0000 7f30d1861640 1 -- 172.21.15.91:0/4078120874 shutdown_connections 2023-11-27T20:42:14.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.204+0000 7f30d1861640 1 -- 172.21.15.91:0/4078120874 wait complete. 2023-11-27T20:42:14.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.206+0000 7f30d1861640 1 Processor -- start 2023-11-27T20:42:14.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.206+0000 7f30d1861640 1 -- start start 2023-11-27T20:42:14.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.207+0000 7f30d1861640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30ac005b80 0x7f30cc0a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.207+0000 7f30d1861640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30cc0bc7b0 0x7f30cc071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.207+0000 7f30d1861640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30cc1e8c00 0x7f30cc1e90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.207+0000 7f30d1861640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0a73b0 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.207+0000 7f30d1861640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc1e5690 con 0x7f30cc1e8c00 2023-11-27T20:42:14.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.207+0000 7f30d1861640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc1e6660 con 0x7f30ac005b80 2023-11-27T20:42:14.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.207+0000 7f30c27fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30cc0bc7b0 0x7f30cc071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.207+0000 7f30c27fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30cc0bc7b0 0x7f30cc071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43502/0 (socket says 172.21.15.91:43502) 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.207+0000 7f30c27fc640 1 -- 172.21.15.91:0/3612592640 learned_addr learned my addr 172.21.15.91:0/3612592640 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30c27fc640 1 -- 172.21.15.91:0/3612592640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30ac005b80 msgr2=0x7f30cc0a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30caffd640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30ac005b80 0x7f30cc0a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30c27fc640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30ac005b80 0x7f30cc0a6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30c27fc640 1 -- 172.21.15.91:0/3612592640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30cc1e8c00 msgr2=0x7f30cc1e90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30c27fc640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30cc1e8c00 0x7f30cc1e90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30c27fc640 1 -- 172.21.15.91:0/3612592640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0bf4c0 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30c27fc640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30cc0bc7b0 0x7f30cc071060 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f30b400d810 tx=0x7f30b400dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30c8ff9640 1 -- 172.21.15.91:0/3612592640 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40074e0 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30c8ff9640 1 -- 172.21.15.91:0/3612592640 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4007640 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30c8ff9640 1 -- 172.21.15.91:0/3612592640 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4004a00 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.208+0000 7f30d1861640 1 -- 172.21.15.91:0/3612592640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc1e61d0 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.209+0000 7f30d1861640 1 -- 172.21.15.91:0/3612592640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc1e5b80 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.210+0000 7f30d1861640 1 -- 172.21.15.91:0/3612592640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc1e6360 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.210+0000 7f30c8ff9640 1 -- 172.21.15.91:0/3612592640 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f30b4004b60 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.212+0000 7f30c8ff9640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f30b006b1c0 0x7f30b006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.212+0000 7f30c8ff9640 1 -- 172.21.15.91:0/3612592640 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30b4089200 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.212+0000 7f30caffd640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f30b006b1c0 0x7f30b006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.213+0000 7f30caffd640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f30b006b1c0 0x7f30b006d680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00ba00 tx=0x7f30bc03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:14.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.216+0000 7f30c8ff9640 1 -- 172.21.15.91:0/3612592640 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f30b4053fc0 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.409+0000 7f30d1861640 1 -- 172.21.15.91:0/3612592640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30cc0bf4c0 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.412+0000 7f30c8ff9640 1 -- 172.21.15.91:0/3612592640 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f30cc0bf4c0 con 0x7f30cc0bc7b0 2023-11-27T20:42:14.414 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:14.414 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:41:36.158246+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:14.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 -- 172.21.15.91:0/3612592640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f30b006b1c0 msgr2=0x7f30b006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f30b006b1c0 0x7f30b006d680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00ba00 tx=0x7f30bc03d040 comp rx=0 tx=0).stop 2023-11-27T20:42:14.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 -- 172.21.15.91:0/3612592640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30cc0bc7b0 msgr2=0x7f30cc071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30cc0bc7b0 0x7f30cc071060 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f30b400d810 tx=0x7f30b400dcd0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 -- 172.21.15.91:0/3612592640 shutdown_connections 2023-11-27T20:42:14.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f30b006b1c0 0x7f30b006d680 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30cc1e8c00 0x7f30cc1e90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30cc0bc7b0 0x7f30cc071060 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 --2- 172.21.15.91:0/3612592640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30ac005b80 0x7f30cc0a6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 -- 172.21.15.91:0/3612592640 >> 172.21.15.91:0/3612592640 conn(0x7f30cc06a500 msgr2=0x7f30cc1544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:14.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 -- 172.21.15.91:0/3612592640 shutdown_connections 2023-11-27T20:42:14.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.415+0000 7f30d1861640 1 -- 172.21.15.91:0/3612592640 wait complete. 2023-11-27T20:42:14.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:41:32.704555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:41:33.818847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:42:14.437 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:42:14.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.645+0000 7ff9f1147640 1 Processor -- start 2023-11-27T20:42:14.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.645+0000 7ff9f1147640 1 -- start start 2023-11-27T20:42:14.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.646+0000 7ff9f1147640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9ec14c2e0 0x7ff9ec0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.646+0000 7ff9f1147640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff9ec072310 0x7ff9ec0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.646+0000 7ff9f1147640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec071e80 con 0x7ff9ec0c0440 2023-11-27T20:42:14.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.646+0000 7ff9f1147640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec071470 con 0x7ff9ec072310 2023-11-27T20:42:14.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.646+0000 7ff9f1147640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec14c6c0 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.647+0000 7ff9f0946640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff9ec072310 0x7ff9ec0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.647+0000 7ff9e3fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff9ec0c0440 0x7ff9ec152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53924/0 (socket says 172.21.15.91:53924) 2023-11-27T20:42:14.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.647+0000 7ff9e3fff640 1 -- 172.21.15.91:0/3160884124 learned_addr learned my addr 172.21.15.91:0/3160884124 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:14.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.647+0000 7ff9ebfff640 1 --2- 172.21.15.91:0/3160884124 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9ec14c2e0 0x7ff9ec0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.647+0000 7ff9f0946640 1 -- 172.21.15.91:0/3160884124 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9ec14c2e0 msgr2=0x7ff9ec0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:14.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.647+0000 7ff9f0946640 1 --2- 172.21.15.91:0/3160884124 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9ec14c2e0 0x7ff9ec0c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.647+0000 7ff9f0946640 1 -- 172.21.15.91:0/3160884124 >> v1:172.21.15.91:6789/0 conn(0x7ff9ec0c0440 legacy=0x7ff9ec152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.647+0000 7ff9f0946640 1 -- 172.21.15.91:0/3160884124 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec06fdc0 con 0x7ff9ec072310 2023-11-27T20:42:14.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.647+0000 7ff9eb7fe640 1 -- 172.21.15.91:0/3160884124 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998309037 0 0) 0x7ff9ec071e80 con 0x7ff9ec0c0440 2023-11-27T20:42:14.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.648+0000 7ff9f0946640 1 --2- 172.21.15.91:0/3160884124 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec072310 0x7ff9ec0a4d20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009d90 tx=0x7ff9e402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb621b3f3e83e8e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:14.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.648+0000 7ff9eb7fe640 1 -- 172.21.15.91:0/3160884124 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e402cb30 con 0x7ff9ec072310 2023-11-27T20:42:14.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.648+0000 7ff9eb7fe640 1 -- 172.21.15.91:0/3160884124 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e402cc90 con 0x7ff9ec072310 2023-11-27T20:42:14.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.649+0000 7ff9eb7fe640 1 -- 172.21.15.91:0/3160884124 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4034440 con 0x7ff9ec072310 2023-11-27T20:42:14.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.649+0000 7ff9f1147640 1 -- 172.21.15.91:0/3160884124 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec072310 msgr2=0x7ff9ec0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.649+0000 7ff9f1147640 1 --2- 172.21.15.91:0/3160884124 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec072310 0x7ff9ec0a4d20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009d90 tx=0x7ff9e402bd80 comp rx=0 tx=0).stop 2023-11-27T20:42:14.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.649+0000 7ff9f1147640 1 -- 172.21.15.91:0/3160884124 shutdown_connections 2023-11-27T20:42:14.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.649+0000 7ff9f1147640 1 --2- 172.21.15.91:0/3160884124 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec072310 0x7ff9ec0a4d20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.649+0000 7ff9f1147640 1 --2- 172.21.15.91:0/3160884124 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9ec14c2e0 0x7ff9ec0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.649+0000 7ff9f1147640 1 -- 172.21.15.91:0/3160884124 >> 172.21.15.91:0/3160884124 conn(0x7ff9ec0a77f0 msgr2=0x7ff9ec0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:14.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.649+0000 7ff9f1147640 1 -- 172.21.15.91:0/3160884124 shutdown_connections 2023-11-27T20:42:14.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.649+0000 7ff9f1147640 1 -- 172.21.15.91:0/3160884124 wait complete. 2023-11-27T20:42:14.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.651+0000 7ff9f1147640 1 Processor -- start 2023-11-27T20:42:14.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.651+0000 7ff9f1147640 1 -- start start 2023-11-27T20:42:14.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.652+0000 7ff9f1147640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9ec072310 0x7ff9ec0a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.652+0000 7ff9f1147640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9ec0c0440 0x7ff9ec1e8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.652+0000 7ff9f1147640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec14c2e0 0x7ff9ec0bacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.652+0000 7ff9f1147640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0bd560 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.652+0000 7ff9f1147640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0be5e0 con 0x7ff9ec0c0440 2023-11-27T20:42:14.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.652+0000 7ff9f1147640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec1e7fc0 con 0x7ff9ec072310 2023-11-27T20:42:14.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.652+0000 7ff9f0946640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec14c2e0 0x7ff9ec0bacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.652+0000 7ff9f0946640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec14c2e0 0x7ff9ec0bacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43528/0 (socket says 172.21.15.91:43528) 2023-11-27T20:42:14.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.652+0000 7ff9f0946640 1 -- 172.21.15.91:0/1817845348 learned_addr learned my addr 172.21.15.91:0/1817845348 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:14.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9e3fff640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9ec0c0440 0x7ff9ec1e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9f0946640 1 -- 172.21.15.91:0/1817845348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9ec072310 msgr2=0x7ff9ec0a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9f0946640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9ec072310 0x7ff9ec0a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9f0946640 1 -- 172.21.15.91:0/1817845348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9ec0c0440 msgr2=0x7ff9ec1e8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9f0946640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9ec0c0440 0x7ff9ec1e8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9f0946640 1 -- 172.21.15.91:0/1817845348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e4009a70 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9e3fff640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9ec0c0440 0x7ff9ec1e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:14.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9f0946640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec14c2e0 0x7ff9ec0bacd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009d90 tx=0x7ff9e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:14.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9e97fa640 1 -- 172.21.15.91:0/1817845348 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4034440 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9e97fa640 1 -- 172.21.15.91:0/1817845348 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e403e620 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9e97fa640 1 -- 172.21.15.91:0/1817845348 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e403e9d0 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9f1147640 1 -- 172.21.15.91:0/1817845348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec0bf4d0 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.653+0000 7ff9f1147640 1 -- 172.21.15.91:0/1817845348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec1e8240 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.655+0000 7ff9f1147640 1 -- 172.21.15.91:0/1817845348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec04e840 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.655+0000 7ff9e97fa640 1 -- 172.21.15.91:0/1817845348 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff9e403b050 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.656+0000 7ff9e97fa640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff9cc06b1c0 0x7ff9cc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:14.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.656+0000 7ff9e97fa640 1 -- 172.21.15.91:0/1817845348 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9e40abc70 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.657+0000 7ff9ebfff640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff9cc06b1c0 0x7ff9cc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:14.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.657+0000 7ff9ebfff640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff9cc06b1c0 0x7ff9cc06d680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec155f20 tx=0x7ff9dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:14.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.661+0000 7ff9e97fa640 1 -- 172.21.15.91:0/1817845348 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff9e4076990 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.849+0000 7ff9f1147640 1 -- 172.21.15.91:0/1817845348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9ec0a75d0 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.849+0000 7ff9e97fa640 1 -- 172.21.15.91:0/1817845348 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9e40390a0 con 0x7ff9ec14c2e0 2023-11-27T20:42:14.852 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:42:14.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.851+0000 7ff9f1147640 1 -- 172.21.15.91:0/1817845348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff9cc06b1c0 msgr2=0x7ff9cc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.851+0000 7ff9f1147640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff9cc06b1c0 0x7ff9cc06d680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec155f20 tx=0x7ff9dc008040 comp rx=0 tx=0).stop 2023-11-27T20:42:14.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.851+0000 7ff9f1147640 1 -- 172.21.15.91:0/1817845348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec14c2e0 msgr2=0x7ff9ec0bacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:14.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.851+0000 7ff9f1147640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec14c2e0 0x7ff9ec0bacd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009d90 tx=0x7ff9e4004a40 comp rx=0 tx=0).stop 2023-11-27T20:42:14.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.852+0000 7ff9f1147640 1 -- 172.21.15.91:0/1817845348 shutdown_connections 2023-11-27T20:42:14.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.852+0000 7ff9f1147640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9ec14c2e0 0x7ff9ec0bacd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.852+0000 7ff9f1147640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff9cc06b1c0 0x7ff9cc06d680 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.852+0000 7ff9f1147640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9ec0c0440 0x7ff9ec1e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.852+0000 7ff9f1147640 1 --2- 172.21.15.91:0/1817845348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9ec072310 0x7ff9ec0a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:14.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.852+0000 7ff9f1147640 1 -- 172.21.15.91:0/1817845348 >> 172.21.15.91:0/1817845348 conn(0x7ff9ec0a77f0 msgr2=0x7ff9ec153650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:14.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.852+0000 7ff9f1147640 1 -- 172.21.15.91:0/1817845348 shutdown_connections 2023-11-27T20:42:14.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:14.852+0000 7ff9f1147640 1 -- 172.21.15.91:0/1817845348 wait complete. 2023-11-27T20:42:14.870 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:42:15.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.077+0000 7fa3659c9640 1 Processor -- start 2023-11-27T20:42:15.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.077+0000 7fa3659c9640 1 -- start start 2023-11-27T20:42:15.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.079+0000 7fa3659c9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa36014fd30 0x7fa360152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.079+0000 7fa3659c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3600c3ea0 0x7fa3600c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.079+0000 7fa3659c9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3600c64a0 con 0x7fa36006d0a0 2023-11-27T20:42:15.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.079+0000 7fa3659c9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3600c5c00 con 0x7fa36014fd30 2023-11-27T20:42:15.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.079+0000 7fa3659c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600c5ee0 con 0x7fa3600c3ea0 2023-11-27T20:42:15.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.079+0000 7fa3567fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa36006d0a0 0x7fa3600a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53926/0 (socket says 172.21.15.91:53926) 2023-11-27T20:42:15.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.079+0000 7fa3567fc640 1 -- 172.21.15.91:0/4078649578 learned_addr learned my addr 172.21.15.91:0/4078649578 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:15.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35effd640 1 --2- 172.21.15.91:0/4078649578 >> v2:172.21.15.183:3300/0 conn(0x7fa36014fd30 0x7fa360152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35f7fe640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3600c3ea0 0x7fa3600c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541134570 0 0) 0x7fa3600c64a0 con 0x7fa36006d0a0 2023-11-27T20:42:15.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa34c003520 con 0x7fa36006d0a0 2023-11-27T20:42:15.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2413367533 0 0) 0x7fa34c003520 con 0x7fa36006d0a0 2023-11-27T20:42:15.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3600c3ea0 msgr2=0x7fa3600c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:15.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3600c3ea0 0x7fa3600c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 >> v2:172.21.15.183:3300/0 conn(0x7fa36014fd30 msgr2=0x7fa360152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:15.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 --2- 172.21.15.91:0/4078649578 >> v2:172.21.15.183:3300/0 conn(0x7fa36014fd30 0x7fa360152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600c61c0 con 0x7fa36006d0a0 2023-11-27T20:42:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fa348001670 con 0x7fa36006d0a0 2023-11-27T20:42:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 >> v1:172.21.15.91:6789/0 conn(0x7fa36006d0a0 legacy=0x7fa3600a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa34c003970 0x7fa34c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.080+0000 7fa35e7fc640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3600c3ea0 0x7fa34c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35e7fc640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa34c004d00 0x7fa34c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600c5c00 con 0x7fa34c003970 2023-11-27T20:42:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600c5ee0 con 0x7fa34c004d00 2023-11-27T20:42:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c00b980 con 0x7fa3600c3ea0 2023-11-27T20:42:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35effd640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa34c003970 0x7fa34c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35f7fe640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa34c004d00 0x7fa34c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35effd640 1 -- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3600c3ea0 msgr2=0x7fa34c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa3567fc640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3600c3ea0 0x7fa34c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35effd640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3600c3ea0 0x7fa34c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35effd640 1 -- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa34c004d00 msgr2=0x7fa34c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35effd640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa34c004d00 0x7fa34c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35effd640 1 -- 172.21.15.91:0/4078649578 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c003520 con 0x7fa34c003970 2023-11-27T20:42:15.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.081+0000 7fa35f7fe640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa34c004d00 0x7fa34c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:15.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.083+0000 7fa35effd640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa34c003970 0x7fa34c003d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa350009af0 tx=0x7fa34c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c91e2c78938552f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.083+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35002c710 con 0x7fa34c003970 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.083+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35002c870 con 0x7fa34c003970 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.083+0000 7fa35e7fc640 1 -- 172.21.15.91:0/4078649578 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35002cc00 con 0x7fa34c003970 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.084+0000 7fa3659c9640 1 -- 172.21.15.91:0/4078649578 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa34c003970 msgr2=0x7fa34c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.084+0000 7fa3659c9640 1 --2- 172.21.15.91:0/4078649578 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa34c003970 0x7fa34c003d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa350009af0 tx=0x7fa34c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.084+0000 7fa35f7fe640 1 -- 172.21.15.91:0/4078649578 reap_dead start 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.084+0000 7fa3659c9640 1 -- 172.21.15.91:0/4078649578 shutdown_connections 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.084+0000 7fa3659c9640 1 -- 172.21.15.91:0/4078649578 >> 172.21.15.91:0/4078649578 conn(0x7fa36006a500 msgr2=0x7fa36006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.084+0000 7fa3659c9640 1 -- 172.21.15.91:0/4078649578 shutdown_connections 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.084+0000 7fa3659c9640 1 -- 172.21.15.91:0/4078649578 wait complete. 2023-11-27T20:42:15.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.085+0000 7fa3659c9640 1 Processor -- start 2023-11-27T20:42:15.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.086+0000 7fa3659c9640 1 -- start start 2023-11-27T20:42:15.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.086+0000 7fa3659c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36014ef50 0x7fa3600a9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.086+0000 7fa3659c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa360153860 0x7fa3601edd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.086+0000 7fa3659c9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa36014f5e0 0x7fa3600bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.086+0000 7fa3659c9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3601544d0 con 0x7fa36014f5e0 2023-11-27T20:42:15.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.086+0000 7fa3659c9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3601de7a0 con 0x7fa36014ef50 2023-11-27T20:42:15.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.086+0000 7fa3659c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3601eb530 con 0x7fa360153860 2023-11-27T20:42:15.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa36014f5e0 0x7fa3600bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa36014f5e0 0x7fa3600bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43556/0 (socket says 172.21.15.91:43556) 2023-11-27T20:42:15.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa35f7fe640 1 -- 172.21.15.91:0/1959151172 learned_addr learned my addr 172.21.15.91:0/1959151172 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:15.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa35effd640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36014ef50 0x7fa3600a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa3567fc640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa360153860 0x7fa3601edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa35f7fe640 1 -- 172.21.15.91:0/1959151172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa360153860 msgr2=0x7fa3601edd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa35f7fe640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa360153860 0x7fa3601edd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa35f7fe640 1 -- 172.21.15.91:0/1959151172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36014ef50 msgr2=0x7fa3600a9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa35f7fe640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36014ef50 0x7fa3600a9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa35f7fe640 1 -- 172.21.15.91:0/1959151172 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3601de430 con 0x7fa36014f5e0 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa35effd640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36014ef50 0x7fa3600a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.087+0000 7fa3567fc640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa360153860 0x7fa3601edd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.088+0000 7fa35f7fe640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa36014f5e0 0x7fa3600bf0f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa3600c3860 tx=0x7fa35800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.088+0000 7fa35cff9640 1 -- 172.21.15.91:0/1959151172 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358017400 con 0x7fa36014f5e0 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.088+0000 7fa35cff9640 1 -- 172.21.15.91:0/1959151172 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa358011040 con 0x7fa36014f5e0 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.088+0000 7fa3659c9640 1 -- 172.21.15.91:0/1959151172 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36014f330 con 0x7fa36014f5e0 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.088+0000 7fa35cff9640 1 -- 172.21.15.91:0/1959151172 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580177c0 con 0x7fa36014f5e0 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.088+0000 7fa3659c9640 1 -- 172.21.15.91:0/1959151172 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3601eb150 con 0x7fa36014f5e0 2023-11-27T20:42:15.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.089+0000 7fa3659c9640 1 -- 172.21.15.91:0/1959151172 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3601de5c0 con 0x7fa36014f5e0 2023-11-27T20:42:15.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.090+0000 7fa35cff9640 1 -- 172.21.15.91:0/1959151172 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa3580203b0 con 0x7fa36014f5e0 2023-11-27T20:42:15.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.091+0000 7fa35cff9640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa34006b1f0 0x7fa34006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.091+0000 7fa35cff9640 1 -- 172.21.15.91:0/1959151172 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa358089d20 con 0x7fa36014f5e0 2023-11-27T20:42:15.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.091+0000 7fa35effd640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa34006b1f0 0x7fa34006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.092+0000 7fa35effd640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa34006b1f0 0x7fa34006d6b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa350036000 tx=0x7fa350030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:15.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.096+0000 7fa35cff9640 1 -- 172.21.15.91:0/1959151172 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa358054a40 con 0x7fa36014f5e0 2023-11-27T20:42:15.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.289+0000 7fa3659c9640 1 -- 172.21.15.91:0/1959151172 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa360068350 con 0x7fa36014f5e0 2023-11-27T20:42:15.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.290+0000 7fa35cff9640 1 -- 172.21.15.91:0/1959151172 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa358058060 con 0x7fa36014f5e0 2023-11-27T20:42:15.291 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:42:15.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.292+0000 7fa3659c9640 1 -- 172.21.15.91:0/1959151172 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa34006b1f0 msgr2=0x7fa34006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.292+0000 7fa3659c9640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa34006b1f0 0x7fa34006d6b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa350036000 tx=0x7fa350030000 comp rx=0 tx=0).stop 2023-11-27T20:42:15.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.292+0000 7fa3659c9640 1 -- 172.21.15.91:0/1959151172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa36014f5e0 msgr2=0x7fa3600bf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.292+0000 7fa3659c9640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa36014f5e0 0x7fa3600bf0f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa3600c3860 tx=0x7fa35800f4a0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.293+0000 7fa3659c9640 1 -- 172.21.15.91:0/1959151172 shutdown_connections 2023-11-27T20:42:15.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.293+0000 7fa3659c9640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa36014f5e0 0x7fa3600bf0f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.293+0000 7fa3659c9640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa360153860 0x7fa3601edd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.293+0000 7fa3659c9640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa34006b1f0 0x7fa34006d6b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.293+0000 7fa3659c9640 1 --2- 172.21.15.91:0/1959151172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36014ef50 0x7fa3600a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.293+0000 7fa3659c9640 1 -- 172.21.15.91:0/1959151172 >> 172.21.15.91:0/1959151172 conn(0x7fa36006a500 msgr2=0x7fa360071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:15.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.293+0000 7fa3659c9640 1 -- 172.21.15.91:0/1959151172 shutdown_connections 2023-11-27T20:42:15.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.293+0000 7fa3659c9640 1 -- 172.21.15.91:0/1959151172 wait complete. 2023-11-27T20:42:15.313 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:42:15.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.523+0000 7f641b573640 1 Processor -- start 2023-11-27T20:42:15.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.523+0000 7f641b573640 1 -- start start 2023-11-27T20:42:15.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.525+0000 7f641b573640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6414154b40 0x7f64140a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.525+0000 7f641b573640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6414157ad0 con 0x7f64140a4d20 2023-11-27T20:42:15.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.525+0000 7f641b573640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6414157db0 con 0x7f64140c1450 2023-11-27T20:42:15.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.525+0000 7f641b573640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6414158890 con 0x7f6414154b40 2023-11-27T20:42:15.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.525+0000 7f641a571640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f64140a4d20 0x7f6414154430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53932/0 (socket says 172.21.15.91:53932) 2023-11-27T20:42:15.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.525+0000 7f641a571640 1 -- 172.21.15.91:0/2813402679 learned_addr learned my addr 172.21.15.91:0/2813402679 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:15.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.525+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705731933 0 0) 0x7f6414157ad0 con 0x7f64140a4d20 2023-11-27T20:42:15.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.525+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6400003520 con 0x7f64140a4d20 2023-11-27T20:42:15.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.525+0000 7f6419d70640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6414154b40 0x7f64140a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 92807968 0 0) 0x7f6400003520 con 0x7f64140a4d20 2023-11-27T20:42:15.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6414154b40 msgr2=0x7f64140a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:15.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6414154b40 0x7f64140a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 >> v1:172.21.15.183:6789/0 conn(0x7f64140c1450 legacy=0x7f641415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6414158090 con 0x7f64140a4d20 2023-11-27T20:42:15.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f6410001670 con 0x7f64140a4d20 2023-11-27T20:42:15.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f6419d70640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6414154b40 0x7f64140a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:42:15.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 >> v1:172.21.15.91:6789/0 conn(0x7f64140a4d20 legacy=0x7f6414154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64000039a0 0x7f6400003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6414154b40 0x7f64000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6400004d00 0x7f6400005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6414158890 con 0x7f64000039a0 2023-11-27T20:42:15.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640000bb40 con 0x7f6400004d00 2023-11-27T20:42:15.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640000bd00 con 0x7f6414154b40 2023-11-27T20:42:15.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.526+0000 7f641a571640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64000039a0 0x7f6400003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.527+0000 7f6419d70640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6414154b40 0x7f64000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.527+0000 7f641ad72640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6400004d00 0x7f6400005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.527+0000 7f641a571640 1 -- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6414154b40 msgr2=0x7f64000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:15.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.527+0000 7f641a571640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6414154b40 0x7f64000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.527+0000 7f641a571640 1 -- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6400004d00 msgr2=0x7f6400005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:15.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.527+0000 7f641a571640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6400004d00 0x7f6400005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.527+0000 7f641a571640 1 -- 172.21.15.91:0/2813402679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6400003520 con 0x7f64000039a0 2023-11-27T20:42:15.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.528+0000 7f641a571640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64000039a0 0x7f6400003dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f641000c240 tx=0x7f64000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccddacf2a7ce176 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:15.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.528+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6410005ad0 con 0x7f64000039a0 2023-11-27T20:42:15.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.528+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6410005c30 con 0x7f64000039a0 2023-11-27T20:42:15.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.528+0000 7f641956f640 1 -- 172.21.15.91:0/2813402679 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641002c8b0 con 0x7f64000039a0 2023-11-27T20:42:15.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.529+0000 7f641b573640 1 -- 172.21.15.91:0/2813402679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64000039a0 msgr2=0x7f6400003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.529+0000 7f641b573640 1 --2- 172.21.15.91:0/2813402679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64000039a0 0x7f6400003dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f641000c240 tx=0x7f64000057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.529+0000 7f641ad72640 1 -- 172.21.15.91:0/2813402679 reap_dead start 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.529+0000 7f641b573640 1 -- 172.21.15.91:0/2813402679 shutdown_connections 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.529+0000 7f641b573640 1 -- 172.21.15.91:0/2813402679 >> 172.21.15.91:0/2813402679 conn(0x7f64140a77f0 msgr2=0x7f64140a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.529+0000 7f641b573640 1 -- 172.21.15.91:0/2813402679 shutdown_connections 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.529+0000 7f641b573640 1 -- 172.21.15.91:0/2813402679 wait complete. 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.530+0000 7f641b573640 1 Processor -- start 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.531+0000 7f641b573640 1 -- start start 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.531+0000 7f641b573640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64000039a0 0x7f6414153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.531+0000 7f641b573640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64140a71e0 0x7f641414dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.531+0000 7f641b573640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f641414e290 0x7f64141ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.531+0000 7f641b573640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64140a90f0 con 0x7f64140a71e0 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.531+0000 7f641b573640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64140a55b0 con 0x7f64000039a0 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.531+0000 7f641b573640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64140a92e0 con 0x7f641414e290 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.532+0000 7f6419d70640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64140a71e0 0x7f641414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.532+0000 7f6419d70640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64140a71e0 0x7f641414dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43584/0 (socket says 172.21.15.91:43584) 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.532+0000 7f6419d70640 1 -- 172.21.15.91:0/3050552501 learned_addr learned my addr 172.21.15.91:0/3050552501 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.532+0000 7f641a571640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64000039a0 0x7f6414153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.532+0000 7f6419d70640 1 -- 172.21.15.91:0/3050552501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f641414e290 msgr2=0x7f64141ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.532+0000 7f6419d70640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f641414e290 0x7f64141ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.532+0000 7f6419d70640 1 -- 172.21.15.91:0/3050552501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64000039a0 msgr2=0x7f6414153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.532+0000 7f6419d70640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64000039a0 0x7f6414153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.532+0000 7f6419d70640 1 -- 172.21.15.91:0/3050552501 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64140a9880 con 0x7f64140a71e0 2023-11-27T20:42:15.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.532+0000 7f6419d70640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64140a71e0 0x7f641414dd50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6408010860 tx=0x7f6408010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:15.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.533+0000 7f6406ffd640 1 -- 172.21.15.91:0/3050552501 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800cae0 con 0x7f64140a71e0 2023-11-27T20:42:15.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.533+0000 7f6406ffd640 1 -- 172.21.15.91:0/3050552501 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640800cc40 con 0x7f64140a71e0 2023-11-27T20:42:15.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.533+0000 7f641b573640 1 -- 172.21.15.91:0/3050552501 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64140a8bf0 con 0x7f64140a71e0 2023-11-27T20:42:15.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.533+0000 7f6406ffd640 1 -- 172.21.15.91:0/3050552501 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408010e50 con 0x7f64140a71e0 2023-11-27T20:42:15.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.533+0000 7f641b573640 1 -- 172.21.15.91:0/3050552501 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641414e710 con 0x7f64140a71e0 2023-11-27T20:42:15.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.534+0000 7f641b573640 1 -- 172.21.15.91:0/3050552501 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6414068350 con 0x7f64140a71e0 2023-11-27T20:42:15.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.535+0000 7f6406ffd640 1 -- 172.21.15.91:0/3050552501 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6408015470 con 0x7f64140a71e0 2023-11-27T20:42:15.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.536+0000 7f6406ffd640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f63f806b1c0 0x7f63f806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.536+0000 7f6406ffd640 1 -- 172.21.15.91:0/3050552501 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f640808a180 con 0x7f64140a71e0 2023-11-27T20:42:15.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.536+0000 7f641a571640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f63f806b1c0 0x7f63f806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.537+0000 7f641a571640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f63f806b1c0 0x7f63f806d680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6410034000 tx=0x7f6410009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:15.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.541+0000 7f6406ffd640 1 -- 172.21.15.91:0/3050552501 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6408054eb0 con 0x7f64140a71e0 2023-11-27T20:42:15.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.732+0000 7f641b573640 1 -- 172.21.15.91:0/3050552501 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f641404e840 con 0x7f64140a71e0 2023-11-27T20:42:15.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.733+0000 7f6406ffd640 1 -- 172.21.15.91:0/3050552501 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f64080584d0 con 0x7f64140a71e0 2023-11-27T20:42:15.734 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:42:15.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 -- 172.21.15.91:0/3050552501 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f63f806b1c0 msgr2=0x7f63f806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f63f806b1c0 0x7f63f806d680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6410034000 tx=0x7f6410009030 comp rx=0 tx=0).stop 2023-11-27T20:42:15.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 -- 172.21.15.91:0/3050552501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64140a71e0 msgr2=0x7f641414dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64140a71e0 0x7f641414dd50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6408010860 tx=0x7f6408010d20 comp rx=0 tx=0).stop 2023-11-27T20:42:15.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 -- 172.21.15.91:0/3050552501 shutdown_connections 2023-11-27T20:42:15.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f641414e290 0x7f64141ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64140a71e0 0x7f641414dd50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f63f806b1c0 0x7f63f806d680 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 --2- 172.21.15.91:0/3050552501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64000039a0 0x7f6414153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 -- 172.21.15.91:0/3050552501 >> 172.21.15.91:0/3050552501 conn(0x7f64140a77f0 msgr2=0x7f6414156480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:15.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 -- 172.21.15.91:0/3050552501 shutdown_connections 2023-11-27T20:42:15.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.735+0000 7f641b573640 1 -- 172.21.15.91:0/3050552501 wait complete. 2023-11-27T20:42:15.754 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:42:15.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.958+0000 7f300759e640 1 Processor -- start 2023-11-27T20:42:15.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.959+0000 7f300759e640 1 -- start start 2023-11-27T20:42:15.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.960+0000 7f300759e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f30080ca450 0x7f30080ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.960+0000 7f300759e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3008158a60 con 0x7f3008154580 2023-11-27T20:42:15.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.960+0000 7f300759e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30080c4dd0 con 0x7f300814e7c0 2023-11-27T20:42:15.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.960+0000 7f300759e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30080c5b10 con 0x7f30080ca450 2023-11-27T20:42:15.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.960+0000 7f3006d9d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f3008154580 0x7f30081549f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53942/0 (socket says 172.21.15.91:53942) 2023-11-27T20:42:15.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.960+0000 7f3006d9d640 1 -- 172.21.15.91:0/639819387 learned_addr learned my addr 172.21.15.91:0/639819387 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:15.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f3005d9b640 1 --2- 172.21.15.91:0/639819387 >> v2:172.21.15.183:3300/0 conn(0x7f30080ca450 0x7f30080ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321705118 0 0) 0x7f3008158a60 con 0x7f3008154580 2023-11-27T20:42:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff4003520 con 0x7f3008154580 2023-11-27T20:42:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3817710007 0 0) 0x7f2ff4003520 con 0x7f3008154580 2023-11-27T20:42:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 >> v2:172.21.15.183:3300/0 conn(0x7f30080ca450 msgr2=0x7f30080ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:15.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 --2- 172.21.15.91:0/639819387 >> v2:172.21.15.183:3300/0 conn(0x7f30080ca450 0x7f30080ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 >> v1:172.21.15.183:6789/0 conn(0x7f300814e7c0 legacy=0x7f30080c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008157ca0 con 0x7f3008154580 2023-11-27T20:42:15.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f3000001670 con 0x7f3008154580 2023-11-27T20:42:15.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 >> v1:172.21.15.91:6789/0 conn(0x7f3008154580 legacy=0x7f30081549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 --2- 172.21.15.91:0/639819387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ff4003970 0x7f2ff4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 --2- 172.21.15.91:0/639819387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ff40047c0 0x7f2ff4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 --2- 172.21.15.91:0/639819387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ff4005380 0x7f2ff400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff400c1e0 con 0x7f2ff4003970 2023-11-27T20:42:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff400c350 con 0x7f2ff4005380 2023-11-27T20:42:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.961+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff400c510 con 0x7f2ff40047c0 2023-11-27T20:42:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.962+0000 7f300659c640 1 --2- 172.21.15.91:0/639819387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ff4003970 0x7f2ff4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.962+0000 7f3006d9d640 1 --2- 172.21.15.91:0/639819387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ff4005380 0x7f2ff400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.962+0000 7f300659c640 1 -- 172.21.15.91:0/639819387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ff40047c0 msgr2=0x7f2ff4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:15.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.962+0000 7f300659c640 1 --2- 172.21.15.91:0/639819387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ff40047c0 0x7f2ff4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.962+0000 7f300659c640 1 -- 172.21.15.91:0/639819387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ff4005380 msgr2=0x7f2ff400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:15.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.962+0000 7f300659c640 1 --2- 172.21.15.91:0/639819387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ff4005380 0x7f2ff400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.962+0000 7f300659c640 1 -- 172.21.15.91:0/639819387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff4003520 con 0x7f2ff4003970 2023-11-27T20:42:15.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.962+0000 7f3006d9d640 1 -- 172.21.15.91:0/639819387 reap_dead start 2023-11-27T20:42:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.963+0000 7f300659c640 1 --2- 172.21.15.91:0/639819387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ff4003970 0x7f2ff4003d90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8001e50 tx=0x7f2ff40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42be209495d9d5f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.963+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8003b70 con 0x7f2ff4003970 2023-11-27T20:42:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.963+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff8003cd0 con 0x7f2ff4003970 2023-11-27T20:42:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.963+0000 7f300559a640 1 -- 172.21.15.91:0/639819387 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8005310 con 0x7f2ff4003970 2023-11-27T20:42:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.964+0000 7f300759e640 1 -- 172.21.15.91:0/639819387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ff4003970 msgr2=0x7f2ff4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.964+0000 7f300759e640 1 --2- 172.21.15.91:0/639819387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ff4003970 0x7f2ff4003d90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8001e50 tx=0x7f2ff40057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.964+0000 7f300759e640 1 -- 172.21.15.91:0/639819387 shutdown_connections 2023-11-27T20:42:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.964+0000 7f300759e640 1 --2- 172.21.15.91:0/639819387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ff4003970 0x7f2ff4003d90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.964+0000 7f300759e640 1 -- 172.21.15.91:0/639819387 >> 172.21.15.91:0/639819387 conn(0x7f30080abf00 msgr2=0x7f30080c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.964+0000 7f300759e640 1 -- 172.21.15.91:0/639819387 shutdown_connections 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.964+0000 7f300759e640 1 -- 172.21.15.91:0/639819387 wait complete. 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.966+0000 7f300759e640 1 Processor -- start 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.966+0000 7f300759e640 1 -- start start 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f300759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ff4003970 0x7f30081524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f300759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f300814bfe0 0x7f30080c0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f300759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f300814c6a0 0x7f30081571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f300759e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3008153e30 con 0x7f300814c6a0 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f300759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300814c4e0 con 0x7f300814bfe0 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f300759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30080c09b0 con 0x7f2ff4003970 2023-11-27T20:42:15.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f3006d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f300814c6a0 0x7f30081571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f3006d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f300814c6a0 0x7f30081571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43606/0 (socket says 172.21.15.91:43606) 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f3006d9d640 1 -- 172.21.15.91:0/3804323986 learned_addr learned my addr 172.21.15.91:0/3804323986 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f300659c640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ff4003970 0x7f30081524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.967+0000 7f3005d9b640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f300814bfe0 0x7f30080c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f3006d9d640 1 -- 172.21.15.91:0/3804323986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ff4003970 msgr2=0x7f30081524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f3006d9d640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ff4003970 0x7f30081524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f3006d9d640 1 -- 172.21.15.91:0/3804323986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f300814bfe0 msgr2=0x7f30080c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f3006d9d640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f300814bfe0 0x7f30080c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f3006d9d640 1 -- 172.21.15.91:0/3804323986 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008154060 con 0x7f300814c6a0 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f3005d9b640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f300814bfe0 0x7f30080c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f3006d9d640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f300814c6a0 0x7f30081571e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3008154960 tx=0x7f300000d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f2ffeffd640 1 -- 172.21.15.91:0/3804323986 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000007440 con 0x7f300814c6a0 2023-11-27T20:42:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f2ffeffd640 1 -- 172.21.15.91:0/3804323986 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30000075a0 con 0x7f300814c6a0 2023-11-27T20:42:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f2ffeffd640 1 -- 172.21.15.91:0/3804323986 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000004a20 con 0x7f300814c6a0 2023-11-27T20:42:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f300759e640 1 -- 172.21.15.91:0/3804323986 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3008154340 con 0x7f300814c6a0 2023-11-27T20:42:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.968+0000 7f300759e640 1 -- 172.21.15.91:0/3804323986 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30081ea8c0 con 0x7f300814c6a0 2023-11-27T20:42:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.969+0000 7f300759e640 1 -- 172.21.15.91:0/3804323986 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300804e840 con 0x7f300814c6a0 2023-11-27T20:42:15.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.970+0000 7f2ffeffd640 1 -- 172.21.15.91:0/3804323986 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3000004b80 con 0x7f300814c6a0 2023-11-27T20:42:15.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.971+0000 7f2ffeffd640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fe806b1f0 0x7f2fe806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:15.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.971+0000 7f2ffeffd640 1 -- 172.21.15.91:0/3804323986 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30000891e0 con 0x7f300814c6a0 2023-11-27T20:42:15.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.972+0000 7f300659c640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fe806b1f0 0x7f2fe806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:15.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.972+0000 7f300659c640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fe806b1f0 0x7f2fe806d6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8034000 tx=0x7f2ff8009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:15.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:15.976+0000 7f2ffeffd640 1 -- 172.21.15.91:0/3804323986 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3000053fa0 con 0x7f300814c6a0 2023-11-27T20:42:16.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.178+0000 7f300759e640 1 -- 172.21.15.91:0/3804323986 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f30080c7c40 con 0x7f300814c6a0 2023-11-27T20:42:16.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.181+0000 7f2ffeffd640 1 -- 172.21.15.91:0/3804323986 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f30000575c0 con 0x7f300814c6a0 2023-11-27T20:42:16.182 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:42:16.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.183+0000 7f300759e640 1 -- 172.21.15.91:0/3804323986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fe806b1f0 msgr2=0x7f2fe806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:16.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.183+0000 7f300759e640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fe806b1f0 0x7f2fe806d6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8034000 tx=0x7f2ff8009030 comp rx=0 tx=0).stop 2023-11-27T20:42:16.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.183+0000 7f300759e640 1 -- 172.21.15.91:0/3804323986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f300814c6a0 msgr2=0x7f30081571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:16.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.183+0000 7f300759e640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f300814c6a0 0x7f30081571e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3008154960 tx=0x7f300000d890 comp rx=0 tx=0).stop 2023-11-27T20:42:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.184+0000 7f300759e640 1 -- 172.21.15.91:0/3804323986 shutdown_connections 2023-11-27T20:42:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.184+0000 7f300759e640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f300814c6a0 0x7f30081571e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.184+0000 7f300759e640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fe806b1f0 0x7f2fe806d6b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.184+0000 7f300759e640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f300814bfe0 0x7f30080c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.184+0000 7f300759e640 1 --2- 172.21.15.91:0/3804323986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ff4003970 0x7f30081524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.184+0000 7f300759e640 1 -- 172.21.15.91:0/3804323986 >> 172.21.15.91:0/3804323986 conn(0x7f30080abf00 msgr2=0x7f300814b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.184+0000 7f300759e640 1 -- 172.21.15.91:0/3804323986 shutdown_connections 2023-11-27T20:42:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.184+0000 7f300759e640 1 -- 172.21.15.91:0/3804323986 wait complete. 2023-11-27T20:42:16.206 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-27T20:42:16.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:16.207 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-27T20:42:16.309 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:42:16.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:16.309 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-27T20:42:16.363 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-27T20:42:16.364 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:42:16.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.587+0000 7f75cdf39640 1 Processor -- start 2023-11-27T20:42:16.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.587+0000 7f75cdf39640 1 -- start start 2023-11-27T20:42:16.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.589+0000 7f75cdf39640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f75c8155e80 0x7f75c8156260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:16.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.589+0000 7f75cdf39640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c80a50e0 0x7f75c80c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:16.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.589+0000 7f75cdf39640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c80c05c0 con 0x7f75c80c54e0 2023-11-27T20:42:16.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.589+0000 7f75cdf39640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c80c11b0 con 0x7f75c8155e80 2023-11-27T20:42:16.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.589+0000 7f75cdf39640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c806de60 con 0x7f75c80a50e0 2023-11-27T20:42:16.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.589+0000 7f75c7fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f75c80c54e0 0x7f75c814f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53946/0 (socket says 172.21.15.91:53946) 2023-11-27T20:42:16.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.589+0000 7f75c7fff640 1 -- 172.21.15.91:0/90578975 learned_addr learned my addr 172.21.15.91:0/90578975 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:16.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.589+0000 7f75c6ffd640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c80a50e0 0x7f75c80c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:16.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.589+0000 7f75c77fe640 1 --2- 172.21.15.91:0/90578975 >> v2:172.21.15.183:3300/0 conn(0x7f75c8155e80 0x7f75c8156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:16.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.589+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232882854 0 0) 0x7f75c80c05c0 con 0x7f75c80c54e0 2023-11-27T20:42:16.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b0003520 con 0x7f75c80c54e0 2023-11-27T20:42:16.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3875474224 0 0) 0x7f75b0003520 con 0x7f75c80c54e0 2023-11-27T20:42:16.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c80a50e0 msgr2=0x7f75c80c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:16.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c80a50e0 0x7f75c80c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 >> v2:172.21.15.183:3300/0 conn(0x7f75c8155e80 msgr2=0x7f75c8156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:16.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 --2- 172.21.15.91:0/90578975 >> v2:172.21.15.183:3300/0 conn(0x7f75c8155e80 0x7f75c8156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8156b50 con 0x7f75c80c54e0 2023-11-27T20:42:16.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f75c00019f0 con 0x7f75c80c54e0 2023-11-27T20:42:16.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 >> v1:172.21.15.91:6789/0 conn(0x7f75c80c54e0 legacy=0x7f75c814f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:16.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c80a50e0 0x7f75b0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:16.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75b0003ef0 0x7f75b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:16.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75b0004d00 0x7f75b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:16.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c806de60 con 0x7f75b0003ef0 2023-11-27T20:42:16.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b000b9e0 con 0x7f75b0004d00 2023-11-27T20:42:16.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b000bba0 con 0x7f75c80a50e0 2023-11-27T20:42:16.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.590+0000 7f75c6ffd640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75b0003ef0 0x7f75b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:16.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.591+0000 7f75c77fe640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c80a50e0 0x7f75b0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:16.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.591+0000 7f75c7fff640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75b0004d00 0x7f75b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:16.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.591+0000 7f75c6ffd640 1 -- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c80a50e0 msgr2=0x7f75b0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:16.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.591+0000 7f75c6ffd640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c80a50e0 0x7f75b0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.591+0000 7f75c6ffd640 1 -- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75b0004d00 msgr2=0x7f75b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:16.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.591+0000 7f75c6ffd640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75b0004d00 0x7f75b0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.591+0000 7f75c6ffd640 1 -- 172.21.15.91:0/90578975 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0003520 con 0x7f75b0003ef0 2023-11-27T20:42:16.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.591+0000 7f75c77fe640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c80a50e0 0x7f75b0003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:16.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.592+0000 7f75c6ffd640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75b0003ef0 0x7f75b00047c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009a90 tx=0x7f75b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf552248df2a158d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:16.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.592+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc02c680 con 0x7f75b0003ef0 2023-11-27T20:42:16.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.592+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc02c7e0 con 0x7f75b0003ef0 2023-11-27T20:42:16.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.592+0000 7f75c67fc640 1 -- 172.21.15.91:0/90578975 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc02cb90 con 0x7f75b0003ef0 2023-11-27T20:42:16.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.593+0000 7f75cdf39640 1 -- 172.21.15.91:0/90578975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75b0003ef0 msgr2=0x7f75b00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:16.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.593+0000 7f75cdf39640 1 --2- 172.21.15.91:0/90578975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75b0003ef0 0x7f75b00047c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009a90 tx=0x7f75b00057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.593+0000 7f75c7fff640 1 -- 172.21.15.91:0/90578975 reap_dead start 2023-11-27T20:42:16.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.593+0000 7f75cdf39640 1 -- 172.21.15.91:0/90578975 shutdown_connections 2023-11-27T20:42:16.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.593+0000 7f75cdf39640 1 -- 172.21.15.91:0/90578975 >> 172.21.15.91:0/90578975 conn(0x7f75c80a7970 msgr2=0x7f75c80a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:16.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.593+0000 7f75cdf39640 1 -- 172.21.15.91:0/90578975 shutdown_connections 2023-11-27T20:42:16.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.593+0000 7f75cdf39640 1 -- 172.21.15.91:0/90578975 wait complete. 2023-11-27T20:42:16.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.595+0000 7f75cdf39640 1 Processor -- start 2023-11-27T20:42:16.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.595+0000 7f75cdf39640 1 -- start start 2023-11-27T20:42:16.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75cdf39640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75b0003ef0 0x7f75c806d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:16.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75cdf39640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75c814ad50 0x7f75c814b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:16.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75cdf39640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c81eb5d0 0x7f75c81eba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:16.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75cdf39640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80a9b70 con 0x7f75c814ad50 2023-11-27T20:42:16.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75cdf39640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80a9890 con 0x7f75b0003ef0 2023-11-27T20:42:16.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75cdf39640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c81516a0 con 0x7f75c81eb5d0 2023-11-27T20:42:16.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75c6ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75c814ad50 0x7f75c814b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:16.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75c6ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75c814ad50 0x7f75c814b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43634/0 (socket says 172.21.15.91:43634) 2023-11-27T20:42:16.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75c6ffd640 1 -- 172.21.15.91:0/2314472449 learned_addr learned my addr 172.21.15.91:0/2314472449 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:16.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75c77fe640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75b0003ef0 0x7f75c806d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:16.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.596+0000 7f75c7fff640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c81eb5d0 0x7f75c81eba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:16.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75c6ffd640 1 -- 172.21.15.91:0/2314472449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c81eb5d0 msgr2=0x7f75c81eba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:16.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75c6ffd640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c81eb5d0 0x7f75c81eba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75c6ffd640 1 -- 172.21.15.91:0/2314472449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75b0003ef0 msgr2=0x7f75c806d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:16.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75c6ffd640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75b0003ef0 0x7f75c806d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75c6ffd640 1 -- 172.21.15.91:0/2314472449 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8151980 con 0x7f75c814ad50 2023-11-27T20:42:16.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75c6ffd640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75c814ad50 0x7f75c814b1b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f75bc037040 tx=0x7f75bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:16.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75affff640 1 -- 172.21.15.91:0/2314472449 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0349d0 con 0x7f75c814ad50 2023-11-27T20:42:16.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75affff640 1 -- 172.21.15.91:0/2314472449 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc034b30 con 0x7f75c814ad50 2023-11-27T20:42:16.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75affff640 1 -- 172.21.15.91:0/2314472449 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc03e400 con 0x7f75c814ad50 2023-11-27T20:42:16.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75cdf39640 1 -- 172.21.15.91:0/2314472449 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c8151c60 con 0x7f75c814ad50 2023-11-27T20:42:16.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.597+0000 7f75cdf39640 1 -- 172.21.15.91:0/2314472449 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c81e5950 con 0x7f75c814ad50 2023-11-27T20:42:16.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.599+0000 7f75cdf39640 1 -- 172.21.15.91:0/2314472449 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c8067e50 con 0x7f75c814ad50 2023-11-27T20:42:16.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.599+0000 7f75affff640 1 -- 172.21.15.91:0/2314472449 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f75bc03e560 con 0x7f75c814ad50 2023-11-27T20:42:16.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.600+0000 7f75affff640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f75b406b1f0 0x7f75b406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:16.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.600+0000 7f75affff640 1 -- 172.21.15.91:0/2314472449 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5833+0+0 (secure 0 0 0) 0x7f75bc0aba50 con 0x7f75c814ad50 2023-11-27T20:42:16.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.601+0000 7f75c77fe640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f75b406b1f0 0x7f75b406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:16.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.601+0000 7f75c77fe640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f75b406b1f0 0x7f75b406d6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009b20 tx=0x7f75b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:16.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.605+0000 7f75affff640 1 -- 172.21.15.91:0/2314472449 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f75bc0768c0 con 0x7f75c814ad50 2023-11-27T20:42:16.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.832+0000 7f75cdf39640 1 -- 172.21.15.91:0/2314472449 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75c80a9b70 con 0x7f75c814ad50 2023-11-27T20:42:16.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.834+0000 7f75affff640 1 -- 172.21.15.91:0/2314472449 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f75bc039090 con 0x7f75c814ad50 2023-11-27T20:42:16.835 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:16.835 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/636329462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":636329462},{"type":"v1","addr":"172.21.15.91:6836","nonce":636329462}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/433109070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":433109070},{"type":"v1","addr":"172.21.15.91:6837","nonce":433109070}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1419226381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1419226381},{"type":"v1","addr":"172.21.15.183:6835","nonce":1419226381}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:41:34.815589+0000","modified":"2023-11-27T20:41:37.881858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/4022772138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4022772138},{"type":"v1","addr":"172.21.15.183:6834","nonce":4022772138}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:42:16.835 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 8 2023-11-27T20:42:16.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.836+0000 7f75cdf39640 1 -- 172.21.15.91:0/2314472449 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f75b406b1f0 msgr2=0x7f75b406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:16.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.836+0000 7f75cdf39640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f75b406b1f0 0x7f75b406d6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009b20 tx=0x7f75b8008040 comp rx=0 tx=0).stop 2023-11-27T20:42:16.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.836+0000 7f75cdf39640 1 -- 172.21.15.91:0/2314472449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75c814ad50 msgr2=0x7f75c814b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:16.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.836+0000 7f75cdf39640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75c814ad50 0x7f75c814b1b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f75bc037040 tx=0x7f75bc004730 comp rx=0 tx=0).stop 2023-11-27T20:42:16.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.836+0000 7f75cdf39640 1 -- 172.21.15.91:0/2314472449 shutdown_connections 2023-11-27T20:42:16.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.836+0000 7f75cdf39640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75c81eb5d0 0x7f75c81eba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.836+0000 7f75cdf39640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75c814ad50 0x7f75c814b1b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.836+0000 7f75cdf39640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f75b406b1f0 0x7f75b406d6b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.836+0000 7f75cdf39640 1 --2- 172.21.15.91:0/2314472449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75b0003ef0 0x7f75c806d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:16.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.836+0000 7f75cdf39640 1 -- 172.21.15.91:0/2314472449 >> 172.21.15.91:0/2314472449 conn(0x7f75c80a7970 msgr2=0x7f75c814e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:16.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.837+0000 7f75cdf39640 1 -- 172.21.15.91:0/2314472449 shutdown_connections 2023-11-27T20:42:16.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:16.837+0000 7f75cdf39640 1 -- 172.21.15.91:0/2314472449 wait complete. 2023-11-27T20:42:16.856 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:17.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.066+0000 7f3800cdf640 1 Processor -- start 2023-11-27T20:42:17.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.066+0000 7f3800cdf640 1 -- start start 2023-11-27T20:42:17.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.067+0000 7f3800cdf640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f37fc14e7f0 0x7f37fc0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.067+0000 7f3800cdf640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f37fc0c52e0 0x7f37fc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.067+0000 7f3800cdf640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc0a8380 con 0x7f37fc06cd20 2023-11-27T20:42:17.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.067+0000 7f3800cdf640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc1510b0 con 0x7f37fc14e7f0 2023-11-27T20:42:17.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.067+0000 7f3800cdf640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc06bf60 con 0x7f37fc0c52e0 2023-11-27T20:42:17.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.067+0000 7f37fb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f37fc14e7f0 0x7f37fc0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.068+0000 7f37fbfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f37fc06cd20 0x7f37fc1546a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53952/0 (socket says 172.21.15.91:53952) 2023-11-27T20:42:17.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.068+0000 7f37fb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f37fc14e7f0 0x7f37fc0c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43640/0 (socket says 172.21.15.91:43640) 2023-11-27T20:42:17.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.068+0000 7f37fbfff640 1 -- 172.21.15.91:0/3354932055 learned_addr learned my addr 172.21.15.91:0/3354932055 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:17.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.068+0000 7f37f3fff640 1 --2- 172.21.15.91:0/3354932055 >> v2:172.21.15.183:3300/0 conn(0x7f37fc0c52e0 0x7f37fc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.068+0000 7f37fb7fe640 1 -- 172.21.15.91:0/3354932055 >> v2:172.21.15.183:3300/0 conn(0x7f37fc0c52e0 msgr2=0x7f37fc06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:17.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.068+0000 7f37fb7fe640 1 --2- 172.21.15.91:0/3354932055 >> v2:172.21.15.183:3300/0 conn(0x7f37fc0c52e0 0x7f37fc06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.068+0000 7f37fb7fe640 1 -- 172.21.15.91:0/3354932055 >> v1:172.21.15.91:6789/0 conn(0x7f37fc06cd20 legacy=0x7f37fc1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.068+0000 7f37fb7fe640 1 -- 172.21.15.91:0/3354932055 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc06c240 con 0x7f37fc14e7f0 2023-11-27T20:42:17.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.068+0000 7f37faffd640 1 -- 172.21.15.91:0/3354932055 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382371657 0 0) 0x7f37fc0a8380 con 0x7f37fc06cd20 2023-11-27T20:42:17.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.069+0000 7f37fb7fe640 1 --2- 172.21.15.91:0/3354932055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc14e7f0 0x7f37fc0c0440 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f37fc06f680 tx=0x7f37ec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160fb8286bcbe4a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:17.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.069+0000 7f37faffd640 1 -- 172.21.15.91:0/3354932055 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec02e070 con 0x7f37fc14e7f0 2023-11-27T20:42:17.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.070+0000 7f37faffd640 1 -- 172.21.15.91:0/3354932055 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ec0315a0 con 0x7f37fc14e7f0 2023-11-27T20:42:17.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.070+0000 7f37faffd640 1 -- 172.21.15.91:0/3354932055 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec031930 con 0x7f37fc14e7f0 2023-11-27T20:42:17.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.070+0000 7f3800cdf640 1 -- 172.21.15.91:0/3354932055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc14e7f0 msgr2=0x7f37fc0c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.070+0000 7f3800cdf640 1 --2- 172.21.15.91:0/3354932055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc14e7f0 0x7f37fc0c0440 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f37fc06f680 tx=0x7f37ec02b840 comp rx=0 tx=0).stop 2023-11-27T20:42:17.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.070+0000 7f3800cdf640 1 -- 172.21.15.91:0/3354932055 shutdown_connections 2023-11-27T20:42:17.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.070+0000 7f3800cdf640 1 --2- 172.21.15.91:0/3354932055 >> v2:172.21.15.183:3300/0 conn(0x7f37fc0c52e0 0x7f37fc06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.070+0000 7f3800cdf640 1 --2- 172.21.15.91:0/3354932055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc14e7f0 0x7f37fc0c0440 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.070+0000 7f3800cdf640 1 -- 172.21.15.91:0/3354932055 >> 172.21.15.91:0/3354932055 conn(0x7f37fc0a77f0 msgr2=0x7f37fc0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:17.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.070+0000 7f3800cdf640 1 -- 172.21.15.91:0/3354932055 shutdown_connections 2023-11-27T20:42:17.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.070+0000 7f3800cdf640 1 -- 172.21.15.91:0/3354932055 wait complete. 2023-11-27T20:42:17.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.072+0000 7f3800cdf640 1 Processor -- start 2023-11-27T20:42:17.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.072+0000 7f3800cdf640 1 -- start start 2023-11-27T20:42:17.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.073+0000 7f3800cdf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc06cd20 0x7f37fc14c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.073+0000 7f3800cdf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc0c52e0 0x7f37fc147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.073+0000 7f3800cdf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc14e7f0 0x7f37fc1eb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.073+0000 7f3800cdf640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc0ab1d0 con 0x7f37fc0c52e0 2023-11-27T20:42:17.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.073+0000 7f3800cdf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc0ab750 con 0x7f37fc14e7f0 2023-11-27T20:42:17.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.073+0000 7f3800cdf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc14d260 con 0x7f37fc06cd20 2023-11-27T20:42:17.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.073+0000 7f37f3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc0c52e0 0x7f37fc147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.073+0000 7f37f3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc0c52e0 0x7f37fc147db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43646/0 (socket says 172.21.15.91:43646) 2023-11-27T20:42:17.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.073+0000 7f37f3fff640 1 -- 172.21.15.91:0/678341467 learned_addr learned my addr 172.21.15.91:0/678341467 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:17.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37fbfff640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc14e7f0 0x7f37fc1eb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37fb7fe640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc06cd20 0x7f37fc14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37f3fff640 1 -- 172.21.15.91:0/678341467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc06cd20 msgr2=0x7f37fc14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37f3fff640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc06cd20 0x7f37fc14c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37f3fff640 1 -- 172.21.15.91:0/678341467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc14e7f0 msgr2=0x7f37fc1eb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37f3fff640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc14e7f0 0x7f37fc1eb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37f3fff640 1 -- 172.21.15.91:0/678341467 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec009400 con 0x7f37fc0c52e0 2023-11-27T20:42:17.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37fbfff640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc14e7f0 0x7f37fc1eb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:17.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37f3fff640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc0c52e0 0x7f37fc147db0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37e400d800 tx=0x7f37e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:17.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37f8ff9640 1 -- 172.21.15.91:0/678341467 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400b6c0 con 0x7f37fc0c52e0 2023-11-27T20:42:17.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37f8ff9640 1 -- 172.21.15.91:0/678341467 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e400b820 con 0x7f37fc0c52e0 2023-11-27T20:42:17.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f37f8ff9640 1 -- 172.21.15.91:0/678341467 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400bbb0 con 0x7f37fc0c52e0 2023-11-27T20:42:17.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.074+0000 7f3800cdf640 1 -- 172.21.15.91:0/678341467 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc14d540 con 0x7f37fc0c52e0 2023-11-27T20:42:17.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.075+0000 7f3800cdf640 1 -- 172.21.15.91:0/678341467 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc14cda0 con 0x7f37fc0c52e0 2023-11-27T20:42:17.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.076+0000 7f3800cdf640 1 -- 172.21.15.91:0/678341467 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc06dd30 con 0x7f37fc0c52e0 2023-11-27T20:42:17.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.077+0000 7f37f8ff9640 1 -- 172.21.15.91:0/678341467 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f37e400bd10 con 0x7f37fc0c52e0 2023-11-27T20:42:17.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.077+0000 7f37f8ff9640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37dc06b1c0 0x7f37dc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.078+0000 7f37f8ff9640 1 -- 172.21.15.91:0/678341467 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5833+0+0 (secure 0 0 0) 0x7f37e408a000 con 0x7f37fc0c52e0 2023-11-27T20:42:17.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.078+0000 7f37fb7fe640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37dc06b1c0 0x7f37dc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.079+0000 7f37fb7fe640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37dc06b1c0 0x7f37dc06d680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f37ec036000 tx=0x7f37ec03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:17.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.082+0000 7f37f8ff9640 1 -- 172.21.15.91:0/678341467 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f37e4054cb0 con 0x7f37fc0c52e0 2023-11-27T20:42:17.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.281+0000 7f3800cdf640 1 -- 172.21.15.91:0/678341467 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37fc04e840 con 0x7f37fc0c52e0 2023-11-27T20:42:17.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.282+0000 7f37f8ff9640 1 -- 172.21.15.91:0/678341467 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16678 (secure 0 0 0) 0x7f37e40582d0 con 0x7f37fc0c52e0 2023-11-27T20:42:17.284 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:17.284 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":22,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:42:17.184370+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1},{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:17.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 -- 172.21.15.91:0/678341467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37dc06b1c0 msgr2=0x7f37dc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37dc06b1c0 0x7f37dc06d680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f37ec036000 tx=0x7f37ec03d040 comp rx=0 tx=0).stop 2023-11-27T20:42:17.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 -- 172.21.15.91:0/678341467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc0c52e0 msgr2=0x7f37fc147db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc0c52e0 0x7f37fc147db0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37e400d800 tx=0x7f37e400dcc0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 -- 172.21.15.91:0/678341467 shutdown_connections 2023-11-27T20:42:17.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37dc06b1c0 0x7f37dc06d680 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc14e7f0 0x7f37fc1eb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37fc0c52e0 0x7f37fc147db0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 --2- 172.21.15.91:0/678341467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc06cd20 0x7f37fc14c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 -- 172.21.15.91:0/678341467 >> 172.21.15.91:0/678341467 conn(0x7f37fc0a77f0 msgr2=0x7f37fc0c41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:17.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 -- 172.21.15.91:0/678341467 shutdown_connections 2023-11-27T20:42:17.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.285+0000 7f3800cdf640 1 -- 172.21.15.91:0/678341467 wait complete. 2023-11-27T20:42:17.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:41:32.704555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:41:33.818847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:42:17.306 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:42:17.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.507+0000 7fd3eedd7640 1 Processor -- start 2023-11-27T20:42:17.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.507+0000 7fd3eedd7640 1 -- start start 2023-11-27T20:42:17.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.508+0000 7fd3eedd7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd3e8155490 0x7fd3e80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.508+0000 7fd3eedd7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3e80a9b40 0x7fd3e80c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.508+0000 7fd3eedd7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e80c06c0 con 0x7fd3e80c1500 2023-11-27T20:42:17.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.508+0000 7fd3eedd7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e80a5820 con 0x7fd3e8155490 2023-11-27T20:42:17.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.508+0000 7fd3eedd7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80c1020 con 0x7fd3e80a9b40 2023-11-27T20:42:17.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.509+0000 7fd3ed374640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3e80a9b40 0x7fd3e80c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.509+0000 7fd3e7fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fd3e80c1500 0x7fd3e80a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:40446/0 (socket says 172.21.15.91:40446) 2023-11-27T20:42:17.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.509+0000 7fd3e7fff640 1 -- 172.21.15.91:0/1190210081 learned_addr learned my addr 172.21.15.91:0/1190210081 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:17.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.510+0000 7fd3ecb73640 1 --2- 172.21.15.91:0/1190210081 >> v2:172.21.15.183:3300/0 conn(0x7fd3e8155490 0x7fd3e80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.510+0000 7fd3e77fe640 1 -- 172.21.15.91:0/1190210081 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251207864 0 0) 0x7fd3e80c06c0 con 0x7fd3e80c1500 2023-11-27T20:42:17.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.510+0000 7fd3ecb73640 1 -- 172.21.15.91:0/1190210081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3e80a9b40 msgr2=0x7fd3e80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:17.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.511+0000 7fd3ecb73640 1 --2- 172.21.15.91:0/1190210081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3e80a9b40 0x7fd3e80c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.511+0000 7fd3ecb73640 1 -- 172.21.15.91:0/1190210081 >> v1:172.21.15.183:6789/0 conn(0x7fd3e80c1500 legacy=0x7fd3e80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.511+0000 7fd3ecb73640 1 -- 172.21.15.91:0/1190210081 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e80c0910 con 0x7fd3e8155490 2023-11-27T20:42:17.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.511+0000 7fd3ed374640 1 --2- 172.21.15.91:0/1190210081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3e80a9b40 0x7fd3e80c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:42:17.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.512+0000 7fd3ecb73640 1 --2- 172.21.15.91:0/1190210081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3e8155490 0x7fd3e80a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0097a0 tx=0x7fd3dc02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df8afdd2be13cdc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:17.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.513+0000 7fd3e77fe640 1 -- 172.21.15.91:0/1190210081 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc02d040 con 0x7fd3e8155490 2023-11-27T20:42:17.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.513+0000 7fd3e77fe640 1 -- 172.21.15.91:0/1190210081 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc031810 con 0x7fd3e8155490 2023-11-27T20:42:17.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.513+0000 7fd3e77fe640 1 -- 172.21.15.91:0/1190210081 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc031ba0 con 0x7fd3e8155490 2023-11-27T20:42:17.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.514+0000 7fd3eedd7640 1 -- 172.21.15.91:0/1190210081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3e8155490 msgr2=0x7fd3e80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.514+0000 7fd3eedd7640 1 --2- 172.21.15.91:0/1190210081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3e8155490 0x7fd3e80a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0097a0 tx=0x7fd3dc02b8b0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.514+0000 7fd3eedd7640 1 -- 172.21.15.91:0/1190210081 shutdown_connections 2023-11-27T20:42:17.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.514+0000 7fd3eedd7640 1 --2- 172.21.15.91:0/1190210081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3e80a9b40 0x7fd3e80c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.514+0000 7fd3eedd7640 1 --2- 172.21.15.91:0/1190210081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3e8155490 0x7fd3e80a51b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.514+0000 7fd3eedd7640 1 -- 172.21.15.91:0/1190210081 >> 172.21.15.91:0/1190210081 conn(0x7fd3e806a500 msgr2=0x7fd3e806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:17.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.514+0000 7fd3eedd7640 1 -- 172.21.15.91:0/1190210081 shutdown_connections 2023-11-27T20:42:17.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.514+0000 7fd3eedd7640 1 -- 172.21.15.91:0/1190210081 wait complete. 2023-11-27T20:42:17.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.516+0000 7fd3eedd7640 1 Processor -- start 2023-11-27T20:42:17.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.516+0000 7fd3eedd7640 1 -- start start 2023-11-27T20:42:17.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3eedd7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3e80c1500 0x7fd3e80714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3eedd7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3e8155490 0x7fd3e80bc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3eedd7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3e8071a00 0x7fd3e80bc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3eedd7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8152a10 con 0x7fd3e8071a00 2023-11-27T20:42:17.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3eedd7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80bcd00 con 0x7fd3e80c1500 2023-11-27T20:42:17.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3eedd7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e815d430 con 0x7fd3e8155490 2023-11-27T20:42:17.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3ed374640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3e8071a00 0x7fd3e80bc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3ed374640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3e8071a00 0x7fd3e80bc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43662/0 (socket says 172.21.15.91:43662) 2023-11-27T20:42:17.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3ed374640 1 -- 172.21.15.91:0/2481003082 learned_addr learned my addr 172.21.15.91:0/2481003082 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:17.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3ecb73640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3e80c1500 0x7fd3e80714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3ed374640 1 -- 172.21.15.91:0/2481003082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3e8155490 msgr2=0x7fd3e80bc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3ed374640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3e8155490 0x7fd3e80bc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3ed374640 1 -- 172.21.15.91:0/2481003082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3e80c1500 msgr2=0x7fd3e80714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3ed374640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3e80c1500 0x7fd3e80714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.517+0000 7fd3ed374640 1 -- 172.21.15.91:0/2481003082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0009a70 con 0x7fd3e8071a00 2023-11-27T20:42:17.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.518+0000 7fd3ed374640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3e8071a00 0x7fd3e80bc7c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000efc0 tx=0x7fd3e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:17.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.518+0000 7fd3e57fa640 1 -- 172.21.15.91:0/2481003082 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0014480 con 0x7fd3e8071a00 2023-11-27T20:42:17.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.518+0000 7fd3e57fa640 1 -- 172.21.15.91:0/2481003082 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e000f040 con 0x7fd3e8071a00 2023-11-27T20:42:17.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.518+0000 7fd3e57fa640 1 -- 172.21.15.91:0/2481003082 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0014840 con 0x7fd3e8071a00 2023-11-27T20:42:17.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.518+0000 7fd3eedd7640 1 -- 172.21.15.91:0/2481003082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc009400 con 0x7fd3e8071a00 2023-11-27T20:42:17.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.518+0000 7fd3eedd7640 1 -- 172.21.15.91:0/2481003082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e80bda60 con 0x7fd3e8071a00 2023-11-27T20:42:17.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.519+0000 7fd3eedd7640 1 -- 172.21.15.91:0/2481003082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e8068350 con 0x7fd3e8071a00 2023-11-27T20:42:17.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.520+0000 7fd3e57fa640 1 -- 172.21.15.91:0/2481003082 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd3e00149a0 con 0x7fd3e8071a00 2023-11-27T20:42:17.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.522+0000 7fd3e57fa640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3cc06b1f0 0x7fd3cc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.522+0000 7fd3e57fa640 1 -- 172.21.15.91:0/2481003082 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5833+0+0 (secure 0 0 0) 0x7fd3e008a940 con 0x7fd3e8071a00 2023-11-27T20:42:17.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.522+0000 7fd3ecb73640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3cc06b1f0 0x7fd3cc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.523+0000 7fd3ecb73640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3cc06b1f0 0x7fd3cc06d6b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc036000 tx=0x7fd3dc03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:17.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.526+0000 7fd3e57fa640 1 -- 172.21.15.91:0/2481003082 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd3e0055680 con 0x7fd3e8071a00 2023-11-27T20:42:17.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.718+0000 7fd3eedd7640 1 -- 172.21.15.91:0/2481003082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3e80c4750 con 0x7fd3e8071a00 2023-11-27T20:42:17.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.719+0000 7fd3e57fa640 1 -- 172.21.15.91:0/2481003082 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3e0018020 con 0x7fd3e8071a00 2023-11-27T20:42:17.720 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:42:17.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.721+0000 7fd3eedd7640 1 -- 172.21.15.91:0/2481003082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3cc06b1f0 msgr2=0x7fd3cc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.721+0000 7fd3eedd7640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3cc06b1f0 0x7fd3cc06d6b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc036000 tx=0x7fd3dc03c040 comp rx=0 tx=0).stop 2023-11-27T20:42:17.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.721+0000 7fd3eedd7640 1 -- 172.21.15.91:0/2481003082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3e8071a00 msgr2=0x7fd3e80bc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.721+0000 7fd3eedd7640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3e8071a00 0x7fd3e80bc7c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000efc0 tx=0x7fd3e000c490 comp rx=0 tx=0).stop 2023-11-27T20:42:17.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.722+0000 7fd3eedd7640 1 -- 172.21.15.91:0/2481003082 shutdown_connections 2023-11-27T20:42:17.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.722+0000 7fd3eedd7640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3e8071a00 0x7fd3e80bc7c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.722+0000 7fd3eedd7640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3e8155490 0x7fd3e80bc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.722+0000 7fd3eedd7640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3cc06b1f0 0x7fd3cc06d6b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.722+0000 7fd3eedd7640 1 --2- 172.21.15.91:0/2481003082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3e80c1500 0x7fd3e80714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.722+0000 7fd3eedd7640 1 -- 172.21.15.91:0/2481003082 >> 172.21.15.91:0/2481003082 conn(0x7fd3e806a500 msgr2=0x7fd3e806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:17.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.722+0000 7fd3eedd7640 1 -- 172.21.15.91:0/2481003082 shutdown_connections 2023-11-27T20:42:17.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.722+0000 7fd3eedd7640 1 -- 172.21.15.91:0/2481003082 wait complete. 2023-11-27T20:42:17.742 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:42:17.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.956+0000 7f5eafc7c640 1 Processor -- start 2023-11-27T20:42:17.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.956+0000 7f5eafc7c640 1 -- start start 2023-11-27T20:42:17.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.957+0000 7f5eafc7c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5ea80c7fc0 0x7f5ea80c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.957+0000 7f5eafc7c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea80c1da0 con 0x7f5ea80c7700 2023-11-27T20:42:17.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.957+0000 7f5eafc7c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea80c2080 con 0x7f5ea8155790 2023-11-27T20:42:17.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.957+0000 7f5eafc7c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea80c3ee0 con 0x7f5ea80c7fc0 2023-11-27T20:42:17.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.958+0000 7f5ead217640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f5ea80c7700 0x7f5ea8155080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53962/0 (socket says 172.21.15.91:53962) 2023-11-27T20:42:17.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.958+0000 7f5ead217640 1 -- 172.21.15.91:0/843154546 learned_addr learned my addr 172.21.15.91:0/843154546 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:17.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.958+0000 7f5eada18640 1 --2- 172.21.15.91:0/843154546 >> v2:172.21.15.183:3300/0 conn(0x7f5ea80c7fc0 0x7f5ea80c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.958+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934963622 0 0) 0x7f5ea80c1da0 con 0x7f5ea80c7700 2023-11-27T20:42:17.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.958+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e90003520 con 0x7f5ea80c7700 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.958+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2104321018 0 0) 0x7f5e90003520 con 0x7f5ea80c7700 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.958+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 >> v2:172.21.15.183:3300/0 conn(0x7f5ea80c7fc0 msgr2=0x7f5ea80c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.958+0000 7f5eaca16640 1 --2- 172.21.15.91:0/843154546 >> v2:172.21.15.183:3300/0 conn(0x7f5ea80c7fc0 0x7f5ea80c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 >> v1:172.21.15.183:6789/0 conn(0x7f5ea8155790 legacy=0x7f5ea80c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80c5d60 con 0x7f5ea80c7700 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f5e9c001670 con 0x7f5ea80c7700 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 >> v1:172.21.15.91:6789/0 conn(0x7f5ea80c7700 legacy=0x7f5ea8155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eaca16640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e90003970 0x7f5e90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eaca16640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5e90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eaca16640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e90005180 0x7f5e9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80c3ee0 con 0x7f5e900047c0 2023-11-27T20:42:17.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9000c120 con 0x7f5e90005180 2023-11-27T20:42:17.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9000c2e0 con 0x7f5e90003970 2023-11-27T20:42:17.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5ead217640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5e90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.959+0000 7f5eada18640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e90003970 0x7f5e90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.960+0000 7f5ead217640 1 -- 172.21.15.91:0/843154546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e90003970 msgr2=0x7f5e90003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:17.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.960+0000 7f5ead217640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e90003970 0x7f5e90003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.960+0000 7f5ead217640 1 -- 172.21.15.91:0/843154546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e90005180 msgr2=0x7f5e9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:17.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.960+0000 7f5ead217640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e90005180 0x7f5e9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.960+0000 7f5ead217640 1 -- 172.21.15.91:0/843154546 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e90003520 con 0x7f5e900047c0 2023-11-27T20:42:17.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.960+0000 7f5eae219640 1 -- 172.21.15.91:0/843154546 reap_dead start 2023-11-27T20:42:17.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.960+0000 7f5eada18640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e90003970 0x7f5e90003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:17.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.961+0000 7f5ead217640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5e90004c40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8158f00 tx=0x7f5e900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb361d8eced03da server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.961+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c005ad0 con 0x7f5e900047c0 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.961+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c005c50 con 0x7f5e900047c0 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.961+0000 7f5eaca16640 1 -- 172.21.15.91:0/843154546 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c02c850 con 0x7f5e900047c0 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.961+0000 7f5eafc7c640 1 -- 172.21.15.91:0/843154546 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 msgr2=0x7f5e90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.961+0000 7f5eafc7c640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5e90004c40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8158f00 tx=0x7f5e900057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.962+0000 7f5eafc7c640 1 -- 172.21.15.91:0/843154546 shutdown_connections 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.962+0000 7f5eafc7c640 1 --2- 172.21.15.91:0/843154546 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5e90004c40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.962+0000 7f5eafc7c640 1 -- 172.21.15.91:0/843154546 >> 172.21.15.91:0/843154546 conn(0x7f5ea80a9b70 msgr2=0x7f5ea80a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.962+0000 7f5eafc7c640 1 -- 172.21.15.91:0/843154546 shutdown_connections 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.962+0000 7f5eafc7c640 1 -- 172.21.15.91:0/843154546 wait complete. 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.963+0000 7f5eafc7c640 1 Processor -- start 2023-11-27T20:42:17.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.964+0000 7f5eafc7c640 1 -- start start 2023-11-27T20:42:17.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.964+0000 7f5eafc7c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5ea81de2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.964+0000 7f5eafc7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81e0ac0 0x7f5ea80abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.964+0000 7f5eafc7c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea81df760 0x7f5ea80ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.964+0000 7f5eafc7c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80c7b90 con 0x7f5e900047c0 2023-11-27T20:42:17.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.964+0000 7f5eafc7c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80acfa0 con 0x7f5ea81df760 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.965+0000 7f5eafc7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80ad280 con 0x7f5ea81e0ac0 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.965+0000 7f5eada18640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5ea81de2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.965+0000 7f5eada18640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5ea81de2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43674/0 (socket says 172.21.15.91:43674) 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.965+0000 7f5eada18640 1 -- 172.21.15.91:0/3987673191 learned_addr learned my addr 172.21.15.91:0/3987673191 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.965+0000 7f5eada18640 1 -- 172.21.15.91:0/3987673191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81e0ac0 msgr2=0x7f5ea80abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.965+0000 7f5ead217640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81e0ac0 0x7f5ea80abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.965+0000 7f5eada18640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81e0ac0 0x7f5ea80abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.965+0000 7f5eada18640 1 -- 172.21.15.91:0/3987673191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea81df760 msgr2=0x7f5ea80ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.965+0000 7f5eada18640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea81df760 0x7f5ea80ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.965+0000 7f5eada18640 1 -- 172.21.15.91:0/3987673191 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80ab240 con 0x7f5e900047c0 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.966+0000 7f5eada18640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5ea81de2d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800f3b0 tx=0x7f5e9800f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:17.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.966+0000 7f5ea67fc640 1 -- 172.21.15.91:0/3987673191 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9801a070 con 0x7f5e900047c0 2023-11-27T20:42:17.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.966+0000 7f5ea67fc640 1 -- 172.21.15.91:0/3987673191 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e98003990 con 0x7f5e900047c0 2023-11-27T20:42:17.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.966+0000 7f5ea67fc640 1 -- 172.21.15.91:0/3987673191 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e98003d00 con 0x7f5e900047c0 2023-11-27T20:42:17.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.966+0000 7f5eafc7c640 1 -- 172.21.15.91:0/3987673191 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea80ab520 con 0x7f5e900047c0 2023-11-27T20:42:17.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.966+0000 7f5eafc7c640 1 -- 172.21.15.91:0/3987673191 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea81de810 con 0x7f5e900047c0 2023-11-27T20:42:17.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.967+0000 7f5eafc7c640 1 -- 172.21.15.91:0/3987673191 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea8068350 con 0x7f5e900047c0 2023-11-27T20:42:17.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.968+0000 7f5ea67fc640 1 -- 172.21.15.91:0/3987673191 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5e98004020 con 0x7f5e900047c0 2023-11-27T20:42:17.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.969+0000 7f5ea67fc640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e9406b1c0 0x7f5e9406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:17.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.970+0000 7f5ea67fc640 1 -- 172.21.15.91:0/3987673191 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5833+0+0 (secure 0 0 0) 0x7f5e9808a5e0 con 0x7f5e900047c0 2023-11-27T20:42:17.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.970+0000 7f5ead217640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e9406b1c0 0x7f5e9406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:17.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.970+0000 7f5ead217640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e9406b1c0 0x7f5e9406d680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c034000 tx=0x7f5e9c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:17.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:17.974+0000 7f5ea67fc640 1 -- 172.21.15.91:0/3987673191 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5e98055280 con 0x7f5e900047c0 2023-11-27T20:42:18.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.163+0000 7f5eafc7c640 1 -- 172.21.15.91:0/3987673191 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ea80c2c80 con 0x7f5e900047c0 2023-11-27T20:42:18.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.164+0000 7f5ea67fc640 1 -- 172.21.15.91:0/3987673191 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e98003e60 con 0x7f5e900047c0 2023-11-27T20:42:18.165 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:42:18.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 -- 172.21.15.91:0/3987673191 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e9406b1c0 msgr2=0x7f5e9406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e9406b1c0 0x7f5e9406d680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c034000 tx=0x7f5e9c009030 comp rx=0 tx=0).stop 2023-11-27T20:42:18.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 -- 172.21.15.91:0/3987673191 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 msgr2=0x7f5ea81de2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5ea81de2d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800f3b0 tx=0x7f5e9800f870 comp rx=0 tx=0).stop 2023-11-27T20:42:18.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 -- 172.21.15.91:0/3987673191 shutdown_connections 2023-11-27T20:42:18.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e9406b1c0 0x7f5e9406d680 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea81df760 0x7f5ea80ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81e0ac0 0x7f5ea80abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 --2- 172.21.15.91:0/3987673191 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e900047c0 0x7f5ea81de2d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 -- 172.21.15.91:0/3987673191 >> 172.21.15.91:0/3987673191 conn(0x7f5ea80a9b70 msgr2=0x7f5ea80a9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:18.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 -- 172.21.15.91:0/3987673191 shutdown_connections 2023-11-27T20:42:18.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.166+0000 7f5eafc7c640 1 -- 172.21.15.91:0/3987673191 wait complete. 2023-11-27T20:42:18.185 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:42:18.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.400+0000 7f2b6eff4640 1 Processor -- start 2023-11-27T20:42:18.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.400+0000 7f2b6eff4640 1 -- start start 2023-11-27T20:42:18.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.401+0000 7f2b6eff4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2b6814c2e0 0x7f2b680c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.401+0000 7f2b6eff4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b68071e80 con 0x7f2b68072310 2023-11-27T20:42:18.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.401+0000 7f2b6eff4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6814c6c0 con 0x7f2b680c0440 2023-11-27T20:42:18.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.401+0000 7f2b6eff4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b68071470 con 0x7f2b6814c2e0 2023-11-27T20:42:18.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.402+0000 7f2b6dff2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2b6814c2e0 0x7f2b680c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:18.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.402+0000 7f2b6e7f3640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2b68072310 0x7f2b680a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53976/0 (socket says 172.21.15.91:53976) 2023-11-27T20:42:18.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.402+0000 7f2b6e7f3640 1 -- 172.21.15.91:0/4144555611 learned_addr learned my addr 172.21.15.91:0/4144555611 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:18.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.402+0000 7f2b6dff2640 1 -- 172.21.15.91:0/4144555611 >> v1:172.21.15.183:6789/0 conn(0x7f2b680c0440 legacy=0x7f2b68152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:18.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.402+0000 7f2b6dff2640 1 -- 172.21.15.91:0/4144555611 >> v1:172.21.15.91:6789/0 conn(0x7f2b68072310 legacy=0x7f2b680a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.402+0000 7f2b6dff2640 1 -- 172.21.15.91:0/4144555611 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6806fdc0 con 0x7f2b6814c2e0 2023-11-27T20:42:18.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.402+0000 7f2b6cff0640 1 -- 172.21.15.91:0/4144555611 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284309645 0 0) 0x7f2b68071e80 con 0x7f2b68072310 2023-11-27T20:42:18.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.403+0000 7f2b6dff2640 1 --2- 172.21.15.91:0/4144555611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6814c2e0 0x7f2b680c0c80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2b640097a0 tx=0x7f2b6402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b3216945e42013 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:18.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.404+0000 7f2b6cff0640 1 -- 172.21.15.91:0/4144555611 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6402f050 con 0x7f2b6814c2e0 2023-11-27T20:42:18.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.404+0000 7f2b6cff0640 1 -- 172.21.15.91:0/4144555611 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64031700 con 0x7f2b6814c2e0 2023-11-27T20:42:18.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.404+0000 7f2b6cff0640 1 -- 172.21.15.91:0/4144555611 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64031a90 con 0x7f2b6814c2e0 2023-11-27T20:42:18.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.404+0000 7f2b6eff4640 1 -- 172.21.15.91:0/4144555611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6814c2e0 msgr2=0x7f2b680c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.404+0000 7f2b6eff4640 1 --2- 172.21.15.91:0/4144555611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6814c2e0 0x7f2b680c0c80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2b640097a0 tx=0x7f2b6402b7a0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.404+0000 7f2b6eff4640 1 -- 172.21.15.91:0/4144555611 shutdown_connections 2023-11-27T20:42:18.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.404+0000 7f2b6eff4640 1 --2- 172.21.15.91:0/4144555611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b6814c2e0 0x7f2b680c0c80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.404+0000 7f2b6eff4640 1 -- 172.21.15.91:0/4144555611 >> 172.21.15.91:0/4144555611 conn(0x7f2b680a77f0 msgr2=0x7f2b680a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:18.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.404+0000 7f2b6eff4640 1 -- 172.21.15.91:0/4144555611 shutdown_connections 2023-11-27T20:42:18.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.404+0000 7f2b6eff4640 1 -- 172.21.15.91:0/4144555611 wait complete. 2023-11-27T20:42:18.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.406+0000 7f2b6eff4640 1 Processor -- start 2023-11-27T20:42:18.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.406+0000 7f2b6eff4640 1 -- start start 2023-11-27T20:42:18.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.407+0000 7f2b6eff4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b68072310 0x7f2b68154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.407+0000 7f2b6eff4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b680c0440 0x7f2b680bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.407+0000 7f2b6eff4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6814c2e0 0x7f2b681ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.407+0000 7f2b6eff4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b681ea310 con 0x7f2b68072310 2023-11-27T20:42:18.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.407+0000 7f2b6eff4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b681e9fe0 con 0x7f2b680c0440 2023-11-27T20:42:18.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.407+0000 7f2b6eff4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b680a8a40 con 0x7f2b6814c2e0 2023-11-27T20:42:18.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.407+0000 7f2b6dff2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b68072310 0x7f2b68154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:18.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.407+0000 7f2b6dff2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b68072310 0x7f2b68154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43686/0 (socket says 172.21.15.91:43686) 2023-11-27T20:42:18.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.407+0000 7f2b6dff2640 1 -- 172.21.15.91:0/3302984112 learned_addr learned my addr 172.21.15.91:0/3302984112 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:18.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.408+0000 7f2b6dff2640 1 -- 172.21.15.91:0/3302984112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6814c2e0 msgr2=0x7f2b681ea7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.408+0000 7f2b6dff2640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6814c2e0 0x7f2b681ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.408+0000 7f2b6dff2640 1 -- 172.21.15.91:0/3302984112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b680c0440 msgr2=0x7f2b680bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.408+0000 7f2b6d7f1640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b680c0440 0x7f2b680bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.408+0000 7f2b6dff2640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b680c0440 0x7f2b680bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.408+0000 7f2b6dff2640 1 -- 172.21.15.91:0/3302984112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b64009400 con 0x7f2b68072310 2023-11-27T20:42:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.408+0000 7f2b6d7f1640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b680c0440 0x7f2b680bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.408+0000 7f2b6dff2640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b68072310 0x7f2b68154440 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2b640097a0 tx=0x7f2b640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.409+0000 7f2b5e7fc640 1 -- 172.21.15.91:0/3302984112 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64033c30 con 0x7f2b68072310 2023-11-27T20:42:18.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.409+0000 7f2b5e7fc640 1 -- 172.21.15.91:0/3302984112 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64033d90 con 0x7f2b68072310 2023-11-27T20:42:18.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.409+0000 7f2b5e7fc640 1 -- 172.21.15.91:0/3302984112 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6403d6b0 con 0x7f2b68072310 2023-11-27T20:42:18.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.409+0000 7f2b6eff4640 1 -- 172.21.15.91:0/3302984112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b680a8d20 con 0x7f2b68072310 2023-11-27T20:42:18.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.409+0000 7f2b6eff4640 1 -- 172.21.15.91:0/3302984112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b680a9000 con 0x7f2b68072310 2023-11-27T20:42:18.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.410+0000 7f2b6eff4640 1 -- 172.21.15.91:0/3302984112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b681ea150 con 0x7f2b68072310 2023-11-27T20:42:18.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.411+0000 7f2b5e7fc640 1 -- 172.21.15.91:0/3302984112 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2b6403a040 con 0x7f2b68072310 2023-11-27T20:42:18.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.412+0000 7f2b5e7fc640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2b4c06b1c0 0x7f2b4c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.412+0000 7f2b5e7fc640 1 -- 172.21.15.91:0/3302984112 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5833+0+0 (secure 0 0 0) 0x7f2b640ab820 con 0x7f2b68072310 2023-11-27T20:42:18.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.412+0000 7f2b6d7f1640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2b4c06b1c0 0x7f2b4c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:18.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.413+0000 7f2b6d7f1640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2b4c06b1c0 0x7f2b4c06d680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b680c51a0 tx=0x7f2b58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:18.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.416+0000 7f2b5e7fc640 1 -- 172.21.15.91:0/3302984112 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2b64076540 con 0x7f2b68072310 2023-11-27T20:42:18.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.613+0000 7f2b6eff4640 1 -- 172.21.15.91:0/3302984112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b6804e840 con 0x7f2b68072310 2023-11-27T20:42:18.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.614+0000 7f2b5e7fc640 1 -- 172.21.15.91:0/3302984112 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b64079b60 con 0x7f2b68072310 2023-11-27T20:42:18.615 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:42:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 -- 172.21.15.91:0/3302984112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2b4c06b1c0 msgr2=0x7f2b4c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2b4c06b1c0 0x7f2b4c06d680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b680c51a0 tx=0x7f2b58009040 comp rx=0 tx=0).stop 2023-11-27T20:42:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 -- 172.21.15.91:0/3302984112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b68072310 msgr2=0x7f2b68154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b68072310 0x7f2b68154440 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2b640097a0 tx=0x7f2b640046c0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 -- 172.21.15.91:0/3302984112 shutdown_connections 2023-11-27T20:42:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6814c2e0 0x7f2b681ea7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2b4c06b1c0 0x7f2b4c06d680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b680c0440 0x7f2b680bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 --2- 172.21.15.91:0/3302984112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b68072310 0x7f2b68154440 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 -- 172.21.15.91:0/3302984112 >> 172.21.15.91:0/3302984112 conn(0x7f2b680a77f0 msgr2=0x7f2b680a5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:18.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.616+0000 7f2b6eff4640 1 -- 172.21.15.91:0/3302984112 shutdown_connections 2023-11-27T20:42:18.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.617+0000 7f2b6eff4640 1 -- 172.21.15.91:0/3302984112 wait complete. 2023-11-27T20:42:18.635 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:42:18.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.832+0000 7f8f30878640 1 Processor -- start 2023-11-27T20:42:18.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.832+0000 7f8f30878640 1 -- start start 2023-11-27T20:42:18.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.833+0000 7f8f30878640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8f2c0c4720 0x7f8f2c0c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.833+0000 7f8f30878640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8f2c06ba00 0x7f8f2c06be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.833+0000 7f8f30878640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c0c83b0 con 0x7f8f2c151ba0 2023-11-27T20:42:18.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.833+0000 7f8f30878640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c151f80 con 0x7f8f2c0c4720 2023-11-27T20:42:18.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.833+0000 7f8f30878640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c1552c0 con 0x7f8f2c06ba00 2023-11-27T20:42:18.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.834+0000 7f8f2affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8f2c0c4720 0x7f8f2c0c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:18.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.834+0000 7f8f2b7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8f2c151ba0 0x7f8f2c0c7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53982/0 (socket says 172.21.15.91:53982) 2023-11-27T20:42:18.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.834+0000 7f8f2b7fe640 1 -- 172.21.15.91:0/3876843306 learned_addr learned my addr 172.21.15.91:0/3876843306 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:18.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.834+0000 7f8f2affd640 1 -- 172.21.15.91:0/3876843306 >> v2:172.21.15.183:3300/0 conn(0x7f8f2c06ba00 msgr2=0x7f8f2c06be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:18.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.834+0000 7f8f2bfff640 1 --2- 172.21.15.91:0/3876843306 >> v2:172.21.15.183:3300/0 conn(0x7f8f2c06ba00 0x7f8f2c06be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:18.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.834+0000 7f8f2affd640 1 --2- 172.21.15.91:0/3876843306 >> v2:172.21.15.183:3300/0 conn(0x7f8f2c06ba00 0x7f8f2c06be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.834+0000 7f8f2affd640 1 -- 172.21.15.91:0/3876843306 >> v1:172.21.15.91:6789/0 conn(0x7f8f2c151ba0 legacy=0x7f8f2c0c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.834+0000 7f8f2a7fc640 1 -- 172.21.15.91:0/3876843306 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342436949 0 0) 0x7f8f2c0c83b0 con 0x7f8f2c151ba0 2023-11-27T20:42:18.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.834+0000 7f8f2affd640 1 -- 172.21.15.91:0/3876843306 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c154640 con 0x7f8f2c0c4720 2023-11-27T20:42:18.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.835+0000 7f8f2affd640 1 --2- 172.21.15.91:0/3876843306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c0c4720 0x7f8f2c0c4ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c08bf70 tx=0x7f8f2002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2173a215da0f8e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:18.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f2a7fc640 1 -- 172.21.15.91:0/3876843306 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2002e070 con 0x7f8f2c0c4720 2023-11-27T20:42:18.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f2a7fc640 1 -- 172.21.15.91:0/3876843306 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f200315a0 con 0x7f8f2c0c4720 2023-11-27T20:42:18.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f2a7fc640 1 -- 172.21.15.91:0/3876843306 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f20031930 con 0x7f8f2c0c4720 2023-11-27T20:42:18.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f30878640 1 -- 172.21.15.91:0/3876843306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c0c4720 msgr2=0x7f8f2c0c4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f30878640 1 --2- 172.21.15.91:0/3876843306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c0c4720 0x7f8f2c0c4ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c08bf70 tx=0x7f8f2002b840 comp rx=0 tx=0).stop 2023-11-27T20:42:18.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f30878640 1 -- 172.21.15.91:0/3876843306 shutdown_connections 2023-11-27T20:42:18.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f30878640 1 --2- 172.21.15.91:0/3876843306 >> v2:172.21.15.183:3300/0 conn(0x7f8f2c06ba00 0x7f8f2c06be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f30878640 1 --2- 172.21.15.91:0/3876843306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c0c4720 0x7f8f2c0c4ba0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f30878640 1 -- 172.21.15.91:0/3876843306 >> 172.21.15.91:0/3876843306 conn(0x7f8f2c0ab930 msgr2=0x7f8f2c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:18.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f30878640 1 -- 172.21.15.91:0/3876843306 shutdown_connections 2023-11-27T20:42:18.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.836+0000 7f8f30878640 1 -- 172.21.15.91:0/3876843306 wait complete. 2023-11-27T20:42:18.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.838+0000 7f8f30878640 1 Processor -- start 2023-11-27T20:42:18.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.838+0000 7f8f30878640 1 -- start start 2023-11-27T20:42:18.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.839+0000 7f8f30878640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f2c06ba00 0x7f8f2c0af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.839+0000 7f8f30878640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f2c0c4720 0x7f8f2c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.839+0000 7f8f30878640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c151ba0 0x7f8f2c0bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.839+0000 7f8f30878640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0bf520 con 0x7f8f2c151ba0 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.839+0000 7f8f30878640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c1588e0 con 0x7f8f2c06ba00 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.839+0000 7f8f30878640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c158320 con 0x7f8f2c0c4720 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.839+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c151ba0 0x7f8f2c0bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c151ba0 0x7f8f2c0bd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43710/0 (socket says 172.21.15.91:43710) 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2bfff640 1 -- 172.21.15.91:0/2663100139 learned_addr learned my addr 172.21.15.91:0/2663100139 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2affd640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f2c0c4720 0x7f8f2c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2b7fe640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f2c06ba00 0x7f8f2c0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2bfff640 1 -- 172.21.15.91:0/2663100139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f2c0c4720 msgr2=0x7f8f2c1534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2bfff640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f2c0c4720 0x7f8f2c1534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2bfff640 1 -- 172.21.15.91:0/2663100139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f2c06ba00 msgr2=0x7f8f2c0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:18.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2bfff640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f2c06ba00 0x7f8f2c0af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:18.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2bfff640 1 -- 172.21.15.91:0/2663100139 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20009400 con 0x7f8f2c151ba0 2023-11-27T20:42:18.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2affd640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f2c0c4720 0x7f8f2c1534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:18.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f2bfff640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c151ba0 0x7f8f2c0bd8a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400cd70 tx=0x7f8f2400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:18.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.840+0000 7f8f13fff640 1 -- 172.21.15.91:0/2663100139 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24003b90 con 0x7f8f2c151ba0 2023-11-27T20:42:18.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.841+0000 7f8f13fff640 1 -- 172.21.15.91:0/2663100139 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24003cf0 con 0x7f8f2c151ba0 2023-11-27T20:42:18.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.841+0000 7f8f30878640 1 -- 172.21.15.91:0/2663100139 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c158600 con 0x7f8f2c151ba0 2023-11-27T20:42:18.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.841+0000 7f8f13fff640 1 -- 172.21.15.91:0/2663100139 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24004240 con 0x7f8f2c151ba0 2023-11-27T20:42:18.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.841+0000 7f8f30878640 1 -- 172.21.15.91:0/2663100139 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c1539f0 con 0x7f8f2c151ba0 2023-11-27T20:42:18.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.842+0000 7f8f30878640 1 -- 172.21.15.91:0/2663100139 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c04e840 con 0x7f8f2c151ba0 2023-11-27T20:42:18.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.843+0000 7f8f13fff640 1 -- 172.21.15.91:0/2663100139 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8f240043a0 con 0x7f8f2c151ba0 2023-11-27T20:42:18.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.844+0000 7f8f13fff640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f1806b1f0 0x7f8f1806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:18.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.844+0000 7f8f13fff640 1 -- 172.21.15.91:0/2663100139 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5833+0+0 (secure 0 0 0) 0x7f8f24012070 con 0x7f8f2c151ba0 2023-11-27T20:42:18.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.844+0000 7f8f2b7fe640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f1806b1f0 0x7f8f1806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:18.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.845+0000 7f8f2b7fe640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f1806b1f0 0x7f8f1806d6b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c000f60 tx=0x7f8f1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:18.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:18.848+0000 7f8f13fff640 1 -- 172.21.15.91:0/2663100139 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8f24055190 con 0x7f8f2c151ba0 2023-11-27T20:42:19.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.072+0000 7f8f30878640 1 -- 172.21.15.91:0/2663100139 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f2c06c670 con 0x7f8f2c151ba0 2023-11-27T20:42:19.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.073+0000 7f8f13fff640 1 -- 172.21.15.91:0/2663100139 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f8f240587b0 con 0x7f8f2c151ba0 2023-11-27T20:42:19.075 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:19.075 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/636329462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":636329462},{"type":"v1","addr":"172.21.15.91:6836","nonce":636329462}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/433109070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":433109070},{"type":"v1","addr":"172.21.15.91:6837","nonce":433109070}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1419226381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1419226381},{"type":"v1","addr":"172.21.15.183:6835","nonce":1419226381}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:41:34.815589+0000","modified":"2023-11-27T20:41:37.881858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/4022772138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4022772138},{"type":"v1","addr":"172.21.15.183:6834","nonce":4022772138}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:42:19.075 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 8 2023-11-27T20:42:19.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 -- 172.21.15.91:0/2663100139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f1806b1f0 msgr2=0x7f8f1806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f1806b1f0 0x7f8f1806d6b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c000f60 tx=0x7f8f1c009040 comp rx=0 tx=0).stop 2023-11-27T20:42:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 -- 172.21.15.91:0/2663100139 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c151ba0 msgr2=0x7f8f2c0bd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c151ba0 0x7f8f2c0bd8a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400cd70 tx=0x7f8f2400a660 comp rx=0 tx=0).stop 2023-11-27T20:42:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 -- 172.21.15.91:0/2663100139 shutdown_connections 2023-11-27T20:42:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f2c151ba0 0x7f8f2c0bd8a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f2c0c4720 0x7f8f2c1534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f1806b1f0 0x7f8f1806d6b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 --2- 172.21.15.91:0/2663100139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f2c06ba00 0x7f8f2c0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 -- 172.21.15.91:0/2663100139 >> 172.21.15.91:0/2663100139 conn(0x7f8f2c0ab930 msgr2=0x7f8f2c14b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 -- 172.21.15.91:0/2663100139 shutdown_connections 2023-11-27T20:42:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.076+0000 7f8f30878640 1 -- 172.21.15.91:0/2663100139 wait complete. 2023-11-27T20:42:19.096 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:19.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.305+0000 7ff712690640 1 Processor -- start 2023-11-27T20:42:19.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.305+0000 7ff712690640 1 -- start start 2023-11-27T20:42:19.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.306+0000 7ff712690640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff70c0a9b40 0x7ff70c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.307+0000 7ff712690640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70c0c06c0 con 0x7ff70c0c1500 2023-11-27T20:42:19.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.307+0000 7ff712690640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70c0c1020 con 0x7ff70c155490 2023-11-27T20:42:19.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.307+0000 7ff712690640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70c0a5820 con 0x7ff70c0a9b40 2023-11-27T20:42:19.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.307+0000 7ff710c2d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff70c0c1500 0x7ff70c0c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53992/0 (socket says 172.21.15.91:53992) 2023-11-27T20:42:19.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.307+0000 7ff710c2d640 1 -- 172.21.15.91:0/564501617 learned_addr learned my addr 172.21.15.91:0/564501617 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:19.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.307+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857704662 0 0) 0x7ff70c0c06c0 con 0x7ff70c0c1500 2023-11-27T20:42:19.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.307+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f8003520 con 0x7ff70c0c1500 2023-11-27T20:42:19.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.307+0000 7ff703fff640 1 --2- 172.21.15.91:0/564501617 >> v2:172.21.15.183:3300/0 conn(0x7ff70c0a9b40 0x7ff70c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1393474674 0 0) 0x7ff6f8003520 con 0x7ff70c0c1500 2023-11-27T20:42:19.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 >> v2:172.21.15.183:3300/0 conn(0x7ff70c0a9b40 msgr2=0x7ff70c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:19.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 --2- 172.21.15.91:0/564501617 >> v2:172.21.15.183:3300/0 conn(0x7ff70c0a9b40 0x7ff70c0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 >> v1:172.21.15.183:6789/0 conn(0x7ff70c155490 legacy=0x7ff70c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:19.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c0c0910 con 0x7ff70c0c1500 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7ff7040019f0 con 0x7ff70c0c1500 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 >> v1:172.21.15.91:6789/0 conn(0x7ff70c0c1500 legacy=0x7ff70c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 --2- 172.21.15.91:0/564501617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6f8003970 0x7ff6f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 --2- 172.21.15.91:0/564501617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6f80047c0 0x7ff6f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 --2- 172.21.15.91:0/564501617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6f8005180 0x7ff6f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f800c0a0 con 0x7ff6f8003970 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f800c210 con 0x7ff6f80047c0 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f800c3d0 con 0x7ff6f8005180 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70bfff640 1 --2- 172.21.15.91:0/564501617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6f8003970 0x7ff6f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70bfff640 1 -- 172.21.15.91:0/564501617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6f8005180 msgr2=0x7ff6f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff703fff640 1 --2- 172.21.15.91:0/564501617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6f80047c0 0x7ff6f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70bfff640 1 --2- 172.21.15.91:0/564501617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6f8005180 0x7ff6f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70bfff640 1 -- 172.21.15.91:0/564501617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6f80047c0 msgr2=0x7ff6f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:19.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.308+0000 7ff70bfff640 1 --2- 172.21.15.91:0/564501617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6f80047c0 0x7ff6f8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.309+0000 7ff70bfff640 1 -- 172.21.15.91:0/564501617 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8003520 con 0x7ff6f8003970 2023-11-27T20:42:19.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.309+0000 7ff710c2d640 1 -- 172.21.15.91:0/564501617 reap_dead start 2023-11-27T20:42:19.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.310+0000 7ff70bfff640 1 --2- 172.21.15.91:0/564501617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6f8003970 0x7ff6f8003d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc001330 tx=0x7ff6f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7aab970145441b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:19.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.310+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0052d0 con 0x7ff6f8003970 2023-11-27T20:42:19.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.310+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc005430 con 0x7ff6f8003970 2023-11-27T20:42:19.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.310+0000 7ff70b7fe640 1 -- 172.21.15.91:0/564501617 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc003830 con 0x7ff6f8003970 2023-11-27T20:42:19.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.310+0000 7ff712690640 1 -- 172.21.15.91:0/564501617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6f8003970 msgr2=0x7ff6f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.310+0000 7ff712690640 1 --2- 172.21.15.91:0/564501617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6f8003970 0x7ff6f8003d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc001330 tx=0x7ff6f80057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.310+0000 7ff712690640 1 -- 172.21.15.91:0/564501617 shutdown_connections 2023-11-27T20:42:19.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.310+0000 7ff712690640 1 --2- 172.21.15.91:0/564501617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6f8003970 0x7ff6f8003d90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.310+0000 7ff712690640 1 -- 172.21.15.91:0/564501617 >> 172.21.15.91:0/564501617 conn(0x7ff70c06a500 msgr2=0x7ff70c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:19.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.311+0000 7ff712690640 1 -- 172.21.15.91:0/564501617 shutdown_connections 2023-11-27T20:42:19.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.311+0000 7ff712690640 1 -- 172.21.15.91:0/564501617 wait complete. 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.312+0000 7ff712690640 1 Processor -- start 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.312+0000 7ff712690640 1 -- start start 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.313+0000 7ff712690640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6f8003970 0x7ff70c1db7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.313+0000 7ff712690640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff70c151560 0x7ff70c1dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.313+0000 7ff712690640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff70c0a6c40 0x7ff70c0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.313+0000 7ff712690640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c0a6820 con 0x7ff70c0a6c40 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.313+0000 7ff712690640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c1dc230 con 0x7ff6f8003970 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.313+0000 7ff712690640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c151e20 con 0x7ff70c151560 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.313+0000 7ff710c2d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff70c0a6c40 0x7ff70c0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff710c2d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff70c0a6c40 0x7ff70c0a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43722/0 (socket says 172.21.15.91:43722) 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff710c2d640 1 -- 172.21.15.91:0/167113601 learned_addr learned my addr 172.21.15.91:0/167113601 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:19.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff703fff640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff70c151560 0x7ff70c1dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff70bfff640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6f8003970 0x7ff70c1db7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff710c2d640 1 -- 172.21.15.91:0/167113601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff70c151560 msgr2=0x7ff70c1dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff710c2d640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff70c151560 0x7ff70c1dbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff710c2d640 1 -- 172.21.15.91:0/167113601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6f8003970 msgr2=0x7ff70c1db7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff710c2d640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6f8003970 0x7ff70c1db7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff710c2d640 1 -- 172.21.15.91:0/167113601 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c1eac70 con 0x7ff70c0a6c40 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff710c2d640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff70c0a6c40 0x7ff70c0a70c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0c1950 tx=0x7ff70400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff7097fa640 1 -- 172.21.15.91:0/167113601 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70400ce50 con 0x7ff70c0a6c40 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff7097fa640 1 -- 172.21.15.91:0/167113601 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70400a610 con 0x7ff70c0a6c40 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff7097fa640 1 -- 172.21.15.91:0/167113601 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70400a9c0 con 0x7ff70c0a6c40 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.314+0000 7ff712690640 1 -- 172.21.15.91:0/167113601 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70c1eaf10 con 0x7ff70c0a6c40 2023-11-27T20:42:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.315+0000 7ff712690640 1 -- 172.21.15.91:0/167113601 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70c151ab0 con 0x7ff70c0a6c40 2023-11-27T20:42:19.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.316+0000 7ff712690640 1 -- 172.21.15.91:0/167113601 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70c0a6960 con 0x7ff70c0a6c40 2023-11-27T20:42:19.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.316+0000 7ff7097fa640 1 -- 172.21.15.91:0/167113601 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff70400ab20 con 0x7ff70c0a6c40 2023-11-27T20:42:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.317+0000 7ff7097fa640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff6ec06b1c0 0x7ff6ec06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.317+0000 7ff7097fa640 1 -- 172.21.15.91:0/167113601 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5833+0+0 (secure 0 0 0) 0x7ff704089320 con 0x7ff70c0a6c40 2023-11-27T20:42:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.318+0000 7ff70bfff640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff6ec06b1c0 0x7ff6ec06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.318+0000 7ff70bfff640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff6ec06b1c0 0x7ff6ec06d680 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc036000 tx=0x7ff6fc009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:19.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.322+0000 7ff7097fa640 1 -- 172.21.15.91:0/167113601 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff70c0a6960 con 0x7ff70c0a6c40 2023-11-27T20:42:19.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.501+0000 7ff712690640 1 -- 172.21.15.91:0/167113601 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff70c0a6960 con 0x7ff70c0a6c40 2023-11-27T20:42:19.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.504+0000 7ff7097fa640 1 -- 172.21.15.91:0/167113601 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16678 (secure 0 0 0) 0x7ff70c0a6960 con 0x7ff70c0a6c40 2023-11-27T20:42:19.506 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:19.506 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":22,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:42:17.184370+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1},{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:19.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 -- 172.21.15.91:0/167113601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff6ec06b1c0 msgr2=0x7ff6ec06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff6ec06b1c0 0x7ff6ec06d680 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc036000 tx=0x7ff6fc009030 comp rx=0 tx=0).stop 2023-11-27T20:42:19.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 -- 172.21.15.91:0/167113601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff70c0a6c40 msgr2=0x7ff70c0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff70c0a6c40 0x7ff70c0a70c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0c1950 tx=0x7ff70400cc00 comp rx=0 tx=0).stop 2023-11-27T20:42:19.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 -- 172.21.15.91:0/167113601 shutdown_connections 2023-11-27T20:42:19.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff70c0a6c40 0x7ff70c0a70c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff70c151560 0x7ff70c1dbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff6ec06b1c0 0x7ff6ec06d680 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 --2- 172.21.15.91:0/167113601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6f8003970 0x7ff70c1db7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 -- 172.21.15.91:0/167113601 >> 172.21.15.91:0/167113601 conn(0x7ff70c06a500 msgr2=0x7ff70c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:19.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 -- 172.21.15.91:0/167113601 shutdown_connections 2023-11-27T20:42:19.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.507+0000 7ff712690640 1 -- 172.21.15.91:0/167113601 wait complete. 2023-11-27T20:42:19.529 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-27T20:42:19.529 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:42:19.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.738+0000 7f5b0475a640 1 Processor -- start 2023-11-27T20:42:19.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.738+0000 7f5b0475a640 1 -- start start 2023-11-27T20:42:19.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b0475a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc155fc0 0x7f5afc159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b0475a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5afc0c2e60 0x7f5afc163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b0475a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc06d580 con 0x7f5afc0c1ca0 2023-11-27T20:42:19.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b0475a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc06dd60 con 0x7f5afc0c2e60 2023-11-27T20:42:19.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b0475a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0c6580 con 0x7f5afc155fc0 2023-11-27T20:42:19.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b01cf5640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f5afc0c1ca0 0x7f5afc0c2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54006/0 (socket says 172.21.15.91:54006) 2023-11-27T20:42:19.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b01cf5640 1 -- 172.21.15.91:0/553656432 learned_addr learned my addr 172.21.15.91:0/553656432 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:19.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b024f6640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc155fc0 0x7f5afc159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514070743 0 0) 0x7f5afc06d580 con 0x7f5afc0c1ca0 2023-11-27T20:42:19.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b02cf7640 1 --2- 172.21.15.91:0/553656432 >> v2:172.21.15.183:3300/0 conn(0x7f5afc0c2e60 0x7f5afc163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.740+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae8003520 con 0x7f5afc0c1ca0 2023-11-27T20:42:19.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3006891963 0 0) 0x7f5ae8003520 con 0x7f5afc0c1ca0 2023-11-27T20:42:19.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc155fc0 msgr2=0x7f5afc159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:19.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc155fc0 0x7f5afc159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 >> v2:172.21.15.183:3300/0 conn(0x7f5afc0c2e60 msgr2=0x7f5afc163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:19.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 --2- 172.21.15.91:0/553656432 >> v2:172.21.15.183:3300/0 conn(0x7f5afc0c2e60 0x7f5afc163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc0726d0 con 0x7f5afc0c1ca0 2023-11-27T20:42:19.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f5aec001670 con 0x7f5afc0c1ca0 2023-11-27T20:42:19.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b02cf7640 1 --2- 172.21.15.91:0/553656432 >> v2:172.21.15.183:3300/0 conn(0x7f5afc0c2e60 0x7f5afc163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:42:19.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 >> v1:172.21.15.91:6789/0 conn(0x7f5afc0c1ca0 legacy=0x7f5afc0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc155fc0 0x7f5ae8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ae8003ef0 0x7f5ae80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 0x7f5ae8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc06dd60 con 0x7f5ae8004d00 2023-11-27T20:42:19.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae800ba90 con 0x7f5ae8003ef0 2023-11-27T20:42:19.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae800bc50 con 0x7f5afc155fc0 2023-11-27T20:42:19.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.741+0000 7f5b02cf7640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 0x7f5ae8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.742+0000 7f5b024f6640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc155fc0 0x7f5ae8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.742+0000 7f5b01cf5640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ae8003ef0 0x7f5ae80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.742+0000 7f5b02cf7640 1 -- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc155fc0 msgr2=0x7f5ae8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:19.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.742+0000 7f5b02cf7640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc155fc0 0x7f5ae8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.742+0000 7f5b02cf7640 1 -- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ae8003ef0 msgr2=0x7f5ae80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:19.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.742+0000 7f5b02cf7640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ae8003ef0 0x7f5ae80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.742+0000 7f5b02cf7640 1 -- 172.21.15.91:0/553656432 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8003520 con 0x7f5ae8004d00 2023-11-27T20:42:19.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.742+0000 7f5b01cf5640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ae8003ef0 0x7f5ae80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:19.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.743+0000 7f5b02cf7640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 0x7f5ae8005180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5af40073e0 tx=0x7f5ae80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3567c0fb8925f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:19.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.743+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af402cdc0 con 0x7f5ae8004d00 2023-11-27T20:42:19.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.743+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af4034440 con 0x7f5ae8004d00 2023-11-27T20:42:19.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.743+0000 7f5b014f4640 1 -- 172.21.15.91:0/553656432 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af40347b0 con 0x7f5ae8004d00 2023-11-27T20:42:19.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.744+0000 7f5b0475a640 1 -- 172.21.15.91:0/553656432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 msgr2=0x7f5ae8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.744+0000 7f5b0475a640 1 --2- 172.21.15.91:0/553656432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 0x7f5ae8005180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5af40073e0 tx=0x7f5ae80057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.744+0000 7f5b02cf7640 1 -- 172.21.15.91:0/553656432 reap_dead start 2023-11-27T20:42:19.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.744+0000 7f5b0475a640 1 -- 172.21.15.91:0/553656432 shutdown_connections 2023-11-27T20:42:19.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.744+0000 7f5b0475a640 1 -- 172.21.15.91:0/553656432 >> 172.21.15.91:0/553656432 conn(0x7f5afc06a500 msgr2=0x7f5afc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:19.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.744+0000 7f5b0475a640 1 -- 172.21.15.91:0/553656432 shutdown_connections 2023-11-27T20:42:19.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.744+0000 7f5b0475a640 1 -- 172.21.15.91:0/553656432 wait complete. 2023-11-27T20:42:19.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.746+0000 7f5b0475a640 1 Processor -- start 2023-11-27T20:42:19.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.746+0000 7f5b0475a640 1 -- start start 2023-11-27T20:42:19.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b0475a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 0x7f5afc0a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b0475a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc0aa110 0x7f5afc151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b0475a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5afc152730 0x7f5afc152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b0475a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0a7a70 con 0x7f5ae8004d00 2023-11-27T20:42:19.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b0475a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0a7d50 con 0x7f5afc152730 2023-11-27T20:42:19.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b0475a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc152560 con 0x7f5afc0aa110 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b024f6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 0x7f5afc0a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b024f6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 0x7f5afc0a9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43742/0 (socket says 172.21.15.91:43742) 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b024f6640 1 -- 172.21.15.91:0/328738034 learned_addr learned my addr 172.21.15.91:0/328738034 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b024f6640 1 -- 172.21.15.91:0/328738034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc0aa110 msgr2=0x7f5afc151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b024f6640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc0aa110 0x7f5afc151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b024f6640 1 -- 172.21.15.91:0/328738034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5afc152730 msgr2=0x7f5afc152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b024f6640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5afc152730 0x7f5afc152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.747+0000 7f5b024f6640 1 -- 172.21.15.91:0/328738034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc15cf60 con 0x7f5ae8004d00 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.748+0000 7f5b024f6640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 0x7f5afc0a9bd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5af8011660 tx=0x7f5af8011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.748+0000 7f5af2ffd640 1 -- 172.21.15.91:0/328738034 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800f8e0 con 0x7f5ae8004d00 2023-11-27T20:42:19.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.748+0000 7f5af2ffd640 1 -- 172.21.15.91:0/328738034 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af800fa40 con 0x7f5ae8004d00 2023-11-27T20:42:19.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.748+0000 7f5b0475a640 1 -- 172.21.15.91:0/328738034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc1f1e80 con 0x7f5ae8004d00 2023-11-27T20:42:19.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.748+0000 7f5af2ffd640 1 -- 172.21.15.91:0/328738034 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800fdb0 con 0x7f5ae8004d00 2023-11-27T20:42:19.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.748+0000 7f5b0475a640 1 -- 172.21.15.91:0/328738034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc15cbf0 con 0x7f5ae8004d00 2023-11-27T20:42:19.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.749+0000 7f5b0475a640 1 -- 172.21.15.91:0/328738034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc068350 con 0x7f5ae8004d00 2023-11-27T20:42:19.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.750+0000 7f5af2ffd640 1 -- 172.21.15.91:0/328738034 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5af8015460 con 0x7f5ae8004d00 2023-11-27T20:42:19.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.751+0000 7f5af2ffd640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ae006b1c0 0x7f5ae006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:19.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.751+0000 7f5af2ffd640 1 -- 172.21.15.91:0/328738034 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5833+0+0 (secure 0 0 0) 0x7f5af808a2b0 con 0x7f5ae8004d00 2023-11-27T20:42:19.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.751+0000 7f5b01cf5640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ae006b1c0 0x7f5ae006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:19.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.752+0000 7f5b01cf5640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ae006b1c0 0x7f5ae006d680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5aec000f60 tx=0x7f5aec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:19.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.756+0000 7f5af2ffd640 1 -- 172.21.15.91:0/328738034 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5af8054f50 con 0x7f5ae8004d00 2023-11-27T20:42:19.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.982+0000 7f5b0475a640 1 -- 172.21.15.91:0/328738034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5afc06e1f0 con 0x7f5ae8004d00 2023-11-27T20:42:19.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.984+0000 7f5af2ffd640 1 -- 172.21.15.91:0/328738034 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f5af8058570 con 0x7f5ae8004d00 2023-11-27T20:42:19.985 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:19.985 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/636329462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":636329462},{"type":"v1","addr":"172.21.15.91:6836","nonce":636329462}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/433109070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":433109070},{"type":"v1","addr":"172.21.15.91:6837","nonce":433109070}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1419226381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1419226381},{"type":"v1","addr":"172.21.15.183:6835","nonce":1419226381}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:41:34.815589+0000","modified":"2023-11-27T20:41:37.881858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/4022772138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4022772138},{"type":"v1","addr":"172.21.15.183:6834","nonce":4022772138}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:42:19.986 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 8 2023-11-27T20:42:19.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.986+0000 7f5b0475a640 1 -- 172.21.15.91:0/328738034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ae006b1c0 msgr2=0x7f5ae006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.986+0000 7f5b0475a640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ae006b1c0 0x7f5ae006d680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5aec000f60 tx=0x7f5aec009040 comp rx=0 tx=0).stop 2023-11-27T20:42:19.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.986+0000 7f5b0475a640 1 -- 172.21.15.91:0/328738034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 msgr2=0x7f5afc0a9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:19.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.986+0000 7f5b0475a640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 0x7f5afc0a9bd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5af8011660 tx=0x7f5af8011b20 comp rx=0 tx=0).stop 2023-11-27T20:42:19.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.987+0000 7f5b0475a640 1 -- 172.21.15.91:0/328738034 shutdown_connections 2023-11-27T20:42:19.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.987+0000 7f5b0475a640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ae006b1c0 0x7f5ae006d680 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.987+0000 7f5b0475a640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5afc152730 0x7f5afc152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.987+0000 7f5b0475a640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5afc0aa110 0x7f5afc151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.987+0000 7f5b0475a640 1 --2- 172.21.15.91:0/328738034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ae8004d00 0x7f5afc0a9bd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:19.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.987+0000 7f5b0475a640 1 -- 172.21.15.91:0/328738034 >> 172.21.15.91:0/328738034 conn(0x7f5afc06a500 msgr2=0x7f5afc0a7210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:19.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.987+0000 7f5b0475a640 1 -- 172.21.15.91:0/328738034 shutdown_connections 2023-11-27T20:42:19.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:19.987+0000 7f5b0475a640 1 -- 172.21.15.91:0/328738034 wait complete. 2023-11-27T20:42:20.006 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:42:20.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.200+0000 7f56601f5640 1 Processor -- start 2023-11-27T20:42:20.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.200+0000 7f56601f5640 1 -- start start 2023-11-27T20:42:20.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.202+0000 7f56601f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f565814fd30 0x7f5658152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.202+0000 7f56601f5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f56580c3ea0 0x7f56580c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.202+0000 7f56601f5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56580c64a0 con 0x7f565806d0a0 2023-11-27T20:42:20.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.202+0000 7f56601f5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56580c5c00 con 0x7f56580c3ea0 2023-11-27T20:42:20.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.202+0000 7f56601f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56580c5ee0 con 0x7f565814fd30 2023-11-27T20:42:20.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.202+0000 7f565e792640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f56580c3ea0 0x7f56580c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:20.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.202+0000 7f565e792640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f56580c3ea0 0x7f56580c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43750/0 (socket says 172.21.15.91:43750) 2023-11-27T20:42:20.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.202+0000 7f565e792640 1 -- 172.21.15.91:0/952546829 learned_addr learned my addr 172.21.15.91:0/952546829 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:20.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.202+0000 7f565d790640 1 --1- 172.21.15.91:0/952546829 >> v1:172.21.15.91:6789/0 conn(0x7f565806d0a0 0x7f56580a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54018/0 (socket says 172.21.15.91:54018) 2023-11-27T20:42:20.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.203+0000 7f565df91640 1 --2- 172.21.15.91:0/952546829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f565814fd30 0x7f5658152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:20.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.203+0000 7f565e792640 1 -- 172.21.15.91:0/952546829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f565814fd30 msgr2=0x7f5658152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:20.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.203+0000 7f565e792640 1 --2- 172.21.15.91:0/952546829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f565814fd30 0x7f5658152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.203+0000 7f565e792640 1 -- 172.21.15.91:0/952546829 >> v1:172.21.15.91:6789/0 conn(0x7f565806d0a0 legacy=0x7f56580a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.203+0000 7f565e792640 1 -- 172.21.15.91:0/952546829 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580c61c0 con 0x7f56580c3ea0 2023-11-27T20:42:20.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.203+0000 7f565cf8f640 1 -- 172.21.15.91:0/952546829 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767166769 0 0) 0x7f56580c64a0 con 0x7f565806d0a0 2023-11-27T20:42:20.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.204+0000 7f565e792640 1 --2- 172.21.15.91:0/952546829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56580c3ea0 0x7f56580c4330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5650009e50 tx=0x7f565002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bcc82960ffc595 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:20.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.204+0000 7f565cf8f640 1 -- 172.21.15.91:0/952546829 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565002cb00 con 0x7f56580c3ea0 2023-11-27T20:42:20.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.204+0000 7f565cf8f640 1 -- 172.21.15.91:0/952546829 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565002cc60 con 0x7f56580c3ea0 2023-11-27T20:42:20.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.204+0000 7f565cf8f640 1 -- 172.21.15.91:0/952546829 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500343f0 con 0x7f56580c3ea0 2023-11-27T20:42:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.205+0000 7f56601f5640 1 -- 172.21.15.91:0/952546829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56580c3ea0 msgr2=0x7f56580c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.205+0000 7f56601f5640 1 --2- 172.21.15.91:0/952546829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56580c3ea0 0x7f56580c4330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5650009e50 tx=0x7f565002bf60 comp rx=0 tx=0).stop 2023-11-27T20:42:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.205+0000 7f56601f5640 1 -- 172.21.15.91:0/952546829 shutdown_connections 2023-11-27T20:42:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.205+0000 7f56601f5640 1 --2- 172.21.15.91:0/952546829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56580c3ea0 0x7f56580c4330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.205+0000 7f56601f5640 1 --2- 172.21.15.91:0/952546829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f565814fd30 0x7f5658152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.205+0000 7f56601f5640 1 -- 172.21.15.91:0/952546829 >> 172.21.15.91:0/952546829 conn(0x7f565806a500 msgr2=0x7f565806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.205+0000 7f56601f5640 1 -- 172.21.15.91:0/952546829 shutdown_connections 2023-11-27T20:42:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.205+0000 7f56601f5640 1 -- 172.21.15.91:0/952546829 wait complete. 2023-11-27T20:42:20.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.207+0000 7f56601f5640 1 Processor -- start 2023-11-27T20:42:20.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.207+0000 7f56601f5640 1 -- start start 2023-11-27T20:42:20.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f56601f5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f565806d0a0 0x7f565814f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f56601f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56580c3ea0 0x7f5658155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f56601f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f565814fd30 0x7f565814def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f56601f5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56581dd800 con 0x7f565814fd30 2023-11-27T20:42:20.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f56601f5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56581e8c00 con 0x7f565806d0a0 2023-11-27T20:42:20.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f56601f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565814edc0 con 0x7f56580c3ea0 2023-11-27T20:42:20.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f565e792640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f565814fd30 0x7f565814def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:20.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f565e792640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f565814fd30 0x7f565814def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43766/0 (socket says 172.21.15.91:43766) 2023-11-27T20:42:20.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f565e792640 1 -- 172.21.15.91:0/2788126102 learned_addr learned my addr 172.21.15.91:0/2788126102 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:20.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f565e792640 1 -- 172.21.15.91:0/2788126102 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56580c3ea0 msgr2=0x7f5658155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f565e792640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56580c3ea0 0x7f5658155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f565e792640 1 -- 172.21.15.91:0/2788126102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f565806d0a0 msgr2=0x7f565814f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f565e792640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f565806d0a0 0x7f565814f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.208+0000 7f565e792640 1 -- 172.21.15.91:0/2788126102 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650009b30 con 0x7f565814fd30 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.209+0000 7f565e792640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f565814fd30 0x7f565814def0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5650009e50 tx=0x7f5650004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.209+0000 7f564e7fc640 1 -- 172.21.15.91:0/2788126102 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650009510 con 0x7f565814fd30 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.209+0000 7f564e7fc640 1 -- 172.21.15.91:0/2788126102 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565003e450 con 0x7f565814fd30 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.209+0000 7f564e7fc640 1 -- 172.21.15.91:0/2788126102 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565003e800 con 0x7f565814fd30 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.209+0000 7f56601f5640 1 -- 172.21.15.91:0/2788126102 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56581dda10 con 0x7f565814fd30 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.209+0000 7f56601f5640 1 -- 172.21.15.91:0/2788126102 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56580c30a0 con 0x7f565814fd30 2023-11-27T20:42:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.210+0000 7f56601f5640 1 -- 172.21.15.91:0/2788126102 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56580bb720 con 0x7f565814fd30 2023-11-27T20:42:20.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.211+0000 7f564e7fc640 1 -- 172.21.15.91:0/2788126102 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f565003e960 con 0x7f565814fd30 2023-11-27T20:42:20.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.213+0000 7f564e7fc640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f563c06b1c0 0x7f563c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.213+0000 7f564e7fc640 1 -- 172.21.15.91:0/2788126102 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5833+0+0 (secure 0 0 0) 0x7f56500ac8f0 con 0x7f565814fd30 2023-11-27T20:42:20.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.213+0000 7f565df91640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f563c06b1c0 0x7f563c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:20.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.213+0000 7f565df91640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f563c06b1c0 0x7f563c06d680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5654006fd0 tx=0x7f5654008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:20.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.217+0000 7f564e7fc640 1 -- 172.21.15.91:0/2788126102 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f56580bb720 con 0x7f565814fd30 2023-11-27T20:42:20.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.445+0000 7f56601f5640 1 -- 172.21.15.91:0/2788126102 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56580bb720 con 0x7f565814fd30 2023-11-27T20:42:20.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.445+0000 7f564e7fc640 1 -- 172.21.15.91:0/2788126102 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f56580bb720 con 0x7f565814fd30 2023-11-27T20:42:20.447 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:20.448 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/636329462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":636329462},{"type":"v1","addr":"172.21.15.91:6836","nonce":636329462}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/433109070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":433109070},{"type":"v1","addr":"172.21.15.91:6837","nonce":433109070}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1419226381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1419226381},{"type":"v1","addr":"172.21.15.183:6835","nonce":1419226381}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:41:34.815589+0000","modified":"2023-11-27T20:41:37.881858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/4022772138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4022772138},{"type":"v1","addr":"172.21.15.183:6834","nonce":4022772138}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T20:42:20.448 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 8 2023-11-27T20:42:20.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 -- 172.21.15.91:0/2788126102 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f563c06b1c0 msgr2=0x7f563c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f563c06b1c0 0x7f563c06d680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5654006fd0 tx=0x7f5654008040 comp rx=0 tx=0).stop 2023-11-27T20:42:20.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 -- 172.21.15.91:0/2788126102 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f565814fd30 msgr2=0x7f565814def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f565814fd30 0x7f565814def0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5650009e50 tx=0x7f5650004a40 comp rx=0 tx=0).stop 2023-11-27T20:42:20.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 -- 172.21.15.91:0/2788126102 shutdown_connections 2023-11-27T20:42:20.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f565814fd30 0x7f565814def0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56580c3ea0 0x7f5658155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f563c06b1c0 0x7f563c06d680 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 --2- 172.21.15.91:0/2788126102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f565806d0a0 0x7f565814f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 -- 172.21.15.91:0/2788126102 >> 172.21.15.91:0/2788126102 conn(0x7f565806a500 msgr2=0x7f5658152340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:20.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 -- 172.21.15.91:0/2788126102 shutdown_connections 2023-11-27T20:42:20.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.448+0000 7f56601f5640 1 -- 172.21.15.91:0/2788126102 wait complete. 2023-11-27T20:42:20.468 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:20.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.680+0000 7fcce759e640 1 Processor -- start 2023-11-27T20:42:20.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.681+0000 7fcce759e640 1 -- start start 2023-11-27T20:42:20.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.682+0000 7fcce759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcce814e7c0 0x7fcce80c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.682+0000 7fcce759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce80c4c00 0x7fcce80ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.682+0000 7fcce759e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce8158a60 con 0x7fcce80ca990 2023-11-27T20:42:20.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.682+0000 7fcce759e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce80c5b10 con 0x7fcce814e7c0 2023-11-27T20:42:20.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.682+0000 7fcce759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8157ca0 con 0x7fcce80c4c00 2023-11-27T20:42:20.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.682+0000 7fcce659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcce814e7c0 0x7fcce80c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:20.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.682+0000 7fcce659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcce814e7c0 0x7fcce80c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43780/0 (socket says 172.21.15.91:43780) 2023-11-27T20:42:20.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.682+0000 7fcce659c640 1 -- 172.21.15.91:0/3260497069 learned_addr learned my addr 172.21.15.91:0/3260497069 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:20.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.683+0000 7fcce659c640 1 -- 172.21.15.91:0/3260497069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce80c4c00 msgr2=0x7fcce80ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:20.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.683+0000 7fcce659c640 1 --2- 172.21.15.91:0/3260497069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce80c4c00 0x7fcce80ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.683+0000 7fcce659c640 1 -- 172.21.15.91:0/3260497069 >> v1:172.21.15.183:6789/0 conn(0x7fcce80ca990 legacy=0x7fcce8154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:20.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.683+0000 7fcce659c640 1 -- 172.21.15.91:0/3260497069 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce8157f80 con 0x7fcce814e7c0 2023-11-27T20:42:20.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.684+0000 7fcce659c640 1 --2- 172.21.15.91:0/3260497069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce814e7c0 0x7fcce80c46c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009e50 tx=0x7fcce002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cf10352328231e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:20.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.684+0000 7fcce559a640 1 -- 172.21.15.91:0/3260497069 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce002c960 con 0x7fcce814e7c0 2023-11-27T20:42:20.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.684+0000 7fcce559a640 1 -- 172.21.15.91:0/3260497069 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce002cac0 con 0x7fcce814e7c0 2023-11-27T20:42:20.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.684+0000 7fcce559a640 1 -- 172.21.15.91:0/3260497069 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce002ce50 con 0x7fcce814e7c0 2023-11-27T20:42:20.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.685+0000 7fcce759e640 1 -- 172.21.15.91:0/3260497069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce814e7c0 msgr2=0x7fcce80c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.685+0000 7fcce759e640 1 --2- 172.21.15.91:0/3260497069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce814e7c0 0x7fcce80c46c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009e50 tx=0x7fcce002bdc0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.685+0000 7fcce759e640 1 -- 172.21.15.91:0/3260497069 shutdown_connections 2023-11-27T20:42:20.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.685+0000 7fcce759e640 1 --2- 172.21.15.91:0/3260497069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce80c4c00 0x7fcce80ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.685+0000 7fcce759e640 1 --2- 172.21.15.91:0/3260497069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce814e7c0 0x7fcce80c46c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.685+0000 7fcce759e640 1 -- 172.21.15.91:0/3260497069 >> 172.21.15.91:0/3260497069 conn(0x7fcce80abf00 msgr2=0x7fcce80c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:20.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.685+0000 7fcce759e640 1 -- 172.21.15.91:0/3260497069 shutdown_connections 2023-11-27T20:42:20.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.685+0000 7fcce759e640 1 -- 172.21.15.91:0/3260497069 wait complete. 2023-11-27T20:42:20.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.687+0000 7fcce759e640 1 Processor -- start 2023-11-27T20:42:20.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.687+0000 7fcce759e640 1 -- start start 2023-11-27T20:42:20.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce80c4c00 0x7fcce814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce80ca990 0x7fcce80bf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce814e7c0 0x7fcce80bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce759e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8143ef0 con 0x7fcce80c4c00 2023-11-27T20:42:20.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce81567d0 con 0x7fcce814e7c0 2023-11-27T20:42:20.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8143cd0 con 0x7fcce80ca990 2023-11-27T20:42:20.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce80c4c00 0x7fcce814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:20.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce80c4c00 0x7fcce814b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43784/0 (socket says 172.21.15.91:43784) 2023-11-27T20:42:20.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce659c640 1 -- 172.21.15.91:0/1630438252 learned_addr learned my addr 172.21.15.91:0/1630438252 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:20.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce659c640 1 -- 172.21.15.91:0/1630438252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce80ca990 msgr2=0x7fcce80bf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce659c640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce80ca990 0x7fcce80bf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce659c640 1 -- 172.21.15.91:0/1630438252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce814e7c0 msgr2=0x7fcce80bfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce659c640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce814e7c0 0x7fcce80bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.688+0000 7fcce659c640 1 -- 172.21.15.91:0/1630438252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0009b30 con 0x7fcce80c4c00 2023-11-27T20:42:20.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.689+0000 7fcce659c640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce80c4c00 0x7fcce814b4e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009e50 tx=0x7fcce0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:20.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.689+0000 7fccdeffd640 1 -- 172.21.15.91:0/1630438252 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce003e450 con 0x7fcce80c4c00 2023-11-27T20:42:20.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.689+0000 7fccdeffd640 1 -- 172.21.15.91:0/1630438252 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce003e5b0 con 0x7fcce80c4c00 2023-11-27T20:42:20.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.689+0000 7fccdeffd640 1 -- 172.21.15.91:0/1630438252 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce003e960 con 0x7fcce80c4c00 2023-11-27T20:42:20.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.689+0000 7fcce759e640 1 -- 172.21.15.91:0/1630438252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce81445e0 con 0x7fcce80c4c00 2023-11-27T20:42:20.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.689+0000 7fcce759e640 1 -- 172.21.15.91:0/1630438252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce8156460 con 0x7fcce80c4c00 2023-11-27T20:42:20.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.690+0000 7fcce759e640 1 -- 172.21.15.91:0/1630438252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce8149fc0 con 0x7fcce80c4c00 2023-11-27T20:42:20.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.691+0000 7fccdeffd640 1 -- 172.21.15.91:0/1630438252 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcce003eac0 con 0x7fcce80c4c00 2023-11-27T20:42:20.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.692+0000 7fccdeffd640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccc806b1c0 0x7fccc806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:20.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.692+0000 7fccdeffd640 1 -- 172.21.15.91:0/1630438252 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5833+0+0 (secure 0 0 0) 0x7fcce00ac9c0 con 0x7fcce80c4c00 2023-11-27T20:42:20.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.692+0000 7fcce5d9b640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccc806b1c0 0x7fccc806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:20.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.693+0000 7fcce5d9b640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccc806b1c0 0x7fccc806d680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcce80c3730 tx=0x7fccd8006c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:20.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.696+0000 7fccdeffd640 1 -- 172.21.15.91:0/1630438252 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcce0077660 con 0x7fcce80c4c00 2023-11-27T20:42:20.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.889+0000 7fcce759e640 1 -- 172.21.15.91:0/1630438252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcce804e840 con 0x7fcce80c4c00 2023-11-27T20:42:20.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.891+0000 7fccdeffd640 1 -- 172.21.15.91:0/1630438252 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16678 (secure 0 0 0) 0x7fcce007ac80 con 0x7fcce80c4c00 2023-11-27T20:42:20.893 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:20.893 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":22,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:42:17.184370+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:41:32.704555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T20:41:33.818847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1},{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:20.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 -- 172.21.15.91:0/1630438252 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccc806b1c0 msgr2=0x7fccc806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccc806b1c0 0x7fccc806d680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcce80c3730 tx=0x7fccd8006c90 comp rx=0 tx=0).stop 2023-11-27T20:42:20.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 -- 172.21.15.91:0/1630438252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce80c4c00 msgr2=0x7fcce814b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:20.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce80c4c00 0x7fcce814b4e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009e50 tx=0x7fcce0004a40 comp rx=0 tx=0).stop 2023-11-27T20:42:20.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 -- 172.21.15.91:0/1630438252 shutdown_connections 2023-11-27T20:42:20.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccc806b1c0 0x7fccc806d680 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce814e7c0 0x7fcce80bfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce80ca990 0x7fcce80bf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 --2- 172.21.15.91:0/1630438252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce80c4c00 0x7fcce814b4e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:20.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 -- 172.21.15.91:0/1630438252 >> 172.21.15.91:0/1630438252 conn(0x7fcce80abf00 msgr2=0x7fcce80662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:20.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 -- 172.21.15.91:0/1630438252 shutdown_connections 2023-11-27T20:42:20.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:20.894+0000 7fcce759e640 1 -- 172.21.15.91:0/1630438252 wait complete. 2023-11-27T20:42:20.915 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-27T20:42:21.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.115+0000 7fdbb70a6640 1 Processor -- start 2023-11-27T20:42:21.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.115+0000 7fdbb70a6640 1 -- start start 2023-11-27T20:42:21.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.116+0000 7fdbb70a6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdbb006d0a0 0x7fdbb0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.116+0000 7fdbb70a6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdbb00c3ea0 0x7fdbb00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.117+0000 7fdbb70a6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb00c64a0 con 0x7fdbb014fd30 2023-11-27T20:42:21.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.117+0000 7fdbb70a6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb00c5c00 con 0x7fdbb006d0a0 2023-11-27T20:42:21.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.117+0000 7fdbb70a6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb00c5ee0 con 0x7fdbb00c3ea0 2023-11-27T20:42:21.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.117+0000 7fdbaffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdbb006d0a0 0x7fdbb0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:21.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.117+0000 7fdbaffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdbb006d0a0 0x7fdbb0152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43796/0 (socket says 172.21.15.91:43796) 2023-11-27T20:42:21.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.117+0000 7fdbaffff640 1 -- 172.21.15.91:0/3986244350 learned_addr learned my addr 172.21.15.91:0/3986244350 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:21.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.117+0000 7fdbaffff640 1 -- 172.21.15.91:0/3986244350 >> v2:172.21.15.183:3300/0 conn(0x7fdbb00c3ea0 msgr2=0x7fdbb00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:21.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.117+0000 7fdbaffff640 1 --2- 172.21.15.91:0/3986244350 >> v2:172.21.15.183:3300/0 conn(0x7fdbb00c3ea0 0x7fdbb00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.117+0000 7fdbaffff640 1 -- 172.21.15.91:0/3986244350 >> v1:172.21.15.183:6789/0 conn(0x7fdbb014fd30 legacy=0x7fdbb00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:21.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.117+0000 7fdbaffff640 1 -- 172.21.15.91:0/3986244350 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb00c61c0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.118+0000 7fdbaffff640 1 --2- 172.21.15.91:0/3986244350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 0x7fdbb0152f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdbb006e430 tx=0x7fdb9c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46207588e188217c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:21.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.119+0000 7fdbaf7fe640 1 -- 172.21.15.91:0/3986244350 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c031870 con 0x7fdbb006d0a0 2023-11-27T20:42:21.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.119+0000 7fdbaf7fe640 1 -- 172.21.15.91:0/3986244350 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c0319d0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.119+0000 7fdbaf7fe640 1 -- 172.21.15.91:0/3986244350 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c031d60 con 0x7fdbb006d0a0 2023-11-27T20:42:21.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.119+0000 7fdbb70a6640 1 -- 172.21.15.91:0/3986244350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 msgr2=0x7fdbb0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:21.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.119+0000 7fdbb70a6640 1 --2- 172.21.15.91:0/3986244350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 0x7fdbb0152f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdbb006e430 tx=0x7fdb9c02b910 comp rx=0 tx=0).stop 2023-11-27T20:42:21.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.120+0000 7fdbb70a6640 1 -- 172.21.15.91:0/3986244350 shutdown_connections 2023-11-27T20:42:21.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.120+0000 7fdbb70a6640 1 --2- 172.21.15.91:0/3986244350 >> v2:172.21.15.183:3300/0 conn(0x7fdbb00c3ea0 0x7fdbb00c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.120+0000 7fdbb70a6640 1 --2- 172.21.15.91:0/3986244350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 0x7fdbb0152f20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.120+0000 7fdbb70a6640 1 -- 172.21.15.91:0/3986244350 >> 172.21.15.91:0/3986244350 conn(0x7fdbb006a500 msgr2=0x7fdbb006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:21.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.120+0000 7fdbb70a6640 1 -- 172.21.15.91:0/3986244350 shutdown_connections 2023-11-27T20:42:21.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.120+0000 7fdbb70a6640 1 -- 172.21.15.91:0/3986244350 wait complete. 2023-11-27T20:42:21.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.122+0000 7fdbb70a6640 1 Processor -- start 2023-11-27T20:42:21.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.122+0000 7fdbb70a6640 1 -- start start 2023-11-27T20:42:21.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.123+0000 7fdbb70a6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 0x7fdbb014a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.123+0000 7fdbb70a6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb00c3ea0 0x7fdbb01e9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.123+0000 7fdbb70a6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb014fd30 0x7fdbb00a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.123+0000 7fdbb70a6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb0154ad0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.123+0000 7fdbb70a6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb0149a40 con 0x7fdbb00c3ea0 2023-11-27T20:42:21.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.123+0000 7fdbb70a6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb014ab50 con 0x7fdbb014fd30 2023-11-27T20:42:21.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.123+0000 7fdbb4e42640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 0x7fdbb014a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:21.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.123+0000 7fdbb4e42640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 0x7fdbb014a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43804/0 (socket says 172.21.15.91:43804) 2023-11-27T20:42:21.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.123+0000 7fdbb4e42640 1 -- 172.21.15.91:0/2497662713 learned_addr learned my addr 172.21.15.91:0/2497662713 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:21.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.123+0000 7fdbb5643640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb014fd30 0x7fdbb00a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:21.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbb4e42640 1 -- 172.21.15.91:0/2497662713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb014fd30 msgr2=0x7fdbb00a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:21.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbb4e42640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb014fd30 0x7fdbb00a8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbaffff640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb00c3ea0 0x7fdbb01e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:21.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbb4e42640 1 -- 172.21.15.91:0/2497662713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb00c3ea0 msgr2=0x7fdbb01e9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:21.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbb4e42640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb00c3ea0 0x7fdbb01e9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbb4e42640 1 -- 172.21.15.91:0/2497662713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0094d0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbb5643640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb014fd30 0x7fdbb00a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:21.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbb4e42640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 0x7fdbb014a450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c430 tx=0x7fdba400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:21.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbad7fa640 1 -- 172.21.15.91:0/2497662713 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4011790 con 0x7fdbb006d0a0 2023-11-27T20:42:21.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbad7fa640 1 -- 172.21.15.91:0/2497662713 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba40118f0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbad7fa640 1 -- 172.21.15.91:0/2497662713 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4011ca0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbb70a6640 1 -- 172.21.15.91:0/2497662713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb01ea2b0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.124+0000 7fdbb70a6640 1 -- 172.21.15.91:0/2497662713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb0149c50 con 0x7fdbb006d0a0 2023-11-27T20:42:21.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.125+0000 7fdbb70a6640 1 -- 172.21.15.91:0/2497662713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb01ea4a0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.127+0000 7fdbad7fa640 1 -- 172.21.15.91:0/2497662713 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdba401c460 con 0x7fdbb006d0a0 2023-11-27T20:42:21.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.127+0000 7fdbad7fa640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb9406b1c0 0x7fdb9406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.128+0000 7fdbad7fa640 1 -- 172.21.15.91:0/2497662713 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5833+0+0 (secure 0 0 0) 0x7fdba4089a60 con 0x7fdbb006d0a0 2023-11-27T20:42:21.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.128+0000 7fdbaffff640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb9406b1c0 0x7fdb9406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:21.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.128+0000 7fdbaffff640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb9406b1c0 0x7fdb9406d680 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c036000 tx=0x7fdb9c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:21.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.132+0000 7fdbad7fa640 1 -- 172.21.15.91:0/2497662713 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdbb01ea4a0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.343 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:42:21.353 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:42:21.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.361+0000 7fdbb70a6640 1 -- 172.21.15.91:0/2497662713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdbb01ea4a0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.366 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-11-27T20:42:21.362+0000 7fb57696d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-27T20:42:21.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.365+0000 7fdbad7fa640 1 -- 172.21.15.91:0/2497662713 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdbb01ea4a0 con 0x7fdbb006d0a0 2023-11-27T20:42:21.367 INFO:teuthology.orchestra.run.smithi091.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T20:42:21.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.367+0000 7fdbb70a6640 1 -- 172.21.15.91:0/2497662713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb9406b1c0 msgr2=0x7fdb9406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:21.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.367+0000 7fdbb70a6640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb9406b1c0 0x7fdb9406d680 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c036000 tx=0x7fdb9c03c040 comp rx=0 tx=0).stop 2023-11-27T20:42:21.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.367+0000 7fdbb70a6640 1 -- 172.21.15.91:0/2497662713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 msgr2=0x7fdbb014a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:21.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.367+0000 7fdbb70a6640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 0x7fdbb014a450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c430 tx=0x7fdba400c8f0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.368+0000 7fdbb70a6640 1 -- 172.21.15.91:0/2497662713 shutdown_connections 2023-11-27T20:42:21.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.368+0000 7fdbb70a6640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb014fd30 0x7fdbb00a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.368+0000 7fdbb70a6640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb9406b1c0 0x7fdb9406d680 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.368+0000 7fdbb70a6640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb00c3ea0 0x7fdbb01e9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.368+0000 7fdbb70a6640 1 --2- 172.21.15.91:0/2497662713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb006d0a0 0x7fdbb014a450 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.368+0000 7fdbb70a6640 1 -- 172.21.15.91:0/2497662713 >> 172.21.15.91:0/2497662713 conn(0x7fdbb006a500 msgr2=0x7fdbb006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:21.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.368+0000 7fdbb70a6640 1 -- 172.21.15.91:0/2497662713 shutdown_connections 2023-11-27T20:42:21.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.368+0000 7fdbb70a6640 1 -- 172.21.15.91:0/2497662713 wait complete. 2023-11-27T20:42:21.388 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-27T20:42:21.388 INFO:tasks.ceph.mds.d.smithi183.stderr: -5699> 2023-11-27T20:41:40.818+0000 7fc63f67c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:42:21.444 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-11-27T20:42:21.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.634+0000 7f6afa39e640 1 Processor -- start 2023-11-27T20:42:21.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.634+0000 7f6afa39e640 1 -- start start 2023-11-27T20:42:21.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.635+0000 7f6afa39e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6af40c45d0 0x7f6af4155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.635+0000 7f6afa39e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c3340 0x7f6af4156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.635+0000 7f6afa39e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af40bfdc0 con 0x7f6af40c5ec0 2023-11-27T20:42:21.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.636+0000 7f6afa39e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af406e390 con 0x7f6af40c45d0 2023-11-27T20:42:21.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.636+0000 7f6afa39e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af406ddd0 con 0x7f6af40c3340 2023-11-27T20:42:21.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.636+0000 7f6af3fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f6af40c5ec0 0x7f6af40c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54026/0 (socket says 172.21.15.91:54026) 2023-11-27T20:42:21.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.636+0000 7f6af3fff640 1 -- 172.21.15.91:0/1810110659 learned_addr learned my addr 172.21.15.91:0/1810110659 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:21.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.636+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302006221 0 0) 0x7f6af40bfdc0 con 0x7f6af40c5ec0 2023-11-27T20:42:21.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.636+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae0003520 con 0x7f6af40c5ec0 2023-11-27T20:42:21.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.636+0000 7f6af893b640 1 --2- 172.21.15.91:0/1810110659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c3340 0x7f6af4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:21.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.636+0000 7f6af37fe640 1 --2- 172.21.15.91:0/1810110659 >> v2:172.21.15.183:3300/0 conn(0x7f6af40c45d0 0x7f6af4155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:21.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3071138651 0 0) 0x7f6ae0003520 con 0x7f6af40c5ec0 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c3340 msgr2=0x7f6af4156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 --2- 172.21.15.91:0/1810110659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c3340 0x7f6af4156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 >> v2:172.21.15.183:3300/0 conn(0x7f6af40c45d0 msgr2=0x7f6af4155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 --2- 172.21.15.91:0/1810110659 >> v2:172.21.15.183:3300/0 conn(0x7f6af40c45d0 0x7f6af4155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af406e0b0 con 0x7f6af40c5ec0 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f6ae4001670 con 0x7f6af40c5ec0 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 >> v1:172.21.15.91:6789/0 conn(0x7f6af40c5ec0 legacy=0x7f6af40c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 --2- 172.21.15.91:0/1810110659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 0x7f6ae0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 --2- 172.21.15.91:0/1810110659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c3340 0x7f6ae00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 --2- 172.21.15.91:0/1810110659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae0004d00 0x7f6ae0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af406e390 con 0x7f6ae0003970 2023-11-27T20:42:21.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af406ddd0 con 0x7f6ae0004d00 2023-11-27T20:42:21.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae000bbc0 con 0x7f6af40c3340 2023-11-27T20:42:21.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.637+0000 7f6af3fff640 1 --2- 172.21.15.91:0/1810110659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 0x7f6ae0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:21.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.638+0000 7f6af3fff640 1 -- 172.21.15.91:0/1810110659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c3340 msgr2=0x7f6ae00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:21.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.638+0000 7f6af3fff640 1 --2- 172.21.15.91:0/1810110659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c3340 0x7f6ae00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.638+0000 7f6af3fff640 1 -- 172.21.15.91:0/1810110659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae0004d00 msgr2=0x7f6ae0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:21.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.638+0000 7f6af3fff640 1 --2- 172.21.15.91:0/1810110659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae0004d00 0x7f6ae0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.638+0000 7f6af3fff640 1 -- 172.21.15.91:0/1810110659 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae0003520 con 0x7f6ae0003970 2023-11-27T20:42:21.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.639+0000 7f6af3fff640 1 --2- 172.21.15.91:0/1810110659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 0x7f6ae0003d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400c240 tx=0x7f6ae00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8601244553178c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:21.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.639+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4005ad0 con 0x7f6ae0003970 2023-11-27T20:42:21.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.639+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4005c30 con 0x7f6ae0003970 2023-11-27T20:42:21.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.639+0000 7f6af2ffd640 1 -- 172.21.15.91:0/1810110659 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae402c8b0 con 0x7f6ae0003970 2023-11-27T20:42:21.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.639+0000 7f6afa39e640 1 -- 172.21.15.91:0/1810110659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 msgr2=0x7f6ae0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:21.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.639+0000 7f6afa39e640 1 --2- 172.21.15.91:0/1810110659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 0x7f6ae0003d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400c240 tx=0x7f6ae00057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.639+0000 7f6af893b640 1 -- 172.21.15.91:0/1810110659 reap_dead start 2023-11-27T20:42:21.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.640+0000 7f6afa39e640 1 -- 172.21.15.91:0/1810110659 shutdown_connections 2023-11-27T20:42:21.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.640+0000 7f6afa39e640 1 -- 172.21.15.91:0/1810110659 >> 172.21.15.91:0/1810110659 conn(0x7f6af406a500 msgr2=0x7f6af406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:21.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.640+0000 7f6afa39e640 1 -- 172.21.15.91:0/1810110659 shutdown_connections 2023-11-27T20:42:21.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.640+0000 7f6afa39e640 1 -- 172.21.15.91:0/1810110659 wait complete. 2023-11-27T20:42:21.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.641+0000 7f6afa39e640 1 Processor -- start 2023-11-27T20:42:21.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.642+0000 7f6afa39e640 1 -- start start 2023-11-27T20:42:21.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.642+0000 7f6afa39e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 0x7f6af40a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.642+0000 7f6afa39e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af41556a0 0x7f6af4155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.642+0000 7f6afa39e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c1a80 0x7f6af40a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.642+0000 7f6afa39e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4156b60 con 0x7f6ae0003970 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.642+0000 7f6afa39e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af41edf30 con 0x7f6af41556a0 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.642+0000 7f6afa39e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af41ee4b0 con 0x7f6af40c1a80 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.643+0000 7f6af3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 0x7f6af40a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.643+0000 7f6af3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 0x7f6af40a7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43818/0 (socket says 172.21.15.91:43818) 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.643+0000 7f6af3fff640 1 -- 172.21.15.91:0/362338450 learned_addr learned my addr 172.21.15.91:0/362338450 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.643+0000 7f6af3fff640 1 -- 172.21.15.91:0/362338450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c1a80 msgr2=0x7f6af40a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.643+0000 7f6af3fff640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c1a80 0x7f6af40a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.643+0000 7f6af3fff640 1 -- 172.21.15.91:0/362338450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af41556a0 msgr2=0x7f6af4155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:21.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.643+0000 7f6af3fff640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af41556a0 0x7f6af4155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:21.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.643+0000 7f6af3fff640 1 -- 172.21.15.91:0/362338450 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af41ee1d0 con 0x7f6ae0003970 2023-11-27T20:42:21.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.643+0000 7f6af3fff640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 0x7f6af40a7af0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ae402c450 tx=0x7f6ae4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:21.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.644+0000 7f6af0ff9640 1 -- 172.21.15.91:0/362338450 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae403c040 con 0x7f6ae0003970 2023-11-27T20:42:21.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.644+0000 7f6af0ff9640 1 -- 172.21.15.91:0/362338450 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae402ccc0 con 0x7f6ae0003970 2023-11-27T20:42:21.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.644+0000 7f6af0ff9640 1 -- 172.21.15.91:0/362338450 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40072b0 con 0x7f6ae0003970 2023-11-27T20:42:21.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.644+0000 7f6afa39e640 1 -- 172.21.15.91:0/362338450 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af40a8370 con 0x7f6ae0003970 2023-11-27T20:42:21.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.644+0000 7f6afa39e640 1 -- 172.21.15.91:0/362338450 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af4150920 con 0x7f6ae0003970 2023-11-27T20:42:21.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.645+0000 7f6afa39e640 1 -- 172.21.15.91:0/362338450 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af4068350 con 0x7f6ae0003970 2023-11-27T20:42:21.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.646+0000 7f6af0ff9640 1 -- 172.21.15.91:0/362338450 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6ae4032070 con 0x7f6ae0003970 2023-11-27T20:42:21.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.647+0000 7f6af0ff9640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad406b1c0 0x7f6ad406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:21.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.647+0000 7f6af0ff9640 1 -- 172.21.15.91:0/362338450 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f6ae40aad80 con 0x7f6ae0003970 2023-11-27T20:42:21.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.647+0000 7f6af37fe640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad406b1c0 0x7f6ad406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:21.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.648+0000 7f6af37fe640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad406b1c0 0x7f6ad406d680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6adc006e80 tx=0x7f6adc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:21.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.651+0000 7f6af0ff9640 1 -- 172.21.15.91:0/362338450 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6ae40759d0 con 0x7f6ae0003970 2023-11-27T20:42:21.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:21.880+0000 7f6afa39e640 1 -- 172.21.15.91:0/362338450 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6af40bfa00 con 0x7f6ae0003970 2023-11-27T20:42:22.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.376+0000 7f6af0ff9640 1 -- 172.21.15.91:0/362338450 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6ae40460a0 con 0x7f6ae0003970 2023-11-27T20:42:22.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 -- 172.21.15.91:0/362338450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad406b1c0 msgr2=0x7f6ad406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:22.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad406b1c0 0x7f6ad406d680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6adc006e80 tx=0x7f6adc008040 comp rx=0 tx=0).stop 2023-11-27T20:42:22.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 -- 172.21.15.91:0/362338450 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 msgr2=0x7f6af40a7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:22.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 0x7f6af40a7af0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ae402c450 tx=0x7f6ae4001a00 comp rx=0 tx=0).stop 2023-11-27T20:42:22.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 -- 172.21.15.91:0/362338450 shutdown_connections 2023-11-27T20:42:22.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af40c1a80 0x7f6af40a6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:22.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad406b1c0 0x7f6ad406d680 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:22.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af41556a0 0x7f6af4155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:22.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 --2- 172.21.15.91:0/362338450 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ae0003970 0x7f6af40a7af0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:22.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 -- 172.21.15.91:0/362338450 >> 172.21.15.91:0/362338450 conn(0x7f6af406a500 msgr2=0x7f6af40aaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:22.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 -- 172.21.15.91:0/362338450 shutdown_connections 2023-11-27T20:42:22.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.380+0000 7f6afa39e640 1 -- 172.21.15.91:0/362338450 wait complete. 2023-11-27T20:42:22.403 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-27T20:42:22.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.620+0000 7f59fbaa6640 1 Processor -- start 2023-11-27T20:42:22.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.620+0000 7f59fbaa6640 1 -- start start 2023-11-27T20:42:22.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.621+0000 7f59fbaa6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f59f40a52d0 0x7f59f40c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:22.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.621+0000 7f59fbaa6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 0x7f59f40c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:22.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.621+0000 7f59fbaa6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f40a8de0 con 0x7f59f406c890 2023-11-27T20:42:22.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.621+0000 7f59fbaa6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f40a9030 con 0x7f59f40a52d0 2023-11-27T20:42:22.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.621+0000 7f59fbaa6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f40a9310 con 0x7f59f40c4d40 2023-11-27T20:42:22.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.621+0000 7f59f9842640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f59f40a52d0 0x7f59f40c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:22.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.622+0000 7f59f9842640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f59f40a52d0 0x7f59f40c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43824/0 (socket says 172.21.15.91:43824) 2023-11-27T20:42:22.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.622+0000 7f59f9842640 1 -- 172.21.15.91:0/2883200663 learned_addr learned my addr 172.21.15.91:0/2883200663 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:22.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.622+0000 7f59f9041640 1 --2- 172.21.15.91:0/2883200663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 0x7f59f40c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:22.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.622+0000 7f59f9842640 1 -- 172.21.15.91:0/2883200663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 msgr2=0x7f59f40c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:22.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.622+0000 7f59f9842640 1 --2- 172.21.15.91:0/2883200663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 0x7f59f40c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:22.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.622+0000 7f59f9842640 1 -- 172.21.15.91:0/2883200663 >> v1:172.21.15.183:6789/0 conn(0x7f59f406c890 legacy=0x7f59f406cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:22.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.622+0000 7f59f9842640 1 -- 172.21.15.91:0/2883200663 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f40a95f0 con 0x7f59f40a52d0 2023-11-27T20:42:22.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.622+0000 7f59f9041640 1 --2- 172.21.15.91:0/2883200663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 0x7f59f40c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:42:22.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.623+0000 7f59f9842640 1 --2- 172.21.15.91:0/2883200663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 0x7f59f40c12f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009870 tx=0x7f59f002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464d4f11e1d01e44 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:22.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59f8840640 1 -- 172.21.15.91:0/2883200663 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0031640 con 0x7f59f40a52d0 2023-11-27T20:42:22.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59f8840640 1 -- 172.21.15.91:0/2883200663 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f00317a0 con 0x7f59f40a52d0 2023-11-27T20:42:22.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59f8840640 1 -- 172.21.15.91:0/2883200663 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0031b30 con 0x7f59f40a52d0 2023-11-27T20:42:22.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59fbaa6640 1 -- 172.21.15.91:0/2883200663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 msgr2=0x7f59f40c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:22.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59fbaa6640 1 --2- 172.21.15.91:0/2883200663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 0x7f59f40c12f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009870 tx=0x7f59f002b8f0 comp rx=0 tx=0).stop 2023-11-27T20:42:22.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59fbaa6640 1 -- 172.21.15.91:0/2883200663 shutdown_connections 2023-11-27T20:42:22.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59fbaa6640 1 --2- 172.21.15.91:0/2883200663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 0x7f59f40c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:22.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59fbaa6640 1 --2- 172.21.15.91:0/2883200663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 0x7f59f40c12f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:22.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59fbaa6640 1 -- 172.21.15.91:0/2883200663 >> 172.21.15.91:0/2883200663 conn(0x7f59f40c5d30 msgr2=0x7f59f40c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:22.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59fbaa6640 1 -- 172.21.15.91:0/2883200663 shutdown_connections 2023-11-27T20:42:22.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.624+0000 7f59fbaa6640 1 -- 172.21.15.91:0/2883200663 wait complete. 2023-11-27T20:42:22.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.626+0000 7f59fbaa6640 1 Processor -- start 2023-11-27T20:42:22.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.626+0000 7f59fbaa6640 1 -- start start 2023-11-27T20:42:22.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.627+0000 7f59fbaa6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f406c890 0x7f59f41df130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:22.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.627+0000 7f59fbaa6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 0x7f59f40a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:22.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.627+0000 7f59fbaa6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 0x7f59f4140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:22.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.627+0000 7f59fbaa6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f40bb360 con 0x7f59f40a52d0 2023-11-27T20:42:22.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.627+0000 7f59fbaa6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f414fac0 con 0x7f59f406c890 2023-11-27T20:42:22.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.627+0000 7f59fbaa6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f40a7a20 con 0x7f59f40c4d40 2023-11-27T20:42:22.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.627+0000 7f59f9041640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 0x7f59f40a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:22.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.627+0000 7f59f9041640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 0x7f59f40a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43836/0 (socket says 172.21.15.91:43836) 2023-11-27T20:42:22.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.627+0000 7f59f9041640 1 -- 172.21.15.91:0/1400658522 learned_addr learned my addr 172.21.15.91:0/1400658522 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:22.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.628+0000 7f59fa043640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 0x7f59f4140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:22.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.628+0000 7f59f9842640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f406c890 0x7f59f41df130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:22.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.628+0000 7f59f9041640 1 -- 172.21.15.91:0/1400658522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 msgr2=0x7f59f4140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:22.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.628+0000 7f59f9041640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 0x7f59f4140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:22.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.628+0000 7f59f9041640 1 -- 172.21.15.91:0/1400658522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f406c890 msgr2=0x7f59f41df130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:22.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.628+0000 7f59f9041640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f406c890 0x7f59f41df130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:22.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.628+0000 7f59f9041640 1 -- 172.21.15.91:0/1400658522 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00094d0 con 0x7f59f40a52d0 2023-11-27T20:42:22.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.628+0000 7f59f9842640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f406c890 0x7f59f41df130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:42:22.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.628+0000 7f59f9041640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 0x7f59f40a63e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f59e800d7d0 tx=0x7f59e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:22.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.629+0000 7f59e67fc640 1 -- 172.21.15.91:0/1400658522 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8004030 con 0x7f59f40a52d0 2023-11-27T20:42:22.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.629+0000 7f59e67fc640 1 -- 172.21.15.91:0/1400658522 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e8004190 con 0x7f59f40a52d0 2023-11-27T20:42:22.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.629+0000 7f59e67fc640 1 -- 172.21.15.91:0/1400658522 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8004520 con 0x7f59f40a52d0 2023-11-27T20:42:22.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.629+0000 7f59fbaa6640 1 -- 172.21.15.91:0/1400658522 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f40a7740 con 0x7f59f40a52d0 2023-11-27T20:42:22.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.629+0000 7f59fbaa6640 1 -- 172.21.15.91:0/1400658522 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f414f750 con 0x7f59f40a52d0 2023-11-27T20:42:22.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.630+0000 7f59fbaa6640 1 -- 172.21.15.91:0/1400658522 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f414f2d0 con 0x7f59f40a52d0 2023-11-27T20:42:22.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.631+0000 7f59e67fc640 1 -- 172.21.15.91:0/1400658522 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f59e80096a0 con 0x7f59f40a52d0 2023-11-27T20:42:22.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.632+0000 7f59e67fc640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59d806b1c0 0x7f59d806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:22.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.632+0000 7f59e67fc640 1 -- 172.21.15.91:0/1400658522 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f59e8089cc0 con 0x7f59f40a52d0 2023-11-27T20:42:22.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.632+0000 7f59f9842640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59d806b1c0 0x7f59d806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:22.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.633+0000 7f59f9842640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59d806b1c0 0x7f59d806d680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f59f0036000 tx=0x7f59f003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:22.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.636+0000 7f59e67fc640 1 -- 172.21.15.91:0/1400658522 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f59f414f2d0 con 0x7f59f40a52d0 2023-11-27T20:42:22.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:22.827+0000 7f59fbaa6640 1 -- 172.21.15.91:0/1400658522 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59f414f2d0 con 0x7f59f40a52d0 2023-11-27T20:42:23.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.550+0000 7f59e67fc640 1 -- 172.21.15.91:0/1400658522 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f59f414f2d0 con 0x7f59f40a52d0 2023-11-27T20:42:23.552 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' removed 2023-11-27T20:42:23.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 -- 172.21.15.91:0/1400658522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59d806b1c0 msgr2=0x7f59d806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:23.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59d806b1c0 0x7f59d806d680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f59f0036000 tx=0x7f59f003c040 comp rx=0 tx=0).stop 2023-11-27T20:42:23.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 -- 172.21.15.91:0/1400658522 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 msgr2=0x7f59f40a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:23.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 0x7f59f40a63e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f59e800d7d0 tx=0x7f59e800dc90 comp rx=0 tx=0).stop 2023-11-27T20:42:23.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 -- 172.21.15.91:0/1400658522 shutdown_connections 2023-11-27T20:42:23.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59f40c4d40 0x7f59f4140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59f40a52d0 0x7f59f40a63e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59d806b1c0 0x7f59d806d680 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 --2- 172.21.15.91:0/1400658522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f406c890 0x7f59f41df130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 -- 172.21.15.91:0/1400658522 >> 172.21.15.91:0/1400658522 conn(0x7f59f40c5d30 msgr2=0x7f59f40a83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:23.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 -- 172.21.15.91:0/1400658522 shutdown_connections 2023-11-27T20:42:23.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.554+0000 7f59fbaa6640 1 -- 172.21.15.91:0/1400658522 wait complete. 2023-11-27T20:42:23.579 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-27T20:42:23.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.788+0000 7f2a43f90640 1 Processor -- start 2023-11-27T20:42:23.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.788+0000 7f2a43f90640 1 -- start start 2023-11-27T20:42:23.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.790+0000 7f2a43f90640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2a3c0aa940 0x7f2a3c071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:23.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.790+0000 7f2a43f90640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2a3c0c4660 0x7f2a3c0aad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:23.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.790+0000 7f2a43f90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4180 0x7f2a3c0a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:23.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.790+0000 7f2a43f90640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c0c3120 con 0x7f2a3c0c4660 2023-11-27T20:42:23.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.790+0000 7f2a43f90640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c0a9560 con 0x7f2a3c0aa940 2023-11-27T20:42:23.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.790+0000 7f2a43f90640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0a9820 con 0x7f2a3c0c4180 2023-11-27T20:42:23.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.790+0000 7f2a4152b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2a3c0c4660 0x7f2a3c0aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:23.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.790+0000 7f2a4152b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2a3c0c4660 0x7f2a3c0aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43844/0 (socket says 172.21.15.91:43844) 2023-11-27T20:42:23.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.790+0000 7f2a4152b640 1 -- 172.21.15.91:0/1936699864 learned_addr learned my addr 172.21.15.91:0/1936699864 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:23.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.791+0000 7f2a4252d640 1 --2- 172.21.15.91:0/1936699864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4180 0x7f2a3c0a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:23.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.791+0000 7f2a4152b640 1 -- 172.21.15.91:0/1936699864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4180 msgr2=0x7f2a3c0a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:23.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.791+0000 7f2a41d2c640 1 --2- 172.21.15.91:0/1936699864 >> v2:172.21.15.183:3300/0 conn(0x7f2a3c0aa940 0x7f2a3c071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:23.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.791+0000 7f2a4152b640 1 --2- 172.21.15.91:0/1936699864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4180 0x7f2a3c0a9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.791+0000 7f2a4152b640 1 -- 172.21.15.91:0/1936699864 >> v2:172.21.15.183:3300/0 conn(0x7f2a3c0aa940 msgr2=0x7f2a3c071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:23.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.791+0000 7f2a4152b640 1 --2- 172.21.15.91:0/1936699864 >> v2:172.21.15.183:3300/0 conn(0x7f2a3c0aa940 0x7f2a3c071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.791+0000 7f2a4152b640 1 -- 172.21.15.91:0/1936699864 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c0c4b50 con 0x7f2a3c0c4660 2023-11-27T20:42:23.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.791+0000 7f2a4252d640 1 --2- 172.21.15.91:0/1936699864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4180 0x7f2a3c0a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:23.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.791+0000 7f2a41d2c640 1 --2- 172.21.15.91:0/1936699864 >> v2:172.21.15.183:3300/0 conn(0x7f2a3c0aa940 0x7f2a3c071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:23.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.792+0000 7f2a4152b640 1 --2- 172.21.15.91:0/1936699864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0c4660 0x7f2a3c0aad20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0c4d40 tx=0x7f2a3002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a590c1e8f2b5e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:23.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.792+0000 7f2a40d2a640 1 -- 172.21.15.91:0/1936699864 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30031640 con 0x7f2a3c0c4660 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.792+0000 7f2a40d2a640 1 -- 172.21.15.91:0/1936699864 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a300317a0 con 0x7f2a3c0c4660 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.792+0000 7f2a40d2a640 1 -- 172.21.15.91:0/1936699864 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30031b30 con 0x7f2a3c0c4660 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.793+0000 7f2a43f90640 1 -- 172.21.15.91:0/1936699864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0c4660 msgr2=0x7f2a3c0aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.793+0000 7f2a43f90640 1 --2- 172.21.15.91:0/1936699864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0c4660 0x7f2a3c0aad20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0c4d40 tx=0x7f2a3002b8f0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.793+0000 7f2a43f90640 1 -- 172.21.15.91:0/1936699864 shutdown_connections 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.793+0000 7f2a43f90640 1 --2- 172.21.15.91:0/1936699864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4180 0x7f2a3c0a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.793+0000 7f2a43f90640 1 --2- 172.21.15.91:0/1936699864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0c4660 0x7f2a3c0aad20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.793+0000 7f2a43f90640 1 --2- 172.21.15.91:0/1936699864 >> v2:172.21.15.183:3300/0 conn(0x7f2a3c0aa940 0x7f2a3c071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.793+0000 7f2a43f90640 1 -- 172.21.15.91:0/1936699864 >> 172.21.15.91:0/1936699864 conn(0x7f2a3c0c5bc0 msgr2=0x7f2a3c0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.793+0000 7f2a43f90640 1 -- 172.21.15.91:0/1936699864 shutdown_connections 2023-11-27T20:42:23.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.793+0000 7f2a43f90640 1 -- 172.21.15.91:0/1936699864 wait complete. 2023-11-27T20:42:23.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.795+0000 7f2a43f90640 1 Processor -- start 2023-11-27T20:42:23.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.795+0000 7f2a43f90640 1 -- start start 2023-11-27T20:42:23.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.796+0000 7f2a43f90640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0aa940 0x7f2a3c1d9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:23.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.796+0000 7f2a43f90640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3c0c4180 0x7f2a3c1de480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:23.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.796+0000 7f2a43f90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4660 0x7f2a3c0a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:23.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.796+0000 7f2a43f90640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0a74f0 con 0x7f2a3c0aa940 2023-11-27T20:42:23.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.796+0000 7f2a43f90640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0a8ac0 con 0x7f2a3c0c4180 2023-11-27T20:42:23.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.796+0000 7f2a43f90640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0a85d0 con 0x7f2a3c0c4660 2023-11-27T20:42:23.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.796+0000 7f2a41d2c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0aa940 0x7f2a3c1d9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:23.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.796+0000 7f2a41d2c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0aa940 0x7f2a3c1d9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43856/0 (socket says 172.21.15.91:43856) 2023-11-27T20:42:23.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.796+0000 7f2a41d2c640 1 -- 172.21.15.91:0/2478888750 learned_addr learned my addr 172.21.15.91:0/2478888750 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:23.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a4152b640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3c0c4180 0x7f2a3c1de480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:23.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a4252d640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4660 0x7f2a3c0a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:23.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a41d2c640 1 -- 172.21.15.91:0/2478888750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4660 msgr2=0x7f2a3c0a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:23.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a41d2c640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4660 0x7f2a3c0a58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a41d2c640 1 -- 172.21.15.91:0/2478888750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3c0c4180 msgr2=0x7f2a3c1de480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:23.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a41d2c640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3c0c4180 0x7f2a3c1de480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:23.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a41d2c640 1 -- 172.21.15.91:0/2478888750 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a300094d0 con 0x7f2a3c0aa940 2023-11-27T20:42:23.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a4152b640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3c0c4180 0x7f2a3c1de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:23.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a41d2c640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0aa940 0x7f2a3c1d9000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00ce00 tx=0x7f2a2c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:23.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a3a7fc640 1 -- 172.21.15.91:0/2478888750 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00f680 con 0x7f2a3c0aa940 2023-11-27T20:42:23.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a3a7fc640 1 -- 172.21.15.91:0/2478888750 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00f7e0 con 0x7f2a3c0aa940 2023-11-27T20:42:23.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a3a7fc640 1 -- 172.21.15.91:0/2478888750 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00fbb0 con 0x7f2a3c0aa940 2023-11-27T20:42:23.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.797+0000 7f2a43f90640 1 -- 172.21.15.91:0/2478888750 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c0be850 con 0x7f2a3c0aa940 2023-11-27T20:42:23.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.798+0000 7f2a43f90640 1 -- 172.21.15.91:0/2478888750 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c1dcd10 con 0x7f2a3c0aa940 2023-11-27T20:42:23.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.799+0000 7f2a43f90640 1 -- 172.21.15.91:0/2478888750 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c067950 con 0x7f2a3c0aa940 2023-11-27T20:42:23.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.800+0000 7f2a3a7fc640 1 -- 172.21.15.91:0/2478888750 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2a2c00b040 con 0x7f2a3c0aa940 2023-11-27T20:42:23.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.800+0000 7f2a3a7fc640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a2806b1f0 0x7f2a2806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:23.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.801+0000 7f2a3a7fc640 1 -- 172.21.15.91:0/2478888750 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5481+0+0 (secure 0 0 0) 0x7f2a2c08a2e0 con 0x7f2a3c0aa940 2023-11-27T20:42:23.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.801+0000 7f2a4152b640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a2806b1f0 0x7f2a2806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:23.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.802+0000 7f2a4152b640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a2806b1f0 0x7f2a2806d6b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2a30036000 tx=0x7f2a3003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:23.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.805+0000 7f2a3a7fc640 1 -- 172.21.15.91:0/2478888750 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2a2c0550e0 con 0x7f2a3c0aa940 2023-11-27T20:42:23.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:23.994+0000 7f2a43f90640 1 -- 172.21.15.91:0/2478888750 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2a3c068350 con 0x7f2a3c0aa940 2023-11-27T20:42:24.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.554+0000 7f2a3a7fc640 1 -- 172.21.15.91:0/2478888750 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2a2c058700 con 0x7f2a3c0aa940 2023-11-27T20:42:24.555 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' removed 2023-11-27T20:42:24.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.558+0000 7f2a43f90640 1 -- 172.21.15.91:0/2478888750 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a2806b1f0 msgr2=0x7f2a2806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:24.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.558+0000 7f2a43f90640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a2806b1f0 0x7f2a2806d6b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2a30036000 tx=0x7f2a3003c040 comp rx=0 tx=0).stop 2023-11-27T20:42:24.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.558+0000 7f2a43f90640 1 -- 172.21.15.91:0/2478888750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0aa940 msgr2=0x7f2a3c1d9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:24.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.558+0000 7f2a43f90640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0aa940 0x7f2a3c1d9000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00ce00 tx=0x7f2a2c00a650 comp rx=0 tx=0).stop 2023-11-27T20:42:24.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.559+0000 7f2a43f90640 1 -- 172.21.15.91:0/2478888750 shutdown_connections 2023-11-27T20:42:24.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.559+0000 7f2a43f90640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3c0c4660 0x7f2a3c0a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:24.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.559+0000 7f2a43f90640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a2806b1f0 0x7f2a2806d6b0 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2a30036000 tx=0x7f2a3003c040 comp rx=0 tx=0).stop 2023-11-27T20:42:24.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.559+0000 7f2a43f90640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3c0c4180 0x7f2a3c1de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:24.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.559+0000 7f2a43f90640 1 --2- 172.21.15.91:0/2478888750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3c0aa940 0x7f2a3c1d9000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:24.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.559+0000 7f2a43f90640 1 -- 172.21.15.91:0/2478888750 >> 172.21.15.91:0/2478888750 conn(0x7f2a3c0c5bc0 msgr2=0x7f2a3c0c4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:24.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.560+0000 7f2a43f90640 1 -- 172.21.15.91:0/2478888750 shutdown_connections 2023-11-27T20:42:24.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.560+0000 7f2a43f90640 1 -- 172.21.15.91:0/2478888750 wait complete. 2023-11-27T20:42:24.588 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T20:42:24.589 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-27T20:42:24.589 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-27T20:42:24.589 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:42:24.590 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T20:42:24.590 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-27T20:42:24.590 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-27T20:42:24.590 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:42:24.590 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T20:42:24.591 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-27T20:42:24.591 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-27T20:42:24.591 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:42:24.591 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-27T20:42:24.591 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-27T20:42:24.592 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-27T20:42:24.592 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:42:24.609 INFO:tasks.ceph.mds.a:Stopped 2023-11-27T20:42:24.609 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-27T20:42:24.610 INFO:tasks.ceph.mds.c:Stopped 2023-11-27T20:42:24.610 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-27T20:42:24.614 INFO:tasks.ceph.mds.d:Stopped 2023-11-27T20:42:24.615 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-27T20:42:24.615 INFO:tasks.ceph.mds.b:Stopped 2023-11-27T20:42:24.616 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-27T20:42:24.658 INFO:tasks.ceph.mds.a:Started 2023-11-27T20:42:24.658 DEBUG:teuthology.parallel:result is None 2023-11-27T20:42:24.662 INFO:tasks.ceph.mds.d:Started 2023-11-27T20:42:24.662 DEBUG:teuthology.parallel:result is None 2023-11-27T20:42:24.663 INFO:tasks.ceph.mds.c:Started 2023-11-27T20:42:24.663 DEBUG:teuthology.parallel:result is None 2023-11-27T20:42:24.666 INFO:tasks.ceph.mds.b:Started 2023-11-27T20:42:24.666 DEBUG:teuthology.parallel:result is None 2023-11-27T20:42:24.667 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-27T20:42:24.814 INFO:tasks.ceph.mds.a.smithi091.stdout:starting mds.a at 2023-11-27T20:42:24.815 INFO:tasks.ceph.mds.c.smithi091.stdout:starting mds.c at 2023-11-27T20:42:24.818 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-11-27T20:42:24.819 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-11-27T20:42:24.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.851+0000 7fd7f1ff4640 1 Processor -- start 2023-11-27T20:42:24.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.851+0000 7fd7f1ff4640 1 -- start start 2023-11-27T20:42:24.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.852+0000 7fd7f1ff4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd7ec14e7c0 0x7fd7ec0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.852+0000 7fd7f1ff4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7ec154580 0x7fd7ec1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.852+0000 7fd7f1ff4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec158a60 con 0x7fd7ec0c4c00 2023-11-27T20:42:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.852+0000 7fd7f1ff4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec0c5b10 con 0x7fd7ec14e7c0 2023-11-27T20:42:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.852+0000 7fd7f1ff4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec157ca0 con 0x7fd7ec154580 2023-11-27T20:42:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.852+0000 7fd7f0ff2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd7ec14e7c0 0x7fd7ec0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.852+0000 7fd7f0ff2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd7ec14e7c0 0x7fd7ec0c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36686/0 (socket says 172.21.15.91:36686) 2023-11-27T20:42:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.852+0000 7fd7ebfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd7ec0c4c00 0x7fd7ec0ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:47638/0 (socket says 172.21.15.91:47638) 2023-11-27T20:42:24.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.852+0000 7fd7f0ff2640 1 -- 172.21.15.91:0/3509447497 learned_addr learned my addr 172.21.15.91:0/3509447497 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:24.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.853+0000 7fd7f17f3640 1 --2- 172.21.15.91:0/3509447497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7ec154580 0x7fd7ec1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:24.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.853+0000 7fd7f0ff2640 1 -- 172.21.15.91:0/3509447497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7ec154580 msgr2=0x7fd7ec1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:24.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.853+0000 7fd7f0ff2640 1 --2- 172.21.15.91:0/3509447497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7ec154580 0x7fd7ec1549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:24.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.853+0000 7fd7f0ff2640 1 -- 172.21.15.91:0/3509447497 >> v1:172.21.15.91:6789/0 conn(0x7fd7ec0c4c00 legacy=0x7fd7ec0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:24.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.853+0000 7fd7eb7fe640 1 -- 172.21.15.91:0/3509447497 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198414493 0 0) 0x7fd7ec158a60 con 0x7fd7ec0c4c00 2023-11-27T20:42:24.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.853+0000 7fd7f0ff2640 1 -- 172.21.15.91:0/3509447497 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec157f80 con 0x7fd7ec14e7c0 2023-11-27T20:42:24.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.854+0000 7fd7f0ff2640 1 --2- 172.21.15.91:0/3509447497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec14e7c0 0x7fd7ec0c46c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009870 tx=0x7fd7e002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c6534985f60e2e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:24.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.854+0000 7fd7eb7fe640 1 -- 172.21.15.91:0/3509447497 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00317c0 con 0x7fd7ec14e7c0 2023-11-27T20:42:24.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.854+0000 7fd7eb7fe640 1 -- 172.21.15.91:0/3509447497 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e0031920 con 0x7fd7ec14e7c0 2023-11-27T20:42:24.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.855+0000 7fd7eb7fe640 1 -- 172.21.15.91:0/3509447497 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0031cb0 con 0x7fd7ec14e7c0 2023-11-27T20:42:24.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.855+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/3509447497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec14e7c0 msgr2=0x7fd7ec0c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:24.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.855+0000 7fd7f1ff4640 1 --2- 172.21.15.91:0/3509447497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec14e7c0 0x7fd7ec0c46c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009870 tx=0x7fd7e002b860 comp rx=0 tx=0).stop 2023-11-27T20:42:24.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.855+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/3509447497 shutdown_connections 2023-11-27T20:42:24.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.855+0000 7fd7f1ff4640 1 --2- 172.21.15.91:0/3509447497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7ec154580 0x7fd7ec1549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:24.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.855+0000 7fd7f1ff4640 1 --2- 172.21.15.91:0/3509447497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec14e7c0 0x7fd7ec0c46c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:24.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.855+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/3509447497 >> 172.21.15.91:0/3509447497 conn(0x7fd7ec0abf00 msgr2=0x7fd7ec0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:24.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.855+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/3509447497 shutdown_connections 2023-11-27T20:42:24.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.855+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/3509447497 wait complete. 2023-11-27T20:42:24.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.857+0000 7fd7f1ff4640 1 Processor -- start 2023-11-27T20:42:24.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.857+0000 7fd7f1ff4640 1 -- start start 2023-11-27T20:42:24.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7f1ff4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7ec0c4c00 0x7fd7ec1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:24.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7f1ff4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7ec14e7c0 0x7fd7ec0aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:24.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7f1ff4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec154580 0x7fd7ec1ed210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:24.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7f1ff4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec1572c0 con 0x7fd7ec154580 2023-11-27T20:42:24.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7f1ff4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec155f50 con 0x7fd7ec0c4c00 2023-11-27T20:42:24.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7f1ff4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec1465d0 con 0x7fd7ec14e7c0 2023-11-27T20:42:24.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7f17f3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec154580 0x7fd7ec1ed210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:24.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7f17f3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec154580 0x7fd7ec1ed210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36698/0 (socket says 172.21.15.91:36698) 2023-11-27T20:42:24.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7f17f3640 1 -- 172.21.15.91:0/222829727 learned_addr learned my addr 172.21.15.91:0/222829727 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:24.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7ebfff640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7ec14e7c0 0x7fd7ec0aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:24.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.858+0000 7fd7f0ff2640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7ec0c4c00 0x7fd7ec1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:24.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.859+0000 7fd7f17f3640 1 -- 172.21.15.91:0/222829727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7ec14e7c0 msgr2=0x7fd7ec0aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:24.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.859+0000 7fd7f17f3640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7ec14e7c0 0x7fd7ec0aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:24.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.859+0000 7fd7f17f3640 1 -- 172.21.15.91:0/222829727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7ec0c4c00 msgr2=0x7fd7ec1558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:24.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.859+0000 7fd7f17f3640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7ec0c4c00 0x7fd7ec1558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:24.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.859+0000 7fd7f17f3640 1 -- 172.21.15.91:0/222829727 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e00094d0 con 0x7fd7ec154580 2023-11-27T20:42:24.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.859+0000 7fd7f17f3640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec154580 0x7fd7ec1ed210 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4007e40 tx=0x7fd7e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:24.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.859+0000 7fd7e97fa640 1 -- 172.21.15.91:0/222829727 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4014620 con 0x7fd7ec154580 2023-11-27T20:42:24.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.859+0000 7fd7e97fa640 1 -- 172.21.15.91:0/222829727 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e400ee90 con 0x7fd7ec154580 2023-11-27T20:42:24.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.859+0000 7fd7e97fa640 1 -- 172.21.15.91:0/222829727 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40149e0 con 0x7fd7ec154580 2023-11-27T20:42:24.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.859+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/222829727 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec1468b0 con 0x7fd7ec154580 2023-11-27T20:42:24.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.860+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/222829727 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec0ab050 con 0x7fd7ec154580 2023-11-27T20:42:24.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.861+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/222829727 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec147130 con 0x7fd7ec154580 2023-11-27T20:42:24.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.862+0000 7fd7e97fa640 1 -- 172.21.15.91:0/222829727 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd7e4014b40 con 0x7fd7ec154580 2023-11-27T20:42:24.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.862+0000 7fd7e97fa640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7d006b1c0 0x7fd7d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:24.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.863+0000 7fd7e97fa640 1 -- 172.21.15.91:0/222829727 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd7e4089fd0 con 0x7fd7ec154580 2023-11-27T20:42:24.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.863+0000 7fd7f0ff2640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7d006b1c0 0x7fd7d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:24.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.863+0000 7fd7f0ff2640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7d006b1c0 0x7fd7d006d680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0036000 tx=0x7fd7e003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:24.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:24.867+0000 7fd7e97fa640 1 -- 172.21.15.91:0/222829727 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd7ec147130 con 0x7fd7ec154580 2023-11-27T20:42:25.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:25.064+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/222829727 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd7ec147130 con 0x7fd7ec154580 2023-11-27T20:42:30.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.209+0000 7fd7e97fa640 1 -- 172.21.15.91:0/222829727 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd7ec147130 con 0x7fd7ec154580 2023-11-27T20:42:30.456 INFO:teuthology.orchestra.run.smithi091.stderr: removed all blocklist entries 2023-11-27T20:42:30.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.212+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/222829727 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7d006b1c0 msgr2=0x7fd7d006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:30.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.212+0000 7fd7f1ff4640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7d006b1c0 0x7fd7d006d680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0036000 tx=0x7fd7e003d040 comp rx=0 tx=0).stop 2023-11-27T20:42:30.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.212+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/222829727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec154580 msgr2=0x7fd7ec1ed210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:30.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.212+0000 7fd7f1ff4640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec154580 0x7fd7ec1ed210 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4007e40 tx=0x7fd7e400e4b0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.213+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/222829727 shutdown_connections 2023-11-27T20:42:30.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.213+0000 7fd7f1ff4640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7ec154580 0x7fd7ec1ed210 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.213+0000 7fd7f1ff4640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7ec14e7c0 0x7fd7ec0aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.213+0000 7fd7f1ff4640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7d006b1c0 0x7fd7d006d680 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.213+0000 7fd7f1ff4640 1 --2- 172.21.15.91:0/222829727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7ec0c4c00 0x7fd7ec1558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.213+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/222829727 >> 172.21.15.91:0/222829727 conn(0x7fd7ec0abf00 msgr2=0x7fd7ec1549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:30.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.213+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/222829727 shutdown_connections 2023-11-27T20:42:30.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:26.213+0000 7fd7f1ff4640 1 -- 172.21.15.91:0/222829727 wait complete. 2023-11-27T20:42:30.458 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-27T20:42:30.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.678+0000 7f78e87a9640 1 Processor -- start 2023-11-27T20:42:30.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.678+0000 7f78e87a9640 1 -- start start 2023-11-27T20:42:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.680+0000 7f78e87a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78e006a770 0x7f78e006ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.680+0000 7f78e87a9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f78e006b090 0x7f78e014f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.680+0000 7f78e87a9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e01534e0 con 0x7f78e0072050 2023-11-27T20:42:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.680+0000 7f78e87a9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e00aab70 con 0x7f78e006b090 2023-11-27T20:42:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.680+0000 7f78e87a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0152f80 con 0x7f78e006a770 2023-11-27T20:42:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.680+0000 7f78e5d44640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f78e006b090 0x7f78e014f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.680+0000 7f78e5d44640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f78e006b090 0x7f78e014f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36708/0 (socket says 172.21.15.91:36708) 2023-11-27T20:42:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.680+0000 7f78e5d44640 1 -- 172.21.15.91:0/2905878166 learned_addr learned my addr 172.21.15.91:0/2905878166 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.681+0000 7f78e6545640 1 --2- 172.21.15.91:0/2905878166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78e006a770 0x7f78e006ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:30.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.681+0000 7f78e5d44640 1 -- 172.21.15.91:0/2905878166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78e006a770 msgr2=0x7f78e006ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:30.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.681+0000 7f78e5d44640 1 --2- 172.21.15.91:0/2905878166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78e006a770 0x7f78e006ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.681+0000 7f78e5d44640 1 -- 172.21.15.91:0/2905878166 >> v1:172.21.15.183:6789/0 conn(0x7f78e0072050 legacy=0x7f78e0070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:30.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.681+0000 7f78e5d44640 1 -- 172.21.15.91:0/2905878166 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e00ac470 con 0x7f78e006b090 2023-11-27T20:42:30.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.682+0000 7f78e5d44640 1 --2- 172.21.15.91:0/2905878166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e006b090 0x7f78e014f940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009870 tx=0x7f78d402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03ce99b1d29a05d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:30.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.683+0000 7f78e5543640 1 -- 172.21.15.91:0/2905878166 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4031740 con 0x7f78e006b090 2023-11-27T20:42:30.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.683+0000 7f78e5543640 1 -- 172.21.15.91:0/2905878166 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d40318a0 con 0x7f78e006b090 2023-11-27T20:42:30.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.683+0000 7f78e5543640 1 -- 172.21.15.91:0/2905878166 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4031c30 con 0x7f78e006b090 2023-11-27T20:42:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.683+0000 7f78e87a9640 1 -- 172.21.15.91:0/2905878166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e006b090 msgr2=0x7f78e014f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.683+0000 7f78e87a9640 1 --2- 172.21.15.91:0/2905878166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e006b090 0x7f78e014f940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009870 tx=0x7f78d402b7e0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.683+0000 7f78e87a9640 1 -- 172.21.15.91:0/2905878166 shutdown_connections 2023-11-27T20:42:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.683+0000 7f78e87a9640 1 --2- 172.21.15.91:0/2905878166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e006b090 0x7f78e014f940 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.683+0000 7f78e87a9640 1 --2- 172.21.15.91:0/2905878166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78e006a770 0x7f78e006ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.683+0000 7f78e87a9640 1 -- 172.21.15.91:0/2905878166 >> 172.21.15.91:0/2905878166 conn(0x7f78e00c6ee0 msgr2=0x7f78e00c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.683+0000 7f78e87a9640 1 -- 172.21.15.91:0/2905878166 shutdown_connections 2023-11-27T20:42:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.684+0000 7f78e87a9640 1 -- 172.21.15.91:0/2905878166 wait complete. 2023-11-27T20:42:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.685+0000 7f78e87a9640 1 Processor -- start 2023-11-27T20:42:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.685+0000 7f78e87a9640 1 -- start start 2023-11-27T20:42:30.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.686+0000 7f78e87a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78e006a770 0x7f78e01ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:30.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.686+0000 7f78e87a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78e006b090 0x7f78e01eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:30.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.686+0000 7f78e87a9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e0072050 0x7f78e00c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:30.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.686+0000 7f78e87a9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00c6790 con 0x7f78e0072050 2023-11-27T20:42:30.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.686+0000 7f78e87a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e01eab50 con 0x7f78e006b090 2023-11-27T20:42:30.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.686+0000 7f78e87a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e01ea560 con 0x7f78e006a770 2023-11-27T20:42:30.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.687+0000 7f78e6d46640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e0072050 0x7f78e00c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:30.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.687+0000 7f78e6d46640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e0072050 0x7f78e00c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36714/0 (socket says 172.21.15.91:36714) 2023-11-27T20:42:30.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.687+0000 7f78e6d46640 1 -- 172.21.15.91:0/1172230624 learned_addr learned my addr 172.21.15.91:0/1172230624 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:30.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.687+0000 7f78e6545640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78e006a770 0x7f78e01ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:30.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.687+0000 7f78e5d44640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78e006b090 0x7f78e01eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.687+0000 7f78e6d46640 1 -- 172.21.15.91:0/1172230624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78e006a770 msgr2=0x7f78e01ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.687+0000 7f78e6d46640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78e006a770 0x7f78e01ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.687+0000 7f78e6d46640 1 -- 172.21.15.91:0/1172230624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78e006b090 msgr2=0x7f78e01eaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.687+0000 7f78e6d46640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78e006b090 0x7f78e01eaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.687+0000 7f78e6d46640 1 -- 172.21.15.91:0/1172230624 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d40094d0 con 0x7f78e0072050 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.688+0000 7f78e6d46640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e0072050 0x7f78e00c1a70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f78d800b970 tx=0x7f78d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.688+0000 7f78d2ffd640 1 -- 172.21.15.91:0/1172230624 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d800cb40 con 0x7f78e0072050 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.688+0000 7f78d2ffd640 1 -- 172.21.15.91:0/1172230624 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d800cca0 con 0x7f78e0072050 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.688+0000 7f78d2ffd640 1 -- 172.21.15.91:0/1172230624 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8014680 con 0x7f78e0072050 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.688+0000 7f78e87a9640 1 -- 172.21.15.91:0/1172230624 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e01eea20 con 0x7f78e0072050 2023-11-27T20:42:30.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.688+0000 7f78e87a9640 1 -- 172.21.15.91:0/1172230624 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e00c1fb0 con 0x7f78e0072050 2023-11-27T20:42:30.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.689+0000 7f78e87a9640 1 -- 172.21.15.91:0/1172230624 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e0153690 con 0x7f78e0072050 2023-11-27T20:42:30.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.690+0000 7f78d2ffd640 1 -- 172.21.15.91:0/1172230624 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f78d801d3b0 con 0x7f78e0072050 2023-11-27T20:42:30.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.691+0000 7f78d2ffd640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c406b1c0 0x7f78c406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:30.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.691+0000 7f78d2ffd640 1 -- 172.21.15.91:0/1172230624 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f78d80893a0 con 0x7f78e0072050 2023-11-27T20:42:30.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.691+0000 7f78e6545640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c406b1c0 0x7f78c406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:30.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.692+0000 7f78e6545640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c406b1c0 0x7f78c406d680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78dc006fd0 tx=0x7f78dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:30.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.695+0000 7f78d2ffd640 1 -- 172.21.15.91:0/1172230624 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f78d8054410 con 0x7f78e0072050 2023-11-27T20:42:30.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.951+0000 7f78e87a9640 1 -- 172.21.15.91:0/1172230624 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f78e01eea20 con 0x7f78e0072050 2023-11-27T20:42:30.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.952+0000 7f78d2ffd640 1 -- 172.21.15.91:0/1172230624 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f78e01eea20 con 0x7f78e0072050 2023-11-27T20:42:30.953 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:30.954 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:42:30.954 INFO:teuthology.orchestra.run.smithi091.stdout: "auth_dump": [ 2023-11-27T20:42:30.954 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.954 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.a", 2023-11-27T20:42:30.954 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRlRwaqHRAAqer3j2kHk7wuowivepQUgw==", 2023-11-27T20:42:30.954 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.954 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:42:30.954 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:42:30.954 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:42:30.954 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.955 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.955 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.955 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.955 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.b", 2023-11-27T20:42:30.955 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRlx9BVAxAA+wJ5xix5GpiENKnZfH/iFw==", 2023-11-27T20:42:30.955 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.955 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:42:30.955 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:42:30.955 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:42:30.956 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.956 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.956 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.956 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.956 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.c", 2023-11-27T20:42:30.956 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRlv407LhAAE6ECkLA1z27fwufNKJNIYA==", 2023-11-27T20:42:30.956 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.956 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:42:30.957 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:42:30.957 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:42:30.957 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.957 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.957 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.957 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.957 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.d", 2023-11-27T20:42:30.957 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRl+kFcExAAkuOMQ90ecoxXDkPxO6FDvw==", 2023-11-27T20:42:30.957 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.0", 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC9/mRlONFOLhAAYUIBkatNBD7/J4D9sfAiaw==", 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:42:30.958 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.1", 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDB/mRlvE+RDBAACA+NQHmb0QQxYZgXZpslEQ==", 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.959 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.960 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.2", 2023-11-27T20:42:30.960 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDE/mRleeqGFhAAHwW2F6fQnCdomrsUsdm+8w==", 2023-11-27T20:42:30.960 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.960 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:42:30.960 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:42:30.960 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.960 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.960 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.960 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.3", 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDH/mRlYT1/IBAATkOmqpRab148FbKtb+MifA==", 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.4", 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDO/mRlebvbIBAARnJZSuaKdb1vs1PoMQNDOw==", 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.961 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.5", 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDR/mRl6MgQOxAAw94eeILe8F/405enQHSaiA==", 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.962 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.6", 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDV/mRl5Jd9GhAAv9BxPC9a0D6l3ZBcP0ceUg==", 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.963 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.7", 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDY/mRlllnNJRAAXnAoHjIq7CKkL8c6MC3byg==", 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.0", 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRlKBgjIhAArHSIgmH/SwVIdiUlROMOfA==", 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.964 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow r", 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow rw", 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow rwx" 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.1", 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRlsqHoLBAAzs5TAvGaf/SnzmZfDewgAg==", 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow r", 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow rw", 2023-11-27T20:42:30.965 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow rwx" 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.admin", 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC3/mRlMswjDhAAq6QNwbsRncp78C5FXSuMZg==", 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow *", 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.966 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.bootstrap-mds", 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDm/mRlqftPFxAARCIpmA1/aEDTqK+xUggwhw==", 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile bootstrap-mds" 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.bootstrap-mgr", 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDm/mRlNRpQFxAAFaSson/OrHJidY1jsdFbUA==", 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.967 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.bootstrap-osd", 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDm/mRlVjNQFxAAFtpMgZbY5/7QVK2tbwbLvA==", 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile bootstrap-osd" 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.bootstrap-rbd", 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDm/mRlGE1QFxAAMX3uxl4j8UA++xQo/sYAQw==", 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-27T20:42:30.968 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.969 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.969 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.969 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-27T20:42:30.969 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDm/mRlH2dQFxAA7dxEay2nUy2pCJAmLEnCYQ==", 2023-11-27T20:42:30.969 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.969 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-27T20:42:30.969 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.969 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.969 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.969 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.bootstrap-rgw", 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDm/mRlu4RQFxAAIMDXjxpNTbwv6fjHskHkiA==", 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mgr.x", 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRl8E2qERAA2C9blyASELJzyHJZ3BdIUw==", 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow *", 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile mgr", 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.970 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mgr.y", 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRld4txBRAAvOUjPT9j+tXIe6B82dWA0w==", 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow *", 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile mgr", 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout: ] 2023-11-27T20:42:30.971 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:42:30.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 -- 172.21.15.91:0/1172230624 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c406b1c0 msgr2=0x7f78c406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:30.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c406b1c0 0x7f78c406d680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78dc006fd0 tx=0x7f78dc008040 comp rx=0 tx=0).stop 2023-11-27T20:42:30.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 -- 172.21.15.91:0/1172230624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e0072050 msgr2=0x7f78e00c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:30.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e0072050 0x7f78e00c1a70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f78d800b970 tx=0x7f78d800be30 comp rx=0 tx=0).stop 2023-11-27T20:42:30.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 -- 172.21.15.91:0/1172230624 shutdown_connections 2023-11-27T20:42:30.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78e0072050 0x7f78e00c1a70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c406b1c0 0x7f78c406d680 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78e006b090 0x7f78e01eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 --2- 172.21.15.91:0/1172230624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78e006a770 0x7f78e01ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:30.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 -- 172.21.15.91:0/1172230624 >> 172.21.15.91:0/1172230624 conn(0x7f78e00c6ee0 msgr2=0x7f78e014e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:30.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 -- 172.21.15.91:0/1172230624 shutdown_connections 2023-11-27T20:42:30.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:30.954+0000 7f78e87a9640 1 -- 172.21.15.91:0/1172230624 wait complete. 2023-11-27T20:42:30.974 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-27T20:42:31.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.181+0000 7f94a759e640 1 Processor -- start 2023-11-27T20:42:31.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.181+0000 7f94a759e640 1 -- start start 2023-11-27T20:42:31.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.182+0000 7f94a759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f94a814e570 0x7f94a80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.182+0000 7f94a759e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f94a80c6d60 0x7f94a8158240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.182+0000 7f94a759e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a80c4830 con 0x7f94a80c7d10 2023-11-27T20:42:31.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.182+0000 7f94a759e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a814e950 con 0x7f94a814e570 2023-11-27T20:42:31.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.182+0000 7f94a759e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a8155060 con 0x7f94a80c6d60 2023-11-27T20:42:31.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.183+0000 7f94a659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f94a814e570 0x7f94a80c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:31.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.183+0000 7f94a659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f94a814e570 0x7f94a80c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36728/0 (socket says 172.21.15.91:36728) 2023-11-27T20:42:31.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.183+0000 7f94a659c640 1 -- 172.21.15.91:0/2743435574 learned_addr learned my addr 172.21.15.91:0/2743435574 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.183+0000 7f94a6d9d640 1 --2- 172.21.15.91:0/2743435574 >> v2:172.21.15.183:3300/0 conn(0x7f94a80c6d60 0x7f94a8158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.183+0000 7f94a659c640 1 -- 172.21.15.91:0/2743435574 >> v2:172.21.15.183:3300/0 conn(0x7f94a80c6d60 msgr2=0x7f94a8158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.183+0000 7f94a659c640 1 --2- 172.21.15.91:0/2743435574 >> v2:172.21.15.183:3300/0 conn(0x7f94a80c6d60 0x7f94a8158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.183+0000 7f94a659c640 1 -- 172.21.15.91:0/2743435574 >> v1:172.21.15.183:6789/0 conn(0x7f94a80c7d10 legacy=0x7f94a8157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:31.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.183+0000 7f94a659c640 1 -- 172.21.15.91:0/2743435574 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a80c4ad0 con 0x7f94a814e570 2023-11-27T20:42:31.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.184+0000 7f94a659c640 1 --2- 172.21.15.91:0/2743435574 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a814e570 0x7f94a80c6820 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f94a80c43f0 tx=0x7f949802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4741b66039532770 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.184+0000 7f94a559a640 1 -- 172.21.15.91:0/2743435574 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949802cb20 con 0x7f94a814e570 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.185+0000 7f94a559a640 1 -- 172.21.15.91:0/2743435574 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949802cc80 con 0x7f94a814e570 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.185+0000 7f94a559a640 1 -- 172.21.15.91:0/2743435574 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980343f0 con 0x7f94a814e570 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.185+0000 7f94a759e640 1 -- 172.21.15.91:0/2743435574 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a814e570 msgr2=0x7f94a80c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.185+0000 7f94a759e640 1 --2- 172.21.15.91:0/2743435574 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a814e570 0x7f94a80c6820 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f94a80c43f0 tx=0x7f949802bf80 comp rx=0 tx=0).stop 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.185+0000 7f94a759e640 1 -- 172.21.15.91:0/2743435574 shutdown_connections 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.185+0000 7f94a759e640 1 --2- 172.21.15.91:0/2743435574 >> v2:172.21.15.183:3300/0 conn(0x7f94a80c6d60 0x7f94a8158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.185+0000 7f94a759e640 1 --2- 172.21.15.91:0/2743435574 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a814e570 0x7f94a80c6820 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.185+0000 7f94a759e640 1 -- 172.21.15.91:0/2743435574 >> 172.21.15.91:0/2743435574 conn(0x7f94a80ab9e0 msgr2=0x7f94a80abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.185+0000 7f94a759e640 1 -- 172.21.15.91:0/2743435574 shutdown_connections 2023-11-27T20:42:31.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.185+0000 7f94a759e640 1 -- 172.21.15.91:0/2743435574 wait complete. 2023-11-27T20:42:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.187+0000 7f94a759e640 1 Processor -- start 2023-11-27T20:42:31.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.187+0000 7f94a759e640 1 -- start start 2023-11-27T20:42:31.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94a80c6d60 0x7f94a80bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a80c7d10 0x7f94a8156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94a814e570 0x7f94a81ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a759e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80bf3f0 con 0x7f94a80c7d10 2023-11-27T20:42:31.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80c03d0 con 0x7f94a80c6d60 2023-11-27T20:42:31.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a814ea90 con 0x7f94a814e570 2023-11-27T20:42:31.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a5d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a80c7d10 0x7f94a8156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:31.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a5d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a80c7d10 0x7f94a8156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36730/0 (socket says 172.21.15.91:36730) 2023-11-27T20:42:31.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a5d9b640 1 -- 172.21.15.91:0/504897920 learned_addr learned my addr 172.21.15.91:0/504897920 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a5d9b640 1 -- 172.21.15.91:0/504897920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94a814e570 msgr2=0x7f94a81ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a5d9b640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94a814e570 0x7f94a81ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a5d9b640 1 -- 172.21.15.91:0/504897920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94a80c6d60 msgr2=0x7f94a80bfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a5d9b640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94a80c6d60 0x7f94a80bfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.188+0000 7f94a5d9b640 1 -- 172.21.15.91:0/504897920 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498009b30 con 0x7f94a80c7d10 2023-11-27T20:42:31.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.189+0000 7f94a5d9b640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a80c7d10 0x7f94a8156d20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f949000c410 tx=0x7f949000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.189+0000 7f949effd640 1 -- 172.21.15.91:0/504897920 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900035f0 con 0x7f94a80c7d10 2023-11-27T20:42:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.189+0000 7f949effd640 1 -- 172.21.15.91:0/504897920 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9490003750 con 0x7f94a80c7d10 2023-11-27T20:42:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.189+0000 7f949effd640 1 -- 172.21.15.91:0/504897920 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490003b40 con 0x7f94a80c7d10 2023-11-27T20:42:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.189+0000 7f94a759e640 1 -- 172.21.15.91:0/504897920 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a814ad80 con 0x7f94a80c7d10 2023-11-27T20:42:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.189+0000 7f94a759e640 1 -- 172.21.15.91:0/504897920 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a8157260 con 0x7f94a80c7d10 2023-11-27T20:42:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.190+0000 7f94a759e640 1 -- 172.21.15.91:0/504897920 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a804e840 con 0x7f94a80c7d10 2023-11-27T20:42:31.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.191+0000 7f949effd640 1 -- 172.21.15.91:0/504897920 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9490003ca0 con 0x7f94a80c7d10 2023-11-27T20:42:31.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.192+0000 7f949effd640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f948806b1c0 0x7f948806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.192+0000 7f949effd640 1 -- 172.21.15.91:0/504897920 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f94900888f0 con 0x7f94a80c7d10 2023-11-27T20:42:31.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.192+0000 7f94a659c640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f948806b1c0 0x7f948806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:31.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.193+0000 7f94a659c640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f948806b1c0 0x7f948806d680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9498035000 tx=0x7f949802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:31.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.196+0000 7f949effd640 1 -- 172.21.15.91:0/504897920 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9490053960 con 0x7f94a80c7d10 2023-11-27T20:42:31.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.458+0000 7f94a759e640 1 -- 172.21.15.91:0/504897920 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f94a814c980 con 0x7f94a80c7d10 2023-11-27T20:42:31.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.467+0000 7f949effd640 1 -- 172.21.15.91:0/504897920 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9490056f80 con 0x7f94a80c7d10 2023-11-27T20:42:31.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 -- 172.21.15.91:0/504897920 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f948806b1c0 msgr2=0x7f948806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f948806b1c0 0x7f948806d680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9498035000 tx=0x7f949802e000 comp rx=0 tx=0).stop 2023-11-27T20:42:31.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 -- 172.21.15.91:0/504897920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a80c7d10 msgr2=0x7f94a8156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a80c7d10 0x7f94a8156d20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f949000c410 tx=0x7f949000c8d0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 -- 172.21.15.91:0/504897920 shutdown_connections 2023-11-27T20:42:31.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94a814e570 0x7f94a81ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94a80c7d10 0x7f94a8156d20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f948806b1c0 0x7f948806d680 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 --2- 172.21.15.91:0/504897920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94a80c6d60 0x7f94a80bfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 -- 172.21.15.91:0/504897920 >> 172.21.15.91:0/504897920 conn(0x7f94a80ab9e0 msgr2=0x7f94a806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:31.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.470+0000 7f94a759e640 1 -- 172.21.15.91:0/504897920 shutdown_connections 2023-11-27T20:42:31.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.471+0000 7f94a759e640 1 -- 172.21.15.91:0/504897920 wait complete. 2023-11-27T20:42:31.489 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-27T20:42:31.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.686+0000 7fc3fa82b640 1 Processor -- start 2023-11-27T20:42:31.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.686+0000 7fc3fa82b640 1 -- start start 2023-11-27T20:42:31.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.688+0000 7fc3fa82b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f4155fc0 0x7fc3f4159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.688+0000 7fc3fa82b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc3f40c2e60 0x7fc3f4163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.688+0000 7fc3fa82b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f406d580 con 0x7fc3f40c1ca0 2023-11-27T20:42:31.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.688+0000 7fc3fa82b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f406dd60 con 0x7fc3f40c2e60 2023-11-27T20:42:31.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.688+0000 7fc3fa82b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40c6580 con 0x7fc3f4155fc0 2023-11-27T20:42:31.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.689+0000 7fc3f3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f4155fc0 0x7fc3f4159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:31.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.689+0000 7fc3f8dc8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc3f40c2e60 0x7fc3f4163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:31.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.689+0000 7fc3f3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f4155fc0 0x7fc3f4159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:57442/0 (socket says 172.21.15.91:57442) 2023-11-27T20:42:31.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.689+0000 7fc3f3fff640 1 -- 172.21.15.91:0/4264278212 learned_addr learned my addr 172.21.15.91:0/4264278212 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:31.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.689+0000 7fc3f3fff640 1 -- 172.21.15.91:0/4264278212 >> v2:172.21.15.183:3300/0 conn(0x7fc3f40c2e60 msgr2=0x7fc3f4163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:31.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.689+0000 7fc3f3fff640 1 --2- 172.21.15.91:0/4264278212 >> v2:172.21.15.183:3300/0 conn(0x7fc3f40c2e60 0x7fc3f4163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.689+0000 7fc3f3fff640 1 -- 172.21.15.91:0/4264278212 >> v1:172.21.15.183:6789/0 conn(0x7fc3f40c1ca0 legacy=0x7fc3f40c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.690+0000 7fc3f2ffd640 1 -- 172.21.15.91:0/4264278212 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534208388 0 0) 0x7fc3f406d580 con 0x7fc3f40c1ca0 2023-11-27T20:42:31.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.690+0000 7fc3f3fff640 1 -- 172.21.15.91:0/4264278212 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40726d0 con 0x7fc3f4155fc0 2023-11-27T20:42:31.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.690+0000 7fc3f8dc8640 1 --2- 172.21.15.91:0/4264278212 >> v2:172.21.15.183:3300/0 conn(0x7fc3f40c2e60 0x7fc3f4163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:42:31.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.691+0000 7fc3f3fff640 1 --2- 172.21.15.91:0/4264278212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f4155fc0 0x7fc3f4159470 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009870 tx=0x7fc3e402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afcd52d562bff3bc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:31.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3f2ffd640 1 -- 172.21.15.91:0/4264278212 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40317c0 con 0x7fc3f4155fc0 2023-11-27T20:42:31.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3f2ffd640 1 -- 172.21.15.91:0/4264278212 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e4031920 con 0x7fc3f4155fc0 2023-11-27T20:42:31.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3f2ffd640 1 -- 172.21.15.91:0/4264278212 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4031cb0 con 0x7fc3f4155fc0 2023-11-27T20:42:31.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3fa82b640 1 -- 172.21.15.91:0/4264278212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f4155fc0 msgr2=0x7fc3f4159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3fa82b640 1 --2- 172.21.15.91:0/4264278212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f4155fc0 0x7fc3f4159470 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009870 tx=0x7fc3e402b860 comp rx=0 tx=0).stop 2023-11-27T20:42:31.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3fa82b640 1 -- 172.21.15.91:0/4264278212 shutdown_connections 2023-11-27T20:42:31.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3fa82b640 1 --2- 172.21.15.91:0/4264278212 >> v2:172.21.15.183:3300/0 conn(0x7fc3f40c2e60 0x7fc3f4163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3fa82b640 1 --2- 172.21.15.91:0/4264278212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f4155fc0 0x7fc3f4159470 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3fa82b640 1 -- 172.21.15.91:0/4264278212 >> 172.21.15.91:0/4264278212 conn(0x7fc3f406a500 msgr2=0x7fc3f406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:31.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3fa82b640 1 -- 172.21.15.91:0/4264278212 shutdown_connections 2023-11-27T20:42:31.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.692+0000 7fc3fa82b640 1 -- 172.21.15.91:0/4264278212 wait complete. 2023-11-27T20:42:31.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.694+0000 7fc3fa82b640 1 Processor -- start 2023-11-27T20:42:31.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.694+0000 7fc3fa82b640 1 -- start start 2023-11-27T20:42:31.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.695+0000 7fc3fa82b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f40c1ca0 0x7fc3f40bf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.695+0000 7fc3fa82b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f40c2e60 0x7fc3f40a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.695+0000 7fc3fa82b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3f4155fc0 0x7fc3f40a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.695+0000 7fc3fa82b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f41ee280 con 0x7fc3f40c2e60 2023-11-27T20:42:31.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.695+0000 7fc3fa82b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40bba40 con 0x7fc3f4155fc0 2023-11-27T20:42:31.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.695+0000 7fc3fa82b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f41ee490 con 0x7fc3f40c1ca0 2023-11-27T20:42:31.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.695+0000 7fc3f37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f40c2e60 0x7fc3f40a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:31.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.695+0000 7fc3f37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f40c2e60 0x7fc3f40a4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36732/0 (socket says 172.21.15.91:36732) 2023-11-27T20:42:31.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.695+0000 7fc3f37fe640 1 -- 172.21.15.91:0/2090447291 learned_addr learned my addr 172.21.15.91:0/2090447291 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:31.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f8dc8640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3f4155fc0 0x7fc3f40a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:31.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f37fe640 1 -- 172.21.15.91:0/2090447291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f40c1ca0 msgr2=0x7fc3f40bf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f3fff640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f40c1ca0 0x7fc3f40bf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:31.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f37fe640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f40c1ca0 0x7fc3f40bf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f37fe640 1 -- 172.21.15.91:0/2090447291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3f4155fc0 msgr2=0x7fc3f40a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f37fe640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3f4155fc0 0x7fc3f40a2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f37fe640 1 -- 172.21.15.91:0/2090447291 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec009a70 con 0x7fc3f40c2e60 2023-11-27T20:42:31.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f37fe640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f40c2e60 0x7fc3f40a4e30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800c4b0 tx=0x7fc3e800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:31.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f0ff9640 1 -- 172.21.15.91:0/2090447291 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8005480 con 0x7fc3f40c2e60 2023-11-27T20:42:31.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f0ff9640 1 -- 172.21.15.91:0/2090447291 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e80035f0 con 0x7fc3f40c2e60 2023-11-27T20:42:31.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3f0ff9640 1 -- 172.21.15.91:0/2090447291 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80039e0 con 0x7fc3f40c2e60 2023-11-27T20:42:31.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.696+0000 7fc3fa82b640 1 -- 172.21.15.91:0/2090447291 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e40094d0 con 0x7fc3f40c2e60 2023-11-27T20:42:31.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.697+0000 7fc3fa82b640 1 -- 172.21.15.91:0/2090447291 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f41eea50 con 0x7fc3f40c2e60 2023-11-27T20:42:31.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.698+0000 7fc3fa82b640 1 -- 172.21.15.91:0/2090447291 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f41eec70 con 0x7fc3f40c2e60 2023-11-27T20:42:31.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.699+0000 7fc3f0ff9640 1 -- 172.21.15.91:0/2090447291 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc3e8003b40 con 0x7fc3f40c2e60 2023-11-27T20:42:31.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.700+0000 7fc3f0ff9640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1f0 0x7fc3e006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:31.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.700+0000 7fc3f0ff9640 1 -- 172.21.15.91:0/2090447291 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc3e8088c70 con 0x7fc3f40c2e60 2023-11-27T20:42:31.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.700+0000 7fc3f3fff640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1f0 0x7fc3e006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:31.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.701+0000 7fc3f3fff640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1f0 0x7fc3e006d6b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4036000 tx=0x7fc3e403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:31.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.704+0000 7fc3f0ff9640 1 -- 172.21.15.91:0/2090447291 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc3e8053ce0 con 0x7fc3f40c2e60 2023-11-27T20:42:31.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.964+0000 7fc3fa82b640 1 -- 172.21.15.91:0/2090447291 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc3f4068350 con 0x7fc3f40c2e60 2023-11-27T20:42:31.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.969+0000 7fc3f0ff9640 1 -- 172.21.15.91:0/2090447291 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc3e8017070 con 0x7fc3f40c2e60 2023-11-27T20:42:31.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 -- 172.21.15.91:0/2090447291 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1f0 msgr2=0x7fc3e006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1f0 0x7fc3e006d6b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4036000 tx=0x7fc3e403d040 comp rx=0 tx=0).stop 2023-11-27T20:42:31.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 -- 172.21.15.91:0/2090447291 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f40c2e60 msgr2=0x7fc3f40a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:31.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f40c2e60 0x7fc3f40a4e30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800c4b0 tx=0x7fc3e800c970 comp rx=0 tx=0).stop 2023-11-27T20:42:31.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 -- 172.21.15.91:0/2090447291 shutdown_connections 2023-11-27T20:42:31.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1f0 0x7fc3e006d6b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3f4155fc0 0x7fc3f40a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3f40c2e60 0x7fc3f40a4e30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 --2- 172.21.15.91:0/2090447291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3f40c1ca0 0x7fc3f40bf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:31.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 -- 172.21.15.91:0/2090447291 >> 172.21.15.91:0/2090447291 conn(0x7fc3f406a500 msgr2=0x7fc3f4071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:31.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.971+0000 7fc3fa82b640 1 -- 172.21.15.91:0/2090447291 shutdown_connections 2023-11-27T20:42:31.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:31.972+0000 7fc3fa82b640 1 -- 172.21.15.91:0/2090447291 wait complete. 2023-11-27T20:42:31.992 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-27T20:42:32.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.206+0000 7fa094248640 1 Processor -- start 2023-11-27T20:42:32.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.206+0000 7fa094248640 1 -- start start 2023-11-27T20:42:32.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.207+0000 7fa094248640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa08c14f9f0 0x7fa08c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.207+0000 7fa094248640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa08c152600 0x7fa08c152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.207+0000 7fa094248640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08c0a6de0 con 0x7fa08c0c7540 2023-11-27T20:42:32.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.207+0000 7fa094248640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c0a7740 con 0x7fa08c14f9f0 2023-11-27T20:42:32.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.207+0000 7fa094248640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0a7080 con 0x7fa08c152600 2023-11-27T20:42:32.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.208+0000 7fa091fe4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa08c14f9f0 0x7fa08c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.208+0000 7fa091fe4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa08c14f9f0 0x7fa08c06dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:34352/0 (socket says 172.21.15.91:34352) 2023-11-27T20:42:32.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.208+0000 7fa091fe4640 1 -- 172.21.15.91:0/1812188348 learned_addr learned my addr 172.21.15.91:0/1812188348 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:32.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.208+0000 7fa0927e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa08c152600 0x7fa08c152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.209+0000 7fa091fe4640 1 -- 172.21.15.91:0/1812188348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa08c152600 msgr2=0x7fa08c152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:32.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.209+0000 7fa091fe4640 1 --2- 172.21.15.91:0/1812188348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa08c152600 0x7fa08c152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.209+0000 7fa091fe4640 1 -- 172.21.15.91:0/1812188348 >> v1:172.21.15.183:6789/0 conn(0x7fa08c0c7540 legacy=0x7fa08c0c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:32.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.209+0000 7fa091fe4640 1 -- 172.21.15.91:0/1812188348 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c0a7360 con 0x7fa08c14f9f0 2023-11-27T20:42:32.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.210+0000 7fa091fe4640 1 --2- 172.21.15.91:0/1812188348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa08c14f9f0 0x7fa08c06dd20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa080009e50 tx=0x7fa08002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68af36156b545657 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:32.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa090fe2640 1 -- 172.21.15.91:0/1812188348 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08002ca80 con 0x7fa08c14f9f0 2023-11-27T20:42:32.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa090fe2640 1 -- 172.21.15.91:0/1812188348 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08002cbe0 con 0x7fa08c14f9f0 2023-11-27T20:42:32.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa090fe2640 1 -- 172.21.15.91:0/1812188348 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0800343f0 con 0x7fa08c14f9f0 2023-11-27T20:42:32.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa094248640 1 -- 172.21.15.91:0/1812188348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa08c14f9f0 msgr2=0x7fa08c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:32.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa094248640 1 --2- 172.21.15.91:0/1812188348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa08c14f9f0 0x7fa08c06dd20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa080009e50 tx=0x7fa08002bee0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa094248640 1 -- 172.21.15.91:0/1812188348 shutdown_connections 2023-11-27T20:42:32.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa094248640 1 --2- 172.21.15.91:0/1812188348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa08c152600 0x7fa08c152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa094248640 1 --2- 172.21.15.91:0/1812188348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa08c14f9f0 0x7fa08c06dd20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa094248640 1 -- 172.21.15.91:0/1812188348 >> 172.21.15.91:0/1812188348 conn(0x7fa08c0c7dc0 msgr2=0x7fa08c0c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:32.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa094248640 1 -- 172.21.15.91:0/1812188348 shutdown_connections 2023-11-27T20:42:32.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.211+0000 7fa094248640 1 -- 172.21.15.91:0/1812188348 wait complete. 2023-11-27T20:42:32.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.213+0000 7fa094248640 1 Processor -- start 2023-11-27T20:42:32.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.213+0000 7fa094248640 1 -- start start 2023-11-27T20:42:32.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.214+0000 7fa094248640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa08c0c7540 0x7fa08c143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.214+0000 7fa094248640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa08c14f9f0 0x7fa08c14e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.214+0000 7fa094248640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa08c152600 0x7fa08c1e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.214+0000 7fa094248640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c142fe0 con 0x7fa08c152600 2023-11-27T20:42:32.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.214+0000 7fa094248640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c1553a0 con 0x7fa08c0c7540 2023-11-27T20:42:32.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.214+0000 7fa094248640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c155e00 con 0x7fa08c14f9f0 2023-11-27T20:42:32.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.214+0000 7fa0927e5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa08c152600 0x7fa08c1e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.214+0000 7fa0927e5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa08c152600 0x7fa08c1e4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36746/0 (socket says 172.21.15.91:36746) 2023-11-27T20:42:32.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.214+0000 7fa0927e5640 1 -- 172.21.15.91:0/2126331986 learned_addr learned my addr 172.21.15.91:0/2126331986 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:32.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa0917e3640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa08c14f9f0 0x7fa08c14e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa091fe4640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa08c0c7540 0x7fa08c143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa0927e5640 1 -- 172.21.15.91:0/2126331986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa08c14f9f0 msgr2=0x7fa08c14e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:32.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa0927e5640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa08c14f9f0 0x7fa08c14e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa0927e5640 1 -- 172.21.15.91:0/2126331986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa08c0c7540 msgr2=0x7fa08c143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:32.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa0927e5640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa08c0c7540 0x7fa08c143df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa0927e5640 1 -- 172.21.15.91:0/2126331986 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa080009b30 con 0x7fa08c152600 2023-11-27T20:42:32.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa0927e5640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa08c152600 0x7fa08c1e4e20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa08400e7f0 tx=0x7fa08400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:32.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa08a7fc640 1 -- 172.21.15.91:0/2126331986 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084009510 con 0x7fa08c152600 2023-11-27T20:42:32.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa08a7fc640 1 -- 172.21.15.91:0/2126331986 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08400ee40 con 0x7fa08c152600 2023-11-27T20:42:32.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa08a7fc640 1 -- 172.21.15.91:0/2126331986 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400cb20 con 0x7fa08c152600 2023-11-27T20:42:32.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.215+0000 7fa094248640 1 -- 172.21.15.91:0/2126331986 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c1560c0 con 0x7fa08c152600 2023-11-27T20:42:32.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.216+0000 7fa094248640 1 -- 172.21.15.91:0/2126331986 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c1ebf40 con 0x7fa08c152600 2023-11-27T20:42:32.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.217+0000 7fa094248640 1 -- 172.21.15.91:0/2126331986 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c155550 con 0x7fa08c152600 2023-11-27T20:42:32.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.218+0000 7fa08a7fc640 1 -- 172.21.15.91:0/2126331986 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa08400cc80 con 0x7fa08c152600 2023-11-27T20:42:32.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.219+0000 7fa08a7fc640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07006b1c0 0x7fa07006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.219+0000 7fa08a7fc640 1 -- 172.21.15.91:0/2126331986 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa084089660 con 0x7fa08c152600 2023-11-27T20:42:32.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.219+0000 7fa091fe4640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07006b1c0 0x7fa07006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.220+0000 7fa091fe4640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07006b1c0 0x7fa07006d680 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa080035000 tx=0x7fa080030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:32.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.223+0000 7fa08a7fc640 1 -- 172.21.15.91:0/2126331986 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa08c155550 con 0x7fa08c152600 2023-11-27T20:42:32.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.464+0000 7fa094248640 1 -- 172.21.15.91:0/2126331986 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa08c1ebaa0 con 0x7fa08c152600 2023-11-27T20:42:32.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.473+0000 7fa08a7fc640 1 -- 172.21.15.91:0/2126331986 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa084054770 con 0x7fa08c152600 2023-11-27T20:42:32.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.475+0000 7fa094248640 1 -- 172.21.15.91:0/2126331986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07006b1c0 msgr2=0x7fa07006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:32.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.475+0000 7fa094248640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07006b1c0 0x7fa07006d680 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa080035000 tx=0x7fa080030000 comp rx=0 tx=0).stop 2023-11-27T20:42:32.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.475+0000 7fa094248640 1 -- 172.21.15.91:0/2126331986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa08c152600 msgr2=0x7fa08c1e4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:32.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.476+0000 7fa094248640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa08c152600 0x7fa08c1e4e20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa08400e7f0 tx=0x7fa08400ebf0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.476+0000 7fa094248640 1 -- 172.21.15.91:0/2126331986 shutdown_connections 2023-11-27T20:42:32.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.476+0000 7fa094248640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa08c152600 0x7fa08c1e4e20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.476+0000 7fa094248640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa08c14f9f0 0x7fa08c14e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.476+0000 7fa094248640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07006b1c0 0x7fa07006d680 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.476+0000 7fa094248640 1 --2- 172.21.15.91:0/2126331986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa08c0c7540 0x7fa08c143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.476+0000 7fa094248640 1 -- 172.21.15.91:0/2126331986 >> 172.21.15.91:0/2126331986 conn(0x7fa08c0c7dc0 msgr2=0x7fa08c152e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:32.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.476+0000 7fa094248640 1 -- 172.21.15.91:0/2126331986 shutdown_connections 2023-11-27T20:42:32.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.476+0000 7fa094248640 1 -- 172.21.15.91:0/2126331986 wait complete. 2023-11-27T20:42:32.495 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-27T20:42:32.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.701+0000 7fb29f547640 1 Processor -- start 2023-11-27T20:42:32.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.702+0000 7fb29f547640 1 -- start start 2023-11-27T20:42:32.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.703+0000 7fb29f547640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb29814e570 0x7fb2980c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.703+0000 7fb29f547640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb2980c6d60 0x7fb298158240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.703+0000 7fb29f547640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2980c4830 con 0x7fb2980c7d10 2023-11-27T20:42:32.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.703+0000 7fb29f547640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29814e950 con 0x7fb2980c6d60 2023-11-27T20:42:32.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.703+0000 7fb29f547640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb298155060 con 0x7fb29814e570 2023-11-27T20:42:32.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.703+0000 7fb29ed46640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb2980c6d60 0x7fb298158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.703+0000 7fb29ed46640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb2980c6d60 0x7fb298158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36756/0 (socket says 172.21.15.91:36756) 2023-11-27T20:42:32.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.703+0000 7fb29ed46640 1 -- 172.21.15.91:0/2217747674 learned_addr learned my addr 172.21.15.91:0/2217747674 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:32.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.704+0000 7fb29e545640 1 --2- 172.21.15.91:0/2217747674 >> v2:172.21.15.183:3300/0 conn(0x7fb29814e570 0x7fb2980c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.704+0000 7fb29ed46640 1 -- 172.21.15.91:0/2217747674 >> v2:172.21.15.183:3300/0 conn(0x7fb29814e570 msgr2=0x7fb2980c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:32.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.704+0000 7fb29ed46640 1 --2- 172.21.15.91:0/2217747674 >> v2:172.21.15.183:3300/0 conn(0x7fb29814e570 0x7fb2980c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.704+0000 7fb29ed46640 1 -- 172.21.15.91:0/2217747674 >> v1:172.21.15.183:6789/0 conn(0x7fb2980c7d10 legacy=0x7fb298157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:32.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.704+0000 7fb29ed46640 1 -- 172.21.15.91:0/2217747674 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2980c4ad0 con 0x7fb2980c6d60 2023-11-27T20:42:32.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.705+0000 7fb29ed46640 1 --2- 172.21.15.91:0/2217747674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 0x7fb298158240 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb29808b560 tx=0x7fb29002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae477abcf47af197 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:32.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.705+0000 7fb29d543640 1 -- 172.21.15.91:0/2217747674 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29002cb20 con 0x7fb2980c6d60 2023-11-27T20:42:32.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.706+0000 7fb29d543640 1 -- 172.21.15.91:0/2217747674 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29002cc80 con 0x7fb2980c6d60 2023-11-27T20:42:32.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.706+0000 7fb29d543640 1 -- 172.21.15.91:0/2217747674 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2900343f0 con 0x7fb2980c6d60 2023-11-27T20:42:32.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.706+0000 7fb29f547640 1 -- 172.21.15.91:0/2217747674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 msgr2=0x7fb298158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:32.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.706+0000 7fb29f547640 1 --2- 172.21.15.91:0/2217747674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 0x7fb298158240 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb29808b560 tx=0x7fb29002bf80 comp rx=0 tx=0).stop 2023-11-27T20:42:32.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.706+0000 7fb29f547640 1 -- 172.21.15.91:0/2217747674 shutdown_connections 2023-11-27T20:42:32.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.706+0000 7fb29f547640 1 --2- 172.21.15.91:0/2217747674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 0x7fb298158240 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.706+0000 7fb29f547640 1 --2- 172.21.15.91:0/2217747674 >> v2:172.21.15.183:3300/0 conn(0x7fb29814e570 0x7fb2980c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.706+0000 7fb29f547640 1 -- 172.21.15.91:0/2217747674 >> 172.21.15.91:0/2217747674 conn(0x7fb2980ab9e0 msgr2=0x7fb2980abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:32.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.706+0000 7fb29f547640 1 -- 172.21.15.91:0/2217747674 shutdown_connections 2023-11-27T20:42:32.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.706+0000 7fb29f547640 1 -- 172.21.15.91:0/2217747674 wait complete. 2023-11-27T20:42:32.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.708+0000 7fb29f547640 1 Processor -- start 2023-11-27T20:42:32.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.708+0000 7fb29f547640 1 -- start start 2023-11-27T20:42:32.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.709+0000 7fb29f547640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 0x7fb2981edf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.709+0000 7fb29f547640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2980c7d10 0x7fb2980bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.709+0000 7fb29f547640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb29814e570 0x7fb29814f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.709+0000 7fb29f547640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2981ee480 con 0x7fb2980c6d60 2023-11-27T20:42:32.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.709+0000 7fb29f547640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29814ef10 con 0x7fb2980c7d10 2023-11-27T20:42:32.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.709+0000 7fb29f547640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb298157280 con 0x7fb29814e570 2023-11-27T20:42:32.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.709+0000 7fb29e545640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 0x7fb2981edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.709+0000 7fb29e545640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 0x7fb2981edf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36768/0 (socket says 172.21.15.91:36768) 2023-11-27T20:42:32.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.709+0000 7fb29e545640 1 -- 172.21.15.91:0/3206707520 learned_addr learned my addr 172.21.15.91:0/3206707520 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:32.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb29e545640 1 -- 172.21.15.91:0/3206707520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb29814e570 msgr2=0x7fb29814f3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T20:42:32.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb29e545640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb29814e570 0x7fb29814f3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb29dd44640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2980c7d10 0x7fb2980bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb29e545640 1 -- 172.21.15.91:0/3206707520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2980c7d10 msgr2=0x7fb2980bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:32.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb29e545640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2980c7d10 0x7fb2980bf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb29e545640 1 -- 172.21.15.91:0/3206707520 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb290009b30 con 0x7fb2980c6d60 2023-11-27T20:42:32.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb29e545640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 0x7fb2981edf40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb29400d600 tx=0x7fb29400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:32.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb28effd640 1 -- 172.21.15.91:0/3206707520 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2940125f0 con 0x7fb2980c6d60 2023-11-27T20:42:32.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb28effd640 1 -- 172.21.15.91:0/3206707520 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294012770 con 0x7fb2980c6d60 2023-11-27T20:42:32.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb29f547640 1 -- 172.21.15.91:0/3206707520 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb298156cc0 con 0x7fb2980c6d60 2023-11-27T20:42:32.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb28effd640 1 -- 172.21.15.91:0/3206707520 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294012b20 con 0x7fb2980c6d60 2023-11-27T20:42:32.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.710+0000 7fb29f547640 1 -- 172.21.15.91:0/3206707520 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29814eba0 con 0x7fb2980c6d60 2023-11-27T20:42:32.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.712+0000 7fb29f547640 1 -- 172.21.15.91:0/3206707520 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb298068350 con 0x7fb2980c6d60 2023-11-27T20:42:32.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.712+0000 7fb28effd640 1 -- 172.21.15.91:0/3206707520 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb294012c80 con 0x7fb2980c6d60 2023-11-27T20:42:32.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.713+0000 7fb28effd640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb27c06b1c0 0x7fb27c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:32.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.713+0000 7fb28effd640 1 -- 172.21.15.91:0/3206707520 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb294089b80 con 0x7fb2980c6d60 2023-11-27T20:42:32.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.714+0000 7fb29dd44640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb27c06b1c0 0x7fb27c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:32.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.714+0000 7fb29dd44640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb27c06b1c0 0x7fb27c06d680 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb2980c7670 tx=0x7fb288009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:32.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.718+0000 7fb28effd640 1 -- 172.21.15.91:0/3206707520 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb294054c90 con 0x7fb2980c6d60 2023-11-27T20:42:32.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.978+0000 7fb29f547640 1 -- 172.21.15.91:0/3206707520 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb29804e840 con 0x7fb2980c6d60 2023-11-27T20:42:32.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.983+0000 7fb28effd640 1 -- 172.21.15.91:0/3206707520 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb2940582b0 con 0x7fb2980c6d60 2023-11-27T20:42:32.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 -- 172.21.15.91:0/3206707520 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb27c06b1c0 msgr2=0x7fb27c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:32.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb27c06b1c0 0x7fb27c06d680 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb2980c7670 tx=0x7fb288009040 comp rx=0 tx=0).stop 2023-11-27T20:42:32.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 -- 172.21.15.91:0/3206707520 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 msgr2=0x7fb2981edf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:32.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 0x7fb2981edf40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb29400d600 tx=0x7fb29400dac0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 -- 172.21.15.91:0/3206707520 shutdown_connections 2023-11-27T20:42:32.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb29814e570 0x7fb29814f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb27c06b1c0 0x7fb27c06d680 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2980c7d10 0x7fb2980bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 --2- 172.21.15.91:0/3206707520 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2980c6d60 0x7fb2981edf40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:32.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 -- 172.21.15.91:0/3206707520 >> 172.21.15.91:0/3206707520 conn(0x7fb2980ab9e0 msgr2=0x7fb29814d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:32.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 -- 172.21.15.91:0/3206707520 shutdown_connections 2023-11-27T20:42:32.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:32.985+0000 7fb29f547640 1 -- 172.21.15.91:0/3206707520 wait complete. 2023-11-27T20:42:33.007 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-27T20:42:33.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.218+0000 7f5b63fb6640 1 Processor -- start 2023-11-27T20:42:33.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.218+0000 7f5b63fb6640 1 -- start start 2023-11-27T20:42:33.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.220+0000 7f5b63fb6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0c6680 0x7f5b5c0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.220+0000 7f5b63fb6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5b5c0a6bc0 0x7f5b5c0c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.220+0000 7f5b63fb6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c0c4220 con 0x7f5b5c0c7950 2023-11-27T20:42:33.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.220+0000 7f5b63fb6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c0c2e80 con 0x7f5b5c0a6bc0 2023-11-27T20:42:33.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.220+0000 7f5b63fb6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0c2ba0 con 0x7f5b5c0c6680 2023-11-27T20:42:33.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.221+0000 7f5b61551640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5b5c0a6bc0 0x7f5b5c0c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.221+0000 7f5b61d52640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0c6680 0x7f5b5c0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.221+0000 7f5b61551640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5b5c0a6bc0 0x7f5b5c0c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:34388/0 (socket says 172.21.15.91:34388) 2023-11-27T20:42:33.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.221+0000 7f5b61551640 1 -- 172.21.15.91:0/2561141390 learned_addr learned my addr 172.21.15.91:0/2561141390 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:33.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.222+0000 7f5b61d52640 1 -- 172.21.15.91:0/2561141390 >> v2:172.21.15.183:3300/0 conn(0x7f5b5c0a6bc0 msgr2=0x7f5b5c0c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:33.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.222+0000 7f5b61d52640 1 --2- 172.21.15.91:0/2561141390 >> v2:172.21.15.183:3300/0 conn(0x7f5b5c0a6bc0 0x7f5b5c0c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.222+0000 7f5b61d52640 1 -- 172.21.15.91:0/2561141390 >> v1:172.21.15.183:6789/0 conn(0x7f5b5c0c7950 legacy=0x7f5b5c0c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:33.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.222+0000 7f5b61d52640 1 -- 172.21.15.91:0/2561141390 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c0c32e0 con 0x7f5b5c0c6680 2023-11-27T20:42:33.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.223+0000 7f5b61d52640 1 --2- 172.21.15.91:0/2561141390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0c6680 0x7f5b5c0c6a60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b580097a0 tx=0x7f5b5802b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7718f19a3117b78 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:33.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.224+0000 7f5b60d50640 1 -- 172.21.15.91:0/2561141390 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5802f050 con 0x7f5b5c0c6680 2023-11-27T20:42:33.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.224+0000 7f5b60d50640 1 -- 172.21.15.91:0/2561141390 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58031700 con 0x7f5b5c0c6680 2023-11-27T20:42:33.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.224+0000 7f5b60d50640 1 -- 172.21.15.91:0/2561141390 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58031a90 con 0x7f5b5c0c6680 2023-11-27T20:42:33.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.225+0000 7f5b63fb6640 1 -- 172.21.15.91:0/2561141390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0c6680 msgr2=0x7f5b5c0c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:33.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.225+0000 7f5b63fb6640 1 --2- 172.21.15.91:0/2561141390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0c6680 0x7f5b5c0c6a60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b580097a0 tx=0x7f5b5802b7a0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.225+0000 7f5b63fb6640 1 -- 172.21.15.91:0/2561141390 shutdown_connections 2023-11-27T20:42:33.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.225+0000 7f5b63fb6640 1 --2- 172.21.15.91:0/2561141390 >> v2:172.21.15.183:3300/0 conn(0x7f5b5c0a6bc0 0x7f5b5c0c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.225+0000 7f5b63fb6640 1 --2- 172.21.15.91:0/2561141390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0c6680 0x7f5b5c0c6a60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.225+0000 7f5b63fb6640 1 -- 172.21.15.91:0/2561141390 >> 172.21.15.91:0/2561141390 conn(0x7f5b5c0c7e30 msgr2=0x7f5b5c0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:33.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.225+0000 7f5b63fb6640 1 -- 172.21.15.91:0/2561141390 shutdown_connections 2023-11-27T20:42:33.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.225+0000 7f5b63fb6640 1 -- 172.21.15.91:0/2561141390 wait complete. 2023-11-27T20:42:33.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.227+0000 7f5b63fb6640 1 Processor -- start 2023-11-27T20:42:33.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.227+0000 7f5b63fb6640 1 -- start start 2023-11-27T20:42:33.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.227+0000 7f5b63fb6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0a6bc0 0x7f5b5c14d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b63fb6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b5c0c6680 0x7f5b5c1ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b63fb6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b5c0c7950 0x7f5b5c1eb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b63fb6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1ee090 con 0x7f5b5c0c6680 2023-11-27T20:42:33.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b63fb6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0a7f10 con 0x7f5b5c0c7950 2023-11-27T20:42:33.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b63fb6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c14d5d0 con 0x7f5b5c0a6bc0 2023-11-27T20:42:33.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b61551640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b5c0c6680 0x7f5b5c1ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b61551640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b5c0c6680 0x7f5b5c1ed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36774/0 (socket says 172.21.15.91:36774) 2023-11-27T20:42:33.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b61551640 1 -- 172.21.15.91:0/4056055448 learned_addr learned my addr 172.21.15.91:0/4056055448 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b61d52640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0a6bc0 0x7f5b5c14d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b61551640 1 -- 172.21.15.91:0/4056055448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0a6bc0 msgr2=0x7f5b5c14d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b61551640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0a6bc0 0x7f5b5c14d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b61551640 1 -- 172.21.15.91:0/4056055448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b5c0c7950 msgr2=0x7f5b5c1eb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b61551640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b5c0c7950 0x7f5b5c1eb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.228+0000 7f5b61551640 1 -- 172.21.15.91:0/4056055448 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58009400 con 0x7f5b5c0c6680 2023-11-27T20:42:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.229+0000 7f5b61551640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b5c0c6680 0x7f5b5c1ed7c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00e870 tx=0x7f5b4c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.229+0000 7f5b527fc640 1 -- 172.21.15.91:0/4056055448 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00c8e0 con 0x7f5b5c0c6680 2023-11-27T20:42:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.229+0000 7f5b527fc640 1 -- 172.21.15.91:0/4056055448 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c00ca40 con 0x7f5b5c0c6680 2023-11-27T20:42:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.229+0000 7f5b527fc640 1 -- 172.21.15.91:0/4056055448 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00cdf0 con 0x7f5b5c0c6680 2023-11-27T20:42:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.229+0000 7f5b63fb6640 1 -- 172.21.15.91:0/4056055448 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c14cdf0 con 0x7f5b5c0c6680 2023-11-27T20:42:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.229+0000 7f5b63fb6640 1 -- 172.21.15.91:0/4056055448 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c1edd00 con 0x7f5b5c0c6680 2023-11-27T20:42:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.230+0000 7f5b63fb6640 1 -- 172.21.15.91:0/4056055448 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c1ee200 con 0x7f5b5c0c6680 2023-11-27T20:42:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.231+0000 7f5b527fc640 1 -- 172.21.15.91:0/4056055448 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5b4c013470 con 0x7f5b5c0c6680 2023-11-27T20:42:33.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.232+0000 7f5b527fc640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b4006b1f0 0x7f5b4006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.232+0000 7f5b527fc640 1 -- 172.21.15.91:0/4056055448 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5b4c089680 con 0x7f5b5c0c6680 2023-11-27T20:42:33.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.232+0000 7f5b61d52640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b4006b1f0 0x7f5b4006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.233+0000 7f5b61d52640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b4006b1f0 0x7f5b4006d6b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5b58035000 tx=0x7f5b58008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:33.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.236+0000 7f5b527fc640 1 -- 172.21.15.91:0/4056055448 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5b5c1ee200 con 0x7f5b5c0c6680 2023-11-27T20:42:33.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.478+0000 7f5b63fb6640 1 -- 172.21.15.91:0/4056055448 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5b5c1ee1d0 con 0x7f5b5c0c6680 2023-11-27T20:42:33.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.482+0000 7f5b527fc640 1 -- 172.21.15.91:0/4056055448 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5b4c054850 con 0x7f5b5c0c6680 2023-11-27T20:42:33.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.484+0000 7f5b63fb6640 1 -- 172.21.15.91:0/4056055448 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b4006b1f0 msgr2=0x7f5b4006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:33.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.484+0000 7f5b63fb6640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b4006b1f0 0x7f5b4006d6b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5b58035000 tx=0x7f5b58008030 comp rx=0 tx=0).stop 2023-11-27T20:42:33.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.484+0000 7f5b63fb6640 1 -- 172.21.15.91:0/4056055448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b5c0c6680 msgr2=0x7f5b5c1ed7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:33.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.484+0000 7f5b63fb6640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b5c0c6680 0x7f5b5c1ed7c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00e870 tx=0x7f5b4c00ed30 comp rx=0 tx=0).stop 2023-11-27T20:42:33.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.484+0000 7f5b63fb6640 1 -- 172.21.15.91:0/4056055448 shutdown_connections 2023-11-27T20:42:33.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.484+0000 7f5b63fb6640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b4006b1f0 0x7f5b4006d6b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.484+0000 7f5b63fb6640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b5c0c7950 0x7f5b5c1eb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.484+0000 7f5b63fb6640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b5c0c6680 0x7f5b5c1ed7c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.484+0000 7f5b63fb6640 1 --2- 172.21.15.91:0/4056055448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b5c0a6bc0 0x7f5b5c14d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.484+0000 7f5b63fb6640 1 -- 172.21.15.91:0/4056055448 >> 172.21.15.91:0/4056055448 conn(0x7f5b5c0c7e30 msgr2=0x7f5b5c0c15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:33.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.485+0000 7f5b63fb6640 1 -- 172.21.15.91:0/4056055448 shutdown_connections 2023-11-27T20:42:33.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.485+0000 7f5b63fb6640 1 -- 172.21.15.91:0/4056055448 wait complete. 2023-11-27T20:42:33.504 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-27T20:42:33.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.709+0000 7fad110b4640 1 Processor -- start 2023-11-27T20:42:33.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.709+0000 7fad110b4640 1 -- start start 2023-11-27T20:42:33.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.710+0000 7fad110b4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fad0c14fd30 0x7fad0c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.710+0000 7fad110b4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fad0c06d0a0 0x7fad0c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.710+0000 7fad110b4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad0c0a5260 0x7fad0c0c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.710+0000 7fad110b4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c0c64a0 con 0x7fad0c14fd30 2023-11-27T20:42:33.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad110b4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c0c5c00 con 0x7fad0c06d0a0 2023-11-27T20:42:33.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad110b4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0c5ee0 con 0x7fad0c0a5260 2023-11-27T20:42:33.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad0ad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fad0c14fd30 0x7fad0c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad0ad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fad0c14fd30 0x7fad0c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36780/0 (socket says 172.21.15.91:36780) 2023-11-27T20:42:33.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad0ad9d640 1 -- 172.21.15.91:0/1144749951 learned_addr learned my addr 172.21.15.91:0/1144749951 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:33.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad03fff640 1 --2- 172.21.15.91:0/1144749951 >> v2:172.21.15.183:3300/0 conn(0x7fad0c06d0a0 0x7fad0c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad0b59e640 1 --2- 172.21.15.91:0/1144749951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad0c0a5260 0x7fad0c0c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad0ad9d640 1 -- 172.21.15.91:0/1144749951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad0c0a5260 msgr2=0x7fad0c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:33.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad0ad9d640 1 --2- 172.21.15.91:0/1144749951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad0c0a5260 0x7fad0c0c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad0ad9d640 1 -- 172.21.15.91:0/1144749951 >> v2:172.21.15.183:3300/0 conn(0x7fad0c06d0a0 msgr2=0x7fad0c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:33.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.711+0000 7fad0ad9d640 1 --2- 172.21.15.91:0/1144749951 >> v2:172.21.15.183:3300/0 conn(0x7fad0c06d0a0 0x7fad0c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.712+0000 7fad0ad9d640 1 -- 172.21.15.91:0/1144749951 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c0c61c0 con 0x7fad0c14fd30 2023-11-27T20:42:33.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.713+0000 7fad0ad9d640 1 --2- 172.21.15.91:0/1144749951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c14fd30 0x7fad0c152f20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fad0c06b460 tx=0x7facfc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1635638fbf0204 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:33.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.713+0000 7fad0a59c640 1 -- 172.21.15.91:0/1144749951 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc031870 con 0x7fad0c14fd30 2023-11-27T20:42:33.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.713+0000 7fad0a59c640 1 -- 172.21.15.91:0/1144749951 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc0319d0 con 0x7fad0c14fd30 2023-11-27T20:42:33.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.713+0000 7fad0a59c640 1 -- 172.21.15.91:0/1144749951 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc031d60 con 0x7fad0c14fd30 2023-11-27T20:42:33.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.714+0000 7fad110b4640 1 -- 172.21.15.91:0/1144749951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c14fd30 msgr2=0x7fad0c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:33.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.714+0000 7fad110b4640 1 --2- 172.21.15.91:0/1144749951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c14fd30 0x7fad0c152f20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fad0c06b460 tx=0x7facfc02b910 comp rx=0 tx=0).stop 2023-11-27T20:42:33.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.714+0000 7fad110b4640 1 -- 172.21.15.91:0/1144749951 shutdown_connections 2023-11-27T20:42:33.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.714+0000 7fad110b4640 1 --2- 172.21.15.91:0/1144749951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad0c0a5260 0x7fad0c0c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.714+0000 7fad110b4640 1 --2- 172.21.15.91:0/1144749951 >> v2:172.21.15.183:3300/0 conn(0x7fad0c06d0a0 0x7fad0c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.714+0000 7fad110b4640 1 --2- 172.21.15.91:0/1144749951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c14fd30 0x7fad0c152f20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.714+0000 7fad110b4640 1 -- 172.21.15.91:0/1144749951 >> 172.21.15.91:0/1144749951 conn(0x7fad0c06a500 msgr2=0x7fad0c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:33.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.714+0000 7fad110b4640 1 -- 172.21.15.91:0/1144749951 shutdown_connections 2023-11-27T20:42:33.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.714+0000 7fad110b4640 1 -- 172.21.15.91:0/1144749951 wait complete. 2023-11-27T20:42:33.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.716+0000 7fad110b4640 1 Processor -- start 2023-11-27T20:42:33.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.716+0000 7fad110b4640 1 -- start start 2023-11-27T20:42:33.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.717+0000 7fad110b4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad0c06d0a0 0x7fad0c14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.717+0000 7fad110b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c0a5260 0x7fad0c151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.717+0000 7fad110b4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad0c14fd30 0x7fad0c155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.717+0000 7fad110b4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c155570 con 0x7fad0c0a5260 2023-11-27T20:42:33.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.717+0000 7fad110b4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c154270 con 0x7fad0c06d0a0 2023-11-27T20:42:33.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.717+0000 7fad110b4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1551b0 con 0x7fad0c14fd30 2023-11-27T20:42:33.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.717+0000 7fad03fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c0a5260 0x7fad0c151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.717+0000 7fad03fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c0a5260 0x7fad0c151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36796/0 (socket says 172.21.15.91:36796) 2023-11-27T20:42:33.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.717+0000 7fad03fff640 1 -- 172.21.15.91:0/2676720165 learned_addr learned my addr 172.21.15.91:0/2676720165 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:33.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.718+0000 7fad0ad9d640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad0c06d0a0 0x7fad0c14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.718+0000 7fad0b59e640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad0c14fd30 0x7fad0c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.718+0000 7fad03fff640 1 -- 172.21.15.91:0/2676720165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad0c14fd30 msgr2=0x7fad0c155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:33.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.718+0000 7fad03fff640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad0c14fd30 0x7fad0c155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.718+0000 7fad03fff640 1 -- 172.21.15.91:0/2676720165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad0c06d0a0 msgr2=0x7fad0c14a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:33.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.718+0000 7fad03fff640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad0c06d0a0 0x7fad0c14a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:33.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.718+0000 7fad03fff640 1 -- 172.21.15.91:0/2676720165 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0094d0 con 0x7fad0c0a5260 2023-11-27T20:42:33.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.718+0000 7fad03fff640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c0a5260 0x7fad0c151650 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7facf400d7d0 tx=0x7facf400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:33.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.718+0000 7fad037fe640 1 -- 172.21.15.91:0/2676720165 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf40096a0 con 0x7fad0c0a5260 2023-11-27T20:42:33.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.719+0000 7fad037fe640 1 -- 172.21.15.91:0/2676720165 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf4009800 con 0x7fad0c0a5260 2023-11-27T20:42:33.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.719+0000 7fad037fe640 1 -- 172.21.15.91:0/2676720165 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4009b90 con 0x7fad0c0a5260 2023-11-27T20:42:33.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.719+0000 7fad110b4640 1 -- 172.21.15.91:0/2676720165 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c1544c0 con 0x7fad0c0a5260 2023-11-27T20:42:33.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.719+0000 7fad110b4640 1 -- 172.21.15.91:0/2676720165 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c151b90 con 0x7fad0c0a5260 2023-11-27T20:42:33.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.720+0000 7fad110b4640 1 -- 172.21.15.91:0/2676720165 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c1556b0 con 0x7fad0c0a5260 2023-11-27T20:42:33.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.721+0000 7fad037fe640 1 -- 172.21.15.91:0/2676720165 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7facf4009cf0 con 0x7fad0c0a5260 2023-11-27T20:42:33.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.722+0000 7fad037fe640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7facec06b1f0 0x7facec06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:33.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.722+0000 7fad037fe640 1 -- 172.21.15.91:0/2676720165 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7facf4089b90 con 0x7fad0c0a5260 2023-11-27T20:42:33.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.722+0000 7fad0ad9d640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7facec06b1f0 0x7facec06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:33.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.723+0000 7fad0ad9d640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7facec06b1f0 0x7facec06d6b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7facfc036000 tx=0x7facfc03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:33.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.727+0000 7fad037fe640 1 -- 172.21.15.91:0/2676720165 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fad0c1556b0 con 0x7fad0c0a5260 2023-11-27T20:42:33.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.983+0000 7fad110b4640 1 -- 172.21.15.91:0/2676720165 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fad0c1556b0 con 0x7fad0c0a5260 2023-11-27T20:42:33.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.995+0000 7fad037fe640 1 -- 172.21.15.91:0/2676720165 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fad0c1556b0 con 0x7fad0c0a5260 2023-11-27T20:42:33.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.997+0000 7fad110b4640 1 -- 172.21.15.91:0/2676720165 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7facec06b1f0 msgr2=0x7facec06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:33.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.997+0000 7fad110b4640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7facec06b1f0 0x7facec06d6b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7facfc036000 tx=0x7facfc03c040 comp rx=0 tx=0).stop 2023-11-27T20:42:34.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.997+0000 7fad110b4640 1 -- 172.21.15.91:0/2676720165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c0a5260 msgr2=0x7fad0c151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.997+0000 7fad110b4640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c0a5260 0x7fad0c151650 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7facf400d7d0 tx=0x7facf400dc90 comp rx=0 tx=0).stop 2023-11-27T20:42:34.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.998+0000 7fad110b4640 1 -- 172.21.15.91:0/2676720165 shutdown_connections 2023-11-27T20:42:34.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.998+0000 7fad110b4640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad0c14fd30 0x7fad0c155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.998+0000 7fad110b4640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad0c0a5260 0x7fad0c151650 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.998+0000 7fad110b4640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7facec06b1f0 0x7facec06d6b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.998+0000 7fad110b4640 1 --2- 172.21.15.91:0/2676720165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad0c06d0a0 0x7fad0c14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.998+0000 7fad110b4640 1 -- 172.21.15.91:0/2676720165 >> 172.21.15.91:0/2676720165 conn(0x7fad0c06a500 msgr2=0x7fad0c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:34.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.998+0000 7fad110b4640 1 -- 172.21.15.91:0/2676720165 shutdown_connections 2023-11-27T20:42:34.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:33.998+0000 7fad110b4640 1 -- 172.21.15.91:0/2676720165 wait complete. 2023-11-27T20:42:34.017 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:34.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.210+0000 7f7c7049b640 1 Processor -- start 2023-11-27T20:42:34.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.210+0000 7f7c7049b640 1 -- start start 2023-11-27T20:42:34.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.211+0000 7f7c7049b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7c6814fd30 0x7f7c68152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.211+0000 7f7c7049b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7c6806d0a0 0x7f7c680a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.211+0000 7f7c7049b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c680c64a0 con 0x7f7c680a5260 2023-11-27T20:42:34.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.211+0000 7f7c7049b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c680c5c00 con 0x7f7c6806d0a0 2023-11-27T20:42:34.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.211+0000 7f7c7049b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c680c5ee0 con 0x7f7c6814fd30 2023-11-27T20:42:34.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.212+0000 7f7c6da36640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7c6806d0a0 0x7f7c680a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:34.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.212+0000 7f7c6da36640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7c6806d0a0 0x7f7c680a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33574/0 (socket says 172.21.15.91:33574) 2023-11-27T20:42:34.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.212+0000 7f7c6da36640 1 -- 172.21.15.91:0/3076505026 learned_addr learned my addr 172.21.15.91:0/3076505026 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:34.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.212+0000 7f7c6da36640 1 -- 172.21.15.91:0/3076505026 >> v2:172.21.15.183:3300/0 conn(0x7f7c6814fd30 msgr2=0x7f7c68152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:34.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.212+0000 7f7c6da36640 1 --2- 172.21.15.91:0/3076505026 >> v2:172.21.15.183:3300/0 conn(0x7f7c6814fd30 0x7f7c68152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.212+0000 7f7c6da36640 1 -- 172.21.15.91:0/3076505026 >> v1:172.21.15.183:6789/0 conn(0x7f7c680a5260 legacy=0x7f7c680c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:34.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.212+0000 7f7c6da36640 1 -- 172.21.15.91:0/3076505026 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c680c61c0 con 0x7f7c6806d0a0 2023-11-27T20:42:34.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.213+0000 7f7c6da36640 1 --2- 172.21.15.91:0/3076505026 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6806d0a0 0x7f7c680a4d20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7c6806b200 tx=0x7f7c5802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7f4efd763c027e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:34.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.213+0000 7f7c6d235640 1 -- 172.21.15.91:0/3076505026 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58031870 con 0x7f7c6806d0a0 2023-11-27T20:42:34.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.214+0000 7f7c6d235640 1 -- 172.21.15.91:0/3076505026 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c580319d0 con 0x7f7c6806d0a0 2023-11-27T20:42:34.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.214+0000 7f7c6d235640 1 -- 172.21.15.91:0/3076505026 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58031d60 con 0x7f7c6806d0a0 2023-11-27T20:42:34.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.214+0000 7f7c7049b640 1 -- 172.21.15.91:0/3076505026 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6806d0a0 msgr2=0x7f7c680a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.214+0000 7f7c7049b640 1 --2- 172.21.15.91:0/3076505026 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6806d0a0 0x7f7c680a4d20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7c6806b200 tx=0x7f7c5802b910 comp rx=0 tx=0).stop 2023-11-27T20:42:34.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.214+0000 7f7c7049b640 1 -- 172.21.15.91:0/3076505026 shutdown_connections 2023-11-27T20:42:34.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.214+0000 7f7c7049b640 1 --2- 172.21.15.91:0/3076505026 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6806d0a0 0x7f7c680a4d20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.214+0000 7f7c7049b640 1 --2- 172.21.15.91:0/3076505026 >> v2:172.21.15.183:3300/0 conn(0x7f7c6814fd30 0x7f7c68152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.214+0000 7f7c7049b640 1 -- 172.21.15.91:0/3076505026 >> 172.21.15.91:0/3076505026 conn(0x7f7c6806a500 msgr2=0x7f7c6806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:34.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.214+0000 7f7c7049b640 1 -- 172.21.15.91:0/3076505026 shutdown_connections 2023-11-27T20:42:34.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.214+0000 7f7c7049b640 1 -- 172.21.15.91:0/3076505026 wait complete. 2023-11-27T20:42:34.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.216+0000 7f7c7049b640 1 Processor -- start 2023-11-27T20:42:34.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.216+0000 7f7c7049b640 1 -- start start 2023-11-27T20:42:34.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c7049b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c6806d0a0 0x7f7c680aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c7049b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c680a5260 0x7f7c68151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c7049b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6814fd30 0x7f7c68145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c7049b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c681554a0 con 0x7f7c6814fd30 2023-11-27T20:42:34.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c7049b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68155da0 con 0x7f7c6806d0a0 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c7049b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680aad90 con 0x7f7c680a5260 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c6ea38640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6814fd30 0x7f7c68145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c6ea38640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6814fd30 0x7f7c68145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33580/0 (socket says 172.21.15.91:33580) 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c6ea38640 1 -- 172.21.15.91:0/3971375561 learned_addr learned my addr 172.21.15.91:0/3971375561 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c6ea38640 1 -- 172.21.15.91:0/3971375561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c680a5260 msgr2=0x7f7c68151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c6da36640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c680a5260 0x7f7c68151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c6e237640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c6806d0a0 0x7f7c680aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c6ea38640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c680a5260 0x7f7c68151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c6ea38640 1 -- 172.21.15.91:0/3971375561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c6806d0a0 msgr2=0x7f7c680aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c6ea38640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c6806d0a0 0x7f7c680aa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.217+0000 7f7c6ea38640 1 -- 172.21.15.91:0/3971375561 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580094d0 con 0x7f7c6814fd30 2023-11-27T20:42:34.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.218+0000 7f7c6ea38640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6814fd30 0x7f7c68145c50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000c780 tx=0x7f7c6000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:34.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.218+0000 7f7c5effd640 1 -- 172.21.15.91:0/3971375561 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60003d80 con 0x7f7c6814fd30 2023-11-27T20:42:34.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.218+0000 7f7c5effd640 1 -- 172.21.15.91:0/3971375561 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000ce90 con 0x7f7c6814fd30 2023-11-27T20:42:34.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.218+0000 7f7c7049b640 1 -- 172.21.15.91:0/3971375561 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c681eaf80 con 0x7f7c6814fd30 2023-11-27T20:42:34.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.218+0000 7f7c5effd640 1 -- 172.21.15.91:0/3971375561 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c600052b0 con 0x7f7c6814fd30 2023-11-27T20:42:34.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.218+0000 7f7c7049b640 1 -- 172.21.15.91:0/3971375561 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c681ea650 con 0x7f7c6814fd30 2023-11-27T20:42:34.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.219+0000 7f7c7049b640 1 -- 172.21.15.91:0/3971375561 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c681eb110 con 0x7f7c6814fd30 2023-11-27T20:42:34.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.220+0000 7f7c5effd640 1 -- 172.21.15.91:0/3971375561 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7c60005410 con 0x7f7c6814fd30 2023-11-27T20:42:34.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.221+0000 7f7c5effd640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c4c06b1f0 0x7f7c4c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.221+0000 7f7c5effd640 1 -- 172.21.15.91:0/3971375561 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c60088f40 con 0x7f7c6814fd30 2023-11-27T20:42:34.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.222+0000 7f7c6e237640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c4c06b1f0 0x7f7c4c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:34.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.222+0000 7f7c6e237640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c4c06b1f0 0x7f7c4c06d6b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400a770 tx=0x7f7c64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:34.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.226+0000 7f7c5effd640 1 -- 172.21.15.91:0/3971375561 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7c60053fb0 con 0x7f7c6814fd30 2023-11-27T20:42:34.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.404+0000 7f7c7049b640 1 -- 172.21.15.91:0/3971375561 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c68068350 con 0x7f7c6814fd30 2023-11-27T20:42:34.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.405+0000 7f7c5effd640 1 -- 172.21.15.91:0/3971375561 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12822 (secure 0 0 0) 0x7f7c60017070 con 0x7f7c6814fd30 2023-11-27T20:42:34.407 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:34.407 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:42:26.201417+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:34.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 -- 172.21.15.91:0/3971375561 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c4c06b1f0 msgr2=0x7f7c4c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c4c06b1f0 0x7f7c4c06d6b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400a770 tx=0x7f7c64008040 comp rx=0 tx=0).stop 2023-11-27T20:42:34.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 -- 172.21.15.91:0/3971375561 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6814fd30 msgr2=0x7f7c68145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6814fd30 0x7f7c68145c50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000c780 tx=0x7f7c6000cc40 comp rx=0 tx=0).stop 2023-11-27T20:42:34.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 -- 172.21.15.91:0/3971375561 shutdown_connections 2023-11-27T20:42:34.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6814fd30 0x7f7c68145c50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c680a5260 0x7f7c68151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c4c06b1f0 0x7f7c4c06d6b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 --2- 172.21.15.91:0/3971375561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c6806d0a0 0x7f7c680aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 -- 172.21.15.91:0/3971375561 >> 172.21.15.91:0/3971375561 conn(0x7f7c6806a500 msgr2=0x7f7c6806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:34.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 -- 172.21.15.91:0/3971375561 shutdown_connections 2023-11-27T20:42:34.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.409+0000 7f7c7049b640 1 -- 172.21.15.91:0/3971375561 wait complete. 2023-11-27T20:42:34.428 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:42:34.428 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:42:34.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.629+0000 7f4da9390640 1 Processor -- start 2023-11-27T20:42:34.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.629+0000 7f4da9390640 1 -- start start 2023-11-27T20:42:34.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.631+0000 7f4da9390640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4da4155190 0x7f4da41600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.631+0000 7f4da9390640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da4154740 con 0x7f4da4151cc0 2023-11-27T20:42:34.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.631+0000 7f4da9390640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da406c760 con 0x7f4da40c7ec0 2023-11-27T20:42:34.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.631+0000 7f4da9390640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da40c8470 con 0x7f4da4155190 2023-11-27T20:42:34.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da2ffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f4da4151cc0 0x7f4da4157d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:35722/0 (socket says 172.21.15.91:35722) 2023-11-27T20:42:34.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da2ffd640 1 -- 172.21.15.91:0/165829252 learned_addr learned my addr 172.21.15.91:0/165829252 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:34.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921124150 0 0) 0x7f4da4154740 con 0x7f4da4151cc0 2023-11-27T20:42:34.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d90003520 con 0x7f4da4151cc0 2023-11-27T20:42:34.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da37fe640 1 --2- 172.21.15.91:0/165829252 >> v2:172.21.15.183:3300/0 conn(0x7f4da4155190 0x7f4da41600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:34.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3807892906 0 0) 0x7f4d90003520 con 0x7f4da4151cc0 2023-11-27T20:42:34.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 >> v2:172.21.15.183:3300/0 conn(0x7f4da4155190 msgr2=0x7f4da41600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:34.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da27fc640 1 --2- 172.21.15.91:0/165829252 >> v2:172.21.15.183:3300/0 conn(0x7f4da4155190 0x7f4da41600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 >> v1:172.21.15.183:6789/0 conn(0x7f4da40c7ec0 legacy=0x7f4da40c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:34.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da40c8750 con 0x7f4da4151cc0 2023-11-27T20:42:34.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f4d94001670 con 0x7f4da4151cc0 2023-11-27T20:42:34.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.632+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 >> v1:172.21.15.91:6789/0 conn(0x7f4da4151cc0 legacy=0x7f4da4157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4da27fc640 1 --2- 172.21.15.91:0/165829252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d90003970 0x7f4d90003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4da27fc640 1 --2- 172.21.15.91:0/165829252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4d90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4da27fc640 1 --2- 172.21.15.91:0/165829252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d90005180 0x7f4d9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da40c8470 con 0x7f4d900047c0 2023-11-27T20:42:34.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9000c0b0 con 0x7f4d90003970 2023-11-27T20:42:34.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9000c270 con 0x7f4d90005180 2023-11-27T20:42:34.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4d9bfff640 1 --2- 172.21.15.91:0/165829252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4d90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:34.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4d9bfff640 1 -- 172.21.15.91:0/165829252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d90005180 msgr2=0x7f4d9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:34.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4d9bfff640 1 --2- 172.21.15.91:0/165829252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d90005180 0x7f4d9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4d9bfff640 1 -- 172.21.15.91:0/165829252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d90003970 msgr2=0x7f4d90003d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T20:42:34.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4d9bfff640 1 --2- 172.21.15.91:0/165829252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d90003970 0x7f4d90003d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4d9bfff640 1 -- 172.21.15.91:0/165829252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d90003520 con 0x7f4d900047c0 2023-11-27T20:42:34.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.633+0000 7f4da37fe640 1 -- 172.21.15.91:0/165829252 reap_dead start 2023-11-27T20:42:34.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.634+0000 7f4d9bfff640 1 --2- 172.21.15.91:0/165829252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4d90004c40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4da40c4270 tx=0x7f4d900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa45a012f90dd158 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:34.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.635+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c005270 con 0x7f4d900047c0 2023-11-27T20:42:34.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.635+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c02e070 con 0x7f4d900047c0 2023-11-27T20:42:34.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.635+0000 7f4da27fc640 1 -- 172.21.15.91:0/165829252 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c003610 con 0x7f4d900047c0 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.635+0000 7f4da9390640 1 -- 172.21.15.91:0/165829252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 msgr2=0x7f4d90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.635+0000 7f4da9390640 1 --2- 172.21.15.91:0/165829252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4d90004c40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4da40c4270 tx=0x7f4d900057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.635+0000 7f4da9390640 1 -- 172.21.15.91:0/165829252 shutdown_connections 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.635+0000 7f4da9390640 1 --2- 172.21.15.91:0/165829252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4d90004c40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.635+0000 7f4da9390640 1 -- 172.21.15.91:0/165829252 >> 172.21.15.91:0/165829252 conn(0x7f4da4071e10 msgr2=0x7f4da4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.635+0000 7f4da9390640 1 -- 172.21.15.91:0/165829252 shutdown_connections 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.635+0000 7f4da9390640 1 -- 172.21.15.91:0/165829252 wait complete. 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.637+0000 7f4da9390640 1 Processor -- start 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.637+0000 7f4da9390640 1 -- start start 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.638+0000 7f4da9390640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4da414a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.638+0000 7f4da9390640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4da40af930 0x7f4da4148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.638+0000 7f4da9390640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4da4148a50 0x7f4da4153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.638+0000 7f4da9390640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4152d00 con 0x7f4d900047c0 2023-11-27T20:42:34.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.638+0000 7f4da9390640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da40af3e0 con 0x7f4da4148a50 2023-11-27T20:42:34.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.638+0000 7f4da9390640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4148f00 con 0x7f4da40af930 2023-11-27T20:42:34.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.638+0000 7f4da2ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4da414a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:34.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.638+0000 7f4da2ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4da414a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33600/0 (socket says 172.21.15.91:33600) 2023-11-27T20:42:34.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.638+0000 7f4da2ffd640 1 -- 172.21.15.91:0/2453487334 learned_addr learned my addr 172.21.15.91:0/2453487334 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:34.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4da2ffd640 1 -- 172.21.15.91:0/2453487334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4da40af930 msgr2=0x7f4da4148510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T20:42:34.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4da2ffd640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4da40af930 0x7f4da4148510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4da2ffd640 1 -- 172.21.15.91:0/2453487334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4da4148a50 msgr2=0x7f4da4153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4da2ffd640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4da4148a50 0x7f4da4153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4da2ffd640 1 -- 172.21.15.91:0/2453487334 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da41eedb0 con 0x7f4d900047c0 2023-11-27T20:42:34.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4da2ffd640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4da414a5a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400c770 tx=0x7f4d9400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:34.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4d9b7fe640 1 -- 172.21.15.91:0/2453487334 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940074e0 con 0x7f4d900047c0 2023-11-27T20:42:34.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4d9b7fe640 1 -- 172.21.15.91:0/2453487334 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d94007640 con 0x7f4d900047c0 2023-11-27T20:42:34.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4d9b7fe640 1 -- 172.21.15.91:0/2453487334 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94004a20 con 0x7f4d900047c0 2023-11-27T20:42:34.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4da9390640 1 -- 172.21.15.91:0/2453487334 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da41ef090 con 0x7f4d900047c0 2023-11-27T20:42:34.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.639+0000 7f4da9390640 1 -- 172.21.15.91:0/2453487334 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da4149710 con 0x7f4d900047c0 2023-11-27T20:42:34.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.640+0000 7f4da9390640 1 -- 172.21.15.91:0/2453487334 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da40c4370 con 0x7f4d900047c0 2023-11-27T20:42:34.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.641+0000 7f4d9b7fe640 1 -- 172.21.15.91:0/2453487334 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4d94004b80 con 0x7f4d900047c0 2023-11-27T20:42:34.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.642+0000 7f4d9b7fe640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1c0 0x7f4d8406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:34.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.642+0000 7f4d9b7fe640 1 -- 172.21.15.91:0/2453487334 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4d940889e0 con 0x7f4d900047c0 2023-11-27T20:42:34.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.642+0000 7f4d9bfff640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1c0 0x7f4d8406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:34.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.643+0000 7f4d9bfff640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1c0 0x7f4d8406d680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c033000 tx=0x7f4d8c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:34.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.647+0000 7f4d9b7fe640 1 -- 172.21.15.91:0/2453487334 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4d94053af0 con 0x7f4d900047c0 2023-11-27T20:42:34.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.835+0000 7f4da9390640 1 -- 172.21.15.91:0/2453487334 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4da4068350 con 0x7f4d900047c0 2023-11-27T20:42:34.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.836+0000 7f4d9b7fe640 1 -- 172.21.15.91:0/2453487334 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d94018020 con 0x7f4d900047c0 2023-11-27T20:42:34.836 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:42:34.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.838+0000 7f4da9390640 1 -- 172.21.15.91:0/2453487334 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1c0 msgr2=0x7f4d8406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.838+0000 7f4da9390640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1c0 0x7f4d8406d680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c033000 tx=0x7f4d8c009030 comp rx=0 tx=0).stop 2023-11-27T20:42:34.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.838+0000 7f4da9390640 1 -- 172.21.15.91:0/2453487334 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 msgr2=0x7f4da414a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:34.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.838+0000 7f4da9390640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4da414a5a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400c770 tx=0x7f4d9400cc30 comp rx=0 tx=0).stop 2023-11-27T20:42:34.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.839+0000 7f4da9390640 1 -- 172.21.15.91:0/2453487334 shutdown_connections 2023-11-27T20:42:34.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.839+0000 7f4da9390640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1c0 0x7f4d8406d680 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.839+0000 7f4da9390640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4da4148a50 0x7f4da4153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.839+0000 7f4da9390640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4da40af930 0x7f4da4148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.839+0000 7f4da9390640 1 --2- 172.21.15.91:0/2453487334 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d900047c0 0x7f4da414a5a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:34.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.839+0000 7f4da9390640 1 -- 172.21.15.91:0/2453487334 >> 172.21.15.91:0/2453487334 conn(0x7f4da4071e10 msgr2=0x7f4da414c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:34.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.839+0000 7f4da9390640 1 -- 172.21.15.91:0/2453487334 shutdown_connections 2023-11-27T20:42:34.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:34.839+0000 7f4da9390640 1 -- 172.21.15.91:0/2453487334 wait complete. 2023-11-27T20:42:34.858 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T20:42:35.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.068+0000 7f8028ac9640 1 Processor -- start 2023-11-27T20:42:35.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.068+0000 7f8028ac9640 1 -- start start 2023-11-27T20:42:35.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.069+0000 7f8028ac9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8024155490 0x7f80240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f8028ac9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f80240a9b40 0x7f80240c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f8028ac9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240c06c0 con 0x7f80240c1500 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f8028ac9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80240a5820 con 0x7f8024155490 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f8028ac9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80240c1020 con 0x7f80240a9b40 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f802259c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8024155490 0x7f80240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f802259c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8024155490 0x7f80240a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33604/0 (socket says 172.21.15.91:33604) 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f802259c640 1 -- 172.21.15.91:0/1336799441 learned_addr learned my addr 172.21.15.91:0/1336799441 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f8022d9d640 1 --2- 172.21.15.91:0/1336799441 >> v2:172.21.15.183:3300/0 conn(0x7f80240a9b40 0x7f80240c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f802259c640 1 -- 172.21.15.91:0/1336799441 >> v2:172.21.15.183:3300/0 conn(0x7f80240a9b40 msgr2=0x7f80240c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f802259c640 1 --2- 172.21.15.91:0/1336799441 >> v2:172.21.15.183:3300/0 conn(0x7f80240a9b40 0x7f80240c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f802259c640 1 -- 172.21.15.91:0/1336799441 >> v1:172.21.15.183:6789/0 conn(0x7f80240c1500 legacy=0x7f80240a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:35.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.070+0000 7f802259c640 1 -- 172.21.15.91:0/1336799441 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240c0910 con 0x7f8024155490 2023-11-27T20:42:35.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.071+0000 7f802259c640 1 --2- 172.21.15.91:0/1336799441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 0x7f80240a51b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8024067220 tx=0x7f801402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a57b4359eca916 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:35.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.072+0000 7f8021d9b640 1 -- 172.21.15.91:0/1336799441 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014031870 con 0x7f8024155490 2023-11-27T20:42:35.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.072+0000 7f8021d9b640 1 -- 172.21.15.91:0/1336799441 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80140319d0 con 0x7f8024155490 2023-11-27T20:42:35.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.072+0000 7f8021d9b640 1 -- 172.21.15.91:0/1336799441 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014031d60 con 0x7f8024155490 2023-11-27T20:42:35.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.072+0000 7f8028ac9640 1 -- 172.21.15.91:0/1336799441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 msgr2=0x7f80240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:35.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.072+0000 7f8028ac9640 1 --2- 172.21.15.91:0/1336799441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 0x7f80240a51b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8024067220 tx=0x7f801402b910 comp rx=0 tx=0).stop 2023-11-27T20:42:35.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.073+0000 7f8028ac9640 1 -- 172.21.15.91:0/1336799441 shutdown_connections 2023-11-27T20:42:35.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.073+0000 7f8028ac9640 1 --2- 172.21.15.91:0/1336799441 >> v2:172.21.15.183:3300/0 conn(0x7f80240a9b40 0x7f80240c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.073+0000 7f8028ac9640 1 --2- 172.21.15.91:0/1336799441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 0x7f80240a51b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.073+0000 7f8028ac9640 1 -- 172.21.15.91:0/1336799441 >> 172.21.15.91:0/1336799441 conn(0x7f802406a500 msgr2=0x7f802406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:35.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.073+0000 7f8028ac9640 1 -- 172.21.15.91:0/1336799441 shutdown_connections 2023-11-27T20:42:35.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.073+0000 7f8028ac9640 1 -- 172.21.15.91:0/1336799441 wait complete. 2023-11-27T20:42:35.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.074+0000 7f8028ac9640 1 Processor -- start 2023-11-27T20:42:35.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.075+0000 7f8028ac9640 1 -- start start 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.075+0000 7f8028ac9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80240c1500 0x7f80241db730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f8028ac9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 0x7f80240a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f8028ac9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f802414eb40 0x7f80241e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f8028ac9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80241dbed0 con 0x7f8024155490 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f8028ac9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80241e18c0 con 0x7f80240c1500 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f8028ac9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80241edf60 con 0x7f802414eb40 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f801bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 0x7f80240a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f801bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 0x7f80240a6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33608/0 (socket says 172.21.15.91:33608) 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f801bfff640 1 -- 172.21.15.91:0/2781555021 learned_addr learned my addr 172.21.15.91:0/2781555021 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f801bfff640 1 -- 172.21.15.91:0/2781555021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f802414eb40 msgr2=0x7f80241e9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:35.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f801bfff640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f802414eb40 0x7f80241e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f801bfff640 1 -- 172.21.15.91:0/2781555021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80240c1500 msgr2=0x7f80241db730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:35.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f801bfff640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80240c1500 0x7f80241db730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.076+0000 7f801bfff640 1 -- 172.21.15.91:0/2781555021 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140094d0 con 0x7f8024155490 2023-11-27T20:42:35.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.077+0000 7f801bfff640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 0x7f80240a6d60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c410 tx=0x7f800c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:35.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.077+0000 7f801affd640 1 -- 172.21.15.91:0/2781555021 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c0035f0 con 0x7f8024155490 2023-11-27T20:42:35.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.077+0000 7f801affd640 1 -- 172.21.15.91:0/2781555021 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c003750 con 0x7f8024155490 2023-11-27T20:42:35.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.077+0000 7f801affd640 1 -- 172.21.15.91:0/2781555021 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c003b40 con 0x7f8024155490 2023-11-27T20:42:35.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.077+0000 7f8028ac9640 1 -- 172.21.15.91:0/2781555021 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80241547b0 con 0x7f8024155490 2023-11-27T20:42:35.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.077+0000 7f8028ac9640 1 -- 172.21.15.91:0/2781555021 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80240a72a0 con 0x7f8024155490 2023-11-27T20:42:35.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.078+0000 7f8028ac9640 1 -- 172.21.15.91:0/2781555021 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80241db370 con 0x7f8024155490 2023-11-27T20:42:35.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.079+0000 7f801affd640 1 -- 172.21.15.91:0/2781555021 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f800c003ca0 con 0x7f8024155490 2023-11-27T20:42:35.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.080+0000 7f801affd640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f800406b1f0 0x7f800406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.081+0000 7f801affd640 1 -- 172.21.15.91:0/2781555021 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f800c088830 con 0x7f8024155490 2023-11-27T20:42:35.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.081+0000 7f802259c640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f800406b1f0 0x7f800406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:35.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.081+0000 7f802259c640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f800406b1f0 0x7f800406d6b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8014036000 tx=0x7f8014030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:35.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.085+0000 7f801affd640 1 -- 172.21.15.91:0/2781555021 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f800c0538a0 con 0x7f8024155490 2023-11-27T20:42:35.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.279+0000 7f8028ac9640 1 -- 172.21.15.91:0/2781555021 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8024068350 con 0x7f8024155490 2023-11-27T20:42:35.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.279+0000 7f801affd640 1 -- 172.21.15.91:0/2781555021 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f800c056ec0 con 0x7f8024155490 2023-11-27T20:42:35.282 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:35.283 INFO:teuthology.orchestra.run.smithi091.stdout:[ 2023-11-27T20:42:35.283 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:35.283 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 1, 2023-11-27T20:42:35.283 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": ".mgr" 2023-11-27T20:42:35.283 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:35.283 INFO:teuthology.orchestra.run.smithi091.stdout:] 2023-11-27T20:42:35.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 -- 172.21.15.91:0/2781555021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f800406b1f0 msgr2=0x7f800406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:35.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f800406b1f0 0x7f800406d6b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8014036000 tx=0x7f8014030000 comp rx=0 tx=0).stop 2023-11-27T20:42:35.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 -- 172.21.15.91:0/2781555021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 msgr2=0x7f80240a6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:35.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 0x7f80240a6d60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c410 tx=0x7f800c00c8d0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 -- 172.21.15.91:0/2781555021 shutdown_connections 2023-11-27T20:42:35.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f802414eb40 0x7f80241e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8024155490 0x7f80240a6d60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f800406b1f0 0x7f800406d6b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 --2- 172.21.15.91:0/2781555021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80240c1500 0x7f80241db730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 -- 172.21.15.91:0/2781555021 >> 172.21.15.91:0/2781555021 conn(0x7f802406a500 msgr2=0x7f80240c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:35.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 -- 172.21.15.91:0/2781555021 shutdown_connections 2023-11-27T20:42:35.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.282+0000 7f8028ac9640 1 -- 172.21.15.91:0/2781555021 wait complete. 2023-11-27T20:42:35.299 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T20:42:35.300 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T20:42:35.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.492+0000 7ff14291d640 1 Processor -- start 2023-11-27T20:42:35.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.492+0000 7ff14291d640 1 -- start start 2023-11-27T20:42:35.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.493+0000 7ff14291d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff13c0c7ec0 0x7ff13c155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.493+0000 7ff14291d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff13c0c4940 0x7ff13c0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.494+0000 7ff14291d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c1556d0 con 0x7ff13c151cc0 2023-11-27T20:42:35.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.494+0000 7ff14291d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c154740 con 0x7ff13c0c7ec0 2023-11-27T20:42:35.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.494+0000 7ff14291d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c06c760 con 0x7ff13c0c4940 2023-11-27T20:42:35.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.494+0000 7ff13b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff13c0c7ec0 0x7ff13c155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:35.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.494+0000 7ff13b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff13c0c7ec0 0x7ff13c155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33624/0 (socket says 172.21.15.91:33624) 2023-11-27T20:42:35.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.494+0000 7ff13b7fe640 1 -- 172.21.15.91:0/45331395 learned_addr learned my addr 172.21.15.91:0/45331395 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:35.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.494+0000 7ff13b7fe640 1 -- 172.21.15.91:0/45331395 >> v2:172.21.15.183:3300/0 conn(0x7ff13c0c4940 msgr2=0x7ff13c0c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:35.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.494+0000 7ff13b7fe640 1 --2- 172.21.15.91:0/45331395 >> v2:172.21.15.183:3300/0 conn(0x7ff13c0c4940 0x7ff13c0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.494+0000 7ff13b7fe640 1 -- 172.21.15.91:0/45331395 >> v1:172.21.15.183:6789/0 conn(0x7ff13c151cc0 legacy=0x7ff13c157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:35.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.494+0000 7ff13b7fe640 1 -- 172.21.15.91:0/45331395 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0c8470 con 0x7ff13c0c7ec0 2023-11-27T20:42:35.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.495+0000 7ff13b7fe640 1 --2- 172.21.15.91:0/45331395 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c0c7ec0 0x7ff13c155190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0c67b0 tx=0x7ff12402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8929cc5009d7e2c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:35.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff13affd640 1 -- 172.21.15.91:0/45331395 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124031870 con 0x7ff13c0c7ec0 2023-11-27T20:42:35.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff13affd640 1 -- 172.21.15.91:0/45331395 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1240319d0 con 0x7ff13c0c7ec0 2023-11-27T20:42:35.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff13affd640 1 -- 172.21.15.91:0/45331395 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124031d60 con 0x7ff13c0c7ec0 2023-11-27T20:42:35.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff14291d640 1 -- 172.21.15.91:0/45331395 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c0c7ec0 msgr2=0x7ff13c155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:35.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff14291d640 1 --2- 172.21.15.91:0/45331395 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c0c7ec0 0x7ff13c155190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0c67b0 tx=0x7ff12402b910 comp rx=0 tx=0).stop 2023-11-27T20:42:35.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff14291d640 1 -- 172.21.15.91:0/45331395 shutdown_connections 2023-11-27T20:42:35.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff14291d640 1 --2- 172.21.15.91:0/45331395 >> v2:172.21.15.183:3300/0 conn(0x7ff13c0c4940 0x7ff13c0c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff14291d640 1 --2- 172.21.15.91:0/45331395 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c0c7ec0 0x7ff13c155190 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff14291d640 1 -- 172.21.15.91:0/45331395 >> 172.21.15.91:0/45331395 conn(0x7ff13c071e10 msgr2=0x7ff13c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:35.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff14291d640 1 -- 172.21.15.91:0/45331395 shutdown_connections 2023-11-27T20:42:35.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.496+0000 7ff14291d640 1 -- 172.21.15.91:0/45331395 wait complete. 2023-11-27T20:42:35.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.498+0000 7ff14291d640 1 Processor -- start 2023-11-27T20:42:35.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.498+0000 7ff14291d640 1 -- start start 2023-11-27T20:42:35.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff14291d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff13c0c4940 0x7ff13c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff14291d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff13c0c7ec0 0x7ff13c147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff14291d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c151cc0 0x7ff13c148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff14291d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c1ea6c0 con 0x7ff13c151cc0 2023-11-27T20:42:35.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff14291d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c1ea9a0 con 0x7ff13c0c4940 2023-11-27T20:42:35.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff14291d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c150680 con 0x7ff13c0c7ec0 2023-11-27T20:42:35.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff140eba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c151cc0 0x7ff13c148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:35.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff140eba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c151cc0 0x7ff13c148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33632/0 (socket says 172.21.15.91:33632) 2023-11-27T20:42:35.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff140eba640 1 -- 172.21.15.91:0/1338845458 learned_addr learned my addr 172.21.15.91:0/1338845458 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:35.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff140eba640 1 -- 172.21.15.91:0/1338845458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff13c0c7ec0 msgr2=0x7ff13c147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:35.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff140eba640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff13c0c7ec0 0x7ff13c147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff140eba640 1 -- 172.21.15.91:0/1338845458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff13c0c4940 msgr2=0x7ff13c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:35.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff140eba640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff13c0c4940 0x7ff13c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:35.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.499+0000 7ff140eba640 1 -- 172.21.15.91:0/1338845458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1240094d0 con 0x7ff13c151cc0 2023-11-27T20:42:35.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.500+0000 7ff140eba640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c151cc0 0x7ff13c148420 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff134009fd0 tx=0x7ff13400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:35.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.500+0000 7ff138ff9640 1 -- 172.21.15.91:0/1338845458 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134011830 con 0x7ff13c151cc0 2023-11-27T20:42:35.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.500+0000 7ff138ff9640 1 -- 172.21.15.91:0/1338845458 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134011990 con 0x7ff13c151cc0 2023-11-27T20:42:35.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.500+0000 7ff138ff9640 1 -- 172.21.15.91:0/1338845458 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134011d20 con 0x7ff13c151cc0 2023-11-27T20:42:35.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.500+0000 7ff14291d640 1 -- 172.21.15.91:0/1338845458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c150960 con 0x7ff13c151cc0 2023-11-27T20:42:35.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.500+0000 7ff14291d640 1 -- 172.21.15.91:0/1338845458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c0ab1c0 con 0x7ff13c151cc0 2023-11-27T20:42:35.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.501+0000 7ff14291d640 1 -- 172.21.15.91:0/1338845458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c068350 con 0x7ff13c151cc0 2023-11-27T20:42:35.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.502+0000 7ff138ff9640 1 -- 172.21.15.91:0/1338845458 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff13401b460 con 0x7ff13c151cc0 2023-11-27T20:42:35.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.503+0000 7ff138ff9640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff11c06b1c0 0x7ff11c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:35.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.503+0000 7ff138ff9640 1 -- 172.21.15.91:0/1338845458 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff134089500 con 0x7ff13c151cc0 2023-11-27T20:42:35.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.503+0000 7ff13bfff640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff11c06b1c0 0x7ff11c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:35.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.504+0000 7ff13bfff640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff11c06b1c0 0x7ff11c06d680 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00abb0 tx=0x7ff12c009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:35.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.507+0000 7ff138ff9640 1 -- 172.21.15.91:0/1338845458 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff134058000 con 0x7ff13c151cc0 2023-11-27T20:42:35.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:35.694+0000 7ff14291d640 1 -- 172.21.15.91:0/1338845458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff13c06c9c0 con 0x7ff13c151cc0 2023-11-27T20:42:36.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.485+0000 7ff138ff9640 1 -- 172.21.15.91:0/1338845458 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff134057b90 con 0x7ff13c151cc0 2023-11-27T20:42:36.486 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' created 2023-11-27T20:42:36.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.490+0000 7ff14291d640 1 -- 172.21.15.91:0/1338845458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff11c06b1c0 msgr2=0x7ff11c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:36.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.490+0000 7ff14291d640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff11c06b1c0 0x7ff11c06d680 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00abb0 tx=0x7ff12c009250 comp rx=0 tx=0).stop 2023-11-27T20:42:36.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.490+0000 7ff14291d640 1 -- 172.21.15.91:0/1338845458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c151cc0 msgr2=0x7ff13c148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:36.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.490+0000 7ff14291d640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c151cc0 0x7ff13c148420 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff134009fd0 tx=0x7ff13400b8e0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.490+0000 7ff14291d640 1 -- 172.21.15.91:0/1338845458 shutdown_connections 2023-11-27T20:42:36.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.490+0000 7ff14291d640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff13c151cc0 0x7ff13c148420 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.490+0000 7ff14291d640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff13c0c7ec0 0x7ff13c147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.490+0000 7ff14291d640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff11c06b1c0 0x7ff11c06d680 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.490+0000 7ff14291d640 1 --2- 172.21.15.91:0/1338845458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff13c0c4940 0x7ff13c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.490+0000 7ff14291d640 1 -- 172.21.15.91:0/1338845458 >> 172.21.15.91:0/1338845458 conn(0x7ff13c071e10 msgr2=0x7ff13c0c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:36.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.491+0000 7ff14291d640 1 -- 172.21.15.91:0/1338845458 shutdown_connections 2023-11-27T20:42:36.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.491+0000 7ff14291d640 1 -- 172.21.15.91:0/1338845458 wait complete. 2023-11-27T20:42:36.517 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T20:42:36.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.728+0000 7f3030fa4640 1 Processor -- start 2023-11-27T20:42:36.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.728+0000 7f3030fa4640 1 -- start start 2023-11-27T20:42:36.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.729+0000 7f3030fa4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c0c1500 0x7f302c0c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:36.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.729+0000 7f3030fa4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c0c06c0 con 0x7f302c155490 2023-11-27T20:42:36.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.729+0000 7f3030fa4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c0c1020 con 0x7f302c0a9b40 2023-11-27T20:42:36.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.729+0000 7f3030fa4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0a5820 con 0x7f302c0c1500 2023-11-27T20:42:36.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.730+0000 7f302a59c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f302c155490 0x7f302c0a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:35732/0 (socket says 172.21.15.91:35732) 2023-11-27T20:42:36.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.730+0000 7f302a59c640 1 -- 172.21.15.91:0/4015317464 learned_addr learned my addr 172.21.15.91:0/4015317464 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.730+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347036327 0 0) 0x7f302c0c06c0 con 0x7f302c155490 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.730+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3018003520 con 0x7f302c155490 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.730+0000 7f302ad9d640 1 --2- 172.21.15.91:0/4015317464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c0c1500 0x7f302c0c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.730+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1124756197 0 0) 0x7f3018003520 con 0x7f302c155490 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c0c1500 msgr2=0x7f302c0c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 --2- 172.21.15.91:0/4015317464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c0c1500 0x7f302c0c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 >> v1:172.21.15.183:6789/0 conn(0x7f302c0a9b40 legacy=0x7f302c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c0c0910 con 0x7f302c155490 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f301c0019f0 con 0x7f302c155490 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 >> v1:172.21.15.91:6789/0 conn(0x7f302c155490 legacy=0x7f302c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:36.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 --2- 172.21.15.91:0/4015317464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30180039a0 0x7f3018003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 --2- 172.21.15.91:0/4015317464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30180047c0 0x7f3018004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 --2- 172.21.15.91:0/4015317464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c0c1500 0x7f3018005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301800dc40 con 0x7f30180047c0 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301800ddb0 con 0x7f30180039a0 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301800df70 con 0x7f302c0c1500 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3021d9b640 1 --2- 172.21.15.91:0/4015317464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30180047c0 0x7f3018004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3021d9b640 1 -- 172.21.15.91:0/4015317464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c0c1500 msgr2=0x7f3018005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3021d9b640 1 --2- 172.21.15.91:0/4015317464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c0c1500 0x7f3018005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3021d9b640 1 -- 172.21.15.91:0/4015317464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30180039a0 msgr2=0x7f3018003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3021d9b640 1 --2- 172.21.15.91:0/4015317464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30180039a0 0x7f3018003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.731+0000 7f3021d9b640 1 -- 172.21.15.91:0/4015317464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018003520 con 0x7f30180047c0 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.732+0000 7f3021d9b640 1 --2- 172.21.15.91:0/4015317464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30180047c0 0x7f3018004c40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3014001720 tx=0x7f30180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7c8b5fcd56f27 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.733+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30140052d0 con 0x7f30180047c0 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.733+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301402e050 con 0x7f30180047c0 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.733+0000 7f3029d9b640 1 -- 172.21.15.91:0/4015317464 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30140035f0 con 0x7f30180047c0 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.733+0000 7f3030fa4640 1 -- 172.21.15.91:0/4015317464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30180047c0 msgr2=0x7f3018004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.733+0000 7f3030fa4640 1 --2- 172.21.15.91:0/4015317464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f30180047c0 0x7f3018004c40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3014001720 tx=0x7f30180057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.733+0000 7f302ad9d640 1 -- 172.21.15.91:0/4015317464 reap_dead start 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.733+0000 7f3030fa4640 1 -- 172.21.15.91:0/4015317464 shutdown_connections 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.733+0000 7f3030fa4640 1 -- 172.21.15.91:0/4015317464 >> 172.21.15.91:0/4015317464 conn(0x7f302c06a500 msgr2=0x7f302c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.733+0000 7f3030fa4640 1 -- 172.21.15.91:0/4015317464 shutdown_connections 2023-11-27T20:42:36.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.733+0000 7f3030fa4640 1 -- 172.21.15.91:0/4015317464 wait complete. 2023-11-27T20:42:36.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.735+0000 7f3030fa4640 1 Processor -- start 2023-11-27T20:42:36.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.735+0000 7f3030fa4640 1 -- start start 2023-11-27T20:42:36.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.736+0000 7f3030fa4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30180047c0 0x7f302c0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:36.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.736+0000 7f3030fa4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c099a60 0x7f302c14dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:36.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.736+0000 7f3030fa4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f302c14e210 0x7f302c1ed330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.736+0000 7f3030fa4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c14e690 con 0x7f302c14e210 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.736+0000 7f3030fa4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0a5c80 con 0x7f30180047c0 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.736+0000 7f3030fa4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c1ea5b0 con 0x7f302c099a60 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.736+0000 7f302ad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f302c14e210 0x7f302c1ed330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.736+0000 7f302ad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f302c14e210 0x7f302c1ed330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33646/0 (socket says 172.21.15.91:33646) 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.736+0000 7f302ad9d640 1 -- 172.21.15.91:0/3939017093 learned_addr learned my addr 172.21.15.91:0/3939017093 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f302a59c640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30180047c0 0x7f302c0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f3021d9b640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c099a60 0x7f302c14dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f302ad9d640 1 -- 172.21.15.91:0/3939017093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c099a60 msgr2=0x7f302c14dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f302ad9d640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c099a60 0x7f302c14dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f302ad9d640 1 -- 172.21.15.91:0/3939017093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30180047c0 msgr2=0x7f302c0bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:36.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f302ad9d640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30180047c0 0x7f302c0bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:36.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f302ad9d640 1 -- 172.21.15.91:0/3939017093 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c0a4f70 con 0x7f302c14e210 2023-11-27T20:42:36.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f302ad9d640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f302c14e210 0x7f302c1ed330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f302c067240 tx=0x7f302400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:36.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f30237fe640 1 -- 172.21.15.91:0/3939017093 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302400c680 con 0x7f302c14e210 2023-11-27T20:42:36.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f30237fe640 1 -- 172.21.15.91:0/3939017093 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302400c7e0 con 0x7f302c14e210 2023-11-27T20:42:36.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f30237fe640 1 -- 172.21.15.91:0/3939017093 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302400cb90 con 0x7f302c14e210 2023-11-27T20:42:36.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.737+0000 7f3030fa4640 1 -- 172.21.15.91:0/3939017093 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302c0a5250 con 0x7f302c14e210 2023-11-27T20:42:36.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.738+0000 7f3030fa4640 1 -- 172.21.15.91:0/3939017093 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302c1ea890 con 0x7f302c14e210 2023-11-27T20:42:36.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.738+0000 7f3030fa4640 1 -- 172.21.15.91:0/3939017093 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302c068350 con 0x7f302c14e210 2023-11-27T20:42:36.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.740+0000 7f30237fe640 1 -- 172.21.15.91:0/3939017093 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f302400ccf0 con 0x7f302c14e210 2023-11-27T20:42:36.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.741+0000 7f30237fe640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f300c06b1c0 0x7f300c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:36.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.741+0000 7f30237fe640 1 -- 172.21.15.91:0/3939017093 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3024089cb0 con 0x7f302c14e210 2023-11-27T20:42:36.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.741+0000 7f302a59c640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f300c06b1c0 0x7f300c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:36.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.741+0000 7f302a59c640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f300c06b1c0 0x7f300c06d680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f301c005fd0 tx=0x7f301c0019b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:36.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.744+0000 7f30237fe640 1 -- 172.21.15.91:0/3939017093 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3024054c30 con 0x7f302c14e210 2023-11-27T20:42:36.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:36.922+0000 7f3030fa4640 1 -- 172.21.15.91:0/3939017093 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f302c1ecf70 con 0x7f302c14e210 2023-11-27T20:42:37.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.491+0000 7f30237fe640 1 -- 172.21.15.91:0/3939017093 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3024058250 con 0x7f302c14e210 2023-11-27T20:42:37.492 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' created 2023-11-27T20:42:37.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.496+0000 7f3030fa4640 1 -- 172.21.15.91:0/3939017093 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f300c06b1c0 msgr2=0x7f300c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:37.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.496+0000 7f3030fa4640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f300c06b1c0 0x7f300c06d680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f301c005fd0 tx=0x7f301c0019b0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.496+0000 7f3030fa4640 1 -- 172.21.15.91:0/3939017093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f302c14e210 msgr2=0x7f302c1ed330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:37.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.496+0000 7f3030fa4640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f302c14e210 0x7f302c1ed330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f302c067240 tx=0x7f302400ec00 comp rx=0 tx=0).stop 2023-11-27T20:42:37.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.496+0000 7f3030fa4640 1 -- 172.21.15.91:0/3939017093 shutdown_connections 2023-11-27T20:42:37.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.496+0000 7f3030fa4640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f302c14e210 0x7f302c1ed330 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.496+0000 7f3030fa4640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f302c099a60 0x7f302c14dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.497+0000 7f3030fa4640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f300c06b1c0 0x7f300c06d680 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.497+0000 7f3030fa4640 1 --2- 172.21.15.91:0/3939017093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30180047c0 0x7f302c0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.497+0000 7f3030fa4640 1 -- 172.21.15.91:0/3939017093 >> 172.21.15.91:0/3939017093 conn(0x7f302c06a500 msgr2=0x7f302c153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:37.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.497+0000 7f3030fa4640 1 -- 172.21.15.91:0/3939017093 shutdown_connections 2023-11-27T20:42:37.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.498+0000 7f3030fa4640 1 -- 172.21.15.91:0/3939017093 wait complete. 2023-11-27T20:42:37.528 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T20:42:37.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.715+0000 7fd12298a640 1 Processor -- start 2023-11-27T20:42:37.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.716+0000 7fd12298a640 1 -- start start 2023-11-27T20:42:37.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.717+0000 7fd12298a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c0a70a0 0x7fd11c0a7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:37.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.717+0000 7fd12298a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11c14ffd0 con 0x7fd11c153240 2023-11-27T20:42:37.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.717+0000 7fd12298a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11c06df60 con 0x7fd11c06f7d0 2023-11-27T20:42:37.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.717+0000 7fd12298a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c06e240 con 0x7fd11c0a70a0 2023-11-27T20:42:37.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.717+0000 7fd120f27640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd11c153240 0x7fd11c15ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:35734/0 (socket says 172.21.15.91:35734) 2023-11-27T20:42:37.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.717+0000 7fd120f27640 1 -- 172.21.15.91:0/3300618513 learned_addr learned my addr 172.21.15.91:0/3300618513 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11b7fe640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c0a70a0 0x7fd11c0a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638119777 0 0) 0x7fd11c14ffd0 con 0x7fd11c153240 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd108003520 con 0x7fd11c153240 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1170335513 0 0) 0x7fd108003520 con 0x7fd11c153240 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c0a70a0 msgr2=0x7fd11c0a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c0a70a0 0x7fd11c0a7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 >> v1:172.21.15.183:6789/0 conn(0x7fd11c06f7d0 legacy=0x7fd11c0c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c152760 con 0x7fd11c153240 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fd114001670 con 0x7fd11c153240 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 >> v1:172.21.15.91:6789/0 conn(0x7fd11c153240 legacy=0x7fd11c15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1080039a0 0x7fd108003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:37.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c0a70a0 0x7fd1080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.718+0000 7fd11affd640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd108004d00 0x7fd108005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c06e240 con 0x7fd108004d00 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10800bab0 con 0x7fd1080039a0 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10800bc70 con 0x7fd11c0a70a0 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd120f27640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd108004d00 0x7fd108005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd11b7fe640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c0a70a0 0x7fd1080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd11bfff640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1080039a0 0x7fd108003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd120f27640 1 -- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c0a70a0 msgr2=0x7fd1080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd120f27640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c0a70a0 0x7fd1080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd120f27640 1 -- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1080039a0 msgr2=0x7fd108003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd120f27640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1080039a0 0x7fd108003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd120f27640 1 -- 172.21.15.91:0/3300618513 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd108003520 con 0x7fd108004d00 2023-11-27T20:42:37.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.719+0000 7fd11bfff640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1080039a0 0x7fd108003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:37.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.720+0000 7fd120f27640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd108004d00 0x7fd108005180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd11400c240 tx=0x7fd1080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46626d18b6486160 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.721+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114005ad0 con 0x7fd108004d00 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.721+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114005c30 con 0x7fd108004d00 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.721+0000 7fd11affd640 1 -- 172.21.15.91:0/3300618513 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11402c8b0 con 0x7fd108004d00 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.721+0000 7fd12298a640 1 -- 172.21.15.91:0/3300618513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd108004d00 msgr2=0x7fd108005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.721+0000 7fd12298a640 1 --2- 172.21.15.91:0/3300618513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd108004d00 0x7fd108005180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd11400c240 tx=0x7fd1080057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.721+0000 7fd120f27640 1 -- 172.21.15.91:0/3300618513 reap_dead start 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.721+0000 7fd12298a640 1 -- 172.21.15.91:0/3300618513 shutdown_connections 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.721+0000 7fd12298a640 1 -- 172.21.15.91:0/3300618513 >> 172.21.15.91:0/3300618513 conn(0x7fd11c0c7e30 msgr2=0x7fd11c0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.721+0000 7fd12298a640 1 -- 172.21.15.91:0/3300618513 shutdown_connections 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.721+0000 7fd12298a640 1 -- 172.21.15.91:0/3300618513 wait complete. 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.723+0000 7fd12298a640 1 Processor -- start 2023-11-27T20:42:37.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.723+0000 7fd12298a640 1 -- start start 2023-11-27T20:42:37.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.724+0000 7fd12298a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd108004d00 0x7fd11c0aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:37.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.724+0000 7fd12298a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd11c06d030 0x7fd11c155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:37.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.724+0000 7fd12298a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c1ed7d0 0x7fd11c14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:37.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.724+0000 7fd12298a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c0a90b0 con 0x7fd11c06d030 2023-11-27T20:42:37.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.724+0000 7fd12298a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c0a9ec0 con 0x7fd11c1ed7d0 2023-11-27T20:42:37.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.724+0000 7fd12298a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c06bc70 con 0x7fd108004d00 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.724+0000 7fd11b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd11c06d030 0x7fd11c155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.724+0000 7fd11b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd11c06d030 0x7fd11c155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33650/0 (socket says 172.21.15.91:33650) 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.724+0000 7fd11b7fe640 1 -- 172.21.15.91:0/1436707828 learned_addr learned my addr 172.21.15.91:0/1436707828 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd11bfff640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd108004d00 0x7fd11c0aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd120f27640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c1ed7d0 0x7fd11c14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd11b7fe640 1 -- 172.21.15.91:0/1436707828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd108004d00 msgr2=0x7fd11c0aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd11b7fe640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd108004d00 0x7fd11c0aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd11b7fe640 1 -- 172.21.15.91:0/1436707828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c1ed7d0 msgr2=0x7fd11c14b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd11b7fe640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c1ed7d0 0x7fd11c14b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd11b7fe640 1 -- 172.21.15.91:0/1436707828 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c06bf50 con 0x7fd11c06d030 2023-11-27T20:42:37.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd120f27640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c1ed7d0 0x7fd11c14b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:37.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd11bfff640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd108004d00 0x7fd11c0aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:37.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd11b7fe640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd11c06d030 0x7fd11c155d30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd104011590 tx=0x7fd104011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:37.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd118ff9640 1 -- 172.21.15.91:0/1436707828 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104004220 con 0x7fd11c06d030 2023-11-27T20:42:37.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd118ff9640 1 -- 172.21.15.91:0/1436707828 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104004380 con 0x7fd11c06d030 2023-11-27T20:42:37.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd118ff9640 1 -- 172.21.15.91:0/1436707828 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104015870 con 0x7fd11c06d030 2023-11-27T20:42:37.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.725+0000 7fd12298a640 1 -- 172.21.15.91:0/1436707828 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11c06c230 con 0x7fd11c06d030 2023-11-27T20:42:37.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.726+0000 7fd12298a640 1 -- 172.21.15.91:0/1436707828 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11c156270 con 0x7fd11c06d030 2023-11-27T20:42:37.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.727+0000 7fd12298a640 1 -- 172.21.15.91:0/1436707828 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11c06c470 con 0x7fd11c06d030 2023-11-27T20:42:37.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.728+0000 7fd118ff9640 1 -- 172.21.15.91:0/1436707828 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd1040159d0 con 0x7fd11c06d030 2023-11-27T20:42:37.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.729+0000 7fd118ff9640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0fc06b1f0 0x7fd0fc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:37.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.729+0000 7fd118ff9640 1 -- 172.21.15.91:0/1436707828 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd104089b40 con 0x7fd11c06d030 2023-11-27T20:42:37.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.729+0000 7fd11bfff640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0fc06b1f0 0x7fd0fc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:37.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.730+0000 7fd11bfff640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0fc06b1f0 0x7fd0fc06d6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd10c007fd0 tx=0x7fd10c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:37.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.734+0000 7fd118ff9640 1 -- 172.21.15.91:0/1436707828 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd1040548c0 con 0x7fd11c06d030 2023-11-27T20:42:37.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:37.961+0000 7fd12298a640 1 -- 172.21.15.91:0/1436707828 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd11c0add70 con 0x7fd11c06d030 2023-11-27T20:42:38.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.511+0000 7fd118ff9640 1 -- 172.21.15.91:0/1436707828 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd104057ee0 con 0x7fd11c06d030 2023-11-27T20:42:38.512 INFO:teuthology.orchestra.run.smithi091.stderr:new fs with metadata pool 4 and data pool 5 2023-11-27T20:42:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.515+0000 7fd12298a640 1 -- 172.21.15.91:0/1436707828 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0fc06b1f0 msgr2=0x7fd0fc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.515+0000 7fd12298a640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0fc06b1f0 0x7fd0fc06d6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd10c007fd0 tx=0x7fd10c009040 comp rx=0 tx=0).stop 2023-11-27T20:42:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.515+0000 7fd12298a640 1 -- 172.21.15.91:0/1436707828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd11c06d030 msgr2=0x7fd11c155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.515+0000 7fd12298a640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd11c06d030 0x7fd11c155d30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd104011590 tx=0x7fd104011a50 comp rx=0 tx=0).stop 2023-11-27T20:42:38.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.516+0000 7fd12298a640 1 -- 172.21.15.91:0/1436707828 shutdown_connections 2023-11-27T20:42:38.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.516+0000 7fd12298a640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0fc06b1f0 0x7fd0fc06d6b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.516+0000 7fd12298a640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c1ed7d0 0x7fd11c14b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.516+0000 7fd12298a640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd11c06d030 0x7fd11c155d30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.516+0000 7fd12298a640 1 --2- 172.21.15.91:0/1436707828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd108004d00 0x7fd11c0aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.516+0000 7fd12298a640 1 -- 172.21.15.91:0/1436707828 >> 172.21.15.91:0/1436707828 conn(0x7fd11c0c7e30 msgr2=0x7fd11c06fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:38.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.517+0000 7fd12298a640 1 -- 172.21.15.91:0/1436707828 shutdown_connections 2023-11-27T20:42:38.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.517+0000 7fd12298a640 1 -- 172.21.15.91:0/1436707828 wait complete. 2023-11-27T20:42:38.565 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:38.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.745+0000 7f721755c640 1 Processor -- start 2023-11-27T20:42:38.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.745+0000 7f721755c640 1 -- start start 2023-11-27T20:42:38.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.746+0000 7f721755c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 0x7f721006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:38.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.746+0000 7f721755c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f721006cd20 0x7f721015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:38.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.746+0000 7f721755c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72100a8380 con 0x7f721014e7f0 2023-11-27T20:42:38.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.746+0000 7f721755c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72101510b0 con 0x7f721006cd20 2023-11-27T20:42:38.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.746+0000 7f721755c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721006bf60 con 0x7f72100c52e0 2023-11-27T20:42:38.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.747+0000 7f7216d5b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f721006cd20 0x7f721015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:38.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.747+0000 7f7215d59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 0x7f721006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:38.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.747+0000 7f7216d5b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f721006cd20 0x7f721015ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:52720/0 (socket says 172.21.15.91:52720) 2023-11-27T20:42:38.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.747+0000 7f7216d5b640 1 -- 172.21.15.91:0/154279601 learned_addr learned my addr 172.21.15.91:0/154279601 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:38.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.748+0000 7f7215d59640 1 -- 172.21.15.91:0/154279601 >> v2:172.21.15.183:3300/0 conn(0x7f721006cd20 msgr2=0x7f721015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:38.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.748+0000 7f7215d59640 1 --2- 172.21.15.91:0/154279601 >> v2:172.21.15.183:3300/0 conn(0x7f721006cd20 0x7f721015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.748+0000 7f7215d59640 1 -- 172.21.15.91:0/154279601 >> v1:172.21.15.183:6789/0 conn(0x7f721014e7f0 legacy=0x7f72100c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:38.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.748+0000 7f7215d59640 1 -- 172.21.15.91:0/154279601 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721006c240 con 0x7f72100c52e0 2023-11-27T20:42:38.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.748+0000 7f7216d5b640 1 --2- 172.21.15.91:0/154279601 >> v2:172.21.15.183:3300/0 conn(0x7f721006cd20 0x7f721015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:42:38.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.749+0000 7f7215d59640 1 --2- 172.21.15.91:0/154279601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 0x7f721006d1e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f72000097a0 tx=0x7f720002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac9d20d64d3ed1f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:38.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.750+0000 7f7215558640 1 -- 172.21.15.91:0/154279601 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200031780 con 0x7f72100c52e0 2023-11-27T20:42:38.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.750+0000 7f7215558640 1 -- 172.21.15.91:0/154279601 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72000318e0 con 0x7f72100c52e0 2023-11-27T20:42:38.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.750+0000 7f7215558640 1 -- 172.21.15.91:0/154279601 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200031c70 con 0x7f72100c52e0 2023-11-27T20:42:38.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.751+0000 7f721755c640 1 -- 172.21.15.91:0/154279601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 msgr2=0x7f721006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:38.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.751+0000 7f721755c640 1 --2- 172.21.15.91:0/154279601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 0x7f721006d1e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f72000097a0 tx=0x7f720002b820 comp rx=0 tx=0).stop 2023-11-27T20:42:38.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.751+0000 7f721755c640 1 -- 172.21.15.91:0/154279601 shutdown_connections 2023-11-27T20:42:38.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.751+0000 7f721755c640 1 --2- 172.21.15.91:0/154279601 >> v2:172.21.15.183:3300/0 conn(0x7f721006cd20 0x7f721015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.751+0000 7f721755c640 1 --2- 172.21.15.91:0/154279601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 0x7f721006d1e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.751+0000 7f721755c640 1 -- 172.21.15.91:0/154279601 >> 172.21.15.91:0/154279601 conn(0x7f72100a77f0 msgr2=0x7f72100a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:38.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.751+0000 7f721755c640 1 -- 172.21.15.91:0/154279601 shutdown_connections 2023-11-27T20:42:38.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.751+0000 7f721755c640 1 -- 172.21.15.91:0/154279601 wait complete. 2023-11-27T20:42:38.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.753+0000 7f721755c640 1 Processor -- start 2023-11-27T20:42:38.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.753+0000 7f721755c640 1 -- start start 2023-11-27T20:42:38.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.754+0000 7f721755c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f721006cd20 0x7f72101edfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:38.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.754+0000 7f721755c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 0x7f72101ea0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:38.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.754+0000 7f721755c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f721014e7f0 0x7f721014d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:38.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.754+0000 7f721755c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72100bfa50 con 0x7f721006cd20 2023-11-27T20:42:38.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.754+0000 7f721755c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72101ee510 con 0x7f721014e7f0 2023-11-27T20:42:38.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.754+0000 7f721755c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72100bf490 con 0x7f72100c52e0 2023-11-27T20:42:38.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.754+0000 7f721655a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f721006cd20 0x7f72101edfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:38.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f721655a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f721006cd20 0x7f72101edfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33656/0 (socket says 172.21.15.91:33656) 2023-11-27T20:42:38.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f721655a640 1 -- 172.21.15.91:0/189180947 learned_addr learned my addr 172.21.15.91:0/189180947 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:38.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f7215d59640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 0x7f72101ea0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:38.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f7216d5b640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f721014e7f0 0x7f721014d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:38.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f721655a640 1 -- 172.21.15.91:0/189180947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 msgr2=0x7f72101ea0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:38.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f721655a640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 0x7f72101ea0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f721655a640 1 -- 172.21.15.91:0/189180947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f721014e7f0 msgr2=0x7f721014d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:38.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f721655a640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f721014e7f0 0x7f721014d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f721655a640 1 -- 172.21.15.91:0/189180947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720800bd40 con 0x7f721006cd20 2023-11-27T20:42:38.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f7216d5b640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f721014e7f0 0x7f721014d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:38.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f721655a640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f721006cd20 0x7f72101edfd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f720c00c3c0 tx=0x7f720c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:38.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.755+0000 7f7206ffd640 1 -- 172.21.15.91:0/189180947 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c0052d0 con 0x7f721006cd20 2023-11-27T20:42:38.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.756+0000 7f7206ffd640 1 -- 172.21.15.91:0/189180947 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c005450 con 0x7f721006cd20 2023-11-27T20:42:38.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.756+0000 7f7206ffd640 1 -- 172.21.15.91:0/189180947 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c007260 con 0x7f721006cd20 2023-11-27T20:42:38.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.756+0000 7f721755c640 1 -- 172.21.15.91:0/189180947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7200009400 con 0x7f721006cd20 2023-11-27T20:42:38.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.756+0000 7f721755c640 1 -- 172.21.15.91:0/189180947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72101ed7d0 con 0x7f721006cd20 2023-11-27T20:42:38.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.757+0000 7f721755c640 1 -- 172.21.15.91:0/189180947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72101ed630 con 0x7f721006cd20 2023-11-27T20:42:38.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.758+0000 7f7206ffd640 1 -- 172.21.15.91:0/189180947 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f720c0073c0 con 0x7f721006cd20 2023-11-27T20:42:38.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.759+0000 7f7206ffd640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f71f406b1c0 0x7f71f406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:38.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.759+0000 7f7206ffd640 1 -- 172.21.15.91:0/189180947 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f720c088e40 con 0x7f721006cd20 2023-11-27T20:42:38.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.759+0000 7f7215d59640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f71f406b1c0 0x7f71f406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:38.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.760+0000 7f7215d59640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f71f406b1c0 0x7f71f406d680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7200036000 tx=0x7f720003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:38.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.763+0000 7f7206ffd640 1 -- 172.21.15.91:0/189180947 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f72101ed630 con 0x7f721006cd20 2023-11-27T20:42:38.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.958+0000 7f721755c640 1 -- 172.21.15.91:0/189180947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72101ed630 con 0x7f721006cd20 2023-11-27T20:42:38.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.960+0000 7f7206ffd640 1 -- 172.21.15.91:0/189180947 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16547 (secure 0 0 0) 0x7f72101ed630 con 0x7f721006cd20 2023-11-27T20:42:38.961 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:38.961 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":33,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:42:37.961935+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:38.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.962+0000 7f721755c640 1 -- 172.21.15.91:0/189180947 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f71f406b1c0 msgr2=0x7f71f406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:38.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.962+0000 7f721755c640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f71f406b1c0 0x7f71f406d680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7200036000 tx=0x7f720003d040 comp rx=0 tx=0).stop 2023-11-27T20:42:38.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.962+0000 7f721755c640 1 -- 172.21.15.91:0/189180947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f721006cd20 msgr2=0x7f72101edfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:38.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.962+0000 7f721755c640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f721006cd20 0x7f72101edfd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f720c00c3c0 tx=0x7f720c00c880 comp rx=0 tx=0).stop 2023-11-27T20:42:38.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.963+0000 7f721755c640 1 -- 172.21.15.91:0/189180947 shutdown_connections 2023-11-27T20:42:38.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.963+0000 7f721755c640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f71f406b1c0 0x7f71f406d680 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.963+0000 7f721755c640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f721014e7f0 0x7f721014d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.963+0000 7f721755c640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72100c52e0 0x7f72101ea0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.963+0000 7f721755c640 1 --2- 172.21.15.91:0/189180947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f721006cd20 0x7f72101edfd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:38.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.963+0000 7f721755c640 1 -- 172.21.15.91:0/189180947 >> 172.21.15.91:0/189180947 conn(0x7f72100a77f0 msgr2=0x7f72100a6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:38.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.963+0000 7f721755c640 1 -- 172.21.15.91:0/189180947 shutdown_connections 2023-11-27T20:42:38.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:38.963+0000 7f721755c640 1 -- 172.21.15.91:0/189180947 wait complete. 2023-11-27T20:42:38.983 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:39.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.190+0000 7f9a2373c640 1 Processor -- start 2023-11-27T20:42:39.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.191+0000 7f9a2373c640 1 -- start start 2023-11-27T20:42:39.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.192+0000 7f9a2373c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9a1c06d0a0 0x7f9a1c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.192+0000 7f9a2373c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c0c64a0 con 0x7f9a1c0c3ea0 2023-11-27T20:42:39.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.192+0000 7f9a2373c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c0c5c00 con 0x7f9a1c14fd30 2023-11-27T20:42:39.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.192+0000 7f9a2373c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0c5ee0 con 0x7f9a1c06d0a0 2023-11-27T20:42:39.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.192+0000 7f9a21cd9640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f9a1c0c3ea0 0x7f9a1c0c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:35736/0 (socket says 172.21.15.91:35736) 2023-11-27T20:42:39.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.192+0000 7f9a21cd9640 1 -- 172.21.15.91:0/3213541990 learned_addr learned my addr 172.21.15.91:0/3213541990 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:39.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a20cd7640 1 --2- 172.21.15.91:0/3213541990 >> v2:172.21.15.183:3300/0 conn(0x7f9a1c06d0a0 0x7f9a1c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668636989 0 0) 0x7f9a1c0c64a0 con 0x7f9a1c0c3ea0 2023-11-27T20:42:39.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a08003520 con 0x7f9a1c0c3ea0 2023-11-27T20:42:39.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1369654668 0 0) 0x7f9a08003520 con 0x7f9a1c0c3ea0 2023-11-27T20:42:39.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 >> v2:172.21.15.183:3300/0 conn(0x7f9a1c06d0a0 msgr2=0x7f9a1c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:39.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 --2- 172.21.15.91:0/3213541990 >> v2:172.21.15.183:3300/0 conn(0x7f9a1c06d0a0 0x7f9a1c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 >> v1:172.21.15.183:6789/0 conn(0x7f9a1c14fd30 legacy=0x7f9a1c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0c61c0 con 0x7f9a1c0c3ea0 2023-11-27T20:42:39.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f9a140019f0 con 0x7f9a1c0c3ea0 2023-11-27T20:42:39.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 >> v1:172.21.15.91:6789/0 conn(0x7f9a1c0c3ea0 legacy=0x7f9a1c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 --2- 172.21.15.91:0/3213541990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 --2- 172.21.15.91:0/3213541990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a080047c0 0x7f9a08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 --2- 172.21.15.91:0/3213541990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a08005180 0x7f9a0800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.193+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c0c5ee0 con 0x7f9a08003970 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.194+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0800c020 con 0x7f9a080047c0 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.194+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0800c1e0 con 0x7f9a08005180 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.194+0000 7f9a214d8640 1 --2- 172.21.15.91:0/3213541990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.194+0000 7f9a214d8640 1 -- 172.21.15.91:0/3213541990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a08005180 msgr2=0x7f9a0800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.194+0000 7f9a214d8640 1 --2- 172.21.15.91:0/3213541990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a08005180 0x7f9a0800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.194+0000 7f9a214d8640 1 -- 172.21.15.91:0/3213541990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a080047c0 msgr2=0x7f9a08004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.194+0000 7f9a214d8640 1 --2- 172.21.15.91:0/3213541990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a080047c0 0x7f9a08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.194+0000 7f9a214d8640 1 -- 172.21.15.91:0/3213541990 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08003520 con 0x7f9a08003970 2023-11-27T20:42:39.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.194+0000 7f9a21cd9640 1 -- 172.21.15.91:0/3213541990 reap_dead start 2023-11-27T20:42:39.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.195+0000 7f9a214d8640 1 --2- 172.21.15.91:0/3213541990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a08003d90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9a18001750 tx=0x7f9a080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3a1c7f5b644898 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:39.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.196+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180052d0 con 0x7f9a08003970 2023-11-27T20:42:39.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.196+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1802e050 con 0x7f9a08003970 2023-11-27T20:42:39.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.196+0000 7f9a13fff640 1 -- 172.21.15.91:0/3213541990 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18003830 con 0x7f9a08003970 2023-11-27T20:42:39.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.196+0000 7f9a2373c640 1 -- 172.21.15.91:0/3213541990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 msgr2=0x7f9a08003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.196+0000 7f9a2373c640 1 --2- 172.21.15.91:0/3213541990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a08003d90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9a18001750 tx=0x7f9a080057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.196+0000 7f9a2373c640 1 -- 172.21.15.91:0/3213541990 shutdown_connections 2023-11-27T20:42:39.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.196+0000 7f9a2373c640 1 --2- 172.21.15.91:0/3213541990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a08003d90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.196+0000 7f9a2373c640 1 -- 172.21.15.91:0/3213541990 >> 172.21.15.91:0/3213541990 conn(0x7f9a1c06a500 msgr2=0x7f9a1c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:39.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.196+0000 7f9a2373c640 1 -- 172.21.15.91:0/3213541990 shutdown_connections 2023-11-27T20:42:39.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.196+0000 7f9a2373c640 1 -- 172.21.15.91:0/3213541990 wait complete. 2023-11-27T20:42:39.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.198+0000 7f9a2373c640 1 Processor -- start 2023-11-27T20:42:39.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.198+0000 7f9a2373c640 1 -- start start 2023-11-27T20:42:39.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.199+0000 7f9a2373c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a1c1ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.199+0000 7f9a2373c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a1c1dbad0 0x7f9a1c0a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.199+0000 7f9a2373c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a1c14f070 0x7f9a1c0a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.199+0000 7f9a2373c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c1dc1b0 con 0x7f9a08003970 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.199+0000 7f9a2373c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c0aa300 con 0x7f9a1c14f070 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.199+0000 7f9a2373c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c150770 con 0x7f9a1c1dbad0 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.199+0000 7f9a214d8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a1c1ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.199+0000 7f9a214d8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a1c1ed890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33674/0 (socket says 172.21.15.91:33674) 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.199+0000 7f9a214d8640 1 -- 172.21.15.91:0/1543604719 learned_addr learned my addr 172.21.15.91:0/1543604719 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a20cd7640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a1c1dbad0 0x7f9a1c0a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a214d8640 1 -- 172.21.15.91:0/1543604719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a1c1dbad0 msgr2=0x7f9a1c0a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a214d8640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a1c1dbad0 0x7f9a1c0a9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a214d8640 1 -- 172.21.15.91:0/1543604719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a1c14f070 msgr2=0x7f9a1c0a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a214d8640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a1c14f070 0x7f9a1c0a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a214d8640 1 -- 172.21.15.91:0/1543604719 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c14ee90 con 0x7f9a08003970 2023-11-27T20:42:39.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a214d8640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a1c1ed890 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9a1802bc30 tx=0x7f9a18001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:39.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a11ffb640 1 -- 172.21.15.91:0/1543604719 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180076c0 con 0x7f9a08003970 2023-11-27T20:42:39.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a11ffb640 1 -- 172.21.15.91:0/1543604719 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a18007a30 con 0x7f9a08003970 2023-11-27T20:42:39.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a11ffb640 1 -- 172.21.15.91:0/1543604719 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18006be0 con 0x7f9a08003970 2023-11-27T20:42:39.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.200+0000 7f9a2373c640 1 -- 172.21.15.91:0/1543604719 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c150490 con 0x7f9a08003970 2023-11-27T20:42:39.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.201+0000 7f9a2373c640 1 -- 172.21.15.91:0/1543604719 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c14eb20 con 0x7f9a08003970 2023-11-27T20:42:39.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.202+0000 7f9a2373c640 1 -- 172.21.15.91:0/1543604719 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c0aaac0 con 0x7f9a08003970 2023-11-27T20:42:39.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.203+0000 7f9a11ffb640 1 -- 172.21.15.91:0/1543604719 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9a18006d40 con 0x7f9a08003970 2023-11-27T20:42:39.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.204+0000 7f9a11ffb640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a0006b1c0 0x7f9a0006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.204+0000 7f9a11ffb640 1 -- 172.21.15.91:0/1543604719 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a180ab500 con 0x7f9a08003970 2023-11-27T20:42:39.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.204+0000 7f9a20cd7640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a0006b1c0 0x7f9a0006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.205+0000 7f9a20cd7640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a0006b1c0 0x7f9a0006d680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0c0450 tx=0x7f9a0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:39.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.208+0000 7f9a11ffb640 1 -- 172.21.15.91:0/1543604719 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9a1c0aaac0 con 0x7f9a08003970 2023-11-27T20:42:39.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.397+0000 7f9a2373c640 1 -- 172.21.15.91:0/1543604719 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a1c0aaac0 con 0x7f9a08003970 2023-11-27T20:42:39.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.399+0000 7f9a11ffb640 1 -- 172.21.15.91:0/1543604719 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16547 (secure 0 0 0) 0x7f9a1c0aaac0 con 0x7f9a08003970 2023-11-27T20:42:39.400 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:39.400 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":33,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:42:37.961935+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:39.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.402+0000 7f9a2373c640 1 -- 172.21.15.91:0/1543604719 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a0006b1c0 msgr2=0x7f9a0006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.402+0000 7f9a2373c640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a0006b1c0 0x7f9a0006d680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0c0450 tx=0x7f9a0c008040 comp rx=0 tx=0).stop 2023-11-27T20:42:39.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.402+0000 7f9a2373c640 1 -- 172.21.15.91:0/1543604719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 msgr2=0x7f9a1c1ed890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.402+0000 7f9a2373c640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a1c1ed890 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9a1802bc30 tx=0x7f9a18001120 comp rx=0 tx=0).stop 2023-11-27T20:42:39.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.402+0000 7f9a2373c640 1 -- 172.21.15.91:0/1543604719 shutdown_connections 2023-11-27T20:42:39.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.402+0000 7f9a2373c640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a0006b1c0 0x7f9a0006d680 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.402+0000 7f9a2373c640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a1c14f070 0x7f9a1c0a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.402+0000 7f9a2373c640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a1c1dbad0 0x7f9a1c0a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.402+0000 7f9a2373c640 1 --2- 172.21.15.91:0/1543604719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a08003970 0x7f9a1c1ed890 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.402+0000 7f9a2373c640 1 -- 172.21.15.91:0/1543604719 >> 172.21.15.91:0/1543604719 conn(0x7f9a1c06a500 msgr2=0x7f9a1c071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:39.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.403+0000 7f9a2373c640 1 -- 172.21.15.91:0/1543604719 shutdown_connections 2023-11-27T20:42:39.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.403+0000 7f9a2373c640 1 -- 172.21.15.91:0/1543604719 wait complete. 2023-11-27T20:42:39.421 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T20:42:39.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.642+0000 7fc863fb6640 1 Processor -- start 2023-11-27T20:42:39.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.642+0000 7fc863fb6640 1 -- start start 2023-11-27T20:42:39.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.643+0000 7fc863fb6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c5ec0 0x7fc85c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.643+0000 7fc863fb6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc85c0c45d0 0x7fc85c0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.643+0000 7fc863fb6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c0bfdc0 con 0x7fc85c0721a0 2023-11-27T20:42:39.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.643+0000 7fc863fb6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c06e390 con 0x7fc85c0c45d0 2023-11-27T20:42:39.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.643+0000 7fc863fb6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c06ddd0 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.644+0000 7fc861551640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc85c0c45d0 0x7fc85c0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.644+0000 7fc861551640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc85c0c45d0 0x7fc85c0c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33690/0 (socket says 172.21.15.91:33690) 2023-11-27T20:42:39.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.644+0000 7fc861551640 1 -- 172.21.15.91:0/1918801164 learned_addr learned my addr 172.21.15.91:0/1918801164 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:39.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.644+0000 7fc861d52640 1 --2- 172.21.15.91:0/1918801164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c5ec0 0x7fc85c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.644+0000 7fc861551640 1 -- 172.21.15.91:0/1918801164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c5ec0 msgr2=0x7fc85c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:39.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.644+0000 7fc861551640 1 --2- 172.21.15.91:0/1918801164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c5ec0 0x7fc85c0c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.644+0000 7fc861551640 1 -- 172.21.15.91:0/1918801164 >> v1:172.21.15.91:6789/0 conn(0x7fc85c0721a0 legacy=0x7fc85c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.644+0000 7fc861551640 1 -- 172.21.15.91:0/1918801164 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c06e0b0 con 0x7fc85c0c45d0 2023-11-27T20:42:39.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.644+0000 7fc861d52640 1 --2- 172.21.15.91:0/1918801164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c5ec0 0x7fc85c0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:39.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.645+0000 7fc861551640 1 --2- 172.21.15.91:0/1918801164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c45d0 0x7fc85c0c3170 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc850009870 tx=0x7fc85002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49b55f1f1e51886 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:39.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.646+0000 7fc860d50640 1 -- 172.21.15.91:0/1918801164 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500317c0 con 0x7fc85c0c45d0 2023-11-27T20:42:39.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.646+0000 7fc860d50640 1 -- 172.21.15.91:0/1918801164 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc850031920 con 0x7fc85c0c45d0 2023-11-27T20:42:39.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.646+0000 7fc860d50640 1 -- 172.21.15.91:0/1918801164 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850031cb0 con 0x7fc85c0c45d0 2023-11-27T20:42:39.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.646+0000 7fc863fb6640 1 -- 172.21.15.91:0/1918801164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c45d0 msgr2=0x7fc85c0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.646+0000 7fc863fb6640 1 --2- 172.21.15.91:0/1918801164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c45d0 0x7fc85c0c3170 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc850009870 tx=0x7fc85002b860 comp rx=0 tx=0).stop 2023-11-27T20:42:39.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.646+0000 7fc863fb6640 1 -- 172.21.15.91:0/1918801164 shutdown_connections 2023-11-27T20:42:39.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.646+0000 7fc863fb6640 1 --2- 172.21.15.91:0/1918801164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c45d0 0x7fc85c0c3170 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.646+0000 7fc863fb6640 1 --2- 172.21.15.91:0/1918801164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c5ec0 0x7fc85c0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.646+0000 7fc863fb6640 1 -- 172.21.15.91:0/1918801164 >> 172.21.15.91:0/1918801164 conn(0x7fc85c06a500 msgr2=0x7fc85c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:39.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.646+0000 7fc863fb6640 1 -- 172.21.15.91:0/1918801164 shutdown_connections 2023-11-27T20:42:39.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.647+0000 7fc863fb6640 1 -- 172.21.15.91:0/1918801164 wait complete. 2023-11-27T20:42:39.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.648+0000 7fc863fb6640 1 Processor -- start 2023-11-27T20:42:39.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.648+0000 7fc863fb6640 1 -- start start 2023-11-27T20:42:39.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.649+0000 7fc863fb6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc85c0721a0 0x7fc85c0aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.649+0000 7fc863fb6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c45d0 0x7fc85c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.649+0000 7fc863fb6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c5ec0 0x7fc85c0a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.649+0000 7fc863fb6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0a7930 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.649+0000 7fc863fb6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1556a0 con 0x7fc85c0721a0 2023-11-27T20:42:39.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.649+0000 7fc863fb6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0a7370 con 0x7fc85c0c45d0 2023-11-27T20:42:39.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.649+0000 7fc862553640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c5ec0 0x7fc85c0a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.649+0000 7fc862553640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c5ec0 0x7fc85c0a3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33698/0 (socket says 172.21.15.91:33698) 2023-11-27T20:42:39.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.649+0000 7fc862553640 1 -- 172.21.15.91:0/2617337734 learned_addr learned my addr 172.21.15.91:0/2617337734 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:39.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc861551640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c45d0 0x7fc85c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc861d52640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc85c0721a0 0x7fc85c0aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc862553640 1 -- 172.21.15.91:0/2617337734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c45d0 msgr2=0x7fc85c0a3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc862553640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c45d0 0x7fc85c0a3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc862553640 1 -- 172.21.15.91:0/2617337734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc85c0721a0 msgr2=0x7fc85c0aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:39.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc862553640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc85c0721a0 0x7fc85c0aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:39.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc862553640 1 -- 172.21.15.91:0/2617337734 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500094d0 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc861d52640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc85c0721a0 0x7fc85c0aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:39.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc862553640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c5ec0 0x7fc85c0a3bc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c7a0 tx=0x7fc85400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:39.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc84e7fc640 1 -- 172.21.15.91:0/2617337734 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854003b70 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc84e7fc640 1 -- 172.21.15.91:0/2617337734 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc854003cf0 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc863fb6640 1 -- 172.21.15.91:0/2617337734 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c0a7650 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.650+0000 7fc84e7fc640 1 -- 172.21.15.91:0/2617337734 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854003ea0 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.651+0000 7fc863fb6640 1 -- 172.21.15.91:0/2617337734 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c155980 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.652+0000 7fc863fb6640 1 -- 172.21.15.91:0/2617337734 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c1560e0 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.653+0000 7fc84e7fc640 1 -- 172.21.15.91:0/2617337734 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc85400aa90 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.654+0000 7fc84e7fc640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc84006b1c0 0x7fc84006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:39.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.654+0000 7fc84e7fc640 1 -- 172.21.15.91:0/2617337734 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8540897f0 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.654+0000 7fc861d52640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc84006b1c0 0x7fc84006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:39.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.655+0000 7fc861d52640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc84006b1c0 0x7fc84006d680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc858006fd0 tx=0x7fc858008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:39.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.658+0000 7fc84e7fc640 1 -- 172.21.15.91:0/2617337734 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc85c1560e0 con 0x7fc85c0c5ec0 2023-11-27T20:42:39.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:39.890+0000 7fc863fb6640 1 -- 172.21.15.91:0/2617337734 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc85c1560e0 con 0x7fc85c0c5ec0 2023-11-27T20:42:40.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.554+0000 7fc84e7fc640 1 -- 172.21.15.91:0/2617337734 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc85c1560e0 con 0x7fc85c0c5ec0 2023-11-27T20:42:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 -- 172.21.15.91:0/2617337734 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc84006b1c0 msgr2=0x7fc84006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc84006b1c0 0x7fc84006d680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc858006fd0 tx=0x7fc858008040 comp rx=0 tx=0).stop 2023-11-27T20:42:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 -- 172.21.15.91:0/2617337734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c5ec0 msgr2=0x7fc85c0a3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c5ec0 0x7fc85c0a3bc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c7a0 tx=0x7fc85400cc60 comp rx=0 tx=0).stop 2023-11-27T20:42:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 -- 172.21.15.91:0/2617337734 shutdown_connections 2023-11-27T20:42:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0c5ec0 0x7fc85c0a3bc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc85c0c45d0 0x7fc85c0a3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc84006b1c0 0x7fc84006d680 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 --2- 172.21.15.91:0/2617337734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc85c0721a0 0x7fc85c0aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 -- 172.21.15.91:0/2617337734 >> 172.21.15.91:0/2617337734 conn(0x7fc85c06a500 msgr2=0x7fc85c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 -- 172.21.15.91:0/2617337734 shutdown_connections 2023-11-27T20:42:40.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.558+0000 7fc863fb6640 1 -- 172.21.15.91:0/2617337734 wait complete. 2023-11-27T20:42:40.578 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T20:42:40.578 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T20:42:40.598 INFO:tasks.ceph.mds.d.smithi183.stderr:2023-11-27T20:42:40.597+0000 7f651c1e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:42:40.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.789+0000 7f7c8fc02640 1 Processor -- start 2023-11-27T20:42:40.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.789+0000 7f7c8fc02640 1 -- start start 2023-11-27T20:42:40.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.791+0000 7f7c8fc02640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7c880c5ec0 0x7f7c880c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:40.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.791+0000 7f7c8fc02640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7c880721a0 0x7f7c880c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:40.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.791+0000 7f7c8fc02640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c880bfdc0 con 0x7f7c880c45d0 2023-11-27T20:42:40.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.791+0000 7f7c8fc02640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8806e390 con 0x7f7c880c5ec0 2023-11-27T20:42:40.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.791+0000 7f7c8fc02640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8806ddd0 con 0x7f7c880721a0 2023-11-27T20:42:40.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.791+0000 7f7c8d99e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7c880c5ec0 0x7f7c880c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:40.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.791+0000 7f7c8d99e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7c880c5ec0 0x7f7c880c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33712/0 (socket says 172.21.15.91:33712) 2023-11-27T20:42:40.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.791+0000 7f7c8d99e640 1 -- 172.21.15.91:0/1483255199 learned_addr learned my addr 172.21.15.91:0/1483255199 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:40.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.792+0000 7f7c8e19f640 1 --2- 172.21.15.91:0/1483255199 >> v2:172.21.15.183:3300/0 conn(0x7f7c880721a0 0x7f7c880c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:40.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.792+0000 7f7c8d99e640 1 -- 172.21.15.91:0/1483255199 >> v2:172.21.15.183:3300/0 conn(0x7f7c880721a0 msgr2=0x7f7c880c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:40.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.792+0000 7f7c8d99e640 1 --2- 172.21.15.91:0/1483255199 >> v2:172.21.15.183:3300/0 conn(0x7f7c880721a0 0x7f7c880c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:40.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.792+0000 7f7c8d99e640 1 -- 172.21.15.91:0/1483255199 >> v1:172.21.15.91:6789/0 conn(0x7f7c880c45d0 legacy=0x7f7c88155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:40.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.792+0000 7f7c8d99e640 1 -- 172.21.15.91:0/1483255199 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8806e0b0 con 0x7f7c880c5ec0 2023-11-27T20:42:40.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.792+0000 7f7c8e19f640 1 --2- 172.21.15.91:0/1483255199 >> v2:172.21.15.183:3300/0 conn(0x7f7c880721a0 0x7f7c880c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:40.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.793+0000 7f7c8d99e640 1 --2- 172.21.15.91:0/1483255199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 0x7f7c880c2c30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009870 tx=0x7f7c8402b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c6849d81409eab server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:40.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.793+0000 7f7c8c99c640 1 -- 172.21.15.91:0/1483255199 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840317f0 con 0x7f7c880c5ec0 2023-11-27T20:42:40.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.793+0000 7f7c8c99c640 1 -- 172.21.15.91:0/1483255199 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c84031950 con 0x7f7c880c5ec0 2023-11-27T20:42:40.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.793+0000 7f7c8c99c640 1 -- 172.21.15.91:0/1483255199 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84031ce0 con 0x7f7c880c5ec0 2023-11-27T20:42:40.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.794+0000 7f7c8fc02640 1 -- 172.21.15.91:0/1483255199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 msgr2=0x7f7c880c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:40.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.794+0000 7f7c8fc02640 1 --2- 172.21.15.91:0/1483255199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 0x7f7c880c2c30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009870 tx=0x7f7c8402b890 comp rx=0 tx=0).stop 2023-11-27T20:42:40.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.794+0000 7f7c8fc02640 1 -- 172.21.15.91:0/1483255199 shutdown_connections 2023-11-27T20:42:40.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.794+0000 7f7c8fc02640 1 --2- 172.21.15.91:0/1483255199 >> v2:172.21.15.183:3300/0 conn(0x7f7c880721a0 0x7f7c880c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:40.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.794+0000 7f7c8fc02640 1 --2- 172.21.15.91:0/1483255199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 0x7f7c880c2c30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:40.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.794+0000 7f7c8fc02640 1 -- 172.21.15.91:0/1483255199 >> 172.21.15.91:0/1483255199 conn(0x7f7c8806a500 msgr2=0x7f7c8806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:40.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.794+0000 7f7c8fc02640 1 -- 172.21.15.91:0/1483255199 shutdown_connections 2023-11-27T20:42:40.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.794+0000 7f7c8fc02640 1 -- 172.21.15.91:0/1483255199 wait complete. 2023-11-27T20:42:40.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.796+0000 7f7c8fc02640 1 Processor -- start 2023-11-27T20:42:40.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.796+0000 7f7c8fc02640 1 -- start start 2023-11-27T20:42:40.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8fc02640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c880721a0 0x7f7c881ee120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:40.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8fc02640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c880c45d0 0x7f7c88150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:40.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8fc02640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 0x7f7c881ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:40.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8fc02640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8814d4f0 con 0x7f7c880c5ec0 2023-11-27T20:42:40.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8fc02640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c881ee660 con 0x7f7c880721a0 2023-11-27T20:42:40.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8fc02640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8814c290 con 0x7f7c880c45d0 2023-11-27T20:42:40.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8e19f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 0x7f7c881ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:40.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8e19f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 0x7f7c881ea1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33728/0 (socket says 172.21.15.91:33728) 2023-11-27T20:42:40.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8e19f640 1 -- 172.21.15.91:0/57214295 learned_addr learned my addr 172.21.15.91:0/57214295 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:40.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8d99e640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c880721a0 0x7f7c881ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:40.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8e19f640 1 -- 172.21.15.91:0/57214295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c880c45d0 msgr2=0x7f7c88150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:40.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8e19f640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c880c45d0 0x7f7c88150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:40.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8e19f640 1 -- 172.21.15.91:0/57214295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c880721a0 msgr2=0x7f7c881ee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:40.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8e19f640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c880721a0 0x7f7c881ee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:40.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.797+0000 7f7c8e19f640 1 -- 172.21.15.91:0/57214295 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840094d0 con 0x7f7c880c5ec0 2023-11-27T20:42:40.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.798+0000 7f7c8e19f640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 0x7f7c881ea1a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000cef0 tx=0x7f7c8000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:40.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.798+0000 7f7c7e7fc640 1 -- 172.21.15.91:0/57214295 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000d840 con 0x7f7c880c5ec0 2023-11-27T20:42:40.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.798+0000 7f7c7e7fc640 1 -- 172.21.15.91:0/57214295 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8000d9c0 con 0x7f7c880c5ec0 2023-11-27T20:42:40.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.798+0000 7f7c7e7fc640 1 -- 172.21.15.91:0/57214295 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000dd70 con 0x7f7c880c5ec0 2023-11-27T20:42:40.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.798+0000 7f7c8fc02640 1 -- 172.21.15.91:0/57214295 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8814c570 con 0x7f7c880c5ec0 2023-11-27T20:42:40.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.798+0000 7f7c8fc02640 1 -- 172.21.15.91:0/57214295 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c880a6c50 con 0x7f7c880c5ec0 2023-11-27T20:42:40.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.800+0000 7f7c8fc02640 1 -- 172.21.15.91:0/57214295 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8814c700 con 0x7f7c880c5ec0 2023-11-27T20:42:40.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.800+0000 7f7c7e7fc640 1 -- 172.21.15.91:0/57214295 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7c8001e3b0 con 0x7f7c880c5ec0 2023-11-27T20:42:40.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.801+0000 7f7c7e7fc640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c6c06b1c0 0x7f7c6c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:40.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.801+0000 7f7c7e7fc640 1 -- 172.21.15.91:0/57214295 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c8008a430 con 0x7f7c880c5ec0 2023-11-27T20:42:40.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.802+0000 7f7c8d99e640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c6c06b1c0 0x7f7c6c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:40.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.802+0000 7f7c8d99e640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c6c06b1c0 0x7f7c6c06d680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7c84036000 tx=0x7f7c8403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:40.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:40.806+0000 7f7c7e7fc640 1 -- 172.21.15.91:0/57214295 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7c800552b0 con 0x7f7c880c5ec0 2023-11-27T20:42:41.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.039+0000 7f7c8fc02640 1 -- 172.21.15.91:0/57214295 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7c88068350 con 0x7f7c880c5ec0 2023-11-27T20:42:41.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.564+0000 7f7c7e7fc640 1 -- 172.21.15.91:0/57214295 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c800588d0 con 0x7f7c880c5ec0 2023-11-27T20:42:41.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 -- 172.21.15.91:0/57214295 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c6c06b1c0 msgr2=0x7f7c6c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:41.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c6c06b1c0 0x7f7c6c06d680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7c84036000 tx=0x7f7c8403d040 comp rx=0 tx=0).stop 2023-11-27T20:42:41.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 -- 172.21.15.91:0/57214295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 msgr2=0x7f7c881ea1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:41.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 0x7f7c881ea1a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000cef0 tx=0x7f7c8000a710 comp rx=0 tx=0).stop 2023-11-27T20:42:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 -- 172.21.15.91:0/57214295 shutdown_connections 2023-11-27T20:42:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c880c5ec0 0x7f7c881ea1a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c880c45d0 0x7f7c88150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7c6c06b1c0 0x7f7c6c06d680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 --2- 172.21.15.91:0/57214295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c880721a0 0x7f7c881ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 -- 172.21.15.91:0/57214295 >> 172.21.15.91:0/57214295 conn(0x7f7c8806a500 msgr2=0x7f7c880a8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 -- 172.21.15.91:0/57214295 shutdown_connections 2023-11-27T20:42:41.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.568+0000 7f7c8fc02640 1 -- 172.21.15.91:0/57214295 wait complete. 2023-11-27T20:42:41.591 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T20:42:41.592 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:42:41.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.802+0000 7fd923200640 1 Processor -- start 2023-11-27T20:42:41.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.803+0000 7fd923200640 1 -- start start 2023-11-27T20:42:41.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.804+0000 7fd923200640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd91c155490 0x7fd91c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:41.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.804+0000 7fd923200640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd91c0a9b40 0x7fd91c0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:41.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.804+0000 7fd923200640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c0c06c0 con 0x7fd91c0c1500 2023-11-27T20:42:41.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.804+0000 7fd923200640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c0a5820 con 0x7fd91c155490 2023-11-27T20:42:41.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.804+0000 7fd923200640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0c1020 con 0x7fd91c0a9b40 2023-11-27T20:42:41.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.804+0000 7fd920f9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd91c155490 0x7fd91c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:41.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.804+0000 7fd920f9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd91c155490 0x7fd91c0a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33736/0 (socket says 172.21.15.91:33736) 2023-11-27T20:42:41.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.804+0000 7fd920f9c640 1 -- 172.21.15.91:0/1455492979 learned_addr learned my addr 172.21.15.91:0/1455492979 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:41.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.805+0000 7fd92179d640 1 --2- 172.21.15.91:0/1455492979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd91c0a9b40 0x7fd91c0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:41.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.805+0000 7fd920f9c640 1 -- 172.21.15.91:0/1455492979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd91c0a9b40 msgr2=0x7fd91c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:41.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.805+0000 7fd920f9c640 1 --2- 172.21.15.91:0/1455492979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd91c0a9b40 0x7fd91c0c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:41.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.805+0000 7fd920f9c640 1 -- 172.21.15.91:0/1455492979 >> v1:172.21.15.183:6789/0 conn(0x7fd91c0c1500 legacy=0x7fd91c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:41.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.805+0000 7fd920f9c640 1 -- 172.21.15.91:0/1455492979 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0c0910 con 0x7fd91c155490 2023-11-27T20:42:41.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.806+0000 7fd920f9c640 1 --2- 172.21.15.91:0/1455492979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c155490 0x7fd91c0a51b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd918009e50 tx=0x7fd91802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c286ddcf3e8062dc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:41.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.806+0000 7fd9137fe640 1 -- 172.21.15.91:0/1455492979 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91802ca70 con 0x7fd91c155490 2023-11-27T20:42:41.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.806+0000 7fd9137fe640 1 -- 172.21.15.91:0/1455492979 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91802cbd0 con 0x7fd91c155490 2023-11-27T20:42:41.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.806+0000 7fd9137fe640 1 -- 172.21.15.91:0/1455492979 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9180343f0 con 0x7fd91c155490 2023-11-27T20:42:41.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.807+0000 7fd923200640 1 -- 172.21.15.91:0/1455492979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c155490 msgr2=0x7fd91c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:41.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.807+0000 7fd923200640 1 --2- 172.21.15.91:0/1455492979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c155490 0x7fd91c0a51b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd918009e50 tx=0x7fd91802bed0 comp rx=0 tx=0).stop 2023-11-27T20:42:41.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.807+0000 7fd923200640 1 -- 172.21.15.91:0/1455492979 shutdown_connections 2023-11-27T20:42:41.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.807+0000 7fd923200640 1 --2- 172.21.15.91:0/1455492979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd91c0a9b40 0x7fd91c0c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:41.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.807+0000 7fd923200640 1 --2- 172.21.15.91:0/1455492979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c155490 0x7fd91c0a51b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:41.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.807+0000 7fd923200640 1 -- 172.21.15.91:0/1455492979 >> 172.21.15.91:0/1455492979 conn(0x7fd91c06a500 msgr2=0x7fd91c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:41.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.807+0000 7fd923200640 1 -- 172.21.15.91:0/1455492979 shutdown_connections 2023-11-27T20:42:41.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.807+0000 7fd923200640 1 -- 172.21.15.91:0/1455492979 wait complete. 2023-11-27T20:42:41.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.809+0000 7fd923200640 1 Processor -- start 2023-11-27T20:42:41.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.809+0000 7fd923200640 1 -- start start 2023-11-27T20:42:41.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.810+0000 7fd923200640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c0c1500 0x7fd91c1e7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:41.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.810+0000 7fd923200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd91c155490 0x7fd91c150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:41.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.810+0000 7fd923200640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd91c0bace0 0x7fd91c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:41.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.810+0000 7fd923200640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1e6960 con 0x7fd91c0c1500 2023-11-27T20:42:41.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.810+0000 7fd923200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1e6e90 con 0x7fd91c155490 2023-11-27T20:42:41.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.810+0000 7fd923200640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0bb7b0 con 0x7fd91c0bace0 2023-11-27T20:42:41.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.810+0000 7fd920f9c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c0c1500 0x7fd91c1e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:41.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.810+0000 7fd920f9c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c0c1500 0x7fd91c1e7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33744/0 (socket says 172.21.15.91:33744) 2023-11-27T20:42:41.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.810+0000 7fd920f9c640 1 -- 172.21.15.91:0/3790883679 learned_addr learned my addr 172.21.15.91:0/3790883679 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:41.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd920f9c640 1 -- 172.21.15.91:0/3790883679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd91c0bace0 msgr2=0x7fd91c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:41.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd920f9c640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd91c0bace0 0x7fd91c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:41.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd920f9c640 1 -- 172.21.15.91:0/3790883679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd91c155490 msgr2=0x7fd91c150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:41.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd920f9c640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd91c155490 0x7fd91c150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:41.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd920f9c640 1 -- 172.21.15.91:0/3790883679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918009b30 con 0x7fd91c0c1500 2023-11-27T20:42:41.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd920f9c640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c0c1500 0x7fd91c1e7350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd918009e50 tx=0x7fd918004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:41.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd9117fa640 1 -- 172.21.15.91:0/3790883679 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918009510 con 0x7fd91c0c1500 2023-11-27T20:42:41.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd9117fa640 1 -- 172.21.15.91:0/3790883679 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91803e450 con 0x7fd91c0c1500 2023-11-27T20:42:41.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd9117fa640 1 -- 172.21.15.91:0/3790883679 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91803e800 con 0x7fd91c0c1500 2023-11-27T20:42:41.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd923200640 1 -- 172.21.15.91:0/3790883679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c14d2a0 con 0x7fd91c0c1500 2023-11-27T20:42:41.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.811+0000 7fd923200640 1 -- 172.21.15.91:0/3790883679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c150c90 con 0x7fd91c0c1500 2023-11-27T20:42:41.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.813+0000 7fd923200640 1 -- 172.21.15.91:0/3790883679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c068350 con 0x7fd91c0c1500 2023-11-27T20:42:41.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.814+0000 7fd9117fa640 1 -- 172.21.15.91:0/3790883679 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd91803e960 con 0x7fd91c0c1500 2023-11-27T20:42:41.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.814+0000 7fd9117fa640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd90806b1c0 0x7fd90806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:41.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.814+0000 7fd9117fa640 1 -- 172.21.15.91:0/3790883679 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9180ac780 con 0x7fd91c0c1500 2023-11-27T20:42:41.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.815+0000 7fd913fff640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd90806b1c0 0x7fd90806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:41.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.815+0000 7fd913fff640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd90806b1c0 0x7fd90806d680 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd91c150280 tx=0x7fd90c0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:41.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:41.819+0000 7fd9117fa640 1 -- 172.21.15.91:0/3790883679 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd918077520 con 0x7fd91c0c1500 2023-11-27T20:42:42.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.045+0000 7fd923200640 1 -- 172.21.15.91:0/3790883679 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd91c152090 con 0x7fd91c0c1500 2023-11-27T20:42:42.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.046+0000 7fd9117fa640 1 -- 172.21.15.91:0/3790883679 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fd91807ab40 con 0x7fd91c0c1500 2023-11-27T20:42:42.047 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:42.047 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/127433365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":127433365},{"type":"v1","addr":"172.21.15.91:6837","nonce":127433365}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:37.962718+0000","modified":"2023-11-27T20:42:41.040049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.183:6834/3450105603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3450105603},{"type":"v1","addr":"172.21.15.183:6834","nonce":3450105603}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-27T20:42:42.047 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 16 2023-11-27T20:42:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.050+0000 7fd923200640 1 -- 172.21.15.91:0/3790883679 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd90806b1c0 msgr2=0x7fd90806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.050+0000 7fd923200640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd90806b1c0 0x7fd90806d680 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd91c150280 tx=0x7fd90c0079b0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.050+0000 7fd923200640 1 -- 172.21.15.91:0/3790883679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c0c1500 msgr2=0x7fd91c1e7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.050+0000 7fd923200640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c0c1500 0x7fd91c1e7350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd918009e50 tx=0x7fd918004a40 comp rx=0 tx=0).stop 2023-11-27T20:42:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.050+0000 7fd923200640 1 -- 172.21.15.91:0/3790883679 shutdown_connections 2023-11-27T20:42:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.050+0000 7fd923200640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd91c0bace0 0x7fd91c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.050+0000 7fd923200640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd90806b1c0 0x7fd90806d680 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.050+0000 7fd923200640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd91c155490 0x7fd91c150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.050+0000 7fd923200640 1 --2- 172.21.15.91:0/3790883679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd91c0c1500 0x7fd91c1e7350 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.050+0000 7fd923200640 1 -- 172.21.15.91:0/3790883679 >> 172.21.15.91:0/3790883679 conn(0x7fd91c06a500 msgr2=0x7fd91c0c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:42.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.051+0000 7fd923200640 1 -- 172.21.15.91:0/3790883679 shutdown_connections 2023-11-27T20:42:42.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.051+0000 7fd923200640 1 -- 172.21.15.91:0/3790883679 wait complete. 2023-11-27T20:42:42.069 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:42.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.272+0000 7fb153e56640 1 Processor -- start 2023-11-27T20:42:42.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.273+0000 7fb153e56640 1 -- start start 2023-11-27T20:42:42.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.274+0000 7fb153e56640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb14c0a6bc0 0x7fb14c0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.274+0000 7fb153e56640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c0c4220 con 0x7fb14c0c7950 2023-11-27T20:42:42.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.274+0000 7fb153e56640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c0c2ba0 con 0x7fb14c0c6680 2023-11-27T20:42:42.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.274+0000 7fb153e56640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c0c2e80 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.274+0000 7fb1513f1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb14c0a6bc0 0x7fb14c0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:42.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.274+0000 7fb1513f1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb14c0a6bc0 0x7fb14c0c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33756/0 (socket says 172.21.15.91:33756) 2023-11-27T20:42:42.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.274+0000 7fb1513f1640 1 -- 172.21.15.91:0/1333677897 learned_addr learned my addr 172.21.15.91:0/1333677897 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:42.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.274+0000 7fb1523f3640 1 --1- 172.21.15.91:0/1333677897 >> v1:172.21.15.91:6789/0 conn(0x7fb14c0c7950 0x7fb14c0c1ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:35760/0 (socket says 172.21.15.91:35760) 2023-11-27T20:42:42.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.275+0000 7fb1513f1640 1 -- 172.21.15.91:0/1333677897 >> v1:172.21.15.183:6789/0 conn(0x7fb14c0c6680 legacy=0x7fb14c0c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:42.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.275+0000 7fb1513f1640 1 -- 172.21.15.91:0/1333677897 >> v1:172.21.15.91:6789/0 conn(0x7fb14c0c7950 legacy=0x7fb14c0c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.275+0000 7fb1513f1640 1 -- 172.21.15.91:0/1333677897 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0c32e0 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.276+0000 7fb1513f1640 1 --2- 172.21.15.91:0/1333677897 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 0x7fb14c0c6a60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009870 tx=0x7fb13c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741dfd2d693b3701 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:42.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.276+0000 7fb150bf0640 1 -- 172.21.15.91:0/1333677897 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0317e0 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.276+0000 7fb150bf0640 1 -- 172.21.15.91:0/1333677897 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c031940 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.276+0000 7fb150bf0640 1 -- 172.21.15.91:0/1333677897 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c031cd0 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.277+0000 7fb153e56640 1 -- 172.21.15.91:0/1333677897 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 msgr2=0x7fb14c0c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.277+0000 7fb153e56640 1 --2- 172.21.15.91:0/1333677897 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 0x7fb14c0c6a60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009870 tx=0x7fb13c02b880 comp rx=0 tx=0).stop 2023-11-27T20:42:42.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.277+0000 7fb153e56640 1 -- 172.21.15.91:0/1333677897 shutdown_connections 2023-11-27T20:42:42.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.277+0000 7fb153e56640 1 --2- 172.21.15.91:0/1333677897 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 0x7fb14c0c6a60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.277+0000 7fb153e56640 1 -- 172.21.15.91:0/1333677897 >> 172.21.15.91:0/1333677897 conn(0x7fb14c0c7e30 msgr2=0x7fb14c0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:42.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.277+0000 7fb153e56640 1 -- 172.21.15.91:0/1333677897 shutdown_connections 2023-11-27T20:42:42.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.277+0000 7fb153e56640 1 -- 172.21.15.91:0/1333677897 wait complete. 2023-11-27T20:42:42.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.279+0000 7fb153e56640 1 Processor -- start 2023-11-27T20:42:42.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.279+0000 7fb153e56640 1 -- start start 2023-11-27T20:42:42.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.280+0000 7fb153e56640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 0x7fb14c14c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.280+0000 7fb153e56640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb14c0c6680 0x7fb14c149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.280+0000 7fb153e56640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb14c0c7950 0x7fb14c14a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.280+0000 7fb153e56640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c06f3f0 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.280+0000 7fb153e56640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c1edcc0 con 0x7fb14c0c6680 2023-11-27T20:42:42.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.280+0000 7fb153e56640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c155230 con 0x7fb14c0c7950 2023-11-27T20:42:42.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.280+0000 7fb151bf2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 0x7fb14c14c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:42.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.280+0000 7fb151bf2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 0x7fb14c14c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33764/0 (socket says 172.21.15.91:33764) 2023-11-27T20:42:42.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.280+0000 7fb151bf2640 1 -- 172.21.15.91:0/3244903886 learned_addr learned my addr 172.21.15.91:0/3244903886 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.281+0000 7fb151bf2640 1 -- 172.21.15.91:0/3244903886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb14c0c7950 msgr2=0x7fb14c14a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.281+0000 7fb151bf2640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb14c0c7950 0x7fb14c14a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.281+0000 7fb151bf2640 1 -- 172.21.15.91:0/3244903886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb14c0c6680 msgr2=0x7fb14c149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.281+0000 7fb151bf2640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb14c0c6680 0x7fb14c149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.281+0000 7fb151bf2640 1 -- 172.21.15.91:0/3244903886 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0094d0 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.281+0000 7fb151bf2640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 0x7fb14c14c700 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb14800c430 tx=0x7fb14800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.281+0000 7fb1427fc640 1 -- 172.21.15.91:0/3244903886 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148011790 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.282+0000 7fb1427fc640 1 -- 172.21.15.91:0/3244903886 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1480118f0 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.282+0000 7fb153e56640 1 -- 172.21.15.91:0/3244903886 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c1edeb0 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.282+0000 7fb1427fc640 1 -- 172.21.15.91:0/3244903886 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148011ca0 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.282+0000 7fb153e56640 1 -- 172.21.15.91:0/3244903886 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c1ee190 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.283+0000 7fb153e56640 1 -- 172.21.15.91:0/3244903886 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c155710 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.284+0000 7fb1427fc640 1 -- 172.21.15.91:0/3244903886 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb14801c460 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.285+0000 7fb1427fc640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb13006b1c0 0x7fb13006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.285+0000 7fb1427fc640 1 -- 172.21.15.91:0/3244903886 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb148089a70 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.285+0000 7fb1513f1640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb13006b1c0 0x7fb13006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:42.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.286+0000 7fb1513f1640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb13006b1c0 0x7fb13006d680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb13c036000 tx=0x7fb13c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.289+0000 7fb1427fc640 1 -- 172.21.15.91:0/3244903886 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb14c155710 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.470+0000 7fb153e56640 1 -- 172.21.15.91:0/3244903886 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb14c155710 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.473+0000 7fb1427fc640 1 -- 172.21.15.91:0/3244903886 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16534 (secure 0 0 0) 0x7fb14c155710 con 0x7fb14c0a6bc0 2023-11-27T20:42:42.473 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:42.474 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":34,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:42:39.530533+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:42.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.475+0000 7fb153e56640 1 -- 172.21.15.91:0/3244903886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb13006b1c0 msgr2=0x7fb13006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.475+0000 7fb153e56640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb13006b1c0 0x7fb13006d680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb13c036000 tx=0x7fb13c030000 comp rx=0 tx=0).stop 2023-11-27T20:42:42.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.475+0000 7fb153e56640 1 -- 172.21.15.91:0/3244903886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 msgr2=0x7fb14c14c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.475+0000 7fb153e56640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 0x7fb14c14c700 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb14800c430 tx=0x7fb14800c8f0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.475+0000 7fb153e56640 1 -- 172.21.15.91:0/3244903886 shutdown_connections 2023-11-27T20:42:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.475+0000 7fb153e56640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb14c0c7950 0x7fb14c14a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.475+0000 7fb153e56640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb13006b1c0 0x7fb13006d680 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.475+0000 7fb153e56640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb14c0c6680 0x7fb14c149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.475+0000 7fb153e56640 1 --2- 172.21.15.91:0/3244903886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb14c0a6bc0 0x7fb14c14c700 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.475+0000 7fb153e56640 1 -- 172.21.15.91:0/3244903886 >> 172.21.15.91:0/3244903886 conn(0x7fb14c0c7e30 msgr2=0x7fb14c0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:42.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.476+0000 7fb153e56640 1 -- 172.21.15.91:0/3244903886 shutdown_connections 2023-11-27T20:42:42.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.476+0000 7fb153e56640 1 -- 172.21.15.91:0/3244903886 wait complete. 2023-11-27T20:42:42.494 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T20:42:42.495 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:42:42.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.702+0000 7f3887341640 1 Processor -- start 2023-11-27T20:42:42.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.702+0000 7f3887341640 1 -- start start 2023-11-27T20:42:42.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.703+0000 7f3887341640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f38800c1500 0x7f38800c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.703+0000 7f3887341640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38800c06c0 con 0x7f3880155490 2023-11-27T20:42:42.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.703+0000 7f3887341640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38800c1020 con 0x7f38800a9b40 2023-11-27T20:42:42.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.703+0000 7f3887341640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38800a5820 con 0x7f38800c1500 2023-11-27T20:42:42.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f38850dd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f3880155490 0x7f38800a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:35762/0 (socket says 172.21.15.91:35762) 2023-11-27T20:42:42.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f38850dd640 1 -- 172.21.15.91:0/3205109282 learned_addr learned my addr 172.21.15.91:0/3205109282 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:42.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617558057 0 0) 0x7f38800c06c0 con 0x7f3880155490 2023-11-27T20:42:42.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f386c003520 con 0x7f3880155490 2023-11-27T20:42:42.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f38858de640 1 --2- 172.21.15.91:0/3205109282 >> v2:172.21.15.183:3300/0 conn(0x7f38800c1500 0x7f38800c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:42.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2480123412 0 0) 0x7f386c003520 con 0x7f3880155490 2023-11-27T20:42:42.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 >> v2:172.21.15.183:3300/0 conn(0x7f38800c1500 msgr2=0x7f38800c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:42.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f3877fff640 1 --2- 172.21.15.91:0/3205109282 >> v2:172.21.15.183:3300/0 conn(0x7f38800c1500 0x7f38800c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 >> v1:172.21.15.183:6789/0 conn(0x7f38800a9b40 legacy=0x7f38800c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800c0910 con 0x7f3880155490 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f387c0019f0 con 0x7f3880155490 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f38858de640 1 --2- 172.21.15.91:0/3205109282 >> v2:172.21.15.183:3300/0 conn(0x7f38800c1500 0x7f38800c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 >> v1:172.21.15.91:6789/0 conn(0x7f3880155490 legacy=0x7f38800a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.704+0000 7f3877fff640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c003970 0x7f386c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f3877fff640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f386c0047c0 0x7f386c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f3877fff640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f386c0052a0 0x7f386c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c00c170 con 0x7f386c0052a0 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c00c2e0 con 0x7f386c003970 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c00e6b0 con 0x7f386c0047c0 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f38858de640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f386c0052a0 0x7f386c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:42.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f38850dd640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c003970 0x7f386c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:42.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f38848dc640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f386c0047c0 0x7f386c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:42.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f38858de640 1 -- 172.21.15.91:0/3205109282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f386c0047c0 msgr2=0x7f386c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:42.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f38858de640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f386c0047c0 0x7f386c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f38858de640 1 -- 172.21.15.91:0/3205109282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c003970 msgr2=0x7f386c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:42.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f38858de640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c003970 0x7f386c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.705+0000 7f38858de640 1 -- 172.21.15.91:0/3205109282 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c003520 con 0x7f386c0052a0 2023-11-27T20:42:42.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.706+0000 7f38858de640 1 -- 172.21.15.91:0/3205109282 reap_dead start 2023-11-27T20:42:42.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.706+0000 7f38858de640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f386c0052a0 0x7f386c00b980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f387800aa50 tx=0x7f386c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae7909885f0a27d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:42.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.707+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387802d610 con 0x7f386c0052a0 2023-11-27T20:42:42.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.707+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387802d770 con 0x7f386c0052a0 2023-11-27T20:42:42.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.707+0000 7f3877fff640 1 -- 172.21.15.91:0/3205109282 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387802db20 con 0x7f386c0052a0 2023-11-27T20:42:42.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.707+0000 7f3887341640 1 -- 172.21.15.91:0/3205109282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f386c0052a0 msgr2=0x7f386c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.707+0000 7f3887341640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f386c0052a0 0x7f386c00b980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f387800aa50 tx=0x7f386c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.707+0000 7f3887341640 1 -- 172.21.15.91:0/3205109282 shutdown_connections 2023-11-27T20:42:42.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.707+0000 7f3887341640 1 --2- 172.21.15.91:0/3205109282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f386c0052a0 0x7f386c00b980 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.707+0000 7f3887341640 1 -- 172.21.15.91:0/3205109282 >> 172.21.15.91:0/3205109282 conn(0x7f388006a500 msgr2=0x7f388006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:42.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.707+0000 7f3887341640 1 -- 172.21.15.91:0/3205109282 shutdown_connections 2023-11-27T20:42:42.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.707+0000 7f3887341640 1 -- 172.21.15.91:0/3205109282 wait complete. 2023-11-27T20:42:42.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.709+0000 7f3887341640 1 Processor -- start 2023-11-27T20:42:42.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.709+0000 7f3887341640 1 -- start start 2023-11-27T20:42:42.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.710+0000 7f3887341640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c0052a0 0x7f3880070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.710+0000 7f3887341640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38801e9f20 0x7f38801dd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.710+0000 7f3887341640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3880151ec0 0x7f3880152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.710+0000 7f3887341640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38801dae30 con 0x7f3880151ec0 2023-11-27T20:42:42.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.710+0000 7f3887341640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38801528b0 con 0x7f386c0052a0 2023-11-27T20:42:42.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.710+0000 7f3887341640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38801ea420 con 0x7f38801e9f20 2023-11-27T20:42:42.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.710+0000 7f38858de640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3880151ec0 0x7f3880152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:42.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.710+0000 7f38858de640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3880151ec0 0x7f3880152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33778/0 (socket says 172.21.15.91:33778) 2023-11-27T20:42:42.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.710+0000 7f38858de640 1 -- 172.21.15.91:0/873305063 learned_addr learned my addr 172.21.15.91:0/873305063 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:42.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f38850dd640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c0052a0 0x7f3880070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:42.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f38858de640 1 -- 172.21.15.91:0/873305063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38801e9f20 msgr2=0x7f38801dd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f38858de640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38801e9f20 0x7f38801dd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f38858de640 1 -- 172.21.15.91:0/873305063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c0052a0 msgr2=0x7f3880070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f38858de640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c0052a0 0x7f3880070c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f38858de640 1 -- 172.21.15.91:0/873305063 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38801ea700 con 0x7f3880151ec0 2023-11-27T20:42:42.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f38858de640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3880151ec0 0x7f3880152370 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f387800aa50 tx=0x7f3878004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:42.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f3875ffb640 1 -- 172.21.15.91:0/873305063 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387803c070 con 0x7f3880151ec0 2023-11-27T20:42:42.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f3875ffb640 1 -- 172.21.15.91:0/873305063 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3878037610 con 0x7f3880151ec0 2023-11-27T20:42:42.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f3875ffb640 1 -- 172.21.15.91:0/873305063 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878037980 con 0x7f3880151ec0 2023-11-27T20:42:42.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f3887341640 1 -- 172.21.15.91:0/873305063 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38801ea9e0 con 0x7f3880151ec0 2023-11-27T20:42:42.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.711+0000 7f3887341640 1 -- 172.21.15.91:0/873305063 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3880071160 con 0x7f3880151ec0 2023-11-27T20:42:42.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.712+0000 7f3887341640 1 -- 172.21.15.91:0/873305063 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3880154cb0 con 0x7f3880151ec0 2023-11-27T20:42:42.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.713+0000 7f3875ffb640 1 -- 172.21.15.91:0/873305063 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3878037ae0 con 0x7f3880151ec0 2023-11-27T20:42:42.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.714+0000 7f3875ffb640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f386406b1f0 0x7f386406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:42.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.714+0000 7f3875ffb640 1 -- 172.21.15.91:0/873305063 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38780aaba0 con 0x7f3880151ec0 2023-11-27T20:42:42.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.714+0000 7f38850dd640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f386406b1f0 0x7f386406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:42.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.715+0000 7f38850dd640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f386406b1f0 0x7f386406d6b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f387c002230 tx=0x7f387c001490 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:42.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.718+0000 7f3875ffb640 1 -- 172.21.15.91:0/873305063 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f38780758c0 con 0x7f3880151ec0 2023-11-27T20:42:42.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.904+0000 7f3887341640 1 -- 172.21.15.91:0/873305063 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38800c0300 con 0x7f386406b1f0 2023-11-27T20:42:42.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.918+0000 7f3875ffb640 1 -- 172.21.15.91:0/873305063 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281577 (secure 0 0 0) 0x7f38800c0300 con 0x7f386406b1f0 2023-11-27T20:42:42.921 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:42.924 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:42:42.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.922+0000 7f3887341640 1 -- 172.21.15.91:0/873305063 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f386406b1f0 msgr2=0x7f386406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.922+0000 7f3887341640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f386406b1f0 0x7f386406d6b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f387c002230 tx=0x7f387c001490 comp rx=0 tx=0).stop 2023-11-27T20:42:42.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.922+0000 7f3887341640 1 -- 172.21.15.91:0/873305063 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3880151ec0 msgr2=0x7f3880152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:42.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.922+0000 7f3887341640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3880151ec0 0x7f3880152370 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f387800aa50 tx=0x7f3878004730 comp rx=0 tx=0).stop 2023-11-27T20:42:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.923+0000 7f3887341640 1 -- 172.21.15.91:0/873305063 shutdown_connections 2023-11-27T20:42:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.923+0000 7f3887341640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3880151ec0 0x7f3880152370 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.923+0000 7f3887341640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38801e9f20 0x7f38801dd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.923+0000 7f3887341640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f386406b1f0 0x7f386406d6b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.923+0000 7f3887341640 1 --2- 172.21.15.91:0/873305063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c0052a0 0x7f3880070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.923+0000 7f3887341640 1 -- 172.21.15.91:0/873305063 >> 172.21.15.91:0/873305063 conn(0x7f388006a500 msgr2=0x7f388006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.923+0000 7f3887341640 1 -- 172.21.15.91:0/873305063 shutdown_connections 2023-11-27T20:42:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:42.923+0000 7f3887341640 1 -- 172.21.15.91:0/873305063 wait complete. 2023-11-27T20:42:42.941 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-11-27T20:42:41.392312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220120,"kb_used_data":3940,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754600,"statfs":{"total":773094113280,"available":772868710400,"internally_reserved":0,"allocated":4034560,"data_stored":2272847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.904940"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.507171+0000","last_change":"2023-11-27T20:42:37.507171+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.507171+0000","last_undegraded":"2023-11-27T20:42:37.507171+0000","last_fullsized":"2023-11-27T20:42:37.507171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.512450+0000","last_change":"2023-11-27T20:42:37.512450+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.512450+0000","last_undegraded":"2023-11-27T20:42:37.512450+0000","last_fullsized":"2023-11-27T20:42:37.512450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518057+0000","last_change":"2023-11-27T20:42:37.518057+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518057+0000","last_undegraded":"2023-11-27T20:42:37.518057+0000","last_fullsized":"2023-11-27T20:42:37.518057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.510195+0000","last_change":"2023-11-27T20:42:37.510195+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.510195+0000","last_undegraded":"2023-11-27T20:42:37.510195+0000","last_fullsized":"2023-11-27T20:42:37.510195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515787+0000","last_change":"2023-11-27T20:42:37.515787+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515787+0000","last_undegraded":"2023-11-27T20:42:37.515787+0000","last_fullsized":"2023-11-27T20:42:37.515787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511964+0000","last_change":"2023-11-27T20:42:37.511964+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511964+0000","last_undegraded":"2023-11-27T20:42:37.511964+0000","last_fullsized":"2023-11-27T20:42:37.511964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.523443+0000","last_change":"2023-11-27T20:42:37.523443+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.523443+0000","last_undegraded":"2023-11-27T20:42:37.523443+0000","last_fullsized":"2023-11-27T20:42:37.523443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.528897+0000","last_change":"2023-11-27T20:42:37.528897+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.528897+0000","last_undegraded":"2023-11-27T20:42:37.528897+0000","last_fullsized":"2023-11-27T20:42:37.528897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.501968+0000","last_change":"2023-11-27T20:42:37.501968+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.501968+0000","last_undegraded":"2023-11-27T20:42:37.501968+0000","last_fullsized":"2023-11-27T20:42:37.501968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504322+0000","last_change":"2023-11-27T20:42:37.504322+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504322+0000","last_undegraded":"2023-11-27T20:42:37.504322+0000","last_fullsized":"2023-11-27T20:42:37.504322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.521826+0000","last_change":"2023-11-27T20:42:37.521826+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.521826+0000","last_undegraded":"2023-11-27T20:42:37.521826+0000","last_fullsized":"2023-11-27T20:42:37.521826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514524+0000","last_change":"2023-11-27T20:42:37.514524+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514524+0000","last_undegraded":"2023-11-27T20:42:37.514524+0000","last_fullsized":"2023-11-27T20:42:37.514524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515208+0000","last_change":"2023-11-27T20:42:37.515208+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515208+0000","last_undegraded":"2023-11-27T20:42:37.515208+0000","last_fullsized":"2023-11-27T20:42:37.515208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511574+0000","last_change":"2023-11-27T20:42:37.511574+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511574+0000","last_undegraded":"2023-11-27T20:42:37.511574+0000","last_fullsized":"2023-11-27T20:42:37.511574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519349+0000","last_change":"2023-11-27T20:42:37.519349+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519349+0000","last_undegraded":"2023-11-27T20:42:37.519349+0000","last_fullsized":"2023-11-27T20:42:37.519349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519684+0000","last_change":"2023-11-27T20:42:37.519684+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519684+0000","last_undegraded":"2023-11-27T20:42:37.519684+0000","last_fullsized":"2023-11-27T20:42:37.519684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.522777+0000","last_change":"2023-11-27T20:42:37.522777+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.522777+0000","last_undegraded":"2023-11-27T20:42:37.522777+0000","last_fullsized":"2023-11-27T20:42:37.522777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511548+0000","last_change":"2023-11-27T20:42:37.511548+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511548+0000","last_undegraded":"2023-11-27T20:42:37.511548+0000","last_fullsized":"2023-11-27T20:42:37.511548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511531+0000","last_change":"2023-11-27T20:42:37.511531+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511531+0000","last_undegraded":"2023-11-27T20:42:37.511531+0000","last_fullsized":"2023-11-27T20:42:37.511531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518559+0000","last_change":"2023-11-27T20:42:37.518559+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518559+0000","last_undegraded":"2023-11-27T20:42:37.518559+0000","last_fullsized":"2023-11-27T20:42:37.518559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.506586+0000","last_change":"2023-11-27T20:42:37.506586+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.506586+0000","last_undegraded":"2023-11-27T20:42:37.506586+0000","last_fullsized":"2023-11-27T20:42:37.506586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504134+0000","last_change":"2023-11-27T20:42:37.504134+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504134+0000","last_undegraded":"2023-11-27T20:42:37.504134+0000","last_fullsized":"2023-11-27T20:42:37.504134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515948+0000","last_change":"2023-11-27T20:42:37.515948+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515948+0000","last_undegraded":"2023-11-27T20:42:37.515948+0000","last_fullsized":"2023-11-27T20:42:37.515948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514796+0000","last_change":"2023-11-27T20:42:37.514796+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514796+0000","last_undegraded":"2023-11-27T20:42:37.514796+0000","last_fullsized":"2023-11-27T20:42:37.514796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508064+0000","last_change":"2023-11-27T20:42:37.508064+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508064+0000","last_undegraded":"2023-11-27T20:42:37.508064+0000","last_fullsized":"2023-11-27T20:42:37.508064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.510504+0000","last_change":"2023-11-27T20:42:37.510504+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.510504+0000","last_undegraded":"2023-11-27T20:42:37.510504+0000","last_fullsized":"2023-11-27T20:42:37.510504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513568+0000","last_change":"2023-11-27T20:42:37.513568+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513568+0000","last_undegraded":"2023-11-27T20:42:37.513568+0000","last_fullsized":"2023-11-27T20:42:37.513568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511588+0000","last_change":"2023-11-27T20:42:37.511588+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511588+0000","last_undegraded":"2023-11-27T20:42:37.511588+0000","last_fullsized":"2023-11-27T20:42:37.511588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503780+0000","last_change":"2023-11-27T20:42:37.503780+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503780+0000","last_undegraded":"2023-11-27T20:42:37.503780+0000","last_fullsized":"2023-11-27T20:42:37.503780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.520838+0000","last_change":"2023-11-27T20:42:37.520838+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.520838+0000","last_undegraded":"2023-11-27T20:42:37.520838+0000","last_fullsized":"2023-11-27T20:42:37.520838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504137+0000","last_change":"2023-11-27T20:42:37.504137+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504137+0000","last_undegraded":"2023-11-27T20:42:37.504137+0000","last_fullsized":"2023-11-27T20:42:37.504137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.528425+0000","last_change":"2023-11-27T20:42:37.528425+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.528425+0000","last_undegraded":"2023-11-27T20:42:37.528425+0000","last_fullsized":"2023-11-27T20:42:37.528425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519836+0000","last_change":"2023-11-27T20:42:37.519836+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519836+0000","last_undegraded":"2023-11-27T20:42:37.519836+0000","last_fullsized":"2023-11-27T20:42:37.519836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.532488+0000","last_change":"2023-11-27T20:42:37.528294+0000","last_active":"2023-11-27T20:42:37.532488+0000","last_peered":"2023-11-27T20:42:37.532488+0000","last_clean":"2023-11-27T20:42:37.532488+0000","last_became_active":"2023-11-27T20:42:37.528055+0000","last_became_peered":"2023-11-27T20:42:37.528055+0000","last_unstale":"2023-11-27T20:42:37.532488+0000","last_undegraded":"2023-11-27T20:42:37.532488+0000","last_fullsized":"2023-11-27T20:42:37.532488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.506060+0000","last_change":"2023-11-27T20:42:37.506060+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.506060+0000","last_undegraded":"2023-11-27T20:42:37.506060+0000","last_fullsized":"2023-11-27T20:42:37.506060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.539636+0000","last_change":"2023-11-27T20:42:37.535511+0000","last_active":"2023-11-27T20:42:37.539636+0000","last_peered":"2023-11-27T20:42:37.539636+0000","last_clean":"2023-11-27T20:42:37.539636+0000","last_became_active":"2023-11-27T20:42:37.535314+0000","last_became_peered":"2023-11-27T20:42:37.535314+0000","last_unstale":"2023-11-27T20:42:37.539636+0000","last_undegraded":"2023-11-27T20:42:37.539636+0000","last_fullsized":"2023-11-27T20:42:37.539636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:47.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502494+0000","last_change":"2023-11-27T20:42:37.502494+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502494+0000","last_undegraded":"2023-11-27T20:42:37.502494+0000","last_fullsized":"2023-11-27T20:42:37.502494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.529016+0000","last_change":"2023-11-27T20:42:37.520015+0000","last_active":"2023-11-27T20:42:37.529016+0000","last_peered":"2023-11-27T20:42:37.529016+0000","last_clean":"2023-11-27T20:42:37.529016+0000","last_became_active":"2023-11-27T20:42:37.519779+0000","last_became_peered":"2023-11-27T20:42:37.519779+0000","last_unstale":"2023-11-27T20:42:37.529016+0000","last_undegraded":"2023-11-27T20:42:37.529016+0000","last_fullsized":"2023-11-27T20:42:37.529016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513095+0000","last_change":"2023-11-27T20:42:37.513095+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513095+0000","last_undegraded":"2023-11-27T20:42:37.513095+0000","last_fullsized":"2023-11-27T20:42:37.513095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533841+0000","last_change":"2023-11-27T20:42:37.530074+0000","last_active":"2023-11-27T20:42:37.533841+0000","last_peered":"2023-11-27T20:42:37.533841+0000","last_clean":"2023-11-27T20:42:37.533841+0000","last_became_active":"2023-11-27T20:42:37.529422+0000","last_became_peered":"2023-11-27T20:42:37.529422+0000","last_unstale":"2023-11-27T20:42:37.533841+0000","last_undegraded":"2023-11-27T20:42:37.533841+0000","last_fullsized":"2023-11-27T20:42:37.533841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:32:25.861163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.520224+0000","last_change":"2023-11-27T20:42:37.520224+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.520224+0000","last_undegraded":"2023-11-27T20:42:37.520224+0000","last_fullsized":"2023-11-27T20:42:37.520224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533860+0000","last_change":"2023-11-27T20:42:37.527381+0000","last_active":"2023-11-27T20:42:37.533860+0000","last_peered":"2023-11-27T20:42:37.533860+0000","last_clean":"2023-11-27T20:42:37.533860+0000","last_became_active":"2023-11-27T20:42:37.527147+0000","last_became_peered":"2023-11-27T20:42:37.527147+0000","last_unstale":"2023-11-27T20:42:37.533860+0000","last_undegraded":"2023-11-27T20:42:37.533860+0000","last_fullsized":"2023-11-27T20:42:37.533860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:28:47.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514071+0000","last_change":"2023-11-27T20:42:37.514071+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514071+0000","last_undegraded":"2023-11-27T20:42:37.514071+0000","last_fullsized":"2023-11-27T20:42:37.514071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537556+0000","last_change":"2023-11-27T20:42:37.531654+0000","last_active":"2023-11-27T20:42:37.537556+0000","last_peered":"2023-11-27T20:42:37.537556+0000","last_clean":"2023-11-27T20:42:37.537556+0000","last_became_active":"2023-11-27T20:42:37.529901+0000","last_became_peered":"2023-11-27T20:42:37.529901+0000","last_unstale":"2023-11-27T20:42:37.537556+0000","last_undegraded":"2023-11-27T20:42:37.537556+0000","last_fullsized":"2023-11-27T20:42:37.537556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:25:52.361215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.501269+0000","last_change":"2023-11-27T20:42:37.501269+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.501269+0000","last_undegraded":"2023-11-27T20:42:37.501269+0000","last_fullsized":"2023-11-27T20:42:37.501269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.528979+0000","last_change":"2023-11-27T20:42:37.522964+0000","last_active":"2023-11-27T20:42:37.528979+0000","last_peered":"2023-11-27T20:42:37.528979+0000","last_clean":"2023-11-27T20:42:37.528979+0000","last_became_active":"2023-11-27T20:42:37.522677+0000","last_became_peered":"2023-11-27T20:42:37.522677+0000","last_unstale":"2023-11-27T20:42:37.528979+0000","last_undegraded":"2023-11-27T20:42:37.528979+0000","last_fullsized":"2023-11-27T20:42:37.528979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:42.888540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503711+0000","last_change":"2023-11-27T20:42:37.503711+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503711+0000","last_undegraded":"2023-11-27T20:42:37.503711+0000","last_fullsized":"2023-11-27T20:42:37.503711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527926+0000","last_change":"2023-11-27T20:42:37.522230+0000","last_active":"2023-11-27T20:42:37.527926+0000","last_peered":"2023-11-27T20:42:37.527926+0000","last_clean":"2023-11-27T20:42:37.527926+0000","last_became_active":"2023-11-27T20:42:37.521898+0000","last_became_peered":"2023-11-27T20:42:37.521898+0000","last_unstale":"2023-11-27T20:42:37.527926+0000","last_undegraded":"2023-11-27T20:42:37.527926+0000","last_fullsized":"2023-11-27T20:42:37.527926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:29:17.198964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511614+0000","last_change":"2023-11-27T20:42:37.511614+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511614+0000","last_undegraded":"2023-11-27T20:42:37.511614+0000","last_fullsized":"2023-11-27T20:42:37.511614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536950+0000","last_change":"2023-11-27T20:42:37.531762+0000","last_active":"2023-11-27T20:42:37.536950+0000","last_peered":"2023-11-27T20:42:37.536950+0000","last_clean":"2023-11-27T20:42:37.536950+0000","last_became_active":"2023-11-27T20:42:37.531446+0000","last_became_peered":"2023-11-27T20:42:37.531446+0000","last_unstale":"2023-11-27T20:42:37.536950+0000","last_undegraded":"2023-11-27T20:42:37.536950+0000","last_fullsized":"2023-11-27T20:42:37.536950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:16:18.992040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.512794+0000","last_change":"2023-11-27T20:42:37.512794+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.512794+0000","last_undegraded":"2023-11-27T20:42:37.512794+0000","last_fullsized":"2023-11-27T20:42:37.512794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536897+0000","last_change":"2023-11-27T20:42:37.532869+0000","last_active":"2023-11-27T20:42:37.536897+0000","last_peered":"2023-11-27T20:42:37.536897+0000","last_clean":"2023-11-27T20:42:37.536897+0000","last_became_active":"2023-11-27T20:42:37.532576+0000","last_became_peered":"2023-11-27T20:42:37.532576+0000","last_unstale":"2023-11-27T20:42:37.536897+0000","last_undegraded":"2023-11-27T20:42:37.536897+0000","last_fullsized":"2023-11-27T20:42:37.536897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508823+0000","last_change":"2023-11-27T20:42:37.508823+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508823+0000","last_undegraded":"2023-11-27T20:42:37.508823+0000","last_fullsized":"2023-11-27T20:42:37.508823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536684+0000","last_change":"2023-11-27T20:42:37.530460+0000","last_active":"2023-11-27T20:42:37.536684+0000","last_peered":"2023-11-27T20:42:37.536684+0000","last_clean":"2023-11-27T20:42:37.536684+0000","last_became_active":"2023-11-27T20:42:37.529879+0000","last_became_peered":"2023-11-27T20:42:37.529879+0000","last_unstale":"2023-11-27T20:42:37.536684+0000","last_undegraded":"2023-11-27T20:42:37.536684+0000","last_fullsized":"2023-11-27T20:42:37.536684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:42.888540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518638+0000","last_change":"2023-11-27T20:42:37.518638+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518638+0000","last_undegraded":"2023-11-27T20:42:37.518638+0000","last_fullsized":"2023-11-27T20:42:37.518638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531644+0000","last_change":"2023-11-27T20:42:37.523173+0000","last_active":"2023-11-27T20:42:37.531644+0000","last_peered":"2023-11-27T20:42:37.531644+0000","last_clean":"2023-11-27T20:42:37.531644+0000","last_became_active":"2023-11-27T20:42:37.522903+0000","last_became_peered":"2023-11-27T20:42:37.522903+0000","last_unstale":"2023-11-27T20:42:37.531644+0000","last_undegraded":"2023-11-27T20:42:37.531644+0000","last_fullsized":"2023-11-27T20:42:37.531644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:47.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505436+0000","last_change":"2023-11-27T20:42:37.505436+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505436+0000","last_undegraded":"2023-11-27T20:42:37.505436+0000","last_fullsized":"2023-11-27T20:42:37.505436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533633+0000","last_change":"2023-11-27T20:42:37.524294+0000","last_active":"2023-11-27T20:42:37.533633+0000","last_peered":"2023-11-27T20:42:37.533633+0000","last_clean":"2023-11-27T20:42:37.533633+0000","last_became_active":"2023-11-27T20:42:37.523858+0000","last_became_peered":"2023-11-27T20:42:37.523858+0000","last_unstale":"2023-11-27T20:42:37.533633+0000","last_undegraded":"2023-11-27T20:42:37.533633+0000","last_fullsized":"2023-11-27T20:42:37.533633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:02:50.193416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508941+0000","last_change":"2023-11-27T20:42:37.508941+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508941+0000","last_undegraded":"2023-11-27T20:42:37.508941+0000","last_fullsized":"2023-11-27T20:42:37.508941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.530936+0000","last_change":"2023-11-27T20:42:37.522904+0000","last_active":"2023-11-27T20:42:37.530936+0000","last_peered":"2023-11-27T20:42:37.530936+0000","last_clean":"2023-11-27T20:42:37.530936+0000","last_became_active":"2023-11-27T20:42:37.522574+0000","last_became_peered":"2023-11-27T20:42:37.522574+0000","last_unstale":"2023-11-27T20:42:37.530936+0000","last_undegraded":"2023-11-27T20:42:37.530936+0000","last_fullsized":"2023-11-27T20:42:37.530936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:37.188919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.527110+0000","last_change":"2023-11-27T20:42:37.527110+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.527110+0000","last_undegraded":"2023-11-27T20:42:37.527110+0000","last_fullsized":"2023-11-27T20:42:37.527110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.539619+0000","last_change":"2023-11-27T20:42:37.535247+0000","last_active":"2023-11-27T20:42:37.539619+0000","last_peered":"2023-11-27T20:42:37.539619+0000","last_clean":"2023-11-27T20:42:37.539619+0000","last_became_active":"2023-11-27T20:42:37.534922+0000","last_became_peered":"2023-11-27T20:42:37.534922+0000","last_unstale":"2023-11-27T20:42:37.539619+0000","last_undegraded":"2023-11-27T20:42:37.539619+0000","last_fullsized":"2023-11-27T20:42:37.539619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502506+0000","last_change":"2023-11-27T20:42:37.502506+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502506+0000","last_undegraded":"2023-11-27T20:42:37.502506+0000","last_fullsized":"2023-11-27T20:42:37.502506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.524213+0000","last_change":"2023-11-27T20:42:37.514338+0000","last_active":"2023-11-27T20:42:37.524213+0000","last_peered":"2023-11-27T20:42:37.524213+0000","last_clean":"2023-11-27T20:42:37.524213+0000","last_became_active":"2023-11-27T20:42:37.514055+0000","last_became_peered":"2023-11-27T20:42:37.514055+0000","last_unstale":"2023-11-27T20:42:37.524213+0000","last_undegraded":"2023-11-27T20:42:37.524213+0000","last_fullsized":"2023-11-27T20:42:37.524213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505512+0000","last_change":"2023-11-27T20:42:37.505512+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505512+0000","last_undegraded":"2023-11-27T20:42:37.505512+0000","last_fullsized":"2023-11-27T20:42:37.505512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531502+0000","last_change":"2023-11-27T20:42:37.525560+0000","last_active":"2023-11-27T20:42:37.531502+0000","last_peered":"2023-11-27T20:42:37.531502+0000","last_clean":"2023-11-27T20:42:37.531502+0000","last_became_active":"2023-11-27T20:42:37.525261+0000","last_became_peered":"2023-11-27T20:42:37.525261+0000","last_unstale":"2023-11-27T20:42:37.531502+0000","last_undegraded":"2023-11-27T20:42:37.531502+0000","last_fullsized":"2023-11-27T20:42:37.531502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516690+0000","last_change":"2023-11-27T20:42:37.516690+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516690+0000","last_undegraded":"2023-11-27T20:42:37.516690+0000","last_fullsized":"2023-11-27T20:42:37.516690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527935+0000","last_change":"2023-11-27T20:42:37.522245+0000","last_active":"2023-11-27T20:42:37.527935+0000","last_peered":"2023-11-27T20:42:37.527935+0000","last_clean":"2023-11-27T20:42:37.527935+0000","last_became_active":"2023-11-27T20:42:37.521938+0000","last_became_peered":"2023-11-27T20:42:37.521938+0000","last_unstale":"2023-11-27T20:42:37.527935+0000","last_undegraded":"2023-11-27T20:42:37.527935+0000","last_fullsized":"2023-11-27T20:42:37.527935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:47:06.669263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505173+0000","last_change":"2023-11-27T20:42:37.505173+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505173+0000","last_undegraded":"2023-11-27T20:42:37.505173+0000","last_fullsized":"2023-11-27T20:42:37.505173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533733+0000","last_change":"2023-11-27T20:42:37.525601+0000","last_active":"2023-11-27T20:42:37.533733+0000","last_peered":"2023-11-27T20:42:37.533733+0000","last_clean":"2023-11-27T20:42:37.533733+0000","last_became_active":"2023-11-27T20:42:37.525296+0000","last_became_peered":"2023-11-27T20:42:37.525296+0000","last_unstale":"2023-11-27T20:42:37.533733+0000","last_undegraded":"2023-11-27T20:42:37.533733+0000","last_fullsized":"2023-11-27T20:42:37.533733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:09:22.812521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517575+0000","last_change":"2023-11-27T20:42:37.517575+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517575+0000","last_undegraded":"2023-11-27T20:42:37.517575+0000","last_fullsized":"2023-11-27T20:42:37.517575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533779+0000","last_change":"2023-11-27T20:42:37.527131+0000","last_active":"2023-11-27T20:42:37.533779+0000","last_peered":"2023-11-27T20:42:37.533779+0000","last_clean":"2023-11-27T20:42:37.533779+0000","last_became_active":"2023-11-27T20:42:37.526804+0000","last_became_peered":"2023-11-27T20:42:37.526804+0000","last_unstale":"2023-11-27T20:42:37.533779+0000","last_undegraded":"2023-11-27T20:42:37.533779+0000","last_fullsized":"2023-11-27T20:42:37.533779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:05.189004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513949+0000","last_change":"2023-11-27T20:42:37.513949+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513949+0000","last_undegraded":"2023-11-27T20:42:37.513949+0000","last_fullsized":"2023-11-27T20:42:37.513949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531689+0000","last_change":"2023-11-27T20:42:37.527591+0000","last_active":"2023-11-27T20:42:37.531689+0000","last_peered":"2023-11-27T20:42:37.531689+0000","last_clean":"2023-11-27T20:42:37.531689+0000","last_became_active":"2023-11-27T20:42:37.527305+0000","last_became_peered":"2023-11-27T20:42:37.527305+0000","last_unstale":"2023-11-27T20:42:37.531689+0000","last_undegraded":"2023-11-27T20:42:37.531689+0000","last_fullsized":"2023-11-27T20:42:37.531689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514521+0000","last_change":"2023-11-27T20:42:37.514521+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514521+0000","last_undegraded":"2023-11-27T20:42:37.514521+0000","last_fullsized":"2023-11-27T20:42:37.514521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.525562+0000","last_change":"2023-11-27T20:42:37.522543+0000","last_active":"2023-11-27T20:42:37.525562+0000","last_peered":"2023-11-27T20:42:37.525562+0000","last_clean":"2023-11-27T20:42:37.525562+0000","last_became_active":"2023-11-27T20:42:37.522163+0000","last_became_peered":"2023-11-27T20:42:37.522163+0000","last_unstale":"2023-11-27T20:42:37.525562+0000","last_undegraded":"2023-11-27T20:42:37.525562+0000","last_fullsized":"2023-11-27T20:42:37.525562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513682+0000","last_change":"2023-11-27T20:42:37.513682+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513682+0000","last_undegraded":"2023-11-27T20:42:37.513682+0000","last_fullsized":"2023-11-27T20:42:37.513682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.522197+0000","last_change":"2023-11-27T20:42:37.518579+0000","last_active":"2023-11-27T20:42:37.522197+0000","last_peered":"2023-11-27T20:42:37.522197+0000","last_clean":"2023-11-27T20:42:37.522197+0000","last_became_active":"2023-11-27T20:42:37.517970+0000","last_became_peered":"2023-11-27T20:42:37.517970+0000","last_unstale":"2023-11-27T20:42:37.522197+0000","last_undegraded":"2023-11-27T20:42:37.522197+0000","last_fullsized":"2023-11-27T20:42:37.522197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:32:25.861163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.526199+0000","last_change":"2023-11-27T20:42:37.526199+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.526199+0000","last_undegraded":"2023-11-27T20:42:37.526199+0000","last_fullsized":"2023-11-27T20:42:37.526199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536771+0000","last_change":"2023-11-27T20:42:37.532212+0000","last_active":"2023-11-27T20:42:37.536771+0000","last_peered":"2023-11-27T20:42:37.536771+0000","last_clean":"2023-11-27T20:42:37.536771+0000","last_became_active":"2023-11-27T20:42:37.531894+0000","last_became_peered":"2023-11-27T20:42:37.531894+0000","last_unstale":"2023-11-27T20:42:37.536771+0000","last_undegraded":"2023-11-27T20:42:37.536771+0000","last_fullsized":"2023-11-27T20:42:37.536771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516658+0000","last_change":"2023-11-27T20:42:37.516658+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516658+0000","last_undegraded":"2023-11-27T20:42:37.516658+0000","last_fullsized":"2023-11-27T20:42:37.516658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534076+0000","last_change":"2023-11-27T20:42:37.530114+0000","last_active":"2023-11-27T20:42:37.534076+0000","last_peered":"2023-11-27T20:42:37.534076+0000","last_clean":"2023-11-27T20:42:37.534076+0000","last_became_active":"2023-11-27T20:42:37.529838+0000","last_became_peered":"2023-11-27T20:42:37.529838+0000","last_unstale":"2023-11-27T20:42:37.534076+0000","last_undegraded":"2023-11-27T20:42:37.534076+0000","last_fullsized":"2023-11-27T20:42:37.534076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516148+0000","last_change":"2023-11-27T20:42:37.516148+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516148+0000","last_undegraded":"2023-11-27T20:42:37.516148+0000","last_fullsized":"2023-11-27T20:42:37.516148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534123+0000","last_change":"2023-11-27T20:42:37.528142+0000","last_active":"2023-11-27T20:42:37.534123+0000","last_peered":"2023-11-27T20:42:37.534123+0000","last_clean":"2023-11-27T20:42:37.534123+0000","last_became_active":"2023-11-27T20:42:37.527318+0000","last_became_peered":"2023-11-27T20:42:37.527318+0000","last_unstale":"2023-11-27T20:42:37.534123+0000","last_undegraded":"2023-11-27T20:42:37.534123+0000","last_fullsized":"2023-11-27T20:42:37.534123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517148+0000","last_change":"2023-11-27T20:42:37.517148+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517148+0000","last_undegraded":"2023-11-27T20:42:37.517148+0000","last_fullsized":"2023-11-27T20:42:37.517148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533948+0000","last_change":"2023-11-27T20:42:37.527056+0000","last_active":"2023-11-27T20:42:37.533948+0000","last_peered":"2023-11-27T20:42:37.533948+0000","last_clean":"2023-11-27T20:42:37.533948+0000","last_became_active":"2023-11-27T20:42:37.526803+0000","last_became_peered":"2023-11-27T20:42:37.526803+0000","last_unstale":"2023-11-27T20:42:37.533948+0000","last_undegraded":"2023-11-27T20:42:37.533948+0000","last_fullsized":"2023-11-27T20:42:37.533948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.507542+0000","last_change":"2023-11-27T20:42:37.507542+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.507542+0000","last_undegraded":"2023-11-27T20:42:37.507542+0000","last_fullsized":"2023-11-27T20:42:37.507542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536858+0000","last_change":"2023-11-27T20:42:37.532441+0000","last_active":"2023-11-27T20:42:37.536858+0000","last_peered":"2023-11-27T20:42:37.536858+0000","last_clean":"2023-11-27T20:42:37.536858+0000","last_became_active":"2023-11-27T20:42:37.532074+0000","last_became_peered":"2023-11-27T20:42:37.532074+0000","last_unstale":"2023-11-27T20:42:37.536858+0000","last_undegraded":"2023-11-27T20:42:37.536858+0000","last_fullsized":"2023-11-27T20:42:37.536858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517601+0000","last_change":"2023-11-27T20:42:37.517601+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517601+0000","last_undegraded":"2023-11-27T20:42:37.517601+0000","last_fullsized":"2023-11-27T20:42:37.517601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534045+0000","last_change":"2023-11-27T20:42:37.529807+0000","last_active":"2023-11-27T20:42:37.534045+0000","last_peered":"2023-11-27T20:42:37.534045+0000","last_clean":"2023-11-27T20:42:37.534045+0000","last_became_active":"2023-11-27T20:42:37.529543+0000","last_became_peered":"2023-11-27T20:42:37.529543+0000","last_unstale":"2023-11-27T20:42:37.534045+0000","last_undegraded":"2023-11-27T20:42:37.534045+0000","last_fullsized":"2023-11-27T20:42:37.534045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503706+0000","last_change":"2023-11-27T20:42:37.503706+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503706+0000","last_undegraded":"2023-11-27T20:42:37.503706+0000","last_fullsized":"2023-11-27T20:42:37.503706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537539+0000","last_change":"2023-11-27T20:42:37.530919+0000","last_active":"2023-11-27T20:42:37.537539+0000","last_peered":"2023-11-27T20:42:37.537539+0000","last_clean":"2023-11-27T20:42:37.537539+0000","last_became_active":"2023-11-27T20:42:37.530606+0000","last_became_peered":"2023-11-27T20:42:37.530606+0000","last_unstale":"2023-11-27T20:42:37.537539+0000","last_undegraded":"2023-11-27T20:42:37.537539+0000","last_fullsized":"2023-11-27T20:42:37.537539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:05:16.047989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502275+0000","last_change":"2023-11-27T20:42:37.502275+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502275+0000","last_undegraded":"2023-11-27T20:42:37.502275+0000","last_fullsized":"2023-11-27T20:42:37.502275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537006+0000","last_change":"2023-11-27T20:42:37.533800+0000","last_active":"2023-11-27T20:42:37.537006+0000","last_peered":"2023-11-27T20:42:37.537006+0000","last_clean":"2023-11-27T20:42:37.537006+0000","last_became_active":"2023-11-27T20:42:37.533358+0000","last_became_peered":"2023-11-27T20:42:37.533358+0000","last_unstale":"2023-11-27T20:42:37.537006+0000","last_undegraded":"2023-11-27T20:42:37.537006+0000","last_fullsized":"2023-11-27T20:42:37.537006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.523128+0000","last_change":"2023-11-27T20:42:37.523128+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.523128+0000","last_undegraded":"2023-11-27T20:42:37.523128+0000","last_fullsized":"2023-11-27T20:42:37.523128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527729+0000","last_change":"2023-11-27T20:42:37.523367+0000","last_active":"2023-11-27T20:42:37.527729+0000","last_peered":"2023-11-27T20:42:37.527729+0000","last_clean":"2023-11-27T20:42:37.527729+0000","last_became_active":"2023-11-27T20:42:37.522948+0000","last_became_peered":"2023-11-27T20:42:37.522948+0000","last_unstale":"2023-11-27T20:42:37.527729+0000","last_undegraded":"2023-11-27T20:42:37.527729+0000","last_fullsized":"2023-11-27T20:42:37.527729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-27T20:42:36.508328+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:42:36.508328+0000","last_peered":"2023-11-27T20:42:36.508328+0000","last_clean":"2023-11-27T20:42:36.508328+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:42:36.508328+0000","last_undegraded":"2023-11-27T20:42:36.508328+0000","last_fullsized":"2023-11-27T20:42:36.508328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0760000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2010000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.4039999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.248}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.367}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.573}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.006},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.95799999999999996}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.196},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.1579999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.88900000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3919999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.107},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":3.536,"5min":3.536,"15min":3.536},"last":1.2549999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.3}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.583},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.6499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.50800000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.379},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.433},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.47899999999999998}]},{"osd":3,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":0.58499999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2149999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.71399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.671}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.105},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.448}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.286},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.234}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.5940000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.3420000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.732}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.7849999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.442}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.8050000000000002,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.91300000000000003}]},{"osd":6,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":0.871},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.1140000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.66100000000000003}]},{"osd":1,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.90200000000000002},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.77000000000000002}]},{"osd":3,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.82499999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.044},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.3540000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.508}]},{"osd":6,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.272},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":1.585}]},{"osd":7,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.3}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.5449999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.4410000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.337}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.615},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.4930000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.133}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.71}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.98299999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":0.95999999999999996}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.181},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.83399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:42:42.947 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:42:43.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.189+0000 7fec0ee00640 1 Processor -- start 2023-11-27T20:42:43.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.190+0000 7fec0ee00640 1 -- start start 2023-11-27T20:42:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.191+0000 7fec0ee00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814fd30 0x7fec08152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.191+0000 7fec0ee00640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec080c64a0 con 0x7fec080c3ea0 2023-11-27T20:42:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.191+0000 7fec0ee00640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec080c5c00 con 0x7fec0806d0a0 2023-11-27T20:42:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.191+0000 7fec0ee00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec080c5ee0 con 0x7fec0814fd30 2023-11-27T20:42:43.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.191+0000 7fec0d39d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fec080c3ea0 0x7fec080c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:35776/0 (socket says 172.21.15.91:35776) 2023-11-27T20:42:43.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.191+0000 7fec0d39d640 1 -- 172.21.15.91:0/2951259427 learned_addr learned my addr 172.21.15.91:0/2951259427 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:43.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec0cb9c640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814fd30 0x7fec08152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718350906 0 0) 0x7fec080c64a0 con 0x7fec080c3ea0 2023-11-27T20:42:43.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf8003520 con 0x7fec080c3ea0 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1054082076 0 0) 0x7febf8003520 con 0x7fec080c3ea0 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814fd30 msgr2=0x7fec08152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814fd30 0x7fec08152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 >> v1:172.21.15.183:6789/0 conn(0x7fec0806d0a0 legacy=0x7fec080a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec080c61c0 con 0x7fec080c3ea0 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fec000019f0 con 0x7fec080c3ea0 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 >> v1:172.21.15.91:6789/0 conn(0x7fec080c3ea0 legacy=0x7fec080c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814fd30 0x7febf80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febf8003f20 0x7febf80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf8004d00 0x7febf8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec080c5ee0 con 0x7febf8003f20 2023-11-27T20:42:43.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf800ba60 con 0x7febf8004d00 2023-11-27T20:42:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.192+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf800bc20 con 0x7fec0814fd30 2023-11-27T20:42:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.193+0000 7fec07fff640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febf8003f20 0x7febf80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.193+0000 7fec0cb9c640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814fd30 0x7febf80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.193+0000 7fec0d39d640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf8004d00 0x7febf8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.193+0000 7fec07fff640 1 -- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814fd30 msgr2=0x7febf80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.193+0000 7fec07fff640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814fd30 0x7febf80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.193+0000 7fec07fff640 1 -- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf8004d00 msgr2=0x7febf8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.193+0000 7fec07fff640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf8004d00 0x7febf8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.193+0000 7fec07fff640 1 -- 172.21.15.91:0/2951259427 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8003520 con 0x7febf8003f20 2023-11-27T20:42:43.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.194+0000 7fec07fff640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febf8003f20 0x7febf80047c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7febf4001720 tx=0x7febf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db3a9ce85d4214f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:43.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.194+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40052d0 con 0x7febf8003f20 2023-11-27T20:42:43.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.194+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf402e050 con 0x7febf8003f20 2023-11-27T20:42:43.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.194+0000 7fec077fe640 1 -- 172.21.15.91:0/2951259427 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4003830 con 0x7febf8003f20 2023-11-27T20:42:43.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.195+0000 7fec0ee00640 1 -- 172.21.15.91:0/2951259427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febf8003f20 msgr2=0x7febf80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.195+0000 7fec0ee00640 1 --2- 172.21.15.91:0/2951259427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febf8003f20 0x7febf80047c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7febf4001720 tx=0x7febf80057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.195+0000 7fec0d39d640 1 -- 172.21.15.91:0/2951259427 reap_dead start 2023-11-27T20:42:43.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.195+0000 7fec0ee00640 1 -- 172.21.15.91:0/2951259427 shutdown_connections 2023-11-27T20:42:43.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.195+0000 7fec0ee00640 1 -- 172.21.15.91:0/2951259427 >> 172.21.15.91:0/2951259427 conn(0x7fec0806a500 msgr2=0x7fec0806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:43.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.195+0000 7fec0ee00640 1 -- 172.21.15.91:0/2951259427 shutdown_connections 2023-11-27T20:42:43.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.195+0000 7fec0ee00640 1 -- 172.21.15.91:0/2951259427 wait complete. 2023-11-27T20:42:43.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.197+0000 7fec0ee00640 1 Processor -- start 2023-11-27T20:42:43.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.197+0000 7fec0ee00640 1 -- start start 2023-11-27T20:42:43.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec0ee00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf8003f20 0x7fec080711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec0ee00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec081e8dd0 0x7fec0814d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec0ee00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814dec0 0x7fec0814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec0ee00640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec081e6850 con 0x7fec081e8dd0 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec0ee00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec080bbd30 con 0x7febf8003f20 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec0ee00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec081e5cd0 con 0x7fec0814dec0 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec07fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec081e8dd0 0x7fec0814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec07fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec081e8dd0 0x7fec0814d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33798/0 (socket says 172.21.15.91:33798) 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec07fff640 1 -- 172.21.15.91:0/326847613 learned_addr learned my addr 172.21.15.91:0/326847613 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec0cb9c640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf8003f20 0x7fec080711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec07fff640 1 -- 172.21.15.91:0/326847613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814dec0 msgr2=0x7fec0814eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec07fff640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814dec0 0x7fec0814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec07fff640 1 -- 172.21.15.91:0/326847613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf8003f20 msgr2=0x7fec080711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec07fff640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf8003f20 0x7fec080711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec07fff640 1 -- 172.21.15.91:0/326847613 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec081e5fb0 con 0x7fec081e8dd0 2023-11-27T20:42:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.198+0000 7fec0cb9c640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf8003f20 0x7fec080711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.199+0000 7fec07fff640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec081e8dd0 0x7fec0814d980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7febf4005040 tx=0x7febf4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.199+0000 7fec057fa640 1 -- 172.21.15.91:0/326847613 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40076c0 con 0x7fec081e8dd0 2023-11-27T20:42:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.199+0000 7fec057fa640 1 -- 172.21.15.91:0/326847613 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4007a30 con 0x7fec081e8dd0 2023-11-27T20:42:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.199+0000 7fec057fa640 1 -- 172.21.15.91:0/326847613 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4006be0 con 0x7fec081e8dd0 2023-11-27T20:42:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.199+0000 7fec0ee00640 1 -- 172.21.15.91:0/326847613 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec081e6290 con 0x7fec081e8dd0 2023-11-27T20:42:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.199+0000 7fec0ee00640 1 -- 172.21.15.91:0/326847613 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec08071730 con 0x7fec081e8dd0 2023-11-27T20:42:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.200+0000 7fec0ee00640 1 -- 172.21.15.91:0/326847613 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec081e67b0 con 0x7fec081e8dd0 2023-11-27T20:42:43.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.201+0000 7fec057fa640 1 -- 172.21.15.91:0/326847613 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7febf4006d40 con 0x7fec081e8dd0 2023-11-27T20:42:43.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.202+0000 7fec057fa640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7febec06b240 0x7febec06d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.202+0000 7fec057fa640 1 -- 172.21.15.91:0/326847613 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febf40ab7b0 con 0x7fec081e8dd0 2023-11-27T20:42:43.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.202+0000 7fec0cb9c640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7febec06b240 0x7febec06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.203+0000 7fec0cb9c640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7febec06b240 0x7febec06d700 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7febfc009a00 tx=0x7febfc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:43.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.207+0000 7fec057fa640 1 -- 172.21.15.91:0/326847613 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7febf40765e0 con 0x7fec081e8dd0 2023-11-27T20:42:43.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.392+0000 7fec0ee00640 1 -- 172.21.15.91:0/326847613 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec080c4a40 con 0x7febec06b240 2023-11-27T20:42:43.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.415+0000 7fec057fa640 1 -- 172.21.15.91:0/326847613 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281577 (secure 0 0 0) 0x7febfc012950 con 0x7febec06b240 2023-11-27T20:42:43.418 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:43.420 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:42:43.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 -- 172.21.15.91:0/326847613 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7febec06b240 msgr2=0x7febec06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7febec06b240 0x7febec06d700 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7febfc009a00 tx=0x7febfc008040 comp rx=0 tx=0).stop 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 -- 172.21.15.91:0/326847613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec081e8dd0 msgr2=0x7fec0814d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec081e8dd0 0x7fec0814d980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7febf4005040 tx=0x7febf4001120 comp rx=0 tx=0).stop 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 -- 172.21.15.91:0/326847613 shutdown_connections 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0814dec0 0x7fec0814eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec081e8dd0 0x7fec0814d980 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7febec06b240 0x7febec06d700 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 --2- 172.21.15.91:0/326847613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf8003f20 0x7fec080711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 -- 172.21.15.91:0/326847613 >> 172.21.15.91:0/326847613 conn(0x7fec0806a500 msgr2=0x7fec0806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 -- 172.21.15.91:0/326847613 shutdown_connections 2023-11-27T20:42:43.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.420+0000 7fec0ee00640 1 -- 172.21.15.91:0/326847613 wait complete. 2023-11-27T20:42:43.440 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-27T20:42:43.392891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220120,"kb_used_data":3940,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754600,"statfs":{"total":773094113280,"available":772868710400,"internally_reserved":0,"allocated":4034560,"data_stored":2272847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002019"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.507171+0000","last_change":"2023-11-27T20:42:37.507171+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.507171+0000","last_undegraded":"2023-11-27T20:42:37.507171+0000","last_fullsized":"2023-11-27T20:42:37.507171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.512450+0000","last_change":"2023-11-27T20:42:37.512450+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.512450+0000","last_undegraded":"2023-11-27T20:42:37.512450+0000","last_fullsized":"2023-11-27T20:42:37.512450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518057+0000","last_change":"2023-11-27T20:42:37.518057+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518057+0000","last_undegraded":"2023-11-27T20:42:37.518057+0000","last_fullsized":"2023-11-27T20:42:37.518057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.510195+0000","last_change":"2023-11-27T20:42:37.510195+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.510195+0000","last_undegraded":"2023-11-27T20:42:37.510195+0000","last_fullsized":"2023-11-27T20:42:37.510195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515787+0000","last_change":"2023-11-27T20:42:37.515787+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515787+0000","last_undegraded":"2023-11-27T20:42:37.515787+0000","last_fullsized":"2023-11-27T20:42:37.515787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511964+0000","last_change":"2023-11-27T20:42:37.511964+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511964+0000","last_undegraded":"2023-11-27T20:42:37.511964+0000","last_fullsized":"2023-11-27T20:42:37.511964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.523443+0000","last_change":"2023-11-27T20:42:37.523443+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.523443+0000","last_undegraded":"2023-11-27T20:42:37.523443+0000","last_fullsized":"2023-11-27T20:42:37.523443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.528897+0000","last_change":"2023-11-27T20:42:37.528897+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.528897+0000","last_undegraded":"2023-11-27T20:42:37.528897+0000","last_fullsized":"2023-11-27T20:42:37.528897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.501968+0000","last_change":"2023-11-27T20:42:37.501968+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.501968+0000","last_undegraded":"2023-11-27T20:42:37.501968+0000","last_fullsized":"2023-11-27T20:42:37.501968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504322+0000","last_change":"2023-11-27T20:42:37.504322+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504322+0000","last_undegraded":"2023-11-27T20:42:37.504322+0000","last_fullsized":"2023-11-27T20:42:37.504322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.521826+0000","last_change":"2023-11-27T20:42:37.521826+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.521826+0000","last_undegraded":"2023-11-27T20:42:37.521826+0000","last_fullsized":"2023-11-27T20:42:37.521826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514524+0000","last_change":"2023-11-27T20:42:37.514524+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514524+0000","last_undegraded":"2023-11-27T20:42:37.514524+0000","last_fullsized":"2023-11-27T20:42:37.514524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515208+0000","last_change":"2023-11-27T20:42:37.515208+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515208+0000","last_undegraded":"2023-11-27T20:42:37.515208+0000","last_fullsized":"2023-11-27T20:42:37.515208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511574+0000","last_change":"2023-11-27T20:42:37.511574+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511574+0000","last_undegraded":"2023-11-27T20:42:37.511574+0000","last_fullsized":"2023-11-27T20:42:37.511574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519349+0000","last_change":"2023-11-27T20:42:37.519349+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519349+0000","last_undegraded":"2023-11-27T20:42:37.519349+0000","last_fullsized":"2023-11-27T20:42:37.519349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519684+0000","last_change":"2023-11-27T20:42:37.519684+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519684+0000","last_undegraded":"2023-11-27T20:42:37.519684+0000","last_fullsized":"2023-11-27T20:42:37.519684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.522777+0000","last_change":"2023-11-27T20:42:37.522777+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.522777+0000","last_undegraded":"2023-11-27T20:42:37.522777+0000","last_fullsized":"2023-11-27T20:42:37.522777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511548+0000","last_change":"2023-11-27T20:42:37.511548+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511548+0000","last_undegraded":"2023-11-27T20:42:37.511548+0000","last_fullsized":"2023-11-27T20:42:37.511548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511531+0000","last_change":"2023-11-27T20:42:37.511531+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511531+0000","last_undegraded":"2023-11-27T20:42:37.511531+0000","last_fullsized":"2023-11-27T20:42:37.511531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518559+0000","last_change":"2023-11-27T20:42:37.518559+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518559+0000","last_undegraded":"2023-11-27T20:42:37.518559+0000","last_fullsized":"2023-11-27T20:42:37.518559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.506586+0000","last_change":"2023-11-27T20:42:37.506586+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.506586+0000","last_undegraded":"2023-11-27T20:42:37.506586+0000","last_fullsized":"2023-11-27T20:42:37.506586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504134+0000","last_change":"2023-11-27T20:42:37.504134+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504134+0000","last_undegraded":"2023-11-27T20:42:37.504134+0000","last_fullsized":"2023-11-27T20:42:37.504134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515948+0000","last_change":"2023-11-27T20:42:37.515948+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515948+0000","last_undegraded":"2023-11-27T20:42:37.515948+0000","last_fullsized":"2023-11-27T20:42:37.515948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514796+0000","last_change":"2023-11-27T20:42:37.514796+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514796+0000","last_undegraded":"2023-11-27T20:42:37.514796+0000","last_fullsized":"2023-11-27T20:42:37.514796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508064+0000","last_change":"2023-11-27T20:42:37.508064+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508064+0000","last_undegraded":"2023-11-27T20:42:37.508064+0000","last_fullsized":"2023-11-27T20:42:37.508064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.510504+0000","last_change":"2023-11-27T20:42:37.510504+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.510504+0000","last_undegraded":"2023-11-27T20:42:37.510504+0000","last_fullsized":"2023-11-27T20:42:37.510504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513568+0000","last_change":"2023-11-27T20:42:37.513568+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513568+0000","last_undegraded":"2023-11-27T20:42:37.513568+0000","last_fullsized":"2023-11-27T20:42:37.513568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511588+0000","last_change":"2023-11-27T20:42:37.511588+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511588+0000","last_undegraded":"2023-11-27T20:42:37.511588+0000","last_fullsized":"2023-11-27T20:42:37.511588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503780+0000","last_change":"2023-11-27T20:42:37.503780+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503780+0000","last_undegraded":"2023-11-27T20:42:37.503780+0000","last_fullsized":"2023-11-27T20:42:37.503780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.520838+0000","last_change":"2023-11-27T20:42:37.520838+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.520838+0000","last_undegraded":"2023-11-27T20:42:37.520838+0000","last_fullsized":"2023-11-27T20:42:37.520838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504137+0000","last_change":"2023-11-27T20:42:37.504137+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504137+0000","last_undegraded":"2023-11-27T20:42:37.504137+0000","last_fullsized":"2023-11-27T20:42:37.504137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.528425+0000","last_change":"2023-11-27T20:42:37.528425+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.528425+0000","last_undegraded":"2023-11-27T20:42:37.528425+0000","last_fullsized":"2023-11-27T20:42:37.528425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519836+0000","last_change":"2023-11-27T20:42:37.519836+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519836+0000","last_undegraded":"2023-11-27T20:42:37.519836+0000","last_fullsized":"2023-11-27T20:42:37.519836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.532488+0000","last_change":"2023-11-27T20:42:37.528294+0000","last_active":"2023-11-27T20:42:37.532488+0000","last_peered":"2023-11-27T20:42:37.532488+0000","last_clean":"2023-11-27T20:42:37.532488+0000","last_became_active":"2023-11-27T20:42:37.528055+0000","last_became_peered":"2023-11-27T20:42:37.528055+0000","last_unstale":"2023-11-27T20:42:37.532488+0000","last_undegraded":"2023-11-27T20:42:37.532488+0000","last_fullsized":"2023-11-27T20:42:37.532488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.506060+0000","last_change":"2023-11-27T20:42:37.506060+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.506060+0000","last_undegraded":"2023-11-27T20:42:37.506060+0000","last_fullsized":"2023-11-27T20:42:37.506060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.539636+0000","last_change":"2023-11-27T20:42:37.535511+0000","last_active":"2023-11-27T20:42:37.539636+0000","last_peered":"2023-11-27T20:42:37.539636+0000","last_clean":"2023-11-27T20:42:37.539636+0000","last_became_active":"2023-11-27T20:42:37.535314+0000","last_became_peered":"2023-11-27T20:42:37.535314+0000","last_unstale":"2023-11-27T20:42:37.539636+0000","last_undegraded":"2023-11-27T20:42:37.539636+0000","last_fullsized":"2023-11-27T20:42:37.539636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:47.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502494+0000","last_change":"2023-11-27T20:42:37.502494+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502494+0000","last_undegraded":"2023-11-27T20:42:37.502494+0000","last_fullsized":"2023-11-27T20:42:37.502494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.529016+0000","last_change":"2023-11-27T20:42:37.520015+0000","last_active":"2023-11-27T20:42:37.529016+0000","last_peered":"2023-11-27T20:42:37.529016+0000","last_clean":"2023-11-27T20:42:37.529016+0000","last_became_active":"2023-11-27T20:42:37.519779+0000","last_became_peered":"2023-11-27T20:42:37.519779+0000","last_unstale":"2023-11-27T20:42:37.529016+0000","last_undegraded":"2023-11-27T20:42:37.529016+0000","last_fullsized":"2023-11-27T20:42:37.529016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513095+0000","last_change":"2023-11-27T20:42:37.513095+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513095+0000","last_undegraded":"2023-11-27T20:42:37.513095+0000","last_fullsized":"2023-11-27T20:42:37.513095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533841+0000","last_change":"2023-11-27T20:42:37.530074+0000","last_active":"2023-11-27T20:42:37.533841+0000","last_peered":"2023-11-27T20:42:37.533841+0000","last_clean":"2023-11-27T20:42:37.533841+0000","last_became_active":"2023-11-27T20:42:37.529422+0000","last_became_peered":"2023-11-27T20:42:37.529422+0000","last_unstale":"2023-11-27T20:42:37.533841+0000","last_undegraded":"2023-11-27T20:42:37.533841+0000","last_fullsized":"2023-11-27T20:42:37.533841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:32:25.861163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.520224+0000","last_change":"2023-11-27T20:42:37.520224+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.520224+0000","last_undegraded":"2023-11-27T20:42:37.520224+0000","last_fullsized":"2023-11-27T20:42:37.520224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533860+0000","last_change":"2023-11-27T20:42:37.527381+0000","last_active":"2023-11-27T20:42:37.533860+0000","last_peered":"2023-11-27T20:42:37.533860+0000","last_clean":"2023-11-27T20:42:37.533860+0000","last_became_active":"2023-11-27T20:42:37.527147+0000","last_became_peered":"2023-11-27T20:42:37.527147+0000","last_unstale":"2023-11-27T20:42:37.533860+0000","last_undegraded":"2023-11-27T20:42:37.533860+0000","last_fullsized":"2023-11-27T20:42:37.533860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:28:47.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514071+0000","last_change":"2023-11-27T20:42:37.514071+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514071+0000","last_undegraded":"2023-11-27T20:42:37.514071+0000","last_fullsized":"2023-11-27T20:42:37.514071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537556+0000","last_change":"2023-11-27T20:42:37.531654+0000","last_active":"2023-11-27T20:42:37.537556+0000","last_peered":"2023-11-27T20:42:37.537556+0000","last_clean":"2023-11-27T20:42:37.537556+0000","last_became_active":"2023-11-27T20:42:37.529901+0000","last_became_peered":"2023-11-27T20:42:37.529901+0000","last_unstale":"2023-11-27T20:42:37.537556+0000","last_undegraded":"2023-11-27T20:42:37.537556+0000","last_fullsized":"2023-11-27T20:42:37.537556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:25:52.361215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.501269+0000","last_change":"2023-11-27T20:42:37.501269+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.501269+0000","last_undegraded":"2023-11-27T20:42:37.501269+0000","last_fullsized":"2023-11-27T20:42:37.501269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.528979+0000","last_change":"2023-11-27T20:42:37.522964+0000","last_active":"2023-11-27T20:42:37.528979+0000","last_peered":"2023-11-27T20:42:37.528979+0000","last_clean":"2023-11-27T20:42:37.528979+0000","last_became_active":"2023-11-27T20:42:37.522677+0000","last_became_peered":"2023-11-27T20:42:37.522677+0000","last_unstale":"2023-11-27T20:42:37.528979+0000","last_undegraded":"2023-11-27T20:42:37.528979+0000","last_fullsized":"2023-11-27T20:42:37.528979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:42.888540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503711+0000","last_change":"2023-11-27T20:42:37.503711+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503711+0000","last_undegraded":"2023-11-27T20:42:37.503711+0000","last_fullsized":"2023-11-27T20:42:37.503711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527926+0000","last_change":"2023-11-27T20:42:37.522230+0000","last_active":"2023-11-27T20:42:37.527926+0000","last_peered":"2023-11-27T20:42:37.527926+0000","last_clean":"2023-11-27T20:42:37.527926+0000","last_became_active":"2023-11-27T20:42:37.521898+0000","last_became_peered":"2023-11-27T20:42:37.521898+0000","last_unstale":"2023-11-27T20:42:37.527926+0000","last_undegraded":"2023-11-27T20:42:37.527926+0000","last_fullsized":"2023-11-27T20:42:37.527926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:29:17.198964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511614+0000","last_change":"2023-11-27T20:42:37.511614+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511614+0000","last_undegraded":"2023-11-27T20:42:37.511614+0000","last_fullsized":"2023-11-27T20:42:37.511614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536950+0000","last_change":"2023-11-27T20:42:37.531762+0000","last_active":"2023-11-27T20:42:37.536950+0000","last_peered":"2023-11-27T20:42:37.536950+0000","last_clean":"2023-11-27T20:42:37.536950+0000","last_became_active":"2023-11-27T20:42:37.531446+0000","last_became_peered":"2023-11-27T20:42:37.531446+0000","last_unstale":"2023-11-27T20:42:37.536950+0000","last_undegraded":"2023-11-27T20:42:37.536950+0000","last_fullsized":"2023-11-27T20:42:37.536950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:16:18.992040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.512794+0000","last_change":"2023-11-27T20:42:37.512794+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.512794+0000","last_undegraded":"2023-11-27T20:42:37.512794+0000","last_fullsized":"2023-11-27T20:42:37.512794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536897+0000","last_change":"2023-11-27T20:42:37.532869+0000","last_active":"2023-11-27T20:42:37.536897+0000","last_peered":"2023-11-27T20:42:37.536897+0000","last_clean":"2023-11-27T20:42:37.536897+0000","last_became_active":"2023-11-27T20:42:37.532576+0000","last_became_peered":"2023-11-27T20:42:37.532576+0000","last_unstale":"2023-11-27T20:42:37.536897+0000","last_undegraded":"2023-11-27T20:42:37.536897+0000","last_fullsized":"2023-11-27T20:42:37.536897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508823+0000","last_change":"2023-11-27T20:42:37.508823+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508823+0000","last_undegraded":"2023-11-27T20:42:37.508823+0000","last_fullsized":"2023-11-27T20:42:37.508823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536684+0000","last_change":"2023-11-27T20:42:37.530460+0000","last_active":"2023-11-27T20:42:37.536684+0000","last_peered":"2023-11-27T20:42:37.536684+0000","last_clean":"2023-11-27T20:42:37.536684+0000","last_became_active":"2023-11-27T20:42:37.529879+0000","last_became_peered":"2023-11-27T20:42:37.529879+0000","last_unstale":"2023-11-27T20:42:37.536684+0000","last_undegraded":"2023-11-27T20:42:37.536684+0000","last_fullsized":"2023-11-27T20:42:37.536684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:42.888540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518638+0000","last_change":"2023-11-27T20:42:37.518638+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518638+0000","last_undegraded":"2023-11-27T20:42:37.518638+0000","last_fullsized":"2023-11-27T20:42:37.518638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531644+0000","last_change":"2023-11-27T20:42:37.523173+0000","last_active":"2023-11-27T20:42:37.531644+0000","last_peered":"2023-11-27T20:42:37.531644+0000","last_clean":"2023-11-27T20:42:37.531644+0000","last_became_active":"2023-11-27T20:42:37.522903+0000","last_became_peered":"2023-11-27T20:42:37.522903+0000","last_unstale":"2023-11-27T20:42:37.531644+0000","last_undegraded":"2023-11-27T20:42:37.531644+0000","last_fullsized":"2023-11-27T20:42:37.531644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:47.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505436+0000","last_change":"2023-11-27T20:42:37.505436+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505436+0000","last_undegraded":"2023-11-27T20:42:37.505436+0000","last_fullsized":"2023-11-27T20:42:37.505436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533633+0000","last_change":"2023-11-27T20:42:37.524294+0000","last_active":"2023-11-27T20:42:37.533633+0000","last_peered":"2023-11-27T20:42:37.533633+0000","last_clean":"2023-11-27T20:42:37.533633+0000","last_became_active":"2023-11-27T20:42:37.523858+0000","last_became_peered":"2023-11-27T20:42:37.523858+0000","last_unstale":"2023-11-27T20:42:37.533633+0000","last_undegraded":"2023-11-27T20:42:37.533633+0000","last_fullsized":"2023-11-27T20:42:37.533633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:02:50.193416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508941+0000","last_change":"2023-11-27T20:42:37.508941+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508941+0000","last_undegraded":"2023-11-27T20:42:37.508941+0000","last_fullsized":"2023-11-27T20:42:37.508941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.530936+0000","last_change":"2023-11-27T20:42:37.522904+0000","last_active":"2023-11-27T20:42:37.530936+0000","last_peered":"2023-11-27T20:42:37.530936+0000","last_clean":"2023-11-27T20:42:37.530936+0000","last_became_active":"2023-11-27T20:42:37.522574+0000","last_became_peered":"2023-11-27T20:42:37.522574+0000","last_unstale":"2023-11-27T20:42:37.530936+0000","last_undegraded":"2023-11-27T20:42:37.530936+0000","last_fullsized":"2023-11-27T20:42:37.530936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:37.188919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.527110+0000","last_change":"2023-11-27T20:42:37.527110+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.527110+0000","last_undegraded":"2023-11-27T20:42:37.527110+0000","last_fullsized":"2023-11-27T20:42:37.527110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.539619+0000","last_change":"2023-11-27T20:42:37.535247+0000","last_active":"2023-11-27T20:42:37.539619+0000","last_peered":"2023-11-27T20:42:37.539619+0000","last_clean":"2023-11-27T20:42:37.539619+0000","last_became_active":"2023-11-27T20:42:37.534922+0000","last_became_peered":"2023-11-27T20:42:37.534922+0000","last_unstale":"2023-11-27T20:42:37.539619+0000","last_undegraded":"2023-11-27T20:42:37.539619+0000","last_fullsized":"2023-11-27T20:42:37.539619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502506+0000","last_change":"2023-11-27T20:42:37.502506+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502506+0000","last_undegraded":"2023-11-27T20:42:37.502506+0000","last_fullsized":"2023-11-27T20:42:37.502506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.524213+0000","last_change":"2023-11-27T20:42:37.514338+0000","last_active":"2023-11-27T20:42:37.524213+0000","last_peered":"2023-11-27T20:42:37.524213+0000","last_clean":"2023-11-27T20:42:37.524213+0000","last_became_active":"2023-11-27T20:42:37.514055+0000","last_became_peered":"2023-11-27T20:42:37.514055+0000","last_unstale":"2023-11-27T20:42:37.524213+0000","last_undegraded":"2023-11-27T20:42:37.524213+0000","last_fullsized":"2023-11-27T20:42:37.524213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505512+0000","last_change":"2023-11-27T20:42:37.505512+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505512+0000","last_undegraded":"2023-11-27T20:42:37.505512+0000","last_fullsized":"2023-11-27T20:42:37.505512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531502+0000","last_change":"2023-11-27T20:42:37.525560+0000","last_active":"2023-11-27T20:42:37.531502+0000","last_peered":"2023-11-27T20:42:37.531502+0000","last_clean":"2023-11-27T20:42:37.531502+0000","last_became_active":"2023-11-27T20:42:37.525261+0000","last_became_peered":"2023-11-27T20:42:37.525261+0000","last_unstale":"2023-11-27T20:42:37.531502+0000","last_undegraded":"2023-11-27T20:42:37.531502+0000","last_fullsized":"2023-11-27T20:42:37.531502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516690+0000","last_change":"2023-11-27T20:42:37.516690+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516690+0000","last_undegraded":"2023-11-27T20:42:37.516690+0000","last_fullsized":"2023-11-27T20:42:37.516690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527935+0000","last_change":"2023-11-27T20:42:37.522245+0000","last_active":"2023-11-27T20:42:37.527935+0000","last_peered":"2023-11-27T20:42:37.527935+0000","last_clean":"2023-11-27T20:42:37.527935+0000","last_became_active":"2023-11-27T20:42:37.521938+0000","last_became_peered":"2023-11-27T20:42:37.521938+0000","last_unstale":"2023-11-27T20:42:37.527935+0000","last_undegraded":"2023-11-27T20:42:37.527935+0000","last_fullsized":"2023-11-27T20:42:37.527935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:47:06.669263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505173+0000","last_change":"2023-11-27T20:42:37.505173+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505173+0000","last_undegraded":"2023-11-27T20:42:37.505173+0000","last_fullsized":"2023-11-27T20:42:37.505173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533733+0000","last_change":"2023-11-27T20:42:37.525601+0000","last_active":"2023-11-27T20:42:37.533733+0000","last_peered":"2023-11-27T20:42:37.533733+0000","last_clean":"2023-11-27T20:42:37.533733+0000","last_became_active":"2023-11-27T20:42:37.525296+0000","last_became_peered":"2023-11-27T20:42:37.525296+0000","last_unstale":"2023-11-27T20:42:37.533733+0000","last_undegraded":"2023-11-27T20:42:37.533733+0000","last_fullsized":"2023-11-27T20:42:37.533733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:09:22.812521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517575+0000","last_change":"2023-11-27T20:42:37.517575+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517575+0000","last_undegraded":"2023-11-27T20:42:37.517575+0000","last_fullsized":"2023-11-27T20:42:37.517575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533779+0000","last_change":"2023-11-27T20:42:37.527131+0000","last_active":"2023-11-27T20:42:37.533779+0000","last_peered":"2023-11-27T20:42:37.533779+0000","last_clean":"2023-11-27T20:42:37.533779+0000","last_became_active":"2023-11-27T20:42:37.526804+0000","last_became_peered":"2023-11-27T20:42:37.526804+0000","last_unstale":"2023-11-27T20:42:37.533779+0000","last_undegraded":"2023-11-27T20:42:37.533779+0000","last_fullsized":"2023-11-27T20:42:37.533779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:05.189004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513949+0000","last_change":"2023-11-27T20:42:37.513949+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513949+0000","last_undegraded":"2023-11-27T20:42:37.513949+0000","last_fullsized":"2023-11-27T20:42:37.513949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531689+0000","last_change":"2023-11-27T20:42:37.527591+0000","last_active":"2023-11-27T20:42:37.531689+0000","last_peered":"2023-11-27T20:42:37.531689+0000","last_clean":"2023-11-27T20:42:37.531689+0000","last_became_active":"2023-11-27T20:42:37.527305+0000","last_became_peered":"2023-11-27T20:42:37.527305+0000","last_unstale":"2023-11-27T20:42:37.531689+0000","last_undegraded":"2023-11-27T20:42:37.531689+0000","last_fullsized":"2023-11-27T20:42:37.531689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514521+0000","last_change":"2023-11-27T20:42:37.514521+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514521+0000","last_undegraded":"2023-11-27T20:42:37.514521+0000","last_fullsized":"2023-11-27T20:42:37.514521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.525562+0000","last_change":"2023-11-27T20:42:37.522543+0000","last_active":"2023-11-27T20:42:37.525562+0000","last_peered":"2023-11-27T20:42:37.525562+0000","last_clean":"2023-11-27T20:42:37.525562+0000","last_became_active":"2023-11-27T20:42:37.522163+0000","last_became_peered":"2023-11-27T20:42:37.522163+0000","last_unstale":"2023-11-27T20:42:37.525562+0000","last_undegraded":"2023-11-27T20:42:37.525562+0000","last_fullsized":"2023-11-27T20:42:37.525562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513682+0000","last_change":"2023-11-27T20:42:37.513682+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513682+0000","last_undegraded":"2023-11-27T20:42:37.513682+0000","last_fullsized":"2023-11-27T20:42:37.513682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.522197+0000","last_change":"2023-11-27T20:42:37.518579+0000","last_active":"2023-11-27T20:42:37.522197+0000","last_peered":"2023-11-27T20:42:37.522197+0000","last_clean":"2023-11-27T20:42:37.522197+0000","last_became_active":"2023-11-27T20:42:37.517970+0000","last_became_peered":"2023-11-27T20:42:37.517970+0000","last_unstale":"2023-11-27T20:42:37.522197+0000","last_undegraded":"2023-11-27T20:42:37.522197+0000","last_fullsized":"2023-11-27T20:42:37.522197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:32:25.861163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.526199+0000","last_change":"2023-11-27T20:42:37.526199+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.526199+0000","last_undegraded":"2023-11-27T20:42:37.526199+0000","last_fullsized":"2023-11-27T20:42:37.526199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536771+0000","last_change":"2023-11-27T20:42:37.532212+0000","last_active":"2023-11-27T20:42:37.536771+0000","last_peered":"2023-11-27T20:42:37.536771+0000","last_clean":"2023-11-27T20:42:37.536771+0000","last_became_active":"2023-11-27T20:42:37.531894+0000","last_became_peered":"2023-11-27T20:42:37.531894+0000","last_unstale":"2023-11-27T20:42:37.536771+0000","last_undegraded":"2023-11-27T20:42:37.536771+0000","last_fullsized":"2023-11-27T20:42:37.536771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516658+0000","last_change":"2023-11-27T20:42:37.516658+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516658+0000","last_undegraded":"2023-11-27T20:42:37.516658+0000","last_fullsized":"2023-11-27T20:42:37.516658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534076+0000","last_change":"2023-11-27T20:42:37.530114+0000","last_active":"2023-11-27T20:42:37.534076+0000","last_peered":"2023-11-27T20:42:37.534076+0000","last_clean":"2023-11-27T20:42:37.534076+0000","last_became_active":"2023-11-27T20:42:37.529838+0000","last_became_peered":"2023-11-27T20:42:37.529838+0000","last_unstale":"2023-11-27T20:42:37.534076+0000","last_undegraded":"2023-11-27T20:42:37.534076+0000","last_fullsized":"2023-11-27T20:42:37.534076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516148+0000","last_change":"2023-11-27T20:42:37.516148+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516148+0000","last_undegraded":"2023-11-27T20:42:37.516148+0000","last_fullsized":"2023-11-27T20:42:37.516148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534123+0000","last_change":"2023-11-27T20:42:37.528142+0000","last_active":"2023-11-27T20:42:37.534123+0000","last_peered":"2023-11-27T20:42:37.534123+0000","last_clean":"2023-11-27T20:42:37.534123+0000","last_became_active":"2023-11-27T20:42:37.527318+0000","last_became_peered":"2023-11-27T20:42:37.527318+0000","last_unstale":"2023-11-27T20:42:37.534123+0000","last_undegraded":"2023-11-27T20:42:37.534123+0000","last_fullsized":"2023-11-27T20:42:37.534123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517148+0000","last_change":"2023-11-27T20:42:37.517148+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517148+0000","last_undegraded":"2023-11-27T20:42:37.517148+0000","last_fullsized":"2023-11-27T20:42:37.517148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533948+0000","last_change":"2023-11-27T20:42:37.527056+0000","last_active":"2023-11-27T20:42:37.533948+0000","last_peered":"2023-11-27T20:42:37.533948+0000","last_clean":"2023-11-27T20:42:37.533948+0000","last_became_active":"2023-11-27T20:42:37.526803+0000","last_became_peered":"2023-11-27T20:42:37.526803+0000","last_unstale":"2023-11-27T20:42:37.533948+0000","last_undegraded":"2023-11-27T20:42:37.533948+0000","last_fullsized":"2023-11-27T20:42:37.533948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.507542+0000","last_change":"2023-11-27T20:42:37.507542+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.507542+0000","last_undegraded":"2023-11-27T20:42:37.507542+0000","last_fullsized":"2023-11-27T20:42:37.507542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536858+0000","last_change":"2023-11-27T20:42:37.532441+0000","last_active":"2023-11-27T20:42:37.536858+0000","last_peered":"2023-11-27T20:42:37.536858+0000","last_clean":"2023-11-27T20:42:37.536858+0000","last_became_active":"2023-11-27T20:42:37.532074+0000","last_became_peered":"2023-11-27T20:42:37.532074+0000","last_unstale":"2023-11-27T20:42:37.536858+0000","last_undegraded":"2023-11-27T20:42:37.536858+0000","last_fullsized":"2023-11-27T20:42:37.536858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517601+0000","last_change":"2023-11-27T20:42:37.517601+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517601+0000","last_undegraded":"2023-11-27T20:42:37.517601+0000","last_fullsized":"2023-11-27T20:42:37.517601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534045+0000","last_change":"2023-11-27T20:42:37.529807+0000","last_active":"2023-11-27T20:42:37.534045+0000","last_peered":"2023-11-27T20:42:37.534045+0000","last_clean":"2023-11-27T20:42:37.534045+0000","last_became_active":"2023-11-27T20:42:37.529543+0000","last_became_peered":"2023-11-27T20:42:37.529543+0000","last_unstale":"2023-11-27T20:42:37.534045+0000","last_undegraded":"2023-11-27T20:42:37.534045+0000","last_fullsized":"2023-11-27T20:42:37.534045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503706+0000","last_change":"2023-11-27T20:42:37.503706+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503706+0000","last_undegraded":"2023-11-27T20:42:37.503706+0000","last_fullsized":"2023-11-27T20:42:37.503706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537539+0000","last_change":"2023-11-27T20:42:37.530919+0000","last_active":"2023-11-27T20:42:37.537539+0000","last_peered":"2023-11-27T20:42:37.537539+0000","last_clean":"2023-11-27T20:42:37.537539+0000","last_became_active":"2023-11-27T20:42:37.530606+0000","last_became_peered":"2023-11-27T20:42:37.530606+0000","last_unstale":"2023-11-27T20:42:37.537539+0000","last_undegraded":"2023-11-27T20:42:37.537539+0000","last_fullsized":"2023-11-27T20:42:37.537539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:05:16.047989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502275+0000","last_change":"2023-11-27T20:42:37.502275+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502275+0000","last_undegraded":"2023-11-27T20:42:37.502275+0000","last_fullsized":"2023-11-27T20:42:37.502275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537006+0000","last_change":"2023-11-27T20:42:37.533800+0000","last_active":"2023-11-27T20:42:37.537006+0000","last_peered":"2023-11-27T20:42:37.537006+0000","last_clean":"2023-11-27T20:42:37.537006+0000","last_became_active":"2023-11-27T20:42:37.533358+0000","last_became_peered":"2023-11-27T20:42:37.533358+0000","last_unstale":"2023-11-27T20:42:37.537006+0000","last_undegraded":"2023-11-27T20:42:37.537006+0000","last_fullsized":"2023-11-27T20:42:37.537006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.523128+0000","last_change":"2023-11-27T20:42:37.523128+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.523128+0000","last_undegraded":"2023-11-27T20:42:37.523128+0000","last_fullsized":"2023-11-27T20:42:37.523128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527729+0000","last_change":"2023-11-27T20:42:37.523367+0000","last_active":"2023-11-27T20:42:37.527729+0000","last_peered":"2023-11-27T20:42:37.527729+0000","last_clean":"2023-11-27T20:42:37.527729+0000","last_became_active":"2023-11-27T20:42:37.522948+0000","last_became_peered":"2023-11-27T20:42:37.522948+0000","last_unstale":"2023-11-27T20:42:37.527729+0000","last_undegraded":"2023-11-27T20:42:37.527729+0000","last_fullsized":"2023-11-27T20:42:37.527729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-27T20:42:36.508328+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:42:36.508328+0000","last_peered":"2023-11-27T20:42:36.508328+0000","last_clean":"2023-11-27T20:42:36.508328+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:42:36.508328+0000","last_undegraded":"2023-11-27T20:42:36.508328+0000","last_fullsized":"2023-11-27T20:42:36.508328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0760000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2010000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.4039999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.248}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.367}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.573}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.006},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.95799999999999996}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.196},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.1579999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.88900000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3919999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.107},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":3.536,"5min":3.536,"15min":3.536},"last":1.2549999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.3}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.583},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.6499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.50800000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.379},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.433},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.47899999999999998}]},{"osd":3,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":0.58499999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2149999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.71399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.671}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.105},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.448}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.286},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.234}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.5940000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.3420000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.732}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.7849999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.442}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.8050000000000002,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.91300000000000003}]},{"osd":6,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":0.871},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.1140000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.66100000000000003}]},{"osd":1,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.90200000000000002},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.77000000000000002}]},{"osd":3,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.82499999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.044},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.3540000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.508}]},{"osd":6,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.272},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":1.585}]},{"osd":7,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.3}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.5449999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.4410000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.337}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.615},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.4930000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.133}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.71}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.98299999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":0.95999999999999996}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.181},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.83399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:42:43.445 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:42:43.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.700+0000 7fc6382ad640 1 Processor -- start 2023-11-27T20:42:43.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.700+0000 7fc6382ad640 1 -- start start 2023-11-27T20:42:43.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.701+0000 7fc6382ad640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc63014fd30 0x7fc630152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.701+0000 7fc6382ad640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6300c64a0 con 0x7fc6300c3ea0 2023-11-27T20:42:43.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.701+0000 7fc6382ad640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6300c5c00 con 0x7fc63006d0a0 2023-11-27T20:42:43.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.701+0000 7fc6382ad640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300c5ee0 con 0x7fc63014fd30 2023-11-27T20:42:43.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.701+0000 7fc63684a640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fc6300c3ea0 0x7fc6300c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:35782/0 (socket says 172.21.15.91:35782) 2023-11-27T20:42:43.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc63684a640 1 -- 172.21.15.91:0/139866719 learned_addr learned my addr 172.21.15.91:0/139866719 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:43.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc636049640 1 --2- 172.21.15.91:0/139866719 >> v2:172.21.15.183:3300/0 conn(0x7fc63014fd30 0x7fc630152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558448677 0 0) 0x7fc6300c64a0 con 0x7fc6300c3ea0 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc61c003520 con 0x7fc6300c3ea0 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1781952161 0 0) 0x7fc61c003520 con 0x7fc6300c3ea0 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 >> v2:172.21.15.183:3300/0 conn(0x7fc63014fd30 msgr2=0x7fc630152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 --2- 172.21.15.91:0/139866719 >> v2:172.21.15.183:3300/0 conn(0x7fc63014fd30 0x7fc630152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 >> v1:172.21.15.183:6789/0 conn(0x7fc63006d0a0 legacy=0x7fc6300a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300c61c0 con 0x7fc6300c3ea0 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fc6280019f0 con 0x7fc6300c3ea0 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 >> v1:172.21.15.91:6789/0 conn(0x7fc6300c3ea0 legacy=0x7fc6300c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 --2- 172.21.15.91:0/139866719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc61c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 --2- 172.21.15.91:0/139866719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc61c0047c0 0x7fc61c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 --2- 172.21.15.91:0/139866719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc61c005180 0x7fc61c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.702+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300c5ee0 con 0x7fc61c003970 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.703+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c00c0b0 con 0x7fc61c0047c0 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.703+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c00c270 con 0x7fc61c005180 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.703+0000 7fc636049640 1 --2- 172.21.15.91:0/139866719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc61c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.703+0000 7fc636049640 1 -- 172.21.15.91:0/139866719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc61c005180 msgr2=0x7fc61c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.703+0000 7fc636049640 1 --2- 172.21.15.91:0/139866719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc61c005180 0x7fc61c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.703+0000 7fc636049640 1 -- 172.21.15.91:0/139866719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc61c0047c0 msgr2=0x7fc61c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.703+0000 7fc635848640 1 --2- 172.21.15.91:0/139866719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc61c0047c0 0x7fc61c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.703+0000 7fc636049640 1 --2- 172.21.15.91:0/139866719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc61c0047c0 0x7fc61c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.703+0000 7fc636049640 1 -- 172.21.15.91:0/139866719 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c003520 con 0x7fc61c003970 2023-11-27T20:42:43.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.703+0000 7fc63684a640 1 -- 172.21.15.91:0/139866719 reap_dead start 2023-11-27T20:42:43.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.704+0000 7fc636049640 1 --2- 172.21.15.91:0/139866719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc61c003d70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00ba00 tx=0x7fc61c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eccc826719f58f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:43.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.704+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c032620 con 0x7fc61c003970 2023-11-27T20:42:43.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.704+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c032780 con 0x7fc61c003970 2023-11-27T20:42:43.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.704+0000 7fc635047640 1 -- 172.21.15.91:0/139866719 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c032b10 con 0x7fc61c003970 2023-11-27T20:42:43.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.705+0000 7fc6382ad640 1 -- 172.21.15.91:0/139866719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 msgr2=0x7fc61c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.705+0000 7fc6382ad640 1 --2- 172.21.15.91:0/139866719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc61c003d70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00ba00 tx=0x7fc61c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.705+0000 7fc6382ad640 1 -- 172.21.15.91:0/139866719 shutdown_connections 2023-11-27T20:42:43.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.705+0000 7fc6382ad640 1 --2- 172.21.15.91:0/139866719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc61c003d70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.705+0000 7fc6382ad640 1 -- 172.21.15.91:0/139866719 >> 172.21.15.91:0/139866719 conn(0x7fc63006a500 msgr2=0x7fc63006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:43.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.705+0000 7fc6382ad640 1 -- 172.21.15.91:0/139866719 shutdown_connections 2023-11-27T20:42:43.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.705+0000 7fc6382ad640 1 -- 172.21.15.91:0/139866719 wait complete. 2023-11-27T20:42:43.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.707+0000 7fc6382ad640 1 Processor -- start 2023-11-27T20:42:43.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.707+0000 7fc6382ad640 1 -- start start 2023-11-27T20:42:43.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc6382ad640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc63014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc6382ad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc630071060 0x7fc630153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc6382ad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc630153da0 0x7fc6301ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc6382ad640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6301dbf50 con 0x7fc61c003970 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc6382ad640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300725d0 con 0x7fc630071060 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc6382ad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6301dd400 con 0x7fc630153da0 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc636049640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc63014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc636049640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc63014f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33826/0 (socket says 172.21.15.91:33826) 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc636049640 1 -- 172.21.15.91:0/3786328349 learned_addr learned my addr 172.21.15.91:0/3786328349 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc636049640 1 -- 172.21.15.91:0/3786328349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc630153da0 msgr2=0x7fc6301ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc636049640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc630153da0 0x7fc6301ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc636049640 1 -- 172.21.15.91:0/3786328349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc630071060 msgr2=0x7fc630153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc636049640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc630071060 0x7fc630153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.708+0000 7fc636049640 1 -- 172.21.15.91:0/3786328349 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6301dc370 con 0x7fc61c003970 2023-11-27T20:42:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.709+0000 7fc636049640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc63014f100 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc62c035040 tx=0x7fc62c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.709+0000 7fc626ffd640 1 -- 172.21.15.91:0/3786328349 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c03b620 con 0x7fc61c003970 2023-11-27T20:42:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.709+0000 7fc626ffd640 1 -- 172.21.15.91:0/3786328349 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c03b7a0 con 0x7fc61c003970 2023-11-27T20:42:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.709+0000 7fc6382ad640 1 -- 172.21.15.91:0/3786328349 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6301eaa50 con 0x7fc61c003970 2023-11-27T20:42:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.709+0000 7fc626ffd640 1 -- 172.21.15.91:0/3786328349 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c03bb50 con 0x7fc61c003970 2023-11-27T20:42:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.709+0000 7fc6382ad640 1 -- 172.21.15.91:0/3786328349 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6300c0c80 con 0x7fc61c003970 2023-11-27T20:42:43.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.710+0000 7fc6382ad640 1 -- 172.21.15.91:0/3786328349 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc630068350 con 0x7fc61c003970 2023-11-27T20:42:43.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.711+0000 7fc626ffd640 1 -- 172.21.15.91:0/3786328349 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc62c04e450 con 0x7fc61c003970 2023-11-27T20:42:43.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.712+0000 7fc626ffd640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc61406b210 0x7fc61406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:43.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.712+0000 7fc626ffd640 1 -- 172.21.15.91:0/3786328349 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc62c0ab980 con 0x7fc61c003970 2023-11-27T20:42:43.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.712+0000 7fc635848640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc61406b210 0x7fc61406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:43.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.713+0000 7fc635848640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc61406b210 0x7fc61406d6d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc620007fd0 tx=0x7fc620009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:43.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.716+0000 7fc626ffd640 1 -- 172.21.15.91:0/3786328349 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc62c076820 con 0x7fc61c003970 2023-11-27T20:42:43.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.902+0000 7fc6382ad640 1 -- 172.21.15.91:0/3786328349 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc630152f20 con 0x7fc61406b210 2023-11-27T20:42:43.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.916+0000 7fc626ffd640 1 -- 172.21.15.91:0/3786328349 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281577 (secure 0 0 0) 0x7fc6200050d0 con 0x7fc61406b210 2023-11-27T20:42:43.918 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:43.922 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:42:43.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.922+0000 7fc6382ad640 1 -- 172.21.15.91:0/3786328349 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc61406b210 msgr2=0x7fc61406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.922+0000 7fc6382ad640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc61406b210 0x7fc61406d6d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc620007fd0 tx=0x7fc620009040 comp rx=0 tx=0).stop 2023-11-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.922+0000 7fc6382ad640 1 -- 172.21.15.91:0/3786328349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 msgr2=0x7fc63014f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.922+0000 7fc6382ad640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc63014f100 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc62c035040 tx=0x7fc62c004730 comp rx=0 tx=0).stop 2023-11-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.922+0000 7fc6382ad640 1 -- 172.21.15.91:0/3786328349 shutdown_connections 2023-11-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.922+0000 7fc6382ad640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc630153da0 0x7fc6301ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.922+0000 7fc6382ad640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc61406b210 0x7fc61406d6d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.922+0000 7fc6382ad640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc630071060 0x7fc630153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.922+0000 7fc6382ad640 1 --2- 172.21.15.91:0/3786328349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc61c003970 0x7fc63014f100 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.923+0000 7fc6382ad640 1 -- 172.21.15.91:0/3786328349 >> 172.21.15.91:0/3786328349 conn(0x7fc63006a500 msgr2=0x7fc6300c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.923+0000 7fc6382ad640 1 -- 172.21.15.91:0/3786328349 shutdown_connections 2023-11-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:43.923+0000 7fc6382ad640 1 -- 172.21.15.91:0/3786328349 wait complete. 2023-11-27T20:42:43.943 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-27T20:42:43.392891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220120,"kb_used_data":3940,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754600,"statfs":{"total":773094113280,"available":772868710400,"internally_reserved":0,"allocated":4034560,"data_stored":2272847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002019"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.507171+0000","last_change":"2023-11-27T20:42:37.507171+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.507171+0000","last_undegraded":"2023-11-27T20:42:37.507171+0000","last_fullsized":"2023-11-27T20:42:37.507171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.512450+0000","last_change":"2023-11-27T20:42:37.512450+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.512450+0000","last_undegraded":"2023-11-27T20:42:37.512450+0000","last_fullsized":"2023-11-27T20:42:37.512450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518057+0000","last_change":"2023-11-27T20:42:37.518057+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518057+0000","last_undegraded":"2023-11-27T20:42:37.518057+0000","last_fullsized":"2023-11-27T20:42:37.518057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.510195+0000","last_change":"2023-11-27T20:42:37.510195+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.510195+0000","last_undegraded":"2023-11-27T20:42:37.510195+0000","last_fullsized":"2023-11-27T20:42:37.510195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515787+0000","last_change":"2023-11-27T20:42:37.515787+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515787+0000","last_undegraded":"2023-11-27T20:42:37.515787+0000","last_fullsized":"2023-11-27T20:42:37.515787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511964+0000","last_change":"2023-11-27T20:42:37.511964+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511964+0000","last_undegraded":"2023-11-27T20:42:37.511964+0000","last_fullsized":"2023-11-27T20:42:37.511964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.523443+0000","last_change":"2023-11-27T20:42:37.523443+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.523443+0000","last_undegraded":"2023-11-27T20:42:37.523443+0000","last_fullsized":"2023-11-27T20:42:37.523443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.528897+0000","last_change":"2023-11-27T20:42:37.528897+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.528897+0000","last_undegraded":"2023-11-27T20:42:37.528897+0000","last_fullsized":"2023-11-27T20:42:37.528897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.501968+0000","last_change":"2023-11-27T20:42:37.501968+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.501968+0000","last_undegraded":"2023-11-27T20:42:37.501968+0000","last_fullsized":"2023-11-27T20:42:37.501968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504322+0000","last_change":"2023-11-27T20:42:37.504322+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504322+0000","last_undegraded":"2023-11-27T20:42:37.504322+0000","last_fullsized":"2023-11-27T20:42:37.504322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.521826+0000","last_change":"2023-11-27T20:42:37.521826+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.521826+0000","last_undegraded":"2023-11-27T20:42:37.521826+0000","last_fullsized":"2023-11-27T20:42:37.521826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514524+0000","last_change":"2023-11-27T20:42:37.514524+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514524+0000","last_undegraded":"2023-11-27T20:42:37.514524+0000","last_fullsized":"2023-11-27T20:42:37.514524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515208+0000","last_change":"2023-11-27T20:42:37.515208+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515208+0000","last_undegraded":"2023-11-27T20:42:37.515208+0000","last_fullsized":"2023-11-27T20:42:37.515208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511574+0000","last_change":"2023-11-27T20:42:37.511574+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511574+0000","last_undegraded":"2023-11-27T20:42:37.511574+0000","last_fullsized":"2023-11-27T20:42:37.511574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519349+0000","last_change":"2023-11-27T20:42:37.519349+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519349+0000","last_undegraded":"2023-11-27T20:42:37.519349+0000","last_fullsized":"2023-11-27T20:42:37.519349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519684+0000","last_change":"2023-11-27T20:42:37.519684+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519684+0000","last_undegraded":"2023-11-27T20:42:37.519684+0000","last_fullsized":"2023-11-27T20:42:37.519684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.522777+0000","last_change":"2023-11-27T20:42:37.522777+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.522777+0000","last_undegraded":"2023-11-27T20:42:37.522777+0000","last_fullsized":"2023-11-27T20:42:37.522777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511548+0000","last_change":"2023-11-27T20:42:37.511548+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511548+0000","last_undegraded":"2023-11-27T20:42:37.511548+0000","last_fullsized":"2023-11-27T20:42:37.511548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511531+0000","last_change":"2023-11-27T20:42:37.511531+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511531+0000","last_undegraded":"2023-11-27T20:42:37.511531+0000","last_fullsized":"2023-11-27T20:42:37.511531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518559+0000","last_change":"2023-11-27T20:42:37.518559+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518559+0000","last_undegraded":"2023-11-27T20:42:37.518559+0000","last_fullsized":"2023-11-27T20:42:37.518559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.506586+0000","last_change":"2023-11-27T20:42:37.506586+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.506586+0000","last_undegraded":"2023-11-27T20:42:37.506586+0000","last_fullsized":"2023-11-27T20:42:37.506586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504134+0000","last_change":"2023-11-27T20:42:37.504134+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504134+0000","last_undegraded":"2023-11-27T20:42:37.504134+0000","last_fullsized":"2023-11-27T20:42:37.504134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515948+0000","last_change":"2023-11-27T20:42:37.515948+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515948+0000","last_undegraded":"2023-11-27T20:42:37.515948+0000","last_fullsized":"2023-11-27T20:42:37.515948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514796+0000","last_change":"2023-11-27T20:42:37.514796+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514796+0000","last_undegraded":"2023-11-27T20:42:37.514796+0000","last_fullsized":"2023-11-27T20:42:37.514796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508064+0000","last_change":"2023-11-27T20:42:37.508064+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508064+0000","last_undegraded":"2023-11-27T20:42:37.508064+0000","last_fullsized":"2023-11-27T20:42:37.508064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.510504+0000","last_change":"2023-11-27T20:42:37.510504+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.510504+0000","last_undegraded":"2023-11-27T20:42:37.510504+0000","last_fullsized":"2023-11-27T20:42:37.510504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513568+0000","last_change":"2023-11-27T20:42:37.513568+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513568+0000","last_undegraded":"2023-11-27T20:42:37.513568+0000","last_fullsized":"2023-11-27T20:42:37.513568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511588+0000","last_change":"2023-11-27T20:42:37.511588+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511588+0000","last_undegraded":"2023-11-27T20:42:37.511588+0000","last_fullsized":"2023-11-27T20:42:37.511588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503780+0000","last_change":"2023-11-27T20:42:37.503780+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503780+0000","last_undegraded":"2023-11-27T20:42:37.503780+0000","last_fullsized":"2023-11-27T20:42:37.503780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.520838+0000","last_change":"2023-11-27T20:42:37.520838+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.520838+0000","last_undegraded":"2023-11-27T20:42:37.520838+0000","last_fullsized":"2023-11-27T20:42:37.520838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504137+0000","last_change":"2023-11-27T20:42:37.504137+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504137+0000","last_undegraded":"2023-11-27T20:42:37.504137+0000","last_fullsized":"2023-11-27T20:42:37.504137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.528425+0000","last_change":"2023-11-27T20:42:37.528425+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.528425+0000","last_undegraded":"2023-11-27T20:42:37.528425+0000","last_fullsized":"2023-11-27T20:42:37.528425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519836+0000","last_change":"2023-11-27T20:42:37.519836+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519836+0000","last_undegraded":"2023-11-27T20:42:37.519836+0000","last_fullsized":"2023-11-27T20:42:37.519836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.532488+0000","last_change":"2023-11-27T20:42:37.528294+0000","last_active":"2023-11-27T20:42:37.532488+0000","last_peered":"2023-11-27T20:42:37.532488+0000","last_clean":"2023-11-27T20:42:37.532488+0000","last_became_active":"2023-11-27T20:42:37.528055+0000","last_became_peered":"2023-11-27T20:42:37.528055+0000","last_unstale":"2023-11-27T20:42:37.532488+0000","last_undegraded":"2023-11-27T20:42:37.532488+0000","last_fullsized":"2023-11-27T20:42:37.532488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.506060+0000","last_change":"2023-11-27T20:42:37.506060+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.506060+0000","last_undegraded":"2023-11-27T20:42:37.506060+0000","last_fullsized":"2023-11-27T20:42:37.506060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.539636+0000","last_change":"2023-11-27T20:42:37.535511+0000","last_active":"2023-11-27T20:42:37.539636+0000","last_peered":"2023-11-27T20:42:37.539636+0000","last_clean":"2023-11-27T20:42:37.539636+0000","last_became_active":"2023-11-27T20:42:37.535314+0000","last_became_peered":"2023-11-27T20:42:37.535314+0000","last_unstale":"2023-11-27T20:42:37.539636+0000","last_undegraded":"2023-11-27T20:42:37.539636+0000","last_fullsized":"2023-11-27T20:42:37.539636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:47.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502494+0000","last_change":"2023-11-27T20:42:37.502494+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502494+0000","last_undegraded":"2023-11-27T20:42:37.502494+0000","last_fullsized":"2023-11-27T20:42:37.502494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.529016+0000","last_change":"2023-11-27T20:42:37.520015+0000","last_active":"2023-11-27T20:42:37.529016+0000","last_peered":"2023-11-27T20:42:37.529016+0000","last_clean":"2023-11-27T20:42:37.529016+0000","last_became_active":"2023-11-27T20:42:37.519779+0000","last_became_peered":"2023-11-27T20:42:37.519779+0000","last_unstale":"2023-11-27T20:42:37.529016+0000","last_undegraded":"2023-11-27T20:42:37.529016+0000","last_fullsized":"2023-11-27T20:42:37.529016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513095+0000","last_change":"2023-11-27T20:42:37.513095+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513095+0000","last_undegraded":"2023-11-27T20:42:37.513095+0000","last_fullsized":"2023-11-27T20:42:37.513095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533841+0000","last_change":"2023-11-27T20:42:37.530074+0000","last_active":"2023-11-27T20:42:37.533841+0000","last_peered":"2023-11-27T20:42:37.533841+0000","last_clean":"2023-11-27T20:42:37.533841+0000","last_became_active":"2023-11-27T20:42:37.529422+0000","last_became_peered":"2023-11-27T20:42:37.529422+0000","last_unstale":"2023-11-27T20:42:37.533841+0000","last_undegraded":"2023-11-27T20:42:37.533841+0000","last_fullsized":"2023-11-27T20:42:37.533841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:32:25.861163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.520224+0000","last_change":"2023-11-27T20:42:37.520224+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.520224+0000","last_undegraded":"2023-11-27T20:42:37.520224+0000","last_fullsized":"2023-11-27T20:42:37.520224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533860+0000","last_change":"2023-11-27T20:42:37.527381+0000","last_active":"2023-11-27T20:42:37.533860+0000","last_peered":"2023-11-27T20:42:37.533860+0000","last_clean":"2023-11-27T20:42:37.533860+0000","last_became_active":"2023-11-27T20:42:37.527147+0000","last_became_peered":"2023-11-27T20:42:37.527147+0000","last_unstale":"2023-11-27T20:42:37.533860+0000","last_undegraded":"2023-11-27T20:42:37.533860+0000","last_fullsized":"2023-11-27T20:42:37.533860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:28:47.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514071+0000","last_change":"2023-11-27T20:42:37.514071+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514071+0000","last_undegraded":"2023-11-27T20:42:37.514071+0000","last_fullsized":"2023-11-27T20:42:37.514071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537556+0000","last_change":"2023-11-27T20:42:37.531654+0000","last_active":"2023-11-27T20:42:37.537556+0000","last_peered":"2023-11-27T20:42:37.537556+0000","last_clean":"2023-11-27T20:42:37.537556+0000","last_became_active":"2023-11-27T20:42:37.529901+0000","last_became_peered":"2023-11-27T20:42:37.529901+0000","last_unstale":"2023-11-27T20:42:37.537556+0000","last_undegraded":"2023-11-27T20:42:37.537556+0000","last_fullsized":"2023-11-27T20:42:37.537556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:25:52.361215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.501269+0000","last_change":"2023-11-27T20:42:37.501269+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.501269+0000","last_undegraded":"2023-11-27T20:42:37.501269+0000","last_fullsized":"2023-11-27T20:42:37.501269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.528979+0000","last_change":"2023-11-27T20:42:37.522964+0000","last_active":"2023-11-27T20:42:37.528979+0000","last_peered":"2023-11-27T20:42:37.528979+0000","last_clean":"2023-11-27T20:42:37.528979+0000","last_became_active":"2023-11-27T20:42:37.522677+0000","last_became_peered":"2023-11-27T20:42:37.522677+0000","last_unstale":"2023-11-27T20:42:37.528979+0000","last_undegraded":"2023-11-27T20:42:37.528979+0000","last_fullsized":"2023-11-27T20:42:37.528979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:42.888540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503711+0000","last_change":"2023-11-27T20:42:37.503711+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503711+0000","last_undegraded":"2023-11-27T20:42:37.503711+0000","last_fullsized":"2023-11-27T20:42:37.503711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527926+0000","last_change":"2023-11-27T20:42:37.522230+0000","last_active":"2023-11-27T20:42:37.527926+0000","last_peered":"2023-11-27T20:42:37.527926+0000","last_clean":"2023-11-27T20:42:37.527926+0000","last_became_active":"2023-11-27T20:42:37.521898+0000","last_became_peered":"2023-11-27T20:42:37.521898+0000","last_unstale":"2023-11-27T20:42:37.527926+0000","last_undegraded":"2023-11-27T20:42:37.527926+0000","last_fullsized":"2023-11-27T20:42:37.527926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:29:17.198964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511614+0000","last_change":"2023-11-27T20:42:37.511614+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511614+0000","last_undegraded":"2023-11-27T20:42:37.511614+0000","last_fullsized":"2023-11-27T20:42:37.511614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536950+0000","last_change":"2023-11-27T20:42:37.531762+0000","last_active":"2023-11-27T20:42:37.536950+0000","last_peered":"2023-11-27T20:42:37.536950+0000","last_clean":"2023-11-27T20:42:37.536950+0000","last_became_active":"2023-11-27T20:42:37.531446+0000","last_became_peered":"2023-11-27T20:42:37.531446+0000","last_unstale":"2023-11-27T20:42:37.536950+0000","last_undegraded":"2023-11-27T20:42:37.536950+0000","last_fullsized":"2023-11-27T20:42:37.536950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:16:18.992040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.512794+0000","last_change":"2023-11-27T20:42:37.512794+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.512794+0000","last_undegraded":"2023-11-27T20:42:37.512794+0000","last_fullsized":"2023-11-27T20:42:37.512794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536897+0000","last_change":"2023-11-27T20:42:37.532869+0000","last_active":"2023-11-27T20:42:37.536897+0000","last_peered":"2023-11-27T20:42:37.536897+0000","last_clean":"2023-11-27T20:42:37.536897+0000","last_became_active":"2023-11-27T20:42:37.532576+0000","last_became_peered":"2023-11-27T20:42:37.532576+0000","last_unstale":"2023-11-27T20:42:37.536897+0000","last_undegraded":"2023-11-27T20:42:37.536897+0000","last_fullsized":"2023-11-27T20:42:37.536897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508823+0000","last_change":"2023-11-27T20:42:37.508823+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508823+0000","last_undegraded":"2023-11-27T20:42:37.508823+0000","last_fullsized":"2023-11-27T20:42:37.508823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536684+0000","last_change":"2023-11-27T20:42:37.530460+0000","last_active":"2023-11-27T20:42:37.536684+0000","last_peered":"2023-11-27T20:42:37.536684+0000","last_clean":"2023-11-27T20:42:37.536684+0000","last_became_active":"2023-11-27T20:42:37.529879+0000","last_became_peered":"2023-11-27T20:42:37.529879+0000","last_unstale":"2023-11-27T20:42:37.536684+0000","last_undegraded":"2023-11-27T20:42:37.536684+0000","last_fullsized":"2023-11-27T20:42:37.536684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:42.888540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518638+0000","last_change":"2023-11-27T20:42:37.518638+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518638+0000","last_undegraded":"2023-11-27T20:42:37.518638+0000","last_fullsized":"2023-11-27T20:42:37.518638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531644+0000","last_change":"2023-11-27T20:42:37.523173+0000","last_active":"2023-11-27T20:42:37.531644+0000","last_peered":"2023-11-27T20:42:37.531644+0000","last_clean":"2023-11-27T20:42:37.531644+0000","last_became_active":"2023-11-27T20:42:37.522903+0000","last_became_peered":"2023-11-27T20:42:37.522903+0000","last_unstale":"2023-11-27T20:42:37.531644+0000","last_undegraded":"2023-11-27T20:42:37.531644+0000","last_fullsized":"2023-11-27T20:42:37.531644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:47.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505436+0000","last_change":"2023-11-27T20:42:37.505436+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505436+0000","last_undegraded":"2023-11-27T20:42:37.505436+0000","last_fullsized":"2023-11-27T20:42:37.505436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533633+0000","last_change":"2023-11-27T20:42:37.524294+0000","last_active":"2023-11-27T20:42:37.533633+0000","last_peered":"2023-11-27T20:42:37.533633+0000","last_clean":"2023-11-27T20:42:37.533633+0000","last_became_active":"2023-11-27T20:42:37.523858+0000","last_became_peered":"2023-11-27T20:42:37.523858+0000","last_unstale":"2023-11-27T20:42:37.533633+0000","last_undegraded":"2023-11-27T20:42:37.533633+0000","last_fullsized":"2023-11-27T20:42:37.533633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:02:50.193416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508941+0000","last_change":"2023-11-27T20:42:37.508941+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508941+0000","last_undegraded":"2023-11-27T20:42:37.508941+0000","last_fullsized":"2023-11-27T20:42:37.508941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.530936+0000","last_change":"2023-11-27T20:42:37.522904+0000","last_active":"2023-11-27T20:42:37.530936+0000","last_peered":"2023-11-27T20:42:37.530936+0000","last_clean":"2023-11-27T20:42:37.530936+0000","last_became_active":"2023-11-27T20:42:37.522574+0000","last_became_peered":"2023-11-27T20:42:37.522574+0000","last_unstale":"2023-11-27T20:42:37.530936+0000","last_undegraded":"2023-11-27T20:42:37.530936+0000","last_fullsized":"2023-11-27T20:42:37.530936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:37.188919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.527110+0000","last_change":"2023-11-27T20:42:37.527110+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.527110+0000","last_undegraded":"2023-11-27T20:42:37.527110+0000","last_fullsized":"2023-11-27T20:42:37.527110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.539619+0000","last_change":"2023-11-27T20:42:37.535247+0000","last_active":"2023-11-27T20:42:37.539619+0000","last_peered":"2023-11-27T20:42:37.539619+0000","last_clean":"2023-11-27T20:42:37.539619+0000","last_became_active":"2023-11-27T20:42:37.534922+0000","last_became_peered":"2023-11-27T20:42:37.534922+0000","last_unstale":"2023-11-27T20:42:37.539619+0000","last_undegraded":"2023-11-27T20:42:37.539619+0000","last_fullsized":"2023-11-27T20:42:37.539619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502506+0000","last_change":"2023-11-27T20:42:37.502506+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502506+0000","last_undegraded":"2023-11-27T20:42:37.502506+0000","last_fullsized":"2023-11-27T20:42:37.502506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.524213+0000","last_change":"2023-11-27T20:42:37.514338+0000","last_active":"2023-11-27T20:42:37.524213+0000","last_peered":"2023-11-27T20:42:37.524213+0000","last_clean":"2023-11-27T20:42:37.524213+0000","last_became_active":"2023-11-27T20:42:37.514055+0000","last_became_peered":"2023-11-27T20:42:37.514055+0000","last_unstale":"2023-11-27T20:42:37.524213+0000","last_undegraded":"2023-11-27T20:42:37.524213+0000","last_fullsized":"2023-11-27T20:42:37.524213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505512+0000","last_change":"2023-11-27T20:42:37.505512+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505512+0000","last_undegraded":"2023-11-27T20:42:37.505512+0000","last_fullsized":"2023-11-27T20:42:37.505512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531502+0000","last_change":"2023-11-27T20:42:37.525560+0000","last_active":"2023-11-27T20:42:37.531502+0000","last_peered":"2023-11-27T20:42:37.531502+0000","last_clean":"2023-11-27T20:42:37.531502+0000","last_became_active":"2023-11-27T20:42:37.525261+0000","last_became_peered":"2023-11-27T20:42:37.525261+0000","last_unstale":"2023-11-27T20:42:37.531502+0000","last_undegraded":"2023-11-27T20:42:37.531502+0000","last_fullsized":"2023-11-27T20:42:37.531502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516690+0000","last_change":"2023-11-27T20:42:37.516690+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516690+0000","last_undegraded":"2023-11-27T20:42:37.516690+0000","last_fullsized":"2023-11-27T20:42:37.516690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527935+0000","last_change":"2023-11-27T20:42:37.522245+0000","last_active":"2023-11-27T20:42:37.527935+0000","last_peered":"2023-11-27T20:42:37.527935+0000","last_clean":"2023-11-27T20:42:37.527935+0000","last_became_active":"2023-11-27T20:42:37.521938+0000","last_became_peered":"2023-11-27T20:42:37.521938+0000","last_unstale":"2023-11-27T20:42:37.527935+0000","last_undegraded":"2023-11-27T20:42:37.527935+0000","last_fullsized":"2023-11-27T20:42:37.527935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:47:06.669263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505173+0000","last_change":"2023-11-27T20:42:37.505173+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505173+0000","last_undegraded":"2023-11-27T20:42:37.505173+0000","last_fullsized":"2023-11-27T20:42:37.505173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533733+0000","last_change":"2023-11-27T20:42:37.525601+0000","last_active":"2023-11-27T20:42:37.533733+0000","last_peered":"2023-11-27T20:42:37.533733+0000","last_clean":"2023-11-27T20:42:37.533733+0000","last_became_active":"2023-11-27T20:42:37.525296+0000","last_became_peered":"2023-11-27T20:42:37.525296+0000","last_unstale":"2023-11-27T20:42:37.533733+0000","last_undegraded":"2023-11-27T20:42:37.533733+0000","last_fullsized":"2023-11-27T20:42:37.533733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:09:22.812521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517575+0000","last_change":"2023-11-27T20:42:37.517575+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517575+0000","last_undegraded":"2023-11-27T20:42:37.517575+0000","last_fullsized":"2023-11-27T20:42:37.517575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533779+0000","last_change":"2023-11-27T20:42:37.527131+0000","last_active":"2023-11-27T20:42:37.533779+0000","last_peered":"2023-11-27T20:42:37.533779+0000","last_clean":"2023-11-27T20:42:37.533779+0000","last_became_active":"2023-11-27T20:42:37.526804+0000","last_became_peered":"2023-11-27T20:42:37.526804+0000","last_unstale":"2023-11-27T20:42:37.533779+0000","last_undegraded":"2023-11-27T20:42:37.533779+0000","last_fullsized":"2023-11-27T20:42:37.533779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:05.189004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513949+0000","last_change":"2023-11-27T20:42:37.513949+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513949+0000","last_undegraded":"2023-11-27T20:42:37.513949+0000","last_fullsized":"2023-11-27T20:42:37.513949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531689+0000","last_change":"2023-11-27T20:42:37.527591+0000","last_active":"2023-11-27T20:42:37.531689+0000","last_peered":"2023-11-27T20:42:37.531689+0000","last_clean":"2023-11-27T20:42:37.531689+0000","last_became_active":"2023-11-27T20:42:37.527305+0000","last_became_peered":"2023-11-27T20:42:37.527305+0000","last_unstale":"2023-11-27T20:42:37.531689+0000","last_undegraded":"2023-11-27T20:42:37.531689+0000","last_fullsized":"2023-11-27T20:42:37.531689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514521+0000","last_change":"2023-11-27T20:42:37.514521+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514521+0000","last_undegraded":"2023-11-27T20:42:37.514521+0000","last_fullsized":"2023-11-27T20:42:37.514521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.525562+0000","last_change":"2023-11-27T20:42:37.522543+0000","last_active":"2023-11-27T20:42:37.525562+0000","last_peered":"2023-11-27T20:42:37.525562+0000","last_clean":"2023-11-27T20:42:37.525562+0000","last_became_active":"2023-11-27T20:42:37.522163+0000","last_became_peered":"2023-11-27T20:42:37.522163+0000","last_unstale":"2023-11-27T20:42:37.525562+0000","last_undegraded":"2023-11-27T20:42:37.525562+0000","last_fullsized":"2023-11-27T20:42:37.525562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513682+0000","last_change":"2023-11-27T20:42:37.513682+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513682+0000","last_undegraded":"2023-11-27T20:42:37.513682+0000","last_fullsized":"2023-11-27T20:42:37.513682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.522197+0000","last_change":"2023-11-27T20:42:37.518579+0000","last_active":"2023-11-27T20:42:37.522197+0000","last_peered":"2023-11-27T20:42:37.522197+0000","last_clean":"2023-11-27T20:42:37.522197+0000","last_became_active":"2023-11-27T20:42:37.517970+0000","last_became_peered":"2023-11-27T20:42:37.517970+0000","last_unstale":"2023-11-27T20:42:37.522197+0000","last_undegraded":"2023-11-27T20:42:37.522197+0000","last_fullsized":"2023-11-27T20:42:37.522197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:32:25.861163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.526199+0000","last_change":"2023-11-27T20:42:37.526199+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.526199+0000","last_undegraded":"2023-11-27T20:42:37.526199+0000","last_fullsized":"2023-11-27T20:42:37.526199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536771+0000","last_change":"2023-11-27T20:42:37.532212+0000","last_active":"2023-11-27T20:42:37.536771+0000","last_peered":"2023-11-27T20:42:37.536771+0000","last_clean":"2023-11-27T20:42:37.536771+0000","last_became_active":"2023-11-27T20:42:37.531894+0000","last_became_peered":"2023-11-27T20:42:37.531894+0000","last_unstale":"2023-11-27T20:42:37.536771+0000","last_undegraded":"2023-11-27T20:42:37.536771+0000","last_fullsized":"2023-11-27T20:42:37.536771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516658+0000","last_change":"2023-11-27T20:42:37.516658+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516658+0000","last_undegraded":"2023-11-27T20:42:37.516658+0000","last_fullsized":"2023-11-27T20:42:37.516658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534076+0000","last_change":"2023-11-27T20:42:37.530114+0000","last_active":"2023-11-27T20:42:37.534076+0000","last_peered":"2023-11-27T20:42:37.534076+0000","last_clean":"2023-11-27T20:42:37.534076+0000","last_became_active":"2023-11-27T20:42:37.529838+0000","last_became_peered":"2023-11-27T20:42:37.529838+0000","last_unstale":"2023-11-27T20:42:37.534076+0000","last_undegraded":"2023-11-27T20:42:37.534076+0000","last_fullsized":"2023-11-27T20:42:37.534076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516148+0000","last_change":"2023-11-27T20:42:37.516148+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516148+0000","last_undegraded":"2023-11-27T20:42:37.516148+0000","last_fullsized":"2023-11-27T20:42:37.516148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534123+0000","last_change":"2023-11-27T20:42:37.528142+0000","last_active":"2023-11-27T20:42:37.534123+0000","last_peered":"2023-11-27T20:42:37.534123+0000","last_clean":"2023-11-27T20:42:37.534123+0000","last_became_active":"2023-11-27T20:42:37.527318+0000","last_became_peered":"2023-11-27T20:42:37.527318+0000","last_unstale":"2023-11-27T20:42:37.534123+0000","last_undegraded":"2023-11-27T20:42:37.534123+0000","last_fullsized":"2023-11-27T20:42:37.534123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517148+0000","last_change":"2023-11-27T20:42:37.517148+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517148+0000","last_undegraded":"2023-11-27T20:42:37.517148+0000","last_fullsized":"2023-11-27T20:42:37.517148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533948+0000","last_change":"2023-11-27T20:42:37.527056+0000","last_active":"2023-11-27T20:42:37.533948+0000","last_peered":"2023-11-27T20:42:37.533948+0000","last_clean":"2023-11-27T20:42:37.533948+0000","last_became_active":"2023-11-27T20:42:37.526803+0000","last_became_peered":"2023-11-27T20:42:37.526803+0000","last_unstale":"2023-11-27T20:42:37.533948+0000","last_undegraded":"2023-11-27T20:42:37.533948+0000","last_fullsized":"2023-11-27T20:42:37.533948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.507542+0000","last_change":"2023-11-27T20:42:37.507542+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.507542+0000","last_undegraded":"2023-11-27T20:42:37.507542+0000","last_fullsized":"2023-11-27T20:42:37.507542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536858+0000","last_change":"2023-11-27T20:42:37.532441+0000","last_active":"2023-11-27T20:42:37.536858+0000","last_peered":"2023-11-27T20:42:37.536858+0000","last_clean":"2023-11-27T20:42:37.536858+0000","last_became_active":"2023-11-27T20:42:37.532074+0000","last_became_peered":"2023-11-27T20:42:37.532074+0000","last_unstale":"2023-11-27T20:42:37.536858+0000","last_undegraded":"2023-11-27T20:42:37.536858+0000","last_fullsized":"2023-11-27T20:42:37.536858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517601+0000","last_change":"2023-11-27T20:42:37.517601+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517601+0000","last_undegraded":"2023-11-27T20:42:37.517601+0000","last_fullsized":"2023-11-27T20:42:37.517601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534045+0000","last_change":"2023-11-27T20:42:37.529807+0000","last_active":"2023-11-27T20:42:37.534045+0000","last_peered":"2023-11-27T20:42:37.534045+0000","last_clean":"2023-11-27T20:42:37.534045+0000","last_became_active":"2023-11-27T20:42:37.529543+0000","last_became_peered":"2023-11-27T20:42:37.529543+0000","last_unstale":"2023-11-27T20:42:37.534045+0000","last_undegraded":"2023-11-27T20:42:37.534045+0000","last_fullsized":"2023-11-27T20:42:37.534045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503706+0000","last_change":"2023-11-27T20:42:37.503706+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503706+0000","last_undegraded":"2023-11-27T20:42:37.503706+0000","last_fullsized":"2023-11-27T20:42:37.503706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537539+0000","last_change":"2023-11-27T20:42:37.530919+0000","last_active":"2023-11-27T20:42:37.537539+0000","last_peered":"2023-11-27T20:42:37.537539+0000","last_clean":"2023-11-27T20:42:37.537539+0000","last_became_active":"2023-11-27T20:42:37.530606+0000","last_became_peered":"2023-11-27T20:42:37.530606+0000","last_unstale":"2023-11-27T20:42:37.537539+0000","last_undegraded":"2023-11-27T20:42:37.537539+0000","last_fullsized":"2023-11-27T20:42:37.537539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:05:16.047989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502275+0000","last_change":"2023-11-27T20:42:37.502275+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502275+0000","last_undegraded":"2023-11-27T20:42:37.502275+0000","last_fullsized":"2023-11-27T20:42:37.502275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537006+0000","last_change":"2023-11-27T20:42:37.533800+0000","last_active":"2023-11-27T20:42:37.537006+0000","last_peered":"2023-11-27T20:42:37.537006+0000","last_clean":"2023-11-27T20:42:37.537006+0000","last_became_active":"2023-11-27T20:42:37.533358+0000","last_became_peered":"2023-11-27T20:42:37.533358+0000","last_unstale":"2023-11-27T20:42:37.537006+0000","last_undegraded":"2023-11-27T20:42:37.537006+0000","last_fullsized":"2023-11-27T20:42:37.537006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.523128+0000","last_change":"2023-11-27T20:42:37.523128+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.523128+0000","last_undegraded":"2023-11-27T20:42:37.523128+0000","last_fullsized":"2023-11-27T20:42:37.523128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527729+0000","last_change":"2023-11-27T20:42:37.523367+0000","last_active":"2023-11-27T20:42:37.527729+0000","last_peered":"2023-11-27T20:42:37.527729+0000","last_clean":"2023-11-27T20:42:37.527729+0000","last_became_active":"2023-11-27T20:42:37.522948+0000","last_became_peered":"2023-11-27T20:42:37.522948+0000","last_unstale":"2023-11-27T20:42:37.527729+0000","last_undegraded":"2023-11-27T20:42:37.527729+0000","last_fullsized":"2023-11-27T20:42:37.527729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-27T20:42:36.508328+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:42:36.508328+0000","last_peered":"2023-11-27T20:42:36.508328+0000","last_clean":"2023-11-27T20:42:36.508328+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:42:36.508328+0000","last_undegraded":"2023-11-27T20:42:36.508328+0000","last_fullsized":"2023-11-27T20:42:36.508328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0760000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2010000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.4039999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.248}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.367}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.573}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.006},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.95799999999999996}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.196},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.1579999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.88900000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3919999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.107},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":3.536,"5min":3.536,"15min":3.536},"last":1.2549999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.3}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.583},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.6499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.50800000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.379},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.433},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.47899999999999998}]},{"osd":3,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":0.58499999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2149999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.71399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.671}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.105},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.448}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.286},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.234}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.5940000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.3420000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.732}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.7849999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.442}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.8050000000000002,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.91300000000000003}]},{"osd":6,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":0.871},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.1140000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.66100000000000003}]},{"osd":1,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.90200000000000002},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.77000000000000002}]},{"osd":3,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.82499999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.044},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.3540000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.508}]},{"osd":6,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.272},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":1.585}]},{"osd":7,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.3}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.5449999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.4410000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.337}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.615},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.4930000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.133}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.71}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.98299999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":0.95999999999999996}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.181},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.83399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:42:43.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-27T20:42:43.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.507171+0000', 'last_change': '2023-11-27T20:42:37.507171+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.507171+0000', 'last_undegraded': '2023-11-27T20:42:37.507171+0000', 'last_fullsized': '2023-11-27T20:42:37.507171+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:42:43.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-27T20:42:43.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.512450+0000', 'last_change': '2023-11-27T20:42:37.512450+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.512450+0000', 'last_undegraded': '2023-11-27T20:42:37.512450+0000', 'last_fullsized': '2023-11-27T20:42:37.512450+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:42:43.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-27T20:42:43.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.518057+0000', 'last_change': '2023-11-27T20:42:37.518057+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.518057+0000', 'last_undegraded': '2023-11-27T20:42:37.518057+0000', 'last_fullsized': '2023-11-27T20:42:37.518057+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:42:43.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-27T20:42:43.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.510195+0000', 'last_change': '2023-11-27T20:42:37.510195+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.510195+0000', 'last_undegraded': '2023-11-27T20:42:37.510195+0000', 'last_fullsized': '2023-11-27T20:42:37.510195+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:42:43.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-27T20:42:43.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.515787+0000', 'last_change': '2023-11-27T20:42:37.515787+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.515787+0000', 'last_undegraded': '2023-11-27T20:42:37.515787+0000', 'last_fullsized': '2023-11-27T20:42:37.515787+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:42:43.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-27T20:42:43.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.511964+0000', 'last_change': '2023-11-27T20:42:37.511964+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.511964+0000', 'last_undegraded': '2023-11-27T20:42:37.511964+0000', 'last_fullsized': '2023-11-27T20:42:37.511964+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:42:43.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-27T20:42:43.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.523443+0000', 'last_change': '2023-11-27T20:42:37.523443+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.523443+0000', 'last_undegraded': '2023-11-27T20:42:37.523443+0000', 'last_fullsized': '2023-11-27T20:42:37.523443+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-27T20:42:43.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.528897+0000', 'last_change': '2023-11-27T20:42:37.528897+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.528897+0000', 'last_undegraded': '2023-11-27T20:42:37.528897+0000', 'last_fullsized': '2023-11-27T20:42:37.528897+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-27T20:42:43.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.501968+0000', 'last_change': '2023-11-27T20:42:37.501968+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.501968+0000', 'last_undegraded': '2023-11-27T20:42:37.501968+0000', 'last_fullsized': '2023-11-27T20:42:37.501968+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:42:43.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-27T20:42:43.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.504322+0000', 'last_change': '2023-11-27T20:42:37.504322+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.504322+0000', 'last_undegraded': '2023-11-27T20:42:37.504322+0000', 'last_fullsized': '2023-11-27T20:42:37.504322+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:42:43.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-27T20:42:43.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.521826+0000', 'last_change': '2023-11-27T20:42:37.521826+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.521826+0000', 'last_undegraded': '2023-11-27T20:42:37.521826+0000', 'last_fullsized': '2023-11-27T20:42:37.521826+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-27T20:42:43.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.514524+0000', 'last_change': '2023-11-27T20:42:37.514524+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.514524+0000', 'last_undegraded': '2023-11-27T20:42:37.514524+0000', 'last_fullsized': '2023-11-27T20:42:37.514524+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:42:43.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-27T20:42:43.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.515208+0000', 'last_change': '2023-11-27T20:42:37.515208+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.515208+0000', 'last_undegraded': '2023-11-27T20:42:37.515208+0000', 'last_fullsized': '2023-11-27T20:42:37.515208+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:42:43.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-27T20:42:43.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.511574+0000', 'last_change': '2023-11-27T20:42:37.511574+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.511574+0000', 'last_undegraded': '2023-11-27T20:42:37.511574+0000', 'last_fullsized': '2023-11-27T20:42:37.511574+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:42:43.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-27T20:42:43.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.519349+0000', 'last_change': '2023-11-27T20:42:37.519349+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.519349+0000', 'last_undegraded': '2023-11-27T20:42:37.519349+0000', 'last_fullsized': '2023-11-27T20:42:37.519349+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:42:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-27T20:42:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.519684+0000', 'last_change': '2023-11-27T20:42:37.519684+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.519684+0000', 'last_undegraded': '2023-11-27T20:42:37.519684+0000', 'last_fullsized': '2023-11-27T20:42:37.519684+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-27T20:42:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.522777+0000', 'last_change': '2023-11-27T20:42:37.522777+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.522777+0000', 'last_undegraded': '2023-11-27T20:42:37.522777+0000', 'last_fullsized': '2023-11-27T20:42:37.522777+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-27T20:42:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.511548+0000', 'last_change': '2023-11-27T20:42:37.511548+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.511548+0000', 'last_undegraded': '2023-11-27T20:42:37.511548+0000', 'last_fullsized': '2023-11-27T20:42:37.511548+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:42:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-27T20:42:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.511531+0000', 'last_change': '2023-11-27T20:42:37.511531+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.511531+0000', 'last_undegraded': '2023-11-27T20:42:37.511531+0000', 'last_fullsized': '2023-11-27T20:42:37.511531+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:42:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-27T20:42:43.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.518559+0000', 'last_change': '2023-11-27T20:42:37.518559+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.518559+0000', 'last_undegraded': '2023-11-27T20:42:37.518559+0000', 'last_fullsized': '2023-11-27T20:42:37.518559+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:42:43.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-27T20:42:43.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.506586+0000', 'last_change': '2023-11-27T20:42:37.506586+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.506586+0000', 'last_undegraded': '2023-11-27T20:42:37.506586+0000', 'last_fullsized': '2023-11-27T20:42:37.506586+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:42:43.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-27T20:42:43.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.504134+0000', 'last_change': '2023-11-27T20:42:37.504134+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.504134+0000', 'last_undegraded': '2023-11-27T20:42:37.504134+0000', 'last_fullsized': '2023-11-27T20:42:37.504134+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:42:43.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-27T20:42:43.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.515948+0000', 'last_change': '2023-11-27T20:42:37.515948+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.515948+0000', 'last_undegraded': '2023-11-27T20:42:37.515948+0000', 'last_fullsized': '2023-11-27T20:42:37.515948+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:42:43.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-27T20:42:43.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.514796+0000', 'last_change': '2023-11-27T20:42:37.514796+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.514796+0000', 'last_undegraded': '2023-11-27T20:42:37.514796+0000', 'last_fullsized': '2023-11-27T20:42:37.514796+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:42:43.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-27T20:42:43.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.508064+0000', 'last_change': '2023-11-27T20:42:37.508064+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.508064+0000', 'last_undegraded': '2023-11-27T20:42:37.508064+0000', 'last_fullsized': '2023-11-27T20:42:37.508064+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:42:43.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-27T20:42:43.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.510504+0000', 'last_change': '2023-11-27T20:42:37.510504+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.510504+0000', 'last_undegraded': '2023-11-27T20:42:37.510504+0000', 'last_fullsized': '2023-11-27T20:42:37.510504+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:42:43.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-27T20:42:43.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.513568+0000', 'last_change': '2023-11-27T20:42:37.513568+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.513568+0000', 'last_undegraded': '2023-11-27T20:42:37.513568+0000', 'last_fullsized': '2023-11-27T20:42:37.513568+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:42:43.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-27T20:42:43.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.511588+0000', 'last_change': '2023-11-27T20:42:37.511588+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.511588+0000', 'last_undegraded': '2023-11-27T20:42:37.511588+0000', 'last_fullsized': '2023-11-27T20:42:37.511588+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:42:43.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-27T20:42:43.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.503780+0000', 'last_change': '2023-11-27T20:42:37.503780+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.503780+0000', 'last_undegraded': '2023-11-27T20:42:37.503780+0000', 'last_fullsized': '2023-11-27T20:42:37.503780+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:42:43.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-27T20:42:43.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.520838+0000', 'last_change': '2023-11-27T20:42:37.520838+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.520838+0000', 'last_undegraded': '2023-11-27T20:42:37.520838+0000', 'last_fullsized': '2023-11-27T20:42:37.520838+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-27T20:42:43.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.504137+0000', 'last_change': '2023-11-27T20:42:37.504137+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.504137+0000', 'last_undegraded': '2023-11-27T20:42:37.504137+0000', 'last_fullsized': '2023-11-27T20:42:37.504137+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:42:43.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-27T20:42:43.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.528425+0000', 'last_change': '2023-11-27T20:42:37.528425+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.528425+0000', 'last_undegraded': '2023-11-27T20:42:37.528425+0000', 'last_fullsized': '2023-11-27T20:42:37.528425+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-27T20:42:43.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.519836+0000', 'last_change': '2023-11-27T20:42:37.519836+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.519836+0000', 'last_undegraded': '2023-11-27T20:42:37.519836+0000', 'last_fullsized': '2023-11-27T20:42:37.519836+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:42:43.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-27T20:42:43.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.506060+0000', 'last_change': '2023-11-27T20:42:37.506060+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.506060+0000', 'last_undegraded': '2023-11-27T20:42:37.506060+0000', 'last_fullsized': '2023-11-27T20:42:37.506060+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:42:43.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-27T20:42:43.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.502494+0000', 'last_change': '2023-11-27T20:42:37.502494+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.502494+0000', 'last_undegraded': '2023-11-27T20:42:37.502494+0000', 'last_fullsized': '2023-11-27T20:42:37.502494+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:42:43.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-27T20:42:43.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.513095+0000', 'last_change': '2023-11-27T20:42:37.513095+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.513095+0000', 'last_undegraded': '2023-11-27T20:42:37.513095+0000', 'last_fullsized': '2023-11-27T20:42:37.513095+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:42:43.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-27T20:42:43.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.520224+0000', 'last_change': '2023-11-27T20:42:37.520224+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.520224+0000', 'last_undegraded': '2023-11-27T20:42:37.520224+0000', 'last_fullsized': '2023-11-27T20:42:37.520224+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-27T20:42:43.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.514071+0000', 'last_change': '2023-11-27T20:42:37.514071+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.514071+0000', 'last_undegraded': '2023-11-27T20:42:37.514071+0000', 'last_fullsized': '2023-11-27T20:42:37.514071+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:42:43.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-27T20:42:43.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.501269+0000', 'last_change': '2023-11-27T20:42:37.501269+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.501269+0000', 'last_undegraded': '2023-11-27T20:42:37.501269+0000', 'last_fullsized': '2023-11-27T20:42:37.501269+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:42:43.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-27T20:42:43.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.503711+0000', 'last_change': '2023-11-27T20:42:37.503711+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.503711+0000', 'last_undegraded': '2023-11-27T20:42:37.503711+0000', 'last_fullsized': '2023-11-27T20:42:37.503711+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:42:43.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-27T20:42:43.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.511614+0000', 'last_change': '2023-11-27T20:42:37.511614+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.511614+0000', 'last_undegraded': '2023-11-27T20:42:37.511614+0000', 'last_fullsized': '2023-11-27T20:42:37.511614+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:42:43.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-27T20:42:43.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.512794+0000', 'last_change': '2023-11-27T20:42:37.512794+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.512794+0000', 'last_undegraded': '2023-11-27T20:42:37.512794+0000', 'last_fullsized': '2023-11-27T20:42:37.512794+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:42:43.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-27T20:42:43.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.508823+0000', 'last_change': '2023-11-27T20:42:37.508823+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.508823+0000', 'last_undegraded': '2023-11-27T20:42:37.508823+0000', 'last_fullsized': '2023-11-27T20:42:37.508823+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:42:43.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-27T20:42:43.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.518638+0000', 'last_change': '2023-11-27T20:42:37.518638+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.518638+0000', 'last_undegraded': '2023-11-27T20:42:37.518638+0000', 'last_fullsized': '2023-11-27T20:42:37.518638+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:42:43.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.505436+0000', 'last_change': '2023-11-27T20:42:37.505436+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.505436+0000', 'last_undegraded': '2023-11-27T20:42:37.505436+0000', 'last_fullsized': '2023-11-27T20:42:37.505436+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.508941+0000', 'last_change': '2023-11-27T20:42:37.508941+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.508941+0000', 'last_undegraded': '2023-11-27T20:42:37.508941+0000', 'last_fullsized': '2023-11-27T20:42:37.508941+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.527110+0000', 'last_change': '2023-11-27T20:42:37.527110+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.527110+0000', 'last_undegraded': '2023-11-27T20:42:37.527110+0000', 'last_fullsized': '2023-11-27T20:42:37.527110+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.502506+0000', 'last_change': '2023-11-27T20:42:37.502506+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.502506+0000', 'last_undegraded': '2023-11-27T20:42:37.502506+0000', 'last_fullsized': '2023-11-27T20:42:37.502506+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.505512+0000', 'last_change': '2023-11-27T20:42:37.505512+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.505512+0000', 'last_undegraded': '2023-11-27T20:42:37.505512+0000', 'last_fullsized': '2023-11-27T20:42:37.505512+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-27T20:42:43.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.516690+0000', 'last_change': '2023-11-27T20:42:37.516690+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.516690+0000', 'last_undegraded': '2023-11-27T20:42:37.516690+0000', 'last_fullsized': '2023-11-27T20:42:37.516690+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:42:43.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-27T20:42:43.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.505173+0000', 'last_change': '2023-11-27T20:42:37.505173+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.505173+0000', 'last_undegraded': '2023-11-27T20:42:37.505173+0000', 'last_fullsized': '2023-11-27T20:42:37.505173+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:42:43.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-27T20:42:43.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.517575+0000', 'last_change': '2023-11-27T20:42:37.517575+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.517575+0000', 'last_undegraded': '2023-11-27T20:42:37.517575+0000', 'last_fullsized': '2023-11-27T20:42:37.517575+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:42:43.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-27T20:42:43.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.513949+0000', 'last_change': '2023-11-27T20:42:37.513949+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.513949+0000', 'last_undegraded': '2023-11-27T20:42:37.513949+0000', 'last_fullsized': '2023-11-27T20:42:37.513949+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:42:43.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-27T20:42:43.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.514521+0000', 'last_change': '2023-11-27T20:42:37.514521+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.514521+0000', 'last_undegraded': '2023-11-27T20:42:37.514521+0000', 'last_fullsized': '2023-11-27T20:42:37.514521+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:42:43.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-27T20:42:43.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.513682+0000', 'last_change': '2023-11-27T20:42:37.513682+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.513682+0000', 'last_undegraded': '2023-11-27T20:42:37.513682+0000', 'last_fullsized': '2023-11-27T20:42:37.513682+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:42:43.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-27T20:42:43.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.526199+0000', 'last_change': '2023-11-27T20:42:37.526199+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.526199+0000', 'last_undegraded': '2023-11-27T20:42:37.526199+0000', 'last_fullsized': '2023-11-27T20:42:37.526199+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-27T20:42:43.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.516658+0000', 'last_change': '2023-11-27T20:42:37.516658+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.516658+0000', 'last_undegraded': '2023-11-27T20:42:37.516658+0000', 'last_fullsized': '2023-11-27T20:42:37.516658+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:42:43.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-27T20:42:43.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.516148+0000', 'last_change': '2023-11-27T20:42:37.516148+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.516148+0000', 'last_undegraded': '2023-11-27T20:42:37.516148+0000', 'last_fullsized': '2023-11-27T20:42:37.516148+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:42:43.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-27T20:42:43.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.517148+0000', 'last_change': '2023-11-27T20:42:37.517148+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.517148+0000', 'last_undegraded': '2023-11-27T20:42:37.517148+0000', 'last_fullsized': '2023-11-27T20:42:37.517148+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:42:43.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-27T20:42:43.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.507542+0000', 'last_change': '2023-11-27T20:42:37.507542+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.507542+0000', 'last_undegraded': '2023-11-27T20:42:37.507542+0000', 'last_fullsized': '2023-11-27T20:42:37.507542+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:42:43.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-27T20:42:43.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.517601+0000', 'last_change': '2023-11-27T20:42:37.517601+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.517601+0000', 'last_undegraded': '2023-11-27T20:42:37.517601+0000', 'last_fullsized': '2023-11-27T20:42:37.517601+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:42:43.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-27T20:42:43.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.503706+0000', 'last_change': '2023-11-27T20:42:37.503706+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.503706+0000', 'last_undegraded': '2023-11-27T20:42:37.503706+0000', 'last_fullsized': '2023-11-27T20:42:37.503706+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:42:43.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-27T20:42:43.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.502275+0000', 'last_change': '2023-11-27T20:42:37.502275+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.502275+0000', 'last_undegraded': '2023-11-27T20:42:37.502275+0000', 'last_fullsized': '2023-11-27T20:42:37.502275+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:42:43.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-27T20:42:43.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:37.523128+0000', 'last_change': '2023-11-27T20:42:37.523128+0000', 'last_active': '2023-11-27T20:42:37.485705+0000', 'last_peered': '2023-11-27T20:42:37.485705+0000', 'last_clean': '2023-11-27T20:42:37.485705+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:37.523128+0000', 'last_undegraded': '2023-11-27T20:42:37.523128+0000', 'last_fullsized': '2023-11-27T20:42:37.523128+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:37.485705+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:42:43.966 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-27T20:42:44.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.201+0000 7f700958a640 1 Processor -- start 2023-11-27T20:42:44.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.202+0000 7f700958a640 1 -- start start 2023-11-27T20:42:44.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.203+0000 7f700958a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f700414c2e0 0x7f70040c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.203+0000 7f700958a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7004072310 0x7f70040a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.203+0000 7f700958a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7004071e80 con 0x7f70040c0440 2023-11-27T20:42:44.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.203+0000 7f700958a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7004071470 con 0x7f7004072310 2023-11-27T20:42:44.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.203+0000 7f700958a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700414c6c0 con 0x7f700414c2e0 2023-11-27T20:42:44.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.204+0000 7f7008d89640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7004072310 0x7f70040a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.204+0000 7f7008d89640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7004072310 0x7f70040a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54540/0 (socket says 172.21.15.91:54540) 2023-11-27T20:42:44.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.204+0000 7f7008d89640 1 -- 172.21.15.91:0/995750903 learned_addr learned my addr 172.21.15.91:0/995750903 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:44.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.204+0000 7f7003fff640 1 --2- 172.21.15.91:0/995750903 >> v2:172.21.15.183:3300/0 conn(0x7f700414c2e0 0x7f70040c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.204+0000 7f7008d89640 1 -- 172.21.15.91:0/995750903 >> v2:172.21.15.183:3300/0 conn(0x7f700414c2e0 msgr2=0x7f70040c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:44.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.204+0000 7f7008d89640 1 --2- 172.21.15.91:0/995750903 >> v2:172.21.15.183:3300/0 conn(0x7f700414c2e0 0x7f70040c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.204+0000 7f7008d89640 1 -- 172.21.15.91:0/995750903 >> v1:172.21.15.183:6789/0 conn(0x7f70040c0440 legacy=0x7f7004152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:44.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.204+0000 7f7008d89640 1 -- 172.21.15.91:0/995750903 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700406fdc0 con 0x7f7004072310 2023-11-27T20:42:44.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.205+0000 7f7008d89640 1 --2- 172.21.15.91:0/995750903 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7004072310 0x7f70040a4d20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7004067940 tx=0x7f6ffc02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3044fa2d41e998 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:44.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f70037fe640 1 -- 172.21.15.91:0/995750903 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc02c960 con 0x7f7004072310 2023-11-27T20:42:44.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f70037fe640 1 -- 172.21.15.91:0/995750903 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc02cac0 con 0x7f7004072310 2023-11-27T20:42:44.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f70037fe640 1 -- 172.21.15.91:0/995750903 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc02ce50 con 0x7f7004072310 2023-11-27T20:42:44.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f700958a640 1 -- 172.21.15.91:0/995750903 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7004072310 msgr2=0x7f70040a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:44.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f700958a640 1 --2- 172.21.15.91:0/995750903 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7004072310 0x7f70040a4d20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7004067940 tx=0x7f6ffc02bdc0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f700958a640 1 -- 172.21.15.91:0/995750903 shutdown_connections 2023-11-27T20:42:44.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f700958a640 1 --2- 172.21.15.91:0/995750903 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7004072310 0x7f70040a4d20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f700958a640 1 --2- 172.21.15.91:0/995750903 >> v2:172.21.15.183:3300/0 conn(0x7f700414c2e0 0x7f70040c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f700958a640 1 -- 172.21.15.91:0/995750903 >> 172.21.15.91:0/995750903 conn(0x7f70040a77f0 msgr2=0x7f70040a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:44.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f700958a640 1 -- 172.21.15.91:0/995750903 shutdown_connections 2023-11-27T20:42:44.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.206+0000 7f700958a640 1 -- 172.21.15.91:0/995750903 wait complete. 2023-11-27T20:42:44.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.208+0000 7f700958a640 1 Processor -- start 2023-11-27T20:42:44.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.208+0000 7f700958a640 1 -- start start 2023-11-27T20:42:44.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.209+0000 7f700958a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7004072310 0x7f700406bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.209+0000 7f700958a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70040c0440 0x7f70040bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.209+0000 7f700958a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f700414c2e0 0x7f70041ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.209+0000 7f700958a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70041e9a50 con 0x7f70040c0440 2023-11-27T20:42:44.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.209+0000 7f700958a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70040a87f0 con 0x7f7004072310 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.209+0000 7f700958a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70040a8ad0 con 0x7f700414c2e0 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.209+0000 7f6ffb7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70040c0440 0x7f70040bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.209+0000 7f6ffb7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70040c0440 0x7f70040bf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54554/0 (socket says 172.21.15.91:54554) 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.209+0000 7f6ffb7fe640 1 -- 172.21.15.91:0/711369112 learned_addr learned my addr 172.21.15.91:0/711369112 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.210+0000 7f7003fff640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7004072310 0x7f700406bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.210+0000 7f6ffb7fe640 1 -- 172.21.15.91:0/711369112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f700414c2e0 msgr2=0x7f70041ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.210+0000 7f7008d89640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f700414c2e0 0x7f70041ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.210+0000 7f6ffb7fe640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f700414c2e0 0x7f70041ea210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.210+0000 7f6ffb7fe640 1 -- 172.21.15.91:0/711369112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7004072310 msgr2=0x7f700406bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.210+0000 7f6ffb7fe640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7004072310 0x7f700406bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.210+0000 7f6ffb7fe640 1 -- 172.21.15.91:0/711369112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc009b30 con 0x7f70040c0440 2023-11-27T20:42:44.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.210+0000 7f7003fff640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7004072310 0x7f700406bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:44.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.210+0000 7f6ffb7fe640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70040c0440 0x7f70040bf0e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00c430 tx=0x7f6fec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:44.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.210+0000 7f70017fa640 1 -- 172.21.15.91:0/711369112 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec011790 con 0x7f70040c0440 2023-11-27T20:42:44.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.211+0000 7f70017fa640 1 -- 172.21.15.91:0/711369112 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec0118f0 con 0x7f70040c0440 2023-11-27T20:42:44.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.211+0000 7f700958a640 1 -- 172.21.15.91:0/711369112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70041e9cf0 con 0x7f70040c0440 2023-11-27T20:42:44.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.211+0000 7f70017fa640 1 -- 172.21.15.91:0/711369112 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec011ce0 con 0x7f70040c0440 2023-11-27T20:42:44.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.211+0000 7f700958a640 1 -- 172.21.15.91:0/711369112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70040a8db0 con 0x7f70040c0440 2023-11-27T20:42:44.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.212+0000 7f700958a640 1 -- 172.21.15.91:0/711369112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700404e840 con 0x7f70040c0440 2023-11-27T20:42:44.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.213+0000 7f70017fa640 1 -- 172.21.15.91:0/711369112 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6fec01c460 con 0x7f70040c0440 2023-11-27T20:42:44.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.213+0000 7f70017fa640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6fe406b1c0 0x7f6fe406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.214+0000 7f70017fa640 1 -- 172.21.15.91:0/711369112 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fec0899f0 con 0x7f70040c0440 2023-11-27T20:42:44.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.214+0000 7f7003fff640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6fe406b1c0 0x7f6fe406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.214+0000 7f7003fff640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6fe406b1c0 0x7f6fe406d680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4006fd0 tx=0x7f6ff4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:44.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.218+0000 7f70017fa640 1 -- 172.21.15.91:0/711369112 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6fec054710 con 0x7f70040c0440 2023-11-27T20:42:44.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.481+0000 7f700958a640 1 -- 172.21.15.91:0/711369112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f70040c5380 con 0x7f70040c0440 2023-11-27T20:42:44.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.482+0000 7f70017fa640 1 -- 172.21.15.91:0/711369112 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1581 (secure 0 0 0) 0x7f6fec057d30 con 0x7f70040c0440 2023-11-27T20:42:44.483 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:44.483 INFO:teuthology.orchestra.run.smithi091.stdout:{"fsid":"76812701-65a9-4deb-87af-ef00110d1601","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":94,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1701117682,"num_in_osds":8,"osd_in_since":1701117673,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225402880,"bytes_avail":772868710400,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5025}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-27T20:42:25.387904+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-27T20:42:44.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 -- 172.21.15.91:0/711369112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6fe406b1c0 msgr2=0x7f6fe406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:44.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6fe406b1c0 0x7f6fe406d680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4006fd0 tx=0x7f6ff4008040 comp rx=0 tx=0).stop 2023-11-27T20:42:44.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 -- 172.21.15.91:0/711369112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70040c0440 msgr2=0x7f70040bf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:44.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70040c0440 0x7f70040bf0e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00c430 tx=0x7f6fec00c8f0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 -- 172.21.15.91:0/711369112 shutdown_connections 2023-11-27T20:42:44.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f700414c2e0 0x7f70041ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70040c0440 0x7f70040bf0e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6fe406b1c0 0x7f6fe406d680 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 --2- 172.21.15.91:0/711369112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7004072310 0x7f700406bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 -- 172.21.15.91:0/711369112 >> 172.21.15.91:0/711369112 conn(0x7f70040a77f0 msgr2=0x7f7004156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:44.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 -- 172.21.15.91:0/711369112 shutdown_connections 2023-11-27T20:42:44.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.485+0000 7f700958a640 1 -- 172.21.15.91:0/711369112 wait complete. 2023-11-27T20:42:44.503 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-27T20:42:44.504 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:42:44.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.718+0000 7f940a73c640 1 Processor -- start 2023-11-27T20:42:44.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.718+0000 7f940a73c640 1 -- start start 2023-11-27T20:42:44.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f940a73c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f940414fd30 0x7f9404152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f940a73c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f940406d0a0 0x7f94040a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f940a73c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f94040a5260 0x7f94040c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f940a73c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94040c64a0 con 0x7f940414fd30 2023-11-27T20:42:44.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f940a73c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94040c5c00 con 0x7f94040a5260 2023-11-27T20:42:44.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f940a73c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94040c5ee0 con 0x7f940406d0a0 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f9403fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f940414fd30 0x7f9404152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f9403fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f940414fd30 0x7f9404152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54556/0 (socket says 172.21.15.91:54556) 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f9403fff640 1 -- 172.21.15.91:0/3874727790 learned_addr learned my addr 172.21.15.91:0/3874727790 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f9408cd9640 1 --2- 172.21.15.91:0/3874727790 >> v2:172.21.15.183:3300/0 conn(0x7f94040a5260 0x7f94040c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.720+0000 7f94037fe640 1 --2- 172.21.15.91:0/3874727790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f940406d0a0 0x7f94040a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.721+0000 7f9403fff640 1 -- 172.21.15.91:0/3874727790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f940406d0a0 msgr2=0x7f94040a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.721+0000 7f9403fff640 1 --2- 172.21.15.91:0/3874727790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f940406d0a0 0x7f94040a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.721+0000 7f9403fff640 1 -- 172.21.15.91:0/3874727790 >> v2:172.21.15.183:3300/0 conn(0x7f94040a5260 msgr2=0x7f94040c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.721+0000 7f9403fff640 1 --2- 172.21.15.91:0/3874727790 >> v2:172.21.15.183:3300/0 conn(0x7f94040a5260 0x7f94040c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.721+0000 7f9403fff640 1 -- 172.21.15.91:0/3874727790 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94040c61c0 con 0x7f940414fd30 2023-11-27T20:42:44.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.722+0000 7f9403fff640 1 --2- 172.21.15.91:0/3874727790 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f940414fd30 0x7f9404152f20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f940406d990 tx=0x7f93f402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c8cd75833251b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:44.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.722+0000 7f9402ffd640 1 -- 172.21.15.91:0/3874727790 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4031870 con 0x7f940414fd30 2023-11-27T20:42:44.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.722+0000 7f9402ffd640 1 -- 172.21.15.91:0/3874727790 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f40319d0 con 0x7f940414fd30 2023-11-27T20:42:44.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.722+0000 7f9402ffd640 1 -- 172.21.15.91:0/3874727790 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4031d60 con 0x7f940414fd30 2023-11-27T20:42:44.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.723+0000 7f940a73c640 1 -- 172.21.15.91:0/3874727790 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f940414fd30 msgr2=0x7f9404152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:44.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.723+0000 7f940a73c640 1 --2- 172.21.15.91:0/3874727790 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f940414fd30 0x7f9404152f20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f940406d990 tx=0x7f93f402b910 comp rx=0 tx=0).stop 2023-11-27T20:42:44.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.723+0000 7f940a73c640 1 -- 172.21.15.91:0/3874727790 shutdown_connections 2023-11-27T20:42:44.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.723+0000 7f940a73c640 1 --2- 172.21.15.91:0/3874727790 >> v2:172.21.15.183:3300/0 conn(0x7f94040a5260 0x7f94040c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.723+0000 7f940a73c640 1 --2- 172.21.15.91:0/3874727790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f940406d0a0 0x7f94040a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.723+0000 7f940a73c640 1 --2- 172.21.15.91:0/3874727790 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f940414fd30 0x7f9404152f20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.723+0000 7f940a73c640 1 -- 172.21.15.91:0/3874727790 >> 172.21.15.91:0/3874727790 conn(0x7f940406a500 msgr2=0x7f940406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:44.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.723+0000 7f940a73c640 1 -- 172.21.15.91:0/3874727790 shutdown_connections 2023-11-27T20:42:44.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.723+0000 7f940a73c640 1 -- 172.21.15.91:0/3874727790 wait complete. 2023-11-27T20:42:44.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.725+0000 7f940a73c640 1 Processor -- start 2023-11-27T20:42:44.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.725+0000 7f940a73c640 1 -- start start 2023-11-27T20:42:44.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f940a73c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f940406d0a0 0x7f94040a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f940a73c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94040a5260 0x7f940414ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f940a73c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f940414fd30 0x7f940414e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f940a73c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94040a5fa0 con 0x7f94040a5260 2023-11-27T20:42:44.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f940a73c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94040a5970 con 0x7f940406d0a0 2023-11-27T20:42:44.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f940a73c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94040a8120 con 0x7f940414fd30 2023-11-27T20:42:44.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f94037fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94040a5260 0x7f940414ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f94037fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94040a5260 0x7f940414ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54562/0 (socket says 172.21.15.91:54562) 2023-11-27T20:42:44.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f94037fe640 1 -- 172.21.15.91:0/2391728090 learned_addr learned my addr 172.21.15.91:0/2391728090 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:44.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f9408cd9640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f940414fd30 0x7f940414e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f94037fe640 1 -- 172.21.15.91:0/2391728090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f940414fd30 msgr2=0x7f940414e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:44.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f9403fff640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f940406d0a0 0x7f94040a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f94037fe640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f940414fd30 0x7f940414e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f94037fe640 1 -- 172.21.15.91:0/2391728090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f940406d0a0 msgr2=0x7f94040a78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:44.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.726+0000 7f94037fe640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f940406d0a0 0x7f94040a78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.727+0000 7f94037fe640 1 -- 172.21.15.91:0/2391728090 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40094d0 con 0x7f94040a5260 2023-11-27T20:42:44.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.727+0000 7f94037fe640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94040a5260 0x7f940414ded0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f93f800d7d0 tx=0x7f93f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:44.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.727+0000 7f9400ff9640 1 -- 172.21.15.91:0/2391728090 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80096a0 con 0x7f94040a5260 2023-11-27T20:42:44.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.727+0000 7f9400ff9640 1 -- 172.21.15.91:0/2391728090 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f8009800 con 0x7f94040a5260 2023-11-27T20:42:44.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.727+0000 7f9400ff9640 1 -- 172.21.15.91:0/2391728090 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f8009b90 con 0x7f94040a5260 2023-11-27T20:42:44.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.727+0000 7f940a73c640 1 -- 172.21.15.91:0/2391728090 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94040a8400 con 0x7f94040a5260 2023-11-27T20:42:44.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.727+0000 7f940a73c640 1 -- 172.21.15.91:0/2391728090 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9404071fd0 con 0x7f94040a5260 2023-11-27T20:42:44.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.728+0000 7f940a73c640 1 -- 172.21.15.91:0/2391728090 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9404068350 con 0x7f94040a5260 2023-11-27T20:42:44.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.729+0000 7f9400ff9640 1 -- 172.21.15.91:0/2391728090 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f93f8009cf0 con 0x7f94040a5260 2023-11-27T20:42:44.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.730+0000 7f9400ff9640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f93f006b1c0 0x7f93f006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:44.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.731+0000 7f9400ff9640 1 -- 172.21.15.91:0/2391728090 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93f8089f30 con 0x7f94040a5260 2023-11-27T20:42:44.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.731+0000 7f9403fff640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f93f006b1c0 0x7f93f006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:44.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.731+0000 7f9403fff640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f93f006b1c0 0x7f93f006d680 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f93f4036000 tx=0x7f93f403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:44.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.735+0000 7f9400ff9640 1 -- 172.21.15.91:0/2391728090 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f93f8054c50 con 0x7f94040a5260 2023-11-27T20:42:44.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.921+0000 7f940a73c640 1 -- 172.21.15.91:0/2391728090 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94040c43e0 con 0x7f93f006b1c0 2023-11-27T20:42:44.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.933+0000 7f9400ff9640 1 -- 172.21.15.91:0/2391728090 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281577 (secure 0 0 0) 0x7f93f403a420 con 0x7f93f006b1c0 2023-11-27T20:42:44.937 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:44.939 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:42:44.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.939+0000 7f940a73c640 1 -- 172.21.15.91:0/2391728090 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f93f006b1c0 msgr2=0x7f93f006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:44.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.939+0000 7f940a73c640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f93f006b1c0 0x7f93f006d680 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f93f4036000 tx=0x7f93f403c040 comp rx=0 tx=0).stop 2023-11-27T20:42:44.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.939+0000 7f940a73c640 1 -- 172.21.15.91:0/2391728090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94040a5260 msgr2=0x7f940414ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:44.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.939+0000 7f940a73c640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94040a5260 0x7f940414ded0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f93f800d7d0 tx=0x7f93f800dc90 comp rx=0 tx=0).stop 2023-11-27T20:42:44.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.940+0000 7f940a73c640 1 -- 172.21.15.91:0/2391728090 shutdown_connections 2023-11-27T20:42:44.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.940+0000 7f940a73c640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f940414fd30 0x7f940414e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.940+0000 7f940a73c640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94040a5260 0x7f940414ded0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.940+0000 7f940a73c640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f93f006b1c0 0x7f93f006d680 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.940+0000 7f940a73c640 1 --2- 172.21.15.91:0/2391728090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f940406d0a0 0x7f94040a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:44.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.940+0000 7f940a73c640 1 -- 172.21.15.91:0/2391728090 >> 172.21.15.91:0/2391728090 conn(0x7f940406a500 msgr2=0x7f94041e0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:44.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.940+0000 7f940a73c640 1 -- 172.21.15.91:0/2391728090 shutdown_connections 2023-11-27T20:42:44.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:44.940+0000 7f940a73c640 1 -- 172.21.15.91:0/2391728090 wait complete. 2023-11-27T20:42:44.959 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-27T20:42:43.392891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220120,"kb_used_data":3940,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754600,"statfs":{"total":773094113280,"available":772868710400,"internally_reserved":0,"allocated":4034560,"data_stored":2272847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002019"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.507171+0000","last_change":"2023-11-27T20:42:37.507171+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.507171+0000","last_undegraded":"2023-11-27T20:42:37.507171+0000","last_fullsized":"2023-11-27T20:42:37.507171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.512450+0000","last_change":"2023-11-27T20:42:37.512450+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.512450+0000","last_undegraded":"2023-11-27T20:42:37.512450+0000","last_fullsized":"2023-11-27T20:42:37.512450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518057+0000","last_change":"2023-11-27T20:42:37.518057+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518057+0000","last_undegraded":"2023-11-27T20:42:37.518057+0000","last_fullsized":"2023-11-27T20:42:37.518057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.510195+0000","last_change":"2023-11-27T20:42:37.510195+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.510195+0000","last_undegraded":"2023-11-27T20:42:37.510195+0000","last_fullsized":"2023-11-27T20:42:37.510195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515787+0000","last_change":"2023-11-27T20:42:37.515787+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515787+0000","last_undegraded":"2023-11-27T20:42:37.515787+0000","last_fullsized":"2023-11-27T20:42:37.515787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511964+0000","last_change":"2023-11-27T20:42:37.511964+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511964+0000","last_undegraded":"2023-11-27T20:42:37.511964+0000","last_fullsized":"2023-11-27T20:42:37.511964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.523443+0000","last_change":"2023-11-27T20:42:37.523443+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.523443+0000","last_undegraded":"2023-11-27T20:42:37.523443+0000","last_fullsized":"2023-11-27T20:42:37.523443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.528897+0000","last_change":"2023-11-27T20:42:37.528897+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.528897+0000","last_undegraded":"2023-11-27T20:42:37.528897+0000","last_fullsized":"2023-11-27T20:42:37.528897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.501968+0000","last_change":"2023-11-27T20:42:37.501968+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.501968+0000","last_undegraded":"2023-11-27T20:42:37.501968+0000","last_fullsized":"2023-11-27T20:42:37.501968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504322+0000","last_change":"2023-11-27T20:42:37.504322+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504322+0000","last_undegraded":"2023-11-27T20:42:37.504322+0000","last_fullsized":"2023-11-27T20:42:37.504322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.521826+0000","last_change":"2023-11-27T20:42:37.521826+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.521826+0000","last_undegraded":"2023-11-27T20:42:37.521826+0000","last_fullsized":"2023-11-27T20:42:37.521826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514524+0000","last_change":"2023-11-27T20:42:37.514524+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514524+0000","last_undegraded":"2023-11-27T20:42:37.514524+0000","last_fullsized":"2023-11-27T20:42:37.514524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515208+0000","last_change":"2023-11-27T20:42:37.515208+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515208+0000","last_undegraded":"2023-11-27T20:42:37.515208+0000","last_fullsized":"2023-11-27T20:42:37.515208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511574+0000","last_change":"2023-11-27T20:42:37.511574+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511574+0000","last_undegraded":"2023-11-27T20:42:37.511574+0000","last_fullsized":"2023-11-27T20:42:37.511574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519349+0000","last_change":"2023-11-27T20:42:37.519349+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519349+0000","last_undegraded":"2023-11-27T20:42:37.519349+0000","last_fullsized":"2023-11-27T20:42:37.519349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519684+0000","last_change":"2023-11-27T20:42:37.519684+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519684+0000","last_undegraded":"2023-11-27T20:42:37.519684+0000","last_fullsized":"2023-11-27T20:42:37.519684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.522777+0000","last_change":"2023-11-27T20:42:37.522777+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.522777+0000","last_undegraded":"2023-11-27T20:42:37.522777+0000","last_fullsized":"2023-11-27T20:42:37.522777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511548+0000","last_change":"2023-11-27T20:42:37.511548+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511548+0000","last_undegraded":"2023-11-27T20:42:37.511548+0000","last_fullsized":"2023-11-27T20:42:37.511548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511531+0000","last_change":"2023-11-27T20:42:37.511531+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511531+0000","last_undegraded":"2023-11-27T20:42:37.511531+0000","last_fullsized":"2023-11-27T20:42:37.511531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518559+0000","last_change":"2023-11-27T20:42:37.518559+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518559+0000","last_undegraded":"2023-11-27T20:42:37.518559+0000","last_fullsized":"2023-11-27T20:42:37.518559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.506586+0000","last_change":"2023-11-27T20:42:37.506586+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.506586+0000","last_undegraded":"2023-11-27T20:42:37.506586+0000","last_fullsized":"2023-11-27T20:42:37.506586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504134+0000","last_change":"2023-11-27T20:42:37.504134+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504134+0000","last_undegraded":"2023-11-27T20:42:37.504134+0000","last_fullsized":"2023-11-27T20:42:37.504134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.515948+0000","last_change":"2023-11-27T20:42:37.515948+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.515948+0000","last_undegraded":"2023-11-27T20:42:37.515948+0000","last_fullsized":"2023-11-27T20:42:37.515948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514796+0000","last_change":"2023-11-27T20:42:37.514796+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514796+0000","last_undegraded":"2023-11-27T20:42:37.514796+0000","last_fullsized":"2023-11-27T20:42:37.514796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508064+0000","last_change":"2023-11-27T20:42:37.508064+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508064+0000","last_undegraded":"2023-11-27T20:42:37.508064+0000","last_fullsized":"2023-11-27T20:42:37.508064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.510504+0000","last_change":"2023-11-27T20:42:37.510504+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.510504+0000","last_undegraded":"2023-11-27T20:42:37.510504+0000","last_fullsized":"2023-11-27T20:42:37.510504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513568+0000","last_change":"2023-11-27T20:42:37.513568+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513568+0000","last_undegraded":"2023-11-27T20:42:37.513568+0000","last_fullsized":"2023-11-27T20:42:37.513568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511588+0000","last_change":"2023-11-27T20:42:37.511588+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511588+0000","last_undegraded":"2023-11-27T20:42:37.511588+0000","last_fullsized":"2023-11-27T20:42:37.511588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503780+0000","last_change":"2023-11-27T20:42:37.503780+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503780+0000","last_undegraded":"2023-11-27T20:42:37.503780+0000","last_fullsized":"2023-11-27T20:42:37.503780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.520838+0000","last_change":"2023-11-27T20:42:37.520838+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.520838+0000","last_undegraded":"2023-11-27T20:42:37.520838+0000","last_fullsized":"2023-11-27T20:42:37.520838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.504137+0000","last_change":"2023-11-27T20:42:37.504137+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.504137+0000","last_undegraded":"2023-11-27T20:42:37.504137+0000","last_fullsized":"2023-11-27T20:42:37.504137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.528425+0000","last_change":"2023-11-27T20:42:37.528425+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.528425+0000","last_undegraded":"2023-11-27T20:42:37.528425+0000","last_fullsized":"2023-11-27T20:42:37.528425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.519836+0000","last_change":"2023-11-27T20:42:37.519836+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.519836+0000","last_undegraded":"2023-11-27T20:42:37.519836+0000","last_fullsized":"2023-11-27T20:42:37.519836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.532488+0000","last_change":"2023-11-27T20:42:37.528294+0000","last_active":"2023-11-27T20:42:37.532488+0000","last_peered":"2023-11-27T20:42:37.532488+0000","last_clean":"2023-11-27T20:42:37.532488+0000","last_became_active":"2023-11-27T20:42:37.528055+0000","last_became_peered":"2023-11-27T20:42:37.528055+0000","last_unstale":"2023-11-27T20:42:37.532488+0000","last_undegraded":"2023-11-27T20:42:37.532488+0000","last_fullsized":"2023-11-27T20:42:37.532488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.506060+0000","last_change":"2023-11-27T20:42:37.506060+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.506060+0000","last_undegraded":"2023-11-27T20:42:37.506060+0000","last_fullsized":"2023-11-27T20:42:37.506060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.539636+0000","last_change":"2023-11-27T20:42:37.535511+0000","last_active":"2023-11-27T20:42:37.539636+0000","last_peered":"2023-11-27T20:42:37.539636+0000","last_clean":"2023-11-27T20:42:37.539636+0000","last_became_active":"2023-11-27T20:42:37.535314+0000","last_became_peered":"2023-11-27T20:42:37.535314+0000","last_unstale":"2023-11-27T20:42:37.539636+0000","last_undegraded":"2023-11-27T20:42:37.539636+0000","last_fullsized":"2023-11-27T20:42:37.539636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:47.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502494+0000","last_change":"2023-11-27T20:42:37.502494+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502494+0000","last_undegraded":"2023-11-27T20:42:37.502494+0000","last_fullsized":"2023-11-27T20:42:37.502494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.529016+0000","last_change":"2023-11-27T20:42:37.520015+0000","last_active":"2023-11-27T20:42:37.529016+0000","last_peered":"2023-11-27T20:42:37.529016+0000","last_clean":"2023-11-27T20:42:37.529016+0000","last_became_active":"2023-11-27T20:42:37.519779+0000","last_became_peered":"2023-11-27T20:42:37.519779+0000","last_unstale":"2023-11-27T20:42:37.529016+0000","last_undegraded":"2023-11-27T20:42:37.529016+0000","last_fullsized":"2023-11-27T20:42:37.529016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513095+0000","last_change":"2023-11-27T20:42:37.513095+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513095+0000","last_undegraded":"2023-11-27T20:42:37.513095+0000","last_fullsized":"2023-11-27T20:42:37.513095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533841+0000","last_change":"2023-11-27T20:42:37.530074+0000","last_active":"2023-11-27T20:42:37.533841+0000","last_peered":"2023-11-27T20:42:37.533841+0000","last_clean":"2023-11-27T20:42:37.533841+0000","last_became_active":"2023-11-27T20:42:37.529422+0000","last_became_peered":"2023-11-27T20:42:37.529422+0000","last_unstale":"2023-11-27T20:42:37.533841+0000","last_undegraded":"2023-11-27T20:42:37.533841+0000","last_fullsized":"2023-11-27T20:42:37.533841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:32:25.861163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.520224+0000","last_change":"2023-11-27T20:42:37.520224+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.520224+0000","last_undegraded":"2023-11-27T20:42:37.520224+0000","last_fullsized":"2023-11-27T20:42:37.520224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533860+0000","last_change":"2023-11-27T20:42:37.527381+0000","last_active":"2023-11-27T20:42:37.533860+0000","last_peered":"2023-11-27T20:42:37.533860+0000","last_clean":"2023-11-27T20:42:37.533860+0000","last_became_active":"2023-11-27T20:42:37.527147+0000","last_became_peered":"2023-11-27T20:42:37.527147+0000","last_unstale":"2023-11-27T20:42:37.533860+0000","last_undegraded":"2023-11-27T20:42:37.533860+0000","last_fullsized":"2023-11-27T20:42:37.533860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:28:47.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514071+0000","last_change":"2023-11-27T20:42:37.514071+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514071+0000","last_undegraded":"2023-11-27T20:42:37.514071+0000","last_fullsized":"2023-11-27T20:42:37.514071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537556+0000","last_change":"2023-11-27T20:42:37.531654+0000","last_active":"2023-11-27T20:42:37.537556+0000","last_peered":"2023-11-27T20:42:37.537556+0000","last_clean":"2023-11-27T20:42:37.537556+0000","last_became_active":"2023-11-27T20:42:37.529901+0000","last_became_peered":"2023-11-27T20:42:37.529901+0000","last_unstale":"2023-11-27T20:42:37.537556+0000","last_undegraded":"2023-11-27T20:42:37.537556+0000","last_fullsized":"2023-11-27T20:42:37.537556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:25:52.361215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.501269+0000","last_change":"2023-11-27T20:42:37.501269+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.501269+0000","last_undegraded":"2023-11-27T20:42:37.501269+0000","last_fullsized":"2023-11-27T20:42:37.501269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.528979+0000","last_change":"2023-11-27T20:42:37.522964+0000","last_active":"2023-11-27T20:42:37.528979+0000","last_peered":"2023-11-27T20:42:37.528979+0000","last_clean":"2023-11-27T20:42:37.528979+0000","last_became_active":"2023-11-27T20:42:37.522677+0000","last_became_peered":"2023-11-27T20:42:37.522677+0000","last_unstale":"2023-11-27T20:42:37.528979+0000","last_undegraded":"2023-11-27T20:42:37.528979+0000","last_fullsized":"2023-11-27T20:42:37.528979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:42.888540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503711+0000","last_change":"2023-11-27T20:42:37.503711+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503711+0000","last_undegraded":"2023-11-27T20:42:37.503711+0000","last_fullsized":"2023-11-27T20:42:37.503711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527926+0000","last_change":"2023-11-27T20:42:37.522230+0000","last_active":"2023-11-27T20:42:37.527926+0000","last_peered":"2023-11-27T20:42:37.527926+0000","last_clean":"2023-11-27T20:42:37.527926+0000","last_became_active":"2023-11-27T20:42:37.521898+0000","last_became_peered":"2023-11-27T20:42:37.521898+0000","last_unstale":"2023-11-27T20:42:37.527926+0000","last_undegraded":"2023-11-27T20:42:37.527926+0000","last_fullsized":"2023-11-27T20:42:37.527926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:29:17.198964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.511614+0000","last_change":"2023-11-27T20:42:37.511614+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.511614+0000","last_undegraded":"2023-11-27T20:42:37.511614+0000","last_fullsized":"2023-11-27T20:42:37.511614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536950+0000","last_change":"2023-11-27T20:42:37.531762+0000","last_active":"2023-11-27T20:42:37.536950+0000","last_peered":"2023-11-27T20:42:37.536950+0000","last_clean":"2023-11-27T20:42:37.536950+0000","last_became_active":"2023-11-27T20:42:37.531446+0000","last_became_peered":"2023-11-27T20:42:37.531446+0000","last_unstale":"2023-11-27T20:42:37.536950+0000","last_undegraded":"2023-11-27T20:42:37.536950+0000","last_fullsized":"2023-11-27T20:42:37.536950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:16:18.992040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.512794+0000","last_change":"2023-11-27T20:42:37.512794+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.512794+0000","last_undegraded":"2023-11-27T20:42:37.512794+0000","last_fullsized":"2023-11-27T20:42:37.512794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536897+0000","last_change":"2023-11-27T20:42:37.532869+0000","last_active":"2023-11-27T20:42:37.536897+0000","last_peered":"2023-11-27T20:42:37.536897+0000","last_clean":"2023-11-27T20:42:37.536897+0000","last_became_active":"2023-11-27T20:42:37.532576+0000","last_became_peered":"2023-11-27T20:42:37.532576+0000","last_unstale":"2023-11-27T20:42:37.536897+0000","last_undegraded":"2023-11-27T20:42:37.536897+0000","last_fullsized":"2023-11-27T20:42:37.536897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508823+0000","last_change":"2023-11-27T20:42:37.508823+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508823+0000","last_undegraded":"2023-11-27T20:42:37.508823+0000","last_fullsized":"2023-11-27T20:42:37.508823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536684+0000","last_change":"2023-11-27T20:42:37.530460+0000","last_active":"2023-11-27T20:42:37.536684+0000","last_peered":"2023-11-27T20:42:37.536684+0000","last_clean":"2023-11-27T20:42:37.536684+0000","last_became_active":"2023-11-27T20:42:37.529879+0000","last_became_peered":"2023-11-27T20:42:37.529879+0000","last_unstale":"2023-11-27T20:42:37.536684+0000","last_undegraded":"2023-11-27T20:42:37.536684+0000","last_fullsized":"2023-11-27T20:42:37.536684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:42.888540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.518638+0000","last_change":"2023-11-27T20:42:37.518638+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.518638+0000","last_undegraded":"2023-11-27T20:42:37.518638+0000","last_fullsized":"2023-11-27T20:42:37.518638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531644+0000","last_change":"2023-11-27T20:42:37.523173+0000","last_active":"2023-11-27T20:42:37.531644+0000","last_peered":"2023-11-27T20:42:37.531644+0000","last_clean":"2023-11-27T20:42:37.531644+0000","last_became_active":"2023-11-27T20:42:37.522903+0000","last_became_peered":"2023-11-27T20:42:37.522903+0000","last_unstale":"2023-11-27T20:42:37.531644+0000","last_undegraded":"2023-11-27T20:42:37.531644+0000","last_fullsized":"2023-11-27T20:42:37.531644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:47.717784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505436+0000","last_change":"2023-11-27T20:42:37.505436+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505436+0000","last_undegraded":"2023-11-27T20:42:37.505436+0000","last_fullsized":"2023-11-27T20:42:37.505436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533633+0000","last_change":"2023-11-27T20:42:37.524294+0000","last_active":"2023-11-27T20:42:37.533633+0000","last_peered":"2023-11-27T20:42:37.533633+0000","last_clean":"2023-11-27T20:42:37.533633+0000","last_became_active":"2023-11-27T20:42:37.523858+0000","last_became_peered":"2023-11-27T20:42:37.523858+0000","last_unstale":"2023-11-27T20:42:37.533633+0000","last_undegraded":"2023-11-27T20:42:37.533633+0000","last_fullsized":"2023-11-27T20:42:37.533633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:02:50.193416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.508941+0000","last_change":"2023-11-27T20:42:37.508941+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.508941+0000","last_undegraded":"2023-11-27T20:42:37.508941+0000","last_fullsized":"2023-11-27T20:42:37.508941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.530936+0000","last_change":"2023-11-27T20:42:37.522904+0000","last_active":"2023-11-27T20:42:37.530936+0000","last_peered":"2023-11-27T20:42:37.530936+0000","last_clean":"2023-11-27T20:42:37.530936+0000","last_became_active":"2023-11-27T20:42:37.522574+0000","last_became_peered":"2023-11-27T20:42:37.522574+0000","last_unstale":"2023-11-27T20:42:37.530936+0000","last_undegraded":"2023-11-27T20:42:37.530936+0000","last_fullsized":"2023-11-27T20:42:37.530936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:37.188919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.527110+0000","last_change":"2023-11-27T20:42:37.527110+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.527110+0000","last_undegraded":"2023-11-27T20:42:37.527110+0000","last_fullsized":"2023-11-27T20:42:37.527110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.539619+0000","last_change":"2023-11-27T20:42:37.535247+0000","last_active":"2023-11-27T20:42:37.539619+0000","last_peered":"2023-11-27T20:42:37.539619+0000","last_clean":"2023-11-27T20:42:37.539619+0000","last_became_active":"2023-11-27T20:42:37.534922+0000","last_became_peered":"2023-11-27T20:42:37.534922+0000","last_unstale":"2023-11-27T20:42:37.539619+0000","last_undegraded":"2023-11-27T20:42:37.539619+0000","last_fullsized":"2023-11-27T20:42:37.539619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502506+0000","last_change":"2023-11-27T20:42:37.502506+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502506+0000","last_undegraded":"2023-11-27T20:42:37.502506+0000","last_fullsized":"2023-11-27T20:42:37.502506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.524213+0000","last_change":"2023-11-27T20:42:37.514338+0000","last_active":"2023-11-27T20:42:37.524213+0000","last_peered":"2023-11-27T20:42:37.524213+0000","last_clean":"2023-11-27T20:42:37.524213+0000","last_became_active":"2023-11-27T20:42:37.514055+0000","last_became_peered":"2023-11-27T20:42:37.514055+0000","last_unstale":"2023-11-27T20:42:37.524213+0000","last_undegraded":"2023-11-27T20:42:37.524213+0000","last_fullsized":"2023-11-27T20:42:37.524213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505512+0000","last_change":"2023-11-27T20:42:37.505512+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505512+0000","last_undegraded":"2023-11-27T20:42:37.505512+0000","last_fullsized":"2023-11-27T20:42:37.505512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531502+0000","last_change":"2023-11-27T20:42:37.525560+0000","last_active":"2023-11-27T20:42:37.531502+0000","last_peered":"2023-11-27T20:42:37.531502+0000","last_clean":"2023-11-27T20:42:37.531502+0000","last_became_active":"2023-11-27T20:42:37.525261+0000","last_became_peered":"2023-11-27T20:42:37.525261+0000","last_unstale":"2023-11-27T20:42:37.531502+0000","last_undegraded":"2023-11-27T20:42:37.531502+0000","last_fullsized":"2023-11-27T20:42:37.531502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516690+0000","last_change":"2023-11-27T20:42:37.516690+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516690+0000","last_undegraded":"2023-11-27T20:42:37.516690+0000","last_fullsized":"2023-11-27T20:42:37.516690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527935+0000","last_change":"2023-11-27T20:42:37.522245+0000","last_active":"2023-11-27T20:42:37.527935+0000","last_peered":"2023-11-27T20:42:37.527935+0000","last_clean":"2023-11-27T20:42:37.527935+0000","last_became_active":"2023-11-27T20:42:37.521938+0000","last_became_peered":"2023-11-27T20:42:37.521938+0000","last_unstale":"2023-11-27T20:42:37.527935+0000","last_undegraded":"2023-11-27T20:42:37.527935+0000","last_fullsized":"2023-11-27T20:42:37.527935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:47:06.669263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.505173+0000","last_change":"2023-11-27T20:42:37.505173+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.505173+0000","last_undegraded":"2023-11-27T20:42:37.505173+0000","last_fullsized":"2023-11-27T20:42:37.505173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533733+0000","last_change":"2023-11-27T20:42:37.525601+0000","last_active":"2023-11-27T20:42:37.533733+0000","last_peered":"2023-11-27T20:42:37.533733+0000","last_clean":"2023-11-27T20:42:37.533733+0000","last_became_active":"2023-11-27T20:42:37.525296+0000","last_became_peered":"2023-11-27T20:42:37.525296+0000","last_unstale":"2023-11-27T20:42:37.533733+0000","last_undegraded":"2023-11-27T20:42:37.533733+0000","last_fullsized":"2023-11-27T20:42:37.533733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:09:22.812521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517575+0000","last_change":"2023-11-27T20:42:37.517575+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517575+0000","last_undegraded":"2023-11-27T20:42:37.517575+0000","last_fullsized":"2023-11-27T20:42:37.517575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533779+0000","last_change":"2023-11-27T20:42:37.527131+0000","last_active":"2023-11-27T20:42:37.533779+0000","last_peered":"2023-11-27T20:42:37.533779+0000","last_clean":"2023-11-27T20:42:37.533779+0000","last_became_active":"2023-11-27T20:42:37.526804+0000","last_became_peered":"2023-11-27T20:42:37.526804+0000","last_unstale":"2023-11-27T20:42:37.533779+0000","last_undegraded":"2023-11-27T20:42:37.533779+0000","last_fullsized":"2023-11-27T20:42:37.533779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:05.189004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513949+0000","last_change":"2023-11-27T20:42:37.513949+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513949+0000","last_undegraded":"2023-11-27T20:42:37.513949+0000","last_fullsized":"2023-11-27T20:42:37.513949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.531689+0000","last_change":"2023-11-27T20:42:37.527591+0000","last_active":"2023-11-27T20:42:37.531689+0000","last_peered":"2023-11-27T20:42:37.531689+0000","last_clean":"2023-11-27T20:42:37.531689+0000","last_became_active":"2023-11-27T20:42:37.527305+0000","last_became_peered":"2023-11-27T20:42:37.527305+0000","last_unstale":"2023-11-27T20:42:37.531689+0000","last_undegraded":"2023-11-27T20:42:37.531689+0000","last_fullsized":"2023-11-27T20:42:37.531689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.514521+0000","last_change":"2023-11-27T20:42:37.514521+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.514521+0000","last_undegraded":"2023-11-27T20:42:37.514521+0000","last_fullsized":"2023-11-27T20:42:37.514521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.525562+0000","last_change":"2023-11-27T20:42:37.522543+0000","last_active":"2023-11-27T20:42:37.525562+0000","last_peered":"2023-11-27T20:42:37.525562+0000","last_clean":"2023-11-27T20:42:37.525562+0000","last_became_active":"2023-11-27T20:42:37.522163+0000","last_became_peered":"2023-11-27T20:42:37.522163+0000","last_unstale":"2023-11-27T20:42:37.525562+0000","last_undegraded":"2023-11-27T20:42:37.525562+0000","last_fullsized":"2023-11-27T20:42:37.525562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.513682+0000","last_change":"2023-11-27T20:42:37.513682+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.513682+0000","last_undegraded":"2023-11-27T20:42:37.513682+0000","last_fullsized":"2023-11-27T20:42:37.513682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.522197+0000","last_change":"2023-11-27T20:42:37.518579+0000","last_active":"2023-11-27T20:42:37.522197+0000","last_peered":"2023-11-27T20:42:37.522197+0000","last_clean":"2023-11-27T20:42:37.522197+0000","last_became_active":"2023-11-27T20:42:37.517970+0000","last_became_peered":"2023-11-27T20:42:37.517970+0000","last_unstale":"2023-11-27T20:42:37.522197+0000","last_undegraded":"2023-11-27T20:42:37.522197+0000","last_fullsized":"2023-11-27T20:42:37.522197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:32:25.861163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.526199+0000","last_change":"2023-11-27T20:42:37.526199+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.526199+0000","last_undegraded":"2023-11-27T20:42:37.526199+0000","last_fullsized":"2023-11-27T20:42:37.526199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536771+0000","last_change":"2023-11-27T20:42:37.532212+0000","last_active":"2023-11-27T20:42:37.536771+0000","last_peered":"2023-11-27T20:42:37.536771+0000","last_clean":"2023-11-27T20:42:37.536771+0000","last_became_active":"2023-11-27T20:42:37.531894+0000","last_became_peered":"2023-11-27T20:42:37.531894+0000","last_unstale":"2023-11-27T20:42:37.536771+0000","last_undegraded":"2023-11-27T20:42:37.536771+0000","last_fullsized":"2023-11-27T20:42:37.536771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516658+0000","last_change":"2023-11-27T20:42:37.516658+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516658+0000","last_undegraded":"2023-11-27T20:42:37.516658+0000","last_fullsized":"2023-11-27T20:42:37.516658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534076+0000","last_change":"2023-11-27T20:42:37.530114+0000","last_active":"2023-11-27T20:42:37.534076+0000","last_peered":"2023-11-27T20:42:37.534076+0000","last_clean":"2023-11-27T20:42:37.534076+0000","last_became_active":"2023-11-27T20:42:37.529838+0000","last_became_peered":"2023-11-27T20:42:37.529838+0000","last_unstale":"2023-11-27T20:42:37.534076+0000","last_undegraded":"2023-11-27T20:42:37.534076+0000","last_fullsized":"2023-11-27T20:42:37.534076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.516148+0000","last_change":"2023-11-27T20:42:37.516148+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.516148+0000","last_undegraded":"2023-11-27T20:42:37.516148+0000","last_fullsized":"2023-11-27T20:42:37.516148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534123+0000","last_change":"2023-11-27T20:42:37.528142+0000","last_active":"2023-11-27T20:42:37.534123+0000","last_peered":"2023-11-27T20:42:37.534123+0000","last_clean":"2023-11-27T20:42:37.534123+0000","last_became_active":"2023-11-27T20:42:37.527318+0000","last_became_peered":"2023-11-27T20:42:37.527318+0000","last_unstale":"2023-11-27T20:42:37.534123+0000","last_undegraded":"2023-11-27T20:42:37.534123+0000","last_fullsized":"2023-11-27T20:42:37.534123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517148+0000","last_change":"2023-11-27T20:42:37.517148+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517148+0000","last_undegraded":"2023-11-27T20:42:37.517148+0000","last_fullsized":"2023-11-27T20:42:37.517148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.533948+0000","last_change":"2023-11-27T20:42:37.527056+0000","last_active":"2023-11-27T20:42:37.533948+0000","last_peered":"2023-11-27T20:42:37.533948+0000","last_clean":"2023-11-27T20:42:37.533948+0000","last_became_active":"2023-11-27T20:42:37.526803+0000","last_became_peered":"2023-11-27T20:42:37.526803+0000","last_unstale":"2023-11-27T20:42:37.533948+0000","last_undegraded":"2023-11-27T20:42:37.533948+0000","last_fullsized":"2023-11-27T20:42:37.533948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.507542+0000","last_change":"2023-11-27T20:42:37.507542+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.507542+0000","last_undegraded":"2023-11-27T20:42:37.507542+0000","last_fullsized":"2023-11-27T20:42:37.507542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.536858+0000","last_change":"2023-11-27T20:42:37.532441+0000","last_active":"2023-11-27T20:42:37.536858+0000","last_peered":"2023-11-27T20:42:37.536858+0000","last_clean":"2023-11-27T20:42:37.536858+0000","last_became_active":"2023-11-27T20:42:37.532074+0000","last_became_peered":"2023-11-27T20:42:37.532074+0000","last_unstale":"2023-11-27T20:42:37.536858+0000","last_undegraded":"2023-11-27T20:42:37.536858+0000","last_fullsized":"2023-11-27T20:42:37.536858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.517601+0000","last_change":"2023-11-27T20:42:37.517601+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.517601+0000","last_undegraded":"2023-11-27T20:42:37.517601+0000","last_fullsized":"2023-11-27T20:42:37.517601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.534045+0000","last_change":"2023-11-27T20:42:37.529807+0000","last_active":"2023-11-27T20:42:37.534045+0000","last_peered":"2023-11-27T20:42:37.534045+0000","last_clean":"2023-11-27T20:42:37.534045+0000","last_became_active":"2023-11-27T20:42:37.529543+0000","last_became_peered":"2023-11-27T20:42:37.529543+0000","last_unstale":"2023-11-27T20:42:37.534045+0000","last_undegraded":"2023-11-27T20:42:37.534045+0000","last_fullsized":"2023-11-27T20:42:37.534045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.503706+0000","last_change":"2023-11-27T20:42:37.503706+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.503706+0000","last_undegraded":"2023-11-27T20:42:37.503706+0000","last_fullsized":"2023-11-27T20:42:37.503706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537539+0000","last_change":"2023-11-27T20:42:37.530919+0000","last_active":"2023-11-27T20:42:37.537539+0000","last_peered":"2023-11-27T20:42:37.537539+0000","last_clean":"2023-11-27T20:42:37.537539+0000","last_became_active":"2023-11-27T20:42:37.530606+0000","last_became_peered":"2023-11-27T20:42:37.530606+0000","last_unstale":"2023-11-27T20:42:37.537539+0000","last_undegraded":"2023-11-27T20:42:37.537539+0000","last_fullsized":"2023-11-27T20:42:37.537539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:05:16.047989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.502275+0000","last_change":"2023-11-27T20:42:37.502275+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.502275+0000","last_undegraded":"2023-11-27T20:42:37.502275+0000","last_fullsized":"2023-11-27T20:42:37.502275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.537006+0000","last_change":"2023-11-27T20:42:37.533800+0000","last_active":"2023-11-27T20:42:37.537006+0000","last_peered":"2023-11-27T20:42:37.537006+0000","last_clean":"2023-11-27T20:42:37.537006+0000","last_became_active":"2023-11-27T20:42:37.533358+0000","last_became_peered":"2023-11-27T20:42:37.533358+0000","last_unstale":"2023-11-27T20:42:37.537006+0000","last_undegraded":"2023-11-27T20:42:37.537006+0000","last_fullsized":"2023-11-27T20:42:37.537006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-27T20:42:37.523128+0000","last_change":"2023-11-27T20:42:37.523128+0000","last_active":"2023-11-27T20:42:37.485705+0000","last_peered":"2023-11-27T20:42:37.485705+0000","last_clean":"2023-11-27T20:42:37.485705+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:37.523128+0000","last_undegraded":"2023-11-27T20:42:37.523128+0000","last_fullsized":"2023-11-27T20:42:37.523128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T20:42:37.527729+0000","last_change":"2023-11-27T20:42:37.523367+0000","last_active":"2023-11-27T20:42:37.527729+0000","last_peered":"2023-11-27T20:42:37.527729+0000","last_clean":"2023-11-27T20:42:37.527729+0000","last_became_active":"2023-11-27T20:42:37.522948+0000","last_became_peered":"2023-11-27T20:42:37.522948+0000","last_unstale":"2023-11-27T20:42:37.527729+0000","last_undegraded":"2023-11-27T20:42:37.527729+0000","last_fullsized":"2023-11-27T20:42:37.527729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-27T20:42:36.508328+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:42:36.508328+0000","last_peered":"2023-11-27T20:42:36.508328+0000","last_clean":"2023-11-27T20:42:36.508328+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:42:36.508328+0000","last_undegraded":"2023-11-27T20:42:36.508328+0000","last_fullsized":"2023-11-27T20:42:36.508328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0760000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2010000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.4039999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.248}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.367}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.573}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.006},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.95799999999999996}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.196},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.1579999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.88900000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3919999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.107},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":3.536,"5min":3.536,"15min":3.536},"last":1.2549999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.3}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.583},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.6499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.50800000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.379},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.433},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.47899999999999998}]},{"osd":3,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":0.58499999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2149999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.71399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.671}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.105},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.448}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.286},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.234}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.5940000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.3420000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.732}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.7849999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.442}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.8050000000000002,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.91300000000000003}]},{"osd":6,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":0.871},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.1140000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.66100000000000003}]},{"osd":1,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.90200000000000002},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.77000000000000002}]},{"osd":3,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.82499999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.044},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.3540000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.508}]},{"osd":6,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.272},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":1.585}]},{"osd":7,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.3}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.5449999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.4410000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.337}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.615},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.4930000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.133}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.71}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.98299999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":0.95999999999999996}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.181},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.83399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:42:47.964 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:42:48.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.182+0000 7f9d1be87640 1 Processor -- start 2023-11-27T20:42:48.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.182+0000 7f9d1be87640 1 -- start start 2023-11-27T20:42:48.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.184+0000 7f9d1be87640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9d1406d0a0 0x7f9d14152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.184+0000 7f9d1be87640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9d140c3ea0 0x7f9d140c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.184+0000 7f9d1be87640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d140c64a0 con 0x7f9d1414fd30 2023-11-27T20:42:48.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.184+0000 7f9d1be87640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d140c5c00 con 0x7f9d140c3ea0 2023-11-27T20:42:48.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.184+0000 7f9d1be87640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d140c5ee0 con 0x7f9d1406d0a0 2023-11-27T20:42:48.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.184+0000 7f9d19c23640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f9d1414fd30 0x7f9d140a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:58496/0 (socket says 172.21.15.91:58496) 2023-11-27T20:42:48.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.184+0000 7f9d19c23640 1 -- 172.21.15.91:0/1927622118 learned_addr learned my addr 172.21.15.91:0/1927622118 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:48.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.184+0000 7f9d1a424640 1 --2- 172.21.15.91:0/1927622118 >> v2:172.21.15.91:3300/0 conn(0x7f9d140c3ea0 0x7f9d140c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:48.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.184+0000 7f9d19422640 1 --2- 172.21.15.91:0/1927622118 >> v2:172.21.15.183:3300/0 conn(0x7f9d1406d0a0 0x7f9d14152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:48.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.185+0000 7f9d18c21640 1 -- 172.21.15.91:0/1927622118 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649460236 0 0) 0x7f9d140c64a0 con 0x7f9d1414fd30 2023-11-27T20:42:48.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.185+0000 7f9d18c21640 1 -- 172.21.15.91:0/1927622118 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d00003520 con 0x7f9d1414fd30 2023-11-27T20:42:48.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.185+0000 7f9d1a424640 1 -- 172.21.15.91:0/1927622118 >> v2:172.21.15.183:3300/0 conn(0x7f9d1406d0a0 msgr2=0x7f9d14152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:48.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.185+0000 7f9d1a424640 1 --2- 172.21.15.91:0/1927622118 >> v2:172.21.15.183:3300/0 conn(0x7f9d1406d0a0 0x7f9d14152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.185+0000 7f9d1a424640 1 -- 172.21.15.91:0/1927622118 >> v1:172.21.15.91:6789/0 conn(0x7f9d1414fd30 legacy=0x7f9d140a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.185+0000 7f9d1a424640 1 -- 172.21.15.91:0/1927622118 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140c61c0 con 0x7f9d140c3ea0 2023-11-27T20:42:48.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.185+0000 7f9d19422640 1 --2- 172.21.15.91:0/1927622118 >> v2:172.21.15.183:3300/0 conn(0x7f9d1406d0a0 0x7f9d14152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:42:48.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.186+0000 7f9d1a424640 1 --2- 172.21.15.91:0/1927622118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d140c3ea0 0x7f9d140c4330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9d1406b460 tx=0x7f9d0c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809cc701672958c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:48.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.186+0000 7f9d18c21640 1 -- 172.21.15.91:0/1927622118 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c02cc70 con 0x7f9d140c3ea0 2023-11-27T20:42:48.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.186+0000 7f9d18c21640 1 -- 172.21.15.91:0/1927622118 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c02cdd0 con 0x7f9d140c3ea0 2023-11-27T20:42:48.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.186+0000 7f9d18c21640 1 -- 172.21.15.91:0/1927622118 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c034660 con 0x7f9d140c3ea0 2023-11-27T20:42:48.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.187+0000 7f9d1be87640 1 -- 172.21.15.91:0/1927622118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d140c3ea0 msgr2=0x7f9d140c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.187+0000 7f9d1be87640 1 --2- 172.21.15.91:0/1927622118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d140c3ea0 0x7f9d140c4330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9d1406b460 tx=0x7f9d0c02bec0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.187+0000 7f9d1be87640 1 -- 172.21.15.91:0/1927622118 shutdown_connections 2023-11-27T20:42:48.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.187+0000 7f9d1be87640 1 --2- 172.21.15.91:0/1927622118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d140c3ea0 0x7f9d140c4330 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.187+0000 7f9d1be87640 1 --2- 172.21.15.91:0/1927622118 >> v2:172.21.15.183:3300/0 conn(0x7f9d1406d0a0 0x7f9d14152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.187+0000 7f9d1be87640 1 -- 172.21.15.91:0/1927622118 >> 172.21.15.91:0/1927622118 conn(0x7f9d1406a500 msgr2=0x7f9d1406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:48.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.187+0000 7f9d1be87640 1 -- 172.21.15.91:0/1927622118 shutdown_connections 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.187+0000 7f9d1be87640 1 -- 172.21.15.91:0/1927622118 wait complete. 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.189+0000 7f9d1be87640 1 Processor -- start 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.189+0000 7f9d1be87640 1 -- start start 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1be87640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d1406d0a0 0x7f9d140a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1be87640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d140c3ea0 0x7f9d14071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1be87640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d1414fd30 0x7f9d14154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1be87640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140aa8d0 con 0x7f9d1414fd30 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1be87640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140aa0c0 con 0x7f9d1406d0a0 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1be87640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d141541c0 con 0x7f9d140c3ea0 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1a424640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d1414fd30 0x7f9d14154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1a424640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d1414fd30 0x7f9d14154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54574/0 (socket says 172.21.15.91:54574) 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1a424640 1 -- 172.21.15.91:0/2164728868 learned_addr learned my addr 172.21.15.91:0/2164728868 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d19c23640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d1406d0a0 0x7f9d140a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d19422640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d140c3ea0 0x7f9d14071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1a424640 1 -- 172.21.15.91:0/2164728868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d140c3ea0 msgr2=0x7f9d14071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1a424640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d140c3ea0 0x7f9d14071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1a424640 1 -- 172.21.15.91:0/2164728868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d1406d0a0 msgr2=0x7f9d140a94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1a424640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d1406d0a0 0x7f9d140a94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d1a424640 1 -- 172.21.15.91:0/2164728868 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c009a70 con 0x7f9d1414fd30 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.190+0000 7f9d19c23640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d1406d0a0 0x7f9d140a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.191+0000 7f9d1a424640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d1414fd30 0x7f9d14154650 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c02c4d0 tx=0x7f9d0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.191+0000 7f9d0a7fc640 1 -- 172.21.15.91:0/2164728868 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c03e610 con 0x7f9d1414fd30 2023-11-27T20:42:48.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.191+0000 7f9d0a7fc640 1 -- 172.21.15.91:0/2164728868 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c03e770 con 0x7f9d1414fd30 2023-11-27T20:42:48.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.191+0000 7f9d0a7fc640 1 -- 172.21.15.91:0/2164728868 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c03eb20 con 0x7f9d1414fd30 2023-11-27T20:42:48.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.191+0000 7f9d1be87640 1 -- 172.21.15.91:0/2164728868 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d140a9a30 con 0x7f9d1414fd30 2023-11-27T20:42:48.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.191+0000 7f9d1be87640 1 -- 172.21.15.91:0/2164728868 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d140aa5f0 con 0x7f9d1414fd30 2023-11-27T20:42:48.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.193+0000 7f9d1be87640 1 -- 172.21.15.91:0/2164728868 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d14154330 con 0x7f9d1414fd30 2023-11-27T20:42:48.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.193+0000 7f9d0a7fc640 1 -- 172.21.15.91:0/2164728868 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9d0c03b050 con 0x7f9d1414fd30 2023-11-27T20:42:48.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.195+0000 7f9d0a7fc640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cf806b1f0 0x7f9cf806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.195+0000 7f9d0a7fc640 1 -- 172.21.15.91:0/2164728868 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d0c0ac2b0 con 0x7f9d1414fd30 2023-11-27T20:42:48.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.195+0000 7f9d19c23640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cf806b1f0 0x7f9cf806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:48.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.196+0000 7f9d19c23640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cf806b1f0 0x7f9cf806d6b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9d100011e0 tx=0x7f9d10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:48.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.200+0000 7f9d0a7fc640 1 -- 172.21.15.91:0/2164728868 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9d0c076f40 con 0x7f9d1414fd30 2023-11-27T20:42:48.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.382+0000 7f9d1be87640 1 -- 172.21.15.91:0/2164728868 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d14072980 con 0x7f9cf806b1f0 2023-11-27T20:42:48.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.390+0000 7f9d0a7fc640 1 -- 172.21.15.91:0/2164728868 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286712 (secure 0 0 0) 0x7f9d100013f0 con 0x7f9cf806b1f0 2023-11-27T20:42:48.396 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:48.397 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:42:48.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.395+0000 7f9d1be87640 1 -- 172.21.15.91:0/2164728868 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cf806b1f0 msgr2=0x7f9cf806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.395+0000 7f9d1be87640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cf806b1f0 0x7f9cf806d6b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9d100011e0 tx=0x7f9d10009040 comp rx=0 tx=0).stop 2023-11-27T20:42:48.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.395+0000 7f9d1be87640 1 -- 172.21.15.91:0/2164728868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d1414fd30 msgr2=0x7f9d14154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.395+0000 7f9d1be87640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d1414fd30 0x7f9d14154650 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c02c4d0 tx=0x7f9d0c004a40 comp rx=0 tx=0).stop 2023-11-27T20:42:48.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.396+0000 7f9d1be87640 1 -- 172.21.15.91:0/2164728868 shutdown_connections 2023-11-27T20:42:48.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.396+0000 7f9d1be87640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d1414fd30 0x7f9d14154650 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.396+0000 7f9d1be87640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d140c3ea0 0x7f9d14071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.396+0000 7f9d1be87640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cf806b1f0 0x7f9cf806d6b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.396+0000 7f9d1be87640 1 --2- 172.21.15.91:0/2164728868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d1406d0a0 0x7f9d140a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.396+0000 7f9d1be87640 1 -- 172.21.15.91:0/2164728868 >> 172.21.15.91:0/2164728868 conn(0x7f9d1406a500 msgr2=0x7f9d140a71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:48.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.396+0000 7f9d1be87640 1 -- 172.21.15.91:0/2164728868 shutdown_connections 2023-11-27T20:42:48.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.396+0000 7f9d1be87640 1 -- 172.21.15.91:0/2164728868 wait complete. 2023-11-27T20:42:48.414 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-11-27T20:42:47.394582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220412,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754308,"statfs":{"total":773094113280,"available":772868411392,"internally_reserved":0,"allocated":4333568,"data_stored":2401068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.880107"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546973+0000","last_change":"2023-11-27T20:42:38.539057+0000","last_active":"2023-11-27T20:42:39.546973+0000","last_peered":"2023-11-27T20:42:39.546973+0000","last_clean":"2023-11-27T20:42:39.546973+0000","last_became_active":"2023-11-27T20:42:38.536139+0000","last_became_peered":"2023-11-27T20:42:38.536139+0000","last_unstale":"2023-11-27T20:42:39.546973+0000","last_undegraded":"2023-11-27T20:42:39.546973+0000","last_fullsized":"2023-11-27T20:42:39.546973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545847+0000","last_change":"2023-11-27T20:42:38.554526+0000","last_active":"2023-11-27T20:42:39.545847+0000","last_peered":"2023-11-27T20:42:39.545847+0000","last_clean":"2023-11-27T20:42:39.545847+0000","last_became_active":"2023-11-27T20:42:38.554180+0000","last_became_peered":"2023-11-27T20:42:38.554180+0000","last_unstale":"2023-11-27T20:42:39.545847+0000","last_undegraded":"2023-11-27T20:42:39.545847+0000","last_fullsized":"2023-11-27T20:42:39.545847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848776+0000","last_change":"2023-11-27T20:42:38.558109+0000","last_active":"2023-11-27T20:42:39.848776+0000","last_peered":"2023-11-27T20:42:39.848776+0000","last_clean":"2023-11-27T20:42:39.848776+0000","last_became_active":"2023-11-27T20:42:38.557268+0000","last_became_peered":"2023-11-27T20:42:38.557268+0000","last_unstale":"2023-11-27T20:42:39.848776+0000","last_undegraded":"2023-11-27T20:42:39.848776+0000","last_fullsized":"2023-11-27T20:42:39.848776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833116+0000","last_change":"2023-11-27T20:42:38.558993+0000","last_active":"2023-11-27T20:42:39.833116+0000","last_peered":"2023-11-27T20:42:39.833116+0000","last_clean":"2023-11-27T20:42:39.833116+0000","last_became_active":"2023-11-27T20:42:38.558259+0000","last_became_peered":"2023-11-27T20:42:38.558259+0000","last_unstale":"2023-11-27T20:42:39.833116+0000","last_undegraded":"2023-11-27T20:42:39.833116+0000","last_fullsized":"2023-11-27T20:42:39.833116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.925936+0000","last_change":"2023-11-27T20:42:38.554226+0000","last_active":"2023-11-27T20:42:39.925936+0000","last_peered":"2023-11-27T20:42:39.925936+0000","last_clean":"2023-11-27T20:42:39.925936+0000","last_became_active":"2023-11-27T20:42:38.553902+0000","last_became_peered":"2023-11-27T20:42:38.553902+0000","last_unstale":"2023-11-27T20:42:39.925936+0000","last_undegraded":"2023-11-27T20:42:39.925936+0000","last_fullsized":"2023-11-27T20:42:39.925936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:27.699633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546003+0000","last_change":"2023-11-27T20:42:38.557750+0000","last_active":"2023-11-27T20:42:39.546003+0000","last_peered":"2023-11-27T20:42:39.546003+0000","last_clean":"2023-11-27T20:42:39.546003+0000","last_became_active":"2023-11-27T20:42:38.557513+0000","last_became_peered":"2023-11-27T20:42:38.557513+0000","last_unstale":"2023-11-27T20:42:39.546003+0000","last_undegraded":"2023-11-27T20:42:39.546003+0000","last_fullsized":"2023-11-27T20:42:39.546003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:00:16.000787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547693+0000","last_change":"2023-11-27T20:42:38.537531+0000","last_active":"2023-11-27T20:42:39.547693+0000","last_peered":"2023-11-27T20:42:39.547693+0000","last_clean":"2023-11-27T20:42:39.547693+0000","last_became_active":"2023-11-27T20:42:38.536923+0000","last_became_peered":"2023-11-27T20:42:38.536923+0000","last_unstale":"2023-11-27T20:42:39.547693+0000","last_undegraded":"2023-11-27T20:42:39.547693+0000","last_fullsized":"2023-11-27T20:42:39.547693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547211+0000","last_change":"2023-11-27T20:42:38.541486+0000","last_active":"2023-11-27T20:42:39.547211+0000","last_peered":"2023-11-27T20:42:39.547211+0000","last_clean":"2023-11-27T20:42:39.547211+0000","last_became_active":"2023-11-27T20:42:38.541126+0000","last_became_peered":"2023-11-27T20:42:38.541126+0000","last_unstale":"2023-11-27T20:42:39.547211+0000","last_undegraded":"2023-11-27T20:42:39.547211+0000","last_fullsized":"2023-11-27T20:42:39.547211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927265+0000","last_change":"2023-11-27T20:42:38.538848+0000","last_active":"2023-11-27T20:42:39.927265+0000","last_peered":"2023-11-27T20:42:39.927265+0000","last_clean":"2023-11-27T20:42:39.927265+0000","last_became_active":"2023-11-27T20:42:38.538541+0000","last_became_peered":"2023-11-27T20:42:38.538541+0000","last_unstale":"2023-11-27T20:42:39.927265+0000","last_undegraded":"2023-11-27T20:42:39.927265+0000","last_fullsized":"2023-11-27T20:42:39.927265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833778+0000","last_change":"2023-11-27T20:42:38.559990+0000","last_active":"2023-11-27T20:42:39.833778+0000","last_peered":"2023-11-27T20:42:39.833778+0000","last_clean":"2023-11-27T20:42:39.833778+0000","last_became_active":"2023-11-27T20:42:38.559736+0000","last_became_peered":"2023-11-27T20:42:38.559736+0000","last_unstale":"2023-11-27T20:42:39.833778+0000","last_undegraded":"2023-11-27T20:42:39.833778+0000","last_fullsized":"2023-11-27T20:42:39.833778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.549631+0000","last_change":"2023-11-27T20:42:38.547591+0000","last_active":"2023-11-27T20:42:39.549631+0000","last_peered":"2023-11-27T20:42:39.549631+0000","last_clean":"2023-11-27T20:42:39.549631+0000","last_became_active":"2023-11-27T20:42:38.547330+0000","last_became_peered":"2023-11-27T20:42:38.547330+0000","last_unstale":"2023-11-27T20:42:39.549631+0000","last_undegraded":"2023-11-27T20:42:39.549631+0000","last_fullsized":"2023-11-27T20:42:39.549631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848916+0000","last_change":"2023-11-27T20:42:38.558320+0000","last_active":"2023-11-27T20:42:39.848916+0000","last_peered":"2023-11-27T20:42:39.848916+0000","last_clean":"2023-11-27T20:42:39.848916+0000","last_became_active":"2023-11-27T20:42:38.557951+0000","last_became_peered":"2023-11-27T20:42:38.557951+0000","last_unstale":"2023-11-27T20:42:39.848916+0000","last_undegraded":"2023-11-27T20:42:39.848916+0000","last_fullsized":"2023-11-27T20:42:39.848916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926326+0000","last_change":"2023-11-27T20:42:38.545796+0000","last_active":"2023-11-27T20:42:39.926326+0000","last_peered":"2023-11-27T20:42:39.926326+0000","last_clean":"2023-11-27T20:42:39.926326+0000","last_became_active":"2023-11-27T20:42:38.545553+0000","last_became_peered":"2023-11-27T20:42:38.545553+0000","last_unstale":"2023-11-27T20:42:39.926326+0000","last_undegraded":"2023-11-27T20:42:39.926326+0000","last_fullsized":"2023-11-27T20:42:39.926326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:43.682169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546392+0000","last_change":"2023-11-27T20:42:38.547129+0000","last_active":"2023-11-27T20:42:39.546392+0000","last_peered":"2023-11-27T20:42:39.546392+0000","last_clean":"2023-11-27T20:42:39.546392+0000","last_became_active":"2023-11-27T20:42:38.546838+0000","last_became_peered":"2023-11-27T20:42:38.546838+0000","last_unstale":"2023-11-27T20:42:39.546392+0000","last_undegraded":"2023-11-27T20:42:39.546392+0000","last_fullsized":"2023-11-27T20:42:39.546392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:13:37.585057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848295+0000","last_change":"2023-11-27T20:42:38.547627+0000","last_active":"2023-11-27T20:42:39.848295+0000","last_peered":"2023-11-27T20:42:39.848295+0000","last_clean":"2023-11-27T20:42:39.848295+0000","last_became_active":"2023-11-27T20:42:38.539984+0000","last_became_peered":"2023-11-27T20:42:38.539984+0000","last_unstale":"2023-11-27T20:42:39.848295+0000","last_undegraded":"2023-11-27T20:42:39.848295+0000","last_fullsized":"2023-11-27T20:42:39.848295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548259+0000","last_change":"2023-11-27T20:42:38.546971+0000","last_active":"2023-11-27T20:42:39.548259+0000","last_peered":"2023-11-27T20:42:39.548259+0000","last_clean":"2023-11-27T20:42:39.548259+0000","last_became_active":"2023-11-27T20:42:38.546653+0000","last_became_peered":"2023-11-27T20:42:38.546653+0000","last_unstale":"2023-11-27T20:42:39.548259+0000","last_undegraded":"2023-11-27T20:42:39.548259+0000","last_fullsized":"2023-11-27T20:42:39.548259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547935+0000","last_change":"2023-11-27T20:42:38.540846+0000","last_active":"2023-11-27T20:42:39.547935+0000","last_peered":"2023-11-27T20:42:39.547935+0000","last_clean":"2023-11-27T20:42:39.547935+0000","last_became_active":"2023-11-27T20:42:38.540576+0000","last_became_peered":"2023-11-27T20:42:38.540576+0000","last_unstale":"2023-11-27T20:42:39.547935+0000","last_undegraded":"2023-11-27T20:42:39.547935+0000","last_fullsized":"2023-11-27T20:42:39.547935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546031+0000","last_change":"2023-11-27T20:42:38.560432+0000","last_active":"2023-11-27T20:42:39.546031+0000","last_peered":"2023-11-27T20:42:39.546031+0000","last_clean":"2023-11-27T20:42:39.546031+0000","last_became_active":"2023-11-27T20:42:38.560192+0000","last_became_peered":"2023-11-27T20:42:38.560192+0000","last_unstale":"2023-11-27T20:42:39.546031+0000","last_undegraded":"2023-11-27T20:42:39.546031+0000","last_fullsized":"2023-11-27T20:42:39.546031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545846+0000","last_change":"2023-11-27T20:42:38.561753+0000","last_active":"2023-11-27T20:42:39.545846+0000","last_peered":"2023-11-27T20:42:39.545846+0000","last_clean":"2023-11-27T20:42:39.545846+0000","last_became_active":"2023-11-27T20:42:38.561380+0000","last_became_peered":"2023-11-27T20:42:38.561380+0000","last_unstale":"2023-11-27T20:42:39.545846+0000","last_undegraded":"2023-11-27T20:42:39.545846+0000","last_fullsized":"2023-11-27T20:42:39.545846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926724+0000","last_change":"2023-11-27T20:42:38.550553+0000","last_active":"2023-11-27T20:42:39.926724+0000","last_peered":"2023-11-27T20:42:39.926724+0000","last_clean":"2023-11-27T20:42:39.926724+0000","last_became_active":"2023-11-27T20:42:38.550311+0000","last_became_peered":"2023-11-27T20:42:38.550311+0000","last_unstale":"2023-11-27T20:42:39.926724+0000","last_undegraded":"2023-11-27T20:42:39.926724+0000","last_fullsized":"2023-11-27T20:42:39.926724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:48.730603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926676+0000","last_change":"2023-11-27T20:42:38.534413+0000","last_active":"2023-11-27T20:42:39.926676+0000","last_peered":"2023-11-27T20:42:39.926676+0000","last_clean":"2023-11-27T20:42:39.926676+0000","last_became_active":"2023-11-27T20:42:38.534183+0000","last_became_peered":"2023-11-27T20:42:38.534183+0000","last_unstale":"2023-11-27T20:42:39.926676+0000","last_undegraded":"2023-11-27T20:42:39.926676+0000","last_fullsized":"2023-11-27T20:42:39.926676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926754+0000","last_change":"2023-11-27T20:42:38.551263+0000","last_active":"2023-11-27T20:42:39.926754+0000","last_peered":"2023-11-27T20:42:39.926754+0000","last_clean":"2023-11-27T20:42:39.926754+0000","last_became_active":"2023-11-27T20:42:38.545451+0000","last_became_peered":"2023-11-27T20:42:38.545451+0000","last_unstale":"2023-11-27T20:42:39.926754+0000","last_undegraded":"2023-11-27T20:42:39.926754+0000","last_fullsized":"2023-11-27T20:42:39.926754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561398+0000","last_change":"2023-11-27T20:42:38.535802+0000","last_active":"2023-11-27T20:42:39.561398+0000","last_peered":"2023-11-27T20:42:39.561398+0000","last_clean":"2023-11-27T20:42:39.561398+0000","last_became_active":"2023-11-27T20:42:38.535498+0000","last_became_peered":"2023-11-27T20:42:38.535498+0000","last_unstale":"2023-11-27T20:42:39.561398+0000","last_undegraded":"2023-11-27T20:42:39.561398+0000","last_fullsized":"2023-11-27T20:42:39.561398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848228+0000","last_change":"2023-11-27T20:42:38.542428+0000","last_active":"2023-11-27T20:42:39.848228+0000","last_peered":"2023-11-27T20:42:39.848228+0000","last_clean":"2023-11-27T20:42:39.848228+0000","last_became_active":"2023-11-27T20:42:38.542153+0000","last_became_peered":"2023-11-27T20:42:38.542153+0000","last_unstale":"2023-11-27T20:42:39.848228+0000","last_undegraded":"2023-11-27T20:42:39.848228+0000","last_fullsized":"2023-11-27T20:42:39.848228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833879+0000","last_change":"2023-11-27T20:42:38.547156+0000","last_active":"2023-11-27T20:42:39.833879+0000","last_peered":"2023-11-27T20:42:39.833879+0000","last_clean":"2023-11-27T20:42:39.833879+0000","last_became_active":"2023-11-27T20:42:38.545609+0000","last_became_peered":"2023-11-27T20:42:38.545609+0000","last_unstale":"2023-11-27T20:42:39.833879+0000","last_undegraded":"2023-11-27T20:42:39.833879+0000","last_fullsized":"2023-11-27T20:42:39.833879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546208+0000","last_change":"2023-11-27T20:42:38.553640+0000","last_active":"2023-11-27T20:42:39.546208+0000","last_peered":"2023-11-27T20:42:39.546208+0000","last_clean":"2023-11-27T20:42:39.546208+0000","last_became_active":"2023-11-27T20:42:38.552879+0000","last_became_peered":"2023-11-27T20:42:38.552879+0000","last_unstale":"2023-11-27T20:42:39.546208+0000","last_undegraded":"2023-11-27T20:42:39.546208+0000","last_fullsized":"2023-11-27T20:42:39.546208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:40:10.146333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833621+0000","last_change":"2023-11-27T20:42:38.547768+0000","last_active":"2023-11-27T20:42:39.833621+0000","last_peered":"2023-11-27T20:42:39.833621+0000","last_clean":"2023-11-27T20:42:39.833621+0000","last_became_active":"2023-11-27T20:42:38.547403+0000","last_became_peered":"2023-11-27T20:42:38.547403+0000","last_unstale":"2023-11-27T20:42:39.833621+0000","last_undegraded":"2023-11-27T20:42:39.833621+0000","last_fullsized":"2023-11-27T20:42:39.833621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849264+0000","last_change":"2023-11-27T20:42:38.541871+0000","last_active":"2023-11-27T20:42:39.849264+0000","last_peered":"2023-11-27T20:42:39.849264+0000","last_clean":"2023-11-27T20:42:39.849264+0000","last_became_active":"2023-11-27T20:42:38.532675+0000","last_became_peered":"2023-11-27T20:42:38.532675+0000","last_unstale":"2023-11-27T20:42:39.849264+0000","last_undegraded":"2023-11-27T20:42:39.849264+0000","last_fullsized":"2023-11-27T20:42:39.849264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926697+0000","last_change":"2023-11-27T20:42:38.548676+0000","last_active":"2023-11-27T20:42:39.926697+0000","last_peered":"2023-11-27T20:42:39.926697+0000","last_clean":"2023-11-27T20:42:39.926697+0000","last_became_active":"2023-11-27T20:42:38.548338+0000","last_became_peered":"2023-11-27T20:42:38.548338+0000","last_unstale":"2023-11-27T20:42:39.926697+0000","last_undegraded":"2023-11-27T20:42:39.926697+0000","last_fullsized":"2023-11-27T20:42:39.926697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548404+0000","last_change":"2023-11-27T20:42:38.531773+0000","last_active":"2023-11-27T20:42:39.548404+0000","last_peered":"2023-11-27T20:42:39.548404+0000","last_clean":"2023-11-27T20:42:39.548404+0000","last_became_active":"2023-11-27T20:42:38.531469+0000","last_became_peered":"2023-11-27T20:42:38.531469+0000","last_unstale":"2023-11-27T20:42:39.548404+0000","last_undegraded":"2023-11-27T20:42:39.548404+0000","last_fullsized":"2023-11-27T20:42:39.548404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545950+0000","last_change":"2023-11-27T20:42:38.539218+0000","last_active":"2023-11-27T20:42:39.545950+0000","last_peered":"2023-11-27T20:42:39.545950+0000","last_clean":"2023-11-27T20:42:39.545950+0000","last_became_active":"2023-11-27T20:42:38.538843+0000","last_became_peered":"2023-11-27T20:42:38.538843+0000","last_unstale":"2023-11-27T20:42:39.545950+0000","last_undegraded":"2023-11-27T20:42:39.545950+0000","last_fullsized":"2023-11-27T20:42:39.545950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:10.273471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548260+0000","last_change":"2023-11-27T20:42:38.549776+0000","last_active":"2023-11-27T20:42:39.548260+0000","last_peered":"2023-11-27T20:42:39.548260+0000","last_clean":"2023-11-27T20:42:39.548260+0000","last_became_active":"2023-11-27T20:42:38.549339+0000","last_became_peered":"2023-11-27T20:42:38.549339+0000","last_unstale":"2023-11-27T20:42:39.548260+0000","last_undegraded":"2023-11-27T20:42:39.548260+0000","last_fullsized":"2023-11-27T20:42:39.548260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561722+0000","last_change":"2023-11-27T20:42:38.529609+0000","last_active":"2023-11-27T20:42:39.561722+0000","last_peered":"2023-11-27T20:42:39.561722+0000","last_clean":"2023-11-27T20:42:39.561722+0000","last_became_active":"2023-11-27T20:42:38.529089+0000","last_became_peered":"2023-11-27T20:42:38.529089+0000","last_unstale":"2023-11-27T20:42:39.561722+0000","last_undegraded":"2023-11-27T20:42:39.561722+0000","last_fullsized":"2023-11-27T20:42:39.561722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.553686+0000","last_change":"2023-11-27T20:42:37.528294+0000","last_active":"2023-11-27T20:42:38.553686+0000","last_peered":"2023-11-27T20:42:38.553686+0000","last_clean":"2023-11-27T20:42:38.553686+0000","last_became_active":"2023-11-27T20:42:37.528055+0000","last_became_peered":"2023-11-27T20:42:37.528055+0000","last_unstale":"2023-11-27T20:42:38.553686+0000","last_undegraded":"2023-11-27T20:42:38.553686+0000","last_fullsized":"2023-11-27T20:42:38.553686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548156+0000","last_change":"2023-11-27T20:42:38.545391+0000","last_active":"2023-11-27T20:42:39.548156+0000","last_peered":"2023-11-27T20:42:39.548156+0000","last_clean":"2023-11-27T20:42:39.548156+0000","last_became_active":"2023-11-27T20:42:38.544984+0000","last_became_peered":"2023-11-27T20:42:38.544984+0000","last_unstale":"2023-11-27T20:42:39.548156+0000","last_undegraded":"2023-11-27T20:42:39.548156+0000","last_fullsized":"2023-11-27T20:42:39.548156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.540714+0000","last_change":"2023-11-27T20:42:37.535511+0000","last_active":"2023-11-27T20:42:38.540714+0000","last_peered":"2023-11-27T20:42:38.540714+0000","last_clean":"2023-11-27T20:42:38.540714+0000","last_became_active":"2023-11-27T20:42:37.535314+0000","last_became_peered":"2023-11-27T20:42:37.535314+0000","last_unstale":"2023-11-27T20:42:38.540714+0000","last_undegraded":"2023-11-27T20:42:38.540714+0000","last_fullsized":"2023-11-27T20:42:38.540714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927168+0000","last_change":"2023-11-27T20:42:38.558352+0000","last_active":"2023-11-27T20:42:39.927168+0000","last_peered":"2023-11-27T20:42:39.927168+0000","last_clean":"2023-11-27T20:42:39.927168+0000","last_became_active":"2023-11-27T20:42:38.557630+0000","last_became_peered":"2023-11-27T20:42:38.557630+0000","last_unstale":"2023-11-27T20:42:39.927168+0000","last_undegraded":"2023-11-27T20:42:39.927168+0000","last_fullsized":"2023-11-27T20:42:39.927168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.565103+0000","last_change":"2023-11-27T20:42:37.520015+0000","last_active":"2023-11-27T20:42:38.565103+0000","last_peered":"2023-11-27T20:42:38.565103+0000","last_clean":"2023-11-27T20:42:38.565103+0000","last_became_active":"2023-11-27T20:42:37.519779+0000","last_became_peered":"2023-11-27T20:42:37.519779+0000","last_unstale":"2023-11-27T20:42:38.565103+0000","last_undegraded":"2023-11-27T20:42:38.565103+0000","last_fullsized":"2023-11-27T20:42:38.565103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:47.336738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833537+0000","last_change":"2023-11-27T20:42:38.551495+0000","last_active":"2023-11-27T20:42:39.833537+0000","last_peered":"2023-11-27T20:42:39.833537+0000","last_clean":"2023-11-27T20:42:39.833537+0000","last_became_active":"2023-11-27T20:42:38.548057+0000","last_became_peered":"2023-11-27T20:42:38.548057+0000","last_unstale":"2023-11-27T20:42:39.833537+0000","last_undegraded":"2023-11-27T20:42:39.833537+0000","last_fullsized":"2023-11-27T20:42:39.833537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.557431+0000","last_change":"2023-11-27T20:42:37.530074+0000","last_active":"2023-11-27T20:42:38.557431+0000","last_peered":"2023-11-27T20:42:38.557431+0000","last_clean":"2023-11-27T20:42:38.557431+0000","last_became_active":"2023-11-27T20:42:37.529422+0000","last_became_peered":"2023-11-27T20:42:37.529422+0000","last_unstale":"2023-11-27T20:42:38.557431+0000","last_undegraded":"2023-11-27T20:42:38.557431+0000","last_fullsized":"2023-11-27T20:42:38.557431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:40:40.129670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548848+0000","last_change":"2023-11-27T20:42:38.552242+0000","last_active":"2023-11-27T20:42:39.548848+0000","last_peered":"2023-11-27T20:42:39.548848+0000","last_clean":"2023-11-27T20:42:39.548848+0000","last_became_active":"2023-11-27T20:42:38.551805+0000","last_became_peered":"2023-11-27T20:42:38.551805+0000","last_unstale":"2023-11-27T20:42:39.548848+0000","last_undegraded":"2023-11-27T20:42:39.548848+0000","last_fullsized":"2023-11-27T20:42:39.548848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.555619+0000","last_change":"2023-11-27T20:42:37.527381+0000","last_active":"2023-11-27T20:42:38.555619+0000","last_peered":"2023-11-27T20:42:38.555619+0000","last_clean":"2023-11-27T20:42:38.555619+0000","last_became_active":"2023-11-27T20:42:37.527147+0000","last_became_peered":"2023-11-27T20:42:37.527147+0000","last_unstale":"2023-11-27T20:42:38.555619+0000","last_undegraded":"2023-11-27T20:42:38.555619+0000","last_fullsized":"2023-11-27T20:42:38.555619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848705+0000","last_change":"2023-11-27T20:42:38.545564+0000","last_active":"2023-11-27T20:42:39.848705+0000","last_peered":"2023-11-27T20:42:39.848705+0000","last_clean":"2023-11-27T20:42:39.848705+0000","last_became_active":"2023-11-27T20:42:38.545232+0000","last_became_peered":"2023-11-27T20:42:38.545232+0000","last_unstale":"2023-11-27T20:42:39.848705+0000","last_undegraded":"2023-11-27T20:42:39.848705+0000","last_fullsized":"2023-11-27T20:42:39.848705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.546026+0000","last_change":"2023-11-27T20:42:37.531654+0000","last_active":"2023-11-27T20:42:38.546026+0000","last_peered":"2023-11-27T20:42:38.546026+0000","last_clean":"2023-11-27T20:42:38.546026+0000","last_became_active":"2023-11-27T20:42:37.529901+0000","last_became_peered":"2023-11-27T20:42:37.529901+0000","last_unstale":"2023-11-27T20:42:38.546026+0000","last_undegraded":"2023-11-27T20:42:38.546026+0000","last_fullsized":"2023-11-27T20:42:38.546026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926211+0000","last_change":"2023-11-27T20:42:38.533572+0000","last_active":"2023-11-27T20:42:39.926211+0000","last_peered":"2023-11-27T20:42:39.926211+0000","last_clean":"2023-11-27T20:42:39.926211+0000","last_became_active":"2023-11-27T20:42:38.533281+0000","last_became_peered":"2023-11-27T20:42:38.533281+0000","last_unstale":"2023-11-27T20:42:39.926211+0000","last_undegraded":"2023-11-27T20:42:39.926211+0000","last_fullsized":"2023-11-27T20:42:39.926211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.542147+0000","last_change":"2023-11-27T20:42:37.522964+0000","last_active":"2023-11-27T20:42:38.542147+0000","last_peered":"2023-11-27T20:42:38.542147+0000","last_clean":"2023-11-27T20:42:38.542147+0000","last_became_active":"2023-11-27T20:42:37.522677+0000","last_became_peered":"2023-11-27T20:42:37.522677+0000","last_unstale":"2023-11-27T20:42:38.542147+0000","last_undegraded":"2023-11-27T20:42:38.542147+0000","last_fullsized":"2023-11-27T20:42:38.542147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:30.748479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832586+0000","last_change":"2023-11-27T20:42:38.538177+0000","last_active":"2023-11-27T20:42:39.832586+0000","last_peered":"2023-11-27T20:42:39.832586+0000","last_clean":"2023-11-27T20:42:39.832586+0000","last_became_active":"2023-11-27T20:42:38.537835+0000","last_became_peered":"2023-11-27T20:42:38.537835+0000","last_unstale":"2023-11-27T20:42:39.832586+0000","last_undegraded":"2023-11-27T20:42:39.832586+0000","last_fullsized":"2023-11-27T20:42:39.832586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.519628+0000","last_change":"2023-11-27T20:42:37.522230+0000","last_active":"2023-11-27T20:42:38.519628+0000","last_peered":"2023-11-27T20:42:38.519628+0000","last_clean":"2023-11-27T20:42:38.519628+0000","last_became_active":"2023-11-27T20:42:37.521898+0000","last_became_peered":"2023-11-27T20:42:37.521898+0000","last_unstale":"2023-11-27T20:42:38.519628+0000","last_undegraded":"2023-11-27T20:42:38.519628+0000","last_fullsized":"2023-11-27T20:42:38.519628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:16:18.992040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849283+0000","last_change":"2023-11-27T20:42:38.555603+0000","last_active":"2023-11-27T20:42:39.849283+0000","last_peered":"2023-11-27T20:42:39.849283+0000","last_clean":"2023-11-27T20:42:39.849283+0000","last_became_active":"2023-11-27T20:42:38.555305+0000","last_became_peered":"2023-11-27T20:42:38.555305+0000","last_unstale":"2023-11-27T20:42:39.849283+0000","last_undegraded":"2023-11-27T20:42:39.849283+0000","last_fullsized":"2023-11-27T20:42:39.849283+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.550498+0000","last_change":"2023-11-27T20:42:37.531762+0000","last_active":"2023-11-27T20:42:38.550498+0000","last_peered":"2023-11-27T20:42:38.550498+0000","last_clean":"2023-11-27T20:42:38.550498+0000","last_became_active":"2023-11-27T20:42:37.531446+0000","last_became_peered":"2023-11-27T20:42:37.531446+0000","last_unstale":"2023-11-27T20:42:38.550498+0000","last_undegraded":"2023-11-27T20:42:38.550498+0000","last_fullsized":"2023-11-27T20:42:38.550498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:11.474537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546585+0000","last_change":"2023-11-27T20:42:38.559970+0000","last_active":"2023-11-27T20:42:39.546585+0000","last_peered":"2023-11-27T20:42:39.546585+0000","last_clean":"2023-11-27T20:42:39.546585+0000","last_became_active":"2023-11-27T20:42:38.559688+0000","last_became_peered":"2023-11-27T20:42:38.559688+0000","last_unstale":"2023-11-27T20:42:39.546585+0000","last_undegraded":"2023-11-27T20:42:39.546585+0000","last_fullsized":"2023-11-27T20:42:39.546585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:47.260947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.524398+0000","last_change":"2023-11-27T20:42:37.532869+0000","last_active":"2023-11-27T20:42:38.524398+0000","last_peered":"2023-11-27T20:42:38.524398+0000","last_clean":"2023-11-27T20:42:38.524398+0000","last_became_active":"2023-11-27T20:42:37.532576+0000","last_became_peered":"2023-11-27T20:42:37.532576+0000","last_unstale":"2023-11-27T20:42:38.524398+0000","last_undegraded":"2023-11-27T20:42:38.524398+0000","last_fullsized":"2023-11-27T20:42:38.524398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545800+0000","last_change":"2023-11-27T20:42:38.555684+0000","last_active":"2023-11-27T20:42:39.545800+0000","last_peered":"2023-11-27T20:42:39.545800+0000","last_clean":"2023-11-27T20:42:39.545800+0000","last_became_active":"2023-11-27T20:42:38.555415+0000","last_became_peered":"2023-11-27T20:42:38.555415+0000","last_unstale":"2023-11-27T20:42:39.545800+0000","last_undegraded":"2023-11-27T20:42:39.545800+0000","last_fullsized":"2023-11-27T20:42:39.545800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.553840+0000","last_change":"2023-11-27T20:42:37.530460+0000","last_active":"2023-11-27T20:42:38.553840+0000","last_peered":"2023-11-27T20:42:38.553840+0000","last_clean":"2023-11-27T20:42:38.553840+0000","last_became_active":"2023-11-27T20:42:37.529879+0000","last_became_peered":"2023-11-27T20:42:37.529879+0000","last_unstale":"2023-11-27T20:42:38.553840+0000","last_undegraded":"2023-11-27T20:42:38.553840+0000","last_fullsized":"2023-11-27T20:42:38.553840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:58.185242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848831+0000","last_change":"2023-11-27T20:42:38.557705+0000","last_active":"2023-11-27T20:42:39.848831+0000","last_peered":"2023-11-27T20:42:39.848831+0000","last_clean":"2023-11-27T20:42:39.848831+0000","last_became_active":"2023-11-27T20:42:38.557251+0000","last_became_peered":"2023-11-27T20:42:38.557251+0000","last_unstale":"2023-11-27T20:42:39.848831+0000","last_undegraded":"2023-11-27T20:42:39.848831+0000","last_fullsized":"2023-11-27T20:42:39.848831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.567412+0000","last_change":"2023-11-27T20:42:37.523173+0000","last_active":"2023-11-27T20:42:38.567412+0000","last_peered":"2023-11-27T20:42:38.567412+0000","last_clean":"2023-11-27T20:42:38.567412+0000","last_became_active":"2023-11-27T20:42:37.522903+0000","last_became_peered":"2023-11-27T20:42:37.522903+0000","last_unstale":"2023-11-27T20:42:38.567412+0000","last_undegraded":"2023-11-27T20:42:38.567412+0000","last_fullsized":"2023-11-27T20:42:38.567412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:28.381599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832560+0000","last_change":"2023-11-27T20:42:38.543201+0000","last_active":"2023-11-27T20:42:39.832560+0000","last_peered":"2023-11-27T20:42:39.832560+0000","last_clean":"2023-11-27T20:42:39.832560+0000","last_became_active":"2023-11-27T20:42:38.542920+0000","last_became_peered":"2023-11-27T20:42:38.542920+0000","last_unstale":"2023-11-27T20:42:39.832560+0000","last_undegraded":"2023-11-27T20:42:39.832560+0000","last_fullsized":"2023-11-27T20:42:39.832560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.551582+0000","last_change":"2023-11-27T20:42:37.524294+0000","last_active":"2023-11-27T20:42:38.551582+0000","last_peered":"2023-11-27T20:42:38.551582+0000","last_clean":"2023-11-27T20:42:38.551582+0000","last_became_active":"2023-11-27T20:42:37.523858+0000","last_became_peered":"2023-11-27T20:42:37.523858+0000","last_unstale":"2023-11-27T20:42:38.551582+0000","last_undegraded":"2023-11-27T20:42:38.551582+0000","last_fullsized":"2023-11-27T20:42:38.551582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546702+0000","last_change":"2023-11-27T20:42:38.553812+0000","last_active":"2023-11-27T20:42:39.546702+0000","last_peered":"2023-11-27T20:42:39.546702+0000","last_clean":"2023-11-27T20:42:39.546702+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:39.546702+0000","last_undegraded":"2023-11-27T20:42:39.546702+0000","last_fullsized":"2023-11-27T20:42:39.546702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:21.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.534713+0000","last_change":"2023-11-27T20:42:37.522904+0000","last_active":"2023-11-27T20:42:38.534713+0000","last_peered":"2023-11-27T20:42:38.534713+0000","last_clean":"2023-11-27T20:42:38.534713+0000","last_became_active":"2023-11-27T20:42:37.522574+0000","last_became_peered":"2023-11-27T20:42:37.522574+0000","last_unstale":"2023-11-27T20:42:38.534713+0000","last_undegraded":"2023-11-27T20:42:38.534713+0000","last_fullsized":"2023-11-27T20:42:38.534713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547592+0000","last_change":"2023-11-27T20:42:38.548304+0000","last_active":"2023-11-27T20:42:39.547592+0000","last_peered":"2023-11-27T20:42:39.547592+0000","last_clean":"2023-11-27T20:42:39.547592+0000","last_became_active":"2023-11-27T20:42:38.547970+0000","last_became_peered":"2023-11-27T20:42:38.547970+0000","last_unstale":"2023-11-27T20:42:39.547592+0000","last_undegraded":"2023-11-27T20:42:39.547592+0000","last_fullsized":"2023-11-27T20:42:39.547592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.541997+0000","last_change":"2023-11-27T20:42:37.535247+0000","last_active":"2023-11-27T20:42:38.541997+0000","last_peered":"2023-11-27T20:42:38.541997+0000","last_clean":"2023-11-27T20:42:38.541997+0000","last_became_active":"2023-11-27T20:42:37.534922+0000","last_became_peered":"2023-11-27T20:42:37.534922+0000","last_unstale":"2023-11-27T20:42:38.541997+0000","last_undegraded":"2023-11-27T20:42:38.541997+0000","last_fullsized":"2023-11-27T20:42:38.541997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:45.108775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546268+0000","last_change":"2023-11-27T20:42:38.547970+0000","last_active":"2023-11-27T20:42:39.546268+0000","last_peered":"2023-11-27T20:42:39.546268+0000","last_clean":"2023-11-27T20:42:39.546268+0000","last_became_active":"2023-11-27T20:42:38.547656+0000","last_became_peered":"2023-11-27T20:42:38.547656+0000","last_unstale":"2023-11-27T20:42:39.546268+0000","last_undegraded":"2023-11-27T20:42:39.546268+0000","last_fullsized":"2023-11-27T20:42:39.546268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.562061+0000","last_change":"2023-11-27T20:42:37.514338+0000","last_active":"2023-11-27T20:42:38.562061+0000","last_peered":"2023-11-27T20:42:38.562061+0000","last_clean":"2023-11-27T20:42:38.562061+0000","last_became_active":"2023-11-27T20:42:37.514055+0000","last_became_peered":"2023-11-27T20:42:37.514055+0000","last_unstale":"2023-11-27T20:42:38.562061+0000","last_undegraded":"2023-11-27T20:42:38.562061+0000","last_fullsized":"2023-11-27T20:42:38.562061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927078+0000","last_change":"2023-11-27T20:42:38.546056+0000","last_active":"2023-11-27T20:42:39.927078+0000","last_peered":"2023-11-27T20:42:39.927078+0000","last_clean":"2023-11-27T20:42:39.927078+0000","last_became_active":"2023-11-27T20:42:38.545736+0000","last_became_peered":"2023-11-27T20:42:38.545736+0000","last_unstale":"2023-11-27T20:42:39.927078+0000","last_undegraded":"2023-11-27T20:42:39.927078+0000","last_fullsized":"2023-11-27T20:42:39.927078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.561754+0000","last_change":"2023-11-27T20:42:37.525560+0000","last_active":"2023-11-27T20:42:38.561754+0000","last_peered":"2023-11-27T20:42:38.561754+0000","last_clean":"2023-11-27T20:42:38.561754+0000","last_became_active":"2023-11-27T20:42:37.525261+0000","last_became_peered":"2023-11-27T20:42:37.525261+0000","last_unstale":"2023-11-27T20:42:38.561754+0000","last_undegraded":"2023-11-27T20:42:38.561754+0000","last_fullsized":"2023-11-27T20:42:38.561754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:16.392657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849208+0000","last_change":"2023-11-27T20:42:38.549553+0000","last_active":"2023-11-27T20:42:39.849208+0000","last_peered":"2023-11-27T20:42:39.849208+0000","last_clean":"2023-11-27T20:42:39.849208+0000","last_became_active":"2023-11-27T20:42:38.549075+0000","last_became_peered":"2023-11-27T20:42:38.549075+0000","last_unstale":"2023-11-27T20:42:39.849208+0000","last_undegraded":"2023-11-27T20:42:39.849208+0000","last_fullsized":"2023-11-27T20:42:39.849208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.553505+0000","last_change":"2023-11-27T20:42:37.522245+0000","last_active":"2023-11-27T20:42:38.553505+0000","last_peered":"2023-11-27T20:42:38.553505+0000","last_clean":"2023-11-27T20:42:38.553505+0000","last_became_active":"2023-11-27T20:42:37.521938+0000","last_became_peered":"2023-11-27T20:42:37.521938+0000","last_unstale":"2023-11-27T20:42:38.553505+0000","last_undegraded":"2023-11-27T20:42:38.553505+0000","last_fullsized":"2023-11-27T20:42:38.553505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833347+0000","last_change":"2023-11-27T20:42:38.554165+0000","last_active":"2023-11-27T20:42:39.833347+0000","last_peered":"2023-11-27T20:42:39.833347+0000","last_clean":"2023-11-27T20:42:39.833347+0000","last_became_active":"2023-11-27T20:42:38.553912+0000","last_became_peered":"2023-11-27T20:42:38.553912+0000","last_unstale":"2023-11-27T20:42:39.833347+0000","last_undegraded":"2023-11-27T20:42:39.833347+0000","last_fullsized":"2023-11-27T20:42:39.833347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.551516+0000","last_change":"2023-11-27T20:42:37.525601+0000","last_active":"2023-11-27T20:42:38.551516+0000","last_peered":"2023-11-27T20:42:38.551516+0000","last_clean":"2023-11-27T20:42:38.551516+0000","last_became_active":"2023-11-27T20:42:37.525296+0000","last_became_peered":"2023-11-27T20:42:37.525296+0000","last_unstale":"2023-11-27T20:42:38.551516+0000","last_undegraded":"2023-11-27T20:42:38.551516+0000","last_fullsized":"2023-11-27T20:42:38.551516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926490+0000","last_change":"2023-11-27T20:42:38.549244+0000","last_active":"2023-11-27T20:42:39.926490+0000","last_peered":"2023-11-27T20:42:39.926490+0000","last_clean":"2023-11-27T20:42:39.926490+0000","last_became_active":"2023-11-27T20:42:38.548660+0000","last_became_peered":"2023-11-27T20:42:38.548660+0000","last_unstale":"2023-11-27T20:42:39.926490+0000","last_undegraded":"2023-11-27T20:42:39.926490+0000","last_fullsized":"2023-11-27T20:42:39.926490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:22.348409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.519332+0000","last_change":"2023-11-27T20:42:37.527131+0000","last_active":"2023-11-27T20:42:38.519332+0000","last_peered":"2023-11-27T20:42:38.519332+0000","last_clean":"2023-11-27T20:42:38.519332+0000","last_became_active":"2023-11-27T20:42:37.526804+0000","last_became_peered":"2023-11-27T20:42:37.526804+0000","last_unstale":"2023-11-27T20:42:38.519332+0000","last_undegraded":"2023-11-27T20:42:38.519332+0000","last_fullsized":"2023-11-27T20:42:38.519332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.925927+0000","last_change":"2023-11-27T20:42:38.547894+0000","last_active":"2023-11-27T20:42:39.925927+0000","last_peered":"2023-11-27T20:42:39.925927+0000","last_clean":"2023-11-27T20:42:39.925927+0000","last_became_active":"2023-11-27T20:42:38.547558+0000","last_became_peered":"2023-11-27T20:42:38.547558+0000","last_unstale":"2023-11-27T20:42:39.925927+0000","last_undegraded":"2023-11-27T20:42:39.925927+0000","last_fullsized":"2023-11-27T20:42:39.925927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:38.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.552598+0000","last_change":"2023-11-27T20:42:37.527591+0000","last_active":"2023-11-27T20:42:38.552598+0000","last_peered":"2023-11-27T20:42:38.552598+0000","last_clean":"2023-11-27T20:42:38.552598+0000","last_became_active":"2023-11-27T20:42:37.527305+0000","last_became_peered":"2023-11-27T20:42:37.527305+0000","last_unstale":"2023-11-27T20:42:38.552598+0000","last_undegraded":"2023-11-27T20:42:38.552598+0000","last_fullsized":"2023-11-27T20:42:38.552598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926258+0000","last_change":"2023-11-27T20:42:38.536322+0000","last_active":"2023-11-27T20:42:39.926258+0000","last_peered":"2023-11-27T20:42:39.926258+0000","last_clean":"2023-11-27T20:42:39.926258+0000","last_became_active":"2023-11-27T20:42:38.536051+0000","last_became_peered":"2023-11-27T20:42:38.536051+0000","last_unstale":"2023-11-27T20:42:39.926258+0000","last_undegraded":"2023-11-27T20:42:39.926258+0000","last_fullsized":"2023-11-27T20:42:39.926258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:31.539798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.533110+0000","last_change":"2023-11-27T20:42:37.522543+0000","last_active":"2023-11-27T20:42:38.533110+0000","last_peered":"2023-11-27T20:42:38.533110+0000","last_clean":"2023-11-27T20:42:38.533110+0000","last_became_active":"2023-11-27T20:42:37.522163+0000","last_became_peered":"2023-11-27T20:42:37.522163+0000","last_unstale":"2023-11-27T20:42:38.533110+0000","last_undegraded":"2023-11-27T20:42:38.533110+0000","last_fullsized":"2023-11-27T20:42:38.533110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:46.239563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.925799+0000","last_change":"2023-11-27T20:42:38.539525+0000","last_active":"2023-11-27T20:42:39.925799+0000","last_peered":"2023-11-27T20:42:39.925799+0000","last_clean":"2023-11-27T20:42:39.925799+0000","last_became_active":"2023-11-27T20:42:38.539244+0000","last_became_peered":"2023-11-27T20:42:38.539244+0000","last_unstale":"2023-11-27T20:42:39.925799+0000","last_undegraded":"2023-11-27T20:42:39.925799+0000","last_fullsized":"2023-11-27T20:42:39.925799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:12:08.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.519131+0000","last_change":"2023-11-27T20:42:37.518579+0000","last_active":"2023-11-27T20:42:38.519131+0000","last_peered":"2023-11-27T20:42:38.519131+0000","last_clean":"2023-11-27T20:42:38.519131+0000","last_became_active":"2023-11-27T20:42:37.517970+0000","last_became_peered":"2023-11-27T20:42:37.517970+0000","last_unstale":"2023-11-27T20:42:38.519131+0000","last_undegraded":"2023-11-27T20:42:38.519131+0000","last_fullsized":"2023-11-27T20:42:38.519131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547360+0000","last_change":"2023-11-27T20:42:38.537364+0000","last_active":"2023-11-27T20:42:39.547360+0000","last_peered":"2023-11-27T20:42:39.547360+0000","last_clean":"2023-11-27T20:42:39.547360+0000","last_became_active":"2023-11-27T20:42:38.536521+0000","last_became_peered":"2023-11-27T20:42:38.536521+0000","last_unstale":"2023-11-27T20:42:39.547360+0000","last_undegraded":"2023-11-27T20:42:39.547360+0000","last_fullsized":"2023-11-27T20:42:39.547360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.525660+0000","last_change":"2023-11-27T20:42:37.532212+0000","last_active":"2023-11-27T20:42:38.525660+0000","last_peered":"2023-11-27T20:42:38.525660+0000","last_clean":"2023-11-27T20:42:38.525660+0000","last_became_active":"2023-11-27T20:42:37.531894+0000","last_became_peered":"2023-11-27T20:42:37.531894+0000","last_unstale":"2023-11-27T20:42:38.525660+0000","last_undegraded":"2023-11-27T20:42:38.525660+0000","last_fullsized":"2023-11-27T20:42:38.525660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926630+0000","last_change":"2023-11-27T20:42:38.551126+0000","last_active":"2023-11-27T20:42:39.926630+0000","last_peered":"2023-11-27T20:42:39.926630+0000","last_clean":"2023-11-27T20:42:39.926630+0000","last_became_active":"2023-11-27T20:42:38.550881+0000","last_became_peered":"2023-11-27T20:42:38.550881+0000","last_unstale":"2023-11-27T20:42:39.926630+0000","last_undegraded":"2023-11-27T20:42:39.926630+0000","last_fullsized":"2023-11-27T20:42:39.926630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:08.745845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.557618+0000","last_change":"2023-11-27T20:42:37.530114+0000","last_active":"2023-11-27T20:42:38.557618+0000","last_peered":"2023-11-27T20:42:38.557618+0000","last_clean":"2023-11-27T20:42:38.557618+0000","last_became_active":"2023-11-27T20:42:37.529838+0000","last_became_peered":"2023-11-27T20:42:37.529838+0000","last_unstale":"2023-11-27T20:42:38.557618+0000","last_undegraded":"2023-11-27T20:42:38.557618+0000","last_fullsized":"2023-11-27T20:42:38.557618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849399+0000","last_change":"2023-11-27T20:42:38.553617+0000","last_active":"2023-11-27T20:42:39.849399+0000","last_peered":"2023-11-27T20:42:39.849399+0000","last_clean":"2023-11-27T20:42:39.849399+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:39.849399+0000","last_undegraded":"2023-11-27T20:42:39.849399+0000","last_fullsized":"2023-11-27T20:42:39.849399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562088+0000","last_change":"2023-11-27T20:42:37.528142+0000","last_active":"2023-11-27T20:42:39.562088+0000","last_peered":"2023-11-27T20:42:39.562088+0000","last_clean":"2023-11-27T20:42:39.562088+0000","last_became_active":"2023-11-27T20:42:37.527318+0000","last_became_peered":"2023-11-27T20:42:37.527318+0000","last_unstale":"2023-11-27T20:42:39.562088+0000","last_undegraded":"2023-11-27T20:42:39.562088+0000","last_fullsized":"2023-11-27T20:42:39.562088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561601+0000","last_change":"2023-11-27T20:42:38.536715+0000","last_active":"2023-11-27T20:42:39.561601+0000","last_peered":"2023-11-27T20:42:39.561601+0000","last_clean":"2023-11-27T20:42:39.561601+0000","last_became_active":"2023-11-27T20:42:38.536349+0000","last_became_peered":"2023-11-27T20:42:38.536349+0000","last_unstale":"2023-11-27T20:42:39.561601+0000","last_undegraded":"2023-11-27T20:42:39.561601+0000","last_fullsized":"2023-11-27T20:42:39.561601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.535876+0000","last_change":"2023-11-27T20:42:37.527056+0000","last_active":"2023-11-27T20:42:38.535876+0000","last_peered":"2023-11-27T20:42:38.535876+0000","last_clean":"2023-11-27T20:42:38.535876+0000","last_became_active":"2023-11-27T20:42:37.526803+0000","last_became_peered":"2023-11-27T20:42:37.526803+0000","last_unstale":"2023-11-27T20:42:38.535876+0000","last_undegraded":"2023-11-27T20:42:38.535876+0000","last_fullsized":"2023-11-27T20:42:38.535876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546103+0000","last_change":"2023-11-27T20:42:38.533430+0000","last_active":"2023-11-27T20:42:39.546103+0000","last_peered":"2023-11-27T20:42:39.546103+0000","last_clean":"2023-11-27T20:42:39.546103+0000","last_became_active":"2023-11-27T20:42:38.532325+0000","last_became_peered":"2023-11-27T20:42:38.532325+0000","last_unstale":"2023-11-27T20:42:39.546103+0000","last_undegraded":"2023-11-27T20:42:39.546103+0000","last_fullsized":"2023-11-27T20:42:39.546103+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.524727+0000","last_change":"2023-11-27T20:42:37.532441+0000","last_active":"2023-11-27T20:42:38.524727+0000","last_peered":"2023-11-27T20:42:38.524727+0000","last_clean":"2023-11-27T20:42:38.524727+0000","last_became_active":"2023-11-27T20:42:37.532074+0000","last_became_peered":"2023-11-27T20:42:37.532074+0000","last_unstale":"2023-11-27T20:42:38.524727+0000","last_undegraded":"2023-11-27T20:42:38.524727+0000","last_fullsized":"2023-11-27T20:42:38.524727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:04.889609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561985+0000","last_change":"2023-11-27T20:42:38.531762+0000","last_active":"2023-11-27T20:42:39.561985+0000","last_peered":"2023-11-27T20:42:39.561985+0000","last_clean":"2023-11-27T20:42:39.561985+0000","last_became_active":"2023-11-27T20:42:38.531490+0000","last_became_peered":"2023-11-27T20:42:38.531490+0000","last_unstale":"2023-11-27T20:42:39.561985+0000","last_undegraded":"2023-11-27T20:42:39.561985+0000","last_fullsized":"2023-11-27T20:42:39.561985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.534713+0000","last_change":"2023-11-27T20:42:37.529807+0000","last_active":"2023-11-27T20:42:38.534713+0000","last_peered":"2023-11-27T20:42:38.534713+0000","last_clean":"2023-11-27T20:42:38.534713+0000","last_became_active":"2023-11-27T20:42:37.529543+0000","last_became_peered":"2023-11-27T20:42:37.529543+0000","last_unstale":"2023-11-27T20:42:38.534713+0000","last_undegraded":"2023-11-27T20:42:38.534713+0000","last_fullsized":"2023-11-27T20:42:38.534713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545363+0000","last_change":"2023-11-27T20:42:38.556454+0000","last_active":"2023-11-27T20:42:39.545363+0000","last_peered":"2023-11-27T20:42:39.545363+0000","last_clean":"2023-11-27T20:42:39.545363+0000","last_became_active":"2023-11-27T20:42:38.556194+0000","last_became_peered":"2023-11-27T20:42:38.556194+0000","last_unstale":"2023-11-27T20:42:39.545363+0000","last_undegraded":"2023-11-27T20:42:39.545363+0000","last_fullsized":"2023-11-27T20:42:39.545363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.518825+0000","last_change":"2023-11-27T20:42:37.530919+0000","last_active":"2023-11-27T20:42:38.518825+0000","last_peered":"2023-11-27T20:42:38.518825+0000","last_clean":"2023-11-27T20:42:38.518825+0000","last_became_active":"2023-11-27T20:42:37.530606+0000","last_became_peered":"2023-11-27T20:42:37.530606+0000","last_unstale":"2023-11-27T20:42:38.518825+0000","last_undegraded":"2023-11-27T20:42:38.518825+0000","last_fullsized":"2023-11-27T20:42:38.518825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:26.686814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926199+0000","last_change":"2023-11-27T20:42:38.544391+0000","last_active":"2023-11-27T20:42:39.926199+0000","last_peered":"2023-11-27T20:42:39.926199+0000","last_clean":"2023-11-27T20:42:39.926199+0000","last_became_active":"2023-11-27T20:42:38.544114+0000","last_became_peered":"2023-11-27T20:42:38.544114+0000","last_unstale":"2023-11-27T20:42:39.926199+0000","last_undegraded":"2023-11-27T20:42:39.926199+0000","last_fullsized":"2023-11-27T20:42:39.926199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.541446+0000","last_change":"2023-11-27T20:42:37.533800+0000","last_active":"2023-11-27T20:42:38.541446+0000","last_peered":"2023-11-27T20:42:38.541446+0000","last_clean":"2023-11-27T20:42:38.541446+0000","last_became_active":"2023-11-27T20:42:37.533358+0000","last_became_peered":"2023-11-27T20:42:37.533358+0000","last_unstale":"2023-11-27T20:42:38.541446+0000","last_undegraded":"2023-11-27T20:42:38.541446+0000","last_fullsized":"2023-11-27T20:42:38.541446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.549458+0000","last_change":"2023-11-27T20:42:38.542611+0000","last_active":"2023-11-27T20:42:39.549458+0000","last_peered":"2023-11-27T20:42:39.549458+0000","last_clean":"2023-11-27T20:42:39.549458+0000","last_became_active":"2023-11-27T20:42:38.542177+0000","last_became_peered":"2023-11-27T20:42:38.542177+0000","last_unstale":"2023-11-27T20:42:39.549458+0000","last_undegraded":"2023-11-27T20:42:39.549458+0000","last_fullsized":"2023-11-27T20:42:39.549458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.535770+0000","last_change":"2023-11-27T20:42:37.523367+0000","last_active":"2023-11-27T20:42:38.535770+0000","last_peered":"2023-11-27T20:42:38.535770+0000","last_clean":"2023-11-27T20:42:38.535770+0000","last_became_active":"2023-11-27T20:42:37.522948+0000","last_became_peered":"2023-11-27T20:42:37.522948+0000","last_unstale":"2023-11-27T20:42:38.535770+0000","last_undegraded":"2023-11-27T20:42:38.535770+0000","last_fullsized":"2023-11-27T20:42:38.535770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T20:42:38.525694+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:42:38.525694+0000","last_peered":"2023-11-27T20:42:38.525694+0000","last_clean":"2023-11-27T20:42:38.525694+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:42:38.525694+0000","last_undegraded":"2023-11-27T20:42:38.525694+0000","last_fullsized":"2023-11-27T20:42:38.525694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":742397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.4279999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.607}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.099}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.2090000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.724},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.512}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.8169999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.885},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.667}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.425},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.3979999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.1819999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.997},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.528}]},{"osd":3,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.054},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.127}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.704},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":3.536,"5min":3.536,"15min":3.536},"last":0.93100000000000005}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.615}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.282},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.24}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.628}]},{"osd":1,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0900000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.0509999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.264},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":1.1419999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.5589999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2149999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.3260000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.3700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.7010000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.327}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.4330000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.611}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.5509999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.512},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.7609999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.647},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.8180000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.78600000000000003}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.1519999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.24}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.8050000000000002,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.365},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.4330000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.982},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.4039999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.643},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.764}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.595}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":152009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.2270000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.1499999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.93899999999999995}]},{"osd":3,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.998},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.98299999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.4490000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.5289999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.419},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":1.387}]},{"osd":7,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.288},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.581}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.78100000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.198}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.409},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.91500000000000004}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.252},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.6739999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.034},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.97699999999999998}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.111}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.353}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":742307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.4590000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.127},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0640000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.2470000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.415}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.369},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.3380000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.5409999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.587},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.5029999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:42:48.419 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T20:42:48.419 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-27T20:42:48.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.667+0000 7faf42183640 1 Processor -- start 2023-11-27T20:42:48.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.667+0000 7faf42183640 1 -- start start 2023-11-27T20:42:48.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.669+0000 7faf42183640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faf3c06a770 0x7faf3c06ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.669+0000 7faf42183640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf3c072050 0x7faf3c070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.669+0000 7faf42183640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c1534e0 con 0x7faf3c06b090 2023-11-27T20:42:48.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.669+0000 7faf42183640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c0aab70 con 0x7faf3c06a770 2023-11-27T20:42:48.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.669+0000 7faf42183640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c152f80 con 0x7faf3c072050 2023-11-27T20:42:48.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.669+0000 7faf3affd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7faf3c06b090 0x7faf3c14f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:58510/0 (socket says 172.21.15.91:58510) 2023-11-27T20:42:48.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.669+0000 7faf3affd640 1 -- 172.21.15.91:0/3336999329 learned_addr learned my addr 172.21.15.91:0/3336999329 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:48.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.669+0000 7faf3b7fe640 1 --2- 172.21.15.91:0/3336999329 >> v2:172.21.15.183:3300/0 conn(0x7faf3c06a770 0x7faf3c06ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:48.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.669+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629136346 0 0) 0x7faf3c1534e0 con 0x7faf3c06b090 2023-11-27T20:42:48.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf24003520 con 0x7faf3c06b090 2023-11-27T20:42:48.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 34268362 0 0) 0x7faf24003520 con 0x7faf3c06b090 2023-11-27T20:42:48.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf3c072050 msgr2=0x7faf3c070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:48.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 --2- 172.21.15.91:0/3336999329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf3c072050 0x7faf3c070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 >> v2:172.21.15.183:3300/0 conn(0x7faf3c06a770 msgr2=0x7faf3c06ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:48.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 --2- 172.21.15.91:0/3336999329 >> v2:172.21.15.183:3300/0 conn(0x7faf3c06a770 0x7faf3c06ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0ac470 con 0x7faf3c06b090 2023-11-27T20:42:48.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7faf30001670 con 0x7faf3c06b090 2023-11-27T20:42:48.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 >> v1:172.21.15.91:6789/0 conn(0x7faf3c06b090 legacy=0x7faf3c14f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 --2- 172.21.15.91:0/3336999329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf3c072050 0x7faf24003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 --2- 172.21.15.91:0/3336999329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 0x7faf240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 --2- 172.21.15.91:0/3336999329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24004d00 0x7faf24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0aab70 con 0x7faf24003ef0 2023-11-27T20:42:48.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c152f80 con 0x7faf24004d00 2023-11-27T20:42:48.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2400bbf0 con 0x7faf3c072050 2023-11-27T20:42:48.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.670+0000 7faf3affd640 1 --2- 172.21.15.91:0/3336999329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 0x7faf240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:48.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.671+0000 7faf3affd640 1 -- 172.21.15.91:0/3336999329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf3c072050 msgr2=0x7faf24003970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T20:42:48.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.671+0000 7faf3affd640 1 --2- 172.21.15.91:0/3336999329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf3c072050 0x7faf24003970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.671+0000 7faf3affd640 1 -- 172.21.15.91:0/3336999329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24004d00 msgr2=0x7faf24005180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T20:42:48.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.671+0000 7faf3affd640 1 --2- 172.21.15.91:0/3336999329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24004d00 0x7faf24005180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.671+0000 7faf3affd640 1 -- 172.21.15.91:0/3336999329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24003520 con 0x7faf24003ef0 2023-11-27T20:42:48.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.672+0000 7faf3affd640 1 --2- 172.21.15.91:0/3336999329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 0x7faf240047c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faf3000c210 tx=0x7faf240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832345aaf4daf67d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:48.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.672+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30005ad0 con 0x7faf24003ef0 2023-11-27T20:42:48.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.672+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30005c30 con 0x7faf24003ef0 2023-11-27T20:42:48.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.672+0000 7faf3a7fc640 1 -- 172.21.15.91:0/3336999329 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3002c8d0 con 0x7faf24003ef0 2023-11-27T20:42:48.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.673+0000 7faf42183640 1 -- 172.21.15.91:0/3336999329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 msgr2=0x7faf240047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.673+0000 7faf42183640 1 --2- 172.21.15.91:0/3336999329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 0x7faf240047c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faf3000c210 tx=0x7faf240057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.673+0000 7faf3bfff640 1 -- 172.21.15.91:0/3336999329 reap_dead start 2023-11-27T20:42:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.673+0000 7faf42183640 1 -- 172.21.15.91:0/3336999329 shutdown_connections 2023-11-27T20:42:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.673+0000 7faf42183640 1 -- 172.21.15.91:0/3336999329 >> 172.21.15.91:0/3336999329 conn(0x7faf3c0c6ee0 msgr2=0x7faf3c0c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.673+0000 7faf42183640 1 -- 172.21.15.91:0/3336999329 shutdown_connections 2023-11-27T20:42:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.673+0000 7faf42183640 1 -- 172.21.15.91:0/3336999329 wait complete. 2023-11-27T20:42:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.674+0000 7faf42183640 1 Processor -- start 2023-11-27T20:42:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.675+0000 7faf42183640 1 -- start start 2023-11-27T20:42:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.675+0000 7faf42183640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 0x7faf3c0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.675+0000 7faf42183640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf3c0a99c0 0x7faf3c0a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf42183640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf3c145790 0x7faf3c145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf42183640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0c2180 con 0x7faf24003ef0 2023-11-27T20:42:48.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf42183640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c1ea350 con 0x7faf3c0a99c0 2023-11-27T20:42:48.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf42183640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0c2e70 con 0x7faf3c145790 2023-11-27T20:42:48.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf3b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 0x7faf3c0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:48.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf3b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 0x7faf3c0c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54596/0 (socket says 172.21.15.91:54596) 2023-11-27T20:42:48.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf3b7fe640 1 -- 172.21.15.91:0/1283339387 learned_addr learned my addr 172.21.15.91:0/1283339387 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:48.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf3b7fe640 1 -- 172.21.15.91:0/1283339387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf3c145790 msgr2=0x7faf3c145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf3b7fe640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf3c145790 0x7faf3c145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf3b7fe640 1 -- 172.21.15.91:0/1283339387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf3c0a99c0 msgr2=0x7faf3c0a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf3b7fe640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf3c0a99c0 0x7faf3c0a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.676+0000 7faf3b7fe640 1 -- 172.21.15.91:0/1283339387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0c3110 con 0x7faf24003ef0 2023-11-27T20:42:48.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.677+0000 7faf3b7fe640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 0x7faf3c0c4070 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00e930 tx=0x7faf2c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:48.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.677+0000 7faf23fff640 1 -- 172.21.15.91:0/1283339387 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c009690 con 0x7faf24003ef0 2023-11-27T20:42:48.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.677+0000 7faf23fff640 1 -- 172.21.15.91:0/1283339387 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00c980 con 0x7faf24003ef0 2023-11-27T20:42:48.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.677+0000 7faf23fff640 1 -- 172.21.15.91:0/1283339387 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00cd30 con 0x7faf24003ef0 2023-11-27T20:42:48.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.677+0000 7faf42183640 1 -- 172.21.15.91:0/1283339387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c0c33f0 con 0x7faf24003ef0 2023-11-27T20:42:48.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.677+0000 7faf42183640 1 -- 172.21.15.91:0/1283339387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c0c39b0 con 0x7faf24003ef0 2023-11-27T20:42:48.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.678+0000 7faf42183640 1 -- 172.21.15.91:0/1283339387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c068350 con 0x7faf24003ef0 2023-11-27T20:42:48.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.679+0000 7faf23fff640 1 -- 172.21.15.91:0/1283339387 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faf2c013470 con 0x7faf24003ef0 2023-11-27T20:42:48.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.680+0000 7faf23fff640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf2806b1c0 0x7faf2806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:48.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.680+0000 7faf23fff640 1 -- 172.21.15.91:0/1283339387 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf2c089bc0 con 0x7faf24003ef0 2023-11-27T20:42:48.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.680+0000 7faf3affd640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf2806b1c0 0x7faf2806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:48.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.681+0000 7faf3affd640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf2806b1c0 0x7faf2806d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faf30034000 tx=0x7faf3002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:48.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.685+0000 7faf23fff640 1 -- 172.21.15.91:0/1283339387 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faf2c0549b0 con 0x7faf24003ef0 2023-11-27T20:42:48.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.945+0000 7faf42183640 1 -- 172.21.15.91:0/1283339387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7faf3c06f870 con 0x7faf24003ef0 2023-11-27T20:42:48.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.950+0000 7faf23fff640 1 -- 172.21.15.91:0/1283339387 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7faf2c0210b0 con 0x7faf24003ef0 2023-11-27T20:42:48.952 INFO:teuthology.orchestra.run.smithi091.stdout:[client.0] 2023-11-27T20:42:48.952 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5/mRlKBgjIhAArHSIgmH/SwVIdiUlROMOfA== 2023-11-27T20:42:48.952 INFO:teuthology.orchestra.run.smithi091.stdout: caps mds = "allow" 2023-11-27T20:42:48.952 INFO:teuthology.orchestra.run.smithi091.stdout: caps mon = "allow r" 2023-11-27T20:42:48.952 INFO:teuthology.orchestra.run.smithi091.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-27T20:42:48.952 INFO:teuthology.orchestra.run.smithi091.stderr:updated caps for client.0 2023-11-27T20:42:48.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.952+0000 7faf42183640 1 -- 172.21.15.91:0/1283339387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf2806b1c0 msgr2=0x7faf2806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.952+0000 7faf42183640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf2806b1c0 0x7faf2806d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faf30034000 tx=0x7faf3002e000 comp rx=0 tx=0).stop 2023-11-27T20:42:48.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.952+0000 7faf42183640 1 -- 172.21.15.91:0/1283339387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 msgr2=0x7faf3c0c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:48.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.952+0000 7faf42183640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 0x7faf3c0c4070 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00e930 tx=0x7faf2c00edf0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.953+0000 7faf42183640 1 -- 172.21.15.91:0/1283339387 shutdown_connections 2023-11-27T20:42:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.953+0000 7faf42183640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf3c145790 0x7faf3c145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.953+0000 7faf42183640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf2806b1c0 0x7faf2806d680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.953+0000 7faf42183640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf3c0a99c0 0x7faf3c0a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.953+0000 7faf42183640 1 --2- 172.21.15.91:0/1283339387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf24003ef0 0x7faf3c0c4070 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.953+0000 7faf42183640 1 -- 172.21.15.91:0/1283339387 >> 172.21.15.91:0/1283339387 conn(0x7faf3c0c6ee0 msgr2=0x7faf3c14f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.953+0000 7faf42183640 1 -- 172.21.15.91:0/1283339387 shutdown_connections 2023-11-27T20:42:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:48.953+0000 7faf42183640 1 -- 172.21.15.91:0/1283339387 wait complete. 2023-11-27T20:42:48.972 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:42:49.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.181+0000 7f847896e640 1 Processor -- start 2023-11-27T20:42:49.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.182+0000 7f847896e640 1 -- start start 2023-11-27T20:42:49.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.183+0000 7f847896e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f847406d0a0 0x7f8474152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.183+0000 7f847896e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f84740c3ea0 0x7f84740c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.183+0000 7f847896e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84740c64a0 con 0x7f847414fd30 2023-11-27T20:42:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.183+0000 7f847896e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84740c5c00 con 0x7f847406d0a0 2023-11-27T20:42:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.183+0000 7f847896e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84740c5ee0 con 0x7f84740c3ea0 2023-11-27T20:42:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.183+0000 7f846bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f847406d0a0 0x7f8474152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.183+0000 7f846bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f847406d0a0 0x7f8474152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54602/0 (socket says 172.21.15.91:54602) 2023-11-27T20:42:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.183+0000 7f846bfff640 1 -- 172.21.15.91:0/1755550970 learned_addr learned my addr 172.21.15.91:0/1755550970 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.184+0000 7f8472d9d640 1 --2- 172.21.15.91:0/1755550970 >> v2:172.21.15.183:3300/0 conn(0x7f84740c3ea0 0x7f84740c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.184+0000 7f846bfff640 1 -- 172.21.15.91:0/1755550970 >> v2:172.21.15.183:3300/0 conn(0x7f84740c3ea0 msgr2=0x7f84740c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.184+0000 7f846bfff640 1 --2- 172.21.15.91:0/1755550970 >> v2:172.21.15.183:3300/0 conn(0x7f84740c3ea0 0x7f84740c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.184+0000 7f846bfff640 1 -- 172.21.15.91:0/1755550970 >> v1:172.21.15.183:6789/0 conn(0x7f847414fd30 legacy=0x7f84740a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.184+0000 7f846bfff640 1 -- 172.21.15.91:0/1755550970 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84740c61c0 con 0x7f847406d0a0 2023-11-27T20:42:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.184+0000 7f8472d9d640 1 --2- 172.21.15.91:0/1755550970 >> v2:172.21.15.183:3300/0 conn(0x7f84740c3ea0 0x7f84740c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:49.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.185+0000 7f846bfff640 1 --2- 172.21.15.91:0/1755550970 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847406d0a0 0x7f8474152f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f847406e430 tx=0x7f845c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8b99834fe95b81 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:49.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.185+0000 7f8471d9b640 1 -- 172.21.15.91:0/1755550970 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c031870 con 0x7f847406d0a0 2023-11-27T20:42:49.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.185+0000 7f8471d9b640 1 -- 172.21.15.91:0/1755550970 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c0319d0 con 0x7f847406d0a0 2023-11-27T20:42:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.185+0000 7f8471d9b640 1 -- 172.21.15.91:0/1755550970 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c031d60 con 0x7f847406d0a0 2023-11-27T20:42:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.186+0000 7f847896e640 1 -- 172.21.15.91:0/1755550970 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847406d0a0 msgr2=0x7f8474152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.186+0000 7f847896e640 1 --2- 172.21.15.91:0/1755550970 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847406d0a0 0x7f8474152f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f847406e430 tx=0x7f845c02b910 comp rx=0 tx=0).stop 2023-11-27T20:42:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.186+0000 7f847896e640 1 -- 172.21.15.91:0/1755550970 shutdown_connections 2023-11-27T20:42:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.186+0000 7f847896e640 1 --2- 172.21.15.91:0/1755550970 >> v2:172.21.15.183:3300/0 conn(0x7f84740c3ea0 0x7f84740c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.186+0000 7f847896e640 1 --2- 172.21.15.91:0/1755550970 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847406d0a0 0x7f8474152f20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.186+0000 7f847896e640 1 -- 172.21.15.91:0/1755550970 >> 172.21.15.91:0/1755550970 conn(0x7f847406a500 msgr2=0x7f847406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.186+0000 7f847896e640 1 -- 172.21.15.91:0/1755550970 shutdown_connections 2023-11-27T20:42:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.186+0000 7f847896e640 1 -- 172.21.15.91:0/1755550970 wait complete. 2023-11-27T20:42:49.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.188+0000 7f847896e640 1 Processor -- start 2023-11-27T20:42:49.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.188+0000 7f847896e640 1 -- start start 2023-11-27T20:42:49.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.189+0000 7f847896e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f847406d0a0 0x7f84740bf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:49.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.189+0000 7f847896e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84740c3ea0 0x7f84740bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:49.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.189+0000 7f847896e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847414fd30 0x7f84741e9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:49.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.189+0000 7f847896e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847414f500 con 0x7f847414fd30 2023-11-27T20:42:49.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.189+0000 7f847896e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84741dc900 con 0x7f847406d0a0 2023-11-27T20:42:49.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.189+0000 7f847896e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84741dcbe0 con 0x7f84740c3ea0 2023-11-27T20:42:49.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.189+0000 7f8472d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847414fd30 0x7f84741e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:49.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.189+0000 7f8472d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847414fd30 0x7f84741e9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54608/0 (socket says 172.21.15.91:54608) 2023-11-27T20:42:49.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.189+0000 7f8472d9d640 1 -- 172.21.15.91:0/3732710135 learned_addr learned my addr 172.21.15.91:0/3732710135 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:49.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f847259c640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f847406d0a0 0x7f84740bf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:49.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f846bfff640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84740c3ea0 0x7f84740bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:49.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f8472d9d640 1 -- 172.21.15.91:0/3732710135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84740c3ea0 msgr2=0x7f84740bf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:49.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f8472d9d640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84740c3ea0 0x7f84740bf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:49.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f8472d9d640 1 -- 172.21.15.91:0/3732710135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f847406d0a0 msgr2=0x7f84740bf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:49.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f8472d9d640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f847406d0a0 0x7f84740bf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:49.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f8472d9d640 1 -- 172.21.15.91:0/3732710135 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0094d0 con 0x7f847414fd30 2023-11-27T20:42:49.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f8472d9d640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847414fd30 0x7f84741e9560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f846c00cef0 tx=0x7f846c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:49.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f846affd640 1 -- 172.21.15.91:0/3732710135 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00d840 con 0x7f847414fd30 2023-11-27T20:42:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f846affd640 1 -- 172.21.15.91:0/3732710135 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c00d9c0 con 0x7f847414fd30 2023-11-27T20:42:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f847896e640 1 -- 172.21.15.91:0/3732710135 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84741dcec0 con 0x7f847414fd30 2023-11-27T20:42:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.190+0000 7f846affd640 1 -- 172.21.15.91:0/3732710135 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00dd70 con 0x7f847414fd30 2023-11-27T20:42:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.191+0000 7f847896e640 1 -- 172.21.15.91:0/3732710135 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847414f070 con 0x7f847414fd30 2023-11-27T20:42:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.192+0000 7f847896e640 1 -- 172.21.15.91:0/3732710135 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847414f2c0 con 0x7f847414fd30 2023-11-27T20:42:49.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.193+0000 7f846affd640 1 -- 172.21.15.91:0/3732710135 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f846c01e3b0 con 0x7f847414fd30 2023-11-27T20:42:49.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.193+0000 7f846affd640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f845406b1f0 0x7f845406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:49.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.194+0000 7f846affd640 1 -- 172.21.15.91:0/3732710135 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f846c08a4d0 con 0x7f847414fd30 2023-11-27T20:42:49.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.194+0000 7f847259c640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f845406b1f0 0x7f845406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:49.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.194+0000 7f847259c640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f845406b1f0 0x7f845406d6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8464004ea0 tx=0x7f8464009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.198+0000 7f846affd640 1 -- 172.21.15.91:0/3732710135 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f847414f2c0 con 0x7f847414fd30 2023-11-27T20:42:49.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.408+0000 7f847896e640 1 -- 172.21.15.91:0/3732710135 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84741dd100 con 0x7f847414fd30 2023-11-27T20:42:49.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.408+0000 7f846affd640 1 -- 172.21.15.91:0/3732710135 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f84741dd100 con 0x7f847414fd30 2023-11-27T20:42:49.413 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:49.414 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/127433365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":127433365},{"type":"v1","addr":"172.21.15.91:6837","nonce":127433365}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:37.962718+0000","modified":"2023-11-27T20:42:41.040049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.183:6834/3450105603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3450105603},{"type":"v1","addr":"172.21.15.183:6834","nonce":3450105603}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-27T20:42:49.414 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 16 2023-11-27T20:42:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 -- 172.21.15.91:0/3732710135 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f845406b1f0 msgr2=0x7f845406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f845406b1f0 0x7f845406d6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8464004ea0 tx=0x7f8464009040 comp rx=0 tx=0).stop 2023-11-27T20:42:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 -- 172.21.15.91:0/3732710135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847414fd30 msgr2=0x7f84741e9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847414fd30 0x7f84741e9560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f846c00cef0 tx=0x7f846c00a710 comp rx=0 tx=0).stop 2023-11-27T20:42:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 -- 172.21.15.91:0/3732710135 shutdown_connections 2023-11-27T20:42:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f847414fd30 0x7f84741e9560 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84740c3ea0 0x7f84740bf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:49.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f845406b1f0 0x7f845406d6b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:49.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 --2- 172.21.15.91:0/3732710135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f847406d0a0 0x7f84740bf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:49.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 -- 172.21.15.91:0/3732710135 >> 172.21.15.91:0/3732710135 conn(0x7f847406a500 msgr2=0x7f847406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:49.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 -- 172.21.15.91:0/3732710135 shutdown_connections 2023-11-27T20:42:49.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:49.411+0000 7f847896e640 1 -- 172.21.15.91:0/3732710135 wait complete. 2023-11-27T20:42:49.832 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T20:42:37.962718+0000', 'modified': '2023-11-27T20:42:41.040049+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5025}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5025': {'gid': 5025, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.183:6834/3450105603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6832', 'nonce': 3450105603}, {'type': 'v1', 'addr': '172.21.15.183:6834', 'nonce': 3450105603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T20:42:49.832 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T20:42:49.832 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-27T20:42:50.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.051+0000 7f02e0abb640 1 Processor -- start 2023-11-27T20:42:50.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.052+0000 7f02e0abb640 1 -- start start 2023-11-27T20:42:50.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.053+0000 7f02e0abb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0c7fc0 0x7f02dc0c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.053+0000 7f02e0abb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f02dc0c7700 0x7f02dc155080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.053+0000 7f02e0abb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f02dc1555c0 0x7f02dc0c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.053+0000 7f02e0abb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc0c3ee0 con 0x7f02dc0c7700 2023-11-27T20:42:50.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.053+0000 7f02e0abb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc0c7b90 con 0x7f02dc1555c0 2023-11-27T20:42:50.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.053+0000 7f02e0abb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0c1da0 con 0x7f02dc0c7fc0 2023-11-27T20:42:50.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.053+0000 7f02d9d9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f02dc0c7700 0x7f02dc155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.053+0000 7f02d9d9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f02dc0c7700 0x7f02dc155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54616/0 (socket says 172.21.15.91:54616) 2023-11-27T20:42:50.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.053+0000 7f02d9d9b640 1 -- 172.21.15.91:0/1419578076 learned_addr learned my addr 172.21.15.91:0/1419578076 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:50.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.054+0000 7f02da59c640 1 --2- 172.21.15.91:0/1419578076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0c7fc0 0x7f02dc0c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.054+0000 7f02dad9d640 1 --2- 172.21.15.91:0/1419578076 >> v2:172.21.15.183:3300/0 conn(0x7f02dc1555c0 0x7f02dc0c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.054+0000 7f02d9d9b640 1 -- 172.21.15.91:0/1419578076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0c7fc0 msgr2=0x7f02dc0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:50.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.054+0000 7f02d9d9b640 1 --2- 172.21.15.91:0/1419578076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0c7fc0 0x7f02dc0c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.054+0000 7f02d9d9b640 1 -- 172.21.15.91:0/1419578076 >> v2:172.21.15.183:3300/0 conn(0x7f02dc1555c0 msgr2=0x7f02dc0c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:50.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.054+0000 7f02d9d9b640 1 --2- 172.21.15.91:0/1419578076 >> v2:172.21.15.183:3300/0 conn(0x7f02dc1555c0 0x7f02dc0c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.054+0000 7f02d9d9b640 1 -- 172.21.15.91:0/1419578076 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0c2080 con 0x7f02dc0c7700 2023-11-27T20:42:50.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.055+0000 7f02d9d9b640 1 --2- 172.21.15.91:0/1419578076 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc0c7700 0x7f02dc155080 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0c8b30 tx=0x7f02c402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e386608f8afc07 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:50.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.055+0000 7f02d959a640 1 -- 172.21.15.91:0/1419578076 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40317e0 con 0x7f02dc0c7700 2023-11-27T20:42:50.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.055+0000 7f02d959a640 1 -- 172.21.15.91:0/1419578076 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4031940 con 0x7f02dc0c7700 2023-11-27T20:42:50.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.055+0000 7f02d959a640 1 -- 172.21.15.91:0/1419578076 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4031cd0 con 0x7f02dc0c7700 2023-11-27T20:42:50.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.056+0000 7f02e0abb640 1 -- 172.21.15.91:0/1419578076 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc0c7700 msgr2=0x7f02dc155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.056+0000 7f02e0abb640 1 --2- 172.21.15.91:0/1419578076 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc0c7700 0x7f02dc155080 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0c8b30 tx=0x7f02c402b880 comp rx=0 tx=0).stop 2023-11-27T20:42:50.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.056+0000 7f02e0abb640 1 -- 172.21.15.91:0/1419578076 shutdown_connections 2023-11-27T20:42:50.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.056+0000 7f02e0abb640 1 --2- 172.21.15.91:0/1419578076 >> v2:172.21.15.183:3300/0 conn(0x7f02dc1555c0 0x7f02dc0c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.056+0000 7f02e0abb640 1 --2- 172.21.15.91:0/1419578076 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc0c7700 0x7f02dc155080 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.056+0000 7f02e0abb640 1 --2- 172.21.15.91:0/1419578076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0c7fc0 0x7f02dc0c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.056+0000 7f02e0abb640 1 -- 172.21.15.91:0/1419578076 >> 172.21.15.91:0/1419578076 conn(0x7f02dc0a9b70 msgr2=0x7f02dc0a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:50.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.056+0000 7f02e0abb640 1 -- 172.21.15.91:0/1419578076 shutdown_connections 2023-11-27T20:42:50.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.056+0000 7f02e0abb640 1 -- 172.21.15.91:0/1419578076 wait complete. 2023-11-27T20:42:50.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.058+0000 7f02e0abb640 1 Processor -- start 2023-11-27T20:42:50.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.058+0000 7f02e0abb640 1 -- start start 2023-11-27T20:42:50.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02e0abb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0c7fc0 0x7f02dc158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02e0abb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc1555c0 0x7f02dc1ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02e0abb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc153490 0x7f02dc0a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02e0abb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc157b20 con 0x7f02dc153490 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02e0abb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc1eabe0 con 0x7f02dc1555c0 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02e0abb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0abba0 con 0x7f02dc0c7fc0 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02dad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc153490 0x7f02dc0a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02dad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc153490 0x7f02dc0a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54618/0 (socket says 172.21.15.91:54618) 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02dad9d640 1 -- 172.21.15.91:0/1972487051 learned_addr learned my addr 172.21.15.91:0/1972487051 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02dad9d640 1 -- 172.21.15.91:0/1972487051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0c7fc0 msgr2=0x7f02dc158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02dad9d640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0c7fc0 0x7f02dc158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02dad9d640 1 -- 172.21.15.91:0/1972487051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc1555c0 msgr2=0x7f02dc1ea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02dad9d640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc1555c0 0x7f02dc1ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.059+0000 7f02dad9d640 1 -- 172.21.15.91:0/1972487051 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40094d0 con 0x7f02dc153490 2023-11-27T20:42:50.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.060+0000 7f02dad9d640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc153490 0x7f02dc0a5de0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f02d400d5d0 tx=0x7f02d400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:50.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.060+0000 7f02d2ffd640 1 -- 172.21.15.91:0/1972487051 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d40125f0 con 0x7f02dc153490 2023-11-27T20:42:50.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.060+0000 7f02d2ffd640 1 -- 172.21.15.91:0/1972487051 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d4012770 con 0x7f02dc153490 2023-11-27T20:42:50.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.060+0000 7f02d2ffd640 1 -- 172.21.15.91:0/1972487051 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4012b20 con 0x7f02dc153490 2023-11-27T20:42:50.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.060+0000 7f02e0abb640 1 -- 172.21.15.91:0/1972487051 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc0abe80 con 0x7f02dc153490 2023-11-27T20:42:50.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.060+0000 7f02e0abb640 1 -- 172.21.15.91:0/1972487051 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc0aca60 con 0x7f02dc153490 2023-11-27T20:42:50.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.062+0000 7f02d2ffd640 1 -- 172.21.15.91:0/1972487051 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f02d4012c80 con 0x7f02dc153490 2023-11-27T20:42:50.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.063+0000 7f02d2ffd640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02bc06b1c0 0x7f02bc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.063+0000 7f02d2ffd640 1 -- 172.21.15.91:0/1972487051 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02d4089ec0 con 0x7f02dc153490 2023-11-27T20:42:50.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.063+0000 7f02da59c640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02bc06b1c0 0x7f02bc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.064+0000 7f02e3645740 1 Processor -- start 2023-11-27T20:42:50.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.064+0000 7f02e3645740 1 -- start start 2023-11-27T20:42:50.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.064+0000 7f02da59c640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02bc06b1c0 0x7f02bc06d680 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0070b0 tx=0x7f02cc007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:50.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02e3645740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa4960 0x55bb54fa4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02e3645740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54f6b6b0 0x55bb54fa7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02e3645740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54fa8170 0x55bb54f64ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02e3645740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb54ec8880 con 0x55bb54fa4960 2023-11-27T20:42:50.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02e3645740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb54ed7ae0 con 0x55bb54fa8170 2023-11-27T20:42:50.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02e3645740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb54ed51d0 con 0x55bb54f6b6b0 2023-11-27T20:42:50.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02da59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa4960 0x55bb54fa4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02da59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa4960 0x55bb54fa4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54632/0 (socket says 172.21.15.91:54632) 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02da59c640 1 -- 172.21.15.91:0/3390644476 learned_addr learned my addr 172.21.15.91:0/3390644476 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02da59c640 1 -- 172.21.15.91:0/3390644476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54f6b6b0 msgr2=0x55bb54fa7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02da59c640 1 --2- 172.21.15.91:0/3390644476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54f6b6b0 0x55bb54fa7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02da59c640 1 -- 172.21.15.91:0/3390644476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54fa8170 msgr2=0x55bb54f64ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02da59c640 1 --2- 172.21.15.91:0/3390644476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54fa8170 0x55bb54f64ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.065+0000 7f02da59c640 1 -- 172.21.15.91:0/3390644476 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb54e98860 con 0x55bb54fa4960 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.066+0000 7f02da59c640 1 --2- 172.21.15.91:0/3390644476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa4960 0x55bb54fa4d40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f02cc017780 tx=0x7f02cc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7e8ad21d9f4e3c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.066+0000 7f02bbfff640 1 -- 172.21.15.91:0/3390644476 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc01c070 con 0x55bb54fa4960 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.066+0000 7f02bbfff640 1 -- 172.21.15.91:0/3390644476 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc0154f0 con 0x55bb54fa4960 2023-11-27T20:42:50.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.066+0000 7f02bbfff640 1 -- 172.21.15.91:0/3390644476 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc015880 con 0x55bb54fa4960 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.066+0000 7f02e3645740 1 -- 172.21.15.91:0/3390644476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa4960 msgr2=0x55bb54fa4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.066+0000 7f02e3645740 1 --2- 172.21.15.91:0/3390644476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa4960 0x55bb54fa4d40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f02cc017780 tx=0x7f02cc011000 comp rx=0 tx=0).stop 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.067+0000 7f02e3645740 1 -- 172.21.15.91:0/3390644476 shutdown_connections 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.067+0000 7f02e3645740 1 --2- 172.21.15.91:0/3390644476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54fa8170 0x55bb54f64ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.067+0000 7f02e3645740 1 --2- 172.21.15.91:0/3390644476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54f6b6b0 0x55bb54fa7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.067+0000 7f02e3645740 1 --2- 172.21.15.91:0/3390644476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa4960 0x55bb54fa4d40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.067+0000 7f02e3645740 1 -- 172.21.15.91:0/3390644476 >> 172.21.15.91:0/3390644476 conn(0x55bb54f2bc70 msgr2=0x55bb54f8b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.067+0000 7f02e3645740 1 -- 172.21.15.91:0/3390644476 shutdown_connections 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.067+0000 7f02e3645740 1 -- 172.21.15.91:0/3390644476 wait complete. 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.067+0000 7f02e3645740 1 -- start start 2023-11-27T20:42:50.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.068+0000 7f02e3645740 1 Processor -- start 2023-11-27T20:42:50.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.068+0000 7f02e3645740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54f6b6b0 0x55bb54fa30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.068+0000 7f02e3645740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54fa4960 0x55bb54fb71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.068+0000 7f02e3645740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa8170 0x55bb54f685e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.068+0000 7f02e3645740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb54ed0ac0 con 0x55bb54f6b6b0 2023-11-27T20:42:50.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.068+0000 7f02e3645740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb54e6d2f0 con 0x55bb54fa4960 2023-11-27T20:42:50.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.068+0000 7f02e3645740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb54e8ac70 con 0x55bb54fa8170 2023-11-27T20:42:50.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.068+0000 7f02e3645740 10 client.0 _ll_register_callbacks cb 0x55bb54e8f3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:42:50.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02da59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54f6b6b0 0x55bb54fa30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02da59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54f6b6b0 0x55bb54fa30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54634/0 (socket says 172.21.15.91:54634) 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02da59c640 1 -- 172.21.15.91:0/2149795004 learned_addr learned my addr 172.21.15.91:0/2149795004 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02d9d9b640 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54fa4960 0x55bb54fb71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02da59c640 1 -- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa8170 msgr2=0x55bb54f685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02dad9d640 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa8170 0x55bb54f685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02da59c640 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa8170 0x55bb54f685e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02da59c640 1 -- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54fa4960 msgr2=0x55bb54fb71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02da59c640 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54fa4960 0x55bb54fb71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02da59c640 1 -- 172.21.15.91:0/2149795004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc017430 con 0x55bb54f6b6b0 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.069+0000 7f02d9d9b640 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54fa4960 0x55bb54fb71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02da59c640 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54f6b6b0 0x55bb54fa30c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f02cc025040 tx=0x7f02cc009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd1e8c174c8aa9f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T20:42:50.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02b97fa640 1 -- 172.21.15.91:0/2149795004 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc02d620 con 0x55bb54f6b6b0 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02e3645740 1 -- 172.21.15.91:0/2149795004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb54ec9aa0 con 0x55bb54f6b6b0 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02b97fa640 1 -- 172.21.15.91:0/2149795004 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02cc02d780 con 0x55bb54f6b6b0 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02b97fa640 1 -- 172.21.15.91:0/2149795004 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02cc02d980 con 0x55bb54f6b6b0 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02e3645740 10 client.5211 fetch_fsmap learned FSMap version 16 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02e3645740 1 -- 172.21.15.91:0/2149795004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55bb54ecf140 con 0x55bb54f6b6b0 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02b97fa640 1 -- 172.21.15.91:0/2149795004 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb54ec9aa0 con 0x55bb54f6b6b0 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02b97fa640 1 -- 172.21.15.91:0/2149795004 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f02cc02dae0 con 0x55bb54f6b6b0 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02e3645740 10 client.5211 fetch_fsmap finished waiting for FSMap version 16 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02e3645740 10 client.5211 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02e3645740 20 client.5211 populate_metadata read hostname 'smithi091' 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.070+0000 7f02e3645740 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:6832/3450105603,v1:172.21.15.183:6834/3450105603] conn(0x55bb54fb9ce0 0x55bb54fba0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.071+0000 7f02e3645740 4 client.5211 mds_command: new command op to 5025 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.071+0000 7f02e3645740 1 -- 172.21.15.91:0/2149795004 --> [v2:172.21.15.183:6832/3450105603,v1:172.21.15.183:6834/3450105603] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb54ec97c0 con 0x55bb54fb9ce0 2023-11-27T20:42:50.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.071+0000 7f02d9d9b640 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:6832/3450105603,v1:172.21.15.183:6834/3450105603] conn(0x55bb54fb9ce0 0x55bb54fba0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.072+0000 7f02d9d9b640 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:6832/3450105603,v1:172.21.15.183:6834/3450105603] conn(0x55bb54fb9ce0 0x55bb54fba0c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16a86a23baff734d server_cookie=ef5a6ea2f6c52bc5 in_seq=0 out_seq=0 2023-11-27T20:42:50.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.072+0000 7f02b97fa640 10 client.5211 ms_handle_connect on v2:172.21.15.183:6832/3450105603 2023-11-27T20:42:50.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.074+0000 7f02b97fa640 1 -- 172.21.15.91:0/2149795004 <== mds.0 v2:172.21.15.183:6832/3450105603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bb54ec97c0 con 0x55bb54fb9ce0 2023-11-27T20:42:50.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.074+0000 7f02b97fa640 10 client.5211 handle_command_reply: tid=0 2023-11-27T20:42:50.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.074+0000 7f02e3645740 1 client.5211 shutdown 2023-11-27T20:42:50.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 1 -- 172.21.15.91:0/2149795004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54f6b6b0 msgr2=0x55bb54fa30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54f6b6b0 0x55bb54fa30c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f02cc025040 tx=0x7f02cc009450 comp rx=0 tx=0).stop 2023-11-27T20:42:50.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 1 -- 172.21.15.91:0/2149795004 shutdown_connections 2023-11-27T20:42:50.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:6832/3450105603,v1:172.21.15.183:6834/3450105603] conn(0x55bb54fb9ce0 0x55bb54fba0c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa8170 0x55bb54f685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54fa4960 0x55bb54fb71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 1 --2- 172.21.15.91:0/2149795004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54f6b6b0 0x55bb54fa30c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02b97fa640 0 client.5211 ms_handle_reset on v2:172.21.15.183:6832/3450105603 2023-11-27T20:42:50.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 1 -- 172.21.15.91:0/2149795004 >> 172.21.15.91:0/2149795004 conn(0x55bb54f2bc70 msgr2=0x55bb54f8b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:50.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 1 -- 172.21.15.91:0/2149795004 shutdown_connections 2023-11-27T20:42:50.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 1 -- 172.21.15.91:0/2149795004 wait complete. 2023-11-27T20:42:50.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.075+0000 7f02e3645740 20 client.5211 trim_cache size 0 max 16384 2023-11-27T20:42:50.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.091+0000 7f02e3645740 1 Processor -- start 2023-11-27T20:42:50.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.091+0000 7f02e3645740 1 -- start start 2023-11-27T20:42:50.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.092+0000 7f02e3645740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54f6b6b0 0x55bb54fc9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.092+0000 7f02e3645740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa4960 0x55bb54f85da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.092+0000 7f02e3645740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb54f862e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.092+0000 7f02e3645740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb54c33f20 con 0x55bb54fa8170 2023-11-27T20:42:50.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.092+0000 7f02e3645740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb54f9cab0 con 0x55bb54f6b6b0 2023-11-27T20:42:50.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.092+0000 7f02e3645740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb54f602a0 con 0x55bb54fa4960 2023-11-27T20:42:50.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.092+0000 7f02dad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb54f862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.092+0000 7f02dad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb54f862e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54644/0 (socket says 172.21.15.91:54644) 2023-11-27T20:42:50.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.092+0000 7f02dad9d640 1 -- 172.21.15.91:0/728070417 learned_addr learned my addr 172.21.15.91:0/728070417 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:50.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.093+0000 7f02dad9d640 1 -- 172.21.15.91:0/728070417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa4960 msgr2=0x55bb54f85da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.093+0000 7f02dad9d640 1 --2- 172.21.15.91:0/728070417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa4960 0x55bb54f85da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.093+0000 7f02dad9d640 1 -- 172.21.15.91:0/728070417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54f6b6b0 msgr2=0x55bb54fc9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.093+0000 7f02dad9d640 1 --2- 172.21.15.91:0/728070417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54f6b6b0 0x55bb54fc9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.093+0000 7f02dad9d640 1 -- 172.21.15.91:0/728070417 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb54e6cb80 con 0x55bb54fa8170 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.093+0000 7f02dad9d640 1 --2- 172.21.15.91:0/728070417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb54f862e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f02d4054d20 tx=0x7f02d4058240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a444c8b22e97cf24 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.093+0000 7f02d0ff9640 1 -- 172.21.15.91:0/728070417 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4070170 con 0x55bb54fa8170 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.093+0000 7f02d0ff9640 1 -- 172.21.15.91:0/728070417 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d405c970 con 0x55bb54fa8170 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.093+0000 7f02d0ff9640 1 -- 172.21.15.91:0/728070417 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4060b20 con 0x55bb54fa8170 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.094+0000 7f02e3645740 1 -- 172.21.15.91:0/728070417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 msgr2=0x55bb54f862e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.094+0000 7f02e3645740 1 --2- 172.21.15.91:0/728070417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb54f862e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f02d4054d20 tx=0x7f02d4058240 comp rx=0 tx=0).stop 2023-11-27T20:42:50.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.094+0000 7f02e3645740 1 -- 172.21.15.91:0/728070417 shutdown_connections 2023-11-27T20:42:50.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.094+0000 7f02e3645740 1 --2- 172.21.15.91:0/728070417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb54f862e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.094+0000 7f02e3645740 1 --2- 172.21.15.91:0/728070417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa4960 0x55bb54f85da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.094+0000 7f02e3645740 1 --2- 172.21.15.91:0/728070417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54f6b6b0 0x55bb54fc9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.094+0000 7f02e3645740 1 -- 172.21.15.91:0/728070417 >> 172.21.15.91:0/728070417 conn(0x55bb54f2bc70 msgr2=0x55bb54fa6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:50.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.094+0000 7f02e3645740 1 -- 172.21.15.91:0/728070417 shutdown_connections 2023-11-27T20:42:50.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.094+0000 7f02e3645740 1 -- 172.21.15.91:0/728070417 wait complete. 2023-11-27T20:42:50.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.094+0000 7f02e3645740 1 -- start start 2023-11-27T20:42:50.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.095+0000 7f02e3645740 1 Processor -- start 2023-11-27T20:42:50.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.095+0000 7f02e3645740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54f6b6b0 0x55bb54f880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.095+0000 7f02e3645740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa4960 0x55bb55011140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.095+0000 7f02e3645740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb55011680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.095+0000 7f02e3645740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb54f88fb0 con 0x55bb54fa8170 2023-11-27T20:42:50.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.095+0000 7f02e3645740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb55011ed0 con 0x55bb54f6b6b0 2023-11-27T20:42:50.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.095+0000 7f02e3645740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb54f891c0 con 0x55bb54fa4960 2023-11-27T20:42:50.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.095+0000 7f02e3645740 10 client.0 _ll_register_callbacks cb 0x7f02cc025070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:42:50.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02dad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb55011680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02dad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb55011680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54652/0 (socket says 172.21.15.91:54652) 2023-11-27T20:42:50.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02dad9d640 1 -- 172.21.15.91:0/943781892 learned_addr learned my addr 172.21.15.91:0/943781892 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:50.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02dad9d640 1 -- 172.21.15.91:0/943781892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa4960 msgr2=0x55bb55011140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:50.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02dad9d640 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa4960 0x55bb55011140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02dad9d640 1 -- 172.21.15.91:0/943781892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54f6b6b0 msgr2=0x55bb54f880d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:50.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02dad9d640 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54f6b6b0 0x55bb54f880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02dad9d640 1 -- 172.21.15.91:0/943781892 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc0aca60 con 0x55bb54fa8170 2023-11-27T20:42:50.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02dad9d640 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb55011680 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f02d40587b0 tx=0x7f02d4006d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f4229d844bf8a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:50.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T20:42:50.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.096+0000 7f02b97fa640 1 -- 172.21.15.91:0/943781892 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4060ba0 con 0x55bb54fa8170 2023-11-27T20:42:50.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02b97fa640 1 -- 172.21.15.91:0/943781892 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02d4054f30 con 0x55bb54fa8170 2023-11-27T20:42:50.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02e3645740 1 -- 172.21.15.91:0/943781892 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02cc0154f0 con 0x55bb54fa8170 2023-11-27T20:42:50.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02b97fa640 1 -- 172.21.15.91:0/943781892 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02d40550f0 con 0x55bb54fa8170 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02e3645740 10 client.5217 fetch_fsmap learned FSMap version 16 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02e3645740 1 -- 172.21.15.91:0/943781892 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55bb54e92170 con 0x55bb54fa8170 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02b97fa640 1 -- 172.21.15.91:0/943781892 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc0154f0 con 0x55bb54fa8170 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02b97fa640 1 -- 172.21.15.91:0/943781892 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f02d4057d10 con 0x55bb54fa8170 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02e3645740 10 client.5217 fetch_fsmap finished waiting for FSMap version 16 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02e3645740 10 client.5217 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02e3645740 20 client.5217 populate_metadata read hostname 'smithi091' 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02e3645740 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.183:6832/3450105603,v1:172.21.15.183:6834/3450105603] conn(0x55bb5500af80 0x55bb55014730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02e3645740 4 client.5217 mds_command: new command op to 5025 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.097+0000 7f02e3645740 1 -- 172.21.15.91:0/943781892 --> [v2:172.21.15.183:6832/3450105603,v1:172.21.15.183:6834/3450105603] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bb54bd16c0 con 0x55bb5500af80 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.098+0000 7f02da59c640 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.183:6832/3450105603,v1:172.21.15.183:6834/3450105603] conn(0x55bb5500af80 0x55bb55014730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.099+0000 7f02da59c640 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.183:6832/3450105603,v1:172.21.15.183:6834/3450105603] conn(0x55bb5500af80 0x55bb55014730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1510bd1da7cf5d7 server_cookie=a0cc279b734a75ee in_seq=0 out_seq=0 2023-11-27T20:42:50.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.099+0000 7f02b97fa640 10 client.5217 ms_handle_connect on v2:172.21.15.183:6832/3450105603 2023-11-27T20:42:50.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.099+0000 7f02b97fa640 1 -- 172.21.15.91:0/943781892 <== mds.0 v2:172.21.15.183:6832/3450105603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55bb54bd16c0 con 0x55bb5500af80 2023-11-27T20:42:50.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.099+0000 7f02b97fa640 10 client.5217 handle_command_reply: tid=0 2023-11-27T20:42:50.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.099+0000 7f02e3645740 1 client.5217 shutdown 2023-11-27T20:42:50.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.099+0000 7f02e3645740 1 -- 172.21.15.91:0/943781892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 msgr2=0x55bb55011680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.099+0000 7f02e3645740 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb55011680 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f02d40587b0 tx=0x7f02d4006d50 comp rx=0 tx=0).stop 2023-11-27T20:42:50.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e3645740 1 -- 172.21.15.91:0/943781892 shutdown_connections 2023-11-27T20:42:50.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e3645740 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.183:6832/3450105603,v1:172.21.15.183:6834/3450105603] conn(0x55bb5500af80 0x55bb55014730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e3645740 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bb54fa8170 0x55bb55011680 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e3645740 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55bb54fa4960 0x55bb55011140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02b97fa640 0 client.5217 ms_handle_reset on v2:172.21.15.183:6832/3450105603 2023-11-27T20:42:50.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e3645740 1 --2- 172.21.15.91:0/943781892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb54f6b6b0 0x55bb54f880d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e3645740 1 -- 172.21.15.91:0/943781892 >> 172.21.15.91:0/943781892 conn(0x55bb54f2bc70 msgr2=0x55bb54f69450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:50.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e3645740 1 -- 172.21.15.91:0/943781892 shutdown_connections 2023-11-27T20:42:50.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e3645740 1 -- 172.21.15.91:0/943781892 wait complete. 2023-11-27T20:42:50.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e3645740 20 client.5217 trim_cache size 0 max 16384 2023-11-27T20:42:50.105 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:42:50.105 INFO:teuthology.orchestra.run.smithi091.stdout: "cluster_fsid": "76812701-65a9-4deb-87af-ef00110d1601", 2023-11-27T20:42:50.105 INFO:teuthology.orchestra.run.smithi091.stdout: "whoami": 0, 2023-11-27T20:42:50.105 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 5025, 2023-11-27T20:42:50.105 INFO:teuthology.orchestra.run.smithi091.stdout: "want_state": "up:active", 2023-11-27T20:42:50.106 INFO:teuthology.orchestra.run.smithi091.stdout: "state": "up:active", 2023-11-27T20:42:50.106 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs", 2023-11-27T20:42:50.106 INFO:teuthology.orchestra.run.smithi091.stdout: "rank_uptime": 11.586411087, 2023-11-27T20:42:50.106 INFO:teuthology.orchestra.run.smithi091.stdout: "mdsmap_epoch": 16, 2023-11-27T20:42:50.106 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch": 34, 2023-11-27T20:42:50.106 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch_barrier": 34, 2023-11-27T20:42:50.106 INFO:teuthology.orchestra.run.smithi091.stdout: "uptime": 25.277436538 2023-11-27T20:42:50.106 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:42:50.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e0abb640 1 -- 172.21.15.91:0/1972487051 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02bc06b1c0 msgr2=0x7f02bc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e0abb640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02bc06b1c0 0x7f02bc06d680 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0070b0 tx=0x7f02cc007040 comp rx=0 tx=0).stop 2023-11-27T20:42:50.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e0abb640 1 -- 172.21.15.91:0/1972487051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc153490 msgr2=0x7f02dc0a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e0abb640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc153490 0x7f02dc0a5de0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f02d400d5d0 tx=0x7f02d400da90 comp rx=0 tx=0).stop 2023-11-27T20:42:50.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e0abb640 1 -- 172.21.15.91:0/1972487051 shutdown_connections 2023-11-27T20:42:50.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e0abb640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02dc153490 0x7f02dc0a5de0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e0abb640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f02bc06b1c0 0x7f02bc06d680 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e0abb640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc1555c0 0x7f02dc1ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e0abb640 1 --2- 172.21.15.91:0/1972487051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0c7fc0 0x7f02dc158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.100+0000 7f02e0abb640 1 -- 172.21.15.91:0/1972487051 >> 172.21.15.91:0/1972487051 conn(0x7f02dc0a9b70 msgr2=0x7f02dc154530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:50.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.101+0000 7f02e0abb640 1 -- 172.21.15.91:0/1972487051 shutdown_connections 2023-11-27T20:42:50.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.101+0000 7f02e0abb640 1 -- 172.21.15.91:0/1972487051 wait complete. 2023-11-27T20:42:50.118 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:42:50.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.307+0000 7fe798636640 1 Processor -- start 2023-11-27T20:42:50.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.307+0000 7fe798636640 1 -- start start 2023-11-27T20:42:50.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.308+0000 7fe798636640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe79014fd30 0x7fe790152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.308+0000 7fe798636640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe79006d0a0 0x7fe7900a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.308+0000 7fe798636640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7900c64a0 con 0x7fe7900a5260 2023-11-27T20:42:50.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.308+0000 7fe798636640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7900c5c00 con 0x7fe79006d0a0 2023-11-27T20:42:50.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.308+0000 7fe798636640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7900c5ee0 con 0x7fe79014fd30 2023-11-27T20:42:50.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.309+0000 7fe795bd1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe79006d0a0 0x7fe7900a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.309+0000 7fe795bd1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe79006d0a0 0x7fe7900a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54666/0 (socket says 172.21.15.91:54666) 2023-11-27T20:42:50.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.309+0000 7fe795bd1640 1 -- 172.21.15.91:0/3919438071 learned_addr learned my addr 172.21.15.91:0/3919438071 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:50.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.309+0000 7fe796bd3640 1 --1- 172.21.15.91:0/3919438071 >> v1:172.21.15.91:6789/0 conn(0x7fe7900a5260 0x7fe7900c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:58524/0 (socket says 172.21.15.91:58524) 2023-11-27T20:42:50.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.309+0000 7fe795bd1640 1 -- 172.21.15.91:0/3919438071 >> v2:172.21.15.183:3300/0 conn(0x7fe79014fd30 msgr2=0x7fe790152f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T20:42:50.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.309+0000 7fe795bd1640 1 --2- 172.21.15.91:0/3919438071 >> v2:172.21.15.183:3300/0 conn(0x7fe79014fd30 0x7fe790152f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.309+0000 7fe795bd1640 1 -- 172.21.15.91:0/3919438071 >> v1:172.21.15.91:6789/0 conn(0x7fe7900a5260 legacy=0x7fe7900c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.309+0000 7fe795bd1640 1 -- 172.21.15.91:0/3919438071 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900c61c0 con 0x7fe79006d0a0 2023-11-27T20:42:50.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.310+0000 7fe795bd1640 1 --2- 172.21.15.91:0/3919438071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 0x7fe7900a4d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe79006b200 tx=0x7fe78002b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06f7a004baaebf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:50.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.311+0000 7fe7953d0640 1 -- 172.21.15.91:0/3919438071 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780030890 con 0x7fe79006d0a0 2023-11-27T20:42:50.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.311+0000 7fe7953d0640 1 -- 172.21.15.91:0/3919438071 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7800309f0 con 0x7fe79006d0a0 2023-11-27T20:42:50.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.311+0000 7fe7953d0640 1 -- 172.21.15.91:0/3919438071 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780030d80 con 0x7fe79006d0a0 2023-11-27T20:42:50.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.311+0000 7fe798636640 1 -- 172.21.15.91:0/3919438071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 msgr2=0x7fe7900a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.311+0000 7fe798636640 1 --2- 172.21.15.91:0/3919438071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 0x7fe7900a4d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe79006b200 tx=0x7fe78002b9d0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.312+0000 7fe798636640 1 -- 172.21.15.91:0/3919438071 shutdown_connections 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.312+0000 7fe798636640 1 --2- 172.21.15.91:0/3919438071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 0x7fe7900a4d20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.312+0000 7fe798636640 1 --2- 172.21.15.91:0/3919438071 >> v2:172.21.15.183:3300/0 conn(0x7fe79014fd30 0x7fe790152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.312+0000 7fe798636640 1 -- 172.21.15.91:0/3919438071 >> 172.21.15.91:0/3919438071 conn(0x7fe79006a500 msgr2=0x7fe79006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.312+0000 7fe798636640 1 -- 172.21.15.91:0/3919438071 shutdown_connections 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.312+0000 7fe798636640 1 -- 172.21.15.91:0/3919438071 wait complete. 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.313+0000 7fe798636640 1 Processor -- start 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.313+0000 7fe798636640 1 -- start start 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.314+0000 7fe798636640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 0x7fe7900a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.314+0000 7fe798636640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7900a5260 0x7fe79014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.314+0000 7fe798636640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe79014fd30 0x7fe79014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.314+0000 7fe798636640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7901e92f0 con 0x7fe79006d0a0 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.314+0000 7fe798636640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79014f760 con 0x7fe79014fd30 2023-11-27T20:42:50.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.314+0000 7fe798636640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7901dc7c0 con 0x7fe7900a5260 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.315+0000 7fe7963d2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 0x7fe7900a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.315+0000 7fe7963d2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 0x7fe7900a6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54680/0 (socket says 172.21.15.91:54680) 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.315+0000 7fe7963d2640 1 -- 172.21.15.91:0/846475034 learned_addr learned my addr 172.21.15.91:0/846475034 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.315+0000 7fe795bd1640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7900a5260 0x7fe79014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.315+0000 7fe7963d2640 1 -- 172.21.15.91:0/846475034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7900a5260 msgr2=0x7fe79014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.315+0000 7fe7963d2640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7900a5260 0x7fe79014ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.315+0000 7fe7963d2640 1 -- 172.21.15.91:0/846475034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe79014fd30 msgr2=0x7fe79014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.315+0000 7fe7963d2640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe79014fd30 0x7fe79014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.315+0000 7fe7963d2640 1 -- 172.21.15.91:0/846475034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800094d0 con 0x7fe79006d0a0 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.315+0000 7fe7963d2640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 0x7fe7900a6bd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00b3e0 tx=0x7fe78c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.316+0000 7fe786ffd640 1 -- 172.21.15.91:0/846475034 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c011830 con 0x7fe79006d0a0 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.316+0000 7fe786ffd640 1 -- 172.21.15.91:0/846475034 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c0119b0 con 0x7fe79006d0a0 2023-11-27T20:42:50.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.316+0000 7fe786ffd640 1 -- 172.21.15.91:0/846475034 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c011d60 con 0x7fe79006d0a0 2023-11-27T20:42:50.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.316+0000 7fe798636640 1 -- 172.21.15.91:0/846475034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7901dcaa0 con 0x7fe79006d0a0 2023-11-27T20:42:50.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.316+0000 7fe798636640 1 -- 172.21.15.91:0/846475034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7901e97e0 con 0x7fe79006d0a0 2023-11-27T20:42:50.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.317+0000 7fe798636640 1 -- 172.21.15.91:0/846475034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7901e99d0 con 0x7fe79006d0a0 2023-11-27T20:42:50.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.318+0000 7fe786ffd640 1 -- 172.21.15.91:0/846475034 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe78c01a400 con 0x7fe79006d0a0 2023-11-27T20:42:50.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.319+0000 7fe786ffd640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe77406b1f0 0x7fe77406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:50.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.319+0000 7fe786ffd640 1 -- 172.21.15.91:0/846475034 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe78c089ba0 con 0x7fe79006d0a0 2023-11-27T20:42:50.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.320+0000 7fe795bd1640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe77406b1f0 0x7fe77406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:50.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.320+0000 7fe795bd1640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe77406b1f0 0x7fe77406d6b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe780036000 tx=0x7fe78003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:50.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.324+0000 7fe786ffd640 1 -- 172.21.15.91:0/846475034 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe78c0548d0 con 0x7fe79006d0a0 2023-11-27T20:42:50.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.556+0000 7fe798636640 1 -- 172.21.15.91:0/846475034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe790068350 con 0x7fe79006d0a0 2023-11-27T20:42:50.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.557+0000 7fe786ffd640 1 -- 172.21.15.91:0/846475034 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe78c015020 con 0x7fe79006d0a0 2023-11-27T20:42:50.558 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:42:50.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.559+0000 7fe798636640 1 -- 172.21.15.91:0/846475034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe77406b1f0 msgr2=0x7fe77406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.559+0000 7fe798636640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe77406b1f0 0x7fe77406d6b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe780036000 tx=0x7fe78003b040 comp rx=0 tx=0).stop 2023-11-27T20:42:50.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.559+0000 7fe798636640 1 -- 172.21.15.91:0/846475034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 msgr2=0x7fe7900a6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:50.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.559+0000 7fe798636640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 0x7fe7900a6bd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00b3e0 tx=0x7fe78c00b8a0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.559+0000 7fe798636640 1 -- 172.21.15.91:0/846475034 shutdown_connections 2023-11-27T20:42:50.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.559+0000 7fe798636640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe77406b1f0 0x7fe77406d6b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.559+0000 7fe798636640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe79014fd30 0x7fe79014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.559+0000 7fe798636640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7900a5260 0x7fe79014ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.559+0000 7fe798636640 1 --2- 172.21.15.91:0/846475034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe79006d0a0 0x7fe7900a6bd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:50.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.560+0000 7fe798636640 1 -- 172.21.15.91:0/846475034 >> 172.21.15.91:0/846475034 conn(0x7fe79006a500 msgr2=0x7fe79006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:50.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.560+0000 7fe798636640 1 -- 172.21.15.91:0/846475034 shutdown_connections 2023-11-27T20:42:50.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:50.560+0000 7fe798636640 1 -- 172.21.15.91:0/846475034 wait complete. 2023-11-27T20:42:50.580 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T20:42:50.581 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:42:50.581 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-27T20:42:50.581 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T20:42:50.581 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:42:50.582 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T20:42:50.582 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:42:50.582 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:42:50.582 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:42:50.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:50.583 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-27T20:42:50.636 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:42:50.636 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:42:50.637 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:42:50.637 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:50.637 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-27T20:42:50.637 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:50.638 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:42:50.638 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:42:50.638 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-27T20:42:50.638 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:42:50.639 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:42:50.639 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-27T20:42:50.640 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:42:50.640 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:42:50.640 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:42:50.640 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:42:50.641 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:42:50.641 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 42251sec preferred_lft 42251sec 2023-11-27T20:42:50.641 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-27T20:42:50.641 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:50.642 INFO:teuthology.orchestra.run.smithi091.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:42:50.642 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff 2023-11-27T20:42:50.643 INFO:teuthology.orchestra.run.smithi091.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:42:50.643 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:50.643 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::c0c6:34ff:feb5:e67/64 scope link 2023-11-27T20:42:50.644 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:50.644 INFO:teuthology.orchestra.run.smithi091.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:42:50.644 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:42:50.645 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::d8e3:6ff:fe8b:3b7f/64 scope link 2023-11-27T20:42:50.645 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:50.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:50.645 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:42:50.740 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-27T20:42:50.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:50.744 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-27T20:42:50.798 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-27T20:42:50.798 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:42:50.798 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:42:50.798 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:42:50.798 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:42:50.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:50.799 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:42:50.799 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:42:50.799 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:42:50.799 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:42:50.799 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:42:50.799 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:42:50.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:50.982 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T20:42:51.031 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T20:42:51.031 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:42:51.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:51.032 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-11-27T20:42:51.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:42:51.126 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T20:42:51.182 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:42:51.182 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:42:51.182 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:42:51.231 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:42:51.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:51.231 DEBUG:teuthology.orchestra.run.smithi091:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:42:51.366 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:42:51.366 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:42:51.366 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:42:51.388 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:42:51.389 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:42:51.389 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:42:51.389 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:42:51.389 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:42:51.419 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:42:51.420 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:42:51.420 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:42:51.420 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:42:51.420 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:42:51.420 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:42:51.420 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:42:51.420 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:42:51.422 INFO:teuthology.orchestra.run.smithi091.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-27T20:42:51.422 INFO:teuthology.orchestra.run.smithi091.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:42:51.422 INFO:teuthology.orchestra.run.smithi091.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:42:51.422 INFO:teuthology.orchestra.run.smithi091.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:42:51.422 INFO:teuthology.orchestra.run.smithi091.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:42:51.427 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:42:51.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:51.427 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:42:51.506 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:42:51.512 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:42:51.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:51.513 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:42:51.618 INFO:teuthology.orchestra.run.smithi091.stdout:client4771 2023-11-27T20:42:51.619 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:42:51.619 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:42:51.718 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:42:51.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.934+0000 7f7873d2c640 1 Processor -- start 2023-11-27T20:42:51.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.934+0000 7f7873d2c640 1 -- start start 2023-11-27T20:42:51.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.935+0000 7f7873d2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c06d0a0 0x7f786c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:51.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.935+0000 7f7873d2c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f786c0c3ea0 0x7f786c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:51.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.935+0000 7f7873d2c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786c0c64a0 con 0x7f786c14fd30 2023-11-27T20:42:51.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.935+0000 7f7873d2c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c0c5c00 con 0x7f786c0c3ea0 2023-11-27T20:42:51.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.935+0000 7f7873d2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0c5ee0 con 0x7f786c06d0a0 2023-11-27T20:42:51.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.936+0000 7f78712c7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c06d0a0 0x7f786c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:51.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.936+0000 7f78712c7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c06d0a0 0x7f786c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:54168/0 (socket says 172.21.15.91:54168) 2023-11-27T20:42:51.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.936+0000 7f78712c7640 1 -- 172.21.15.91:0/2745352270 learned_addr learned my addr 172.21.15.91:0/2745352270 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:51.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.936+0000 7f78722c9640 1 --2- 172.21.15.91:0/2745352270 >> v2:172.21.15.183:3300/0 conn(0x7f786c0c3ea0 0x7f786c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:51.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.937+0000 7f78712c7640 1 -- 172.21.15.91:0/2745352270 >> v2:172.21.15.183:3300/0 conn(0x7f786c0c3ea0 msgr2=0x7f786c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:51.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.937+0000 7f78712c7640 1 --2- 172.21.15.91:0/2745352270 >> v2:172.21.15.183:3300/0 conn(0x7f786c0c3ea0 0x7f786c0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:51.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.937+0000 7f78712c7640 1 -- 172.21.15.91:0/2745352270 >> v1:172.21.15.183:6789/0 conn(0x7f786c14fd30 legacy=0x7f786c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:51.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.937+0000 7f78712c7640 1 -- 172.21.15.91:0/2745352270 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0c61c0 con 0x7f786c06d0a0 2023-11-27T20:42:51.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.938+0000 7f78712c7640 1 --2- 172.21.15.91:0/2745352270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c06d0a0 0x7f786c152f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f785c009870 tx=0x7f785c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=157930d53905b5e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:51.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.939+0000 7f7870ac6640 1 -- 172.21.15.91:0/2745352270 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c030840 con 0x7f786c06d0a0 2023-11-27T20:42:51.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.939+0000 7f7870ac6640 1 -- 172.21.15.91:0/2745352270 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c0309a0 con 0x7f786c06d0a0 2023-11-27T20:42:51.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.939+0000 7f7870ac6640 1 -- 172.21.15.91:0/2745352270 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c030d30 con 0x7f786c06d0a0 2023-11-27T20:42:51.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.940+0000 7f7873d2c640 1 -- 172.21.15.91:0/2745352270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c06d0a0 msgr2=0x7f786c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:51.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.940+0000 7f7873d2c640 1 --2- 172.21.15.91:0/2745352270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c06d0a0 0x7f786c152f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f785c009870 tx=0x7f785c02b980 comp rx=0 tx=0).stop 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.940+0000 7f7873d2c640 1 -- 172.21.15.91:0/2745352270 shutdown_connections 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.940+0000 7f7873d2c640 1 --2- 172.21.15.91:0/2745352270 >> v2:172.21.15.183:3300/0 conn(0x7f786c0c3ea0 0x7f786c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.940+0000 7f7873d2c640 1 --2- 172.21.15.91:0/2745352270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c06d0a0 0x7f786c152f20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.940+0000 7f7873d2c640 1 -- 172.21.15.91:0/2745352270 >> 172.21.15.91:0/2745352270 conn(0x7f786c06a500 msgr2=0x7f786c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.940+0000 7f7873d2c640 1 -- 172.21.15.91:0/2745352270 shutdown_connections 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.940+0000 7f7873d2c640 1 -- 172.21.15.91:0/2745352270 wait complete. 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.942+0000 7f7873d2c640 1 Processor -- start 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.942+0000 7f7873d2c640 1 -- start start 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f7873d2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f786c06d0a0 0x7f786c1edf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f7873d2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c0c3ea0 0x7f786c15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f7873d2c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f786c14fd30 0x7f786c149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f7873d2c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0bb7e0 con 0x7f786c14fd30 2023-11-27T20:42:51.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f7873d2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c1ee4c0 con 0x7f786c06d0a0 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f7873d2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0bbc70 con 0x7f786c0c3ea0 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f78722c9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f786c14fd30 0x7f786c149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f78722c9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f786c14fd30 0x7f786c149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54684/0 (socket says 172.21.15.91:54684) 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f78722c9640 1 -- 172.21.15.91:0/4248976619 learned_addr learned my addr 172.21.15.91:0/4248976619 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f78712c7640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c0c3ea0 0x7f786c15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f7871ac8640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f786c06d0a0 0x7f786c1edf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f78722c9640 1 -- 172.21.15.91:0/4248976619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c0c3ea0 msgr2=0x7f786c15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f78722c9640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c0c3ea0 0x7f786c15d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f78722c9640 1 -- 172.21.15.91:0/4248976619 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f786c06d0a0 msgr2=0x7f786c1edf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f78722c9640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f786c06d0a0 0x7f786c1edf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.943+0000 7f78722c9640 1 -- 172.21.15.91:0/4248976619 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c0094d0 con 0x7f786c14fd30 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.944+0000 7f78722c9640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f786c14fd30 0x7f786c149140 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f786400efc0 tx=0x7f786400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.944+0000 7f78627fc640 1 -- 172.21.15.91:0/4248976619 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864014480 con 0x7f786c14fd30 2023-11-27T20:42:51.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.944+0000 7f78627fc640 1 -- 172.21.15.91:0/4248976619 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786400f040 con 0x7f786c14fd30 2023-11-27T20:42:51.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.944+0000 7f78627fc640 1 -- 172.21.15.91:0/4248976619 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864014820 con 0x7f786c14fd30 2023-11-27T20:42:51.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.944+0000 7f7873d2c640 1 -- 172.21.15.91:0/4248976619 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786c14f8c0 con 0x7f786c14fd30 2023-11-27T20:42:51.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.944+0000 7f7873d2c640 1 -- 172.21.15.91:0/4248976619 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c1565d0 con 0x7f786c14fd30 2023-11-27T20:42:51.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.946+0000 7f7873d2c640 1 -- 172.21.15.91:0/4248976619 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786c0bb950 con 0x7f786c14fd30 2023-11-27T20:42:51.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.946+0000 7f78627fc640 1 -- 172.21.15.91:0/4248976619 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7864014980 con 0x7f786c14fd30 2023-11-27T20:42:51.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.947+0000 7f78627fc640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f785006b1c0 0x7f785006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:51.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.947+0000 7f78627fc640 1 -- 172.21.15.91:0/4248976619 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f786408a6b0 con 0x7f786c14fd30 2023-11-27T20:42:51.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.947+0000 7f7871ac8640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f785006b1c0 0x7f785006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:51.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.948+0000 7f7871ac8640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f785006b1c0 0x7f785006d680 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7868007fd0 tx=0x7f7868009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:51.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:51.952+0000 7f78627fc640 1 -- 172.21.15.91:0/4248976619 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f78640553e0 con 0x7f786c14fd30 2023-11-27T20:42:52.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.180+0000 7f7873d2c640 1 -- 172.21.15.91:0/4248976619 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f786c068350 con 0x7f786c14fd30 2023-11-27T20:42:52.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.181+0000 7f78627fc640 1 -- 172.21.15.91:0/4248976619 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7864058a00 con 0x7f786c14fd30 2023-11-27T20:42:52.182 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:42:52.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 -- 172.21.15.91:0/4248976619 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f785006b1c0 msgr2=0x7f785006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:52.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f785006b1c0 0x7f785006d680 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7868007fd0 tx=0x7f7868009040 comp rx=0 tx=0).stop 2023-11-27T20:42:52.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 -- 172.21.15.91:0/4248976619 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f786c14fd30 msgr2=0x7f786c149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:52.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f786c14fd30 0x7f786c149140 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f786400efc0 tx=0x7f786400c490 comp rx=0 tx=0).stop 2023-11-27T20:42:52.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 -- 172.21.15.91:0/4248976619 shutdown_connections 2023-11-27T20:42:52.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f786c14fd30 0x7f786c149140 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:52.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f786c0c3ea0 0x7f786c15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:52.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f785006b1c0 0x7f785006d680 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:52.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 --2- 172.21.15.91:0/4248976619 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f786c06d0a0 0x7f786c1edf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:52.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 -- 172.21.15.91:0/4248976619 >> 172.21.15.91:0/4248976619 conn(0x7f786c06a500 msgr2=0x7f786c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:52.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 -- 172.21.15.91:0/4248976619 shutdown_connections 2023-11-27T20:42:52.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:52.183+0000 7f7873d2c640 1 -- 172.21.15.91:0/4248976619 wait complete. 2023-11-27T20:42:52.204 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T20:42:52.204 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:42:52.204 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-27T20:42:52.204 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-27T20:42:52.204 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T20:42:52.204 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T20:42:52.204 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:42:52.204 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:42:52.204 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:42:52.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:52.204 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-27T20:42:52.265 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:42:52.265 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:42:52.265 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:42:52.265 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:52.265 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-27T20:42:52.265 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:52.266 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:42:52.266 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-27T20:42:52.266 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-27T20:42:52.266 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:42:52.266 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-27T20:42:52.266 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-27T20:42:52.266 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:42:52.266 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:42:52.267 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:42:52.267 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:42:52.267 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:42:52.267 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42286sec preferred_lft 42286sec 2023-11-27T20:42:52.267 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-27T20:42:52.267 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:52.268 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:42:52.268 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:42:52.268 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:42:52.268 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:52.268 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8479:57ff:fe06:e35b/64 scope link 2023-11-27T20:42:52.269 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:52.269 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:42:52.269 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T20:42:52.269 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::40e4:26ff:fe7f:e25/64 scope link 2023-11-27T20:42:52.269 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:42:52.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:52.271 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:42:52.365 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-27T20:42:52.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:52.370 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-27T20:42:52.425 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-27T20:42:52.425 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:42:52.425 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:42:52.425 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:42:52.425 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:42:52.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:52.426 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:42:52.426 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:42:52.426 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:42:52.426 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:42:52.427 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:42:52.427 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:42:52.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:52.610 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-27T20:42:52.662 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-27T20:42:52.663 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:42:52.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:52.663 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-11-27T20:42:52.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:42:52.759 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-27T20:42:52.816 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:42:52.816 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:42:52.816 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:42:52.870 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:42:52.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:52.870 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:42:53.009 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:42:53.010 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:42:53.010 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:42:53.032 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:42:53.033 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:42:53.033 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:42:53.033 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:42:53.033 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:42:53.061 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:42:53.061 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:42:53.061 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:42:53.061 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:42:53.061 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:42:53.061 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:42:53.062 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:42:53.062 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:42:53.066 INFO:teuthology.orchestra.run.smithi183.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-27T20:42:53.066 INFO:teuthology.orchestra.run.smithi183.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:42:53.066 INFO:teuthology.orchestra.run.smithi183.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:42:53.066 INFO:teuthology.orchestra.run.smithi183.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:42:53.066 INFO:teuthology.orchestra.run.smithi183.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:42:53.070 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:42:53.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:53.071 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:42:53.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:42:53.161 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:42:53.216 INFO:teuthology.orchestra.run.smithi183.stdout:client4783 2023-11-27T20:42:53.216 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:42:53.216 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:42:53.265 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-27T20:42:53.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.490+0000 7f19b9b0d640 1 Processor -- start 2023-11-27T20:42:53.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.490+0000 7f19b9b0d640 1 -- start start 2023-11-27T20:42:53.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.492+0000 7f19b9b0d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f19b4155f60 0x7f19b40c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:53.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.492+0000 7f19b9b0d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19b40c1100 0x7f19b415c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:53.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.492+0000 7f19b9b0d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b4159800 con 0x7f19b406e000 2023-11-27T20:42:53.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.492+0000 7f19b9b0d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b406c440 con 0x7f19b4155f60 2023-11-27T20:42:53.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.492+0000 7f19b9b0d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b4156340 con 0x7f19b40c1100 2023-11-27T20:42:53.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.492+0000 7f19b3fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f19b406e000 0x7f19b415be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:58540/0 (socket says 172.21.15.91:58540) 2023-11-27T20:42:53.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.492+0000 7f19b3fff640 1 -- 172.21.15.91:0/4065003256 learned_addr learned my addr 172.21.15.91:0/4065003256 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:53.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b930c640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19b40c1100 0x7f19b415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:53.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b8b0b640 1 --2- 172.21.15.91:0/4065003256 >> v2:172.21.15.183:3300/0 conn(0x7f19b4155f60 0x7f19b40c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:53.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548208386 0 0) 0x7f19b4159800 con 0x7f19b406e000 2023-11-27T20:42:53.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c003520 con 0x7f19b406e000 2023-11-27T20:42:53.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 404543098 0 0) 0x7f199c003520 con 0x7f19b406e000 2023-11-27T20:42:53.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19b40c1100 msgr2=0x7f19b415c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:53.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19b40c1100 0x7f19b415c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 >> v2:172.21.15.183:3300/0 conn(0x7f19b4155f60 msgr2=0x7f19b40c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:53.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 --2- 172.21.15.91:0/4065003256 >> v2:172.21.15.183:3300/0 conn(0x7f19b4155f60 0x7f19b40c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4158a40 con 0x7f19b406e000 2023-11-27T20:42:53.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f19a4001670 con 0x7f19b406e000 2023-11-27T20:42:53.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 >> v1:172.21.15.91:6789/0 conn(0x7f19b406e000 legacy=0x7f19b415be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:53.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19b40c1100 0x7f199c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:53.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f199c003f40 0x7f199c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:53.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f199c004d00 0x7f199c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:53.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b406c440 con 0x7f199c003f40 2023-11-27T20:42:53.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c00b980 con 0x7f199c004d00 2023-11-27T20:42:53.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.493+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c00bac0 con 0x7f19b40c1100 2023-11-27T20:42:53.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.494+0000 7f19b3fff640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f199c003f40 0x7f199c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:53.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.494+0000 7f19b8b0b640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19b40c1100 0x7f199c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:53.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.494+0000 7f19b930c640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f199c004d00 0x7f199c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:53.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.494+0000 7f19b3fff640 1 -- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19b40c1100 msgr2=0x7f199c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:53.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.494+0000 7f19b3fff640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19b40c1100 0x7f199c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.494+0000 7f19b3fff640 1 -- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f199c004d00 msgr2=0x7f199c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:53.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.494+0000 7f19b3fff640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f199c004d00 0x7f199c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.494+0000 7f19b3fff640 1 -- 172.21.15.91:0/4065003256 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c003520 con 0x7f199c003f40 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.495+0000 7f19b3fff640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f199c003f40 0x7f199c0047c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c140 tx=0x7f199c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7026f5fadb2446d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.495+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4005ad0 con 0x7f199c003f40 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.495+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4005c50 con 0x7f199c003f40 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.495+0000 7f19b37fe640 1 -- 172.21.15.91:0/4065003256 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a402c810 con 0x7f199c003f40 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.496+0000 7f19b9b0d640 1 -- 172.21.15.91:0/4065003256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f199c003f40 msgr2=0x7f199c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.496+0000 7f19b9b0d640 1 --2- 172.21.15.91:0/4065003256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f199c003f40 0x7f199c0047c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c140 tx=0x7f199c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.496+0000 7f19b930c640 1 -- 172.21.15.91:0/4065003256 reap_dead start 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.496+0000 7f19b9b0d640 1 -- 172.21.15.91:0/4065003256 shutdown_connections 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.496+0000 7f19b9b0d640 1 -- 172.21.15.91:0/4065003256 >> 172.21.15.91:0/4065003256 conn(0x7f19b40a77f0 msgr2=0x7f19b40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.496+0000 7f19b9b0d640 1 -- 172.21.15.91:0/4065003256 shutdown_connections 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.496+0000 7f19b9b0d640 1 -- 172.21.15.91:0/4065003256 wait complete. 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.498+0000 7f19b9b0d640 1 Processor -- start 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.498+0000 7f19b9b0d640 1 -- start start 2023-11-27T20:42:53.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.499+0000 7f19b9b0d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199c003f40 0x7f19b41edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.499+0000 7f19b9b0d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19b415b060 0x7f19b415c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.499+0000 7f19b9b0d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19b40a2c80 0x7f19b40ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.499+0000 7f19b9b0d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40a4f80 con 0x7f19b40a2c80 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.499+0000 7f19b9b0d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b415b4e0 con 0x7f19b415b060 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.499+0000 7f19b9b0d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40a53f0 con 0x7f199c003f40 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.499+0000 7f19b930c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19b40a2c80 0x7f19b40ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.499+0000 7f19b930c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19b40a2c80 0x7f19b40ab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54702/0 (socket says 172.21.15.91:54702) 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.499+0000 7f19b930c640 1 -- 172.21.15.91:0/3044457322 learned_addr learned my addr 172.21.15.91:0/3044457322 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b930c640 1 -- 172.21.15.91:0/3044457322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199c003f40 msgr2=0x7f19b41edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b930c640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199c003f40 0x7f19b41edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b930c640 1 -- 172.21.15.91:0/3044457322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19b415b060 msgr2=0x7f19b415c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:53.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b930c640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19b415b060 0x7f19b415c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b930c640 1 -- 172.21.15.91:0/3044457322 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4159fc0 con 0x7f19b40a2c80 2023-11-27T20:42:53.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b930c640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19b40a2c80 0x7f19b40ab3f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f19b415cee0 tx=0x7f19ac0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:53.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b17fa640 1 -- 172.21.15.91:0/3044457322 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00e070 con 0x7f19b40a2c80 2023-11-27T20:42:53.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b17fa640 1 -- 172.21.15.91:0/3044457322 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac011e40 con 0x7f19b40a2c80 2023-11-27T20:42:53.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b17fa640 1 -- 172.21.15.91:0/3044457322 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac003990 con 0x7f19b40a2c80 2023-11-27T20:42:53.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b9b0d640 1 -- 172.21.15.91:0/3044457322 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b415a2a0 con 0x7f19b40a2c80 2023-11-27T20:42:53.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.500+0000 7f19b9b0d640 1 -- 172.21.15.91:0/3044457322 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b415a860 con 0x7f19b40a2c80 2023-11-27T20:42:53.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.501+0000 7f19b9b0d640 1 -- 172.21.15.91:0/3044457322 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b404e840 con 0x7f19b40a2c80 2023-11-27T20:42:53.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.502+0000 7f19b17fa640 1 -- 172.21.15.91:0/3044457322 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f19ac003af0 con 0x7f19b40a2c80 2023-11-27T20:42:53.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.503+0000 7f19b17fa640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19a006b1f0 0x7f19a006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:53.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.504+0000 7f19b17fa640 1 -- 172.21.15.91:0/3044457322 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19ac089fc0 con 0x7f19b40a2c80 2023-11-27T20:42:53.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.504+0000 7f19b8b0b640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19a006b1f0 0x7f19a006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:53.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.504+0000 7f19b8b0b640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19a006b1f0 0x7f19a006d6b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009990 tx=0x7f19a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:53.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.508+0000 7f19b17fa640 1 -- 172.21.15.91:0/3044457322 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f19ac054c50 con 0x7f19b40a2c80 2023-11-27T20:42:53.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.769+0000 7f19b9b0d640 1 -- 172.21.15.91:0/3044457322 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f19b40c5750 con 0x7f19b40a2c80 2023-11-27T20:42:53.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.770+0000 7f19b17fa640 1 -- 172.21.15.91:0/3044457322 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v15) v1 ==== 84+0+0 (secure 0 0 0) 0x7f19ac058270 con 0x7f19b40a2c80 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 -- 172.21.15.91:0/3044457322 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19a006b1f0 msgr2=0x7f19a006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19a006b1f0 0x7f19a006d6b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009990 tx=0x7f19a8008040 comp rx=0 tx=0).stop 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 -- 172.21.15.91:0/3044457322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19b40a2c80 msgr2=0x7f19b40ab3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19b40a2c80 0x7f19b40ab3f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f19b415cee0 tx=0x7f19ac0115a0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 -- 172.21.15.91:0/3044457322 shutdown_connections 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19b40a2c80 0x7f19b40ab3f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f19a006b1f0 0x7f19a006d6b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19b415b060 0x7f19b415c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 --2- 172.21.15.91:0/3044457322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199c003f40 0x7f19b41edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 -- 172.21.15.91:0/3044457322 >> 172.21.15.91:0/3044457322 conn(0x7f19b40a77f0 msgr2=0x7f19b40c49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 -- 172.21.15.91:0/3044457322 shutdown_connections 2023-11-27T20:42:53.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:53.773+0000 7f19b9b0d640 1 -- 172.21.15.91:0/3044457322 wait complete. 2023-11-27T20:42:53.792 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:54.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.004+0000 7f16f3d48640 1 Processor -- start 2023-11-27T20:42:54.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.004+0000 7f16f3d48640 1 -- start start 2023-11-27T20:42:54.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.006+0000 7f16f3d48640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f16ec14fd30 0x7f16ec152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.006+0000 7f16f3d48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec0c3ea0 0x7f16ec0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.006+0000 7f16f3d48640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec0c64a0 con 0x7f16ec06d0a0 2023-11-27T20:42:54.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.006+0000 7f16f3d48640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec0c5c00 con 0x7f16ec14fd30 2023-11-27T20:42:54.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.006+0000 7f16f3d48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec0c5ee0 con 0x7f16ec0c3ea0 2023-11-27T20:42:54.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.006+0000 7f16f22e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec0c3ea0 0x7f16ec0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.006+0000 7f16f1ae4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f16ec14fd30 0x7f16ec152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.007+0000 7f16f22e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec0c3ea0 0x7f16ec0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:58290/0 (socket says 172.21.15.91:58290) 2023-11-27T20:42:54.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.007+0000 7f16f22e5640 1 -- 172.21.15.91:0/1793214024 learned_addr learned my addr 172.21.15.91:0/1793214024 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:54.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.007+0000 7f16f1ae4640 1 -- 172.21.15.91:0/1793214024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec0c3ea0 msgr2=0x7f16ec0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:54.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.007+0000 7f16f1ae4640 1 --2- 172.21.15.91:0/1793214024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec0c3ea0 0x7f16ec0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.007+0000 7f16f1ae4640 1 -- 172.21.15.91:0/1793214024 >> v1:172.21.15.183:6789/0 conn(0x7f16ec06d0a0 legacy=0x7f16ec0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.007+0000 7f16f1ae4640 1 -- 172.21.15.91:0/1793214024 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0c61c0 con 0x7f16ec14fd30 2023-11-27T20:42:54.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.007+0000 7f16f22e5640 1 --2- 172.21.15.91:0/1793214024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec0c3ea0 0x7f16ec0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:42:54.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.009+0000 7f16f1ae4640 1 --2- 172.21.15.91:0/1793214024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16ec14fd30 0x7f16ec152f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16e80097a0 tx=0x7f16e802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=682a972467a91125 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:54.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.009+0000 7f16f0ae2640 1 -- 172.21.15.91:0/1793214024 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e802d040 con 0x7f16ec14fd30 2023-11-27T20:42:54.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.009+0000 7f16f0ae2640 1 -- 172.21.15.91:0/1793214024 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e8031810 con 0x7f16ec14fd30 2023-11-27T20:42:54.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.009+0000 7f16f0ae2640 1 -- 172.21.15.91:0/1793214024 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8031ba0 con 0x7f16ec14fd30 2023-11-27T20:42:54.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.010+0000 7f16f3d48640 1 -- 172.21.15.91:0/1793214024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16ec14fd30 msgr2=0x7f16ec152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.010+0000 7f16f3d48640 1 --2- 172.21.15.91:0/1793214024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16ec14fd30 0x7f16ec152f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16e80097a0 tx=0x7f16e802b8b0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.010+0000 7f16f3d48640 1 -- 172.21.15.91:0/1793214024 shutdown_connections 2023-11-27T20:42:54.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.010+0000 7f16f3d48640 1 --2- 172.21.15.91:0/1793214024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec0c3ea0 0x7f16ec0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.010+0000 7f16f3d48640 1 --2- 172.21.15.91:0/1793214024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16ec14fd30 0x7f16ec152f20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.010+0000 7f16f3d48640 1 -- 172.21.15.91:0/1793214024 >> 172.21.15.91:0/1793214024 conn(0x7f16ec06a500 msgr2=0x7f16ec06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:54.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.010+0000 7f16f3d48640 1 -- 172.21.15.91:0/1793214024 shutdown_connections 2023-11-27T20:42:54.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.010+0000 7f16f3d48640 1 -- 172.21.15.91:0/1793214024 wait complete. 2023-11-27T20:42:54.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.012+0000 7f16f3d48640 1 Processor -- start 2023-11-27T20:42:54.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.012+0000 7f16f3d48640 1 -- start start 2023-11-27T20:42:54.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f3d48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec06d0a0 0x7f16ec14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f3d48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16ec0c3ea0 0x7f16ec155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f3d48640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16ec14fd30 0x7f16ec1ea140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f3d48640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec1dcc60 con 0x7f16ec14fd30 2023-11-27T20:42:54.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f3d48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec1dbde0 con 0x7f16ec0c3ea0 2023-11-27T20:42:54.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f3d48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec1ee4c0 con 0x7f16ec06d0a0 2023-11-27T20:42:54.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f22e5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16ec14fd30 0x7f16ec1ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f22e5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16ec14fd30 0x7f16ec1ea140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35342/0 (socket says 172.21.15.91:35342) 2023-11-27T20:42:54.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f22e5640 1 -- 172.21.15.91:0/219808021 learned_addr learned my addr 172.21.15.91:0/219808021 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f1ae4640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec06d0a0 0x7f16ec14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f12e3640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16ec0c3ea0 0x7f16ec155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f22e5640 1 -- 172.21.15.91:0/219808021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec06d0a0 msgr2=0x7f16ec14eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f22e5640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec06d0a0 0x7f16ec14eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f22e5640 1 -- 172.21.15.91:0/219808021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16ec0c3ea0 msgr2=0x7f16ec155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f22e5640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16ec0c3ea0 0x7f16ec155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.014+0000 7f16f22e5640 1 -- 172.21.15.91:0/219808021 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4009b30 con 0x7f16ec14fd30 2023-11-27T20:42:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.015+0000 7f16f1ae4640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec06d0a0 0x7f16ec14eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:54.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.015+0000 7f16f22e5640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16ec14fd30 0x7f16ec1ea140 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f16e400efc0 tx=0x7f16e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:54.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.015+0000 7f16e27fc640 1 -- 172.21.15.91:0/219808021 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4018070 con 0x7f16ec14fd30 2023-11-27T20:42:54.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.015+0000 7f16e27fc640 1 -- 172.21.15.91:0/219808021 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e400f040 con 0x7f16ec14fd30 2023-11-27T20:42:54.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.015+0000 7f16f3d48640 1 -- 172.21.15.91:0/219808021 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e8009400 con 0x7f16ec14fd30 2023-11-27T20:42:54.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.015+0000 7f16e27fc640 1 -- 172.21.15.91:0/219808021 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e400ce00 con 0x7f16ec14fd30 2023-11-27T20:42:54.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.015+0000 7f16f3d48640 1 -- 172.21.15.91:0/219808021 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec0aaa80 con 0x7f16ec14fd30 2023-11-27T20:42:54.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.016+0000 7f16f3d48640 1 -- 172.21.15.91:0/219808021 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec072960 con 0x7f16ec14fd30 2023-11-27T20:42:54.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.017+0000 7f16e27fc640 1 -- 172.21.15.91:0/219808021 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f16e4014480 con 0x7f16ec14fd30 2023-11-27T20:42:54.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.018+0000 7f16e27fc640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f16d006b1c0 0x7f16d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.018+0000 7f16e27fc640 1 -- 172.21.15.91:0/219808021 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16e4089d70 con 0x7f16ec14fd30 2023-11-27T20:42:54.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.018+0000 7f16f1ae4640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f16d006b1c0 0x7f16d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.019+0000 7f16f1ae4640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f16d006b1c0 0x7f16d006d680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16e8036000 tx=0x7f16e803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:54.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.023+0000 7f16e27fc640 1 -- 172.21.15.91:0/219808021 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f16ec072960 con 0x7f16ec14fd30 2023-11-27T20:42:54.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.210+0000 7f16f3d48640 1 -- 172.21.15.91:0/219808021 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16ec072960 con 0x7f16ec14fd30 2023-11-27T20:42:54.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.212+0000 7f16e27fc640 1 -- 172.21.15.91:0/219808021 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f16ec072960 con 0x7f16ec14fd30 2023-11-27T20:42:54.214 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:54.214 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":34,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:42:39.530533+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:54.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 -- 172.21.15.91:0/219808021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f16d006b1c0 msgr2=0x7f16d006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f16d006b1c0 0x7f16d006d680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16e8036000 tx=0x7f16e803c040 comp rx=0 tx=0).stop 2023-11-27T20:42:54.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 -- 172.21.15.91:0/219808021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16ec14fd30 msgr2=0x7f16ec1ea140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16ec14fd30 0x7f16ec1ea140 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f16e400efc0 tx=0x7f16e400c490 comp rx=0 tx=0).stop 2023-11-27T20:42:54.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 -- 172.21.15.91:0/219808021 shutdown_connections 2023-11-27T20:42:54.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16ec14fd30 0x7f16ec1ea140 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f16d006b1c0 0x7f16d006d680 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16ec0c3ea0 0x7f16ec155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 --2- 172.21.15.91:0/219808021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16ec06d0a0 0x7f16ec14eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 -- 172.21.15.91:0/219808021 >> 172.21.15.91:0/219808021 conn(0x7f16ec06a500 msgr2=0x7f16ec0c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:54.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 -- 172.21.15.91:0/219808021 shutdown_connections 2023-11-27T20:42:54.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.215+0000 7f16f3d48640 1 -- 172.21.15.91:0/219808021 wait complete. 2023-11-27T20:42:54.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:42:35.743447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:42:36.976231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:42:54.234 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:42:54.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.450+0000 7fc403153640 1 Processor -- start 2023-11-27T20:42:54.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.450+0000 7fc403153640 1 -- start start 2023-11-27T20:42:54.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.451+0000 7fc403153640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0c5ec0 0x7fc3fc0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.451+0000 7fc403153640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc3fc0c45d0 0x7fc3fc0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.451+0000 7fc403153640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3fc0bfdc0 con 0x7fc3fc0721a0 2023-11-27T20:42:54.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.452+0000 7fc403153640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc06e390 con 0x7fc3fc0c45d0 2023-11-27T20:42:54.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.452+0000 7fc403153640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc06ddd0 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.452+0000 7fc3fbfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc3fc0c45d0 0x7fc3fc0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.452+0000 7fc3fbfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc3fc0c45d0 0x7fc3fc0c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35348/0 (socket says 172.21.15.91:35348) 2023-11-27T20:42:54.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.452+0000 7fc3fbfff640 1 -- 172.21.15.91:0/490401389 learned_addr learned my addr 172.21.15.91:0/490401389 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:54.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.452+0000 7fc400eef640 1 --2- 172.21.15.91:0/490401389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0c5ec0 0x7fc3fc0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.452+0000 7fc3fbfff640 1 -- 172.21.15.91:0/490401389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0c5ec0 msgr2=0x7fc3fc0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:54.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.452+0000 7fc3fbfff640 1 --2- 172.21.15.91:0/490401389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0c5ec0 0x7fc3fc0c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.452+0000 7fc3fbfff640 1 -- 172.21.15.91:0/490401389 >> v1:172.21.15.183:6789/0 conn(0x7fc3fc0721a0 legacy=0x7fc3fc155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:54.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.452+0000 7fc3fbfff640 1 -- 172.21.15.91:0/490401389 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc06e0b0 con 0x7fc3fc0c45d0 2023-11-27T20:42:54.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.453+0000 7fc3fbfff640 1 --2- 172.21.15.91:0/490401389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c45d0 0x7fc3fc0c3170 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009870 tx=0x7fc3e802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50981f5d2438c10 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:54.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.454+0000 7fc3fb7fe640 1 -- 172.21.15.91:0/490401389 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8031740 con 0x7fc3fc0c45d0 2023-11-27T20:42:54.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.454+0000 7fc3fb7fe640 1 -- 172.21.15.91:0/490401389 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e80318a0 con 0x7fc3fc0c45d0 2023-11-27T20:42:54.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.454+0000 7fc3fb7fe640 1 -- 172.21.15.91:0/490401389 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8031c30 con 0x7fc3fc0c45d0 2023-11-27T20:42:54.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.454+0000 7fc403153640 1 -- 172.21.15.91:0/490401389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c45d0 msgr2=0x7fc3fc0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.454+0000 7fc403153640 1 --2- 172.21.15.91:0/490401389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c45d0 0x7fc3fc0c3170 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009870 tx=0x7fc3e802b7e0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.454+0000 7fc403153640 1 -- 172.21.15.91:0/490401389 shutdown_connections 2023-11-27T20:42:54.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.454+0000 7fc403153640 1 --2- 172.21.15.91:0/490401389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c45d0 0x7fc3fc0c3170 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.454+0000 7fc403153640 1 --2- 172.21.15.91:0/490401389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0c5ec0 0x7fc3fc0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.454+0000 7fc403153640 1 -- 172.21.15.91:0/490401389 >> 172.21.15.91:0/490401389 conn(0x7fc3fc06a500 msgr2=0x7fc3fc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:54.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.455+0000 7fc403153640 1 -- 172.21.15.91:0/490401389 shutdown_connections 2023-11-27T20:42:54.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.455+0000 7fc403153640 1 -- 172.21.15.91:0/490401389 wait complete. 2023-11-27T20:42:54.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.456+0000 7fc403153640 1 Processor -- start 2023-11-27T20:42:54.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.456+0000 7fc403153640 1 -- start start 2023-11-27T20:42:54.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.457+0000 7fc403153640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0721a0 0x7fc3fc1ede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.457+0000 7fc403153640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3fc0c45d0 0x7fc3fc1e7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.457+0000 7fc403153640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c5ec0 0x7fc3fc157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.457+0000 7fc403153640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc156c70 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.457+0000 7fc403153640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0a8560 con 0x7fc3fc0c45d0 2023-11-27T20:42:54.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.457+0000 7fc403153640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc1ed3b0 con 0x7fc3fc0721a0 2023-11-27T20:42:54.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.457+0000 7fc4016f0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c5ec0 0x7fc3fc157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.457+0000 7fc4016f0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c5ec0 0x7fc3fc157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35358/0 (socket says 172.21.15.91:35358) 2023-11-27T20:42:54.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.457+0000 7fc4016f0640 1 -- 172.21.15.91:0/1834569990 learned_addr learned my addr 172.21.15.91:0/1834569990 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc400eef640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0721a0 0x7fc3fc1ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc4016f0640 1 -- 172.21.15.91:0/1834569990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0721a0 msgr2=0x7fc3fc1ede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc4016f0640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0721a0 0x7fc3fc1ede50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc3fbfff640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3fc0c45d0 0x7fc3fc1e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc4016f0640 1 -- 172.21.15.91:0/1834569990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3fc0c45d0 msgr2=0x7fc3fc1e7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc4016f0640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3fc0c45d0 0x7fc3fc1e7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc4016f0640 1 -- 172.21.15.91:0/1834569990 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80094d0 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc400eef640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0721a0 0x7fc3fc1ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc3fbfff640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3fc0c45d0 0x7fc3fc1e7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc4016f0640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c5ec0 0x7fc3fc157a80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c780 tx=0x7fc3f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc3f97fa640 1 -- 172.21.15.91:0/1834569990 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4004b60 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.458+0000 7fc3f97fa640 1 -- 172.21.15.91:0/1834569990 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f400ce90 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.459+0000 7fc3f97fa640 1 -- 172.21.15.91:0/1834569990 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400a850 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.459+0000 7fc403153640 1 -- 172.21.15.91:0/1834569990 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc1ed650 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.459+0000 7fc403153640 1 -- 172.21.15.91:0/1834569990 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc0a8800 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.460+0000 7fc403153640 1 -- 172.21.15.91:0/1834569990 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3fc1edb70 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.461+0000 7fc3f97fa640 1 -- 172.21.15.91:0/1834569990 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc3f400a9b0 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.462+0000 7fc3f97fa640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1c0 0x7fc3e006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.462+0000 7fc3f97fa640 1 -- 172.21.15.91:0/1834569990 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3f4089c80 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.462+0000 7fc400eef640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1c0 0x7fc3e006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.463+0000 7fc400eef640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1c0 0x7fc3e006d680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000b820 tx=0x7fc3f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:54.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.466+0000 7fc3f97fa640 1 -- 172.21.15.91:0/1834569990 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc3fc1edb70 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.662+0000 7fc403153640 1 -- 172.21.15.91:0/1834569990 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3fc1edb70 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.663+0000 7fc3f97fa640 1 -- 172.21.15.91:0/1834569990 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3fc1edb70 con 0x7fc3fc0c5ec0 2023-11-27T20:42:54.665 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:42:54.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 -- 172.21.15.91:0/1834569990 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1c0 msgr2=0x7fc3e006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1c0 0x7fc3e006d680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000b820 tx=0x7fc3f0008040 comp rx=0 tx=0).stop 2023-11-27T20:42:54.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 -- 172.21.15.91:0/1834569990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c5ec0 msgr2=0x7fc3fc157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c5ec0 0x7fc3fc157a80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c780 tx=0x7fc3f400cc40 comp rx=0 tx=0).stop 2023-11-27T20:42:54.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 -- 172.21.15.91:0/1834569990 shutdown_connections 2023-11-27T20:42:54.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0c5ec0 0x7fc3fc157a80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc3e006b1c0 0x7fc3e006d680 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3fc0c45d0 0x7fc3fc1e7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 --2- 172.21.15.91:0/1834569990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3fc0721a0 0x7fc3fc1ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 -- 172.21.15.91:0/1834569990 >> 172.21.15.91:0/1834569990 conn(0x7fc3fc06a500 msgr2=0x7fc3fc0715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:54.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 -- 172.21.15.91:0/1834569990 shutdown_connections 2023-11-27T20:42:54.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.666+0000 7fc403153640 1 -- 172.21.15.91:0/1834569990 wait complete. 2023-11-27T20:42:54.685 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:42:54.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.898+0000 7f155b209640 1 Processor -- start 2023-11-27T20:42:54.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.898+0000 7f155b209640 1 -- start start 2023-11-27T20:42:54.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.899+0000 7f155b209640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f155414fd30 0x7f1554152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.899+0000 7f155b209640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f155406d0a0 0x7f15540a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.900+0000 7f155b209640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15540c64a0 con 0x7f15540a5260 2023-11-27T20:42:54.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.900+0000 7f155b209640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15540c5c00 con 0x7f155406d0a0 2023-11-27T20:42:54.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.900+0000 7f155b209640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540c5ee0 con 0x7f155414fd30 2023-11-27T20:42:54.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.900+0000 7f1553fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f155406d0a0 0x7f15540a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.900+0000 7f1553fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f155406d0a0 0x7f15540a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35368/0 (socket says 172.21.15.91:35368) 2023-11-27T20:42:54.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.900+0000 7f1553fff640 1 -- 172.21.15.91:0/3260104294 learned_addr learned my addr 172.21.15.91:0/3260104294 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:54.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.900+0000 7f1553fff640 1 -- 172.21.15.91:0/3260104294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f155414fd30 msgr2=0x7f1554152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:54.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.900+0000 7f1553fff640 1 --2- 172.21.15.91:0/3260104294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f155414fd30 0x7f1554152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.900+0000 7f1553fff640 1 -- 172.21.15.91:0/3260104294 >> v1:172.21.15.183:6789/0 conn(0x7f15540a5260 legacy=0x7f15540c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:54.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.900+0000 7f1553fff640 1 -- 172.21.15.91:0/3260104294 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540c61c0 con 0x7f155406d0a0 2023-11-27T20:42:54.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.901+0000 7f1553fff640 1 --2- 172.21.15.91:0/3260104294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155406d0a0 0x7f15540a4d20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1540009870 tx=0x7f154002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8857e14661e5e03 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:54.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.902+0000 7f15537fe640 1 -- 172.21.15.91:0/3260104294 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540031640 con 0x7f155406d0a0 2023-11-27T20:42:54.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.902+0000 7f15537fe640 1 -- 172.21.15.91:0/3260104294 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15400317a0 con 0x7f155406d0a0 2023-11-27T20:42:54.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.902+0000 7f15537fe640 1 -- 172.21.15.91:0/3260104294 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540031b30 con 0x7f155406d0a0 2023-11-27T20:42:54.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.902+0000 7f155b209640 1 -- 172.21.15.91:0/3260104294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155406d0a0 msgr2=0x7f15540a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.902+0000 7f155b209640 1 --2- 172.21.15.91:0/3260104294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155406d0a0 0x7f15540a4d20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1540009870 tx=0x7f154002b8f0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.903+0000 7f155b209640 1 -- 172.21.15.91:0/3260104294 shutdown_connections 2023-11-27T20:42:54.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.903+0000 7f155b209640 1 --2- 172.21.15.91:0/3260104294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155406d0a0 0x7f15540a4d20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.903+0000 7f155b209640 1 --2- 172.21.15.91:0/3260104294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f155414fd30 0x7f1554152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.903+0000 7f155b209640 1 -- 172.21.15.91:0/3260104294 >> 172.21.15.91:0/3260104294 conn(0x7f155406a500 msgr2=0x7f155406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:54.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.903+0000 7f155b209640 1 -- 172.21.15.91:0/3260104294 shutdown_connections 2023-11-27T20:42:54.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.903+0000 7f155b209640 1 -- 172.21.15.91:0/3260104294 wait complete. 2023-11-27T20:42:54.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.904+0000 7f155b209640 1 Processor -- start 2023-11-27T20:42:54.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.905+0000 7f155b209640 1 -- start start 2023-11-27T20:42:54.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.905+0000 7f155b209640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f155406d0a0 0x7f155414aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f155b209640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15540a5260 0x7f15540bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f155b209640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155414fd30 0x7f15541ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f155b209640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15541de560 con 0x7f155414fd30 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f155b209640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15541508c0 con 0x7f15540a5260 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f155b209640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540aa1a0 con 0x7f155406d0a0 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f15597a6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155414fd30 0x7f15541ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f15597a6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155414fd30 0x7f15541ed9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35372/0 (socket says 172.21.15.91:35372) 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f15597a6640 1 -- 172.21.15.91:0/360871907 learned_addr learned my addr 172.21.15.91:0/360871907 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f1558fa5640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f155406d0a0 0x7f155414aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f1553fff640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15540a5260 0x7f15540bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f15597a6640 1 -- 172.21.15.91:0/360871907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f155406d0a0 msgr2=0x7f155414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f15597a6640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f155406d0a0 0x7f155414aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f15597a6640 1 -- 172.21.15.91:0/360871907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15540a5260 msgr2=0x7f15540bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f15597a6640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15540a5260 0x7f15540bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f15597a6640 1 -- 172.21.15.91:0/360871907 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15400094d0 con 0x7f155414fd30 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.906+0000 7f1553fff640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15540a5260 0x7f15540bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.907+0000 7f15597a6640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155414fd30 0x7f15541ed9c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f154c00c780 tx=0x7f154c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.907+0000 7f15517fa640 1 -- 172.21.15.91:0/360871907 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c003d80 con 0x7f155414fd30 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.907+0000 7f15517fa640 1 -- 172.21.15.91:0/360871907 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c00ce90 con 0x7f155414fd30 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.907+0000 7f15517fa640 1 -- 172.21.15.91:0/360871907 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c0052b0 con 0x7f155414fd30 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.907+0000 7f155b209640 1 -- 172.21.15.91:0/360871907 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15541529f0 con 0x7f155414fd30 2023-11-27T20:42:54.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.907+0000 7f155b209640 1 -- 172.21.15.91:0/360871907 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15541dbc00 con 0x7f155414fd30 2023-11-27T20:42:54.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.908+0000 7f155b209640 1 -- 172.21.15.91:0/360871907 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1554068350 con 0x7f155414fd30 2023-11-27T20:42:54.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.909+0000 7f15517fa640 1 -- 172.21.15.91:0/360871907 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f154c005410 con 0x7f155414fd30 2023-11-27T20:42:54.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.911+0000 7f15517fa640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f153806b1c0 0x7f153806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:54.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.911+0000 7f15517fa640 1 -- 172.21.15.91:0/360871907 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f154c088f00 con 0x7f155414fd30 2023-11-27T20:42:54.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.911+0000 7f1558fa5640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f153806b1c0 0x7f153806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:54.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.912+0000 7f1558fa5640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f153806b1c0 0x7f153806d680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f154800b810 tx=0x7f1548008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:54.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:54.915+0000 7f15517fa640 1 -- 172.21.15.91:0/360871907 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f154c053c20 con 0x7f155414fd30 2023-11-27T20:42:55.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.099+0000 7f155b209640 1 -- 172.21.15.91:0/360871907 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f155406dcf0 con 0x7f155414fd30 2023-11-27T20:42:55.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.100+0000 7f15517fa640 1 -- 172.21.15.91:0/360871907 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f154c0170a0 con 0x7f155414fd30 2023-11-27T20:42:55.101 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:42:55.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.102+0000 7f155b209640 1 -- 172.21.15.91:0/360871907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f153806b1c0 msgr2=0x7f153806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.102+0000 7f155b209640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f153806b1c0 0x7f153806d680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f154800b810 tx=0x7f1548008040 comp rx=0 tx=0).stop 2023-11-27T20:42:55.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.102+0000 7f155b209640 1 -- 172.21.15.91:0/360871907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155414fd30 msgr2=0x7f15541ed9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.102+0000 7f155b209640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155414fd30 0x7f15541ed9c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f154c00c780 tx=0x7f154c00cc40 comp rx=0 tx=0).stop 2023-11-27T20:42:55.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.102+0000 7f155b209640 1 -- 172.21.15.91:0/360871907 shutdown_connections 2023-11-27T20:42:55.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.102+0000 7f155b209640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f155414fd30 0x7f15541ed9c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.102+0000 7f155b209640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f153806b1c0 0x7f153806d680 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.102+0000 7f155b209640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15540a5260 0x7f15540bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.102+0000 7f155b209640 1 --2- 172.21.15.91:0/360871907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f155406d0a0 0x7f155414aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.103+0000 7f155b209640 1 -- 172.21.15.91:0/360871907 >> 172.21.15.91:0/360871907 conn(0x7f155406a500 msgr2=0x7f15540c2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:55.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.103+0000 7f155b209640 1 -- 172.21.15.91:0/360871907 shutdown_connections 2023-11-27T20:42:55.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.103+0000 7f155b209640 1 -- 172.21.15.91:0/360871907 wait complete. 2023-11-27T20:42:55.123 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:42:55.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.332+0000 7fd90e3a5640 1 Processor -- start 2023-11-27T20:42:55.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.332+0000 7fd90e3a5640 1 -- start start 2023-11-27T20:42:55.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.333+0000 7fd90e3a5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd908155490 0x7fd9080a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.333+0000 7fd90e3a5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c1500 0x7fd9080a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.333+0000 7fd90e3a5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9080c06c0 con 0x7fd9080c4080 2023-11-27T20:42:55.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.333+0000 7fd90e3a5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9080a5820 con 0x7fd908155490 2023-11-27T20:42:55.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.333+0000 7fd90e3a5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080c1020 con 0x7fd9080c1500 2023-11-27T20:42:55.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.334+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c1500 0x7fd9080a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:55.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.334+0000 7fd907fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd908155490 0x7fd9080a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:55.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.334+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c1500 0x7fd9080a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:58364/0 (socket says 172.21.15.91:58364) 2023-11-27T20:42:55.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.334+0000 7fd9077fe640 1 -- 172.21.15.91:0/1793721380 learned_addr learned my addr 172.21.15.91:0/1793721380 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:55.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.334+0000 7fd9077fe640 1 -- 172.21.15.91:0/1793721380 >> v2:172.21.15.183:3300/0 conn(0x7fd908155490 msgr2=0x7fd9080a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:55.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.334+0000 7fd9077fe640 1 --2- 172.21.15.91:0/1793721380 >> v2:172.21.15.183:3300/0 conn(0x7fd908155490 0x7fd9080a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.334+0000 7fd9077fe640 1 -- 172.21.15.91:0/1793721380 >> v1:172.21.15.183:6789/0 conn(0x7fd9080c4080 legacy=0x7fd9080c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.334+0000 7fd9077fe640 1 -- 172.21.15.91:0/1793721380 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9080c0910 con 0x7fd9080c1500 2023-11-27T20:42:55.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.336+0000 7fd9077fe640 1 --2- 172.21.15.91:0/1793721380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c1500 0x7fd9080a9430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009870 tx=0x7fd8f002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ff4b09e1338d18 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:55.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.336+0000 7fd906ffd640 1 -- 172.21.15.91:0/1793721380 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0031640 con 0x7fd9080c1500 2023-11-27T20:42:55.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.336+0000 7fd906ffd640 1 -- 172.21.15.91:0/1793721380 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f00317a0 con 0x7fd9080c1500 2023-11-27T20:42:55.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.336+0000 7fd906ffd640 1 -- 172.21.15.91:0/1793721380 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0031b30 con 0x7fd9080c1500 2023-11-27T20:42:55.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.337+0000 7fd90e3a5640 1 -- 172.21.15.91:0/1793721380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c1500 msgr2=0x7fd9080a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.337+0000 7fd90e3a5640 1 --2- 172.21.15.91:0/1793721380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c1500 0x7fd9080a9430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009870 tx=0x7fd8f002b8f0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.337+0000 7fd90e3a5640 1 -- 172.21.15.91:0/1793721380 shutdown_connections 2023-11-27T20:42:55.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.337+0000 7fd90e3a5640 1 --2- 172.21.15.91:0/1793721380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c1500 0x7fd9080a9430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.337+0000 7fd90e3a5640 1 --2- 172.21.15.91:0/1793721380 >> v2:172.21.15.183:3300/0 conn(0x7fd908155490 0x7fd9080a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.337+0000 7fd90e3a5640 1 -- 172.21.15.91:0/1793721380 >> 172.21.15.91:0/1793721380 conn(0x7fd90806a500 msgr2=0x7fd90806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:55.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.337+0000 7fd90e3a5640 1 -- 172.21.15.91:0/1793721380 shutdown_connections 2023-11-27T20:42:55.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.337+0000 7fd90e3a5640 1 -- 172.21.15.91:0/1793721380 wait complete. 2023-11-27T20:42:55.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.339+0000 7fd90e3a5640 1 Processor -- start 2023-11-27T20:42:55.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.339+0000 7fd90e3a5640 1 -- start start 2023-11-27T20:42:55.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd90e3a5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9080c1500 0x7fd90814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd90e3a5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c4080 0x7fd9081ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd90e3a5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd908155490 0x7fd9081ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd90e3a5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9081501c0 con 0x7fd9080c1500 2023-11-27T20:42:55.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd90e3a5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd908150330 con 0x7fd908155490 2023-11-27T20:42:55.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd90e3a5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9081edb70 con 0x7fd9080c4080 2023-11-27T20:42:55.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd907fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9080c1500 0x7fd90814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:55.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd907fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9080c1500 0x7fd90814fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35374/0 (socket says 172.21.15.91:35374) 2023-11-27T20:42:55.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd907fff640 1 -- 172.21.15.91:0/3140848876 learned_addr learned my addr 172.21.15.91:0/3140848876 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:55.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd9077fe640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c4080 0x7fd9081ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:55.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd907fff640 1 -- 172.21.15.91:0/3140848876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c4080 msgr2=0x7fd9081ed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd907fff640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c4080 0x7fd9081ed0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.340+0000 7fd907fff640 1 -- 172.21.15.91:0/3140848876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd908155490 msgr2=0x7fd9081ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.341+0000 7fd907fff640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd908155490 0x7fd9081ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.341+0000 7fd907fff640 1 -- 172.21.15.91:0/3140848876 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00094d0 con 0x7fd9080c1500 2023-11-27T20:42:55.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.341+0000 7fd907fff640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9080c1500 0x7fd90814fc80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e8a0 tx=0x7fd8f800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:55.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.341+0000 7fd904ff9640 1 -- 172.21.15.91:0/3140848876 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80094f0 con 0x7fd9080c1500 2023-11-27T20:42:55.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.341+0000 7fd904ff9640 1 -- 172.21.15.91:0/3140848876 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f800c940 con 0x7fd9080c1500 2023-11-27T20:42:55.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.341+0000 7fd904ff9640 1 -- 172.21.15.91:0/3140848876 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800ccf0 con 0x7fd9080c1500 2023-11-27T20:42:55.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.341+0000 7fd90e3a5640 1 -- 172.21.15.91:0/3140848876 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd908150a20 con 0x7fd9080c1500 2023-11-27T20:42:55.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.341+0000 7fd90e3a5640 1 -- 172.21.15.91:0/3140848876 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9081edde0 con 0x7fd9080c1500 2023-11-27T20:42:55.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.342+0000 7fd90e3a5640 1 -- 172.21.15.91:0/3140848876 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9081507c0 con 0x7fd9080c1500 2023-11-27T20:42:55.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.343+0000 7fd904ff9640 1 -- 172.21.15.91:0/3140848876 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd8f8013470 con 0x7fd9080c1500 2023-11-27T20:42:55.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.344+0000 7fd904ff9640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd8e806b1c0 0x7fd8e806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.344+0000 7fd904ff9640 1 -- 172.21.15.91:0/3140848876 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8f8089ab0 con 0x7fd9080c1500 2023-11-27T20:42:55.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.344+0000 7fd9077fe640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd8e806b1c0 0x7fd8e806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:55.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.345+0000 7fd9077fe640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd8e806b1c0 0x7fd8e806d680 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0036000 tx=0x7fd8f003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:55.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.349+0000 7fd904ff9640 1 -- 172.21.15.91:0/3140848876 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd8f80547d0 con 0x7fd9080c1500 2023-11-27T20:42:55.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.540+0000 7fd90e3a5640 1 -- 172.21.15.91:0/3140848876 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd908068350 con 0x7fd9080c1500 2023-11-27T20:42:55.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.540+0000 7fd904ff9640 1 -- 172.21.15.91:0/3140848876 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8f80210a0 con 0x7fd9080c1500 2023-11-27T20:42:55.543 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:42:55.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 -- 172.21.15.91:0/3140848876 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd8e806b1c0 msgr2=0x7fd8e806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd8e806b1c0 0x7fd8e806d680 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0036000 tx=0x7fd8f003c040 comp rx=0 tx=0).stop 2023-11-27T20:42:55.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 -- 172.21.15.91:0/3140848876 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9080c1500 msgr2=0x7fd90814fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9080c1500 0x7fd90814fc80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e8a0 tx=0x7fd8f800ed60 comp rx=0 tx=0).stop 2023-11-27T20:42:55.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 -- 172.21.15.91:0/3140848876 shutdown_connections 2023-11-27T20:42:55.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd8e806b1c0 0x7fd8e806d680 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd908155490 0x7fd9081ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9080c4080 0x7fd9081ed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 --2- 172.21.15.91:0/3140848876 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9080c1500 0x7fd90814fc80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 -- 172.21.15.91:0/3140848876 >> 172.21.15.91:0/3140848876 conn(0x7fd90806a500 msgr2=0x7fd90806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:55.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 -- 172.21.15.91:0/3140848876 shutdown_connections 2023-11-27T20:42:55.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.543+0000 7fd90e3a5640 1 -- 172.21.15.91:0/3140848876 wait complete. 2023-11-27T20:42:55.563 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T20:42:55.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.769+0000 7fbf466ee640 1 Processor -- start 2023-11-27T20:42:55.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.769+0000 7fbf466ee640 1 -- start start 2023-11-27T20:42:55.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.770+0000 7fbf466ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf4014fd30 0x7fbf40152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.770+0000 7fbf466ee640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbf4006d0a0 0x7fbf400a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.770+0000 7fbf466ee640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400c64a0 con 0x7fbf400a5260 2023-11-27T20:42:55.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.770+0000 7fbf466ee640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf400c5c00 con 0x7fbf4006d0a0 2023-11-27T20:42:55.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.770+0000 7fbf466ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400c5ee0 con 0x7fbf4014fd30 2023-11-27T20:42:55.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.771+0000 7fbf3f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbf4006d0a0 0x7fbf400a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:55.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.771+0000 7fbf3f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbf4006d0a0 0x7fbf400a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35382/0 (socket says 172.21.15.91:35382) 2023-11-27T20:42:55.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.771+0000 7fbf3f7fe640 1 -- 172.21.15.91:0/525474146 learned_addr learned my addr 172.21.15.91:0/525474146 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:55.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.771+0000 7fbf3f7fe640 1 -- 172.21.15.91:0/525474146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf4014fd30 msgr2=0x7fbf40152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:55.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.771+0000 7fbf3f7fe640 1 --2- 172.21.15.91:0/525474146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf4014fd30 0x7fbf40152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.771+0000 7fbf3f7fe640 1 -- 172.21.15.91:0/525474146 >> v1:172.21.15.183:6789/0 conn(0x7fbf400a5260 legacy=0x7fbf400c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:55.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.771+0000 7fbf3f7fe640 1 -- 172.21.15.91:0/525474146 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400c61c0 con 0x7fbf4006d0a0 2023-11-27T20:42:55.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.772+0000 7fbf3f7fe640 1 --2- 172.21.15.91:0/525474146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 0x7fbf400a4d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009870 tx=0x7fbf2802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c4bbaa64e9935c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:55.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.773+0000 7fbf3effd640 1 -- 172.21.15.91:0/525474146 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28031640 con 0x7fbf4006d0a0 2023-11-27T20:42:55.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.773+0000 7fbf3effd640 1 -- 172.21.15.91:0/525474146 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf280317a0 con 0x7fbf4006d0a0 2023-11-27T20:42:55.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.773+0000 7fbf3effd640 1 -- 172.21.15.91:0/525474146 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28031b30 con 0x7fbf4006d0a0 2023-11-27T20:42:55.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.773+0000 7fbf466ee640 1 -- 172.21.15.91:0/525474146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 msgr2=0x7fbf400a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.773+0000 7fbf466ee640 1 --2- 172.21.15.91:0/525474146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 0x7fbf400a4d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009870 tx=0x7fbf2802b8f0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.774+0000 7fbf466ee640 1 -- 172.21.15.91:0/525474146 shutdown_connections 2023-11-27T20:42:55.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.774+0000 7fbf466ee640 1 --2- 172.21.15.91:0/525474146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 0x7fbf400a4d20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.774+0000 7fbf466ee640 1 --2- 172.21.15.91:0/525474146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf4014fd30 0x7fbf40152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.774+0000 7fbf466ee640 1 -- 172.21.15.91:0/525474146 >> 172.21.15.91:0/525474146 conn(0x7fbf4006a500 msgr2=0x7fbf4006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:55.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.774+0000 7fbf466ee640 1 -- 172.21.15.91:0/525474146 shutdown_connections 2023-11-27T20:42:55.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.774+0000 7fbf466ee640 1 -- 172.21.15.91:0/525474146 wait complete. 2023-11-27T20:42:55.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.775+0000 7fbf466ee640 1 Processor -- start 2023-11-27T20:42:55.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.775+0000 7fbf466ee640 1 -- start start 2023-11-27T20:42:55.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.776+0000 7fbf466ee640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 0x7fbf401dbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.776+0000 7fbf466ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf400a5260 0x7fbf401dda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.776+0000 7fbf466ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf4014fd30 0x7fbf401ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.776+0000 7fbf466ee640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401dd200 con 0x7fbf4006d0a0 2023-11-27T20:42:55.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.776+0000 7fbf466ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401524c0 con 0x7fbf400a5260 2023-11-27T20:42:55.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.776+0000 7fbf466ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40151690 con 0x7fbf4014fd30 2023-11-27T20:42:55.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.776+0000 7fbf3ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 0x7fbf401dbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:55.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.777+0000 7fbf3ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 0x7fbf401dbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35386/0 (socket says 172.21.15.91:35386) 2023-11-27T20:42:55.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.777+0000 7fbf3ffff640 1 -- 172.21.15.91:0/1798381647 learned_addr learned my addr 172.21.15.91:0/1798381647 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:55.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.777+0000 7fbf44c8b640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf4014fd30 0x7fbf401ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:55.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.777+0000 7fbf3ffff640 1 -- 172.21.15.91:0/1798381647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf4014fd30 msgr2=0x7fbf401ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.777+0000 7fbf3ffff640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf4014fd30 0x7fbf401ddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.777+0000 7fbf3ffff640 1 -- 172.21.15.91:0/1798381647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf400a5260 msgr2=0x7fbf401dda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:55.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.777+0000 7fbf3ffff640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf400a5260 0x7fbf401dda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:55.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.777+0000 7fbf3ffff640 1 -- 172.21.15.91:0/1798381647 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280094d0 con 0x7fbf4006d0a0 2023-11-27T20:42:55.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.777+0000 7fbf3ffff640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 0x7fbf401dbd40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000b410 tx=0x7fbf3000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:55.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.777+0000 7fbf3cff9640 1 -- 172.21.15.91:0/1798381647 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30011830 con 0x7fbf4006d0a0 2023-11-27T20:42:55.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.778+0000 7fbf3cff9640 1 -- 172.21.15.91:0/1798381647 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf300119b0 con 0x7fbf4006d0a0 2023-11-27T20:42:55.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.778+0000 7fbf3cff9640 1 -- 172.21.15.91:0/1798381647 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30011d60 con 0x7fbf4006d0a0 2023-11-27T20:42:55.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.778+0000 7fbf466ee640 1 -- 172.21.15.91:0/1798381647 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf40151900 con 0x7fbf4006d0a0 2023-11-27T20:42:55.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.778+0000 7fbf466ee640 1 -- 172.21.15.91:0/1798381647 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf40152130 con 0x7fbf4006d0a0 2023-11-27T20:42:55.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.779+0000 7fbf466ee640 1 -- 172.21.15.91:0/1798381647 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40152630 con 0x7fbf4006d0a0 2023-11-27T20:42:55.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.780+0000 7fbf3cff9640 1 -- 172.21.15.91:0/1798381647 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbf3001a400 con 0x7fbf4006d0a0 2023-11-27T20:42:55.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.780+0000 7fbf3cff9640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf2006b1c0 0x7fbf2006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:55.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.780+0000 7fbf3cff9640 1 -- 172.21.15.91:0/1798381647 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf30089ae0 con 0x7fbf4006d0a0 2023-11-27T20:42:55.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.781+0000 7fbf3f7fe640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf2006b1c0 0x7fbf2006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:55.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.781+0000 7fbf3f7fe640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf2006b1c0 0x7fbf2006d680 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf28036000 tx=0x7fbf28030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:55.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.785+0000 7fbf3cff9640 1 -- 172.21.15.91:0/1798381647 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbf300548a0 con 0x7fbf4006d0a0 2023-11-27T20:42:55.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.976+0000 7fbf466ee640 1 -- 172.21.15.91:0/1798381647 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbf40068350 con 0x7fbf4006d0a0 2023-11-27T20:42:56.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.976+0000 7fbf3cff9640 1 -- 172.21.15.91:0/1798381647 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+207 (secure 0 0 0) 0x7fbf30015020 con 0x7fbf4006d0a0 2023-11-27T20:42:56.101 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:56.101 INFO:teuthology.orchestra.run.smithi091.stdout:[ 2023-11-27T20:42:56.101 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:56.101 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 1, 2023-11-27T20:42:56.101 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": ".mgr" 2023-11-27T20:42:56.101 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:56.101 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:56.101 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 4, 2023-11-27T20:42:56.101 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": "cephfs_metadata" 2023-11-27T20:42:56.101 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:42:56.102 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:42:56.102 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 5, 2023-11-27T20:42:56.102 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": "cephfs_data" 2023-11-27T20:42:56.102 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:42:56.102 INFO:teuthology.orchestra.run.smithi091.stdout:] 2023-11-27T20:42:56.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.979+0000 7fbf466ee640 1 -- 172.21.15.91:0/1798381647 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf2006b1c0 msgr2=0x7fbf2006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:56.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.979+0000 7fbf466ee640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf2006b1c0 0x7fbf2006d680 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf28036000 tx=0x7fbf28030000 comp rx=0 tx=0).stop 2023-11-27T20:42:56.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.979+0000 7fbf466ee640 1 -- 172.21.15.91:0/1798381647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 msgr2=0x7fbf401dbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:56.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.979+0000 7fbf466ee640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 0x7fbf401dbd40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000b410 tx=0x7fbf3000b8d0 comp rx=0 tx=0).stop 2023-11-27T20:42:56.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.979+0000 7fbf466ee640 1 -- 172.21.15.91:0/1798381647 shutdown_connections 2023-11-27T20:42:56.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.979+0000 7fbf466ee640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf4014fd30 0x7fbf401ddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:56.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.979+0000 7fbf466ee640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbf2006b1c0 0x7fbf2006d680 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:56.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.979+0000 7fbf466ee640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf400a5260 0x7fbf401dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:56.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.979+0000 7fbf466ee640 1 --2- 172.21.15.91:0/1798381647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf4006d0a0 0x7fbf401dbd40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:56.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.979+0000 7fbf466ee640 1 -- 172.21.15.91:0/1798381647 >> 172.21.15.91:0/1798381647 conn(0x7fbf4006a500 msgr2=0x7fbf4006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:56.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.980+0000 7fbf466ee640 1 -- 172.21.15.91:0/1798381647 shutdown_connections 2023-11-27T20:42:56.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:55.980+0000 7fbf466ee640 1 -- 172.21.15.91:0/1798381647 wait complete. 2023-11-27T20:42:56.104 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-27T20:42:56.104 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-27T20:42:56.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.331+0000 7f19c0e2b640 1 Processor -- start 2023-11-27T20:42:56.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.332+0000 7f19c0e2b640 1 -- start start 2023-11-27T20:42:56.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.333+0000 7f19c0e2b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc0aa940 0x7f19bc071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:56.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.333+0000 7f19c0e2b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19bc0c4180 0x7f19bc0aad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:56.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.333+0000 7f19c0e2b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19bc0a9560 con 0x7f19bc0c4660 2023-11-27T20:42:56.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.333+0000 7f19c0e2b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0c3120 con 0x7f19bc0c4180 2023-11-27T20:42:56.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.333+0000 7f19c0e2b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0a9820 con 0x7f19bc0aa940 2023-11-27T20:42:56.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.333+0000 7f19bad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19bc0c4180 0x7f19bc0aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:56.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.333+0000 7f19b3fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f19bc0c4660 0x7f19bc0a9cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46894/0 (socket says 172.21.15.91:46894) 2023-11-27T20:42:56.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.333+0000 7f19b3fff640 1 -- 172.21.15.91:0/1126607641 learned_addr learned my addr 172.21.15.91:0/1126607641 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:56.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.334+0000 7f19ba59c640 1 --2- 172.21.15.91:0/1126607641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc0aa940 0x7f19bc071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:56.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.334+0000 7f19bad9d640 1 -- 172.21.15.91:0/1126607641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc0aa940 msgr2=0x7f19bc071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:56.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.334+0000 7f19bad9d640 1 --2- 172.21.15.91:0/1126607641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc0aa940 0x7f19bc071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:56.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.334+0000 7f19bad9d640 1 -- 172.21.15.91:0/1126607641 >> v1:172.21.15.91:6789/0 conn(0x7f19bc0c4660 legacy=0x7f19bc0a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:56.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.334+0000 7f19bad9d640 1 -- 172.21.15.91:0/1126607641 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc0c4b50 con 0x7f19bc0c4180 2023-11-27T20:42:56.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.334+0000 7f19b9d9b640 1 -- 172.21.15.91:0/1126607641 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828367279 0 0) 0x7f19bc0a9560 con 0x7f19bc0c4660 2023-11-27T20:42:56.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.335+0000 7f19bad9d640 1 --2- 172.21.15.91:0/1126607641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4180 0x7f19bc0aad20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009d90 tx=0x7f19b402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caba97ae159b016 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:56.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.335+0000 7f19b9d9b640 1 -- 172.21.15.91:0/1126607641 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b402cbc0 con 0x7f19bc0c4180 2023-11-27T20:42:56.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.335+0000 7f19b9d9b640 1 -- 172.21.15.91:0/1126607641 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b402cd20 con 0x7f19bc0c4180 2023-11-27T20:42:56.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.335+0000 7f19b9d9b640 1 -- 172.21.15.91:0/1126607641 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4034660 con 0x7f19bc0c4180 2023-11-27T20:42:56.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.336+0000 7f19c0e2b640 1 -- 172.21.15.91:0/1126607641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4180 msgr2=0x7f19bc0aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:56.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.336+0000 7f19c0e2b640 1 --2- 172.21.15.91:0/1126607641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4180 0x7f19bc0aad20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009d90 tx=0x7f19b402be10 comp rx=0 tx=0).stop 2023-11-27T20:42:56.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.336+0000 7f19c0e2b640 1 -- 172.21.15.91:0/1126607641 shutdown_connections 2023-11-27T20:42:56.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.336+0000 7f19c0e2b640 1 --2- 172.21.15.91:0/1126607641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4180 0x7f19bc0aad20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:56.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.336+0000 7f19c0e2b640 1 --2- 172.21.15.91:0/1126607641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc0aa940 0x7f19bc071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:56.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.336+0000 7f19c0e2b640 1 -- 172.21.15.91:0/1126607641 >> 172.21.15.91:0/1126607641 conn(0x7f19bc0c5bc0 msgr2=0x7f19bc0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:56.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.336+0000 7f19c0e2b640 1 -- 172.21.15.91:0/1126607641 shutdown_connections 2023-11-27T20:42:56.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.336+0000 7f19c0e2b640 1 -- 172.21.15.91:0/1126607641 wait complete. 2023-11-27T20:42:56.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.338+0000 7f19c0e2b640 1 Processor -- start 2023-11-27T20:42:56.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.338+0000 7f19c0e2b640 1 -- start start 2023-11-27T20:42:56.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.339+0000 7f19c0e2b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc0aa940 0x7f19bc1d90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:56.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.339+0000 7f19c0e2b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19bc0c4180 0x7f19bc1d9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:56.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.339+0000 7f19c0e2b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4660 0x7f19bc071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:56.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.339+0000 7f19c0e2b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc072410 con 0x7f19bc0c4660 2023-11-27T20:42:56.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.339+0000 7f19c0e2b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc1d8c30 con 0x7f19bc0c4180 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.339+0000 7f19c0e2b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc1d88e0 con 0x7f19bc0aa940 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.339+0000 7f19bad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4660 0x7f19bc071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.339+0000 7f19bad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4660 0x7f19bc071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35410/0 (socket says 172.21.15.91:35410) 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.339+0000 7f19bad9d640 1 -- 172.21.15.91:0/115922637 learned_addr learned my addr 172.21.15.91:0/115922637 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.340+0000 7f19ba59c640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc0aa940 0x7f19bc1d90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.340+0000 7f19bad9d640 1 -- 172.21.15.91:0/115922637 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc0aa940 msgr2=0x7f19bc1d90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.340+0000 7f19bad9d640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc0aa940 0x7f19bc1d90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.340+0000 7f19bad9d640 1 -- 172.21.15.91:0/115922637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19bc0c4180 msgr2=0x7f19bc1d9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.340+0000 7f19b3fff640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19bc0c4180 0x7f19bc1d9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.340+0000 7f19bad9d640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19bc0c4180 0x7f19bc1d9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.340+0000 7f19bad9d640 1 -- 172.21.15.91:0/115922637 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009a70 con 0x7f19bc0c4660 2023-11-27T20:42:56.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.340+0000 7f19bad9d640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4660 0x7f19bc071200 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009d90 tx=0x7f19b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.340+0000 7f19b2ffd640 1 -- 172.21.15.91:0/115922637 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4040650 con 0x7f19bc0c4660 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.341+0000 7f19b2ffd640 1 -- 172.21.15.91:0/115922637 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b402ce90 con 0x7f19bc0c4660 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.341+0000 7f19c0e2b640 1 -- 172.21.15.91:0/115922637 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc1ea980 con 0x7f19bc0c4660 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.341+0000 7f19b2ffd640 1 -- 172.21.15.91:0/115922637 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4040a10 con 0x7f19bc0c4660 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.341+0000 7f19c0e2b640 1 -- 172.21.15.91:0/115922637 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc072050 con 0x7f19bc0c4660 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.342+0000 7f19c0e2b640 1 -- 172.21.15.91:0/115922637 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc1d8da0 con 0x7f19bc0c4660 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.343+0000 7f19b2ffd640 1 -- 172.21.15.91:0/115922637 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f19b4040b70 con 0x7f19bc0c4660 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.344+0000 7f19b2ffd640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f199c06b1f0 0x7f199c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.344+0000 7f19b2ffd640 1 -- 172.21.15.91:0/115922637 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19b40ac490 con 0x7f19bc0c4660 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.344+0000 7f19ba59c640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f199c06b1f0 0x7f199c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.345+0000 7f19ba59c640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f199c06b1f0 0x7f199c06d6b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f19ac006fd0 tx=0x7f19ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:56.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.348+0000 7f19b2ffd640 1 -- 172.21.15.91:0/115922637 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f19b40771b0 con 0x7f19bc0c4660 2023-11-27T20:42:56.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:56.537+0000 7f19c0e2b640 1 -- 172.21.15.91:0/115922637 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f19bc068350 con 0x7f19bc0c4660 2023-11-27T20:42:57.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.502+0000 7f19b2ffd640 1 -- 172.21.15.91:0/115922637 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v35) v1 ==== 140+0+0 (secure 0 0 0) 0x7f19b407a7d0 con 0x7f19bc0c4660 2023-11-27T20:42:57.504 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_metadata' created 2023-11-27T20:42:57.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.506+0000 7f19c0e2b640 1 -- 172.21.15.91:0/115922637 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f199c06b1f0 msgr2=0x7f199c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:57.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.506+0000 7f19c0e2b640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f199c06b1f0 0x7f199c06d6b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f19ac006fd0 tx=0x7f19ac008040 comp rx=0 tx=0).stop 2023-11-27T20:42:57.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.506+0000 7f19c0e2b640 1 -- 172.21.15.91:0/115922637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4660 msgr2=0x7f19bc071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:57.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.506+0000 7f19c0e2b640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4660 0x7f19bc071200 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009d90 tx=0x7f19b4004a40 comp rx=0 tx=0).stop 2023-11-27T20:42:57.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.507+0000 7f19c0e2b640 1 -- 172.21.15.91:0/115922637 shutdown_connections 2023-11-27T20:42:57.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.507+0000 7f19c0e2b640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c4660 0x7f19bc071200 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:57.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.507+0000 7f19c0e2b640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f199c06b1f0 0x7f199c06d6b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:57.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.507+0000 7f19c0e2b640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19bc0c4180 0x7f19bc1d9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:57.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.507+0000 7f19c0e2b640 1 --2- 172.21.15.91:0/115922637 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc0aa940 0x7f19bc1d90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:57.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.507+0000 7f19c0e2b640 1 -- 172.21.15.91:0/115922637 >> 172.21.15.91:0/115922637 conn(0x7f19bc0c5bc0 msgr2=0x7f19bc0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:57.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.508+0000 7f19c0e2b640 1 -- 172.21.15.91:0/115922637 shutdown_connections 2023-11-27T20:42:57.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.508+0000 7f19c0e2b640 1 -- 172.21.15.91:0/115922637 wait complete. 2023-11-27T20:42:57.538 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T20:42:57.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.743+0000 7fb50ab4e640 1 Processor -- start 2023-11-27T20:42:57.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.743+0000 7fb50ab4e640 1 -- start start 2023-11-27T20:42:57.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.745+0000 7fb50ab4e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50414c2e0 0x7fb5040c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:57.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.745+0000 7fb50ab4e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb5040c0440 0x7fb504152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:57.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.745+0000 7fb50ab4e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb504071e80 con 0x7fb504072310 2023-11-27T20:42:57.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.745+0000 7fb50ab4e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb504071470 con 0x7fb5040c0440 2023-11-27T20:42:57.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.745+0000 7fb50ab4e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50414c6c0 con 0x7fb50414c2e0 2023-11-27T20:42:57.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.745+0000 7fb50934b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb5040c0440 0x7fb504152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:57.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.745+0000 7fb50a34d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb504072310 0x7fb5040a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46898/0 (socket says 172.21.15.91:46898) 2023-11-27T20:42:57.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.745+0000 7fb50a34d640 1 -- 172.21.15.91:0/1284347544 learned_addr learned my addr 172.21.15.91:0/1284347544 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:57.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.746+0000 7fb509b4c640 1 --2- 172.21.15.91:0/1284347544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50414c2e0 0x7fb5040c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:57.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.746+0000 7fb50934b640 1 -- 172.21.15.91:0/1284347544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50414c2e0 msgr2=0x7fb5040c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:57.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.746+0000 7fb50934b640 1 --2- 172.21.15.91:0/1284347544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50414c2e0 0x7fb5040c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:57.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.746+0000 7fb50934b640 1 -- 172.21.15.91:0/1284347544 >> v1:172.21.15.91:6789/0 conn(0x7fb504072310 legacy=0x7fb5040a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:57.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.746+0000 7fb50934b640 1 -- 172.21.15.91:0/1284347544 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504153180 con 0x7fb5040c0440 2023-11-27T20:42:57.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.746+0000 7fb508b4a640 1 -- 172.21.15.91:0/1284347544 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393971916 0 0) 0x7fb504071e80 con 0x7fb504072310 2023-11-27T20:42:57.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.747+0000 7fb50934b640 1 --2- 172.21.15.91:0/1284347544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5040c0440 0x7fb504152c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40097a0 tx=0x7fb4f402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5716d3c3db2f46b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:57.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.748+0000 7fb508b4a640 1 -- 172.21.15.91:0/1284347544 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f402f050 con 0x7fb5040c0440 2023-11-27T20:42:57.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.748+0000 7fb508b4a640 1 -- 172.21.15.91:0/1284347544 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f4031700 con 0x7fb5040c0440 2023-11-27T20:42:57.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.748+0000 7fb508b4a640 1 -- 172.21.15.91:0/1284347544 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4031a90 con 0x7fb5040c0440 2023-11-27T20:42:57.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.748+0000 7fb50ab4e640 1 -- 172.21.15.91:0/1284347544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5040c0440 msgr2=0x7fb504152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:57.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.748+0000 7fb50ab4e640 1 --2- 172.21.15.91:0/1284347544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5040c0440 0x7fb504152c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40097a0 tx=0x7fb4f402b7a0 comp rx=0 tx=0).stop 2023-11-27T20:42:57.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.748+0000 7fb50ab4e640 1 -- 172.21.15.91:0/1284347544 shutdown_connections 2023-11-27T20:42:57.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.748+0000 7fb50ab4e640 1 --2- 172.21.15.91:0/1284347544 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5040c0440 0x7fb504152c40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:57.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.748+0000 7fb50ab4e640 1 --2- 172.21.15.91:0/1284347544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50414c2e0 0x7fb5040c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:57.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.748+0000 7fb50ab4e640 1 -- 172.21.15.91:0/1284347544 >> 172.21.15.91:0/1284347544 conn(0x7fb5040a77f0 msgr2=0x7fb5040a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:57.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.748+0000 7fb50ab4e640 1 -- 172.21.15.91:0/1284347544 shutdown_connections 2023-11-27T20:42:57.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.749+0000 7fb50ab4e640 1 -- 172.21.15.91:0/1284347544 wait complete. 2023-11-27T20:42:57.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.750+0000 7fb50ab4e640 1 Processor -- start 2023-11-27T20:42:57.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.750+0000 7fb50ab4e640 1 -- start start 2023-11-27T20:42:57.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.751+0000 7fb50ab4e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb504072310 0x7fb5041490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:57.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.751+0000 7fb50ab4e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5040c0440 0x7fb5040a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:57.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.751+0000 7fb50ab4e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50414c2e0 0x7fb504155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:57.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.751+0000 7fb50ab4e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb504156260 con 0x7fb504072310 2023-11-27T20:42:57.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.751+0000 7fb50ab4e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041eab60 con 0x7fb50414c2e0 2023-11-27T20:42:57.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.751+0000 7fb50ab4e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041e7af0 con 0x7fb5040c0440 2023-11-27T20:42:57.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.751+0000 7fb509b4c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb504072310 0x7fb5041490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:57.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.751+0000 7fb509b4c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb504072310 0x7fb5041490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35438/0 (socket says 172.21.15.91:35438) 2023-11-27T20:42:57.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.751+0000 7fb509b4c640 1 -- 172.21.15.91:0/2659586327 learned_addr learned my addr 172.21.15.91:0/2659586327 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:57.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb50934b640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5040c0440 0x7fb5040a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:57.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb50a34d640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50414c2e0 0x7fb504155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:57.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb509b4c640 1 -- 172.21.15.91:0/2659586327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5040c0440 msgr2=0x7fb5040a9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:57.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb509b4c640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5040c0440 0x7fb5040a9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:57.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb509b4c640 1 -- 172.21.15.91:0/2659586327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50414c2e0 msgr2=0x7fb504155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:57.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb509b4c640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50414c2e0 0x7fb504155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:57.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb509b4c640 1 -- 172.21.15.91:0/2659586327 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f4009400 con 0x7fb504072310 2023-11-27T20:42:57.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb50934b640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5040c0440 0x7fb5040a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:57.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb509b4c640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb504072310 0x7fb5041490c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb50000d5f0 tx=0x7fb50000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:57.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb4fa7fc640 1 -- 172.21.15.91:0/2659586327 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000125f0 con 0x7fb504072310 2023-11-27T20:42:57.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb4fa7fc640 1 -- 172.21.15.91:0/2659586327 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb500012750 con 0x7fb504072310 2023-11-27T20:42:57.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.752+0000 7fb50ab4e640 1 -- 172.21.15.91:0/2659586327 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5041e7dd0 con 0x7fb504072310 2023-11-27T20:42:57.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.753+0000 7fb4fa7fc640 1 -- 172.21.15.91:0/2659586327 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500012b00 con 0x7fb504072310 2023-11-27T20:42:57.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.753+0000 7fb50ab4e640 1 -- 172.21.15.91:0/2659586327 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5041e8390 con 0x7fb504072310 2023-11-27T20:42:57.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.754+0000 7fb50ab4e640 1 -- 172.21.15.91:0/2659586327 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5041e8520 con 0x7fb504072310 2023-11-27T20:42:57.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.755+0000 7fb4fa7fc640 1 -- 172.21.15.91:0/2659586327 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb500012c60 con 0x7fb504072310 2023-11-27T20:42:57.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.756+0000 7fb4fa7fc640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4e806b1c0 0x7fb4e806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:57.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.756+0000 7fb4fa7fc640 1 -- 172.21.15.91:0/2659586327 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6080+0+0 (secure 0 0 0) 0x7fb500089fd0 con 0x7fb504072310 2023-11-27T20:42:57.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.756+0000 7fb50934b640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4e806b1c0 0x7fb4e806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:57.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.757+0000 7fb50934b640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4e806b1c0 0x7fb4e806d680 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4035000 tx=0x7fb4f4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:57.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.761+0000 7fb4fa7fc640 1 -- 172.21.15.91:0/2659586327 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb500054c20 con 0x7fb504072310 2023-11-27T20:42:57.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:57.953+0000 7fb50ab4e640 1 -- 172.21.15.91:0/2659586327 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb50404e840 con 0x7fb504072310 2023-11-27T20:42:58.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.510+0000 7fb4fa7fc640 1 -- 172.21.15.91:0/2659586327 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v36) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb500058240 con 0x7fb504072310 2023-11-27T20:42:58.512 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_data' created 2023-11-27T20:42:58.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.515+0000 7fb50ab4e640 1 -- 172.21.15.91:0/2659586327 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4e806b1c0 msgr2=0x7fb4e806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:58.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.515+0000 7fb50ab4e640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4e806b1c0 0x7fb4e806d680 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4035000 tx=0x7fb4f4008030 comp rx=0 tx=0).stop 2023-11-27T20:42:58.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.515+0000 7fb50ab4e640 1 -- 172.21.15.91:0/2659586327 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb504072310 msgr2=0x7fb5041490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:58.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.515+0000 7fb50ab4e640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb504072310 0x7fb5041490c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb50000d5f0 tx=0x7fb50000dab0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.515+0000 7fb50ab4e640 1 -- 172.21.15.91:0/2659586327 shutdown_connections 2023-11-27T20:42:58.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.515+0000 7fb50ab4e640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb4e806b1c0 0x7fb4e806d680 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.515+0000 7fb50ab4e640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50414c2e0 0x7fb504155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.515+0000 7fb50ab4e640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5040c0440 0x7fb5040a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.515+0000 7fb50ab4e640 1 --2- 172.21.15.91:0/2659586327 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb504072310 0x7fb5041490c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.515+0000 7fb50ab4e640 1 -- 172.21.15.91:0/2659586327 >> 172.21.15.91:0/2659586327 conn(0x7fb5040a77f0 msgr2=0x7fb50414abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:58.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.516+0000 7fb50ab4e640 1 -- 172.21.15.91:0/2659586327 shutdown_connections 2023-11-27T20:42:58.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.516+0000 7fb50ab4e640 1 -- 172.21.15.91:0/2659586327 wait complete. 2023-11-27T20:42:58.555 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-27T20:42:58.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.738+0000 7f991e49a640 1 Processor -- start 2023-11-27T20:42:58.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.738+0000 7f991e49a640 1 -- start start 2023-11-27T20:42:58.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.739+0000 7f991e49a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991814e7c0 0x7f99180c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:58.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.739+0000 7f991e49a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99180c4c00 0x7f99180ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:58.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.739+0000 7f991e49a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9918158a60 con 0x7f99180ca990 2023-11-27T20:42:58.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.739+0000 7f991e49a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99180c5b10 con 0x7f99180c4c00 2023-11-27T20:42:58.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.740+0000 7f991e49a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9918157ca0 con 0x7f991814e7c0 2023-11-27T20:42:58.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.740+0000 7f991dc99640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f99180ca990 0x7f9918154580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46906/0 (socket says 172.21.15.91:46906) 2023-11-27T20:42:58.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.740+0000 7f991dc99640 1 -- 172.21.15.91:0/396384553 learned_addr learned my addr 172.21.15.91:0/396384553 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:42:58.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.740+0000 7f991cc97640 1 --2- 172.21.15.91:0/396384553 >> v2:172.21.15.183:3300/0 conn(0x7f99180c4c00 0x7f99180ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:58.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.740+0000 7f991d498640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991814e7c0 0x7f99180c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:58.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.740+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860544999 0 0) 0x7f9918158a60 con 0x7f99180ca990 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9904003520 con 0x7f99180ca990 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96722002 0 0) 0x7f9904003520 con 0x7f99180ca990 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991814e7c0 msgr2=0x7f99180c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991814e7c0 0x7f99180c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 >> v2:172.21.15.183:3300/0 conn(0x7f99180c4c00 msgr2=0x7f99180ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 --2- 172.21.15.91:0/396384553 >> v2:172.21.15.183:3300/0 conn(0x7f99180c4c00 0x7f99180ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918157f80 con 0x7f99180ca990 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f99100019f0 con 0x7f99180ca990 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 >> v1:172.21.15.91:6789/0 conn(0x7f99180ca990 legacy=0x7f9918154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 0x7f9904003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991814e7c0 0x7f99040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:58.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9904004d00 0x7f9904005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9918157ca0 con 0x7f9904003970 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990400b980 con 0x7f9904004d00 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990400bb40 con 0x7f991814e7c0 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.741+0000 7f991d498640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 0x7f9904003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.742+0000 7f991cc97640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991814e7c0 0x7f99040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.742+0000 7f991d498640 1 -- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991814e7c0 msgr2=0x7f99040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.742+0000 7f991d498640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991814e7c0 0x7f99040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.742+0000 7f991d498640 1 -- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9904004d00 msgr2=0x7f9904005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.742+0000 7f991d498640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9904004d00 0x7f9904005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.742+0000 7f991d498640 1 -- 172.21.15.91:0/396384553 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904003520 con 0x7f9904003970 2023-11-27T20:42:58.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.742+0000 7f991cc97640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991814e7c0 0x7f99040047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:42:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.743+0000 7f991d498640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 0x7f9904003d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9914009ac0 tx=0x7f99040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7a94c35590600f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.743+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991402c6b0 con 0x7f9904003970 2023-11-27T20:42:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.743+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991402c810 con 0x7f9904003970 2023-11-27T20:42:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.743+0000 7f990ffff640 1 -- 172.21.15.91:0/396384553 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991402cba0 con 0x7f9904003970 2023-11-27T20:42:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.744+0000 7f991e49a640 1 -- 172.21.15.91:0/396384553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 msgr2=0x7f9904003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.744+0000 7f991e49a640 1 --2- 172.21.15.91:0/396384553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 0x7f9904003d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9914009ac0 tx=0x7f99040057f0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.744+0000 7f991dc99640 1 -- 172.21.15.91:0/396384553 reap_dead start 2023-11-27T20:42:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.744+0000 7f991e49a640 1 -- 172.21.15.91:0/396384553 shutdown_connections 2023-11-27T20:42:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.744+0000 7f991e49a640 1 -- 172.21.15.91:0/396384553 >> 172.21.15.91:0/396384553 conn(0x7f99180abf00 msgr2=0x7f99180c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.744+0000 7f991e49a640 1 -- 172.21.15.91:0/396384553 shutdown_connections 2023-11-27T20:42:58.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.744+0000 7f991e49a640 1 -- 172.21.15.91:0/396384553 wait complete. 2023-11-27T20:42:58.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.746+0000 7f991e49a640 1 Processor -- start 2023-11-27T20:42:58.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.746+0000 7f991e49a640 1 -- start start 2023-11-27T20:42:58.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.746+0000 7f991e49a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 0x7f99180c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:58.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991e49a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991806bb70 0x7f991814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:58.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991e49a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99180c1080 0x7f99181ed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991e49a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180c2b40 con 0x7f9904003970 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991e49a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99181ed490 con 0x7f99180c1080 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991e49a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99181ed160 con 0x7f991806bb70 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991d498640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 0x7f99180c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991d498640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 0x7f99180c3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35456/0 (socket says 172.21.15.91:35456) 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991d498640 1 -- 172.21.15.91:0/272932078 learned_addr learned my addr 172.21.15.91:0/272932078 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991d498640 1 -- 172.21.15.91:0/272932078 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991806bb70 msgr2=0x7f991814c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991d498640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991806bb70 0x7f991814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991d498640 1 -- 172.21.15.91:0/272932078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99180c1080 msgr2=0x7f99181ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991d498640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99180c1080 0x7f99181ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.747+0000 7f991d498640 1 -- 172.21.15.91:0/272932078 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991806c050 con 0x7f9904003970 2023-11-27T20:42:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.748+0000 7f991d498640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 0x7f99180c3950 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9914037040 tx=0x7f9914004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:58.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.748+0000 7f990dffb640 1 -- 172.21.15.91:0/272932078 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914003820 con 0x7f9904003970 2023-11-27T20:42:58.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.748+0000 7f990dffb640 1 -- 172.21.15.91:0/272932078 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9914003980 con 0x7f9904003970 2023-11-27T20:42:58.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.748+0000 7f990dffb640 1 -- 172.21.15.91:0/272932078 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914003d30 con 0x7f9904003970 2023-11-27T20:42:58.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.748+0000 7f991e49a640 1 -- 172.21.15.91:0/272932078 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991806c330 con 0x7f9904003970 2023-11-27T20:42:58.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.748+0000 7f991e49a640 1 -- 172.21.15.91:0/272932078 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99180c1510 con 0x7f9904003970 2023-11-27T20:42:58.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.749+0000 7f991e49a640 1 -- 172.21.15.91:0/272932078 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99181ed2d0 con 0x7f9904003970 2023-11-27T20:42:58.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.751+0000 7f990dffb640 1 -- 172.21.15.91:0/272932078 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9914051480 con 0x7f9904003970 2023-11-27T20:42:58.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.752+0000 7f990dffb640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98fc06b1f0 0x7f98fc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:58.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.752+0000 7f990dffb640 1 -- 172.21.15.91:0/272932078 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f99140ac1f0 con 0x7f9904003970 2023-11-27T20:42:58.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.753+0000 7f991cc97640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98fc06b1f0 0x7f98fc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:58.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.754+0000 7f991cc97640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98fc06b1f0 0x7f98fc06d6b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f991814c760 tx=0x7f9908008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:58.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.756+0000 7f990dffb640 1 -- 172.21.15.91:0/272932078 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9914076dc0 con 0x7f9904003970 2023-11-27T20:42:58.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:58.977+0000 7f991e49a640 1 -- 172.21.15.91:0/272932078 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f991804e840 con 0x7f9904003970 2023-11-27T20:42:59.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.565+0000 7f990dffb640 1 -- 172.21.15.91:0/272932078 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v17) v1 ==== 175+0+0 (secure 0 0 0) 0x7f991407a3e0 con 0x7f9904003970 2023-11-27T20:42:59.569 INFO:teuthology.orchestra.run.smithi091.stderr:new fs with metadata pool 6 and data pool 7 2023-11-27T20:42:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.573+0000 7f991e49a640 1 -- 172.21.15.91:0/272932078 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98fc06b1f0 msgr2=0x7f98fc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.573+0000 7f991e49a640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98fc06b1f0 0x7f98fc06d6b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f991814c760 tx=0x7f9908008040 comp rx=0 tx=0).stop 2023-11-27T20:42:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.574+0000 7f991e49a640 1 -- 172.21.15.91:0/272932078 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 msgr2=0x7f99180c3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.574+0000 7f991e49a640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 0x7f99180c3950 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9914037040 tx=0x7f9914004730 comp rx=0 tx=0).stop 2023-11-27T20:42:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.574+0000 7f991e49a640 1 -- 172.21.15.91:0/272932078 shutdown_connections 2023-11-27T20:42:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.574+0000 7f991e49a640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f98fc06b1f0 0x7f98fc06d6b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.574+0000 7f991e49a640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99180c1080 0x7f99181ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.574+0000 7f991e49a640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f991806bb70 0x7f991814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.574+0000 7f991e49a640 1 --2- 172.21.15.91:0/272932078 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9904003970 0x7f99180c3950 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.574+0000 7f991e49a640 1 -- 172.21.15.91:0/272932078 >> 172.21.15.91:0/272932078 conn(0x7f99180abf00 msgr2=0x7f9918149070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:59.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.575+0000 7f991e49a640 1 -- 172.21.15.91:0/272932078 shutdown_connections 2023-11-27T20:42:59.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.575+0000 7f991e49a640 1 -- 172.21.15.91:0/272932078 wait complete. 2023-11-27T20:42:59.611 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:42:59.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.788+0000 7f347bec2640 1 Processor -- start 2023-11-27T20:42:59.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.788+0000 7f347bec2640 1 -- start start 2023-11-27T20:42:59.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.790+0000 7f347bec2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f347414fd30 0x7f3474152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:59.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.790+0000 7f347bec2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f347406d0a0 0x7f34740a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:59.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.790+0000 7f347bec2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34740c64a0 con 0x7f34740a5260 2023-11-27T20:42:59.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.790+0000 7f347bec2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34740c5c00 con 0x7f347414fd30 2023-11-27T20:42:59.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.790+0000 7f347bec2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34740c5ee0 con 0x7f347406d0a0 2023-11-27T20:42:59.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.790+0000 7f3479c5e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f347414fd30 0x7f3474152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:59.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.790+0000 7f3479c5e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f347414fd30 0x7f3474152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35462/0 (socket says 172.21.15.91:35462) 2023-11-27T20:42:59.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.790+0000 7f3479c5e640 1 -- 172.21.15.91:0/1875173847 learned_addr learned my addr 172.21.15.91:0/1875173847 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:59.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.790+0000 7f3479c5e640 1 -- 172.21.15.91:0/1875173847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f347406d0a0 msgr2=0x7f34740a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:59.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.790+0000 7f347945d640 1 --2- 172.21.15.91:0/1875173847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f347406d0a0 0x7f34740a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:59.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.791+0000 7f3479c5e640 1 --2- 172.21.15.91:0/1875173847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f347406d0a0 0x7f34740a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.791+0000 7f3479c5e640 1 -- 172.21.15.91:0/1875173847 >> v1:172.21.15.183:6789/0 conn(0x7f34740a5260 legacy=0x7f34740c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:42:59.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.791+0000 7f3479c5e640 1 -- 172.21.15.91:0/1875173847 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740c61c0 con 0x7f347414fd30 2023-11-27T20:42:59.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.792+0000 7f3479c5e640 1 --2- 172.21.15.91:0/1875173847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347414fd30 0x7f3474152f20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3470009870 tx=0x7f347002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaee0a9fb86af83 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:59.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.792+0000 7f3478c5c640 1 -- 172.21.15.91:0/1875173847 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3470031640 con 0x7f347414fd30 2023-11-27T20:42:59.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.792+0000 7f3478c5c640 1 -- 172.21.15.91:0/1875173847 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34700317a0 con 0x7f347414fd30 2023-11-27T20:42:59.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.792+0000 7f3478c5c640 1 -- 172.21.15.91:0/1875173847 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3470031b30 con 0x7f347414fd30 2023-11-27T20:42:59.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.793+0000 7f347bec2640 1 -- 172.21.15.91:0/1875173847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347414fd30 msgr2=0x7f3474152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:59.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.793+0000 7f347bec2640 1 --2- 172.21.15.91:0/1875173847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347414fd30 0x7f3474152f20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3470009870 tx=0x7f347002b8f0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.793+0000 7f347bec2640 1 -- 172.21.15.91:0/1875173847 shutdown_connections 2023-11-27T20:42:59.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.793+0000 7f347bec2640 1 --2- 172.21.15.91:0/1875173847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f347406d0a0 0x7f34740a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.793+0000 7f347bec2640 1 --2- 172.21.15.91:0/1875173847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347414fd30 0x7f3474152f20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.793+0000 7f347bec2640 1 -- 172.21.15.91:0/1875173847 >> 172.21.15.91:0/1875173847 conn(0x7f347406a500 msgr2=0x7f347406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:59.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.793+0000 7f347bec2640 1 -- 172.21.15.91:0/1875173847 shutdown_connections 2023-11-27T20:42:59.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.793+0000 7f347bec2640 1 -- 172.21.15.91:0/1875173847 wait complete. 2023-11-27T20:42:59.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.795+0000 7f347bec2640 1 Processor -- start 2023-11-27T20:42:59.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.795+0000 7f347bec2640 1 -- start start 2023-11-27T20:42:59.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f347bec2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347406d0a0 0x7f347414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f347bec2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34740a5260 0x7f34741df3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f347bec2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f347414fd30 0x7f34741e9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f347bec2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34741eb410 con 0x7f347406d0a0 2023-11-27T20:42:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f347bec2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34740bbe30 con 0x7f347414fd30 2023-11-27T20:42:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f347bec2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347414ebc0 con 0x7f34740a5260 2023-11-27T20:42:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f3479c5e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347406d0a0 0x7f347414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f3479c5e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347406d0a0 0x7f347414ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35478/0 (socket says 172.21.15.91:35478) 2023-11-27T20:42:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f3479c5e640 1 -- 172.21.15.91:0/3365791879 learned_addr learned my addr 172.21.15.91:0/3365791879 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:42:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f3479c5e640 1 -- 172.21.15.91:0/3365791879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34740a5260 msgr2=0x7f34741df3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f3479c5e640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34740a5260 0x7f34741df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f3479c5e640 1 -- 172.21.15.91:0/3365791879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f347414fd30 msgr2=0x7f34741e9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f3479c5e640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f347414fd30 0x7f34741e9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.796+0000 7f3479c5e640 1 -- 172.21.15.91:0/3365791879 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34700094d0 con 0x7f347406d0a0 2023-11-27T20:42:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.797+0000 7f3479c5e640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347406d0a0 0x7f347414ee60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3470000c00 tx=0x7f34700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.797+0000 7f346a7fc640 1 -- 172.21.15.91:0/3365791879 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347003ac60 con 0x7f347406d0a0 2023-11-27T20:42:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.797+0000 7f346a7fc640 1 -- 172.21.15.91:0/3365791879 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347003adc0 con 0x7f347406d0a0 2023-11-27T20:42:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.797+0000 7f346a7fc640 1 -- 172.21.15.91:0/3365791879 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3470044630 con 0x7f347406d0a0 2023-11-27T20:42:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.797+0000 7f347bec2640 1 -- 172.21.15.91:0/3365791879 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34741eb660 con 0x7f347406d0a0 2023-11-27T20:42:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.797+0000 7f347bec2640 1 -- 172.21.15.91:0/3365791879 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34741ebc20 con 0x7f347406d0a0 2023-11-27T20:42:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.798+0000 7f347bec2640 1 -- 172.21.15.91:0/3365791879 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34741ebe10 con 0x7f347406d0a0 2023-11-27T20:42:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.799+0000 7f346a7fc640 1 -- 172.21.15.91:0/3365791879 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f347002f050 con 0x7f347406d0a0 2023-11-27T20:42:59.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.800+0000 7f346a7fc640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f345806b1c0 0x7f345806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:42:59.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.800+0000 7f346a7fc640 1 -- 172.21.15.91:0/3365791879 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f34700abed0 con 0x7f347406d0a0 2023-11-27T20:42:59.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.800+0000 7f347945d640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f345806b1c0 0x7f345806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:42:59.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.801+0000 7f347945d640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f345806b1c0 0x7f345806d680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3464006fd0 tx=0x7f3464008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:42:59.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.804+0000 7f346a7fc640 1 -- 172.21.15.91:0/3365791879 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3470076890 con 0x7f347406d0a0 2023-11-27T20:42:59.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.988+0000 7f347bec2640 1 -- 172.21.15.91:0/3365791879 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3474068350 con 0x7f347406d0a0 2023-11-27T20:42:59.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.991+0000 7f346a7fc640 1 -- 172.21.15.91:0/3365791879 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+20207 (secure 0 0 0) 0x7f347004e020 con 0x7f347406d0a0 2023-11-27T20:42:59.993 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:42:59.993 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":37,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:42:58.979879+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:42:59.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.993+0000 7f347bec2640 1 -- 172.21.15.91:0/3365791879 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f345806b1c0 msgr2=0x7f345806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:59.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.993+0000 7f347bec2640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f345806b1c0 0x7f345806d680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3464006fd0 tx=0x7f3464008040 comp rx=0 tx=0).stop 2023-11-27T20:42:59.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.993+0000 7f347bec2640 1 -- 172.21.15.91:0/3365791879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347406d0a0 msgr2=0x7f347414ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:42:59.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.993+0000 7f347bec2640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347406d0a0 0x7f347414ee60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3470000c00 tx=0x7f34700046c0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.994+0000 7f347bec2640 1 -- 172.21.15.91:0/3365791879 shutdown_connections 2023-11-27T20:42:59.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.994+0000 7f347bec2640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f345806b1c0 0x7f345806d680 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.994+0000 7f347bec2640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f347414fd30 0x7f34741e9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.994+0000 7f347bec2640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34740a5260 0x7f34741df3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.994+0000 7f347bec2640 1 --2- 172.21.15.91:0/3365791879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f347406d0a0 0x7f347414ee60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:42:59.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.994+0000 7f347bec2640 1 -- 172.21.15.91:0/3365791879 >> 172.21.15.91:0/3365791879 conn(0x7f347406a500 msgr2=0x7f34740703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:42:59.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.994+0000 7f347bec2640 1 -- 172.21.15.91:0/3365791879 shutdown_connections 2023-11-27T20:42:59.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:42:59.994+0000 7f347bec2640 1 -- 172.21.15.91:0/3365791879 wait complete. 2023-11-27T20:43:00.014 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:00.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.209+0000 7fe997bd0640 1 Processor -- start 2023-11-27T20:43:00.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.209+0000 7fe997bd0640 1 -- start start 2023-11-27T20:43:00.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.211+0000 7fe997bd0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe9900c7fc0 0x7fe9900c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.211+0000 7fe997bd0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9900c1da0 con 0x7fe990155790 2023-11-27T20:43:00.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.211+0000 7fe997bd0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9900c2080 con 0x7fe9900c7700 2023-11-27T20:43:00.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.211+0000 7fe997bd0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9900c3ee0 con 0x7fe9900c7fc0 2023-11-27T20:43:00.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.211+0000 7fe99616d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fe990155790 0x7fe9900c6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46916/0 (socket says 172.21.15.91:46916) 2023-11-27T20:43:00.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.211+0000 7fe99616d640 1 -- 172.21.15.91:0/3324297552 learned_addr learned my addr 172.21.15.91:0/3324297552 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:00.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.211+0000 7fe99596c640 1 --2- 172.21.15.91:0/3324297552 >> v2:172.21.15.183:3300/0 conn(0x7fe9900c7fc0 0x7fe9900c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943295692 0 0) 0x7fe9900c1da0 con 0x7fe990155790 2023-11-27T20:43:00.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe97c003520 con 0x7fe990155790 2023-11-27T20:43:00.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 92664217 0 0) 0x7fe97c003520 con 0x7fe990155790 2023-11-27T20:43:00.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 >> v2:172.21.15.183:3300/0 conn(0x7fe9900c7fc0 msgr2=0x7fe9900c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:00.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 --2- 172.21.15.91:0/3324297552 >> v2:172.21.15.183:3300/0 conn(0x7fe9900c7fc0 0x7fe9900c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 >> v1:172.21.15.183:6789/0 conn(0x7fe9900c7700 legacy=0x7fe990155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9900c5d60 con 0x7fe990155790 2023-11-27T20:43:00.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fe9880019f0 con 0x7fe990155790 2023-11-27T20:43:00.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 >> v1:172.21.15.91:6789/0 conn(0x7fe990155790 legacy=0x7fe9900c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 --2- 172.21.15.91:0/3324297552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe97c003970 0x7fe97c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 --2- 172.21.15.91:0/3324297552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe97c0047c0 0x7fe97c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 --2- 172.21.15.91:0/3324297552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe97c005180 0x7fe97c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9900c3ee0 con 0x7fe97c005180 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c00c120 con 0x7fe97c003970 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.212+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c00c2e0 con 0x7fe97c0047c0 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.213+0000 7fe99616d640 1 --2- 172.21.15.91:0/3324297552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe97c005180 0x7fe97c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.213+0000 7fe99516b640 1 --2- 172.21.15.91:0/3324297552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe97c0047c0 0x7fe97c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.213+0000 7fe99616d640 1 -- 172.21.15.91:0/3324297552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe97c0047c0 msgr2=0x7fe97c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.213+0000 7fe99616d640 1 --2- 172.21.15.91:0/3324297552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe97c0047c0 0x7fe97c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.213+0000 7fe99616d640 1 -- 172.21.15.91:0/3324297552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe97c003970 msgr2=0x7fe97c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:00.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.213+0000 7fe99616d640 1 --2- 172.21.15.91:0/3324297552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe97c003970 0x7fe97c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.213+0000 7fe99616d640 1 -- 172.21.15.91:0/3324297552 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c003520 con 0x7fe97c005180 2023-11-27T20:43:00.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.214+0000 7fe99616d640 1 -- 172.21.15.91:0/3324297552 reap_dead start 2023-11-27T20:43:00.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.214+0000 7fe99616d640 1 --2- 172.21.15.91:0/3324297552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe97c005180 0x7fe97c00b980 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe98800a830 tx=0x7fe97c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b96e3b0103bd9e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:00.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.214+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880072d0 con 0x7fe97c005180 2023-11-27T20:43:00.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.214+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98802f070 con 0x7fe97c005180 2023-11-27T20:43:00.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.214+0000 7fe99496a640 1 -- 172.21.15.91:0/3324297552 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880076b0 con 0x7fe97c005180 2023-11-27T20:43:00.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.215+0000 7fe997bd0640 1 -- 172.21.15.91:0/3324297552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe97c005180 msgr2=0x7fe97c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.215+0000 7fe997bd0640 1 --2- 172.21.15.91:0/3324297552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe97c005180 0x7fe97c00b980 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe98800a830 tx=0x7fe97c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.215+0000 7fe997bd0640 1 -- 172.21.15.91:0/3324297552 shutdown_connections 2023-11-27T20:43:00.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.215+0000 7fe997bd0640 1 --2- 172.21.15.91:0/3324297552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe97c005180 0x7fe97c00b980 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.215+0000 7fe997bd0640 1 -- 172.21.15.91:0/3324297552 >> 172.21.15.91:0/3324297552 conn(0x7fe9900a9b70 msgr2=0x7fe9900a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:00.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.215+0000 7fe997bd0640 1 -- 172.21.15.91:0/3324297552 shutdown_connections 2023-11-27T20:43:00.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.215+0000 7fe997bd0640 1 -- 172.21.15.91:0/3324297552 wait complete. 2023-11-27T20:43:00.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.217+0000 7fe997bd0640 1 Processor -- start 2023-11-27T20:43:00.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.217+0000 7fe997bd0640 1 -- start start 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.217+0000 7fe997bd0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe97c005180 0x7fe9901ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe997bd0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99006ee80 0x7fe9900a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe997bd0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9900a66b0 0x7fe9900ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe997bd0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9900c7b90 con 0x7fe99006ee80 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe997bd0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9901eade0 con 0x7fe97c005180 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe997bd0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9900ac820 con 0x7fe9900a66b0 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe99516b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99006ee80 0x7fe9900a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe99516b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99006ee80 0x7fe9900a6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35498/0 (socket says 172.21.15.91:35498) 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe99516b640 1 -- 172.21.15.91:0/3257819446 learned_addr learned my addr 172.21.15.91:0/3257819446 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe99516b640 1 -- 172.21.15.91:0/3257819446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9900a66b0 msgr2=0x7fe9900ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe99516b640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9900a66b0 0x7fe9900ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe99516b640 1 -- 172.21.15.91:0/3257819446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe97c005180 msgr2=0x7fe9901ea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe99516b640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe97c005180 0x7fe9901ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe99516b640 1 -- 172.21.15.91:0/3257819446 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9900acb00 con 0x7fe99006ee80 2023-11-27T20:43:00.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.218+0000 7fe99516b640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99006ee80 0x7fe9900a6170 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe98000e480 tx=0x7fe98000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:00.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.219+0000 7fe9867fc640 1 -- 172.21.15.91:0/3257819446 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800052e0 con 0x7fe99006ee80 2023-11-27T20:43:00.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.219+0000 7fe9867fc640 1 -- 172.21.15.91:0/3257819446 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe980005440 con 0x7fe99006ee80 2023-11-27T20:43:00.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.219+0000 7fe9867fc640 1 -- 172.21.15.91:0/3257819446 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980003810 con 0x7fe99006ee80 2023-11-27T20:43:00.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.219+0000 7fe997bd0640 1 -- 172.21.15.91:0/3257819446 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9900acde0 con 0x7fe99006ee80 2023-11-27T20:43:00.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.219+0000 7fe997bd0640 1 -- 172.21.15.91:0/3257819446 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9900a6b30 con 0x7fe99006ee80 2023-11-27T20:43:00.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.220+0000 7fe997bd0640 1 -- 172.21.15.91:0/3257819446 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe990068350 con 0x7fe99006ee80 2023-11-27T20:43:00.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.221+0000 7fe9867fc640 1 -- 172.21.15.91:0/3257819446 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe980003970 con 0x7fe99006ee80 2023-11-27T20:43:00.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.222+0000 7fe9867fc640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe97406b1c0 0x7fe97406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.222+0000 7fe9867fc640 1 -- 172.21.15.91:0/3257819446 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe980089ac0 con 0x7fe99006ee80 2023-11-27T20:43:00.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.222+0000 7fe99596c640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe97406b1c0 0x7fe97406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.223+0000 7fe99596c640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe97406b1c0 0x7fe97406d680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe98c006a90 tx=0x7fe98c006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:00.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.226+0000 7fe9867fc640 1 -- 172.21.15.91:0/3257819446 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe9800545e0 con 0x7fe99006ee80 2023-11-27T20:43:00.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.405+0000 7fe997bd0640 1 -- 172.21.15.91:0/3257819446 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9900c2c80 con 0x7fe99006ee80 2023-11-27T20:43:00.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.409+0000 7fe9867fc640 1 -- 172.21.15.91:0/3257819446 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+20207 (secure 0 0 0) 0x7fe980089e60 con 0x7fe99006ee80 2023-11-27T20:43:00.411 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:00.411 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":37,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:42:58.979879+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:00.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 -- 172.21.15.91:0/3257819446 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe97406b1c0 msgr2=0x7fe97406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe97406b1c0 0x7fe97406d680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe98c006a90 tx=0x7fe98c006a20 comp rx=0 tx=0).stop 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 -- 172.21.15.91:0/3257819446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99006ee80 msgr2=0x7fe9900a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99006ee80 0x7fe9900a6170 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe98000e480 tx=0x7fe98000e940 comp rx=0 tx=0).stop 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 -- 172.21.15.91:0/3257819446 shutdown_connections 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9900a66b0 0x7fe9900ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe99006ee80 0x7fe9900a6170 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe97406b1c0 0x7fe97406d680 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 --2- 172.21.15.91:0/3257819446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe97c005180 0x7fe9901ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 -- 172.21.15.91:0/3257819446 >> 172.21.15.91:0/3257819446 conn(0x7fe9900a9b70 msgr2=0x7fe99006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 -- 172.21.15.91:0/3257819446 shutdown_connections 2023-11-27T20:43:00.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.412+0000 7fe997bd0640 1 -- 172.21.15.91:0/3257819446 wait complete. 2023-11-27T20:43:00.432 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-27T20:43:00.598 INFO:tasks.ceph.mds.c.smithi091.stderr:2023-11-27T20:43:00.597+0000 7f63868b8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:43:00.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.644+0000 7f31325f1640 1 Processor -- start 2023-11-27T20:43:00.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.644+0000 7f31325f1640 1 -- start start 2023-11-27T20:43:00.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.646+0000 7f31325f1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f312c0c7700 0x7f312c0c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.646+0000 7f31325f1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f312c155790 0x7f312c0c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.646+0000 7f31325f1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c0c1da0 con 0x7f312c0c7fc0 2023-11-27T20:43:00.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.646+0000 7f31325f1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0c3ee0 con 0x7f312c155790 2023-11-27T20:43:00.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.646+0000 7f31325f1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0c7b90 con 0x7f312c0c7700 2023-11-27T20:43:00.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.646+0000 7f312bfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f312c0c7fc0 0x7f312c155080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46922/0 (socket says 172.21.15.91:46922) 2023-11-27T20:43:00.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.646+0000 7f312bfff640 1 -- 172.21.15.91:0/1637235276 learned_addr learned my addr 172.21.15.91:0/1637235276 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:00.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418294241 0 0) 0x7f312c0c1da0 con 0x7f312c0c7fc0 2023-11-27T20:43:00.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f3130b8e640 1 --2- 172.21.15.91:0/1637235276 >> v2:172.21.15.183:3300/0 conn(0x7f312c155790 0x7f312c0c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3118003520 con 0x7f312c0c7fc0 2023-11-27T20:43:00.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f31237fe640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f312c0c7700 0x7f312c0c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2257666457 0 0) 0x7f3118003520 con 0x7f312c0c7fc0 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f312c0c7700 msgr2=0x7f312c0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f312c0c7700 0x7f312c0c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 >> v2:172.21.15.183:3300/0 conn(0x7f312c155790 msgr2=0x7f312c0c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 --2- 172.21.15.91:0/1637235276 >> v2:172.21.15.183:3300/0 conn(0x7f312c155790 0x7f312c0c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c0c2080 con 0x7f312c0c7fc0 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f311c001670 con 0x7f312c0c7fc0 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 >> v1:172.21.15.91:6789/0 conn(0x7f312c0c7fc0 legacy=0x7f312c155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3118003970 0x7f3118003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31180047c0 0x7f3118004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3118005140 0x7f311800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0c3ee0 con 0x7f3118005140 2023-11-27T20:43:00.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0c7b90 con 0x7f3118003970 2023-11-27T20:43:00.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311800bec0 con 0x7f31180047c0 2023-11-27T20:43:00.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.647+0000 7f3130b8e640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3118005140 0x7f311800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.648+0000 7f31237fe640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31180047c0 0x7f3118004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.648+0000 7f3130b8e640 1 -- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31180047c0 msgr2=0x7f3118004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:00.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.648+0000 7f312bfff640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3118003970 0x7f3118003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.648+0000 7f3130b8e640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31180047c0 0x7f3118004c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.648+0000 7f3130b8e640 1 -- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3118003970 msgr2=0x7f3118003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:00.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.648+0000 7f3130b8e640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3118003970 0x7f3118003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.648+0000 7f3130b8e640 1 -- 172.21.15.91:0/1637235276 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3118003520 con 0x7f3118005140 2023-11-27T20:43:00.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.649+0000 7f3130b8e640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3118005140 0x7f311800b980 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3124007360 tx=0x7f31180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb2d2c5ad8d949 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:00.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.649+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312402ccf0 con 0x7f3118005140 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.649+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312402ce50 con 0x7f3118005140 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.649+0000 7f312b7fe640 1 -- 172.21.15.91:0/1637235276 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124034660 con 0x7f3118005140 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.650+0000 7f31325f1640 1 -- 172.21.15.91:0/1637235276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3118005140 msgr2=0x7f311800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.650+0000 7f31325f1640 1 --2- 172.21.15.91:0/1637235276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3118005140 0x7f311800b980 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3124007360 tx=0x7f31180057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.650+0000 7f3130b8e640 1 -- 172.21.15.91:0/1637235276 reap_dead start 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.650+0000 7f31325f1640 1 -- 172.21.15.91:0/1637235276 shutdown_connections 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.650+0000 7f31325f1640 1 -- 172.21.15.91:0/1637235276 >> 172.21.15.91:0/1637235276 conn(0x7f312c0a9b70 msgr2=0x7f312c0a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.650+0000 7f31325f1640 1 -- 172.21.15.91:0/1637235276 shutdown_connections 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.650+0000 7f31325f1640 1 -- 172.21.15.91:0/1637235276 wait complete. 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.651+0000 7f31325f1640 1 Processor -- start 2023-11-27T20:43:00.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.652+0000 7f31325f1640 1 -- start start 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.652+0000 7f31325f1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3118005140 0x7f312c1de0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.652+0000 7f31325f1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f312c0ab880 0x7f312c145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.652+0000 7f31325f1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312c145550 0x7f312c1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.652+0000 7f31325f1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0ac9a0 con 0x7f312c145550 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.652+0000 7f31325f1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c156150 con 0x7f312c0ab880 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.652+0000 7f31325f1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c1459d0 con 0x7f3118005140 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.653+0000 7f3130b8e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312c145550 0x7f312c1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.653+0000 7f3130b8e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312c145550 0x7f312c1565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35512/0 (socket says 172.21.15.91:35512) 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.653+0000 7f3130b8e640 1 -- 172.21.15.91:0/2070685737 learned_addr learned my addr 172.21.15.91:0/2070685737 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.653+0000 7f3130b8e640 1 -- 172.21.15.91:0/2070685737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3118005140 msgr2=0x7f312c1de0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.653+0000 7f3130b8e640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3118005140 0x7f312c1de0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.653+0000 7f3130b8e640 1 -- 172.21.15.91:0/2070685737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f312c0ab880 msgr2=0x7f312c145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:00.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.653+0000 7f3130b8e640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f312c0ab880 0x7f312c145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:00.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.653+0000 7f3130b8e640 1 -- 172.21.15.91:0/2070685737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c1deb00 con 0x7f312c145550 2023-11-27T20:43:00.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.653+0000 7f3130b8e640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312c145550 0x7f312c1565e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f312402dfd0 tx=0x7f3124004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:00.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.654+0000 7f31297fa640 1 -- 172.21.15.91:0/2070685737 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124045070 con 0x7f312c145550 2023-11-27T20:43:00.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.654+0000 7f31297fa640 1 -- 172.21.15.91:0/2070685737 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312403d400 con 0x7f312c145550 2023-11-27T20:43:00.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.654+0000 7f31297fa640 1 -- 172.21.15.91:0/2070685737 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124034ea0 con 0x7f312c145550 2023-11-27T20:43:00.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.654+0000 7f31325f1640 1 -- 172.21.15.91:0/2070685737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c0ac3e0 con 0x7f312c145550 2023-11-27T20:43:00.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.654+0000 7f31325f1640 1 -- 172.21.15.91:0/2070685737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c155de0 con 0x7f312c145550 2023-11-27T20:43:00.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.655+0000 7f31325f1640 1 -- 172.21.15.91:0/2070685737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c155c40 con 0x7f312c145550 2023-11-27T20:43:00.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.656+0000 7f31297fa640 1 -- 172.21.15.91:0/2070685737 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f312403b040 con 0x7f312c145550 2023-11-27T20:43:00.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.657+0000 7f31297fa640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f310c06b1c0 0x7f310c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:00.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.657+0000 7f31297fa640 1 -- 172.21.15.91:0/2070685737 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f31240ab590 con 0x7f312c145550 2023-11-27T20:43:00.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.657+0000 7f312bfff640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f310c06b1c0 0x7f310c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:00.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.658+0000 7f312bfff640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f310c06b1c0 0x7f310c06d680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f311c0017a0 tx=0x7f311c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:00.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.661+0000 7f31297fa640 1 -- 172.21.15.91:0/2070685737 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f312c155c40 con 0x7f312c145550 2023-11-27T20:43:00.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:00.887+0000 7f31325f1640 1 -- 172.21.15.91:0/2070685737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f312c155c40 con 0x7f312c145550 2023-11-27T20:43:01.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.575+0000 7f31297fa640 1 -- 172.21.15.91:0/2070685737 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v19) v1 ==== 119+0+0 (secure 0 0 0) 0x7f312c155c40 con 0x7f312c145550 2023-11-27T20:43:01.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 -- 172.21.15.91:0/2070685737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f310c06b1c0 msgr2=0x7f310c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:01.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f310c06b1c0 0x7f310c06d680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f311c0017a0 tx=0x7f311c009040 comp rx=0 tx=0).stop 2023-11-27T20:43:01.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 -- 172.21.15.91:0/2070685737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312c145550 msgr2=0x7f312c1565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:01.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312c145550 0x7f312c1565e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f312402dfd0 tx=0x7f3124004ab0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 -- 172.21.15.91:0/2070685737 shutdown_connections 2023-11-27T20:43:01.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312c145550 0x7f312c1565e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f310c06b1c0 0x7f310c06d680 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f312c0ab880 0x7f312c145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 --2- 172.21.15.91:0/2070685737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3118005140 0x7f312c1de0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 -- 172.21.15.91:0/2070685737 >> 172.21.15.91:0/2070685737 conn(0x7f312c0a9b70 msgr2=0x7f312c0a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:01.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 -- 172.21.15.91:0/2070685737 shutdown_connections 2023-11-27T20:43:01.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.580+0000 7f31325f1640 1 -- 172.21.15.91:0/2070685737 wait complete. 2023-11-27T20:43:01.601 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T20:43:01.601 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-27T20:43:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.819+0000 7f6d33d0c640 1 Processor -- start 2023-11-27T20:43:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.819+0000 7f6d33d0c640 1 -- start start 2023-11-27T20:43:01.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.820+0000 7f6d33d0c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6d2c155490 0x7f6d2c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:01.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.820+0000 7f6d33d0c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d2c0a9b40 0x7f6d2c0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:01.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.820+0000 7f6d33d0c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2c0c06c0 con 0x7f6d2c0c1500 2023-11-27T20:43:01.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.820+0000 7f6d33d0c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2c0a5820 con 0x7f6d2c0a9b40 2023-11-27T20:43:01.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.820+0000 7f6d33d0c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2c0c1020 con 0x7f6d2c155490 2023-11-27T20:43:01.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.820+0000 7f6d322a9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d2c0a9b40 0x7f6d2c0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:01.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.820+0000 7f6d312a7640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f6d2c0c1500 0x7f6d2c0a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46934/0 (socket says 172.21.15.91:46934) 2023-11-27T20:43:01.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.820+0000 7f6d312a7640 1 -- 172.21.15.91:0/848739975 learned_addr learned my addr 172.21.15.91:0/848739975 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:01.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.821+0000 7f6d322a9640 1 -- 172.21.15.91:0/848739975 >> v2:172.21.15.183:3300/0 conn(0x7f6d2c155490 msgr2=0x7f6d2c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:01.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.821+0000 7f6d322a9640 1 --2- 172.21.15.91:0/848739975 >> v2:172.21.15.183:3300/0 conn(0x7f6d2c155490 0x7f6d2c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.821+0000 7f6d322a9640 1 -- 172.21.15.91:0/848739975 >> v1:172.21.15.91:6789/0 conn(0x7f6d2c0c1500 legacy=0x7f6d2c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:01.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.821+0000 7f6d322a9640 1 -- 172.21.15.91:0/848739975 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0c0910 con 0x7f6d2c0a9b40 2023-11-27T20:43:01.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.821+0000 7f6d30aa6640 1 -- 172.21.15.91:0/848739975 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805853282 0 0) 0x7f6d2c0c06c0 con 0x7f6d2c0c1500 2023-11-27T20:43:01.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.822+0000 7f6d322a9640 1 --2- 172.21.15.91:0/848739975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0a9b40 0x7f6d2c0c24d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c06dff0 tx=0x7f6d2402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ee46163cc13e3e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:01.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.822+0000 7f6d30aa6640 1 -- 172.21.15.91:0/848739975 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2402cc80 con 0x7f6d2c0a9b40 2023-11-27T20:43:01.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.822+0000 7f6d30aa6640 1 -- 172.21.15.91:0/848739975 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2402cde0 con 0x7f6d2c0a9b40 2023-11-27T20:43:01.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.822+0000 7f6d30aa6640 1 -- 172.21.15.91:0/848739975 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24034660 con 0x7f6d2c0a9b40 2023-11-27T20:43:01.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.823+0000 7f6d33d0c640 1 -- 172.21.15.91:0/848739975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0a9b40 msgr2=0x7f6d2c0c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:01.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.823+0000 7f6d33d0c640 1 --2- 172.21.15.91:0/848739975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0a9b40 0x7f6d2c0c24d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c06dff0 tx=0x7f6d2402bed0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.823+0000 7f6d33d0c640 1 -- 172.21.15.91:0/848739975 shutdown_connections 2023-11-27T20:43:01.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.823+0000 7f6d33d0c640 1 --2- 172.21.15.91:0/848739975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0a9b40 0x7f6d2c0c24d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.823+0000 7f6d33d0c640 1 --2- 172.21.15.91:0/848739975 >> v2:172.21.15.183:3300/0 conn(0x7f6d2c155490 0x7f6d2c0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.823+0000 7f6d33d0c640 1 -- 172.21.15.91:0/848739975 >> 172.21.15.91:0/848739975 conn(0x7f6d2c06a500 msgr2=0x7f6d2c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:01.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.823+0000 7f6d33d0c640 1 -- 172.21.15.91:0/848739975 shutdown_connections 2023-11-27T20:43:01.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.823+0000 7f6d33d0c640 1 -- 172.21.15.91:0/848739975 wait complete. 2023-11-27T20:43:01.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.824+0000 7f6d33d0c640 1 Processor -- start 2023-11-27T20:43:01.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.825+0000 7f6d33d0c640 1 -- start start 2023-11-27T20:43:01.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.825+0000 7f6d33d0c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0c1500 0x7f6d2c0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:01.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.825+0000 7f6d33d0c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d2c155490 0x7f6d2c070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:01.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.825+0000 7f6d33d0c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d2c071240 0x7f6d2c144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:01.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.825+0000 7f6d33d0c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c1ea1c0 con 0x7f6d2c0c1500 2023-11-27T20:43:01.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.825+0000 7f6d33d0c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c14edd0 con 0x7f6d2c155490 2023-11-27T20:43:01.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.825+0000 7f6d33d0c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c070870 con 0x7f6d2c071240 2023-11-27T20:43:01.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.826+0000 7f6d31aa8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0c1500 0x7f6d2c0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:01.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.826+0000 7f6d31aa8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0c1500 0x7f6d2c0bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35538/0 (socket says 172.21.15.91:35538) 2023-11-27T20:43:01.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.826+0000 7f6d31aa8640 1 -- 172.21.15.91:0/1007667083 learned_addr learned my addr 172.21.15.91:0/1007667083 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.826+0000 7f6d31aa8640 1 -- 172.21.15.91:0/1007667083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d2c071240 msgr2=0x7f6d2c144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.826+0000 7f6d31aa8640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d2c071240 0x7f6d2c144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.826+0000 7f6d31aa8640 1 -- 172.21.15.91:0/1007667083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d2c155490 msgr2=0x7f6d2c070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.826+0000 7f6d31aa8640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d2c155490 0x7f6d2c070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.826+0000 7f6d31aa8640 1 -- 172.21.15.91:0/1007667083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24009a70 con 0x7f6d2c0c1500 2023-11-27T20:43:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.826+0000 7f6d31aa8640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0c1500 0x7f6d2c0bf360 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800b410 tx=0x7f6d2800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.827+0000 7f6d227fc640 1 -- 172.21.15.91:0/1007667083 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28011830 con 0x7f6d2c0c1500 2023-11-27T20:43:01.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.827+0000 7f6d227fc640 1 -- 172.21.15.91:0/1007667083 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d28011990 con 0x7f6d2c0c1500 2023-11-27T20:43:01.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.827+0000 7f6d227fc640 1 -- 172.21.15.91:0/1007667083 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28011d40 con 0x7f6d2c0c1500 2023-11-27T20:43:01.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.827+0000 7f6d33d0c640 1 -- 172.21.15.91:0/1007667083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c06ff40 con 0x7f6d2c0c1500 2023-11-27T20:43:01.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.827+0000 7f6d33d0c640 1 -- 172.21.15.91:0/1007667083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c070500 con 0x7f6d2c0c1500 2023-11-27T20:43:01.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.828+0000 7f6d33d0c640 1 -- 172.21.15.91:0/1007667083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2c068350 con 0x7f6d2c0c1500 2023-11-27T20:43:01.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.829+0000 7f6d227fc640 1 -- 172.21.15.91:0/1007667083 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6d2801a400 con 0x7f6d2c0c1500 2023-11-27T20:43:01.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.830+0000 7f6d227fc640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d1006b1c0 0x7f6d1006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:01.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.830+0000 7f6d227fc640 1 -- 172.21.15.91:0/1007667083 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6d28089ef0 con 0x7f6d2c0c1500 2023-11-27T20:43:01.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.830+0000 7f6d312a7640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d1006b1c0 0x7f6d1006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:01.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.831+0000 7f6d312a7640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d1006b1c0 0x7f6d1006d680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c007fd0 tx=0x7f6d1c007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:01.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:01.834+0000 7f6d227fc640 1 -- 172.21.15.91:0/1007667083 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6d280548b0 con 0x7f6d2c0c1500 2023-11-27T20:43:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.063+0000 7f6d33d0c640 1 -- 172.21.15.91:0/1007667083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6d2c0bf8a0 con 0x7f6d2c0c1500 2023-11-27T20:43:02.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.587+0000 7f6d227fc640 1 -- 172.21.15.91:0/1007667083 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v20) v1 ==== 123+0+0 (secure 0 0 0) 0x7f6d28015020 con 0x7f6d2c0c1500 2023-11-27T20:43:02.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.591+0000 7f6d33d0c640 1 -- 172.21.15.91:0/1007667083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d1006b1c0 msgr2=0x7f6d1006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:02.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.591+0000 7f6d33d0c640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d1006b1c0 0x7f6d1006d680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c007fd0 tx=0x7f6d1c007920 comp rx=0 tx=0).stop 2023-11-27T20:43:02.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.592+0000 7f6d33d0c640 1 -- 172.21.15.91:0/1007667083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0c1500 msgr2=0x7f6d2c0bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:02.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.592+0000 7f6d33d0c640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0c1500 0x7f6d2c0bf360 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800b410 tx=0x7f6d2800b8d0 comp rx=0 tx=0).stop 2023-11-27T20:43:02.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.592+0000 7f6d33d0c640 1 -- 172.21.15.91:0/1007667083 shutdown_connections 2023-11-27T20:43:02.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.592+0000 7f6d33d0c640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d2c071240 0x7f6d2c144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:02.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.592+0000 7f6d33d0c640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d1006b1c0 0x7f6d1006d680 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:02.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.592+0000 7f6d33d0c640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d2c155490 0x7f6d2c070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:02.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.592+0000 7f6d33d0c640 1 --2- 172.21.15.91:0/1007667083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d2c0c1500 0x7f6d2c0bf360 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:02.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.592+0000 7f6d33d0c640 1 -- 172.21.15.91:0/1007667083 >> 172.21.15.91:0/1007667083 conn(0x7f6d2c06a500 msgr2=0x7f6d2c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:02.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.592+0000 7f6d33d0c640 1 -- 172.21.15.91:0/1007667083 shutdown_connections 2023-11-27T20:43:02.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.592+0000 7f6d33d0c640 1 -- 172.21.15.91:0/1007667083 wait complete. 2023-11-27T20:43:02.614 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-27T20:43:02.614 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:02.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.818+0000 7f255c133640 1 Processor -- start 2023-11-27T20:43:02.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.818+0000 7f255c133640 1 -- start start 2023-11-27T20:43:02.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.820+0000 7f255c133640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f255414fd30 0x7f2554152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:02.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.820+0000 7f255c133640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25540c3ea0 0x7f25540c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:02.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.820+0000 7f255c133640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25540c64a0 con 0x7f255406d0a0 2023-11-27T20:43:02.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.820+0000 7f255c133640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25540c5c00 con 0x7f255414fd30 2023-11-27T20:43:02.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.820+0000 7f255c133640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540c5ee0 con 0x7f25540c3ea0 2023-11-27T20:43:02.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.820+0000 7f25596ce640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f255406d0a0 0x7f25540a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46936/0 (socket says 172.21.15.91:46936) 2023-11-27T20:43:02.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.820+0000 7f25596ce640 1 -- 172.21.15.91:0/3603627192 learned_addr learned my addr 172.21.15.91:0/3603627192 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:02.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.820+0000 7f2559ecf640 1 --2- 172.21.15.91:0/3603627192 >> v2:172.21.15.183:3300/0 conn(0x7f255414fd30 0x7f2554152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:02.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.820+0000 7f255a6d0640 1 --2- 172.21.15.91:0/3603627192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25540c3ea0 0x7f25540c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:02.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.821+0000 7f2558ecd640 1 -- 172.21.15.91:0/3603627192 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45067841 0 0) 0x7f25540c64a0 con 0x7f255406d0a0 2023-11-27T20:43:02.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.821+0000 7f2558ecd640 1 -- 172.21.15.91:0/3603627192 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2540003520 con 0x7f255406d0a0 2023-11-27T20:43:02.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.821+0000 7f2559ecf640 1 -- 172.21.15.91:0/3603627192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25540c3ea0 msgr2=0x7f25540c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:02.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.821+0000 7f2559ecf640 1 --2- 172.21.15.91:0/3603627192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25540c3ea0 0x7f25540c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:02.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.821+0000 7f2558ecd640 1 -- 172.21.15.91:0/3603627192 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2940235085 0 0) 0x7f2540003520 con 0x7f255406d0a0 2023-11-27T20:43:02.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.821+0000 7f2559ecf640 1 -- 172.21.15.91:0/3603627192 >> v1:172.21.15.91:6789/0 conn(0x7f255406d0a0 legacy=0x7f25540a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:02.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.821+0000 7f2559ecf640 1 -- 172.21.15.91:0/3603627192 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540c61c0 con 0x7f255414fd30 2023-11-27T20:43:02.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.823+0000 7f2559ecf640 1 --2- 172.21.15.91:0/3603627192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255414fd30 0x7f2554152f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f25500097a0 tx=0x7f255002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e62e542e3e8f5c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:02.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.823+0000 7f2558ecd640 1 -- 172.21.15.91:0/3603627192 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544001670 con 0x7f255414fd30 2023-11-27T20:43:02.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.823+0000 7f2558ecd640 1 -- 172.21.15.91:0/3603627192 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255002e050 con 0x7f255414fd30 2023-11-27T20:43:02.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.823+0000 7f2558ecd640 1 -- 172.21.15.91:0/3603627192 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550030710 con 0x7f255414fd30 2023-11-27T20:43:02.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.824+0000 7f255c133640 1 -- 172.21.15.91:0/3603627192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255414fd30 msgr2=0x7f2554152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:02.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.824+0000 7f255c133640 1 --2- 172.21.15.91:0/3603627192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255414fd30 0x7f2554152f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f25500097a0 tx=0x7f255002b790 comp rx=0 tx=0).stop 2023-11-27T20:43:02.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.824+0000 7f255c133640 1 -- 172.21.15.91:0/3603627192 shutdown_connections 2023-11-27T20:43:02.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.824+0000 7f255c133640 1 --2- 172.21.15.91:0/3603627192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25540c3ea0 0x7f25540c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:02.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.824+0000 7f255c133640 1 --2- 172.21.15.91:0/3603627192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255414fd30 0x7f2554152f20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:02.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.824+0000 7f255c133640 1 -- 172.21.15.91:0/3603627192 >> 172.21.15.91:0/3603627192 conn(0x7f255406a500 msgr2=0x7f255406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:02.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.824+0000 7f255c133640 1 -- 172.21.15.91:0/3603627192 shutdown_connections 2023-11-27T20:43:02.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.824+0000 7f255c133640 1 -- 172.21.15.91:0/3603627192 wait complete. 2023-11-27T20:43:02.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.826+0000 7f255c133640 1 Processor -- start 2023-11-27T20:43:02.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.826+0000 7f255c133640 1 -- start start 2023-11-27T20:43:02.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255c133640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255406d0a0 0x7f2554151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:02.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255c133640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25540c3ea0 0x7f255414c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:02.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255c133640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f255414fd30 0x7f255414c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:02.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255c133640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25541552d0 con 0x7f255414fd30 2023-11-27T20:43:02.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255c133640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554154270 con 0x7f255406d0a0 2023-11-27T20:43:02.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255c133640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255414cb80 con 0x7f25540c3ea0 2023-11-27T20:43:02.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255a6d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f255414fd30 0x7f255414c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:02.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255a6d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f255414fd30 0x7f255414c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35544/0 (socket says 172.21.15.91:35544) 2023-11-27T20:43:02.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255a6d0640 1 -- 172.21.15.91:0/842367019 learned_addr learned my addr 172.21.15.91:0/842367019 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:02.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f25596ce640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25540c3ea0 0x7f255414c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:02.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f2559ecf640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255406d0a0 0x7f2554151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:02.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255a6d0640 1 -- 172.21.15.91:0/842367019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25540c3ea0 msgr2=0x7f255414c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:02.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255a6d0640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25540c3ea0 0x7f255414c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:02.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255a6d0640 1 -- 172.21.15.91:0/842367019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255406d0a0 msgr2=0x7f2554151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:02.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.827+0000 7f255a6d0640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255406d0a0 0x7f2554151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:02.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.828+0000 7f255a6d0640 1 -- 172.21.15.91:0/842367019 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2550009400 con 0x7f255414fd30 2023-11-27T20:43:02.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.828+0000 7f255a6d0640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f255414fd30 0x7f255414c640 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f254c00efc0 tx=0x7f254c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:02.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.828+0000 7f254a7fc640 1 -- 172.21.15.91:0/842367019 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c014480 con 0x7f255414fd30 2023-11-27T20:43:02.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.828+0000 7f254a7fc640 1 -- 172.21.15.91:0/842367019 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c00f040 con 0x7f255414fd30 2023-11-27T20:43:02.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.828+0000 7f254a7fc640 1 -- 172.21.15.91:0/842367019 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c014820 con 0x7f255414fd30 2023-11-27T20:43:02.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.828+0000 7f255c133640 1 -- 172.21.15.91:0/842367019 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25541544c0 con 0x7f255414fd30 2023-11-27T20:43:02.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.828+0000 7f255c133640 1 -- 172.21.15.91:0/842367019 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25540bad80 con 0x7f255414fd30 2023-11-27T20:43:02.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.829+0000 7f255c133640 1 -- 172.21.15.91:0/842367019 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25540ac060 con 0x7f255414fd30 2023-11-27T20:43:02.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.830+0000 7f254a7fc640 1 -- 172.21.15.91:0/842367019 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f254c014980 con 0x7f255414fd30 2023-11-27T20:43:02.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.831+0000 7f254a7fc640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f253806b1c0 0x7f253806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:02.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.831+0000 7f254a7fc640 1 -- 172.21.15.91:0/842367019 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f254c08ac30 con 0x7f255414fd30 2023-11-27T20:43:02.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.831+0000 7f2559ecf640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f253806b1c0 0x7f253806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:02.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.832+0000 7f2559ecf640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f253806b1c0 0x7f253806d680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2550034000 tx=0x7f255002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:02.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:02.835+0000 7f254a7fc640 1 -- 172.21.15.91:0/842367019 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f254c055690 con 0x7f255414fd30 2023-11-27T20:43:03.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.063+0000 7f255c133640 1 -- 172.21.15.91:0/842367019 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25541531a0 con 0x7f255414fd30 2023-11-27T20:43:03.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.064+0000 7f254a7fc640 1 -- 172.21.15.91:0/842367019 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f254c018090 con 0x7f255414fd30 2023-11-27T20:43:03.065 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:03.066 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:37.962718+0000","modified":"2023-11-27T20:42:41.040049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.183:6834/3450105603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3450105603},{"type":"v1","addr":"172.21.15.183:6834","nonce":3450105603}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:58.980635+0000","modified":"2023-11-27T20:43:02.065929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":10,"addr":"172.21.15.91:6837/127433365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":127433365},{"type":"v1","addr":"172.21.15.91:6837","nonce":127433365}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-27T20:43:03.066 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 20 2023-11-27T20:43:03.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 -- 172.21.15.91:0/842367019 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f253806b1c0 msgr2=0x7f253806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f253806b1c0 0x7f253806d680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2550034000 tx=0x7f255002f000 comp rx=0 tx=0).stop 2023-11-27T20:43:03.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 -- 172.21.15.91:0/842367019 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f255414fd30 msgr2=0x7f255414c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f255414fd30 0x7f255414c640 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f254c00efc0 tx=0x7f254c00c490 comp rx=0 tx=0).stop 2023-11-27T20:43:03.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 -- 172.21.15.91:0/842367019 shutdown_connections 2023-11-27T20:43:03.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f255414fd30 0x7f255414c640 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25540c3ea0 0x7f255414c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f253806b1c0 0x7f253806d680 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 --2- 172.21.15.91:0/842367019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255406d0a0 0x7f2554151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 -- 172.21.15.91:0/842367019 >> 172.21.15.91:0/842367019 conn(0x7f255406a500 msgr2=0x7f255406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:03.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 -- 172.21.15.91:0/842367019 shutdown_connections 2023-11-27T20:43:03.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.067+0000 7f255c133640 1 -- 172.21.15.91:0/842367019 wait complete. 2023-11-27T20:43:03.087 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:03.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.298+0000 7fc5e0ed3640 1 Processor -- start 2023-11-27T20:43:03.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.299+0000 7fc5e0ed3640 1 -- start start 2023-11-27T20:43:03.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.300+0000 7fc5e0ed3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5dc14fd30 0x7fc5dc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.300+0000 7fc5e0ed3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc5dc06d0a0 0x7fc5dc0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.300+0000 7fc5e0ed3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc0c64a0 con 0x7fc5dc0a5260 2023-11-27T20:43:03.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.300+0000 7fc5e0ed3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c5c00 con 0x7fc5dc06d0a0 2023-11-27T20:43:03.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.300+0000 7fc5e0ed3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c5ee0 con 0x7fc5dc14fd30 2023-11-27T20:43:03.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.300+0000 7fc5dad9d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fc5dc0a5260 0x7fc5dc0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46942/0 (socket says 172.21.15.91:46942) 2023-11-27T20:43:03.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.300+0000 7fc5dad9d640 1 -- 172.21.15.91:0/1886749967 learned_addr learned my addr 172.21.15.91:0/1886749967 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:03.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.300+0000 7fc5d3fff640 1 --2- 172.21.15.91:0/1886749967 >> v2:172.21.15.183:3300/0 conn(0x7fc5dc06d0a0 0x7fc5dc0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.300+0000 7fc5da59c640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5dc14fd30 0x7fc5dc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829528179 0 0) 0x7fc5dc0c64a0 con 0x7fc5dc0a5260 2023-11-27T20:43:03.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c8003520 con 0x7fc5dc0a5260 2023-11-27T20:43:03.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1405839384 0 0) 0x7fc5c8003520 con 0x7fc5dc0a5260 2023-11-27T20:43:03.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5dc14fd30 msgr2=0x7fc5dc152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:03.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5dc14fd30 0x7fc5dc152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 >> v2:172.21.15.183:3300/0 conn(0x7fc5dc06d0a0 msgr2=0x7fc5dc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:03.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 --2- 172.21.15.91:0/1886749967 >> v2:172.21.15.183:3300/0 conn(0x7fc5dc06d0a0 0x7fc5dc0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0c61c0 con 0x7fc5dc0a5260 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fc5d40019f0 con 0x7fc5dc0a5260 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 >> v1:172.21.15.91:6789/0 conn(0x7fc5dc0a5260 legacy=0x7fc5dc0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5dc14fd30 0x7fc5c8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5c8003ef0 0x7fc5c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c8004d00 0x7fc5c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c5c00 con 0x7fc5c8003ef0 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c5ee0 con 0x7fc5c8004d00 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.301+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c800b980 con 0x7fc5dc14fd30 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.302+0000 7fc5d3fff640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5c8003ef0 0x7fc5c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.302+0000 7fc5da59c640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5dc14fd30 0x7fc5c8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.302+0000 7fc5dad9d640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c8004d00 0x7fc5c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.302+0000 7fc5d3fff640 1 -- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5dc14fd30 msgr2=0x7fc5c8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.302+0000 7fc5d3fff640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5dc14fd30 0x7fc5c8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.302+0000 7fc5d3fff640 1 -- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c8004d00 msgr2=0x7fc5c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.302+0000 7fc5d3fff640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c8004d00 0x7fc5c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.302+0000 7fc5d3fff640 1 -- 172.21.15.91:0/1886749967 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8003520 con 0x7fc5c8003ef0 2023-11-27T20:43:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.302+0000 7fc5da59c640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5dc14fd30 0x7fc5c8003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:03.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.302+0000 7fc5dad9d640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5c8004d00 0x7fc5c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:03.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.303+0000 7fc5d3fff640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5c8003ef0 0x7fc5c80047c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009a90 tx=0x7fc5c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a3b8eb36f459b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:03.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.303+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c402c6b0 con 0x7fc5c8003ef0 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.303+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c402c810 con 0x7fc5c8003ef0 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.303+0000 7fc5d9d9b640 1 -- 172.21.15.91:0/1886749967 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c402cba0 con 0x7fc5c8003ef0 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.304+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/1886749967 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5c8003ef0 msgr2=0x7fc5c80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.304+0000 7fc5e0ed3640 1 --2- 172.21.15.91:0/1886749967 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5c8003ef0 0x7fc5c80047c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009a90 tx=0x7fc5c80057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.304+0000 7fc5dad9d640 1 -- 172.21.15.91:0/1886749967 reap_dead start 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.304+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/1886749967 shutdown_connections 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.304+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/1886749967 >> 172.21.15.91:0/1886749967 conn(0x7fc5dc06a500 msgr2=0x7fc5dc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.304+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/1886749967 shutdown_connections 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.304+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/1886749967 wait complete. 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.306+0000 7fc5e0ed3640 1 Processor -- start 2023-11-27T20:43:03.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.306+0000 7fc5e0ed3640 1 -- start start 2023-11-27T20:43:03.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.307+0000 7fc5e0ed3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5c8003ef0 0x7fc5dc0bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.307+0000 7fc5e0ed3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5dc0bf630 0x7fc5dc1ea670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.307+0000 7fc5e0ed3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5dc1eabb0 0x7fc5dc14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.307+0000 7fc5e0ed3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc153c10 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.307+0000 7fc5e0ed3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1568f0 con 0x7fc5dc0bf630 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.307+0000 7fc5e0ed3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1ee2a0 con 0x7fc5c8003ef0 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.307+0000 7fc5dad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5dc1eabb0 0x7fc5dc14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.307+0000 7fc5dad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5dc1eabb0 0x7fc5dc14eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35562/0 (socket says 172.21.15.91:35562) 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.307+0000 7fc5dad9d640 1 -- 172.21.15.91:0/2443898248 learned_addr learned my addr 172.21.15.91:0/2443898248 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5da59c640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5c8003ef0 0x7fc5dc0bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5d3fff640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5dc0bf630 0x7fc5dc1ea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5dad9d640 1 -- 172.21.15.91:0/2443898248 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5c8003ef0 msgr2=0x7fc5dc0bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5dad9d640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5c8003ef0 0x7fc5dc0bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5dad9d640 1 -- 172.21.15.91:0/2443898248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5dc0bf630 msgr2=0x7fc5dc1ea670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5dad9d640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5dc0bf630 0x7fc5dc1ea670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5dad9d640 1 -- 172.21.15.91:0/2443898248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc1ee7d0 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5da59c640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5c8003ef0 0x7fc5dc0bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:03.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5d3fff640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5dc0bf630 0x7fc5dc1ea670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:03.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5dad9d640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5dc1eabb0 0x7fc5dc14eab0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0c6020 tx=0x7fc5d400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:03.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5d2ffd640 1 -- 172.21.15.91:0/2443898248 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4004d60 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5d2ffd640 1 -- 172.21.15.91:0/2443898248 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d400bb20 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.308+0000 7fc5d2ffd640 1 -- 172.21.15.91:0/2443898248 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d400be90 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.309+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/2443898248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc0aa6b0 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.309+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/2443898248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc0aa060 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.310+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/2443898248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc1ea370 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.311+0000 7fc5d2ffd640 1 -- 172.21.15.91:0/2443898248 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc5d4007110 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.312+0000 7fc5d2ffd640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc5bc06b1f0 0x7fc5bc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.312+0000 7fc5d2ffd640 1 -- 172.21.15.91:0/2443898248 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc5d408a0f0 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.312+0000 7fc5da59c640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc5bc06b1f0 0x7fc5bc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.313+0000 7fc5da59c640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc5bc06b1f0 0x7fc5bc06d6b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0c1350 tx=0x7fc5cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:03.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.316+0000 7fc5d2ffd640 1 -- 172.21.15.91:0/2443898248 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc5d4054ab0 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.509+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/2443898248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5dc068350 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.513+0000 7fc5d2ffd640 1 -- 172.21.15.91:0/2443898248 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20194 (secure 0 0 0) 0x7fc5d40580d0 con 0x7fc5dc1eabb0 2023-11-27T20:43:03.515 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:03.515 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":38,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:00.559657+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:03.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/2443898248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc5bc06b1f0 msgr2=0x7fc5bc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc5bc06b1f0 0x7fc5bc06d6b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0c1350 tx=0x7fc5cc008040 comp rx=0 tx=0).stop 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/2443898248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5dc1eabb0 msgr2=0x7fc5dc14eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5dc1eabb0 0x7fc5dc14eab0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0c6020 tx=0x7fc5d400b4a0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/2443898248 shutdown_connections 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5dc1eabb0 0x7fc5dc14eab0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc5bc06b1f0 0x7fc5bc06d6b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5dc0bf630 0x7fc5dc1ea670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 --2- 172.21.15.91:0/2443898248 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5c8003ef0 0x7fc5dc0bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/2443898248 >> 172.21.15.91:0/2443898248 conn(0x7fc5dc06a500 msgr2=0x7fc5dc0a7060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/2443898248 shutdown_connections 2023-11-27T20:43:03.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.516+0000 7fc5e0ed3640 1 -- 172.21.15.91:0/2443898248 wait complete. 2023-11-27T20:43:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T20:43:03.538 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:43:03.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.754+0000 7f7ecb5a9640 1 Processor -- start 2023-11-27T20:43:03.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.754+0000 7f7ecb5a9640 1 -- start start 2023-11-27T20:43:03.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.755+0000 7f7ecb5a9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7ec406d0a0 0x7f7ec4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.755+0000 7f7ecb5a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 0x7f7ec40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.755+0000 7f7ecb5a9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec40c64a0 con 0x7f7ec414fd30 2023-11-27T20:43:03.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.755+0000 7f7ecb5a9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec40c5c00 con 0x7f7ec406d0a0 2023-11-27T20:43:03.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.755+0000 7f7ecb5a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40c5ee0 con 0x7f7ec40c3ea0 2023-11-27T20:43:03.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ec9345640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f7ec414fd30 0x7f7ec40a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46950/0 (socket says 172.21.15.91:46950) 2023-11-27T20:43:03.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ec9345640 1 -- 172.21.15.91:0/1965128323 learned_addr learned my addr 172.21.15.91:0/1965128323 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:03.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ec8b44640 1 --2- 172.21.15.91:0/1965128323 >> v2:172.21.15.91:3300/0 conn(0x7f7ec406d0a0 0x7f7ec4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ebbfff640 1 -- 172.21.15.91:0/1965128323 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068962972 0 0) 0x7f7ec40c64a0 con 0x7f7ec414fd30 2023-11-27T20:43:03.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ebbfff640 1 -- 172.21.15.91:0/1965128323 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb0003520 con 0x7f7ec414fd30 2023-11-27T20:43:03.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ec9b46640 1 --2- 172.21.15.91:0/1965128323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 0x7f7ec40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ec8b44640 1 -- 172.21.15.91:0/1965128323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 msgr2=0x7f7ec40c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:03.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ec8b44640 1 --2- 172.21.15.91:0/1965128323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 0x7f7ec40c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ec8b44640 1 -- 172.21.15.91:0/1965128323 >> v1:172.21.15.91:6789/0 conn(0x7f7ec414fd30 legacy=0x7f7ec40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ec8b44640 1 -- 172.21.15.91:0/1965128323 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40c61c0 con 0x7f7ec406d0a0 2023-11-27T20:43:03.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.756+0000 7f7ec9b46640 1 --2- 172.21.15.91:0/1965128323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 0x7f7ec40c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:03.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.758+0000 7f7ec8b44640 1 --2- 172.21.15.91:0/1965128323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 0x7f7ec4152f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40097a0 tx=0x7f7eb402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c60d49900c88075 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:03.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.758+0000 7f7ebbfff640 1 -- 172.21.15.91:0/1965128323 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb402d040 con 0x7f7ec406d0a0 2023-11-27T20:43:03.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.758+0000 7f7ebbfff640 1 -- 172.21.15.91:0/1965128323 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb4031810 con 0x7f7ec406d0a0 2023-11-27T20:43:03.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.758+0000 7f7ebbfff640 1 -- 172.21.15.91:0/1965128323 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4031b80 con 0x7f7ec406d0a0 2023-11-27T20:43:03.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.758+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1965128323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 msgr2=0x7f7ec4152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.758+0000 7f7ecb5a9640 1 --2- 172.21.15.91:0/1965128323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 0x7f7ec4152f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40097a0 tx=0x7f7eb402b8b0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.758+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1965128323 shutdown_connections 2023-11-27T20:43:03.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.758+0000 7f7ecb5a9640 1 --2- 172.21.15.91:0/1965128323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 0x7f7ec40c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.758+0000 7f7ecb5a9640 1 --2- 172.21.15.91:0/1965128323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 0x7f7ec4152f20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.758+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1965128323 >> 172.21.15.91:0/1965128323 conn(0x7f7ec406a500 msgr2=0x7f7ec406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:03.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.759+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1965128323 shutdown_connections 2023-11-27T20:43:03.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.759+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1965128323 wait complete. 2023-11-27T20:43:03.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.760+0000 7f7ecb5a9640 1 Processor -- start 2023-11-27T20:43:03.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.760+0000 7f7ecb5a9640 1 -- start start 2023-11-27T20:43:03.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.761+0000 7f7ecb5a9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 0x7f7ec4156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.761+0000 7f7ecb5a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 0x7f7ec41eb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.761+0000 7f7ecb5a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ec414fd30 0x7f7ec41defa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.761+0000 7f7ecb5a9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec4155420 con 0x7f7ec406d0a0 2023-11-27T20:43:03.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.761+0000 7f7ecb5a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec41561d0 con 0x7f7ec414fd30 2023-11-27T20:43:03.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.761+0000 7f7ecb5a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec41df4e0 con 0x7f7ec40c3ea0 2023-11-27T20:43:03.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.761+0000 7f7ec9345640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 0x7f7ec4156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7ec9345640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 0x7f7ec4156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35574/0 (socket says 172.21.15.91:35574) 2023-11-27T20:43:03.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7ec9345640 1 -- 172.21.15.91:0/1747215033 learned_addr learned my addr 172.21.15.91:0/1747215033 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:03.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7ec8b44640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 0x7f7ec41eb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7ec9345640 1 -- 172.21.15.91:0/1747215033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 msgr2=0x7f7ec41eb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7ec9b46640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ec414fd30 0x7f7ec41defa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7ec9345640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 0x7f7ec41eb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7ec9345640 1 -- 172.21.15.91:0/1747215033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ec414fd30 msgr2=0x7f7ec41defa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7ec9345640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ec414fd30 0x7f7ec41defa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7ec9345640 1 -- 172.21.15.91:0/1747215033 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4009400 con 0x7f7ec406d0a0 2023-11-27T20:43:03.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7ec9345640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 0x7f7ec4156580 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000c430 tx=0x7f7ec000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:03.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.762+0000 7f7eb9ffb640 1 -- 172.21.15.91:0/1747215033 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0005ce0 con 0x7f7ec406d0a0 2023-11-27T20:43:03.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.763+0000 7f7eb9ffb640 1 -- 172.21.15.91:0/1747215033 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec0005e40 con 0x7f7ec406d0a0 2023-11-27T20:43:03.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.763+0000 7f7eb9ffb640 1 -- 172.21.15.91:0/1747215033 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00072f0 con 0x7f7ec406d0a0 2023-11-27T20:43:03.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.763+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1747215033 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec40a9c90 con 0x7f7ec406d0a0 2023-11-27T20:43:03.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.763+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1747215033 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec41eab30 con 0x7f7ec406d0a0 2023-11-27T20:43:03.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.764+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1747215033 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec4068350 con 0x7f7ec406d0a0 2023-11-27T20:43:03.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.765+0000 7f7eb9ffb640 1 -- 172.21.15.91:0/1747215033 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7ec0007450 con 0x7f7ec406d0a0 2023-11-27T20:43:03.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.766+0000 7f7eb9ffb640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ea806b1c0 0x7f7ea806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:03.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.766+0000 7f7eb9ffb640 1 -- 172.21.15.91:0/1747215033 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7ec00893e0 con 0x7f7ec406d0a0 2023-11-27T20:43:03.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.766+0000 7f7ec8b44640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ea806b1c0 0x7f7ea806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:03.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.767+0000 7f7ec8b44640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ea806b1c0 0x7f7ea806d680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4036000 tx=0x7f7eb403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:03.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.770+0000 7f7eb9ffb640 1 -- 172.21.15.91:0/1747215033 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7ec0057840 con 0x7f7ec406d0a0 2023-11-27T20:43:03.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.956+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1747215033 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ec4067430 con 0x7f7ea806b1c0 2023-11-27T20:43:03.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.977+0000 7f7eb9ffb640 1 -- 172.21.15.91:0/1747215033 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+513314 (secure 0 0 0) 0x7f7ec4067430 con 0x7f7ea806b1c0 2023-11-27T20:43:03.985 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:03.989 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:43:03.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1747215033 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ea806b1c0 msgr2=0x7f7ea806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ea806b1c0 0x7f7ea806d680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4036000 tx=0x7f7eb403c040 comp rx=0 tx=0).stop 2023-11-27T20:43:03.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1747215033 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 msgr2=0x7f7ec4156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:03.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 0x7f7ec4156580 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000c430 tx=0x7f7ec000c8f0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1747215033 shutdown_connections 2023-11-27T20:43:03.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ea806b1c0 0x7f7ea806d680 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ec414fd30 0x7f7ec41defa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ec40c3ea0 0x7f7ec41eb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 --2- 172.21.15.91:0/1747215033 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ec406d0a0 0x7f7ec4156580 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:03.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1747215033 >> 172.21.15.91:0/1747215033 conn(0x7f7ec406a500 msgr2=0x7f7ec40c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:03.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.984+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1747215033 shutdown_connections 2023-11-27T20:43:03.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:03.985+0000 7f7ecb5a9640 1 -- 172.21.15.91:0/1747215033 wait complete. 2023-11-27T20:43:04.006 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-27T20:43:03.400015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220476,"kb_used_data":4316,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754244,"statfs":{"total":773094113280,"available":772868345856,"internally_reserved":0,"allocated":4419584,"data_stored":2450755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.895590"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548391+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:42:39.548391+0000","last_peered":"2023-11-27T20:42:39.548391+0000","last_clean":"2023-11-27T20:42:39.548391+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:42:39.548391+0000","last_undegraded":"2023-11-27T20:42:39.548391+0000","last_fullsized":"2023-11-27T20:42:39.548391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546449+0000","last_change":"2023-11-27T20:42:37.523367+0000","last_active":"2023-11-27T20:42:39.546449+0000","last_peered":"2023-11-27T20:42:39.546449+0000","last_clean":"2023-11-27T20:42:39.546449+0000","last_became_active":"2023-11-27T20:42:37.522948+0000","last_became_peered":"2023-11-27T20:42:37.522948+0000","last_unstale":"2023-11-27T20:42:39.546449+0000","last_undegraded":"2023-11-27T20:42:39.546449+0000","last_fullsized":"2023-11-27T20:42:39.546449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.549536+0000","last_change":"2023-11-27T20:42:38.542611+0000","last_active":"2023-11-27T20:42:39.549536+0000","last_peered":"2023-11-27T20:42:39.549536+0000","last_clean":"2023-11-27T20:42:39.549536+0000","last_became_active":"2023-11-27T20:42:38.542177+0000","last_became_peered":"2023-11-27T20:42:38.542177+0000","last_unstale":"2023-11-27T20:42:39.549536+0000","last_undegraded":"2023-11-27T20:42:39.549536+0000","last_fullsized":"2023-11-27T20:42:39.549536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510564+0000","last_change":"2023-11-27T20:42:57.510564+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510564+0000","last_undegraded":"2023-11-27T20:42:57.510564+0000","last_fullsized":"2023-11-27T20:42:57.510564+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545308+0000","last_change":"2023-11-27T20:42:37.533800+0000","last_active":"2023-11-27T20:42:39.545308+0000","last_peered":"2023-11-27T20:42:39.545308+0000","last_clean":"2023-11-27T20:42:39.545308+0000","last_became_active":"2023-11-27T20:42:37.533358+0000","last_became_peered":"2023-11-27T20:42:37.533358+0000","last_unstale":"2023-11-27T20:42:39.545308+0000","last_undegraded":"2023-11-27T20:42:39.545308+0000","last_fullsized":"2023-11-27T20:42:39.545308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926329+0000","last_change":"2023-11-27T20:42:38.544391+0000","last_active":"2023-11-27T20:42:39.926329+0000","last_peered":"2023-11-27T20:42:39.926329+0000","last_clean":"2023-11-27T20:42:39.926329+0000","last_became_active":"2023-11-27T20:42:38.544114+0000","last_became_peered":"2023-11-27T20:42:38.544114+0000","last_unstale":"2023-11-27T20:42:39.926329+0000","last_undegraded":"2023-11-27T20:42:39.926329+0000","last_fullsized":"2023-11-27T20:42:39.926329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518058+0000","last_change":"2023-11-27T20:42:57.518058+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518058+0000","last_undegraded":"2023-11-27T20:42:57.518058+0000","last_fullsized":"2023-11-27T20:42:57.518058+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927152+0000","last_change":"2023-11-27T20:42:37.530919+0000","last_active":"2023-11-27T20:42:39.927152+0000","last_peered":"2023-11-27T20:42:39.927152+0000","last_clean":"2023-11-27T20:42:39.927152+0000","last_became_active":"2023-11-27T20:42:37.530606+0000","last_became_peered":"2023-11-27T20:42:37.530606+0000","last_unstale":"2023-11-27T20:42:39.927152+0000","last_undegraded":"2023-11-27T20:42:39.927152+0000","last_fullsized":"2023-11-27T20:42:39.927152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:26.686814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545481+0000","last_change":"2023-11-27T20:42:38.556454+0000","last_active":"2023-11-27T20:42:39.545481+0000","last_peered":"2023-11-27T20:42:39.545481+0000","last_clean":"2023-11-27T20:42:39.545481+0000","last_became_active":"2023-11-27T20:42:38.556194+0000","last_became_peered":"2023-11-27T20:42:38.556194+0000","last_unstale":"2023-11-27T20:42:39.545481+0000","last_undegraded":"2023-11-27T20:42:39.545481+0000","last_fullsized":"2023-11-27T20:42:39.545481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526221+0000","last_change":"2023-11-27T20:42:57.526221+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526221+0000","last_undegraded":"2023-11-27T20:42:57.526221+0000","last_fullsized":"2023-11-27T20:42:57.526221+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832832+0000","last_change":"2023-11-27T20:42:37.529807+0000","last_active":"2023-11-27T20:42:39.832832+0000","last_peered":"2023-11-27T20:42:39.832832+0000","last_clean":"2023-11-27T20:42:39.832832+0000","last_became_active":"2023-11-27T20:42:37.529543+0000","last_became_peered":"2023-11-27T20:42:37.529543+0000","last_unstale":"2023-11-27T20:42:39.832832+0000","last_undegraded":"2023-11-27T20:42:39.832832+0000","last_fullsized":"2023-11-27T20:42:39.832832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562085+0000","last_change":"2023-11-27T20:42:38.531762+0000","last_active":"2023-11-27T20:42:39.562085+0000","last_peered":"2023-11-27T20:42:39.562085+0000","last_clean":"2023-11-27T20:42:39.562085+0000","last_became_active":"2023-11-27T20:42:38.531490+0000","last_became_peered":"2023-11-27T20:42:38.531490+0000","last_unstale":"2023-11-27T20:42:39.562085+0000","last_undegraded":"2023-11-27T20:42:39.562085+0000","last_fullsized":"2023-11-27T20:42:39.562085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516201+0000","last_change":"2023-11-27T20:42:57.516201+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516201+0000","last_undegraded":"2023-11-27T20:42:57.516201+0000","last_fullsized":"2023-11-27T20:42:57.516201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562653+0000","last_change":"2023-11-27T20:42:37.532441+0000","last_active":"2023-11-27T20:42:39.562653+0000","last_peered":"2023-11-27T20:42:39.562653+0000","last_clean":"2023-11-27T20:42:39.562653+0000","last_became_active":"2023-11-27T20:42:37.532074+0000","last_became_peered":"2023-11-27T20:42:37.532074+0000","last_unstale":"2023-11-27T20:42:39.562653+0000","last_undegraded":"2023-11-27T20:42:39.562653+0000","last_fullsized":"2023-11-27T20:42:39.562653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:04.889609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546138+0000","last_change":"2023-11-27T20:42:38.533430+0000","last_active":"2023-11-27T20:42:39.546138+0000","last_peered":"2023-11-27T20:42:39.546138+0000","last_clean":"2023-11-27T20:42:39.546138+0000","last_became_active":"2023-11-27T20:42:38.532325+0000","last_became_peered":"2023-11-27T20:42:38.532325+0000","last_unstale":"2023-11-27T20:42:39.546138+0000","last_undegraded":"2023-11-27T20:42:39.546138+0000","last_fullsized":"2023-11-27T20:42:39.546138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510732+0000","last_change":"2023-11-27T20:42:57.510732+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510732+0000","last_undegraded":"2023-11-27T20:42:57.510732+0000","last_fullsized":"2023-11-27T20:42:57.510732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833620+0000","last_change":"2023-11-27T20:42:37.527056+0000","last_active":"2023-11-27T20:42:39.833620+0000","last_peered":"2023-11-27T20:42:39.833620+0000","last_clean":"2023-11-27T20:42:39.833620+0000","last_became_active":"2023-11-27T20:42:37.526803+0000","last_became_peered":"2023-11-27T20:42:37.526803+0000","last_unstale":"2023-11-27T20:42:39.833620+0000","last_undegraded":"2023-11-27T20:42:39.833620+0000","last_fullsized":"2023-11-27T20:42:39.833620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561663+0000","last_change":"2023-11-27T20:42:38.536715+0000","last_active":"2023-11-27T20:42:39.561663+0000","last_peered":"2023-11-27T20:42:39.561663+0000","last_clean":"2023-11-27T20:42:39.561663+0000","last_became_active":"2023-11-27T20:42:38.536349+0000","last_became_peered":"2023-11-27T20:42:38.536349+0000","last_unstale":"2023-11-27T20:42:39.561663+0000","last_undegraded":"2023-11-27T20:42:39.561663+0000","last_fullsized":"2023-11-27T20:42:39.561663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.517117+0000","last_change":"2023-11-27T20:42:57.517117+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.517117+0000","last_undegraded":"2023-11-27T20:42:57.517117+0000","last_fullsized":"2023-11-27T20:42:57.517117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.831237+0000","last_change":"2023-11-27T20:42:37.528142+0000","last_active":"2023-11-27T20:42:39.831237+0000","last_peered":"2023-11-27T20:42:39.831237+0000","last_clean":"2023-11-27T20:42:39.831237+0000","last_became_active":"2023-11-27T20:42:37.527318+0000","last_became_peered":"2023-11-27T20:42:37.527318+0000","last_unstale":"2023-11-27T20:42:39.831237+0000","last_undegraded":"2023-11-27T20:42:39.831237+0000","last_fullsized":"2023-11-27T20:42:39.831237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849506+0000","last_change":"2023-11-27T20:42:38.553617+0000","last_active":"2023-11-27T20:42:39.849506+0000","last_peered":"2023-11-27T20:42:39.849506+0000","last_clean":"2023-11-27T20:42:39.849506+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:39.849506+0000","last_undegraded":"2023-11-27T20:42:39.849506+0000","last_fullsized":"2023-11-27T20:42:39.849506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.511845+0000","last_change":"2023-11-27T20:42:57.511845+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.511845+0000","last_undegraded":"2023-11-27T20:42:57.511845+0000","last_fullsized":"2023-11-27T20:42:57.511845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.834058+0000","last_change":"2023-11-27T20:42:37.530114+0000","last_active":"2023-11-27T20:42:39.834058+0000","last_peered":"2023-11-27T20:42:39.834058+0000","last_clean":"2023-11-27T20:42:39.834058+0000","last_became_active":"2023-11-27T20:42:37.529838+0000","last_became_peered":"2023-11-27T20:42:37.529838+0000","last_unstale":"2023-11-27T20:42:39.834058+0000","last_undegraded":"2023-11-27T20:42:39.834058+0000","last_fullsized":"2023-11-27T20:42:39.834058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926678+0000","last_change":"2023-11-27T20:42:38.551126+0000","last_active":"2023-11-27T20:42:39.926678+0000","last_peered":"2023-11-27T20:42:39.926678+0000","last_clean":"2023-11-27T20:42:39.926678+0000","last_became_active":"2023-11-27T20:42:38.550881+0000","last_became_peered":"2023-11-27T20:42:38.550881+0000","last_unstale":"2023-11-27T20:42:39.926678+0000","last_undegraded":"2023-11-27T20:42:39.926678+0000","last_fullsized":"2023-11-27T20:42:39.926678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:08.745845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.527169+0000","last_change":"2023-11-27T20:42:57.527169+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.527169+0000","last_undegraded":"2023-11-27T20:42:57.527169+0000","last_fullsized":"2023-11-27T20:42:57.527169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848218+0000","last_change":"2023-11-27T20:42:37.532212+0000","last_active":"2023-11-27T20:42:39.848218+0000","last_peered":"2023-11-27T20:42:39.848218+0000","last_clean":"2023-11-27T20:42:39.848218+0000","last_became_active":"2023-11-27T20:42:37.531894+0000","last_became_peered":"2023-11-27T20:42:37.531894+0000","last_unstale":"2023-11-27T20:42:39.848218+0000","last_undegraded":"2023-11-27T20:42:39.848218+0000","last_fullsized":"2023-11-27T20:42:39.848218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547400+0000","last_change":"2023-11-27T20:42:38.537364+0000","last_active":"2023-11-27T20:42:39.547400+0000","last_peered":"2023-11-27T20:42:39.547400+0000","last_clean":"2023-11-27T20:42:39.547400+0000","last_became_active":"2023-11-27T20:42:38.536521+0000","last_became_peered":"2023-11-27T20:42:38.536521+0000","last_unstale":"2023-11-27T20:42:39.547400+0000","last_undegraded":"2023-11-27T20:42:39.547400+0000","last_fullsized":"2023-11-27T20:42:39.547400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510514+0000","last_change":"2023-11-27T20:42:57.510514+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510514+0000","last_undegraded":"2023-11-27T20:42:57.510514+0000","last_fullsized":"2023-11-27T20:42:57.510514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926403+0000","last_change":"2023-11-27T20:42:37.518579+0000","last_active":"2023-11-27T20:42:39.926403+0000","last_peered":"2023-11-27T20:42:39.926403+0000","last_clean":"2023-11-27T20:42:39.926403+0000","last_became_active":"2023-11-27T20:42:37.517970+0000","last_became_peered":"2023-11-27T20:42:37.517970+0000","last_unstale":"2023-11-27T20:42:39.926403+0000","last_undegraded":"2023-11-27T20:42:39.926403+0000","last_fullsized":"2023-11-27T20:42:39.926403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.925849+0000","last_change":"2023-11-27T20:42:38.539525+0000","last_active":"2023-11-27T20:42:39.925849+0000","last_peered":"2023-11-27T20:42:39.925849+0000","last_clean":"2023-11-27T20:42:39.925849+0000","last_became_active":"2023-11-27T20:42:38.539244+0000","last_became_peered":"2023-11-27T20:42:38.539244+0000","last_unstale":"2023-11-27T20:42:39.925849+0000","last_undegraded":"2023-11-27T20:42:39.925849+0000","last_fullsized":"2023-11-27T20:42:39.925849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:12:08.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518026+0000","last_change":"2023-11-27T20:42:57.518026+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518026+0000","last_undegraded":"2023-11-27T20:42:57.518026+0000","last_fullsized":"2023-11-27T20:42:57.518026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546116+0000","last_change":"2023-11-27T20:42:37.522543+0000","last_active":"2023-11-27T20:42:39.546116+0000","last_peered":"2023-11-27T20:42:39.546116+0000","last_clean":"2023-11-27T20:42:39.546116+0000","last_became_active":"2023-11-27T20:42:37.522163+0000","last_became_peered":"2023-11-27T20:42:37.522163+0000","last_unstale":"2023-11-27T20:42:39.546116+0000","last_undegraded":"2023-11-27T20:42:39.546116+0000","last_fullsized":"2023-11-27T20:42:39.546116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:46.239563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926297+0000","last_change":"2023-11-27T20:42:38.536322+0000","last_active":"2023-11-27T20:42:39.926297+0000","last_peered":"2023-11-27T20:42:39.926297+0000","last_clean":"2023-11-27T20:42:39.926297+0000","last_became_active":"2023-11-27T20:42:38.536051+0000","last_became_peered":"2023-11-27T20:42:38.536051+0000","last_unstale":"2023-11-27T20:42:39.926297+0000","last_undegraded":"2023-11-27T20:42:39.926297+0000","last_fullsized":"2023-11-27T20:42:39.926297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:31.539798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526042+0000","last_change":"2023-11-27T20:42:57.526042+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526042+0000","last_undegraded":"2023-11-27T20:42:57.526042+0000","last_fullsized":"2023-11-27T20:42:57.526042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562351+0000","last_change":"2023-11-27T20:42:37.527591+0000","last_active":"2023-11-27T20:42:39.562351+0000","last_peered":"2023-11-27T20:42:39.562351+0000","last_clean":"2023-11-27T20:42:39.562351+0000","last_became_active":"2023-11-27T20:42:37.527305+0000","last_became_peered":"2023-11-27T20:42:37.527305+0000","last_unstale":"2023-11-27T20:42:39.562351+0000","last_undegraded":"2023-11-27T20:42:39.562351+0000","last_fullsized":"2023-11-27T20:42:39.562351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926039+0000","last_change":"2023-11-27T20:42:38.547894+0000","last_active":"2023-11-27T20:42:39.926039+0000","last_peered":"2023-11-27T20:42:39.926039+0000","last_clean":"2023-11-27T20:42:39.926039+0000","last_became_active":"2023-11-27T20:42:38.547558+0000","last_became_peered":"2023-11-27T20:42:38.547558+0000","last_unstale":"2023-11-27T20:42:39.926039+0000","last_undegraded":"2023-11-27T20:42:39.926039+0000","last_fullsized":"2023-11-27T20:42:39.926039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:38.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516720+0000","last_change":"2023-11-27T20:42:57.516720+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516720+0000","last_undegraded":"2023-11-27T20:42:57.516720+0000","last_fullsized":"2023-11-27T20:42:57.516720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927409+0000","last_change":"2023-11-27T20:42:37.527131+0000","last_active":"2023-11-27T20:42:39.927409+0000","last_peered":"2023-11-27T20:42:39.927409+0000","last_clean":"2023-11-27T20:42:39.927409+0000","last_became_active":"2023-11-27T20:42:37.526804+0000","last_became_peered":"2023-11-27T20:42:37.526804+0000","last_unstale":"2023-11-27T20:42:39.927409+0000","last_undegraded":"2023-11-27T20:42:39.927409+0000","last_fullsized":"2023-11-27T20:42:39.927409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926551+0000","last_change":"2023-11-27T20:42:38.549244+0000","last_active":"2023-11-27T20:42:39.926551+0000","last_peered":"2023-11-27T20:42:39.926551+0000","last_clean":"2023-11-27T20:42:39.926551+0000","last_became_active":"2023-11-27T20:42:38.548660+0000","last_became_peered":"2023-11-27T20:42:38.548660+0000","last_unstale":"2023-11-27T20:42:39.926551+0000","last_undegraded":"2023-11-27T20:42:39.926551+0000","last_fullsized":"2023-11-27T20:42:39.926551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:22.348409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.520466+0000","last_change":"2023-11-27T20:42:57.520466+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.520466+0000","last_undegraded":"2023-11-27T20:42:57.520466+0000","last_fullsized":"2023-11-27T20:42:57.520466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927419+0000","last_change":"2023-11-27T20:42:37.525601+0000","last_active":"2023-11-27T20:42:39.927419+0000","last_peered":"2023-11-27T20:42:39.927419+0000","last_clean":"2023-11-27T20:42:39.927419+0000","last_became_active":"2023-11-27T20:42:37.525296+0000","last_became_peered":"2023-11-27T20:42:37.525296+0000","last_unstale":"2023-11-27T20:42:39.927419+0000","last_undegraded":"2023-11-27T20:42:39.927419+0000","last_fullsized":"2023-11-27T20:42:39.927419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833446+0000","last_change":"2023-11-27T20:42:38.554165+0000","last_active":"2023-11-27T20:42:39.833446+0000","last_peered":"2023-11-27T20:42:39.833446+0000","last_clean":"2023-11-27T20:42:39.833446+0000","last_became_active":"2023-11-27T20:42:38.553912+0000","last_became_peered":"2023-11-27T20:42:38.553912+0000","last_unstale":"2023-11-27T20:42:39.833446+0000","last_undegraded":"2023-11-27T20:42:39.833446+0000","last_fullsized":"2023-11-27T20:42:39.833446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.511643+0000","last_change":"2023-11-27T20:42:57.511643+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.511643+0000","last_undegraded":"2023-11-27T20:42:57.511643+0000","last_fullsized":"2023-11-27T20:42:57.511643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927463+0000","last_change":"2023-11-27T20:42:37.522245+0000","last_active":"2023-11-27T20:42:39.927463+0000","last_peered":"2023-11-27T20:42:39.927463+0000","last_clean":"2023-11-27T20:42:39.927463+0000","last_became_active":"2023-11-27T20:42:37.521938+0000","last_became_peered":"2023-11-27T20:42:37.521938+0000","last_unstale":"2023-11-27T20:42:39.927463+0000","last_undegraded":"2023-11-27T20:42:39.927463+0000","last_fullsized":"2023-11-27T20:42:39.927463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849278+0000","last_change":"2023-11-27T20:42:38.549553+0000","last_active":"2023-11-27T20:42:39.849278+0000","last_peered":"2023-11-27T20:42:39.849278+0000","last_clean":"2023-11-27T20:42:39.849278+0000","last_became_active":"2023-11-27T20:42:38.549075+0000","last_became_peered":"2023-11-27T20:42:38.549075+0000","last_unstale":"2023-11-27T20:42:39.849278+0000","last_undegraded":"2023-11-27T20:42:39.849278+0000","last_fullsized":"2023-11-27T20:42:39.849278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.517619+0000","last_change":"2023-11-27T20:42:57.517619+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.517619+0000","last_undegraded":"2023-11-27T20:42:57.517619+0000","last_fullsized":"2023-11-27T20:42:57.517619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.834022+0000","last_change":"2023-11-27T20:42:37.525560+0000","last_active":"2023-11-27T20:42:39.834022+0000","last_peered":"2023-11-27T20:42:39.834022+0000","last_clean":"2023-11-27T20:42:39.834022+0000","last_became_active":"2023-11-27T20:42:37.525261+0000","last_became_peered":"2023-11-27T20:42:37.525261+0000","last_unstale":"2023-11-27T20:42:39.834022+0000","last_undegraded":"2023-11-27T20:42:39.834022+0000","last_fullsized":"2023-11-27T20:42:39.834022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:16.392657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927183+0000","last_change":"2023-11-27T20:42:38.546056+0000","last_active":"2023-11-27T20:42:39.927183+0000","last_peered":"2023-11-27T20:42:39.927183+0000","last_clean":"2023-11-27T20:42:39.927183+0000","last_became_active":"2023-11-27T20:42:38.545736+0000","last_became_peered":"2023-11-27T20:42:38.545736+0000","last_unstale":"2023-11-27T20:42:39.927183+0000","last_undegraded":"2023-11-27T20:42:39.927183+0000","last_fullsized":"2023-11-27T20:42:39.927183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510435+0000","last_change":"2023-11-27T20:42:57.510435+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510435+0000","last_undegraded":"2023-11-27T20:42:57.510435+0000","last_fullsized":"2023-11-27T20:42:57.510435+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545443+0000","last_change":"2023-11-27T20:42:37.514338+0000","last_active":"2023-11-27T20:42:39.545443+0000","last_peered":"2023-11-27T20:42:39.545443+0000","last_clean":"2023-11-27T20:42:39.545443+0000","last_became_active":"2023-11-27T20:42:37.514055+0000","last_became_peered":"2023-11-27T20:42:37.514055+0000","last_unstale":"2023-11-27T20:42:39.545443+0000","last_undegraded":"2023-11-27T20:42:39.545443+0000","last_fullsized":"2023-11-27T20:42:39.545443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546366+0000","last_change":"2023-11-27T20:42:38.547970+0000","last_active":"2023-11-27T20:42:39.546366+0000","last_peered":"2023-11-27T20:42:39.546366+0000","last_clean":"2023-11-27T20:42:39.546366+0000","last_became_active":"2023-11-27T20:42:38.547656+0000","last_became_peered":"2023-11-27T20:42:38.547656+0000","last_unstale":"2023-11-27T20:42:39.546366+0000","last_undegraded":"2023-11-27T20:42:39.546366+0000","last_fullsized":"2023-11-27T20:42:39.546366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526486+0000","last_change":"2023-11-27T20:42:57.526486+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526486+0000","last_undegraded":"2023-11-27T20:42:57.526486+0000","last_fullsized":"2023-11-27T20:42:57.526486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545452+0000","last_change":"2023-11-27T20:42:37.535247+0000","last_active":"2023-11-27T20:42:39.545452+0000","last_peered":"2023-11-27T20:42:39.545452+0000","last_clean":"2023-11-27T20:42:39.545452+0000","last_became_active":"2023-11-27T20:42:37.534922+0000","last_became_peered":"2023-11-27T20:42:37.534922+0000","last_unstale":"2023-11-27T20:42:39.545452+0000","last_undegraded":"2023-11-27T20:42:39.545452+0000","last_fullsized":"2023-11-27T20:42:39.545452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:45.108775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547677+0000","last_change":"2023-11-27T20:42:38.548304+0000","last_active":"2023-11-27T20:42:39.547677+0000","last_peered":"2023-11-27T20:42:39.547677+0000","last_clean":"2023-11-27T20:42:39.547677+0000","last_became_active":"2023-11-27T20:42:38.547970+0000","last_became_peered":"2023-11-27T20:42:38.547970+0000","last_unstale":"2023-11-27T20:42:39.547677+0000","last_undegraded":"2023-11-27T20:42:39.547677+0000","last_fullsized":"2023-11-27T20:42:39.547677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518549+0000","last_change":"2023-11-27T20:42:57.518549+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518549+0000","last_undegraded":"2023-11-27T20:42:57.518549+0000","last_fullsized":"2023-11-27T20:42:57.518549+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832636+0000","last_change":"2023-11-27T20:42:37.522904+0000","last_active":"2023-11-27T20:42:39.832636+0000","last_peered":"2023-11-27T20:42:39.832636+0000","last_clean":"2023-11-27T20:42:39.832636+0000","last_became_active":"2023-11-27T20:42:37.522574+0000","last_became_peered":"2023-11-27T20:42:37.522574+0000","last_unstale":"2023-11-27T20:42:39.832636+0000","last_undegraded":"2023-11-27T20:42:39.832636+0000","last_fullsized":"2023-11-27T20:42:39.832636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546755+0000","last_change":"2023-11-27T20:42:38.553812+0000","last_active":"2023-11-27T20:42:39.546755+0000","last_peered":"2023-11-27T20:42:39.546755+0000","last_clean":"2023-11-27T20:42:39.546755+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:39.546755+0000","last_undegraded":"2023-11-27T20:42:39.546755+0000","last_fullsized":"2023-11-27T20:42:39.546755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:21.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516790+0000","last_change":"2023-11-27T20:42:57.516790+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516790+0000","last_undegraded":"2023-11-27T20:42:57.516790+0000","last_fullsized":"2023-11-27T20:42:57.516790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927117+0000","last_change":"2023-11-27T20:42:37.524294+0000","last_active":"2023-11-27T20:42:39.927117+0000","last_peered":"2023-11-27T20:42:39.927117+0000","last_clean":"2023-11-27T20:42:39.927117+0000","last_became_active":"2023-11-27T20:42:37.523858+0000","last_became_peered":"2023-11-27T20:42:37.523858+0000","last_unstale":"2023-11-27T20:42:39.927117+0000","last_undegraded":"2023-11-27T20:42:39.927117+0000","last_fullsized":"2023-11-27T20:42:39.927117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832659+0000","last_change":"2023-11-27T20:42:38.543201+0000","last_active":"2023-11-27T20:42:39.832659+0000","last_peered":"2023-11-27T20:42:39.832659+0000","last_clean":"2023-11-27T20:42:39.832659+0000","last_became_active":"2023-11-27T20:42:38.542920+0000","last_became_peered":"2023-11-27T20:42:38.542920+0000","last_unstale":"2023-11-27T20:42:39.832659+0000","last_undegraded":"2023-11-27T20:42:39.832659+0000","last_fullsized":"2023-11-27T20:42:39.832659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516769+0000","last_change":"2023-11-27T20:42:57.516769+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516769+0000","last_undegraded":"2023-11-27T20:42:57.516769+0000","last_fullsized":"2023-11-27T20:42:57.516769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:53.057510+0000","last_change":"2023-11-27T20:42:37.523173+0000","last_active":"2023-11-27T20:42:53.057510+0000","last_peered":"2023-11-27T20:42:53.057510+0000","last_clean":"2023-11-27T20:42:53.057510+0000","last_became_active":"2023-11-27T20:42:37.522903+0000","last_became_peered":"2023-11-27T20:42:37.522903+0000","last_unstale":"2023-11-27T20:42:53.057510+0000","last_undegraded":"2023-11-27T20:42:53.057510+0000","last_fullsized":"2023-11-27T20:42:53.057510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:28.381599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848936+0000","last_change":"2023-11-27T20:42:38.557705+0000","last_active":"2023-11-27T20:42:39.848936+0000","last_peered":"2023-11-27T20:42:39.848936+0000","last_clean":"2023-11-27T20:42:39.848936+0000","last_became_active":"2023-11-27T20:42:38.557251+0000","last_became_peered":"2023-11-27T20:42:38.557251+0000","last_unstale":"2023-11-27T20:42:39.848936+0000","last_undegraded":"2023-11-27T20:42:39.848936+0000","last_fullsized":"2023-11-27T20:42:39.848936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516409+0000","last_change":"2023-11-27T20:42:57.516409+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516409+0000","last_undegraded":"2023-11-27T20:42:57.516409+0000","last_fullsized":"2023-11-27T20:42:57.516409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849118+0000","last_change":"2023-11-27T20:42:37.530460+0000","last_active":"2023-11-27T20:42:39.849118+0000","last_peered":"2023-11-27T20:42:39.849118+0000","last_clean":"2023-11-27T20:42:39.849118+0000","last_became_active":"2023-11-27T20:42:37.529879+0000","last_became_peered":"2023-11-27T20:42:37.529879+0000","last_unstale":"2023-11-27T20:42:39.849118+0000","last_undegraded":"2023-11-27T20:42:39.849118+0000","last_fullsized":"2023-11-27T20:42:39.849118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:58.185242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545848+0000","last_change":"2023-11-27T20:42:38.555684+0000","last_active":"2023-11-27T20:42:39.545848+0000","last_peered":"2023-11-27T20:42:39.545848+0000","last_clean":"2023-11-27T20:42:39.545848+0000","last_became_active":"2023-11-27T20:42:38.555415+0000","last_became_peered":"2023-11-27T20:42:38.555415+0000","last_unstale":"2023-11-27T20:42:39.545848+0000","last_undegraded":"2023-11-27T20:42:39.545848+0000","last_fullsized":"2023-11-27T20:42:39.545848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518638+0000","last_change":"2023-11-27T20:42:57.518638+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518638+0000","last_undegraded":"2023-11-27T20:42:57.518638+0000","last_fullsized":"2023-11-27T20:42:57.518638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562223+0000","last_change":"2023-11-27T20:42:37.532869+0000","last_active":"2023-11-27T20:42:39.562223+0000","last_peered":"2023-11-27T20:42:39.562223+0000","last_clean":"2023-11-27T20:42:39.562223+0000","last_became_active":"2023-11-27T20:42:37.532576+0000","last_became_peered":"2023-11-27T20:42:37.532576+0000","last_unstale":"2023-11-27T20:42:39.562223+0000","last_undegraded":"2023-11-27T20:42:39.562223+0000","last_fullsized":"2023-11-27T20:42:39.562223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546630+0000","last_change":"2023-11-27T20:42:38.559970+0000","last_active":"2023-11-27T20:42:39.546630+0000","last_peered":"2023-11-27T20:42:39.546630+0000","last_clean":"2023-11-27T20:42:39.546630+0000","last_became_active":"2023-11-27T20:42:38.559688+0000","last_became_peered":"2023-11-27T20:42:38.559688+0000","last_unstale":"2023-11-27T20:42:39.546630+0000","last_undegraded":"2023-11-27T20:42:39.546630+0000","last_fullsized":"2023-11-27T20:42:39.546630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:47.260947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.511654+0000","last_change":"2023-11-27T20:42:57.511654+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.511654+0000","last_undegraded":"2023-11-27T20:42:57.511654+0000","last_fullsized":"2023-11-27T20:42:57.511654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546639+0000","last_change":"2023-11-27T20:42:37.531762+0000","last_active":"2023-11-27T20:42:39.546639+0000","last_peered":"2023-11-27T20:42:39.546639+0000","last_clean":"2023-11-27T20:42:39.546639+0000","last_became_active":"2023-11-27T20:42:37.531446+0000","last_became_peered":"2023-11-27T20:42:37.531446+0000","last_unstale":"2023-11-27T20:42:39.546639+0000","last_undegraded":"2023-11-27T20:42:39.546639+0000","last_fullsized":"2023-11-27T20:42:39.546639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:11.474537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849378+0000","last_change":"2023-11-27T20:42:38.555603+0000","last_active":"2023-11-27T20:42:39.849378+0000","last_peered":"2023-11-27T20:42:39.849378+0000","last_clean":"2023-11-27T20:42:39.849378+0000","last_became_active":"2023-11-27T20:42:38.555305+0000","last_became_peered":"2023-11-27T20:42:38.555305+0000","last_unstale":"2023-11-27T20:42:39.849378+0000","last_undegraded":"2023-11-27T20:42:39.849378+0000","last_fullsized":"2023-11-27T20:42:39.849378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.528207+0000","last_change":"2023-11-27T20:42:57.528207+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.528207+0000","last_undegraded":"2023-11-27T20:42:57.528207+0000","last_fullsized":"2023-11-27T20:42:57.528207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926258+0000","last_change":"2023-11-27T20:42:37.522230+0000","last_active":"2023-11-27T20:42:39.926258+0000","last_peered":"2023-11-27T20:42:39.926258+0000","last_clean":"2023-11-27T20:42:39.926258+0000","last_became_active":"2023-11-27T20:42:37.521898+0000","last_became_peered":"2023-11-27T20:42:37.521898+0000","last_unstale":"2023-11-27T20:42:39.926258+0000","last_undegraded":"2023-11-27T20:42:39.926258+0000","last_fullsized":"2023-11-27T20:42:39.926258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:16:18.992040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832678+0000","last_change":"2023-11-27T20:42:38.538177+0000","last_active":"2023-11-27T20:42:39.832678+0000","last_peered":"2023-11-27T20:42:39.832678+0000","last_clean":"2023-11-27T20:42:39.832678+0000","last_became_active":"2023-11-27T20:42:38.537835+0000","last_became_peered":"2023-11-27T20:42:38.537835+0000","last_unstale":"2023-11-27T20:42:39.832678+0000","last_undegraded":"2023-11-27T20:42:39.832678+0000","last_fullsized":"2023-11-27T20:42:39.832678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.519383+0000","last_change":"2023-11-27T20:42:57.519383+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.519383+0000","last_undegraded":"2023-11-27T20:42:57.519383+0000","last_fullsized":"2023-11-27T20:42:57.519383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545442+0000","last_change":"2023-11-27T20:42:37.522964+0000","last_active":"2023-11-27T20:42:39.545442+0000","last_peered":"2023-11-27T20:42:39.545442+0000","last_clean":"2023-11-27T20:42:39.545442+0000","last_became_active":"2023-11-27T20:42:37.522677+0000","last_became_peered":"2023-11-27T20:42:37.522677+0000","last_unstale":"2023-11-27T20:42:39.545442+0000","last_undegraded":"2023-11-27T20:42:39.545442+0000","last_fullsized":"2023-11-27T20:42:39.545442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:30.748479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926310+0000","last_change":"2023-11-27T20:42:38.533572+0000","last_active":"2023-11-27T20:42:39.926310+0000","last_peered":"2023-11-27T20:42:39.926310+0000","last_clean":"2023-11-27T20:42:39.926310+0000","last_became_active":"2023-11-27T20:42:38.533281+0000","last_became_peered":"2023-11-27T20:42:38.533281+0000","last_unstale":"2023-11-27T20:42:39.926310+0000","last_undegraded":"2023-11-27T20:42:39.926310+0000","last_fullsized":"2023-11-27T20:42:39.926310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.519078+0000","last_change":"2023-11-27T20:42:57.519078+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.519078+0000","last_undegraded":"2023-11-27T20:42:57.519078+0000","last_fullsized":"2023-11-27T20:42:57.519078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926655+0000","last_change":"2023-11-27T20:42:37.531654+0000","last_active":"2023-11-27T20:42:39.926655+0000","last_peered":"2023-11-27T20:42:39.926655+0000","last_clean":"2023-11-27T20:42:39.926655+0000","last_became_active":"2023-11-27T20:42:37.529901+0000","last_became_peered":"2023-11-27T20:42:37.529901+0000","last_unstale":"2023-11-27T20:42:39.926655+0000","last_undegraded":"2023-11-27T20:42:39.926655+0000","last_fullsized":"2023-11-27T20:42:39.926655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848846+0000","last_change":"2023-11-27T20:42:38.545564+0000","last_active":"2023-11-27T20:42:39.848846+0000","last_peered":"2023-11-27T20:42:39.848846+0000","last_clean":"2023-11-27T20:42:39.848846+0000","last_became_active":"2023-11-27T20:42:38.545232+0000","last_became_peered":"2023-11-27T20:42:38.545232+0000","last_unstale":"2023-11-27T20:42:39.848846+0000","last_undegraded":"2023-11-27T20:42:39.848846+0000","last_fullsized":"2023-11-27T20:42:39.848846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.517252+0000","last_change":"2023-11-27T20:42:57.517252+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.517252+0000","last_undegraded":"2023-11-27T20:42:57.517252+0000","last_fullsized":"2023-11-27T20:42:57.517252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927435+0000","last_change":"2023-11-27T20:42:37.527381+0000","last_active":"2023-11-27T20:42:39.927435+0000","last_peered":"2023-11-27T20:42:39.927435+0000","last_clean":"2023-11-27T20:42:39.927435+0000","last_became_active":"2023-11-27T20:42:37.527147+0000","last_became_peered":"2023-11-27T20:42:37.527147+0000","last_unstale":"2023-11-27T20:42:39.927435+0000","last_undegraded":"2023-11-27T20:42:39.927435+0000","last_fullsized":"2023-11-27T20:42:39.927435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548933+0000","last_change":"2023-11-27T20:42:38.552242+0000","last_active":"2023-11-27T20:42:39.548933+0000","last_peered":"2023-11-27T20:42:39.548933+0000","last_clean":"2023-11-27T20:42:39.548933+0000","last_became_active":"2023-11-27T20:42:38.551805+0000","last_became_peered":"2023-11-27T20:42:38.551805+0000","last_unstale":"2023-11-27T20:42:39.548933+0000","last_undegraded":"2023-11-27T20:42:39.548933+0000","last_fullsized":"2023-11-27T20:42:39.548933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510670+0000","last_change":"2023-11-27T20:42:57.510670+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510670+0000","last_undegraded":"2023-11-27T20:42:57.510670+0000","last_fullsized":"2023-11-27T20:42:57.510670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.519360+0000","last_change":"2023-11-27T20:42:57.519360+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.519360+0000","last_undegraded":"2023-11-27T20:42:57.519360+0000","last_fullsized":"2023-11-27T20:42:57.519360+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926662+0000","last_change":"2023-11-27T20:42:37.530074+0000","last_active":"2023-11-27T20:42:39.926662+0000","last_peered":"2023-11-27T20:42:39.926662+0000","last_clean":"2023-11-27T20:42:39.926662+0000","last_became_active":"2023-11-27T20:42:37.529422+0000","last_became_peered":"2023-11-27T20:42:37.529422+0000","last_unstale":"2023-11-27T20:42:39.926662+0000","last_undegraded":"2023-11-27T20:42:39.926662+0000","last_fullsized":"2023-11-27T20:42:39.926662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:40:40.129670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833577+0000","last_change":"2023-11-27T20:42:38.551495+0000","last_active":"2023-11-27T20:42:39.833577+0000","last_peered":"2023-11-27T20:42:39.833577+0000","last_clean":"2023-11-27T20:42:39.833577+0000","last_became_active":"2023-11-27T20:42:38.548057+0000","last_became_peered":"2023-11-27T20:42:38.548057+0000","last_unstale":"2023-11-27T20:42:39.833577+0000","last_undegraded":"2023-11-27T20:42:39.833577+0000","last_fullsized":"2023-11-27T20:42:39.833577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516646+0000","last_change":"2023-11-27T20:42:57.516646+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516646+0000","last_undegraded":"2023-11-27T20:42:57.516646+0000","last_fullsized":"2023-11-27T20:42:57.516646+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546210+0000","last_change":"2023-11-27T20:42:37.520015+0000","last_active":"2023-11-27T20:42:39.546210+0000","last_peered":"2023-11-27T20:42:39.546210+0000","last_clean":"2023-11-27T20:42:39.546210+0000","last_became_active":"2023-11-27T20:42:37.519779+0000","last_became_peered":"2023-11-27T20:42:37.519779+0000","last_unstale":"2023-11-27T20:42:39.546210+0000","last_undegraded":"2023-11-27T20:42:39.546210+0000","last_fullsized":"2023-11-27T20:42:39.546210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:47.336738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927259+0000","last_change":"2023-11-27T20:42:38.558352+0000","last_active":"2023-11-27T20:42:39.927259+0000","last_peered":"2023-11-27T20:42:39.927259+0000","last_clean":"2023-11-27T20:42:39.927259+0000","last_became_active":"2023-11-27T20:42:38.557630+0000","last_became_peered":"2023-11-27T20:42:38.557630+0000","last_unstale":"2023-11-27T20:42:39.927259+0000","last_undegraded":"2023-11-27T20:42:39.927259+0000","last_fullsized":"2023-11-27T20:42:39.927259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562043+0000","last_change":"2023-11-27T20:42:37.535511+0000","last_active":"2023-11-27T20:42:39.562043+0000","last_peered":"2023-11-27T20:42:39.562043+0000","last_clean":"2023-11-27T20:42:39.562043+0000","last_became_active":"2023-11-27T20:42:37.535314+0000","last_became_peered":"2023-11-27T20:42:37.535314+0000","last_unstale":"2023-11-27T20:42:39.562043+0000","last_undegraded":"2023-11-27T20:42:39.562043+0000","last_fullsized":"2023-11-27T20:42:39.562043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548247+0000","last_change":"2023-11-27T20:42:38.545391+0000","last_active":"2023-11-27T20:42:39.548247+0000","last_peered":"2023-11-27T20:42:39.548247+0000","last_clean":"2023-11-27T20:42:39.548247+0000","last_became_active":"2023-11-27T20:42:38.544984+0000","last_became_peered":"2023-11-27T20:42:38.544984+0000","last_unstale":"2023-11-27T20:42:39.548247+0000","last_undegraded":"2023-11-27T20:42:39.548247+0000","last_fullsized":"2023-11-27T20:42:39.548247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526385+0000","last_change":"2023-11-27T20:42:57.526385+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526385+0000","last_undegraded":"2023-11-27T20:42:57.526385+0000","last_fullsized":"2023-11-27T20:42:57.526385+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548476+0000","last_change":"2023-11-27T20:42:37.528294+0000","last_active":"2023-11-27T20:42:39.548476+0000","last_peered":"2023-11-27T20:42:39.548476+0000","last_clean":"2023-11-27T20:42:39.548476+0000","last_became_active":"2023-11-27T20:42:37.528055+0000","last_became_peered":"2023-11-27T20:42:37.528055+0000","last_unstale":"2023-11-27T20:42:39.548476+0000","last_undegraded":"2023-11-27T20:42:39.548476+0000","last_fullsized":"2023-11-27T20:42:39.548476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561817+0000","last_change":"2023-11-27T20:42:38.529609+0000","last_active":"2023-11-27T20:42:39.561817+0000","last_peered":"2023-11-27T20:42:39.561817+0000","last_clean":"2023-11-27T20:42:39.561817+0000","last_became_active":"2023-11-27T20:42:38.529089+0000","last_became_peered":"2023-11-27T20:42:38.529089+0000","last_unstale":"2023-11-27T20:42:39.561817+0000","last_undegraded":"2023-11-27T20:42:39.561817+0000","last_fullsized":"2023-11-27T20:42:39.561817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.512528+0000","last_change":"2023-11-27T20:42:57.512528+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.512528+0000","last_undegraded":"2023-11-27T20:42:57.512528+0000","last_fullsized":"2023-11-27T20:42:57.512528+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548354+0000","last_change":"2023-11-27T20:42:38.549776+0000","last_active":"2023-11-27T20:42:39.548354+0000","last_peered":"2023-11-27T20:42:39.548354+0000","last_clean":"2023-11-27T20:42:39.548354+0000","last_became_active":"2023-11-27T20:42:38.549339+0000","last_became_peered":"2023-11-27T20:42:38.549339+0000","last_unstale":"2023-11-27T20:42:39.548354+0000","last_undegraded":"2023-11-27T20:42:39.548354+0000","last_fullsized":"2023-11-27T20:42:39.548354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546002+0000","last_change":"2023-11-27T20:42:38.539218+0000","last_active":"2023-11-27T20:42:39.546002+0000","last_peered":"2023-11-27T20:42:39.546002+0000","last_clean":"2023-11-27T20:42:39.546002+0000","last_became_active":"2023-11-27T20:42:38.538843+0000","last_became_peered":"2023-11-27T20:42:38.538843+0000","last_unstale":"2023-11-27T20:42:39.546002+0000","last_undegraded":"2023-11-27T20:42:39.546002+0000","last_fullsized":"2023-11-27T20:42:39.546002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:10.273471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548498+0000","last_change":"2023-11-27T20:42:38.531773+0000","last_active":"2023-11-27T20:42:39.548498+0000","last_peered":"2023-11-27T20:42:39.548498+0000","last_clean":"2023-11-27T20:42:39.548498+0000","last_became_active":"2023-11-27T20:42:38.531469+0000","last_became_peered":"2023-11-27T20:42:38.531469+0000","last_unstale":"2023-11-27T20:42:39.548498+0000","last_undegraded":"2023-11-27T20:42:39.548498+0000","last_fullsized":"2023-11-27T20:42:39.548498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926846+0000","last_change":"2023-11-27T20:42:38.548676+0000","last_active":"2023-11-27T20:42:39.926846+0000","last_peered":"2023-11-27T20:42:39.926846+0000","last_clean":"2023-11-27T20:42:39.926846+0000","last_became_active":"2023-11-27T20:42:38.548338+0000","last_became_peered":"2023-11-27T20:42:38.548338+0000","last_unstale":"2023-11-27T20:42:39.926846+0000","last_undegraded":"2023-11-27T20:42:39.926846+0000","last_fullsized":"2023-11-27T20:42:39.926846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849355+0000","last_change":"2023-11-27T20:42:38.541871+0000","last_active":"2023-11-27T20:42:39.849355+0000","last_peered":"2023-11-27T20:42:39.849355+0000","last_clean":"2023-11-27T20:42:39.849355+0000","last_became_active":"2023-11-27T20:42:38.532675+0000","last_became_peered":"2023-11-27T20:42:38.532675+0000","last_unstale":"2023-11-27T20:42:39.849355+0000","last_undegraded":"2023-11-27T20:42:39.849355+0000","last_fullsized":"2023-11-27T20:42:39.849355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833713+0000","last_change":"2023-11-27T20:42:38.547768+0000","last_active":"2023-11-27T20:42:39.833713+0000","last_peered":"2023-11-27T20:42:39.833713+0000","last_clean":"2023-11-27T20:42:39.833713+0000","last_became_active":"2023-11-27T20:42:38.547403+0000","last_became_peered":"2023-11-27T20:42:38.547403+0000","last_unstale":"2023-11-27T20:42:39.833713+0000","last_undegraded":"2023-11-27T20:42:39.833713+0000","last_fullsized":"2023-11-27T20:42:39.833713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546256+0000","last_change":"2023-11-27T20:42:38.553640+0000","last_active":"2023-11-27T20:42:39.546256+0000","last_peered":"2023-11-27T20:42:39.546256+0000","last_clean":"2023-11-27T20:42:39.546256+0000","last_became_active":"2023-11-27T20:42:38.552879+0000","last_became_peered":"2023-11-27T20:42:38.552879+0000","last_unstale":"2023-11-27T20:42:39.546256+0000","last_undegraded":"2023-11-27T20:42:39.546256+0000","last_fullsized":"2023-11-27T20:42:39.546256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:40:10.146333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833936+0000","last_change":"2023-11-27T20:42:38.547156+0000","last_active":"2023-11-27T20:42:39.833936+0000","last_peered":"2023-11-27T20:42:39.833936+0000","last_clean":"2023-11-27T20:42:39.833936+0000","last_became_active":"2023-11-27T20:42:38.545609+0000","last_became_peered":"2023-11-27T20:42:38.545609+0000","last_unstale":"2023-11-27T20:42:39.833936+0000","last_undegraded":"2023-11-27T20:42:39.833936+0000","last_fullsized":"2023-11-27T20:42:39.833936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848338+0000","last_change":"2023-11-27T20:42:38.542428+0000","last_active":"2023-11-27T20:42:39.848338+0000","last_peered":"2023-11-27T20:42:39.848338+0000","last_clean":"2023-11-27T20:42:39.848338+0000","last_became_active":"2023-11-27T20:42:38.542153+0000","last_became_peered":"2023-11-27T20:42:38.542153+0000","last_unstale":"2023-11-27T20:42:39.848338+0000","last_undegraded":"2023-11-27T20:42:39.848338+0000","last_fullsized":"2023-11-27T20:42:39.848338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561499+0000","last_change":"2023-11-27T20:42:38.535802+0000","last_active":"2023-11-27T20:42:39.561499+0000","last_peered":"2023-11-27T20:42:39.561499+0000","last_clean":"2023-11-27T20:42:39.561499+0000","last_became_active":"2023-11-27T20:42:38.535498+0000","last_became_peered":"2023-11-27T20:42:38.535498+0000","last_unstale":"2023-11-27T20:42:39.561499+0000","last_undegraded":"2023-11-27T20:42:39.561499+0000","last_fullsized":"2023-11-27T20:42:39.561499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926880+0000","last_change":"2023-11-27T20:42:38.551263+0000","last_active":"2023-11-27T20:42:39.926880+0000","last_peered":"2023-11-27T20:42:39.926880+0000","last_clean":"2023-11-27T20:42:39.926880+0000","last_became_active":"2023-11-27T20:42:38.545451+0000","last_became_peered":"2023-11-27T20:42:38.545451+0000","last_unstale":"2023-11-27T20:42:39.926880+0000","last_undegraded":"2023-11-27T20:42:39.926880+0000","last_fullsized":"2023-11-27T20:42:39.926880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926780+0000","last_change":"2023-11-27T20:42:38.534413+0000","last_active":"2023-11-27T20:42:39.926780+0000","last_peered":"2023-11-27T20:42:39.926780+0000","last_clean":"2023-11-27T20:42:39.926780+0000","last_became_active":"2023-11-27T20:42:38.534183+0000","last_became_peered":"2023-11-27T20:42:38.534183+0000","last_unstale":"2023-11-27T20:42:39.926780+0000","last_undegraded":"2023-11-27T20:42:39.926780+0000","last_fullsized":"2023-11-27T20:42:39.926780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926810+0000","last_change":"2023-11-27T20:42:38.550553+0000","last_active":"2023-11-27T20:42:39.926810+0000","last_peered":"2023-11-27T20:42:39.926810+0000","last_clean":"2023-11-27T20:42:39.926810+0000","last_became_active":"2023-11-27T20:42:38.550311+0000","last_became_peered":"2023-11-27T20:42:38.550311+0000","last_unstale":"2023-11-27T20:42:39.926810+0000","last_undegraded":"2023-11-27T20:42:39.926810+0000","last_fullsized":"2023-11-27T20:42:39.926810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:48.730603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545958+0000","last_change":"2023-11-27T20:42:38.561753+0000","last_active":"2023-11-27T20:42:39.545958+0000","last_peered":"2023-11-27T20:42:39.545958+0000","last_clean":"2023-11-27T20:42:39.545958+0000","last_became_active":"2023-11-27T20:42:38.561380+0000","last_became_peered":"2023-11-27T20:42:38.561380+0000","last_unstale":"2023-11-27T20:42:39.545958+0000","last_undegraded":"2023-11-27T20:42:39.545958+0000","last_fullsized":"2023-11-27T20:42:39.545958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546086+0000","last_change":"2023-11-27T20:42:38.560432+0000","last_active":"2023-11-27T20:42:39.546086+0000","last_peered":"2023-11-27T20:42:39.546086+0000","last_clean":"2023-11-27T20:42:39.546086+0000","last_became_active":"2023-11-27T20:42:38.560192+0000","last_became_peered":"2023-11-27T20:42:38.560192+0000","last_unstale":"2023-11-27T20:42:39.546086+0000","last_undegraded":"2023-11-27T20:42:39.546086+0000","last_fullsized":"2023-11-27T20:42:39.546086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547970+0000","last_change":"2023-11-27T20:42:38.540846+0000","last_active":"2023-11-27T20:42:39.547970+0000","last_peered":"2023-11-27T20:42:39.547970+0000","last_clean":"2023-11-27T20:42:39.547970+0000","last_became_active":"2023-11-27T20:42:38.540576+0000","last_became_peered":"2023-11-27T20:42:38.540576+0000","last_unstale":"2023-11-27T20:42:39.547970+0000","last_undegraded":"2023-11-27T20:42:39.547970+0000","last_fullsized":"2023-11-27T20:42:39.547970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548295+0000","last_change":"2023-11-27T20:42:38.546971+0000","last_active":"2023-11-27T20:42:39.548295+0000","last_peered":"2023-11-27T20:42:39.548295+0000","last_clean":"2023-11-27T20:42:39.548295+0000","last_became_active":"2023-11-27T20:42:38.546653+0000","last_became_peered":"2023-11-27T20:42:38.546653+0000","last_unstale":"2023-11-27T20:42:39.548295+0000","last_undegraded":"2023-11-27T20:42:39.548295+0000","last_fullsized":"2023-11-27T20:42:39.548295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848410+0000","last_change":"2023-11-27T20:42:38.547627+0000","last_active":"2023-11-27T20:42:39.848410+0000","last_peered":"2023-11-27T20:42:39.848410+0000","last_clean":"2023-11-27T20:42:39.848410+0000","last_became_active":"2023-11-27T20:42:38.539984+0000","last_became_peered":"2023-11-27T20:42:38.539984+0000","last_unstale":"2023-11-27T20:42:39.848410+0000","last_undegraded":"2023-11-27T20:42:39.848410+0000","last_fullsized":"2023-11-27T20:42:39.848410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546478+0000","last_change":"2023-11-27T20:42:38.547129+0000","last_active":"2023-11-27T20:42:39.546478+0000","last_peered":"2023-11-27T20:42:39.546478+0000","last_clean":"2023-11-27T20:42:39.546478+0000","last_became_active":"2023-11-27T20:42:38.546838+0000","last_became_peered":"2023-11-27T20:42:38.546838+0000","last_unstale":"2023-11-27T20:42:39.546478+0000","last_undegraded":"2023-11-27T20:42:39.546478+0000","last_fullsized":"2023-11-27T20:42:39.546478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:13:37.585057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926388+0000","last_change":"2023-11-27T20:42:38.545796+0000","last_active":"2023-11-27T20:42:39.926388+0000","last_peered":"2023-11-27T20:42:39.926388+0000","last_clean":"2023-11-27T20:42:39.926388+0000","last_became_active":"2023-11-27T20:42:38.545553+0000","last_became_peered":"2023-11-27T20:42:38.545553+0000","last_unstale":"2023-11-27T20:42:39.926388+0000","last_undegraded":"2023-11-27T20:42:39.926388+0000","last_fullsized":"2023-11-27T20:42:39.926388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:43.682169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848996+0000","last_change":"2023-11-27T20:42:38.558320+0000","last_active":"2023-11-27T20:42:39.848996+0000","last_peered":"2023-11-27T20:42:39.848996+0000","last_clean":"2023-11-27T20:42:39.848996+0000","last_became_active":"2023-11-27T20:42:38.557951+0000","last_became_peered":"2023-11-27T20:42:38.557951+0000","last_unstale":"2023-11-27T20:42:39.848996+0000","last_undegraded":"2023-11-27T20:42:39.848996+0000","last_fullsized":"2023-11-27T20:42:39.848996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.549780+0000","last_change":"2023-11-27T20:42:38.547591+0000","last_active":"2023-11-27T20:42:39.549780+0000","last_peered":"2023-11-27T20:42:39.549780+0000","last_clean":"2023-11-27T20:42:39.549780+0000","last_became_active":"2023-11-27T20:42:38.547330+0000","last_became_peered":"2023-11-27T20:42:38.547330+0000","last_unstale":"2023-11-27T20:42:39.549780+0000","last_undegraded":"2023-11-27T20:42:39.549780+0000","last_fullsized":"2023-11-27T20:42:39.549780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833818+0000","last_change":"2023-11-27T20:42:38.559990+0000","last_active":"2023-11-27T20:42:39.833818+0000","last_peered":"2023-11-27T20:42:39.833818+0000","last_clean":"2023-11-27T20:42:39.833818+0000","last_became_active":"2023-11-27T20:42:38.559736+0000","last_became_peered":"2023-11-27T20:42:38.559736+0000","last_unstale":"2023-11-27T20:42:39.833818+0000","last_undegraded":"2023-11-27T20:42:39.833818+0000","last_fullsized":"2023-11-27T20:42:39.833818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927365+0000","last_change":"2023-11-27T20:42:38.538848+0000","last_active":"2023-11-27T20:42:39.927365+0000","last_peered":"2023-11-27T20:42:39.927365+0000","last_clean":"2023-11-27T20:42:39.927365+0000","last_became_active":"2023-11-27T20:42:38.538541+0000","last_became_peered":"2023-11-27T20:42:38.538541+0000","last_unstale":"2023-11-27T20:42:39.927365+0000","last_undegraded":"2023-11-27T20:42:39.927365+0000","last_fullsized":"2023-11-27T20:42:39.927365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547303+0000","last_change":"2023-11-27T20:42:38.541486+0000","last_active":"2023-11-27T20:42:39.547303+0000","last_peered":"2023-11-27T20:42:39.547303+0000","last_clean":"2023-11-27T20:42:39.547303+0000","last_became_active":"2023-11-27T20:42:38.541126+0000","last_became_peered":"2023-11-27T20:42:38.541126+0000","last_unstale":"2023-11-27T20:42:39.547303+0000","last_undegraded":"2023-11-27T20:42:39.547303+0000","last_fullsized":"2023-11-27T20:42:39.547303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547821+0000","last_change":"2023-11-27T20:42:38.537531+0000","last_active":"2023-11-27T20:42:39.547821+0000","last_peered":"2023-11-27T20:42:39.547821+0000","last_clean":"2023-11-27T20:42:39.547821+0000","last_became_active":"2023-11-27T20:42:38.536923+0000","last_became_peered":"2023-11-27T20:42:38.536923+0000","last_unstale":"2023-11-27T20:42:39.547821+0000","last_undegraded":"2023-11-27T20:42:39.547821+0000","last_fullsized":"2023-11-27T20:42:39.547821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546112+0000","last_change":"2023-11-27T20:42:38.557750+0000","last_active":"2023-11-27T20:42:39.546112+0000","last_peered":"2023-11-27T20:42:39.546112+0000","last_clean":"2023-11-27T20:42:39.546112+0000","last_became_active":"2023-11-27T20:42:38.557513+0000","last_became_peered":"2023-11-27T20:42:38.557513+0000","last_unstale":"2023-11-27T20:42:39.546112+0000","last_undegraded":"2023-11-27T20:42:39.546112+0000","last_fullsized":"2023-11-27T20:42:39.546112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:00:16.000787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926038+0000","last_change":"2023-11-27T20:42:38.554226+0000","last_active":"2023-11-27T20:42:39.926038+0000","last_peered":"2023-11-27T20:42:39.926038+0000","last_clean":"2023-11-27T20:42:39.926038+0000","last_became_active":"2023-11-27T20:42:38.553902+0000","last_became_peered":"2023-11-27T20:42:38.553902+0000","last_unstale":"2023-11-27T20:42:39.926038+0000","last_undegraded":"2023-11-27T20:42:39.926038+0000","last_fullsized":"2023-11-27T20:42:39.926038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:27.699633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833178+0000","last_change":"2023-11-27T20:42:38.558993+0000","last_active":"2023-11-27T20:42:39.833178+0000","last_peered":"2023-11-27T20:42:39.833178+0000","last_clean":"2023-11-27T20:42:39.833178+0000","last_became_active":"2023-11-27T20:42:38.558259+0000","last_became_peered":"2023-11-27T20:42:38.558259+0000","last_unstale":"2023-11-27T20:42:39.833178+0000","last_undegraded":"2023-11-27T20:42:39.833178+0000","last_fullsized":"2023-11-27T20:42:39.833178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848874+0000","last_change":"2023-11-27T20:42:38.558109+0000","last_active":"2023-11-27T20:42:39.848874+0000","last_peered":"2023-11-27T20:42:39.848874+0000","last_clean":"2023-11-27T20:42:39.848874+0000","last_became_active":"2023-11-27T20:42:38.557268+0000","last_became_peered":"2023-11-27T20:42:38.557268+0000","last_unstale":"2023-11-27T20:42:39.848874+0000","last_undegraded":"2023-11-27T20:42:39.848874+0000","last_fullsized":"2023-11-27T20:42:39.848874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545903+0000","last_change":"2023-11-27T20:42:38.554526+0000","last_active":"2023-11-27T20:42:39.545903+0000","last_peered":"2023-11-27T20:42:39.545903+0000","last_clean":"2023-11-27T20:42:39.545903+0000","last_became_active":"2023-11-27T20:42:38.554180+0000","last_became_peered":"2023-11-27T20:42:38.554180+0000","last_unstale":"2023-11-27T20:42:39.545903+0000","last_undegraded":"2023-11-27T20:42:39.545903+0000","last_fullsized":"2023-11-27T20:42:39.545903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547069+0000","last_change":"2023-11-27T20:42:38.539057+0000","last_active":"2023-11-27T20:42:39.547069+0000","last_peered":"2023-11-27T20:42:39.547069+0000","last_clean":"2023-11-27T20:42:39.547069+0000","last_became_active":"2023-11-27T20:42:38.536139+0000","last_became_peered":"2023-11-27T20:42:38.536139+0000","last_unstale":"2023-11-27T20:42:39.547069+0000","last_undegraded":"2023-11-27T20:42:39.547069+0000","last_fullsized":"2023-11-27T20:42:39.547069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":749068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0860000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3089999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.5580000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.26},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.6759999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.198},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":0.99099999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.71}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":159226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.1559999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.036}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.111}]},{"osd":3,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4419999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":3.536,"5min":3.536,"15min":3.536},"last":1.377}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.6919999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.266},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.6259999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":159282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.077}]},{"osd":1,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.206}]},{"osd":2,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.014}]},{"osd":3,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":1.3759999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.4239999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2149999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.4670000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.7050000000000001},{"interface":"front","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.6599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.1379999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.028}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.78200000000000003}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.5269999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.6559999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.25}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.7290000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":161739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.51400000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.745},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.8050000000000002,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.204}]},{"osd":6,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.016},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.0820000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":158680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.63}]},{"osd":1,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.42099999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.89900000000000002}]},{"osd":4,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.73199999999999998}]},{"osd":5,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.157},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":0.81200000000000006}]},{"osd":7,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":0.76700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":161739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.3140000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.751},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.2509999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.421},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.167}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.605}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.3839999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.218}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.6519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":742307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.097}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.96699999999999997}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.147}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.3169999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.3779999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.431}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.613}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:43:04.017 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:43:04.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.262+0000 7fb665ebb640 1 Processor -- start 2023-11-27T20:43:04.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.262+0000 7fb665ebb640 1 -- start start 2023-11-27T20:43:04.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.264+0000 7fb665ebb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb660152f20 0x7fb6600c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.264+0000 7fb665ebb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600c64a0 con 0x7fb66006d0a0 2023-11-27T20:43:04.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.264+0000 7fb665ebb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600c5c00 con 0x7fb66014fd30 2023-11-27T20:43:04.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.264+0000 7fb665ebb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6600c5ee0 con 0x7fb660152f20 2023-11-27T20:43:04.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.264+0000 7fb657fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb66006d0a0 0x7fb6600c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36152/0 (socket says 172.21.15.91:36152) 2023-11-27T20:43:04.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.264+0000 7fb657fff640 1 -- 172.21.15.91:0/2174897366 learned_addr learned my addr 172.21.15.91:0/2174897366 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:04.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.264+0000 7fb65ffff640 1 --2- 172.21.15.91:0/2174897366 >> v2:172.21.15.183:3300/0 conn(0x7fb660152f20 0x7fb6600c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.264+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686571957 0 0) 0x7fb6600c64a0 con 0x7fb66006d0a0 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb64c003520 con 0x7fb66006d0a0 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2624158322 0 0) 0x7fb64c003520 con 0x7fb66006d0a0 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 >> v2:172.21.15.183:3300/0 conn(0x7fb660152f20 msgr2=0x7fb6600c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 --2- 172.21.15.91:0/2174897366 >> v2:172.21.15.183:3300/0 conn(0x7fb660152f20 0x7fb6600c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 >> v1:172.21.15.183:6789/0 conn(0x7fb66014fd30 legacy=0x7fb6600a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600c61c0 con 0x7fb66006d0a0 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fb648001670 con 0x7fb66006d0a0 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 >> v1:172.21.15.91:6789/0 conn(0x7fb66006d0a0 legacy=0x7fb6600c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 --2- 172.21.15.91:0/2174897366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb64c003970 0x7fb64c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 --2- 172.21.15.91:0/2174897366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb64c0047c0 0x7fb64c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 --2- 172.21.15.91:0/2174897366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c005180 0x7fb64c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600c5ee0 con 0x7fb64c0047c0 2023-11-27T20:43:04.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c00c020 con 0x7fb64c003970 2023-11-27T20:43:04.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c00c1e0 con 0x7fb64c005180 2023-11-27T20:43:04.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.265+0000 7fb657fff640 1 --2- 172.21.15.91:0/2174897366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb64c0047c0 0x7fb64c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.266+0000 7fb65f7fe640 1 --2- 172.21.15.91:0/2174897366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb64c003970 0x7fb64c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.266+0000 7fb657fff640 1 -- 172.21.15.91:0/2174897366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c005180 msgr2=0x7fb64c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:04.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.266+0000 7fb657fff640 1 --2- 172.21.15.91:0/2174897366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c005180 0x7fb64c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.266+0000 7fb657fff640 1 -- 172.21.15.91:0/2174897366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb64c003970 msgr2=0x7fb64c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:04.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.266+0000 7fb657fff640 1 --2- 172.21.15.91:0/2174897366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb64c003970 0x7fb64c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.266+0000 7fb657fff640 1 -- 172.21.15.91:0/2174897366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c003520 con 0x7fb64c0047c0 2023-11-27T20:43:04.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.266+0000 7fb65ffff640 1 -- 172.21.15.91:0/2174897366 reap_dead start 2023-11-27T20:43:04.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.267+0000 7fb657fff640 1 --2- 172.21.15.91:0/2174897366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb64c0047c0 0x7fb64c004c40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb648007fd0 tx=0x7fb64c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fd170405f21ca7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:04.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.267+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb648005ad0 con 0x7fb64c0047c0 2023-11-27T20:43:04.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.267+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb648005c50 con 0x7fb64c0047c0 2023-11-27T20:43:04.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.267+0000 7fb65effd640 1 -- 172.21.15.91:0/2174897366 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64802c850 con 0x7fb64c0047c0 2023-11-27T20:43:04.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.268+0000 7fb665ebb640 1 -- 172.21.15.91:0/2174897366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb64c0047c0 msgr2=0x7fb64c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.268+0000 7fb665ebb640 1 --2- 172.21.15.91:0/2174897366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb64c0047c0 0x7fb64c004c40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb648007fd0 tx=0x7fb64c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.268+0000 7fb665ebb640 1 -- 172.21.15.91:0/2174897366 shutdown_connections 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.268+0000 7fb665ebb640 1 --2- 172.21.15.91:0/2174897366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb64c0047c0 0x7fb64c004c40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.268+0000 7fb665ebb640 1 -- 172.21.15.91:0/2174897366 >> 172.21.15.91:0/2174897366 conn(0x7fb66006a500 msgr2=0x7fb66006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.268+0000 7fb665ebb640 1 -- 172.21.15.91:0/2174897366 shutdown_connections 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.268+0000 7fb665ebb640 1 -- 172.21.15.91:0/2174897366 wait complete. 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.270+0000 7fb665ebb640 1 Processor -- start 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.270+0000 7fb665ebb640 1 -- start start 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb665ebb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c0047c0 0x7fb6601ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb665ebb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6601eded0 0x7fb6600a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb665ebb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb660156660 0x7fb6600a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb665ebb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600aa3b0 con 0x7fb6601eded0 2023-11-27T20:43:04.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb665ebb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6601543f0 con 0x7fb660156660 2023-11-27T20:43:04.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb665ebb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600aa8a0 con 0x7fb64c0047c0 2023-11-27T20:43:04.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb657fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6601eded0 0x7fb6600a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb657fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6601eded0 0x7fb6600a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52276/0 (socket says 172.21.15.91:52276) 2023-11-27T20:43:04.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb657fff640 1 -- 172.21.15.91:0/1478159924 learned_addr learned my addr 172.21.15.91:0/1478159924 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:04.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb657fff640 1 -- 172.21.15.91:0/1478159924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c0047c0 msgr2=0x7fb6601ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:04.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb657fff640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c0047c0 0x7fb6601ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb657fff640 1 -- 172.21.15.91:0/1478159924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb660156660 msgr2=0x7fb6600a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:04.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb657fff640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb660156660 0x7fb6600a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.271+0000 7fb657fff640 1 -- 172.21.15.91:0/1478159924 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600aab80 con 0x7fb6601eded0 2023-11-27T20:43:04.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.272+0000 7fb657fff640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6601eded0 0x7fb6600a9930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb648009000 tx=0x7fb64802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:04.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.272+0000 7fb65cff9640 1 -- 172.21.15.91:0/1478159924 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64803c040 con 0x7fb6601eded0 2023-11-27T20:43:04.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.272+0000 7fb65cff9640 1 -- 172.21.15.91:0/1478159924 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64802cd20 con 0x7fb6601eded0 2023-11-27T20:43:04.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.272+0000 7fb665ebb640 1 -- 172.21.15.91:0/1478159924 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6601ee380 con 0x7fb6601eded0 2023-11-27T20:43:04.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.272+0000 7fb65cff9640 1 -- 172.21.15.91:0/1478159924 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb648007270 con 0x7fb6601eded0 2023-11-27T20:43:04.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.272+0000 7fb665ebb640 1 -- 172.21.15.91:0/1478159924 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66014b800 con 0x7fb6601eded0 2023-11-27T20:43:04.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.273+0000 7fb665ebb640 1 -- 172.21.15.91:0/1478159924 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6600a9570 con 0x7fb6601eded0 2023-11-27T20:43:04.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.274+0000 7fb65cff9640 1 -- 172.21.15.91:0/1478159924 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb648032070 con 0x7fb6601eded0 2023-11-27T20:43:04.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.275+0000 7fb65cff9640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb64006b1c0 0x7fb64006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.275+0000 7fb65cff9640 1 -- 172.21.15.91:0/1478159924 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb6480ab1a0 con 0x7fb6601eded0 2023-11-27T20:43:04.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.275+0000 7fb65f7fe640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb64006b1c0 0x7fb64006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.276+0000 7fb65f7fe640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb64006b1c0 0x7fb64006d680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb6500015d0 tx=0x7fb650009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:04.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.279+0000 7fb65cff9640 1 -- 172.21.15.91:0/1478159924 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb648075b60 con 0x7fb6601eded0 2023-11-27T20:43:04.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.465+0000 7fb665ebb640 1 -- 172.21.15.91:0/1478159924 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb66006ae80 con 0x7fb64006b1c0 2023-11-27T20:43:04.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.491+0000 7fb65cff9640 1 -- 172.21.15.91:0/1478159924 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+513314 (secure 0 0 0) 0x7fb66006ae80 con 0x7fb64006b1c0 2023-11-27T20:43:04.496 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:04.503 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:43:04.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 -- 172.21.15.91:0/1478159924 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb64006b1c0 msgr2=0x7fb64006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:04.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb64006b1c0 0x7fb64006d680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb6500015d0 tx=0x7fb650009040 comp rx=0 tx=0).stop 2023-11-27T20:43:04.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 -- 172.21.15.91:0/1478159924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6601eded0 msgr2=0x7fb6600a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:04.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6601eded0 0x7fb6600a9930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb648009000 tx=0x7fb64802e070 comp rx=0 tx=0).stop 2023-11-27T20:43:04.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 -- 172.21.15.91:0/1478159924 shutdown_connections 2023-11-27T20:43:04.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb64006b1c0 0x7fb64006d680 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb660156660 0x7fb6600a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6601eded0 0x7fb6600a9930 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 --2- 172.21.15.91:0/1478159924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c0047c0 0x7fb6601ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 -- 172.21.15.91:0/1478159924 >> 172.21.15.91:0/1478159924 conn(0x7fb66006a500 msgr2=0x7fb6600a50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:04.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 -- 172.21.15.91:0/1478159924 shutdown_connections 2023-11-27T20:43:04.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.501+0000 7fb665ebb640 1 -- 172.21.15.91:0/1478159924 wait complete. 2023-11-27T20:43:04.525 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-27T20:43:03.400015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220476,"kb_used_data":4316,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754244,"statfs":{"total":773094113280,"available":772868345856,"internally_reserved":0,"allocated":4419584,"data_stored":2450755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.895590"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548391+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:42:39.548391+0000","last_peered":"2023-11-27T20:42:39.548391+0000","last_clean":"2023-11-27T20:42:39.548391+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:42:39.548391+0000","last_undegraded":"2023-11-27T20:42:39.548391+0000","last_fullsized":"2023-11-27T20:42:39.548391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546449+0000","last_change":"2023-11-27T20:42:37.523367+0000","last_active":"2023-11-27T20:42:39.546449+0000","last_peered":"2023-11-27T20:42:39.546449+0000","last_clean":"2023-11-27T20:42:39.546449+0000","last_became_active":"2023-11-27T20:42:37.522948+0000","last_became_peered":"2023-11-27T20:42:37.522948+0000","last_unstale":"2023-11-27T20:42:39.546449+0000","last_undegraded":"2023-11-27T20:42:39.546449+0000","last_fullsized":"2023-11-27T20:42:39.546449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.549536+0000","last_change":"2023-11-27T20:42:38.542611+0000","last_active":"2023-11-27T20:42:39.549536+0000","last_peered":"2023-11-27T20:42:39.549536+0000","last_clean":"2023-11-27T20:42:39.549536+0000","last_became_active":"2023-11-27T20:42:38.542177+0000","last_became_peered":"2023-11-27T20:42:38.542177+0000","last_unstale":"2023-11-27T20:42:39.549536+0000","last_undegraded":"2023-11-27T20:42:39.549536+0000","last_fullsized":"2023-11-27T20:42:39.549536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510564+0000","last_change":"2023-11-27T20:42:57.510564+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510564+0000","last_undegraded":"2023-11-27T20:42:57.510564+0000","last_fullsized":"2023-11-27T20:42:57.510564+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545308+0000","last_change":"2023-11-27T20:42:37.533800+0000","last_active":"2023-11-27T20:42:39.545308+0000","last_peered":"2023-11-27T20:42:39.545308+0000","last_clean":"2023-11-27T20:42:39.545308+0000","last_became_active":"2023-11-27T20:42:37.533358+0000","last_became_peered":"2023-11-27T20:42:37.533358+0000","last_unstale":"2023-11-27T20:42:39.545308+0000","last_undegraded":"2023-11-27T20:42:39.545308+0000","last_fullsized":"2023-11-27T20:42:39.545308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926329+0000","last_change":"2023-11-27T20:42:38.544391+0000","last_active":"2023-11-27T20:42:39.926329+0000","last_peered":"2023-11-27T20:42:39.926329+0000","last_clean":"2023-11-27T20:42:39.926329+0000","last_became_active":"2023-11-27T20:42:38.544114+0000","last_became_peered":"2023-11-27T20:42:38.544114+0000","last_unstale":"2023-11-27T20:42:39.926329+0000","last_undegraded":"2023-11-27T20:42:39.926329+0000","last_fullsized":"2023-11-27T20:42:39.926329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518058+0000","last_change":"2023-11-27T20:42:57.518058+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518058+0000","last_undegraded":"2023-11-27T20:42:57.518058+0000","last_fullsized":"2023-11-27T20:42:57.518058+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927152+0000","last_change":"2023-11-27T20:42:37.530919+0000","last_active":"2023-11-27T20:42:39.927152+0000","last_peered":"2023-11-27T20:42:39.927152+0000","last_clean":"2023-11-27T20:42:39.927152+0000","last_became_active":"2023-11-27T20:42:37.530606+0000","last_became_peered":"2023-11-27T20:42:37.530606+0000","last_unstale":"2023-11-27T20:42:39.927152+0000","last_undegraded":"2023-11-27T20:42:39.927152+0000","last_fullsized":"2023-11-27T20:42:39.927152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:26.686814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545481+0000","last_change":"2023-11-27T20:42:38.556454+0000","last_active":"2023-11-27T20:42:39.545481+0000","last_peered":"2023-11-27T20:42:39.545481+0000","last_clean":"2023-11-27T20:42:39.545481+0000","last_became_active":"2023-11-27T20:42:38.556194+0000","last_became_peered":"2023-11-27T20:42:38.556194+0000","last_unstale":"2023-11-27T20:42:39.545481+0000","last_undegraded":"2023-11-27T20:42:39.545481+0000","last_fullsized":"2023-11-27T20:42:39.545481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526221+0000","last_change":"2023-11-27T20:42:57.526221+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526221+0000","last_undegraded":"2023-11-27T20:42:57.526221+0000","last_fullsized":"2023-11-27T20:42:57.526221+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832832+0000","last_change":"2023-11-27T20:42:37.529807+0000","last_active":"2023-11-27T20:42:39.832832+0000","last_peered":"2023-11-27T20:42:39.832832+0000","last_clean":"2023-11-27T20:42:39.832832+0000","last_became_active":"2023-11-27T20:42:37.529543+0000","last_became_peered":"2023-11-27T20:42:37.529543+0000","last_unstale":"2023-11-27T20:42:39.832832+0000","last_undegraded":"2023-11-27T20:42:39.832832+0000","last_fullsized":"2023-11-27T20:42:39.832832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562085+0000","last_change":"2023-11-27T20:42:38.531762+0000","last_active":"2023-11-27T20:42:39.562085+0000","last_peered":"2023-11-27T20:42:39.562085+0000","last_clean":"2023-11-27T20:42:39.562085+0000","last_became_active":"2023-11-27T20:42:38.531490+0000","last_became_peered":"2023-11-27T20:42:38.531490+0000","last_unstale":"2023-11-27T20:42:39.562085+0000","last_undegraded":"2023-11-27T20:42:39.562085+0000","last_fullsized":"2023-11-27T20:42:39.562085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516201+0000","last_change":"2023-11-27T20:42:57.516201+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516201+0000","last_undegraded":"2023-11-27T20:42:57.516201+0000","last_fullsized":"2023-11-27T20:42:57.516201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562653+0000","last_change":"2023-11-27T20:42:37.532441+0000","last_active":"2023-11-27T20:42:39.562653+0000","last_peered":"2023-11-27T20:42:39.562653+0000","last_clean":"2023-11-27T20:42:39.562653+0000","last_became_active":"2023-11-27T20:42:37.532074+0000","last_became_peered":"2023-11-27T20:42:37.532074+0000","last_unstale":"2023-11-27T20:42:39.562653+0000","last_undegraded":"2023-11-27T20:42:39.562653+0000","last_fullsized":"2023-11-27T20:42:39.562653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:04.889609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546138+0000","last_change":"2023-11-27T20:42:38.533430+0000","last_active":"2023-11-27T20:42:39.546138+0000","last_peered":"2023-11-27T20:42:39.546138+0000","last_clean":"2023-11-27T20:42:39.546138+0000","last_became_active":"2023-11-27T20:42:38.532325+0000","last_became_peered":"2023-11-27T20:42:38.532325+0000","last_unstale":"2023-11-27T20:42:39.546138+0000","last_undegraded":"2023-11-27T20:42:39.546138+0000","last_fullsized":"2023-11-27T20:42:39.546138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510732+0000","last_change":"2023-11-27T20:42:57.510732+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510732+0000","last_undegraded":"2023-11-27T20:42:57.510732+0000","last_fullsized":"2023-11-27T20:42:57.510732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833620+0000","last_change":"2023-11-27T20:42:37.527056+0000","last_active":"2023-11-27T20:42:39.833620+0000","last_peered":"2023-11-27T20:42:39.833620+0000","last_clean":"2023-11-27T20:42:39.833620+0000","last_became_active":"2023-11-27T20:42:37.526803+0000","last_became_peered":"2023-11-27T20:42:37.526803+0000","last_unstale":"2023-11-27T20:42:39.833620+0000","last_undegraded":"2023-11-27T20:42:39.833620+0000","last_fullsized":"2023-11-27T20:42:39.833620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561663+0000","last_change":"2023-11-27T20:42:38.536715+0000","last_active":"2023-11-27T20:42:39.561663+0000","last_peered":"2023-11-27T20:42:39.561663+0000","last_clean":"2023-11-27T20:42:39.561663+0000","last_became_active":"2023-11-27T20:42:38.536349+0000","last_became_peered":"2023-11-27T20:42:38.536349+0000","last_unstale":"2023-11-27T20:42:39.561663+0000","last_undegraded":"2023-11-27T20:42:39.561663+0000","last_fullsized":"2023-11-27T20:42:39.561663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.517117+0000","last_change":"2023-11-27T20:42:57.517117+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.517117+0000","last_undegraded":"2023-11-27T20:42:57.517117+0000","last_fullsized":"2023-11-27T20:42:57.517117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.831237+0000","last_change":"2023-11-27T20:42:37.528142+0000","last_active":"2023-11-27T20:42:39.831237+0000","last_peered":"2023-11-27T20:42:39.831237+0000","last_clean":"2023-11-27T20:42:39.831237+0000","last_became_active":"2023-11-27T20:42:37.527318+0000","last_became_peered":"2023-11-27T20:42:37.527318+0000","last_unstale":"2023-11-27T20:42:39.831237+0000","last_undegraded":"2023-11-27T20:42:39.831237+0000","last_fullsized":"2023-11-27T20:42:39.831237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849506+0000","last_change":"2023-11-27T20:42:38.553617+0000","last_active":"2023-11-27T20:42:39.849506+0000","last_peered":"2023-11-27T20:42:39.849506+0000","last_clean":"2023-11-27T20:42:39.849506+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:39.849506+0000","last_undegraded":"2023-11-27T20:42:39.849506+0000","last_fullsized":"2023-11-27T20:42:39.849506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.511845+0000","last_change":"2023-11-27T20:42:57.511845+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.511845+0000","last_undegraded":"2023-11-27T20:42:57.511845+0000","last_fullsized":"2023-11-27T20:42:57.511845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.834058+0000","last_change":"2023-11-27T20:42:37.530114+0000","last_active":"2023-11-27T20:42:39.834058+0000","last_peered":"2023-11-27T20:42:39.834058+0000","last_clean":"2023-11-27T20:42:39.834058+0000","last_became_active":"2023-11-27T20:42:37.529838+0000","last_became_peered":"2023-11-27T20:42:37.529838+0000","last_unstale":"2023-11-27T20:42:39.834058+0000","last_undegraded":"2023-11-27T20:42:39.834058+0000","last_fullsized":"2023-11-27T20:42:39.834058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926678+0000","last_change":"2023-11-27T20:42:38.551126+0000","last_active":"2023-11-27T20:42:39.926678+0000","last_peered":"2023-11-27T20:42:39.926678+0000","last_clean":"2023-11-27T20:42:39.926678+0000","last_became_active":"2023-11-27T20:42:38.550881+0000","last_became_peered":"2023-11-27T20:42:38.550881+0000","last_unstale":"2023-11-27T20:42:39.926678+0000","last_undegraded":"2023-11-27T20:42:39.926678+0000","last_fullsized":"2023-11-27T20:42:39.926678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:08.745845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.527169+0000","last_change":"2023-11-27T20:42:57.527169+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.527169+0000","last_undegraded":"2023-11-27T20:42:57.527169+0000","last_fullsized":"2023-11-27T20:42:57.527169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848218+0000","last_change":"2023-11-27T20:42:37.532212+0000","last_active":"2023-11-27T20:42:39.848218+0000","last_peered":"2023-11-27T20:42:39.848218+0000","last_clean":"2023-11-27T20:42:39.848218+0000","last_became_active":"2023-11-27T20:42:37.531894+0000","last_became_peered":"2023-11-27T20:42:37.531894+0000","last_unstale":"2023-11-27T20:42:39.848218+0000","last_undegraded":"2023-11-27T20:42:39.848218+0000","last_fullsized":"2023-11-27T20:42:39.848218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547400+0000","last_change":"2023-11-27T20:42:38.537364+0000","last_active":"2023-11-27T20:42:39.547400+0000","last_peered":"2023-11-27T20:42:39.547400+0000","last_clean":"2023-11-27T20:42:39.547400+0000","last_became_active":"2023-11-27T20:42:38.536521+0000","last_became_peered":"2023-11-27T20:42:38.536521+0000","last_unstale":"2023-11-27T20:42:39.547400+0000","last_undegraded":"2023-11-27T20:42:39.547400+0000","last_fullsized":"2023-11-27T20:42:39.547400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510514+0000","last_change":"2023-11-27T20:42:57.510514+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510514+0000","last_undegraded":"2023-11-27T20:42:57.510514+0000","last_fullsized":"2023-11-27T20:42:57.510514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926403+0000","last_change":"2023-11-27T20:42:37.518579+0000","last_active":"2023-11-27T20:42:39.926403+0000","last_peered":"2023-11-27T20:42:39.926403+0000","last_clean":"2023-11-27T20:42:39.926403+0000","last_became_active":"2023-11-27T20:42:37.517970+0000","last_became_peered":"2023-11-27T20:42:37.517970+0000","last_unstale":"2023-11-27T20:42:39.926403+0000","last_undegraded":"2023-11-27T20:42:39.926403+0000","last_fullsized":"2023-11-27T20:42:39.926403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.925849+0000","last_change":"2023-11-27T20:42:38.539525+0000","last_active":"2023-11-27T20:42:39.925849+0000","last_peered":"2023-11-27T20:42:39.925849+0000","last_clean":"2023-11-27T20:42:39.925849+0000","last_became_active":"2023-11-27T20:42:38.539244+0000","last_became_peered":"2023-11-27T20:42:38.539244+0000","last_unstale":"2023-11-27T20:42:39.925849+0000","last_undegraded":"2023-11-27T20:42:39.925849+0000","last_fullsized":"2023-11-27T20:42:39.925849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:12:08.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518026+0000","last_change":"2023-11-27T20:42:57.518026+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518026+0000","last_undegraded":"2023-11-27T20:42:57.518026+0000","last_fullsized":"2023-11-27T20:42:57.518026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546116+0000","last_change":"2023-11-27T20:42:37.522543+0000","last_active":"2023-11-27T20:42:39.546116+0000","last_peered":"2023-11-27T20:42:39.546116+0000","last_clean":"2023-11-27T20:42:39.546116+0000","last_became_active":"2023-11-27T20:42:37.522163+0000","last_became_peered":"2023-11-27T20:42:37.522163+0000","last_unstale":"2023-11-27T20:42:39.546116+0000","last_undegraded":"2023-11-27T20:42:39.546116+0000","last_fullsized":"2023-11-27T20:42:39.546116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:46.239563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926297+0000","last_change":"2023-11-27T20:42:38.536322+0000","last_active":"2023-11-27T20:42:39.926297+0000","last_peered":"2023-11-27T20:42:39.926297+0000","last_clean":"2023-11-27T20:42:39.926297+0000","last_became_active":"2023-11-27T20:42:38.536051+0000","last_became_peered":"2023-11-27T20:42:38.536051+0000","last_unstale":"2023-11-27T20:42:39.926297+0000","last_undegraded":"2023-11-27T20:42:39.926297+0000","last_fullsized":"2023-11-27T20:42:39.926297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:31.539798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526042+0000","last_change":"2023-11-27T20:42:57.526042+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526042+0000","last_undegraded":"2023-11-27T20:42:57.526042+0000","last_fullsized":"2023-11-27T20:42:57.526042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562351+0000","last_change":"2023-11-27T20:42:37.527591+0000","last_active":"2023-11-27T20:42:39.562351+0000","last_peered":"2023-11-27T20:42:39.562351+0000","last_clean":"2023-11-27T20:42:39.562351+0000","last_became_active":"2023-11-27T20:42:37.527305+0000","last_became_peered":"2023-11-27T20:42:37.527305+0000","last_unstale":"2023-11-27T20:42:39.562351+0000","last_undegraded":"2023-11-27T20:42:39.562351+0000","last_fullsized":"2023-11-27T20:42:39.562351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926039+0000","last_change":"2023-11-27T20:42:38.547894+0000","last_active":"2023-11-27T20:42:39.926039+0000","last_peered":"2023-11-27T20:42:39.926039+0000","last_clean":"2023-11-27T20:42:39.926039+0000","last_became_active":"2023-11-27T20:42:38.547558+0000","last_became_peered":"2023-11-27T20:42:38.547558+0000","last_unstale":"2023-11-27T20:42:39.926039+0000","last_undegraded":"2023-11-27T20:42:39.926039+0000","last_fullsized":"2023-11-27T20:42:39.926039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:38.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516720+0000","last_change":"2023-11-27T20:42:57.516720+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516720+0000","last_undegraded":"2023-11-27T20:42:57.516720+0000","last_fullsized":"2023-11-27T20:42:57.516720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927409+0000","last_change":"2023-11-27T20:42:37.527131+0000","last_active":"2023-11-27T20:42:39.927409+0000","last_peered":"2023-11-27T20:42:39.927409+0000","last_clean":"2023-11-27T20:42:39.927409+0000","last_became_active":"2023-11-27T20:42:37.526804+0000","last_became_peered":"2023-11-27T20:42:37.526804+0000","last_unstale":"2023-11-27T20:42:39.927409+0000","last_undegraded":"2023-11-27T20:42:39.927409+0000","last_fullsized":"2023-11-27T20:42:39.927409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926551+0000","last_change":"2023-11-27T20:42:38.549244+0000","last_active":"2023-11-27T20:42:39.926551+0000","last_peered":"2023-11-27T20:42:39.926551+0000","last_clean":"2023-11-27T20:42:39.926551+0000","last_became_active":"2023-11-27T20:42:38.548660+0000","last_became_peered":"2023-11-27T20:42:38.548660+0000","last_unstale":"2023-11-27T20:42:39.926551+0000","last_undegraded":"2023-11-27T20:42:39.926551+0000","last_fullsized":"2023-11-27T20:42:39.926551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:22.348409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.520466+0000","last_change":"2023-11-27T20:42:57.520466+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.520466+0000","last_undegraded":"2023-11-27T20:42:57.520466+0000","last_fullsized":"2023-11-27T20:42:57.520466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927419+0000","last_change":"2023-11-27T20:42:37.525601+0000","last_active":"2023-11-27T20:42:39.927419+0000","last_peered":"2023-11-27T20:42:39.927419+0000","last_clean":"2023-11-27T20:42:39.927419+0000","last_became_active":"2023-11-27T20:42:37.525296+0000","last_became_peered":"2023-11-27T20:42:37.525296+0000","last_unstale":"2023-11-27T20:42:39.927419+0000","last_undegraded":"2023-11-27T20:42:39.927419+0000","last_fullsized":"2023-11-27T20:42:39.927419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833446+0000","last_change":"2023-11-27T20:42:38.554165+0000","last_active":"2023-11-27T20:42:39.833446+0000","last_peered":"2023-11-27T20:42:39.833446+0000","last_clean":"2023-11-27T20:42:39.833446+0000","last_became_active":"2023-11-27T20:42:38.553912+0000","last_became_peered":"2023-11-27T20:42:38.553912+0000","last_unstale":"2023-11-27T20:42:39.833446+0000","last_undegraded":"2023-11-27T20:42:39.833446+0000","last_fullsized":"2023-11-27T20:42:39.833446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.511643+0000","last_change":"2023-11-27T20:42:57.511643+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.511643+0000","last_undegraded":"2023-11-27T20:42:57.511643+0000","last_fullsized":"2023-11-27T20:42:57.511643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927463+0000","last_change":"2023-11-27T20:42:37.522245+0000","last_active":"2023-11-27T20:42:39.927463+0000","last_peered":"2023-11-27T20:42:39.927463+0000","last_clean":"2023-11-27T20:42:39.927463+0000","last_became_active":"2023-11-27T20:42:37.521938+0000","last_became_peered":"2023-11-27T20:42:37.521938+0000","last_unstale":"2023-11-27T20:42:39.927463+0000","last_undegraded":"2023-11-27T20:42:39.927463+0000","last_fullsized":"2023-11-27T20:42:39.927463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849278+0000","last_change":"2023-11-27T20:42:38.549553+0000","last_active":"2023-11-27T20:42:39.849278+0000","last_peered":"2023-11-27T20:42:39.849278+0000","last_clean":"2023-11-27T20:42:39.849278+0000","last_became_active":"2023-11-27T20:42:38.549075+0000","last_became_peered":"2023-11-27T20:42:38.549075+0000","last_unstale":"2023-11-27T20:42:39.849278+0000","last_undegraded":"2023-11-27T20:42:39.849278+0000","last_fullsized":"2023-11-27T20:42:39.849278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.517619+0000","last_change":"2023-11-27T20:42:57.517619+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.517619+0000","last_undegraded":"2023-11-27T20:42:57.517619+0000","last_fullsized":"2023-11-27T20:42:57.517619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.834022+0000","last_change":"2023-11-27T20:42:37.525560+0000","last_active":"2023-11-27T20:42:39.834022+0000","last_peered":"2023-11-27T20:42:39.834022+0000","last_clean":"2023-11-27T20:42:39.834022+0000","last_became_active":"2023-11-27T20:42:37.525261+0000","last_became_peered":"2023-11-27T20:42:37.525261+0000","last_unstale":"2023-11-27T20:42:39.834022+0000","last_undegraded":"2023-11-27T20:42:39.834022+0000","last_fullsized":"2023-11-27T20:42:39.834022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:16.392657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927183+0000","last_change":"2023-11-27T20:42:38.546056+0000","last_active":"2023-11-27T20:42:39.927183+0000","last_peered":"2023-11-27T20:42:39.927183+0000","last_clean":"2023-11-27T20:42:39.927183+0000","last_became_active":"2023-11-27T20:42:38.545736+0000","last_became_peered":"2023-11-27T20:42:38.545736+0000","last_unstale":"2023-11-27T20:42:39.927183+0000","last_undegraded":"2023-11-27T20:42:39.927183+0000","last_fullsized":"2023-11-27T20:42:39.927183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510435+0000","last_change":"2023-11-27T20:42:57.510435+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510435+0000","last_undegraded":"2023-11-27T20:42:57.510435+0000","last_fullsized":"2023-11-27T20:42:57.510435+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545443+0000","last_change":"2023-11-27T20:42:37.514338+0000","last_active":"2023-11-27T20:42:39.545443+0000","last_peered":"2023-11-27T20:42:39.545443+0000","last_clean":"2023-11-27T20:42:39.545443+0000","last_became_active":"2023-11-27T20:42:37.514055+0000","last_became_peered":"2023-11-27T20:42:37.514055+0000","last_unstale":"2023-11-27T20:42:39.545443+0000","last_undegraded":"2023-11-27T20:42:39.545443+0000","last_fullsized":"2023-11-27T20:42:39.545443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546366+0000","last_change":"2023-11-27T20:42:38.547970+0000","last_active":"2023-11-27T20:42:39.546366+0000","last_peered":"2023-11-27T20:42:39.546366+0000","last_clean":"2023-11-27T20:42:39.546366+0000","last_became_active":"2023-11-27T20:42:38.547656+0000","last_became_peered":"2023-11-27T20:42:38.547656+0000","last_unstale":"2023-11-27T20:42:39.546366+0000","last_undegraded":"2023-11-27T20:42:39.546366+0000","last_fullsized":"2023-11-27T20:42:39.546366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526486+0000","last_change":"2023-11-27T20:42:57.526486+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526486+0000","last_undegraded":"2023-11-27T20:42:57.526486+0000","last_fullsized":"2023-11-27T20:42:57.526486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545452+0000","last_change":"2023-11-27T20:42:37.535247+0000","last_active":"2023-11-27T20:42:39.545452+0000","last_peered":"2023-11-27T20:42:39.545452+0000","last_clean":"2023-11-27T20:42:39.545452+0000","last_became_active":"2023-11-27T20:42:37.534922+0000","last_became_peered":"2023-11-27T20:42:37.534922+0000","last_unstale":"2023-11-27T20:42:39.545452+0000","last_undegraded":"2023-11-27T20:42:39.545452+0000","last_fullsized":"2023-11-27T20:42:39.545452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:45.108775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547677+0000","last_change":"2023-11-27T20:42:38.548304+0000","last_active":"2023-11-27T20:42:39.547677+0000","last_peered":"2023-11-27T20:42:39.547677+0000","last_clean":"2023-11-27T20:42:39.547677+0000","last_became_active":"2023-11-27T20:42:38.547970+0000","last_became_peered":"2023-11-27T20:42:38.547970+0000","last_unstale":"2023-11-27T20:42:39.547677+0000","last_undegraded":"2023-11-27T20:42:39.547677+0000","last_fullsized":"2023-11-27T20:42:39.547677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518549+0000","last_change":"2023-11-27T20:42:57.518549+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518549+0000","last_undegraded":"2023-11-27T20:42:57.518549+0000","last_fullsized":"2023-11-27T20:42:57.518549+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832636+0000","last_change":"2023-11-27T20:42:37.522904+0000","last_active":"2023-11-27T20:42:39.832636+0000","last_peered":"2023-11-27T20:42:39.832636+0000","last_clean":"2023-11-27T20:42:39.832636+0000","last_became_active":"2023-11-27T20:42:37.522574+0000","last_became_peered":"2023-11-27T20:42:37.522574+0000","last_unstale":"2023-11-27T20:42:39.832636+0000","last_undegraded":"2023-11-27T20:42:39.832636+0000","last_fullsized":"2023-11-27T20:42:39.832636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546755+0000","last_change":"2023-11-27T20:42:38.553812+0000","last_active":"2023-11-27T20:42:39.546755+0000","last_peered":"2023-11-27T20:42:39.546755+0000","last_clean":"2023-11-27T20:42:39.546755+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:39.546755+0000","last_undegraded":"2023-11-27T20:42:39.546755+0000","last_fullsized":"2023-11-27T20:42:39.546755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:21.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516790+0000","last_change":"2023-11-27T20:42:57.516790+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516790+0000","last_undegraded":"2023-11-27T20:42:57.516790+0000","last_fullsized":"2023-11-27T20:42:57.516790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927117+0000","last_change":"2023-11-27T20:42:37.524294+0000","last_active":"2023-11-27T20:42:39.927117+0000","last_peered":"2023-11-27T20:42:39.927117+0000","last_clean":"2023-11-27T20:42:39.927117+0000","last_became_active":"2023-11-27T20:42:37.523858+0000","last_became_peered":"2023-11-27T20:42:37.523858+0000","last_unstale":"2023-11-27T20:42:39.927117+0000","last_undegraded":"2023-11-27T20:42:39.927117+0000","last_fullsized":"2023-11-27T20:42:39.927117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832659+0000","last_change":"2023-11-27T20:42:38.543201+0000","last_active":"2023-11-27T20:42:39.832659+0000","last_peered":"2023-11-27T20:42:39.832659+0000","last_clean":"2023-11-27T20:42:39.832659+0000","last_became_active":"2023-11-27T20:42:38.542920+0000","last_became_peered":"2023-11-27T20:42:38.542920+0000","last_unstale":"2023-11-27T20:42:39.832659+0000","last_undegraded":"2023-11-27T20:42:39.832659+0000","last_fullsized":"2023-11-27T20:42:39.832659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516769+0000","last_change":"2023-11-27T20:42:57.516769+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516769+0000","last_undegraded":"2023-11-27T20:42:57.516769+0000","last_fullsized":"2023-11-27T20:42:57.516769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:53.057510+0000","last_change":"2023-11-27T20:42:37.523173+0000","last_active":"2023-11-27T20:42:53.057510+0000","last_peered":"2023-11-27T20:42:53.057510+0000","last_clean":"2023-11-27T20:42:53.057510+0000","last_became_active":"2023-11-27T20:42:37.522903+0000","last_became_peered":"2023-11-27T20:42:37.522903+0000","last_unstale":"2023-11-27T20:42:53.057510+0000","last_undegraded":"2023-11-27T20:42:53.057510+0000","last_fullsized":"2023-11-27T20:42:53.057510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:28.381599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848936+0000","last_change":"2023-11-27T20:42:38.557705+0000","last_active":"2023-11-27T20:42:39.848936+0000","last_peered":"2023-11-27T20:42:39.848936+0000","last_clean":"2023-11-27T20:42:39.848936+0000","last_became_active":"2023-11-27T20:42:38.557251+0000","last_became_peered":"2023-11-27T20:42:38.557251+0000","last_unstale":"2023-11-27T20:42:39.848936+0000","last_undegraded":"2023-11-27T20:42:39.848936+0000","last_fullsized":"2023-11-27T20:42:39.848936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516409+0000","last_change":"2023-11-27T20:42:57.516409+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516409+0000","last_undegraded":"2023-11-27T20:42:57.516409+0000","last_fullsized":"2023-11-27T20:42:57.516409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849118+0000","last_change":"2023-11-27T20:42:37.530460+0000","last_active":"2023-11-27T20:42:39.849118+0000","last_peered":"2023-11-27T20:42:39.849118+0000","last_clean":"2023-11-27T20:42:39.849118+0000","last_became_active":"2023-11-27T20:42:37.529879+0000","last_became_peered":"2023-11-27T20:42:37.529879+0000","last_unstale":"2023-11-27T20:42:39.849118+0000","last_undegraded":"2023-11-27T20:42:39.849118+0000","last_fullsized":"2023-11-27T20:42:39.849118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:58.185242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545848+0000","last_change":"2023-11-27T20:42:38.555684+0000","last_active":"2023-11-27T20:42:39.545848+0000","last_peered":"2023-11-27T20:42:39.545848+0000","last_clean":"2023-11-27T20:42:39.545848+0000","last_became_active":"2023-11-27T20:42:38.555415+0000","last_became_peered":"2023-11-27T20:42:38.555415+0000","last_unstale":"2023-11-27T20:42:39.545848+0000","last_undegraded":"2023-11-27T20:42:39.545848+0000","last_fullsized":"2023-11-27T20:42:39.545848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518638+0000","last_change":"2023-11-27T20:42:57.518638+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518638+0000","last_undegraded":"2023-11-27T20:42:57.518638+0000","last_fullsized":"2023-11-27T20:42:57.518638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562223+0000","last_change":"2023-11-27T20:42:37.532869+0000","last_active":"2023-11-27T20:42:39.562223+0000","last_peered":"2023-11-27T20:42:39.562223+0000","last_clean":"2023-11-27T20:42:39.562223+0000","last_became_active":"2023-11-27T20:42:37.532576+0000","last_became_peered":"2023-11-27T20:42:37.532576+0000","last_unstale":"2023-11-27T20:42:39.562223+0000","last_undegraded":"2023-11-27T20:42:39.562223+0000","last_fullsized":"2023-11-27T20:42:39.562223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546630+0000","last_change":"2023-11-27T20:42:38.559970+0000","last_active":"2023-11-27T20:42:39.546630+0000","last_peered":"2023-11-27T20:42:39.546630+0000","last_clean":"2023-11-27T20:42:39.546630+0000","last_became_active":"2023-11-27T20:42:38.559688+0000","last_became_peered":"2023-11-27T20:42:38.559688+0000","last_unstale":"2023-11-27T20:42:39.546630+0000","last_undegraded":"2023-11-27T20:42:39.546630+0000","last_fullsized":"2023-11-27T20:42:39.546630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:47.260947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.511654+0000","last_change":"2023-11-27T20:42:57.511654+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.511654+0000","last_undegraded":"2023-11-27T20:42:57.511654+0000","last_fullsized":"2023-11-27T20:42:57.511654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546639+0000","last_change":"2023-11-27T20:42:37.531762+0000","last_active":"2023-11-27T20:42:39.546639+0000","last_peered":"2023-11-27T20:42:39.546639+0000","last_clean":"2023-11-27T20:42:39.546639+0000","last_became_active":"2023-11-27T20:42:37.531446+0000","last_became_peered":"2023-11-27T20:42:37.531446+0000","last_unstale":"2023-11-27T20:42:39.546639+0000","last_undegraded":"2023-11-27T20:42:39.546639+0000","last_fullsized":"2023-11-27T20:42:39.546639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:11.474537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849378+0000","last_change":"2023-11-27T20:42:38.555603+0000","last_active":"2023-11-27T20:42:39.849378+0000","last_peered":"2023-11-27T20:42:39.849378+0000","last_clean":"2023-11-27T20:42:39.849378+0000","last_became_active":"2023-11-27T20:42:38.555305+0000","last_became_peered":"2023-11-27T20:42:38.555305+0000","last_unstale":"2023-11-27T20:42:39.849378+0000","last_undegraded":"2023-11-27T20:42:39.849378+0000","last_fullsized":"2023-11-27T20:42:39.849378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.528207+0000","last_change":"2023-11-27T20:42:57.528207+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.528207+0000","last_undegraded":"2023-11-27T20:42:57.528207+0000","last_fullsized":"2023-11-27T20:42:57.528207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926258+0000","last_change":"2023-11-27T20:42:37.522230+0000","last_active":"2023-11-27T20:42:39.926258+0000","last_peered":"2023-11-27T20:42:39.926258+0000","last_clean":"2023-11-27T20:42:39.926258+0000","last_became_active":"2023-11-27T20:42:37.521898+0000","last_became_peered":"2023-11-27T20:42:37.521898+0000","last_unstale":"2023-11-27T20:42:39.926258+0000","last_undegraded":"2023-11-27T20:42:39.926258+0000","last_fullsized":"2023-11-27T20:42:39.926258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:16:18.992040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832678+0000","last_change":"2023-11-27T20:42:38.538177+0000","last_active":"2023-11-27T20:42:39.832678+0000","last_peered":"2023-11-27T20:42:39.832678+0000","last_clean":"2023-11-27T20:42:39.832678+0000","last_became_active":"2023-11-27T20:42:38.537835+0000","last_became_peered":"2023-11-27T20:42:38.537835+0000","last_unstale":"2023-11-27T20:42:39.832678+0000","last_undegraded":"2023-11-27T20:42:39.832678+0000","last_fullsized":"2023-11-27T20:42:39.832678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.519383+0000","last_change":"2023-11-27T20:42:57.519383+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.519383+0000","last_undegraded":"2023-11-27T20:42:57.519383+0000","last_fullsized":"2023-11-27T20:42:57.519383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545442+0000","last_change":"2023-11-27T20:42:37.522964+0000","last_active":"2023-11-27T20:42:39.545442+0000","last_peered":"2023-11-27T20:42:39.545442+0000","last_clean":"2023-11-27T20:42:39.545442+0000","last_became_active":"2023-11-27T20:42:37.522677+0000","last_became_peered":"2023-11-27T20:42:37.522677+0000","last_unstale":"2023-11-27T20:42:39.545442+0000","last_undegraded":"2023-11-27T20:42:39.545442+0000","last_fullsized":"2023-11-27T20:42:39.545442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:30.748479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926310+0000","last_change":"2023-11-27T20:42:38.533572+0000","last_active":"2023-11-27T20:42:39.926310+0000","last_peered":"2023-11-27T20:42:39.926310+0000","last_clean":"2023-11-27T20:42:39.926310+0000","last_became_active":"2023-11-27T20:42:38.533281+0000","last_became_peered":"2023-11-27T20:42:38.533281+0000","last_unstale":"2023-11-27T20:42:39.926310+0000","last_undegraded":"2023-11-27T20:42:39.926310+0000","last_fullsized":"2023-11-27T20:42:39.926310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.519078+0000","last_change":"2023-11-27T20:42:57.519078+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.519078+0000","last_undegraded":"2023-11-27T20:42:57.519078+0000","last_fullsized":"2023-11-27T20:42:57.519078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926655+0000","last_change":"2023-11-27T20:42:37.531654+0000","last_active":"2023-11-27T20:42:39.926655+0000","last_peered":"2023-11-27T20:42:39.926655+0000","last_clean":"2023-11-27T20:42:39.926655+0000","last_became_active":"2023-11-27T20:42:37.529901+0000","last_became_peered":"2023-11-27T20:42:37.529901+0000","last_unstale":"2023-11-27T20:42:39.926655+0000","last_undegraded":"2023-11-27T20:42:39.926655+0000","last_fullsized":"2023-11-27T20:42:39.926655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848846+0000","last_change":"2023-11-27T20:42:38.545564+0000","last_active":"2023-11-27T20:42:39.848846+0000","last_peered":"2023-11-27T20:42:39.848846+0000","last_clean":"2023-11-27T20:42:39.848846+0000","last_became_active":"2023-11-27T20:42:38.545232+0000","last_became_peered":"2023-11-27T20:42:38.545232+0000","last_unstale":"2023-11-27T20:42:39.848846+0000","last_undegraded":"2023-11-27T20:42:39.848846+0000","last_fullsized":"2023-11-27T20:42:39.848846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.517252+0000","last_change":"2023-11-27T20:42:57.517252+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.517252+0000","last_undegraded":"2023-11-27T20:42:57.517252+0000","last_fullsized":"2023-11-27T20:42:57.517252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927435+0000","last_change":"2023-11-27T20:42:37.527381+0000","last_active":"2023-11-27T20:42:39.927435+0000","last_peered":"2023-11-27T20:42:39.927435+0000","last_clean":"2023-11-27T20:42:39.927435+0000","last_became_active":"2023-11-27T20:42:37.527147+0000","last_became_peered":"2023-11-27T20:42:37.527147+0000","last_unstale":"2023-11-27T20:42:39.927435+0000","last_undegraded":"2023-11-27T20:42:39.927435+0000","last_fullsized":"2023-11-27T20:42:39.927435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548933+0000","last_change":"2023-11-27T20:42:38.552242+0000","last_active":"2023-11-27T20:42:39.548933+0000","last_peered":"2023-11-27T20:42:39.548933+0000","last_clean":"2023-11-27T20:42:39.548933+0000","last_became_active":"2023-11-27T20:42:38.551805+0000","last_became_peered":"2023-11-27T20:42:38.551805+0000","last_unstale":"2023-11-27T20:42:39.548933+0000","last_undegraded":"2023-11-27T20:42:39.548933+0000","last_fullsized":"2023-11-27T20:42:39.548933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510670+0000","last_change":"2023-11-27T20:42:57.510670+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510670+0000","last_undegraded":"2023-11-27T20:42:57.510670+0000","last_fullsized":"2023-11-27T20:42:57.510670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.519360+0000","last_change":"2023-11-27T20:42:57.519360+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.519360+0000","last_undegraded":"2023-11-27T20:42:57.519360+0000","last_fullsized":"2023-11-27T20:42:57.519360+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926662+0000","last_change":"2023-11-27T20:42:37.530074+0000","last_active":"2023-11-27T20:42:39.926662+0000","last_peered":"2023-11-27T20:42:39.926662+0000","last_clean":"2023-11-27T20:42:39.926662+0000","last_became_active":"2023-11-27T20:42:37.529422+0000","last_became_peered":"2023-11-27T20:42:37.529422+0000","last_unstale":"2023-11-27T20:42:39.926662+0000","last_undegraded":"2023-11-27T20:42:39.926662+0000","last_fullsized":"2023-11-27T20:42:39.926662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:40:40.129670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833577+0000","last_change":"2023-11-27T20:42:38.551495+0000","last_active":"2023-11-27T20:42:39.833577+0000","last_peered":"2023-11-27T20:42:39.833577+0000","last_clean":"2023-11-27T20:42:39.833577+0000","last_became_active":"2023-11-27T20:42:38.548057+0000","last_became_peered":"2023-11-27T20:42:38.548057+0000","last_unstale":"2023-11-27T20:42:39.833577+0000","last_undegraded":"2023-11-27T20:42:39.833577+0000","last_fullsized":"2023-11-27T20:42:39.833577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516646+0000","last_change":"2023-11-27T20:42:57.516646+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516646+0000","last_undegraded":"2023-11-27T20:42:57.516646+0000","last_fullsized":"2023-11-27T20:42:57.516646+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546210+0000","last_change":"2023-11-27T20:42:37.520015+0000","last_active":"2023-11-27T20:42:39.546210+0000","last_peered":"2023-11-27T20:42:39.546210+0000","last_clean":"2023-11-27T20:42:39.546210+0000","last_became_active":"2023-11-27T20:42:37.519779+0000","last_became_peered":"2023-11-27T20:42:37.519779+0000","last_unstale":"2023-11-27T20:42:39.546210+0000","last_undegraded":"2023-11-27T20:42:39.546210+0000","last_fullsized":"2023-11-27T20:42:39.546210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:47.336738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927259+0000","last_change":"2023-11-27T20:42:38.558352+0000","last_active":"2023-11-27T20:42:39.927259+0000","last_peered":"2023-11-27T20:42:39.927259+0000","last_clean":"2023-11-27T20:42:39.927259+0000","last_became_active":"2023-11-27T20:42:38.557630+0000","last_became_peered":"2023-11-27T20:42:38.557630+0000","last_unstale":"2023-11-27T20:42:39.927259+0000","last_undegraded":"2023-11-27T20:42:39.927259+0000","last_fullsized":"2023-11-27T20:42:39.927259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562043+0000","last_change":"2023-11-27T20:42:37.535511+0000","last_active":"2023-11-27T20:42:39.562043+0000","last_peered":"2023-11-27T20:42:39.562043+0000","last_clean":"2023-11-27T20:42:39.562043+0000","last_became_active":"2023-11-27T20:42:37.535314+0000","last_became_peered":"2023-11-27T20:42:37.535314+0000","last_unstale":"2023-11-27T20:42:39.562043+0000","last_undegraded":"2023-11-27T20:42:39.562043+0000","last_fullsized":"2023-11-27T20:42:39.562043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548247+0000","last_change":"2023-11-27T20:42:38.545391+0000","last_active":"2023-11-27T20:42:39.548247+0000","last_peered":"2023-11-27T20:42:39.548247+0000","last_clean":"2023-11-27T20:42:39.548247+0000","last_became_active":"2023-11-27T20:42:38.544984+0000","last_became_peered":"2023-11-27T20:42:38.544984+0000","last_unstale":"2023-11-27T20:42:39.548247+0000","last_undegraded":"2023-11-27T20:42:39.548247+0000","last_fullsized":"2023-11-27T20:42:39.548247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526385+0000","last_change":"2023-11-27T20:42:57.526385+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526385+0000","last_undegraded":"2023-11-27T20:42:57.526385+0000","last_fullsized":"2023-11-27T20:42:57.526385+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548476+0000","last_change":"2023-11-27T20:42:37.528294+0000","last_active":"2023-11-27T20:42:39.548476+0000","last_peered":"2023-11-27T20:42:39.548476+0000","last_clean":"2023-11-27T20:42:39.548476+0000","last_became_active":"2023-11-27T20:42:37.528055+0000","last_became_peered":"2023-11-27T20:42:37.528055+0000","last_unstale":"2023-11-27T20:42:39.548476+0000","last_undegraded":"2023-11-27T20:42:39.548476+0000","last_fullsized":"2023-11-27T20:42:39.548476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561817+0000","last_change":"2023-11-27T20:42:38.529609+0000","last_active":"2023-11-27T20:42:39.561817+0000","last_peered":"2023-11-27T20:42:39.561817+0000","last_clean":"2023-11-27T20:42:39.561817+0000","last_became_active":"2023-11-27T20:42:38.529089+0000","last_became_peered":"2023-11-27T20:42:38.529089+0000","last_unstale":"2023-11-27T20:42:39.561817+0000","last_undegraded":"2023-11-27T20:42:39.561817+0000","last_fullsized":"2023-11-27T20:42:39.561817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.512528+0000","last_change":"2023-11-27T20:42:57.512528+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.512528+0000","last_undegraded":"2023-11-27T20:42:57.512528+0000","last_fullsized":"2023-11-27T20:42:57.512528+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548354+0000","last_change":"2023-11-27T20:42:38.549776+0000","last_active":"2023-11-27T20:42:39.548354+0000","last_peered":"2023-11-27T20:42:39.548354+0000","last_clean":"2023-11-27T20:42:39.548354+0000","last_became_active":"2023-11-27T20:42:38.549339+0000","last_became_peered":"2023-11-27T20:42:38.549339+0000","last_unstale":"2023-11-27T20:42:39.548354+0000","last_undegraded":"2023-11-27T20:42:39.548354+0000","last_fullsized":"2023-11-27T20:42:39.548354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546002+0000","last_change":"2023-11-27T20:42:38.539218+0000","last_active":"2023-11-27T20:42:39.546002+0000","last_peered":"2023-11-27T20:42:39.546002+0000","last_clean":"2023-11-27T20:42:39.546002+0000","last_became_active":"2023-11-27T20:42:38.538843+0000","last_became_peered":"2023-11-27T20:42:38.538843+0000","last_unstale":"2023-11-27T20:42:39.546002+0000","last_undegraded":"2023-11-27T20:42:39.546002+0000","last_fullsized":"2023-11-27T20:42:39.546002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:10.273471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548498+0000","last_change":"2023-11-27T20:42:38.531773+0000","last_active":"2023-11-27T20:42:39.548498+0000","last_peered":"2023-11-27T20:42:39.548498+0000","last_clean":"2023-11-27T20:42:39.548498+0000","last_became_active":"2023-11-27T20:42:38.531469+0000","last_became_peered":"2023-11-27T20:42:38.531469+0000","last_unstale":"2023-11-27T20:42:39.548498+0000","last_undegraded":"2023-11-27T20:42:39.548498+0000","last_fullsized":"2023-11-27T20:42:39.548498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926846+0000","last_change":"2023-11-27T20:42:38.548676+0000","last_active":"2023-11-27T20:42:39.926846+0000","last_peered":"2023-11-27T20:42:39.926846+0000","last_clean":"2023-11-27T20:42:39.926846+0000","last_became_active":"2023-11-27T20:42:38.548338+0000","last_became_peered":"2023-11-27T20:42:38.548338+0000","last_unstale":"2023-11-27T20:42:39.926846+0000","last_undegraded":"2023-11-27T20:42:39.926846+0000","last_fullsized":"2023-11-27T20:42:39.926846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849355+0000","last_change":"2023-11-27T20:42:38.541871+0000","last_active":"2023-11-27T20:42:39.849355+0000","last_peered":"2023-11-27T20:42:39.849355+0000","last_clean":"2023-11-27T20:42:39.849355+0000","last_became_active":"2023-11-27T20:42:38.532675+0000","last_became_peered":"2023-11-27T20:42:38.532675+0000","last_unstale":"2023-11-27T20:42:39.849355+0000","last_undegraded":"2023-11-27T20:42:39.849355+0000","last_fullsized":"2023-11-27T20:42:39.849355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833713+0000","last_change":"2023-11-27T20:42:38.547768+0000","last_active":"2023-11-27T20:42:39.833713+0000","last_peered":"2023-11-27T20:42:39.833713+0000","last_clean":"2023-11-27T20:42:39.833713+0000","last_became_active":"2023-11-27T20:42:38.547403+0000","last_became_peered":"2023-11-27T20:42:38.547403+0000","last_unstale":"2023-11-27T20:42:39.833713+0000","last_undegraded":"2023-11-27T20:42:39.833713+0000","last_fullsized":"2023-11-27T20:42:39.833713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546256+0000","last_change":"2023-11-27T20:42:38.553640+0000","last_active":"2023-11-27T20:42:39.546256+0000","last_peered":"2023-11-27T20:42:39.546256+0000","last_clean":"2023-11-27T20:42:39.546256+0000","last_became_active":"2023-11-27T20:42:38.552879+0000","last_became_peered":"2023-11-27T20:42:38.552879+0000","last_unstale":"2023-11-27T20:42:39.546256+0000","last_undegraded":"2023-11-27T20:42:39.546256+0000","last_fullsized":"2023-11-27T20:42:39.546256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:40:10.146333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833936+0000","last_change":"2023-11-27T20:42:38.547156+0000","last_active":"2023-11-27T20:42:39.833936+0000","last_peered":"2023-11-27T20:42:39.833936+0000","last_clean":"2023-11-27T20:42:39.833936+0000","last_became_active":"2023-11-27T20:42:38.545609+0000","last_became_peered":"2023-11-27T20:42:38.545609+0000","last_unstale":"2023-11-27T20:42:39.833936+0000","last_undegraded":"2023-11-27T20:42:39.833936+0000","last_fullsized":"2023-11-27T20:42:39.833936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848338+0000","last_change":"2023-11-27T20:42:38.542428+0000","last_active":"2023-11-27T20:42:39.848338+0000","last_peered":"2023-11-27T20:42:39.848338+0000","last_clean":"2023-11-27T20:42:39.848338+0000","last_became_active":"2023-11-27T20:42:38.542153+0000","last_became_peered":"2023-11-27T20:42:38.542153+0000","last_unstale":"2023-11-27T20:42:39.848338+0000","last_undegraded":"2023-11-27T20:42:39.848338+0000","last_fullsized":"2023-11-27T20:42:39.848338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561499+0000","last_change":"2023-11-27T20:42:38.535802+0000","last_active":"2023-11-27T20:42:39.561499+0000","last_peered":"2023-11-27T20:42:39.561499+0000","last_clean":"2023-11-27T20:42:39.561499+0000","last_became_active":"2023-11-27T20:42:38.535498+0000","last_became_peered":"2023-11-27T20:42:38.535498+0000","last_unstale":"2023-11-27T20:42:39.561499+0000","last_undegraded":"2023-11-27T20:42:39.561499+0000","last_fullsized":"2023-11-27T20:42:39.561499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926880+0000","last_change":"2023-11-27T20:42:38.551263+0000","last_active":"2023-11-27T20:42:39.926880+0000","last_peered":"2023-11-27T20:42:39.926880+0000","last_clean":"2023-11-27T20:42:39.926880+0000","last_became_active":"2023-11-27T20:42:38.545451+0000","last_became_peered":"2023-11-27T20:42:38.545451+0000","last_unstale":"2023-11-27T20:42:39.926880+0000","last_undegraded":"2023-11-27T20:42:39.926880+0000","last_fullsized":"2023-11-27T20:42:39.926880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926780+0000","last_change":"2023-11-27T20:42:38.534413+0000","last_active":"2023-11-27T20:42:39.926780+0000","last_peered":"2023-11-27T20:42:39.926780+0000","last_clean":"2023-11-27T20:42:39.926780+0000","last_became_active":"2023-11-27T20:42:38.534183+0000","last_became_peered":"2023-11-27T20:42:38.534183+0000","last_unstale":"2023-11-27T20:42:39.926780+0000","last_undegraded":"2023-11-27T20:42:39.926780+0000","last_fullsized":"2023-11-27T20:42:39.926780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926810+0000","last_change":"2023-11-27T20:42:38.550553+0000","last_active":"2023-11-27T20:42:39.926810+0000","last_peered":"2023-11-27T20:42:39.926810+0000","last_clean":"2023-11-27T20:42:39.926810+0000","last_became_active":"2023-11-27T20:42:38.550311+0000","last_became_peered":"2023-11-27T20:42:38.550311+0000","last_unstale":"2023-11-27T20:42:39.926810+0000","last_undegraded":"2023-11-27T20:42:39.926810+0000","last_fullsized":"2023-11-27T20:42:39.926810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:48.730603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545958+0000","last_change":"2023-11-27T20:42:38.561753+0000","last_active":"2023-11-27T20:42:39.545958+0000","last_peered":"2023-11-27T20:42:39.545958+0000","last_clean":"2023-11-27T20:42:39.545958+0000","last_became_active":"2023-11-27T20:42:38.561380+0000","last_became_peered":"2023-11-27T20:42:38.561380+0000","last_unstale":"2023-11-27T20:42:39.545958+0000","last_undegraded":"2023-11-27T20:42:39.545958+0000","last_fullsized":"2023-11-27T20:42:39.545958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546086+0000","last_change":"2023-11-27T20:42:38.560432+0000","last_active":"2023-11-27T20:42:39.546086+0000","last_peered":"2023-11-27T20:42:39.546086+0000","last_clean":"2023-11-27T20:42:39.546086+0000","last_became_active":"2023-11-27T20:42:38.560192+0000","last_became_peered":"2023-11-27T20:42:38.560192+0000","last_unstale":"2023-11-27T20:42:39.546086+0000","last_undegraded":"2023-11-27T20:42:39.546086+0000","last_fullsized":"2023-11-27T20:42:39.546086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547970+0000","last_change":"2023-11-27T20:42:38.540846+0000","last_active":"2023-11-27T20:42:39.547970+0000","last_peered":"2023-11-27T20:42:39.547970+0000","last_clean":"2023-11-27T20:42:39.547970+0000","last_became_active":"2023-11-27T20:42:38.540576+0000","last_became_peered":"2023-11-27T20:42:38.540576+0000","last_unstale":"2023-11-27T20:42:39.547970+0000","last_undegraded":"2023-11-27T20:42:39.547970+0000","last_fullsized":"2023-11-27T20:42:39.547970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548295+0000","last_change":"2023-11-27T20:42:38.546971+0000","last_active":"2023-11-27T20:42:39.548295+0000","last_peered":"2023-11-27T20:42:39.548295+0000","last_clean":"2023-11-27T20:42:39.548295+0000","last_became_active":"2023-11-27T20:42:38.546653+0000","last_became_peered":"2023-11-27T20:42:38.546653+0000","last_unstale":"2023-11-27T20:42:39.548295+0000","last_undegraded":"2023-11-27T20:42:39.548295+0000","last_fullsized":"2023-11-27T20:42:39.548295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848410+0000","last_change":"2023-11-27T20:42:38.547627+0000","last_active":"2023-11-27T20:42:39.848410+0000","last_peered":"2023-11-27T20:42:39.848410+0000","last_clean":"2023-11-27T20:42:39.848410+0000","last_became_active":"2023-11-27T20:42:38.539984+0000","last_became_peered":"2023-11-27T20:42:38.539984+0000","last_unstale":"2023-11-27T20:42:39.848410+0000","last_undegraded":"2023-11-27T20:42:39.848410+0000","last_fullsized":"2023-11-27T20:42:39.848410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546478+0000","last_change":"2023-11-27T20:42:38.547129+0000","last_active":"2023-11-27T20:42:39.546478+0000","last_peered":"2023-11-27T20:42:39.546478+0000","last_clean":"2023-11-27T20:42:39.546478+0000","last_became_active":"2023-11-27T20:42:38.546838+0000","last_became_peered":"2023-11-27T20:42:38.546838+0000","last_unstale":"2023-11-27T20:42:39.546478+0000","last_undegraded":"2023-11-27T20:42:39.546478+0000","last_fullsized":"2023-11-27T20:42:39.546478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:13:37.585057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926388+0000","last_change":"2023-11-27T20:42:38.545796+0000","last_active":"2023-11-27T20:42:39.926388+0000","last_peered":"2023-11-27T20:42:39.926388+0000","last_clean":"2023-11-27T20:42:39.926388+0000","last_became_active":"2023-11-27T20:42:38.545553+0000","last_became_peered":"2023-11-27T20:42:38.545553+0000","last_unstale":"2023-11-27T20:42:39.926388+0000","last_undegraded":"2023-11-27T20:42:39.926388+0000","last_fullsized":"2023-11-27T20:42:39.926388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:43.682169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848996+0000","last_change":"2023-11-27T20:42:38.558320+0000","last_active":"2023-11-27T20:42:39.848996+0000","last_peered":"2023-11-27T20:42:39.848996+0000","last_clean":"2023-11-27T20:42:39.848996+0000","last_became_active":"2023-11-27T20:42:38.557951+0000","last_became_peered":"2023-11-27T20:42:38.557951+0000","last_unstale":"2023-11-27T20:42:39.848996+0000","last_undegraded":"2023-11-27T20:42:39.848996+0000","last_fullsized":"2023-11-27T20:42:39.848996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.549780+0000","last_change":"2023-11-27T20:42:38.547591+0000","last_active":"2023-11-27T20:42:39.549780+0000","last_peered":"2023-11-27T20:42:39.549780+0000","last_clean":"2023-11-27T20:42:39.549780+0000","last_became_active":"2023-11-27T20:42:38.547330+0000","last_became_peered":"2023-11-27T20:42:38.547330+0000","last_unstale":"2023-11-27T20:42:39.549780+0000","last_undegraded":"2023-11-27T20:42:39.549780+0000","last_fullsized":"2023-11-27T20:42:39.549780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833818+0000","last_change":"2023-11-27T20:42:38.559990+0000","last_active":"2023-11-27T20:42:39.833818+0000","last_peered":"2023-11-27T20:42:39.833818+0000","last_clean":"2023-11-27T20:42:39.833818+0000","last_became_active":"2023-11-27T20:42:38.559736+0000","last_became_peered":"2023-11-27T20:42:38.559736+0000","last_unstale":"2023-11-27T20:42:39.833818+0000","last_undegraded":"2023-11-27T20:42:39.833818+0000","last_fullsized":"2023-11-27T20:42:39.833818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927365+0000","last_change":"2023-11-27T20:42:38.538848+0000","last_active":"2023-11-27T20:42:39.927365+0000","last_peered":"2023-11-27T20:42:39.927365+0000","last_clean":"2023-11-27T20:42:39.927365+0000","last_became_active":"2023-11-27T20:42:38.538541+0000","last_became_peered":"2023-11-27T20:42:38.538541+0000","last_unstale":"2023-11-27T20:42:39.927365+0000","last_undegraded":"2023-11-27T20:42:39.927365+0000","last_fullsized":"2023-11-27T20:42:39.927365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547303+0000","last_change":"2023-11-27T20:42:38.541486+0000","last_active":"2023-11-27T20:42:39.547303+0000","last_peered":"2023-11-27T20:42:39.547303+0000","last_clean":"2023-11-27T20:42:39.547303+0000","last_became_active":"2023-11-27T20:42:38.541126+0000","last_became_peered":"2023-11-27T20:42:38.541126+0000","last_unstale":"2023-11-27T20:42:39.547303+0000","last_undegraded":"2023-11-27T20:42:39.547303+0000","last_fullsized":"2023-11-27T20:42:39.547303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547821+0000","last_change":"2023-11-27T20:42:38.537531+0000","last_active":"2023-11-27T20:42:39.547821+0000","last_peered":"2023-11-27T20:42:39.547821+0000","last_clean":"2023-11-27T20:42:39.547821+0000","last_became_active":"2023-11-27T20:42:38.536923+0000","last_became_peered":"2023-11-27T20:42:38.536923+0000","last_unstale":"2023-11-27T20:42:39.547821+0000","last_undegraded":"2023-11-27T20:42:39.547821+0000","last_fullsized":"2023-11-27T20:42:39.547821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546112+0000","last_change":"2023-11-27T20:42:38.557750+0000","last_active":"2023-11-27T20:42:39.546112+0000","last_peered":"2023-11-27T20:42:39.546112+0000","last_clean":"2023-11-27T20:42:39.546112+0000","last_became_active":"2023-11-27T20:42:38.557513+0000","last_became_peered":"2023-11-27T20:42:38.557513+0000","last_unstale":"2023-11-27T20:42:39.546112+0000","last_undegraded":"2023-11-27T20:42:39.546112+0000","last_fullsized":"2023-11-27T20:42:39.546112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:00:16.000787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926038+0000","last_change":"2023-11-27T20:42:38.554226+0000","last_active":"2023-11-27T20:42:39.926038+0000","last_peered":"2023-11-27T20:42:39.926038+0000","last_clean":"2023-11-27T20:42:39.926038+0000","last_became_active":"2023-11-27T20:42:38.553902+0000","last_became_peered":"2023-11-27T20:42:38.553902+0000","last_unstale":"2023-11-27T20:42:39.926038+0000","last_undegraded":"2023-11-27T20:42:39.926038+0000","last_fullsized":"2023-11-27T20:42:39.926038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:27.699633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833178+0000","last_change":"2023-11-27T20:42:38.558993+0000","last_active":"2023-11-27T20:42:39.833178+0000","last_peered":"2023-11-27T20:42:39.833178+0000","last_clean":"2023-11-27T20:42:39.833178+0000","last_became_active":"2023-11-27T20:42:38.558259+0000","last_became_peered":"2023-11-27T20:42:38.558259+0000","last_unstale":"2023-11-27T20:42:39.833178+0000","last_undegraded":"2023-11-27T20:42:39.833178+0000","last_fullsized":"2023-11-27T20:42:39.833178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848874+0000","last_change":"2023-11-27T20:42:38.558109+0000","last_active":"2023-11-27T20:42:39.848874+0000","last_peered":"2023-11-27T20:42:39.848874+0000","last_clean":"2023-11-27T20:42:39.848874+0000","last_became_active":"2023-11-27T20:42:38.557268+0000","last_became_peered":"2023-11-27T20:42:38.557268+0000","last_unstale":"2023-11-27T20:42:39.848874+0000","last_undegraded":"2023-11-27T20:42:39.848874+0000","last_fullsized":"2023-11-27T20:42:39.848874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545903+0000","last_change":"2023-11-27T20:42:38.554526+0000","last_active":"2023-11-27T20:42:39.545903+0000","last_peered":"2023-11-27T20:42:39.545903+0000","last_clean":"2023-11-27T20:42:39.545903+0000","last_became_active":"2023-11-27T20:42:38.554180+0000","last_became_peered":"2023-11-27T20:42:38.554180+0000","last_unstale":"2023-11-27T20:42:39.545903+0000","last_undegraded":"2023-11-27T20:42:39.545903+0000","last_fullsized":"2023-11-27T20:42:39.545903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547069+0000","last_change":"2023-11-27T20:42:38.539057+0000","last_active":"2023-11-27T20:42:39.547069+0000","last_peered":"2023-11-27T20:42:39.547069+0000","last_clean":"2023-11-27T20:42:39.547069+0000","last_became_active":"2023-11-27T20:42:38.536139+0000","last_became_peered":"2023-11-27T20:42:38.536139+0000","last_unstale":"2023-11-27T20:42:39.547069+0000","last_undegraded":"2023-11-27T20:42:39.547069+0000","last_fullsized":"2023-11-27T20:42:39.547069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":749068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0860000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3089999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.5580000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.26},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.6759999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.198},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":0.99099999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.71}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":159226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.1559999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.036}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.111}]},{"osd":3,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4419999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":3.536,"5min":3.536,"15min":3.536},"last":1.377}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.6919999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.266},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.6259999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":159282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.077}]},{"osd":1,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.206}]},{"osd":2,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.014}]},{"osd":3,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":1.3759999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.4239999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2149999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.4670000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.7050000000000001},{"interface":"front","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.6599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.1379999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.028}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.78200000000000003}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.5269999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.6559999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.25}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.7290000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":161739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.51400000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.745},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.8050000000000002,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.204}]},{"osd":6,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.016},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.0820000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":158680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.63}]},{"osd":1,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.42099999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.89900000000000002}]},{"osd":4,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.73199999999999998}]},{"osd":5,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.157},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":0.81200000000000006}]},{"osd":7,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":0.76700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":161739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.3140000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.751},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.2509999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.421},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.167}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.605}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.3839999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.218}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.6519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":742307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.097}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.96699999999999997}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.147}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.3169999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.3779999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.431}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.613}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:43:04.535 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:43:04.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.787+0000 7f05b217c640 1 Processor -- start 2023-11-27T20:43:04.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.787+0000 7f05b217c640 1 -- start start 2023-11-27T20:43:04.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.788+0000 7f05b217c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac14fd30 0x7f05ac152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.788+0000 7f05b217c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f05ac06d0a0 0x7f05ac0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.788+0000 7f05b217c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ac0c64a0 con 0x7f05ac0a5260 2023-11-27T20:43:04.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.788+0000 7f05b217c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ac0c5c00 con 0x7f05ac06d0a0 2023-11-27T20:43:04.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.788+0000 7f05b217c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0c5ee0 con 0x7f05ac14fd30 2023-11-27T20:43:04.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.789+0000 7f05a3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f05ac06d0a0 0x7f05ac0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.789+0000 7f05a3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f05ac06d0a0 0x7f05ac0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52286/0 (socket says 172.21.15.91:52286) 2023-11-27T20:43:04.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.789+0000 7f05a3fff640 1 -- 172.21.15.91:0/1242719770 learned_addr learned my addr 172.21.15.91:0/1242719770 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:04.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.789+0000 7f05ab7fe640 1 --2- 172.21.15.91:0/1242719770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac14fd30 0x7f05ac152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.789+0000 7f05a3fff640 1 -- 172.21.15.91:0/1242719770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac14fd30 msgr2=0x7f05ac152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:04.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.789+0000 7f05a3fff640 1 --2- 172.21.15.91:0/1242719770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac14fd30 0x7f05ac152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.789+0000 7f05a3fff640 1 -- 172.21.15.91:0/1242719770 >> v1:172.21.15.183:6789/0 conn(0x7f05ac0a5260 legacy=0x7f05ac0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:04.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.789+0000 7f05a3fff640 1 -- 172.21.15.91:0/1242719770 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac0c61c0 con 0x7f05ac06d0a0 2023-11-27T20:43:04.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.790+0000 7f05a3fff640 1 --2- 172.21.15.91:0/1242719770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 0x7f05ac0a4d20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0594009870 tx=0x7f059402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5cdca2adc30417 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:04.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05aaffd640 1 -- 172.21.15.91:0/1242719770 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594031640 con 0x7f05ac06d0a0 2023-11-27T20:43:04.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05aaffd640 1 -- 172.21.15.91:0/1242719770 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05940317a0 con 0x7f05ac06d0a0 2023-11-27T20:43:04.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05aaffd640 1 -- 172.21.15.91:0/1242719770 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594031b30 con 0x7f05ac06d0a0 2023-11-27T20:43:04.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05b217c640 1 -- 172.21.15.91:0/1242719770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 msgr2=0x7f05ac0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:04.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05b217c640 1 --2- 172.21.15.91:0/1242719770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 0x7f05ac0a4d20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0594009870 tx=0x7f059402b8f0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05b217c640 1 -- 172.21.15.91:0/1242719770 shutdown_connections 2023-11-27T20:43:04.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05b217c640 1 --2- 172.21.15.91:0/1242719770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 0x7f05ac0a4d20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05b217c640 1 --2- 172.21.15.91:0/1242719770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac14fd30 0x7f05ac152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05b217c640 1 -- 172.21.15.91:0/1242719770 >> 172.21.15.91:0/1242719770 conn(0x7f05ac06a500 msgr2=0x7f05ac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:04.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05b217c640 1 -- 172.21.15.91:0/1242719770 shutdown_connections 2023-11-27T20:43:04.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.791+0000 7f05b217c640 1 -- 172.21.15.91:0/1242719770 wait complete. 2023-11-27T20:43:04.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.793+0000 7f05b217c640 1 Processor -- start 2023-11-27T20:43:04.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.793+0000 7f05b217c640 1 -- start start 2023-11-27T20:43:04.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.794+0000 7f05b217c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 0x7f05ac14b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.794+0000 7f05b217c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0a5260 0x7f05ac14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.794+0000 7f05b217c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac14fd30 0x7f05ac14eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.794+0000 7f05b217c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac14b900 con 0x7f05ac06d0a0 2023-11-27T20:43:04.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.794+0000 7f05b217c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac1ee260 con 0x7f05ac14fd30 2023-11-27T20:43:04.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.794+0000 7f05b217c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac153d10 con 0x7f05ac0a5260 2023-11-27T20:43:04.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05ab7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 0x7f05ac14b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05ab7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 0x7f05ac14b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52292/0 (socket says 172.21.15.91:52292) 2023-11-27T20:43:04.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05ab7fe640 1 -- 172.21.15.91:0/973631005 learned_addr learned my addr 172.21.15.91:0/973631005 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:04.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05a3fff640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0a5260 0x7f05ac14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05abfff640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac14fd30 0x7f05ac14eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05ab7fe640 1 -- 172.21.15.91:0/973631005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0a5260 msgr2=0x7f05ac14e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:04.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05ab7fe640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0a5260 0x7f05ac14e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05ab7fe640 1 -- 172.21.15.91:0/973631005 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac14fd30 msgr2=0x7f05ac14eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:04.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05ab7fe640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac14fd30 0x7f05ac14eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:04.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05ab7fe640 1 -- 172.21.15.91:0/973631005 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05940094d0 con 0x7f05ac06d0a0 2023-11-27T20:43:04.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05a3fff640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0a5260 0x7f05ac14e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:04.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05abfff640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac14fd30 0x7f05ac14eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:04.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.795+0000 7f05ab7fe640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 0x7f05ac14b3c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f059c00c7f0 tx=0x7f059c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:04.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.796+0000 7f05a8ff9640 1 -- 172.21.15.91:0/973631005 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c004220 con 0x7f05ac06d0a0 2023-11-27T20:43:04.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.796+0000 7f05a8ff9640 1 -- 172.21.15.91:0/973631005 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c004380 con 0x7f05ac06d0a0 2023-11-27T20:43:04.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.796+0000 7f05b217c640 1 -- 172.21.15.91:0/973631005 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac153ff0 con 0x7f05ac06d0a0 2023-11-27T20:43:04.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.796+0000 7f05a8ff9640 1 -- 172.21.15.91:0/973631005 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c007840 con 0x7f05ac06d0a0 2023-11-27T20:43:04.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.796+0000 7f05b217c640 1 -- 172.21.15.91:0/973631005 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ac14b050 con 0x7f05ac06d0a0 2023-11-27T20:43:04.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.797+0000 7f05b217c640 1 -- 172.21.15.91:0/973631005 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ac068350 con 0x7f05ac06d0a0 2023-11-27T20:43:04.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.798+0000 7f05a8ff9640 1 -- 172.21.15.91:0/973631005 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f059c007bb0 con 0x7f05ac06d0a0 2023-11-27T20:43:04.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.799+0000 7f05a8ff9640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f058c06b1c0 0x7f058c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:04.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.799+0000 7f05a8ff9640 1 -- 172.21.15.91:0/973631005 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f059c089be0 con 0x7f05ac06d0a0 2023-11-27T20:43:04.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.799+0000 7f05a3fff640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f058c06b1c0 0x7f058c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:04.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.800+0000 7f05a3fff640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f058c06b1c0 0x7f058c06d680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0594036000 tx=0x7f059403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:04.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.803+0000 7f05a8ff9640 1 -- 172.21.15.91:0/973631005 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f059c054640 con 0x7f05ac06d0a0 2023-11-27T20:43:04.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:04.989+0000 7f05b217c640 1 -- 172.21.15.91:0/973631005 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05ac152d00 con 0x7f058c06b1c0 2023-11-27T20:43:05.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.013+0000 7f05a8ff9640 1 -- 172.21.15.91:0/973631005 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+513314 (secure 0 0 0) 0x7f05ac152d00 con 0x7f058c06b1c0 2023-11-27T20:43:05.023 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:05.027 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:43:05.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 -- 172.21.15.91:0/973631005 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f058c06b1c0 msgr2=0x7f058c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f058c06b1c0 0x7f058c06d680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0594036000 tx=0x7f059403c040 comp rx=0 tx=0).stop 2023-11-27T20:43:05.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 -- 172.21.15.91:0/973631005 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 msgr2=0x7f05ac14b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 0x7f05ac14b3c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f059c00c7f0 tx=0x7f059c00ccb0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 -- 172.21.15.91:0/973631005 shutdown_connections 2023-11-27T20:43:05.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f058c06b1c0 0x7f058c06d680 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac14fd30 0x7f05ac14eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0a5260 0x7f05ac14e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 --2- 172.21.15.91:0/973631005 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05ac06d0a0 0x7f05ac14b3c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 -- 172.21.15.91:0/973631005 >> 172.21.15.91:0/973631005 conn(0x7f05ac06a500 msgr2=0x7f05ac0bfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:05.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.023+0000 7f05b217c640 1 -- 172.21.15.91:0/973631005 shutdown_connections 2023-11-27T20:43:05.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.024+0000 7f05b217c640 1 -- 172.21.15.91:0/973631005 wait complete. 2023-11-27T20:43:05.048 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-27T20:43:03.400015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220476,"kb_used_data":4316,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754244,"statfs":{"total":773094113280,"available":772868345856,"internally_reserved":0,"allocated":4419584,"data_stored":2450755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.895590"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548391+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:42:39.548391+0000","last_peered":"2023-11-27T20:42:39.548391+0000","last_clean":"2023-11-27T20:42:39.548391+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:42:39.548391+0000","last_undegraded":"2023-11-27T20:42:39.548391+0000","last_fullsized":"2023-11-27T20:42:39.548391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546449+0000","last_change":"2023-11-27T20:42:37.523367+0000","last_active":"2023-11-27T20:42:39.546449+0000","last_peered":"2023-11-27T20:42:39.546449+0000","last_clean":"2023-11-27T20:42:39.546449+0000","last_became_active":"2023-11-27T20:42:37.522948+0000","last_became_peered":"2023-11-27T20:42:37.522948+0000","last_unstale":"2023-11-27T20:42:39.546449+0000","last_undegraded":"2023-11-27T20:42:39.546449+0000","last_fullsized":"2023-11-27T20:42:39.546449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.549536+0000","last_change":"2023-11-27T20:42:38.542611+0000","last_active":"2023-11-27T20:42:39.549536+0000","last_peered":"2023-11-27T20:42:39.549536+0000","last_clean":"2023-11-27T20:42:39.549536+0000","last_became_active":"2023-11-27T20:42:38.542177+0000","last_became_peered":"2023-11-27T20:42:38.542177+0000","last_unstale":"2023-11-27T20:42:39.549536+0000","last_undegraded":"2023-11-27T20:42:39.549536+0000","last_fullsized":"2023-11-27T20:42:39.549536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510564+0000","last_change":"2023-11-27T20:42:57.510564+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510564+0000","last_undegraded":"2023-11-27T20:42:57.510564+0000","last_fullsized":"2023-11-27T20:42:57.510564+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545308+0000","last_change":"2023-11-27T20:42:37.533800+0000","last_active":"2023-11-27T20:42:39.545308+0000","last_peered":"2023-11-27T20:42:39.545308+0000","last_clean":"2023-11-27T20:42:39.545308+0000","last_became_active":"2023-11-27T20:42:37.533358+0000","last_became_peered":"2023-11-27T20:42:37.533358+0000","last_unstale":"2023-11-27T20:42:39.545308+0000","last_undegraded":"2023-11-27T20:42:39.545308+0000","last_fullsized":"2023-11-27T20:42:39.545308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926329+0000","last_change":"2023-11-27T20:42:38.544391+0000","last_active":"2023-11-27T20:42:39.926329+0000","last_peered":"2023-11-27T20:42:39.926329+0000","last_clean":"2023-11-27T20:42:39.926329+0000","last_became_active":"2023-11-27T20:42:38.544114+0000","last_became_peered":"2023-11-27T20:42:38.544114+0000","last_unstale":"2023-11-27T20:42:39.926329+0000","last_undegraded":"2023-11-27T20:42:39.926329+0000","last_fullsized":"2023-11-27T20:42:39.926329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518058+0000","last_change":"2023-11-27T20:42:57.518058+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518058+0000","last_undegraded":"2023-11-27T20:42:57.518058+0000","last_fullsized":"2023-11-27T20:42:57.518058+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927152+0000","last_change":"2023-11-27T20:42:37.530919+0000","last_active":"2023-11-27T20:42:39.927152+0000","last_peered":"2023-11-27T20:42:39.927152+0000","last_clean":"2023-11-27T20:42:39.927152+0000","last_became_active":"2023-11-27T20:42:37.530606+0000","last_became_peered":"2023-11-27T20:42:37.530606+0000","last_unstale":"2023-11-27T20:42:39.927152+0000","last_undegraded":"2023-11-27T20:42:39.927152+0000","last_fullsized":"2023-11-27T20:42:39.927152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:26.686814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545481+0000","last_change":"2023-11-27T20:42:38.556454+0000","last_active":"2023-11-27T20:42:39.545481+0000","last_peered":"2023-11-27T20:42:39.545481+0000","last_clean":"2023-11-27T20:42:39.545481+0000","last_became_active":"2023-11-27T20:42:38.556194+0000","last_became_peered":"2023-11-27T20:42:38.556194+0000","last_unstale":"2023-11-27T20:42:39.545481+0000","last_undegraded":"2023-11-27T20:42:39.545481+0000","last_fullsized":"2023-11-27T20:42:39.545481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526221+0000","last_change":"2023-11-27T20:42:57.526221+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526221+0000","last_undegraded":"2023-11-27T20:42:57.526221+0000","last_fullsized":"2023-11-27T20:42:57.526221+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832832+0000","last_change":"2023-11-27T20:42:37.529807+0000","last_active":"2023-11-27T20:42:39.832832+0000","last_peered":"2023-11-27T20:42:39.832832+0000","last_clean":"2023-11-27T20:42:39.832832+0000","last_became_active":"2023-11-27T20:42:37.529543+0000","last_became_peered":"2023-11-27T20:42:37.529543+0000","last_unstale":"2023-11-27T20:42:39.832832+0000","last_undegraded":"2023-11-27T20:42:39.832832+0000","last_fullsized":"2023-11-27T20:42:39.832832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562085+0000","last_change":"2023-11-27T20:42:38.531762+0000","last_active":"2023-11-27T20:42:39.562085+0000","last_peered":"2023-11-27T20:42:39.562085+0000","last_clean":"2023-11-27T20:42:39.562085+0000","last_became_active":"2023-11-27T20:42:38.531490+0000","last_became_peered":"2023-11-27T20:42:38.531490+0000","last_unstale":"2023-11-27T20:42:39.562085+0000","last_undegraded":"2023-11-27T20:42:39.562085+0000","last_fullsized":"2023-11-27T20:42:39.562085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516201+0000","last_change":"2023-11-27T20:42:57.516201+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516201+0000","last_undegraded":"2023-11-27T20:42:57.516201+0000","last_fullsized":"2023-11-27T20:42:57.516201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562653+0000","last_change":"2023-11-27T20:42:37.532441+0000","last_active":"2023-11-27T20:42:39.562653+0000","last_peered":"2023-11-27T20:42:39.562653+0000","last_clean":"2023-11-27T20:42:39.562653+0000","last_became_active":"2023-11-27T20:42:37.532074+0000","last_became_peered":"2023-11-27T20:42:37.532074+0000","last_unstale":"2023-11-27T20:42:39.562653+0000","last_undegraded":"2023-11-27T20:42:39.562653+0000","last_fullsized":"2023-11-27T20:42:39.562653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:04.889609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546138+0000","last_change":"2023-11-27T20:42:38.533430+0000","last_active":"2023-11-27T20:42:39.546138+0000","last_peered":"2023-11-27T20:42:39.546138+0000","last_clean":"2023-11-27T20:42:39.546138+0000","last_became_active":"2023-11-27T20:42:38.532325+0000","last_became_peered":"2023-11-27T20:42:38.532325+0000","last_unstale":"2023-11-27T20:42:39.546138+0000","last_undegraded":"2023-11-27T20:42:39.546138+0000","last_fullsized":"2023-11-27T20:42:39.546138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510732+0000","last_change":"2023-11-27T20:42:57.510732+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510732+0000","last_undegraded":"2023-11-27T20:42:57.510732+0000","last_fullsized":"2023-11-27T20:42:57.510732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833620+0000","last_change":"2023-11-27T20:42:37.527056+0000","last_active":"2023-11-27T20:42:39.833620+0000","last_peered":"2023-11-27T20:42:39.833620+0000","last_clean":"2023-11-27T20:42:39.833620+0000","last_became_active":"2023-11-27T20:42:37.526803+0000","last_became_peered":"2023-11-27T20:42:37.526803+0000","last_unstale":"2023-11-27T20:42:39.833620+0000","last_undegraded":"2023-11-27T20:42:39.833620+0000","last_fullsized":"2023-11-27T20:42:39.833620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561663+0000","last_change":"2023-11-27T20:42:38.536715+0000","last_active":"2023-11-27T20:42:39.561663+0000","last_peered":"2023-11-27T20:42:39.561663+0000","last_clean":"2023-11-27T20:42:39.561663+0000","last_became_active":"2023-11-27T20:42:38.536349+0000","last_became_peered":"2023-11-27T20:42:38.536349+0000","last_unstale":"2023-11-27T20:42:39.561663+0000","last_undegraded":"2023-11-27T20:42:39.561663+0000","last_fullsized":"2023-11-27T20:42:39.561663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.517117+0000","last_change":"2023-11-27T20:42:57.517117+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.517117+0000","last_undegraded":"2023-11-27T20:42:57.517117+0000","last_fullsized":"2023-11-27T20:42:57.517117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.831237+0000","last_change":"2023-11-27T20:42:37.528142+0000","last_active":"2023-11-27T20:42:39.831237+0000","last_peered":"2023-11-27T20:42:39.831237+0000","last_clean":"2023-11-27T20:42:39.831237+0000","last_became_active":"2023-11-27T20:42:37.527318+0000","last_became_peered":"2023-11-27T20:42:37.527318+0000","last_unstale":"2023-11-27T20:42:39.831237+0000","last_undegraded":"2023-11-27T20:42:39.831237+0000","last_fullsized":"2023-11-27T20:42:39.831237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849506+0000","last_change":"2023-11-27T20:42:38.553617+0000","last_active":"2023-11-27T20:42:39.849506+0000","last_peered":"2023-11-27T20:42:39.849506+0000","last_clean":"2023-11-27T20:42:39.849506+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:39.849506+0000","last_undegraded":"2023-11-27T20:42:39.849506+0000","last_fullsized":"2023-11-27T20:42:39.849506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.511845+0000","last_change":"2023-11-27T20:42:57.511845+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.511845+0000","last_undegraded":"2023-11-27T20:42:57.511845+0000","last_fullsized":"2023-11-27T20:42:57.511845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.834058+0000","last_change":"2023-11-27T20:42:37.530114+0000","last_active":"2023-11-27T20:42:39.834058+0000","last_peered":"2023-11-27T20:42:39.834058+0000","last_clean":"2023-11-27T20:42:39.834058+0000","last_became_active":"2023-11-27T20:42:37.529838+0000","last_became_peered":"2023-11-27T20:42:37.529838+0000","last_unstale":"2023-11-27T20:42:39.834058+0000","last_undegraded":"2023-11-27T20:42:39.834058+0000","last_fullsized":"2023-11-27T20:42:39.834058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926678+0000","last_change":"2023-11-27T20:42:38.551126+0000","last_active":"2023-11-27T20:42:39.926678+0000","last_peered":"2023-11-27T20:42:39.926678+0000","last_clean":"2023-11-27T20:42:39.926678+0000","last_became_active":"2023-11-27T20:42:38.550881+0000","last_became_peered":"2023-11-27T20:42:38.550881+0000","last_unstale":"2023-11-27T20:42:39.926678+0000","last_undegraded":"2023-11-27T20:42:39.926678+0000","last_fullsized":"2023-11-27T20:42:39.926678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:08.745845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.527169+0000","last_change":"2023-11-27T20:42:57.527169+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.527169+0000","last_undegraded":"2023-11-27T20:42:57.527169+0000","last_fullsized":"2023-11-27T20:42:57.527169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848218+0000","last_change":"2023-11-27T20:42:37.532212+0000","last_active":"2023-11-27T20:42:39.848218+0000","last_peered":"2023-11-27T20:42:39.848218+0000","last_clean":"2023-11-27T20:42:39.848218+0000","last_became_active":"2023-11-27T20:42:37.531894+0000","last_became_peered":"2023-11-27T20:42:37.531894+0000","last_unstale":"2023-11-27T20:42:39.848218+0000","last_undegraded":"2023-11-27T20:42:39.848218+0000","last_fullsized":"2023-11-27T20:42:39.848218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547400+0000","last_change":"2023-11-27T20:42:38.537364+0000","last_active":"2023-11-27T20:42:39.547400+0000","last_peered":"2023-11-27T20:42:39.547400+0000","last_clean":"2023-11-27T20:42:39.547400+0000","last_became_active":"2023-11-27T20:42:38.536521+0000","last_became_peered":"2023-11-27T20:42:38.536521+0000","last_unstale":"2023-11-27T20:42:39.547400+0000","last_undegraded":"2023-11-27T20:42:39.547400+0000","last_fullsized":"2023-11-27T20:42:39.547400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510514+0000","last_change":"2023-11-27T20:42:57.510514+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510514+0000","last_undegraded":"2023-11-27T20:42:57.510514+0000","last_fullsized":"2023-11-27T20:42:57.510514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926403+0000","last_change":"2023-11-27T20:42:37.518579+0000","last_active":"2023-11-27T20:42:39.926403+0000","last_peered":"2023-11-27T20:42:39.926403+0000","last_clean":"2023-11-27T20:42:39.926403+0000","last_became_active":"2023-11-27T20:42:37.517970+0000","last_became_peered":"2023-11-27T20:42:37.517970+0000","last_unstale":"2023-11-27T20:42:39.926403+0000","last_undegraded":"2023-11-27T20:42:39.926403+0000","last_fullsized":"2023-11-27T20:42:39.926403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.925849+0000","last_change":"2023-11-27T20:42:38.539525+0000","last_active":"2023-11-27T20:42:39.925849+0000","last_peered":"2023-11-27T20:42:39.925849+0000","last_clean":"2023-11-27T20:42:39.925849+0000","last_became_active":"2023-11-27T20:42:38.539244+0000","last_became_peered":"2023-11-27T20:42:38.539244+0000","last_unstale":"2023-11-27T20:42:39.925849+0000","last_undegraded":"2023-11-27T20:42:39.925849+0000","last_fullsized":"2023-11-27T20:42:39.925849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:12:08.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518026+0000","last_change":"2023-11-27T20:42:57.518026+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518026+0000","last_undegraded":"2023-11-27T20:42:57.518026+0000","last_fullsized":"2023-11-27T20:42:57.518026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546116+0000","last_change":"2023-11-27T20:42:37.522543+0000","last_active":"2023-11-27T20:42:39.546116+0000","last_peered":"2023-11-27T20:42:39.546116+0000","last_clean":"2023-11-27T20:42:39.546116+0000","last_became_active":"2023-11-27T20:42:37.522163+0000","last_became_peered":"2023-11-27T20:42:37.522163+0000","last_unstale":"2023-11-27T20:42:39.546116+0000","last_undegraded":"2023-11-27T20:42:39.546116+0000","last_fullsized":"2023-11-27T20:42:39.546116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:46.239563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926297+0000","last_change":"2023-11-27T20:42:38.536322+0000","last_active":"2023-11-27T20:42:39.926297+0000","last_peered":"2023-11-27T20:42:39.926297+0000","last_clean":"2023-11-27T20:42:39.926297+0000","last_became_active":"2023-11-27T20:42:38.536051+0000","last_became_peered":"2023-11-27T20:42:38.536051+0000","last_unstale":"2023-11-27T20:42:39.926297+0000","last_undegraded":"2023-11-27T20:42:39.926297+0000","last_fullsized":"2023-11-27T20:42:39.926297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:31.539798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526042+0000","last_change":"2023-11-27T20:42:57.526042+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526042+0000","last_undegraded":"2023-11-27T20:42:57.526042+0000","last_fullsized":"2023-11-27T20:42:57.526042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562351+0000","last_change":"2023-11-27T20:42:37.527591+0000","last_active":"2023-11-27T20:42:39.562351+0000","last_peered":"2023-11-27T20:42:39.562351+0000","last_clean":"2023-11-27T20:42:39.562351+0000","last_became_active":"2023-11-27T20:42:37.527305+0000","last_became_peered":"2023-11-27T20:42:37.527305+0000","last_unstale":"2023-11-27T20:42:39.562351+0000","last_undegraded":"2023-11-27T20:42:39.562351+0000","last_fullsized":"2023-11-27T20:42:39.562351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926039+0000","last_change":"2023-11-27T20:42:38.547894+0000","last_active":"2023-11-27T20:42:39.926039+0000","last_peered":"2023-11-27T20:42:39.926039+0000","last_clean":"2023-11-27T20:42:39.926039+0000","last_became_active":"2023-11-27T20:42:38.547558+0000","last_became_peered":"2023-11-27T20:42:38.547558+0000","last_unstale":"2023-11-27T20:42:39.926039+0000","last_undegraded":"2023-11-27T20:42:39.926039+0000","last_fullsized":"2023-11-27T20:42:39.926039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:38.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516720+0000","last_change":"2023-11-27T20:42:57.516720+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516720+0000","last_undegraded":"2023-11-27T20:42:57.516720+0000","last_fullsized":"2023-11-27T20:42:57.516720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927409+0000","last_change":"2023-11-27T20:42:37.527131+0000","last_active":"2023-11-27T20:42:39.927409+0000","last_peered":"2023-11-27T20:42:39.927409+0000","last_clean":"2023-11-27T20:42:39.927409+0000","last_became_active":"2023-11-27T20:42:37.526804+0000","last_became_peered":"2023-11-27T20:42:37.526804+0000","last_unstale":"2023-11-27T20:42:39.927409+0000","last_undegraded":"2023-11-27T20:42:39.927409+0000","last_fullsized":"2023-11-27T20:42:39.927409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926551+0000","last_change":"2023-11-27T20:42:38.549244+0000","last_active":"2023-11-27T20:42:39.926551+0000","last_peered":"2023-11-27T20:42:39.926551+0000","last_clean":"2023-11-27T20:42:39.926551+0000","last_became_active":"2023-11-27T20:42:38.548660+0000","last_became_peered":"2023-11-27T20:42:38.548660+0000","last_unstale":"2023-11-27T20:42:39.926551+0000","last_undegraded":"2023-11-27T20:42:39.926551+0000","last_fullsized":"2023-11-27T20:42:39.926551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:22.348409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.520466+0000","last_change":"2023-11-27T20:42:57.520466+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.520466+0000","last_undegraded":"2023-11-27T20:42:57.520466+0000","last_fullsized":"2023-11-27T20:42:57.520466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927419+0000","last_change":"2023-11-27T20:42:37.525601+0000","last_active":"2023-11-27T20:42:39.927419+0000","last_peered":"2023-11-27T20:42:39.927419+0000","last_clean":"2023-11-27T20:42:39.927419+0000","last_became_active":"2023-11-27T20:42:37.525296+0000","last_became_peered":"2023-11-27T20:42:37.525296+0000","last_unstale":"2023-11-27T20:42:39.927419+0000","last_undegraded":"2023-11-27T20:42:39.927419+0000","last_fullsized":"2023-11-27T20:42:39.927419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833446+0000","last_change":"2023-11-27T20:42:38.554165+0000","last_active":"2023-11-27T20:42:39.833446+0000","last_peered":"2023-11-27T20:42:39.833446+0000","last_clean":"2023-11-27T20:42:39.833446+0000","last_became_active":"2023-11-27T20:42:38.553912+0000","last_became_peered":"2023-11-27T20:42:38.553912+0000","last_unstale":"2023-11-27T20:42:39.833446+0000","last_undegraded":"2023-11-27T20:42:39.833446+0000","last_fullsized":"2023-11-27T20:42:39.833446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.511643+0000","last_change":"2023-11-27T20:42:57.511643+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.511643+0000","last_undegraded":"2023-11-27T20:42:57.511643+0000","last_fullsized":"2023-11-27T20:42:57.511643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927463+0000","last_change":"2023-11-27T20:42:37.522245+0000","last_active":"2023-11-27T20:42:39.927463+0000","last_peered":"2023-11-27T20:42:39.927463+0000","last_clean":"2023-11-27T20:42:39.927463+0000","last_became_active":"2023-11-27T20:42:37.521938+0000","last_became_peered":"2023-11-27T20:42:37.521938+0000","last_unstale":"2023-11-27T20:42:39.927463+0000","last_undegraded":"2023-11-27T20:42:39.927463+0000","last_fullsized":"2023-11-27T20:42:39.927463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849278+0000","last_change":"2023-11-27T20:42:38.549553+0000","last_active":"2023-11-27T20:42:39.849278+0000","last_peered":"2023-11-27T20:42:39.849278+0000","last_clean":"2023-11-27T20:42:39.849278+0000","last_became_active":"2023-11-27T20:42:38.549075+0000","last_became_peered":"2023-11-27T20:42:38.549075+0000","last_unstale":"2023-11-27T20:42:39.849278+0000","last_undegraded":"2023-11-27T20:42:39.849278+0000","last_fullsized":"2023-11-27T20:42:39.849278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.517619+0000","last_change":"2023-11-27T20:42:57.517619+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.517619+0000","last_undegraded":"2023-11-27T20:42:57.517619+0000","last_fullsized":"2023-11-27T20:42:57.517619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.834022+0000","last_change":"2023-11-27T20:42:37.525560+0000","last_active":"2023-11-27T20:42:39.834022+0000","last_peered":"2023-11-27T20:42:39.834022+0000","last_clean":"2023-11-27T20:42:39.834022+0000","last_became_active":"2023-11-27T20:42:37.525261+0000","last_became_peered":"2023-11-27T20:42:37.525261+0000","last_unstale":"2023-11-27T20:42:39.834022+0000","last_undegraded":"2023-11-27T20:42:39.834022+0000","last_fullsized":"2023-11-27T20:42:39.834022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:16.392657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927183+0000","last_change":"2023-11-27T20:42:38.546056+0000","last_active":"2023-11-27T20:42:39.927183+0000","last_peered":"2023-11-27T20:42:39.927183+0000","last_clean":"2023-11-27T20:42:39.927183+0000","last_became_active":"2023-11-27T20:42:38.545736+0000","last_became_peered":"2023-11-27T20:42:38.545736+0000","last_unstale":"2023-11-27T20:42:39.927183+0000","last_undegraded":"2023-11-27T20:42:39.927183+0000","last_fullsized":"2023-11-27T20:42:39.927183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510435+0000","last_change":"2023-11-27T20:42:57.510435+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510435+0000","last_undegraded":"2023-11-27T20:42:57.510435+0000","last_fullsized":"2023-11-27T20:42:57.510435+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545443+0000","last_change":"2023-11-27T20:42:37.514338+0000","last_active":"2023-11-27T20:42:39.545443+0000","last_peered":"2023-11-27T20:42:39.545443+0000","last_clean":"2023-11-27T20:42:39.545443+0000","last_became_active":"2023-11-27T20:42:37.514055+0000","last_became_peered":"2023-11-27T20:42:37.514055+0000","last_unstale":"2023-11-27T20:42:39.545443+0000","last_undegraded":"2023-11-27T20:42:39.545443+0000","last_fullsized":"2023-11-27T20:42:39.545443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546366+0000","last_change":"2023-11-27T20:42:38.547970+0000","last_active":"2023-11-27T20:42:39.546366+0000","last_peered":"2023-11-27T20:42:39.546366+0000","last_clean":"2023-11-27T20:42:39.546366+0000","last_became_active":"2023-11-27T20:42:38.547656+0000","last_became_peered":"2023-11-27T20:42:38.547656+0000","last_unstale":"2023-11-27T20:42:39.546366+0000","last_undegraded":"2023-11-27T20:42:39.546366+0000","last_fullsized":"2023-11-27T20:42:39.546366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526486+0000","last_change":"2023-11-27T20:42:57.526486+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526486+0000","last_undegraded":"2023-11-27T20:42:57.526486+0000","last_fullsized":"2023-11-27T20:42:57.526486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545452+0000","last_change":"2023-11-27T20:42:37.535247+0000","last_active":"2023-11-27T20:42:39.545452+0000","last_peered":"2023-11-27T20:42:39.545452+0000","last_clean":"2023-11-27T20:42:39.545452+0000","last_became_active":"2023-11-27T20:42:37.534922+0000","last_became_peered":"2023-11-27T20:42:37.534922+0000","last_unstale":"2023-11-27T20:42:39.545452+0000","last_undegraded":"2023-11-27T20:42:39.545452+0000","last_fullsized":"2023-11-27T20:42:39.545452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:45.108775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547677+0000","last_change":"2023-11-27T20:42:38.548304+0000","last_active":"2023-11-27T20:42:39.547677+0000","last_peered":"2023-11-27T20:42:39.547677+0000","last_clean":"2023-11-27T20:42:39.547677+0000","last_became_active":"2023-11-27T20:42:38.547970+0000","last_became_peered":"2023-11-27T20:42:38.547970+0000","last_unstale":"2023-11-27T20:42:39.547677+0000","last_undegraded":"2023-11-27T20:42:39.547677+0000","last_fullsized":"2023-11-27T20:42:39.547677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518549+0000","last_change":"2023-11-27T20:42:57.518549+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518549+0000","last_undegraded":"2023-11-27T20:42:57.518549+0000","last_fullsized":"2023-11-27T20:42:57.518549+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832636+0000","last_change":"2023-11-27T20:42:37.522904+0000","last_active":"2023-11-27T20:42:39.832636+0000","last_peered":"2023-11-27T20:42:39.832636+0000","last_clean":"2023-11-27T20:42:39.832636+0000","last_became_active":"2023-11-27T20:42:37.522574+0000","last_became_peered":"2023-11-27T20:42:37.522574+0000","last_unstale":"2023-11-27T20:42:39.832636+0000","last_undegraded":"2023-11-27T20:42:39.832636+0000","last_fullsized":"2023-11-27T20:42:39.832636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546755+0000","last_change":"2023-11-27T20:42:38.553812+0000","last_active":"2023-11-27T20:42:39.546755+0000","last_peered":"2023-11-27T20:42:39.546755+0000","last_clean":"2023-11-27T20:42:39.546755+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:39.546755+0000","last_undegraded":"2023-11-27T20:42:39.546755+0000","last_fullsized":"2023-11-27T20:42:39.546755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:21.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516790+0000","last_change":"2023-11-27T20:42:57.516790+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516790+0000","last_undegraded":"2023-11-27T20:42:57.516790+0000","last_fullsized":"2023-11-27T20:42:57.516790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927117+0000","last_change":"2023-11-27T20:42:37.524294+0000","last_active":"2023-11-27T20:42:39.927117+0000","last_peered":"2023-11-27T20:42:39.927117+0000","last_clean":"2023-11-27T20:42:39.927117+0000","last_became_active":"2023-11-27T20:42:37.523858+0000","last_became_peered":"2023-11-27T20:42:37.523858+0000","last_unstale":"2023-11-27T20:42:39.927117+0000","last_undegraded":"2023-11-27T20:42:39.927117+0000","last_fullsized":"2023-11-27T20:42:39.927117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832659+0000","last_change":"2023-11-27T20:42:38.543201+0000","last_active":"2023-11-27T20:42:39.832659+0000","last_peered":"2023-11-27T20:42:39.832659+0000","last_clean":"2023-11-27T20:42:39.832659+0000","last_became_active":"2023-11-27T20:42:38.542920+0000","last_became_peered":"2023-11-27T20:42:38.542920+0000","last_unstale":"2023-11-27T20:42:39.832659+0000","last_undegraded":"2023-11-27T20:42:39.832659+0000","last_fullsized":"2023-11-27T20:42:39.832659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516769+0000","last_change":"2023-11-27T20:42:57.516769+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516769+0000","last_undegraded":"2023-11-27T20:42:57.516769+0000","last_fullsized":"2023-11-27T20:42:57.516769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:53.057510+0000","last_change":"2023-11-27T20:42:37.523173+0000","last_active":"2023-11-27T20:42:53.057510+0000","last_peered":"2023-11-27T20:42:53.057510+0000","last_clean":"2023-11-27T20:42:53.057510+0000","last_became_active":"2023-11-27T20:42:37.522903+0000","last_became_peered":"2023-11-27T20:42:37.522903+0000","last_unstale":"2023-11-27T20:42:53.057510+0000","last_undegraded":"2023-11-27T20:42:53.057510+0000","last_fullsized":"2023-11-27T20:42:53.057510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:28.381599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848936+0000","last_change":"2023-11-27T20:42:38.557705+0000","last_active":"2023-11-27T20:42:39.848936+0000","last_peered":"2023-11-27T20:42:39.848936+0000","last_clean":"2023-11-27T20:42:39.848936+0000","last_became_active":"2023-11-27T20:42:38.557251+0000","last_became_peered":"2023-11-27T20:42:38.557251+0000","last_unstale":"2023-11-27T20:42:39.848936+0000","last_undegraded":"2023-11-27T20:42:39.848936+0000","last_fullsized":"2023-11-27T20:42:39.848936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516409+0000","last_change":"2023-11-27T20:42:57.516409+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516409+0000","last_undegraded":"2023-11-27T20:42:57.516409+0000","last_fullsized":"2023-11-27T20:42:57.516409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849118+0000","last_change":"2023-11-27T20:42:37.530460+0000","last_active":"2023-11-27T20:42:39.849118+0000","last_peered":"2023-11-27T20:42:39.849118+0000","last_clean":"2023-11-27T20:42:39.849118+0000","last_became_active":"2023-11-27T20:42:37.529879+0000","last_became_peered":"2023-11-27T20:42:37.529879+0000","last_unstale":"2023-11-27T20:42:39.849118+0000","last_undegraded":"2023-11-27T20:42:39.849118+0000","last_fullsized":"2023-11-27T20:42:39.849118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:58.185242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545848+0000","last_change":"2023-11-27T20:42:38.555684+0000","last_active":"2023-11-27T20:42:39.545848+0000","last_peered":"2023-11-27T20:42:39.545848+0000","last_clean":"2023-11-27T20:42:39.545848+0000","last_became_active":"2023-11-27T20:42:38.555415+0000","last_became_peered":"2023-11-27T20:42:38.555415+0000","last_unstale":"2023-11-27T20:42:39.545848+0000","last_undegraded":"2023-11-27T20:42:39.545848+0000","last_fullsized":"2023-11-27T20:42:39.545848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.518638+0000","last_change":"2023-11-27T20:42:57.518638+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.518638+0000","last_undegraded":"2023-11-27T20:42:57.518638+0000","last_fullsized":"2023-11-27T20:42:57.518638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562223+0000","last_change":"2023-11-27T20:42:37.532869+0000","last_active":"2023-11-27T20:42:39.562223+0000","last_peered":"2023-11-27T20:42:39.562223+0000","last_clean":"2023-11-27T20:42:39.562223+0000","last_became_active":"2023-11-27T20:42:37.532576+0000","last_became_peered":"2023-11-27T20:42:37.532576+0000","last_unstale":"2023-11-27T20:42:39.562223+0000","last_undegraded":"2023-11-27T20:42:39.562223+0000","last_fullsized":"2023-11-27T20:42:39.562223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546630+0000","last_change":"2023-11-27T20:42:38.559970+0000","last_active":"2023-11-27T20:42:39.546630+0000","last_peered":"2023-11-27T20:42:39.546630+0000","last_clean":"2023-11-27T20:42:39.546630+0000","last_became_active":"2023-11-27T20:42:38.559688+0000","last_became_peered":"2023-11-27T20:42:38.559688+0000","last_unstale":"2023-11-27T20:42:39.546630+0000","last_undegraded":"2023-11-27T20:42:39.546630+0000","last_fullsized":"2023-11-27T20:42:39.546630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:47.260947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.511654+0000","last_change":"2023-11-27T20:42:57.511654+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.511654+0000","last_undegraded":"2023-11-27T20:42:57.511654+0000","last_fullsized":"2023-11-27T20:42:57.511654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546639+0000","last_change":"2023-11-27T20:42:37.531762+0000","last_active":"2023-11-27T20:42:39.546639+0000","last_peered":"2023-11-27T20:42:39.546639+0000","last_clean":"2023-11-27T20:42:39.546639+0000","last_became_active":"2023-11-27T20:42:37.531446+0000","last_became_peered":"2023-11-27T20:42:37.531446+0000","last_unstale":"2023-11-27T20:42:39.546639+0000","last_undegraded":"2023-11-27T20:42:39.546639+0000","last_fullsized":"2023-11-27T20:42:39.546639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:11.474537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849378+0000","last_change":"2023-11-27T20:42:38.555603+0000","last_active":"2023-11-27T20:42:39.849378+0000","last_peered":"2023-11-27T20:42:39.849378+0000","last_clean":"2023-11-27T20:42:39.849378+0000","last_became_active":"2023-11-27T20:42:38.555305+0000","last_became_peered":"2023-11-27T20:42:38.555305+0000","last_unstale":"2023-11-27T20:42:39.849378+0000","last_undegraded":"2023-11-27T20:42:39.849378+0000","last_fullsized":"2023-11-27T20:42:39.849378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.528207+0000","last_change":"2023-11-27T20:42:57.528207+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.528207+0000","last_undegraded":"2023-11-27T20:42:57.528207+0000","last_fullsized":"2023-11-27T20:42:57.528207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926258+0000","last_change":"2023-11-27T20:42:37.522230+0000","last_active":"2023-11-27T20:42:39.926258+0000","last_peered":"2023-11-27T20:42:39.926258+0000","last_clean":"2023-11-27T20:42:39.926258+0000","last_became_active":"2023-11-27T20:42:37.521898+0000","last_became_peered":"2023-11-27T20:42:37.521898+0000","last_unstale":"2023-11-27T20:42:39.926258+0000","last_undegraded":"2023-11-27T20:42:39.926258+0000","last_fullsized":"2023-11-27T20:42:39.926258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:16:18.992040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.832678+0000","last_change":"2023-11-27T20:42:38.538177+0000","last_active":"2023-11-27T20:42:39.832678+0000","last_peered":"2023-11-27T20:42:39.832678+0000","last_clean":"2023-11-27T20:42:39.832678+0000","last_became_active":"2023-11-27T20:42:38.537835+0000","last_became_peered":"2023-11-27T20:42:38.537835+0000","last_unstale":"2023-11-27T20:42:39.832678+0000","last_undegraded":"2023-11-27T20:42:39.832678+0000","last_fullsized":"2023-11-27T20:42:39.832678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.519383+0000","last_change":"2023-11-27T20:42:57.519383+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.519383+0000","last_undegraded":"2023-11-27T20:42:57.519383+0000","last_fullsized":"2023-11-27T20:42:57.519383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545442+0000","last_change":"2023-11-27T20:42:37.522964+0000","last_active":"2023-11-27T20:42:39.545442+0000","last_peered":"2023-11-27T20:42:39.545442+0000","last_clean":"2023-11-27T20:42:39.545442+0000","last_became_active":"2023-11-27T20:42:37.522677+0000","last_became_peered":"2023-11-27T20:42:37.522677+0000","last_unstale":"2023-11-27T20:42:39.545442+0000","last_undegraded":"2023-11-27T20:42:39.545442+0000","last_fullsized":"2023-11-27T20:42:39.545442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:30.748479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926310+0000","last_change":"2023-11-27T20:42:38.533572+0000","last_active":"2023-11-27T20:42:39.926310+0000","last_peered":"2023-11-27T20:42:39.926310+0000","last_clean":"2023-11-27T20:42:39.926310+0000","last_became_active":"2023-11-27T20:42:38.533281+0000","last_became_peered":"2023-11-27T20:42:38.533281+0000","last_unstale":"2023-11-27T20:42:39.926310+0000","last_undegraded":"2023-11-27T20:42:39.926310+0000","last_fullsized":"2023-11-27T20:42:39.926310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.519078+0000","last_change":"2023-11-27T20:42:57.519078+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.519078+0000","last_undegraded":"2023-11-27T20:42:57.519078+0000","last_fullsized":"2023-11-27T20:42:57.519078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926655+0000","last_change":"2023-11-27T20:42:37.531654+0000","last_active":"2023-11-27T20:42:39.926655+0000","last_peered":"2023-11-27T20:42:39.926655+0000","last_clean":"2023-11-27T20:42:39.926655+0000","last_became_active":"2023-11-27T20:42:37.529901+0000","last_became_peered":"2023-11-27T20:42:37.529901+0000","last_unstale":"2023-11-27T20:42:39.926655+0000","last_undegraded":"2023-11-27T20:42:39.926655+0000","last_fullsized":"2023-11-27T20:42:39.926655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848846+0000","last_change":"2023-11-27T20:42:38.545564+0000","last_active":"2023-11-27T20:42:39.848846+0000","last_peered":"2023-11-27T20:42:39.848846+0000","last_clean":"2023-11-27T20:42:39.848846+0000","last_became_active":"2023-11-27T20:42:38.545232+0000","last_became_peered":"2023-11-27T20:42:38.545232+0000","last_unstale":"2023-11-27T20:42:39.848846+0000","last_undegraded":"2023-11-27T20:42:39.848846+0000","last_fullsized":"2023-11-27T20:42:39.848846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.517252+0000","last_change":"2023-11-27T20:42:57.517252+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.517252+0000","last_undegraded":"2023-11-27T20:42:57.517252+0000","last_fullsized":"2023-11-27T20:42:57.517252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927435+0000","last_change":"2023-11-27T20:42:37.527381+0000","last_active":"2023-11-27T20:42:39.927435+0000","last_peered":"2023-11-27T20:42:39.927435+0000","last_clean":"2023-11-27T20:42:39.927435+0000","last_became_active":"2023-11-27T20:42:37.527147+0000","last_became_peered":"2023-11-27T20:42:37.527147+0000","last_unstale":"2023-11-27T20:42:39.927435+0000","last_undegraded":"2023-11-27T20:42:39.927435+0000","last_fullsized":"2023-11-27T20:42:39.927435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548933+0000","last_change":"2023-11-27T20:42:38.552242+0000","last_active":"2023-11-27T20:42:39.548933+0000","last_peered":"2023-11-27T20:42:39.548933+0000","last_clean":"2023-11-27T20:42:39.548933+0000","last_became_active":"2023-11-27T20:42:38.551805+0000","last_became_peered":"2023-11-27T20:42:38.551805+0000","last_unstale":"2023-11-27T20:42:39.548933+0000","last_undegraded":"2023-11-27T20:42:39.548933+0000","last_fullsized":"2023-11-27T20:42:39.548933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.510670+0000","last_change":"2023-11-27T20:42:57.510670+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.510670+0000","last_undegraded":"2023-11-27T20:42:57.510670+0000","last_fullsized":"2023-11-27T20:42:57.510670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.519360+0000","last_change":"2023-11-27T20:42:57.519360+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.519360+0000","last_undegraded":"2023-11-27T20:42:57.519360+0000","last_fullsized":"2023-11-27T20:42:57.519360+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926662+0000","last_change":"2023-11-27T20:42:37.530074+0000","last_active":"2023-11-27T20:42:39.926662+0000","last_peered":"2023-11-27T20:42:39.926662+0000","last_clean":"2023-11-27T20:42:39.926662+0000","last_became_active":"2023-11-27T20:42:37.529422+0000","last_became_peered":"2023-11-27T20:42:37.529422+0000","last_unstale":"2023-11-27T20:42:39.926662+0000","last_undegraded":"2023-11-27T20:42:39.926662+0000","last_fullsized":"2023-11-27T20:42:39.926662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:40:40.129670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833577+0000","last_change":"2023-11-27T20:42:38.551495+0000","last_active":"2023-11-27T20:42:39.833577+0000","last_peered":"2023-11-27T20:42:39.833577+0000","last_clean":"2023-11-27T20:42:39.833577+0000","last_became_active":"2023-11-27T20:42:38.548057+0000","last_became_peered":"2023-11-27T20:42:38.548057+0000","last_unstale":"2023-11-27T20:42:39.833577+0000","last_undegraded":"2023-11-27T20:42:39.833577+0000","last_fullsized":"2023-11-27T20:42:39.833577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.516646+0000","last_change":"2023-11-27T20:42:57.516646+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.516646+0000","last_undegraded":"2023-11-27T20:42:57.516646+0000","last_fullsized":"2023-11-27T20:42:57.516646+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546210+0000","last_change":"2023-11-27T20:42:37.520015+0000","last_active":"2023-11-27T20:42:39.546210+0000","last_peered":"2023-11-27T20:42:39.546210+0000","last_clean":"2023-11-27T20:42:39.546210+0000","last_became_active":"2023-11-27T20:42:37.519779+0000","last_became_peered":"2023-11-27T20:42:37.519779+0000","last_unstale":"2023-11-27T20:42:39.546210+0000","last_undegraded":"2023-11-27T20:42:39.546210+0000","last_fullsized":"2023-11-27T20:42:39.546210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:47.336738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927259+0000","last_change":"2023-11-27T20:42:38.558352+0000","last_active":"2023-11-27T20:42:39.927259+0000","last_peered":"2023-11-27T20:42:39.927259+0000","last_clean":"2023-11-27T20:42:39.927259+0000","last_became_active":"2023-11-27T20:42:38.557630+0000","last_became_peered":"2023-11-27T20:42:38.557630+0000","last_unstale":"2023-11-27T20:42:39.927259+0000","last_undegraded":"2023-11-27T20:42:39.927259+0000","last_fullsized":"2023-11-27T20:42:39.927259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.562043+0000","last_change":"2023-11-27T20:42:37.535511+0000","last_active":"2023-11-27T20:42:39.562043+0000","last_peered":"2023-11-27T20:42:39.562043+0000","last_clean":"2023-11-27T20:42:39.562043+0000","last_became_active":"2023-11-27T20:42:37.535314+0000","last_became_peered":"2023-11-27T20:42:37.535314+0000","last_unstale":"2023-11-27T20:42:39.562043+0000","last_undegraded":"2023-11-27T20:42:39.562043+0000","last_fullsized":"2023-11-27T20:42:39.562043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548247+0000","last_change":"2023-11-27T20:42:38.545391+0000","last_active":"2023-11-27T20:42:39.548247+0000","last_peered":"2023-11-27T20:42:39.548247+0000","last_clean":"2023-11-27T20:42:39.548247+0000","last_became_active":"2023-11-27T20:42:38.544984+0000","last_became_peered":"2023-11-27T20:42:38.544984+0000","last_unstale":"2023-11-27T20:42:39.548247+0000","last_undegraded":"2023-11-27T20:42:39.548247+0000","last_fullsized":"2023-11-27T20:42:39.548247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.526385+0000","last_change":"2023-11-27T20:42:57.526385+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.526385+0000","last_undegraded":"2023-11-27T20:42:57.526385+0000","last_fullsized":"2023-11-27T20:42:57.526385+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548476+0000","last_change":"2023-11-27T20:42:37.528294+0000","last_active":"2023-11-27T20:42:39.548476+0000","last_peered":"2023-11-27T20:42:39.548476+0000","last_clean":"2023-11-27T20:42:39.548476+0000","last_became_active":"2023-11-27T20:42:37.528055+0000","last_became_peered":"2023-11-27T20:42:37.528055+0000","last_unstale":"2023-11-27T20:42:39.548476+0000","last_undegraded":"2023-11-27T20:42:39.548476+0000","last_fullsized":"2023-11-27T20:42:39.548476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561817+0000","last_change":"2023-11-27T20:42:38.529609+0000","last_active":"2023-11-27T20:42:39.561817+0000","last_peered":"2023-11-27T20:42:39.561817+0000","last_clean":"2023-11-27T20:42:39.561817+0000","last_became_active":"2023-11-27T20:42:38.529089+0000","last_became_peered":"2023-11-27T20:42:38.529089+0000","last_unstale":"2023-11-27T20:42:39.561817+0000","last_undegraded":"2023-11-27T20:42:39.561817+0000","last_fullsized":"2023-11-27T20:42:39.561817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-27T20:42:57.512528+0000","last_change":"2023-11-27T20:42:57.512528+0000","last_active":"2023-11-27T20:42:57.489897+0000","last_peered":"2023-11-27T20:42:57.489897+0000","last_clean":"2023-11-27T20:42:57.489897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:57.512528+0000","last_undegraded":"2023-11-27T20:42:57.512528+0000","last_fullsized":"2023-11-27T20:42:57.512528+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548354+0000","last_change":"2023-11-27T20:42:38.549776+0000","last_active":"2023-11-27T20:42:39.548354+0000","last_peered":"2023-11-27T20:42:39.548354+0000","last_clean":"2023-11-27T20:42:39.548354+0000","last_became_active":"2023-11-27T20:42:38.549339+0000","last_became_peered":"2023-11-27T20:42:38.549339+0000","last_unstale":"2023-11-27T20:42:39.548354+0000","last_undegraded":"2023-11-27T20:42:39.548354+0000","last_fullsized":"2023-11-27T20:42:39.548354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546002+0000","last_change":"2023-11-27T20:42:38.539218+0000","last_active":"2023-11-27T20:42:39.546002+0000","last_peered":"2023-11-27T20:42:39.546002+0000","last_clean":"2023-11-27T20:42:39.546002+0000","last_became_active":"2023-11-27T20:42:38.538843+0000","last_became_peered":"2023-11-27T20:42:38.538843+0000","last_unstale":"2023-11-27T20:42:39.546002+0000","last_undegraded":"2023-11-27T20:42:39.546002+0000","last_fullsized":"2023-11-27T20:42:39.546002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:10.273471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548498+0000","last_change":"2023-11-27T20:42:38.531773+0000","last_active":"2023-11-27T20:42:39.548498+0000","last_peered":"2023-11-27T20:42:39.548498+0000","last_clean":"2023-11-27T20:42:39.548498+0000","last_became_active":"2023-11-27T20:42:38.531469+0000","last_became_peered":"2023-11-27T20:42:38.531469+0000","last_unstale":"2023-11-27T20:42:39.548498+0000","last_undegraded":"2023-11-27T20:42:39.548498+0000","last_fullsized":"2023-11-27T20:42:39.548498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926846+0000","last_change":"2023-11-27T20:42:38.548676+0000","last_active":"2023-11-27T20:42:39.926846+0000","last_peered":"2023-11-27T20:42:39.926846+0000","last_clean":"2023-11-27T20:42:39.926846+0000","last_became_active":"2023-11-27T20:42:38.548338+0000","last_became_peered":"2023-11-27T20:42:38.548338+0000","last_unstale":"2023-11-27T20:42:39.926846+0000","last_undegraded":"2023-11-27T20:42:39.926846+0000","last_fullsized":"2023-11-27T20:42:39.926846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.849355+0000","last_change":"2023-11-27T20:42:38.541871+0000","last_active":"2023-11-27T20:42:39.849355+0000","last_peered":"2023-11-27T20:42:39.849355+0000","last_clean":"2023-11-27T20:42:39.849355+0000","last_became_active":"2023-11-27T20:42:38.532675+0000","last_became_peered":"2023-11-27T20:42:38.532675+0000","last_unstale":"2023-11-27T20:42:39.849355+0000","last_undegraded":"2023-11-27T20:42:39.849355+0000","last_fullsized":"2023-11-27T20:42:39.849355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833713+0000","last_change":"2023-11-27T20:42:38.547768+0000","last_active":"2023-11-27T20:42:39.833713+0000","last_peered":"2023-11-27T20:42:39.833713+0000","last_clean":"2023-11-27T20:42:39.833713+0000","last_became_active":"2023-11-27T20:42:38.547403+0000","last_became_peered":"2023-11-27T20:42:38.547403+0000","last_unstale":"2023-11-27T20:42:39.833713+0000","last_undegraded":"2023-11-27T20:42:39.833713+0000","last_fullsized":"2023-11-27T20:42:39.833713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546256+0000","last_change":"2023-11-27T20:42:38.553640+0000","last_active":"2023-11-27T20:42:39.546256+0000","last_peered":"2023-11-27T20:42:39.546256+0000","last_clean":"2023-11-27T20:42:39.546256+0000","last_became_active":"2023-11-27T20:42:38.552879+0000","last_became_peered":"2023-11-27T20:42:38.552879+0000","last_unstale":"2023-11-27T20:42:39.546256+0000","last_undegraded":"2023-11-27T20:42:39.546256+0000","last_fullsized":"2023-11-27T20:42:39.546256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:40:10.146333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833936+0000","last_change":"2023-11-27T20:42:38.547156+0000","last_active":"2023-11-27T20:42:39.833936+0000","last_peered":"2023-11-27T20:42:39.833936+0000","last_clean":"2023-11-27T20:42:39.833936+0000","last_became_active":"2023-11-27T20:42:38.545609+0000","last_became_peered":"2023-11-27T20:42:38.545609+0000","last_unstale":"2023-11-27T20:42:39.833936+0000","last_undegraded":"2023-11-27T20:42:39.833936+0000","last_fullsized":"2023-11-27T20:42:39.833936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848338+0000","last_change":"2023-11-27T20:42:38.542428+0000","last_active":"2023-11-27T20:42:39.848338+0000","last_peered":"2023-11-27T20:42:39.848338+0000","last_clean":"2023-11-27T20:42:39.848338+0000","last_became_active":"2023-11-27T20:42:38.542153+0000","last_became_peered":"2023-11-27T20:42:38.542153+0000","last_unstale":"2023-11-27T20:42:39.848338+0000","last_undegraded":"2023-11-27T20:42:39.848338+0000","last_fullsized":"2023-11-27T20:42:39.848338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.561499+0000","last_change":"2023-11-27T20:42:38.535802+0000","last_active":"2023-11-27T20:42:39.561499+0000","last_peered":"2023-11-27T20:42:39.561499+0000","last_clean":"2023-11-27T20:42:39.561499+0000","last_became_active":"2023-11-27T20:42:38.535498+0000","last_became_peered":"2023-11-27T20:42:38.535498+0000","last_unstale":"2023-11-27T20:42:39.561499+0000","last_undegraded":"2023-11-27T20:42:39.561499+0000","last_fullsized":"2023-11-27T20:42:39.561499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926880+0000","last_change":"2023-11-27T20:42:38.551263+0000","last_active":"2023-11-27T20:42:39.926880+0000","last_peered":"2023-11-27T20:42:39.926880+0000","last_clean":"2023-11-27T20:42:39.926880+0000","last_became_active":"2023-11-27T20:42:38.545451+0000","last_became_peered":"2023-11-27T20:42:38.545451+0000","last_unstale":"2023-11-27T20:42:39.926880+0000","last_undegraded":"2023-11-27T20:42:39.926880+0000","last_fullsized":"2023-11-27T20:42:39.926880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926780+0000","last_change":"2023-11-27T20:42:38.534413+0000","last_active":"2023-11-27T20:42:39.926780+0000","last_peered":"2023-11-27T20:42:39.926780+0000","last_clean":"2023-11-27T20:42:39.926780+0000","last_became_active":"2023-11-27T20:42:38.534183+0000","last_became_peered":"2023-11-27T20:42:38.534183+0000","last_unstale":"2023-11-27T20:42:39.926780+0000","last_undegraded":"2023-11-27T20:42:39.926780+0000","last_fullsized":"2023-11-27T20:42:39.926780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926810+0000","last_change":"2023-11-27T20:42:38.550553+0000","last_active":"2023-11-27T20:42:39.926810+0000","last_peered":"2023-11-27T20:42:39.926810+0000","last_clean":"2023-11-27T20:42:39.926810+0000","last_became_active":"2023-11-27T20:42:38.550311+0000","last_became_peered":"2023-11-27T20:42:38.550311+0000","last_unstale":"2023-11-27T20:42:39.926810+0000","last_undegraded":"2023-11-27T20:42:39.926810+0000","last_fullsized":"2023-11-27T20:42:39.926810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:48.730603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545958+0000","last_change":"2023-11-27T20:42:38.561753+0000","last_active":"2023-11-27T20:42:39.545958+0000","last_peered":"2023-11-27T20:42:39.545958+0000","last_clean":"2023-11-27T20:42:39.545958+0000","last_became_active":"2023-11-27T20:42:38.561380+0000","last_became_peered":"2023-11-27T20:42:38.561380+0000","last_unstale":"2023-11-27T20:42:39.545958+0000","last_undegraded":"2023-11-27T20:42:39.545958+0000","last_fullsized":"2023-11-27T20:42:39.545958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546086+0000","last_change":"2023-11-27T20:42:38.560432+0000","last_active":"2023-11-27T20:42:39.546086+0000","last_peered":"2023-11-27T20:42:39.546086+0000","last_clean":"2023-11-27T20:42:39.546086+0000","last_became_active":"2023-11-27T20:42:38.560192+0000","last_became_peered":"2023-11-27T20:42:38.560192+0000","last_unstale":"2023-11-27T20:42:39.546086+0000","last_undegraded":"2023-11-27T20:42:39.546086+0000","last_fullsized":"2023-11-27T20:42:39.546086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547970+0000","last_change":"2023-11-27T20:42:38.540846+0000","last_active":"2023-11-27T20:42:39.547970+0000","last_peered":"2023-11-27T20:42:39.547970+0000","last_clean":"2023-11-27T20:42:39.547970+0000","last_became_active":"2023-11-27T20:42:38.540576+0000","last_became_peered":"2023-11-27T20:42:38.540576+0000","last_unstale":"2023-11-27T20:42:39.547970+0000","last_undegraded":"2023-11-27T20:42:39.547970+0000","last_fullsized":"2023-11-27T20:42:39.547970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.548295+0000","last_change":"2023-11-27T20:42:38.546971+0000","last_active":"2023-11-27T20:42:39.548295+0000","last_peered":"2023-11-27T20:42:39.548295+0000","last_clean":"2023-11-27T20:42:39.548295+0000","last_became_active":"2023-11-27T20:42:38.546653+0000","last_became_peered":"2023-11-27T20:42:38.546653+0000","last_unstale":"2023-11-27T20:42:39.548295+0000","last_undegraded":"2023-11-27T20:42:39.548295+0000","last_fullsized":"2023-11-27T20:42:39.548295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848410+0000","last_change":"2023-11-27T20:42:38.547627+0000","last_active":"2023-11-27T20:42:39.848410+0000","last_peered":"2023-11-27T20:42:39.848410+0000","last_clean":"2023-11-27T20:42:39.848410+0000","last_became_active":"2023-11-27T20:42:38.539984+0000","last_became_peered":"2023-11-27T20:42:38.539984+0000","last_unstale":"2023-11-27T20:42:39.848410+0000","last_undegraded":"2023-11-27T20:42:39.848410+0000","last_fullsized":"2023-11-27T20:42:39.848410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546478+0000","last_change":"2023-11-27T20:42:38.547129+0000","last_active":"2023-11-27T20:42:39.546478+0000","last_peered":"2023-11-27T20:42:39.546478+0000","last_clean":"2023-11-27T20:42:39.546478+0000","last_became_active":"2023-11-27T20:42:38.546838+0000","last_became_peered":"2023-11-27T20:42:38.546838+0000","last_unstale":"2023-11-27T20:42:39.546478+0000","last_undegraded":"2023-11-27T20:42:39.546478+0000","last_fullsized":"2023-11-27T20:42:39.546478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:13:37.585057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926388+0000","last_change":"2023-11-27T20:42:38.545796+0000","last_active":"2023-11-27T20:42:39.926388+0000","last_peered":"2023-11-27T20:42:39.926388+0000","last_clean":"2023-11-27T20:42:39.926388+0000","last_became_active":"2023-11-27T20:42:38.545553+0000","last_became_peered":"2023-11-27T20:42:38.545553+0000","last_unstale":"2023-11-27T20:42:39.926388+0000","last_undegraded":"2023-11-27T20:42:39.926388+0000","last_fullsized":"2023-11-27T20:42:39.926388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:43.682169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848996+0000","last_change":"2023-11-27T20:42:38.558320+0000","last_active":"2023-11-27T20:42:39.848996+0000","last_peered":"2023-11-27T20:42:39.848996+0000","last_clean":"2023-11-27T20:42:39.848996+0000","last_became_active":"2023-11-27T20:42:38.557951+0000","last_became_peered":"2023-11-27T20:42:38.557951+0000","last_unstale":"2023-11-27T20:42:39.848996+0000","last_undegraded":"2023-11-27T20:42:39.848996+0000","last_fullsized":"2023-11-27T20:42:39.848996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.549780+0000","last_change":"2023-11-27T20:42:38.547591+0000","last_active":"2023-11-27T20:42:39.549780+0000","last_peered":"2023-11-27T20:42:39.549780+0000","last_clean":"2023-11-27T20:42:39.549780+0000","last_became_active":"2023-11-27T20:42:38.547330+0000","last_became_peered":"2023-11-27T20:42:38.547330+0000","last_unstale":"2023-11-27T20:42:39.549780+0000","last_undegraded":"2023-11-27T20:42:39.549780+0000","last_fullsized":"2023-11-27T20:42:39.549780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833818+0000","last_change":"2023-11-27T20:42:38.559990+0000","last_active":"2023-11-27T20:42:39.833818+0000","last_peered":"2023-11-27T20:42:39.833818+0000","last_clean":"2023-11-27T20:42:39.833818+0000","last_became_active":"2023-11-27T20:42:38.559736+0000","last_became_peered":"2023-11-27T20:42:38.559736+0000","last_unstale":"2023-11-27T20:42:39.833818+0000","last_undegraded":"2023-11-27T20:42:39.833818+0000","last_fullsized":"2023-11-27T20:42:39.833818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.927365+0000","last_change":"2023-11-27T20:42:38.538848+0000","last_active":"2023-11-27T20:42:39.927365+0000","last_peered":"2023-11-27T20:42:39.927365+0000","last_clean":"2023-11-27T20:42:39.927365+0000","last_became_active":"2023-11-27T20:42:38.538541+0000","last_became_peered":"2023-11-27T20:42:38.538541+0000","last_unstale":"2023-11-27T20:42:39.927365+0000","last_undegraded":"2023-11-27T20:42:39.927365+0000","last_fullsized":"2023-11-27T20:42:39.927365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547303+0000","last_change":"2023-11-27T20:42:38.541486+0000","last_active":"2023-11-27T20:42:39.547303+0000","last_peered":"2023-11-27T20:42:39.547303+0000","last_clean":"2023-11-27T20:42:39.547303+0000","last_became_active":"2023-11-27T20:42:38.541126+0000","last_became_peered":"2023-11-27T20:42:38.541126+0000","last_unstale":"2023-11-27T20:42:39.547303+0000","last_undegraded":"2023-11-27T20:42:39.547303+0000","last_fullsized":"2023-11-27T20:42:39.547303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547821+0000","last_change":"2023-11-27T20:42:38.537531+0000","last_active":"2023-11-27T20:42:39.547821+0000","last_peered":"2023-11-27T20:42:39.547821+0000","last_clean":"2023-11-27T20:42:39.547821+0000","last_became_active":"2023-11-27T20:42:38.536923+0000","last_became_peered":"2023-11-27T20:42:38.536923+0000","last_unstale":"2023-11-27T20:42:39.547821+0000","last_undegraded":"2023-11-27T20:42:39.547821+0000","last_fullsized":"2023-11-27T20:42:39.547821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.546112+0000","last_change":"2023-11-27T20:42:38.557750+0000","last_active":"2023-11-27T20:42:39.546112+0000","last_peered":"2023-11-27T20:42:39.546112+0000","last_clean":"2023-11-27T20:42:39.546112+0000","last_became_active":"2023-11-27T20:42:38.557513+0000","last_became_peered":"2023-11-27T20:42:38.557513+0000","last_unstale":"2023-11-27T20:42:39.546112+0000","last_undegraded":"2023-11-27T20:42:39.546112+0000","last_fullsized":"2023-11-27T20:42:39.546112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:00:16.000787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.926038+0000","last_change":"2023-11-27T20:42:38.554226+0000","last_active":"2023-11-27T20:42:39.926038+0000","last_peered":"2023-11-27T20:42:39.926038+0000","last_clean":"2023-11-27T20:42:39.926038+0000","last_became_active":"2023-11-27T20:42:38.553902+0000","last_became_peered":"2023-11-27T20:42:38.553902+0000","last_unstale":"2023-11-27T20:42:39.926038+0000","last_undegraded":"2023-11-27T20:42:39.926038+0000","last_fullsized":"2023-11-27T20:42:39.926038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:27.699633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.833178+0000","last_change":"2023-11-27T20:42:38.558993+0000","last_active":"2023-11-27T20:42:39.833178+0000","last_peered":"2023-11-27T20:42:39.833178+0000","last_clean":"2023-11-27T20:42:39.833178+0000","last_became_active":"2023-11-27T20:42:38.558259+0000","last_became_peered":"2023-11-27T20:42:38.558259+0000","last_unstale":"2023-11-27T20:42:39.833178+0000","last_undegraded":"2023-11-27T20:42:39.833178+0000","last_fullsized":"2023-11-27T20:42:39.833178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.848874+0000","last_change":"2023-11-27T20:42:38.558109+0000","last_active":"2023-11-27T20:42:39.848874+0000","last_peered":"2023-11-27T20:42:39.848874+0000","last_clean":"2023-11-27T20:42:39.848874+0000","last_became_active":"2023-11-27T20:42:38.557268+0000","last_became_peered":"2023-11-27T20:42:38.557268+0000","last_unstale":"2023-11-27T20:42:39.848874+0000","last_undegraded":"2023-11-27T20:42:39.848874+0000","last_fullsized":"2023-11-27T20:42:39.848874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.545903+0000","last_change":"2023-11-27T20:42:38.554526+0000","last_active":"2023-11-27T20:42:39.545903+0000","last_peered":"2023-11-27T20:42:39.545903+0000","last_clean":"2023-11-27T20:42:39.545903+0000","last_became_active":"2023-11-27T20:42:38.554180+0000","last_became_peered":"2023-11-27T20:42:38.554180+0000","last_unstale":"2023-11-27T20:42:39.545903+0000","last_undegraded":"2023-11-27T20:42:39.545903+0000","last_fullsized":"2023-11-27T20:42:39.545903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T20:42:58.503002+0000","last_change":"2023-11-27T20:42:58.503002+0000","last_active":"2023-11-27T20:42:58.503002+0000","last_peered":"2023-11-27T20:42:58.503002+0000","last_clean":"2023-11-27T20:42:58.503002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:42:58.503002+0000","last_undegraded":"2023-11-27T20:42:58.503002+0000","last_fullsized":"2023-11-27T20:42:58.503002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T20:42:39.547069+0000","last_change":"2023-11-27T20:42:38.539057+0000","last_active":"2023-11-27T20:42:39.547069+0000","last_peered":"2023-11-27T20:42:39.547069+0000","last_clean":"2023-11-27T20:42:39.547069+0000","last_became_active":"2023-11-27T20:42:38.536139+0000","last_became_peered":"2023-11-27T20:42:38.536139+0000","last_unstale":"2023-11-27T20:42:39.547069+0000","last_undegraded":"2023-11-27T20:42:39.547069+0000","last_fullsized":"2023-11-27T20:42:39.547069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":749068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0860000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3089999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.5580000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.26},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.6759999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.198},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":0.99099999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.71}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":159226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.1559999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.036}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.111}]},{"osd":3,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4419999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":3.536,"5min":3.536,"15min":3.536},"last":1.377}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.6919999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.266},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.6259999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":159282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.077}]},{"osd":1,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.206}]},{"osd":2,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.014}]},{"osd":3,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":1.3759999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.4239999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2149999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.4670000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.7050000000000001},{"interface":"front","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.6599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.1379999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.028}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.78200000000000003}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.5269999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.6559999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.25}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.7290000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":161739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.51400000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.745},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.8050000000000002,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.204}]},{"osd":6,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.016},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.0820000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":158680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.63}]},{"osd":1,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.42099999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.89900000000000002}]},{"osd":4,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.73199999999999998}]},{"osd":5,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.157},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":0.81200000000000006}]},{"osd":7,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":0.76700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":161739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.3140000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.751},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.2509999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.421},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.167}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.605}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.3839999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.218}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.6519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":742307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.097}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.96699999999999997}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.147}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.3169999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.3779999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.431}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.613}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:43:05.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-11-27T20:43:05.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-11-27T20:43:05.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.510564+0000', 'last_change': '2023-11-27T20:42:57.510564+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.510564+0000', 'last_undegraded': '2023-11-27T20:42:57.510564+0000', 'last_fullsized': '2023-11-27T20:42:57.510564+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:43:05.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-11-27T20:43:05.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-11-27T20:43:05.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.518058+0000', 'last_change': '2023-11-27T20:42:57.518058+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.518058+0000', 'last_undegraded': '2023-11-27T20:42:57.518058+0000', 'last_fullsized': '2023-11-27T20:42:57.518058+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:43:05.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-11-27T20:43:05.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-11-27T20:43:05.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.526221+0000', 'last_change': '2023-11-27T20:42:57.526221+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.526221+0000', 'last_undegraded': '2023-11-27T20:42:57.526221+0000', 'last_fullsized': '2023-11-27T20:42:57.526221+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:43:05.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-11-27T20:43:05.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-11-27T20:43:05.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.516201+0000', 'last_change': '2023-11-27T20:42:57.516201+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.516201+0000', 'last_undegraded': '2023-11-27T20:42:57.516201+0000', 'last_fullsized': '2023-11-27T20:42:57.516201+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:43:05.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-11-27T20:43:05.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-11-27T20:43:05.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.510732+0000', 'last_change': '2023-11-27T20:42:57.510732+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.510732+0000', 'last_undegraded': '2023-11-27T20:42:57.510732+0000', 'last_fullsized': '2023-11-27T20:42:57.510732+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:43:05.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-11-27T20:43:05.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-11-27T20:43:05.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.517117+0000', 'last_change': '2023-11-27T20:42:57.517117+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.517117+0000', 'last_undegraded': '2023-11-27T20:42:57.517117+0000', 'last_fullsized': '2023-11-27T20:42:57.517117+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:43:05.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-11-27T20:43:05.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-11-27T20:43:05.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.511845+0000', 'last_change': '2023-11-27T20:42:57.511845+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.511845+0000', 'last_undegraded': '2023-11-27T20:42:57.511845+0000', 'last_fullsized': '2023-11-27T20:42:57.511845+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:43:05.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-11-27T20:43:05.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-11-27T20:43:05.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.527169+0000', 'last_change': '2023-11-27T20:42:57.527169+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.527169+0000', 'last_undegraded': '2023-11-27T20:42:57.527169+0000', 'last_fullsized': '2023-11-27T20:42:57.527169+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:43:05.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-11-27T20:43:05.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-11-27T20:43:05.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.510514+0000', 'last_change': '2023-11-27T20:42:57.510514+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.510514+0000', 'last_undegraded': '2023-11-27T20:42:57.510514+0000', 'last_fullsized': '2023-11-27T20:42:57.510514+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:43:05.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-11-27T20:43:05.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-11-27T20:43:05.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.518026+0000', 'last_change': '2023-11-27T20:42:57.518026+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.518026+0000', 'last_undegraded': '2023-11-27T20:42:57.518026+0000', 'last_fullsized': '2023-11-27T20:42:57.518026+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:43:05.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-11-27T20:43:05.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-11-27T20:43:05.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.526042+0000', 'last_change': '2023-11-27T20:42:57.526042+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.526042+0000', 'last_undegraded': '2023-11-27T20:42:57.526042+0000', 'last_fullsized': '2023-11-27T20:42:57.526042+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:43:05.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-11-27T20:43:05.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-11-27T20:43:05.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.516720+0000', 'last_change': '2023-11-27T20:42:57.516720+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.516720+0000', 'last_undegraded': '2023-11-27T20:42:57.516720+0000', 'last_fullsized': '2023-11-27T20:42:57.516720+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:43:05.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-11-27T20:43:05.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-11-27T20:43:05.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.520466+0000', 'last_change': '2023-11-27T20:42:57.520466+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.520466+0000', 'last_undegraded': '2023-11-27T20:42:57.520466+0000', 'last_fullsized': '2023-11-27T20:42:57.520466+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:43:05.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-11-27T20:43:05.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-11-27T20:43:05.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.511643+0000', 'last_change': '2023-11-27T20:42:57.511643+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.511643+0000', 'last_undegraded': '2023-11-27T20:42:57.511643+0000', 'last_fullsized': '2023-11-27T20:42:57.511643+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:43:05.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-11-27T20:43:05.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-11-27T20:43:05.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.517619+0000', 'last_change': '2023-11-27T20:42:57.517619+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.517619+0000', 'last_undegraded': '2023-11-27T20:42:57.517619+0000', 'last_fullsized': '2023-11-27T20:42:57.517619+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:43:05.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-11-27T20:43:05.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-11-27T20:43:05.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.510435+0000', 'last_change': '2023-11-27T20:42:57.510435+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.510435+0000', 'last_undegraded': '2023-11-27T20:42:57.510435+0000', 'last_fullsized': '2023-11-27T20:42:57.510435+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:43:05.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-11-27T20:43:05.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-11-27T20:43:05.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.526486+0000', 'last_change': '2023-11-27T20:42:57.526486+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.526486+0000', 'last_undegraded': '2023-11-27T20:42:57.526486+0000', 'last_fullsized': '2023-11-27T20:42:57.526486+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:43:05.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-11-27T20:43:05.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-11-27T20:43:05.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.518549+0000', 'last_change': '2023-11-27T20:42:57.518549+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.518549+0000', 'last_undegraded': '2023-11-27T20:42:57.518549+0000', 'last_fullsized': '2023-11-27T20:42:57.518549+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:43:05.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-11-27T20:43:05.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-11-27T20:43:05.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.516790+0000', 'last_change': '2023-11-27T20:42:57.516790+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.516790+0000', 'last_undegraded': '2023-11-27T20:42:57.516790+0000', 'last_fullsized': '2023-11-27T20:42:57.516790+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:43:05.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-11-27T20:43:05.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-11-27T20:43:05.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.516769+0000', 'last_change': '2023-11-27T20:42:57.516769+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.516769+0000', 'last_undegraded': '2023-11-27T20:42:57.516769+0000', 'last_fullsized': '2023-11-27T20:42:57.516769+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:43:05.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-11-27T20:43:05.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-11-27T20:43:05.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.516409+0000', 'last_change': '2023-11-27T20:42:57.516409+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.516409+0000', 'last_undegraded': '2023-11-27T20:42:57.516409+0000', 'last_fullsized': '2023-11-27T20:42:57.516409+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:43:05.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-11-27T20:43:05.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-11-27T20:43:05.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.518638+0000', 'last_change': '2023-11-27T20:42:57.518638+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.518638+0000', 'last_undegraded': '2023-11-27T20:42:57.518638+0000', 'last_fullsized': '2023-11-27T20:42:57.518638+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:43:05.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-11-27T20:43:05.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-11-27T20:43:05.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.511654+0000', 'last_change': '2023-11-27T20:42:57.511654+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.511654+0000', 'last_undegraded': '2023-11-27T20:42:57.511654+0000', 'last_fullsized': '2023-11-27T20:42:57.511654+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:43:05.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-11-27T20:43:05.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-11-27T20:43:05.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.528207+0000', 'last_change': '2023-11-27T20:42:57.528207+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.528207+0000', 'last_undegraded': '2023-11-27T20:42:57.528207+0000', 'last_fullsized': '2023-11-27T20:42:57.528207+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:43:05.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-11-27T20:43:05.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-11-27T20:43:05.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.519383+0000', 'last_change': '2023-11-27T20:42:57.519383+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.519383+0000', 'last_undegraded': '2023-11-27T20:42:57.519383+0000', 'last_fullsized': '2023-11-27T20:42:57.519383+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:43:05.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-11-27T20:43:05.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-11-27T20:43:05.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.519078+0000', 'last_change': '2023-11-27T20:42:57.519078+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.519078+0000', 'last_undegraded': '2023-11-27T20:42:57.519078+0000', 'last_fullsized': '2023-11-27T20:42:57.519078+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:43:05.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-11-27T20:43:05.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-11-27T20:43:05.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.517252+0000', 'last_change': '2023-11-27T20:42:57.517252+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.517252+0000', 'last_undegraded': '2023-11-27T20:42:57.517252+0000', 'last_fullsized': '2023-11-27T20:42:57.517252+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:43:05.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-11-27T20:43:05.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-11-27T20:43:05.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.510670+0000', 'last_change': '2023-11-27T20:42:57.510670+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.510670+0000', 'last_undegraded': '2023-11-27T20:42:57.510670+0000', 'last_fullsized': '2023-11-27T20:42:57.510670+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:43:05.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-11-27T20:43:05.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-11-27T20:43:05.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.519360+0000', 'last_change': '2023-11-27T20:42:57.519360+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.519360+0000', 'last_undegraded': '2023-11-27T20:42:57.519360+0000', 'last_fullsized': '2023-11-27T20:42:57.519360+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:43:05.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-11-27T20:43:05.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-11-27T20:43:05.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.516646+0000', 'last_change': '2023-11-27T20:42:57.516646+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.516646+0000', 'last_undegraded': '2023-11-27T20:42:57.516646+0000', 'last_fullsized': '2023-11-27T20:42:57.516646+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:43:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-11-27T20:43:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-11-27T20:43:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.526385+0000', 'last_change': '2023-11-27T20:42:57.526385+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.526385+0000', 'last_undegraded': '2023-11-27T20:42:57.526385+0000', 'last_fullsized': '2023-11-27T20:42:57.526385+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:43:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-11-27T20:43:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-11-27T20:43:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:42:57.512528+0000', 'last_change': '2023-11-27T20:42:57.512528+0000', 'last_active': '2023-11-27T20:42:57.489897+0000', 'last_peered': '2023-11-27T20:42:57.489897+0000', 'last_clean': '2023-11-27T20:42:57.489897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:57.512528+0000', 'last_undegraded': '2023-11-27T20:42:57.512528+0000', 'last_fullsized': '2023-11-27T20:42:57.512528+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:57.489897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:43:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-11-27T20:43:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-11-27T20:43:05.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-11-27T20:43:05.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-11-27T20:43:05.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-11-27T20:43:05.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-11-27T20:43:05.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-11-27T20:43:05.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-11-27T20:43:05.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-11-27T20:43:05.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-11-27T20:43:05.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-11-27T20:43:05.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-11-27T20:43:05.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-11-27T20:43:05.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-11-27T20:43:05.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-11-27T20:43:05.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-11-27T20:43:05.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-11-27T20:43:05.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-11-27T20:43:05.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-11-27T20:43:05.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-11-27T20:43:05.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-11-27T20:43:05.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-11-27T20:43:05.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-11-27T20:43:05.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-11-27T20:43:05.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-11-27T20:43:05.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-11-27T20:43:05.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-11-27T20:43:05.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-11-27T20:43:05.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-11-27T20:43:05.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-11-27T20:43:05.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-11-27T20:43:05.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-11-27T20:43:05.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T20:42:58.503002+0000', 'last_change': '2023-11-27T20:42:58.503002+0000', 'last_active': '2023-11-27T20:42:58.503002+0000', 'last_peered': '2023-11-27T20:42:58.503002+0000', 'last_clean': '2023-11-27T20:42:58.503002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:42:58.503002+0000', 'last_undegraded': '2023-11-27T20:42:58.503002+0000', 'last_fullsized': '2023-11-27T20:42:58.503002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'last_clean_scrub_stamp': '2023-11-27T20:42:58.503002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T20:43:05.081 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-27T20:43:05.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.311+0000 7f54f7941640 1 Processor -- start 2023-11-27T20:43:05.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.311+0000 7f54f7941640 1 -- start start 2023-11-27T20:43:05.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.313+0000 7f54f7941640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f54f0152f20 0x7f54f00c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.313+0000 7f54f7941640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f00c64a0 con 0x7f54f006d0a0 2023-11-27T20:43:05.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.313+0000 7f54f7941640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f00c5c00 con 0x7f54f014fd30 2023-11-27T20:43:05.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.313+0000 7f54f7941640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f00c5ee0 con 0x7f54f0152f20 2023-11-27T20:43:05.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.313+0000 7f54f4edc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f54f006d0a0 0x7f54f00c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36164/0 (socket says 172.21.15.91:36164) 2023-11-27T20:43:05.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.313+0000 7f54f4edc640 1 -- 172.21.15.91:0/2736280238 learned_addr learned my addr 172.21.15.91:0/2736280238 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:05.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.313+0000 7f54f5ede640 1 --2- 172.21.15.91:0/2736280238 >> v2:172.21.15.183:3300/0 conn(0x7f54f0152f20 0x7f54f00c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624616045 0 0) 0x7f54f00c64a0 con 0x7f54f006d0a0 2023-11-27T20:43:05.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54dc003520 con 0x7f54f006d0a0 2023-11-27T20:43:05.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3187820170 0 0) 0x7f54dc003520 con 0x7f54f006d0a0 2023-11-27T20:43:05.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 >> v2:172.21.15.183:3300/0 conn(0x7f54f0152f20 msgr2=0x7f54f00c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:05.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 --2- 172.21.15.91:0/2736280238 >> v2:172.21.15.183:3300/0 conn(0x7f54f0152f20 0x7f54f00c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 >> v1:172.21.15.183:6789/0 conn(0x7f54f014fd30 legacy=0x7f54f00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f00c61c0 con 0x7f54f006d0a0 2023-11-27T20:43:05.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f54e0001670 con 0x7f54f006d0a0 2023-11-27T20:43:05.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 >> v1:172.21.15.91:6789/0 conn(0x7f54f006d0a0 legacy=0x7f54f00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54dc003970 0x7f54dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc0047c0 0x7f54dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54dc005180 0x7f54dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00c5ee0 con 0x7f54dc005180 2023-11-27T20:43:05.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc00c020 con 0x7f54dc0047c0 2023-11-27T20:43:05.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc00c1e0 con 0x7f54dc003970 2023-11-27T20:43:05.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.314+0000 7f54f5ede640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54dc005180 0x7f54dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.315+0000 7f54f4edc640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc0047c0 0x7f54dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.315+0000 7f54f5ede640 1 -- 172.21.15.91:0/2736280238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54dc003970 msgr2=0x7f54dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:05.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.315+0000 7f54f5ede640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54dc003970 0x7f54dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.315+0000 7f54f5ede640 1 -- 172.21.15.91:0/2736280238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc0047c0 msgr2=0x7f54dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:05.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.315+0000 7f54f5ede640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc0047c0 0x7f54dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.315+0000 7f54f5ede640 1 -- 172.21.15.91:0/2736280238 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc003520 con 0x7f54dc005180 2023-11-27T20:43:05.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.315+0000 7f54f4edc640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc0047c0 0x7f54dc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:05.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.316+0000 7f54f5ede640 1 -- 172.21.15.91:0/2736280238 reap_dead start 2023-11-27T20:43:05.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.316+0000 7f54f5ede640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54dc005180 0x7f54dc00b980 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009fc0 tx=0x7f54dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a105a8fc713f524 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:05.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.316+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e802cc60 con 0x7f54dc005180 2023-11-27T20:43:05.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.316+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e800f040 con 0x7f54dc005180 2023-11-27T20:43:05.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.316+0000 7f54e7fff640 1 -- 172.21.15.91:0/2736280238 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e8003990 con 0x7f54dc005180 2023-11-27T20:43:05.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.317+0000 7f54f7941640 1 -- 172.21.15.91:0/2736280238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54dc005180 msgr2=0x7f54dc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.317+0000 7f54f7941640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54dc005180 0x7f54dc00b980 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009fc0 tx=0x7f54dc0057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.317+0000 7f54f7941640 1 -- 172.21.15.91:0/2736280238 shutdown_connections 2023-11-27T20:43:05.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.317+0000 7f54f7941640 1 --2- 172.21.15.91:0/2736280238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54dc005180 0x7f54dc00b980 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.317+0000 7f54f7941640 1 -- 172.21.15.91:0/2736280238 >> 172.21.15.91:0/2736280238 conn(0x7f54f006a500 msgr2=0x7f54f006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:05.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.317+0000 7f54f7941640 1 -- 172.21.15.91:0/2736280238 shutdown_connections 2023-11-27T20:43:05.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.317+0000 7f54f7941640 1 -- 172.21.15.91:0/2736280238 wait complete. 2023-11-27T20:43:05.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.319+0000 7f54f7941640 1 Processor -- start 2023-11-27T20:43:05.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.319+0000 7f54f7941640 1 -- start start 2023-11-27T20:43:05.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f7941640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc005180 0x7f54f00a8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f7941640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54f014d300 0x7f54f014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f7941640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54f0153860 0x7f54f0071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f7941640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f01e9fa0 con 0x7f54f0153860 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f7941640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f0154b10 con 0x7f54dc005180 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f7941640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f0154f40 con 0x7f54f014d300 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f5ede640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54f0153860 0x7f54f0071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f5ede640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54f0153860 0x7f54f0071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52312/0 (socket says 172.21.15.91:52312) 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f5ede640 1 -- 172.21.15.91:0/1107698640 learned_addr learned my addr 172.21.15.91:0/1107698640 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f4edc640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54f014d300 0x7f54f014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f5ede640 1 -- 172.21.15.91:0/1107698640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54f014d300 msgr2=0x7f54f014ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f56dd640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc005180 0x7f54f00a8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f5ede640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54f014d300 0x7f54f014ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.320+0000 7f54f5ede640 1 -- 172.21.15.91:0/1107698640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc005180 msgr2=0x7f54f00a8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.321+0000 7f54f5ede640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc005180 0x7f54f00a8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.321+0000 7f54f5ede640 1 -- 172.21.15.91:0/1107698640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f0155220 con 0x7f54f0153860 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.321+0000 7f54f56dd640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc005180 0x7f54f00a8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.321+0000 7f54f5ede640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54f0153860 0x7f54f0071390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f54e802c6d0 tx=0x7f54e8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.321+0000 7f54e5ffb640 1 -- 172.21.15.91:0/1107698640 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e8003da0 con 0x7f54f0153860 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.321+0000 7f54e5ffb640 1 -- 172.21.15.91:0/1107698640 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e80359d0 con 0x7f54f0153860 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.321+0000 7f54e5ffb640 1 -- 172.21.15.91:0/1107698640 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e8035dc0 con 0x7f54f0153860 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.321+0000 7f54f7941640 1 -- 172.21.15.91:0/1107698640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f0155500 con 0x7f54f0153860 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.321+0000 7f54f7941640 1 -- 172.21.15.91:0/1107698640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f014d850 con 0x7f54f0153860 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.323+0000 7f54f7941640 1 -- 172.21.15.91:0/1107698640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f00a4d00 con 0x7f54f0153860 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.323+0000 7f54e5ffb640 1 -- 172.21.15.91:0/1107698640 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f54e8004030 con 0x7f54f0153860 2023-11-27T20:43:05.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.324+0000 7f54e5ffb640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f54d406b1f0 0x7f54d406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.324+0000 7f54e5ffb640 1 -- 172.21.15.91:0/1107698640 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f54e80ac9c0 con 0x7f54f0153860 2023-11-27T20:43:05.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.325+0000 7f54f56dd640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f54d406b1f0 0x7f54d406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.325+0000 7f54f56dd640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f54d406b1f0 0x7f54d406d6b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f54ec001660 tx=0x7f54ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:05.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.329+0000 7f54e5ffb640 1 -- 172.21.15.91:0/1107698640 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f54f00a4d00 con 0x7f54f0153860 2023-11-27T20:43:05.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.586+0000 7f54f7941640 1 -- 172.21.15.91:0/1107698640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f54f01ea3f0 con 0x7f54f0153860 2023-11-27T20:43:05.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.587+0000 7f54e5ffb640 1 -- 172.21.15.91:0/1107698640 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1761 (secure 0 0 0) 0x7f54f01ea3f0 con 0x7f54f0153860 2023-11-27T20:43:05.589 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:05.589 INFO:teuthology.orchestra.run.smithi091.stdout:{"fsid":"76812701-65a9-4deb-87af-ef00110d1601","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":115,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1701117682,"num_in_osds":8,"osd_in_since":1701117673,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97},{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32}],"num_pgs":193,"num_pools":5,"num_objects":24,"data_bytes":594273,"bytes_used":225767424,"bytes_avail":772868345856,"bytes_total":773094113280,"unknown_pgs_ratio":0.33160620927810669,"inactive_pgs_ratio":0.16580310463905334},"fsmap":{"epoch":20,"id":2,"up":1,"in":1,"max":1,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5022},{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5025}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-27T20:42:25.387904+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-27T20:43:05.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 -- 172.21.15.91:0/1107698640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f54d406b1f0 msgr2=0x7f54d406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f54d406b1f0 0x7f54d406d6b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f54ec001660 tx=0x7f54ec009040 comp rx=0 tx=0).stop 2023-11-27T20:43:05.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 -- 172.21.15.91:0/1107698640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54f0153860 msgr2=0x7f54f0071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54f0153860 0x7f54f0071390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f54e802c6d0 tx=0x7f54e8009750 comp rx=0 tx=0).stop 2023-11-27T20:43:05.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 -- 172.21.15.91:0/1107698640 shutdown_connections 2023-11-27T20:43:05.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54f0153860 0x7f54f0071390 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54f014d300 0x7f54f014ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f54d406b1f0 0x7f54d406d6b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 --2- 172.21.15.91:0/1107698640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54dc005180 0x7f54f00a8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 -- 172.21.15.91:0/1107698640 >> 172.21.15.91:0/1107698640 conn(0x7f54f006a500 msgr2=0x7f54f006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:05.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 -- 172.21.15.91:0/1107698640 shutdown_connections 2023-11-27T20:43:05.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.590+0000 7f54f7941640 1 -- 172.21.15.91:0/1107698640 wait complete. 2023-11-27T20:43:05.611 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-27T20:43:05.612 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:43:05.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.823+0000 7f7260b21640 1 Processor -- start 2023-11-27T20:43:05.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.823+0000 7f7260b21640 1 -- start start 2023-11-27T20:43:05.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.824+0000 7f7260b21640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f725c0c52e0 0x7f725c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f7260b21640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f725c06cd20 0x7f725c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f7260b21640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725c0a8380 con 0x7f725c14e7f0 2023-11-27T20:43:05.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f7260b21640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c1510b0 con 0x7f725c0c52e0 2023-11-27T20:43:05.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f7260b21640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c06bf60 con 0x7f725c06cd20 2023-11-27T20:43:05.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f725affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f725c0c52e0 0x7f725c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f725affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f725c0c52e0 0x7f725c06d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52322/0 (socket says 172.21.15.91:52322) 2023-11-27T20:43:05.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f725affd640 1 -- 172.21.15.91:0/2752357825 learned_addr learned my addr 172.21.15.91:0/2752357825 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:05.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f725bfff640 1 --2- 172.21.15.91:0/2752357825 >> v2:172.21.15.183:3300/0 conn(0x7f725c06cd20 0x7f725c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f725affd640 1 -- 172.21.15.91:0/2752357825 >> v2:172.21.15.183:3300/0 conn(0x7f725c06cd20 msgr2=0x7f725c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:05.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f725affd640 1 --2- 172.21.15.91:0/2752357825 >> v2:172.21.15.183:3300/0 conn(0x7f725c06cd20 0x7f725c15ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f725affd640 1 -- 172.21.15.91:0/2752357825 >> v1:172.21.15.183:6789/0 conn(0x7f725c14e7f0 legacy=0x7f725c0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:05.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.825+0000 7f725affd640 1 -- 172.21.15.91:0/2752357825 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c06c240 con 0x7f725c0c52e0 2023-11-27T20:43:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.826+0000 7f725affd640 1 --2- 172.21.15.91:0/2752357825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c0c52e0 0x7f725c06d1e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f725c0c1f50 tx=0x7f725002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecc9217b5e5fb30 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.827+0000 7f725a7fc640 1 -- 172.21.15.91:0/2752357825 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72500317e0 con 0x7f725c0c52e0 2023-11-27T20:43:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.827+0000 7f725a7fc640 1 -- 172.21.15.91:0/2752357825 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250031940 con 0x7f725c0c52e0 2023-11-27T20:43:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.827+0000 7f725a7fc640 1 -- 172.21.15.91:0/2752357825 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250031cd0 con 0x7f725c0c52e0 2023-11-27T20:43:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.827+0000 7f7260b21640 1 -- 172.21.15.91:0/2752357825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c0c52e0 msgr2=0x7f725c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.827+0000 7f7260b21640 1 --2- 172.21.15.91:0/2752357825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c0c52e0 0x7f725c06d1e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f725c0c1f50 tx=0x7f725002b880 comp rx=0 tx=0).stop 2023-11-27T20:43:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.828+0000 7f7260b21640 1 -- 172.21.15.91:0/2752357825 shutdown_connections 2023-11-27T20:43:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.828+0000 7f7260b21640 1 --2- 172.21.15.91:0/2752357825 >> v2:172.21.15.183:3300/0 conn(0x7f725c06cd20 0x7f725c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.828+0000 7f7260b21640 1 --2- 172.21.15.91:0/2752357825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c0c52e0 0x7f725c06d1e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.828+0000 7f7260b21640 1 -- 172.21.15.91:0/2752357825 >> 172.21.15.91:0/2752357825 conn(0x7f725c0a77f0 msgr2=0x7f725c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.828+0000 7f7260b21640 1 -- 172.21.15.91:0/2752357825 shutdown_connections 2023-11-27T20:43:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.828+0000 7f7260b21640 1 -- 172.21.15.91:0/2752357825 wait complete. 2023-11-27T20:43:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.829+0000 7f7260b21640 1 Processor -- start 2023-11-27T20:43:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.829+0000 7f7260b21640 1 -- start start 2023-11-27T20:43:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.830+0000 7f7260b21640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f725c06cd20 0x7f725c072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.830+0000 7f7260b21640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f725c0c52e0 0x7f725c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.830+0000 7f7260b21640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c14e7f0 0x7f725c1ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.830+0000 7f7260b21640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c1508c0 con 0x7f725c14e7f0 2023-11-27T20:43:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.830+0000 7f7260b21640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c147f00 con 0x7f725c0c52e0 2023-11-27T20:43:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.830+0000 7f7260b21640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c14f970 con 0x7f725c06cd20 2023-11-27T20:43:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c14e7f0 0x7f725c1ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c14e7f0 0x7f725c1ed7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52324/0 (socket says 172.21.15.91:52324) 2023-11-27T20:43:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725bfff640 1 -- 172.21.15.91:0/3482174696 learned_addr learned my addr 172.21.15.91:0/3482174696 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725affd640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f725c0c52e0 0x7f725c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725b7fe640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f725c06cd20 0x7f725c072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725bfff640 1 -- 172.21.15.91:0/3482174696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f725c06cd20 msgr2=0x7f725c072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725bfff640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f725c06cd20 0x7f725c072310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725bfff640 1 -- 172.21.15.91:0/3482174696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f725c0c52e0 msgr2=0x7f725c14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725bfff640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f725c0c52e0 0x7f725c14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725bfff640 1 -- 172.21.15.91:0/3482174696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72500094d0 con 0x7f725c14e7f0 2023-11-27T20:43:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725affd640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f725c0c52e0 0x7f725c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.831+0000 7f725bfff640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c14e7f0 0x7f725c1ed7d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f725400cd70 tx=0x7f725400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.832+0000 7f7243fff640 1 -- 172.21.15.91:0/3482174696 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254003b90 con 0x7f725c14e7f0 2023-11-27T20:43:05.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.832+0000 7f7243fff640 1 -- 172.21.15.91:0/3482174696 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254003cf0 con 0x7f725c14e7f0 2023-11-27T20:43:05.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.832+0000 7f7243fff640 1 -- 172.21.15.91:0/3482174696 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254004240 con 0x7f725c14e7f0 2023-11-27T20:43:05.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.832+0000 7f7260b21640 1 -- 172.21.15.91:0/3482174696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c0bf310 con 0x7f725c14e7f0 2023-11-27T20:43:05.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.832+0000 7f7260b21640 1 -- 172.21.15.91:0/3482174696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725c14f690 con 0x7f725c14e7f0 2023-11-27T20:43:05.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.833+0000 7f7260b21640 1 -- 172.21.15.91:0/3482174696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725c0bf4a0 con 0x7f725c14e7f0 2023-11-27T20:43:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.834+0000 7f7243fff640 1 -- 172.21.15.91:0/3482174696 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f72540043a0 con 0x7f725c14e7f0 2023-11-27T20:43:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.835+0000 7f7243fff640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f724806b1c0 0x7f724806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.835+0000 7f7243fff640 1 -- 172.21.15.91:0/3482174696 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7254012070 con 0x7f725c14e7f0 2023-11-27T20:43:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.835+0000 7f725b7fe640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f724806b1c0 0x7f724806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.836+0000 7f725b7fe640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f724806b1c0 0x7f724806d680 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f724c00a730 tx=0x7f724c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:05.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:05.839+0000 7f7243fff640 1 -- 172.21.15.91:0/3482174696 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7254055110 con 0x7f725c14e7f0 2023-11-27T20:43:06.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.026+0000 7f7260b21640 1 -- 172.21.15.91:0/3482174696 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f725c0c08c0 con 0x7f724806b1c0 2023-11-27T20:43:06.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.050+0000 7f7243fff640 1 -- 172.21.15.91:0/3482174696 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525177 (secure 0 0 0) 0x7f725c0c08c0 con 0x7f724806b1c0 2023-11-27T20:43:06.057 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:06.062 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:43:06.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.060+0000 7f7260b21640 1 -- 172.21.15.91:0/3482174696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f724806b1c0 msgr2=0x7f724806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:06.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.060+0000 7f7260b21640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f724806b1c0 0x7f724806d680 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f724c00a730 tx=0x7f724c008040 comp rx=0 tx=0).stop 2023-11-27T20:43:06.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.060+0000 7f7260b21640 1 -- 172.21.15.91:0/3482174696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c14e7f0 msgr2=0x7f725c1ed7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:06.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.060+0000 7f7260b21640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c14e7f0 0x7f725c1ed7d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f725400cd70 tx=0x7f725400a660 comp rx=0 tx=0).stop 2023-11-27T20:43:06.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.061+0000 7f7260b21640 1 -- 172.21.15.91:0/3482174696 shutdown_connections 2023-11-27T20:43:06.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.061+0000 7f7260b21640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f725c14e7f0 0x7f725c1ed7d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:06.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.061+0000 7f7260b21640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f724806b1c0 0x7f724806d680 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:06.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.061+0000 7f7260b21640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f725c0c52e0 0x7f725c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:06.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.061+0000 7f7260b21640 1 --2- 172.21.15.91:0/3482174696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f725c06cd20 0x7f725c072310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:06.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.061+0000 7f7260b21640 1 -- 172.21.15.91:0/3482174696 >> 172.21.15.91:0/3482174696 conn(0x7f725c0a77f0 msgr2=0x7f725c146600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:06.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.061+0000 7f7260b21640 1 -- 172.21.15.91:0/3482174696 shutdown_connections 2023-11-27T20:43:06.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:06.061+0000 7f7260b21640 1 -- 172.21.15.91:0/3482174696 wait complete. 2023-11-27T20:43:06.083 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-11-27T20:43:05.400696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":379,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220860,"kb_used_data":4680,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753860,"statfs":{"total":773094113280,"available":772867952640,"internally_reserved":0,"allocated":4792320,"data_stored":2637542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.886657"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455837+0000","last_change":"2023-11-27T20:42:59.580901+0000","last_active":"2023-11-27T20:43:01.455837+0000","last_peered":"2023-11-27T20:43:01.455837+0000","last_clean":"2023-11-27T20:43:01.455837+0000","last_became_active":"2023-11-27T20:42:59.580526+0000","last_became_peered":"2023-11-27T20:42:59.580526+0000","last_unstale":"2023-11-27T20:43:01.455837+0000","last_undegraded":"2023-11-27T20:43:01.455837+0000","last_fullsized":"2023-11-27T20:43:01.455837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:09:18.085066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.568189+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:42:59.568189+0000","last_peered":"2023-11-27T20:42:59.568189+0000","last_clean":"2023-11-27T20:42:59.568189+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:42:59.568189+0000","last_undegraded":"2023-11-27T20:42:59.568189+0000","last_fullsized":"2023-11-27T20:42:59.568189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.556053+0000","last_change":"2023-11-27T20:42:37.523367+0000","last_active":"2023-11-27T20:42:59.556053+0000","last_peered":"2023-11-27T20:42:59.556053+0000","last_clean":"2023-11-27T20:42:59.556053+0000","last_became_active":"2023-11-27T20:42:37.522948+0000","last_became_peered":"2023-11-27T20:42:37.522948+0000","last_unstale":"2023-11-27T20:42:59.556053+0000","last_undegraded":"2023-11-27T20:42:59.556053+0000","last_fullsized":"2023-11-27T20:42:59.556053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.577029+0000","last_change":"2023-11-27T20:42:38.542611+0000","last_active":"2023-11-27T20:42:59.577029+0000","last_peered":"2023-11-27T20:42:59.577029+0000","last_clean":"2023-11-27T20:42:59.577029+0000","last_became_active":"2023-11-27T20:42:38.542177+0000","last_became_peered":"2023-11-27T20:42:38.542177+0000","last_unstale":"2023-11-27T20:42:59.577029+0000","last_undegraded":"2023-11-27T20:42:59.577029+0000","last_fullsized":"2023-11-27T20:42:59.577029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.602468+0000","last_change":"2023-11-27T20:42:58.541430+0000","last_active":"2023-11-27T20:42:59.602468+0000","last_peered":"2023-11-27T20:42:59.602468+0000","last_clean":"2023-11-27T20:42:59.602468+0000","last_became_active":"2023-11-27T20:42:58.541116+0000","last_became_peered":"2023-11-27T20:42:58.541116+0000","last_unstale":"2023-11-27T20:42:59.602468+0000","last_undegraded":"2023-11-27T20:42:59.602468+0000","last_fullsized":"2023-11-27T20:42:59.602468+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:06.695281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.569836+0000","last_change":"2023-11-27T20:42:59.594647+0000","last_active":"2023-11-27T20:43:00.569836+0000","last_peered":"2023-11-27T20:43:00.569836+0000","last_clean":"2023-11-27T20:43:00.569836+0000","last_became_active":"2023-11-27T20:42:59.594260+0000","last_became_peered":"2023-11-27T20:42:59.594260+0000","last_unstale":"2023-11-27T20:43:00.569836+0000","last_undegraded":"2023-11-27T20:43:00.569836+0000","last_fullsized":"2023-11-27T20:43:00.569836+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:28.415270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.544446+0000","last_change":"2023-11-27T20:42:37.533800+0000","last_active":"2023-11-27T20:42:59.544446+0000","last_peered":"2023-11-27T20:42:59.544446+0000","last_clean":"2023-11-27T20:42:59.544446+0000","last_became_active":"2023-11-27T20:42:37.533358+0000","last_became_peered":"2023-11-27T20:42:37.533358+0000","last_unstale":"2023-11-27T20:42:59.544446+0000","last_undegraded":"2023-11-27T20:42:59.544446+0000","last_fullsized":"2023-11-27T20:42:59.544446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553861+0000","last_change":"2023-11-27T20:42:38.544391+0000","last_active":"2023-11-27T20:42:59.553861+0000","last_peered":"2023-11-27T20:42:59.553861+0000","last_clean":"2023-11-27T20:42:59.553861+0000","last_became_active":"2023-11-27T20:42:38.544114+0000","last_became_peered":"2023-11-27T20:42:38.544114+0000","last_unstale":"2023-11-27T20:42:59.553861+0000","last_undegraded":"2023-11-27T20:42:59.553861+0000","last_fullsized":"2023-11-27T20:42:59.553861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.555995+0000","last_change":"2023-11-27T20:42:58.543953+0000","last_active":"2023-11-27T20:42:59.555995+0000","last_peered":"2023-11-27T20:42:59.555995+0000","last_clean":"2023-11-27T20:42:59.555995+0000","last_became_active":"2023-11-27T20:42:58.543662+0000","last_became_peered":"2023-11-27T20:42:58.543662+0000","last_unstale":"2023-11-27T20:42:59.555995+0000","last_undegraded":"2023-11-27T20:42:59.555995+0000","last_fullsized":"2023-11-27T20:42:59.555995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:03.416152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.569427+0000","last_change":"2023-11-27T20:42:59.578126+0000","last_active":"2023-11-27T20:43:00.569427+0000","last_peered":"2023-11-27T20:43:00.569427+0000","last_clean":"2023-11-27T20:43:00.569427+0000","last_became_active":"2023-11-27T20:42:59.573214+0000","last_became_peered":"2023-11-27T20:42:59.573214+0000","last_unstale":"2023-11-27T20:43:00.569427+0000","last_undegraded":"2023-11-27T20:43:00.569427+0000","last_fullsized":"2023-11-27T20:43:00.569427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:12:43.706994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.554286+0000","last_change":"2023-11-27T20:42:37.530919+0000","last_active":"2023-11-27T20:42:59.554286+0000","last_peered":"2023-11-27T20:42:59.554286+0000","last_clean":"2023-11-27T20:42:59.554286+0000","last_became_active":"2023-11-27T20:42:37.530606+0000","last_became_peered":"2023-11-27T20:42:37.530606+0000","last_unstale":"2023-11-27T20:42:59.554286+0000","last_undegraded":"2023-11-27T20:42:59.554286+0000","last_fullsized":"2023-11-27T20:42:59.554286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:26.686814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.544204+0000","last_change":"2023-11-27T20:42:38.556454+0000","last_active":"2023-11-27T20:42:59.544204+0000","last_peered":"2023-11-27T20:42:59.544204+0000","last_clean":"2023-11-27T20:42:59.544204+0000","last_became_active":"2023-11-27T20:42:38.556194+0000","last_became_peered":"2023-11-27T20:42:38.556194+0000","last_unstale":"2023-11-27T20:42:59.544204+0000","last_undegraded":"2023-11-27T20:42:59.544204+0000","last_fullsized":"2023-11-27T20:42:59.544204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.578631+0000","last_change":"2023-11-27T20:42:58.555231+0000","last_active":"2023-11-27T20:42:59.578631+0000","last_peered":"2023-11-27T20:42:59.578631+0000","last_clean":"2023-11-27T20:42:59.578631+0000","last_became_active":"2023-11-27T20:42:58.554605+0000","last_became_peered":"2023-11-27T20:42:58.554605+0000","last_unstale":"2023-11-27T20:42:59.578631+0000","last_undegraded":"2023-11-27T20:42:59.578631+0000","last_fullsized":"2023-11-27T20:42:59.578631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:53.950911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.884667+0000","last_change":"2023-11-27T20:42:59.568125+0000","last_active":"2023-11-27T20:43:01.884667+0000","last_peered":"2023-11-27T20:43:01.884667+0000","last_clean":"2023-11-27T20:43:01.884667+0000","last_became_active":"2023-11-27T20:42:59.564117+0000","last_became_peered":"2023-11-27T20:42:59.564117+0000","last_unstale":"2023-11-27T20:43:01.884667+0000","last_undegraded":"2023-11-27T20:43:01.884667+0000","last_fullsized":"2023-11-27T20:43:01.884667+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:19:25.259856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566492+0000","last_change":"2023-11-27T20:42:37.529807+0000","last_active":"2023-11-27T20:42:59.566492+0000","last_peered":"2023-11-27T20:42:59.566492+0000","last_clean":"2023-11-27T20:42:59.566492+0000","last_became_active":"2023-11-27T20:42:37.529543+0000","last_became_peered":"2023-11-27T20:42:37.529543+0000","last_unstale":"2023-11-27T20:42:59.566492+0000","last_undegraded":"2023-11-27T20:42:59.566492+0000","last_fullsized":"2023-11-27T20:42:59.566492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.560712+0000","last_change":"2023-11-27T20:42:38.531762+0000","last_active":"2023-11-27T20:42:59.560712+0000","last_peered":"2023-11-27T20:42:59.560712+0000","last_clean":"2023-11-27T20:42:59.560712+0000","last_became_active":"2023-11-27T20:42:38.531490+0000","last_became_peered":"2023-11-27T20:42:38.531490+0000","last_unstale":"2023-11-27T20:42:59.560712+0000","last_undegraded":"2023-11-27T20:42:59.560712+0000","last_fullsized":"2023-11-27T20:42:59.560712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.559357+0000","last_change":"2023-11-27T20:42:58.543334+0000","last_active":"2023-11-27T20:42:59.559357+0000","last_peered":"2023-11-27T20:42:59.559357+0000","last_clean":"2023-11-27T20:42:59.559357+0000","last_became_active":"2023-11-27T20:42:58.543031+0000","last_became_peered":"2023-11-27T20:42:58.543031+0000","last_unstale":"2023-11-27T20:42:59.559357+0000","last_undegraded":"2023-11-27T20:42:59.559357+0000","last_fullsized":"2023-11-27T20:42:59.559357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:51:13.680792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.883615+0000","last_change":"2023-11-27T20:42:59.573392+0000","last_active":"2023-11-27T20:43:01.883615+0000","last_peered":"2023-11-27T20:43:01.883615+0000","last_clean":"2023-11-27T20:43:01.883615+0000","last_became_active":"2023-11-27T20:42:59.572769+0000","last_became_peered":"2023-11-27T20:42:59.572769+0000","last_unstale":"2023-11-27T20:43:01.883615+0000","last_undegraded":"2023-11-27T20:43:01.883615+0000","last_fullsized":"2023-11-27T20:43:01.883615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:06.826970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.561737+0000","last_change":"2023-11-27T20:42:37.532441+0000","last_active":"2023-11-27T20:42:59.561737+0000","last_peered":"2023-11-27T20:42:59.561737+0000","last_clean":"2023-11-27T20:42:59.561737+0000","last_became_active":"2023-11-27T20:42:37.532074+0000","last_became_peered":"2023-11-27T20:42:37.532074+0000","last_unstale":"2023-11-27T20:42:59.561737+0000","last_undegraded":"2023-11-27T20:42:59.561737+0000","last_fullsized":"2023-11-27T20:42:59.561737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:04.889609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.555856+0000","last_change":"2023-11-27T20:42:38.533430+0000","last_active":"2023-11-27T20:42:59.555856+0000","last_peered":"2023-11-27T20:42:59.555856+0000","last_clean":"2023-11-27T20:42:59.555856+0000","last_became_active":"2023-11-27T20:42:38.532325+0000","last_became_peered":"2023-11-27T20:42:38.532325+0000","last_unstale":"2023-11-27T20:42:59.555856+0000","last_undegraded":"2023-11-27T20:42:59.555856+0000","last_fullsized":"2023-11-27T20:42:59.555856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.565629+0000","last_change":"2023-11-27T20:42:58.551426+0000","last_active":"2023-11-27T20:42:59.565629+0000","last_peered":"2023-11-27T20:42:59.565629+0000","last_clean":"2023-11-27T20:42:59.565629+0000","last_became_active":"2023-11-27T20:42:58.551205+0000","last_became_peered":"2023-11-27T20:42:58.551205+0000","last_unstale":"2023-11-27T20:42:59.565629+0000","last_undegraded":"2023-11-27T20:42:59.565629+0000","last_fullsized":"2023-11-27T20:42:59.565629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:41.395422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.576334+0000","last_change":"2023-11-27T20:42:59.579679+0000","last_active":"2023-11-27T20:43:00.576334+0000","last_peered":"2023-11-27T20:43:00.576334+0000","last_clean":"2023-11-27T20:43:00.576334+0000","last_became_active":"2023-11-27T20:42:59.579403+0000","last_became_peered":"2023-11-27T20:42:59.579403+0000","last_unstale":"2023-11-27T20:43:00.576334+0000","last_undegraded":"2023-11-27T20:43:00.576334+0000","last_fullsized":"2023-11-27T20:43:00.576334+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:30.630781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567405+0000","last_change":"2023-11-27T20:42:37.527056+0000","last_active":"2023-11-27T20:42:59.567405+0000","last_peered":"2023-11-27T20:42:59.567405+0000","last_clean":"2023-11-27T20:42:59.567405+0000","last_became_active":"2023-11-27T20:42:37.526803+0000","last_became_peered":"2023-11-27T20:42:37.526803+0000","last_unstale":"2023-11-27T20:42:59.567405+0000","last_undegraded":"2023-11-27T20:42:59.567405+0000","last_fullsized":"2023-11-27T20:42:59.567405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.563347+0000","last_change":"2023-11-27T20:42:38.536715+0000","last_active":"2023-11-27T20:42:59.563347+0000","last_peered":"2023-11-27T20:42:59.563347+0000","last_clean":"2023-11-27T20:42:59.563347+0000","last_became_active":"2023-11-27T20:42:38.536349+0000","last_became_peered":"2023-11-27T20:42:38.536349+0000","last_unstale":"2023-11-27T20:42:59.563347+0000","last_undegraded":"2023-11-27T20:42:59.563347+0000","last_fullsized":"2023-11-27T20:42:59.563347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.548722+0000","last_change":"2023-11-27T20:42:58.547626+0000","last_active":"2023-11-27T20:42:59.548722+0000","last_peered":"2023-11-27T20:42:59.548722+0000","last_clean":"2023-11-27T20:42:59.548722+0000","last_became_active":"2023-11-27T20:42:58.546759+0000","last_became_peered":"2023-11-27T20:42:58.546759+0000","last_unstale":"2023-11-27T20:42:59.548722+0000","last_undegraded":"2023-11-27T20:42:59.548722+0000","last_fullsized":"2023-11-27T20:42:59.548722+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:11:44.411353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.573154+0000","last_change":"2023-11-27T20:42:59.603257+0000","last_active":"2023-11-27T20:43:00.573154+0000","last_peered":"2023-11-27T20:43:00.573154+0000","last_clean":"2023-11-27T20:43:00.573154+0000","last_became_active":"2023-11-27T20:42:59.603033+0000","last_became_peered":"2023-11-27T20:42:59.603033+0000","last_unstale":"2023-11-27T20:43:00.573154+0000","last_undegraded":"2023-11-27T20:43:00.573154+0000","last_fullsized":"2023-11-27T20:43:00.573154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:00.576412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567136+0000","last_change":"2023-11-27T20:42:37.528142+0000","last_active":"2023-11-27T20:42:59.567136+0000","last_peered":"2023-11-27T20:42:59.567136+0000","last_clean":"2023-11-27T20:42:59.567136+0000","last_became_active":"2023-11-27T20:42:37.527318+0000","last_became_peered":"2023-11-27T20:42:37.527318+0000","last_unstale":"2023-11-27T20:42:59.567136+0000","last_undegraded":"2023-11-27T20:42:59.567136+0000","last_fullsized":"2023-11-27T20:42:59.567136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566620+0000","last_change":"2023-11-27T20:42:38.553617+0000","last_active":"2023-11-27T20:42:59.566620+0000","last_peered":"2023-11-27T20:42:59.566620+0000","last_clean":"2023-11-27T20:42:59.566620+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:59.566620+0000","last_undegraded":"2023-11-27T20:42:59.566620+0000","last_fullsized":"2023-11-27T20:42:59.566620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566607+0000","last_change":"2023-11-27T20:42:58.542324+0000","last_active":"2023-11-27T20:42:59.566607+0000","last_peered":"2023-11-27T20:42:59.566607+0000","last_clean":"2023-11-27T20:42:59.566607+0000","last_became_active":"2023-11-27T20:42:58.541734+0000","last_became_peered":"2023-11-27T20:42:58.541734+0000","last_unstale":"2023-11-27T20:42:59.566607+0000","last_undegraded":"2023-11-27T20:42:59.566607+0000","last_fullsized":"2023-11-27T20:42:59.566607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:29:53.649476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454849+0000","last_change":"2023-11-27T20:42:59.578936+0000","last_active":"2023-11-27T20:43:01.454849+0000","last_peered":"2023-11-27T20:43:01.454849+0000","last_clean":"2023-11-27T20:43:01.454849+0000","last_became_active":"2023-11-27T20:42:59.578216+0000","last_became_peered":"2023-11-27T20:42:59.578216+0000","last_unstale":"2023-11-27T20:43:01.454849+0000","last_undegraded":"2023-11-27T20:43:01.454849+0000","last_fullsized":"2023-11-27T20:43:01.454849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:07:17.690802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.575802+0000","last_change":"2023-11-27T20:42:37.530114+0000","last_active":"2023-11-27T20:42:59.575802+0000","last_peered":"2023-11-27T20:42:59.575802+0000","last_clean":"2023-11-27T20:42:59.575802+0000","last_became_active":"2023-11-27T20:42:37.529838+0000","last_became_peered":"2023-11-27T20:42:37.529838+0000","last_unstale":"2023-11-27T20:42:59.575802+0000","last_undegraded":"2023-11-27T20:42:59.575802+0000","last_fullsized":"2023-11-27T20:42:59.575802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.574297+0000","last_change":"2023-11-27T20:42:38.551126+0000","last_active":"2023-11-27T20:42:59.574297+0000","last_peered":"2023-11-27T20:42:59.574297+0000","last_clean":"2023-11-27T20:42:59.574297+0000","last_became_active":"2023-11-27T20:42:38.550881+0000","last_became_peered":"2023-11-27T20:42:38.550881+0000","last_unstale":"2023-11-27T20:42:59.574297+0000","last_undegraded":"2023-11-27T20:42:59.574297+0000","last_fullsized":"2023-11-27T20:42:59.574297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:08.745845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.576839+0000","last_change":"2023-11-27T20:42:58.555003+0000","last_active":"2023-11-27T20:42:59.576839+0000","last_peered":"2023-11-27T20:42:59.576839+0000","last_clean":"2023-11-27T20:42:59.576839+0000","last_became_active":"2023-11-27T20:42:58.554708+0000","last_became_peered":"2023-11-27T20:42:58.554708+0000","last_unstale":"2023-11-27T20:42:59.576839+0000","last_undegraded":"2023-11-27T20:42:59.576839+0000","last_fullsized":"2023-11-27T20:42:59.576839+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:05.813865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.931186+0000","last_change":"2023-11-27T20:42:59.572562+0000","last_active":"2023-11-27T20:43:00.931186+0000","last_peered":"2023-11-27T20:43:00.931186+0000","last_clean":"2023-11-27T20:43:00.931186+0000","last_became_active":"2023-11-27T20:42:59.572191+0000","last_became_peered":"2023-11-27T20:42:59.572191+0000","last_unstale":"2023-11-27T20:43:00.931186+0000","last_undegraded":"2023-11-27T20:43:00.931186+0000","last_fullsized":"2023-11-27T20:43:00.931186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:56.843133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562172+0000","last_change":"2023-11-27T20:42:37.532212+0000","last_active":"2023-11-27T20:42:59.562172+0000","last_peered":"2023-11-27T20:42:59.562172+0000","last_clean":"2023-11-27T20:42:59.562172+0000","last_became_active":"2023-11-27T20:42:37.531894+0000","last_became_peered":"2023-11-27T20:42:37.531894+0000","last_unstale":"2023-11-27T20:42:59.562172+0000","last_undegraded":"2023-11-27T20:42:59.562172+0000","last_fullsized":"2023-11-27T20:42:59.562172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.572447+0000","last_change":"2023-11-27T20:42:38.537364+0000","last_active":"2023-11-27T20:42:59.572447+0000","last_peered":"2023-11-27T20:42:59.572447+0000","last_clean":"2023-11-27T20:42:59.572447+0000","last_became_active":"2023-11-27T20:42:38.536521+0000","last_became_peered":"2023-11-27T20:42:38.536521+0000","last_unstale":"2023-11-27T20:42:59.572447+0000","last_undegraded":"2023-11-27T20:42:59.572447+0000","last_fullsized":"2023-11-27T20:42:59.572447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562451+0000","last_change":"2023-11-27T20:42:58.554754+0000","last_active":"2023-11-27T20:42:59.562451+0000","last_peered":"2023-11-27T20:42:59.562451+0000","last_clean":"2023-11-27T20:42:59.562451+0000","last_became_active":"2023-11-27T20:42:58.554203+0000","last_became_peered":"2023-11-27T20:42:58.554203+0000","last_unstale":"2023-11-27T20:42:59.562451+0000","last_undegraded":"2023-11-27T20:42:59.562451+0000","last_fullsized":"2023-11-27T20:42:59.562451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:41.289648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.569524+0000","last_change":"2023-11-27T20:42:59.603018+0000","last_active":"2023-11-27T20:43:00.569524+0000","last_peered":"2023-11-27T20:43:00.569524+0000","last_clean":"2023-11-27T20:43:00.569524+0000","last_became_active":"2023-11-27T20:42:59.602737+0000","last_became_peered":"2023-11-27T20:42:59.602737+0000","last_unstale":"2023-11-27T20:43:00.569524+0000","last_undegraded":"2023-11-27T20:43:00.569524+0000","last_fullsized":"2023-11-27T20:43:00.569524+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:49.518639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.554081+0000","last_change":"2023-11-27T20:42:37.518579+0000","last_active":"2023-11-27T20:42:59.554081+0000","last_peered":"2023-11-27T20:42:59.554081+0000","last_clean":"2023-11-27T20:42:59.554081+0000","last_became_active":"2023-11-27T20:42:37.517970+0000","last_became_peered":"2023-11-27T20:42:37.517970+0000","last_unstale":"2023-11-27T20:42:59.554081+0000","last_undegraded":"2023-11-27T20:42:59.554081+0000","last_fullsized":"2023-11-27T20:42:59.554081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.572381+0000","last_change":"2023-11-27T20:42:38.539525+0000","last_active":"2023-11-27T20:42:59.572381+0000","last_peered":"2023-11-27T20:42:59.572381+0000","last_clean":"2023-11-27T20:42:59.572381+0000","last_became_active":"2023-11-27T20:42:38.539244+0000","last_became_peered":"2023-11-27T20:42:38.539244+0000","last_unstale":"2023-11-27T20:42:59.572381+0000","last_undegraded":"2023-11-27T20:42:59.572381+0000","last_fullsized":"2023-11-27T20:42:59.572381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:12:08.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.605387+0000","last_change":"2023-11-27T20:42:58.543574+0000","last_active":"2023-11-27T20:42:59.605387+0000","last_peered":"2023-11-27T20:42:59.605387+0000","last_clean":"2023-11-27T20:42:59.605387+0000","last_became_active":"2023-11-27T20:42:58.542244+0000","last_became_peered":"2023-11-27T20:42:58.542244+0000","last_unstale":"2023-11-27T20:42:59.605387+0000","last_undegraded":"2023-11-27T20:42:59.605387+0000","last_fullsized":"2023-11-27T20:42:59.605387+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:17.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454014+0000","last_change":"2023-11-27T20:42:59.575986+0000","last_active":"2023-11-27T20:43:01.454014+0000","last_peered":"2023-11-27T20:43:01.454014+0000","last_clean":"2023-11-27T20:43:01.454014+0000","last_became_active":"2023-11-27T20:42:59.573715+0000","last_became_peered":"2023-11-27T20:42:59.573715+0000","last_unstale":"2023-11-27T20:43:01.454014+0000","last_undegraded":"2023-11-27T20:43:01.454014+0000","last_fullsized":"2023-11-27T20:43:01.454014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:54.964017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.555559+0000","last_change":"2023-11-27T20:42:37.522543+0000","last_active":"2023-11-27T20:42:59.555559+0000","last_peered":"2023-11-27T20:42:59.555559+0000","last_clean":"2023-11-27T20:42:59.555559+0000","last_became_active":"2023-11-27T20:42:37.522163+0000","last_became_peered":"2023-11-27T20:42:37.522163+0000","last_unstale":"2023-11-27T20:42:59.555559+0000","last_undegraded":"2023-11-27T20:42:59.555559+0000","last_fullsized":"2023-11-27T20:42:59.555559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:46.239563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.570534+0000","last_change":"2023-11-27T20:42:38.536322+0000","last_active":"2023-11-27T20:42:59.570534+0000","last_peered":"2023-11-27T20:42:59.570534+0000","last_clean":"2023-11-27T20:42:59.570534+0000","last_became_active":"2023-11-27T20:42:38.536051+0000","last_became_peered":"2023-11-27T20:42:38.536051+0000","last_unstale":"2023-11-27T20:42:59.570534+0000","last_undegraded":"2023-11-27T20:42:59.570534+0000","last_fullsized":"2023-11-27T20:42:59.570534+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:31.539798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.568006+0000","last_change":"2023-11-27T20:42:58.539589+0000","last_active":"2023-11-27T20:42:59.568006+0000","last_peered":"2023-11-27T20:42:59.568006+0000","last_clean":"2023-11-27T20:42:59.568006+0000","last_became_active":"2023-11-27T20:42:58.539291+0000","last_became_peered":"2023-11-27T20:42:58.539291+0000","last_unstale":"2023-11-27T20:42:59.568006+0000","last_undegraded":"2023-11-27T20:42:59.568006+0000","last_fullsized":"2023-11-27T20:42:59.568006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:52.733989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.724330+0000","last_change":"2023-11-27T20:42:59.577354+0000","last_active":"2023-11-27T20:43:01.724330+0000","last_peered":"2023-11-27T20:43:01.724330+0000","last_clean":"2023-11-27T20:43:01.724330+0000","last_became_active":"2023-11-27T20:42:59.572712+0000","last_became_peered":"2023-11-27T20:42:59.572712+0000","last_unstale":"2023-11-27T20:43:01.724330+0000","last_undegraded":"2023-11-27T20:43:01.724330+0000","last_fullsized":"2023-11-27T20:43:01.724330+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:33.504653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.561181+0000","last_change":"2023-11-27T20:42:37.527591+0000","last_active":"2023-11-27T20:42:59.561181+0000","last_peered":"2023-11-27T20:42:59.561181+0000","last_clean":"2023-11-27T20:42:59.561181+0000","last_became_active":"2023-11-27T20:42:37.527305+0000","last_became_peered":"2023-11-27T20:42:37.527305+0000","last_unstale":"2023-11-27T20:42:59.561181+0000","last_undegraded":"2023-11-27T20:42:59.561181+0000","last_fullsized":"2023-11-27T20:42:59.561181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.580441+0000","last_change":"2023-11-27T20:42:38.547894+0000","last_active":"2023-11-27T20:42:59.580441+0000","last_peered":"2023-11-27T20:42:59.580441+0000","last_clean":"2023-11-27T20:42:59.580441+0000","last_became_active":"2023-11-27T20:42:38.547558+0000","last_became_peered":"2023-11-27T20:42:38.547558+0000","last_unstale":"2023-11-27T20:42:59.580441+0000","last_undegraded":"2023-11-27T20:42:59.580441+0000","last_fullsized":"2023-11-27T20:42:59.580441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:38.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.560265+0000","last_change":"2023-11-27T20:42:58.543955+0000","last_active":"2023-11-27T20:42:59.560265+0000","last_peered":"2023-11-27T20:42:59.560265+0000","last_clean":"2023-11-27T20:42:59.560265+0000","last_became_active":"2023-11-27T20:42:58.543674+0000","last_became_peered":"2023-11-27T20:42:58.543674+0000","last_unstale":"2023-11-27T20:42:59.560265+0000","last_undegraded":"2023-11-27T20:42:59.560265+0000","last_fullsized":"2023-11-27T20:42:59.560265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:55.830027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455646+0000","last_change":"2023-11-27T20:42:59.576738+0000","last_active":"2023-11-27T20:43:01.455646+0000","last_peered":"2023-11-27T20:43:01.455646+0000","last_clean":"2023-11-27T20:43:01.455646+0000","last_became_active":"2023-11-27T20:42:59.576408+0000","last_became_peered":"2023-11-27T20:42:59.576408+0000","last_unstale":"2023-11-27T20:43:01.455646+0000","last_undegraded":"2023-11-27T20:43:01.455646+0000","last_fullsized":"2023-11-27T20:43:01.455646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:54:47.448084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.551931+0000","last_change":"2023-11-27T20:42:37.527131+0000","last_active":"2023-11-27T20:42:59.551931+0000","last_peered":"2023-11-27T20:42:59.551931+0000","last_clean":"2023-11-27T20:42:59.551931+0000","last_became_active":"2023-11-27T20:42:37.526804+0000","last_became_peered":"2023-11-27T20:42:37.526804+0000","last_unstale":"2023-11-27T20:42:59.551931+0000","last_undegraded":"2023-11-27T20:42:59.551931+0000","last_fullsized":"2023-11-27T20:42:59.551931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573070+0000","last_change":"2023-11-27T20:42:38.549244+0000","last_active":"2023-11-27T20:42:59.573070+0000","last_peered":"2023-11-27T20:42:59.573070+0000","last_clean":"2023-11-27T20:42:59.573070+0000","last_became_active":"2023-11-27T20:42:38.548660+0000","last_became_peered":"2023-11-27T20:42:38.548660+0000","last_unstale":"2023-11-27T20:42:59.573070+0000","last_undegraded":"2023-11-27T20:42:59.573070+0000","last_fullsized":"2023-11-27T20:42:59.573070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:22.348409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.602163+0000","last_change":"2023-11-27T20:42:58.551925+0000","last_active":"2023-11-27T20:42:59.602163+0000","last_peered":"2023-11-27T20:42:59.602163+0000","last_clean":"2023-11-27T20:42:59.602163+0000","last_became_active":"2023-11-27T20:42:58.551537+0000","last_became_peered":"2023-11-27T20:42:58.551537+0000","last_unstale":"2023-11-27T20:42:59.602163+0000","last_undegraded":"2023-11-27T20:42:59.602163+0000","last_fullsized":"2023-11-27T20:42:59.602163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:15.676693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.725696+0000","last_change":"2023-11-27T20:42:59.586631+0000","last_active":"2023-11-27T20:43:01.725696+0000","last_peered":"2023-11-27T20:43:01.725696+0000","last_clean":"2023-11-27T20:43:01.725696+0000","last_became_active":"2023-11-27T20:42:59.586290+0000","last_became_peered":"2023-11-27T20:42:59.586290+0000","last_unstale":"2023-11-27T20:43:01.725696+0000","last_undegraded":"2023-11-27T20:43:01.725696+0000","last_fullsized":"2023-11-27T20:43:01.725696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:42.964011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.558791+0000","last_change":"2023-11-27T20:42:37.525601+0000","last_active":"2023-11-27T20:42:59.558791+0000","last_peered":"2023-11-27T20:42:59.558791+0000","last_clean":"2023-11-27T20:42:59.558791+0000","last_became_active":"2023-11-27T20:42:37.525296+0000","last_became_peered":"2023-11-27T20:42:37.525296+0000","last_unstale":"2023-11-27T20:42:59.558791+0000","last_undegraded":"2023-11-27T20:42:59.558791+0000","last_fullsized":"2023-11-27T20:42:59.558791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566778+0000","last_change":"2023-11-27T20:42:38.554165+0000","last_active":"2023-11-27T20:42:59.566778+0000","last_peered":"2023-11-27T20:42:59.566778+0000","last_clean":"2023-11-27T20:42:59.566778+0000","last_became_active":"2023-11-27T20:42:38.553912+0000","last_became_peered":"2023-11-27T20:42:38.553912+0000","last_unstale":"2023-11-27T20:42:59.566778+0000","last_undegraded":"2023-11-27T20:42:59.566778+0000","last_fullsized":"2023-11-27T20:42:59.566778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.606484+0000","last_change":"2023-11-27T20:42:58.529202+0000","last_active":"2023-11-27T20:42:59.606484+0000","last_peered":"2023-11-27T20:42:59.606484+0000","last_clean":"2023-11-27T20:42:59.606484+0000","last_became_active":"2023-11-27T20:42:58.528904+0000","last_became_peered":"2023-11-27T20:42:58.528904+0000","last_unstale":"2023-11-27T20:42:59.606484+0000","last_undegraded":"2023-11-27T20:42:59.606484+0000","last_fullsized":"2023-11-27T20:42:59.606484+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:37.409667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.575373+0000","last_change":"2023-11-27T20:42:59.582035+0000","last_active":"2023-11-27T20:43:00.575373+0000","last_peered":"2023-11-27T20:43:00.575373+0000","last_clean":"2023-11-27T20:43:00.575373+0000","last_became_active":"2023-11-27T20:42:59.581289+0000","last_became_peered":"2023-11-27T20:42:59.581289+0000","last_unstale":"2023-11-27T20:43:00.575373+0000","last_undegraded":"2023-11-27T20:43:00.575373+0000","last_fullsized":"2023-11-27T20:43:00.575373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:16.689799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.558966+0000","last_change":"2023-11-27T20:42:37.522245+0000","last_active":"2023-11-27T20:42:59.558966+0000","last_peered":"2023-11-27T20:42:59.558966+0000","last_clean":"2023-11-27T20:42:59.558966+0000","last_became_active":"2023-11-27T20:42:37.521938+0000","last_became_peered":"2023-11-27T20:42:37.521938+0000","last_unstale":"2023-11-27T20:42:59.558966+0000","last_undegraded":"2023-11-27T20:42:59.558966+0000","last_fullsized":"2023-11-27T20:42:59.558966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566530+0000","last_change":"2023-11-27T20:42:38.549553+0000","last_active":"2023-11-27T20:42:59.566530+0000","last_peered":"2023-11-27T20:42:59.566530+0000","last_clean":"2023-11-27T20:42:59.566530+0000","last_became_active":"2023-11-27T20:42:38.549075+0000","last_became_peered":"2023-11-27T20:42:38.549075+0000","last_unstale":"2023-11-27T20:42:59.566530+0000","last_undegraded":"2023-11-27T20:42:59.566530+0000","last_fullsized":"2023-11-27T20:42:59.566530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.547434+0000","last_change":"2023-11-27T20:42:58.550144+0000","last_active":"2023-11-27T20:42:59.547434+0000","last_peered":"2023-11-27T20:42:59.547434+0000","last_clean":"2023-11-27T20:42:59.547434+0000","last_became_active":"2023-11-27T20:42:58.549810+0000","last_became_peered":"2023-11-27T20:42:58.549810+0000","last_unstale":"2023-11-27T20:42:59.547434+0000","last_undegraded":"2023-11-27T20:42:59.547434+0000","last_fullsized":"2023-11-27T20:42:59.547434+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:57:31.198311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.575193+0000","last_change":"2023-11-27T20:42:59.576915+0000","last_active":"2023-11-27T20:43:00.575193+0000","last_peered":"2023-11-27T20:43:00.575193+0000","last_clean":"2023-11-27T20:43:00.575193+0000","last_became_active":"2023-11-27T20:42:59.576609+0000","last_became_peered":"2023-11-27T20:42:59.576609+0000","last_unstale":"2023-11-27T20:43:00.575193+0000","last_undegraded":"2023-11-27T20:43:00.575193+0000","last_fullsized":"2023-11-27T20:43:00.575193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:04.429258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.575712+0000","last_change":"2023-11-27T20:42:37.525560+0000","last_active":"2023-11-27T20:42:59.575712+0000","last_peered":"2023-11-27T20:42:59.575712+0000","last_clean":"2023-11-27T20:42:59.575712+0000","last_became_active":"2023-11-27T20:42:37.525261+0000","last_became_peered":"2023-11-27T20:42:37.525261+0000","last_unstale":"2023-11-27T20:42:59.575712+0000","last_undegraded":"2023-11-27T20:42:59.575712+0000","last_fullsized":"2023-11-27T20:42:59.575712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:16.392657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.558838+0000","last_change":"2023-11-27T20:42:38.546056+0000","last_active":"2023-11-27T20:42:59.558838+0000","last_peered":"2023-11-27T20:42:59.558838+0000","last_clean":"2023-11-27T20:42:59.558838+0000","last_became_active":"2023-11-27T20:42:38.545736+0000","last_became_peered":"2023-11-27T20:42:38.545736+0000","last_unstale":"2023-11-27T20:42:59.558838+0000","last_undegraded":"2023-11-27T20:42:59.558838+0000","last_fullsized":"2023-11-27T20:42:59.558838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.603501+0000","last_change":"2023-11-27T20:42:58.545669+0000","last_active":"2023-11-27T20:42:59.603501+0000","last_peered":"2023-11-27T20:42:59.603501+0000","last_clean":"2023-11-27T20:42:59.603501+0000","last_became_active":"2023-11-27T20:42:58.545391+0000","last_became_peered":"2023-11-27T20:42:58.545391+0000","last_unstale":"2023-11-27T20:42:59.603501+0000","last_undegraded":"2023-11-27T20:42:59.603501+0000","last_fullsized":"2023-11-27T20:42:59.603501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:53.950911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455738+0000","last_change":"2023-11-27T20:42:59.580949+0000","last_active":"2023-11-27T20:43:01.455738+0000","last_peered":"2023-11-27T20:43:01.455738+0000","last_clean":"2023-11-27T20:43:01.455738+0000","last_became_active":"2023-11-27T20:42:59.580688+0000","last_became_peered":"2023-11-27T20:42:59.580688+0000","last_unstale":"2023-11-27T20:43:01.455738+0000","last_undegraded":"2023-11-27T20:43:01.455738+0000","last_fullsized":"2023-11-27T20:43:01.455738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:23.552503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.544753+0000","last_change":"2023-11-27T20:42:37.514338+0000","last_active":"2023-11-27T20:42:59.544753+0000","last_peered":"2023-11-27T20:42:59.544753+0000","last_clean":"2023-11-27T20:42:59.544753+0000","last_became_active":"2023-11-27T20:42:37.514055+0000","last_became_peered":"2023-11-27T20:42:37.514055+0000","last_unstale":"2023-11-27T20:42:59.544753+0000","last_undegraded":"2023-11-27T20:42:59.544753+0000","last_fullsized":"2023-11-27T20:42:59.544753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.550827+0000","last_change":"2023-11-27T20:42:38.547970+0000","last_active":"2023-11-27T20:42:59.550827+0000","last_peered":"2023-11-27T20:42:59.550827+0000","last_clean":"2023-11-27T20:42:59.550827+0000","last_became_active":"2023-11-27T20:42:38.547656+0000","last_became_peered":"2023-11-27T20:42:38.547656+0000","last_unstale":"2023-11-27T20:42:59.550827+0000","last_undegraded":"2023-11-27T20:42:59.550827+0000","last_fullsized":"2023-11-27T20:42:59.550827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573597+0000","last_change":"2023-11-27T20:42:58.537837+0000","last_active":"2023-11-27T20:42:59.573597+0000","last_peered":"2023-11-27T20:42:59.573597+0000","last_clean":"2023-11-27T20:42:59.573597+0000","last_became_active":"2023-11-27T20:42:58.537529+0000","last_became_peered":"2023-11-27T20:42:58.537529+0000","last_unstale":"2023-11-27T20:42:59.573597+0000","last_undegraded":"2023-11-27T20:42:59.573597+0000","last_fullsized":"2023-11-27T20:42:59.573597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:07:32.653760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.574696+0000","last_change":"2023-11-27T20:42:59.577677+0000","last_active":"2023-11-27T20:43:00.574696+0000","last_peered":"2023-11-27T20:43:00.574696+0000","last_clean":"2023-11-27T20:43:00.574696+0000","last_became_active":"2023-11-27T20:42:59.577228+0000","last_became_peered":"2023-11-27T20:42:59.577228+0000","last_unstale":"2023-11-27T20:43:00.574696+0000","last_undegraded":"2023-11-27T20:43:00.574696+0000","last_fullsized":"2023-11-27T20:43:00.574696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:24.927681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.546609+0000","last_change":"2023-11-27T20:42:37.535247+0000","last_active":"2023-11-27T20:42:59.546609+0000","last_peered":"2023-11-27T20:42:59.546609+0000","last_clean":"2023-11-27T20:42:59.546609+0000","last_became_active":"2023-11-27T20:42:37.534922+0000","last_became_peered":"2023-11-27T20:42:37.534922+0000","last_unstale":"2023-11-27T20:42:59.546609+0000","last_undegraded":"2023-11-27T20:42:59.546609+0000","last_fullsized":"2023-11-27T20:42:59.546609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:45.108775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567735+0000","last_change":"2023-11-27T20:42:38.548304+0000","last_active":"2023-11-27T20:42:59.567735+0000","last_peered":"2023-11-27T20:42:59.567735+0000","last_clean":"2023-11-27T20:42:59.567735+0000","last_became_active":"2023-11-27T20:42:38.547970+0000","last_became_peered":"2023-11-27T20:42:38.547970+0000","last_unstale":"2023-11-27T20:42:59.567735+0000","last_undegraded":"2023-11-27T20:42:59.567735+0000","last_fullsized":"2023-11-27T20:42:59.567735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.601288+0000","last_change":"2023-11-27T20:42:58.543360+0000","last_active":"2023-11-27T20:42:59.601288+0000","last_peered":"2023-11-27T20:42:59.601288+0000","last_clean":"2023-11-27T20:42:59.601288+0000","last_became_active":"2023-11-27T20:42:58.540793+0000","last_became_peered":"2023-11-27T20:42:58.540793+0000","last_unstale":"2023-11-27T20:42:59.601288+0000","last_undegraded":"2023-11-27T20:42:59.601288+0000","last_fullsized":"2023-11-27T20:42:59.601288+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:59.563307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.574356+0000","last_change":"2023-11-27T20:42:59.582866+0000","last_active":"2023-11-27T20:43:00.574356+0000","last_peered":"2023-11-27T20:43:00.574356+0000","last_clean":"2023-11-27T20:43:00.574356+0000","last_became_active":"2023-11-27T20:42:59.582151+0000","last_became_peered":"2023-11-27T20:42:59.582151+0000","last_unstale":"2023-11-27T20:43:00.574356+0000","last_undegraded":"2023-11-27T20:43:00.574356+0000","last_fullsized":"2023-11-27T20:43:00.574356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:54:47.448084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566393+0000","last_change":"2023-11-27T20:42:37.522904+0000","last_active":"2023-11-27T20:42:59.566393+0000","last_peered":"2023-11-27T20:42:59.566393+0000","last_clean":"2023-11-27T20:42:59.566393+0000","last_became_active":"2023-11-27T20:42:37.522574+0000","last_became_peered":"2023-11-27T20:42:37.522574+0000","last_unstale":"2023-11-27T20:42:59.566393+0000","last_undegraded":"2023-11-27T20:42:59.566393+0000","last_fullsized":"2023-11-27T20:42:59.566393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.549694+0000","last_change":"2023-11-27T20:42:38.553812+0000","last_active":"2023-11-27T20:42:59.549694+0000","last_peered":"2023-11-27T20:42:59.549694+0000","last_clean":"2023-11-27T20:42:59.549694+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:59.549694+0000","last_undegraded":"2023-11-27T20:42:59.549694+0000","last_fullsized":"2023-11-27T20:42:59.549694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:21.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.603781+0000","last_change":"2023-11-27T20:42:58.551919+0000","last_active":"2023-11-27T20:42:59.603781+0000","last_peered":"2023-11-27T20:42:59.603781+0000","last_clean":"2023-11-27T20:42:59.603781+0000","last_became_active":"2023-11-27T20:42:58.551241+0000","last_became_peered":"2023-11-27T20:42:58.551241+0000","last_unstale":"2023-11-27T20:42:59.603781+0000","last_undegraded":"2023-11-27T20:42:59.603781+0000","last_fullsized":"2023-11-27T20:42:59.603781+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:41.395422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.568669+0000","last_change":"2023-11-27T20:42:59.584520+0000","last_active":"2023-11-27T20:43:00.568669+0000","last_peered":"2023-11-27T20:43:00.568669+0000","last_clean":"2023-11-27T20:43:00.568669+0000","last_became_active":"2023-11-27T20:42:59.583568+0000","last_became_peered":"2023-11-27T20:42:59.583568+0000","last_unstale":"2023-11-27T20:43:00.568669+0000","last_undegraded":"2023-11-27T20:43:00.568669+0000","last_fullsized":"2023-11-27T20:43:00.568669+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:09:18.085066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.552901+0000","last_change":"2023-11-27T20:42:37.524294+0000","last_active":"2023-11-27T20:42:59.552901+0000","last_peered":"2023-11-27T20:42:59.552901+0000","last_clean":"2023-11-27T20:42:59.552901+0000","last_became_active":"2023-11-27T20:42:37.523858+0000","last_became_peered":"2023-11-27T20:42:37.523858+0000","last_unstale":"2023-11-27T20:42:59.552901+0000","last_undegraded":"2023-11-27T20:42:59.552901+0000","last_fullsized":"2023-11-27T20:42:59.552901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566226+0000","last_change":"2023-11-27T20:42:38.543201+0000","last_active":"2023-11-27T20:42:59.566226+0000","last_peered":"2023-11-27T20:42:59.566226+0000","last_clean":"2023-11-27T20:42:59.566226+0000","last_became_active":"2023-11-27T20:42:38.542920+0000","last_became_peered":"2023-11-27T20:42:38.542920+0000","last_unstale":"2023-11-27T20:42:59.566226+0000","last_undegraded":"2023-11-27T20:42:59.566226+0000","last_fullsized":"2023-11-27T20:42:59.566226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.545427+0000","last_change":"2023-11-27T20:42:58.541595+0000","last_active":"2023-11-27T20:42:59.545427+0000","last_peered":"2023-11-27T20:42:59.545427+0000","last_clean":"2023-11-27T20:42:59.545427+0000","last_became_active":"2023-11-27T20:42:58.540765+0000","last_became_peered":"2023-11-27T20:42:58.540765+0000","last_unstale":"2023-11-27T20:42:59.545427+0000","last_undegraded":"2023-11-27T20:42:59.545427+0000","last_fullsized":"2023-11-27T20:42:59.545427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:06.695281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.573749+0000","last_change":"2023-11-27T20:42:59.583295+0000","last_active":"2023-11-27T20:43:00.573749+0000","last_peered":"2023-11-27T20:43:00.573749+0000","last_clean":"2023-11-27T20:43:00.573749+0000","last_became_active":"2023-11-27T20:42:59.582972+0000","last_became_peered":"2023-11-27T20:42:59.582972+0000","last_unstale":"2023-11-27T20:43:00.573749+0000","last_undegraded":"2023-11-27T20:43:00.573749+0000","last_fullsized":"2023-11-27T20:43:00.573749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:57:32.211417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.548085+0000","last_change":"2023-11-27T20:42:37.523173+0000","last_active":"2023-11-27T20:42:59.548085+0000","last_peered":"2023-11-27T20:42:59.548085+0000","last_clean":"2023-11-27T20:42:59.548085+0000","last_became_active":"2023-11-27T20:42:37.522903+0000","last_became_peered":"2023-11-27T20:42:37.522903+0000","last_unstale":"2023-11-27T20:42:59.548085+0000","last_undegraded":"2023-11-27T20:42:59.548085+0000","last_fullsized":"2023-11-27T20:42:59.548085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:28.381599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562959+0000","last_change":"2023-11-27T20:42:38.557705+0000","last_active":"2023-11-27T20:42:59.562959+0000","last_peered":"2023-11-27T20:42:59.562959+0000","last_clean":"2023-11-27T20:42:59.562959+0000","last_became_active":"2023-11-27T20:42:38.557251+0000","last_became_peered":"2023-11-27T20:42:38.557251+0000","last_unstale":"2023-11-27T20:42:59.562959+0000","last_undegraded":"2023-11-27T20:42:59.562959+0000","last_fullsized":"2023-11-27T20:42:59.562959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566790+0000","last_change":"2023-11-27T20:42:58.548022+0000","last_active":"2023-11-27T20:42:59.566790+0000","last_peered":"2023-11-27T20:42:59.566790+0000","last_clean":"2023-11-27T20:42:59.566790+0000","last_became_active":"2023-11-27T20:42:58.547725+0000","last_became_peered":"2023-11-27T20:42:58.547725+0000","last_unstale":"2023-11-27T20:42:59.566790+0000","last_undegraded":"2023-11-27T20:42:59.566790+0000","last_fullsized":"2023-11-27T20:42:59.566790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:12.419709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.887531+0000","last_change":"2023-11-27T20:42:59.576205+0000","last_active":"2023-11-27T20:43:01.887531+0000","last_peered":"2023-11-27T20:43:01.887531+0000","last_clean":"2023-11-27T20:43:01.887531+0000","last_became_active":"2023-11-27T20:42:59.575925+0000","last_became_peered":"2023-11-27T20:42:59.575925+0000","last_unstale":"2023-11-27T20:43:01.887531+0000","last_undegraded":"2023-11-27T20:43:01.887531+0000","last_fullsized":"2023-11-27T20:43:01.887531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:54.964017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.563736+0000","last_change":"2023-11-27T20:42:37.530460+0000","last_active":"2023-11-27T20:42:59.563736+0000","last_peered":"2023-11-27T20:42:59.563736+0000","last_clean":"2023-11-27T20:42:59.563736+0000","last_became_active":"2023-11-27T20:42:37.529879+0000","last_became_peered":"2023-11-27T20:42:37.529879+0000","last_unstale":"2023-11-27T20:42:59.563736+0000","last_undegraded":"2023-11-27T20:42:59.563736+0000","last_fullsized":"2023-11-27T20:42:59.563736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:58.185242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.548407+0000","last_change":"2023-11-27T20:42:38.555684+0000","last_active":"2023-11-27T20:42:59.548407+0000","last_peered":"2023-11-27T20:42:59.548407+0000","last_clean":"2023-11-27T20:42:59.548407+0000","last_became_active":"2023-11-27T20:42:38.555415+0000","last_became_peered":"2023-11-27T20:42:38.555415+0000","last_unstale":"2023-11-27T20:42:59.548407+0000","last_undegraded":"2023-11-27T20:42:59.548407+0000","last_fullsized":"2023-11-27T20:42:59.548407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.559293+0000","last_change":"2023-11-27T20:42:58.551727+0000","last_active":"2023-11-27T20:42:59.559293+0000","last_peered":"2023-11-27T20:42:59.559293+0000","last_clean":"2023-11-27T20:42:59.559293+0000","last_became_active":"2023-11-27T20:42:58.551109+0000","last_became_peered":"2023-11-27T20:42:58.551109+0000","last_unstale":"2023-11-27T20:42:59.559293+0000","last_undegraded":"2023-11-27T20:42:59.559293+0000","last_fullsized":"2023-11-27T20:42:59.559293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:52.733989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.574214+0000","last_change":"2023-11-27T20:42:59.593819+0000","last_active":"2023-11-27T20:43:00.574214+0000","last_peered":"2023-11-27T20:43:00.574214+0000","last_clean":"2023-11-27T20:43:00.574214+0000","last_became_active":"2023-11-27T20:42:59.592212+0000","last_became_peered":"2023-11-27T20:42:59.592212+0000","last_unstale":"2023-11-27T20:43:00.574214+0000","last_undegraded":"2023-11-27T20:43:00.574214+0000","last_fullsized":"2023-11-27T20:43:00.574214+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:11:45.424458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567221+0000","last_change":"2023-11-27T20:42:37.532869+0000","last_active":"2023-11-27T20:42:59.567221+0000","last_peered":"2023-11-27T20:42:59.567221+0000","last_clean":"2023-11-27T20:42:59.567221+0000","last_became_active":"2023-11-27T20:42:37.532576+0000","last_became_peered":"2023-11-27T20:42:37.532576+0000","last_unstale":"2023-11-27T20:42:59.567221+0000","last_undegraded":"2023-11-27T20:42:59.567221+0000","last_fullsized":"2023-11-27T20:42:59.567221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.551160+0000","last_change":"2023-11-27T20:42:38.559970+0000","last_active":"2023-11-27T20:42:59.551160+0000","last_peered":"2023-11-27T20:42:59.551160+0000","last_clean":"2023-11-27T20:42:59.551160+0000","last_became_active":"2023-11-27T20:42:38.559688+0000","last_became_peered":"2023-11-27T20:42:38.559688+0000","last_unstale":"2023-11-27T20:42:59.551160+0000","last_undegraded":"2023-11-27T20:42:59.551160+0000","last_fullsized":"2023-11-27T20:42:59.551160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:47.260947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.606868+0000","last_change":"2023-11-27T20:42:58.544627+0000","last_active":"2023-11-27T20:42:59.606868+0000","last_peered":"2023-11-27T20:42:59.606868+0000","last_clean":"2023-11-27T20:42:59.606868+0000","last_became_active":"2023-11-27T20:42:58.544367+0000","last_became_peered":"2023-11-27T20:42:58.544367+0000","last_unstale":"2023-11-27T20:42:59.606868+0000","last_undegraded":"2023-11-27T20:42:59.606868+0000","last_fullsized":"2023-11-27T20:42:59.606868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:22.014113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.570535+0000","last_change":"2023-11-27T20:42:59.582621+0000","last_active":"2023-11-27T20:43:00.570535+0000","last_peered":"2023-11-27T20:43:00.570535+0000","last_clean":"2023-11-27T20:43:00.570535+0000","last_became_active":"2023-11-27T20:42:59.582447+0000","last_became_peered":"2023-11-27T20:42:59.582447+0000","last_unstale":"2023-11-27T20:43:00.570535+0000","last_undegraded":"2023-11-27T20:43:00.570535+0000","last_fullsized":"2023-11-27T20:43:00.570535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:07.705415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.549400+0000","last_change":"2023-11-27T20:42:37.531762+0000","last_active":"2023-11-27T20:42:59.549400+0000","last_peered":"2023-11-27T20:42:59.549400+0000","last_clean":"2023-11-27T20:42:59.549400+0000","last_became_active":"2023-11-27T20:42:37.531446+0000","last_became_peered":"2023-11-27T20:42:37.531446+0000","last_unstale":"2023-11-27T20:42:59.549400+0000","last_undegraded":"2023-11-27T20:42:59.549400+0000","last_fullsized":"2023-11-27T20:42:59.549400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:11.474537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.565905+0000","last_change":"2023-11-27T20:42:38.555603+0000","last_active":"2023-11-27T20:42:59.565905+0000","last_peered":"2023-11-27T20:42:59.565905+0000","last_clean":"2023-11-27T20:42:59.565905+0000","last_became_active":"2023-11-27T20:42:38.555305+0000","last_became_peered":"2023-11-27T20:42:38.555305+0000","last_unstale":"2023-11-27T20:42:59.565905+0000","last_undegraded":"2023-11-27T20:42:59.565905+0000","last_fullsized":"2023-11-27T20:42:59.565905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.604884+0000","last_change":"2023-11-27T20:42:58.555168+0000","last_active":"2023-11-27T20:42:59.604884+0000","last_peered":"2023-11-27T20:42:59.604884+0000","last_clean":"2023-11-27T20:42:59.604884+0000","last_became_active":"2023-11-27T20:42:58.554873+0000","last_became_peered":"2023-11-27T20:42:58.554873+0000","last_unstale":"2023-11-27T20:42:59.604884+0000","last_undegraded":"2023-11-27T20:42:59.604884+0000","last_fullsized":"2023-11-27T20:42:59.604884+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:06.695281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455387+0000","last_change":"2023-11-27T20:42:59.587212+0000","last_active":"2023-11-27T20:43:01.455387+0000","last_peered":"2023-11-27T20:43:01.455387+0000","last_clean":"2023-11-27T20:43:01.455387+0000","last_became_active":"2023-11-27T20:42:59.586922+0000","last_became_peered":"2023-11-27T20:42:59.586922+0000","last_unstale":"2023-11-27T20:43:01.455387+0000","last_undegraded":"2023-11-27T20:43:01.455387+0000","last_fullsized":"2023-11-27T20:43:01.455387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:57:32.211417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553461+0000","last_change":"2023-11-27T20:42:37.522230+0000","last_active":"2023-11-27T20:42:59.553461+0000","last_peered":"2023-11-27T20:42:59.553461+0000","last_clean":"2023-11-27T20:42:59.553461+0000","last_became_active":"2023-11-27T20:42:37.521898+0000","last_became_peered":"2023-11-27T20:42:37.521898+0000","last_unstale":"2023-11-27T20:42:59.553461+0000","last_undegraded":"2023-11-27T20:42:59.553461+0000","last_fullsized":"2023-11-27T20:42:59.553461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:16:18.992040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.565806+0000","last_change":"2023-11-27T20:42:38.538177+0000","last_active":"2023-11-27T20:42:59.565806+0000","last_peered":"2023-11-27T20:42:59.565806+0000","last_clean":"2023-11-27T20:42:59.565806+0000","last_became_active":"2023-11-27T20:42:38.537835+0000","last_became_peered":"2023-11-27T20:42:38.537835+0000","last_unstale":"2023-11-27T20:42:59.565806+0000","last_undegraded":"2023-11-27T20:42:59.565806+0000","last_fullsized":"2023-11-27T20:42:59.565806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.599778+0000","last_change":"2023-11-27T20:42:58.553614+0000","last_active":"2023-11-27T20:42:59.599778+0000","last_peered":"2023-11-27T20:42:59.599778+0000","last_clean":"2023-11-27T20:42:59.599778+0000","last_became_active":"2023-11-27T20:42:58.553329+0000","last_became_peered":"2023-11-27T20:42:58.553329+0000","last_unstale":"2023-11-27T20:42:59.599778+0000","last_undegraded":"2023-11-27T20:42:59.599778+0000","last_fullsized":"2023-11-27T20:42:59.599778+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:23.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.885618+0000","last_change":"2023-11-27T20:42:59.568708+0000","last_active":"2023-11-27T20:43:01.885618+0000","last_peered":"2023-11-27T20:43:01.885618+0000","last_clean":"2023-11-27T20:43:01.885618+0000","last_became_active":"2023-11-27T20:42:59.568429+0000","last_became_peered":"2023-11-27T20:42:59.568429+0000","last_unstale":"2023-11-27T20:43:01.885618+0000","last_undegraded":"2023-11-27T20:43:01.885618+0000","last_fullsized":"2023-11-27T20:43:01.885618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:07:33.666865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.546965+0000","last_change":"2023-11-27T20:42:37.522964+0000","last_active":"2023-11-27T20:42:59.546965+0000","last_peered":"2023-11-27T20:42:59.546965+0000","last_clean":"2023-11-27T20:42:59.546965+0000","last_became_active":"2023-11-27T20:42:37.522677+0000","last_became_peered":"2023-11-27T20:42:37.522677+0000","last_unstale":"2023-11-27T20:42:59.546965+0000","last_undegraded":"2023-11-27T20:42:59.546965+0000","last_fullsized":"2023-11-27T20:42:59.546965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:30.748479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553345+0000","last_change":"2023-11-27T20:42:38.533572+0000","last_active":"2023-11-27T20:42:59.553345+0000","last_peered":"2023-11-27T20:42:59.553345+0000","last_clean":"2023-11-27T20:42:59.553345+0000","last_became_active":"2023-11-27T20:42:38.533281+0000","last_became_peered":"2023-11-27T20:42:38.533281+0000","last_unstale":"2023-11-27T20:42:59.553345+0000","last_undegraded":"2023-11-27T20:42:59.553345+0000","last_fullsized":"2023-11-27T20:42:59.553345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.604729+0000","last_change":"2023-11-27T20:42:58.535935+0000","last_active":"2023-11-27T20:42:59.604729+0000","last_peered":"2023-11-27T20:42:59.604729+0000","last_clean":"2023-11-27T20:42:59.604729+0000","last_became_active":"2023-11-27T20:42:58.534678+0000","last_became_peered":"2023-11-27T20:42:58.534678+0000","last_unstale":"2023-11-27T20:42:59.604729+0000","last_undegraded":"2023-11-27T20:42:59.604729+0000","last_fullsized":"2023-11-27T20:42:59.604729+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:45.859604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.572998+0000","last_change":"2023-11-27T20:42:59.579635+0000","last_active":"2023-11-27T20:43:00.572998+0000","last_peered":"2023-11-27T20:43:00.572998+0000","last_clean":"2023-11-27T20:43:00.572998+0000","last_became_active":"2023-11-27T20:42:59.579024+0000","last_became_peered":"2023-11-27T20:42:59.579024+0000","last_unstale":"2023-11-27T20:43:00.572998+0000","last_undegraded":"2023-11-27T20:43:00.572998+0000","last_fullsized":"2023-11-27T20:43:00.572998+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:29:54.662581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.556694+0000","last_change":"2023-11-27T20:42:37.531654+0000","last_active":"2023-11-27T20:42:59.556694+0000","last_peered":"2023-11-27T20:42:59.556694+0000","last_clean":"2023-11-27T20:42:59.556694+0000","last_became_active":"2023-11-27T20:42:37.529901+0000","last_became_peered":"2023-11-27T20:42:37.529901+0000","last_unstale":"2023-11-27T20:42:59.556694+0000","last_undegraded":"2023-11-27T20:42:59.556694+0000","last_fullsized":"2023-11-27T20:42:59.556694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562586+0000","last_change":"2023-11-27T20:42:38.545564+0000","last_active":"2023-11-27T20:42:59.562586+0000","last_peered":"2023-11-27T20:42:59.562586+0000","last_clean":"2023-11-27T20:42:59.562586+0000","last_became_active":"2023-11-27T20:42:38.545232+0000","last_became_peered":"2023-11-27T20:42:38.545232+0000","last_unstale":"2023-11-27T20:42:59.562586+0000","last_undegraded":"2023-11-27T20:42:59.562586+0000","last_fullsized":"2023-11-27T20:42:59.562586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.559956+0000","last_change":"2023-11-27T20:42:58.545203+0000","last_active":"2023-11-27T20:42:59.559956+0000","last_peered":"2023-11-27T20:42:59.559956+0000","last_clean":"2023-11-27T20:42:59.559956+0000","last_became_active":"2023-11-27T20:42:58.544923+0000","last_became_peered":"2023-11-27T20:42:58.544923+0000","last_unstale":"2023-11-27T20:42:59.559956+0000","last_undegraded":"2023-11-27T20:42:59.559956+0000","last_fullsized":"2023-11-27T20:42:59.559956+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:03.416152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454328+0000","last_change":"2023-11-27T20:42:59.571764+0000","last_active":"2023-11-27T20:43:01.454328+0000","last_peered":"2023-11-27T20:43:01.454328+0000","last_clean":"2023-11-27T20:43:01.454328+0000","last_became_active":"2023-11-27T20:42:59.571496+0000","last_became_peered":"2023-11-27T20:42:59.571496+0000","last_unstale":"2023-11-27T20:43:01.454328+0000","last_undegraded":"2023-11-27T20:43:01.454328+0000","last_fullsized":"2023-11-27T20:43:01.454328+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:07.708387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.552647+0000","last_change":"2023-11-27T20:42:37.527381+0000","last_active":"2023-11-27T20:42:59.552647+0000","last_peered":"2023-11-27T20:42:59.552647+0000","last_clean":"2023-11-27T20:42:59.552647+0000","last_became_active":"2023-11-27T20:42:37.527147+0000","last_became_peered":"2023-11-27T20:42:37.527147+0000","last_unstale":"2023-11-27T20:42:59.552647+0000","last_undegraded":"2023-11-27T20:42:59.552647+0000","last_fullsized":"2023-11-27T20:42:59.552647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573790+0000","last_change":"2023-11-27T20:42:38.552242+0000","last_active":"2023-11-27T20:42:59.573790+0000","last_peered":"2023-11-27T20:42:59.573790+0000","last_clean":"2023-11-27T20:42:59.573790+0000","last_became_active":"2023-11-27T20:42:38.551805+0000","last_became_peered":"2023-11-27T20:42:38.551805+0000","last_unstale":"2023-11-27T20:42:59.573790+0000","last_undegraded":"2023-11-27T20:42:59.573790+0000","last_fullsized":"2023-11-27T20:42:59.573790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562447+0000","last_change":"2023-11-27T20:42:58.547657+0000","last_active":"2023-11-27T20:42:59.562447+0000","last_peered":"2023-11-27T20:42:59.562447+0000","last_clean":"2023-11-27T20:42:59.562447+0000","last_became_active":"2023-11-27T20:42:58.547413+0000","last_became_peered":"2023-11-27T20:42:58.547413+0000","last_unstale":"2023-11-27T20:42:59.562447+0000","last_undegraded":"2023-11-27T20:42:59.562447+0000","last_fullsized":"2023-11-27T20:42:59.562447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:12.419709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.575662+0000","last_change":"2023-11-27T20:42:59.567778+0000","last_active":"2023-11-27T20:43:00.575662+0000","last_peered":"2023-11-27T20:43:00.575662+0000","last_clean":"2023-11-27T20:43:00.575662+0000","last_became_active":"2023-11-27T20:42:59.567481+0000","last_became_peered":"2023-11-27T20:42:59.567481+0000","last_unstale":"2023-11-27T20:43:00.575662+0000","last_undegraded":"2023-11-27T20:43:00.575662+0000","last_fullsized":"2023-11-27T20:43:00.575662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:52:37.217003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.600172+0000","last_change":"2023-11-27T20:42:58.555312+0000","last_active":"2023-11-27T20:42:59.600172+0000","last_peered":"2023-11-27T20:42:59.600172+0000","last_clean":"2023-11-27T20:42:59.600172+0000","last_became_active":"2023-11-27T20:42:58.554561+0000","last_became_peered":"2023-11-27T20:42:58.554561+0000","last_unstale":"2023-11-27T20:42:59.600172+0000","last_undegraded":"2023-11-27T20:42:59.600172+0000","last_fullsized":"2023-11-27T20:42:59.600172+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:52:36.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.575933+0000","last_change":"2023-11-27T20:42:37.530074+0000","last_active":"2023-11-27T20:42:59.575933+0000","last_peered":"2023-11-27T20:42:59.575933+0000","last_clean":"2023-11-27T20:42:59.575933+0000","last_became_active":"2023-11-27T20:42:37.529422+0000","last_became_peered":"2023-11-27T20:42:37.529422+0000","last_unstale":"2023-11-27T20:42:59.575933+0000","last_undegraded":"2023-11-27T20:42:59.575933+0000","last_fullsized":"2023-11-27T20:42:59.575933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:40:40.129670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573270+0000","last_change":"2023-11-27T20:42:38.551495+0000","last_active":"2023-11-27T20:42:59.573270+0000","last_peered":"2023-11-27T20:42:59.573270+0000","last_clean":"2023-11-27T20:42:59.573270+0000","last_became_active":"2023-11-27T20:42:38.548057+0000","last_became_peered":"2023-11-27T20:42:38.548057+0000","last_unstale":"2023-11-27T20:42:59.573270+0000","last_undegraded":"2023-11-27T20:42:59.573270+0000","last_fullsized":"2023-11-27T20:42:59.573270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.932102+0000","last_change":"2023-11-27T20:42:59.595419+0000","last_active":"2023-11-27T20:43:00.932102+0000","last_peered":"2023-11-27T20:43:00.932102+0000","last_clean":"2023-11-27T20:43:00.932102+0000","last_became_active":"2023-11-27T20:42:59.593174+0000","last_became_peered":"2023-11-27T20:42:59.593174+0000","last_unstale":"2023-11-27T20:43:00.932102+0000","last_undegraded":"2023-11-27T20:43:00.932102+0000","last_fullsized":"2023-11-27T20:43:00.932102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:52:37.217003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.605957+0000","last_change":"2023-11-27T20:42:58.552527+0000","last_active":"2023-11-27T20:42:59.605957+0000","last_peered":"2023-11-27T20:42:59.605957+0000","last_clean":"2023-11-27T20:42:59.605957+0000","last_became_active":"2023-11-27T20:42:58.552194+0000","last_became_peered":"2023-11-27T20:42:58.552194+0000","last_unstale":"2023-11-27T20:42:59.605957+0000","last_undegraded":"2023-11-27T20:42:59.605957+0000","last_fullsized":"2023-11-27T20:42:59.605957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:54:46.434979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.547537+0000","last_change":"2023-11-27T20:42:37.520015+0000","last_active":"2023-11-27T20:42:59.547537+0000","last_peered":"2023-11-27T20:42:59.547537+0000","last_clean":"2023-11-27T20:42:59.547537+0000","last_became_active":"2023-11-27T20:42:37.519779+0000","last_became_peered":"2023-11-27T20:42:37.519779+0000","last_unstale":"2023-11-27T20:42:59.547537+0000","last_undegraded":"2023-11-27T20:42:59.547537+0000","last_fullsized":"2023-11-27T20:42:59.547537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:47.336738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.551677+0000","last_change":"2023-11-27T20:42:38.558352+0000","last_active":"2023-11-27T20:42:59.551677+0000","last_peered":"2023-11-27T20:42:59.551677+0000","last_clean":"2023-11-27T20:42:59.551677+0000","last_became_active":"2023-11-27T20:42:38.557630+0000","last_became_peered":"2023-11-27T20:42:38.557630+0000","last_unstale":"2023-11-27T20:42:59.551677+0000","last_undegraded":"2023-11-27T20:42:59.551677+0000","last_fullsized":"2023-11-27T20:42:59.551677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.932402+0000","last_change":"2023-11-27T20:42:59.579428+0000","last_active":"2023-11-27T20:43:00.932402+0000","last_peered":"2023-11-27T20:43:00.932402+0000","last_clean":"2023-11-27T20:43:00.932402+0000","last_became_active":"2023-11-27T20:42:59.579214+0000","last_became_peered":"2023-11-27T20:42:59.579214+0000","last_unstale":"2023-11-27T20:43:00.932402+0000","last_undegraded":"2023-11-27T20:43:00.932402+0000","last_fullsized":"2023-11-27T20:43:00.932402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:53.747094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567046+0000","last_change":"2023-11-27T20:42:37.535511+0000","last_active":"2023-11-27T20:42:59.567046+0000","last_peered":"2023-11-27T20:42:59.567046+0000","last_clean":"2023-11-27T20:42:59.567046+0000","last_became_active":"2023-11-27T20:42:37.535314+0000","last_became_peered":"2023-11-27T20:42:37.535314+0000","last_unstale":"2023-11-27T20:42:59.567046+0000","last_undegraded":"2023-11-27T20:42:59.567046+0000","last_fullsized":"2023-11-27T20:42:59.567046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553402+0000","last_change":"2023-11-27T20:42:38.545391+0000","last_active":"2023-11-27T20:42:59.553402+0000","last_peered":"2023-11-27T20:42:59.553402+0000","last_clean":"2023-11-27T20:42:59.553402+0000","last_became_active":"2023-11-27T20:42:38.544984+0000","last_became_peered":"2023-11-27T20:42:38.544984+0000","last_unstale":"2023-11-27T20:42:59.553402+0000","last_undegraded":"2023-11-27T20:42:59.553402+0000","last_fullsized":"2023-11-27T20:42:59.553402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.599746+0000","last_change":"2023-11-27T20:42:58.549733+0000","last_active":"2023-11-27T20:42:59.599746+0000","last_peered":"2023-11-27T20:42:59.599746+0000","last_clean":"2023-11-27T20:42:59.599746+0000","last_became_active":"2023-11-27T20:42:58.549444+0000","last_became_peered":"2023-11-27T20:42:58.549444+0000","last_unstale":"2023-11-27T20:42:59.599746+0000","last_undegraded":"2023-11-27T20:42:59.599746+0000","last_fullsized":"2023-11-27T20:42:59.599746+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:03:32.238576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.885258+0000","last_change":"2023-11-27T20:42:59.576002+0000","last_active":"2023-11-27T20:43:01.885258+0000","last_peered":"2023-11-27T20:43:01.885258+0000","last_clean":"2023-11-27T20:43:01.885258+0000","last_became_active":"2023-11-27T20:42:59.575718+0000","last_became_peered":"2023-11-27T20:42:59.575718+0000","last_unstale":"2023-11-27T20:43:01.885258+0000","last_undegraded":"2023-11-27T20:43:01.885258+0000","last_fullsized":"2023-11-27T20:43:01.885258+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:07:17.690802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553510+0000","last_change":"2023-11-27T20:42:37.528294+0000","last_active":"2023-11-27T20:42:59.553510+0000","last_peered":"2023-11-27T20:42:59.553510+0000","last_clean":"2023-11-27T20:42:59.553510+0000","last_became_active":"2023-11-27T20:42:37.528055+0000","last_became_peered":"2023-11-27T20:42:37.528055+0000","last_unstale":"2023-11-27T20:42:59.553510+0000","last_undegraded":"2023-11-27T20:42:59.553510+0000","last_fullsized":"2023-11-27T20:42:59.553510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566962+0000","last_change":"2023-11-27T20:42:38.529609+0000","last_active":"2023-11-27T20:42:59.566962+0000","last_peered":"2023-11-27T20:42:59.566962+0000","last_clean":"2023-11-27T20:42:59.566962+0000","last_became_active":"2023-11-27T20:42:38.529089+0000","last_became_peered":"2023-11-27T20:42:38.529089+0000","last_unstale":"2023-11-27T20:42:59.566962+0000","last_undegraded":"2023-11-27T20:42:59.566962+0000","last_fullsized":"2023-11-27T20:42:59.566962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.605397+0000","last_change":"2023-11-27T20:42:58.548732+0000","last_active":"2023-11-27T20:42:59.605397+0000","last_peered":"2023-11-27T20:42:59.605397+0000","last_clean":"2023-11-27T20:42:59.605397+0000","last_became_active":"2023-11-27T20:42:58.548377+0000","last_became_peered":"2023-11-27T20:42:58.548377+0000","last_unstale":"2023-11-27T20:42:59.605397+0000","last_undegraded":"2023-11-27T20:42:59.605397+0000","last_fullsized":"2023-11-27T20:42:59.605397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:03.416152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.885370+0000","last_change":"2023-11-27T20:42:59.580067+0000","last_active":"2023-11-27T20:43:01.885370+0000","last_peered":"2023-11-27T20:43:01.885370+0000","last_clean":"2023-11-27T20:43:01.885370+0000","last_became_active":"2023-11-27T20:42:59.577803+0000","last_became_peered":"2023-11-27T20:42:59.577803+0000","last_unstale":"2023-11-27T20:43:01.885370+0000","last_undegraded":"2023-11-27T20:43:01.885370+0000","last_fullsized":"2023-11-27T20:43:01.885370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:30.630781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567614+0000","last_change":"2023-11-27T20:42:38.549776+0000","last_active":"2023-11-27T20:42:59.567614+0000","last_peered":"2023-11-27T20:42:59.567614+0000","last_clean":"2023-11-27T20:42:59.567614+0000","last_became_active":"2023-11-27T20:42:38.549339+0000","last_became_peered":"2023-11-27T20:42:38.549339+0000","last_unstale":"2023-11-27T20:42:59.567614+0000","last_undegraded":"2023-11-27T20:42:59.567614+0000","last_fullsized":"2023-11-27T20:42:59.567614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.575606+0000","last_change":"2023-11-27T20:42:59.581034+0000","last_active":"2023-11-27T20:43:00.575606+0000","last_peered":"2023-11-27T20:43:00.575606+0000","last_clean":"2023-11-27T20:43:00.575606+0000","last_became_active":"2023-11-27T20:42:59.580572+0000","last_became_peered":"2023-11-27T20:42:59.580572+0000","last_unstale":"2023-11-27T20:43:00.575606+0000","last_undegraded":"2023-11-27T20:43:00.575606+0000","last_fullsized":"2023-11-27T20:43:00.575606+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:56.843133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.550307+0000","last_change":"2023-11-27T20:42:38.539218+0000","last_active":"2023-11-27T20:42:59.550307+0000","last_peered":"2023-11-27T20:42:59.550307+0000","last_clean":"2023-11-27T20:42:59.550307+0000","last_became_active":"2023-11-27T20:42:38.538843+0000","last_became_peered":"2023-11-27T20:42:38.538843+0000","last_unstale":"2023-11-27T20:42:59.550307+0000","last_undegraded":"2023-11-27T20:42:59.550307+0000","last_fullsized":"2023-11-27T20:42:59.550307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:10.273471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.724496+0000","last_change":"2023-11-27T20:42:59.586714+0000","last_active":"2023-11-27T20:43:01.724496+0000","last_peered":"2023-11-27T20:43:01.724496+0000","last_clean":"2023-11-27T20:43:01.724496+0000","last_became_active":"2023-11-27T20:42:59.586441+0000","last_became_peered":"2023-11-27T20:42:59.586441+0000","last_unstale":"2023-11-27T20:43:01.724496+0000","last_undegraded":"2023-11-27T20:43:01.724496+0000","last_fullsized":"2023-11-27T20:43:01.724496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:09.366854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573695+0000","last_change":"2023-11-27T20:42:38.531773+0000","last_active":"2023-11-27T20:42:59.573695+0000","last_peered":"2023-11-27T20:42:59.573695+0000","last_clean":"2023-11-27T20:42:59.573695+0000","last_became_active":"2023-11-27T20:42:38.531469+0000","last_became_peered":"2023-11-27T20:42:38.531469+0000","last_unstale":"2023-11-27T20:42:59.573695+0000","last_undegraded":"2023-11-27T20:42:59.573695+0000","last_fullsized":"2023-11-27T20:42:59.573695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.569018+0000","last_change":"2023-11-27T20:42:59.570042+0000","last_active":"2023-11-27T20:43:00.569018+0000","last_peered":"2023-11-27T20:43:00.569018+0000","last_clean":"2023-11-27T20:43:00.569018+0000","last_became_active":"2023-11-27T20:42:59.569730+0000","last_became_peered":"2023-11-27T20:42:59.569730+0000","last_unstale":"2023-11-27T20:43:00.569018+0000","last_undegraded":"2023-11-27T20:43:00.569018+0000","last_fullsized":"2023-11-27T20:43:00.569018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:30:33.327744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.552424+0000","last_change":"2023-11-27T20:42:38.548676+0000","last_active":"2023-11-27T20:42:59.552424+0000","last_peered":"2023-11-27T20:42:59.552424+0000","last_clean":"2023-11-27T20:42:59.552424+0000","last_became_active":"2023-11-27T20:42:38.548338+0000","last_became_peered":"2023-11-27T20:42:38.548338+0000","last_unstale":"2023-11-27T20:42:59.552424+0000","last_undegraded":"2023-11-27T20:42:59.552424+0000","last_fullsized":"2023-11-27T20:42:59.552424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.725378+0000","last_change":"2023-11-27T20:42:59.591691+0000","last_active":"2023-11-27T20:43:01.725378+0000","last_peered":"2023-11-27T20:43:01.725378+0000","last_clean":"2023-11-27T20:43:01.725378+0000","last_became_active":"2023-11-27T20:42:59.591382+0000","last_became_peered":"2023-11-27T20:42:59.591382+0000","last_unstale":"2023-11-27T20:43:01.725378+0000","last_undegraded":"2023-11-27T20:43:01.725378+0000","last_fullsized":"2023-11-27T20:43:01.725378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:34.753259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.563238+0000","last_change":"2023-11-27T20:42:38.541871+0000","last_active":"2023-11-27T20:42:59.563238+0000","last_peered":"2023-11-27T20:42:59.563238+0000","last_clean":"2023-11-27T20:42:59.563238+0000","last_became_active":"2023-11-27T20:42:38.532675+0000","last_became_peered":"2023-11-27T20:42:38.532675+0000","last_unstale":"2023-11-27T20:42:59.563238+0000","last_undegraded":"2023-11-27T20:42:59.563238+0000","last_fullsized":"2023-11-27T20:42:59.563238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.576022+0000","last_change":"2023-11-27T20:42:59.582099+0000","last_active":"2023-11-27T20:43:00.576022+0000","last_peered":"2023-11-27T20:43:00.576022+0000","last_clean":"2023-11-27T20:43:00.576022+0000","last_became_active":"2023-11-27T20:42:59.581816+0000","last_became_peered":"2023-11-27T20:42:59.581816+0000","last_unstale":"2023-11-27T20:43:00.576022+0000","last_undegraded":"2023-11-27T20:43:00.576022+0000","last_fullsized":"2023-11-27T20:43:00.576022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:19:25.259856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573361+0000","last_change":"2023-11-27T20:42:38.547768+0000","last_active":"2023-11-27T20:42:59.573361+0000","last_peered":"2023-11-27T20:42:59.573361+0000","last_clean":"2023-11-27T20:42:59.573361+0000","last_became_active":"2023-11-27T20:42:38.547403+0000","last_became_peered":"2023-11-27T20:42:38.547403+0000","last_unstale":"2023-11-27T20:42:59.573361+0000","last_undegraded":"2023-11-27T20:42:59.573361+0000","last_fullsized":"2023-11-27T20:42:59.573361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.885257+0000","last_change":"2023-11-27T20:42:59.591772+0000","last_active":"2023-11-27T20:43:01.885257+0000","last_peered":"2023-11-27T20:43:01.885257+0000","last_clean":"2023-11-27T20:43:01.885257+0000","last_became_active":"2023-11-27T20:42:59.591430+0000","last_became_peered":"2023-11-27T20:42:59.591430+0000","last_unstale":"2023-11-27T20:43:01.885257+0000","last_undegraded":"2023-11-27T20:43:01.885257+0000","last_fullsized":"2023-11-27T20:43:01.885257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:00.576412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.549266+0000","last_change":"2023-11-27T20:42:38.553640+0000","last_active":"2023-11-27T20:42:59.549266+0000","last_peered":"2023-11-27T20:42:59.549266+0000","last_clean":"2023-11-27T20:42:59.549266+0000","last_became_active":"2023-11-27T20:42:38.552879+0000","last_became_peered":"2023-11-27T20:42:38.552879+0000","last_unstale":"2023-11-27T20:42:59.549266+0000","last_undegraded":"2023-11-27T20:42:59.549266+0000","last_fullsized":"2023-11-27T20:42:59.549266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:40:10.146333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.886692+0000","last_change":"2023-11-27T20:42:59.570928+0000","last_active":"2023-11-27T20:43:01.886692+0000","last_peered":"2023-11-27T20:43:01.886692+0000","last_clean":"2023-11-27T20:43:01.886692+0000","last_became_active":"2023-11-27T20:42:59.570596+0000","last_became_peered":"2023-11-27T20:42:59.570596+0000","last_unstale":"2023-11-27T20:43:01.886692+0000","last_undegraded":"2023-11-27T20:43:01.886692+0000","last_fullsized":"2023-11-27T20:43:01.886692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:03:33.251682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.575538+0000","last_change":"2023-11-27T20:42:38.547156+0000","last_active":"2023-11-27T20:42:59.575538+0000","last_peered":"2023-11-27T20:42:59.575538+0000","last_clean":"2023-11-27T20:42:59.575538+0000","last_became_active":"2023-11-27T20:42:38.545609+0000","last_became_peered":"2023-11-27T20:42:38.545609+0000","last_unstale":"2023-11-27T20:42:59.575538+0000","last_undegraded":"2023-11-27T20:42:59.575538+0000","last_fullsized":"2023-11-27T20:42:59.575538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454432+0000","last_change":"2023-11-27T20:42:59.574299+0000","last_active":"2023-11-27T20:43:01.454432+0000","last_peered":"2023-11-27T20:43:01.454432+0000","last_clean":"2023-11-27T20:43:01.454432+0000","last_became_active":"2023-11-27T20:42:59.573397+0000","last_became_peered":"2023-11-27T20:42:59.573397+0000","last_unstale":"2023-11-27T20:43:01.454432+0000","last_undegraded":"2023-11-27T20:43:01.454432+0000","last_fullsized":"2023-11-27T20:43:01.454432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:42.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562015+0000","last_change":"2023-11-27T20:42:38.542428+0000","last_active":"2023-11-27T20:42:59.562015+0000","last_peered":"2023-11-27T20:42:59.562015+0000","last_clean":"2023-11-27T20:42:59.562015+0000","last_became_active":"2023-11-27T20:42:38.542153+0000","last_became_peered":"2023-11-27T20:42:38.542153+0000","last_unstale":"2023-11-27T20:42:59.562015+0000","last_undegraded":"2023-11-27T20:42:59.562015+0000","last_fullsized":"2023-11-27T20:42:59.562015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.570472+0000","last_change":"2023-11-27T20:42:59.568640+0000","last_active":"2023-11-27T20:43:00.570472+0000","last_peered":"2023-11-27T20:43:00.570472+0000","last_clean":"2023-11-27T20:43:00.570472+0000","last_became_active":"2023-11-27T20:42:59.568301+0000","last_became_peered":"2023-11-27T20:42:59.568301+0000","last_unstale":"2023-11-27T20:43:00.570472+0000","last_undegraded":"2023-11-27T20:43:00.570472+0000","last_fullsized":"2023-11-27T20:43:00.570472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:49.633250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.560488+0000","last_change":"2023-11-27T20:42:38.535802+0000","last_active":"2023-11-27T20:42:59.560488+0000","last_peered":"2023-11-27T20:42:59.560488+0000","last_clean":"2023-11-27T20:42:59.560488+0000","last_became_active":"2023-11-27T20:42:38.535498+0000","last_became_peered":"2023-11-27T20:42:38.535498+0000","last_unstale":"2023-11-27T20:42:59.560488+0000","last_undegraded":"2023-11-27T20:42:59.560488+0000","last_fullsized":"2023-11-27T20:42:59.560488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.571965+0000","last_change":"2023-11-27T20:42:59.569442+0000","last_active":"2023-11-27T20:43:00.571965+0000","last_peered":"2023-11-27T20:43:00.571965+0000","last_clean":"2023-11-27T20:43:00.571965+0000","last_became_active":"2023-11-27T20:42:59.569177+0000","last_became_peered":"2023-11-27T20:42:59.569177+0000","last_unstale":"2023-11-27T20:43:00.571965+0000","last_undegraded":"2023-11-27T20:43:00.571965+0000","last_fullsized":"2023-11-27T20:43:00.571965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:08.278244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.555765+0000","last_change":"2023-11-27T20:42:38.551263+0000","last_active":"2023-11-27T20:42:59.555765+0000","last_peered":"2023-11-27T20:42:59.555765+0000","last_clean":"2023-11-27T20:42:59.555765+0000","last_became_active":"2023-11-27T20:42:38.545451+0000","last_became_peered":"2023-11-27T20:42:38.545451+0000","last_unstale":"2023-11-27T20:42:59.555765+0000","last_undegraded":"2023-11-27T20:42:59.555765+0000","last_fullsized":"2023-11-27T20:42:59.555765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.573973+0000","last_change":"2023-11-27T20:42:59.579822+0000","last_active":"2023-11-27T20:43:00.573973+0000","last_peered":"2023-11-27T20:43:00.573973+0000","last_clean":"2023-11-27T20:43:00.573973+0000","last_became_active":"2023-11-27T20:42:59.579366+0000","last_became_peered":"2023-11-27T20:42:59.579366+0000","last_unstale":"2023-11-27T20:43:00.573973+0000","last_undegraded":"2023-11-27T20:43:00.573973+0000","last_fullsized":"2023-11-27T20:43:00.573973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:51:14.693897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.552190+0000","last_change":"2023-11-27T20:42:38.534413+0000","last_active":"2023-11-27T20:42:59.552190+0000","last_peered":"2023-11-27T20:42:59.552190+0000","last_clean":"2023-11-27T20:42:59.552190+0000","last_became_active":"2023-11-27T20:42:38.534183+0000","last_became_peered":"2023-11-27T20:42:38.534183+0000","last_unstale":"2023-11-27T20:42:59.552190+0000","last_undegraded":"2023-11-27T20:42:59.552190+0000","last_fullsized":"2023-11-27T20:42:59.552190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.887361+0000","last_change":"2023-11-27T20:42:59.576101+0000","last_active":"2023-11-27T20:43:01.887361+0000","last_peered":"2023-11-27T20:43:01.887361+0000","last_clean":"2023-11-27T20:43:01.887361+0000","last_became_active":"2023-11-27T20:42:59.575705+0000","last_became_peered":"2023-11-27T20:42:59.575705+0000","last_unstale":"2023-11-27T20:43:01.887361+0000","last_undegraded":"2023-11-27T20:43:01.887361+0000","last_fullsized":"2023-11-27T20:43:01.887361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:42.302754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.575843+0000","last_change":"2023-11-27T20:42:38.550553+0000","last_active":"2023-11-27T20:42:59.575843+0000","last_peered":"2023-11-27T20:42:59.575843+0000","last_clean":"2023-11-27T20:42:59.575843+0000","last_became_active":"2023-11-27T20:42:38.550311+0000","last_became_peered":"2023-11-27T20:42:38.550311+0000","last_unstale":"2023-11-27T20:42:59.575843+0000","last_undegraded":"2023-11-27T20:42:59.575843+0000","last_fullsized":"2023-11-27T20:42:59.575843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:48.730603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.887658+0000","last_change":"2023-11-27T20:42:59.571338+0000","last_active":"2023-11-27T20:43:01.887658+0000","last_peered":"2023-11-27T20:43:01.887658+0000","last_clean":"2023-11-27T20:43:01.887658+0000","last_became_active":"2023-11-27T20:42:59.571009+0000","last_became_peered":"2023-11-27T20:42:59.571009+0000","last_unstale":"2023-11-27T20:43:01.887658+0000","last_undegraded":"2023-11-27T20:43:01.887658+0000","last_fullsized":"2023-11-27T20:43:01.887658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:07.708387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.545722+0000","last_change":"2023-11-27T20:42:38.561753+0000","last_active":"2023-11-27T20:42:59.545722+0000","last_peered":"2023-11-27T20:42:59.545722+0000","last_clean":"2023-11-27T20:42:59.545722+0000","last_became_active":"2023-11-27T20:42:38.561380+0000","last_became_peered":"2023-11-27T20:42:38.561380+0000","last_unstale":"2023-11-27T20:42:59.545722+0000","last_undegraded":"2023-11-27T20:42:59.545722+0000","last_fullsized":"2023-11-27T20:42:59.545722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.725501+0000","last_change":"2023-11-27T20:42:59.591329+0000","last_active":"2023-11-27T20:43:01.725501+0000","last_peered":"2023-11-27T20:43:01.725501+0000","last_clean":"2023-11-27T20:43:01.725501+0000","last_became_active":"2023-11-27T20:42:59.590915+0000","last_became_peered":"2023-11-27T20:42:59.590915+0000","last_unstale":"2023-11-27T20:43:01.725501+0000","last_undegraded":"2023-11-27T20:43:01.725501+0000","last_fullsized":"2023-11-27T20:43:01.725501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:33:13.023617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.549124+0000","last_change":"2023-11-27T20:42:38.560432+0000","last_active":"2023-11-27T20:42:59.549124+0000","last_peered":"2023-11-27T20:42:59.549124+0000","last_clean":"2023-11-27T20:42:59.549124+0000","last_became_active":"2023-11-27T20:42:38.560192+0000","last_became_peered":"2023-11-27T20:42:38.560192+0000","last_unstale":"2023-11-27T20:42:59.549124+0000","last_undegraded":"2023-11-27T20:42:59.549124+0000","last_fullsized":"2023-11-27T20:42:59.549124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.575774+0000","last_change":"2023-11-27T20:42:59.582784+0000","last_active":"2023-11-27T20:43:00.575774+0000","last_peered":"2023-11-27T20:43:00.575774+0000","last_clean":"2023-11-27T20:43:00.575774+0000","last_became_active":"2023-11-27T20:42:59.582386+0000","last_became_peered":"2023-11-27T20:42:59.582386+0000","last_unstale":"2023-11-27T20:43:00.575774+0000","last_undegraded":"2023-11-27T20:43:00.575774+0000","last_fullsized":"2023-11-27T20:43:00.575774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:53.747094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.579741+0000","last_change":"2023-11-27T20:42:38.540846+0000","last_active":"2023-11-27T20:42:59.579741+0000","last_peered":"2023-11-27T20:42:59.579741+0000","last_clean":"2023-11-27T20:42:59.579741+0000","last_became_active":"2023-11-27T20:42:38.540576+0000","last_became_peered":"2023-11-27T20:42:38.540576+0000","last_unstale":"2023-11-27T20:42:59.579741+0000","last_undegraded":"2023-11-27T20:42:59.579741+0000","last_fullsized":"2023-11-27T20:42:59.579741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454219+0000","last_change":"2023-11-27T20:42:59.575533+0000","last_active":"2023-11-27T20:43:01.454219+0000","last_peered":"2023-11-27T20:43:01.454219+0000","last_clean":"2023-11-27T20:43:01.454219+0000","last_became_active":"2023-11-27T20:42:59.575256+0000","last_became_peered":"2023-11-27T20:42:59.575256+0000","last_unstale":"2023-11-27T20:43:01.454219+0000","last_undegraded":"2023-11-27T20:43:01.454219+0000","last_fullsized":"2023-11-27T20:43:01.454219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:46.872709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.568099+0000","last_change":"2023-11-27T20:42:38.546971+0000","last_active":"2023-11-27T20:42:59.568099+0000","last_peered":"2023-11-27T20:42:59.568099+0000","last_clean":"2023-11-27T20:42:59.568099+0000","last_became_active":"2023-11-27T20:42:38.546653+0000","last_became_peered":"2023-11-27T20:42:38.546653+0000","last_unstale":"2023-11-27T20:42:59.568099+0000","last_undegraded":"2023-11-27T20:42:59.568099+0000","last_fullsized":"2023-11-27T20:42:59.568099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.724748+0000","last_change":"2023-11-27T20:42:59.591372+0000","last_active":"2023-11-27T20:43:01.724748+0000","last_peered":"2023-11-27T20:43:01.724748+0000","last_clean":"2023-11-27T20:43:01.724748+0000","last_became_active":"2023-11-27T20:42:59.590970+0000","last_became_peered":"2023-11-27T20:42:59.590970+0000","last_unstale":"2023-11-27T20:43:01.724748+0000","last_undegraded":"2023-11-27T20:43:01.724748+0000","last_fullsized":"2023-11-27T20:43:01.724748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:58:12.206705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562299+0000","last_change":"2023-11-27T20:42:38.547627+0000","last_active":"2023-11-27T20:42:59.562299+0000","last_peered":"2023-11-27T20:42:59.562299+0000","last_clean":"2023-11-27T20:42:59.562299+0000","last_became_active":"2023-11-27T20:42:38.539984+0000","last_became_peered":"2023-11-27T20:42:38.539984+0000","last_unstale":"2023-11-27T20:42:59.562299+0000","last_undegraded":"2023-11-27T20:42:59.562299+0000","last_fullsized":"2023-11-27T20:42:59.562299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.572445+0000","last_change":"2023-11-27T20:42:59.576821+0000","last_active":"2023-11-27T20:43:00.572445+0000","last_peered":"2023-11-27T20:43:00.572445+0000","last_clean":"2023-11-27T20:43:00.572445+0000","last_became_active":"2023-11-27T20:42:59.576496+0000","last_became_peered":"2023-11-27T20:42:59.576496+0000","last_unstale":"2023-11-27T20:43:00.572445+0000","last_undegraded":"2023-11-27T20:43:00.572445+0000","last_fullsized":"2023-11-27T20:43:00.572445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:42.408528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.548020+0000","last_change":"2023-11-27T20:42:38.547129+0000","last_active":"2023-11-27T20:42:59.548020+0000","last_peered":"2023-11-27T20:42:59.548020+0000","last_clean":"2023-11-27T20:42:59.548020+0000","last_became_active":"2023-11-27T20:42:38.546838+0000","last_became_peered":"2023-11-27T20:42:38.546838+0000","last_unstale":"2023-11-27T20:42:59.548020+0000","last_undegraded":"2023-11-27T20:42:59.548020+0000","last_fullsized":"2023-11-27T20:42:59.548020+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:13:37.585057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.568793+0000","last_change":"2023-11-27T20:42:59.565043+0000","last_active":"2023-11-27T20:43:00.568793+0000","last_peered":"2023-11-27T20:43:00.568793+0000","last_clean":"2023-11-27T20:43:00.568793+0000","last_became_active":"2023-11-27T20:42:59.564532+0000","last_became_peered":"2023-11-27T20:42:59.564532+0000","last_unstale":"2023-11-27T20:43:00.568793+0000","last_undegraded":"2023-11-27T20:43:00.568793+0000","last_fullsized":"2023-11-27T20:43:00.568793+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:25:47.547416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.570453+0000","last_change":"2023-11-27T20:42:38.545796+0000","last_active":"2023-11-27T20:42:59.570453+0000","last_peered":"2023-11-27T20:42:59.570453+0000","last_clean":"2023-11-27T20:42:59.570453+0000","last_became_active":"2023-11-27T20:42:38.545553+0000","last_became_peered":"2023-11-27T20:42:38.545553+0000","last_unstale":"2023-11-27T20:42:59.570453+0000","last_undegraded":"2023-11-27T20:42:59.570453+0000","last_fullsized":"2023-11-27T20:42:59.570453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:43.682169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455223+0000","last_change":"2023-11-27T20:42:59.585307+0000","last_active":"2023-11-27T20:43:01.455223+0000","last_peered":"2023-11-27T20:43:01.455223+0000","last_clean":"2023-11-27T20:43:01.455223+0000","last_became_active":"2023-11-27T20:42:59.585016+0000","last_became_peered":"2023-11-27T20:42:59.585016+0000","last_unstale":"2023-11-27T20:43:01.455223+0000","last_undegraded":"2023-11-27T20:43:01.455223+0000","last_fullsized":"2023-11-27T20:43:01.455223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:18.960274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.563070+0000","last_change":"2023-11-27T20:42:38.558320+0000","last_active":"2023-11-27T20:42:59.563070+0000","last_peered":"2023-11-27T20:42:59.563070+0000","last_clean":"2023-11-27T20:42:59.563070+0000","last_became_active":"2023-11-27T20:42:38.557951+0000","last_became_peered":"2023-11-27T20:42:38.557951+0000","last_unstale":"2023-11-27T20:42:59.563070+0000","last_undegraded":"2023-11-27T20:42:59.563070+0000","last_fullsized":"2023-11-27T20:42:59.563070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455554+0000","last_change":"2023-11-27T20:42:59.587801+0000","last_active":"2023-11-27T20:43:01.455554+0000","last_peered":"2023-11-27T20:43:01.455554+0000","last_clean":"2023-11-27T20:43:01.455554+0000","last_became_active":"2023-11-27T20:42:59.587494+0000","last_became_peered":"2023-11-27T20:42:59.587494+0000","last_unstale":"2023-11-27T20:43:01.455554+0000","last_undegraded":"2023-11-27T20:43:01.455554+0000","last_fullsized":"2023-11-27T20:43:01.455554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:11:45.424458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.576934+0000","last_change":"2023-11-27T20:42:38.547591+0000","last_active":"2023-11-27T20:42:59.576934+0000","last_peered":"2023-11-27T20:42:59.576934+0000","last_clean":"2023-11-27T20:42:59.576934+0000","last_became_active":"2023-11-27T20:42:38.547330+0000","last_became_peered":"2023-11-27T20:42:38.547330+0000","last_unstale":"2023-11-27T20:42:59.576934+0000","last_undegraded":"2023-11-27T20:42:59.576934+0000","last_fullsized":"2023-11-27T20:42:59.576934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.884868+0000","last_change":"2023-11-27T20:42:59.591758+0000","last_active":"2023-11-27T20:43:01.884868+0000","last_peered":"2023-11-27T20:43:01.884868+0000","last_clean":"2023-11-27T20:43:01.884868+0000","last_became_active":"2023-11-27T20:42:59.591408+0000","last_became_peered":"2023-11-27T20:42:59.591408+0000","last_unstale":"2023-11-27T20:43:01.884868+0000","last_undegraded":"2023-11-27T20:43:01.884868+0000","last_fullsized":"2023-11-27T20:43:01.884868+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:42.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.572041+0000","last_change":"2023-11-27T20:42:38.559990+0000","last_active":"2023-11-27T20:42:59.572041+0000","last_peered":"2023-11-27T20:42:59.572041+0000","last_clean":"2023-11-27T20:42:59.572041+0000","last_became_active":"2023-11-27T20:42:38.559736+0000","last_became_peered":"2023-11-27T20:42:38.559736+0000","last_unstale":"2023-11-27T20:42:59.572041+0000","last_undegraded":"2023-11-27T20:42:59.572041+0000","last_fullsized":"2023-11-27T20:42:59.572041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455469+0000","last_change":"2023-11-27T20:42:59.578734+0000","last_active":"2023-11-27T20:43:01.455469+0000","last_peered":"2023-11-27T20:43:01.455469+0000","last_clean":"2023-11-27T20:43:01.455469+0000","last_became_active":"2023-11-27T20:42:59.578385+0000","last_became_peered":"2023-11-27T20:42:59.578385+0000","last_unstale":"2023-11-27T20:43:01.455469+0000","last_undegraded":"2023-11-27T20:43:01.455469+0000","last_fullsized":"2023-11-27T20:43:01.455469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:16:45.037441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.559670+0000","last_change":"2023-11-27T20:42:38.538848+0000","last_active":"2023-11-27T20:42:59.559670+0000","last_peered":"2023-11-27T20:42:59.559670+0000","last_clean":"2023-11-27T20:42:59.559670+0000","last_became_active":"2023-11-27T20:42:38.538541+0000","last_became_peered":"2023-11-27T20:42:38.538541+0000","last_unstale":"2023-11-27T20:42:59.559670+0000","last_undegraded":"2023-11-27T20:42:59.559670+0000","last_fullsized":"2023-11-27T20:42:59.559670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.569289+0000","last_change":"2023-11-27T20:42:59.576289+0000","last_active":"2023-11-27T20:43:00.569289+0000","last_peered":"2023-11-27T20:43:00.569289+0000","last_clean":"2023-11-27T20:43:00.569289+0000","last_became_active":"2023-11-27T20:42:59.573829+0000","last_became_peered":"2023-11-27T20:42:59.573829+0000","last_unstale":"2023-11-27T20:43:00.569289+0000","last_undegraded":"2023-11-27T20:43:00.569289+0000","last_fullsized":"2023-11-27T20:43:00.569289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:01.990591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567521+0000","last_change":"2023-11-27T20:42:38.541486+0000","last_active":"2023-11-27T20:42:59.567521+0000","last_peered":"2023-11-27T20:42:59.567521+0000","last_clean":"2023-11-27T20:42:59.567521+0000","last_became_active":"2023-11-27T20:42:38.541126+0000","last_became_peered":"2023-11-27T20:42:38.541126+0000","last_unstale":"2023-11-27T20:42:59.567521+0000","last_undegraded":"2023-11-27T20:42:59.567521+0000","last_fullsized":"2023-11-27T20:42:59.567521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.884824+0000","last_change":"2023-11-27T20:42:59.574776+0000","last_active":"2023-11-27T20:43:01.884824+0000","last_peered":"2023-11-27T20:43:01.884824+0000","last_clean":"2023-11-27T20:43:01.884824+0000","last_became_active":"2023-11-27T20:42:59.574488+0000","last_became_peered":"2023-11-27T20:42:59.574488+0000","last_unstale":"2023-11-27T20:43:01.884824+0000","last_undegraded":"2023-11-27T20:43:01.884824+0000","last_fullsized":"2023-11-27T20:43:01.884824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:46.872709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.572692+0000","last_change":"2023-11-27T20:42:38.537531+0000","last_active":"2023-11-27T20:42:59.572692+0000","last_peered":"2023-11-27T20:42:59.572692+0000","last_clean":"2023-11-27T20:42:59.572692+0000","last_became_active":"2023-11-27T20:42:38.536923+0000","last_became_peered":"2023-11-27T20:42:38.536923+0000","last_unstale":"2023-11-27T20:42:59.572692+0000","last_undegraded":"2023-11-27T20:42:59.572692+0000","last_fullsized":"2023-11-27T20:42:59.572692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.453999+0000","last_change":"2023-11-27T20:42:59.572395+0000","last_active":"2023-11-27T20:43:01.453999+0000","last_peered":"2023-11-27T20:43:01.453999+0000","last_clean":"2023-11-27T20:43:01.453999+0000","last_became_active":"2023-11-27T20:42:59.571977+0000","last_became_peered":"2023-11-27T20:42:59.571977+0000","last_unstale":"2023-11-27T20:43:01.453999+0000","last_undegraded":"2023-11-27T20:43:01.453999+0000","last_fullsized":"2023-11-27T20:43:01.453999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:06.826970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.547816+0000","last_change":"2023-11-27T20:42:38.557750+0000","last_active":"2023-11-27T20:42:59.547816+0000","last_peered":"2023-11-27T20:42:59.547816+0000","last_clean":"2023-11-27T20:42:59.547816+0000","last_became_active":"2023-11-27T20:42:38.557513+0000","last_became_peered":"2023-11-27T20:42:38.557513+0000","last_unstale":"2023-11-27T20:42:59.547816+0000","last_undegraded":"2023-11-27T20:42:59.547816+0000","last_fullsized":"2023-11-27T20:42:59.547816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:00:16.000787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.574185+0000","last_change":"2023-11-27T20:42:59.592477+0000","last_active":"2023-11-27T20:43:00.574185+0000","last_peered":"2023-11-27T20:43:00.574185+0000","last_clean":"2023-11-27T20:43:00.574185+0000","last_became_active":"2023-11-27T20:42:59.592153+0000","last_became_peered":"2023-11-27T20:42:59.592153+0000","last_unstale":"2023-11-27T20:43:00.574185+0000","last_undegraded":"2023-11-27T20:43:00.574185+0000","last_fullsized":"2023-11-27T20:43:00.574185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:16:45.037441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.570370+0000","last_change":"2023-11-27T20:42:38.554226+0000","last_active":"2023-11-27T20:42:59.570370+0000","last_peered":"2023-11-27T20:42:59.570370+0000","last_clean":"2023-11-27T20:42:59.570370+0000","last_became_active":"2023-11-27T20:42:38.553902+0000","last_became_peered":"2023-11-27T20:42:38.553902+0000","last_unstale":"2023-11-27T20:42:59.570370+0000","last_undegraded":"2023-11-27T20:42:59.570370+0000","last_fullsized":"2023-11-27T20:42:59.570370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:27.699633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.886007+0000","last_change":"2023-11-27T20:42:59.574662+0000","last_active":"2023-11-27T20:43:01.886007+0000","last_peered":"2023-11-27T20:43:01.886007+0000","last_clean":"2023-11-27T20:43:01.886007+0000","last_became_active":"2023-11-27T20:42:59.574372+0000","last_became_peered":"2023-11-27T20:42:59.574372+0000","last_unstale":"2023-11-27T20:43:01.886007+0000","last_undegraded":"2023-11-27T20:43:01.886007+0000","last_fullsized":"2023-11-27T20:43:01.886007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:18.960274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566691+0000","last_change":"2023-11-27T20:42:38.558993+0000","last_active":"2023-11-27T20:42:59.566691+0000","last_peered":"2023-11-27T20:42:59.566691+0000","last_clean":"2023-11-27T20:42:59.566691+0000","last_became_active":"2023-11-27T20:42:38.558259+0000","last_became_peered":"2023-11-27T20:42:38.558259+0000","last_unstale":"2023-11-27T20:42:59.566691+0000","last_undegraded":"2023-11-27T20:42:59.566691+0000","last_fullsized":"2023-11-27T20:42:59.566691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.573435+0000","last_change":"2023-11-27T20:42:59.590501+0000","last_active":"2023-11-27T20:43:00.573435+0000","last_peered":"2023-11-27T20:43:00.573435+0000","last_clean":"2023-11-27T20:43:00.573435+0000","last_became_active":"2023-11-27T20:42:59.589985+0000","last_became_peered":"2023-11-27T20:42:59.589985+0000","last_unstale":"2023-11-27T20:43:00.573435+0000","last_undegraded":"2023-11-27T20:43:00.573435+0000","last_fullsized":"2023-11-27T20:43:00.573435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:18.960274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.563097+0000","last_change":"2023-11-27T20:42:38.558109+0000","last_active":"2023-11-27T20:42:59.563097+0000","last_peered":"2023-11-27T20:42:59.563097+0000","last_clean":"2023-11-27T20:42:59.563097+0000","last_became_active":"2023-11-27T20:42:38.557268+0000","last_became_peered":"2023-11-27T20:42:38.557268+0000","last_unstale":"2023-11-27T20:42:59.563097+0000","last_undegraded":"2023-11-27T20:42:59.563097+0000","last_fullsized":"2023-11-27T20:42:59.563097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454999+0000","last_change":"2023-11-27T20:42:59.578572+0000","last_active":"2023-11-27T20:43:01.454999+0000","last_peered":"2023-11-27T20:43:01.454999+0000","last_clean":"2023-11-27T20:43:01.454999+0000","last_became_active":"2023-11-27T20:42:59.578201+0000","last_became_peered":"2023-11-27T20:42:59.578201+0000","last_unstale":"2023-11-27T20:43:01.454999+0000","last_undegraded":"2023-11-27T20:43:01.454999+0000","last_fullsized":"2023-11-27T20:43:01.454999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:00.576412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.549026+0000","last_change":"2023-11-27T20:42:38.554526+0000","last_active":"2023-11-27T20:42:59.549026+0000","last_peered":"2023-11-27T20:42:59.549026+0000","last_clean":"2023-11-27T20:42:59.549026+0000","last_became_active":"2023-11-27T20:42:38.554180+0000","last_became_peered":"2023-11-27T20:42:38.554180+0000","last_unstale":"2023-11-27T20:42:59.549026+0000","last_undegraded":"2023-11-27T20:42:59.549026+0000","last_fullsized":"2023-11-27T20:42:59.549026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.886860+0000","last_change":"2023-11-27T20:42:59.590858+0000","last_active":"2023-11-27T20:43:01.886860+0000","last_peered":"2023-11-27T20:43:01.886860+0000","last_clean":"2023-11-27T20:43:01.886860+0000","last_became_active":"2023-11-27T20:42:59.590532+0000","last_became_peered":"2023-11-27T20:42:59.590532+0000","last_unstale":"2023-11-27T20:43:01.886860+0000","last_undegraded":"2023-11-27T20:43:01.886860+0000","last_fullsized":"2023-11-27T20:43:01.886860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:13.432814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553260+0000","last_change":"2023-11-27T20:42:38.539057+0000","last_active":"2023-11-27T20:42:59.553260+0000","last_peered":"2023-11-27T20:42:59.553260+0000","last_clean":"2023-11-27T20:42:59.553260+0000","last_became_active":"2023-11-27T20:42:38.536139+0000","last_became_peered":"2023-11-27T20:42:38.536139+0000","last_unstale":"2023-11-27T20:42:59.553260+0000","last_undegraded":"2023-11-27T20:42:59.553260+0000","last_fullsized":"2023-11-27T20:42:59.553260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":771070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.484},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.74}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.284},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.377}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.325},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.1559999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.6879999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.623}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.643}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.8200000000000001},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.5089999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":181810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.679},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.3260000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.93700000000000006}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.004}]},{"osd":3,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.1080000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":3.536,"5min":3.536,"15min":3.536},"last":1.625}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.7769999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.417}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":181264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.97699999999999998}]},{"osd":1,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1819999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.73},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.92200000000000004}]},{"osd":3,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":1.2250000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.8140000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2149999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.145},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.5600000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.871},{"interface":"front","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.337}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":182238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.89600000000000002}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.353},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.544}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.603}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.306},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.6579999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.3979999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.2549999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.448},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.484}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":184289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.75}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.90800000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.081},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.147}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.8050000000000002,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.004},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.4179999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.27},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.321}]},{"osd":6,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.044}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.115},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.722}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":182226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.70999999999999996}]},{"osd":1,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.93700000000000006},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.99099999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":1.071},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.89300000000000002}]},{"osd":6,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":1.512}]},{"osd":7,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.056},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.4570000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":183721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.71899999999999997}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.73799999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.77900000000000003}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.0700000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.024}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.272},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.0600000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.542}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":770924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.80200000000000005}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.88200000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.04},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.069}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.194}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.117}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.403}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.242},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.284}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:43:09.095 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:43:09.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.313+0000 7f3ff912c640 1 Processor -- start 2023-11-27T20:43:09.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.313+0000 7f3ff912c640 1 -- start start 2023-11-27T20:43:09.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.314+0000 7f3ff912c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ff406d0a0 0x7f3ff4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.314+0000 7f3ff912c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3ff40c3ea0 0x7f3ff40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.314+0000 7f3ff912c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff40c64a0 con 0x7f3ff414fd30 2023-11-27T20:43:09.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.314+0000 7f3ff912c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff40c5c00 con 0x7f3ff40c3ea0 2023-11-27T20:43:09.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.314+0000 7f3ff912c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40c5ee0 con 0x7f3ff406d0a0 2023-11-27T20:43:09.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.315+0000 7f3ff2d9d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f3ff414fd30 0x7f3ff40a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36174/0 (socket says 172.21.15.91:36174) 2023-11-27T20:43:09.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.315+0000 7f3ff2d9d640 1 -- 172.21.15.91:0/2623533423 learned_addr learned my addr 172.21.15.91:0/2623533423 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:09.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.315+0000 7f3ff359e640 1 --2- 172.21.15.91:0/2623533423 >> v2:172.21.15.91:3300/0 conn(0x7f3ff40c3ea0 0x7f3ff40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.315+0000 7f3ff259c640 1 -- 172.21.15.91:0/2623533423 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790966627 0 0) 0x7f3ff40c64a0 con 0x7f3ff414fd30 2023-11-27T20:43:09.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.315+0000 7f3ff359e640 1 -- 172.21.15.91:0/2623533423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ff406d0a0 msgr2=0x7f3ff4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:09.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.315+0000 7f3ff359e640 1 --2- 172.21.15.91:0/2623533423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ff406d0a0 0x7f3ff4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.315+0000 7f3ff359e640 1 -- 172.21.15.91:0/2623533423 >> v1:172.21.15.91:6789/0 conn(0x7f3ff414fd30 legacy=0x7f3ff40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.315+0000 7f3ff359e640 1 -- 172.21.15.91:0/2623533423 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff40c61c0 con 0x7f3ff40c3ea0 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.316+0000 7f3ff359e640 1 --2- 172.21.15.91:0/2623533423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff40c3ea0 0x7f3ff40c4330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009d90 tx=0x7f3fec02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279943a2dfea6063 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.316+0000 7f3ff259c640 1 -- 172.21.15.91:0/2623533423 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec02cc60 con 0x7f3ff40c3ea0 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.316+0000 7f3ff259c640 1 -- 172.21.15.91:0/2623533423 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec02cdc0 con 0x7f3ff40c3ea0 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.317+0000 7f3ff259c640 1 -- 172.21.15.91:0/2623533423 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec034660 con 0x7f3ff40c3ea0 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.317+0000 7f3ff912c640 1 -- 172.21.15.91:0/2623533423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff40c3ea0 msgr2=0x7f3ff40c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.317+0000 7f3ff912c640 1 --2- 172.21.15.91:0/2623533423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff40c3ea0 0x7f3ff40c4330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009d90 tx=0x7f3fec02beb0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.317+0000 7f3ff912c640 1 -- 172.21.15.91:0/2623533423 shutdown_connections 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.317+0000 7f3ff912c640 1 --2- 172.21.15.91:0/2623533423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff40c3ea0 0x7f3ff40c4330 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.317+0000 7f3ff912c640 1 --2- 172.21.15.91:0/2623533423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ff406d0a0 0x7f3ff4152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.317+0000 7f3ff912c640 1 -- 172.21.15.91:0/2623533423 >> 172.21.15.91:0/2623533423 conn(0x7f3ff406a500 msgr2=0x7f3ff406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:09.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.317+0000 7f3ff912c640 1 -- 172.21.15.91:0/2623533423 shutdown_connections 2023-11-27T20:43:09.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.317+0000 7f3ff912c640 1 -- 172.21.15.91:0/2623533423 wait complete. 2023-11-27T20:43:09.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.319+0000 7f3ff912c640 1 Processor -- start 2023-11-27T20:43:09.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.319+0000 7f3ff912c640 1 -- start start 2023-11-27T20:43:09.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.320+0000 7f3ff912c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff406d0a0 0x7f3ff41dbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.320+0000 7f3ff912c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ff40c3ea0 0x7f3ff41ea140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.320+0000 7f3ff912c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff414fd30 0x7f3ff41ea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.320+0000 7f3ff912c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff414f810 con 0x7f3ff406d0a0 2023-11-27T20:43:09.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.320+0000 7f3ff912c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff414f530 con 0x7f3ff414fd30 2023-11-27T20:43:09.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.320+0000 7f3ff912c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff41ed850 con 0x7f3ff40c3ea0 2023-11-27T20:43:09.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff2d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff406d0a0 0x7f3ff41dbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff2d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff406d0a0 0x7f3ff41dbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52336/0 (socket says 172.21.15.91:52336) 2023-11-27T20:43:09.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff2d9d640 1 -- 172.21.15.91:0/136783663 learned_addr learned my addr 172.21.15.91:0/136783663 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:09.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3febfff640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ff40c3ea0 0x7f3ff41ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff359e640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff414fd30 0x7f3ff41ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff2d9d640 1 -- 172.21.15.91:0/136783663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ff40c3ea0 msgr2=0x7f3ff41ea140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:09.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff2d9d640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ff40c3ea0 0x7f3ff41ea140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff2d9d640 1 -- 172.21.15.91:0/136783663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff414fd30 msgr2=0x7f3ff41ea680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:09.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff2d9d640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff414fd30 0x7f3ff41ea680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff2d9d640 1 -- 172.21.15.91:0/136783663 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec009a70 con 0x7f3ff406d0a0 2023-11-27T20:43:09.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3febfff640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ff40c3ea0 0x7f3ff41ea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:09.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff359e640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff414fd30 0x7f3ff41ea680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:09.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.321+0000 7f3ff2d9d640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff406d0a0 0x7f3ff41dbd40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c4d0 tx=0x7f3fe400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:09.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.322+0000 7f3feb7fe640 1 -- 172.21.15.91:0/136783663 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40074e0 con 0x7f3ff406d0a0 2023-11-27T20:43:09.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.322+0000 7f3feb7fe640 1 -- 172.21.15.91:0/136783663 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe4007660 con 0x7f3ff406d0a0 2023-11-27T20:43:09.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.322+0000 7f3feb7fe640 1 -- 172.21.15.91:0/136783663 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4004a20 con 0x7f3ff406d0a0 2023-11-27T20:43:09.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.322+0000 7f3ff912c640 1 -- 172.21.15.91:0/136783663 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff41edb30 con 0x7f3ff406d0a0 2023-11-27T20:43:09.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.322+0000 7f3ff912c640 1 -- 172.21.15.91:0/136783663 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff41dc280 con 0x7f3ff406d0a0 2023-11-27T20:43:09.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.323+0000 7f3ff912c640 1 -- 172.21.15.91:0/136783663 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff41ed6b0 con 0x7f3ff406d0a0 2023-11-27T20:43:09.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.324+0000 7f3feb7fe640 1 -- 172.21.15.91:0/136783663 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3fe4004b80 con 0x7f3ff406d0a0 2023-11-27T20:43:09.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.325+0000 7f3feb7fe640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3fd406b1c0 0x7f3fd406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.325+0000 7f3feb7fe640 1 -- 172.21.15.91:0/136783663 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3fe4088f20 con 0x7f3ff406d0a0 2023-11-27T20:43:09.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.326+0000 7f3febfff640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3fd406b1c0 0x7f3fd406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.326+0000 7f3febfff640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3fd406b1c0 0x7f3fd406d680 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40a8c50 tx=0x7f3fdc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:09.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.330+0000 7f3feb7fe640 1 -- 172.21.15.91:0/136783663 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3ff41ed6b0 con 0x7f3ff406d0a0 2023-11-27T20:43:09.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.519+0000 7f3ff912c640 1 -- 172.21.15.91:0/136783663 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ff4072980 con 0x7f3fd406b1c0 2023-11-27T20:43:09.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.560+0000 7f3feb7fe640 1 -- 172.21.15.91:0/136783663 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525144 (secure 0 0 0) 0x7f3fdc00ae70 con 0x7f3fd406b1c0 2023-11-27T20:43:09.569 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:09.573 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:43:09.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 -- 172.21.15.91:0/136783663 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3fd406b1c0 msgr2=0x7f3fd406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:09.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3fd406b1c0 0x7f3fd406d680 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40a8c50 tx=0x7f3fdc008040 comp rx=0 tx=0).stop 2023-11-27T20:43:09.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 -- 172.21.15.91:0/136783663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff406d0a0 msgr2=0x7f3ff41dbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:09.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff406d0a0 0x7f3ff41dbd40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c4d0 tx=0x7f3fe400c990 comp rx=0 tx=0).stop 2023-11-27T20:43:09.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 -- 172.21.15.91:0/136783663 shutdown_connections 2023-11-27T20:43:09.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3fd406b1c0 0x7f3fd406d680 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ff414fd30 0x7f3ff41ea680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ff40c3ea0 0x7f3ff41ea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 --2- 172.21.15.91:0/136783663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff406d0a0 0x7f3ff41dbd40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 -- 172.21.15.91:0/136783663 >> 172.21.15.91:0/136783663 conn(0x7f3ff406a500 msgr2=0x7f3ff40c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:09.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 -- 172.21.15.91:0/136783663 shutdown_connections 2023-11-27T20:43:09.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.571+0000 7f3ff912c640 1 -- 172.21.15.91:0/136783663 wait complete. 2023-11-27T20:43:09.593 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-11-27T20:43:09.402671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220860,"kb_used_data":4680,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753860,"statfs":{"total":773094113280,"available":772867952640,"internally_reserved":0,"allocated":4792320,"data_stored":2637542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.862916"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455837+0000","last_change":"2023-11-27T20:42:59.580901+0000","last_active":"2023-11-27T20:43:01.455837+0000","last_peered":"2023-11-27T20:43:01.455837+0000","last_clean":"2023-11-27T20:43:01.455837+0000","last_became_active":"2023-11-27T20:42:59.580526+0000","last_became_peered":"2023-11-27T20:42:59.580526+0000","last_unstale":"2023-11-27T20:43:01.455837+0000","last_undegraded":"2023-11-27T20:43:01.455837+0000","last_fullsized":"2023-11-27T20:43:01.455837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:09:18.085066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.568189+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:42:59.568189+0000","last_peered":"2023-11-27T20:42:59.568189+0000","last_clean":"2023-11-27T20:42:59.568189+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:42:59.568189+0000","last_undegraded":"2023-11-27T20:42:59.568189+0000","last_fullsized":"2023-11-27T20:42:59.568189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.556053+0000","last_change":"2023-11-27T20:42:37.523367+0000","last_active":"2023-11-27T20:42:59.556053+0000","last_peered":"2023-11-27T20:42:59.556053+0000","last_clean":"2023-11-27T20:42:59.556053+0000","last_became_active":"2023-11-27T20:42:37.522948+0000","last_became_peered":"2023-11-27T20:42:37.522948+0000","last_unstale":"2023-11-27T20:42:59.556053+0000","last_undegraded":"2023-11-27T20:42:59.556053+0000","last_fullsized":"2023-11-27T20:42:59.556053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.577029+0000","last_change":"2023-11-27T20:42:38.542611+0000","last_active":"2023-11-27T20:42:59.577029+0000","last_peered":"2023-11-27T20:42:59.577029+0000","last_clean":"2023-11-27T20:42:59.577029+0000","last_became_active":"2023-11-27T20:42:38.542177+0000","last_became_peered":"2023-11-27T20:42:38.542177+0000","last_unstale":"2023-11-27T20:42:59.577029+0000","last_undegraded":"2023-11-27T20:42:59.577029+0000","last_fullsized":"2023-11-27T20:42:59.577029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.602468+0000","last_change":"2023-11-27T20:42:58.541430+0000","last_active":"2023-11-27T20:42:59.602468+0000","last_peered":"2023-11-27T20:42:59.602468+0000","last_clean":"2023-11-27T20:42:59.602468+0000","last_became_active":"2023-11-27T20:42:58.541116+0000","last_became_peered":"2023-11-27T20:42:58.541116+0000","last_unstale":"2023-11-27T20:42:59.602468+0000","last_undegraded":"2023-11-27T20:42:59.602468+0000","last_fullsized":"2023-11-27T20:42:59.602468+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:06.695281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.569836+0000","last_change":"2023-11-27T20:42:59.594647+0000","last_active":"2023-11-27T20:43:00.569836+0000","last_peered":"2023-11-27T20:43:00.569836+0000","last_clean":"2023-11-27T20:43:00.569836+0000","last_became_active":"2023-11-27T20:42:59.594260+0000","last_became_peered":"2023-11-27T20:42:59.594260+0000","last_unstale":"2023-11-27T20:43:00.569836+0000","last_undegraded":"2023-11-27T20:43:00.569836+0000","last_fullsized":"2023-11-27T20:43:00.569836+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:28.415270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.544446+0000","last_change":"2023-11-27T20:42:37.533800+0000","last_active":"2023-11-27T20:42:59.544446+0000","last_peered":"2023-11-27T20:42:59.544446+0000","last_clean":"2023-11-27T20:42:59.544446+0000","last_became_active":"2023-11-27T20:42:37.533358+0000","last_became_peered":"2023-11-27T20:42:37.533358+0000","last_unstale":"2023-11-27T20:42:59.544446+0000","last_undegraded":"2023-11-27T20:42:59.544446+0000","last_fullsized":"2023-11-27T20:42:59.544446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553861+0000","last_change":"2023-11-27T20:42:38.544391+0000","last_active":"2023-11-27T20:42:59.553861+0000","last_peered":"2023-11-27T20:42:59.553861+0000","last_clean":"2023-11-27T20:42:59.553861+0000","last_became_active":"2023-11-27T20:42:38.544114+0000","last_became_peered":"2023-11-27T20:42:38.544114+0000","last_unstale":"2023-11-27T20:42:59.553861+0000","last_undegraded":"2023-11-27T20:42:59.553861+0000","last_fullsized":"2023-11-27T20:42:59.553861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.555995+0000","last_change":"2023-11-27T20:42:58.543953+0000","last_active":"2023-11-27T20:42:59.555995+0000","last_peered":"2023-11-27T20:42:59.555995+0000","last_clean":"2023-11-27T20:42:59.555995+0000","last_became_active":"2023-11-27T20:42:58.543662+0000","last_became_peered":"2023-11-27T20:42:58.543662+0000","last_unstale":"2023-11-27T20:42:59.555995+0000","last_undegraded":"2023-11-27T20:42:59.555995+0000","last_fullsized":"2023-11-27T20:42:59.555995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:03.416152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.569427+0000","last_change":"2023-11-27T20:42:59.578126+0000","last_active":"2023-11-27T20:43:00.569427+0000","last_peered":"2023-11-27T20:43:00.569427+0000","last_clean":"2023-11-27T20:43:00.569427+0000","last_became_active":"2023-11-27T20:42:59.573214+0000","last_became_peered":"2023-11-27T20:42:59.573214+0000","last_unstale":"2023-11-27T20:43:00.569427+0000","last_undegraded":"2023-11-27T20:43:00.569427+0000","last_fullsized":"2023-11-27T20:43:00.569427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:12:43.706994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.554286+0000","last_change":"2023-11-27T20:42:37.530919+0000","last_active":"2023-11-27T20:42:59.554286+0000","last_peered":"2023-11-27T20:42:59.554286+0000","last_clean":"2023-11-27T20:42:59.554286+0000","last_became_active":"2023-11-27T20:42:37.530606+0000","last_became_peered":"2023-11-27T20:42:37.530606+0000","last_unstale":"2023-11-27T20:42:59.554286+0000","last_undegraded":"2023-11-27T20:42:59.554286+0000","last_fullsized":"2023-11-27T20:42:59.554286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:26.686814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.544204+0000","last_change":"2023-11-27T20:42:38.556454+0000","last_active":"2023-11-27T20:42:59.544204+0000","last_peered":"2023-11-27T20:42:59.544204+0000","last_clean":"2023-11-27T20:42:59.544204+0000","last_became_active":"2023-11-27T20:42:38.556194+0000","last_became_peered":"2023-11-27T20:42:38.556194+0000","last_unstale":"2023-11-27T20:42:59.544204+0000","last_undegraded":"2023-11-27T20:42:59.544204+0000","last_fullsized":"2023-11-27T20:42:59.544204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.578631+0000","last_change":"2023-11-27T20:42:58.555231+0000","last_active":"2023-11-27T20:42:59.578631+0000","last_peered":"2023-11-27T20:42:59.578631+0000","last_clean":"2023-11-27T20:42:59.578631+0000","last_became_active":"2023-11-27T20:42:58.554605+0000","last_became_peered":"2023-11-27T20:42:58.554605+0000","last_unstale":"2023-11-27T20:42:59.578631+0000","last_undegraded":"2023-11-27T20:42:59.578631+0000","last_fullsized":"2023-11-27T20:42:59.578631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:53.950911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.884667+0000","last_change":"2023-11-27T20:42:59.568125+0000","last_active":"2023-11-27T20:43:01.884667+0000","last_peered":"2023-11-27T20:43:01.884667+0000","last_clean":"2023-11-27T20:43:01.884667+0000","last_became_active":"2023-11-27T20:42:59.564117+0000","last_became_peered":"2023-11-27T20:42:59.564117+0000","last_unstale":"2023-11-27T20:43:01.884667+0000","last_undegraded":"2023-11-27T20:43:01.884667+0000","last_fullsized":"2023-11-27T20:43:01.884667+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:19:25.259856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566492+0000","last_change":"2023-11-27T20:42:37.529807+0000","last_active":"2023-11-27T20:42:59.566492+0000","last_peered":"2023-11-27T20:42:59.566492+0000","last_clean":"2023-11-27T20:42:59.566492+0000","last_became_active":"2023-11-27T20:42:37.529543+0000","last_became_peered":"2023-11-27T20:42:37.529543+0000","last_unstale":"2023-11-27T20:42:59.566492+0000","last_undegraded":"2023-11-27T20:42:59.566492+0000","last_fullsized":"2023-11-27T20:42:59.566492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.560712+0000","last_change":"2023-11-27T20:42:38.531762+0000","last_active":"2023-11-27T20:42:59.560712+0000","last_peered":"2023-11-27T20:42:59.560712+0000","last_clean":"2023-11-27T20:42:59.560712+0000","last_became_active":"2023-11-27T20:42:38.531490+0000","last_became_peered":"2023-11-27T20:42:38.531490+0000","last_unstale":"2023-11-27T20:42:59.560712+0000","last_undegraded":"2023-11-27T20:42:59.560712+0000","last_fullsized":"2023-11-27T20:42:59.560712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.559357+0000","last_change":"2023-11-27T20:42:58.543334+0000","last_active":"2023-11-27T20:42:59.559357+0000","last_peered":"2023-11-27T20:42:59.559357+0000","last_clean":"2023-11-27T20:42:59.559357+0000","last_became_active":"2023-11-27T20:42:58.543031+0000","last_became_peered":"2023-11-27T20:42:58.543031+0000","last_unstale":"2023-11-27T20:42:59.559357+0000","last_undegraded":"2023-11-27T20:42:59.559357+0000","last_fullsized":"2023-11-27T20:42:59.559357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:51:13.680792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.883615+0000","last_change":"2023-11-27T20:42:59.573392+0000","last_active":"2023-11-27T20:43:01.883615+0000","last_peered":"2023-11-27T20:43:01.883615+0000","last_clean":"2023-11-27T20:43:01.883615+0000","last_became_active":"2023-11-27T20:42:59.572769+0000","last_became_peered":"2023-11-27T20:42:59.572769+0000","last_unstale":"2023-11-27T20:43:01.883615+0000","last_undegraded":"2023-11-27T20:43:01.883615+0000","last_fullsized":"2023-11-27T20:43:01.883615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:06.826970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.561737+0000","last_change":"2023-11-27T20:42:37.532441+0000","last_active":"2023-11-27T20:42:59.561737+0000","last_peered":"2023-11-27T20:42:59.561737+0000","last_clean":"2023-11-27T20:42:59.561737+0000","last_became_active":"2023-11-27T20:42:37.532074+0000","last_became_peered":"2023-11-27T20:42:37.532074+0000","last_unstale":"2023-11-27T20:42:59.561737+0000","last_undegraded":"2023-11-27T20:42:59.561737+0000","last_fullsized":"2023-11-27T20:42:59.561737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:04.889609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.555856+0000","last_change":"2023-11-27T20:42:38.533430+0000","last_active":"2023-11-27T20:42:59.555856+0000","last_peered":"2023-11-27T20:42:59.555856+0000","last_clean":"2023-11-27T20:42:59.555856+0000","last_became_active":"2023-11-27T20:42:38.532325+0000","last_became_peered":"2023-11-27T20:42:38.532325+0000","last_unstale":"2023-11-27T20:42:59.555856+0000","last_undegraded":"2023-11-27T20:42:59.555856+0000","last_fullsized":"2023-11-27T20:42:59.555856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:14.543001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.565629+0000","last_change":"2023-11-27T20:42:58.551426+0000","last_active":"2023-11-27T20:42:59.565629+0000","last_peered":"2023-11-27T20:42:59.565629+0000","last_clean":"2023-11-27T20:42:59.565629+0000","last_became_active":"2023-11-27T20:42:58.551205+0000","last_became_peered":"2023-11-27T20:42:58.551205+0000","last_unstale":"2023-11-27T20:42:59.565629+0000","last_undegraded":"2023-11-27T20:42:59.565629+0000","last_fullsized":"2023-11-27T20:42:59.565629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:41.395422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.576334+0000","last_change":"2023-11-27T20:42:59.579679+0000","last_active":"2023-11-27T20:43:00.576334+0000","last_peered":"2023-11-27T20:43:00.576334+0000","last_clean":"2023-11-27T20:43:00.576334+0000","last_became_active":"2023-11-27T20:42:59.579403+0000","last_became_peered":"2023-11-27T20:42:59.579403+0000","last_unstale":"2023-11-27T20:43:00.576334+0000","last_undegraded":"2023-11-27T20:43:00.576334+0000","last_fullsized":"2023-11-27T20:43:00.576334+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:30.630781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567405+0000","last_change":"2023-11-27T20:42:37.527056+0000","last_active":"2023-11-27T20:42:59.567405+0000","last_peered":"2023-11-27T20:42:59.567405+0000","last_clean":"2023-11-27T20:42:59.567405+0000","last_became_active":"2023-11-27T20:42:37.526803+0000","last_became_peered":"2023-11-27T20:42:37.526803+0000","last_unstale":"2023-11-27T20:42:59.567405+0000","last_undegraded":"2023-11-27T20:42:59.567405+0000","last_fullsized":"2023-11-27T20:42:59.567405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:29.886664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.563347+0000","last_change":"2023-11-27T20:42:38.536715+0000","last_active":"2023-11-27T20:42:59.563347+0000","last_peered":"2023-11-27T20:42:59.563347+0000","last_clean":"2023-11-27T20:42:59.563347+0000","last_became_active":"2023-11-27T20:42:38.536349+0000","last_became_peered":"2023-11-27T20:42:38.536349+0000","last_unstale":"2023-11-27T20:42:59.563347+0000","last_undegraded":"2023-11-27T20:42:59.563347+0000","last_fullsized":"2023-11-27T20:42:59.563347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.570749+0000","last_change":"2023-11-27T20:42:58.547626+0000","last_active":"2023-11-27T20:43:00.570749+0000","last_peered":"2023-11-27T20:43:00.570749+0000","last_clean":"2023-11-27T20:43:00.570749+0000","last_became_active":"2023-11-27T20:42:58.546759+0000","last_became_peered":"2023-11-27T20:42:58.546759+0000","last_unstale":"2023-11-27T20:43:00.570749+0000","last_undegraded":"2023-11-27T20:43:00.570749+0000","last_fullsized":"2023-11-27T20:43:00.570749+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:11:44.411353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.573154+0000","last_change":"2023-11-27T20:42:59.603257+0000","last_active":"2023-11-27T20:43:00.573154+0000","last_peered":"2023-11-27T20:43:00.573154+0000","last_clean":"2023-11-27T20:43:00.573154+0000","last_became_active":"2023-11-27T20:42:59.603033+0000","last_became_peered":"2023-11-27T20:42:59.603033+0000","last_unstale":"2023-11-27T20:43:00.573154+0000","last_undegraded":"2023-11-27T20:43:00.573154+0000","last_fullsized":"2023-11-27T20:43:00.573154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:00.576412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567136+0000","last_change":"2023-11-27T20:42:37.528142+0000","last_active":"2023-11-27T20:42:59.567136+0000","last_peered":"2023-11-27T20:42:59.567136+0000","last_clean":"2023-11-27T20:42:59.567136+0000","last_became_active":"2023-11-27T20:42:37.527318+0000","last_became_peered":"2023-11-27T20:42:37.527318+0000","last_unstale":"2023-11-27T20:42:59.567136+0000","last_undegraded":"2023-11-27T20:42:59.567136+0000","last_fullsized":"2023-11-27T20:42:59.567136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566620+0000","last_change":"2023-11-27T20:42:38.553617+0000","last_active":"2023-11-27T20:42:59.566620+0000","last_peered":"2023-11-27T20:42:59.566620+0000","last_clean":"2023-11-27T20:42:59.566620+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:59.566620+0000","last_undegraded":"2023-11-27T20:42:59.566620+0000","last_fullsized":"2023-11-27T20:42:59.566620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566607+0000","last_change":"2023-11-27T20:42:58.542324+0000","last_active":"2023-11-27T20:42:59.566607+0000","last_peered":"2023-11-27T20:42:59.566607+0000","last_clean":"2023-11-27T20:42:59.566607+0000","last_became_active":"2023-11-27T20:42:58.541734+0000","last_became_peered":"2023-11-27T20:42:58.541734+0000","last_unstale":"2023-11-27T20:42:59.566607+0000","last_undegraded":"2023-11-27T20:42:59.566607+0000","last_fullsized":"2023-11-27T20:42:59.566607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:29:53.649476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454849+0000","last_change":"2023-11-27T20:42:59.578936+0000","last_active":"2023-11-27T20:43:01.454849+0000","last_peered":"2023-11-27T20:43:01.454849+0000","last_clean":"2023-11-27T20:43:01.454849+0000","last_became_active":"2023-11-27T20:42:59.578216+0000","last_became_peered":"2023-11-27T20:42:59.578216+0000","last_unstale":"2023-11-27T20:43:01.454849+0000","last_undegraded":"2023-11-27T20:43:01.454849+0000","last_fullsized":"2023-11-27T20:43:01.454849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:07:17.690802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.575802+0000","last_change":"2023-11-27T20:42:37.530114+0000","last_active":"2023-11-27T20:42:59.575802+0000","last_peered":"2023-11-27T20:42:59.575802+0000","last_clean":"2023-11-27T20:42:59.575802+0000","last_became_active":"2023-11-27T20:42:37.529838+0000","last_became_peered":"2023-11-27T20:42:37.529838+0000","last_unstale":"2023-11-27T20:42:59.575802+0000","last_undegraded":"2023-11-27T20:42:59.575802+0000","last_fullsized":"2023-11-27T20:42:59.575802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.574297+0000","last_change":"2023-11-27T20:42:38.551126+0000","last_active":"2023-11-27T20:42:59.574297+0000","last_peered":"2023-11-27T20:42:59.574297+0000","last_clean":"2023-11-27T20:42:59.574297+0000","last_became_active":"2023-11-27T20:42:38.550881+0000","last_became_peered":"2023-11-27T20:42:38.550881+0000","last_unstale":"2023-11-27T20:42:59.574297+0000","last_undegraded":"2023-11-27T20:42:59.574297+0000","last_fullsized":"2023-11-27T20:42:59.574297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:08.745845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.576839+0000","last_change":"2023-11-27T20:42:58.555003+0000","last_active":"2023-11-27T20:42:59.576839+0000","last_peered":"2023-11-27T20:42:59.576839+0000","last_clean":"2023-11-27T20:42:59.576839+0000","last_became_active":"2023-11-27T20:42:58.554708+0000","last_became_peered":"2023-11-27T20:42:58.554708+0000","last_unstale":"2023-11-27T20:42:59.576839+0000","last_undegraded":"2023-11-27T20:42:59.576839+0000","last_fullsized":"2023-11-27T20:42:59.576839+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:05.813865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.931186+0000","last_change":"2023-11-27T20:42:59.572562+0000","last_active":"2023-11-27T20:43:00.931186+0000","last_peered":"2023-11-27T20:43:00.931186+0000","last_clean":"2023-11-27T20:43:00.931186+0000","last_became_active":"2023-11-27T20:42:59.572191+0000","last_became_peered":"2023-11-27T20:42:59.572191+0000","last_unstale":"2023-11-27T20:43:00.931186+0000","last_undegraded":"2023-11-27T20:43:00.931186+0000","last_fullsized":"2023-11-27T20:43:00.931186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:56.843133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562172+0000","last_change":"2023-11-27T20:42:37.532212+0000","last_active":"2023-11-27T20:42:59.562172+0000","last_peered":"2023-11-27T20:42:59.562172+0000","last_clean":"2023-11-27T20:42:59.562172+0000","last_became_active":"2023-11-27T20:42:37.531894+0000","last_became_peered":"2023-11-27T20:42:37.531894+0000","last_unstale":"2023-11-27T20:42:59.562172+0000","last_undegraded":"2023-11-27T20:42:59.562172+0000","last_fullsized":"2023-11-27T20:42:59.562172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:09.260652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.572447+0000","last_change":"2023-11-27T20:42:38.537364+0000","last_active":"2023-11-27T20:42:59.572447+0000","last_peered":"2023-11-27T20:42:59.572447+0000","last_clean":"2023-11-27T20:42:59.572447+0000","last_became_active":"2023-11-27T20:42:38.536521+0000","last_became_peered":"2023-11-27T20:42:38.536521+0000","last_unstale":"2023-11-27T20:42:59.572447+0000","last_undegraded":"2023-11-27T20:42:59.572447+0000","last_fullsized":"2023-11-27T20:42:59.572447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562451+0000","last_change":"2023-11-27T20:42:58.554754+0000","last_active":"2023-11-27T20:42:59.562451+0000","last_peered":"2023-11-27T20:42:59.562451+0000","last_clean":"2023-11-27T20:42:59.562451+0000","last_became_active":"2023-11-27T20:42:58.554203+0000","last_became_peered":"2023-11-27T20:42:58.554203+0000","last_unstale":"2023-11-27T20:42:59.562451+0000","last_undegraded":"2023-11-27T20:42:59.562451+0000","last_fullsized":"2023-11-27T20:42:59.562451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:41.289648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.569524+0000","last_change":"2023-11-27T20:42:59.603018+0000","last_active":"2023-11-27T20:43:00.569524+0000","last_peered":"2023-11-27T20:43:00.569524+0000","last_clean":"2023-11-27T20:43:00.569524+0000","last_became_active":"2023-11-27T20:42:59.602737+0000","last_became_peered":"2023-11-27T20:42:59.602737+0000","last_unstale":"2023-11-27T20:43:00.569524+0000","last_undegraded":"2023-11-27T20:43:00.569524+0000","last_fullsized":"2023-11-27T20:43:00.569524+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:49.518639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.554081+0000","last_change":"2023-11-27T20:42:37.518579+0000","last_active":"2023-11-27T20:42:59.554081+0000","last_peered":"2023-11-27T20:42:59.554081+0000","last_clean":"2023-11-27T20:42:59.554081+0000","last_became_active":"2023-11-27T20:42:37.517970+0000","last_became_peered":"2023-11-27T20:42:37.517970+0000","last_unstale":"2023-11-27T20:42:59.554081+0000","last_undegraded":"2023-11-27T20:42:59.554081+0000","last_fullsized":"2023-11-27T20:42:59.554081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:30.526979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.572381+0000","last_change":"2023-11-27T20:42:38.539525+0000","last_active":"2023-11-27T20:42:59.572381+0000","last_peered":"2023-11-27T20:42:59.572381+0000","last_clean":"2023-11-27T20:42:59.572381+0000","last_became_active":"2023-11-27T20:42:38.539244+0000","last_became_peered":"2023-11-27T20:42:38.539244+0000","last_unstale":"2023-11-27T20:42:59.572381+0000","last_undegraded":"2023-11-27T20:42:59.572381+0000","last_fullsized":"2023-11-27T20:42:59.572381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:12:08.243011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.605387+0000","last_change":"2023-11-27T20:42:58.543574+0000","last_active":"2023-11-27T20:42:59.605387+0000","last_peered":"2023-11-27T20:42:59.605387+0000","last_clean":"2023-11-27T20:42:59.605387+0000","last_became_active":"2023-11-27T20:42:58.542244+0000","last_became_peered":"2023-11-27T20:42:58.542244+0000","last_unstale":"2023-11-27T20:42:59.605387+0000","last_undegraded":"2023-11-27T20:42:59.605387+0000","last_fullsized":"2023-11-27T20:42:59.605387+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:17.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454014+0000","last_change":"2023-11-27T20:42:59.575986+0000","last_active":"2023-11-27T20:43:01.454014+0000","last_peered":"2023-11-27T20:43:01.454014+0000","last_clean":"2023-11-27T20:43:01.454014+0000","last_became_active":"2023-11-27T20:42:59.573715+0000","last_became_peered":"2023-11-27T20:42:59.573715+0000","last_unstale":"2023-11-27T20:43:01.454014+0000","last_undegraded":"2023-11-27T20:43:01.454014+0000","last_fullsized":"2023-11-27T20:43:01.454014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:54.964017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.555559+0000","last_change":"2023-11-27T20:42:37.522543+0000","last_active":"2023-11-27T20:42:59.555559+0000","last_peered":"2023-11-27T20:42:59.555559+0000","last_clean":"2023-11-27T20:42:59.555559+0000","last_became_active":"2023-11-27T20:42:37.522163+0000","last_became_peered":"2023-11-27T20:42:37.522163+0000","last_unstale":"2023-11-27T20:42:59.555559+0000","last_undegraded":"2023-11-27T20:42:59.555559+0000","last_fullsized":"2023-11-27T20:42:59.555559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:55:46.239563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.570534+0000","last_change":"2023-11-27T20:42:38.536322+0000","last_active":"2023-11-27T20:42:59.570534+0000","last_peered":"2023-11-27T20:42:59.570534+0000","last_clean":"2023-11-27T20:42:59.570534+0000","last_became_active":"2023-11-27T20:42:38.536051+0000","last_became_peered":"2023-11-27T20:42:38.536051+0000","last_unstale":"2023-11-27T20:42:59.570534+0000","last_undegraded":"2023-11-27T20:42:59.570534+0000","last_fullsized":"2023-11-27T20:42:59.570534+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:31.539798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.568006+0000","last_change":"2023-11-27T20:42:58.539589+0000","last_active":"2023-11-27T20:42:59.568006+0000","last_peered":"2023-11-27T20:42:59.568006+0000","last_clean":"2023-11-27T20:42:59.568006+0000","last_became_active":"2023-11-27T20:42:58.539291+0000","last_became_peered":"2023-11-27T20:42:58.539291+0000","last_unstale":"2023-11-27T20:42:59.568006+0000","last_undegraded":"2023-11-27T20:42:59.568006+0000","last_fullsized":"2023-11-27T20:42:59.568006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:52.733989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.724330+0000","last_change":"2023-11-27T20:42:59.577354+0000","last_active":"2023-11-27T20:43:01.724330+0000","last_peered":"2023-11-27T20:43:01.724330+0000","last_clean":"2023-11-27T20:43:01.724330+0000","last_became_active":"2023-11-27T20:42:59.572712+0000","last_became_peered":"2023-11-27T20:42:59.572712+0000","last_unstale":"2023-11-27T20:43:01.724330+0000","last_undegraded":"2023-11-27T20:43:01.724330+0000","last_fullsized":"2023-11-27T20:43:01.724330+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:33.504653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.561181+0000","last_change":"2023-11-27T20:42:37.527591+0000","last_active":"2023-11-27T20:42:59.561181+0000","last_peered":"2023-11-27T20:42:59.561181+0000","last_clean":"2023-11-27T20:42:59.561181+0000","last_became_active":"2023-11-27T20:42:37.527305+0000","last_became_peered":"2023-11-27T20:42:37.527305+0000","last_unstale":"2023-11-27T20:42:59.561181+0000","last_undegraded":"2023-11-27T20:42:59.561181+0000","last_fullsized":"2023-11-27T20:42:59.561181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.580441+0000","last_change":"2023-11-27T20:42:38.547894+0000","last_active":"2023-11-27T20:42:59.580441+0000","last_peered":"2023-11-27T20:42:59.580441+0000","last_clean":"2023-11-27T20:42:59.580441+0000","last_became_active":"2023-11-27T20:42:38.547558+0000","last_became_peered":"2023-11-27T20:42:38.547558+0000","last_unstale":"2023-11-27T20:42:59.580441+0000","last_undegraded":"2023-11-27T20:42:59.580441+0000","last_fullsized":"2023-11-27T20:42:59.580441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:38.201738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.560265+0000","last_change":"2023-11-27T20:42:58.543955+0000","last_active":"2023-11-27T20:42:59.560265+0000","last_peered":"2023-11-27T20:42:59.560265+0000","last_clean":"2023-11-27T20:42:59.560265+0000","last_became_active":"2023-11-27T20:42:58.543674+0000","last_became_peered":"2023-11-27T20:42:58.543674+0000","last_unstale":"2023-11-27T20:42:59.560265+0000","last_undegraded":"2023-11-27T20:42:59.560265+0000","last_fullsized":"2023-11-27T20:42:59.560265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:55.830027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455646+0000","last_change":"2023-11-27T20:42:59.576738+0000","last_active":"2023-11-27T20:43:01.455646+0000","last_peered":"2023-11-27T20:43:01.455646+0000","last_clean":"2023-11-27T20:43:01.455646+0000","last_became_active":"2023-11-27T20:42:59.576408+0000","last_became_peered":"2023-11-27T20:42:59.576408+0000","last_unstale":"2023-11-27T20:43:01.455646+0000","last_undegraded":"2023-11-27T20:43:01.455646+0000","last_fullsized":"2023-11-27T20:43:01.455646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:54:47.448084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.551931+0000","last_change":"2023-11-27T20:42:37.527131+0000","last_active":"2023-11-27T20:42:59.551931+0000","last_peered":"2023-11-27T20:42:59.551931+0000","last_clean":"2023-11-27T20:42:59.551931+0000","last_became_active":"2023-11-27T20:42:37.526804+0000","last_became_peered":"2023-11-27T20:42:37.526804+0000","last_unstale":"2023-11-27T20:42:59.551931+0000","last_undegraded":"2023-11-27T20:42:59.551931+0000","last_fullsized":"2023-11-27T20:42:59.551931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:21:07.733026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573070+0000","last_change":"2023-11-27T20:42:38.549244+0000","last_active":"2023-11-27T20:42:59.573070+0000","last_peered":"2023-11-27T20:42:59.573070+0000","last_clean":"2023-11-27T20:42:59.573070+0000","last_became_active":"2023-11-27T20:42:38.548660+0000","last_became_peered":"2023-11-27T20:42:38.548660+0000","last_unstale":"2023-11-27T20:42:59.573070+0000","last_undegraded":"2023-11-27T20:42:59.573070+0000","last_fullsized":"2023-11-27T20:42:59.573070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:22.348409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.602163+0000","last_change":"2023-11-27T20:42:58.551925+0000","last_active":"2023-11-27T20:42:59.602163+0000","last_peered":"2023-11-27T20:42:59.602163+0000","last_clean":"2023-11-27T20:42:59.602163+0000","last_became_active":"2023-11-27T20:42:58.551537+0000","last_became_peered":"2023-11-27T20:42:58.551537+0000","last_unstale":"2023-11-27T20:42:59.602163+0000","last_undegraded":"2023-11-27T20:42:59.602163+0000","last_fullsized":"2023-11-27T20:42:59.602163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:15.676693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.725696+0000","last_change":"2023-11-27T20:42:59.586631+0000","last_active":"2023-11-27T20:43:01.725696+0000","last_peered":"2023-11-27T20:43:01.725696+0000","last_clean":"2023-11-27T20:43:01.725696+0000","last_became_active":"2023-11-27T20:42:59.586290+0000","last_became_peered":"2023-11-27T20:42:59.586290+0000","last_unstale":"2023-11-27T20:43:01.725696+0000","last_undegraded":"2023-11-27T20:43:01.725696+0000","last_fullsized":"2023-11-27T20:43:01.725696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:42.964011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.558791+0000","last_change":"2023-11-27T20:42:37.525601+0000","last_active":"2023-11-27T20:42:59.558791+0000","last_peered":"2023-11-27T20:42:59.558791+0000","last_clean":"2023-11-27T20:42:59.558791+0000","last_became_active":"2023-11-27T20:42:37.525296+0000","last_became_peered":"2023-11-27T20:42:37.525296+0000","last_unstale":"2023-11-27T20:42:59.558791+0000","last_undegraded":"2023-11-27T20:42:59.558791+0000","last_fullsized":"2023-11-27T20:42:59.558791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:42.669350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566778+0000","last_change":"2023-11-27T20:42:38.554165+0000","last_active":"2023-11-27T20:42:59.566778+0000","last_peered":"2023-11-27T20:42:59.566778+0000","last_clean":"2023-11-27T20:42:59.566778+0000","last_became_active":"2023-11-27T20:42:38.553912+0000","last_became_peered":"2023-11-27T20:42:38.553912+0000","last_unstale":"2023-11-27T20:42:59.566778+0000","last_undegraded":"2023-11-27T20:42:59.566778+0000","last_fullsized":"2023-11-27T20:42:59.566778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.606484+0000","last_change":"2023-11-27T20:42:58.529202+0000","last_active":"2023-11-27T20:42:59.606484+0000","last_peered":"2023-11-27T20:42:59.606484+0000","last_clean":"2023-11-27T20:42:59.606484+0000","last_became_active":"2023-11-27T20:42:58.528904+0000","last_became_peered":"2023-11-27T20:42:58.528904+0000","last_unstale":"2023-11-27T20:42:59.606484+0000","last_undegraded":"2023-11-27T20:42:59.606484+0000","last_fullsized":"2023-11-27T20:42:59.606484+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:37.409667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.575373+0000","last_change":"2023-11-27T20:42:59.582035+0000","last_active":"2023-11-27T20:43:00.575373+0000","last_peered":"2023-11-27T20:43:00.575373+0000","last_clean":"2023-11-27T20:43:00.575373+0000","last_became_active":"2023-11-27T20:42:59.581289+0000","last_became_peered":"2023-11-27T20:42:59.581289+0000","last_unstale":"2023-11-27T20:43:00.575373+0000","last_undegraded":"2023-11-27T20:43:00.575373+0000","last_fullsized":"2023-11-27T20:43:00.575373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:04:16.689799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.558966+0000","last_change":"2023-11-27T20:42:37.522245+0000","last_active":"2023-11-27T20:42:59.558966+0000","last_peered":"2023-11-27T20:42:59.558966+0000","last_clean":"2023-11-27T20:42:59.558966+0000","last_became_active":"2023-11-27T20:42:37.521938+0000","last_became_peered":"2023-11-27T20:42:37.521938+0000","last_unstale":"2023-11-27T20:42:59.558966+0000","last_undegraded":"2023-11-27T20:42:59.558966+0000","last_fullsized":"2023-11-27T20:42:59.558966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566530+0000","last_change":"2023-11-27T20:42:38.549553+0000","last_active":"2023-11-27T20:42:59.566530+0000","last_peered":"2023-11-27T20:42:59.566530+0000","last_clean":"2023-11-27T20:42:59.566530+0000","last_became_active":"2023-11-27T20:42:38.549075+0000","last_became_peered":"2023-11-27T20:42:38.549075+0000","last_unstale":"2023-11-27T20:42:59.566530+0000","last_undegraded":"2023-11-27T20:42:59.566530+0000","last_fullsized":"2023-11-27T20:42:59.566530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.547434+0000","last_change":"2023-11-27T20:42:58.550144+0000","last_active":"2023-11-27T20:42:59.547434+0000","last_peered":"2023-11-27T20:42:59.547434+0000","last_clean":"2023-11-27T20:42:59.547434+0000","last_became_active":"2023-11-27T20:42:58.549810+0000","last_became_peered":"2023-11-27T20:42:58.549810+0000","last_unstale":"2023-11-27T20:42:59.547434+0000","last_undegraded":"2023-11-27T20:42:59.547434+0000","last_fullsized":"2023-11-27T20:42:59.547434+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:57:31.198311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.575193+0000","last_change":"2023-11-27T20:42:59.576915+0000","last_active":"2023-11-27T20:43:00.575193+0000","last_peered":"2023-11-27T20:43:00.575193+0000","last_clean":"2023-11-27T20:43:00.575193+0000","last_became_active":"2023-11-27T20:42:59.576609+0000","last_became_peered":"2023-11-27T20:42:59.576609+0000","last_unstale":"2023-11-27T20:43:00.575193+0000","last_undegraded":"2023-11-27T20:43:00.575193+0000","last_fullsized":"2023-11-27T20:43:00.575193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:04.429258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.575712+0000","last_change":"2023-11-27T20:42:37.525560+0000","last_active":"2023-11-27T20:42:59.575712+0000","last_peered":"2023-11-27T20:42:59.575712+0000","last_clean":"2023-11-27T20:42:59.575712+0000","last_became_active":"2023-11-27T20:42:37.525261+0000","last_became_peered":"2023-11-27T20:42:37.525261+0000","last_unstale":"2023-11-27T20:42:59.575712+0000","last_undegraded":"2023-11-27T20:42:59.575712+0000","last_fullsized":"2023-11-27T20:42:59.575712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:16.392657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.558838+0000","last_change":"2023-11-27T20:42:38.546056+0000","last_active":"2023-11-27T20:42:59.558838+0000","last_peered":"2023-11-27T20:42:59.558838+0000","last_clean":"2023-11-27T20:42:59.558838+0000","last_became_active":"2023-11-27T20:42:38.545736+0000","last_became_peered":"2023-11-27T20:42:38.545736+0000","last_unstale":"2023-11-27T20:42:59.558838+0000","last_undegraded":"2023-11-27T20:42:59.558838+0000","last_fullsized":"2023-11-27T20:42:59.558838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.603501+0000","last_change":"2023-11-27T20:42:58.545669+0000","last_active":"2023-11-27T20:42:59.603501+0000","last_peered":"2023-11-27T20:42:59.603501+0000","last_clean":"2023-11-27T20:42:59.603501+0000","last_became_active":"2023-11-27T20:42:58.545391+0000","last_became_peered":"2023-11-27T20:42:58.545391+0000","last_unstale":"2023-11-27T20:42:59.603501+0000","last_undegraded":"2023-11-27T20:42:59.603501+0000","last_fullsized":"2023-11-27T20:42:59.603501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:53.950911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455738+0000","last_change":"2023-11-27T20:42:59.580949+0000","last_active":"2023-11-27T20:43:01.455738+0000","last_peered":"2023-11-27T20:43:01.455738+0000","last_clean":"2023-11-27T20:43:01.455738+0000","last_became_active":"2023-11-27T20:42:59.580688+0000","last_became_peered":"2023-11-27T20:42:59.580688+0000","last_unstale":"2023-11-27T20:43:01.455738+0000","last_undegraded":"2023-11-27T20:43:01.455738+0000","last_fullsized":"2023-11-27T20:43:01.455738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:23.552503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.544753+0000","last_change":"2023-11-27T20:42:37.514338+0000","last_active":"2023-11-27T20:42:59.544753+0000","last_peered":"2023-11-27T20:42:59.544753+0000","last_clean":"2023-11-27T20:42:59.544753+0000","last_became_active":"2023-11-27T20:42:37.514055+0000","last_became_peered":"2023-11-27T20:42:37.514055+0000","last_unstale":"2023-11-27T20:42:59.544753+0000","last_undegraded":"2023-11-27T20:42:59.544753+0000","last_fullsized":"2023-11-27T20:42:59.544753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:44.464732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.550827+0000","last_change":"2023-11-27T20:42:38.547970+0000","last_active":"2023-11-27T20:42:59.550827+0000","last_peered":"2023-11-27T20:42:59.550827+0000","last_clean":"2023-11-27T20:42:59.550827+0000","last_became_active":"2023-11-27T20:42:38.547656+0000","last_became_peered":"2023-11-27T20:42:38.547656+0000","last_unstale":"2023-11-27T20:42:59.550827+0000","last_undegraded":"2023-11-27T20:42:59.550827+0000","last_fullsized":"2023-11-27T20:42:59.550827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573597+0000","last_change":"2023-11-27T20:42:58.537837+0000","last_active":"2023-11-27T20:42:59.573597+0000","last_peered":"2023-11-27T20:42:59.573597+0000","last_clean":"2023-11-27T20:42:59.573597+0000","last_became_active":"2023-11-27T20:42:58.537529+0000","last_became_peered":"2023-11-27T20:42:58.537529+0000","last_unstale":"2023-11-27T20:42:59.573597+0000","last_undegraded":"2023-11-27T20:42:59.573597+0000","last_fullsized":"2023-11-27T20:42:59.573597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:07:32.653760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.574696+0000","last_change":"2023-11-27T20:42:59.577677+0000","last_active":"2023-11-27T20:43:00.574696+0000","last_peered":"2023-11-27T20:43:00.574696+0000","last_clean":"2023-11-27T20:43:00.574696+0000","last_became_active":"2023-11-27T20:42:59.577228+0000","last_became_peered":"2023-11-27T20:42:59.577228+0000","last_unstale":"2023-11-27T20:43:00.574696+0000","last_undegraded":"2023-11-27T20:43:00.574696+0000","last_fullsized":"2023-11-27T20:43:00.574696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:24.927681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.546609+0000","last_change":"2023-11-27T20:42:37.535247+0000","last_active":"2023-11-27T20:42:59.546609+0000","last_peered":"2023-11-27T20:42:59.546609+0000","last_clean":"2023-11-27T20:42:59.546609+0000","last_became_active":"2023-11-27T20:42:37.534922+0000","last_became_peered":"2023-11-27T20:42:37.534922+0000","last_unstale":"2023-11-27T20:42:59.546609+0000","last_undegraded":"2023-11-27T20:42:59.546609+0000","last_fullsized":"2023-11-27T20:42:59.546609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:45.108775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567735+0000","last_change":"2023-11-27T20:42:38.548304+0000","last_active":"2023-11-27T20:42:59.567735+0000","last_peered":"2023-11-27T20:42:59.567735+0000","last_clean":"2023-11-27T20:42:59.567735+0000","last_became_active":"2023-11-27T20:42:38.547970+0000","last_became_peered":"2023-11-27T20:42:38.547970+0000","last_unstale":"2023-11-27T20:42:59.567735+0000","last_undegraded":"2023-11-27T20:42:59.567735+0000","last_fullsized":"2023-11-27T20:42:59.567735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:31.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.601288+0000","last_change":"2023-11-27T20:42:58.543360+0000","last_active":"2023-11-27T20:42:59.601288+0000","last_peered":"2023-11-27T20:42:59.601288+0000","last_clean":"2023-11-27T20:42:59.601288+0000","last_became_active":"2023-11-27T20:42:58.540793+0000","last_became_peered":"2023-11-27T20:42:58.540793+0000","last_unstale":"2023-11-27T20:42:59.601288+0000","last_undegraded":"2023-11-27T20:42:59.601288+0000","last_fullsized":"2023-11-27T20:42:59.601288+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:59.563307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.574356+0000","last_change":"2023-11-27T20:42:59.582866+0000","last_active":"2023-11-27T20:43:00.574356+0000","last_peered":"2023-11-27T20:43:00.574356+0000","last_clean":"2023-11-27T20:43:00.574356+0000","last_became_active":"2023-11-27T20:42:59.582151+0000","last_became_peered":"2023-11-27T20:42:59.582151+0000","last_unstale":"2023-11-27T20:43:00.574356+0000","last_undegraded":"2023-11-27T20:43:00.574356+0000","last_fullsized":"2023-11-27T20:43:00.574356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:54:47.448084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566393+0000","last_change":"2023-11-27T20:42:37.522904+0000","last_active":"2023-11-27T20:42:59.566393+0000","last_peered":"2023-11-27T20:42:59.566393+0000","last_clean":"2023-11-27T20:42:59.566393+0000","last_became_active":"2023-11-27T20:42:37.522574+0000","last_became_peered":"2023-11-27T20:42:37.522574+0000","last_unstale":"2023-11-27T20:42:59.566393+0000","last_undegraded":"2023-11-27T20:42:59.566393+0000","last_fullsized":"2023-11-27T20:42:59.566393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:52:13.530182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.549694+0000","last_change":"2023-11-27T20:42:38.553812+0000","last_active":"2023-11-27T20:42:59.549694+0000","last_peered":"2023-11-27T20:42:59.549694+0000","last_clean":"2023-11-27T20:42:59.549694+0000","last_became_active":"2023-11-27T20:42:38.553346+0000","last_became_peered":"2023-11-27T20:42:38.553346+0000","last_unstale":"2023-11-27T20:42:59.549694+0000","last_undegraded":"2023-11-27T20:42:59.549694+0000","last_fullsized":"2023-11-27T20:42:59.549694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:21.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.603781+0000","last_change":"2023-11-27T20:42:58.551919+0000","last_active":"2023-11-27T20:42:59.603781+0000","last_peered":"2023-11-27T20:42:59.603781+0000","last_clean":"2023-11-27T20:42:59.603781+0000","last_became_active":"2023-11-27T20:42:58.551241+0000","last_became_peered":"2023-11-27T20:42:58.551241+0000","last_unstale":"2023-11-27T20:42:59.603781+0000","last_undegraded":"2023-11-27T20:42:59.603781+0000","last_fullsized":"2023-11-27T20:42:59.603781+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:41.395422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.568669+0000","last_change":"2023-11-27T20:42:59.584520+0000","last_active":"2023-11-27T20:43:00.568669+0000","last_peered":"2023-11-27T20:43:00.568669+0000","last_clean":"2023-11-27T20:43:00.568669+0000","last_became_active":"2023-11-27T20:42:59.583568+0000","last_became_peered":"2023-11-27T20:42:59.583568+0000","last_unstale":"2023-11-27T20:43:00.568669+0000","last_undegraded":"2023-11-27T20:43:00.568669+0000","last_fullsized":"2023-11-27T20:43:00.568669+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:09:18.085066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.552901+0000","last_change":"2023-11-27T20:42:37.524294+0000","last_active":"2023-11-27T20:42:59.552901+0000","last_peered":"2023-11-27T20:42:59.552901+0000","last_clean":"2023-11-27T20:42:59.552901+0000","last_became_active":"2023-11-27T20:42:37.523858+0000","last_became_peered":"2023-11-27T20:42:37.523858+0000","last_unstale":"2023-11-27T20:42:59.552901+0000","last_undegraded":"2023-11-27T20:42:59.552901+0000","last_fullsized":"2023-11-27T20:42:59.552901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:21.335590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566226+0000","last_change":"2023-11-27T20:42:38.543201+0000","last_active":"2023-11-27T20:42:59.566226+0000","last_peered":"2023-11-27T20:42:59.566226+0000","last_clean":"2023-11-27T20:42:59.566226+0000","last_became_active":"2023-11-27T20:42:38.542920+0000","last_became_peered":"2023-11-27T20:42:38.542920+0000","last_unstale":"2023-11-27T20:42:59.566226+0000","last_undegraded":"2023-11-27T20:42:59.566226+0000","last_fullsized":"2023-11-27T20:42:59.566226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.545427+0000","last_change":"2023-11-27T20:42:58.541595+0000","last_active":"2023-11-27T20:42:59.545427+0000","last_peered":"2023-11-27T20:42:59.545427+0000","last_clean":"2023-11-27T20:42:59.545427+0000","last_became_active":"2023-11-27T20:42:58.540765+0000","last_became_peered":"2023-11-27T20:42:58.540765+0000","last_unstale":"2023-11-27T20:42:59.545427+0000","last_undegraded":"2023-11-27T20:42:59.545427+0000","last_fullsized":"2023-11-27T20:42:59.545427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:06.695281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.573749+0000","last_change":"2023-11-27T20:42:59.583295+0000","last_active":"2023-11-27T20:43:00.573749+0000","last_peered":"2023-11-27T20:43:00.573749+0000","last_clean":"2023-11-27T20:43:00.573749+0000","last_became_active":"2023-11-27T20:42:59.582972+0000","last_became_peered":"2023-11-27T20:42:59.582972+0000","last_unstale":"2023-11-27T20:43:00.573749+0000","last_undegraded":"2023-11-27T20:43:00.573749+0000","last_fullsized":"2023-11-27T20:43:00.573749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:57:32.211417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.548085+0000","last_change":"2023-11-27T20:42:37.523173+0000","last_active":"2023-11-27T20:42:59.548085+0000","last_peered":"2023-11-27T20:42:59.548085+0000","last_clean":"2023-11-27T20:42:59.548085+0000","last_became_active":"2023-11-27T20:42:37.522903+0000","last_became_peered":"2023-11-27T20:42:37.522903+0000","last_unstale":"2023-11-27T20:42:59.548085+0000","last_undegraded":"2023-11-27T20:42:59.548085+0000","last_fullsized":"2023-11-27T20:42:59.548085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:28.381599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562959+0000","last_change":"2023-11-27T20:42:38.557705+0000","last_active":"2023-11-27T20:42:59.562959+0000","last_peered":"2023-11-27T20:42:59.562959+0000","last_clean":"2023-11-27T20:42:59.562959+0000","last_became_active":"2023-11-27T20:42:38.557251+0000","last_became_peered":"2023-11-27T20:42:38.557251+0000","last_unstale":"2023-11-27T20:42:59.562959+0000","last_undegraded":"2023-11-27T20:42:59.562959+0000","last_fullsized":"2023-11-27T20:42:59.562959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566790+0000","last_change":"2023-11-27T20:42:58.548022+0000","last_active":"2023-11-27T20:42:59.566790+0000","last_peered":"2023-11-27T20:42:59.566790+0000","last_clean":"2023-11-27T20:42:59.566790+0000","last_became_active":"2023-11-27T20:42:58.547725+0000","last_became_peered":"2023-11-27T20:42:58.547725+0000","last_unstale":"2023-11-27T20:42:59.566790+0000","last_undegraded":"2023-11-27T20:42:59.566790+0000","last_fullsized":"2023-11-27T20:42:59.566790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:12.419709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.887531+0000","last_change":"2023-11-27T20:42:59.576205+0000","last_active":"2023-11-27T20:43:01.887531+0000","last_peered":"2023-11-27T20:43:01.887531+0000","last_clean":"2023-11-27T20:43:01.887531+0000","last_became_active":"2023-11-27T20:42:59.575925+0000","last_became_peered":"2023-11-27T20:42:59.575925+0000","last_unstale":"2023-11-27T20:43:01.887531+0000","last_undegraded":"2023-11-27T20:43:01.887531+0000","last_fullsized":"2023-11-27T20:43:01.887531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:07:54.964017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.563736+0000","last_change":"2023-11-27T20:42:37.530460+0000","last_active":"2023-11-27T20:42:59.563736+0000","last_peered":"2023-11-27T20:42:59.563736+0000","last_clean":"2023-11-27T20:42:59.563736+0000","last_became_active":"2023-11-27T20:42:37.529879+0000","last_became_peered":"2023-11-27T20:42:37.529879+0000","last_unstale":"2023-11-27T20:42:59.563736+0000","last_undegraded":"2023-11-27T20:42:59.563736+0000","last_fullsized":"2023-11-27T20:42:59.563736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:58.185242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.548407+0000","last_change":"2023-11-27T20:42:38.555684+0000","last_active":"2023-11-27T20:42:59.548407+0000","last_peered":"2023-11-27T20:42:59.548407+0000","last_clean":"2023-11-27T20:42:59.548407+0000","last_became_active":"2023-11-27T20:42:38.555415+0000","last_became_peered":"2023-11-27T20:42:38.555415+0000","last_unstale":"2023-11-27T20:42:59.548407+0000","last_undegraded":"2023-11-27T20:42:59.548407+0000","last_fullsized":"2023-11-27T20:42:59.548407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:52.006320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.559293+0000","last_change":"2023-11-27T20:42:58.551727+0000","last_active":"2023-11-27T20:42:59.559293+0000","last_peered":"2023-11-27T20:42:59.559293+0000","last_clean":"2023-11-27T20:42:59.559293+0000","last_became_active":"2023-11-27T20:42:58.551109+0000","last_became_peered":"2023-11-27T20:42:58.551109+0000","last_unstale":"2023-11-27T20:42:59.559293+0000","last_undegraded":"2023-11-27T20:42:59.559293+0000","last_fullsized":"2023-11-27T20:42:59.559293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:52.733989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.574214+0000","last_change":"2023-11-27T20:42:59.593819+0000","last_active":"2023-11-27T20:43:00.574214+0000","last_peered":"2023-11-27T20:43:00.574214+0000","last_clean":"2023-11-27T20:43:00.574214+0000","last_became_active":"2023-11-27T20:42:59.592212+0000","last_became_peered":"2023-11-27T20:42:59.592212+0000","last_unstale":"2023-11-27T20:43:00.574214+0000","last_undegraded":"2023-11-27T20:43:00.574214+0000","last_fullsized":"2023-11-27T20:43:00.574214+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:11:45.424458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567221+0000","last_change":"2023-11-27T20:42:37.532869+0000","last_active":"2023-11-27T20:42:59.567221+0000","last_peered":"2023-11-27T20:42:59.567221+0000","last_clean":"2023-11-27T20:42:59.567221+0000","last_became_active":"2023-11-27T20:42:37.532576+0000","last_became_peered":"2023-11-27T20:42:37.532576+0000","last_unstale":"2023-11-27T20:42:59.567221+0000","last_undegraded":"2023-11-27T20:42:59.567221+0000","last_fullsized":"2023-11-27T20:42:59.567221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.551160+0000","last_change":"2023-11-27T20:42:38.559970+0000","last_active":"2023-11-27T20:42:59.551160+0000","last_peered":"2023-11-27T20:42:59.551160+0000","last_clean":"2023-11-27T20:42:59.551160+0000","last_became_active":"2023-11-27T20:42:38.559688+0000","last_became_peered":"2023-11-27T20:42:38.559688+0000","last_unstale":"2023-11-27T20:42:59.551160+0000","last_undegraded":"2023-11-27T20:42:59.551160+0000","last_fullsized":"2023-11-27T20:42:59.551160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:47.260947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.606868+0000","last_change":"2023-11-27T20:42:58.544627+0000","last_active":"2023-11-27T20:42:59.606868+0000","last_peered":"2023-11-27T20:42:59.606868+0000","last_clean":"2023-11-27T20:42:59.606868+0000","last_became_active":"2023-11-27T20:42:58.544367+0000","last_became_peered":"2023-11-27T20:42:58.544367+0000","last_unstale":"2023-11-27T20:42:59.606868+0000","last_undegraded":"2023-11-27T20:42:59.606868+0000","last_fullsized":"2023-11-27T20:42:59.606868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:22.014113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.570535+0000","last_change":"2023-11-27T20:42:59.582621+0000","last_active":"2023-11-27T20:43:00.570535+0000","last_peered":"2023-11-27T20:43:00.570535+0000","last_clean":"2023-11-27T20:43:00.570535+0000","last_became_active":"2023-11-27T20:42:59.582447+0000","last_became_peered":"2023-11-27T20:42:59.582447+0000","last_unstale":"2023-11-27T20:43:00.570535+0000","last_undegraded":"2023-11-27T20:43:00.570535+0000","last_fullsized":"2023-11-27T20:43:00.570535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:00:07.705415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.549400+0000","last_change":"2023-11-27T20:42:37.531762+0000","last_active":"2023-11-27T20:42:59.549400+0000","last_peered":"2023-11-27T20:42:59.549400+0000","last_clean":"2023-11-27T20:42:59.549400+0000","last_became_active":"2023-11-27T20:42:37.531446+0000","last_became_peered":"2023-11-27T20:42:37.531446+0000","last_unstale":"2023-11-27T20:42:59.549400+0000","last_undegraded":"2023-11-27T20:42:59.549400+0000","last_fullsized":"2023-11-27T20:42:59.549400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:11.474537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.565905+0000","last_change":"2023-11-27T20:42:38.555603+0000","last_active":"2023-11-27T20:42:59.565905+0000","last_peered":"2023-11-27T20:42:59.565905+0000","last_clean":"2023-11-27T20:42:59.565905+0000","last_became_active":"2023-11-27T20:42:38.555305+0000","last_became_peered":"2023-11-27T20:42:38.555305+0000","last_unstale":"2023-11-27T20:42:59.565905+0000","last_undegraded":"2023-11-27T20:42:59.565905+0000","last_fullsized":"2023-11-27T20:42:59.565905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.604884+0000","last_change":"2023-11-27T20:42:58.555168+0000","last_active":"2023-11-27T20:42:59.604884+0000","last_peered":"2023-11-27T20:42:59.604884+0000","last_clean":"2023-11-27T20:42:59.604884+0000","last_became_active":"2023-11-27T20:42:58.554873+0000","last_became_peered":"2023-11-27T20:42:58.554873+0000","last_unstale":"2023-11-27T20:42:59.604884+0000","last_undegraded":"2023-11-27T20:42:59.604884+0000","last_fullsized":"2023-11-27T20:42:59.604884+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:06.695281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455387+0000","last_change":"2023-11-27T20:42:59.587212+0000","last_active":"2023-11-27T20:43:01.455387+0000","last_peered":"2023-11-27T20:43:01.455387+0000","last_clean":"2023-11-27T20:43:01.455387+0000","last_became_active":"2023-11-27T20:42:59.586922+0000","last_became_peered":"2023-11-27T20:42:59.586922+0000","last_unstale":"2023-11-27T20:43:01.455387+0000","last_undegraded":"2023-11-27T20:43:01.455387+0000","last_fullsized":"2023-11-27T20:43:01.455387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:57:32.211417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553461+0000","last_change":"2023-11-27T20:42:37.522230+0000","last_active":"2023-11-27T20:42:59.553461+0000","last_peered":"2023-11-27T20:42:59.553461+0000","last_clean":"2023-11-27T20:42:59.553461+0000","last_became_active":"2023-11-27T20:42:37.521898+0000","last_became_peered":"2023-11-27T20:42:37.521898+0000","last_unstale":"2023-11-27T20:42:59.553461+0000","last_undegraded":"2023-11-27T20:42:59.553461+0000","last_fullsized":"2023-11-27T20:42:59.553461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:16:18.992040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.565806+0000","last_change":"2023-11-27T20:42:38.538177+0000","last_active":"2023-11-27T20:42:59.565806+0000","last_peered":"2023-11-27T20:42:59.565806+0000","last_clean":"2023-11-27T20:42:59.565806+0000","last_became_active":"2023-11-27T20:42:38.537835+0000","last_became_peered":"2023-11-27T20:42:38.537835+0000","last_unstale":"2023-11-27T20:42:59.565806+0000","last_undegraded":"2023-11-27T20:42:59.565806+0000","last_fullsized":"2023-11-27T20:42:59.565806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.599778+0000","last_change":"2023-11-27T20:42:58.553614+0000","last_active":"2023-11-27T20:42:59.599778+0000","last_peered":"2023-11-27T20:42:59.599778+0000","last_clean":"2023-11-27T20:42:59.599778+0000","last_became_active":"2023-11-27T20:42:58.553329+0000","last_became_peered":"2023-11-27T20:42:58.553329+0000","last_unstale":"2023-11-27T20:42:59.599778+0000","last_undegraded":"2023-11-27T20:42:59.599778+0000","last_fullsized":"2023-11-27T20:42:59.599778+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:26:23.914576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.885618+0000","last_change":"2023-11-27T20:42:59.568708+0000","last_active":"2023-11-27T20:43:01.885618+0000","last_peered":"2023-11-27T20:43:01.885618+0000","last_clean":"2023-11-27T20:43:01.885618+0000","last_became_active":"2023-11-27T20:42:59.568429+0000","last_became_peered":"2023-11-27T20:42:59.568429+0000","last_unstale":"2023-11-27T20:43:01.885618+0000","last_undegraded":"2023-11-27T20:43:01.885618+0000","last_fullsized":"2023-11-27T20:43:01.885618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:07:33.666865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.546965+0000","last_change":"2023-11-27T20:42:37.522964+0000","last_active":"2023-11-27T20:42:59.546965+0000","last_peered":"2023-11-27T20:42:59.546965+0000","last_clean":"2023-11-27T20:42:59.546965+0000","last_became_active":"2023-11-27T20:42:37.522677+0000","last_became_peered":"2023-11-27T20:42:37.522677+0000","last_unstale":"2023-11-27T20:42:59.546965+0000","last_undegraded":"2023-11-27T20:42:59.546965+0000","last_fullsized":"2023-11-27T20:42:59.546965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:50:30.748479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553345+0000","last_change":"2023-11-27T20:42:38.533572+0000","last_active":"2023-11-27T20:42:59.553345+0000","last_peered":"2023-11-27T20:42:59.553345+0000","last_clean":"2023-11-27T20:42:59.553345+0000","last_became_active":"2023-11-27T20:42:38.533281+0000","last_became_peered":"2023-11-27T20:42:38.533281+0000","last_unstale":"2023-11-27T20:42:59.553345+0000","last_undegraded":"2023-11-27T20:42:59.553345+0000","last_fullsized":"2023-11-27T20:42:59.553345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:05.902429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.604729+0000","last_change":"2023-11-27T20:42:58.535935+0000","last_active":"2023-11-27T20:42:59.604729+0000","last_peered":"2023-11-27T20:42:59.604729+0000","last_clean":"2023-11-27T20:42:59.604729+0000","last_became_active":"2023-11-27T20:42:58.534678+0000","last_became_peered":"2023-11-27T20:42:58.534678+0000","last_unstale":"2023-11-27T20:42:59.604729+0000","last_undegraded":"2023-11-27T20:42:59.604729+0000","last_fullsized":"2023-11-27T20:42:59.604729+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:45.859604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.572998+0000","last_change":"2023-11-27T20:42:59.579635+0000","last_active":"2023-11-27T20:43:00.572998+0000","last_peered":"2023-11-27T20:43:00.572998+0000","last_clean":"2023-11-27T20:43:00.572998+0000","last_became_active":"2023-11-27T20:42:59.579024+0000","last_became_peered":"2023-11-27T20:42:59.579024+0000","last_unstale":"2023-11-27T20:43:00.572998+0000","last_undegraded":"2023-11-27T20:43:00.572998+0000","last_fullsized":"2023-11-27T20:43:00.572998+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:29:54.662581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.556694+0000","last_change":"2023-11-27T20:42:37.531654+0000","last_active":"2023-11-27T20:42:59.556694+0000","last_peered":"2023-11-27T20:42:59.556694+0000","last_clean":"2023-11-27T20:42:59.556694+0000","last_became_active":"2023-11-27T20:42:37.529901+0000","last_became_peered":"2023-11-27T20:42:37.529901+0000","last_unstale":"2023-11-27T20:42:59.556694+0000","last_undegraded":"2023-11-27T20:42:59.556694+0000","last_fullsized":"2023-11-27T20:42:59.556694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562586+0000","last_change":"2023-11-27T20:42:38.545564+0000","last_active":"2023-11-27T20:42:59.562586+0000","last_peered":"2023-11-27T20:42:59.562586+0000","last_clean":"2023-11-27T20:42:59.562586+0000","last_became_active":"2023-11-27T20:42:38.545232+0000","last_became_peered":"2023-11-27T20:42:38.545232+0000","last_unstale":"2023-11-27T20:42:59.562586+0000","last_undegraded":"2023-11-27T20:42:59.562586+0000","last_fullsized":"2023-11-27T20:42:59.562586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.559956+0000","last_change":"2023-11-27T20:42:58.545203+0000","last_active":"2023-11-27T20:42:59.559956+0000","last_peered":"2023-11-27T20:42:59.559956+0000","last_clean":"2023-11-27T20:42:59.559956+0000","last_became_active":"2023-11-27T20:42:58.544923+0000","last_became_peered":"2023-11-27T20:42:58.544923+0000","last_unstale":"2023-11-27T20:42:59.559956+0000","last_undegraded":"2023-11-27T20:42:59.559956+0000","last_fullsized":"2023-11-27T20:42:59.559956+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:03.416152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454328+0000","last_change":"2023-11-27T20:42:59.571764+0000","last_active":"2023-11-27T20:43:01.454328+0000","last_peered":"2023-11-27T20:43:01.454328+0000","last_clean":"2023-11-27T20:43:01.454328+0000","last_became_active":"2023-11-27T20:42:59.571496+0000","last_became_peered":"2023-11-27T20:42:59.571496+0000","last_unstale":"2023-11-27T20:43:01.454328+0000","last_undegraded":"2023-11-27T20:43:01.454328+0000","last_fullsized":"2023-11-27T20:43:01.454328+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:07.708387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.552647+0000","last_change":"2023-11-27T20:42:37.527381+0000","last_active":"2023-11-27T20:42:59.552647+0000","last_peered":"2023-11-27T20:42:59.552647+0000","last_clean":"2023-11-27T20:42:59.552647+0000","last_became_active":"2023-11-27T20:42:37.527147+0000","last_became_peered":"2023-11-27T20:42:37.527147+0000","last_unstale":"2023-11-27T20:42:59.552647+0000","last_undegraded":"2023-11-27T20:42:59.552647+0000","last_fullsized":"2023-11-27T20:42:59.552647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:58:32.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573790+0000","last_change":"2023-11-27T20:42:38.552242+0000","last_active":"2023-11-27T20:42:59.573790+0000","last_peered":"2023-11-27T20:42:59.573790+0000","last_clean":"2023-11-27T20:42:59.573790+0000","last_became_active":"2023-11-27T20:42:38.551805+0000","last_became_peered":"2023-11-27T20:42:38.551805+0000","last_unstale":"2023-11-27T20:42:59.573790+0000","last_undegraded":"2023-11-27T20:42:59.573790+0000","last_fullsized":"2023-11-27T20:42:59.573790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562447+0000","last_change":"2023-11-27T20:42:58.547657+0000","last_active":"2023-11-27T20:42:59.562447+0000","last_peered":"2023-11-27T20:42:59.562447+0000","last_clean":"2023-11-27T20:42:59.562447+0000","last_became_active":"2023-11-27T20:42:58.547413+0000","last_became_peered":"2023-11-27T20:42:58.547413+0000","last_unstale":"2023-11-27T20:42:59.562447+0000","last_undegraded":"2023-11-27T20:42:59.562447+0000","last_fullsized":"2023-11-27T20:42:59.562447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:12.419709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.575662+0000","last_change":"2023-11-27T20:42:59.567778+0000","last_active":"2023-11-27T20:43:00.575662+0000","last_peered":"2023-11-27T20:43:00.575662+0000","last_clean":"2023-11-27T20:43:00.575662+0000","last_became_active":"2023-11-27T20:42:59.567481+0000","last_became_peered":"2023-11-27T20:42:59.567481+0000","last_unstale":"2023-11-27T20:43:00.575662+0000","last_undegraded":"2023-11-27T20:43:00.575662+0000","last_fullsized":"2023-11-27T20:43:00.575662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:52:37.217003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.600172+0000","last_change":"2023-11-27T20:42:58.555312+0000","last_active":"2023-11-27T20:42:59.600172+0000","last_peered":"2023-11-27T20:42:59.600172+0000","last_clean":"2023-11-27T20:42:59.600172+0000","last_became_active":"2023-11-27T20:42:58.554561+0000","last_became_peered":"2023-11-27T20:42:58.554561+0000","last_unstale":"2023-11-27T20:42:59.600172+0000","last_undegraded":"2023-11-27T20:42:59.600172+0000","last_fullsized":"2023-11-27T20:42:59.600172+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:52:36.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.575933+0000","last_change":"2023-11-27T20:42:37.530074+0000","last_active":"2023-11-27T20:42:59.575933+0000","last_peered":"2023-11-27T20:42:59.575933+0000","last_clean":"2023-11-27T20:42:59.575933+0000","last_became_active":"2023-11-27T20:42:37.529422+0000","last_became_peered":"2023-11-27T20:42:37.529422+0000","last_unstale":"2023-11-27T20:42:59.575933+0000","last_undegraded":"2023-11-27T20:42:59.575933+0000","last_fullsized":"2023-11-27T20:42:59.575933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:40:40.129670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573270+0000","last_change":"2023-11-27T20:42:38.551495+0000","last_active":"2023-11-27T20:42:59.573270+0000","last_peered":"2023-11-27T20:42:59.573270+0000","last_clean":"2023-11-27T20:42:59.573270+0000","last_became_active":"2023-11-27T20:42:38.548057+0000","last_became_peered":"2023-11-27T20:42:38.548057+0000","last_unstale":"2023-11-27T20:42:59.573270+0000","last_undegraded":"2023-11-27T20:42:59.573270+0000","last_fullsized":"2023-11-27T20:42:59.573270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.932102+0000","last_change":"2023-11-27T20:42:59.595419+0000","last_active":"2023-11-27T20:43:00.932102+0000","last_peered":"2023-11-27T20:43:00.932102+0000","last_clean":"2023-11-27T20:43:00.932102+0000","last_became_active":"2023-11-27T20:42:59.593174+0000","last_became_peered":"2023-11-27T20:42:59.593174+0000","last_unstale":"2023-11-27T20:43:00.932102+0000","last_undegraded":"2023-11-27T20:43:00.932102+0000","last_fullsized":"2023-11-27T20:43:00.932102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:52:37.217003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.605957+0000","last_change":"2023-11-27T20:42:58.552527+0000","last_active":"2023-11-27T20:42:59.605957+0000","last_peered":"2023-11-27T20:42:59.605957+0000","last_clean":"2023-11-27T20:42:59.605957+0000","last_became_active":"2023-11-27T20:42:58.552194+0000","last_became_peered":"2023-11-27T20:42:58.552194+0000","last_unstale":"2023-11-27T20:42:59.605957+0000","last_undegraded":"2023-11-27T20:42:59.605957+0000","last_fullsized":"2023-11-27T20:42:59.605957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:54:46.434979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.547537+0000","last_change":"2023-11-27T20:42:37.520015+0000","last_active":"2023-11-27T20:42:59.547537+0000","last_peered":"2023-11-27T20:42:59.547537+0000","last_clean":"2023-11-27T20:42:59.547537+0000","last_became_active":"2023-11-27T20:42:37.519779+0000","last_became_peered":"2023-11-27T20:42:37.519779+0000","last_unstale":"2023-11-27T20:42:59.547537+0000","last_undegraded":"2023-11-27T20:42:59.547537+0000","last_fullsized":"2023-11-27T20:42:59.547537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:47.336738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.551677+0000","last_change":"2023-11-27T20:42:38.558352+0000","last_active":"2023-11-27T20:42:59.551677+0000","last_peered":"2023-11-27T20:42:59.551677+0000","last_clean":"2023-11-27T20:42:59.551677+0000","last_became_active":"2023-11-27T20:42:38.557630+0000","last_became_peered":"2023-11-27T20:42:38.557630+0000","last_unstale":"2023-11-27T20:42:59.551677+0000","last_undegraded":"2023-11-27T20:42:59.551677+0000","last_fullsized":"2023-11-27T20:42:59.551677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.932402+0000","last_change":"2023-11-27T20:42:59.579428+0000","last_active":"2023-11-27T20:43:00.932402+0000","last_peered":"2023-11-27T20:43:00.932402+0000","last_clean":"2023-11-27T20:43:00.932402+0000","last_became_active":"2023-11-27T20:42:59.579214+0000","last_became_peered":"2023-11-27T20:42:59.579214+0000","last_unstale":"2023-11-27T20:43:00.932402+0000","last_undegraded":"2023-11-27T20:43:00.932402+0000","last_fullsized":"2023-11-27T20:43:00.932402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:53.747094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567046+0000","last_change":"2023-11-27T20:42:37.535511+0000","last_active":"2023-11-27T20:42:59.567046+0000","last_peered":"2023-11-27T20:42:59.567046+0000","last_clean":"2023-11-27T20:42:59.567046+0000","last_became_active":"2023-11-27T20:42:37.535314+0000","last_became_peered":"2023-11-27T20:42:37.535314+0000","last_unstale":"2023-11-27T20:42:59.567046+0000","last_undegraded":"2023-11-27T20:42:59.567046+0000","last_fullsized":"2023-11-27T20:42:59.567046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:38.468808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553402+0000","last_change":"2023-11-27T20:42:38.545391+0000","last_active":"2023-11-27T20:42:59.553402+0000","last_peered":"2023-11-27T20:42:59.553402+0000","last_clean":"2023-11-27T20:42:59.553402+0000","last_became_active":"2023-11-27T20:42:38.544984+0000","last_became_peered":"2023-11-27T20:42:38.544984+0000","last_unstale":"2023-11-27T20:42:59.553402+0000","last_undegraded":"2023-11-27T20:42:59.553402+0000","last_fullsized":"2023-11-27T20:42:59.553402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.599746+0000","last_change":"2023-11-27T20:42:58.549733+0000","last_active":"2023-11-27T20:42:59.599746+0000","last_peered":"2023-11-27T20:42:59.599746+0000","last_clean":"2023-11-27T20:42:59.599746+0000","last_became_active":"2023-11-27T20:42:58.549444+0000","last_became_peered":"2023-11-27T20:42:58.549444+0000","last_unstale":"2023-11-27T20:42:59.599746+0000","last_undegraded":"2023-11-27T20:42:59.599746+0000","last_fullsized":"2023-11-27T20:42:59.599746+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:03:32.238576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.885258+0000","last_change":"2023-11-27T20:42:59.576002+0000","last_active":"2023-11-27T20:43:01.885258+0000","last_peered":"2023-11-27T20:43:01.885258+0000","last_clean":"2023-11-27T20:43:01.885258+0000","last_became_active":"2023-11-27T20:42:59.575718+0000","last_became_peered":"2023-11-27T20:42:59.575718+0000","last_unstale":"2023-11-27T20:43:01.885258+0000","last_undegraded":"2023-11-27T20:43:01.885258+0000","last_fullsized":"2023-11-27T20:43:01.885258+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:07:17.690802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553510+0000","last_change":"2023-11-27T20:42:37.528294+0000","last_active":"2023-11-27T20:42:59.553510+0000","last_peered":"2023-11-27T20:42:59.553510+0000","last_clean":"2023-11-27T20:42:59.553510+0000","last_became_active":"2023-11-27T20:42:37.528055+0000","last_became_peered":"2023-11-27T20:42:37.528055+0000","last_unstale":"2023-11-27T20:42:59.553510+0000","last_undegraded":"2023-11-27T20:42:59.553510+0000","last_fullsized":"2023-11-27T20:42:59.553510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:36.472886+0000","last_clean_scrub_stamp":"2023-11-27T20:42:36.472886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:08.388338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566962+0000","last_change":"2023-11-27T20:42:38.529609+0000","last_active":"2023-11-27T20:42:59.566962+0000","last_peered":"2023-11-27T20:42:59.566962+0000","last_clean":"2023-11-27T20:42:59.566962+0000","last_became_active":"2023-11-27T20:42:38.529089+0000","last_became_peered":"2023-11-27T20:42:38.529089+0000","last_unstale":"2023-11-27T20:42:59.566962+0000","last_undegraded":"2023-11-27T20:42:59.566962+0000","last_fullsized":"2023-11-27T20:42:59.566962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:20.287739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.605397+0000","last_change":"2023-11-27T20:42:58.548732+0000","last_active":"2023-11-27T20:42:59.605397+0000","last_peered":"2023-11-27T20:42:59.605397+0000","last_clean":"2023-11-27T20:42:59.605397+0000","last_became_active":"2023-11-27T20:42:58.548377+0000","last_became_peered":"2023-11-27T20:42:58.548377+0000","last_unstale":"2023-11-27T20:42:59.605397+0000","last_undegraded":"2023-11-27T20:42:59.605397+0000","last_fullsized":"2023-11-27T20:42:59.605397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:57.489897+0000","last_clean_scrub_stamp":"2023-11-27T20:42:57.489897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:43:03.416152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.885370+0000","last_change":"2023-11-27T20:42:59.580067+0000","last_active":"2023-11-27T20:43:01.885370+0000","last_peered":"2023-11-27T20:43:01.885370+0000","last_clean":"2023-11-27T20:43:01.885370+0000","last_became_active":"2023-11-27T20:42:59.577803+0000","last_became_peered":"2023-11-27T20:42:59.577803+0000","last_unstale":"2023-11-27T20:43:01.885370+0000","last_undegraded":"2023-11-27T20:43:01.885370+0000","last_fullsized":"2023-11-27T20:43:01.885370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:30.630781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567614+0000","last_change":"2023-11-27T20:42:38.549776+0000","last_active":"2023-11-27T20:42:59.567614+0000","last_peered":"2023-11-27T20:42:59.567614+0000","last_clean":"2023-11-27T20:42:59.567614+0000","last_became_active":"2023-11-27T20:42:38.549339+0000","last_became_peered":"2023-11-27T20:42:38.549339+0000","last_unstale":"2023-11-27T20:42:59.567614+0000","last_undegraded":"2023-11-27T20:42:59.567614+0000","last_fullsized":"2023-11-27T20:42:59.567614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.575606+0000","last_change":"2023-11-27T20:42:59.581034+0000","last_active":"2023-11-27T20:43:00.575606+0000","last_peered":"2023-11-27T20:43:00.575606+0000","last_clean":"2023-11-27T20:43:00.575606+0000","last_became_active":"2023-11-27T20:42:59.580572+0000","last_became_peered":"2023-11-27T20:42:59.580572+0000","last_unstale":"2023-11-27T20:43:00.575606+0000","last_undegraded":"2023-11-27T20:43:00.575606+0000","last_fullsized":"2023-11-27T20:43:00.575606+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:56.843133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.550307+0000","last_change":"2023-11-27T20:42:38.539218+0000","last_active":"2023-11-27T20:42:59.550307+0000","last_peered":"2023-11-27T20:42:59.550307+0000","last_clean":"2023-11-27T20:42:59.550307+0000","last_became_active":"2023-11-27T20:42:38.538843+0000","last_became_peered":"2023-11-27T20:42:38.538843+0000","last_unstale":"2023-11-27T20:42:59.550307+0000","last_undegraded":"2023-11-27T20:42:59.550307+0000","last_fullsized":"2023-11-27T20:42:59.550307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:10.273471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.724496+0000","last_change":"2023-11-27T20:42:59.586714+0000","last_active":"2023-11-27T20:43:01.724496+0000","last_peered":"2023-11-27T20:43:01.724496+0000","last_clean":"2023-11-27T20:43:01.724496+0000","last_became_active":"2023-11-27T20:42:59.586441+0000","last_became_peered":"2023-11-27T20:42:59.586441+0000","last_unstale":"2023-11-27T20:43:01.724496+0000","last_undegraded":"2023-11-27T20:43:01.724496+0000","last_fullsized":"2023-11-27T20:43:01.724496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:35:09.366854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573695+0000","last_change":"2023-11-27T20:42:38.531773+0000","last_active":"2023-11-27T20:42:59.573695+0000","last_peered":"2023-11-27T20:42:59.573695+0000","last_clean":"2023-11-27T20:42:59.573695+0000","last_became_active":"2023-11-27T20:42:38.531469+0000","last_became_peered":"2023-11-27T20:42:38.531469+0000","last_unstale":"2023-11-27T20:42:59.573695+0000","last_undegraded":"2023-11-27T20:42:59.573695+0000","last_fullsized":"2023-11-27T20:42:59.573695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:57:51.189408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.569018+0000","last_change":"2023-11-27T20:42:59.570042+0000","last_active":"2023-11-27T20:43:00.569018+0000","last_peered":"2023-11-27T20:43:00.569018+0000","last_clean":"2023-11-27T20:43:00.569018+0000","last_became_active":"2023-11-27T20:42:59.569730+0000","last_became_peered":"2023-11-27T20:42:59.569730+0000","last_unstale":"2023-11-27T20:43:00.569018+0000","last_undegraded":"2023-11-27T20:43:00.569018+0000","last_fullsized":"2023-11-27T20:43:00.569018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:30:33.327744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.552424+0000","last_change":"2023-11-27T20:42:38.548676+0000","last_active":"2023-11-27T20:42:59.552424+0000","last_peered":"2023-11-27T20:42:59.552424+0000","last_clean":"2023-11-27T20:42:59.552424+0000","last_became_active":"2023-11-27T20:42:38.548338+0000","last_became_peered":"2023-11-27T20:42:38.548338+0000","last_unstale":"2023-11-27T20:42:59.552424+0000","last_undegraded":"2023-11-27T20:42:59.552424+0000","last_fullsized":"2023-11-27T20:42:59.552424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.725378+0000","last_change":"2023-11-27T20:42:59.591691+0000","last_active":"2023-11-27T20:43:01.725378+0000","last_peered":"2023-11-27T20:43:01.725378+0000","last_clean":"2023-11-27T20:43:01.725378+0000","last_became_active":"2023-11-27T20:42:59.591382+0000","last_became_peered":"2023-11-27T20:42:59.591382+0000","last_unstale":"2023-11-27T20:43:01.725378+0000","last_undegraded":"2023-11-27T20:43:01.725378+0000","last_fullsized":"2023-11-27T20:43:01.725378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:34.753259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.563238+0000","last_change":"2023-11-27T20:42:38.541871+0000","last_active":"2023-11-27T20:42:59.563238+0000","last_peered":"2023-11-27T20:42:59.563238+0000","last_clean":"2023-11-27T20:42:59.563238+0000","last_became_active":"2023-11-27T20:42:38.532675+0000","last_became_peered":"2023-11-27T20:42:38.532675+0000","last_unstale":"2023-11-27T20:42:59.563238+0000","last_undegraded":"2023-11-27T20:42:59.563238+0000","last_fullsized":"2023-11-27T20:42:59.563238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.576022+0000","last_change":"2023-11-27T20:42:59.582099+0000","last_active":"2023-11-27T20:43:00.576022+0000","last_peered":"2023-11-27T20:43:00.576022+0000","last_clean":"2023-11-27T20:43:00.576022+0000","last_became_active":"2023-11-27T20:42:59.581816+0000","last_became_peered":"2023-11-27T20:42:59.581816+0000","last_unstale":"2023-11-27T20:43:00.576022+0000","last_undegraded":"2023-11-27T20:43:00.576022+0000","last_fullsized":"2023-11-27T20:43:00.576022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:19:25.259856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.573361+0000","last_change":"2023-11-27T20:42:38.547768+0000","last_active":"2023-11-27T20:42:59.573361+0000","last_peered":"2023-11-27T20:42:59.573361+0000","last_clean":"2023-11-27T20:42:59.573361+0000","last_became_active":"2023-11-27T20:42:38.547403+0000","last_became_peered":"2023-11-27T20:42:38.547403+0000","last_unstale":"2023-11-27T20:42:59.573361+0000","last_undegraded":"2023-11-27T20:42:59.573361+0000","last_fullsized":"2023-11-27T20:42:59.573361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.885257+0000","last_change":"2023-11-27T20:42:59.591772+0000","last_active":"2023-11-27T20:43:01.885257+0000","last_peered":"2023-11-27T20:43:01.885257+0000","last_clean":"2023-11-27T20:43:01.885257+0000","last_became_active":"2023-11-27T20:42:59.591430+0000","last_became_peered":"2023-11-27T20:42:59.591430+0000","last_unstale":"2023-11-27T20:43:01.885257+0000","last_undegraded":"2023-11-27T20:43:01.885257+0000","last_fullsized":"2023-11-27T20:43:01.885257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:00.576412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.549266+0000","last_change":"2023-11-27T20:42:38.553640+0000","last_active":"2023-11-27T20:42:59.549266+0000","last_peered":"2023-11-27T20:42:59.549266+0000","last_clean":"2023-11-27T20:42:59.549266+0000","last_became_active":"2023-11-27T20:42:38.552879+0000","last_became_peered":"2023-11-27T20:42:38.552879+0000","last_unstale":"2023-11-27T20:42:59.549266+0000","last_undegraded":"2023-11-27T20:42:59.549266+0000","last_fullsized":"2023-11-27T20:42:59.549266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:40:10.146333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.886692+0000","last_change":"2023-11-27T20:42:59.570928+0000","last_active":"2023-11-27T20:43:01.886692+0000","last_peered":"2023-11-27T20:43:01.886692+0000","last_clean":"2023-11-27T20:43:01.886692+0000","last_became_active":"2023-11-27T20:42:59.570596+0000","last_became_peered":"2023-11-27T20:42:59.570596+0000","last_unstale":"2023-11-27T20:43:01.886692+0000","last_undegraded":"2023-11-27T20:43:01.886692+0000","last_fullsized":"2023-11-27T20:43:01.886692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:03:33.251682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.575538+0000","last_change":"2023-11-27T20:42:38.547156+0000","last_active":"2023-11-27T20:42:59.575538+0000","last_peered":"2023-11-27T20:42:59.575538+0000","last_clean":"2023-11-27T20:42:59.575538+0000","last_became_active":"2023-11-27T20:42:38.545609+0000","last_became_peered":"2023-11-27T20:42:38.545609+0000","last_unstale":"2023-11-27T20:42:59.575538+0000","last_undegraded":"2023-11-27T20:42:59.575538+0000","last_fullsized":"2023-11-27T20:42:59.575538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454432+0000","last_change":"2023-11-27T20:42:59.574299+0000","last_active":"2023-11-27T20:43:01.454432+0000","last_peered":"2023-11-27T20:43:01.454432+0000","last_clean":"2023-11-27T20:43:01.454432+0000","last_became_active":"2023-11-27T20:42:59.573397+0000","last_became_peered":"2023-11-27T20:42:59.573397+0000","last_unstale":"2023-11-27T20:43:01.454432+0000","last_undegraded":"2023-11-27T20:43:01.454432+0000","last_fullsized":"2023-11-27T20:43:01.454432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:42.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562015+0000","last_change":"2023-11-27T20:42:38.542428+0000","last_active":"2023-11-27T20:42:59.562015+0000","last_peered":"2023-11-27T20:42:59.562015+0000","last_clean":"2023-11-27T20:42:59.562015+0000","last_became_active":"2023-11-27T20:42:38.542153+0000","last_became_peered":"2023-11-27T20:42:38.542153+0000","last_unstale":"2023-11-27T20:42:59.562015+0000","last_undegraded":"2023-11-27T20:42:59.562015+0000","last_fullsized":"2023-11-27T20:42:59.562015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.570472+0000","last_change":"2023-11-27T20:42:59.568640+0000","last_active":"2023-11-27T20:43:00.570472+0000","last_peered":"2023-11-27T20:43:00.570472+0000","last_clean":"2023-11-27T20:43:00.570472+0000","last_became_active":"2023-11-27T20:42:59.568301+0000","last_became_peered":"2023-11-27T20:42:59.568301+0000","last_unstale":"2023-11-27T20:43:00.570472+0000","last_undegraded":"2023-11-27T20:43:00.570472+0000","last_fullsized":"2023-11-27T20:43:00.570472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:49.633250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.560488+0000","last_change":"2023-11-27T20:42:38.535802+0000","last_active":"2023-11-27T20:42:59.560488+0000","last_peered":"2023-11-27T20:42:59.560488+0000","last_clean":"2023-11-27T20:42:59.560488+0000","last_became_active":"2023-11-27T20:42:38.535498+0000","last_became_peered":"2023-11-27T20:42:38.535498+0000","last_unstale":"2023-11-27T20:42:59.560488+0000","last_undegraded":"2023-11-27T20:42:59.560488+0000","last_fullsized":"2023-11-27T20:42:59.560488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:36:17.405476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.571965+0000","last_change":"2023-11-27T20:42:59.569442+0000","last_active":"2023-11-27T20:43:00.571965+0000","last_peered":"2023-11-27T20:43:00.571965+0000","last_clean":"2023-11-27T20:43:00.571965+0000","last_became_active":"2023-11-27T20:42:59.569177+0000","last_became_peered":"2023-11-27T20:42:59.569177+0000","last_unstale":"2023-11-27T20:43:00.571965+0000","last_undegraded":"2023-11-27T20:43:00.571965+0000","last_fullsized":"2023-11-27T20:43:00.571965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:08.278244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.555765+0000","last_change":"2023-11-27T20:42:38.551263+0000","last_active":"2023-11-27T20:42:59.555765+0000","last_peered":"2023-11-27T20:42:59.555765+0000","last_clean":"2023-11-27T20:42:59.555765+0000","last_became_active":"2023-11-27T20:42:38.545451+0000","last_became_peered":"2023-11-27T20:42:38.545451+0000","last_unstale":"2023-11-27T20:42:59.555765+0000","last_undegraded":"2023-11-27T20:42:59.555765+0000","last_fullsized":"2023-11-27T20:42:59.555765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:45.477552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.573973+0000","last_change":"2023-11-27T20:42:59.579822+0000","last_active":"2023-11-27T20:43:00.573973+0000","last_peered":"2023-11-27T20:43:00.573973+0000","last_clean":"2023-11-27T20:43:00.573973+0000","last_became_active":"2023-11-27T20:42:59.579366+0000","last_became_peered":"2023-11-27T20:42:59.579366+0000","last_unstale":"2023-11-27T20:43:00.573973+0000","last_undegraded":"2023-11-27T20:43:00.573973+0000","last_fullsized":"2023-11-27T20:43:00.573973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:51:14.693897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.552190+0000","last_change":"2023-11-27T20:42:38.534413+0000","last_active":"2023-11-27T20:42:59.552190+0000","last_peered":"2023-11-27T20:42:59.552190+0000","last_clean":"2023-11-27T20:42:59.552190+0000","last_became_active":"2023-11-27T20:42:38.534183+0000","last_became_peered":"2023-11-27T20:42:38.534183+0000","last_unstale":"2023-11-27T20:42:59.552190+0000","last_undegraded":"2023-11-27T20:42:59.552190+0000","last_fullsized":"2023-11-27T20:42:59.552190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.887361+0000","last_change":"2023-11-27T20:42:59.576101+0000","last_active":"2023-11-27T20:43:01.887361+0000","last_peered":"2023-11-27T20:43:01.887361+0000","last_clean":"2023-11-27T20:43:01.887361+0000","last_became_active":"2023-11-27T20:42:59.575705+0000","last_became_peered":"2023-11-27T20:42:59.575705+0000","last_unstale":"2023-11-27T20:43:01.887361+0000","last_undegraded":"2023-11-27T20:43:01.887361+0000","last_fullsized":"2023-11-27T20:43:01.887361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:42.302754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.575843+0000","last_change":"2023-11-27T20:42:38.550553+0000","last_active":"2023-11-27T20:42:59.575843+0000","last_peered":"2023-11-27T20:42:59.575843+0000","last_clean":"2023-11-27T20:42:59.575843+0000","last_became_active":"2023-11-27T20:42:38.550311+0000","last_became_peered":"2023-11-27T20:42:38.550311+0000","last_unstale":"2023-11-27T20:42:59.575843+0000","last_undegraded":"2023-11-27T20:42:59.575843+0000","last_fullsized":"2023-11-27T20:42:59.575843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:54:48.730603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.887658+0000","last_change":"2023-11-27T20:42:59.571338+0000","last_active":"2023-11-27T20:43:01.887658+0000","last_peered":"2023-11-27T20:43:01.887658+0000","last_clean":"2023-11-27T20:43:01.887658+0000","last_became_active":"2023-11-27T20:42:59.571009+0000","last_became_peered":"2023-11-27T20:42:59.571009+0000","last_unstale":"2023-11-27T20:43:01.887658+0000","last_undegraded":"2023-11-27T20:43:01.887658+0000","last_fullsized":"2023-11-27T20:43:01.887658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:07.708387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.545722+0000","last_change":"2023-11-27T20:42:38.561753+0000","last_active":"2023-11-27T20:42:59.545722+0000","last_peered":"2023-11-27T20:42:59.545722+0000","last_clean":"2023-11-27T20:42:59.545722+0000","last_became_active":"2023-11-27T20:42:38.561380+0000","last_became_peered":"2023-11-27T20:42:38.561380+0000","last_unstale":"2023-11-27T20:42:59.545722+0000","last_undegraded":"2023-11-27T20:42:59.545722+0000","last_fullsized":"2023-11-27T20:42:59.545722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:34:03.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.725501+0000","last_change":"2023-11-27T20:42:59.591329+0000","last_active":"2023-11-27T20:43:01.725501+0000","last_peered":"2023-11-27T20:43:01.725501+0000","last_clean":"2023-11-27T20:43:01.725501+0000","last_became_active":"2023-11-27T20:42:59.590915+0000","last_became_peered":"2023-11-27T20:42:59.590915+0000","last_unstale":"2023-11-27T20:43:01.725501+0000","last_undegraded":"2023-11-27T20:43:01.725501+0000","last_fullsized":"2023-11-27T20:43:01.725501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:33:13.023617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.549124+0000","last_change":"2023-11-27T20:42:38.560432+0000","last_active":"2023-11-27T20:42:59.549124+0000","last_peered":"2023-11-27T20:42:59.549124+0000","last_clean":"2023-11-27T20:42:59.549124+0000","last_became_active":"2023-11-27T20:42:38.560192+0000","last_became_peered":"2023-11-27T20:42:38.560192+0000","last_unstale":"2023-11-27T20:42:59.549124+0000","last_undegraded":"2023-11-27T20:42:59.549124+0000","last_fullsized":"2023-11-27T20:42:59.549124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:52.722373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.575774+0000","last_change":"2023-11-27T20:42:59.582784+0000","last_active":"2023-11-27T20:43:00.575774+0000","last_peered":"2023-11-27T20:43:00.575774+0000","last_clean":"2023-11-27T20:43:00.575774+0000","last_became_active":"2023-11-27T20:42:59.582386+0000","last_became_peered":"2023-11-27T20:42:59.582386+0000","last_unstale":"2023-11-27T20:43:00.575774+0000","last_undegraded":"2023-11-27T20:43:00.575774+0000","last_fullsized":"2023-11-27T20:43:00.575774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:13:53.747094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.579741+0000","last_change":"2023-11-27T20:42:38.540846+0000","last_active":"2023-11-27T20:42:59.579741+0000","last_peered":"2023-11-27T20:42:59.579741+0000","last_clean":"2023-11-27T20:42:59.579741+0000","last_became_active":"2023-11-27T20:42:38.540576+0000","last_became_peered":"2023-11-27T20:42:38.540576+0000","last_unstale":"2023-11-27T20:42:59.579741+0000","last_undegraded":"2023-11-27T20:42:59.579741+0000","last_fullsized":"2023-11-27T20:42:59.579741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454219+0000","last_change":"2023-11-27T20:42:59.575533+0000","last_active":"2023-11-27T20:43:01.454219+0000","last_peered":"2023-11-27T20:43:01.454219+0000","last_clean":"2023-11-27T20:43:01.454219+0000","last_became_active":"2023-11-27T20:42:59.575256+0000","last_became_peered":"2023-11-27T20:42:59.575256+0000","last_unstale":"2023-11-27T20:43:01.454219+0000","last_undegraded":"2023-11-27T20:43:01.454219+0000","last_fullsized":"2023-11-27T20:43:01.454219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:46.872709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.568099+0000","last_change":"2023-11-27T20:42:38.546971+0000","last_active":"2023-11-27T20:42:59.568099+0000","last_peered":"2023-11-27T20:42:59.568099+0000","last_clean":"2023-11-27T20:42:59.568099+0000","last_became_active":"2023-11-27T20:42:38.546653+0000","last_became_peered":"2023-11-27T20:42:38.546653+0000","last_unstale":"2023-11-27T20:42:59.568099+0000","last_undegraded":"2023-11-27T20:42:59.568099+0000","last_fullsized":"2023-11-27T20:42:59.568099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.724748+0000","last_change":"2023-11-27T20:42:59.591372+0000","last_active":"2023-11-27T20:43:01.724748+0000","last_peered":"2023-11-27T20:43:01.724748+0000","last_clean":"2023-11-27T20:43:01.724748+0000","last_became_active":"2023-11-27T20:42:59.590970+0000","last_became_peered":"2023-11-27T20:42:59.590970+0000","last_unstale":"2023-11-27T20:43:01.724748+0000","last_undegraded":"2023-11-27T20:43:01.724748+0000","last_fullsized":"2023-11-27T20:43:01.724748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:58:12.206705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.562299+0000","last_change":"2023-11-27T20:42:38.547627+0000","last_active":"2023-11-27T20:42:59.562299+0000","last_peered":"2023-11-27T20:42:59.562299+0000","last_clean":"2023-11-27T20:42:59.562299+0000","last_became_active":"2023-11-27T20:42:38.539984+0000","last_became_peered":"2023-11-27T20:42:38.539984+0000","last_unstale":"2023-11-27T20:42:59.562299+0000","last_undegraded":"2023-11-27T20:42:59.562299+0000","last_fullsized":"2023-11-27T20:42:59.562299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:51:29.394418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.572445+0000","last_change":"2023-11-27T20:42:59.576821+0000","last_active":"2023-11-27T20:43:00.572445+0000","last_peered":"2023-11-27T20:43:00.572445+0000","last_clean":"2023-11-27T20:43:00.572445+0000","last_became_active":"2023-11-27T20:42:59.576496+0000","last_became_peered":"2023-11-27T20:42:59.576496+0000","last_unstale":"2023-11-27T20:43:00.572445+0000","last_undegraded":"2023-11-27T20:43:00.572445+0000","last_fullsized":"2023-11-27T20:43:00.572445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:42.408528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.548020+0000","last_change":"2023-11-27T20:42:38.547129+0000","last_active":"2023-11-27T20:42:59.548020+0000","last_peered":"2023-11-27T20:42:59.548020+0000","last_clean":"2023-11-27T20:42:59.548020+0000","last_became_active":"2023-11-27T20:42:38.546838+0000","last_became_peered":"2023-11-27T20:42:38.546838+0000","last_unstale":"2023-11-27T20:42:59.548020+0000","last_undegraded":"2023-11-27T20:42:59.548020+0000","last_fullsized":"2023-11-27T20:42:59.548020+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:13:37.585057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.568793+0000","last_change":"2023-11-27T20:42:59.565043+0000","last_active":"2023-11-27T20:43:00.568793+0000","last_peered":"2023-11-27T20:43:00.568793+0000","last_clean":"2023-11-27T20:43:00.568793+0000","last_became_active":"2023-11-27T20:42:59.564532+0000","last_became_peered":"2023-11-27T20:42:59.564532+0000","last_unstale":"2023-11-27T20:43:00.568793+0000","last_undegraded":"2023-11-27T20:43:00.568793+0000","last_fullsized":"2023-11-27T20:43:00.568793+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:25:47.547416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.570453+0000","last_change":"2023-11-27T20:42:38.545796+0000","last_active":"2023-11-27T20:42:59.570453+0000","last_peered":"2023-11-27T20:42:59.570453+0000","last_clean":"2023-11-27T20:42:59.570453+0000","last_became_active":"2023-11-27T20:42:38.545553+0000","last_became_peered":"2023-11-27T20:42:38.545553+0000","last_unstale":"2023-11-27T20:42:59.570453+0000","last_undegraded":"2023-11-27T20:42:59.570453+0000","last_fullsized":"2023-11-27T20:42:59.570453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:48:43.682169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455223+0000","last_change":"2023-11-27T20:42:59.585307+0000","last_active":"2023-11-27T20:43:01.455223+0000","last_peered":"2023-11-27T20:43:01.455223+0000","last_clean":"2023-11-27T20:43:01.455223+0000","last_became_active":"2023-11-27T20:42:59.585016+0000","last_became_peered":"2023-11-27T20:42:59.585016+0000","last_unstale":"2023-11-27T20:43:01.455223+0000","last_undegraded":"2023-11-27T20:43:01.455223+0000","last_fullsized":"2023-11-27T20:43:01.455223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:18.960274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.563070+0000","last_change":"2023-11-27T20:42:38.558320+0000","last_active":"2023-11-27T20:42:59.563070+0000","last_peered":"2023-11-27T20:42:59.563070+0000","last_clean":"2023-11-27T20:42:59.563070+0000","last_became_active":"2023-11-27T20:42:38.557951+0000","last_became_peered":"2023-11-27T20:42:38.557951+0000","last_unstale":"2023-11-27T20:42:59.563070+0000","last_undegraded":"2023-11-27T20:42:59.563070+0000","last_fullsized":"2023-11-27T20:42:59.563070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:14:13.735962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455554+0000","last_change":"2023-11-27T20:42:59.587801+0000","last_active":"2023-11-27T20:43:01.455554+0000","last_peered":"2023-11-27T20:43:01.455554+0000","last_clean":"2023-11-27T20:43:01.455554+0000","last_became_active":"2023-11-27T20:42:59.587494+0000","last_became_peered":"2023-11-27T20:42:59.587494+0000","last_unstale":"2023-11-27T20:43:01.455554+0000","last_undegraded":"2023-11-27T20:43:01.455554+0000","last_fullsized":"2023-11-27T20:43:01.455554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:11:45.424458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.576934+0000","last_change":"2023-11-27T20:42:38.547591+0000","last_active":"2023-11-27T20:42:59.576934+0000","last_peered":"2023-11-27T20:42:59.576934+0000","last_clean":"2023-11-27T20:42:59.576934+0000","last_became_active":"2023-11-27T20:42:38.547330+0000","last_became_peered":"2023-11-27T20:42:38.547330+0000","last_unstale":"2023-11-27T20:42:59.576934+0000","last_undegraded":"2023-11-27T20:42:59.576934+0000","last_fullsized":"2023-11-27T20:42:59.576934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.884868+0000","last_change":"2023-11-27T20:42:59.591758+0000","last_active":"2023-11-27T20:43:01.884868+0000","last_peered":"2023-11-27T20:43:01.884868+0000","last_clean":"2023-11-27T20:43:01.884868+0000","last_became_active":"2023-11-27T20:42:59.591408+0000","last_became_peered":"2023-11-27T20:42:59.591408+0000","last_unstale":"2023-11-27T20:43:01.884868+0000","last_undegraded":"2023-11-27T20:43:01.884868+0000","last_fullsized":"2023-11-27T20:43:01.884868+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:42.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.572041+0000","last_change":"2023-11-27T20:42:38.559990+0000","last_active":"2023-11-27T20:42:59.572041+0000","last_peered":"2023-11-27T20:42:59.572041+0000","last_clean":"2023-11-27T20:42:59.572041+0000","last_became_active":"2023-11-27T20:42:38.559736+0000","last_became_peered":"2023-11-27T20:42:38.559736+0000","last_unstale":"2023-11-27T20:42:59.572041+0000","last_undegraded":"2023-11-27T20:42:59.572041+0000","last_fullsized":"2023-11-27T20:42:59.572041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:12.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.455469+0000","last_change":"2023-11-27T20:42:59.578734+0000","last_active":"2023-11-27T20:43:01.455469+0000","last_peered":"2023-11-27T20:43:01.455469+0000","last_clean":"2023-11-27T20:43:01.455469+0000","last_became_active":"2023-11-27T20:42:59.578385+0000","last_became_peered":"2023-11-27T20:42:59.578385+0000","last_unstale":"2023-11-27T20:43:01.455469+0000","last_undegraded":"2023-11-27T20:43:01.455469+0000","last_fullsized":"2023-11-27T20:43:01.455469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:16:45.037441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.559670+0000","last_change":"2023-11-27T20:42:38.538848+0000","last_active":"2023-11-27T20:42:59.559670+0000","last_peered":"2023-11-27T20:42:59.559670+0000","last_clean":"2023-11-27T20:42:59.559670+0000","last_became_active":"2023-11-27T20:42:38.538541+0000","last_became_peered":"2023-11-27T20:42:38.538541+0000","last_unstale":"2023-11-27T20:42:59.559670+0000","last_undegraded":"2023-11-27T20:42:59.559670+0000","last_fullsized":"2023-11-27T20:42:59.559670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.569289+0000","last_change":"2023-11-27T20:42:59.576289+0000","last_active":"2023-11-27T20:43:00.569289+0000","last_peered":"2023-11-27T20:43:00.569289+0000","last_clean":"2023-11-27T20:43:00.569289+0000","last_became_active":"2023-11-27T20:42:59.573829+0000","last_became_peered":"2023-11-27T20:42:59.573829+0000","last_unstale":"2023-11-27T20:43:00.569289+0000","last_undegraded":"2023-11-27T20:43:00.569289+0000","last_fullsized":"2023-11-27T20:43:00.569289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:01.990591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.567521+0000","last_change":"2023-11-27T20:42:38.541486+0000","last_active":"2023-11-27T20:42:59.567521+0000","last_peered":"2023-11-27T20:42:59.567521+0000","last_clean":"2023-11-27T20:42:59.567521+0000","last_became_active":"2023-11-27T20:42:38.541126+0000","last_became_peered":"2023-11-27T20:42:38.541126+0000","last_unstale":"2023-11-27T20:42:59.567521+0000","last_undegraded":"2023-11-27T20:42:59.567521+0000","last_fullsized":"2023-11-27T20:42:59.567521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:46.121594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.884824+0000","last_change":"2023-11-27T20:42:59.574776+0000","last_active":"2023-11-27T20:43:01.884824+0000","last_peered":"2023-11-27T20:43:01.884824+0000","last_clean":"2023-11-27T20:43:01.884824+0000","last_became_active":"2023-11-27T20:42:59.574488+0000","last_became_peered":"2023-11-27T20:42:59.574488+0000","last_unstale":"2023-11-27T20:43:01.884824+0000","last_undegraded":"2023-11-27T20:43:01.884824+0000","last_fullsized":"2023-11-27T20:43:01.884824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:46.872709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.572692+0000","last_change":"2023-11-27T20:42:38.537531+0000","last_active":"2023-11-27T20:42:59.572692+0000","last_peered":"2023-11-27T20:42:59.572692+0000","last_clean":"2023-11-27T20:42:59.572692+0000","last_became_active":"2023-11-27T20:42:38.536923+0000","last_became_peered":"2023-11-27T20:42:38.536923+0000","last_unstale":"2023-11-27T20:42:59.572692+0000","last_undegraded":"2023-11-27T20:42:59.572692+0000","last_fullsized":"2023-11-27T20:42:59.572692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:02.009922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.453999+0000","last_change":"2023-11-27T20:42:59.572395+0000","last_active":"2023-11-27T20:43:01.453999+0000","last_peered":"2023-11-27T20:43:01.453999+0000","last_clean":"2023-11-27T20:43:01.453999+0000","last_became_active":"2023-11-27T20:42:59.571977+0000","last_became_peered":"2023-11-27T20:42:59.571977+0000","last_unstale":"2023-11-27T20:43:01.453999+0000","last_undegraded":"2023-11-27T20:43:01.453999+0000","last_fullsized":"2023-11-27T20:43:01.453999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:06.826970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.547816+0000","last_change":"2023-11-27T20:42:38.557750+0000","last_active":"2023-11-27T20:42:59.547816+0000","last_peered":"2023-11-27T20:42:59.547816+0000","last_clean":"2023-11-27T20:42:59.547816+0000","last_became_active":"2023-11-27T20:42:38.557513+0000","last_became_peered":"2023-11-27T20:42:38.557513+0000","last_unstale":"2023-11-27T20:42:59.547816+0000","last_undegraded":"2023-11-27T20:42:59.547816+0000","last_fullsized":"2023-11-27T20:42:59.547816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:00:16.000787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.574185+0000","last_change":"2023-11-27T20:42:59.592477+0000","last_active":"2023-11-27T20:43:00.574185+0000","last_peered":"2023-11-27T20:43:00.574185+0000","last_clean":"2023-11-27T20:43:00.574185+0000","last_became_active":"2023-11-27T20:42:59.592153+0000","last_became_peered":"2023-11-27T20:42:59.592153+0000","last_unstale":"2023-11-27T20:43:00.574185+0000","last_undegraded":"2023-11-27T20:43:00.574185+0000","last_fullsized":"2023-11-27T20:43:00.574185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:16:45.037441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.570370+0000","last_change":"2023-11-27T20:42:38.554226+0000","last_active":"2023-11-27T20:42:59.570370+0000","last_peered":"2023-11-27T20:42:59.570370+0000","last_clean":"2023-11-27T20:42:59.570370+0000","last_became_active":"2023-11-27T20:42:38.553902+0000","last_became_peered":"2023-11-27T20:42:38.553902+0000","last_unstale":"2023-11-27T20:42:59.570370+0000","last_undegraded":"2023-11-27T20:42:59.570370+0000","last_fullsized":"2023-11-27T20:42:59.570370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:02:27.699633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.886007+0000","last_change":"2023-11-27T20:42:59.574662+0000","last_active":"2023-11-27T20:43:01.886007+0000","last_peered":"2023-11-27T20:43:01.886007+0000","last_clean":"2023-11-27T20:43:01.886007+0000","last_became_active":"2023-11-27T20:42:59.574372+0000","last_became_peered":"2023-11-27T20:42:59.574372+0000","last_unstale":"2023-11-27T20:43:01.886007+0000","last_undegraded":"2023-11-27T20:43:01.886007+0000","last_fullsized":"2023-11-27T20:43:01.886007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:18.960274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.566691+0000","last_change":"2023-11-27T20:42:38.558993+0000","last_active":"2023-11-27T20:42:59.566691+0000","last_peered":"2023-11-27T20:42:59.566691+0000","last_clean":"2023-11-27T20:42:59.566691+0000","last_became_active":"2023-11-27T20:42:38.558259+0000","last_became_peered":"2023-11-27T20:42:38.558259+0000","last_unstale":"2023-11-27T20:42:59.566691+0000","last_undegraded":"2023-11-27T20:42:59.566691+0000","last_fullsized":"2023-11-27T20:42:59.566691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:46:59.198061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:00.573435+0000","last_change":"2023-11-27T20:42:59.590501+0000","last_active":"2023-11-27T20:43:00.573435+0000","last_peered":"2023-11-27T20:43:00.573435+0000","last_clean":"2023-11-27T20:43:00.573435+0000","last_became_active":"2023-11-27T20:42:59.589985+0000","last_became_peered":"2023-11-27T20:42:59.589985+0000","last_unstale":"2023-11-27T20:43:00.573435+0000","last_undegraded":"2023-11-27T20:43:00.573435+0000","last_fullsized":"2023-11-27T20:43:00.573435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:20:18.960274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.563097+0000","last_change":"2023-11-27T20:42:38.558109+0000","last_active":"2023-11-27T20:42:59.563097+0000","last_peered":"2023-11-27T20:42:59.563097+0000","last_clean":"2023-11-27T20:42:59.563097+0000","last_became_active":"2023-11-27T20:42:38.557268+0000","last_became_peered":"2023-11-27T20:42:38.557268+0000","last_unstale":"2023-11-27T20:42:59.563097+0000","last_undegraded":"2023-11-27T20:42:59.563097+0000","last_fullsized":"2023-11-27T20:42:59.563097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:48.349557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.454999+0000","last_change":"2023-11-27T20:42:59.578572+0000","last_active":"2023-11-27T20:43:01.454999+0000","last_peered":"2023-11-27T20:43:01.454999+0000","last_clean":"2023-11-27T20:43:01.454999+0000","last_became_active":"2023-11-27T20:42:59.578201+0000","last_became_peered":"2023-11-27T20:42:59.578201+0000","last_unstale":"2023-11-27T20:43:01.454999+0000","last_undegraded":"2023-11-27T20:43:01.454999+0000","last_fullsized":"2023-11-27T20:43:01.454999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:00.576412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.549026+0000","last_change":"2023-11-27T20:42:38.554526+0000","last_active":"2023-11-27T20:42:59.549026+0000","last_peered":"2023-11-27T20:42:59.549026+0000","last_clean":"2023-11-27T20:42:59.549026+0000","last_became_active":"2023-11-27T20:42:38.554180+0000","last_became_peered":"2023-11-27T20:42:38.554180+0000","last_unstale":"2023-11-27T20:42:59.549026+0000","last_undegraded":"2023-11-27T20:42:59.549026+0000","last_fullsized":"2023-11-27T20:42:59.549026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:21.946714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-27T20:43:01.886860+0000","last_change":"2023-11-27T20:42:59.590858+0000","last_active":"2023-11-27T20:43:01.886860+0000","last_peered":"2023-11-27T20:43:01.886860+0000","last_clean":"2023-11-27T20:43:01.886860+0000","last_became_active":"2023-11-27T20:42:59.590532+0000","last_became_peered":"2023-11-27T20:42:59.590532+0000","last_unstale":"2023-11-27T20:43:01.886860+0000","last_undegraded":"2023-11-27T20:43:01.886860+0000","last_fullsized":"2023-11-27T20:43:01.886860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:58.503002+0000","last_clean_scrub_stamp":"2023-11-27T20:42:58.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:13.432814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-27T20:42:59.553260+0000","last_change":"2023-11-27T20:42:38.539057+0000","last_active":"2023-11-27T20:42:59.553260+0000","last_peered":"2023-11-27T20:42:59.553260+0000","last_clean":"2023-11-27T20:42:59.553260+0000","last_became_active":"2023-11-27T20:42:38.536139+0000","last_became_peered":"2023-11-27T20:42:38.536139+0000","last_unstale":"2023-11-27T20:42:59.553260+0000","last_undegraded":"2023-11-27T20:42:59.553260+0000","last_fullsized":"2023-11-27T20:42:59.553260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:42:37.485705+0000","last_clean_scrub_stamp":"2023-11-27T20:42:37.485705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:14:30.899483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":771070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0800000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2170000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.4850000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.429},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.2649999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.171}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.129},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.6779999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.79},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.724}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":181810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.2270000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.4390000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.2969999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4850000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.177},{"interface":"front","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":3.536,"5min":3.536,"15min":3.536},"last":1.1100000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.3759999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.5609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":181264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.0880000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.381}]},{"osd":2,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.1890000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.232},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":1.4430000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.502},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.7470000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2149999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.577},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.623}]},{"osd":7,"last update":"Mon Nov 27 20:42:28 2023","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.833},{"interface":"front","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.6659999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":182238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.89600000000000002}]},{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.353},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.544}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.603}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.306},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.6579999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.3979999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.2549999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.448},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.484}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":184289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":1.258},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":1.399},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.1639999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.095}]},{"osd":4,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.8050000000000002,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.226}]},{"osd":5,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.4159999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.363},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.3049999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:42:24 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.3340000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":182226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.0649999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.82899999999999996},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.431}]},{"osd":3,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.282},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.3149999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.123},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.367}]},{"osd":5,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":1.413},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.4950000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":1.2310000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.4710000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":183721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.81000000000000005}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.29}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.198}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.4670000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.248}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.421}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.627}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":770924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.248},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.0469999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.98399999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.365}]},{"osd":4,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.2809999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.581},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.1140000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.504},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.4550000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.21},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.407}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:43:09.603 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T20:43:09.604 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-27T20:43:09.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.857+0000 7f474c610640 1 Processor -- start 2023-11-27T20:43:09.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.857+0000 7f474c610640 1 -- start start 2023-11-27T20:43:09.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.859+0000 7f474c610640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f47440c45d0 0x7f4744155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.859+0000 7f474c610640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 0x7f4744156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.859+0000 7f474c610640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47440bfdc0 con 0x7f47440c5ec0 2023-11-27T20:43:09.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.859+0000 7f474c610640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474406e390 con 0x7f47440c45d0 2023-11-27T20:43:09.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.859+0000 7f474c610640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474406ddd0 con 0x7f47440c3340 2023-11-27T20:43:09.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.859+0000 7f4749bab640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f47440c45d0 0x7f4744155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.859+0000 7f474a3ac640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f47440c5ec0 0x7f47440c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36180/0 (socket says 172.21.15.91:36180) 2023-11-27T20:43:09.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.859+0000 7f474a3ac640 1 -- 172.21.15.91:0/2696357069 learned_addr learned my addr 172.21.15.91:0/2696357069 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:09.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.859+0000 7f4749bab640 1 --2- 172.21.15.91:0/2696357069 >> v2:172.21.15.91:3300/0 conn(0x7f47440c45d0 0x7f4744155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52352/0 (socket says 172.21.15.91:52352) 2023-11-27T20:43:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.860+0000 7f474abad640 1 --2- 172.21.15.91:0/2696357069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 0x7f4744156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.860+0000 7f4749bab640 1 -- 172.21.15.91:0/2696357069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 msgr2=0x7f4744156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.860+0000 7f4749bab640 1 --2- 172.21.15.91:0/2696357069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 0x7f4744156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.860+0000 7f4749bab640 1 -- 172.21.15.91:0/2696357069 >> v1:172.21.15.91:6789/0 conn(0x7f47440c5ec0 legacy=0x7f47440c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.860+0000 7f4749bab640 1 -- 172.21.15.91:0/2696357069 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474406e0b0 con 0x7f47440c45d0 2023-11-27T20:43:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.860+0000 7f47493aa640 1 -- 172.21.15.91:0/2696357069 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729102588 0 0) 0x7f47440bfdc0 con 0x7f47440c5ec0 2023-11-27T20:43:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.861+0000 7f4749bab640 1 --2- 172.21.15.91:0/2696357069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 0x7f4744155e30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f47340097d0 tx=0x7f473402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d5515f8e4eb14f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:09.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.861+0000 7f47493aa640 1 -- 172.21.15.91:0/2696357069 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47340316f0 con 0x7f47440c45d0 2023-11-27T20:43:09.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.861+0000 7f47493aa640 1 -- 172.21.15.91:0/2696357069 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4734031850 con 0x7f47440c45d0 2023-11-27T20:43:09.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.861+0000 7f47493aa640 1 -- 172.21.15.91:0/2696357069 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734031be0 con 0x7f47440c45d0 2023-11-27T20:43:09.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.862+0000 7f474c610640 1 -- 172.21.15.91:0/2696357069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 msgr2=0x7f4744155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:09.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.862+0000 7f474c610640 1 --2- 172.21.15.91:0/2696357069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 0x7f4744155e30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f47340097d0 tx=0x7f473402b790 comp rx=0 tx=0).stop 2023-11-27T20:43:09.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.862+0000 7f474c610640 1 -- 172.21.15.91:0/2696357069 shutdown_connections 2023-11-27T20:43:09.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.862+0000 7f474c610640 1 --2- 172.21.15.91:0/2696357069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 0x7f4744156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.862+0000 7f474c610640 1 --2- 172.21.15.91:0/2696357069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 0x7f4744155e30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.862+0000 7f474c610640 1 -- 172.21.15.91:0/2696357069 >> 172.21.15.91:0/2696357069 conn(0x7f474406a500 msgr2=0x7f474406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:09.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.862+0000 7f474c610640 1 -- 172.21.15.91:0/2696357069 shutdown_connections 2023-11-27T20:43:09.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.862+0000 7f474c610640 1 -- 172.21.15.91:0/2696357069 wait complete. 2023-11-27T20:43:09.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.864+0000 7f474c610640 1 Processor -- start 2023-11-27T20:43:09.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.864+0000 7f474c610640 1 -- start start 2023-11-27T20:43:09.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f474c610640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 0x7f4744155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f474c610640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 0x7f474414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f474c610640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47440c5ec0 0x7f47441e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f474c610640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4744155610 con 0x7f47440c45d0 2023-11-27T20:43:09.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f474c610640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4744158210 con 0x7f47440c5ec0 2023-11-27T20:43:09.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f474c610640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47440a7c50 con 0x7f47440c3340 2023-11-27T20:43:09.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f4749bab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 0x7f474414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f4749bab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 0x7f474414e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52366/0 (socket says 172.21.15.91:52366) 2023-11-27T20:43:09.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f4749bab640 1 -- 172.21.15.91:0/3404541513 learned_addr learned my addr 172.21.15.91:0/3404541513 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:09.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f4749bab640 1 -- 172.21.15.91:0/3404541513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 msgr2=0x7f4744155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:09.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f474a3ac640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 0x7f4744155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f474abad640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47440c5ec0 0x7f47441e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f4749bab640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 0x7f4744155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f4749bab640 1 -- 172.21.15.91:0/3404541513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47440c5ec0 msgr2=0x7f47441e9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f4749bab640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47440c5ec0 0x7f47441e9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f4749bab640 1 -- 172.21.15.91:0/3404541513 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4734009400 con 0x7f47440c45d0 2023-11-27T20:43:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.865+0000 7f474a3ac640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 0x7f4744155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.866+0000 7f474abad640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47440c5ec0 0x7f47441e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.866+0000 7f4749bab640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 0x7f474414e4b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4734037040 tx=0x7f47340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.866+0000 7f473affd640 1 -- 172.21.15.91:0/3404541513 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734034890 con 0x7f47440c45d0 2023-11-27T20:43:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.866+0000 7f473affd640 1 -- 172.21.15.91:0/3404541513 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4734034a10 con 0x7f47440c45d0 2023-11-27T20:43:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.866+0000 7f473affd640 1 -- 172.21.15.91:0/3404541513 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734034dc0 con 0x7f47440c45d0 2023-11-27T20:43:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.866+0000 7f474c610640 1 -- 172.21.15.91:0/3404541513 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47440a7f30 con 0x7f47440c45d0 2023-11-27T20:43:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.866+0000 7f474c610640 1 -- 172.21.15.91:0/3404541513 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47440a59d0 con 0x7f47440c45d0 2023-11-27T20:43:09.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.867+0000 7f474c610640 1 -- 172.21.15.91:0/3404541513 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47441557c0 con 0x7f47440c45d0 2023-11-27T20:43:09.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.868+0000 7f473affd640 1 -- 172.21.15.91:0/3404541513 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f473403b040 con 0x7f47440c45d0 2023-11-27T20:43:09.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.869+0000 7f473affd640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f472806b1c0 0x7f472806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:09.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.869+0000 7f473affd640 1 -- 172.21.15.91:0/3404541513 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f47340ab750 con 0x7f47440c45d0 2023-11-27T20:43:09.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.869+0000 7f474a3ac640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f472806b1c0 0x7f472806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:09.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.870+0000 7f474a3ac640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f472806b1c0 0x7f472806d680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4740000f60 tx=0x7f4740009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:09.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:09.873+0000 7f473affd640 1 -- 172.21.15.91:0/3404541513 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f47441557c0 con 0x7f47440c45d0 2023-11-27T20:43:10.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.128+0000 7f474c610640 1 -- 172.21.15.91:0/3404541513 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f47441557c0 con 0x7f47440c45d0 2023-11-27T20:43:10.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.133+0000 7f473affd640 1 -- 172.21.15.91:0/3404541513 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v16) v1 ==== 185+0+142 (secure 0 0 0) 0x7f47441557c0 con 0x7f47440c45d0 2023-11-27T20:43:10.134 INFO:teuthology.orchestra.run.smithi091.stdout:[client.1] 2023-11-27T20:43:10.134 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5/mRlsqHoLBAAzs5TAvGaf/SnzmZfDewgAg== 2023-11-27T20:43:10.135 INFO:teuthology.orchestra.run.smithi091.stdout: caps mds = "allow" 2023-11-27T20:43:10.135 INFO:teuthology.orchestra.run.smithi091.stdout: caps mon = "allow r" 2023-11-27T20:43:10.135 INFO:teuthology.orchestra.run.smithi091.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-27T20:43:10.135 INFO:teuthology.orchestra.run.smithi091.stderr:updated caps for client.1 2023-11-27T20:43:10.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.135+0000 7f474c610640 1 -- 172.21.15.91:0/3404541513 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f472806b1c0 msgr2=0x7f472806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.135+0000 7f474c610640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f472806b1c0 0x7f472806d680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4740000f60 tx=0x7f4740009040 comp rx=0 tx=0).stop 2023-11-27T20:43:10.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.135+0000 7f474c610640 1 -- 172.21.15.91:0/3404541513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 msgr2=0x7f474414e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.135+0000 7f474c610640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 0x7f474414e4b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4734037040 tx=0x7f47340046c0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.135+0000 7f474c610640 1 -- 172.21.15.91:0/3404541513 shutdown_connections 2023-11-27T20:43:10.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.135+0000 7f474c610640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f472806b1c0 0x7f472806d680 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.135+0000 7f474c610640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47440c5ec0 0x7f47441e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.135+0000 7f474c610640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47440c45d0 0x7f474414e4b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.135+0000 7f474c610640 1 --2- 172.21.15.91:0/3404541513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47440c3340 0x7f4744155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.135+0000 7f474c610640 1 -- 172.21.15.91:0/3404541513 >> 172.21.15.91:0/3404541513 conn(0x7f474406a500 msgr2=0x7f47440c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:10.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.136+0000 7f474c610640 1 -- 172.21.15.91:0/3404541513 shutdown_connections 2023-11-27T20:43:10.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.136+0000 7f474c610640 1 -- 172.21.15.91:0/3404541513 wait complete. 2023-11-27T20:43:10.154 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:43:10.154 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:10.214 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:43:10.215 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:10.267 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:10.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.481+0000 7f28634ad640 1 Processor -- start 2023-11-27T20:43:10.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.482+0000 7f28634ad640 1 -- start start 2023-11-27T20:43:10.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.483+0000 7f28634ad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f285c06d0a0 0x7f285c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.483+0000 7f28634ad640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f285c0c3ea0 0x7f285c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.483+0000 7f28634ad640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c0c64a0 con 0x7f285c14fd30 2023-11-27T20:43:10.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.483+0000 7f28634ad640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c0c5c00 con 0x7f285c0c3ea0 2023-11-27T20:43:10.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.483+0000 7f28634ad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0c5ee0 con 0x7f285c06d0a0 2023-11-27T20:43:10.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.483+0000 7f2861a4a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f285c0c3ea0 0x7f285c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.483+0000 7f2861a4a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f285c0c3ea0 0x7f285c0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52372/0 (socket says 172.21.15.91:52372) 2023-11-27T20:43:10.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.484+0000 7f2861a4a640 1 -- 172.21.15.91:0/189508272 learned_addr learned my addr 172.21.15.91:0/189508272 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:10.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.484+0000 7f2860a48640 1 --2- 172.21.15.91:0/189508272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f285c06d0a0 0x7f285c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.484+0000 7f2861a4a640 1 -- 172.21.15.91:0/189508272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f285c06d0a0 msgr2=0x7f285c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:10.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.484+0000 7f2861a4a640 1 --2- 172.21.15.91:0/189508272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f285c06d0a0 0x7f285c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.484+0000 7f2861a4a640 1 -- 172.21.15.91:0/189508272 >> v1:172.21.15.183:6789/0 conn(0x7f285c14fd30 legacy=0x7f285c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:10.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.484+0000 7f2861a4a640 1 -- 172.21.15.91:0/189508272 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0c61c0 con 0x7f285c0c3ea0 2023-11-27T20:43:10.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.485+0000 7f2861a4a640 1 --2- 172.21.15.91:0/189508272 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c0c3ea0 0x7f285c0c4330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2854009e50 tx=0x7f285402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6172bc75619c0505 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:10.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.485+0000 7f2853fff640 1 -- 172.21.15.91:0/189508272 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285402ca70 con 0x7f285c0c3ea0 2023-11-27T20:43:10.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.485+0000 7f2853fff640 1 -- 172.21.15.91:0/189508272 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285402cbd0 con 0x7f285c0c3ea0 2023-11-27T20:43:10.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.485+0000 7f2853fff640 1 -- 172.21.15.91:0/189508272 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540343f0 con 0x7f285c0c3ea0 2023-11-27T20:43:10.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.486+0000 7f28634ad640 1 -- 172.21.15.91:0/189508272 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c0c3ea0 msgr2=0x7f285c0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.486+0000 7f28634ad640 1 --2- 172.21.15.91:0/189508272 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c0c3ea0 0x7f285c0c4330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2854009e50 tx=0x7f285402bed0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.486+0000 7f28634ad640 1 -- 172.21.15.91:0/189508272 shutdown_connections 2023-11-27T20:43:10.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.486+0000 7f28634ad640 1 --2- 172.21.15.91:0/189508272 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c0c3ea0 0x7f285c0c4330 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.486+0000 7f28634ad640 1 --2- 172.21.15.91:0/189508272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f285c06d0a0 0x7f285c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.486+0000 7f28634ad640 1 -- 172.21.15.91:0/189508272 >> 172.21.15.91:0/189508272 conn(0x7f285c06a500 msgr2=0x7f285c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:10.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.486+0000 7f28634ad640 1 -- 172.21.15.91:0/189508272 shutdown_connections 2023-11-27T20:43:10.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.486+0000 7f28634ad640 1 -- 172.21.15.91:0/189508272 wait complete. 2023-11-27T20:43:10.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.488+0000 7f28634ad640 1 Processor -- start 2023-11-27T20:43:10.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.488+0000 7f28634ad640 1 -- start start 2023-11-27T20:43:10.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.489+0000 7f28634ad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f285c06d0a0 0x7f285c1eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.489+0000 7f28634ad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f285c0c3ea0 0x7f285c0a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.489+0000 7f28634ad640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c14fd30 0x7f285c06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.489+0000 7f28634ad640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0c0d30 con 0x7f285c14fd30 2023-11-27T20:43:10.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.489+0000 7f28634ad640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c071af0 con 0x7f285c06d0a0 2023-11-27T20:43:10.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.489+0000 7f28634ad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c071810 con 0x7f285c0c3ea0 2023-11-27T20:43:10.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2861a4a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c14fd30 0x7f285c06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2861a4a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c14fd30 0x7f285c06fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52378/0 (socket says 172.21.15.91:52378) 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2861a4a640 1 -- 172.21.15.91:0/836556682 learned_addr learned my addr 172.21.15.91:0/836556682 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2861249640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f285c06d0a0 0x7f285c1eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2860a48640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f285c0c3ea0 0x7f285c0a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2861a4a640 1 -- 172.21.15.91:0/836556682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f285c0c3ea0 msgr2=0x7f285c0a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2861a4a640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f285c0c3ea0 0x7f285c0a9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2861a4a640 1 -- 172.21.15.91:0/836556682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f285c06d0a0 msgr2=0x7f285c1eabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2861a4a640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f285c06d0a0 0x7f285c1eabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2861a4a640 1 -- 172.21.15.91:0/836556682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2854009b30 con 0x7f285c14fd30 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.490+0000 7f2861a4a640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c14fd30 0x7f285c06fda0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2854036040 tx=0x7f2854004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.491+0000 7f2851ffb640 1 -- 172.21.15.91:0/836556682 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854009510 con 0x7f285c14fd30 2023-11-27T20:43:10.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.491+0000 7f2851ffb640 1 -- 172.21.15.91:0/836556682 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285403e450 con 0x7f285c14fd30 2023-11-27T20:43:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.491+0000 7f2851ffb640 1 -- 172.21.15.91:0/836556682 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285403e7e0 con 0x7f285c14fd30 2023-11-27T20:43:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.491+0000 7f28634ad640 1 -- 172.21.15.91:0/836556682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c1ea0e0 con 0x7f285c14fd30 2023-11-27T20:43:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.491+0000 7f28634ad640 1 -- 172.21.15.91:0/836556682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c1ea6a0 con 0x7f285c14fd30 2023-11-27T20:43:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.492+0000 7f28634ad640 1 -- 172.21.15.91:0/836556682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c1ea8c0 con 0x7f285c14fd30 2023-11-27T20:43:10.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.493+0000 7f2851ffb640 1 -- 172.21.15.91:0/836556682 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f285403e940 con 0x7f285c14fd30 2023-11-27T20:43:10.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.494+0000 7f2851ffb640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f284006b1c0 0x7f284006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.494+0000 7f2851ffb640 1 -- 172.21.15.91:0/836556682 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f28540acb00 con 0x7f285c14fd30 2023-11-27T20:43:10.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.494+0000 7f2861249640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f284006b1c0 0x7f284006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.495+0000 7f2861249640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f284006b1c0 0x7f284006d680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2858004ea0 tx=0x7f2858009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:10.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.498+0000 7f2851ffb640 1 -- 172.21.15.91:0/836556682 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2854077500 con 0x7f285c14fd30 2023-11-27T20:43:10.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.694+0000 7f28634ad640 1 -- 172.21.15.91:0/836556682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f285c068350 con 0x7f285c14fd30 2023-11-27T20:43:10.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.696+0000 7f2851ffb640 1 -- 172.21.15.91:0/836556682 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20194 (secure 0 0 0) 0x7f2854043090 con 0x7f285c14fd30 2023-11-27T20:43:10.698 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:10.698 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":38,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:00.559657+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:10.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.699+0000 7f28634ad640 1 -- 172.21.15.91:0/836556682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f284006b1c0 msgr2=0x7f284006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.699+0000 7f28634ad640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f284006b1c0 0x7f284006d680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2858004ea0 tx=0x7f2858009040 comp rx=0 tx=0).stop 2023-11-27T20:43:10.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.699+0000 7f28634ad640 1 -- 172.21.15.91:0/836556682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c14fd30 msgr2=0x7f285c06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.699+0000 7f28634ad640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c14fd30 0x7f285c06fda0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2854036040 tx=0x7f2854004a40 comp rx=0 tx=0).stop 2023-11-27T20:43:10.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.699+0000 7f28634ad640 1 -- 172.21.15.91:0/836556682 shutdown_connections 2023-11-27T20:43:10.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.699+0000 7f28634ad640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f285c14fd30 0x7f285c06fda0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.699+0000 7f28634ad640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f285c0c3ea0 0x7f285c0a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.699+0000 7f28634ad640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f284006b1c0 0x7f284006d680 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.699+0000 7f28634ad640 1 --2- 172.21.15.91:0/836556682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f285c06d0a0 0x7f285c1eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.699+0000 7f28634ad640 1 -- 172.21.15.91:0/836556682 >> 172.21.15.91:0/836556682 conn(0x7f285c06a500 msgr2=0x7f285c0a7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:10.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.700+0000 7f28634ad640 1 -- 172.21.15.91:0/836556682 shutdown_connections 2023-11-27T20:43:10.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.700+0000 7f28634ad640 1 -- 172.21.15.91:0/836556682 wait complete. 2023-11-27T20:43:10.721 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:42:35.743447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:42:36.976231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:42:56.585972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:42:58.003354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:43:10.721 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:43:10.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.938+0000 7f2520817640 1 Processor -- start 2023-11-27T20:43:10.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.938+0000 7f2520817640 1 -- start start 2023-11-27T20:43:10.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.939+0000 7f2520817640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f251c152f20 0x7f251c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.939+0000 7f2520817640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c0c64a0 con 0x7f251c06d0a0 2023-11-27T20:43:10.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.939+0000 7f2520817640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c0c5c00 con 0x7f251c14fd30 2023-11-27T20:43:10.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.939+0000 7f2520817640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c0c5ee0 con 0x7f251c152f20 2023-11-27T20:43:10.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.940+0000 7f2519d9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f251c06d0a0 0x7f251c0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36182/0 (socket says 172.21.15.91:36182) 2023-11-27T20:43:10.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.940+0000 7f2519d9b640 1 -- 172.21.15.91:0/3144086960 learned_addr learned my addr 172.21.15.91:0/3144086960 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:10.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.940+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061036585 0 0) 0x7f251c0c64a0 con 0x7f251c06d0a0 2023-11-27T20:43:10.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.940+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2504003520 con 0x7f251c06d0a0 2023-11-27T20:43:10.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.940+0000 7f251ad9d640 1 --2- 172.21.15.91:0/3144086960 >> v2:172.21.15.183:3300/0 conn(0x7f251c152f20 0x7f251c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1968351799 0 0) 0x7f2504003520 con 0x7f251c06d0a0 2023-11-27T20:43:10.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 >> v2:172.21.15.183:3300/0 conn(0x7f251c152f20 msgr2=0x7f251c0c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:10.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 --2- 172.21.15.91:0/3144086960 >> v2:172.21.15.183:3300/0 conn(0x7f251c152f20 0x7f251c0c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 >> v1:172.21.15.183:6789/0 conn(0x7f251c14fd30 legacy=0x7f251c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0c61c0 con 0x7f251c06d0a0 2023-11-27T20:43:10.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f2510001670 con 0x7f251c06d0a0 2023-11-27T20:43:10.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 >> v1:172.21.15.91:6789/0 conn(0x7f251c06d0a0 legacy=0x7f251c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 --2- 172.21.15.91:0/3144086960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2504003970 0x7f2504003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 --2- 172.21.15.91:0/3144086960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25040047c0 0x7f2504004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 --2- 172.21.15.91:0/3144086960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2504005180 0x7f250400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0c5ee0 con 0x7f2504003970 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250400c020 con 0x7f25040047c0 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250400c1e0 con 0x7f2504005180 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251a59c640 1 --2- 172.21.15.91:0/3144086960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2504003970 0x7f2504003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251a59c640 1 -- 172.21.15.91:0/3144086960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2504005180 msgr2=0x7f250400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251a59c640 1 --2- 172.21.15.91:0/3144086960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2504005180 0x7f250400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251a59c640 1 -- 172.21.15.91:0/3144086960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25040047c0 msgr2=0x7f2504004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:10.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251a59c640 1 --2- 172.21.15.91:0/3144086960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25040047c0 0x7f2504004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251a59c640 1 -- 172.21.15.91:0/3144086960 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2504003520 con 0x7f2504003970 2023-11-27T20:43:10.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.941+0000 7f251ad9d640 1 -- 172.21.15.91:0/3144086960 reap_dead start 2023-11-27T20:43:10.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.943+0000 7f251a59c640 1 --2- 172.21.15.91:0/3144086960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2504003970 0x7f2504003d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f250c001750 tx=0x7f25040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2da4324a39bade server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:10.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.943+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c0052d0 con 0x7f2504003970 2023-11-27T20:43:10.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.943+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c02e050 con 0x7f2504003970 2023-11-27T20:43:10.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.943+0000 7f251959a640 1 -- 172.21.15.91:0/3144086960 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c003830 con 0x7f2504003970 2023-11-27T20:43:10.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.943+0000 7f2520817640 1 -- 172.21.15.91:0/3144086960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2504003970 msgr2=0x7f2504003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.943+0000 7f2520817640 1 --2- 172.21.15.91:0/3144086960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2504003970 0x7f2504003d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f250c001750 tx=0x7f25040057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.943+0000 7f2520817640 1 -- 172.21.15.91:0/3144086960 shutdown_connections 2023-11-27T20:43:10.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.943+0000 7f2520817640 1 --2- 172.21.15.91:0/3144086960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2504003970 0x7f2504003d90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.943+0000 7f2520817640 1 -- 172.21.15.91:0/3144086960 >> 172.21.15.91:0/3144086960 conn(0x7f251c06a500 msgr2=0x7f251c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:10.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.944+0000 7f2520817640 1 -- 172.21.15.91:0/3144086960 shutdown_connections 2023-11-27T20:43:10.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.944+0000 7f2520817640 1 -- 172.21.15.91:0/3144086960 wait complete. 2023-11-27T20:43:10.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.945+0000 7f2520817640 1 Processor -- start 2023-11-27T20:43:10.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.945+0000 7f2520817640 1 -- start start 2023-11-27T20:43:10.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.946+0000 7f2520817640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2504003970 0x7f251c0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.946+0000 7f2520817640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f251c0a84c0 0x7f251c150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.946+0000 7f2520817640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f251c1ee090 0x7f251c1e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.946+0000 7f2520817640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c1edc00 con 0x7f251c0a84c0 2023-11-27T20:43:10.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.946+0000 7f2520817640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0aae80 con 0x7f2504003970 2023-11-27T20:43:10.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.946+0000 7f2520817640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c151a80 con 0x7f251c1ee090 2023-11-27T20:43:10.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.946+0000 7f2519d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f251c0a84c0 0x7f251c150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f2519d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f251c0a84c0 0x7f251c150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52396/0 (socket says 172.21.15.91:52396) 2023-11-27T20:43:10.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f2519d9b640 1 -- 172.21.15.91:0/4002800696 learned_addr learned my addr 172.21.15.91:0/4002800696 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:10.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f251a59c640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2504003970 0x7f251c0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f2519d9b640 1 -- 172.21.15.91:0/4002800696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f251c1ee090 msgr2=0x7f251c1e9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f2519d9b640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f251c1ee090 0x7f251c1e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f2519d9b640 1 -- 172.21.15.91:0/4002800696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2504003970 msgr2=0x7f251c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:10.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f2519d9b640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2504003970 0x7f251c0aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:10.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f2519d9b640 1 -- 172.21.15.91:0/4002800696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0aaba0 con 0x7f251c0a84c0 2023-11-27T20:43:10.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f2519d9b640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f251c0a84c0 0x7f251c150f70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2510000fd0 tx=0x7f251000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:10.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f250affd640 1 -- 172.21.15.91:0/4002800696 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25100072d0 con 0x7f251c0a84c0 2023-11-27T20:43:10.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f250affd640 1 -- 172.21.15.91:0/4002800696 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2510007450 con 0x7f251c0a84c0 2023-11-27T20:43:10.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f250affd640 1 -- 172.21.15.91:0/4002800696 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25100047e0 con 0x7f251c0a84c0 2023-11-27T20:43:10.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.947+0000 7f2520817640 1 -- 172.21.15.91:0/4002800696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c1ed5b0 con 0x7f251c0a84c0 2023-11-27T20:43:10.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.948+0000 7f2520817640 1 -- 172.21.15.91:0/4002800696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c1514b0 con 0x7f251c0a84c0 2023-11-27T20:43:10.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.949+0000 7f2520817640 1 -- 172.21.15.91:0/4002800696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c1edd70 con 0x7f251c0a84c0 2023-11-27T20:43:10.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.950+0000 7f250affd640 1 -- 172.21.15.91:0/4002800696 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2510004940 con 0x7f251c0a84c0 2023-11-27T20:43:10.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.951+0000 7f250affd640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f24fc06b1f0 0x7f24fc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:10.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.951+0000 7f250affd640 1 -- 172.21.15.91:0/4002800696 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f25100890c0 con 0x7f251c0a84c0 2023-11-27T20:43:10.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.951+0000 7f251a59c640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f24fc06b1f0 0x7f24fc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:10.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.952+0000 7f251a59c640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f24fc06b1f0 0x7f24fc06d6b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f250c033000 tx=0x7f250c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:10.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:10.955+0000 7f250affd640 1 -- 172.21.15.91:0/4002800696 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2510053a80 con 0x7f251c0a84c0 2023-11-27T20:43:11.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.131+0000 7f2520817640 1 -- 172.21.15.91:0/4002800696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f251c068350 con 0x7f251c0a84c0 2023-11-27T20:43:11.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.132+0000 7f250affd640 1 -- 172.21.15.91:0/4002800696 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25100180a0 con 0x7f251c0a84c0 2023-11-27T20:43:11.133 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:43:11.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.134+0000 7f2520817640 1 -- 172.21.15.91:0/4002800696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f24fc06b1f0 msgr2=0x7f24fc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.134+0000 7f2520817640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f24fc06b1f0 0x7f24fc06d6b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f250c033000 tx=0x7f250c009030 comp rx=0 tx=0).stop 2023-11-27T20:43:11.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.134+0000 7f2520817640 1 -- 172.21.15.91:0/4002800696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f251c0a84c0 msgr2=0x7f251c150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.134+0000 7f2520817640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f251c0a84c0 0x7f251c150f70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2510000fd0 tx=0x7f251000cb90 comp rx=0 tx=0).stop 2023-11-27T20:43:11.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.134+0000 7f2520817640 1 -- 172.21.15.91:0/4002800696 shutdown_connections 2023-11-27T20:43:11.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.134+0000 7f2520817640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f251c1ee090 0x7f251c1e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.134+0000 7f2520817640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f251c0a84c0 0x7f251c150f70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.134+0000 7f2520817640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f24fc06b1f0 0x7f24fc06d6b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.134+0000 7f2520817640 1 --2- 172.21.15.91:0/4002800696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2504003970 0x7f251c0aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.134+0000 7f2520817640 1 -- 172.21.15.91:0/4002800696 >> 172.21.15.91:0/4002800696 conn(0x7f251c06a500 msgr2=0x7f251c0bff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:11.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.135+0000 7f2520817640 1 -- 172.21.15.91:0/4002800696 shutdown_connections 2023-11-27T20:43:11.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.135+0000 7f2520817640 1 -- 172.21.15.91:0/4002800696 wait complete. 2023-11-27T20:43:11.154 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:43:11.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.366+0000 7fc87552c640 1 Processor -- start 2023-11-27T20:43:11.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.366+0000 7fc87552c640 1 -- start start 2023-11-27T20:43:11.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.368+0000 7fc87552c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc87006d0a0 0x7fc870152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.368+0000 7fc87552c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8700c64a0 con 0x7fc8700c3ea0 2023-11-27T20:43:11.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.368+0000 7fc87552c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8700c5c00 con 0x7fc87014fd30 2023-11-27T20:43:11.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.368+0000 7fc87552c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700c5ee0 con 0x7fc87006d0a0 2023-11-27T20:43:11.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.368+0000 7fc86f7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fc8700c3ea0 0x7fc8700c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36198/0 (socket says 172.21.15.91:36198) 2023-11-27T20:43:11.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.368+0000 7fc86f7fe640 1 -- 172.21.15.91:0/2027729206 learned_addr learned my addr 172.21.15.91:0/2027729206 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:11.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86e7fc640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc87006d0a0 0x7fc870152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168312389 0 0) 0x7fc8700c64a0 con 0x7fc8700c3ea0 2023-11-27T20:43:11.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc858003520 con 0x7fc8700c3ea0 2023-11-27T20:43:11.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3455072991 0 0) 0x7fc858003520 con 0x7fc8700c3ea0 2023-11-27T20:43:11.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc87006d0a0 msgr2=0x7fc870152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc87006d0a0 0x7fc870152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 >> v1:172.21.15.183:6789/0 conn(0x7fc87014fd30 legacy=0x7fc8700a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8700c61c0 con 0x7fc8700c3ea0 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fc8680019f0 con 0x7fc8700c3ea0 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 >> v1:172.21.15.91:6789/0 conn(0x7fc8700c3ea0 legacy=0x7fc8700c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8580039a0 0x7fc858003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc87006d0a0 0x7fc8580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc858004d00 0x7fc858005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700c5ee0 con 0x7fc8580039a0 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85800ba30 con 0x7fc858004d00 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.369+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85800bbf0 con 0x7fc87006d0a0 2023-11-27T20:43:11.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.370+0000 7fc86effd640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8580039a0 0x7fc858003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.370+0000 7fc86e7fc640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc87006d0a0 0x7fc8580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.370+0000 7fc86f7fe640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc858004d00 0x7fc858005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.370+0000 7fc86effd640 1 -- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc87006d0a0 msgr2=0x7fc8580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:11.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.370+0000 7fc86effd640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc87006d0a0 0x7fc8580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.370+0000 7fc86effd640 1 -- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc858004d00 msgr2=0x7fc858005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:11.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.370+0000 7fc86effd640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc858004d00 0x7fc858005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.370+0000 7fc86effd640 1 -- 172.21.15.91:0/2027729206 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858003520 con 0x7fc8580039a0 2023-11-27T20:43:11.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.372+0000 7fc86effd640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8580039a0 0x7fc858003dc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc860001720 tx=0x7fc8580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a30fe11c446b90 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:11.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.372+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600052d0 con 0x7fc8580039a0 2023-11-27T20:43:11.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.372+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86002e050 con 0x7fc8580039a0 2023-11-27T20:43:11.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.372+0000 7fc86dffb640 1 -- 172.21.15.91:0/2027729206 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860003830 con 0x7fc8580039a0 2023-11-27T20:43:11.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.372+0000 7fc87552c640 1 -- 172.21.15.91:0/2027729206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8580039a0 msgr2=0x7fc858003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.373+0000 7fc87552c640 1 --2- 172.21.15.91:0/2027729206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8580039a0 0x7fc858003dc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc860001720 tx=0x7fc8580057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.373+0000 7fc86f7fe640 1 -- 172.21.15.91:0/2027729206 reap_dead start 2023-11-27T20:43:11.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.373+0000 7fc87552c640 1 -- 172.21.15.91:0/2027729206 shutdown_connections 2023-11-27T20:43:11.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.373+0000 7fc87552c640 1 -- 172.21.15.91:0/2027729206 >> 172.21.15.91:0/2027729206 conn(0x7fc87006a500 msgr2=0x7fc87006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:11.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.373+0000 7fc87552c640 1 -- 172.21.15.91:0/2027729206 shutdown_connections 2023-11-27T20:43:11.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.373+0000 7fc87552c640 1 -- 172.21.15.91:0/2027729206 wait complete. 2023-11-27T20:43:11.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.374+0000 7fc87552c640 1 Processor -- start 2023-11-27T20:43:11.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.375+0000 7fc87552c640 1 -- start start 2023-11-27T20:43:11.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.375+0000 7fc87552c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc870155ca0 0x7fc8701514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.375+0000 7fc87552c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8701e06e0 0x7fc87014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.375+0000 7fc87552c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc87014f4b0 0x7fc870150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc87552c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8701dbc80 con 0x7fc87014f4b0 2023-11-27T20:43:11.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc87552c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87014f930 con 0x7fc870155ca0 2023-11-27T20:43:11.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc87552c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8701eac60 con 0x7fc8701e06e0 2023-11-27T20:43:11.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc86f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc87014f4b0 0x7fc870150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc86f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc87014f4b0 0x7fc870150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52410/0 (socket says 172.21.15.91:52410) 2023-11-27T20:43:11.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc86f7fe640 1 -- 172.21.15.91:0/3677029656 learned_addr learned my addr 172.21.15.91:0/3677029656 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:11.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc86f7fe640 1 -- 172.21.15.91:0/3677029656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8701e06e0 msgr2=0x7fc87014ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc86f7fe640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8701e06e0 0x7fc87014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc86f7fe640 1 -- 172.21.15.91:0/3677029656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc870155ca0 msgr2=0x7fc8701514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc86effd640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc870155ca0 0x7fc8701514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc86f7fe640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc870155ca0 0x7fc8701514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.376+0000 7fc86f7fe640 1 -- 172.21.15.91:0/3677029656 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870151a20 con 0x7fc87014f4b0 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.377+0000 7fc86f7fe640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc87014f4b0 0x7fc870150340 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc8700c3860 tx=0x7fc86800e220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.377+0000 7fc8577fe640 1 -- 172.21.15.91:0/3677029656 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868017070 con 0x7fc87014f4b0 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.377+0000 7fc8577fe640 1 -- 172.21.15.91:0/3677029656 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86800ec30 con 0x7fc87014f4b0 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.377+0000 7fc8577fe640 1 -- 172.21.15.91:0/3677029656 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86800edc0 con 0x7fc87014f4b0 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.377+0000 7fc87552c640 1 -- 172.21.15.91:0/3677029656 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8701eb0f0 con 0x7fc87014f4b0 2023-11-27T20:43:11.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.377+0000 7fc87552c640 1 -- 172.21.15.91:0/3677029656 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8701ea330 con 0x7fc87014f4b0 2023-11-27T20:43:11.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.378+0000 7fc87552c640 1 -- 172.21.15.91:0/3677029656 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc870068350 con 0x7fc87014f4b0 2023-11-27T20:43:11.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.379+0000 7fc8577fe640 1 -- 172.21.15.91:0/3677029656 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc868013420 con 0x7fc87014f4b0 2023-11-27T20:43:11.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.380+0000 7fc8577fe640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc85c06b1c0 0x7fc85c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.380+0000 7fc8577fe640 1 -- 172.21.15.91:0/3677029656 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc868089930 con 0x7fc87014f4b0 2023-11-27T20:43:11.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.380+0000 7fc86effd640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc85c06b1c0 0x7fc85c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.381+0000 7fc86effd640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc85c06b1c0 0x7fc85c06d680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc860033000 tx=0x7fc860009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:11.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.385+0000 7fc8577fe640 1 -- 172.21.15.91:0/3677029656 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc868054390 con 0x7fc87014f4b0 2023-11-27T20:43:11.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.578+0000 7fc87552c640 1 -- 172.21.15.91:0/3677029656 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8700c66d0 con 0x7fc87014f4b0 2023-11-27T20:43:11.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.578+0000 7fc8577fe640 1 -- 172.21.15.91:0/3677029656 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8680579b0 con 0x7fc87014f4b0 2023-11-27T20:43:11.580 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:43:11.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 -- 172.21.15.91:0/3677029656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc85c06b1c0 msgr2=0x7fc85c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc85c06b1c0 0x7fc85c06d680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc860033000 tx=0x7fc860009030 comp rx=0 tx=0).stop 2023-11-27T20:43:11.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 -- 172.21.15.91:0/3677029656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc87014f4b0 msgr2=0x7fc870150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc87014f4b0 0x7fc870150340 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc8700c3860 tx=0x7fc86800e220 comp rx=0 tx=0).stop 2023-11-27T20:43:11.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 -- 172.21.15.91:0/3677029656 shutdown_connections 2023-11-27T20:43:11.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc87014f4b0 0x7fc870150340 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8701e06e0 0x7fc87014ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc85c06b1c0 0x7fc85c06d680 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 --2- 172.21.15.91:0/3677029656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc870155ca0 0x7fc8701514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 -- 172.21.15.91:0/3677029656 >> 172.21.15.91:0/3677029656 conn(0x7fc87006a500 msgr2=0x7fc8700bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:11.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 -- 172.21.15.91:0/3677029656 shutdown_connections 2023-11-27T20:43:11.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.581+0000 7fc87552c640 1 -- 172.21.15.91:0/3677029656 wait complete. 2023-11-27T20:43:11.601 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:43:11.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.807+0000 7f15adf9e640 1 Processor -- start 2023-11-27T20:43:11.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.807+0000 7f15adf9e640 1 -- start start 2023-11-27T20:43:11.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.809+0000 7f15adf9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8155490 0x7f15a80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.809+0000 7f15adf9e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a80c06c0 con 0x7f15a80a9b40 2023-11-27T20:43:11.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.809+0000 7f15adf9e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a80c1020 con 0x7f15a80c1500 2023-11-27T20:43:11.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.809+0000 7f15adf9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80a5820 con 0x7f15a8155490 2023-11-27T20:43:11.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.809+0000 7f15a7fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f15a80a9b40 0x7f15a80c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36204/0 (socket says 172.21.15.91:36204) 2023-11-27T20:43:11.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.809+0000 7f15a7fff640 1 -- 172.21.15.91:0/1971101348 learned_addr learned my addr 172.21.15.91:0/1971101348 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:11.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.809+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597236515 0 0) 0x7f15a80c06c0 con 0x7f15a80a9b40 2023-11-27T20:43:11.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.809+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1594003520 con 0x7f15a80a9b40 2023-11-27T20:43:11.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.809+0000 7f15a77fe640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8155490 0x7f15a80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2863136983 0 0) 0x7f1594003520 con 0x7f15a80a9b40 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8155490 msgr2=0x7f15a80a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8155490 0x7f15a80a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 >> v1:172.21.15.183:6789/0 conn(0x7f15a80c1500 legacy=0x7f15a80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a80c0910 con 0x7f15a80a9b40 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f15a00019f0 con 0x7f15a80a9b40 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a77fe640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8155490 0x7f15a80a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 >> v1:172.21.15.91:6789/0 conn(0x7f15a80a9b40 legacy=0x7f15a80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 0x7f1594003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8155490 0x7f15940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1594004d00 0x7f1594005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159400dc70 con 0x7f15940039a0 2023-11-27T20:43:11.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159400dde0 con 0x7f1594004d00 2023-11-27T20:43:11.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159400dfa0 con 0x7f15a8155490 2023-11-27T20:43:11.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.810+0000 7f15a77fe640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 0x7f1594003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.811+0000 7f159ffff640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8155490 0x7f15940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.811+0000 7f15a7fff640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1594004d00 0x7f1594005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.811+0000 7f15a77fe640 1 -- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8155490 msgr2=0x7f15940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:11.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.811+0000 7f15a77fe640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8155490 0x7f15940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.811+0000 7f15a77fe640 1 -- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1594004d00 msgr2=0x7f1594005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:11.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.811+0000 7f15a77fe640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1594004d00 0x7f1594005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.811+0000 7f15a77fe640 1 -- 172.21.15.91:0/1971101348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1594003520 con 0x7f15940039a0 2023-11-27T20:43:11.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.811+0000 7f159ffff640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8155490 0x7f15940047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:11.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.812+0000 7f15a77fe640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 0x7f1594003dc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1598006fd0 tx=0x7f15940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef423fca8fced797 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:11.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.812+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598004230 con 0x7f15940039a0 2023-11-27T20:43:11.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.812+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1598004390 con 0x7f15940039a0 2023-11-27T20:43:11.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.812+0000 7f15a6ffd640 1 -- 172.21.15.91:0/1971101348 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598003830 con 0x7f15940039a0 2023-11-27T20:43:11.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.813+0000 7f15adf9e640 1 -- 172.21.15.91:0/1971101348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 msgr2=0x7f1594003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.813+0000 7f15adf9e640 1 --2- 172.21.15.91:0/1971101348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 0x7f1594003dc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1598006fd0 tx=0x7f15940057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.813+0000 7f15a7fff640 1 -- 172.21.15.91:0/1971101348 reap_dead start 2023-11-27T20:43:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.813+0000 7f15adf9e640 1 -- 172.21.15.91:0/1971101348 shutdown_connections 2023-11-27T20:43:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.813+0000 7f15adf9e640 1 -- 172.21.15.91:0/1971101348 >> 172.21.15.91:0/1971101348 conn(0x7f15a806a500 msgr2=0x7f15a806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.813+0000 7f15adf9e640 1 -- 172.21.15.91:0/1971101348 shutdown_connections 2023-11-27T20:43:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.813+0000 7f15adf9e640 1 -- 172.21.15.91:0/1971101348 wait complete. 2023-11-27T20:43:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.814+0000 7f15adf9e640 1 Processor -- start 2023-11-27T20:43:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.815+0000 7f15adf9e640 1 -- start start 2023-11-27T20:43:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.815+0000 7f15adf9e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 0x7f15a8071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.815+0000 7f15adf9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8151ab0 0x7f15a8150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.815+0000 7f15adf9e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15a81513d0 0x7f15a81ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15adf9e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a81e0bb0 con 0x7f15940039a0 2023-11-27T20:43:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15adf9e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a81e9eb0 con 0x7f15a81513d0 2023-11-27T20:43:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15adf9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a81daa40 con 0x7f15a8151ab0 2023-11-27T20:43:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15a77fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 0x7f15a8071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15a77fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 0x7f15a8071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52418/0 (socket says 172.21.15.91:52418) 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15a77fe640 1 -- 172.21.15.91:0/2951977117 learned_addr learned my addr 172.21.15.91:0/2951977117 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15a77fe640 1 -- 172.21.15.91:0/2951977117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8151ab0 msgr2=0x7f15a8150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15a77fe640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8151ab0 0x7f15a8150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15a77fe640 1 -- 172.21.15.91:0/2951977117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15a81513d0 msgr2=0x7f15a81ea300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15a77fe640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15a81513d0 0x7f15a81ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15a77fe640 1 -- 172.21.15.91:0/2951977117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a81dfd50 con 0x7f15940039a0 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.816+0000 7f15a77fe640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 0x7f15a8071060 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f159802bdd0 tx=0x7f1598004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.817+0000 7f15a4ff9640 1 -- 172.21.15.91:0/2951977117 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598032680 con 0x7f15940039a0 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.817+0000 7f15a4ff9640 1 -- 172.21.15.91:0/2951977117 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15980327e0 con 0x7f15940039a0 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.817+0000 7f15a4ff9640 1 -- 172.21.15.91:0/2951977117 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598032b50 con 0x7f15940039a0 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.817+0000 7f15adf9e640 1 -- 172.21.15.91:0/2951977117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a81e0030 con 0x7f15940039a0 2023-11-27T20:43:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.817+0000 7f15adf9e640 1 -- 172.21.15.91:0/2951977117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a81e05f0 con 0x7f15940039a0 2023-11-27T20:43:11.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.818+0000 7f15adf9e640 1 -- 172.21.15.91:0/2951977117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a8068350 con 0x7f15940039a0 2023-11-27T20:43:11.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.819+0000 7f15a4ff9640 1 -- 172.21.15.91:0/2951977117 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1598032cb0 con 0x7f15940039a0 2023-11-27T20:43:11.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.820+0000 7f15a4ff9640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158806b1f0 0x7f158806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:11.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.820+0000 7f15a4ff9640 1 -- 172.21.15.91:0/2951977117 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f15980ac140 con 0x7f15940039a0 2023-11-27T20:43:11.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.820+0000 7f159ffff640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158806b1f0 0x7f158806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:11.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.821+0000 7f159ffff640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158806b1f0 0x7f158806d6b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f15a8072240 tx=0x7f1590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:11.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:11.824+0000 7f15a4ff9640 1 -- 172.21.15.91:0/2951977117 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1598076b00 con 0x7f15940039a0 2023-11-27T20:43:12.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.004+0000 7f15adf9e640 1 -- 172.21.15.91:0/2951977117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15a806aba0 con 0x7f15940039a0 2023-11-27T20:43:12.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.005+0000 7f15a4ff9640 1 -- 172.21.15.91:0/2951977117 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f159800f040 con 0x7f15940039a0 2023-11-27T20:43:12.006 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:43:12.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 -- 172.21.15.91:0/2951977117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158806b1f0 msgr2=0x7f158806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158806b1f0 0x7f158806d6b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f15a8072240 tx=0x7f1590009040 comp rx=0 tx=0).stop 2023-11-27T20:43:12.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 -- 172.21.15.91:0/2951977117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 msgr2=0x7f15a8071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 0x7f15a8071060 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f159802bdd0 tx=0x7f1598004730 comp rx=0 tx=0).stop 2023-11-27T20:43:12.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 -- 172.21.15.91:0/2951977117 shutdown_connections 2023-11-27T20:43:12.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158806b1f0 0x7f158806d6b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15a81513d0 0x7f15a81ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8151ab0 0x7f15a8150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 --2- 172.21.15.91:0/2951977117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15940039a0 0x7f15a8071060 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 -- 172.21.15.91:0/2951977117 >> 172.21.15.91:0/2951977117 conn(0x7f15a806a500 msgr2=0x7f15a80a9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 -- 172.21.15.91:0/2951977117 shutdown_connections 2023-11-27T20:43:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.007+0000 7f15adf9e640 1 -- 172.21.15.91:0/2951977117 wait complete. 2023-11-27T20:43:12.025 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:43:12.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.234+0000 7f2a40461640 1 Processor -- start 2023-11-27T20:43:12.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.234+0000 7f2a40461640 1 -- start start 2023-11-27T20:43:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.235+0000 7f2a40461640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3814fd30 0x7f2a38152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.235+0000 7f2a40461640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2a3806d0a0 0x7f2a380a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.235+0000 7f2a40461640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2a380a5260 0x7f2a380c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.235+0000 7f2a40461640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380c64a0 con 0x7f2a3806d0a0 2023-11-27T20:43:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.235+0000 7f2a40461640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380c5c00 con 0x7f2a380a5260 2023-11-27T20:43:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.235+0000 7f2a40461640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380c5ee0 con 0x7f2a3814fd30 2023-11-27T20:43:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.236+0000 7f2a3d9fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2a3806d0a0 0x7f2a380a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.236+0000 7f2a3d9fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2a3806d0a0 0x7f2a380a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52432/0 (socket says 172.21.15.91:52432) 2023-11-27T20:43:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.236+0000 7f2a3d9fc640 1 -- 172.21.15.91:0/2610365013 learned_addr learned my addr 172.21.15.91:0/2610365013 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:12.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.236+0000 7f2a3e1fd640 1 --2- 172.21.15.91:0/2610365013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3814fd30 0x7f2a38152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.236+0000 7f2a3e9fe640 1 --2- 172.21.15.91:0/2610365013 >> v2:172.21.15.183:3300/0 conn(0x7f2a380a5260 0x7f2a380c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.236+0000 7f2a3d9fc640 1 -- 172.21.15.91:0/2610365013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3814fd30 msgr2=0x7f2a38152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.236+0000 7f2a3d9fc640 1 --2- 172.21.15.91:0/2610365013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3814fd30 0x7f2a38152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.236+0000 7f2a3d9fc640 1 -- 172.21.15.91:0/2610365013 >> v2:172.21.15.183:3300/0 conn(0x7f2a380a5260 msgr2=0x7f2a380c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.236+0000 7f2a3d9fc640 1 --2- 172.21.15.91:0/2610365013 >> v2:172.21.15.183:3300/0 conn(0x7f2a380a5260 0x7f2a380c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.236+0000 7f2a3d9fc640 1 -- 172.21.15.91:0/2610365013 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a380c61c0 con 0x7f2a3806d0a0 2023-11-27T20:43:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.237+0000 7f2a3d9fc640 1 --2- 172.21.15.91:0/2610365013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3806d0a0 0x7f2a380a4d20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2a3806d990 tx=0x7f2a2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5464c6b2f6d065e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.238+0000 7f2a3d1fb640 1 -- 172.21.15.91:0/2610365013 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a28031870 con 0x7f2a3806d0a0 2023-11-27T20:43:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.238+0000 7f2a3d1fb640 1 -- 172.21.15.91:0/2610365013 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a280319d0 con 0x7f2a3806d0a0 2023-11-27T20:43:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.238+0000 7f2a3d1fb640 1 -- 172.21.15.91:0/2610365013 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a28031d60 con 0x7f2a3806d0a0 2023-11-27T20:43:12.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.238+0000 7f2a40461640 1 -- 172.21.15.91:0/2610365013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3806d0a0 msgr2=0x7f2a380a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.238+0000 7f2a40461640 1 --2- 172.21.15.91:0/2610365013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3806d0a0 0x7f2a380a4d20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2a3806d990 tx=0x7f2a2802b910 comp rx=0 tx=0).stop 2023-11-27T20:43:12.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.239+0000 7f2a40461640 1 -- 172.21.15.91:0/2610365013 shutdown_connections 2023-11-27T20:43:12.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.239+0000 7f2a40461640 1 --2- 172.21.15.91:0/2610365013 >> v2:172.21.15.183:3300/0 conn(0x7f2a380a5260 0x7f2a380c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.239+0000 7f2a40461640 1 --2- 172.21.15.91:0/2610365013 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a3806d0a0 0x7f2a380a4d20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.239+0000 7f2a40461640 1 --2- 172.21.15.91:0/2610365013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3814fd30 0x7f2a38152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.239+0000 7f2a40461640 1 -- 172.21.15.91:0/2610365013 >> 172.21.15.91:0/2610365013 conn(0x7f2a3806a500 msgr2=0x7f2a3806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:12.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.239+0000 7f2a40461640 1 -- 172.21.15.91:0/2610365013 shutdown_connections 2023-11-27T20:43:12.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.239+0000 7f2a40461640 1 -- 172.21.15.91:0/2610365013 wait complete. 2023-11-27T20:43:12.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.241+0000 7f2a40461640 1 Processor -- start 2023-11-27T20:43:12.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.241+0000 7f2a40461640 1 -- start start 2023-11-27T20:43:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.242+0000 7f2a40461640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3806d0a0 0x7f2a38070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.242+0000 7f2a40461640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a380a5260 0x7f2a3814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.242+0000 7f2a40461640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3814fd30 0x7f2a3814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.242+0000 7f2a40461640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380aaab0 con 0x7f2a380a5260 2023-11-27T20:43:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.242+0000 7f2a40461640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380a6290 con 0x7f2a3806d0a0 2023-11-27T20:43:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.242+0000 7f2a40461640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380a6570 con 0x7f2a3814fd30 2023-11-27T20:43:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.242+0000 7f2a3d9fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a380a5260 0x7f2a3814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3d9fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a380a5260 0x7f2a3814c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52434/0 (socket says 172.21.15.91:52434) 2023-11-27T20:43:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3d9fc640 1 -- 172.21.15.91:0/332108068 learned_addr learned my addr 172.21.15.91:0/332108068 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3e1fd640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3806d0a0 0x7f2a38070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3e9fe640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3814fd30 0x7f2a3814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3d9fc640 1 -- 172.21.15.91:0/332108068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3814fd30 msgr2=0x7f2a3814c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3d9fc640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3814fd30 0x7f2a3814c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3d9fc640 1 -- 172.21.15.91:0/332108068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3806d0a0 msgr2=0x7f2a38070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3d9fc640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3806d0a0 0x7f2a38070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3d9fc640 1 -- 172.21.15.91:0/332108068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a280094d0 con 0x7f2a380a5260 2023-11-27T20:43:12.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3e1fd640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3806d0a0 0x7f2a38070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:12.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.243+0000 7f2a3d9fc640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a380a5260 0x7f2a3814c290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2a2802b950 tx=0x7f2a280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:12.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.244+0000 7f2a2effd640 1 -- 172.21.15.91:0/332108068 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2803ad30 con 0x7f2a380a5260 2023-11-27T20:43:12.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.244+0000 7f2a2effd640 1 -- 172.21.15.91:0/332108068 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a280443f0 con 0x7f2a380a5260 2023-11-27T20:43:12.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.244+0000 7f2a2effd640 1 -- 172.21.15.91:0/332108068 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280447a0 con 0x7f2a380a5260 2023-11-27T20:43:12.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.244+0000 7f2a40461640 1 -- 172.21.15.91:0/332108068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a380aa740 con 0x7f2a380a5260 2023-11-27T20:43:12.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.244+0000 7f2a40461640 1 -- 172.21.15.91:0/332108068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a380a7700 con 0x7f2a380a5260 2023-11-27T20:43:12.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.245+0000 7f2a40461640 1 -- 172.21.15.91:0/332108068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a380aac20 con 0x7f2a380a5260 2023-11-27T20:43:12.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.246+0000 7f2a2effd640 1 -- 172.21.15.91:0/332108068 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2a2804d450 con 0x7f2a380a5260 2023-11-27T20:43:12.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.247+0000 7f2a2effd640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a1c06b1c0 0x7f2a1c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.247+0000 7f2a2effd640 1 -- 172.21.15.91:0/332108068 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2a2802d040 con 0x7f2a380a5260 2023-11-27T20:43:12.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.248+0000 7f2a3e1fd640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a1c06b1c0 0x7f2a1c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.248+0000 7f2a3e1fd640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a1c06b1c0 0x7f2a1c06d680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2a34006fd0 tx=0x7f2a34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:12.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.252+0000 7f2a2effd640 1 -- 172.21.15.91:0/332108068 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2a28076d60 con 0x7f2a380a5260 2023-11-27T20:43:12.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.440+0000 7f2a40461640 1 -- 172.21.15.91:0/332108068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a38068350 con 0x7f2a380a5260 2023-11-27T20:43:12.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.441+0000 7f2a2effd640 1 -- 172.21.15.91:0/332108068 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7f2a280350b0 con 0x7f2a380a5260 2023-11-27T20:43:12.443 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:43:12.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 -- 172.21.15.91:0/332108068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a1c06b1c0 msgr2=0x7f2a1c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a1c06b1c0 0x7f2a1c06d680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2a34006fd0 tx=0x7f2a34008040 comp rx=0 tx=0).stop 2023-11-27T20:43:12.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 -- 172.21.15.91:0/332108068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a380a5260 msgr2=0x7f2a3814c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a380a5260 0x7f2a3814c290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2a2802b950 tx=0x7f2a280046c0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 -- 172.21.15.91:0/332108068 shutdown_connections 2023-11-27T20:43:12.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a3814fd30 0x7f2a3814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a380a5260 0x7f2a3814c290 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2a1c06b1c0 0x7f2a1c06d680 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 --2- 172.21.15.91:0/332108068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a3806d0a0 0x7f2a38070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 -- 172.21.15.91:0/332108068 >> 172.21.15.91:0/332108068 conn(0x7f2a3806a500 msgr2=0x7f2a3806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:12.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 -- 172.21.15.91:0/332108068 shutdown_connections 2023-11-27T20:43:12.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.444+0000 7f2a40461640 1 -- 172.21.15.91:0/332108068 wait complete. 2023-11-27T20:43:12.463 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:43:12.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.678+0000 7f7d3359e640 1 Processor -- start 2023-11-27T20:43:12.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.679+0000 7f7d3359e640 1 -- start start 2023-11-27T20:43:12.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.680+0000 7f7d3359e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7d3414c2e0 0x7f7d340c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.680+0000 7f7d3359e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7d34072310 0x7f7d340a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.680+0000 7f7d3359e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d34071e80 con 0x7f7d340c0440 2023-11-27T20:43:12.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.680+0000 7f7d3359e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d34071470 con 0x7f7d34072310 2023-11-27T20:43:12.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.680+0000 7f7d3359e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3414c6c0 con 0x7f7d3414c2e0 2023-11-27T20:43:12.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.681+0000 7f7d32d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7d34072310 0x7f7d340a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.681+0000 7f7d32d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7d34072310 0x7f7d340a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52448/0 (socket says 172.21.15.91:52448) 2023-11-27T20:43:12.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.681+0000 7f7d32d9d640 1 -- 172.21.15.91:0/1830257693 learned_addr learned my addr 172.21.15.91:0/1830257693 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:12.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.681+0000 7f7d2bfff640 1 --1- 172.21.15.91:0/1830257693 >> v1:172.21.15.91:6789/0 conn(0x7f7d340c0440 0x7f7d34152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36218/0 (socket says 172.21.15.91:36218) 2023-11-27T20:43:12.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.681+0000 7f7d3259c640 1 --2- 172.21.15.91:0/1830257693 >> v2:172.21.15.183:3300/0 conn(0x7f7d3414c2e0 0x7f7d340c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.681+0000 7f7d32d9d640 1 -- 172.21.15.91:0/1830257693 >> v2:172.21.15.183:3300/0 conn(0x7f7d3414c2e0 msgr2=0x7f7d340c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:12.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.681+0000 7f7d32d9d640 1 --2- 172.21.15.91:0/1830257693 >> v2:172.21.15.183:3300/0 conn(0x7f7d3414c2e0 0x7f7d340c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.681+0000 7f7d32d9d640 1 -- 172.21.15.91:0/1830257693 >> v1:172.21.15.91:6789/0 conn(0x7f7d340c0440 legacy=0x7f7d34152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.681+0000 7f7d32d9d640 1 -- 172.21.15.91:0/1830257693 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3406fdc0 con 0x7f7d34072310 2023-11-27T20:43:12.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.681+0000 7f7d31d9b640 1 -- 172.21.15.91:0/1830257693 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685488682 0 0) 0x7f7d34071e80 con 0x7f7d340c0440 2023-11-27T20:43:12.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.682+0000 7f7d32d9d640 1 --2- 172.21.15.91:0/1830257693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d34072310 0x7f7d340a4d20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7d34067940 tx=0x7f7d2c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5622c84cb28f2f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:12.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.683+0000 7f7d31d9b640 1 -- 172.21.15.91:0/1830257693 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c02c9f0 con 0x7f7d34072310 2023-11-27T20:43:12.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.683+0000 7f7d31d9b640 1 -- 172.21.15.91:0/1830257693 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c02cb50 con 0x7f7d34072310 2023-11-27T20:43:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.683+0000 7f7d31d9b640 1 -- 172.21.15.91:0/1830257693 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0343f0 con 0x7f7d34072310 2023-11-27T20:43:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.683+0000 7f7d3359e640 1 -- 172.21.15.91:0/1830257693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d34072310 msgr2=0x7f7d340a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.683+0000 7f7d3359e640 1 --2- 172.21.15.91:0/1830257693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d34072310 0x7f7d340a4d20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7d34067940 tx=0x7f7d2c02be50 comp rx=0 tx=0).stop 2023-11-27T20:43:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.684+0000 7f7d3359e640 1 -- 172.21.15.91:0/1830257693 shutdown_connections 2023-11-27T20:43:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.684+0000 7f7d3359e640 1 --2- 172.21.15.91:0/1830257693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d34072310 0x7f7d340a4d20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.684+0000 7f7d3359e640 1 --2- 172.21.15.91:0/1830257693 >> v2:172.21.15.183:3300/0 conn(0x7f7d3414c2e0 0x7f7d340c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.684+0000 7f7d3359e640 1 -- 172.21.15.91:0/1830257693 >> 172.21.15.91:0/1830257693 conn(0x7f7d340a77f0 msgr2=0x7f7d340a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.684+0000 7f7d3359e640 1 -- 172.21.15.91:0/1830257693 shutdown_connections 2023-11-27T20:43:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.684+0000 7f7d3359e640 1 -- 172.21.15.91:0/1830257693 wait complete. 2023-11-27T20:43:12.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.685+0000 7f7d3359e640 1 Processor -- start 2023-11-27T20:43:12.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.686+0000 7f7d3359e640 1 -- start start 2023-11-27T20:43:12.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.686+0000 7f7d3359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d34072310 0x7f7d34155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.686+0000 7f7d3359e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d340c0440 0x7f7d3413f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.686+0000 7f7d3359e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d3414c2e0 0x7f7d3413fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.686+0000 7f7d3359e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d341edea0 con 0x7f7d340c0440 2023-11-27T20:43:12.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.686+0000 7f7d3359e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d341ed290 con 0x7f7d3414c2e0 2023-11-27T20:43:12.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.686+0000 7f7d3359e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d341ed570 con 0x7f7d34072310 2023-11-27T20:43:12.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.687+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d340c0440 0x7f7d3413f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.687+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d340c0440 0x7f7d3413f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52452/0 (socket says 172.21.15.91:52452) 2023-11-27T20:43:12.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.687+0000 7f7d2bfff640 1 -- 172.21.15.91:0/844473907 learned_addr learned my addr 172.21.15.91:0/844473907 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:12.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.687+0000 7f7d2bfff640 1 -- 172.21.15.91:0/844473907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d34072310 msgr2=0x7f7d34155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.687+0000 7f7d2bfff640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d34072310 0x7f7d34155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.687+0000 7f7d2bfff640 1 -- 172.21.15.91:0/844473907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d3414c2e0 msgr2=0x7f7d3413fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.687+0000 7f7d2bfff640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d3414c2e0 0x7f7d3413fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.687+0000 7f7d2bfff640 1 -- 172.21.15.91:0/844473907 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c009b30 con 0x7f7d340c0440 2023-11-27T20:43:12.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.687+0000 7f7d2bfff640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d340c0440 0x7f7d3413f8e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c4d0 tx=0x7f7d1c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:12.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.688+0000 7f7d2affd640 1 -- 172.21.15.91:0/844473907 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0074e0 con 0x7f7d340c0440 2023-11-27T20:43:12.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.688+0000 7f7d2affd640 1 -- 172.21.15.91:0/844473907 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c007660 con 0x7f7d340c0440 2023-11-27T20:43:12.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.688+0000 7f7d2affd640 1 -- 172.21.15.91:0/844473907 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c004a20 con 0x7f7d340c0440 2023-11-27T20:43:12.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.688+0000 7f7d3359e640 1 -- 172.21.15.91:0/844473907 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d341ed850 con 0x7f7d340c0440 2023-11-27T20:43:12.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.688+0000 7f7d3359e640 1 -- 172.21.15.91:0/844473907 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d341563e0 con 0x7f7d340c0440 2023-11-27T20:43:12.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.689+0000 7f7d3359e640 1 -- 172.21.15.91:0/844473907 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3404e840 con 0x7f7d340c0440 2023-11-27T20:43:12.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.690+0000 7f7d2affd640 1 -- 172.21.15.91:0/844473907 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7d1c004b80 con 0x7f7d340c0440 2023-11-27T20:43:12.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.691+0000 7f7d2affd640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7d1406b1c0 0x7f7d1406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:12.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.691+0000 7f7d2affd640 1 -- 172.21.15.91:0/844473907 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d1c088f20 con 0x7f7d340c0440 2023-11-27T20:43:12.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.691+0000 7f7d3259c640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7d1406b1c0 0x7f7d1406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:12.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.691+0000 7f7d3259c640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7d1406b1c0 0x7f7d1406d680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7d24006fd0 tx=0x7f7d24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:12.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.695+0000 7f7d2affd640 1 -- 172.21.15.91:0/844473907 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7d1c0538e0 con 0x7f7d340c0440 2023-11-27T20:43:12.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.880+0000 7f7d3359e640 1 -- 172.21.15.91:0/844473907 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7d341edfe0 con 0x7f7d340c0440 2023-11-27T20:43:12.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.881+0000 7f7d2affd640 1 -- 172.21.15.91:0/844473907 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7d341edfe0 con 0x7f7d340c0440 2023-11-27T20:43:12.883 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:43:12.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.883+0000 7f7d3359e640 1 -- 172.21.15.91:0/844473907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7d1406b1c0 msgr2=0x7f7d1406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.883+0000 7f7d3359e640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7d1406b1c0 0x7f7d1406d680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7d24006fd0 tx=0x7f7d24008040 comp rx=0 tx=0).stop 2023-11-27T20:43:12.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.883+0000 7f7d3359e640 1 -- 172.21.15.91:0/844473907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d340c0440 msgr2=0x7f7d3413f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:12.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.883+0000 7f7d3359e640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d340c0440 0x7f7d3413f8e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c4d0 tx=0x7f7d1c00c990 comp rx=0 tx=0).stop 2023-11-27T20:43:12.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.884+0000 7f7d3359e640 1 -- 172.21.15.91:0/844473907 shutdown_connections 2023-11-27T20:43:12.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.884+0000 7f7d3359e640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7d1406b1c0 0x7f7d1406d680 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.884+0000 7f7d3359e640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d3414c2e0 0x7f7d3413fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.884+0000 7f7d3359e640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d340c0440 0x7f7d3413f8e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.884+0000 7f7d3359e640 1 --2- 172.21.15.91:0/844473907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d34072310 0x7f7d34155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:12.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.884+0000 7f7d3359e640 1 -- 172.21.15.91:0/844473907 >> 172.21.15.91:0/844473907 conn(0x7f7d340a77f0 msgr2=0x7f7d3414a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:12.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.884+0000 7f7d3359e640 1 -- 172.21.15.91:0/844473907 shutdown_connections 2023-11-27T20:43:12.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:12.884+0000 7f7d3359e640 1 -- 172.21.15.91:0/844473907 wait complete. 2023-11-27T20:43:12.903 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:43:13.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.104+0000 7f21a2c75640 1 Processor -- start 2023-11-27T20:43:13.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.104+0000 7f21a2c75640 1 -- start start 2023-11-27T20:43:13.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.106+0000 7f21a2c75640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c073a00 0x7f219c06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.106+0000 7f21a2c75640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219c06aa40 con 0x7f219c157c50 2023-11-27T20:43:13.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.106+0000 7f21a2c75640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219c0c00d0 con 0x7f219c158030 2023-11-27T20:43:13.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.106+0000 7f21a2c75640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0c1e00 con 0x7f219c073a00 2023-11-27T20:43:13.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.106+0000 7f21a0a11640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f219c157c50 0x7f219c0c0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36226/0 (socket says 172.21.15.91:36226) 2023-11-27T20:43:13.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.106+0000 7f21a0a11640 1 -- 172.21.15.91:0/3590231650 learned_addr learned my addr 172.21.15.91:0/3590231650 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:13.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071034671 0 0) 0x7f219c06aa40 con 0x7f219c157c50 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219bfff640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c073a00 0x7f219c06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2188003520 con 0x7f219c157c50 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3672500064 0 0) 0x7f2188003520 con 0x7f219c157c50 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c073a00 msgr2=0x7f219c06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c073a00 0x7f219c06a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 >> v1:172.21.15.183:6789/0 conn(0x7f219c158030 legacy=0x7f219c15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0bfa80 con 0x7f219c157c50 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f218c001670 con 0x7f219c157c50 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 >> v1:172.21.15.91:6789/0 conn(0x7f219c157c50 legacy=0x7f219c0c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c073a00 0x7f21880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2188003f20 0x7f21880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2188004d00 0x7f2188005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0c1e00 con 0x7f2188004d00 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218800ba60 con 0x7f2188003f20 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218800bc20 con 0x7f219c073a00 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.107+0000 7f21a1212640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2188004d00 0x7f2188005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.108+0000 7f219bfff640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2188003f20 0x7f21880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.108+0000 7f21a1212640 1 -- 172.21.15.91:0/3590231650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c073a00 msgr2=0x7f21880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.108+0000 7f21a1212640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c073a00 0x7f21880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.108+0000 7f21a1212640 1 -- 172.21.15.91:0/3590231650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2188003f20 msgr2=0x7f21880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.108+0000 7f21a1212640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2188003f20 0x7f21880047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.108+0000 7f21a1212640 1 -- 172.21.15.91:0/3590231650 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188003520 con 0x7f2188004d00 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.109+0000 7f21a1212640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2188004d00 0x7f2188005180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2194001750 tx=0x7f21880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9907f78952c1a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.109+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940052d0 con 0x7f2188004d00 2023-11-27T20:43:13.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.109+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219402e050 con 0x7f2188004d00 2023-11-27T20:43:13.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.109+0000 7f219b7fe640 1 -- 172.21.15.91:0/3590231650 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194003830 con 0x7f2188004d00 2023-11-27T20:43:13.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.110+0000 7f21a2c75640 1 -- 172.21.15.91:0/3590231650 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2188004d00 msgr2=0x7f2188005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.110+0000 7f21a2c75640 1 --2- 172.21.15.91:0/3590231650 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2188004d00 0x7f2188005180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2194001750 tx=0x7f21880057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.110+0000 7f21a1212640 1 -- 172.21.15.91:0/3590231650 reap_dead start 2023-11-27T20:43:13.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.110+0000 7f21a2c75640 1 -- 172.21.15.91:0/3590231650 shutdown_connections 2023-11-27T20:43:13.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.110+0000 7f21a2c75640 1 -- 172.21.15.91:0/3590231650 >> 172.21.15.91:0/3590231650 conn(0x7f219c0c30b0 msgr2=0x7f219c0c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:13.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.110+0000 7f21a2c75640 1 -- 172.21.15.91:0/3590231650 shutdown_connections 2023-11-27T20:43:13.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.110+0000 7f21a2c75640 1 -- 172.21.15.91:0/3590231650 wait complete. 2023-11-27T20:43:13.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.111+0000 7f21a2c75640 1 Processor -- start 2023-11-27T20:43:13.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.111+0000 7f21a2c75640 1 -- start start 2023-11-27T20:43:13.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.112+0000 7f21a2c75640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2188004d00 0x7f219c0a9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.112+0000 7f21a2c75640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f219c155170 0x7f219c1421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.112+0000 7f21a2c75640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c1e7080 0x7f219c1e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.112+0000 7f21a2c75640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0ac490 con 0x7f219c155170 2023-11-27T20:43:13.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.112+0000 7f21a2c75640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0a9960 con 0x7f2188004d00 2023-11-27T20:43:13.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.112+0000 7f21a2c75640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c1ee0b0 con 0x7f219c1e7080 2023-11-27T20:43:13.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f219bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f219c155170 0x7f219c1421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f219bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f219c155170 0x7f219c1421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52468/0 (socket says 172.21.15.91:52468) 2023-11-27T20:43:13.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f219bfff640 1 -- 172.21.15.91:0/829443656 learned_addr learned my addr 172.21.15.91:0/829443656 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:13.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f21a0a11640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2188004d00 0x7f219c0a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f219bfff640 1 -- 172.21.15.91:0/829443656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c1e7080 msgr2=0x7f219c1e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f219bfff640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c1e7080 0x7f219c1e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f219bfff640 1 -- 172.21.15.91:0/829443656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2188004d00 msgr2=0x7f219c0a9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f219bfff640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2188004d00 0x7f219c0a9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f219bfff640 1 -- 172.21.15.91:0/829443656 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0a9b90 con 0x7f219c155170 2023-11-27T20:43:13.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f219bfff640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f219c155170 0x7f219c1421e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2184007fb0 tx=0x7f218400f560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:13.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.113+0000 7f21997fa640 1 -- 172.21.15.91:0/829443656 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184017600 con 0x7f219c155170 2023-11-27T20:43:13.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.114+0000 7f21997fa640 1 -- 172.21.15.91:0/829443656 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2184011040 con 0x7f219c155170 2023-11-27T20:43:13.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.114+0000 7f21a2c75640 1 -- 172.21.15.91:0/829443656 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219c1ed2f0 con 0x7f219c155170 2023-11-27T20:43:13.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.114+0000 7f21997fa640 1 -- 172.21.15.91:0/829443656 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840179a0 con 0x7f219c155170 2023-11-27T20:43:13.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.114+0000 7f21a2c75640 1 -- 172.21.15.91:0/829443656 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219c1ed8b0 con 0x7f219c155170 2023-11-27T20:43:13.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.115+0000 7f21a2c75640 1 -- 172.21.15.91:0/829443656 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219c066b40 con 0x7f219c155170 2023-11-27T20:43:13.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.116+0000 7f21997fa640 1 -- 172.21.15.91:0/829443656 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2184017b00 con 0x7f219c155170 2023-11-27T20:43:13.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.117+0000 7f21997fa640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f217c06b1c0 0x7f217c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.117+0000 7f21997fa640 1 -- 172.21.15.91:0/829443656 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f218408a420 con 0x7f219c155170 2023-11-27T20:43:13.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.117+0000 7f21a0a11640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f217c06b1c0 0x7f217c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.118+0000 7f21a0a11640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f217c06b1c0 0x7f217c06d680 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f218c0079f0 tx=0x7f218c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:13.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.121+0000 7f21997fa640 1 -- 172.21.15.91:0/829443656 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2184054de0 con 0x7f219c155170 2023-11-27T20:43:13.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.307+0000 7f21a2c75640 1 -- 172.21.15.91:0/829443656 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f219c068350 con 0x7f219c155170 2023-11-27T20:43:13.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.308+0000 7f21997fa640 1 -- 172.21.15.91:0/829443656 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f218400fea0 con 0x7f219c155170 2023-11-27T20:43:13.309 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:43:13.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.310+0000 7f21a2c75640 1 -- 172.21.15.91:0/829443656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f217c06b1c0 msgr2=0x7f217c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.310+0000 7f21a2c75640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f217c06b1c0 0x7f217c06d680 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f218c0079f0 tx=0x7f218c009040 comp rx=0 tx=0).stop 2023-11-27T20:43:13.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.310+0000 7f21a2c75640 1 -- 172.21.15.91:0/829443656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f219c155170 msgr2=0x7f219c1421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.310+0000 7f21a2c75640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f219c155170 0x7f219c1421e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2184007fb0 tx=0x7f218400f560 comp rx=0 tx=0).stop 2023-11-27T20:43:13.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.311+0000 7f21a2c75640 1 -- 172.21.15.91:0/829443656 shutdown_connections 2023-11-27T20:43:13.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.311+0000 7f21a2c75640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f219c1e7080 0x7f219c1e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.311+0000 7f21a2c75640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f219c155170 0x7f219c1421e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.311+0000 7f21a2c75640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f217c06b1c0 0x7f217c06d680 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.311+0000 7f21a2c75640 1 --2- 172.21.15.91:0/829443656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2188004d00 0x7f219c0a9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.311+0000 7f21a2c75640 1 -- 172.21.15.91:0/829443656 >> 172.21.15.91:0/829443656 conn(0x7f219c0c30b0 msgr2=0x7f219c156560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:13.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.311+0000 7f21a2c75640 1 -- 172.21.15.91:0/829443656 shutdown_connections 2023-11-27T20:43:13.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.311+0000 7f21a2c75640 1 -- 172.21.15.91:0/829443656 wait complete. 2023-11-27T20:43:13.330 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-27T20:43:13.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:13.330 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-27T20:43:13.444 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:43:13.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:13.444 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-27T20:43:13.496 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:43:13.496 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:13.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-27T20:43:13.544 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:43:13.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.761+0000 7f195ea1e640 1 Processor -- start 2023-11-27T20:43:13.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.761+0000 7f195ea1e640 1 -- start start 2023-11-27T20:43:13.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.762+0000 7f195ea1e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958155490 0x7f19580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.762+0000 7f195ea1e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19580c06c0 con 0x7f19580c1500 2023-11-27T20:43:13.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.762+0000 7f195ea1e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19580c1020 con 0x7f19580a9b40 2023-11-27T20:43:13.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.762+0000 7f195ea1e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19580a5820 con 0x7f1958155490 2023-11-27T20:43:13.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.763+0000 7f194ffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f19580c1500 0x7f19580a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36230/0 (socket says 172.21.15.91:36230) 2023-11-27T20:43:13.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.763+0000 7f194ffff640 1 -- 172.21.15.91:0/1978879960 learned_addr learned my addr 172.21.15.91:0/1978879960 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:13.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.763+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312650565 0 0) 0x7f19580c06c0 con 0x7f19580c1500 2023-11-27T20:43:13.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.763+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1944005730 con 0x7f19580c1500 2023-11-27T20:43:13.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.763+0000 7f1957fff640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958155490 0x7f19580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.763+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 805280741 0 0) 0x7f1944005730 con 0x7f19580c1500 2023-11-27T20:43:13.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.763+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958155490 msgr2=0x7f19580a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:13.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958155490 0x7f19580a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 >> v1:172.21.15.183:6789/0 conn(0x7f19580a9b40 legacy=0x7f19580c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580c0910 con 0x7f19580c1500 2023-11-27T20:43:13.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f1940001670 con 0x7f19580c1500 2023-11-27T20:43:13.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 >> v1:172.21.15.91:6789/0 conn(0x7f19580c1500 legacy=0x7f19580a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958155490 0x7f1944005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 0x7f19440069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1944006f10 0x7f1944007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194400dd20 con 0x7f19440061e0 2023-11-27T20:43:13.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194400de90 con 0x7f1944006f10 2023-11-27T20:43:13.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194400e050 con 0x7f1958155490 2023-11-27T20:43:13.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f194ffff640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 0x7f19440069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f1957fff640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958155490 0x7f1944005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f194ffff640 1 -- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958155490 msgr2=0x7f1944005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:13.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f194ffff640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958155490 0x7f1944005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f194ffff640 1 -- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1944006f10 msgr2=0x7f1944007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:13.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f195cfbb640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1944006f10 0x7f1944007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f194ffff640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1944006f10 0x7f1944007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.764+0000 7f194ffff640 1 -- 172.21.15.91:0/1978879960 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1944005730 con 0x7f19440061e0 2023-11-27T20:43:13.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.765+0000 7f194ffff640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 0x7f19440069d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f194000c240 tx=0x7f1944007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0a7ed885f42fb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:13.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.767+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940005ad0 con 0x7f19440061e0 2023-11-27T20:43:13.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.767+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1940005c30 con 0x7f19440061e0 2023-11-27T20:43:13.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.767+0000 7f19577fe640 1 -- 172.21.15.91:0/1978879960 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194002caf0 con 0x7f19440061e0 2023-11-27T20:43:13.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.767+0000 7f195ea1e640 1 -- 172.21.15.91:0/1978879960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 msgr2=0x7f19440069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.767+0000 7f195ea1e640 1 --2- 172.21.15.91:0/1978879960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 0x7f19440069d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f194000c240 tx=0x7f1944007a00 comp rx=0 tx=0).stop 2023-11-27T20:43:13.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.767+0000 7f195cfbb640 1 -- 172.21.15.91:0/1978879960 reap_dead start 2023-11-27T20:43:13.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.767+0000 7f195ea1e640 1 -- 172.21.15.91:0/1978879960 shutdown_connections 2023-11-27T20:43:13.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.767+0000 7f195ea1e640 1 -- 172.21.15.91:0/1978879960 >> 172.21.15.91:0/1978879960 conn(0x7f195806a500 msgr2=0x7f195806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:13.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.767+0000 7f195ea1e640 1 -- 172.21.15.91:0/1978879960 shutdown_connections 2023-11-27T20:43:13.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.767+0000 7f195ea1e640 1 -- 172.21.15.91:0/1978879960 wait complete. 2023-11-27T20:43:13.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.768+0000 7f195ea1e640 1 Processor -- start 2023-11-27T20:43:13.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.768+0000 7f195ea1e640 1 -- start start 2023-11-27T20:43:13.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.769+0000 7f195ea1e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 0x7f1958071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.769+0000 7f195ea1e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958072040 0x7f19581dff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.769+0000 7f195ea1e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19581e0460 0x7f19581ed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.769+0000 7f195ea1e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19581dfab0 con 0x7f19440061e0 2023-11-27T20:43:13.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.769+0000 7f195ea1e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195814f530 con 0x7f19581e0460 2023-11-27T20:43:13.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.769+0000 7f195ea1e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19581df690 con 0x7f1958072040 2023-11-27T20:43:13.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.769+0000 7f1957fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 0x7f1958071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.769+0000 7f1957fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 0x7f1958071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52486/0 (socket says 172.21.15.91:52486) 2023-11-27T20:43:13.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.769+0000 7f1957fff640 1 -- 172.21.15.91:0/3208938655 learned_addr learned my addr 172.21.15.91:0/3208938655 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:13.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f194ffff640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958072040 0x7f19581dff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f1957fff640 1 -- 172.21.15.91:0/3208938655 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958072040 msgr2=0x7f19581dff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f1957fff640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958072040 0x7f19581dff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f1957fff640 1 -- 172.21.15.91:0/3208938655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19581e0460 msgr2=0x7f19581ed240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f1957fff640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19581e0460 0x7f19581ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f1957fff640 1 -- 172.21.15.91:0/3208938655 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19581db580 con 0x7f19440061e0 2023-11-27T20:43:13.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f194ffff640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958072040 0x7f19581dff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:13.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f1957fff640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 0x7f1958071060 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f194800f5b0 tx=0x7f194800fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:13.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f19557fa640 1 -- 172.21.15.91:0/3208938655 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948014870 con 0x7f19440061e0 2023-11-27T20:43:13.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f19557fa640 1 -- 172.21.15.91:0/3208938655 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19480149d0 con 0x7f19440061e0 2023-11-27T20:43:13.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f195ea1e640 1 -- 172.21.15.91:0/3208938655 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19581db860 con 0x7f19440061e0 2023-11-27T20:43:13.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.770+0000 7f19557fa640 1 -- 172.21.15.91:0/3208938655 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948014d80 con 0x7f19440061e0 2023-11-27T20:43:13.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.771+0000 7f195ea1e640 1 -- 172.21.15.91:0/3208938655 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19580715a0 con 0x7f19440061e0 2023-11-27T20:43:13.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.773+0000 7f195ea1e640 1 -- 172.21.15.91:0/3208938655 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19580a77a0 con 0x7f19440061e0 2023-11-27T20:43:13.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.773+0000 7f19557fa640 1 -- 172.21.15.91:0/3208938655 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1948015410 con 0x7f19440061e0 2023-11-27T20:43:13.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.774+0000 7f19557fa640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f193806b1c0 0x7f193806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:13.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.774+0000 7f19557fa640 1 -- 172.21.15.91:0/3208938655 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f194808a810 con 0x7f19440061e0 2023-11-27T20:43:13.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.774+0000 7f194ffff640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f193806b1c0 0x7f193806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:13.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.775+0000 7f194ffff640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f193806b1c0 0x7f193806d680 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1940034000 tx=0x7f1940009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:13.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.778+0000 7f19557fa640 1 -- 172.21.15.91:0/3208938655 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f19480551d0 con 0x7f19440061e0 2023-11-27T20:43:13.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.991+0000 7f195ea1e640 1 -- 172.21.15.91:0/3208938655 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1958068350 con 0x7f19440061e0 2023-11-27T20:43:13.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.992+0000 7f19557fa640 1 -- 172.21.15.91:0/3208938655 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+149 (secure 0 0 0) 0x7f19480587f0 con 0x7f19440061e0 2023-11-27T20:43:13.992 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:43:13.992 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 -- 172.21.15.91:0/3208938655 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f193806b1c0 msgr2=0x7f193806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f193806b1c0 0x7f193806d680 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1940034000 tx=0x7f1940009030 comp rx=0 tx=0).stop 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 -- 172.21.15.91:0/3208938655 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 msgr2=0x7f1958071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 0x7f1958071060 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f194800f5b0 tx=0x7f194800fa70 comp rx=0 tx=0).stop 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 -- 172.21.15.91:0/3208938655 shutdown_connections 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f193806b1c0 0x7f193806d680 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19581e0460 0x7f19581ed240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1958072040 0x7f19581dff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 --2- 172.21.15.91:0/3208938655 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19440061e0 0x7f1958071060 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 -- 172.21.15.91:0/3208938655 >> 172.21.15.91:0/3208938655 conn(0x7f195806a500 msgr2=0x7f1958152bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 -- 172.21.15.91:0/3208938655 shutdown_connections 2023-11-27T20:43:13.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:13.994+0000 7f195ea1e640 1 -- 172.21.15.91:0/3208938655 wait complete. 2023-11-27T20:43:14.013 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-27T20:43:14.014 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:43:14.014 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-27T20:43:14.014 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-27T20:43:14.014 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T20:43:14.014 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-27T20:43:14.014 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:43:14.014 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:43:14.014 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:43:14.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:14.015 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-27T20:43:14.074 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-27T20:43:14.075 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42264sec preferred_lft 42264sec 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8479:57ff:fe06:e35b/64 scope link 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:14.076 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:43:14.077 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T20:43:14.077 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::40e4:26ff:fe7f:e25/64 scope link 2023-11-27T20:43:14.077 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:14.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:14.078 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:43:14.167 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-27T20:43:14.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:14.171 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-27T20:43:14.227 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-27T20:43:14.227 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:43:14.227 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:43:14.227 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:43:14.227 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:43:14.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:14.228 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:43:14.228 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:43:14.228 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:43:14.228 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:43:14.228 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:43:14.228 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:43:14.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:14.414 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-27T20:43:14.464 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-27T20:43:14.464 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:43:14.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:14.464 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-11-27T20:43:14.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:43:14.553 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-27T20:43:14.605 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:43:14.606 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:43:14.606 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:43:14.653 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:43:14.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:14.654 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:43:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:43:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-27T20:43:14.786 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:43:14.807 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:43:14.807 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-27T20:43:14.808 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:43:14.808 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:43:14.808 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:43:14.835 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:43:14.835 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-27T20:43:14.835 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:43:14.835 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:43:14.835 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:43:14.836 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:43:14.836 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:43:14.836 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:43:14.838 INFO:teuthology.orchestra.run.smithi183.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-27T20:43:14.838 INFO:teuthology.orchestra.run.smithi183.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:43:14.838 INFO:teuthology.orchestra.run.smithi183.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:43:14.838 INFO:teuthology.orchestra.run.smithi183.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:43:14.838 INFO:teuthology.orchestra.run.smithi183.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:43:14.844 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:43:14.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:14.844 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:43:14.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:14.935 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:43:15.012 INFO:teuthology.orchestra.run.smithi183.stdout:client4598 2023-11-27T20:43:15.012 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:43:15.012 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:15.064 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-11-27T20:43:15.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.293+0000 7f80f4d83640 1 Processor -- start 2023-11-27T20:43:15.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.293+0000 7f80f4d83640 1 -- start start 2023-11-27T20:43:15.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.295+0000 7f80f4d83640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80f00aeb40 0x7f80f00c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:15.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.295+0000 7f80f4d83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80f00c98c0 0x7f80f00c8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:15.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.295+0000 7f80f4d83640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f00c8070 con 0x7f80f0151910 2023-11-27T20:43:15.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.295+0000 7f80f4d83640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f00add40 con 0x7f80f00aeb40 2023-11-27T20:43:15.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.295+0000 7f80f4d83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00af330 con 0x7f80f00c98c0 2023-11-27T20:43:15.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.295+0000 7f80eeffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80f00aeb40 0x7f80f00c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:15.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.295+0000 7f80eeffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80f00aeb40 0x7f80f00c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53220/0 (socket says 172.21.15.91:53220) 2023-11-27T20:43:15.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.295+0000 7f80eeffd640 1 -- 172.21.15.91:0/2638527161 learned_addr learned my addr 172.21.15.91:0/2638527161 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:15.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.296+0000 7f80effff640 1 --2- 172.21.15.91:0/2638527161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80f00c98c0 0x7f80f00c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:15.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.296+0000 7f80eeffd640 1 -- 172.21.15.91:0/2638527161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80f00c98c0 msgr2=0x7f80f00c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:15.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.296+0000 7f80eeffd640 1 --2- 172.21.15.91:0/2638527161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80f00c98c0 0x7f80f00c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.296+0000 7f80eeffd640 1 -- 172.21.15.91:0/2638527161 >> v1:172.21.15.183:6789/0 conn(0x7f80f0151910 legacy=0x7f80f0154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:15.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.296+0000 7f80eeffd640 1 -- 172.21.15.91:0/2638527161 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00aceb0 con 0x7f80f00aeb40 2023-11-27T20:43:15.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.296+0000 7f80effff640 1 --2- 172.21.15.91:0/2638527161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80f00c98c0 0x7f80f00c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:15.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.297+0000 7f80eeffd640 1 --2- 172.21.15.91:0/2638527161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f00aeb40 0x7f80f00c9380 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e50 tx=0x7f80d802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a331108b4954df server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:15.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.297+0000 7f80ee7fc640 1 -- 172.21.15.91:0/2638527161 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d802ca70 con 0x7f80f00aeb40 2023-11-27T20:43:15.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.297+0000 7f80ee7fc640 1 -- 172.21.15.91:0/2638527161 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d802cbd0 con 0x7f80f00aeb40 2023-11-27T20:43:15.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.297+0000 7f80ee7fc640 1 -- 172.21.15.91:0/2638527161 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80343f0 con 0x7f80f00aeb40 2023-11-27T20:43:15.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.298+0000 7f80f4d83640 1 -- 172.21.15.91:0/2638527161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f00aeb40 msgr2=0x7f80f00c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:15.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.298+0000 7f80f4d83640 1 --2- 172.21.15.91:0/2638527161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f00aeb40 0x7f80f00c9380 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e50 tx=0x7f80d802bed0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.298+0000 7f80f4d83640 1 -- 172.21.15.91:0/2638527161 shutdown_connections 2023-11-27T20:43:15.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.298+0000 7f80f4d83640 1 --2- 172.21.15.91:0/2638527161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80f00c98c0 0x7f80f00c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.298+0000 7f80f4d83640 1 --2- 172.21.15.91:0/2638527161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f00aeb40 0x7f80f00c9380 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.298+0000 7f80f4d83640 1 -- 172.21.15.91:0/2638527161 >> 172.21.15.91:0/2638527161 conn(0x7f80f0072830 msgr2=0x7f80f00abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:15.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.298+0000 7f80f4d83640 1 -- 172.21.15.91:0/2638527161 shutdown_connections 2023-11-27T20:43:15.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.298+0000 7f80f4d83640 1 -- 172.21.15.91:0/2638527161 wait complete. 2023-11-27T20:43:15.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.300+0000 7f80f4d83640 1 Processor -- start 2023-11-27T20:43:15.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.300+0000 7f80f4d83640 1 -- start start 2023-11-27T20:43:15.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.301+0000 7f80f4d83640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80f00aeb40 0x7f80f006c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:15.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.301+0000 7f80f4d83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80f00c98c0 0x7f80f01ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:15.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.301+0000 7f80f4d83640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f0151910 0x7f80f01ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:15.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.301+0000 7f80f4d83640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f01df860 con 0x7f80f0151910 2023-11-27T20:43:15.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.301+0000 7f80f4d83640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0154640 con 0x7f80f00aeb40 2023-11-27T20:43:15.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.301+0000 7f80f4d83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0155140 con 0x7f80f00c98c0 2023-11-27T20:43:15.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.301+0000 7f80effff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f0151910 0x7f80f01ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:15.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.301+0000 7f80effff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f0151910 0x7f80f01ed360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53232/0 (socket says 172.21.15.91:53232) 2023-11-27T20:43:15.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.301+0000 7f80effff640 1 -- 172.21.15.91:0/1256986654 learned_addr learned my addr 172.21.15.91:0/1256986654 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:15.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80ef7fe640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80f00aeb40 0x7f80f006c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:15.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80effff640 1 -- 172.21.15.91:0/1256986654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80f00c98c0 msgr2=0x7f80f01ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:15.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80effff640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80f00c98c0 0x7f80f01ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80effff640 1 -- 172.21.15.91:0/1256986654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80f00aeb40 msgr2=0x7f80f006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:15.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80effff640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80f00aeb40 0x7f80f006c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80effff640 1 -- 172.21.15.91:0/1256986654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8009b30 con 0x7f80f0151910 2023-11-27T20:43:15.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80effff640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f0151910 0x7f80f01ed360 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c7f0 tx=0x7f80e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:15.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80e7fff640 1 -- 172.21.15.91:0/1256986654 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8007820 con 0x7f80f0151910 2023-11-27T20:43:15.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80e7fff640 1 -- 172.21.15.91:0/1256986654 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e8007980 con 0x7f80f0151910 2023-11-27T20:43:15.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80e7fff640 1 -- 172.21.15.91:0/1256986654 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8007d30 con 0x7f80f0151910 2023-11-27T20:43:15.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80f4d83640 1 -- 172.21.15.91:0/1256986654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f0155420 con 0x7f80f0151910 2023-11-27T20:43:15.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.302+0000 7f80f4d83640 1 -- 172.21.15.91:0/1256986654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f006c7b0 con 0x7f80f0151910 2023-11-27T20:43:15.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.304+0000 7f80f4d83640 1 -- 172.21.15.91:0/1256986654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f0155660 con 0x7f80f0151910 2023-11-27T20:43:15.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.304+0000 7f80e7fff640 1 -- 172.21.15.91:0/1256986654 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f80e80113f0 con 0x7f80f0151910 2023-11-27T20:43:15.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.306+0000 7f80e7fff640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 0x7f80d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:15.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.306+0000 7f80e7fff640 1 -- 172.21.15.91:0/1256986654 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f80e808a460 con 0x7f80f0151910 2023-11-27T20:43:15.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.306+0000 7f80ef7fe640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 0x7f80d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:15.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.307+0000 7f80ef7fe640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 0x7f80d006d680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f80e0006fd0 tx=0x7f80e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:15.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.311+0000 7f80e7fff640 1 -- 172.21.15.91:0/1256986654 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f80f0155660 con 0x7f80f0151910 2023-11-27T20:43:15.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.541+0000 7f80f4d83640 1 -- 172.21.15.91:0/1256986654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f80f0155660 con 0x7f80f0151910 2023-11-27T20:43:15.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.546+0000 7f80e7fff640 1 -- 172.21.15.91:0/1256986654 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v17) v1 ==== 134+0+185 (secure 0 0 0) 0x7f80f0155660 con 0x7f80f0151910 2023-11-27T20:43:15.547 INFO:teuthology.orchestra.run.smithi091.stdout:[client.testuser] 2023-11-27T20:43:15.547 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBj/2RlR8ZeIBAAKBJlovUboYx+59I6/uYa/Q== 2023-11-27T20:43:15.547 INFO:teuthology.orchestra.run.smithi091.stdout: caps mds = "allow rw fsname=cephfs" 2023-11-27T20:43:15.547 INFO:teuthology.orchestra.run.smithi091.stdout: caps mon = "allow r fsname=cephfs" 2023-11-27T20:43:15.547 INFO:teuthology.orchestra.run.smithi091.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-27T20:43:15.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.549+0000 7f80f4d83640 1 -- 172.21.15.91:0/1256986654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 msgr2=0x7f80d006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:15.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.549+0000 7f80f4d83640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 0x7f80d006d680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f80e0006fd0 tx=0x7f80e0008040 comp rx=0 tx=0).stop 2023-11-27T20:43:15.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.549+0000 7f80f4d83640 1 -- 172.21.15.91:0/1256986654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f0151910 msgr2=0x7f80f01ed360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:15.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.549+0000 7f80f4d83640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f0151910 0x7f80f01ed360 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c7f0 tx=0x7f80e800ccb0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.550+0000 7f80f4d83640 1 -- 172.21.15.91:0/1256986654 shutdown_connections 2023-11-27T20:43:15.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.550+0000 7f80f4d83640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80f0151910 0x7f80f01ed360 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.550+0000 7f80f4d83640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80f00c98c0 0x7f80f01ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.550+0000 7f80f4d83640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 0x7f80d006d680 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.550+0000 7f80f4d83640 1 --2- 172.21.15.91:0/1256986654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80f00aeb40 0x7f80f006c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:15.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.550+0000 7f80f4d83640 1 -- 172.21.15.91:0/1256986654 >> 172.21.15.91:0/1256986654 conn(0x7f80f0072830 msgr2=0x7f80f00c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:15.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.550+0000 7f80f4d83640 1 -- 172.21.15.91:0/1256986654 shutdown_connections 2023-11-27T20:43:15.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:15.550+0000 7f80f4d83640 1 -- 172.21.15.91:0/1256986654 wait complete. 2023-11-27T20:43:15.569 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-27T20:43:15.619 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.HzeziEUq8J 2023-11-27T20:43:15.619 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:43:15.619 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/tmp/tmp.HzeziEUq8J 2023-11-27T20:43:15.664 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:43:15.664 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:15.763 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:43:15.764 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:15.817 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:16.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.030+0000 7ff518e90640 1 Processor -- start 2023-11-27T20:43:16.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.031+0000 7ff518e90640 1 -- start start 2023-11-27T20:43:16.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.032+0000 7ff518e90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5140c7e90 0x7ff5140c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.032+0000 7ff518e90640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff5140c4e50 0x7ff51406b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.032+0000 7ff518e90640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5140bd8d0 con 0x7ff51414e810 2023-11-27T20:43:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.032+0000 7ff518e90640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5140c6e60 con 0x7ff5140c4e50 2023-11-27T20:43:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.032+0000 7ff518e90640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140c70d0 con 0x7ff5140c7e90 2023-11-27T20:43:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.032+0000 7ff51259c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff51414e810 0x7ff5141550c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55388/0 (socket says 172.21.15.91:55388) 2023-11-27T20:43:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.032+0000 7ff51259c640 1 -- 172.21.15.91:0/3827828705 learned_addr learned my addr 172.21.15.91:0/3827828705 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.032+0000 7ff512d9d640 1 --2- 172.21.15.91:0/3827828705 >> v2:172.21.15.91:3300/0 conn(0x7ff5140c4e50 0x7ff51406b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.033+0000 7ff511d9b640 1 --2- 172.21.15.91:0/3827828705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5140c7e90 0x7ff5140c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.033+0000 7ff51159a640 1 -- 172.21.15.91:0/3827828705 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486922654 0 0) 0x7ff5140bd8d0 con 0x7ff51414e810 2023-11-27T20:43:16.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.033+0000 7ff51159a640 1 -- 172.21.15.91:0/3827828705 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff500003520 con 0x7ff51414e810 2023-11-27T20:43:16.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.033+0000 7ff512d9d640 1 -- 172.21.15.91:0/3827828705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5140c7e90 msgr2=0x7ff5140c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:16.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.033+0000 7ff512d9d640 1 --2- 172.21.15.91:0/3827828705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5140c7e90 0x7ff5140c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.033+0000 7ff512d9d640 1 -- 172.21.15.91:0/3827828705 >> v1:172.21.15.91:6789/0 conn(0x7ff51414e810 legacy=0x7ff5141550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.033+0000 7ff512d9d640 1 -- 172.21.15.91:0/3827828705 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5140c73b0 con 0x7ff5140c4e50 2023-11-27T20:43:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.034+0000 7ff512d9d640 1 --2- 172.21.15.91:0/3827828705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 0x7ff51406b7d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0097a0 tx=0x7ff50c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699c24cc6df8fd30 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.034+0000 7ff51159a640 1 -- 172.21.15.91:0/3827828705 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c02e070 con 0x7ff5140c4e50 2023-11-27T20:43:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.034+0000 7ff51159a640 1 -- 172.21.15.91:0/3827828705 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c0315a0 con 0x7ff5140c4e50 2023-11-27T20:43:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.034+0000 7ff51159a640 1 -- 172.21.15.91:0/3827828705 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c031930 con 0x7ff5140c4e50 2023-11-27T20:43:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.035+0000 7ff518e90640 1 -- 172.21.15.91:0/3827828705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 msgr2=0x7ff51406b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.035+0000 7ff518e90640 1 --2- 172.21.15.91:0/3827828705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 0x7ff51406b7d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0097a0 tx=0x7ff50c02b840 comp rx=0 tx=0).stop 2023-11-27T20:43:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.035+0000 7ff518e90640 1 -- 172.21.15.91:0/3827828705 shutdown_connections 2023-11-27T20:43:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.035+0000 7ff518e90640 1 --2- 172.21.15.91:0/3827828705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 0x7ff51406b7d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.035+0000 7ff518e90640 1 --2- 172.21.15.91:0/3827828705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5140c7e90 0x7ff5140c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.035+0000 7ff518e90640 1 -- 172.21.15.91:0/3827828705 >> 172.21.15.91:0/3827828705 conn(0x7ff5140ca170 msgr2=0x7ff5140ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.035+0000 7ff518e90640 1 -- 172.21.15.91:0/3827828705 shutdown_connections 2023-11-27T20:43:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.035+0000 7ff518e90640 1 -- 172.21.15.91:0/3827828705 wait complete. 2023-11-27T20:43:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.037+0000 7ff518e90640 1 Processor -- start 2023-11-27T20:43:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.037+0000 7ff518e90640 1 -- start start 2023-11-27T20:43:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.038+0000 7ff518e90640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 0x7ff51414ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.038+0000 7ff518e90640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5140c7e90 0x7ff5141ea7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff518e90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51414e810 0x7ff514150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff518e90640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5141e9dd0 con 0x7ff5140c4e50 2023-11-27T20:43:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff518e90640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51414f130 con 0x7ff5140c7e90 2023-11-27T20:43:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff518e90640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5141ead00 con 0x7ff51414e810 2023-11-27T20:43:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff51259c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 0x7ff51414ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff51259c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 0x7ff51414ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53238/0 (socket says 172.21.15.91:53238) 2023-11-27T20:43:16.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff51259c640 1 -- 172.21.15.91:0/1989644690 learned_addr learned my addr 172.21.15.91:0/1989644690 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff511d9b640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5140c7e90 0x7ff5141ea7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff512d9d640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51414e810 0x7ff514150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff51259c640 1 -- 172.21.15.91:0/1989644690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51414e810 msgr2=0x7ff514150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff51259c640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51414e810 0x7ff514150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff51259c640 1 -- 172.21.15.91:0/1989644690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5140c7e90 msgr2=0x7ff5141ea7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff51259c640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5140c7e90 0x7ff5141ea7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff51259c640 1 -- 172.21.15.91:0/1989644690 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c009400 con 0x7ff5140c4e50 2023-11-27T20:43:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.039+0000 7ff511d9b640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5140c7e90 0x7ff5141ea7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.040+0000 7ff51259c640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 0x7ff51414ebf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff50400cbc0 tx=0x7ff50400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.040+0000 7ff50affd640 1 -- 172.21.15.91:0/1989644690 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400ad40 con 0x7ff5140c4e50 2023-11-27T20:43:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.040+0000 7ff50affd640 1 -- 172.21.15.91:0/1989644690 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff504012400 con 0x7ff5140c4e50 2023-11-27T20:43:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.040+0000 7ff50affd640 1 -- 172.21.15.91:0/1989644690 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400aea0 con 0x7ff5140c4e50 2023-11-27T20:43:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.040+0000 7ff518e90640 1 -- 172.21.15.91:0/1989644690 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5141518a0 con 0x7ff5140c4e50 2023-11-27T20:43:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.040+0000 7ff518e90640 1 -- 172.21.15.91:0/1989644690 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5141e9fc0 con 0x7ff5140c4e50 2023-11-27T20:43:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.041+0000 7ff518e90640 1 -- 172.21.15.91:0/1989644690 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff514151dc0 con 0x7ff5140c4e50 2023-11-27T20:43:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.042+0000 7ff50affd640 1 -- 172.21.15.91:0/1989644690 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff504007070 con 0x7ff5140c4e50 2023-11-27T20:43:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.043+0000 7ff50affd640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4f406b1c0 0x7ff4f406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.043+0000 7ff50affd640 1 -- 172.21.15.91:0/1989644690 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff504089db0 con 0x7ff5140c4e50 2023-11-27T20:43:16.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.043+0000 7ff511d9b640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4f406b1c0 0x7ff4f406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.044+0000 7ff511d9b640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4f406b1c0 0x7ff4f406d680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff51414dc60 tx=0x7ff4fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:16.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.048+0000 7ff50affd640 1 -- 172.21.15.91:0/1989644690 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff514151dc0 con 0x7ff5140c4e50 2023-11-27T20:43:16.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.239+0000 7ff518e90640 1 -- 172.21.15.91:0/1989644690 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff514151dc0 con 0x7ff5140c4e50 2023-11-27T20:43:16.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.241+0000 7ff50affd640 1 -- 172.21.15.91:0/1989644690 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20194 (secure 0 0 0) 0x7ff514151dc0 con 0x7ff5140c4e50 2023-11-27T20:43:16.242 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:16.242 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":38,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:00.559657+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 -- 172.21.15.91:0/1989644690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4f406b1c0 msgr2=0x7ff4f406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4f406b1c0 0x7ff4f406d680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff51414dc60 tx=0x7ff4fc008040 comp rx=0 tx=0).stop 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 -- 172.21.15.91:0/1989644690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 msgr2=0x7ff51414ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 0x7ff51414ebf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff50400cbc0 tx=0x7ff50400a430 comp rx=0 tx=0).stop 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 -- 172.21.15.91:0/1989644690 shutdown_connections 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51414e810 0x7ff514150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4f406b1c0 0x7ff4f406d680 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5140c7e90 0x7ff5141ea7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 --2- 172.21.15.91:0/1989644690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5140c4e50 0x7ff51414ebf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 -- 172.21.15.91:0/1989644690 >> 172.21.15.91:0/1989644690 conn(0x7ff5140ca170 msgr2=0x7ff5141560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.243+0000 7ff518e90640 1 -- 172.21.15.91:0/1989644690 shutdown_connections 2023-11-27T20:43:16.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.244+0000 7ff518e90640 1 -- 172.21.15.91:0/1989644690 wait complete. 2023-11-27T20:43:16.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:42:35.743447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:42:36.976231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:42:56.585972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:42:58.003354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:43:16.263 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:43:16.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.476+0000 7fc8ae01a640 1 Processor -- start 2023-11-27T20:43:16.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.476+0000 7fc8ae01a640 1 -- start start 2023-11-27T20:43:16.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.477+0000 7fc8ae01a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc8a814e7f0 0x7fc8a80c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.477+0000 7fc8ae01a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a806cd20 0x7fc8a815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.477+0000 7fc8ae01a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a80a8380 con 0x7fc8a80c52e0 2023-11-27T20:43:16.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.477+0000 7fc8ae01a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a81510b0 con 0x7fc8a814e7f0 2023-11-27T20:43:16.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.477+0000 7fc8ae01a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a806bf60 con 0x7fc8a806cd20 2023-11-27T20:43:16.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.478+0000 7fc8ac817640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fc8a80c52e0 0x7fc8a806d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55402/0 (socket says 172.21.15.91:55402) 2023-11-27T20:43:16.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.478+0000 7fc8ac817640 1 -- 172.21.15.91:0/1400863691 learned_addr learned my addr 172.21.15.91:0/1400863691 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.478+0000 7fc8ad018640 1 --2- 172.21.15.91:0/1400863691 >> v2:172.21.15.183:3300/0 conn(0x7fc8a814e7f0 0x7fc8a80c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.478+0000 7fc8ad819640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a806cd20 0x7fc8a815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.478+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909731054 0 0) 0x7fc8a80a8380 con 0x7fc8a80c52e0 2023-11-27T20:43:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.478+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc894003520 con 0x7fc8a80c52e0 2023-11-27T20:43:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 428889620 0 0) 0x7fc894003520 con 0x7fc8a80c52e0 2023-11-27T20:43:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a806cd20 msgr2=0x7fc8a815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a806cd20 0x7fc8a815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 >> v2:172.21.15.183:3300/0 conn(0x7fc8a814e7f0 msgr2=0x7fc8a80c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 --2- 172.21.15.91:0/1400863691 >> v2:172.21.15.183:3300/0 conn(0x7fc8a814e7f0 0x7fc8a80c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a806c240 con 0x7fc8a80c52e0 2023-11-27T20:43:16.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fc898001670 con 0x7fc8a80c52e0 2023-11-27T20:43:16.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 >> v1:172.21.15.91:6789/0 conn(0x7fc8a80c52e0 legacy=0x7fc8a806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a806cd20 0x7fc894003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894003ef0 0x7fc8940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 0x7fc894005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a81510b0 con 0x7fc894004d00 2023-11-27T20:43:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a806bf60 con 0x7fc894003ef0 2023-11-27T20:43:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89400dc90 con 0x7fc8a806cd20 2023-11-27T20:43:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc8ad819640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 0x7fc894005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.479+0000 7fc8ad018640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a806cd20 0x7fc894003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.480+0000 7fc8ac817640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894003ef0 0x7fc8940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.480+0000 7fc8ad819640 1 -- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a806cd20 msgr2=0x7fc894003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:16.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.480+0000 7fc8ad819640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a806cd20 0x7fc894003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.480+0000 7fc8ad819640 1 -- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894003ef0 msgr2=0x7fc8940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:16.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.480+0000 7fc8ad819640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894003ef0 0x7fc8940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.480+0000 7fc8ad819640 1 -- 172.21.15.91:0/1400863691 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc894003520 con 0x7fc894004d00 2023-11-27T20:43:16.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.480+0000 7fc8ac817640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894003ef0 0x7fc8940047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:16.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.481+0000 7fc8ad819640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 0x7fc894005180 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0007360 tx=0x7fc8940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b6d603fe5e452f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:16.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.481+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a002cc80 con 0x7fc894004d00 2023-11-27T20:43:16.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.481+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a002cde0 con 0x7fc894004d00 2023-11-27T20:43:16.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.481+0000 7fc89ffff640 1 -- 172.21.15.91:0/1400863691 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0034680 con 0x7fc894004d00 2023-11-27T20:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.481+0000 7fc8ae01a640 1 -- 172.21.15.91:0/1400863691 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 msgr2=0x7fc894005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.481+0000 7fc8ae01a640 1 --2- 172.21.15.91:0/1400863691 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 0x7fc894005180 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0007360 tx=0x7fc8940057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.481+0000 7fc8ad819640 1 -- 172.21.15.91:0/1400863691 reap_dead start 2023-11-27T20:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.482+0000 7fc8ae01a640 1 -- 172.21.15.91:0/1400863691 shutdown_connections 2023-11-27T20:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.482+0000 7fc8ae01a640 1 -- 172.21.15.91:0/1400863691 >> 172.21.15.91:0/1400863691 conn(0x7fc8a80a77f0 msgr2=0x7fc8a80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.482+0000 7fc8ae01a640 1 -- 172.21.15.91:0/1400863691 shutdown_connections 2023-11-27T20:43:16.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.482+0000 7fc8ae01a640 1 -- 172.21.15.91:0/1400863691 wait complete. 2023-11-27T20:43:16.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.483+0000 7fc8ae01a640 1 Processor -- start 2023-11-27T20:43:16.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.483+0000 7fc8ae01a640 1 -- start start 2023-11-27T20:43:16.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.484+0000 7fc8ae01a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 0x7fc8a8152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.484+0000 7fc8ae01a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8a80abbc0 0x7fc8a8071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.484+0000 7fc8ae01a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a81476a0 0x7fc8a8147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.484+0000 7fc8ae01a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80a70e0 con 0x7fc894004d00 2023-11-27T20:43:16.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.484+0000 7fc8ae01a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80a67d0 con 0x7fc8a80abbc0 2023-11-27T20:43:16.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.484+0000 7fc8ae01a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80a5f30 con 0x7fc8a81476a0 2023-11-27T20:43:16.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.484+0000 7fc8ad018640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 0x7fc8a8152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.484+0000 7fc8ad018640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 0x7fc8a8152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53250/0 (socket says 172.21.15.91:53250) 2023-11-27T20:43:16.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.485+0000 7fc8ad018640 1 -- 172.21.15.91:0/71565423 learned_addr learned my addr 172.21.15.91:0/71565423 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:16.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.485+0000 7fc8ad018640 1 -- 172.21.15.91:0/71565423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a81476a0 msgr2=0x7fc8a8147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.485+0000 7fc8ad018640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a81476a0 0x7fc8a8147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.485+0000 7fc8ad018640 1 -- 172.21.15.91:0/71565423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8a80abbc0 msgr2=0x7fc8a8071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.485+0000 7fc8ad018640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8a80abbc0 0x7fc8a8071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.485+0000 7fc8ad018640 1 -- 172.21.15.91:0/71565423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80a6a20 con 0x7fc894004d00 2023-11-27T20:43:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.485+0000 7fc8ad018640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 0x7fc8a8152480 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40108e0 tx=0x7fc8a4010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.485+0000 7fc89dffb640 1 -- 172.21.15.91:0/71565423 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400eba0 con 0x7fc894004d00 2023-11-27T20:43:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.485+0000 7fc89dffb640 1 -- 172.21.15.91:0/71565423 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a400ed00 con 0x7fc894004d00 2023-11-27T20:43:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.486+0000 7fc89dffb640 1 -- 172.21.15.91:0/71565423 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a401c620 con 0x7fc894004d00 2023-11-27T20:43:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.486+0000 7fc8ae01a640 1 -- 172.21.15.91:0/71565423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a80a6d00 con 0x7fc894004d00 2023-11-27T20:43:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.486+0000 7fc8ae01a640 1 -- 172.21.15.91:0/71565423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a8148090 con 0x7fc894004d00 2023-11-27T20:43:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.487+0000 7fc8ae01a640 1 -- 172.21.15.91:0/71565423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a804e840 con 0x7fc894004d00 2023-11-27T20:43:16.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.488+0000 7fc89dffb640 1 -- 172.21.15.91:0/71565423 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc8a401c780 con 0x7fc894004d00 2023-11-27T20:43:16.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.489+0000 7fc89dffb640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc88c06b1b0 0x7fc88c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.489+0000 7fc89dffb640 1 -- 172.21.15.91:0/71565423 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc8a408a490 con 0x7fc894004d00 2023-11-27T20:43:16.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.489+0000 7fc8ac817640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc88c06b1b0 0x7fc88c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.490+0000 7fc8ac817640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc88c06b1b0 0x7fc88c06d670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80a4df0 tx=0x7fc898009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:16.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.494+0000 7fc89dffb640 1 -- 172.21.15.91:0/71565423 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc8a4054e50 con 0x7fc894004d00 2023-11-27T20:43:16.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.686+0000 7fc8ae01a640 1 -- 172.21.15.91:0/71565423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8a80c3c70 con 0x7fc894004d00 2023-11-27T20:43:16.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.687+0000 7fc89dffb640 1 -- 172.21.15.91:0/71565423 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8a4058470 con 0x7fc894004d00 2023-11-27T20:43:16.688 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:43:16.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 -- 172.21.15.91:0/71565423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc88c06b1b0 msgr2=0x7fc88c06d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc88c06b1b0 0x7fc88c06d670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80a4df0 tx=0x7fc898009040 comp rx=0 tx=0).stop 2023-11-27T20:43:16.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 -- 172.21.15.91:0/71565423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 msgr2=0x7fc8a8152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 0x7fc8a8152480 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40108e0 tx=0x7fc8a4010da0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 -- 172.21.15.91:0/71565423 shutdown_connections 2023-11-27T20:43:16.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a81476a0 0x7fc8a8147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc88c06b1b0 0x7fc88c06d670 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8a80abbc0 0x7fc8a8071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 --2- 172.21.15.91:0/71565423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc894004d00 0x7fc8a8152480 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 -- 172.21.15.91:0/71565423 >> 172.21.15.91:0/71565423 conn(0x7fc8a80a77f0 msgr2=0x7fc8a8150360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:16.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.690+0000 7fc8ae01a640 1 -- 172.21.15.91:0/71565423 shutdown_connections 2023-11-27T20:43:16.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.691+0000 7fc8ae01a640 1 -- 172.21.15.91:0/71565423 wait complete. 2023-11-27T20:43:16.707 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:43:16.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.923+0000 7f9457eb4640 1 Processor -- start 2023-11-27T20:43:16.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.923+0000 7f9457eb4640 1 -- start start 2023-11-27T20:43:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.924+0000 7f9457eb4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f945014fd30 0x7f9450152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.924+0000 7f9457eb4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f945006d0a0 0x7f94500a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.924+0000 7f9457eb4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94500a5260 0x7f94500c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.924+0000 7f9457eb4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94500c64a0 con 0x7f945006d0a0 2023-11-27T20:43:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.924+0000 7f9457eb4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94500c5c00 con 0x7f945014fd30 2023-11-27T20:43:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.924+0000 7f9457eb4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94500c5ee0 con 0x7f94500a5260 2023-11-27T20:43:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f945544f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f945006d0a0 0x7f94500a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f945544f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f945006d0a0 0x7f94500a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53264/0 (socket says 172.21.15.91:53264) 2023-11-27T20:43:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f945544f640 1 -- 172.21.15.91:0/847271235 learned_addr learned my addr 172.21.15.91:0/847271235 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:16.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f9455c50640 1 --2- 172.21.15.91:0/847271235 >> v2:172.21.15.183:3300/0 conn(0x7f945014fd30 0x7f9450152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f945544f640 1 -- 172.21.15.91:0/847271235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94500a5260 msgr2=0x7f94500c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f9456451640 1 --2- 172.21.15.91:0/847271235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94500a5260 0x7f94500c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f945544f640 1 --2- 172.21.15.91:0/847271235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94500a5260 0x7f94500c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f945544f640 1 -- 172.21.15.91:0/847271235 >> v2:172.21.15.183:3300/0 conn(0x7f945014fd30 msgr2=0x7f9450152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f945544f640 1 --2- 172.21.15.91:0/847271235 >> v2:172.21.15.183:3300/0 conn(0x7f945014fd30 0x7f9450152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f945544f640 1 -- 172.21.15.91:0/847271235 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94500c61c0 con 0x7f945006d0a0 2023-11-27T20:43:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.925+0000 7f9455c50640 1 --2- 172.21.15.91:0/847271235 >> v2:172.21.15.183:3300/0 conn(0x7f945014fd30 0x7f9450152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.926+0000 7f945544f640 1 --2- 172.21.15.91:0/847271235 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f945006d0a0 0x7f94500a4d20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f945006b200 tx=0x7f944002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d688f67919ba9686 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.926+0000 7f9454c4e640 1 -- 172.21.15.91:0/847271235 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440031870 con 0x7f945006d0a0 2023-11-27T20:43:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.926+0000 7f9454c4e640 1 -- 172.21.15.91:0/847271235 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94400319d0 con 0x7f945006d0a0 2023-11-27T20:43:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.926+0000 7f9454c4e640 1 -- 172.21.15.91:0/847271235 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440031d60 con 0x7f945006d0a0 2023-11-27T20:43:16.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.927+0000 7f9457eb4640 1 -- 172.21.15.91:0/847271235 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f945006d0a0 msgr2=0x7f94500a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.927+0000 7f9457eb4640 1 --2- 172.21.15.91:0/847271235 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f945006d0a0 0x7f94500a4d20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f945006b200 tx=0x7f944002b910 comp rx=0 tx=0).stop 2023-11-27T20:43:16.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.927+0000 7f9457eb4640 1 -- 172.21.15.91:0/847271235 shutdown_connections 2023-11-27T20:43:16.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.927+0000 7f9457eb4640 1 --2- 172.21.15.91:0/847271235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94500a5260 0x7f94500c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.927+0000 7f9457eb4640 1 --2- 172.21.15.91:0/847271235 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f945006d0a0 0x7f94500a4d20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.927+0000 7f9457eb4640 1 --2- 172.21.15.91:0/847271235 >> v2:172.21.15.183:3300/0 conn(0x7f945014fd30 0x7f9450152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.927+0000 7f9457eb4640 1 -- 172.21.15.91:0/847271235 >> 172.21.15.91:0/847271235 conn(0x7f945006a500 msgr2=0x7f945006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:16.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.927+0000 7f9457eb4640 1 -- 172.21.15.91:0/847271235 shutdown_connections 2023-11-27T20:43:16.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.927+0000 7f9457eb4640 1 -- 172.21.15.91:0/847271235 wait complete. 2023-11-27T20:43:16.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.929+0000 7f9457eb4640 1 Processor -- start 2023-11-27T20:43:16.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.930+0000 7f9457eb4640 1 -- start start 2023-11-27T20:43:16.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f9457eb4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f945006d0a0 0x7f94501eb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f9457eb4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94500a5260 0x7f94501ebc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f9457eb4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f945014fd30 0x7f94501559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f9457eb4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945014f930 con 0x7f94500a5260 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f9457eb4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94501dd040 con 0x7f945014fd30 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f9457eb4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94501ec170 con 0x7f945006d0a0 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f945544f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94500a5260 0x7f94501ebc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f945544f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94500a5260 0x7f94501ebc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53278/0 (socket says 172.21.15.91:53278) 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f945544f640 1 -- 172.21.15.91:0/2570753048 learned_addr learned my addr 172.21.15.91:0/2570753048 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f945544f640 1 -- 172.21.15.91:0/2570753048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f945006d0a0 msgr2=0x7f94501eb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f9455c50640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f945006d0a0 0x7f94501eb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f945544f640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f945006d0a0 0x7f94501eb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f945544f640 1 -- 172.21.15.91:0/2570753048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f945014fd30 msgr2=0x7f94501559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:16.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f945544f640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f945014fd30 0x7f94501559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:16.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.931+0000 7f945544f640 1 -- 172.21.15.91:0/2570753048 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94400094d0 con 0x7f94500a5260 2023-11-27T20:43:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.932+0000 7f945544f640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94500a5260 0x7f94501ebc30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9440000c00 tx=0x7f94400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.932+0000 7f94467fc640 1 -- 172.21.15.91:0/2570753048 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440031860 con 0x7f94500a5260 2023-11-27T20:43:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.932+0000 7f94467fc640 1 -- 172.21.15.91:0/2570753048 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94400443f0 con 0x7f94500a5260 2023-11-27T20:43:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.932+0000 7f94467fc640 1 -- 172.21.15.91:0/2570753048 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94400447a0 con 0x7f94500a5260 2023-11-27T20:43:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.932+0000 7f9457eb4640 1 -- 172.21.15.91:0/2570753048 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945014f650 con 0x7f94500a5260 2023-11-27T20:43:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.932+0000 7f9457eb4640 1 -- 172.21.15.91:0/2570753048 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94501dccd0 con 0x7f94500a5260 2023-11-27T20:43:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.933+0000 7f9457eb4640 1 -- 172.21.15.91:0/2570753048 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94501dc850 con 0x7f94500a5260 2023-11-27T20:43:16.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.934+0000 7f94467fc640 1 -- 172.21.15.91:0/2570753048 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9440044900 con 0x7f94500a5260 2023-11-27T20:43:16.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.935+0000 7f94467fc640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f943406b1f0 0x7f943406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:16.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.935+0000 7f94467fc640 1 -- 172.21.15.91:0/2570753048 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f944002d040 con 0x7f94500a5260 2023-11-27T20:43:16.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.935+0000 7f9455c50640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f943406b1f0 0x7f943406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:16.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.936+0000 7f9455c50640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f943406b1f0 0x7f943406d6b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f944c00b840 tx=0x7f944c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:16.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:16.939+0000 7f94467fc640 1 -- 172.21.15.91:0/2570753048 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f94501dc850 con 0x7f94500a5260 2023-11-27T20:43:17.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.124+0000 7f9457eb4640 1 -- 172.21.15.91:0/2570753048 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9450155700 con 0x7f94500a5260 2023-11-27T20:43:17.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.125+0000 7f94467fc640 1 -- 172.21.15.91:0/2570753048 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9450155700 con 0x7f94500a5260 2023-11-27T20:43:17.126 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:43:17.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 -- 172.21.15.91:0/2570753048 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f943406b1f0 msgr2=0x7f943406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f943406b1f0 0x7f943406d6b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f944c00b840 tx=0x7f944c008040 comp rx=0 tx=0).stop 2023-11-27T20:43:17.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 -- 172.21.15.91:0/2570753048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94500a5260 msgr2=0x7f94501ebc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94500a5260 0x7f94501ebc30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9440000c00 tx=0x7f94400046c0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 -- 172.21.15.91:0/2570753048 shutdown_connections 2023-11-27T20:43:17.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f943406b1f0 0x7f943406d6b0 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f944c00b840 tx=0x7f944c008040 comp rx=0 tx=0).stop 2023-11-27T20:43:17.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f945014fd30 0x7f94501559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94500a5260 0x7f94501ebc30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 --2- 172.21.15.91:0/2570753048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f945006d0a0 0x7f94501eb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 -- 172.21.15.91:0/2570753048 >> 172.21.15.91:0/2570753048 conn(0x7f945006a500 msgr2=0x7f94500a7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:17.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 -- 172.21.15.91:0/2570753048 shutdown_connections 2023-11-27T20:43:17.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.128+0000 7f9457eb4640 1 -- 172.21.15.91:0/2570753048 wait complete. 2023-11-27T20:43:17.145 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:43:17.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.345+0000 7f7316f93640 1 Processor -- start 2023-11-27T20:43:17.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.345+0000 7f7316f93640 1 -- start start 2023-11-27T20:43:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.347+0000 7f7316f93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f731014e7c0 0x7f73100c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.347+0000 7f7316f93640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f73100c4c00 0x7f73100ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.347+0000 7f7316f93640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f73100ca990 0x7f7310154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.347+0000 7f7316f93640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100c5b10 con 0x7f73100ca990 2023-11-27T20:43:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.347+0000 7f7316f93640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7310158a60 con 0x7f73100c4c00 2023-11-27T20:43:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.347+0000 7f7316f93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7310157ca0 con 0x7f731014e7c0 2023-11-27T20:43:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.347+0000 7f7316792640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f73100ca990 0x7f7310154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.347+0000 7f7316792640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f73100ca990 0x7f7310154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53290/0 (socket says 172.21.15.91:53290) 2023-11-27T20:43:17.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.347+0000 7f7316792640 1 -- 172.21.15.91:0/3665539324 learned_addr learned my addr 172.21.15.91:0/3665539324 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:17.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.348+0000 7f7315790640 1 --2- 172.21.15.91:0/3665539324 >> v2:172.21.15.183:3300/0 conn(0x7f73100c4c00 0x7f73100ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.348+0000 7f7315f91640 1 --2- 172.21.15.91:0/3665539324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f731014e7c0 0x7f73100c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.348+0000 7f7316792640 1 -- 172.21.15.91:0/3665539324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f731014e7c0 msgr2=0x7f73100c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:17.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.348+0000 7f7316792640 1 --2- 172.21.15.91:0/3665539324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f731014e7c0 0x7f73100c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.348+0000 7f7316792640 1 -- 172.21.15.91:0/3665539324 >> v2:172.21.15.183:3300/0 conn(0x7f73100c4c00 msgr2=0x7f73100ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:17.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.348+0000 7f7316792640 1 --2- 172.21.15.91:0/3665539324 >> v2:172.21.15.183:3300/0 conn(0x7f73100c4c00 0x7f73100ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.348+0000 7f7316792640 1 -- 172.21.15.91:0/3665539324 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310157f80 con 0x7f73100ca990 2023-11-27T20:43:17.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.349+0000 7f7316792640 1 --2- 172.21.15.91:0/3665539324 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73100ca990 0x7f7310154580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f731008ba20 tx=0x7f730802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84526c006d198b45 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:17.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.349+0000 7f7314f8f640 1 -- 172.21.15.91:0/3665539324 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730802c950 con 0x7f73100ca990 2023-11-27T20:43:17.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.349+0000 7f7314f8f640 1 -- 172.21.15.91:0/3665539324 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730802cab0 con 0x7f73100ca990 2023-11-27T20:43:17.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.349+0000 7f7314f8f640 1 -- 172.21.15.91:0/3665539324 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730802ce40 con 0x7f73100ca990 2023-11-27T20:43:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.350+0000 7f7316f93640 1 -- 172.21.15.91:0/3665539324 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73100ca990 msgr2=0x7f7310154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.350+0000 7f7316f93640 1 --2- 172.21.15.91:0/3665539324 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73100ca990 0x7f7310154580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f731008ba20 tx=0x7f730802bdb0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.350+0000 7f7316f93640 1 -- 172.21.15.91:0/3665539324 shutdown_connections 2023-11-27T20:43:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.350+0000 7f7316f93640 1 --2- 172.21.15.91:0/3665539324 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73100ca990 0x7f7310154580 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.350+0000 7f7316f93640 1 --2- 172.21.15.91:0/3665539324 >> v2:172.21.15.183:3300/0 conn(0x7f73100c4c00 0x7f73100ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.350+0000 7f7316f93640 1 --2- 172.21.15.91:0/3665539324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f731014e7c0 0x7f73100c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.350+0000 7f7316f93640 1 -- 172.21.15.91:0/3665539324 >> 172.21.15.91:0/3665539324 conn(0x7f73100abf00 msgr2=0x7f73100c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.350+0000 7f7316f93640 1 -- 172.21.15.91:0/3665539324 shutdown_connections 2023-11-27T20:43:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.350+0000 7f7316f93640 1 -- 172.21.15.91:0/3665539324 wait complete. 2023-11-27T20:43:17.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.351+0000 7f7316f93640 1 Processor -- start 2023-11-27T20:43:17.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.352+0000 7f7316f93640 1 -- start start 2023-11-27T20:43:17.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.352+0000 7f7316f93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73100c4c00 0x7f73100c1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.352+0000 7f7316f93640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73100ca990 0x7f73100bf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.352+0000 7f7316f93640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f731014e7c0 0x7f73100be660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.352+0000 7f7316f93640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73101576c0 con 0x7f731014e7c0 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.352+0000 7f7316f93640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100bf940 con 0x7f73100ca990 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.352+0000 7f7316f93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73101ee0d0 con 0x7f73100c4c00 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.353+0000 7f7316792640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f731014e7c0 0x7f73100be660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.353+0000 7f7316792640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f731014e7c0 0x7f73100be660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53300/0 (socket says 172.21.15.91:53300) 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.353+0000 7f7316792640 1 -- 172.21.15.91:0/4095601369 learned_addr learned my addr 172.21.15.91:0/4095601369 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.353+0000 7f7316792640 1 -- 172.21.15.91:0/4095601369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73100c4c00 msgr2=0x7f73100c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.353+0000 7f7316792640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73100c4c00 0x7f73100c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.353+0000 7f7316792640 1 -- 172.21.15.91:0/4095601369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73100ca990 msgr2=0x7f73100bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.353+0000 7f7315790640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73100ca990 0x7f73100bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.353+0000 7f7316792640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73100ca990 0x7f73100bf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.353+0000 7f7316792640 1 -- 172.21.15.91:0/4095601369 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308009b30 con 0x7f731014e7c0 2023-11-27T20:43:17.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.353+0000 7f7316792640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f731014e7c0 0x7f73100be660 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7308036040 tx=0x7f7308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:17.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.354+0000 7f73067fc640 1 -- 172.21.15.91:0/4095601369 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308009510 con 0x7f731014e7c0 2023-11-27T20:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.354+0000 7f73067fc640 1 -- 172.21.15.91:0/4095601369 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730803e450 con 0x7f731014e7c0 2023-11-27T20:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.354+0000 7f73067fc640 1 -- 172.21.15.91:0/4095601369 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730803e7e0 con 0x7f731014e7c0 2023-11-27T20:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.354+0000 7f7316f93640 1 -- 172.21.15.91:0/4095601369 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73100c3a90 con 0x7f731014e7c0 2023-11-27T20:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.354+0000 7f7316f93640 1 -- 172.21.15.91:0/4095601369 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73100c2850 con 0x7f731014e7c0 2023-11-27T20:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.355+0000 7f7316f93640 1 -- 172.21.15.91:0/4095601369 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73100c1330 con 0x7f731014e7c0 2023-11-27T20:43:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.356+0000 7f73067fc640 1 -- 172.21.15.91:0/4095601369 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f730803e940 con 0x7f731014e7c0 2023-11-27T20:43:17.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.357+0000 7f73067fc640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f72f406b1c0 0x7f72f406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.357+0000 7f73067fc640 1 -- 172.21.15.91:0/4095601369 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f73080accb0 con 0x7f731014e7c0 2023-11-27T20:43:17.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.357+0000 7f7315f91640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f72f406b1c0 0x7f72f406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.358+0000 7f7315f91640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f72f406b1c0 0x7f72f406d680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f730c006fd0 tx=0x7f730c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:17.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.361+0000 7f73067fc640 1 -- 172.21.15.91:0/4095601369 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f73100c1330 con 0x7f731014e7c0 2023-11-27T20:43:17.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.546+0000 7f7316f93640 1 -- 172.21.15.91:0/4095601369 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73100c1330 con 0x7f731014e7c0 2023-11-27T20:43:17.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.547+0000 7f73067fc640 1 -- 172.21.15.91:0/4095601369 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7308043020 con 0x7f731014e7c0 2023-11-27T20:43:17.548 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:43:17.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 -- 172.21.15.91:0/4095601369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f72f406b1c0 msgr2=0x7f72f406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f72f406b1c0 0x7f72f406d680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f730c006fd0 tx=0x7f730c008040 comp rx=0 tx=0).stop 2023-11-27T20:43:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 -- 172.21.15.91:0/4095601369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f731014e7c0 msgr2=0x7f73100be660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f731014e7c0 0x7f73100be660 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7308036040 tx=0x7f7308004a40 comp rx=0 tx=0).stop 2023-11-27T20:43:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 -- 172.21.15.91:0/4095601369 shutdown_connections 2023-11-27T20:43:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f731014e7c0 0x7f73100be660 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f72f406b1c0 0x7f72f406d680 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73100ca990 0x7f73100bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 --2- 172.21.15.91:0/4095601369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73100c4c00 0x7f73100c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 -- 172.21.15.91:0/4095601369 >> 172.21.15.91:0/4095601369 conn(0x7f73100abf00 msgr2=0x7f7310148da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 -- 172.21.15.91:0/4095601369 shutdown_connections 2023-11-27T20:43:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.550+0000 7f7316f93640 1 -- 172.21.15.91:0/4095601369 wait complete. 2023-11-27T20:43:17.568 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:43:17.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.783+0000 7fee2696e640 1 Processor -- start 2023-11-27T20:43:17.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.783+0000 7fee2696e640 1 -- start start 2023-11-27T20:43:17.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.784+0000 7fee2696e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fee20155490 0x7fee200a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.784+0000 7fee2696e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fee200c1500 0x7fee200a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.784+0000 7fee2696e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee200c4080 0x7fee200a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.784+0000 7fee2696e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee200a5820 con 0x7fee200c1500 2023-11-27T20:43:17.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee2696e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee200c06c0 con 0x7fee20155490 2023-11-27T20:43:17.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee2696e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee200c1020 con 0x7fee200c4080 2023-11-27T20:43:17.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee1f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fee200c1500 0x7fee200a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee1f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fee200c1500 0x7fee200a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53302/0 (socket says 172.21.15.91:53302) 2023-11-27T20:43:17.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee1f7fe640 1 -- 172.21.15.91:0/3099027818 learned_addr learned my addr 172.21.15.91:0/3099027818 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:17.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee1ffff640 1 --2- 172.21.15.91:0/3099027818 >> v2:172.21.15.183:3300/0 conn(0x7fee20155490 0x7fee200a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee1f7fe640 1 -- 172.21.15.91:0/3099027818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee200c4080 msgr2=0x7fee200a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:17.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee1f7fe640 1 --2- 172.21.15.91:0/3099027818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee200c4080 0x7fee200a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee1f7fe640 1 -- 172.21.15.91:0/3099027818 >> v2:172.21.15.183:3300/0 conn(0x7fee20155490 msgr2=0x7fee200a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:17.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee1f7fe640 1 --2- 172.21.15.91:0/3099027818 >> v2:172.21.15.183:3300/0 conn(0x7fee20155490 0x7fee200a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee1f7fe640 1 -- 172.21.15.91:0/3099027818 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200c0910 con 0x7fee200c1500 2023-11-27T20:43:17.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.785+0000 7fee1ffff640 1 --2- 172.21.15.91:0/3099027818 >> v2:172.21.15.183:3300/0 conn(0x7fee20155490 0x7fee200a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:17.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.786+0000 7fee1f7fe640 1 --2- 172.21.15.91:0/3099027818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c1500 0x7fee200a9430 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fee2006dff0 tx=0x7fee1402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0cc741dbabd042 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:17.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.787+0000 7fee1effd640 1 -- 172.21.15.91:0/3099027818 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee140317e0 con 0x7fee200c1500 2023-11-27T20:43:17.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.787+0000 7fee1effd640 1 -- 172.21.15.91:0/3099027818 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14031940 con 0x7fee200c1500 2023-11-27T20:43:17.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.787+0000 7fee1effd640 1 -- 172.21.15.91:0/3099027818 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14031cd0 con 0x7fee200c1500 2023-11-27T20:43:17.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.787+0000 7fee2696e640 1 -- 172.21.15.91:0/3099027818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c1500 msgr2=0x7fee200a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.787+0000 7fee2696e640 1 --2- 172.21.15.91:0/3099027818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c1500 0x7fee200a9430 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fee2006dff0 tx=0x7fee1402b880 comp rx=0 tx=0).stop 2023-11-27T20:43:17.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.788+0000 7fee2696e640 1 -- 172.21.15.91:0/3099027818 shutdown_connections 2023-11-27T20:43:17.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.788+0000 7fee2696e640 1 --2- 172.21.15.91:0/3099027818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee200c4080 0x7fee200a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.788+0000 7fee2696e640 1 --2- 172.21.15.91:0/3099027818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c1500 0x7fee200a9430 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.788+0000 7fee2696e640 1 --2- 172.21.15.91:0/3099027818 >> v2:172.21.15.183:3300/0 conn(0x7fee20155490 0x7fee200a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.788+0000 7fee2696e640 1 -- 172.21.15.91:0/3099027818 >> 172.21.15.91:0/3099027818 conn(0x7fee2006a500 msgr2=0x7fee2006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.788+0000 7fee2696e640 1 -- 172.21.15.91:0/3099027818 shutdown_connections 2023-11-27T20:43:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.788+0000 7fee2696e640 1 -- 172.21.15.91:0/3099027818 wait complete. 2023-11-27T20:43:17.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.790+0000 7fee2696e640 1 Processor -- start 2023-11-27T20:43:17.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.790+0000 7fee2696e640 1 -- start start 2023-11-27T20:43:17.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.791+0000 7fee2696e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee200c1500 0x7fee2014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.791+0000 7fee2696e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c4080 0x7fee2015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.791+0000 7fee2696e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee20155490 0x7fee2015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.791+0000 7fee2696e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2014a0f0 con 0x7fee200c4080 2023-11-27T20:43:17.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.791+0000 7fee2696e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2014a8a0 con 0x7fee20155490 2023-11-27T20:43:17.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.791+0000 7fee2696e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2014b020 con 0x7fee200c1500 2023-11-27T20:43:17.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.791+0000 7fee1f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c4080 0x7fee2015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.791+0000 7fee1f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c4080 0x7fee2015bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53310/0 (socket says 172.21.15.91:53310) 2023-11-27T20:43:17.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.791+0000 7fee1f7fe640 1 -- 172.21.15.91:0/3531418375 learned_addr learned my addr 172.21.15.91:0/3531418375 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:17.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1ffff640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee200c1500 0x7fee2014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee24f0b640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee20155490 0x7fee2015c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1f7fe640 1 -- 172.21.15.91:0/3531418375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee200c1500 msgr2=0x7fee2014f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1f7fe640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee200c1500 0x7fee2014f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1f7fe640 1 -- 172.21.15.91:0/3531418375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee20155490 msgr2=0x7fee2015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1f7fe640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee20155490 0x7fee2015c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1f7fe640 1 -- 172.21.15.91:0/3531418375 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140094d0 con 0x7fee200c4080 2023-11-27T20:43:17.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1ffff640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee200c1500 0x7fee2014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:17.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1f7fe640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c4080 0x7fee2015bd60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fee14000c00 tx=0x7fee140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:17.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1cff9640 1 -- 172.21.15.91:0/3531418375 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee140329c0 con 0x7fee200c4080 2023-11-27T20:43:17.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1cff9640 1 -- 172.21.15.91:0/3531418375 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14032b40 con 0x7fee200c4080 2023-11-27T20:43:17.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee1cff9640 1 -- 172.21.15.91:0/3531418375 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee140453f0 con 0x7fee200c4080 2023-11-27T20:43:17.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.792+0000 7fee2696e640 1 -- 172.21.15.91:0/3531418375 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2015ca90 con 0x7fee200c4080 2023-11-27T20:43:17.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.793+0000 7fee2696e640 1 -- 172.21.15.91:0/3531418375 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2014a2e0 con 0x7fee200c4080 2023-11-27T20:43:17.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.794+0000 7fee2696e640 1 -- 172.21.15.91:0/3531418375 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee20068350 con 0x7fee200c4080 2023-11-27T20:43:17.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.794+0000 7fee1cff9640 1 -- 172.21.15.91:0/3531418375 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fee14045550 con 0x7fee200c4080 2023-11-27T20:43:17.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.795+0000 7fee1cff9640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee0c06b1c0 0x7fee0c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:17.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.795+0000 7fee1cff9640 1 -- 172.21.15.91:0/3531418375 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fee140ac270 con 0x7fee200c4080 2023-11-27T20:43:17.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.796+0000 7fee1ffff640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee0c06b1c0 0x7fee0c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:17.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.796+0000 7fee1ffff640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee0c06b1c0 0x7fee0c06d680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fee10006fd0 tx=0x7fee10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:17.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.800+0000 7fee1cff9640 1 -- 172.21.15.91:0/3531418375 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fee14076d20 con 0x7fee200c4080 2023-11-27T20:43:17.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.993+0000 7fee2696e640 1 -- 172.21.15.91:0/3531418375 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee2015dc70 con 0x7fee200c4080 2023-11-27T20:43:17.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.994+0000 7fee1cff9640 1 -- 172.21.15.91:0/3531418375 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v39) v1 ==== 105+0+11 (secure 0 0 0) 0x7fee1407a340 con 0x7fee200c4080 2023-11-27T20:43:17.994 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:43:17.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.996+0000 7fee2696e640 1 -- 172.21.15.91:0/3531418375 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee0c06b1c0 msgr2=0x7fee0c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.996+0000 7fee2696e640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee0c06b1c0 0x7fee0c06d680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fee10006fd0 tx=0x7fee10008040 comp rx=0 tx=0).stop 2023-11-27T20:43:17.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.996+0000 7fee2696e640 1 -- 172.21.15.91:0/3531418375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c4080 msgr2=0x7fee2015bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:17.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.996+0000 7fee2696e640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c4080 0x7fee2015bd60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fee14000c00 tx=0x7fee140046c0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.997+0000 7fee2696e640 1 -- 172.21.15.91:0/3531418375 shutdown_connections 2023-11-27T20:43:17.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.997+0000 7fee2696e640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee0c06b1c0 0x7fee0c06d680 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.997+0000 7fee2696e640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee20155490 0x7fee2015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.997+0000 7fee2696e640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee200c4080 0x7fee2015bd60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.997+0000 7fee2696e640 1 --2- 172.21.15.91:0/3531418375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee200c1500 0x7fee2014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:17.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.997+0000 7fee2696e640 1 -- 172.21.15.91:0/3531418375 >> 172.21.15.91:0/3531418375 conn(0x7fee2006a500 msgr2=0x7fee20152f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:17.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.997+0000 7fee2696e640 1 -- 172.21.15.91:0/3531418375 shutdown_connections 2023-11-27T20:43:17.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:17.997+0000 7fee2696e640 1 -- 172.21.15.91:0/3531418375 wait complete. 2023-11-27T20:43:18.016 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:43:18.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.219+0000 7f380b59e640 1 Processor -- start 2023-11-27T20:43:18.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.219+0000 7f380b59e640 1 -- start start 2023-11-27T20:43:18.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.220+0000 7f380b59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c0ca8d0 0x7f380c154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.220+0000 7f380b59e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c158a60 con 0x7f380c14e7c0 2023-11-27T20:43:18.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.220+0000 7f380b59e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c0c4dd0 con 0x7f380c0ca450 2023-11-27T20:43:18.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.220+0000 7f380b59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c5b10 con 0x7f380c0ca8d0 2023-11-27T20:43:18.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380a59c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f380c14e7c0 0x7f380c0c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55418/0 (socket says 172.21.15.91:55418) 2023-11-27T20:43:18.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380a59c640 1 -- 172.21.15.91:0/51853774 learned_addr learned my addr 172.21.15.91:0/51853774 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:18.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917541498 0 0) 0x7f380c158a60 con 0x7f380c14e7c0 2023-11-27T20:43:18.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37f4003520 con 0x7f380c14e7c0 2023-11-27T20:43:18.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2936879105 0 0) 0x7f37f4003520 con 0x7f380c14e7c0 2023-11-27T20:43:18.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380ad9d640 1 --2- 172.21.15.91:0/51853774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c0ca8d0 0x7f380c154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:18.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c0ca8d0 msgr2=0x7f380c154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:18.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380959a640 1 --2- 172.21.15.91:0/51853774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c0ca8d0 0x7f380c154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 >> v1:172.21.15.183:6789/0 conn(0x7f380c0ca450 legacy=0x7f380c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c157ca0 con 0x7f380c14e7c0 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.221+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f37fc001670 con 0x7f380c14e7c0 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 >> v1:172.21.15.91:6789/0 conn(0x7f380c14e7c0 legacy=0x7f380c0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380959a640 1 --2- 172.21.15.91:0/51853774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c0ca8d0 0x7f37f40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380959a640 1 --2- 172.21.15.91:0/51853774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37f4004090 0x7f37f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380959a640 1 --2- 172.21.15.91:0/51853774 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 0x7f37f4005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f400bcf0 con 0x7f37f4004e00 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f400be60 con 0x7f37f4004090 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f400c020 con 0x7f380c0ca8d0 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380ad9d640 1 --2- 172.21.15.91:0/51853774 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 0x7f37f4005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380ad9d640 1 -- 172.21.15.91:0/51853774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c0ca8d0 msgr2=0x7f37f40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:18.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380ad9d640 1 --2- 172.21.15.91:0/51853774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c0ca8d0 0x7f37f40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380ad9d640 1 -- 172.21.15.91:0/51853774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37f4004090 msgr2=0x7f37f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:18.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380ad9d640 1 --2- 172.21.15.91:0/51853774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37f4004090 0x7f37f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.222+0000 7f380ad9d640 1 -- 172.21.15.91:0/51853774 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f4003520 con 0x7f37f4004e00 2023-11-27T20:43:18.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.223+0000 7f380ad9d640 1 --2- 172.21.15.91:0/51853774 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 0x7f37f4005280 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3804007f60 tx=0x7f37f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e12c7318d760f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:18.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.224+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804033600 con 0x7f37f4004e00 2023-11-27T20:43:18.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.224+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380402f050 con 0x7f37f4004e00 2023-11-27T20:43:18.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.224+0000 7f380959a640 1 -- 172.21.15.91:0/51853774 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040339a0 con 0x7f37f4004e00 2023-11-27T20:43:18.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.224+0000 7f380b59e640 1 -- 172.21.15.91:0/51853774 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 msgr2=0x7f37f4005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.224+0000 7f380b59e640 1 --2- 172.21.15.91:0/51853774 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 0x7f37f4005280 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3804007f60 tx=0x7f37f40057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.224+0000 7f380ad9d640 1 -- 172.21.15.91:0/51853774 reap_dead start 2023-11-27T20:43:18.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.224+0000 7f380b59e640 1 -- 172.21.15.91:0/51853774 shutdown_connections 2023-11-27T20:43:18.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.224+0000 7f380b59e640 1 -- 172.21.15.91:0/51853774 >> 172.21.15.91:0/51853774 conn(0x7f380c0abf00 msgr2=0x7f380c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:18.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.224+0000 7f380b59e640 1 -- 172.21.15.91:0/51853774 shutdown_connections 2023-11-27T20:43:18.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.224+0000 7f380b59e640 1 -- 172.21.15.91:0/51853774 wait complete. 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.226+0000 7f380b59e640 1 Processor -- start 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.226+0000 7f380b59e640 1 -- start start 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.227+0000 7f380b59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 0x7f380c151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.227+0000 7f380b59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c14d140 0x7f380c157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.227+0000 7f380b59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c1ed230 0x7f380c1ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.227+0000 7f380b59e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c155f40 con 0x7f37f4004e00 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.227+0000 7f380b59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c1edc20 con 0x7f380c14d140 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.227+0000 7f380b59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c156120 con 0x7f380c1ed230 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.227+0000 7f380a59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 0x7f380c151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.227+0000 7f380a59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 0x7f380c151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53334/0 (socket says 172.21.15.91:53334) 2023-11-27T20:43:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.227+0000 7f380a59c640 1 -- 172.21.15.91:0/2263974362 learned_addr learned my addr 172.21.15.91:0/2263974362 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f3809d9b640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c14d140 0x7f380c157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f380a59c640 1 -- 172.21.15.91:0/2263974362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c1ed230 msgr2=0x7f380c1ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f380a59c640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c1ed230 0x7f380c1ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f380a59c640 1 -- 172.21.15.91:0/2263974362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c14d140 msgr2=0x7f380c157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f380a59c640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c14d140 0x7f380c157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f380a59c640 1 -- 172.21.15.91:0/2263974362 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c156400 con 0x7f37f4004e00 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f3809d9b640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c14d140 0x7f380c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f380a59c640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 0x7f380c151500 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00c720 tx=0x7f37fc00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f37faffd640 1 -- 172.21.15.91:0/2263974362 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc0074e0 con 0x7f37f4004e00 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f37faffd640 1 -- 172.21.15.91:0/2263974362 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc007640 con 0x7f37f4004e00 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f37faffd640 1 -- 172.21.15.91:0/2263974362 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc004a20 con 0x7f37f4004e00 2023-11-27T20:43:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f380b59e640 1 -- 172.21.15.91:0/2263974362 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c1566e0 con 0x7f37f4004e00 2023-11-27T20:43:18.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.228+0000 7f380b59e640 1 -- 172.21.15.91:0/2263974362 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c1ecd10 con 0x7f37f4004e00 2023-11-27T20:43:18.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.230+0000 7f380b59e640 1 -- 172.21.15.91:0/2263974362 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c1ecf30 con 0x7f37f4004e00 2023-11-27T20:43:18.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.230+0000 7f37faffd640 1 -- 172.21.15.91:0/2263974362 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f37fc004b80 con 0x7f37f4004e00 2023-11-27T20:43:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.231+0000 7f37faffd640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37ec06b1c0 0x7f37ec06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.231+0000 7f37faffd640 1 -- 172.21.15.91:0/2263974362 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f37fc0892f0 con 0x7f37f4004e00 2023-11-27T20:43:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.231+0000 7f3809d9b640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37ec06b1c0 0x7f37ec06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.232+0000 7f3809d9b640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37ec06b1c0 0x7f37ec06d680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3800007fd0 tx=0x7f3800009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:18.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.235+0000 7f37faffd640 1 -- 172.21.15.91:0/2263974362 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f37fc053bf0 con 0x7f37f4004e00 2023-11-27T20:43:18.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.422+0000 7f380b59e640 1 -- 172.21.15.91:0/2263974362 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f380c151c70 con 0x7f37f4004e00 2023-11-27T20:43:18.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.423+0000 7f37faffd640 1 -- 172.21.15.91:0/2263974362 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v40) v1 ==== 101+0+11 (secure 0 0 0) 0x7f37fc0180a0 con 0x7f37f4004e00 2023-11-27T20:43:18.423 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:43:18.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.425+0000 7f380b59e640 1 -- 172.21.15.91:0/2263974362 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37ec06b1c0 msgr2=0x7f37ec06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.425+0000 7f380b59e640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37ec06b1c0 0x7f37ec06d680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3800007fd0 tx=0x7f3800009040 comp rx=0 tx=0).stop 2023-11-27T20:43:18.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.425+0000 7f380b59e640 1 -- 172.21.15.91:0/2263974362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 msgr2=0x7f380c151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.425+0000 7f380b59e640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 0x7f380c151500 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00c720 tx=0x7f37fc00cbe0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.425+0000 7f380b59e640 1 -- 172.21.15.91:0/2263974362 shutdown_connections 2023-11-27T20:43:18.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.425+0000 7f380b59e640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f380c1ed230 0x7f380c1ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.425+0000 7f380b59e640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f37ec06b1c0 0x7f37ec06d680 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.425+0000 7f380b59e640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c14d140 0x7f380c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.425+0000 7f380b59e640 1 --2- 172.21.15.91:0/2263974362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37f4004e00 0x7f380c151500 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.425+0000 7f380b59e640 1 -- 172.21.15.91:0/2263974362 >> 172.21.15.91:0/2263974362 conn(0x7f380c0abf00 msgr2=0x7f380c14bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:18.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.426+0000 7f380b59e640 1 -- 172.21.15.91:0/2263974362 shutdown_connections 2023-11-27T20:43:18.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.426+0000 7f380b59e640 1 -- 172.21.15.91:0/2263974362 wait complete. 2023-11-27T20:43:18.446 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:43:18.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.657+0000 7f653c6c9640 1 Processor -- start 2023-11-27T20:43:18.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.658+0000 7f653c6c9640 1 -- start start 2023-11-27T20:43:18.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.659+0000 7f653c6c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65340c5ec0 0x7f65340c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.659+0000 7f653c6c9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f65340c45d0 0x7f65340c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.659+0000 7f653c6c9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65340bfdc0 con 0x7f65340721a0 2023-11-27T20:43:18.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.659+0000 7f653c6c9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653406e390 con 0x7f65340c45d0 2023-11-27T20:43:18.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.659+0000 7f653c6c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653406ddd0 con 0x7f65340c5ec0 2023-11-27T20:43:18.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f653ac66640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f65340721a0 0x7f6534155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55424/0 (socket says 172.21.15.91:55424) 2023-11-27T20:43:18.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f653ac66640 1 -- 172.21.15.91:0/710163759 learned_addr learned my addr 172.21.15.91:0/710163759 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:18.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f6539c64640 1 --2- 172.21.15.91:0/710163759 >> v2:172.21.15.183:3300/0 conn(0x7f65340c45d0 0x7f65340c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:18.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f653a465640 1 --2- 172.21.15.91:0/710163759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65340c5ec0 0x7f65340c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:18.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273173703 0 0) 0x7f65340bfdc0 con 0x7f65340721a0 2023-11-27T20:43:18.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6520003520 con 0x7f65340721a0 2023-11-27T20:43:18.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3278573756 0 0) 0x7f6520003520 con 0x7f65340721a0 2023-11-27T20:43:18.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65340c5ec0 msgr2=0x7f65340c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:18.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f6539463640 1 --2- 172.21.15.91:0/710163759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65340c5ec0 0x7f65340c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 >> v2:172.21.15.183:3300/0 conn(0x7f65340c45d0 msgr2=0x7f65340c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:18.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f6539463640 1 --2- 172.21.15.91:0/710163759 >> v2:172.21.15.183:3300/0 conn(0x7f65340c45d0 0x7f65340c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653406e0b0 con 0x7f65340721a0 2023-11-27T20:43:18.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.660+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f652c0019f0 con 0x7f65340721a0 2023-11-27T20:43:18.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 >> v1:172.21.15.91:6789/0 conn(0x7f65340721a0 legacy=0x7f6534155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f6539463640 1 --2- 172.21.15.91:0/710163759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 0x7f6520003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f6539463640 1 --2- 172.21.15.91:0/710163759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65200047c0 0x7f6520004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f6539463640 1 --2- 172.21.15.91:0/710163759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65340c5ec0 0x7f6520005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653406e390 con 0x7f6520003970 2023-11-27T20:43:18.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653406ddd0 con 0x7f65200047c0 2023-11-27T20:43:18.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652000bb60 con 0x7f65340c5ec0 2023-11-27T20:43:18.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f653a465640 1 --2- 172.21.15.91:0/710163759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 0x7f6520003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:18.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f653a465640 1 -- 172.21.15.91:0/710163759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65340c5ec0 msgr2=0x7f6520005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:18.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f653a465640 1 --2- 172.21.15.91:0/710163759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65340c5ec0 0x7f6520005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f653a465640 1 -- 172.21.15.91:0/710163759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65200047c0 msgr2=0x7f6520004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:18.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f653a465640 1 --2- 172.21.15.91:0/710163759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65200047c0 0x7f6520004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.661+0000 7f653a465640 1 -- 172.21.15.91:0/710163759 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6520003520 con 0x7f6520003970 2023-11-27T20:43:18.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.662+0000 7f653a465640 1 --2- 172.21.15.91:0/710163759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 0x7f6520003d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f653000ba30 tx=0x7f65200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd74ef271a322e0a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:18.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.663+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530032680 con 0x7f6520003970 2023-11-27T20:43:18.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.663+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65300327e0 con 0x7f6520003970 2023-11-27T20:43:18.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.663+0000 7f6539463640 1 -- 172.21.15.91:0/710163759 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530032b70 con 0x7f6520003970 2023-11-27T20:43:18.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.663+0000 7f653c6c9640 1 -- 172.21.15.91:0/710163759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 msgr2=0x7f6520003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.663+0000 7f653c6c9640 1 --2- 172.21.15.91:0/710163759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 0x7f6520003d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f653000ba30 tx=0x7f65200057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.663+0000 7f653ac66640 1 -- 172.21.15.91:0/710163759 reap_dead start 2023-11-27T20:43:18.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.663+0000 7f653c6c9640 1 -- 172.21.15.91:0/710163759 shutdown_connections 2023-11-27T20:43:18.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.663+0000 7f653c6c9640 1 -- 172.21.15.91:0/710163759 >> 172.21.15.91:0/710163759 conn(0x7f653406a500 msgr2=0x7f653406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:18.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.663+0000 7f653c6c9640 1 -- 172.21.15.91:0/710163759 shutdown_connections 2023-11-27T20:43:18.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.663+0000 7f653c6c9640 1 -- 172.21.15.91:0/710163759 wait complete. 2023-11-27T20:43:18.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.665+0000 7f653c6c9640 1 Processor -- start 2023-11-27T20:43:18.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.665+0000 7f653c6c9640 1 -- start start 2023-11-27T20:43:18.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.666+0000 7f653c6c9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 0x7f653414d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.666+0000 7f653c6c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f653414a690 0x7f6534149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.666+0000 7f653c6c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65341ee5c0 0x7f6534157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.666+0000 7f653c6c9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653414c540 con 0x7f6520003970 2023-11-27T20:43:18.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.666+0000 7f653c6c9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653414a440 con 0x7f65341ee5c0 2023-11-27T20:43:18.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.666+0000 7f653c6c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653414de10 con 0x7f653414a690 2023-11-27T20:43:18.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.666+0000 7f653a465640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 0x7f653414d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:18.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.666+0000 7f653a465640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 0x7f653414d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53348/0 (socket says 172.21.15.91:53348) 2023-11-27T20:43:18.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.666+0000 7f653a465640 1 -- 172.21.15.91:0/803970011 learned_addr learned my addr 172.21.15.91:0/803970011 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:18.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.667+0000 7f653a465640 1 -- 172.21.15.91:0/803970011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f653414a690 msgr2=0x7f6534149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.667+0000 7f653a465640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f653414a690 0x7f6534149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.667+0000 7f653a465640 1 -- 172.21.15.91:0/803970011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65341ee5c0 msgr2=0x7f6534157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.667+0000 7f653a465640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65341ee5c0 0x7f6534157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.667+0000 7f653a465640 1 -- 172.21.15.91:0/803970011 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65341edae0 con 0x7f6520003970 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.667+0000 7f653a465640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 0x7f653414d490 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6530035040 tx=0x7f6530004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.667+0000 7f652affd640 1 -- 172.21.15.91:0/803970011 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530004220 con 0x7f6520003970 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.667+0000 7f652affd640 1 -- 172.21.15.91:0/803970011 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6530004380 con 0x7f6520003970 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.667+0000 7f653c6c9640 1 -- 172.21.15.91:0/803970011 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65341eddc0 con 0x7f6520003970 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.667+0000 7f652affd640 1 -- 172.21.15.91:0/803970011 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65300308d0 con 0x7f6520003970 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.668+0000 7f653c6c9640 1 -- 172.21.15.91:0/803970011 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65340a8e30 con 0x7f6520003970 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.669+0000 7f653c6c9640 1 -- 172.21.15.91:0/803970011 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6534068350 con 0x7f6520003970 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.670+0000 7f652affd640 1 -- 172.21.15.91:0/803970011 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6530043070 con 0x7f6520003970 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.671+0000 7f652affd640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f651806b1f0 0x7f651806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.671+0000 7f652affd640 1 -- 172.21.15.91:0/803970011 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f65300ac280 con 0x7f6520003970 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.671+0000 7f6539c64640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f651806b1f0 0x7f651806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:18.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.672+0000 7f6539c64640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f651806b1f0 0x7f651806d6b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6524006e80 tx=0x7f6524008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:18.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.675+0000 7f652affd640 1 -- 172.21.15.91:0/803970011 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6530076d30 con 0x7f6520003970 2023-11-27T20:43:18.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.879+0000 7f653c6c9640 1 -- 172.21.15.91:0/803970011 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f65340bfa00 con 0x7f6520003970 2023-11-27T20:43:18.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.880+0000 7f652affd640 1 -- 172.21.15.91:0/803970011 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f653007a350 con 0x7f6520003970 2023-11-27T20:43:18.880 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:43:18.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 -- 172.21.15.91:0/803970011 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f651806b1f0 msgr2=0x7f651806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f651806b1f0 0x7f651806d6b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6524006e80 tx=0x7f6524008040 comp rx=0 tx=0).stop 2023-11-27T20:43:18.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 -- 172.21.15.91:0/803970011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 msgr2=0x7f653414d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:18.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 0x7f653414d490 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6530035040 tx=0x7f6530004730 comp rx=0 tx=0).stop 2023-11-27T20:43:18.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 -- 172.21.15.91:0/803970011 shutdown_connections 2023-11-27T20:43:18.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f651806b1f0 0x7f651806d6b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65341ee5c0 0x7f6534157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f653414a690 0x7f6534149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 --2- 172.21.15.91:0/803970011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6520003970 0x7f653414d490 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:18.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 -- 172.21.15.91:0/803970011 >> 172.21.15.91:0/803970011 conn(0x7f653406a500 msgr2=0x7f65340c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:18.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 -- 172.21.15.91:0/803970011 shutdown_connections 2023-11-27T20:43:18.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:18.883+0000 7f653c6c9640 1 -- 172.21.15.91:0/803970011 wait complete. 2023-11-27T20:43:18.904 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-27T20:43:18.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:18.904 DEBUG:teuthology.orchestra.run.smithi091:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-27T20:43:19.012 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:43:19.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:19.012 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-27T20:43:19.064 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:43:19.064 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:19.114 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-27T20:43:19.115 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:43:19.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.314+0000 7f94e9f16640 1 Processor -- start 2023-11-27T20:43:19.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.315+0000 7f94e9f16640 1 -- start start 2023-11-27T20:43:19.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.316+0000 7f94e9f16640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94e4155490 0x7f94e40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:19.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.316+0000 7f94e9f16640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f94e40a9b40 0x7f94e40c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:19.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.316+0000 7f94e9f16640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e40c06c0 con 0x7f94e40c1500 2023-11-27T20:43:19.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.316+0000 7f94e9f16640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e40a5820 con 0x7f94e40a9b40 2023-11-27T20:43:19.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.316+0000 7f94e9f16640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40c1020 con 0x7f94e4155490 2023-11-27T20:43:19.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.316+0000 7f94e3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f94e40a9b40 0x7f94e40c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.316+0000 7f94e3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f94e40a9b40 0x7f94e40c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53356/0 (socket says 172.21.15.91:53356) 2023-11-27T20:43:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.316+0000 7f94e3fff640 1 -- 172.21.15.91:0/3300353135 learned_addr learned my addr 172.21.15.91:0/3300353135 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.317+0000 7f94e3fff640 1 -- 172.21.15.91:0/3300353135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94e4155490 msgr2=0x7f94e40a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.317+0000 7f94e3fff640 1 --2- 172.21.15.91:0/3300353135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94e4155490 0x7f94e40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.317+0000 7f94e3fff640 1 -- 172.21.15.91:0/3300353135 >> v1:172.21.15.183:6789/0 conn(0x7f94e40c1500 legacy=0x7f94e40a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.317+0000 7f94e3fff640 1 -- 172.21.15.91:0/3300353135 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e40c0910 con 0x7f94e40a9b40 2023-11-27T20:43:19.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.318+0000 7f94e3fff640 1 --2- 172.21.15.91:0/3300353135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e40a9b40 0x7f94e40c24d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009e50 tx=0x7f94dc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64563ca2a1f65da3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:19.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.318+0000 7f94e2ffd640 1 -- 172.21.15.91:0/3300353135 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc02ca80 con 0x7f94e40a9b40 2023-11-27T20:43:19.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.318+0000 7f94e2ffd640 1 -- 172.21.15.91:0/3300353135 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc02cbe0 con 0x7f94e40a9b40 2023-11-27T20:43:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.318+0000 7f94e2ffd640 1 -- 172.21.15.91:0/3300353135 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0343f0 con 0x7f94e40a9b40 2023-11-27T20:43:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.319+0000 7f94e9f16640 1 -- 172.21.15.91:0/3300353135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e40a9b40 msgr2=0x7f94e40c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.319+0000 7f94e9f16640 1 --2- 172.21.15.91:0/3300353135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e40a9b40 0x7f94e40c24d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009e50 tx=0x7f94dc02bee0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.319+0000 7f94e9f16640 1 -- 172.21.15.91:0/3300353135 shutdown_connections 2023-11-27T20:43:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.319+0000 7f94e9f16640 1 --2- 172.21.15.91:0/3300353135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e40a9b40 0x7f94e40c24d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.319+0000 7f94e9f16640 1 --2- 172.21.15.91:0/3300353135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94e4155490 0x7f94e40a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.319+0000 7f94e9f16640 1 -- 172.21.15.91:0/3300353135 >> 172.21.15.91:0/3300353135 conn(0x7f94e406a500 msgr2=0x7f94e406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.319+0000 7f94e9f16640 1 -- 172.21.15.91:0/3300353135 shutdown_connections 2023-11-27T20:43:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.319+0000 7f94e9f16640 1 -- 172.21.15.91:0/3300353135 wait complete. 2023-11-27T20:43:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.321+0000 7f94e9f16640 1 Processor -- start 2023-11-27T20:43:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.321+0000 7f94e9f16640 1 -- start start 2023-11-27T20:43:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e9f16640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94e40c1500 0x7f94e40bc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e9f16640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94e4155490 0x7f94e41e8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e9f16640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e41e9310 0x7f94e414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e9f16640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40c0380 con 0x7f94e41e9310 2023-11-27T20:43:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e9f16640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40bb870 con 0x7f94e4155490 2023-11-27T20:43:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e9f16640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40bd330 con 0x7f94e40c1500 2023-11-27T20:43:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e41e9310 0x7f94e414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e41e9310 0x7f94e414ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53366/0 (socket says 172.21.15.91:53366) 2023-11-27T20:43:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e3fff640 1 -- 172.21.15.91:0/1277716616 learned_addr learned my addr 172.21.15.91:0/1277716616 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94dbfff640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94e4155490 0x7f94e41e8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e3fff640 1 -- 172.21.15.91:0/1277716616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94e40c1500 msgr2=0x7f94e40bc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e3fff640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94e40c1500 0x7f94e40bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.322+0000 7f94e3fff640 1 -- 172.21.15.91:0/1277716616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94e4155490 msgr2=0x7f94e41e8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.323+0000 7f94e3fff640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94e4155490 0x7f94e41e8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.323+0000 7f94e3fff640 1 -- 172.21.15.91:0/1277716616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc009b30 con 0x7f94e41e9310 2023-11-27T20:43:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.323+0000 7f94dbfff640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94e4155490 0x7f94e41e8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.323+0000 7f94e3fff640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e41e9310 0x7f94e414ef00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f94dc036040 tx=0x7f94dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.323+0000 7f94e0ff9640 1 -- 172.21.15.91:0/1277716616 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc03e450 con 0x7f94e41e9310 2023-11-27T20:43:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.323+0000 7f94e0ff9640 1 -- 172.21.15.91:0/1277716616 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc03e5d0 con 0x7f94e41e9310 2023-11-27T20:43:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.323+0000 7f94e0ff9640 1 -- 172.21.15.91:0/1277716616 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc03e980 con 0x7f94e41e9310 2023-11-27T20:43:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.323+0000 7f94e9f16640 1 -- 172.21.15.91:0/1277716616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e40bbb30 con 0x7f94e41e9310 2023-11-27T20:43:19.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.323+0000 7f94e9f16640 1 -- 172.21.15.91:0/1277716616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e40a7400 con 0x7f94e41e9310 2023-11-27T20:43:19.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.324+0000 7f94e9f16640 1 -- 172.21.15.91:0/1277716616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e40bb6c0 con 0x7f94e41e9310 2023-11-27T20:43:19.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.325+0000 7f94e0ff9640 1 -- 172.21.15.91:0/1277716616 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f94dc02cd50 con 0x7f94e41e9310 2023-11-27T20:43:19.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.326+0000 7f94e0ff9640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f94c406b1c0 0x7f94c406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:19.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.327+0000 7f94e0ff9640 1 -- 172.21.15.91:0/1277716616 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f94dc0acab0 con 0x7f94e41e9310 2023-11-27T20:43:19.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.327+0000 7f94e37fe640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f94c406b1c0 0x7f94c406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:19.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.327+0000 7f94e37fe640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f94c406b1c0 0x7f94c406d680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009670 tx=0x7f94d4006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:19.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.331+0000 7f94e0ff9640 1 -- 172.21.15.91:0/1277716616 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f94dc0773b0 con 0x7f94e41e9310 2023-11-27T20:43:19.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.559+0000 7f94e9f16640 1 -- 172.21.15.91:0/1277716616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94e40bbff0 con 0x7f94e41e9310 2023-11-27T20:43:19.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.560+0000 7f94e0ff9640 1 -- 172.21.15.91:0/1277716616 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+149 (secure 0 0 0) 0x7f94dc07a9d0 con 0x7f94e41e9310 2023-11-27T20:43:19.562 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:43:19.562 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-27T20:43:19.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.563+0000 7f94e9f16640 1 -- 172.21.15.91:0/1277716616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f94c406b1c0 msgr2=0x7f94c406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:19.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.563+0000 7f94e9f16640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f94c406b1c0 0x7f94c406d680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009670 tx=0x7f94d4006bf0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.563+0000 7f94e9f16640 1 -- 172.21.15.91:0/1277716616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e41e9310 msgr2=0x7f94e414ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:19.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.563+0000 7f94e9f16640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e41e9310 0x7f94e414ef00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f94dc036040 tx=0x7f94dc004a40 comp rx=0 tx=0).stop 2023-11-27T20:43:19.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.564+0000 7f94e9f16640 1 -- 172.21.15.91:0/1277716616 shutdown_connections 2023-11-27T20:43:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.564+0000 7f94e9f16640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94e41e9310 0x7f94e414ef00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.564+0000 7f94e9f16640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f94c406b1c0 0x7f94c406d680 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.564+0000 7f94e9f16640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94e4155490 0x7f94e41e8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.564+0000 7f94e9f16640 1 --2- 172.21.15.91:0/1277716616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94e40c1500 0x7f94e40bc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.564+0000 7f94e9f16640 1 -- 172.21.15.91:0/1277716616 >> 172.21.15.91:0/1277716616 conn(0x7f94e406a500 msgr2=0x7f94e40c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.564+0000 7f94e9f16640 1 -- 172.21.15.91:0/1277716616 shutdown_connections 2023-11-27T20:43:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:19.564+0000 7f94e9f16640 1 -- 172.21.15.91:0/1277716616 wait complete. 2023-11-27T20:43:19.581 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-27T20:43:19.581 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:43:19.581 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-27T20:43:19.581 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-27T20:43:19.582 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:43:19.582 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-27T20:43:19.582 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:43:19.582 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.HzeziEUq8J 2023-11-27T20:43:19.582 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-27T20:43:19.633 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.NtnlsTw8OI 2023-11-27T20:43:19.634 DEBUG:teuthology.orchestra.run.smithi091:> sudo cp /tmp/tmp.HzeziEUq8J /tmp/tmp.NtnlsTw8OI 2023-11-27T20:43:19.719 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.NtnlsTw8OI 2023-11-27T20:43:19.879 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.NtnlsTw8OI is 185B 2023-11-27T20:43:19.945 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.NtnlsTw8OI 2023-11-27T20:43:19.998 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBj/2RlR8ZeIBAAKBJlovUboYx+59I6/uYa/Q== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-11-27T20:43:19.998 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:43:19.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:19.999 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-27T20:43:20.050 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:43:20.050 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-27T20:43:20.051 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 42222sec preferred_lft 42222sec 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::c0c6:34ff:feb5:e67/64 scope link 2023-11-27T20:43:20.052 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:20.053 INFO:teuthology.orchestra.run.smithi091.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:43:20.053 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:43:20.053 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::d8e3:6ff:fe8b:3b7f/64 scope link 2023-11-27T20:43:20.053 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:43:20.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:20.054 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:43:20.143 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-27T20:43:20.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:20.147 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-27T20:43:20.203 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-27T20:43:20.203 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:43:20.203 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:43:20.203 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:43:20.203 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:43:20.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:20.203 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:43:20.203 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:43:20.204 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:43:20.204 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:43:20.204 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:43:20.204 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:43:20.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:20.383 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T20:43:20.435 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T20:43:20.435 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:43:20.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:20.435 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-11-27T20:43:20.530 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:43:20.530 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T20:43:20.585 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:43:20.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:43:20.585 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:43:20.639 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:43:20.639 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/tmp/tmp.HzeziEUq8J of=/dev/stdout 2023-11-27T20:43:20.691 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:43:20.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:20.692 DEBUG:teuthology.orchestra.run.smithi091:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBj/2RlR8ZeIBAAKBJlovUboYx+59I6/uYa/Q==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:43:20.834 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,secret=AQBj/2RlR8ZeIBAAKBJlovUboYx+59I6/uYa/Q==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:43:20.834 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-27T20:43:20.835 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:43:20.835 INFO:teuthology.orchestra.run.smithi091.stdout:keyring.get_secret failed 2023-11-27T20:43:20.856 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,secret=AQBj/2RlR8ZeIBAAKBJlovUboYx+59I6/uYa/Q==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:43:20.856 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-27T20:43:20.856 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:43:20.857 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:43:20.857 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:43:20.857 INFO:teuthology.orchestra.run.smithi091.stdout:keyring.get_secret failed 2023-11-27T20:43:20.884 INFO:teuthology.orchestra.run.smithi091.stderr:mount error: no mds server is up or the cluster is laggy 2023-11-27T20:43:20.884 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,secret=AQBj/2RlR8ZeIBAAKBJlovUboYx+59I6/uYa/Q==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:43:20.885 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-27T20:43:20.885 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:43:20.885 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:43:20.885 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:43:20.885 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:43:20.885 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:43:20.885 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:43:20.890 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-27T20:43:20.891 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-11-27T20:43:20.891 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-27T20:43:20.891 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:43:21.006 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:43:21.134 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-27T20:43:21.134 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:43:21.134 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:21.194 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-27T20:43:21.194 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:43:21.194 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:21.254 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:43:21.254 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:21.309 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.530+0000 7fee7d002640 1 Processor -- start 2023-11-27T20:43:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.530+0000 7fee7d002640 1 -- start start 2023-11-27T20:43:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.532+0000 7fee7d002640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7814fd30 0x7fee78152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.532+0000 7fee7d002640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fee7806d0a0 0x7fee780a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.532+0000 7fee7d002640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee780c64a0 con 0x7fee780a5260 2023-11-27T20:43:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.532+0000 7fee7d002640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780c5c00 con 0x7fee7806d0a0 2023-11-27T20:43:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.532+0000 7fee7d002640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee780c5ee0 con 0x7fee7814fd30 2023-11-27T20:43:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.532+0000 7fee6e59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fee7806d0a0 0x7fee780a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.532+0000 7fee6e59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fee7806d0a0 0x7fee780a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53368/0 (socket says 172.21.15.91:53368) 2023-11-27T20:43:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.532+0000 7fee6e59c640 1 -- 172.21.15.91:0/3222131056 learned_addr learned my addr 172.21.15.91:0/3222131056 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.533+0000 7fee76d9d640 1 --2- 172.21.15.91:0/3222131056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7814fd30 0x7fee78152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.533+0000 7fee6e59c640 1 -- 172.21.15.91:0/3222131056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7814fd30 msgr2=0x7fee78152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.533+0000 7fee6e59c640 1 --2- 172.21.15.91:0/3222131056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7814fd30 0x7fee78152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.533+0000 7fee6e59c640 1 -- 172.21.15.91:0/3222131056 >> v1:172.21.15.183:6789/0 conn(0x7fee780a5260 legacy=0x7fee780c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.533+0000 7fee6e59c640 1 -- 172.21.15.91:0/3222131056 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780c61c0 con 0x7fee7806d0a0 2023-11-27T20:43:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.534+0000 7fee6e59c640 1 --2- 172.21.15.91:0/3222131056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee7806d0a0 0x7fee780a4d20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fee60009870 tx=0x7fee6002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d6bc161c5458af server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:21.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.534+0000 7fee7659c640 1 -- 172.21.15.91:0/3222131056 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60031640 con 0x7fee7806d0a0 2023-11-27T20:43:21.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.534+0000 7fee7659c640 1 -- 172.21.15.91:0/3222131056 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600317a0 con 0x7fee7806d0a0 2023-11-27T20:43:21.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.534+0000 7fee7659c640 1 -- 172.21.15.91:0/3222131056 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60031b30 con 0x7fee7806d0a0 2023-11-27T20:43:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.535+0000 7fee7d002640 1 -- 172.21.15.91:0/3222131056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee7806d0a0 msgr2=0x7fee780a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.535+0000 7fee7d002640 1 --2- 172.21.15.91:0/3222131056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee7806d0a0 0x7fee780a4d20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fee60009870 tx=0x7fee6002b8f0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.535+0000 7fee7d002640 1 -- 172.21.15.91:0/3222131056 shutdown_connections 2023-11-27T20:43:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.535+0000 7fee7d002640 1 --2- 172.21.15.91:0/3222131056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee7806d0a0 0x7fee780a4d20 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.535+0000 7fee7d002640 1 --2- 172.21.15.91:0/3222131056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7814fd30 0x7fee78152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.535+0000 7fee7d002640 1 -- 172.21.15.91:0/3222131056 >> 172.21.15.91:0/3222131056 conn(0x7fee7806a500 msgr2=0x7fee7806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.535+0000 7fee7d002640 1 -- 172.21.15.91:0/3222131056 shutdown_connections 2023-11-27T20:43:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.535+0000 7fee7d002640 1 -- 172.21.15.91:0/3222131056 wait complete. 2023-11-27T20:43:21.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.537+0000 7fee7d002640 1 Processor -- start 2023-11-27T20:43:21.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.537+0000 7fee7d002640 1 -- start start 2023-11-27T20:43:21.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee7d002640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7806d0a0 0x7fee780bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee7d002640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee780a5260 0x7fee78155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee7d002640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee7814fd30 0x7fee78155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee7d002640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780aaa80 con 0x7fee780a5260 2023-11-27T20:43:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee7d002640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee78156410 con 0x7fee7814fd30 2023-11-27T20:43:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee7d002640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee78071000 con 0x7fee7806d0a0 2023-11-27T20:43:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee6e59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee780a5260 0x7fee78155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee6e59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee780a5260 0x7fee78155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53380/0 (socket says 172.21.15.91:53380) 2023-11-27T20:43:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee6e59c640 1 -- 172.21.15.91:0/2983762785 learned_addr learned my addr 172.21.15.91:0/2983762785 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee76d9d640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7806d0a0 0x7fee780bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee7759e640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee7814fd30 0x7fee78155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee6e59c640 1 -- 172.21.15.91:0/2983762785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7806d0a0 msgr2=0x7fee780bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee6e59c640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7806d0a0 0x7fee780bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee6e59c640 1 -- 172.21.15.91:0/2983762785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee7814fd30 msgr2=0x7fee78155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee6e59c640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee7814fd30 0x7fee78155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee6e59c640 1 -- 172.21.15.91:0/2983762785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600094d0 con 0x7fee780a5260 2023-11-27T20:43:21.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee76d9d640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7806d0a0 0x7fee780bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:21.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.539+0000 7fee7759e640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee7814fd30 0x7fee78155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:21.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.540+0000 7fee6e59c640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee780a5260 0x7fee78155990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fee60009870 tx=0x7fee600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:21.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.540+0000 7fee6ffff640 1 -- 172.21.15.91:0/2983762785 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6003ac60 con 0x7fee780a5260 2023-11-27T20:43:21.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.540+0000 7fee6ffff640 1 -- 172.21.15.91:0/2983762785 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6003ade0 con 0x7fee780a5260 2023-11-27T20:43:21.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.540+0000 7fee6ffff640 1 -- 172.21.15.91:0/2983762785 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60044630 con 0x7fee780a5260 2023-11-27T20:43:21.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.540+0000 7fee7d002640 1 -- 172.21.15.91:0/2983762785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee781edda0 con 0x7fee780a5260 2023-11-27T20:43:21.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.540+0000 7fee7d002640 1 -- 172.21.15.91:0/2983762785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee780bf8a0 con 0x7fee780a5260 2023-11-27T20:43:21.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.541+0000 7fee7d002640 1 -- 172.21.15.91:0/2983762785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee78068350 con 0x7fee780a5260 2023-11-27T20:43:21.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.543+0000 7fee6ffff640 1 -- 172.21.15.91:0/2983762785 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fee6002f050 con 0x7fee780a5260 2023-11-27T20:43:21.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.543+0000 7fee6ffff640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee5806b1c0 0x7fee5806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.544+0000 7fee6ffff640 1 -- 172.21.15.91:0/2983762785 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fee600abfc0 con 0x7fee780a5260 2023-11-27T20:43:21.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.544+0000 7fee76d9d640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee5806b1c0 0x7fee5806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.544+0000 7fee76d9d640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee5806b1c0 0x7fee5806d680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fee68007eb0 tx=0x7fee68007400 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:21.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.548+0000 7fee6ffff640 1 -- 172.21.15.91:0/2983762785 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fee600dee90 con 0x7fee780a5260 2023-11-27T20:43:21.646 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:21.655 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:21.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.742+0000 7fee7d002640 1 -- 172.21.15.91:0/2983762785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee7806d540 con 0x7fee780a5260 2023-11-27T20:43:21.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.744+0000 7fee6ffff640 1 -- 172.21.15.91:0/2983762785 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+20346 (secure 0 0 0) 0x7fee60035020 con 0x7fee780a5260 2023-11-27T20:43:21.745 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:21.745 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":40,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:18.205644+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:21.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.746+0000 7fee7d002640 1 -- 172.21.15.91:0/2983762785 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee5806b1c0 msgr2=0x7fee5806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:21.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.746+0000 7fee7d002640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee5806b1c0 0x7fee5806d680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fee68007eb0 tx=0x7fee68007400 comp rx=0 tx=0).stop 2023-11-27T20:43:21.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.746+0000 7fee7d002640 1 -- 172.21.15.91:0/2983762785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee780a5260 msgr2=0x7fee78155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:21.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.746+0000 7fee7d002640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee780a5260 0x7fee78155990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fee60009870 tx=0x7fee600046c0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.747+0000 7fee7d002640 1 -- 172.21.15.91:0/2983762785 shutdown_connections 2023-11-27T20:43:21.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.747+0000 7fee7d002640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee5806b1c0 0x7fee5806d680 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.747+0000 7fee7d002640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee7814fd30 0x7fee78155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.747+0000 7fee7d002640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee780a5260 0x7fee78155990 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.747+0000 7fee7d002640 1 --2- 172.21.15.91:0/2983762785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee7806d0a0 0x7fee780bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.747+0000 7fee7d002640 1 -- 172.21.15.91:0/2983762785 >> 172.21.15.91:0/2983762785 conn(0x7fee7806a500 msgr2=0x7fee78152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:21.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.747+0000 7fee7d002640 1 -- 172.21.15.91:0/2983762785 shutdown_connections 2023-11-27T20:43:21.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.747+0000 7fee7d002640 1 -- 172.21.15.91:0/2983762785 wait complete. 2023-11-27T20:43:21.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:42:35.743447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:42:36.976231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:42:56.585972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:42:58.003354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:43:21.767 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:43:21.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.977+0000 7eff2735a640 1 Processor -- start 2023-11-27T20:43:21.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.977+0000 7eff2735a640 1 -- start start 2023-11-27T20:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.978+0000 7eff2735a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7eff2006d0a0 0x7eff20152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.979+0000 7eff2735a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff200c64a0 con 0x7eff200c3ea0 2023-11-27T20:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.979+0000 7eff2735a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff200c5c00 con 0x7eff2014fd30 2023-11-27T20:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.979+0000 7eff2735a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff200c5ee0 con 0x7eff2006d0a0 2023-11-27T20:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.979+0000 7eff258f7640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7eff200c3ea0 0x7eff200c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55436/0 (socket says 172.21.15.91:55436) 2023-11-27T20:43:21.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.979+0000 7eff258f7640 1 -- 172.21.15.91:0/562170375 learned_addr learned my addr 172.21.15.91:0/562170375 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.979+0000 7eff248f5640 1 --2- 172.21.15.91:0/562170375 >> v2:172.21.15.183:3300/0 conn(0x7eff2006d0a0 0x7eff20152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.979+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129740749 0 0) 0x7eff200c64a0 con 0x7eff200c3ea0 2023-11-27T20:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.979+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff0c003520 con 0x7eff200c3ea0 2023-11-27T20:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 404826249 0 0) 0x7eff0c003520 con 0x7eff200c3ea0 2023-11-27T20:43:21.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 >> v2:172.21.15.183:3300/0 conn(0x7eff2006d0a0 msgr2=0x7eff20152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 --2- 172.21.15.91:0/562170375 >> v2:172.21.15.183:3300/0 conn(0x7eff2006d0a0 0x7eff20152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 >> v1:172.21.15.183:6789/0 conn(0x7eff2014fd30 legacy=0x7eff200a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff200c61c0 con 0x7eff200c3ea0 2023-11-27T20:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7eff180019f0 con 0x7eff200c3ea0 2023-11-27T20:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 >> v1:172.21.15.91:6789/0 conn(0x7eff200c3ea0 legacy=0x7eff200c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff0c003970 0x7eff0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff0c0047c0 0x7eff0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff0c005180 0x7eff0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff200c5ee0 con 0x7eff0c005180 2023-11-27T20:43:21.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c00c020 con 0x7eff0c0047c0 2023-11-27T20:43:21.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c00c1e0 con 0x7eff0c003970 2023-11-27T20:43:21.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff258f7640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff0c005180 0x7eff0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.980+0000 7eff248f5640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff0c0047c0 0x7eff0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.981+0000 7eff250f6640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff0c003970 0x7eff0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.981+0000 7eff258f7640 1 -- 172.21.15.91:0/562170375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff0c003970 msgr2=0x7eff0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:21.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.981+0000 7eff258f7640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff0c003970 0x7eff0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.981+0000 7eff258f7640 1 -- 172.21.15.91:0/562170375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff0c0047c0 msgr2=0x7eff0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:21.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.981+0000 7eff258f7640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff0c0047c0 0x7eff0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.981+0000 7eff258f7640 1 -- 172.21.15.91:0/562170375 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c003520 con 0x7eff0c005180 2023-11-27T20:43:21.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.981+0000 7eff250f6640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff0c003970 0x7eff0c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.982+0000 7eff258f7640 1 -- 172.21.15.91:0/562170375 reap_dead start 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.982+0000 7eff258f7640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff0c005180 0x7eff0c00b980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7eff1800a830 tx=0x7eff0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cee827cc9e5e52 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.982+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180072d0 con 0x7eff0c005180 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.982+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1802f070 con 0x7eff0c005180 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.982+0000 7eff17fff640 1 -- 172.21.15.91:0/562170375 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180076b0 con 0x7eff0c005180 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.983+0000 7eff2735a640 1 -- 172.21.15.91:0/562170375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff0c005180 msgr2=0x7eff0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.983+0000 7eff2735a640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff0c005180 0x7eff0c00b980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7eff1800a830 tx=0x7eff0c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.983+0000 7eff2735a640 1 -- 172.21.15.91:0/562170375 shutdown_connections 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.983+0000 7eff2735a640 1 --2- 172.21.15.91:0/562170375 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff0c005180 0x7eff0c00b980 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.983+0000 7eff2735a640 1 -- 172.21.15.91:0/562170375 >> 172.21.15.91:0/562170375 conn(0x7eff2006a500 msgr2=0x7eff2006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.983+0000 7eff2735a640 1 -- 172.21.15.91:0/562170375 shutdown_connections 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.983+0000 7eff2735a640 1 -- 172.21.15.91:0/562170375 wait complete. 2023-11-27T20:43:21.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.985+0000 7eff2735a640 1 Processor -- start 2023-11-27T20:43:21.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.985+0000 7eff2735a640 1 -- start start 2023-11-27T20:43:21.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.985+0000 7eff2735a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff0c005180 0x7eff201e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.985+0000 7eff2735a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff2014e880 0x7eff201eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff2735a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff200c3010 0x7eff200a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff2735a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff200a69c0 con 0x7eff2014e880 2023-11-27T20:43:21.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff2735a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff201eb090 con 0x7eff200c3010 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff2735a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff200a6f40 con 0x7eff0c005180 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff248f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff2014e880 0x7eff201eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff248f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff2014e880 0x7eff201eab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53396/0 (socket says 172.21.15.91:53396) 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff248f5640 1 -- 172.21.15.91:0/3381797833 learned_addr learned my addr 172.21.15.91:0/3381797833 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff258f7640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff200c3010 0x7eff200a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff250f6640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff0c005180 0x7eff201e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff248f5640 1 -- 172.21.15.91:0/3381797833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff0c005180 msgr2=0x7eff201e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff248f5640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff0c005180 0x7eff201e80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff248f5640 1 -- 172.21.15.91:0/3381797833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff200c3010 msgr2=0x7eff200a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff248f5640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff200c3010 0x7eff200a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff248f5640 1 -- 172.21.15.91:0/3381797833 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20153990 con 0x7eff2014e880 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.986+0000 7eff258f7640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff200c3010 0x7eff200a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.987+0000 7eff248f5640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff2014e880 0x7eff201eab50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7eff10011990 tx=0x7eff10011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:21.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.987+0000 7eff15ffb640 1 -- 172.21.15.91:0/3381797833 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10004240 con 0x7eff2014e880 2023-11-27T20:43:21.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.987+0000 7eff15ffb640 1 -- 172.21.15.91:0/3381797833 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff100043a0 con 0x7eff2014e880 2023-11-27T20:43:21.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.987+0000 7eff2735a640 1 -- 172.21.15.91:0/3381797833 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff20153c70 con 0x7eff2014e880 2023-11-27T20:43:21.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.987+0000 7eff15ffb640 1 -- 172.21.15.91:0/3381797833 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000fa00 con 0x7eff2014e880 2023-11-27T20:43:21.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.987+0000 7eff2735a640 1 -- 172.21.15.91:0/3381797833 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff200c3490 con 0x7eff2014e880 2023-11-27T20:43:21.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.988+0000 7eff2735a640 1 -- 172.21.15.91:0/3381797833 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff20068350 con 0x7eff2014e880 2023-11-27T20:43:21.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.989+0000 7eff15ffb640 1 -- 172.21.15.91:0/3381797833 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7eff1000fb60 con 0x7eff2014e880 2023-11-27T20:43:21.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.990+0000 7eff15ffb640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff0406b1c0 0x7eff0406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:21.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.990+0000 7eff15ffb640 1 -- 172.21.15.91:0/3381797833 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7eff1008a390 con 0x7eff2014e880 2023-11-27T20:43:21.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.990+0000 7eff250f6640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff0406b1c0 0x7eff0406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:21.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.991+0000 7eff250f6640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff0406b1c0 0x7eff0406d680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0015b0 tx=0x7eff1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:21.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:21.994+0000 7eff15ffb640 1 -- 172.21.15.91:0/3381797833 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7eff10054d20 con 0x7eff2014e880 2023-11-27T20:43:22.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.184+0000 7eff2735a640 1 -- 172.21.15.91:0/3381797833 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff200a7080 con 0x7eff2014e880 2023-11-27T20:43:22.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.185+0000 7eff15ffb640 1 -- 172.21.15.91:0/3381797833 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff10058340 con 0x7eff2014e880 2023-11-27T20:43:22.185 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:43:22.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 -- 172.21.15.91:0/3381797833 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff0406b1c0 msgr2=0x7eff0406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff0406b1c0 0x7eff0406d680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0015b0 tx=0x7eff1c009040 comp rx=0 tx=0).stop 2023-11-27T20:43:22.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 -- 172.21.15.91:0/3381797833 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff2014e880 msgr2=0x7eff201eab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff2014e880 0x7eff201eab50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7eff10011990 tx=0x7eff10011e50 comp rx=0 tx=0).stop 2023-11-27T20:43:22.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 -- 172.21.15.91:0/3381797833 shutdown_connections 2023-11-27T20:43:22.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7eff0406b1c0 0x7eff0406d680 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff200c3010 0x7eff200a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff2014e880 0x7eff201eab50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 --2- 172.21.15.91:0/3381797833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff0c005180 0x7eff201e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 -- 172.21.15.91:0/3381797833 >> 172.21.15.91:0/3381797833 conn(0x7eff2006a500 msgr2=0x7eff200a9880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:22.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.187+0000 7eff2735a640 1 -- 172.21.15.91:0/3381797833 shutdown_connections 2023-11-27T20:43:22.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.188+0000 7eff2735a640 1 -- 172.21.15.91:0/3381797833 wait complete. 2023-11-27T20:43:22.207 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:43:22.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.423+0000 7f557b410640 1 Processor -- start 2023-11-27T20:43:22.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.423+0000 7f557b410640 1 -- start start 2023-11-27T20:43:22.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.424+0000 7f557b410640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5574152f20 0x7f55740c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.424+0000 7f557b410640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55740c64a0 con 0x7f557406d0a0 2023-11-27T20:43:22.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.425+0000 7f557b410640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55740c5c00 con 0x7f557414fd30 2023-11-27T20:43:22.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.425+0000 7f557b410640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740c5ee0 con 0x7f5574152f20 2023-11-27T20:43:22.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.425+0000 7f55789ab640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f557406d0a0 0x7f55740c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55440/0 (socket says 172.21.15.91:55440) 2023-11-27T20:43:22.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.425+0000 7f55789ab640 1 -- 172.21.15.91:0/2356315573 learned_addr learned my addr 172.21.15.91:0/2356315573 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:22.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.425+0000 7f55799ad640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5574152f20 0x7f55740c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.425+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742217661 0 0) 0x7f55740c64a0 con 0x7f557406d0a0 2023-11-27T20:43:22.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.425+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5560003520 con 0x7f557406d0a0 2023-11-27T20:43:22.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3365208777 0 0) 0x7f5560003520 con 0x7f557406d0a0 2023-11-27T20:43:22.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5574152f20 msgr2=0x7f55740c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5574152f20 0x7f55740c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 >> v1:172.21.15.183:6789/0 conn(0x7f557414fd30 legacy=0x7f55740a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55740c61c0 con 0x7f557406d0a0 2023-11-27T20:43:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f5564001670 con 0x7f557406d0a0 2023-11-27T20:43:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 >> v1:172.21.15.91:6789/0 conn(0x7f557406d0a0 legacy=0x7f55740c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 0x7f5560003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55600047c0 0x7f5560004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5574152f20 0x7f5560005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740c5ee0 con 0x7f55600039a0 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556000ba60 con 0x7f55600047c0 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556000bc20 con 0x7f5574152f20 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f55791ac640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 0x7f5560003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.426+0000 7f55789ab640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55600047c0 0x7f5560004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.427+0000 7f55799ad640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5574152f20 0x7f5560005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.427+0000 7f55791ac640 1 -- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5574152f20 msgr2=0x7f5560005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.427+0000 7f55791ac640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5574152f20 0x7f5560005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.427+0000 7f55791ac640 1 -- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55600047c0 msgr2=0x7f5560004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.427+0000 7f55791ac640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55600047c0 0x7f5560004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.427+0000 7f55791ac640 1 -- 172.21.15.91:0/2356315573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5560003520 con 0x7f55600039a0 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.427+0000 7f55799ad640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5574152f20 0x7f5560005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.428+0000 7f55791ac640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 0x7f5560003dc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5570001720 tx=0x7f55600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e09c205ad37ff3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.428+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700052d0 con 0x7f55600039a0 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.428+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557002e050 con 0x7f55600039a0 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.428+0000 7f556bfff640 1 -- 172.21.15.91:0/2356315573 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700035f0 con 0x7f55600039a0 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.428+0000 7f557b410640 1 -- 172.21.15.91:0/2356315573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 msgr2=0x7f5560003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.428+0000 7f557b410640 1 --2- 172.21.15.91:0/2356315573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 0x7f5560003dc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5570001720 tx=0x7f55600057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.429+0000 7f55799ad640 1 -- 172.21.15.91:0/2356315573 reap_dead start 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.429+0000 7f557b410640 1 -- 172.21.15.91:0/2356315573 shutdown_connections 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.429+0000 7f557b410640 1 -- 172.21.15.91:0/2356315573 >> 172.21.15.91:0/2356315573 conn(0x7f557406a500 msgr2=0x7f557406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.429+0000 7f557b410640 1 -- 172.21.15.91:0/2356315573 shutdown_connections 2023-11-27T20:43:22.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.429+0000 7f557b410640 1 -- 172.21.15.91:0/2356315573 wait complete. 2023-11-27T20:43:22.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.431+0000 7f557b410640 1 Processor -- start 2023-11-27T20:43:22.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.431+0000 7f557b410640 1 -- start start 2023-11-27T20:43:22.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f557b410640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 0x7f55740aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f557b410640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55741eac20 0x7f557414d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f557b410640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55740a4640 0x7f55740a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f557b410640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55741eb1e0 con 0x7f55600039a0 2023-11-27T20:43:22.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f557b410640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5574155c90 con 0x7f55740a4640 2023-11-27T20:43:22.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f557b410640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5574153f50 con 0x7f55741eac20 2023-11-27T20:43:22.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55791ac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 0x7f55740aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55791ac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 0x7f55740aa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53416/0 (socket says 172.21.15.91:53416) 2023-11-27T20:43:22.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55791ac640 1 -- 172.21.15.91:0/325053494 learned_addr learned my addr 172.21.15.91:0/325053494 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:22.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55799ad640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55740a4640 0x7f55740a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55789ab640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55741eac20 0x7f557414d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55791ac640 1 -- 172.21.15.91:0/325053494 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55741eac20 msgr2=0x7f557414d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55791ac640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55741eac20 0x7f557414d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55791ac640 1 -- 172.21.15.91:0/325053494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55740a4640 msgr2=0x7f55740a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55791ac640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55740a4640 0x7f55740a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55791ac640 1 -- 172.21.15.91:0/325053494 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55741522b0 con 0x7f55600039a0 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.432+0000 7f55789ab640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55741eac20 0x7f557414d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.433+0000 7f55791ac640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 0x7f55740aa1f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5570008fd0 tx=0x7f5570001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.433+0000 7f5569ffb640 1 -- 172.21.15.91:0/325053494 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570007a30 con 0x7f55600039a0 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.433+0000 7f5569ffb640 1 -- 172.21.15.91:0/325053494 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570007640 con 0x7f55600039a0 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.433+0000 7f5569ffb640 1 -- 172.21.15.91:0/325053494 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570006c00 con 0x7f55600039a0 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.433+0000 7f557b410640 1 -- 172.21.15.91:0/325053494 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5574152590 con 0x7f55600039a0 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.433+0000 7f557b410640 1 -- 172.21.15.91:0/325053494 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55741502d0 con 0x7f55600039a0 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.434+0000 7f557b410640 1 -- 172.21.15.91:0/325053494 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5574150460 con 0x7f55600039a0 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.435+0000 7f5569ffb640 1 -- 172.21.15.91:0/325053494 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f55700035f0 con 0x7f55600039a0 2023-11-27T20:43:22.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.436+0000 7f5569ffb640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f555806b1f0 0x7f555806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.436+0000 7f5569ffb640 1 -- 172.21.15.91:0/325053494 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f55700aba30 con 0x7f55600039a0 2023-11-27T20:43:22.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.437+0000 7f55789ab640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f555806b1f0 0x7f555806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.437+0000 7f55789ab640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f555806b1f0 0x7f555806d6b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5564001eb0 tx=0x7f5564000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:22.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.441+0000 7f5569ffb640 1 -- 172.21.15.91:0/325053494 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f557007a010 con 0x7f55600039a0 2023-11-27T20:43:22.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.635+0000 7f557b410640 1 -- 172.21.15.91:0/325053494 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5574068350 con 0x7f55600039a0 2023-11-27T20:43:22.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.636+0000 7f5569ffb640 1 -- 172.21.15.91:0/325053494 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f557004b020 con 0x7f55600039a0 2023-11-27T20:43:22.637 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:43:22.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 -- 172.21.15.91:0/325053494 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f555806b1f0 msgr2=0x7f555806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f555806b1f0 0x7f555806d6b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5564001eb0 tx=0x7f5564000ed0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 -- 172.21.15.91:0/325053494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 msgr2=0x7f55740aa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 0x7f55740aa1f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5570008fd0 tx=0x7f5570001120 comp rx=0 tx=0).stop 2023-11-27T20:43:22.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 -- 172.21.15.91:0/325053494 shutdown_connections 2023-11-27T20:43:22.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f555806b1f0 0x7f555806d6b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55740a4640 0x7f55740a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55741eac20 0x7f557414d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 --2- 172.21.15.91:0/325053494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55600039a0 0x7f55740aa1f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 -- 172.21.15.91:0/325053494 >> 172.21.15.91:0/325053494 conn(0x7f557406a500 msgr2=0x7f55740c1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:22.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 -- 172.21.15.91:0/325053494 shutdown_connections 2023-11-27T20:43:22.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.639+0000 7f557b410640 1 -- 172.21.15.91:0/325053494 wait complete. 2023-11-27T20:43:22.659 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:43:22.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.871+0000 7faa9ac83640 1 Processor -- start 2023-11-27T20:43:22.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.872+0000 7faa9ac83640 1 -- start start 2023-11-27T20:43:22.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.873+0000 7faa9ac83640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faa9414f9c0 0x7faa9406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.873+0000 7faa9ac83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940c49f0 0x7faa94070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.873+0000 7faa9ac83640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa940c4f70 con 0x7faa9406aa40 2023-11-27T20:43:22.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.873+0000 7faa9ac83640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa94071940 con 0x7faa9414f9c0 2023-11-27T20:43:22.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.873+0000 7faa9ac83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa941523b0 con 0x7faa940c49f0 2023-11-27T20:43:22.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.873+0000 7faa9a482640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7faa9406aa40 0x7faa94071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55450/0 (socket says 172.21.15.91:55450) 2023-11-27T20:43:22.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.873+0000 7faa9a482640 1 -- 172.21.15.91:0/1609700123 learned_addr learned my addr 172.21.15.91:0/1609700123 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:22.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa99c81640 1 --2- 172.21.15.91:0/1609700123 >> v2:172.21.15.183:3300/0 conn(0x7faa9414f9c0 0x7faa9406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa99480640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940c49f0 0x7faa94070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618474403 0 0) 0x7faa940c4f70 con 0x7faa9406aa40 2023-11-27T20:43:22.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa7c003520 con 0x7faa9406aa40 2023-11-27T20:43:22.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4267125045 0 0) 0x7faa7c003520 con 0x7faa9406aa40 2023-11-27T20:43:22.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940c49f0 msgr2=0x7faa94070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:22.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940c49f0 0x7faa94070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 >> v2:172.21.15.183:3300/0 conn(0x7faa9414f9c0 msgr2=0x7faa9406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 --2- 172.21.15.91:0/1609700123 >> v2:172.21.15.183:3300/0 conn(0x7faa9414f9c0 0x7faa9406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa94152670 con 0x7faa9406aa40 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7faa8c001670 con 0x7faa9406aa40 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 >> v1:172.21.15.91:6789/0 conn(0x7faa9406aa40 legacy=0x7faa94071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940c49f0 0x7faa7c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa7c003ef0 0x7faa7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 0x7faa7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa941523b0 con 0x7faa7c004d00 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c00b980 con 0x7faa7c003ef0 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.874+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c00bb10 con 0x7faa940c49f0 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.875+0000 7faa9a482640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 0x7faa7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.875+0000 7faa99480640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa7c003ef0 0x7faa7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.875+0000 7faa99c81640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940c49f0 0x7faa7c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.875+0000 7faa9a482640 1 -- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940c49f0 msgr2=0x7faa7c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:22.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.875+0000 7faa9a482640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa940c49f0 0x7faa7c003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.875+0000 7faa9a482640 1 -- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa7c003ef0 msgr2=0x7faa7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:22.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.875+0000 7faa9a482640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa7c003ef0 0x7faa7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.875+0000 7faa9a482640 1 -- 172.21.15.91:0/1609700123 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c003520 con 0x7faa7c004d00 2023-11-27T20:43:22.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.875+0000 7faa99480640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa7c003ef0 0x7faa7c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:22.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.876+0000 7faa9a482640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 0x7faa7c005180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00c1c0 tx=0x7faa7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd77be362af600db server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:22.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.877+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c005ad0 con 0x7faa7c004d00 2023-11-27T20:43:22.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.877+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8c005c30 con 0x7faa7c004d00 2023-11-27T20:43:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.877+0000 7faa98c7f640 1 -- 172.21.15.91:0/1609700123 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c02cad0 con 0x7faa7c004d00 2023-11-27T20:43:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.877+0000 7faa9ac83640 1 -- 172.21.15.91:0/1609700123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 msgr2=0x7faa7c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.877+0000 7faa9ac83640 1 --2- 172.21.15.91:0/1609700123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 0x7faa7c005180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00c1c0 tx=0x7faa7c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.877+0000 7faa9a482640 1 -- 172.21.15.91:0/1609700123 reap_dead start 2023-11-27T20:43:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.877+0000 7faa9ac83640 1 -- 172.21.15.91:0/1609700123 shutdown_connections 2023-11-27T20:43:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.877+0000 7faa9ac83640 1 -- 172.21.15.91:0/1609700123 >> 172.21.15.91:0/1609700123 conn(0x7faa940a88a0 msgr2=0x7faa940a8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.877+0000 7faa9ac83640 1 -- 172.21.15.91:0/1609700123 shutdown_connections 2023-11-27T20:43:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.877+0000 7faa9ac83640 1 -- 172.21.15.91:0/1609700123 wait complete. 2023-11-27T20:43:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.879+0000 7faa9ac83640 1 Processor -- start 2023-11-27T20:43:22.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.879+0000 7faa9ac83640 1 -- start start 2023-11-27T20:43:22.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.880+0000 7faa9ac83640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 0x7faa940a7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.880+0000 7faa9ac83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa9414c800 0x7faa94144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.880+0000 7faa9ac83640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa940bd820 0x7faa941452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.880+0000 7faa9ac83640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa941560d0 con 0x7faa7c004d00 2023-11-27T20:43:22.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.880+0000 7faa9ac83640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa940bc650 con 0x7faa940bd820 2023-11-27T20:43:22.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.880+0000 7faa9ac83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa940bc930 con 0x7faa9414c800 2023-11-27T20:43:22.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.880+0000 7faa99c81640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 0x7faa940a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.880+0000 7faa99c81640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 0x7faa940a7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53424/0 (socket says 172.21.15.91:53424) 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.880+0000 7faa99c81640 1 -- 172.21.15.91:0/3313927378 learned_addr learned my addr 172.21.15.91:0/3313927378 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.881+0000 7faa99c81640 1 -- 172.21.15.91:0/3313927378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa9414c800 msgr2=0x7faa94144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.881+0000 7faa99c81640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa9414c800 0x7faa94144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.881+0000 7faa99c81640 1 -- 172.21.15.91:0/3313927378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa940bd820 msgr2=0x7faa941452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.881+0000 7faa99c81640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa940bd820 0x7faa941452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.881+0000 7faa99c81640 1 -- 172.21.15.91:0/3313927378 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940bcc10 con 0x7faa7c004d00 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.881+0000 7faa99c81640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 0x7faa940a7970 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faa8400f3d0 tx=0x7faa8400f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.881+0000 7faa927fc640 1 -- 172.21.15.91:0/3313927378 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84016620 con 0x7faa7c004d00 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.881+0000 7faa927fc640 1 -- 172.21.15.91:0/3313927378 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa840167a0 con 0x7faa7c004d00 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.881+0000 7faa927fc640 1 -- 172.21.15.91:0/3313927378 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84016b50 con 0x7faa7c004d00 2023-11-27T20:43:22.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.881+0000 7faa9ac83640 1 -- 172.21.15.91:0/3313927378 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa940bcef0 con 0x7faa7c004d00 2023-11-27T20:43:22.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.882+0000 7faa9ac83640 1 -- 172.21.15.91:0/3313927378 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa94071370 con 0x7faa7c004d00 2023-11-27T20:43:22.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.883+0000 7faa9ac83640 1 -- 172.21.15.91:0/3313927378 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa94152c10 con 0x7faa7c004d00 2023-11-27T20:43:22.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.884+0000 7faa927fc640 1 -- 172.21.15.91:0/3313927378 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faa84016cb0 con 0x7faa7c004d00 2023-11-27T20:43:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.884+0000 7faa927fc640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faa8006b1c0 0x7faa8006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.884+0000 7faa927fc640 1 -- 172.21.15.91:0/3313927378 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7faa8408ada0 con 0x7faa7c004d00 2023-11-27T20:43:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.885+0000 7faa99480640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faa8006b1c0 0x7faa8006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.885+0000 7faa99480640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faa8006b1c0 0x7faa8006d680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faa94150bf0 tx=0x7faa88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:22.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:22.889+0000 7faa927fc640 1 -- 172.21.15.91:0/3313927378 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faa94152c10 con 0x7faa7c004d00 2023-11-27T20:43:23.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.077+0000 7faa9ac83640 1 -- 172.21.15.91:0/3313927378 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa94152c10 con 0x7faa7c004d00 2023-11-27T20:43:23.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.078+0000 7faa927fc640 1 -- 172.21.15.91:0/3313927378 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa94152c10 con 0x7faa7c004d00 2023-11-27T20:43:23.078 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:43:23.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 -- 172.21.15.91:0/3313927378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faa8006b1c0 msgr2=0x7faa8006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faa8006b1c0 0x7faa8006d680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faa94150bf0 tx=0x7faa88008040 comp rx=0 tx=0).stop 2023-11-27T20:43:23.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 -- 172.21.15.91:0/3313927378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 msgr2=0x7faa940a7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 0x7faa940a7970 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faa8400f3d0 tx=0x7faa8400f890 comp rx=0 tx=0).stop 2023-11-27T20:43:23.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 -- 172.21.15.91:0/3313927378 shutdown_connections 2023-11-27T20:43:23.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faa8006b1c0 0x7faa8006d680 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa940bd820 0x7faa941452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa9414c800 0x7faa94144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 --2- 172.21.15.91:0/3313927378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa7c004d00 0x7faa940a7970 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 -- 172.21.15.91:0/3313927378 >> 172.21.15.91:0/3313927378 conn(0x7faa940a88a0 msgr2=0x7faa940c61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:23.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 -- 172.21.15.91:0/3313927378 shutdown_connections 2023-11-27T20:43:23.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.081+0000 7faa9ac83640 1 -- 172.21.15.91:0/3313927378 wait complete. 2023-11-27T20:43:23.100 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:43:23.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.317+0000 7fd9cad9e640 1 Processor -- start 2023-11-27T20:43:23.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.317+0000 7fd9cad9e640 1 -- start start 2023-11-27T20:43:23.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.318+0000 7fd9cad9e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd9c4152f20 0x7fd9c40c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.318+0000 7fd9cad9e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c40c64a0 con 0x7fd9c414fd30 2023-11-27T20:43:23.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.318+0000 7fd9cad9e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c40c5c00 con 0x7fd9c406d0a0 2023-11-27T20:43:23.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.318+0000 7fd9cad9e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c40c5ee0 con 0x7fd9c4152f20 2023-11-27T20:43:23.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.319+0000 7fd9c8b3a640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd9c414fd30 0x7fd9c40a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55454/0 (socket says 172.21.15.91:55454) 2023-11-27T20:43:23.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.319+0000 7fd9c8b3a640 1 -- 172.21.15.91:0/3802755663 learned_addr learned my addr 172.21.15.91:0/3802755663 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:23.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.319+0000 7fd9c933b640 1 --2- 172.21.15.91:0/3802755663 >> v2:172.21.15.183:3300/0 conn(0x7fd9c4152f20 0x7fd9c40c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:23.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.319+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964835922 0 0) 0x7fd9c40c64a0 con 0x7fd9c414fd30 2023-11-27T20:43:23.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.319+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b4003520 con 0x7fd9c414fd30 2023-11-27T20:43:23.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2832174490 0 0) 0x7fd9b4003520 con 0x7fd9c414fd30 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 >> v2:172.21.15.183:3300/0 conn(0x7fd9c4152f20 msgr2=0x7fd9c40c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 --2- 172.21.15.91:0/3802755663 >> v2:172.21.15.183:3300/0 conn(0x7fd9c4152f20 0x7fd9c40c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 >> v1:172.21.15.183:6789/0 conn(0x7fd9c406d0a0 legacy=0x7fd9c40c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c40c61c0 con 0x7fd9c414fd30 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fd9b8001670 con 0x7fd9c414fd30 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 >> v1:172.21.15.91:6789/0 conn(0x7fd9c414fd30 legacy=0x7fd9c40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9b4003970 0x7fd9b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9b40047c0 0x7fd9b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c40c5ee0 con 0x7fd9b4005180 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b400c020 con 0x7fd9b40047c0 2023-11-27T20:43:23.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b400c1e0 con 0x7fd9b4003970 2023-11-27T20:43:23.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.320+0000 7fd9c933b640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:23.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.321+0000 7fd9c933b640 1 -- 172.21.15.91:0/3802755663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9b4003970 msgr2=0x7fd9b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:23.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.321+0000 7fd9c933b640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9b4003970 0x7fd9b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.321+0000 7fd9c933b640 1 -- 172.21.15.91:0/3802755663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9b40047c0 msgr2=0x7fd9b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:23.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.321+0000 7fd9c3fff640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9b40047c0 0x7fd9b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:23.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.321+0000 7fd9c933b640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9b40047c0 0x7fd9b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.321+0000 7fd9c933b640 1 -- 172.21.15.91:0/3802755663 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b4003520 con 0x7fd9b4005180 2023-11-27T20:43:23.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.321+0000 7fd9c3fff640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9b40047c0 0x7fd9b4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:23.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.322+0000 7fd9c933b640 1 -- 172.21.15.91:0/3802755663 reap_dead start 2023-11-27T20:43:23.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.322+0000 7fd9c933b640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9b400b980 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009fc0 tx=0x7fd9b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96db9a8bfbbf13f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:23.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.322+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc02cc60 con 0x7fd9b4005180 2023-11-27T20:43:23.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.322+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc00f040 con 0x7fd9b4005180 2023-11-27T20:43:23.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.322+0000 7fd9c37fe640 1 -- 172.21.15.91:0/3802755663 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc003990 con 0x7fd9b4005180 2023-11-27T20:43:23.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.323+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3802755663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 msgr2=0x7fd9b400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.323+0000 7fd9cad9e640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9b400b980 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009fc0 tx=0x7fd9b40057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.323+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3802755663 shutdown_connections 2023-11-27T20:43:23.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.323+0000 7fd9cad9e640 1 --2- 172.21.15.91:0/3802755663 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9b400b980 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.323+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3802755663 >> 172.21.15.91:0/3802755663 conn(0x7fd9c406a500 msgr2=0x7fd9c406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:23.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.323+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3802755663 shutdown_connections 2023-11-27T20:43:23.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.323+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3802755663 wait complete. 2023-11-27T20:43:23.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.324+0000 7fd9cad9e640 1 Processor -- start 2023-11-27T20:43:23.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.325+0000 7fd9cad9e640 1 -- start start 2023-11-27T20:43:23.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.325+0000 7fd9cad9e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9c4156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.325+0000 7fd9cad9e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9c41ed4f0 0x7fd9c41443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9cad9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9c40bf0f0 0x7fd9c40bf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9cad9e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c4144930 con 0x7fd9b4005180 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9cad9e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c41ed970 con 0x7fd9c41ed4f0 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9cad9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c41568f0 con 0x7fd9c40bf0f0 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9c8b3a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9c4156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9c8b3a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9c4156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53450/0 (socket says 172.21.15.91:53450) 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9c8b3a640 1 -- 172.21.15.91:0/3609629983 learned_addr learned my addr 172.21.15.91:0/3609629983 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9c8b3a640 1 -- 172.21.15.91:0/3609629983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9c40bf0f0 msgr2=0x7fd9c40bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9c8b3a640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9c40bf0f0 0x7fd9c40bf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9c8b3a640 1 -- 172.21.15.91:0/3609629983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9c41ed4f0 msgr2=0x7fd9c41443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9c8b3a640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9c41ed4f0 0x7fd9c41443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9c8b3a640 1 -- 172.21.15.91:0/3609629983 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c41ee420 con 0x7fd9b4005180 2023-11-27T20:43:23.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.326+0000 7fd9c8b3a640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9c4156200 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c700 tx=0x7fd9b800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:23.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.327+0000 7fd9c17fa640 1 -- 172.21.15.91:0/3609629983 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80074e0 con 0x7fd9b4005180 2023-11-27T20:43:23.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.327+0000 7fd9c17fa640 1 -- 172.21.15.91:0/3609629983 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8007640 con 0x7fd9b4005180 2023-11-27T20:43:23.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.327+0000 7fd9c17fa640 1 -- 172.21.15.91:0/3609629983 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8004a20 con 0x7fd9b4005180 2023-11-27T20:43:23.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.327+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3609629983 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c41edb80 con 0x7fd9b4005180 2023-11-27T20:43:23.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.327+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3609629983 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c41ee140 con 0x7fd9b4005180 2023-11-27T20:43:23.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.328+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3609629983 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c4068350 con 0x7fd9b4005180 2023-11-27T20:43:23.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.329+0000 7fd9c17fa640 1 -- 172.21.15.91:0/3609629983 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd9b8004b80 con 0x7fd9b4005180 2023-11-27T20:43:23.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.330+0000 7fd9c17fa640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd9a806b1c0 0x7fd9a806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.330+0000 7fd9c17fa640 1 -- 172.21.15.91:0/3609629983 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fd9b80890f0 con 0x7fd9b4005180 2023-11-27T20:43:23.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.331+0000 7fd9c3fff640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd9a806b1c0 0x7fd9a806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:23.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.331+0000 7fd9c3fff640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd9a806b1c0 0x7fd9a806d680 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0000f60 tx=0x7fd9b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:23.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.335+0000 7fd9c17fa640 1 -- 172.21.15.91:0/3609629983 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd9b8053b20 con 0x7fd9b4005180 2023-11-27T20:43:23.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.531+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3609629983 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9c40a4cc0 con 0x7fd9b4005180 2023-11-27T20:43:23.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.532+0000 7fd9c17fa640 1 -- 172.21.15.91:0/3609629983 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v40) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd9b8057140 con 0x7fd9b4005180 2023-11-27T20:43:23.533 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:43:23.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3609629983 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd9a806b1c0 msgr2=0x7fd9a806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd9a806b1c0 0x7fd9a806d680 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0000f60 tx=0x7fd9b0009040 comp rx=0 tx=0).stop 2023-11-27T20:43:23.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3609629983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 msgr2=0x7fd9c4156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9c4156200 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c700 tx=0x7fd9b800cbc0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3609629983 shutdown_connections 2023-11-27T20:43:23.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9c40bf0f0 0x7fd9c40bf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd9a806b1c0 0x7fd9a806d680 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9c41ed4f0 0x7fd9c41443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 --2- 172.21.15.91:0/3609629983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9b4005180 0x7fd9c4156200 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3609629983 >> 172.21.15.91:0/3609629983 conn(0x7fd9c406a500 msgr2=0x7fd9c406fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:23.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3609629983 shutdown_connections 2023-11-27T20:43:23.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.535+0000 7fd9cad9e640 1 -- 172.21.15.91:0/3609629983 wait complete. 2023-11-27T20:43:23.554 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:43:23.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.764+0000 7f842bfce640 1 Processor -- start 2023-11-27T20:43:23.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.764+0000 7f842bfce640 1 -- start start 2023-11-27T20:43:23.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.765+0000 7f842bfce640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8424155490 0x7f84240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.765+0000 7f842bfce640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f84240c1500 0x7f84240a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f842bfce640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84240c06c0 con 0x7f84240c4080 2023-11-27T20:43:23.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f842bfce640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84240a5820 con 0x7f8424155490 2023-11-27T20:43:23.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f842bfce640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84240c1020 con 0x7f84240c1500 2023-11-27T20:43:23.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f8429d6a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8424155490 0x7f84240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:23.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f8429d6a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8424155490 0x7f84240a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53466/0 (socket says 172.21.15.91:53466) 2023-11-27T20:43:23.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f842a56b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f84240c4080 0x7f84240c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55466/0 (socket says 172.21.15.91:55466) 2023-11-27T20:43:23.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f8429d6a640 1 -- 172.21.15.91:0/2923446266 learned_addr learned my addr 172.21.15.91:0/2923446266 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:23.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f8429569640 1 --2- 172.21.15.91:0/2923446266 >> v2:172.21.15.183:3300/0 conn(0x7f84240c1500 0x7f84240a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:23.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f8429d6a640 1 -- 172.21.15.91:0/2923446266 >> v2:172.21.15.183:3300/0 conn(0x7f84240c1500 msgr2=0x7f84240a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:23.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f8429d6a640 1 --2- 172.21.15.91:0/2923446266 >> v2:172.21.15.183:3300/0 conn(0x7f84240c1500 0x7f84240a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f8428d68640 1 -- 172.21.15.91:0/2923446266 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640823909 0 0) 0x7f84240c06c0 con 0x7f84240c4080 2023-11-27T20:43:23.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f8429d6a640 1 -- 172.21.15.91:0/2923446266 >> v1:172.21.15.91:6789/0 conn(0x7f84240c4080 legacy=0x7f84240c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.766+0000 7f8429d6a640 1 -- 172.21.15.91:0/2923446266 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240c0910 con 0x7f8424155490 2023-11-27T20:43:23.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.768+0000 7f8429d6a640 1 --2- 172.21.15.91:0/2923446266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8424155490 0x7f84240a51b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f84240a5160 tx=0x7f842002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5141aeb01bf36c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.768+0000 7f8428d68640 1 -- 172.21.15.91:0/2923446266 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420030860 con 0x7f8424155490 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.768+0000 7f8428d68640 1 -- 172.21.15.91:0/2923446266 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84200309c0 con 0x7f8424155490 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.768+0000 7f8428d68640 1 -- 172.21.15.91:0/2923446266 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420030d50 con 0x7f8424155490 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.768+0000 7f842bfce640 1 -- 172.21.15.91:0/2923446266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8424155490 msgr2=0x7f84240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.768+0000 7f842bfce640 1 --2- 172.21.15.91:0/2923446266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8424155490 0x7f84240a51b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f84240a5160 tx=0x7f842002b9a0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.769+0000 7f842bfce640 1 -- 172.21.15.91:0/2923446266 shutdown_connections 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.769+0000 7f842bfce640 1 --2- 172.21.15.91:0/2923446266 >> v2:172.21.15.183:3300/0 conn(0x7f84240c1500 0x7f84240a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.769+0000 7f842bfce640 1 --2- 172.21.15.91:0/2923446266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8424155490 0x7f84240a51b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.769+0000 7f842bfce640 1 -- 172.21.15.91:0/2923446266 >> 172.21.15.91:0/2923446266 conn(0x7f842406a500 msgr2=0x7f842406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.769+0000 7f842bfce640 1 -- 172.21.15.91:0/2923446266 shutdown_connections 2023-11-27T20:43:23.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.769+0000 7f842bfce640 1 -- 172.21.15.91:0/2923446266 wait complete. 2023-11-27T20:43:23.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.770+0000 7f842bfce640 1 Processor -- start 2023-11-27T20:43:23.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.770+0000 7f842bfce640 1 -- start start 2023-11-27T20:43:23.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.771+0000 7f842bfce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84240c1500 0x7f84240a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.771+0000 7f842bfce640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84240c4080 0x7f842414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.771+0000 7f842bfce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8424155490 0x7f842414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.771+0000 7f842bfce640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842414f8f0 con 0x7f84240c4080 2023-11-27T20:43:23.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.771+0000 7f842bfce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84241daae0 con 0x7f8424155490 2023-11-27T20:43:23.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.771+0000 7f842bfce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84241edf20 con 0x7f84240c1500 2023-11-27T20:43:23.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.772+0000 7f8429569640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84240c4080 0x7f842414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:23.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.772+0000 7f8429569640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84240c4080 0x7f842414ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53472/0 (socket says 172.21.15.91:53472) 2023-11-27T20:43:23.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.772+0000 7f8429569640 1 -- 172.21.15.91:0/1142609999 learned_addr learned my addr 172.21.15.91:0/1142609999 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:23.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.772+0000 7f8429569640 1 -- 172.21.15.91:0/1142609999 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84240c1500 msgr2=0x7f84240a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.772+0000 7f8429569640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84240c1500 0x7f84240a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.772+0000 7f8429569640 1 -- 172.21.15.91:0/1142609999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8424155490 msgr2=0x7f842414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.772+0000 7f8429569640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8424155490 0x7f842414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.772+0000 7f8429569640 1 -- 172.21.15.91:0/1142609999 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200094d0 con 0x7f84240c4080 2023-11-27T20:43:23.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.772+0000 7f8429569640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84240c4080 0x7f842414ee70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f841800c7f0 tx=0x7f841800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:23.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.772+0000 7f84167fc640 1 -- 172.21.15.91:0/1142609999 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418004220 con 0x7f84240c4080 2023-11-27T20:43:23.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.773+0000 7f84167fc640 1 -- 172.21.15.91:0/1142609999 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84180043a0 con 0x7f84240c4080 2023-11-27T20:43:23.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.773+0000 7f842bfce640 1 -- 172.21.15.91:0/1142609999 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84241dad80 con 0x7f84240c4080 2023-11-27T20:43:23.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.773+0000 7f84167fc640 1 -- 172.21.15.91:0/1142609999 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418007860 con 0x7f84240c4080 2023-11-27T20:43:23.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.773+0000 7f842bfce640 1 -- 172.21.15.91:0/1142609999 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84240a8ab0 con 0x7f84240c4080 2023-11-27T20:43:23.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.774+0000 7f842bfce640 1 -- 172.21.15.91:0/1142609999 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8424068350 con 0x7f84240c4080 2023-11-27T20:43:23.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.775+0000 7f84167fc640 1 -- 172.21.15.91:0/1142609999 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8418007bd0 con 0x7f84240c4080 2023-11-27T20:43:23.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.777+0000 7f84167fc640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f840806b1c0 0x7f840806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:23.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.777+0000 7f84167fc640 1 -- 172.21.15.91:0/1142609999 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f8418089e20 con 0x7f84240c4080 2023-11-27T20:43:23.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.777+0000 7f8429d6a640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f840806b1c0 0x7f840806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:23.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.778+0000 7f8429d6a640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f840806b1c0 0x7f840806d680 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8420036000 tx=0x7f842003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:23.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.781+0000 7f84167fc640 1 -- 172.21.15.91:0/1142609999 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8418054720 con 0x7f84240c4080 2023-11-27T20:43:23.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.969+0000 7f842bfce640 1 -- 172.21.15.91:0/1142609999 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f84240c0b00 con 0x7f84240c4080 2023-11-27T20:43:23.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.970+0000 7f84167fc640 1 -- 172.21.15.91:0/1142609999 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v40) v1 ==== 101+0+11 (secure 0 0 0) 0x7f841801e020 con 0x7f84240c4080 2023-11-27T20:43:23.971 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:43:23.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 -- 172.21.15.91:0/1142609999 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f840806b1c0 msgr2=0x7f840806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f840806b1c0 0x7f840806d680 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8420036000 tx=0x7f842003b040 comp rx=0 tx=0).stop 2023-11-27T20:43:23.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 -- 172.21.15.91:0/1142609999 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84240c4080 msgr2=0x7f842414ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:23.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84240c4080 0x7f842414ee70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f841800c7f0 tx=0x7f841800ccb0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 -- 172.21.15.91:0/1142609999 shutdown_connections 2023-11-27T20:43:23.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f840806b1c0 0x7f840806d680 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8424155490 0x7f842414f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84240c4080 0x7f842414ee70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 --2- 172.21.15.91:0/1142609999 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84240c1500 0x7f84240a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:23.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 -- 172.21.15.91:0/1142609999 >> 172.21.15.91:0/1142609999 conn(0x7f842406a500 msgr2=0x7f842406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:23.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 -- 172.21.15.91:0/1142609999 shutdown_connections 2023-11-27T20:43:23.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:23.973+0000 7f842bfce640 1 -- 172.21.15.91:0/1142609999 wait complete. 2023-11-27T20:43:23.992 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:43:24.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.199+0000 7f650232c640 1 Processor -- start 2023-11-27T20:43:24.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.199+0000 7f650232c640 1 -- start start 2023-11-27T20:43:24.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.201+0000 7f650232c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f64fc157c50 0x7f64fc06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.201+0000 7f650232c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc06aa40 con 0x7f64fc073a00 2023-11-27T20:43:24.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.201+0000 7f650232c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc0c00d0 con 0x7f64fc158030 2023-11-27T20:43:24.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.201+0000 7f650232c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc0c1e00 con 0x7f64fc157c50 2023-11-27T20:43:24.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.201+0000 7f64fb7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f64fc073a00 0x7f64fc0c0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45146/0 (socket says 172.21.15.91:45146) 2023-11-27T20:43:24.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.201+0000 7f64fb7fe640 1 -- 172.21.15.91:0/3242226534 learned_addr learned my addr 172.21.15.91:0/3242226534 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:24.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64fbfff640 1 --2- 172.21.15.91:0/3242226534 >> v2:172.21.15.183:3300/0 conn(0x7f64fc157c50 0x7f64fc06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771335049 0 0) 0x7f64fc06aa40 con 0x7f64fc073a00 2023-11-27T20:43:24.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e8003520 con 0x7f64fc073a00 2023-11-27T20:43:24.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 264290032 0 0) 0x7f64e8003520 con 0x7f64fc073a00 2023-11-27T20:43:24.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 >> v2:172.21.15.183:3300/0 conn(0x7f64fc157c50 msgr2=0x7f64fc06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:24.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 --2- 172.21.15.91:0/3242226534 >> v2:172.21.15.183:3300/0 conn(0x7f64fc157c50 0x7f64fc06a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 >> v1:172.21.15.183:6789/0 conn(0x7f64fc158030 legacy=0x7f64fc15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0bfa80 con 0x7f64fc073a00 2023-11-27T20:43:24.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f64e4001670 con 0x7f64fc073a00 2023-11-27T20:43:24.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 >> v1:172.21.15.91:6789/0 conn(0x7f64fc073a00 legacy=0x7f64fc0c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64e8003970 0x7f64e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64e80047c0 0x7f64e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0c1e00 con 0x7f64e8005180 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e800c020 con 0x7f64e80047c0 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.202+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e800c1e0 con 0x7f64e8003970 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.203+0000 7f65008c9640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.203+0000 7f64fbfff640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64e8003970 0x7f64e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.203+0000 7f64fb7fe640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64e80047c0 0x7f64e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.203+0000 7f65008c9640 1 -- 172.21.15.91:0/3242226534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64e8003970 msgr2=0x7f64e8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.203+0000 7f65008c9640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64e8003970 0x7f64e8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.203+0000 7f65008c9640 1 -- 172.21.15.91:0/3242226534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64e80047c0 msgr2=0x7f64e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.203+0000 7f65008c9640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64e80047c0 0x7f64e8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.203+0000 7f65008c9640 1 -- 172.21.15.91:0/3242226534 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e8003520 con 0x7f64e8005180 2023-11-27T20:43:24.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.204+0000 7f65008c9640 1 -- 172.21.15.91:0/3242226534 reap_dead start 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.204+0000 7f65008c9640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64e800b980 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f64f4001750 tx=0x7f64e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3d447159bfa0be server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.204+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40052d0 con 0x7f64e8005180 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.205+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f402e050 con 0x7f64e8005180 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.205+0000 7f64faffd640 1 -- 172.21.15.91:0/3242226534 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40035f0 con 0x7f64e8005180 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.205+0000 7f650232c640 1 -- 172.21.15.91:0/3242226534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 msgr2=0x7f64e800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.205+0000 7f650232c640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64e800b980 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f64f4001750 tx=0x7f64e80057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.205+0000 7f650232c640 1 -- 172.21.15.91:0/3242226534 shutdown_connections 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.205+0000 7f650232c640 1 --2- 172.21.15.91:0/3242226534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64e800b980 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.205+0000 7f650232c640 1 -- 172.21.15.91:0/3242226534 >> 172.21.15.91:0/3242226534 conn(0x7f64fc0c30b0 msgr2=0x7f64fc0c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.205+0000 7f650232c640 1 -- 172.21.15.91:0/3242226534 shutdown_connections 2023-11-27T20:43:24.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.205+0000 7f650232c640 1 -- 172.21.15.91:0/3242226534 wait complete. 2023-11-27T20:43:24.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.207+0000 7f650232c640 1 Processor -- start 2023-11-27T20:43:24.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.207+0000 7f650232c640 1 -- start start 2023-11-27T20:43:24.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.208+0000 7f650232c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64fc14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.208+0000 7f650232c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64fc155160 0x7f64fc1e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.208+0000 7f650232c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64fc0ab5f0 0x7f64fc0aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.208+0000 7f650232c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc1e7b10 con 0x7f64e8005180 2023-11-27T20:43:24.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.208+0000 7f650232c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc1470f0 con 0x7f64fc155160 2023-11-27T20:43:24.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.208+0000 7f650232c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc1476b0 con 0x7f64fc0ab5f0 2023-11-27T20:43:24.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.208+0000 7f64fbfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64fc14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.208+0000 7f64fbfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64fc14d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46926/0 (socket says 172.21.15.91:46926) 2023-11-27T20:43:24.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.208+0000 7f64fbfff640 1 -- 172.21.15.91:0/1209287989 learned_addr learned my addr 172.21.15.91:0/1209287989 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f64fbfff640 1 -- 172.21.15.91:0/1209287989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64fc0ab5f0 msgr2=0x7f64fc0aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f64fb7fe640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64fc155160 0x7f64fc1e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f65008c9640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64fc0ab5f0 0x7f64fc0aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f64fbfff640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64fc0ab5f0 0x7f64fc0aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f64fbfff640 1 -- 172.21.15.91:0/1209287989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64fc155160 msgr2=0x7f64fc1e75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f64fbfff640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64fc155160 0x7f64fc1e75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f64fbfff640 1 -- 172.21.15.91:0/1209287989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc1ea910 con 0x7f64e8005180 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f65008c9640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64fc0ab5f0 0x7f64fc0aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f64fb7fe640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64fc155160 0x7f64fc1e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f64fbfff640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64fc14d560 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009fb0 tx=0x7f64ec0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.209+0000 7f64f8ff9640 1 -- 172.21.15.91:0/1209287989 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00e030 con 0x7f64e8005180 2023-11-27T20:43:24.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.210+0000 7f64f8ff9640 1 -- 172.21.15.91:0/1209287989 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec016470 con 0x7f64e8005180 2023-11-27T20:43:24.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.210+0000 7f64f8ff9640 1 -- 172.21.15.91:0/1209287989 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec016820 con 0x7f64e8005180 2023-11-27T20:43:24.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.210+0000 7f650232c640 1 -- 172.21.15.91:0/1209287989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc1eabf0 con 0x7f64e8005180 2023-11-27T20:43:24.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.210+0000 7f650232c640 1 -- 172.21.15.91:0/1209287989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc0ac200 con 0x7f64e8005180 2023-11-27T20:43:24.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.211+0000 7f650232c640 1 -- 172.21.15.91:0/1209287989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc066b40 con 0x7f64e8005180 2023-11-27T20:43:24.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.212+0000 7f64f8ff9640 1 -- 172.21.15.91:0/1209287989 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f64ec016980 con 0x7f64e8005180 2023-11-27T20:43:24.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.213+0000 7f64f8ff9640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f64dc06b1f0 0x7f64dc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.213+0000 7f64f8ff9640 1 -- 172.21.15.91:0/1209287989 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f64ec00f070 con 0x7f64e8005180 2023-11-27T20:43:24.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.213+0000 7f64fb7fe640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f64dc06b1f0 0x7f64dc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.213+0000 7f64fb7fe640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f64dc06b1f0 0x7f64dc06d6b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f64fc147920 tx=0x7f64e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:24.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.217+0000 7f64f8ff9640 1 -- 172.21.15.91:0/1209287989 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f64ec055690 con 0x7f64e8005180 2023-11-27T20:43:24.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.414+0000 7f650232c640 1 -- 172.21.15.91:0/1209287989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f64fc06a6b0 con 0x7f64e8005180 2023-11-27T20:43:24.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.414+0000 7f64f8ff9640 1 -- 172.21.15.91:0/1209287989 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f64ec058cb0 con 0x7f64e8005180 2023-11-27T20:43:24.415 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:43:24.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 -- 172.21.15.91:0/1209287989 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f64dc06b1f0 msgr2=0x7f64dc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f64dc06b1f0 0x7f64dc06d6b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f64fc147920 tx=0x7f64e4009040 comp rx=0 tx=0).stop 2023-11-27T20:43:24.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 -- 172.21.15.91:0/1209287989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 msgr2=0x7f64fc14d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64fc14d560 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009fb0 tx=0x7f64ec0115a0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 -- 172.21.15.91:0/1209287989 shutdown_connections 2023-11-27T20:43:24.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64fc0ab5f0 0x7f64fc0aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f64dc06b1f0 0x7f64dc06d6b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64fc155160 0x7f64fc1e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 --2- 172.21.15.91:0/1209287989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64e8005180 0x7f64fc14d560 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 -- 172.21.15.91:0/1209287989 >> 172.21.15.91:0/1209287989 conn(0x7f64fc0c30b0 msgr2=0x7f64fc155a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:24.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 -- 172.21.15.91:0/1209287989 shutdown_connections 2023-11-27T20:43:24.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.417+0000 7f650232c640 1 -- 172.21.15.91:0/1209287989 wait complete. 2023-11-27T20:43:24.436 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-27T20:43:24.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:24.436 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-27T20:43:24.546 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:43:24.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:43:24.546 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-27T20:43:24.609 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:24.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.823+0000 7f80a6bd7640 1 Processor -- start 2023-11-27T20:43:24.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.823+0000 7f80a6bd7640 1 -- start start 2023-11-27T20:43:24.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.824+0000 7f80a6bd7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f80a0152f20 0x7f80a00c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.824+0000 7f80a6bd7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00c64a0 con 0x7f80a006d0a0 2023-11-27T20:43:24.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.824+0000 7f80a6bd7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00c5c00 con 0x7f80a014fd30 2023-11-27T20:43:24.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.824+0000 7f80a6bd7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a00c5ee0 con 0x7f80a0152f20 2023-11-27T20:43:24.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809ffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f80a006d0a0 0x7f80a00c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45156/0 (socket says 172.21.15.91:45156) 2023-11-27T20:43:24.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809ffff640 1 -- 172.21.15.91:0/3338921442 learned_addr learned my addr 172.21.15.91:0/3338921442 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:24.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f80a5174640 1 --2- 172.21.15.91:0/3338921442 >> v2:172.21.15.183:3300/0 conn(0x7f80a0152f20 0x7f80a00c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883741682 0 0) 0x7f80a00c64a0 con 0x7f80a006d0a0 2023-11-27T20:43:24.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8090003520 con 0x7f80a006d0a0 2023-11-27T20:43:24.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2053900363 0 0) 0x7f8090003520 con 0x7f80a006d0a0 2023-11-27T20:43:24.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 >> v2:172.21.15.183:3300/0 conn(0x7f80a0152f20 msgr2=0x7f80a00c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:24.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809f7fe640 1 --2- 172.21.15.91:0/3338921442 >> v2:172.21.15.183:3300/0 conn(0x7f80a0152f20 0x7f80a00c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 >> v1:172.21.15.183:6789/0 conn(0x7f80a014fd30 legacy=0x7f80a00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00c61c0 con 0x7f80a006d0a0 2023-11-27T20:43:24.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f808c001670 con 0x7f80a006d0a0 2023-11-27T20:43:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 >> v1:172.21.15.91:6789/0 conn(0x7f80a006d0a0 legacy=0x7f80a00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.825+0000 7f809f7fe640 1 --2- 172.21.15.91:0/3338921442 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8090003970 0x7f8090003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f809f7fe640 1 --2- 172.21.15.91:0/3338921442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80900047c0 0x7f8090004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f809f7fe640 1 --2- 172.21.15.91:0/3338921442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8090005180 0x7f809000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00c5ee0 con 0x7f8090003970 2023-11-27T20:43:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809000c020 con 0x7f80900047c0 2023-11-27T20:43:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809000c1e0 con 0x7f8090005180 2023-11-27T20:43:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f80a4973640 1 --2- 172.21.15.91:0/3338921442 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8090003970 0x7f8090003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f80a5174640 1 --2- 172.21.15.91:0/3338921442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8090005180 0x7f809000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f80a4973640 1 -- 172.21.15.91:0/3338921442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8090005180 msgr2=0x7f809000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:24.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f80a4973640 1 --2- 172.21.15.91:0/3338921442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8090005180 0x7f809000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f80a4973640 1 -- 172.21.15.91:0/3338921442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80900047c0 msgr2=0x7f8090004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:24.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f80a4973640 1 --2- 172.21.15.91:0/3338921442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80900047c0 0x7f8090004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f80a4973640 1 -- 172.21.15.91:0/3338921442 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090003520 con 0x7f8090003970 2023-11-27T20:43:24.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.826+0000 7f80a5174640 1 -- 172.21.15.91:0/3338921442 reap_dead start 2023-11-27T20:43:24.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.827+0000 7f80a4973640 1 --2- 172.21.15.91:0/3338921442 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8090003970 0x7f8090003d90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8094001750 tx=0x7f80900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589c98903f576cc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:24.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.828+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80940052d0 con 0x7f8090003970 2023-11-27T20:43:24.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.828+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809402e050 con 0x7f8090003970 2023-11-27T20:43:24.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.828+0000 7f809f7fe640 1 -- 172.21.15.91:0/3338921442 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094003830 con 0x7f8090003970 2023-11-27T20:43:24.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.828+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3338921442 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8090003970 msgr2=0x7f8090003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.828+0000 7f80a6bd7640 1 --2- 172.21.15.91:0/3338921442 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8090003970 0x7f8090003d90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8094001750 tx=0x7f80900057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.828+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3338921442 shutdown_connections 2023-11-27T20:43:24.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.828+0000 7f80a6bd7640 1 --2- 172.21.15.91:0/3338921442 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8090003970 0x7f8090003d90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.828+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3338921442 >> 172.21.15.91:0/3338921442 conn(0x7f80a006a500 msgr2=0x7f80a006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:24.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.828+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3338921442 shutdown_connections 2023-11-27T20:43:24.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.828+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3338921442 wait complete. 2023-11-27T20:43:24.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.830+0000 7f80a6bd7640 1 Processor -- start 2023-11-27T20:43:24.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.830+0000 7f80a6bd7640 1 -- start start 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.831+0000 7f80a6bd7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8090003970 0x7f80a00bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.831+0000 7f80a6bd7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80a00a9ec0 0x7f80a0143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.831+0000 7f80a6bd7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80a00aa340 0x7f80a0143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.831+0000 7f80a6bd7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01ed660 con 0x7f80a00aa340 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.831+0000 7f80a6bd7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01ed870 con 0x7f80a00a9ec0 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.831+0000 7f80a6bd7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01edb50 con 0x7f8090003970 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.831+0000 7f80a5174640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80a00aa340 0x7f80a0143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.831+0000 7f80a5174640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80a00aa340 0x7f80a0143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46944/0 (socket says 172.21.15.91:46944) 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.831+0000 7f80a5174640 1 -- 172.21.15.91:0/3553347576 learned_addr learned my addr 172.21.15.91:0/3553347576 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f80a4973640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8090003970 0x7f80a00bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f80a5174640 1 -- 172.21.15.91:0/3553347576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8090003970 msgr2=0x7f80a00bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f80a5174640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8090003970 0x7f80a00bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f80a5174640 1 -- 172.21.15.91:0/3553347576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80a00a9ec0 msgr2=0x7f80a0143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f809ffff640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80a00a9ec0 0x7f80a0143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f80a5174640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80a00a9ec0 0x7f80a0143a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f80a5174640 1 -- 172.21.15.91:0/3553347576 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a01ede30 con 0x7f80a00aa340 2023-11-27T20:43:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f80a5174640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80a00aa340 0x7f80a0143f40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f80a0067220 tx=0x7f809800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f809d7fa640 1 -- 172.21.15.91:0/3553347576 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809801a070 con 0x7f80a00aa340 2023-11-27T20:43:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f809d7fa640 1 -- 172.21.15.91:0/3553347576 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800fd90 con 0x7f80a00aa340 2023-11-27T20:43:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3553347576 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a01ee110 con 0x7f80a00aa340 2023-11-27T20:43:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f809d7fa640 1 -- 172.21.15.91:0/3553347576 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098003bb0 con 0x7f80a00aa340 2023-11-27T20:43:24.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.832+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3553347576 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a0144480 con 0x7f80a00aa340 2023-11-27T20:43:24.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.833+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3553347576 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a00ac060 con 0x7f80a00aa340 2023-11-27T20:43:24.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.834+0000 7f809d7fa640 1 -- 172.21.15.91:0/3553347576 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8098016420 con 0x7f80a00aa340 2023-11-27T20:43:24.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.836+0000 7f809d7fa640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f808406b1f0 0x7f808406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:24.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.836+0000 7f809d7fa640 1 -- 172.21.15.91:0/3553347576 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f809808a530 con 0x7f80a00aa340 2023-11-27T20:43:24.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.836+0000 7f80a4973640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f808406b1f0 0x7f808406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:24.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.837+0000 7f80a4973640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f808406b1f0 0x7f808406d6b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8094033000 tx=0x7f8094009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:24.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:24.840+0000 7f809d7fa640 1 -- 172.21.15.91:0/3553347576 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8098054f60 con 0x7f80a00aa340 2023-11-27T20:43:25.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.048+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3553347576 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80a0068350 con 0x7f80a00aa340 2023-11-27T20:43:25.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.049+0000 7f809d7fa640 1 -- 172.21.15.91:0/3553347576 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f8098058580 con 0x7f80a00aa340 2023-11-27T20:43:25.051 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:25.051 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:37.962718+0000","modified":"2023-11-27T20:42:41.040049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.183:6834/3450105603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3450105603},{"type":"v1","addr":"172.21.15.183:6834","nonce":3450105603}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:58.980635+0000","modified":"2023-11-27T20:43:02.065929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":10,"addr":"172.21.15.91:6837/127433365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":127433365},{"type":"v1","addr":"172.21.15.91:6837","nonce":127433365}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-27T20:43:25.051 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 20 2023-11-27T20:43:25.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.052+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3553347576 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f808406b1f0 msgr2=0x7f808406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.052+0000 7f80a6bd7640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f808406b1f0 0x7f808406d6b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8094033000 tx=0x7f8094009030 comp rx=0 tx=0).stop 2023-11-27T20:43:25.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.052+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3553347576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80a00aa340 msgr2=0x7f80a0143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.052+0000 7f80a6bd7640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80a00aa340 0x7f80a0143f40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f80a0067220 tx=0x7f809800f520 comp rx=0 tx=0).stop 2023-11-27T20:43:25.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.052+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3553347576 shutdown_connections 2023-11-27T20:43:25.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.052+0000 7f80a6bd7640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80a00aa340 0x7f80a0143f40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.052+0000 7f80a6bd7640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f808406b1f0 0x7f808406d6b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.052+0000 7f80a6bd7640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80a00a9ec0 0x7f80a0143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.052+0000 7f80a6bd7640 1 --2- 172.21.15.91:0/3553347576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8090003970 0x7f80a00bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.052+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3553347576 >> 172.21.15.91:0/3553347576 conn(0x7f80a006a500 msgr2=0x7f80a006ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:25.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.053+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3553347576 shutdown_connections 2023-11-27T20:43:25.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.053+0000 7f80a6bd7640 1 -- 172.21.15.91:0/3553347576 wait complete. 2023-11-27T20:43:25.072 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:25.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.268+0000 7fbddc905640 1 Processor -- start 2023-11-27T20:43:25.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.268+0000 7fbddc905640 1 -- start start 2023-11-27T20:43:25.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.269+0000 7fbddc905640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd814fd30 0x7fbdd8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.270+0000 7fbddc905640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbdd80c3ea0 0x7fbdd80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.270+0000 7fbddc905640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd80c64a0 con 0x7fbdd806d0a0 2023-11-27T20:43:25.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.270+0000 7fbddc905640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80c5c00 con 0x7fbdd80c3ea0 2023-11-27T20:43:25.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.270+0000 7fbddc905640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80c5ee0 con 0x7fbdd814fd30 2023-11-27T20:43:25.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.270+0000 7fbdcdd9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fbdd806d0a0 0x7fbdd80a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45162/0 (socket says 172.21.15.91:45162) 2023-11-27T20:43:25.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.270+0000 7fbdcdd9b640 1 -- 172.21.15.91:0/2162040851 learned_addr learned my addr 172.21.15.91:0/2162040851 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:25.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.270+0000 7fbdd6d9d640 1 --2- 172.21.15.91:0/2162040851 >> v2:172.21.15.183:3300/0 conn(0x7fbdd80c3ea0 0x7fbdd80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.270+0000 7fbdd659c640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd814fd30 0x7fbdd8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.270+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634591668 0 0) 0x7fbdd80c64a0 con 0x7fbdd806d0a0 2023-11-27T20:43:25.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdc4003520 con 0x7fbdd806d0a0 2023-11-27T20:43:25.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1738033157 0 0) 0x7fbdc4003520 con 0x7fbdd806d0a0 2023-11-27T20:43:25.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd814fd30 msgr2=0x7fbdd8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:25.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd814fd30 0x7fbdd8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 >> v2:172.21.15.183:3300/0 conn(0x7fbdd80c3ea0 msgr2=0x7fbdd80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:25.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 --2- 172.21.15.91:0/2162040851 >> v2:172.21.15.183:3300/0 conn(0x7fbdd80c3ea0 0x7fbdd80c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80c61c0 con 0x7fbdd806d0a0 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fbdc0001670 con 0x7fbdd806d0a0 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 >> v1:172.21.15.91:6789/0 conn(0x7fbdd806d0a0 legacy=0x7fbdd80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 0x7fbdc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd814fd30 0x7fbdc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc4004d00 0x7fbdc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80c5c00 con 0x7fbdc4003970 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80c5ee0 con 0x7fbdc4004d00 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc400b980 con 0x7fbdd814fd30 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.271+0000 7fbdd659c640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 0x7fbdc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.272+0000 7fbdcdd9b640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd814fd30 0x7fbdc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.272+0000 7fbdd6d9d640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc4004d00 0x7fbdc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.272+0000 7fbdd659c640 1 -- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd814fd30 msgr2=0x7fbdc40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:25.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.272+0000 7fbdd659c640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd814fd30 0x7fbdc40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.272+0000 7fbdd659c640 1 -- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc4004d00 msgr2=0x7fbdc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:25.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.272+0000 7fbdd659c640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc4004d00 0x7fbdc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.272+0000 7fbdd659c640 1 -- 172.21.15.91:0/2162040851 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4003520 con 0x7fbdc4003970 2023-11-27T20:43:25.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.273+0000 7fbdd659c640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 0x7fbdc4003d90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009fc0 tx=0x7fbdc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1df14b192159373 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:25.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.274+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc802cc20 con 0x7fbdc4003970 2023-11-27T20:43:25.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.274+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc800f040 con 0x7fbdc4003970 2023-11-27T20:43:25.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.274+0000 7fbdd5d9b640 1 -- 172.21.15.91:0/2162040851 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8034440 con 0x7fbdc4003970 2023-11-27T20:43:25.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.274+0000 7fbddc905640 1 -- 172.21.15.91:0/2162040851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 msgr2=0x7fbdc4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.274+0000 7fbddc905640 1 --2- 172.21.15.91:0/2162040851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 0x7fbdc4003d90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009fc0 tx=0x7fbdc40057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.274+0000 7fbdd6d9d640 1 -- 172.21.15.91:0/2162040851 reap_dead start 2023-11-27T20:43:25.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.274+0000 7fbddc905640 1 -- 172.21.15.91:0/2162040851 shutdown_connections 2023-11-27T20:43:25.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.274+0000 7fbddc905640 1 -- 172.21.15.91:0/2162040851 >> 172.21.15.91:0/2162040851 conn(0x7fbdd806a500 msgr2=0x7fbdd806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:25.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.274+0000 7fbddc905640 1 -- 172.21.15.91:0/2162040851 shutdown_connections 2023-11-27T20:43:25.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.274+0000 7fbddc905640 1 -- 172.21.15.91:0/2162040851 wait complete. 2023-11-27T20:43:25.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.276+0000 7fbddc905640 1 Processor -- start 2023-11-27T20:43:25.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.276+0000 7fbddc905640 1 -- start start 2023-11-27T20:43:25.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.277+0000 7fbddc905640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 0x7fbdd8151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.277+0000 7fbddc905640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdd8151640 0x7fbdd81eb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.277+0000 7fbddc905640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd81eb630 0x7fbdd8154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.277+0000 7fbddc905640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8156740 con 0x7fbdc4003970 2023-11-27T20:43:25.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.277+0000 7fbddc905640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd81543f0 con 0x7fbdd8151640 2023-11-27T20:43:25.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.277+0000 7fbddc905640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd81de590 con 0x7fbdd81eb630 2023-11-27T20:43:25.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.277+0000 7fbdd659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 0x7fbdd8151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.277+0000 7fbdd659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 0x7fbdd8151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46964/0 (socket says 172.21.15.91:46964) 2023-11-27T20:43:25.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.277+0000 7fbdd659c640 1 -- 172.21.15.91:0/631340665 learned_addr learned my addr 172.21.15.91:0/631340665 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:25.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdcdd9b640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdd8151640 0x7fbdd81eb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdd6d9d640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd81eb630 0x7fbdd8154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdd659c640 1 -- 172.21.15.91:0/631340665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd81eb630 msgr2=0x7fbdd8154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdd659c640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd81eb630 0x7fbdd8154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdd659c640 1 -- 172.21.15.91:0/631340665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdd8151640 msgr2=0x7fbdd81eb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdd659c640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdd8151640 0x7fbdd81eb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdd659c640 1 -- 172.21.15.91:0/631340665 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd81de870 con 0x7fbdc4003970 2023-11-27T20:43:25.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdd659c640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 0x7fbdd8151100 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbdc802c5c0 tx=0x7fbdc8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:25.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdcf7fe640 1 -- 172.21.15.91:0/631340665 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8034dd0 con 0x7fbdc4003970 2023-11-27T20:43:25.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdcf7fe640 1 -- 172.21.15.91:0/631340665 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8003990 con 0x7fbdc4003970 2023-11-27T20:43:25.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbddc905640 1 -- 172.21.15.91:0/631340665 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd81546b0 con 0x7fbdc4003970 2023-11-27T20:43:25.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.278+0000 7fbdcf7fe640 1 -- 172.21.15.91:0/631340665 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8003d00 con 0x7fbdc4003970 2023-11-27T20:43:25.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.279+0000 7fbddc905640 1 -- 172.21.15.91:0/631340665 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd81de220 con 0x7fbdc4003970 2023-11-27T20:43:25.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.280+0000 7fbddc905640 1 -- 172.21.15.91:0/631340665 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd8068350 con 0x7fbdc4003970 2023-11-27T20:43:25.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.280+0000 7fbdcf7fe640 1 -- 172.21.15.91:0/631340665 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbdc8004030 con 0x7fbdc4003970 2023-11-27T20:43:25.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.281+0000 7fbdcf7fe640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbdb806b1f0 0x7fbdb806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.281+0000 7fbdcf7fe640 1 -- 172.21.15.91:0/631340665 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fbdc80ac820 con 0x7fbdc4003970 2023-11-27T20:43:25.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.282+0000 7fbdcdd9b640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbdb806b1f0 0x7fbdb806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.282+0000 7fbdcdd9b640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbdb806b1f0 0x7fbdb806d6b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbdd81e89d0 tx=0x7fbdc0001430 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:25.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.286+0000 7fbdcf7fe640 1 -- 172.21.15.91:0/631340665 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbdc80771b0 con 0x7fbdc4003970 2023-11-27T20:43:25.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.479+0000 7fbddc905640 1 -- 172.21.15.91:0/631340665 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdd806d540 con 0x7fbdc4003970 2023-11-27T20:43:25.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.481+0000 7fbdcf7fe640 1 -- 172.21.15.91:0/631340665 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+20346 (secure 0 0 0) 0x7fbdc807a7d0 con 0x7fbdc4003970 2023-11-27T20:43:25.483 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:25.483 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":40,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:18.205644+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:25.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 -- 172.21.15.91:0/631340665 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbdb806b1f0 msgr2=0x7fbdb806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbdb806b1f0 0x7fbdb806d6b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbdd81e89d0 tx=0x7fbdc0001430 comp rx=0 tx=0).stop 2023-11-27T20:43:25.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 -- 172.21.15.91:0/631340665 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 msgr2=0x7fbdd8151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 0x7fbdd8151100 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbdc802c5c0 tx=0x7fbdc8009750 comp rx=0 tx=0).stop 2023-11-27T20:43:25.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 -- 172.21.15.91:0/631340665 shutdown_connections 2023-11-27T20:43:25.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbdd81eb630 0x7fbdd8154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbdb806b1f0 0x7fbdb806d6b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdd8151640 0x7fbdd81eb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 --2- 172.21.15.91:0/631340665 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbdc4003970 0x7fbdd8151100 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 -- 172.21.15.91:0/631340665 >> 172.21.15.91:0/631340665 conn(0x7fbdd806a500 msgr2=0x7fbdd806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:25.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 -- 172.21.15.91:0/631340665 shutdown_connections 2023-11-27T20:43:25.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.484+0000 7fbddc905640 1 -- 172.21.15.91:0/631340665 wait complete. 2023-11-27T20:43:25.504 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:42:35.743447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:42:36.976231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:42:56.585972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:42:58.003354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:43:25.504 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:43:25.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.713+0000 7f4a77fd0640 1 Processor -- start 2023-11-27T20:43:25.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.714+0000 7f4a77fd0640 1 -- start start 2023-11-27T20:43:25.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.715+0000 7f4a77fd0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4a70155fc0 0x7f4a70159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.715+0000 7f4a77fd0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4a700c1ca0 0x7f4a700c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.715+0000 7f4a77fd0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 0x7f4a700c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.715+0000 7f4a77fd0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7006dd60 con 0x7f4a700c1ca0 2023-11-27T20:43:25.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.715+0000 7f4a77fd0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a700c6580 con 0x7f4a70155fc0 2023-11-27T20:43:25.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.715+0000 7f4a77fd0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700c3670 con 0x7f4a70071e30 2023-11-27T20:43:25.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.715+0000 7f4a7556b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4a700c1ca0 0x7f4a700c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.715+0000 7f4a7556b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4a700c1ca0 0x7f4a700c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46978/0 (socket says 172.21.15.91:46978) 2023-11-27T20:43:25.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.715+0000 7f4a7556b640 1 -- 172.21.15.91:0/72556232 learned_addr learned my addr 172.21.15.91:0/72556232 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:25.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.716+0000 7f4a75d6c640 1 --2- 172.21.15.91:0/72556232 >> v2:172.21.15.183:3300/0 conn(0x7f4a70155fc0 0x7f4a70159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.716+0000 7f4a7556b640 1 -- 172.21.15.91:0/72556232 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 msgr2=0x7f4a700c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:25.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.716+0000 7f4a7656d640 1 --2- 172.21.15.91:0/72556232 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 0x7f4a700c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.716+0000 7f4a7556b640 1 --2- 172.21.15.91:0/72556232 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 0x7f4a700c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.716+0000 7f4a7556b640 1 -- 172.21.15.91:0/72556232 >> v2:172.21.15.183:3300/0 conn(0x7f4a70155fc0 msgr2=0x7f4a70159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:25.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.716+0000 7f4a7556b640 1 --2- 172.21.15.91:0/72556232 >> v2:172.21.15.183:3300/0 conn(0x7f4a70155fc0 0x7f4a70159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.716+0000 7f4a7556b640 1 -- 172.21.15.91:0/72556232 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7006d580 con 0x7f4a700c1ca0 2023-11-27T20:43:25.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.716+0000 7f4a75d6c640 1 --2- 172.21.15.91:0/72556232 >> v2:172.21.15.183:3300/0 conn(0x7f4a70155fc0 0x7f4a70159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:25.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.716+0000 7f4a7656d640 1 --2- 172.21.15.91:0/72556232 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 0x7f4a700c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:25.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.717+0000 7f4a7556b640 1 --2- 172.21.15.91:0/72556232 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 0x7f4a700c2750 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4a700c2720 tx=0x7f4a6c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a48da8840e51cb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:25.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a74d6a640 1 -- 172.21.15.91:0/72556232 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c031740 con 0x7f4a700c1ca0 2023-11-27T20:43:25.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a74d6a640 1 -- 172.21.15.91:0/72556232 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c0318a0 con 0x7f4a700c1ca0 2023-11-27T20:43:25.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a74d6a640 1 -- 172.21.15.91:0/72556232 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c031c30 con 0x7f4a700c1ca0 2023-11-27T20:43:25.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a77fd0640 1 -- 172.21.15.91:0/72556232 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 msgr2=0x7f4a700c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a77fd0640 1 --2- 172.21.15.91:0/72556232 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 0x7f4a700c2750 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4a700c2720 tx=0x7f4a6c02b7e0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a77fd0640 1 -- 172.21.15.91:0/72556232 shutdown_connections 2023-11-27T20:43:25.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a77fd0640 1 --2- 172.21.15.91:0/72556232 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 0x7f4a700c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a77fd0640 1 --2- 172.21.15.91:0/72556232 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 0x7f4a700c2750 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a77fd0640 1 --2- 172.21.15.91:0/72556232 >> v2:172.21.15.183:3300/0 conn(0x7f4a70155fc0 0x7f4a70159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a77fd0640 1 -- 172.21.15.91:0/72556232 >> 172.21.15.91:0/72556232 conn(0x7f4a7006a500 msgr2=0x7f4a7006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:25.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a77fd0640 1 -- 172.21.15.91:0/72556232 shutdown_connections 2023-11-27T20:43:25.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.718+0000 7f4a77fd0640 1 -- 172.21.15.91:0/72556232 wait complete. 2023-11-27T20:43:25.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.720+0000 7f4a77fd0640 1 Processor -- start 2023-11-27T20:43:25.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.720+0000 7f4a77fd0640 1 -- start start 2023-11-27T20:43:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.721+0000 7f4a77fd0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 0x7f4a70156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.721+0000 7f4a77fd0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 0x7f4a7015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.721+0000 7f4a77fd0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a70155fc0 0x7f4a701510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.721+0000 7f4a77fd0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7015c9d0 con 0x7f4a700c1ca0 2023-11-27T20:43:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.721+0000 7f4a77fd0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700a32c0 con 0x7f4a70155fc0 2023-11-27T20:43:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.721+0000 7f4a77fd0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700bb690 con 0x7f4a70071e30 2023-11-27T20:43:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.721+0000 7f4a7556b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 0x7f4a7015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.721+0000 7f4a7556b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 0x7f4a7015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46992/0 (socket says 172.21.15.91:46992) 2023-11-27T20:43:25.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.721+0000 7f4a7556b640 1 -- 172.21.15.91:0/1832203290 learned_addr learned my addr 172.21.15.91:0/1832203290 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a75d6c640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 0x7f4a70156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a7556b640 1 -- 172.21.15.91:0/1832203290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 msgr2=0x7f4a70156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a7556b640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 0x7f4a70156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a7656d640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a70155fc0 0x7f4a701510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a7556b640 1 -- 172.21.15.91:0/1832203290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a70155fc0 msgr2=0x7f4a701510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a7556b640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a70155fc0 0x7f4a701510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a7556b640 1 -- 172.21.15.91:0/1832203290 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c0094d0 con 0x7f4a700c1ca0 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a7556b640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 0x7f4a7015aa50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c000c00 tx=0x7f4a6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a667fc640 1 -- 172.21.15.91:0/1832203290 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c033d60 con 0x7f4a700c1ca0 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a667fc640 1 -- 172.21.15.91:0/1832203290 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c03c400 con 0x7f4a700c1ca0 2023-11-27T20:43:25.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a667fc640 1 -- 172.21.15.91:0/1832203290 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c03c7b0 con 0x7f4a700c1ca0 2023-11-27T20:43:25.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.722+0000 7f4a77fd0640 1 -- 172.21.15.91:0/1832203290 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a701eef70 con 0x7f4a700c1ca0 2023-11-27T20:43:25.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.723+0000 7f4a77fd0640 1 -- 172.21.15.91:0/1832203290 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a700a37f0 con 0x7f4a700c1ca0 2023-11-27T20:43:25.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.724+0000 7f4a77fd0640 1 -- 172.21.15.91:0/1832203290 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a70068350 con 0x7f4a700c1ca0 2023-11-27T20:43:25.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.724+0000 7f4a667fc640 1 -- 172.21.15.91:0/1832203290 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4a6c03a040 con 0x7f4a700c1ca0 2023-11-27T20:43:25.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.725+0000 7f4a667fc640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 0x7f4a5c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:25.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.725+0000 7f4a667fc640 1 -- 172.21.15.91:0/1832203290 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f4a6c0aba20 con 0x7f4a700c1ca0 2023-11-27T20:43:25.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.726+0000 7f4a75d6c640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 0x7f4a5c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:25.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.726+0000 7f4a75d6c640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 0x7f4a5c06d680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4a700a46a0 tx=0x7f4a60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:25.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.730+0000 7f4a667fc640 1 -- 172.21.15.91:0/1832203290 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4a6c0764d0 con 0x7f4a700c1ca0 2023-11-27T20:43:25.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.925+0000 7f4a77fd0640 1 -- 172.21.15.91:0/1832203290 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a7006d730 con 0x7f4a700c1ca0 2023-11-27T20:43:25.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.926+0000 7f4a667fc640 1 -- 172.21.15.91:0/1832203290 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a6c02f0a0 con 0x7f4a700c1ca0 2023-11-27T20:43:25.927 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:43:25.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.928+0000 7f4a77fd0640 1 -- 172.21.15.91:0/1832203290 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 msgr2=0x7f4a5c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.928+0000 7f4a77fd0640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 0x7f4a5c06d680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4a700a46a0 tx=0x7f4a60008040 comp rx=0 tx=0).stop 2023-11-27T20:43:25.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.928+0000 7f4a77fd0640 1 -- 172.21.15.91:0/1832203290 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 msgr2=0x7f4a7015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:25.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.928+0000 7f4a77fd0640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 0x7f4a7015aa50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c000c00 tx=0x7f4a6c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.929+0000 7f4a77fd0640 1 -- 172.21.15.91:0/1832203290 shutdown_connections 2023-11-27T20:43:25.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.929+0000 7f4a77fd0640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 0x7f4a5c06d680 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.929+0000 7f4a77fd0640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a70155fc0 0x7f4a701510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.929+0000 7f4a77fd0640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a700c1ca0 0x7f4a7015aa50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.929+0000 7f4a77fd0640 1 --2- 172.21.15.91:0/1832203290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a70071e30 0x7f4a70156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:25.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.929+0000 7f4a77fd0640 1 -- 172.21.15.91:0/1832203290 >> 172.21.15.91:0/1832203290 conn(0x7f4a7006a500 msgr2=0x7f4a700c0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:25.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.929+0000 7f4a77fd0640 1 -- 172.21.15.91:0/1832203290 shutdown_connections 2023-11-27T20:43:25.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:25.929+0000 7f4a77fd0640 1 -- 172.21.15.91:0/1832203290 wait complete. 2023-11-27T20:43:25.949 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:43:26.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.160+0000 7f545a125640 1 Processor -- start 2023-11-27T20:43:26.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.161+0000 7f545a125640 1 -- start start 2023-11-27T20:43:26.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.162+0000 7f545a125640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5454155fc0 0x7f5454159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.162+0000 7f545a125640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54540c2e60 0x7f5454163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.162+0000 7f545a125640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545406d580 con 0x7f54540c1ca0 2023-11-27T20:43:26.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.162+0000 7f545a125640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545406dd60 con 0x7f5454155fc0 2023-11-27T20:43:26.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.162+0000 7f545a125640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54540c6580 con 0x7f54540c2e60 2023-11-27T20:43:26.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.162+0000 7f54537fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5454155fc0 0x7f5454159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.162+0000 7f54537fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5454155fc0 0x7f5454159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47000/0 (socket says 172.21.15.91:47000) 2023-11-27T20:43:26.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.162+0000 7f54537fe640 1 -- 172.21.15.91:0/1624910219 learned_addr learned my addr 172.21.15.91:0/1624910219 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:26.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.163+0000 7f54537fe640 1 -- 172.21.15.91:0/1624910219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54540c2e60 msgr2=0x7f5454163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:26.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.163+0000 7f54537fe640 1 --2- 172.21.15.91:0/1624910219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54540c2e60 0x7f5454163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.163+0000 7f54537fe640 1 -- 172.21.15.91:0/1624910219 >> v1:172.21.15.91:6789/0 conn(0x7f54540c1ca0 legacy=0x7f54540c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.163+0000 7f54537fe640 1 -- 172.21.15.91:0/1624910219 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54540726d0 con 0x7f5454155fc0 2023-11-27T20:43:26.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.164+0000 7f54537fe640 1 --2- 172.21.15.91:0/1624910219 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5454155fc0 0x7f5454159470 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5444009e50 tx=0x7f544402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa01627bd9d4cf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:26.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.164+0000 7f54527fc640 1 -- 172.21.15.91:0/1624910219 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544402c9f0 con 0x7f5454155fc0 2023-11-27T20:43:26.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.164+0000 7f54527fc640 1 -- 172.21.15.91:0/1624910219 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544402cb50 con 0x7f5454155fc0 2023-11-27T20:43:26.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.164+0000 7f54527fc640 1 -- 172.21.15.91:0/1624910219 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54440343f0 con 0x7f5454155fc0 2023-11-27T20:43:26.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.165+0000 7f545a125640 1 -- 172.21.15.91:0/1624910219 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5454155fc0 msgr2=0x7f5454159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.165+0000 7f545a125640 1 --2- 172.21.15.91:0/1624910219 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5454155fc0 0x7f5454159470 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5444009e50 tx=0x7f544402be50 comp rx=0 tx=0).stop 2023-11-27T20:43:26.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.165+0000 7f545a125640 1 -- 172.21.15.91:0/1624910219 shutdown_connections 2023-11-27T20:43:26.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.165+0000 7f545a125640 1 --2- 172.21.15.91:0/1624910219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54540c2e60 0x7f5454163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.165+0000 7f545a125640 1 --2- 172.21.15.91:0/1624910219 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5454155fc0 0x7f5454159470 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.165+0000 7f545a125640 1 -- 172.21.15.91:0/1624910219 >> 172.21.15.91:0/1624910219 conn(0x7f545406a500 msgr2=0x7f545406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:26.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.165+0000 7f545a125640 1 -- 172.21.15.91:0/1624910219 shutdown_connections 2023-11-27T20:43:26.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.166+0000 7f545a125640 1 -- 172.21.15.91:0/1624910219 wait complete. 2023-11-27T20:43:26.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.167+0000 7f545a125640 1 Processor -- start 2023-11-27T20:43:26.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.167+0000 7f545a125640 1 -- start start 2023-11-27T20:43:26.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.168+0000 7f545a125640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54540c1ca0 0x7f54540a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.168+0000 7f545a125640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54540c2e60 0x7f545415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.168+0000 7f545a125640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5454155fc0 0x7f5454151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.168+0000 7f545a125640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54540a54f0 con 0x7f54540c2e60 2023-11-27T20:43:26.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.168+0000 7f545a125640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54540a2e00 con 0x7f54540c1ca0 2023-11-27T20:43:26.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.168+0000 7f545a125640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54540a30e0 con 0x7f5454155fc0 2023-11-27T20:43:26.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.168+0000 7f5452ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54540c2e60 0x7f545415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.168+0000 7f5452ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54540c2e60 0x7f545415c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47016/0 (socket says 172.21.15.91:47016) 2023-11-27T20:43:26.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.168+0000 7f5452ffd640 1 -- 172.21.15.91:0/545113952 learned_addr learned my addr 172.21.15.91:0/545113952 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:26.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f54537fe640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54540c1ca0 0x7f54540a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f5453fff640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5454155fc0 0x7f5454151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f5452ffd640 1 -- 172.21.15.91:0/545113952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5454155fc0 msgr2=0x7f5454151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f5452ffd640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5454155fc0 0x7f5454151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f5452ffd640 1 -- 172.21.15.91:0/545113952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54540c1ca0 msgr2=0x7f54540a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f5452ffd640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54540c1ca0 0x7f54540a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f5452ffd640 1 -- 172.21.15.91:0/545113952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5444009b30 con 0x7f54540c2e60 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f54537fe640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54540c1ca0 0x7f54540a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f5452ffd640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54540c2e60 0x7f545415c220 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f543c00c450 tx=0x7f543c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f544bfff640 1 -- 172.21.15.91:0/545113952 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c0052d0 con 0x7f54540c2e60 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f544bfff640 1 -- 172.21.15.91:0/545113952 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c005430 con 0x7f54540c2e60 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f544bfff640 1 -- 172.21.15.91:0/545113952 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c012870 con 0x7f54540c2e60 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.169+0000 7f545a125640 1 -- 172.21.15.91:0/545113952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54540a5180 con 0x7f54540c2e60 2023-11-27T20:43:26.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.170+0000 7f545a125640 1 -- 172.21.15.91:0/545113952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545415c760 con 0x7f54540c2e60 2023-11-27T20:43:26.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.171+0000 7f545a125640 1 -- 172.21.15.91:0/545113952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5454068350 con 0x7f54540c2e60 2023-11-27T20:43:26.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.172+0000 7f544bfff640 1 -- 172.21.15.91:0/545113952 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f543c0129d0 con 0x7f54540c2e60 2023-11-27T20:43:26.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.173+0000 7f544bfff640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f543406b1c0 0x7f543406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.173+0000 7f544bfff640 1 -- 172.21.15.91:0/545113952 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f543c0898e0 con 0x7f54540c2e60 2023-11-27T20:43:26.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.173+0000 7f54537fe640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f543406b1c0 0x7f543406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.174+0000 7f54537fe640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f543406b1c0 0x7f543406d680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5444035000 tx=0x7f5444030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:26.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.177+0000 7f544bfff640 1 -- 172.21.15.91:0/545113952 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f543c054280 con 0x7f54540c2e60 2023-11-27T20:43:26.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.366+0000 7f545a125640 1 -- 172.21.15.91:0/545113952 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5454159470 con 0x7f54540c2e60 2023-11-27T20:43:26.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.367+0000 7f544bfff640 1 -- 172.21.15.91:0/545113952 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f543c0578a0 con 0x7f54540c2e60 2023-11-27T20:43:26.369 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:43:26.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 -- 172.21.15.91:0/545113952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f543406b1c0 msgr2=0x7f543406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f543406b1c0 0x7f543406d680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5444035000 tx=0x7f5444030000 comp rx=0 tx=0).stop 2023-11-27T20:43:26.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 -- 172.21.15.91:0/545113952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54540c2e60 msgr2=0x7f545415c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54540c2e60 0x7f545415c220 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f543c00c450 tx=0x7f543c00c910 comp rx=0 tx=0).stop 2023-11-27T20:43:26.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 -- 172.21.15.91:0/545113952 shutdown_connections 2023-11-27T20:43:26.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5454155fc0 0x7f5454151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54540c2e60 0x7f545415c220 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f543406b1c0 0x7f543406d680 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 --2- 172.21.15.91:0/545113952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54540c1ca0 0x7f54540a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 -- 172.21.15.91:0/545113952 >> 172.21.15.91:0/545113952 conn(0x7f545406a500 msgr2=0x7f545406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:26.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 -- 172.21.15.91:0/545113952 shutdown_connections 2023-11-27T20:43:26.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.370+0000 7f545a125640 1 -- 172.21.15.91:0/545113952 wait complete. 2023-11-27T20:43:26.390 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:43:26.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.610+0000 7effd5d21640 1 Processor -- start 2023-11-27T20:43:26.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.611+0000 7effd5d21640 1 -- start start 2023-11-27T20:43:26.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.612+0000 7effd5d21640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd014c2e0 0x7effd00c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.612+0000 7effd5d21640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7effd00c0440 0x7effd0152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.612+0000 7effd5d21640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd0071e80 con 0x7effd0072310 2023-11-27T20:43:26.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.612+0000 7effd5d21640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd0071470 con 0x7effd00c0440 2023-11-27T20:43:26.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.612+0000 7effd5d21640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd014c6c0 con 0x7effd014c2e0 2023-11-27T20:43:26.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.613+0000 7effcffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7effd00c0440 0x7effd0152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.613+0000 7effd4d1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd014c2e0 0x7effd00c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.613+0000 7effd4d1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd014c2e0 0x7effd00c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:52124/0 (socket says 172.21.15.91:52124) 2023-11-27T20:43:26.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.613+0000 7effd4d1f640 1 -- 172.21.15.91:0/2448565431 learned_addr learned my addr 172.21.15.91:0/2448565431 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:26.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.614+0000 7effd4d1f640 1 -- 172.21.15.91:0/2448565431 >> v2:172.21.15.183:3300/0 conn(0x7effd00c0440 msgr2=0x7effd0152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:26.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.614+0000 7effd4d1f640 1 --2- 172.21.15.91:0/2448565431 >> v2:172.21.15.183:3300/0 conn(0x7effd00c0440 0x7effd0152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.614+0000 7effd4d1f640 1 -- 172.21.15.91:0/2448565431 >> v1:172.21.15.183:6789/0 conn(0x7effd0072310 legacy=0x7effd00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.614+0000 7effd4d1f640 1 -- 172.21.15.91:0/2448565431 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd0153180 con 0x7effd014c2e0 2023-11-27T20:43:26.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.614+0000 7effcffff640 1 --2- 172.21.15.91:0/2448565431 >> v2:172.21.15.183:3300/0 conn(0x7effd00c0440 0x7effd0152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:43:26.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.615+0000 7effd4d1f640 1 --2- 172.21.15.91:0/2448565431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd014c2e0 0x7effd00c0c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7effc4009870 tx=0x7effc402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebbae1b5c588e2e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:26.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.615+0000 7effcf7fe640 1 -- 172.21.15.91:0/2448565431 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc40317c0 con 0x7effd014c2e0 2023-11-27T20:43:26.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.615+0000 7effcf7fe640 1 -- 172.21.15.91:0/2448565431 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc4031920 con 0x7effd014c2e0 2023-11-27T20:43:26.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.615+0000 7effcf7fe640 1 -- 172.21.15.91:0/2448565431 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4031cb0 con 0x7effd014c2e0 2023-11-27T20:43:26.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.616+0000 7effd5d21640 1 -- 172.21.15.91:0/2448565431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd014c2e0 msgr2=0x7effd00c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.616+0000 7effd5d21640 1 --2- 172.21.15.91:0/2448565431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd014c2e0 0x7effd00c0c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7effc4009870 tx=0x7effc402b860 comp rx=0 tx=0).stop 2023-11-27T20:43:26.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.616+0000 7effd5d21640 1 -- 172.21.15.91:0/2448565431 shutdown_connections 2023-11-27T20:43:26.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.616+0000 7effd5d21640 1 --2- 172.21.15.91:0/2448565431 >> v2:172.21.15.183:3300/0 conn(0x7effd00c0440 0x7effd0152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.616+0000 7effd5d21640 1 --2- 172.21.15.91:0/2448565431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd014c2e0 0x7effd00c0c80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.616+0000 7effd5d21640 1 -- 172.21.15.91:0/2448565431 >> 172.21.15.91:0/2448565431 conn(0x7effd00a77f0 msgr2=0x7effd00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:26.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.616+0000 7effd5d21640 1 -- 172.21.15.91:0/2448565431 shutdown_connections 2023-11-27T20:43:26.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.616+0000 7effd5d21640 1 -- 172.21.15.91:0/2448565431 wait complete. 2023-11-27T20:43:26.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.618+0000 7effd5d21640 1 Processor -- start 2023-11-27T20:43:26.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.618+0000 7effd5d21640 1 -- start start 2023-11-27T20:43:26.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.619+0000 7effd5d21640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd0072310 0x7effd01eb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.619+0000 7effd5d21640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effd00c0440 0x7effd01dc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.619+0000 7effd5d21640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effd014c2e0 0x7effd00aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.619+0000 7effd5d21640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd00aa960 con 0x7effd00c0440 2023-11-27T20:43:26.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.619+0000 7effd5d21640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd01db9a0 con 0x7effd014c2e0 2023-11-27T20:43:26.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.619+0000 7effd5d21640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd01dbc80 con 0x7effd0072310 2023-11-27T20:43:26.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.619+0000 7effcffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effd00c0440 0x7effd01dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.619+0000 7effcffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effd00c0440 0x7effd01dc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47028/0 (socket says 172.21.15.91:47028) 2023-11-27T20:43:26.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.619+0000 7effcffff640 1 -- 172.21.15.91:0/1922351680 learned_addr learned my addr 172.21.15.91:0/1922351680 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:26.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effd5520640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effd014c2e0 0x7effd00aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effd4d1f640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd0072310 0x7effd01eb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effcffff640 1 -- 172.21.15.91:0/1922351680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd0072310 msgr2=0x7effd01eb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effcffff640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd0072310 0x7effd01eb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effcffff640 1 -- 172.21.15.91:0/1922351680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effd014c2e0 msgr2=0x7effd00aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effcffff640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effd014c2e0 0x7effd00aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effcffff640 1 -- 172.21.15.91:0/1922351680 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc009400 con 0x7effd00c0440 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effcffff640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effd00c0440 0x7effd01dc430 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7effbc00ebe0 tx=0x7effbc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effcd7fa640 1 -- 172.21.15.91:0/1922351680 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc009760 con 0x7effd00c0440 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effcd7fa640 1 -- 172.21.15.91:0/1922351680 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc00cc30 con 0x7effd00c0440 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.620+0000 7effcd7fa640 1 -- 172.21.15.91:0/1922351680 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00eee0 con 0x7effd00c0440 2023-11-27T20:43:26.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.621+0000 7effd5d21640 1 -- 172.21.15.91:0/1922351680 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc40094d0 con 0x7effd00c0440 2023-11-27T20:43:26.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.621+0000 7effd5d21640 1 -- 172.21.15.91:0/1922351680 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd01dc970 con 0x7effd00c0440 2023-11-27T20:43:26.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.622+0000 7effd5d21640 1 -- 172.21.15.91:0/1922351680 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd00aab10 con 0x7effd00c0440 2023-11-27T20:43:26.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.623+0000 7effcd7fa640 1 -- 172.21.15.91:0/1922351680 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7effbc013470 con 0x7effd00c0440 2023-11-27T20:43:26.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.624+0000 7effcd7fa640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7effb406b1c0 0x7effb406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:26.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.624+0000 7effcd7fa640 1 -- 172.21.15.91:0/1922351680 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7effbc08a070 con 0x7effd00c0440 2023-11-27T20:43:26.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.624+0000 7effd4d1f640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7effb406b1c0 0x7effb406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:26.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.625+0000 7effd4d1f640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7effb406b1c0 0x7effb406d680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7effc4036000 tx=0x7effc403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:26.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.628+0000 7effcd7fa640 1 -- 172.21.15.91:0/1922351680 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7effbc0bce90 con 0x7effd00c0440 2023-11-27T20:43:26.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.820+0000 7effd5d21640 1 -- 172.21.15.91:0/1922351680 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effd0067d50 con 0x7effd00c0440 2023-11-27T20:43:26.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.821+0000 7effcd7fa640 1 -- 172.21.15.91:0/1922351680 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7effbc0170a0 con 0x7effd00c0440 2023-11-27T20:43:26.822 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:43:26.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 -- 172.21.15.91:0/1922351680 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7effb406b1c0 msgr2=0x7effb406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7effb406b1c0 0x7effb406d680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7effc4036000 tx=0x7effc403d040 comp rx=0 tx=0).stop 2023-11-27T20:43:26.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 -- 172.21.15.91:0/1922351680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effd00c0440 msgr2=0x7effd01dc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:26.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effd00c0440 0x7effd01dc430 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7effbc00ebe0 tx=0x7effbc00c520 comp rx=0 tx=0).stop 2023-11-27T20:43:26.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 -- 172.21.15.91:0/1922351680 shutdown_connections 2023-11-27T20:43:26.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7effb406b1c0 0x7effb406d680 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effd014c2e0 0x7effd00aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effd00c0440 0x7effd01dc430 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 --2- 172.21.15.91:0/1922351680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effd0072310 0x7effd01eb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:26.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 -- 172.21.15.91:0/1922351680 >> 172.21.15.91:0/1922351680 conn(0x7effd00a77f0 msgr2=0x7effd014a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:26.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 -- 172.21.15.91:0/1922351680 shutdown_connections 2023-11-27T20:43:26.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:26.824+0000 7effd5d21640 1 -- 172.21.15.91:0/1922351680 wait complete. 2023-11-27T20:43:26.844 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:43:27.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.060+0000 7fe43f590640 1 Processor -- start 2023-11-27T20:43:27.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.061+0000 7fe43f590640 1 -- start start 2023-11-27T20:43:27.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.062+0000 7fe43f590640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe43806d0a0 0x7fe438152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.062+0000 7fe43f590640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4380c64a0 con 0x7fe4380c3ea0 2023-11-27T20:43:27.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.062+0000 7fe43f590640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4380c5c00 con 0x7fe43814fd30 2023-11-27T20:43:27.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.062+0000 7fe43f590640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4380c5ee0 con 0x7fe43806d0a0 2023-11-27T20:43:27.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.062+0000 7fe43cb2b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe43806d0a0 0x7fe438152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.062+0000 7fe43cb2b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe43806d0a0 0x7fe438152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47040/0 (socket says 172.21.15.91:47040) 2023-11-27T20:43:27.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.062+0000 7fe43cb2b640 1 -- 172.21.15.91:0/3502433265 learned_addr learned my addr 172.21.15.91:0/3502433265 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:27.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.063+0000 7fe43cb2b640 1 -- 172.21.15.91:0/3502433265 >> v1:172.21.15.183:6789/0 conn(0x7fe43814fd30 legacy=0x7fe4380a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:27.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.063+0000 7fe43cb2b640 1 -- 172.21.15.91:0/3502433265 >> v1:172.21.15.91:6789/0 conn(0x7fe4380c3ea0 legacy=0x7fe4380c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.063+0000 7fe43cb2b640 1 -- 172.21.15.91:0/3502433265 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4380c61c0 con 0x7fe43806d0a0 2023-11-27T20:43:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.064+0000 7fe43cb2b640 1 --2- 172.21.15.91:0/3502433265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe43806d0a0 0x7fe438152f20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009870 tx=0x7fe42c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2b41495aecf020 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.064+0000 7fe437fff640 1 -- 172.21.15.91:0/3502433265 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c030860 con 0x7fe43806d0a0 2023-11-27T20:43:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.064+0000 7fe437fff640 1 -- 172.21.15.91:0/3502433265 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c0309c0 con 0x7fe43806d0a0 2023-11-27T20:43:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.064+0000 7fe437fff640 1 -- 172.21.15.91:0/3502433265 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c030d50 con 0x7fe43806d0a0 2023-11-27T20:43:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.065+0000 7fe43f590640 1 -- 172.21.15.91:0/3502433265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe43806d0a0 msgr2=0x7fe438152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.065+0000 7fe43f590640 1 --2- 172.21.15.91:0/3502433265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe43806d0a0 0x7fe438152f20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009870 tx=0x7fe42c02b9a0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.065+0000 7fe43f590640 1 -- 172.21.15.91:0/3502433265 shutdown_connections 2023-11-27T20:43:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.065+0000 7fe43f590640 1 --2- 172.21.15.91:0/3502433265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe43806d0a0 0x7fe438152f20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.065+0000 7fe43f590640 1 -- 172.21.15.91:0/3502433265 >> 172.21.15.91:0/3502433265 conn(0x7fe43806a500 msgr2=0x7fe43806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.065+0000 7fe43f590640 1 -- 172.21.15.91:0/3502433265 shutdown_connections 2023-11-27T20:43:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.065+0000 7fe43f590640 1 -- 172.21.15.91:0/3502433265 wait complete. 2023-11-27T20:43:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.067+0000 7fe43f590640 1 Processor -- start 2023-11-27T20:43:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.067+0000 7fe43f590640 1 -- start start 2023-11-27T20:43:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43f590640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe43806d0a0 0x7fe438155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43f590640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380c3ea0 0x7fe4380c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43f590640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe43814fd30 0x7fe4381548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43f590640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4381eb140 con 0x7fe4380c3ea0 2023-11-27T20:43:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43f590640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4381eb670 con 0x7fe43814fd30 2023-11-27T20:43:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43f590640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43814d0e0 con 0x7fe43806d0a0 2023-11-27T20:43:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43cb2b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380c3ea0 0x7fe4380c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43cb2b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380c3ea0 0x7fe4380c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47052/0 (socket says 172.21.15.91:47052) 2023-11-27T20:43:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43cb2b640 1 -- 172.21.15.91:0/2337434350 learned_addr learned my addr 172.21.15.91:0/2337434350 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:27.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43cb2b640 1 -- 172.21.15.91:0/2337434350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe43806d0a0 msgr2=0x7fe438155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43cb2b640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe43806d0a0 0x7fe438155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43cb2b640 1 -- 172.21.15.91:0/2337434350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe43814fd30 msgr2=0x7fe4381548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.068+0000 7fe43cb2b640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe43814fd30 0x7fe4381548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.069+0000 7fe43cb2b640 1 -- 172.21.15.91:0/2337434350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0094d0 con 0x7fe4380c3ea0 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.069+0000 7fe43cb2b640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380c3ea0 0x7fe4380c1710 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe42c02b9e0 tx=0x7fe42c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.069+0000 7fe435ffb640 1 -- 172.21.15.91:0/2337434350 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c030830 con 0x7fe4380c3ea0 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.069+0000 7fe435ffb640 1 -- 172.21.15.91:0/2337434350 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c039d90 con 0x7fe4380c3ea0 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.069+0000 7fe435ffb640 1 -- 172.21.15.91:0/2337434350 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c043670 con 0x7fe4380c3ea0 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.069+0000 7fe43f590640 1 -- 172.21.15.91:0/2337434350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4380a51a0 con 0x7fe4380c3ea0 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.069+0000 7fe43f590640 1 -- 172.21.15.91:0/2337434350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4380bfc80 con 0x7fe4380c3ea0 2023-11-27T20:43:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.070+0000 7fe43f590640 1 -- 172.21.15.91:0/2337434350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe438068350 con 0x7fe4380c3ea0 2023-11-27T20:43:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.071+0000 7fe435ffb640 1 -- 172.21.15.91:0/2337434350 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe42c02f3b0 con 0x7fe4380c3ea0 2023-11-27T20:43:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.072+0000 7fe435ffb640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe42406b1c0 0x7fe42406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.072+0000 7fe435ffb640 1 -- 172.21.15.91:0/2337434350 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fe42c0ac120 con 0x7fe4380c3ea0 2023-11-27T20:43:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.072+0000 7fe43d32c640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe42406b1c0 0x7fe42406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.073+0000 7fe43d32c640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe42406b1c0 0x7fe42406d680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe4280043c0 tx=0x7fe428007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:27.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.076+0000 7fe435ffb640 1 -- 172.21.15.91:0/2337434350 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe42c076b50 con 0x7fe4380c3ea0 2023-11-27T20:43:27.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.265+0000 7fe43f590640 1 -- 172.21.15.91:0/2337434350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe43814d880 con 0x7fe4380c3ea0 2023-11-27T20:43:27.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.266+0000 7fe435ffb640 1 -- 172.21.15.91:0/2337434350 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v40) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe42c07a170 con 0x7fe4380c3ea0 2023-11-27T20:43:27.297 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:43:27.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 -- 172.21.15.91:0/2337434350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe42406b1c0 msgr2=0x7fe42406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe42406b1c0 0x7fe42406d680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe4280043c0 tx=0x7fe428007d30 comp rx=0 tx=0).stop 2023-11-27T20:43:27.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 -- 172.21.15.91:0/2337434350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380c3ea0 msgr2=0x7fe4380c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380c3ea0 0x7fe4380c1710 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe42c02b9e0 tx=0x7fe42c004730 comp rx=0 tx=0).stop 2023-11-27T20:43:27.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 -- 172.21.15.91:0/2337434350 shutdown_connections 2023-11-27T20:43:27.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe42406b1c0 0x7fe42406d680 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe43814fd30 0x7fe4381548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380c3ea0 0x7fe4380c1710 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 --2- 172.21.15.91:0/2337434350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe43806d0a0 0x7fe438155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 -- 172.21.15.91:0/2337434350 >> 172.21.15.91:0/2337434350 conn(0x7fe43806a500 msgr2=0x7fe438152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:27.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 -- 172.21.15.91:0/2337434350 shutdown_connections 2023-11-27T20:43:27.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.269+0000 7fe43f590640 1 -- 172.21.15.91:0/2337434350 wait complete. 2023-11-27T20:43:27.299 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:43:27.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.507+0000 7f3511b75640 1 Processor -- start 2023-11-27T20:43:27.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.508+0000 7f3511b75640 1 -- start start 2023-11-27T20:43:27.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.509+0000 7f3511b75640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f350c0c52e0 0x7f350c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.509+0000 7f3511b75640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f350c06cd20 0x7f350c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.509+0000 7f3511b75640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c0a8380 con 0x7f350c14e7f0 2023-11-27T20:43:27.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.509+0000 7f3511b75640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c1510b0 con 0x7f350c0c52e0 2023-11-27T20:43:27.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.509+0000 7f3511b75640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c06bf60 con 0x7f350c06cd20 2023-11-27T20:43:27.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.509+0000 7f350bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f350c0c52e0 0x7f350c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.509+0000 7f3510b73640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f350c14e7f0 0x7f350c0c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45190/0 (socket says 172.21.15.91:45190) 2023-11-27T20:43:27.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.509+0000 7f3510b73640 1 -- 172.21.15.91:0/61815768 learned_addr learned my addr 172.21.15.91:0/61815768 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:27.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.510+0000 7f3511374640 1 --2- 172.21.15.91:0/61815768 >> v2:172.21.15.183:3300/0 conn(0x7f350c06cd20 0x7f350c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.510+0000 7f350bfff640 1 -- 172.21.15.91:0/61815768 >> v2:172.21.15.183:3300/0 conn(0x7f350c06cd20 msgr2=0x7f350c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:27.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.510+0000 7f350b7fe640 1 -- 172.21.15.91:0/61815768 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536391887 0 0) 0x7f350c0a8380 con 0x7f350c14e7f0 2023-11-27T20:43:27.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.510+0000 7f350bfff640 1 --2- 172.21.15.91:0/61815768 >> v2:172.21.15.183:3300/0 conn(0x7f350c06cd20 0x7f350c15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.510+0000 7f350bfff640 1 -- 172.21.15.91:0/61815768 >> v1:172.21.15.91:6789/0 conn(0x7f350c14e7f0 legacy=0x7f350c0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.510+0000 7f350bfff640 1 -- 172.21.15.91:0/61815768 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c06c240 con 0x7f350c0c52e0 2023-11-27T20:43:27.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.510+0000 7f3511374640 1 --2- 172.21.15.91:0/61815768 >> v2:172.21.15.183:3300/0 conn(0x7f350c06cd20 0x7f350c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:27.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.511+0000 7f350bfff640 1 --2- 172.21.15.91:0/61815768 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c0c52e0 0x7f350c06d1e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f350c0c1f50 tx=0x7f34fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfaacb7c0d82fd68 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:27.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.511+0000 7f350b7fe640 1 -- 172.21.15.91:0/61815768 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc02e070 con 0x7f350c0c52e0 2023-11-27T20:43:27.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.511+0000 7f350b7fe640 1 -- 172.21.15.91:0/61815768 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc0315a0 con 0x7f350c0c52e0 2023-11-27T20:43:27.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.511+0000 7f350b7fe640 1 -- 172.21.15.91:0/61815768 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc031930 con 0x7f350c0c52e0 2023-11-27T20:43:27.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.512+0000 7f3511b75640 1 -- 172.21.15.91:0/61815768 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c0c52e0 msgr2=0x7f350c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.512+0000 7f3511b75640 1 --2- 172.21.15.91:0/61815768 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c0c52e0 0x7f350c06d1e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f350c0c1f50 tx=0x7f34fc02b840 comp rx=0 tx=0).stop 2023-11-27T20:43:27.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.512+0000 7f3511b75640 1 -- 172.21.15.91:0/61815768 shutdown_connections 2023-11-27T20:43:27.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.512+0000 7f3511b75640 1 --2- 172.21.15.91:0/61815768 >> v2:172.21.15.183:3300/0 conn(0x7f350c06cd20 0x7f350c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.512+0000 7f3511b75640 1 --2- 172.21.15.91:0/61815768 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c0c52e0 0x7f350c06d1e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.512+0000 7f3511b75640 1 -- 172.21.15.91:0/61815768 >> 172.21.15.91:0/61815768 conn(0x7f350c0a77f0 msgr2=0x7f350c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:27.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.512+0000 7f3511b75640 1 -- 172.21.15.91:0/61815768 shutdown_connections 2023-11-27T20:43:27.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.512+0000 7f3511b75640 1 -- 172.21.15.91:0/61815768 wait complete. 2023-11-27T20:43:27.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.514+0000 7f3511b75640 1 Processor -- start 2023-11-27T20:43:27.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.514+0000 7f3511b75640 1 -- start start 2023-11-27T20:43:27.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.515+0000 7f3511b75640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f350c06cd20 0x7f350c1ded90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.515+0000 7f3511b75640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f350c0c52e0 0x7f350c14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.515+0000 7f3511b75640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c14e7f0 0x7f350c14ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.515+0000 7f3511b75640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c1ed550 con 0x7f350c14e7f0 2023-11-27T20:43:27.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.515+0000 7f3511b75640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c154490 con 0x7f350c06cd20 2023-11-27T20:43:27.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.515+0000 7f3511b75640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c1ed7f0 con 0x7f350c0c52e0 2023-11-27T20:43:27.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.515+0000 7f3511374640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c14e7f0 0x7f350c14ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.515+0000 7f3511374640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c14e7f0 0x7f350c14ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47078/0 (socket says 172.21.15.91:47078) 2023-11-27T20:43:27.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.515+0000 7f3511374640 1 -- 172.21.15.91:0/1541676181 learned_addr learned my addr 172.21.15.91:0/1541676181 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.515+0000 7f3510b73640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f350c06cd20 0x7f350c1ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f350bfff640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f350c0c52e0 0x7f350c14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f3511374640 1 -- 172.21.15.91:0/1541676181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f350c0c52e0 msgr2=0x7f350c14c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f3511374640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f350c0c52e0 0x7f350c14c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f3511374640 1 -- 172.21.15.91:0/1541676181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f350c06cd20 msgr2=0x7f350c1ded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f3511374640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f350c06cd20 0x7f350c1ded90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f3511374640 1 -- 172.21.15.91:0/1541676181 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc009400 con 0x7f350c14e7f0 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f3510b73640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f350c06cd20 0x7f350c1ded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f3511374640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c14e7f0 0x7f350c14ced0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f350400cef0 tx=0x7f350400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f35097fa640 1 -- 172.21.15.91:0/1541676181 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350400d840 con 0x7f350c14e7f0 2023-11-27T20:43:27.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f35097fa640 1 -- 172.21.15.91:0/1541676181 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350400d9c0 con 0x7f350c14e7f0 2023-11-27T20:43:27.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f35097fa640 1 -- 172.21.15.91:0/1541676181 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350400dd70 con 0x7f350c14e7f0 2023-11-27T20:43:27.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f3511b75640 1 -- 172.21.15.91:0/1541676181 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c1edad0 con 0x7f350c14e7f0 2023-11-27T20:43:27.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.516+0000 7f3511b75640 1 -- 172.21.15.91:0/1541676181 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c1df2d0 con 0x7f350c14e7f0 2023-11-27T20:43:27.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.518+0000 7f3511b75640 1 -- 172.21.15.91:0/1541676181 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c1edff0 con 0x7f350c14e7f0 2023-11-27T20:43:27.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.518+0000 7f35097fa640 1 -- 172.21.15.91:0/1541676181 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f350401e3b0 con 0x7f350c14e7f0 2023-11-27T20:43:27.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.519+0000 7f35097fa640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f34f806b1c0 0x7f34f806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.519+0000 7f35097fa640 1 -- 172.21.15.91:0/1541676181 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f350408a9c0 con 0x7f350c14e7f0 2023-11-27T20:43:27.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.520+0000 7f3510b73640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f34f806b1c0 0x7f34f806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.520+0000 7f3510b73640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f34f806b1c0 0x7f34f806d680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3500000f60 tx=0x7f3500009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:27.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.523+0000 7f35097fa640 1 -- 172.21.15.91:0/1541676181 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f350c1edff0 con 0x7f350c14e7f0 2023-11-27T20:43:27.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.715+0000 7f3511b75640 1 -- 172.21.15.91:0/1541676181 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f350c1edff0 con 0x7f350c14e7f0 2023-11-27T20:43:27.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.715+0000 7f35097fa640 1 -- 172.21.15.91:0/1541676181 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v40) v1 ==== 101+0+11 (secure 0 0 0) 0x7f350c1edff0 con 0x7f350c14e7f0 2023-11-27T20:43:27.717 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:43:27.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 -- 172.21.15.91:0/1541676181 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f34f806b1c0 msgr2=0x7f34f806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f34f806b1c0 0x7f34f806d680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3500000f60 tx=0x7f3500009040 comp rx=0 tx=0).stop 2023-11-27T20:43:27.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 -- 172.21.15.91:0/1541676181 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c14e7f0 msgr2=0x7f350c14ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c14e7f0 0x7f350c14ced0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f350400cef0 tx=0x7f350400a710 comp rx=0 tx=0).stop 2023-11-27T20:43:27.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 -- 172.21.15.91:0/1541676181 shutdown_connections 2023-11-27T20:43:27.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f350c14e7f0 0x7f350c14ced0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f350c0c52e0 0x7f350c14c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f34f806b1c0 0x7f34f806d680 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 --2- 172.21.15.91:0/1541676181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f350c06cd20 0x7f350c1ded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 -- 172.21.15.91:0/1541676181 >> 172.21.15.91:0/1541676181 conn(0x7f350c0a77f0 msgr2=0x7f350c0c41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:27.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 -- 172.21.15.91:0/1541676181 shutdown_connections 2023-11-27T20:43:27.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.718+0000 7f3511b75640 1 -- 172.21.15.91:0/1541676181 wait complete. 2023-11-27T20:43:27.738 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:27.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.943+0000 7f6bea643640 1 Processor -- start 2023-11-27T20:43:27.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.943+0000 7f6bea643640 1 -- start start 2023-11-27T20:43:27.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.944+0000 7f6bea643640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6be414fd30 0x7f6be4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.944+0000 7f6bea643640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be40c64a0 con 0x7f6be40c3ea0 2023-11-27T20:43:27.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.944+0000 7f6bea643640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be40c5c00 con 0x7f6be406d0a0 2023-11-27T20:43:27.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.944+0000 7f6bea643640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be40c5ee0 con 0x7f6be414fd30 2023-11-27T20:43:27.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.944+0000 7f6be8be0640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f6be40c3ea0 0x7f6be40c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45198/0 (socket says 172.21.15.91:45198) 2023-11-27T20:43:27.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.944+0000 7f6be8be0640 1 -- 172.21.15.91:0/2015664978 learned_addr learned my addr 172.21.15.91:0/2015664978 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:27.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be3fff640 1 --2- 172.21.15.91:0/2015664978 >> v2:172.21.15.183:3300/0 conn(0x7f6be414fd30 0x7f6be4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610200080 0 0) 0x7f6be40c64a0 con 0x7f6be40c3ea0 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd0003520 con 0x7f6be40c3ea0 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3029194759 0 0) 0x7f6bd0003520 con 0x7f6be40c3ea0 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 >> v2:172.21.15.183:3300/0 conn(0x7f6be414fd30 msgr2=0x7f6be4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 --2- 172.21.15.91:0/2015664978 >> v2:172.21.15.183:3300/0 conn(0x7f6be414fd30 0x7f6be4152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 >> v1:172.21.15.183:6789/0 conn(0x7f6be406d0a0 legacy=0x7f6be40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be40c61c0 con 0x7f6be40c3ea0 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f6bdc0019f0 con 0x7f6be40c3ea0 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 >> v1:172.21.15.91:6789/0 conn(0x7f6be40c3ea0 legacy=0x7f6be40c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 --2- 172.21.15.91:0/2015664978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd0003970 0x7f6bd0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 --2- 172.21.15.91:0/2015664978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6bd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 --2- 172.21.15.91:0/2015664978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bd0005180 0x7f6bd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.945+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40c5ee0 con 0x7f6bd00047c0 2023-11-27T20:43:27.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.946+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd000c000 con 0x7f6bd0003970 2023-11-27T20:43:27.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.946+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd000c1c0 con 0x7f6bd0005180 2023-11-27T20:43:27.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.946+0000 7f6be37fe640 1 --2- 172.21.15.91:0/2015664978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6bd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.946+0000 7f6be3fff640 1 --2- 172.21.15.91:0/2015664978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd0003970 0x7f6bd0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.946+0000 7f6be37fe640 1 -- 172.21.15.91:0/2015664978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bd0005180 msgr2=0x7f6bd000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:27.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.946+0000 7f6be37fe640 1 --2- 172.21.15.91:0/2015664978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bd0005180 0x7f6bd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.946+0000 7f6be37fe640 1 -- 172.21.15.91:0/2015664978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd0003970 msgr2=0x7f6bd0003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:27.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.946+0000 7f6be37fe640 1 --2- 172.21.15.91:0/2015664978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd0003970 0x7f6bd0003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.946+0000 7f6be37fe640 1 -- 172.21.15.91:0/2015664978 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0003520 con 0x7f6bd00047c0 2023-11-27T20:43:27.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.946+0000 7f6be8be0640 1 -- 172.21.15.91:0/2015664978 reap_dead start 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.947+0000 7f6be37fe640 1 --2- 172.21.15.91:0/2015664978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6bd0004c40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc003d80 tx=0x7f6bd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5ade7e6622d2b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.948+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc032600 con 0x7f6bd00047c0 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.948+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc02e050 con 0x7f6bd00047c0 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.948+0000 7f6be2ffd640 1 -- 172.21.15.91:0/2015664978 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc0329e0 con 0x7f6bd00047c0 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.948+0000 7f6bea643640 1 -- 172.21.15.91:0/2015664978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 msgr2=0x7f6bd0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.948+0000 7f6bea643640 1 --2- 172.21.15.91:0/2015664978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6bd0004c40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc003d80 tx=0x7f6bd00057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.948+0000 7f6bea643640 1 -- 172.21.15.91:0/2015664978 shutdown_connections 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.948+0000 7f6bea643640 1 --2- 172.21.15.91:0/2015664978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6bd0004c40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.948+0000 7f6bea643640 1 -- 172.21.15.91:0/2015664978 >> 172.21.15.91:0/2015664978 conn(0x7f6be406a500 msgr2=0x7f6be406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.948+0000 7f6bea643640 1 -- 172.21.15.91:0/2015664978 shutdown_connections 2023-11-27T20:43:27.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.948+0000 7f6bea643640 1 -- 172.21.15.91:0/2015664978 wait complete. 2023-11-27T20:43:27.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.950+0000 7f6bea643640 1 Processor -- start 2023-11-27T20:43:27.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.950+0000 7f6bea643640 1 -- start start 2023-11-27T20:43:27.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.951+0000 7f6bea643640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6be41ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.951+0000 7f6bea643640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6be41dbad0 0x7f6be41512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.951+0000 7f6bea643640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be4151820 0x7f6be41e9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.951+0000 7f6bea643640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be4154700 con 0x7f6bd00047c0 2023-11-27T20:43:27.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.951+0000 7f6bea643640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be41dbfd0 con 0x7f6be4151820 2023-11-27T20:43:27.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.951+0000 7f6bea643640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be4153f40 con 0x7f6be41dbad0 2023-11-27T20:43:27.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.951+0000 7f6be3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6be41ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.951+0000 7f6be3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6be41ed610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47096/0 (socket says 172.21.15.91:47096) 2023-11-27T20:43:27.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.951+0000 7f6be3fff640 1 -- 172.21.15.91:0/678745226 learned_addr learned my addr 172.21.15.91:0/678745226 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:27.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be37fe640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6be41dbad0 0x7f6be41512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be3fff640 1 -- 172.21.15.91:0/678745226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6be41dbad0 msgr2=0x7f6be41512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be8be0640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be4151820 0x7f6be41e9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be3fff640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6be41dbad0 0x7f6be41512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be3fff640 1 -- 172.21.15.91:0/678745226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be4151820 msgr2=0x7f6be41e9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:27.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be3fff640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be4151820 0x7f6be41e9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:27.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be3fff640 1 -- 172.21.15.91:0/678745226 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be41edf30 con 0x7f6bd00047c0 2023-11-27T20:43:27.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be37fe640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6be41dbad0 0x7f6be41512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:27.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be3fff640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6be41ed610 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4011700 tx=0x7f6bd4011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:27.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be0ff9640 1 -- 172.21.15.91:0/678745226 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400f960 con 0x7f6bd00047c0 2023-11-27T20:43:27.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be0ff9640 1 -- 172.21.15.91:0/678745226 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd400fac0 con 0x7f6bd00047c0 2023-11-27T20:43:27.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6bea643640 1 -- 172.21.15.91:0/678745226 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be41541e0 con 0x7f6bd00047c0 2023-11-27T20:43:27.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.952+0000 7f6be0ff9640 1 -- 172.21.15.91:0/678745226 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400fe30 con 0x7f6bd00047c0 2023-11-27T20:43:27.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.953+0000 7f6bea643640 1 -- 172.21.15.91:0/678745226 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be41528d0 con 0x7f6bd00047c0 2023-11-27T20:43:27.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.954+0000 7f6bea643640 1 -- 172.21.15.91:0/678745226 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be4068350 con 0x7f6bd00047c0 2023-11-27T20:43:27.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.955+0000 7f6be0ff9640 1 -- 172.21.15.91:0/678745226 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6bd4015460 con 0x7f6bd00047c0 2023-11-27T20:43:27.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.956+0000 7f6be0ff9640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6bc406b1f0 0x7f6bc406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:27.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.956+0000 7f6be0ff9640 1 -- 172.21.15.91:0/678745226 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f6bd408a5c0 con 0x7f6bd00047c0 2023-11-27T20:43:27.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.956+0000 7f6be37fe640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6bc406b1f0 0x7f6bc406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:27.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.956+0000 7f6be37fe640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6bc406b1f0 0x7f6bc406d6b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc034000 tx=0x7f6bcc009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:27.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:27.960+0000 7f6be0ff9640 1 -- 172.21.15.91:0/678745226 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6bd4054ff0 con 0x7f6bd00047c0 2023-11-27T20:43:28.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.189+0000 7f6bea643640 1 -- 172.21.15.91:0/678745226 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6be40c66d0 con 0x7f6bd00047c0 2023-11-27T20:43:28.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.191+0000 7f6be0ff9640 1 -- 172.21.15.91:0/678745226 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f6bd4058610 con 0x7f6bd00047c0 2023-11-27T20:43:28.192 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:28.192 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:37.962718+0000","modified":"2023-11-27T20:42:41.040049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.183:6834/3450105603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3450105603},{"type":"v1","addr":"172.21.15.183:6834","nonce":3450105603}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:58.980635+0000","modified":"2023-11-27T20:43:02.065929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":10,"addr":"172.21.15.91:6837/127433365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":127433365},{"type":"v1","addr":"172.21.15.91:6837","nonce":127433365}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-27T20:43:28.193 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 20 2023-11-27T20:43:28.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.193+0000 7f6bea643640 1 -- 172.21.15.91:0/678745226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6bc406b1f0 msgr2=0x7f6bc406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.193+0000 7f6bea643640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6bc406b1f0 0x7f6bc406d6b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc034000 tx=0x7f6bcc009030 comp rx=0 tx=0).stop 2023-11-27T20:43:28.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.193+0000 7f6bea643640 1 -- 172.21.15.91:0/678745226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 msgr2=0x7f6be41ed610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.193+0000 7f6bea643640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6be41ed610 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4011700 tx=0x7f6bd4011bc0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.193+0000 7f6bea643640 1 -- 172.21.15.91:0/678745226 shutdown_connections 2023-11-27T20:43:28.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.193+0000 7f6bea643640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6bc406b1f0 0x7f6bc406d6b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.194+0000 7f6bea643640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6be4151820 0x7f6be41e9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.194+0000 7f6bea643640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6be41dbad0 0x7f6be41512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.194+0000 7f6bea643640 1 --2- 172.21.15.91:0/678745226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bd00047c0 0x7f6be41ed610 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.194+0000 7f6bea643640 1 -- 172.21.15.91:0/678745226 >> 172.21.15.91:0/678745226 conn(0x7f6be406a500 msgr2=0x7f6be40c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:28.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.194+0000 7f6bea643640 1 -- 172.21.15.91:0/678745226 shutdown_connections 2023-11-27T20:43:28.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.194+0000 7f6bea643640 1 -- 172.21.15.91:0/678745226 wait complete. 2023-11-27T20:43:28.212 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:28.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.419+0000 7fe770fb6640 1 Processor -- start 2023-11-27T20:43:28.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.419+0000 7fe770fb6640 1 -- start start 2023-11-27T20:43:28.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.420+0000 7fe770fb6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe76c151cc0 0x7fe76c155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.420+0000 7fe770fb6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c1556d0 con 0x7fe76c0c4940 2023-11-27T20:43:28.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.420+0000 7fe770fb6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c154740 con 0x7fe76c0c7ec0 2023-11-27T20:43:28.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.420+0000 7fe770fb6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c06c760 con 0x7fe76c151cc0 2023-11-27T20:43:28.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.420+0000 7fe76ad9d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fe76c0c4940 0x7fe76c15f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45212/0 (socket says 172.21.15.91:45212) 2023-11-27T20:43:28.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.420+0000 7fe76ad9d640 1 -- 172.21.15.91:0/720490247 learned_addr learned my addr 172.21.15.91:0/720490247 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:28.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe76a59c640 1 --2- 172.21.15.91:0/720490247 >> v2:172.21.15.183:3300/0 conn(0x7fe76c151cc0 0x7fe76c155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978778564 0 0) 0x7fe764001490 con 0x7fe76c0c4940 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe758003520 con 0x7fe76c0c4940 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1512458679 0 0) 0x7fe758003520 con 0x7fe76c0c4940 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 >> v2:172.21.15.183:3300/0 conn(0x7fe76c151cc0 msgr2=0x7fe76c155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 --2- 172.21.15.91:0/720490247 >> v2:172.21.15.183:3300/0 conn(0x7fe76c151cc0 0x7fe76c155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 >> v1:172.21.15.183:6789/0 conn(0x7fe76c0c7ec0 legacy=0x7fe76c157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c0c8470 con 0x7fe76c0c4940 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fe764001b80 con 0x7fe76c0c4940 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 >> v1:172.21.15.91:6789/0 conn(0x7fe76c0c4940 legacy=0x7fe76c15f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe758003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7580047c0 0x7fe758004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe758005180 0x7fe75800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c06c760 con 0x7fe758003970 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75800c020 con 0x7fe758005180 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75800c1e0 con 0x7fe7580047c0 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.421+0000 7fe76a59c640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe758003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.422+0000 7fe76a59c640 1 -- 172.21.15.91:0/720490247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7580047c0 msgr2=0x7fe758004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.422+0000 7fe763fff640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7580047c0 0x7fe758004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.422+0000 7fe76ad9d640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe758005180 0x7fe75800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.422+0000 7fe76a59c640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7580047c0 0x7fe758004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.422+0000 7fe76a59c640 1 -- 172.21.15.91:0/720490247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe758005180 msgr2=0x7fe75800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.422+0000 7fe76a59c640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe758005180 0x7fe75800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.422+0000 7fe76a59c640 1 -- 172.21.15.91:0/720490247 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe758003520 con 0x7fe758003970 2023-11-27T20:43:28.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.422+0000 7fe76ad9d640 1 -- 172.21.15.91:0/720490247 reap_dead start 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.423+0000 7fe76a59c640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe758003d90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009ac0 tx=0x7fe7580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3ebfd2864fff39 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.423+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c02c6b0 con 0x7fe758003970 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.423+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c02c810 con 0x7fe758003970 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.423+0000 7fe769d9b640 1 -- 172.21.15.91:0/720490247 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c02cba0 con 0x7fe758003970 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.424+0000 7fe770fb6640 1 -- 172.21.15.91:0/720490247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 msgr2=0x7fe758003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.424+0000 7fe770fb6640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe758003d90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009ac0 tx=0x7fe7580057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.424+0000 7fe770fb6640 1 -- 172.21.15.91:0/720490247 shutdown_connections 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.424+0000 7fe770fb6640 1 --2- 172.21.15.91:0/720490247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe758003d90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.424+0000 7fe770fb6640 1 -- 172.21.15.91:0/720490247 >> 172.21.15.91:0/720490247 conn(0x7fe76c071e10 msgr2=0x7fe76c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.424+0000 7fe770fb6640 1 -- 172.21.15.91:0/720490247 shutdown_connections 2023-11-27T20:43:28.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.424+0000 7fe770fb6640 1 -- 172.21.15.91:0/720490247 wait complete. 2023-11-27T20:43:28.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.425+0000 7fe770fb6640 1 Processor -- start 2023-11-27T20:43:28.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.425+0000 7fe770fb6640 1 -- start start 2023-11-27T20:43:28.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.426+0000 7fe770fb6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe76c14b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.426+0000 7fe770fb6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe76c151240 0x7fe76c145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.426+0000 7fe770fb6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe76c145650 0x7fe76c146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.426+0000 7fe770fb6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c145ad0 con 0x7fe758003970 2023-11-27T20:43:28.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.426+0000 7fe770fb6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c1469c0 con 0x7fe76c145650 2023-11-27T20:43:28.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.426+0000 7fe770fb6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c1ea720 con 0x7fe76c151240 2023-11-27T20:43:28.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.427+0000 7fe76a59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe76c14b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.427+0000 7fe76a59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe76c14b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47108/0 (socket says 172.21.15.91:47108) 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.427+0000 7fe76a59c640 1 -- 172.21.15.91:0/1431858029 learned_addr learned my addr 172.21.15.91:0/1431858029 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.427+0000 7fe76a59c640 1 -- 172.21.15.91:0/1431858029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe76c151240 msgr2=0x7fe76c145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.427+0000 7fe76a59c640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe76c151240 0x7fe76c145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.427+0000 7fe76a59c640 1 -- 172.21.15.91:0/1431858029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe76c145650 msgr2=0x7fe76c146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.427+0000 7fe76a59c640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe76c145650 0x7fe76c146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.427+0000 7fe76a59c640 1 -- 172.21.15.91:0/1431858029 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c149160 con 0x7fe758003970 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.427+0000 7fe76a59c640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe76c14b000 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe75c02c250 tx=0x7fe75c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.428+0000 7fe762ffd640 1 -- 172.21.15.91:0/1431858029 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c003810 con 0x7fe758003970 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.428+0000 7fe762ffd640 1 -- 172.21.15.91:0/1431858029 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c003970 con 0x7fe758003970 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.428+0000 7fe762ffd640 1 -- 172.21.15.91:0/1431858029 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c003d00 con 0x7fe758003970 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.428+0000 7fe770fb6640 1 -- 172.21.15.91:0/1431858029 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c1edd70 con 0x7fe758003970 2023-11-27T20:43:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.428+0000 7fe770fb6640 1 -- 172.21.15.91:0/1431858029 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c1ee330 con 0x7fe758003970 2023-11-27T20:43:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.429+0000 7fe770fb6640 1 -- 172.21.15.91:0/1431858029 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76c067d50 con 0x7fe758003970 2023-11-27T20:43:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.430+0000 7fe762ffd640 1 -- 172.21.15.91:0/1431858029 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe75c047450 con 0x7fe758003970 2023-11-27T20:43:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.431+0000 7fe762ffd640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe74c06b1f0 0x7fe74c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.431+0000 7fe762ffd640 1 -- 172.21.15.91:0/1431858029 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fe75c0ac010 con 0x7fe758003970 2023-11-27T20:43:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.431+0000 7fe763fff640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe74c06b1f0 0x7fe74c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.432+0000 7fe763fff640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe74c06b1f0 0x7fe74c06d6b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe754000c00 tx=0x7fe754009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:28.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.435+0000 7fe762ffd640 1 -- 172.21.15.91:0/1431858029 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe75c076a60 con 0x7fe758003970 2023-11-27T20:43:28.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.616+0000 7fe770fb6640 1 -- 172.21.15.91:0/1431858029 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe76c068350 con 0x7fe758003970 2023-11-27T20:43:28.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.619+0000 7fe762ffd640 1 -- 172.21.15.91:0/1431858029 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+20346 (secure 0 0 0) 0x7fe75c003e60 con 0x7fe758003970 2023-11-27T20:43:28.620 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:28.620 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":40,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:18.205644+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:28.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.621+0000 7fe770fb6640 1 -- 172.21.15.91:0/1431858029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe74c06b1f0 msgr2=0x7fe74c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.621+0000 7fe770fb6640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe74c06b1f0 0x7fe74c06d6b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe754000c00 tx=0x7fe754009040 comp rx=0 tx=0).stop 2023-11-27T20:43:28.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.621+0000 7fe770fb6640 1 -- 172.21.15.91:0/1431858029 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 msgr2=0x7fe76c14b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.621+0000 7fe770fb6640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe76c14b000 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe75c02c250 tx=0x7fe75c004730 comp rx=0 tx=0).stop 2023-11-27T20:43:28.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.622+0000 7fe770fb6640 1 -- 172.21.15.91:0/1431858029 shutdown_connections 2023-11-27T20:43:28.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.622+0000 7fe770fb6640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe74c06b1f0 0x7fe74c06d6b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.622+0000 7fe770fb6640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe76c145650 0x7fe76c146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.622+0000 7fe770fb6640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe76c151240 0x7fe76c145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.622+0000 7fe770fb6640 1 --2- 172.21.15.91:0/1431858029 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe758003970 0x7fe76c14b000 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.622+0000 7fe770fb6640 1 -- 172.21.15.91:0/1431858029 >> 172.21.15.91:0/1431858029 conn(0x7fe76c071e10 msgr2=0x7fe76c0c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:28.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.622+0000 7fe770fb6640 1 -- 172.21.15.91:0/1431858029 shutdown_connections 2023-11-27T20:43:28.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.622+0000 7fe770fb6640 1 -- 172.21.15.91:0/1431858029 wait complete. 2023-11-27T20:43:28.642 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-27T20:43:28.642 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:28.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.838+0000 7f686513c640 1 Processor -- start 2023-11-27T20:43:28.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.838+0000 7f686513c640 1 -- start start 2023-11-27T20:43:28.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.839+0000 7f686513c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f68600ca450 0x7f68600ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.839+0000 7f686513c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 0x7f6860154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.839+0000 7f686513c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6860158a60 con 0x7f686014e7c0 2023-11-27T20:43:28.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.840+0000 7f686513c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68600c5b10 con 0x7f68600ca450 2023-11-27T20:43:28.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.840+0000 7f686513c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68600c4dd0 con 0x7f6860154580 2023-11-27T20:43:28.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.840+0000 7f686493b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 0x7f6860154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.840+0000 7f6857fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f68600ca450 0x7f68600ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.840+0000 7f686493b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 0x7f6860154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:52206/0 (socket says 172.21.15.91:52206) 2023-11-27T20:43:28.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.840+0000 7f686493b640 1 -- 172.21.15.91:0/3476416510 learned_addr learned my addr 172.21.15.91:0/3476416510 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:28.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.841+0000 7f686493b640 1 -- 172.21.15.91:0/3476416510 >> v2:172.21.15.183:3300/0 conn(0x7f68600ca450 msgr2=0x7f68600ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:28.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.841+0000 7f686493b640 1 --2- 172.21.15.91:0/3476416510 >> v2:172.21.15.183:3300/0 conn(0x7f68600ca450 0x7f68600ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.841+0000 7f686493b640 1 -- 172.21.15.91:0/3476416510 >> v1:172.21.15.183:6789/0 conn(0x7f686014e7c0 legacy=0x7f68600c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.841+0000 7f686493b640 1 -- 172.21.15.91:0/3476416510 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860157ca0 con 0x7f6860154580 2023-11-27T20:43:28.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.841+0000 7f6857fff640 1 --2- 172.21.15.91:0/3476416510 >> v2:172.21.15.183:3300/0 conn(0x7f68600ca450 0x7f68600ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:43:28.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.843+0000 7f686493b640 1 --2- 172.21.15.91:0/3476416510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 0x7f6860154a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6858009e50 tx=0x7f685802be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fed19232e66e193 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:28.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.843+0000 7f685f7fe640 1 -- 172.21.15.91:0/3476416510 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685802c9f0 con 0x7f6860154580 2023-11-27T20:43:28.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.843+0000 7f685f7fe640 1 -- 172.21.15.91:0/3476416510 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685802cb50 con 0x7f6860154580 2023-11-27T20:43:28.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.843+0000 7f685f7fe640 1 -- 172.21.15.91:0/3476416510 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580343f0 con 0x7f6860154580 2023-11-27T20:43:28.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.844+0000 7f686513c640 1 -- 172.21.15.91:0/3476416510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 msgr2=0x7f6860154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.844+0000 7f686513c640 1 --2- 172.21.15.91:0/3476416510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 0x7f6860154a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6858009e50 tx=0x7f685802be50 comp rx=0 tx=0).stop 2023-11-27T20:43:28.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.844+0000 7f686513c640 1 -- 172.21.15.91:0/3476416510 shutdown_connections 2023-11-27T20:43:28.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.844+0000 7f686513c640 1 --2- 172.21.15.91:0/3476416510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 0x7f6860154a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.844+0000 7f686513c640 1 --2- 172.21.15.91:0/3476416510 >> v2:172.21.15.183:3300/0 conn(0x7f68600ca450 0x7f68600ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.844+0000 7f686513c640 1 -- 172.21.15.91:0/3476416510 >> 172.21.15.91:0/3476416510 conn(0x7f68600abf00 msgr2=0x7f68600c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:28.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.844+0000 7f686513c640 1 -- 172.21.15.91:0/3476416510 shutdown_connections 2023-11-27T20:43:28.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.844+0000 7f686513c640 1 -- 172.21.15.91:0/3476416510 wait complete. 2023-11-27T20:43:28.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.845+0000 7f686513c640 1 Processor -- start 2023-11-27T20:43:28.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.845+0000 7f686513c640 1 -- start start 2023-11-27T20:43:28.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.846+0000 7f686513c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68600ca450 0x7f68600c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.846+0000 7f686513c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f686014e7c0 0x7f68600c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.846+0000 7f686513c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 0x7f68601536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.846+0000 7f686513c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68600ab540 con 0x7f68600ca450 2023-11-27T20:43:28.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.846+0000 7f686513c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68600c2090 con 0x7f686014e7c0 2023-11-27T20:43:28.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.846+0000 7f686513c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686014bda0 con 0x7f6860154580 2023-11-27T20:43:28.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.846+0000 7f685ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68600ca450 0x7f68600c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f685ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68600ca450 0x7f68600c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47116/0 (socket says 172.21.15.91:47116) 2023-11-27T20:43:28.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f685ffff640 1 -- 172.21.15.91:0/2138218992 learned_addr learned my addr 172.21.15.91:0/2138218992 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:28.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f6857fff640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f686014e7c0 0x7f68600c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f685ffff640 1 -- 172.21.15.91:0/2138218992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 msgr2=0x7f68601536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f685ffff640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 0x7f68601536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f685ffff640 1 -- 172.21.15.91:0/2138218992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f686014e7c0 msgr2=0x7f68600c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:28.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f685ffff640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f686014e7c0 0x7f68600c1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:28.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f685ffff640 1 -- 172.21.15.91:0/2138218992 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6848009400 con 0x7f68600ca450 2023-11-27T20:43:28.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f685ffff640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68600ca450 0x7f68600c0e10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f685000c340 tx=0x7f685000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:28.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f685d7fa640 1 -- 172.21.15.91:0/2138218992 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500052d0 con 0x7f68600ca450 2023-11-27T20:43:28.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.847+0000 7f685d7fa640 1 -- 172.21.15.91:0/2138218992 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6850005450 con 0x7f68600ca450 2023-11-27T20:43:28.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.848+0000 7f686513c640 1 -- 172.21.15.91:0/2138218992 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6858009b30 con 0x7f68600ca450 2023-11-27T20:43:28.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.848+0000 7f685d7fa640 1 -- 172.21.15.91:0/2138218992 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850007260 con 0x7f68600ca450 2023-11-27T20:43:28.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.848+0000 7f686513c640 1 -- 172.21.15.91:0/2138218992 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686014b9c0 con 0x7f68600ca450 2023-11-27T20:43:28.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.849+0000 7f686513c640 1 -- 172.21.15.91:0/2138218992 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686004e840 con 0x7f68600ca450 2023-11-27T20:43:28.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.849+0000 7f685d7fa640 1 -- 172.21.15.91:0/2138218992 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f68500073c0 con 0x7f68600ca450 2023-11-27T20:43:28.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.850+0000 7f685d7fa640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f684006b1c0 0x7f684006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:28.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.850+0000 7f685d7fa640 1 -- 172.21.15.91:0/2138218992 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f6850088fe0 con 0x7f68600ca450 2023-11-27T20:43:28.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.851+0000 7f6857fff640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f684006b1c0 0x7f684006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:28.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.851+0000 7f6857fff640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f684006b1c0 0x7f684006d680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6860154550 tx=0x7f6848008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:28.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:28.855+0000 7f685d7fa640 1 -- 172.21.15.91:0/2138218992 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6850053a10 con 0x7f68600ca450 2023-11-27T20:43:29.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.064+0000 7f686513c640 1 -- 172.21.15.91:0/2138218992 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68600c7c40 con 0x7f68600ca450 2023-11-27T20:43:29.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.065+0000 7f685d7fa640 1 -- 172.21.15.91:0/2138218992 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f6850057030 con 0x7f68600ca450 2023-11-27T20:43:29.066 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:29.067 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:37.962718+0000","modified":"2023-11-27T20:42:41.040049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.183:6834/3450105603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3450105603},{"type":"v1","addr":"172.21.15.183:6834","nonce":3450105603}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:58.980635+0000","modified":"2023-11-27T20:43:02.065929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":10,"addr":"172.21.15.91:6837/127433365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":127433365},{"type":"v1","addr":"172.21.15.91:6837","nonce":127433365}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-27T20:43:29.067 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 20 2023-11-27T20:43:29.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.067+0000 7f686513c640 1 -- 172.21.15.91:0/2138218992 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f684006b1c0 msgr2=0x7f684006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.067+0000 7f686513c640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f684006b1c0 0x7f684006d680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6860154550 tx=0x7f6848008040 comp rx=0 tx=0).stop 2023-11-27T20:43:29.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.067+0000 7f686513c640 1 -- 172.21.15.91:0/2138218992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68600ca450 msgr2=0x7f68600c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.067+0000 7f686513c640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68600ca450 0x7f68600c0e10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f685000c340 tx=0x7f685000c800 comp rx=0 tx=0).stop 2023-11-27T20:43:29.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.068+0000 7f686513c640 1 -- 172.21.15.91:0/2138218992 shutdown_connections 2023-11-27T20:43:29.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.068+0000 7f686513c640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6860154580 0x7f68601536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.068+0000 7f686513c640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f684006b1c0 0x7f684006d680 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.068+0000 7f686513c640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f686014e7c0 0x7f68600c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.068+0000 7f686513c640 1 --2- 172.21.15.91:0/2138218992 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68600ca450 0x7f68600c0e10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.068+0000 7f686513c640 1 -- 172.21.15.91:0/2138218992 >> 172.21.15.91:0/2138218992 conn(0x7f68600abf00 msgr2=0x7f6860154990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:29.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.068+0000 7f686513c640 1 -- 172.21.15.91:0/2138218992 shutdown_connections 2023-11-27T20:43:29.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.068+0000 7f686513c640 1 -- 172.21.15.91:0/2138218992 wait complete. 2023-11-27T20:43:29.087 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:29.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.284+0000 7fd3cb59e640 1 Processor -- start 2023-11-27T20:43:29.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.284+0000 7fd3cb59e640 1 -- start start 2023-11-27T20:43:29.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.285+0000 7fd3cb59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3cc0a4d20 0x7fd3cc0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.285+0000 7fd3cb59e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd3cc154430 0x7fd3cc154890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.285+0000 7fd3cb59e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc157ad0 con 0x7fd3cc0c0440 2023-11-27T20:43:29.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.285+0000 7fd3cb59e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc158890 con 0x7fd3cc154430 2023-11-27T20:43:29.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.285+0000 7fd3cb59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc157db0 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.286+0000 7fd3c9d9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd3cc154430 0x7fd3cc154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:29.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.286+0000 7fd3c9d9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd3cc154430 0x7fd3cc154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47118/0 (socket says 172.21.15.91:47118) 2023-11-27T20:43:29.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.286+0000 7fd3c9d9b640 1 -- 172.21.15.91:0/3603388912 learned_addr learned my addr 172.21.15.91:0/3603388912 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:29.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.286+0000 7fd3ca59c640 1 --2- 172.21.15.91:0/3603388912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3cc0a4d20 0x7fd3cc0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:29.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.286+0000 7fd3c9d9b640 1 -- 172.21.15.91:0/3603388912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3cc0a4d20 msgr2=0x7fd3cc0a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:29.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.286+0000 7fd3c9d9b640 1 --2- 172.21.15.91:0/3603388912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3cc0a4d20 0x7fd3cc0a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.286+0000 7fd3c9d9b640 1 -- 172.21.15.91:0/3603388912 >> v1:172.21.15.183:6789/0 conn(0x7fd3cc0c0440 legacy=0x7fd3cc0c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:29.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.286+0000 7fd3c9d9b640 1 -- 172.21.15.91:0/3603388912 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc158090 con 0x7fd3cc154430 2023-11-27T20:43:29.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.287+0000 7fd3c9d9b640 1 --2- 172.21.15.91:0/3603388912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc154430 0x7fd3cc154890 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009e50 tx=0x7fd3c002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83b19795f2249f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:29.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3c959a640 1 -- 172.21.15.91:0/3603388912 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c002c9e0 con 0x7fd3cc154430 2023-11-27T20:43:29.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3c959a640 1 -- 172.21.15.91:0/3603388912 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c002cb40 con 0x7fd3cc154430 2023-11-27T20:43:29.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3c959a640 1 -- 172.21.15.91:0/3603388912 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00343f0 con 0x7fd3cc154430 2023-11-27T20:43:29.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3603388912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc154430 msgr2=0x7fd3cc154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3cb59e640 1 --2- 172.21.15.91:0/3603388912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc154430 0x7fd3cc154890 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009e50 tx=0x7fd3c002be40 comp rx=0 tx=0).stop 2023-11-27T20:43:29.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3603388912 shutdown_connections 2023-11-27T20:43:29.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3cb59e640 1 --2- 172.21.15.91:0/3603388912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc154430 0x7fd3cc154890 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3cb59e640 1 --2- 172.21.15.91:0/3603388912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3cc0a4d20 0x7fd3cc0a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3603388912 >> 172.21.15.91:0/3603388912 conn(0x7fd3cc0a77f0 msgr2=0x7fd3cc0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:29.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3603388912 shutdown_connections 2023-11-27T20:43:29.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.288+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3603388912 wait complete. 2023-11-27T20:43:29.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.290+0000 7fd3cb59e640 1 Processor -- start 2023-11-27T20:43:29.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.290+0000 7fd3cb59e640 1 -- start start 2023-11-27T20:43:29.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.291+0000 7fd3cb59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc0a4d20 0x7fd3cc1ed210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.291+0000 7fd3cb59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3cc0c0440 0x7fd3cc0a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.291+0000 7fd3cb59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3cc154430 0x7fd3cc0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.291+0000 7fd3cb59e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0ab9e0 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.291+0000 7fd3cb59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc070f10 con 0x7fd3cc0c0440 2023-11-27T20:43:29.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.291+0000 7fd3cb59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1edd00 con 0x7fd3cc154430 2023-11-27T20:43:29.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.291+0000 7fd3ca59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc0a4d20 0x7fd3cc1ed210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:29.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.291+0000 7fd3ca59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc0a4d20 0x7fd3cc1ed210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47134/0 (socket says 172.21.15.91:47134) 2023-11-27T20:43:29.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.291+0000 7fd3ca59c640 1 -- 172.21.15.91:0/3390778477 learned_addr learned my addr 172.21.15.91:0/3390778477 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:29.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.292+0000 7fd3cad9d640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3cc154430 0x7fd3cc0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:29.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.292+0000 7fd3c9d9b640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3cc0c0440 0x7fd3cc0a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:29.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.292+0000 7fd3ca59c640 1 -- 172.21.15.91:0/3390778477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3cc154430 msgr2=0x7fd3cc0a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.292+0000 7fd3ca59c640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3cc154430 0x7fd3cc0a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.292+0000 7fd3ca59c640 1 -- 172.21.15.91:0/3390778477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3cc0c0440 msgr2=0x7fd3cc0a8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.292+0000 7fd3ca59c640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3cc0c0440 0x7fd3cc0a8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.292+0000 7fd3ca59c640 1 -- 172.21.15.91:0/3390778477 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009b30 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.292+0000 7fd3c9d9b640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3cc0c0440 0x7fd3cc0a8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:29.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.292+0000 7fd3ca59c640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc0a4d20 0x7fd3cc1ed210 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00d800 tx=0x7fd3bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:29.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.292+0000 7fd3baffd640 1 -- 172.21.15.91:0/3390778477 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00b6c0 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.293+0000 7fd3baffd640 1 -- 172.21.15.91:0/3390778477 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00b820 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.293+0000 7fd3baffd640 1 -- 172.21.15.91:0/3390778477 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00bbb0 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.293+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3390778477 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc071120 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.293+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3390778477 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc0716e0 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.294+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3390778477 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc071870 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.295+0000 7fd3baffd640 1 -- 172.21.15.91:0/3390778477 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd3bc00bd10 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.296+0000 7fd3baffd640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3ac06b1c0 0x7fd3ac06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.296+0000 7fd3baffd640 1 -- 172.21.15.91:0/3390778477 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fd3bc08a390 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.296+0000 7fd3c9d9b640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3ac06b1c0 0x7fd3ac06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:29.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.297+0000 7fd3c9d9b640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3ac06b1c0 0x7fd3ac06d680 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0035000 tx=0x7fd3c0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:29.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.301+0000 7fd3baffd640 1 -- 172.21.15.91:0/3390778477 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd3bc054cd0 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.527+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3390778477 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3cc04e840 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.528+0000 7fd3baffd640 1 -- 172.21.15.91:0/3390778477 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6134 (secure 0 0 0) 0x7fd3bc0582f0 con 0x7fd3cc0a4d20 2023-11-27T20:43:29.530 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:29.530 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:37.962718+0000","modified":"2023-11-27T20:42:41.040049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.183:6834/3450105603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3450105603},{"type":"v1","addr":"172.21.15.183:6834","nonce":3450105603}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:58.980635+0000","modified":"2023-11-27T20:43:02.065929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":10,"addr":"172.21.15.91:6837/127433365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":127433365},{"type":"v1","addr":"172.21.15.91:6837","nonce":127433365}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-27T20:43:29.530 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 20 2023-11-27T20:43:29.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.530+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3390778477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3ac06b1c0 msgr2=0x7fd3ac06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.530+0000 7fd3cb59e640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3ac06b1c0 0x7fd3ac06d680 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0035000 tx=0x7fd3c0030000 comp rx=0 tx=0).stop 2023-11-27T20:43:29.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.530+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3390778477 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc0a4d20 msgr2=0x7fd3cc1ed210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.530+0000 7fd3cb59e640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc0a4d20 0x7fd3cc1ed210 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00d800 tx=0x7fd3bc00dcc0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.531+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3390778477 shutdown_connections 2023-11-27T20:43:29.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.531+0000 7fd3cb59e640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3cc154430 0x7fd3cc0a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.531+0000 7fd3cb59e640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd3ac06b1c0 0x7fd3ac06d680 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.531+0000 7fd3cb59e640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3cc0c0440 0x7fd3cc0a8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.531+0000 7fd3cb59e640 1 --2- 172.21.15.91:0/3390778477 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3cc0a4d20 0x7fd3cc1ed210 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.531+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3390778477 >> 172.21.15.91:0/3390778477 conn(0x7fd3cc0a77f0 msgr2=0x7fd3cc154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:29.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.531+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3390778477 shutdown_connections 2023-11-27T20:43:29.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.531+0000 7fd3cb59e640 1 -- 172.21.15.91:0/3390778477 wait complete. 2023-11-27T20:43:29.550 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:29.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.754+0000 7f22f7328640 1 Processor -- start 2023-11-27T20:43:29.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.754+0000 7f22f7328640 1 -- start start 2023-11-27T20:43:29.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.756+0000 7f22f7328640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f22f014e7c0 0x7f22f00c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.756+0000 7f22f7328640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f22f0154580 0x7f22f01549b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.756+0000 7f22f7328640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f0158a60 con 0x7f22f00c4c00 2023-11-27T20:43:29.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.756+0000 7f22f7328640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f00c5b10 con 0x7f22f0154580 2023-11-27T20:43:29.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.756+0000 7f22f7328640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f0157ca0 con 0x7f22f014e7c0 2023-11-27T20:43:29.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.756+0000 7f22f6b27640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f22f0154580 0x7f22f01549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:29.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.756+0000 7f22f6b27640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f22f0154580 0x7f22f01549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47136/0 (socket says 172.21.15.91:47136) 2023-11-27T20:43:29.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.756+0000 7f22f6b27640 1 -- 172.21.15.91:0/1636407890 learned_addr learned my addr 172.21.15.91:0/1636407890 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:29.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.756+0000 7f22f6326640 1 --2- 172.21.15.91:0/1636407890 >> v2:172.21.15.183:3300/0 conn(0x7f22f014e7c0 0x7f22f00c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:29.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.757+0000 7f22f6b27640 1 -- 172.21.15.91:0/1636407890 >> v2:172.21.15.183:3300/0 conn(0x7f22f014e7c0 msgr2=0x7f22f00c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:29.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.757+0000 7f22f6b27640 1 --2- 172.21.15.91:0/1636407890 >> v2:172.21.15.183:3300/0 conn(0x7f22f014e7c0 0x7f22f00c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.757+0000 7f22f6b27640 1 -- 172.21.15.91:0/1636407890 >> v1:172.21.15.183:6789/0 conn(0x7f22f00c4c00 legacy=0x7f22f00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:29.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.757+0000 7f22f6b27640 1 -- 172.21.15.91:0/1636407890 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0157f80 con 0x7f22f0154580 2023-11-27T20:43:29.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.758+0000 7f22f6b27640 1 --2- 172.21.15.91:0/1636407890 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f0154580 0x7f22f01549b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f22f008b7c0 tx=0x7f22e802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5507c47a0dca9715 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:29.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.758+0000 7f22f5324640 1 -- 172.21.15.91:0/1636407890 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e802c960 con 0x7f22f0154580 2023-11-27T20:43:29.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.758+0000 7f22f5324640 1 -- 172.21.15.91:0/1636407890 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e802cac0 con 0x7f22f0154580 2023-11-27T20:43:29.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.758+0000 7f22f5324640 1 -- 172.21.15.91:0/1636407890 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e802ce50 con 0x7f22f0154580 2023-11-27T20:43:29.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.759+0000 7f22f7328640 1 -- 172.21.15.91:0/1636407890 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f0154580 msgr2=0x7f22f01549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.759+0000 7f22f7328640 1 --2- 172.21.15.91:0/1636407890 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f0154580 0x7f22f01549b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f22f008b7c0 tx=0x7f22e802bdc0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.759+0000 7f22f7328640 1 -- 172.21.15.91:0/1636407890 shutdown_connections 2023-11-27T20:43:29.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.759+0000 7f22f7328640 1 --2- 172.21.15.91:0/1636407890 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f0154580 0x7f22f01549b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.759+0000 7f22f7328640 1 --2- 172.21.15.91:0/1636407890 >> v2:172.21.15.183:3300/0 conn(0x7f22f014e7c0 0x7f22f00c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.759+0000 7f22f7328640 1 -- 172.21.15.91:0/1636407890 >> 172.21.15.91:0/1636407890 conn(0x7f22f00abf00 msgr2=0x7f22f00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:29.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.759+0000 7f22f7328640 1 -- 172.21.15.91:0/1636407890 shutdown_connections 2023-11-27T20:43:29.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.759+0000 7f22f7328640 1 -- 172.21.15.91:0/1636407890 wait complete. 2023-11-27T20:43:29.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.761+0000 7f22f7328640 1 Processor -- start 2023-11-27T20:43:29.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.761+0000 7f22f7328640 1 -- start start 2023-11-27T20:43:29.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.762+0000 7f22f7328640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f00c4c00 0x7f22f01ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.762+0000 7f22f7328640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f014e7c0 0x7f22f01eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f7328640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f0154580 0x7f22f014b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f7328640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01edfc0 con 0x7f22f00c4c00 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f7328640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f00c36f0 con 0x7f22f0154580 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f7328640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01ea260 con 0x7f22f014e7c0 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f6326640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f00c4c00 0x7f22f01ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f6326640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f00c4c00 0x7f22f01ea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47148/0 (socket says 172.21.15.91:47148) 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f6326640 1 -- 172.21.15.91:0/3600701382 learned_addr learned my addr 172.21.15.91:0/3600701382 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f6326640 1 -- 172.21.15.91:0/3600701382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f014e7c0 msgr2=0x7f22f01eda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f6326640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f014e7c0 0x7f22f01eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f6326640 1 -- 172.21.15.91:0/3600701382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f0154580 msgr2=0x7f22f014b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f6326640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f0154580 0x7f22f014b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f6326640 1 -- 172.21.15.91:0/3600701382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8009b30 con 0x7f22f00c4c00 2023-11-27T20:43:29.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.763+0000 7f22f6326640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f00c4c00 0x7f22f01ea6f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00d620 tx=0x7f22ec00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:29.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.764+0000 7f22e6ffd640 1 -- 172.21.15.91:0/3600701382 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec0125f0 con 0x7f22f00c4c00 2023-11-27T20:43:29.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.764+0000 7f22e6ffd640 1 -- 172.21.15.91:0/3600701382 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec012750 con 0x7f22f00c4c00 2023-11-27T20:43:29.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.764+0000 7f22e6ffd640 1 -- 172.21.15.91:0/3600701382 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec012b00 con 0x7f22f00c4c00 2023-11-27T20:43:29.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.764+0000 7f22f7328640 1 -- 172.21.15.91:0/3600701382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f014a690 con 0x7f22f00c4c00 2023-11-27T20:43:29.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.764+0000 7f22f7328640 1 -- 172.21.15.91:0/3600701382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f01e9c10 con 0x7f22f00c4c00 2023-11-27T20:43:29.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.765+0000 7f22f7328640 1 -- 172.21.15.91:0/3600701382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f004e840 con 0x7f22f00c4c00 2023-11-27T20:43:29.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.766+0000 7f22e6ffd640 1 -- 172.21.15.91:0/3600701382 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f22ec012c60 con 0x7f22f00c4c00 2023-11-27T20:43:29.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.767+0000 7f22e6ffd640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22d406b1c0 0x7f22d406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:29.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.768+0000 7f22e6ffd640 1 -- 172.21.15.91:0/3600701382 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f22ec08a2d0 con 0x7f22f00c4c00 2023-11-27T20:43:29.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.768+0000 7f22f5b25640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22d406b1c0 0x7f22d406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:29.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.768+0000 7f22f5b25640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22d406b1c0 0x7f22d406d680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f22e0006fd0 tx=0x7f22e0006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:29.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.772+0000 7f22e6ffd640 1 -- 172.21.15.91:0/3600701382 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f22ec054bd0 con 0x7f22f00c4c00 2023-11-27T20:43:29.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.965+0000 7f22f7328640 1 -- 172.21.15.91:0/3600701382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22f00c7c40 con 0x7f22f00c4c00 2023-11-27T20:43:29.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.968+0000 7f22e6ffd640 1 -- 172.21.15.91:0/3600701382 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+20346 (secure 0 0 0) 0x7f22ec0581f0 con 0x7f22f00c4c00 2023-11-27T20:43:29.969 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:29.970 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":40,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:18.205644+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:42:35.743447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T20:42:36.976231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:29.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 -- 172.21.15.91:0/3600701382 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22d406b1c0 msgr2=0x7f22d406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22d406b1c0 0x7f22d406d680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f22e0006fd0 tx=0x7f22e0006bc0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 -- 172.21.15.91:0/3600701382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f00c4c00 msgr2=0x7f22f01ea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:29.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f00c4c00 0x7f22f01ea6f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00d620 tx=0x7f22ec00dae0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 -- 172.21.15.91:0/3600701382 shutdown_connections 2023-11-27T20:43:29.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22d406b1c0 0x7f22d406d680 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f0154580 0x7f22f014b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f014e7c0 0x7f22f01eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 --2- 172.21.15.91:0/3600701382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22f00c4c00 0x7f22f01ea6f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:29.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 -- 172.21.15.91:0/3600701382 >> 172.21.15.91:0/3600701382 conn(0x7f22f00abf00 msgr2=0x7f22f006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:29.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.970+0000 7f22f7328640 1 -- 172.21.15.91:0/3600701382 shutdown_connections 2023-11-27T20:43:29.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:29.971+0000 7f22f7328640 1 -- 172.21.15.91:0/3600701382 wait complete. 2023-11-27T20:43:29.991 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-27T20:43:30.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.191+0000 7f422759e640 1 Processor -- start 2023-11-27T20:43:30.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.191+0000 7f422759e640 1 -- start start 2023-11-27T20:43:30.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.193+0000 7f422759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f42280c0c80 0x7f42280a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.193+0000 7f422759e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4228071e80 con 0x7f422814c2e0 2023-11-27T20:43:30.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.193+0000 7f422759e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4228072a20 con 0x7f42280c0440 2023-11-27T20:43:30.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.193+0000 7f422759e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4228071470 con 0x7f42280c0c80 2023-11-27T20:43:30.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.193+0000 7f422659c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f422814c2e0 0x7f4228152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45222/0 (socket says 172.21.15.91:45222) 2023-11-27T20:43:30.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.193+0000 7f422659c640 1 -- 172.21.15.91:0/2236818150 learned_addr learned my addr 172.21.15.91:0/2236818150 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:30.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.193+0000 7f4226d9d640 1 --2- 172.21.15.91:0/2236818150 >> v2:172.21.15.91:3300/0 conn(0x7f42280c0c80 0x7f42280a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.194+0000 7f4226d9d640 1 -- 172.21.15.91:0/2236818150 >> v1:172.21.15.183:6789/0 conn(0x7f42280c0440 legacy=0x7f4228072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:30.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.194+0000 7f4226d9d640 1 -- 172.21.15.91:0/2236818150 >> v1:172.21.15.91:6789/0 conn(0x7f422814c2e0 legacy=0x7f4228152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.194+0000 7f4226d9d640 1 -- 172.21.15.91:0/2236818150 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422814c6c0 con 0x7f42280c0c80 2023-11-27T20:43:30.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.195+0000 7f4226d9d640 1 --2- 172.21.15.91:0/2236818150 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0c80 0x7f42280a4d20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4220009d90 tx=0x7f422002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ebdaecbd34e69f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:30.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.195+0000 7f4225d9b640 1 -- 172.21.15.91:0/2236818150 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422002cb40 con 0x7f42280c0c80 2023-11-27T20:43:30.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.197+0000 7f4225d9b640 1 -- 172.21.15.91:0/2236818150 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422002cca0 con 0x7f42280c0c80 2023-11-27T20:43:30.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.197+0000 7f4225d9b640 1 -- 172.21.15.91:0/2236818150 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220034660 con 0x7f42280c0c80 2023-11-27T20:43:30.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.197+0000 7f422759e640 1 -- 172.21.15.91:0/2236818150 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0c80 msgr2=0x7f42280a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.198+0000 7f422759e640 1 --2- 172.21.15.91:0/2236818150 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0c80 0x7f42280a4d20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4220009d90 tx=0x7f422002bd90 comp rx=0 tx=0).stop 2023-11-27T20:43:30.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.198+0000 7f422759e640 1 -- 172.21.15.91:0/2236818150 shutdown_connections 2023-11-27T20:43:30.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.198+0000 7f422759e640 1 --2- 172.21.15.91:0/2236818150 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0c80 0x7f42280a4d20 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.198+0000 7f422759e640 1 -- 172.21.15.91:0/2236818150 >> 172.21.15.91:0/2236818150 conn(0x7f42280a77f0 msgr2=0x7f42280a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:30.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.198+0000 7f422759e640 1 -- 172.21.15.91:0/2236818150 shutdown_connections 2023-11-27T20:43:30.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.198+0000 7f422759e640 1 -- 172.21.15.91:0/2236818150 wait complete. 2023-11-27T20:43:30.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.200+0000 7f422759e640 1 Processor -- start 2023-11-27T20:43:30.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.200+0000 7f422759e640 1 -- start start 2023-11-27T20:43:30.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f422759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0440 0x7f422814fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f422759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42280c0c80 0x7f4228144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f422759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f422814c2e0 0x7f42280c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f422759e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42281ee600 con 0x7f42280c0440 2023-11-27T20:43:30.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f422759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42280ab420 con 0x7f42280c0c80 2023-11-27T20:43:30.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f422759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42281ee0a0 con 0x7f422814c2e0 2023-11-27T20:43:30.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f422659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0440 0x7f422814fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f422659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0440 0x7f422814fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47156/0 (socket says 172.21.15.91:47156) 2023-11-27T20:43:30.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f422659c640 1 -- 172.21.15.91:0/2236017467 learned_addr learned my addr 172.21.15.91:0/2236017467 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:30.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f421ffff640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42280c0c80 0x7f4228144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.201+0000 7f4226d9d640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f422814c2e0 0x7f42280c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f422659c640 1 -- 172.21.15.91:0/2236017467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f422814c2e0 msgr2=0x7f42280c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f422659c640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f422814c2e0 0x7f42280c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f422659c640 1 -- 172.21.15.91:0/2236017467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42280c0c80 msgr2=0x7f4228144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f422659c640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42280c0c80 0x7f4228144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f422659c640 1 -- 172.21.15.91:0/2236017467 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4220009a70 con 0x7f42280c0440 2023-11-27T20:43:30.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f421ffff640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42280c0c80 0x7f4228144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:30.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f422659c640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0440 0x7f422814fff0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f421800c3f0 tx=0x7f421800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:30.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f421effd640 1 -- 172.21.15.91:0/2236017467 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218005ce0 con 0x7f42280c0440 2023-11-27T20:43:30.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f421effd640 1 -- 172.21.15.91:0/2236017467 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218005e40 con 0x7f42280c0440 2023-11-27T20:43:30.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f422759e640 1 -- 172.21.15.91:0/2236017467 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4228144fe0 con 0x7f42280c0440 2023-11-27T20:43:30.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f421effd640 1 -- 172.21.15.91:0/2236017467 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180072f0 con 0x7f42280c0440 2023-11-27T20:43:30.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.202+0000 7f422759e640 1 -- 172.21.15.91:0/2236017467 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42280ab0b0 con 0x7f42280c0440 2023-11-27T20:43:30.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.203+0000 7f422759e640 1 -- 172.21.15.91:0/2236017467 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4228067d50 con 0x7f42280c0440 2023-11-27T20:43:30.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.204+0000 7f421effd640 1 -- 172.21.15.91:0/2236017467 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4218007450 con 0x7f42280c0440 2023-11-27T20:43:30.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.205+0000 7f421effd640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f420806b1c0 0x7f420806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.205+0000 7f421effd640 1 -- 172.21.15.91:0/2236017467 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f4218089380 con 0x7f42280c0440 2023-11-27T20:43:30.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.205+0000 7f421ffff640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f420806b1c0 0x7f420806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.206+0000 7f421ffff640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f420806b1c0 0x7f420806d680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f422814d160 tx=0x7f4210009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:30.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.210+0000 7f421effd640 1 -- 172.21.15.91:0/2236017467 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4218053d10 con 0x7f42280c0440 2023-11-27T20:43:30.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.439+0000 7f422759e640 1 -- 172.21.15.91:0/2236017467 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f422804e840 con 0x7f42280c0440 2023-11-27T20:43:30.442 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-11-27T20:43:30.441+0000 7fb57696d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-27T20:43:30.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.444+0000 7f421effd640 1 -- 172.21.15.91:0/2236017467 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4218057330 con 0x7f42280c0440 2023-11-27T20:43:30.445 INFO:teuthology.orchestra.run.smithi091.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T20:43:30.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.447+0000 7f422759e640 1 -- 172.21.15.91:0/2236017467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f420806b1c0 msgr2=0x7f420806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.447+0000 7f422759e640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f420806b1c0 0x7f420806d680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f422814d160 tx=0x7f4210009040 comp rx=0 tx=0).stop 2023-11-27T20:43:30.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.447+0000 7f422759e640 1 -- 172.21.15.91:0/2236017467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0440 msgr2=0x7f422814fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.447+0000 7f422759e640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0440 0x7f422814fff0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f421800c3f0 tx=0x7f421800c8b0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.448+0000 7f422759e640 1 -- 172.21.15.91:0/2236017467 shutdown_connections 2023-11-27T20:43:30.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.448+0000 7f422759e640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f422814c2e0 0x7f42280c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.448+0000 7f422759e640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f420806b1c0 0x7f420806d680 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.448+0000 7f422759e640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42280c0c80 0x7f4228144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.448+0000 7f422759e640 1 --2- 172.21.15.91:0/2236017467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42280c0440 0x7f422814fff0 secure :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f421800c3f0 tx=0x7f421800c8b0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.448+0000 7f422759e640 1 -- 172.21.15.91:0/2236017467 >> 172.21.15.91:0/2236017467 conn(0x7f42280a77f0 msgr2=0x7f42280c1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:30.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.448+0000 7f422759e640 1 -- 172.21.15.91:0/2236017467 shutdown_connections 2023-11-27T20:43:30.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.448+0000 7f422759e640 1 -- 172.21.15.91:0/2236017467 wait complete. 2023-11-27T20:43:30.468 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-27T20:43:30.475 INFO:tasks.ceph.mds.d.smithi183.stderr: -3361> 2023-11-27T20:42:40.597+0000 7f651c1e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:43:30.569 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-11-27T20:43:30.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.673+0000 7f4d407f5640 1 Processor -- start 2023-11-27T20:43:30.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.673+0000 7f4d407f5640 1 -- start start 2023-11-27T20:43:30.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.674+0000 7f4d407f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d380c1500 0x7f4d380c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.674+0000 7f4d407f5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d380c06c0 con 0x7f4d38155490 2023-11-27T20:43:30.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.674+0000 7f4d407f5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d380c1020 con 0x7f4d380a9b40 2023-11-27T20:43:30.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.674+0000 7f4d407f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380a5820 con 0x7f4d380c1500 2023-11-27T20:43:30.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.675+0000 7f4d3e591640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f4d38155490 0x7f4d380a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45228/0 (socket says 172.21.15.91:45228) 2023-11-27T20:43:30.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.675+0000 7f4d3e591640 1 -- 172.21.15.91:0/2535090677 learned_addr learned my addr 172.21.15.91:0/2535090677 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:30.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.675+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627715133 0 0) 0x7f4d380c06c0 con 0x7f4d38155490 2023-11-27T20:43:30.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.675+0000 7f4d3ed92640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d380c1500 0x7f4d380c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.675+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d24003520 con 0x7f4d38155490 2023-11-27T20:43:30.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.675+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 941693538 0 0) 0x7f4d24003520 con 0x7f4d38155490 2023-11-27T20:43:30.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.675+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d380c1500 msgr2=0x7f4d380c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:30.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.675+0000 7f4d3d58f640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d380c1500 0x7f4d380c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 >> v1:172.21.15.183:6789/0 conn(0x7f4d380a9b40 legacy=0x7f4d380c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380c0910 con 0x7f4d38155490 2023-11-27T20:43:30.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f4d34001670 con 0x7f4d38155490 2023-11-27T20:43:30.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 >> v1:172.21.15.91:6789/0 conn(0x7f4d38155490 legacy=0x7f4d380a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3d58f640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d240039a0 0x7f4d24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3d58f640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d380c1500 0x7f4d240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3d58f640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d24004d00 0x7f4d24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2400bb10 con 0x7f4d24004d00 2023-11-27T20:43:30.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2400bc50 con 0x7f4d240039a0 2023-11-27T20:43:30.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2400be10 con 0x7f4d380c1500 2023-11-27T20:43:30.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3ed92640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d24004d00 0x7f4d24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3e591640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d240039a0 0x7f4d24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3ed92640 1 -- 172.21.15.91:0/2535090677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d380c1500 msgr2=0x7f4d240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:30.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3ed92640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d380c1500 0x7f4d240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3ed92640 1 -- 172.21.15.91:0/2535090677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d240039a0 msgr2=0x7f4d24003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:30.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3ed92640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d240039a0 0x7f4d24003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.676+0000 7f4d3ed92640 1 -- 172.21.15.91:0/2535090677 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d24003520 con 0x7f4d24004d00 2023-11-27T20:43:30.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.677+0000 7f4d3ed92640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d24004d00 0x7f4d24005180 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4d380ab440 tx=0x7f4d240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4514475ed8634a45 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:30.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.678+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3002cca0 con 0x7f4d24004d00 2023-11-27T20:43:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.678+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3002ce00 con 0x7f4d24004d00 2023-11-27T20:43:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.678+0000 7f4d3d58f640 1 -- 172.21.15.91:0/2535090677 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30034680 con 0x7f4d24004d00 2023-11-27T20:43:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.678+0000 7f4d407f5640 1 -- 172.21.15.91:0/2535090677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d24004d00 msgr2=0x7f4d24005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.678+0000 7f4d407f5640 1 --2- 172.21.15.91:0/2535090677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d24004d00 0x7f4d24005180 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4d380ab440 tx=0x7f4d240057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.678+0000 7f4d3ed92640 1 -- 172.21.15.91:0/2535090677 reap_dead start 2023-11-27T20:43:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.678+0000 7f4d407f5640 1 -- 172.21.15.91:0/2535090677 shutdown_connections 2023-11-27T20:43:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.678+0000 7f4d407f5640 1 -- 172.21.15.91:0/2535090677 >> 172.21.15.91:0/2535090677 conn(0x7f4d3806a500 msgr2=0x7f4d3806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.678+0000 7f4d407f5640 1 -- 172.21.15.91:0/2535090677 shutdown_connections 2023-11-27T20:43:30.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.678+0000 7f4d407f5640 1 -- 172.21.15.91:0/2535090677 wait complete. 2023-11-27T20:43:30.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.680+0000 7f4d407f5640 1 Processor -- start 2023-11-27T20:43:30.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.680+0000 7f4d407f5640 1 -- start start 2023-11-27T20:43:30.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.681+0000 7f4d407f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d380a84a0 0x7f4d38156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.681+0000 7f4d407f5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d3815dab0 0x7f4d38157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.681+0000 7f4d407f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d38157580 0x7f4d380bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.681+0000 7f4d407f5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3815d900 con 0x7f4d380a84a0 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.681+0000 7f4d407f5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3815d3d0 con 0x7f4d3815dab0 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.681+0000 7f4d407f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3815d620 con 0x7f4d38157580 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.681+0000 7f4d3e591640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d380a84a0 0x7f4d38156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.681+0000 7f4d3e591640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d380a84a0 0x7f4d38156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47164/0 (socket says 172.21.15.91:47164) 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.681+0000 7f4d3e591640 1 -- 172.21.15.91:0/3219019269 learned_addr learned my addr 172.21.15.91:0/3219019269 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d3dd90640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d3815dab0 0x7f4d38157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d3e591640 1 -- 172.21.15.91:0/3219019269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d38157580 msgr2=0x7f4d380bceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d3e591640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d38157580 0x7f4d380bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d3e591640 1 -- 172.21.15.91:0/3219019269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d3815dab0 msgr2=0x7f4d38157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:30.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d3e591640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d3815dab0 0x7f4d38157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d3e591640 1 -- 172.21.15.91:0/3219019269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380bef50 con 0x7f4d380a84a0 2023-11-27T20:43:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d3dd90640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d3815dab0 0x7f4d38157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d3e591640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d380a84a0 0x7f4d38156b00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000f60 tx=0x7f4d3400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d2effd640 1 -- 172.21.15.91:0/3219019269 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34004cb0 con 0x7f4d380a84a0 2023-11-27T20:43:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d2effd640 1 -- 172.21.15.91:0/3219019269 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34004e10 con 0x7f4d380a84a0 2023-11-27T20:43:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d2effd640 1 -- 172.21.15.91:0/3219019269 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d340072d0 con 0x7f4d380a84a0 2023-11-27T20:43:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d407f5640 1 -- 172.21.15.91:0/3219019269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d380bf230 con 0x7f4d380a84a0 2023-11-27T20:43:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.682+0000 7f4d407f5640 1 -- 172.21.15.91:0/3219019269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d380be120 con 0x7f4d380a84a0 2023-11-27T20:43:30.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.683+0000 7f4d407f5640 1 -- 172.21.15.91:0/3219019269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d380bedb0 con 0x7f4d380a84a0 2023-11-27T20:43:30.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.685+0000 7f4d2effd640 1 -- 172.21.15.91:0/3219019269 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4d34007430 con 0x7f4d380a84a0 2023-11-27T20:43:30.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.685+0000 7f4d2effd640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d1c06b1c0 0x7f4d1c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:30.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.686+0000 7f4d2effd640 1 -- 172.21.15.91:0/3219019269 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6709+0+0 (secure 0 0 0) 0x7f4d34089620 con 0x7f4d380a84a0 2023-11-27T20:43:30.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.686+0000 7f4d3dd90640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d1c06b1c0 0x7f4d1c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:30.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.686+0000 7f4d3dd90640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d1c06b1c0 0x7f4d1c06d680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d3815da60 tx=0x7f4d28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:30.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.690+0000 7f4d2effd640 1 -- 172.21.15.91:0/3219019269 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4d380bedb0 con 0x7f4d380a84a0 2023-11-27T20:43:30.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:30.918+0000 7f4d407f5640 1 -- 172.21.15.91:0/3219019269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4d380bedb0 con 0x7f4d380a84a0 2023-11-27T20:43:31.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.516+0000 7f4d2effd640 1 -- 172.21.15.91:0/3219019269 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4d380bedb0 con 0x7f4d380a84a0 2023-11-27T20:43:31.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.519+0000 7f4d407f5640 1 -- 172.21.15.91:0/3219019269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d1c06b1c0 msgr2=0x7f4d1c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:31.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.519+0000 7f4d407f5640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d1c06b1c0 0x7f4d1c06d680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d3815da60 tx=0x7f4d28009040 comp rx=0 tx=0).stop 2023-11-27T20:43:31.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.519+0000 7f4d407f5640 1 -- 172.21.15.91:0/3219019269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d380a84a0 msgr2=0x7f4d38156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:31.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.519+0000 7f4d407f5640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d380a84a0 0x7f4d38156b00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000f60 tx=0x7f4d3400df70 comp rx=0 tx=0).stop 2023-11-27T20:43:31.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.519+0000 7f4d407f5640 1 -- 172.21.15.91:0/3219019269 shutdown_connections 2023-11-27T20:43:31.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.519+0000 7f4d407f5640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d38157580 0x7f4d380bceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:31.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.519+0000 7f4d407f5640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d1c06b1c0 0x7f4d1c06d680 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:31.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.519+0000 7f4d407f5640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d3815dab0 0x7f4d38157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:31.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.519+0000 7f4d407f5640 1 --2- 172.21.15.91:0/3219019269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d380a84a0 0x7f4d38156b00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:31.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.519+0000 7f4d407f5640 1 -- 172.21.15.91:0/3219019269 >> 172.21.15.91:0/3219019269 conn(0x7f4d3806a500 msgr2=0x7f4d3806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:31.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.520+0000 7f4d407f5640 1 -- 172.21.15.91:0/3219019269 shutdown_connections 2023-11-27T20:43:31.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.520+0000 7f4d407f5640 1 -- 172.21.15.91:0/3219019269 wait complete. 2023-11-27T20:43:31.542 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-27T20:43:31.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.750+0000 7faec05c5640 1 Processor -- start 2023-11-27T20:43:31.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.750+0000 7faec05c5640 1 -- start start 2023-11-27T20:43:31.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.752+0000 7faec05c5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faeb80c31e0 0x7faeb80c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:31.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.752+0000 7faec05c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb806c890 0x7faeb806cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:31.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.752+0000 7faec05c5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80a8de0 con 0x7faeb80a52d0 2023-11-27T20:43:31.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.752+0000 7faec05c5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80a9030 con 0x7faeb80c31e0 2023-11-27T20:43:31.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.752+0000 7faec05c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80a9310 con 0x7faeb806c890 2023-11-27T20:43:31.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.752+0000 7faebdb60640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faeb80c31e0 0x7faeb80c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:31.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.752+0000 7faebdb60640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faeb80c31e0 0x7faeb80c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47180/0 (socket says 172.21.15.91:47180) 2023-11-27T20:43:31.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.752+0000 7faebdb60640 1 -- 172.21.15.91:0/1174452687 learned_addr learned my addr 172.21.15.91:0/1174452687 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:31.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.753+0000 7faebeb62640 1 --2- 172.21.15.91:0/1174452687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb806c890 0x7faeb806cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:31.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.753+0000 7faebdb60640 1 -- 172.21.15.91:0/1174452687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb806c890 msgr2=0x7faeb806cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:31.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.753+0000 7faebdb60640 1 --2- 172.21.15.91:0/1174452687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb806c890 0x7faeb806cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:31.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.753+0000 7faebdb60640 1 -- 172.21.15.91:0/1174452687 >> v1:172.21.15.183:6789/0 conn(0x7faeb80a52d0 legacy=0x7faeb80c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:31.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.753+0000 7faebdb60640 1 -- 172.21.15.91:0/1174452687 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80a95f0 con 0x7faeb80c31e0 2023-11-27T20:43:31.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.754+0000 7faebdb60640 1 --2- 172.21.15.91:0/1174452687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb80c31e0 0x7faeb80c12f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faea800bb10 tx=0x7faea802e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7192f565880f9c95 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:31.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.754+0000 7faebd35f640 1 -- 172.21.15.91:0/1174452687 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea802ede0 con 0x7faeb80c31e0 2023-11-27T20:43:31.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.754+0000 7faebd35f640 1 -- 172.21.15.91:0/1174452687 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8036440 con 0x7faeb80c31e0 2023-11-27T20:43:31.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.754+0000 7faebd35f640 1 -- 172.21.15.91:0/1174452687 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80367d0 con 0x7faeb80c31e0 2023-11-27T20:43:31.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.755+0000 7faec05c5640 1 -- 172.21.15.91:0/1174452687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb80c31e0 msgr2=0x7faeb80c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:31.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.755+0000 7faec05c5640 1 --2- 172.21.15.91:0/1174452687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb80c31e0 0x7faeb80c12f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faea800bb10 tx=0x7faea802e030 comp rx=0 tx=0).stop 2023-11-27T20:43:31.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.755+0000 7faec05c5640 1 -- 172.21.15.91:0/1174452687 shutdown_connections 2023-11-27T20:43:31.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.755+0000 7faec05c5640 1 --2- 172.21.15.91:0/1174452687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb806c890 0x7faeb806cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:31.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.755+0000 7faec05c5640 1 --2- 172.21.15.91:0/1174452687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb80c31e0 0x7faeb80c12f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:31.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.755+0000 7faec05c5640 1 -- 172.21.15.91:0/1174452687 >> 172.21.15.91:0/1174452687 conn(0x7faeb80c5d30 msgr2=0x7faeb80c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:31.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.755+0000 7faec05c5640 1 -- 172.21.15.91:0/1174452687 shutdown_connections 2023-11-27T20:43:31.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.755+0000 7faec05c5640 1 -- 172.21.15.91:0/1174452687 wait complete. 2023-11-27T20:43:31.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.757+0000 7faec05c5640 1 Processor -- start 2023-11-27T20:43:31.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.758+0000 7faec05c5640 1 -- start start 2023-11-27T20:43:31.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.759+0000 7faec05c5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb806c890 0x7faeb8153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:31.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.759+0000 7faec05c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb80a52d0 0x7faeb814dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:31.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.759+0000 7faec05c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb80c31e0 0x7faeb814e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:31.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.759+0000 7faec05c5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb814f780 con 0x7faeb806c890 2023-11-27T20:43:31.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.759+0000 7faec05c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80a5a20 con 0x7faeb80c31e0 2023-11-27T20:43:31.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.759+0000 7faec05c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb814eee0 con 0x7faeb80a52d0 2023-11-27T20:43:31.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.759+0000 7faebe361640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb806c890 0x7faeb8153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:31.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.759+0000 7faebe361640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb806c890 0x7faeb8153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47196/0 (socket says 172.21.15.91:47196) 2023-11-27T20:43:31.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.759+0000 7faebe361640 1 -- 172.21.15.91:0/3854557928 learned_addr learned my addr 172.21.15.91:0/3854557928 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:31.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faebe361640 1 -- 172.21.15.91:0/3854557928 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb80a52d0 msgr2=0x7faeb814dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:31.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faebdb60640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb80a52d0 0x7faeb814dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:31.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faebe361640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb80a52d0 0x7faeb814dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:31.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faebeb62640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb80c31e0 0x7faeb814e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:31.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faebe361640 1 -- 172.21.15.91:0/3854557928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb80c31e0 msgr2=0x7faeb814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:31.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faebe361640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb80c31e0 0x7faeb814e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:31.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faebe361640 1 -- 172.21.15.91:0/3854557928 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea800b770 con 0x7faeb806c890 2023-11-27T20:43:31.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faebeb62640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb80c31e0 0x7faeb814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:31.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faebe361640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb806c890 0x7faeb8153580 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faeb400b3f0 tx=0x7faeb400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:31.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faeaeffd640 1 -- 172.21.15.91:0/3854557928 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4011830 con 0x7faeb806c890 2023-11-27T20:43:31.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faeaeffd640 1 -- 172.21.15.91:0/3854557928 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4011990 con 0x7faeb806c890 2023-11-27T20:43:31.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faec05c5640 1 -- 172.21.15.91:0/3854557928 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb814f1c0 con 0x7faeb806c890 2023-11-27T20:43:31.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.760+0000 7faeaeffd640 1 -- 172.21.15.91:0/3854557928 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4011d40 con 0x7faeb806c890 2023-11-27T20:43:31.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.761+0000 7faec05c5640 1 -- 172.21.15.91:0/3854557928 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb814e7a0 con 0x7faeb806c890 2023-11-27T20:43:31.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.761+0000 7faec05c5640 1 -- 172.21.15.91:0/3854557928 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb8068350 con 0x7faeb806c890 2023-11-27T20:43:31.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.762+0000 7faeaeffd640 1 -- 172.21.15.91:0/3854557928 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faeb401a400 con 0x7faeb806c890 2023-11-27T20:43:31.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.763+0000 7faeaeffd640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fae9c06b1f0 0x7fae9c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:31.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.763+0000 7faeaeffd640 1 -- 172.21.15.91:0/3854557928 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6709+0+0 (secure 0 0 0) 0x7faeb4089c40 con 0x7faeb806c890 2023-11-27T20:43:31.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.764+0000 7faebdb60640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fae9c06b1f0 0x7fae9c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:31.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.764+0000 7faebdb60640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fae9c06b1f0 0x7fae9c06d6b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faea8038000 tx=0x7faea8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:31.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.768+0000 7faeaeffd640 1 -- 172.21.15.91:0/3854557928 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faeb4054570 con 0x7faeb806c890 2023-11-27T20:43:31.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:31.958+0000 7faec05c5640 1 -- 172.21.15.91:0/3854557928 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faeb8072060 con 0x7faeb806c890 2023-11-27T20:43:32.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.528+0000 7faeaeffd640 1 -- 172.21.15.91:0/3854557928 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7faeb40150d0 con 0x7faeb806c890 2023-11-27T20:43:32.530 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' removed 2023-11-27T20:43:32.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 -- 172.21.15.91:0/3854557928 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fae9c06b1f0 msgr2=0x7fae9c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:32.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fae9c06b1f0 0x7fae9c06d6b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faea8038000 tx=0x7faea8008040 comp rx=0 tx=0).stop 2023-11-27T20:43:32.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 -- 172.21.15.91:0/3854557928 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb806c890 msgr2=0x7faeb8153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:32.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb806c890 0x7faeb8153580 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faeb400b3f0 tx=0x7faeb400b8b0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 -- 172.21.15.91:0/3854557928 shutdown_connections 2023-11-27T20:43:32.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fae9c06b1f0 0x7fae9c06d6b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb80c31e0 0x7faeb814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb80a52d0 0x7faeb814dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 --2- 172.21.15.91:0/3854557928 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faeb806c890 0x7faeb8153580 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 -- 172.21.15.91:0/3854557928 >> 172.21.15.91:0/3854557928 conn(0x7faeb80c5d30 msgr2=0x7faeb80c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:32.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.532+0000 7faec05c5640 1 -- 172.21.15.91:0/3854557928 shutdown_connections 2023-11-27T20:43:32.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.533+0000 7faec05c5640 1 -- 172.21.15.91:0/3854557928 wait complete. 2023-11-27T20:43:32.559 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-27T20:43:32.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.768+0000 7f8f4f696640 1 Processor -- start 2023-11-27T20:43:32.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.768+0000 7f8f4f696640 1 -- start start 2023-11-27T20:43:32.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.769+0000 7f8f4f696640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8f48071f70 0x7f8f480c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:32.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.769+0000 7f8f4f696640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f480c0980 con 0x7f8f4814fa80 2023-11-27T20:43:32.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.769+0000 7f8f4f696640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4806c070 con 0x7f8f48072530 2023-11-27T20:43:32.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.769+0000 7f8f4f696640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4806d160 con 0x7f8f48071f70 2023-11-27T20:43:32.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.770+0000 7f8f4d432640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8f4814fa80 0x7f8f4806d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45244/0 (socket says 172.21.15.91:45244) 2023-11-27T20:43:32.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.770+0000 7f8f4d432640 1 -- 172.21.15.91:0/367393755 learned_addr learned my addr 172.21.15.91:0/367393755 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:32.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.770+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953033451 0 0) 0x7f8f480c0980 con 0x7f8f4814fa80 2023-11-27T20:43:32.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.770+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f34003520 con 0x7f8f4814fa80 2023-11-27T20:43:32.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.770+0000 7f8f4dc33640 1 --2- 172.21.15.91:0/367393755 >> v2:172.21.15.183:3300/0 conn(0x7f8f48071f70 0x7f8f480c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:32.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3734278538 0 0) 0x7f8f34003520 con 0x7f8f4814fa80 2023-11-27T20:43:32.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 >> v2:172.21.15.183:3300/0 conn(0x7f8f48071f70 msgr2=0x7f8f480c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:32.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 --2- 172.21.15.91:0/367393755 >> v2:172.21.15.183:3300/0 conn(0x7f8f48071f70 0x7f8f480c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 >> v1:172.21.15.183:6789/0 conn(0x7f8f48072530 legacy=0x7f8f480c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:32.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f480c20d0 con 0x7f8f4814fa80 2023-11-27T20:43:32.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f8f44001670 con 0x7f8f4814fa80 2023-11-27T20:43:32.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 >> v1:172.21.15.91:6789/0 conn(0x7f8f4814fa80 legacy=0x7f8f4806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:32.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f34003970 0x7f8f34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:32.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f340047c0 0x7f8f34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f340052a0 0x7f8f3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4806d160 con 0x7f8f34003970 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3400c170 con 0x7f8f340052a0 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3400c330 con 0x7f8f340047c0 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f4d432640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f34003970 0x7f8f34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f4dc33640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f340052a0 0x7f8f3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f4d432640 1 -- 172.21.15.91:0/367393755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f340047c0 msgr2=0x7f8f34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f4d432640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f340047c0 0x7f8f34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f4d432640 1 -- 172.21.15.91:0/367393755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f340052a0 msgr2=0x7f8f3400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f4d432640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f340052a0 0x7f8f3400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.771+0000 7f8f4d432640 1 -- 172.21.15.91:0/367393755 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34003520 con 0x7f8f34003970 2023-11-27T20:43:32.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.772+0000 7f8f4dc33640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f340052a0 0x7f8f3400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:32.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.772+0000 7f8f4dc33640 1 -- 172.21.15.91:0/367393755 reap_dead start 2023-11-27T20:43:32.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.773+0000 7f8f4d432640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f34003970 0x7f8f34003d90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400c210 tx=0x7f8f340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be491aee69ef770 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:32.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.773+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44005ad0 con 0x7f8f34003970 2023-11-27T20:43:32.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.773+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f44005c30 con 0x7f8f34003970 2023-11-27T20:43:32.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.773+0000 7f8f3ffff640 1 -- 172.21.15.91:0/367393755 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4402cad0 con 0x7f8f34003970 2023-11-27T20:43:32.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.773+0000 7f8f4f696640 1 -- 172.21.15.91:0/367393755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f34003970 msgr2=0x7f8f34003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:32.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.773+0000 7f8f4f696640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f34003970 0x7f8f34003d90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400c210 tx=0x7f8f340057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.774+0000 7f8f4f696640 1 -- 172.21.15.91:0/367393755 shutdown_connections 2023-11-27T20:43:32.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.774+0000 7f8f4f696640 1 --2- 172.21.15.91:0/367393755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f34003970 0x7f8f34003d90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.774+0000 7f8f4f696640 1 -- 172.21.15.91:0/367393755 >> 172.21.15.91:0/367393755 conn(0x7f8f480c5bc0 msgr2=0x7f8f480c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:32.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.774+0000 7f8f4f696640 1 -- 172.21.15.91:0/367393755 shutdown_connections 2023-11-27T20:43:32.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.774+0000 7f8f4f696640 1 -- 172.21.15.91:0/367393755 wait complete. 2023-11-27T20:43:32.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.775+0000 7f8f4f696640 1 Processor -- start 2023-11-27T20:43:32.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.775+0000 7f8f4f696640 1 -- start start 2023-11-27T20:43:32.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.776+0000 7f8f4f696640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f34003970 0x7f8f481ee400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:32.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.776+0000 7f8f4f696640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f48153940 0x7f8f48070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:32.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.776+0000 7f8f4f696640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f480bf260 0x7f8f48155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:32.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.776+0000 7f8f4f696640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4806fdc0 con 0x7f8f480bf260 2023-11-27T20:43:32.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.776+0000 7f8f4f696640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f481ee940 con 0x7f8f34003970 2023-11-27T20:43:32.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.776+0000 7f8f4f696640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48071880 con 0x7f8f48153940 2023-11-27T20:43:32.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4dc33640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f480bf260 0x7f8f48155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:32.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4dc33640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f480bf260 0x7f8f48155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47226/0 (socket says 172.21.15.91:47226) 2023-11-27T20:43:32.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4dc33640 1 -- 172.21.15.91:0/1806444973 learned_addr learned my addr 172.21.15.91:0/1806444973 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4d432640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f34003970 0x7f8f481ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4dc33640 1 -- 172.21.15.91:0/1806444973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f48153940 msgr2=0x7f8f48070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4dc33640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f48153940 0x7f8f48070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4dc33640 1 -- 172.21.15.91:0/1806444973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f34003970 msgr2=0x7f8f481ee400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4dc33640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f34003970 0x7f8f481ee400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4dc33640 1 -- 172.21.15.91:0/1806444973 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f48071b60 con 0x7f8f480bf260 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4d432640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f34003970 0x7f8f481ee400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f4dc33640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f480bf260 0x7f8f48155040 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8f48071f00 tx=0x7f8f40009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.777+0000 7f8f3dffb640 1 -- 172.21.15.91:0/1806444973 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40007d20 con 0x7f8f480bf260 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.778+0000 7f8f3dffb640 1 -- 172.21.15.91:0/1806444973 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40007e80 con 0x7f8f480bf260 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.778+0000 7f8f4f696640 1 -- 172.21.15.91:0/1806444973 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f48070010 con 0x7f8f480bf260 2023-11-27T20:43:32.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.778+0000 7f8f3dffb640 1 -- 172.21.15.91:0/1806444973 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40014640 con 0x7f8f480bf260 2023-11-27T20:43:32.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.778+0000 7f8f4f696640 1 -- 172.21.15.91:0/1806444973 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f48070d50 con 0x7f8f480bf260 2023-11-27T20:43:32.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.779+0000 7f8f4f696640 1 -- 172.21.15.91:0/1806444973 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f48070530 con 0x7f8f480bf260 2023-11-27T20:43:32.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.780+0000 7f8f3dffb640 1 -- 172.21.15.91:0/1806444973 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8f4001d3b0 con 0x7f8f480bf260 2023-11-27T20:43:32.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.781+0000 7f8f3dffb640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f2c06b1c0 0x7f8f2c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:32.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.781+0000 7f8f3dffb640 1 -- 172.21.15.91:0/1806444973 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6271+0+0 (secure 0 0 0) 0x7f8f40089a10 con 0x7f8f480bf260 2023-11-27T20:43:32.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.781+0000 7f8f4d432640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f2c06b1c0 0x7f8f2c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:32.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.782+0000 7f8f4d432640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f2c06b1c0 0x7f8f2c06d680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f44034000 tx=0x7f8f44009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:32.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.785+0000 7f8f3dffb640 1 -- 172.21.15.91:0/1806444973 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8f48070530 con 0x7f8f480bf260 2023-11-27T20:43:32.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:32.980+0000 7f8f4f696640 1 -- 172.21.15.91:0/1806444973 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f48070530 con 0x7f8f480bf260 2023-11-27T20:43:33.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.546+0000 7f8f3dffb640 1 -- 172.21.15.91:0/1806444973 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8f48070530 con 0x7f8f480bf260 2023-11-27T20:43:33.548 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' removed 2023-11-27T20:43:33.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.553+0000 7f8f4f696640 1 -- 172.21.15.91:0/1806444973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f2c06b1c0 msgr2=0x7f8f2c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:33.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.553+0000 7f8f4f696640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f2c06b1c0 0x7f8f2c06d680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f44034000 tx=0x7f8f44009030 comp rx=0 tx=0).stop 2023-11-27T20:43:33.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.553+0000 7f8f4f696640 1 -- 172.21.15.91:0/1806444973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f480bf260 msgr2=0x7f8f48155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:33.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.553+0000 7f8f4f696640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f480bf260 0x7f8f48155040 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8f48071f00 tx=0x7f8f40009d30 comp rx=0 tx=0).stop 2023-11-27T20:43:33.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.555+0000 7f8f4f696640 1 -- 172.21.15.91:0/1806444973 shutdown_connections 2023-11-27T20:43:33.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.555+0000 7f8f4f696640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f480bf260 0x7f8f48155040 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.555+0000 7f8f4f696640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f48153940 0x7f8f48070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.555+0000 7f8f4f696640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8f2c06b1c0 0x7f8f2c06d680 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.555+0000 7f8f4f696640 1 --2- 172.21.15.91:0/1806444973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f34003970 0x7f8f481ee400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.555+0000 7f8f4f696640 1 -- 172.21.15.91:0/1806444973 >> 172.21.15.91:0/1806444973 conn(0x7f8f480c5bc0 msgr2=0x7f8f48148600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:33.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.557+0000 7f8f4f696640 1 -- 172.21.15.91:0/1806444973 shutdown_connections 2023-11-27T20:43:33.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.557+0000 7f8f4f696640 1 -- 172.21.15.91:0/1806444973 wait complete. 2023-11-27T20:43:33.581 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:33.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.777+0000 7f47771a7640 1 Processor -- start 2023-11-27T20:43:33.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.777+0000 7f47771a7640 1 -- start start 2023-11-27T20:43:33.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.778+0000 7f47771a7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477014e7f0 0x7f47700c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:33.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.778+0000 7f47771a7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f477006cd20 0x7f477015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:33.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.778+0000 7f47771a7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700a8380 con 0x7f47700c52e0 2023-11-27T20:43:33.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.778+0000 7f47771a7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47701510b0 con 0x7f477006cd20 2023-11-27T20:43:33.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.778+0000 7f47771a7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477006bf60 con 0x7f477014e7f0 2023-11-27T20:43:33.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.778+0000 7f47759a4640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f47700c52e0 0x7f477006d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45252/0 (socket says 172.21.15.91:45252) 2023-11-27T20:43:33.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47759a4640 1 -- 172.21.15.91:0/282558329 learned_addr learned my addr 172.21.15.91:0/282558329 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:33.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47761a5640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477014e7f0 0x7f47700c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:33.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081275973 0 0) 0x7f47700a8380 con 0x7f47700c52e0 2023-11-27T20:43:33.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f475c005730 con 0x7f47700c52e0 2023-11-27T20:43:33.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47769a6640 1 --2- 172.21.15.91:0/282558329 >> v2:172.21.15.183:3300/0 conn(0x7f477006cd20 0x7f477015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:33.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 139590115 0 0) 0x7f475c005730 con 0x7f47700c52e0 2023-11-27T20:43:33.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477014e7f0 msgr2=0x7f47700c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:33.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477014e7f0 0x7f47700c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 >> v2:172.21.15.183:3300/0 conn(0x7f477006cd20 msgr2=0x7f477015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:33.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 --2- 172.21.15.91:0/282558329 >> v2:172.21.15.183:3300/0 conn(0x7f477006cd20 0x7f477015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477006c240 con 0x7f47700c52e0 2023-11-27T20:43:33.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f4760001670 con 0x7f47700c52e0 2023-11-27T20:43:33.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 >> v1:172.21.15.91:6789/0 conn(0x7f47700c52e0 legacy=0x7f477006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:33.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c005b80 0x7f475c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:33.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.779+0000 7f47751a3640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477014e7f0 0x7f475c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:33.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47751a3640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 0x7f475c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:33.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47701510b0 con 0x7f475c006f10 2023-11-27T20:43:33.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477006bf60 con 0x7f475c005b80 2023-11-27T20:43:33.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c00dc40 con 0x7f477014e7f0 2023-11-27T20:43:33.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47769a6640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 0x7f475c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:33.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47761a5640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c005b80 0x7f475c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:33.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47759a4640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477014e7f0 0x7f475c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:33.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47769a6640 1 -- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477014e7f0 msgr2=0x7f475c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:33.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47769a6640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477014e7f0 0x7f475c0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47769a6640 1 -- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c005b80 msgr2=0x7f475c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:33.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47769a6640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c005b80 0x7f475c005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47769a6640 1 -- 172.21.15.91:0/282558329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c005730 con 0x7f475c006f10 2023-11-27T20:43:33.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47761a5640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c005b80 0x7f475c005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:33.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.780+0000 7f47759a4640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477014e7f0 0x7f475c0069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:33.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.781+0000 7f47769a6640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 0x7f475c007390 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f47700a5730 tx=0x7f475c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a4e867c49be21c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:33.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.782+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476802cca0 con 0x7f475c006f10 2023-11-27T20:43:33.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.782+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476802ce00 con 0x7f475c006f10 2023-11-27T20:43:33.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.782+0000 7f47751a3640 1 -- 172.21.15.91:0/282558329 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768034680 con 0x7f475c006f10 2023-11-27T20:43:33.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.782+0000 7f47771a7640 1 -- 172.21.15.91:0/282558329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 msgr2=0x7f475c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:33.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.782+0000 7f47771a7640 1 --2- 172.21.15.91:0/282558329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 0x7f475c007390 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f47700a5730 tx=0x7f475c007a00 comp rx=0 tx=0).stop 2023-11-27T20:43:33.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.782+0000 7f47769a6640 1 -- 172.21.15.91:0/282558329 reap_dead start 2023-11-27T20:43:33.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.782+0000 7f47771a7640 1 -- 172.21.15.91:0/282558329 shutdown_connections 2023-11-27T20:43:33.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.782+0000 7f47771a7640 1 -- 172.21.15.91:0/282558329 >> 172.21.15.91:0/282558329 conn(0x7f47700a77f0 msgr2=0x7f47700a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:33.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.782+0000 7f47771a7640 1 -- 172.21.15.91:0/282558329 shutdown_connections 2023-11-27T20:43:33.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.782+0000 7f47771a7640 1 -- 172.21.15.91:0/282558329 wait complete. 2023-11-27T20:43:33.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.784+0000 7f47771a7640 1 Processor -- start 2023-11-27T20:43:33.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.784+0000 7f47771a7640 1 -- start start 2023-11-27T20:43:33.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.785+0000 7f47771a7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 0x7f4770149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:33.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.785+0000 7f47771a7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4770147d80 0x7f4770148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:33.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.785+0000 7f47771a7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770147250 0x7f47701476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:33.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.785+0000 7f47771a7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4770147c10 con 0x7f475c006f10 2023-11-27T20:43:33.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.785+0000 7f47771a7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477014c1d0 con 0x7f4770147d80 2023-11-27T20:43:33.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.785+0000 7f47771a7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477014bef0 con 0x7f4770147250 2023-11-27T20:43:33.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.785+0000 7f47761a5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 0x7f4770149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:33.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.785+0000 7f47761a5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 0x7f4770149f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47234/0 (socket says 172.21.15.91:47234) 2023-11-27T20:43:33.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.785+0000 7f47761a5640 1 -- 172.21.15.91:0/907284572 learned_addr learned my addr 172.21.15.91:0/907284572 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:33.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f47759a4640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4770147d80 0x7f4770148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:33.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f47761a5640 1 -- 172.21.15.91:0/907284572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770147250 msgr2=0x7f47701476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:33.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f47761a5640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770147250 0x7f47701476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f47761a5640 1 -- 172.21.15.91:0/907284572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4770147d80 msgr2=0x7f4770148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:33.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f47761a5640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4770147d80 0x7f4770148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f47761a5640 1 -- 172.21.15.91:0/907284572 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477014d8e0 con 0x7f475c006f10 2023-11-27T20:43:33.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f47759a4640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4770147d80 0x7f4770148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:33.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f47761a5640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 0x7f4770149f80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f476c010830 tx=0x7f476c010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:33.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f4766ffd640 1 -- 172.21.15.91:0/907284572 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00eb60 con 0x7f475c006f10 2023-11-27T20:43:33.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f4766ffd640 1 -- 172.21.15.91:0/907284572 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c00ecc0 con 0x7f475c006f10 2023-11-27T20:43:33.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f4766ffd640 1 -- 172.21.15.91:0/907284572 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c01c400 con 0x7f475c006f10 2023-11-27T20:43:33.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f47771a7640 1 -- 172.21.15.91:0/907284572 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477014dbc0 con 0x7f475c006f10 2023-11-27T20:43:33.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.786+0000 7f47771a7640 1 -- 172.21.15.91:0/907284572 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477014a4c0 con 0x7f475c006f10 2023-11-27T20:43:33.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.787+0000 7f47771a7640 1 -- 172.21.15.91:0/907284572 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477014d740 con 0x7f475c006f10 2023-11-27T20:43:33.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.788+0000 7f4766ffd640 1 -- 172.21.15.91:0/907284572 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f476c01c560 con 0x7f475c006f10 2023-11-27T20:43:33.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.789+0000 7f4766ffd640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475406b1f0 0x7f475406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:33.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.789+0000 7f4766ffd640 1 -- 172.21.15.91:0/907284572 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f476c08a0e0 con 0x7f475c006f10 2023-11-27T20:43:33.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.790+0000 7f47759a4640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475406b1f0 0x7f475406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:33.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.790+0000 7f47759a4640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475406b1f0 0x7f475406d6b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4760001eb0 tx=0x7f4760009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:33.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.794+0000 7f4766ffd640 1 -- 172.21.15.91:0/907284572 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f477014d740 con 0x7f475c006f10 2023-11-27T20:43:33.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.984+0000 7f47771a7640 1 -- 172.21.15.91:0/907284572 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47701e9f70 con 0x7f475c006f10 2023-11-27T20:43:33.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.987+0000 7f4766ffd640 1 -- 172.21.15.91:0/907284572 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16765 (secure 0 0 0) 0x7f476c054d80 con 0x7f475c006f10 2023-11-27T20:43:33.989 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:33.989 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":43,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:33.543492+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.183:6834/3450105603":"2023-11-28T20:43:30.441853+0000","172.21.15.183:6832/3450105603":"2023-11-28T20:43:30.441853+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:33.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 -- 172.21.15.91:0/907284572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475406b1f0 msgr2=0x7f475406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:33.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475406b1f0 0x7f475406d6b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4760001eb0 tx=0x7f4760009040 comp rx=0 tx=0).stop 2023-11-27T20:43:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 -- 172.21.15.91:0/907284572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 msgr2=0x7f4770149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 0x7f4770149f80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f476c010830 tx=0x7f476c010cf0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 -- 172.21.15.91:0/907284572 shutdown_connections 2023-11-27T20:43:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770147250 0x7f47701476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475406b1f0 0x7f475406d6b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4770147d80 0x7f4770148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 --2- 172.21.15.91:0/907284572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c006f10 0x7f4770149f80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 -- 172.21.15.91:0/907284572 >> 172.21.15.91:0/907284572 conn(0x7f47700a77f0 msgr2=0x7f47700c1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 -- 172.21.15.91:0/907284572 shutdown_connections 2023-11-27T20:43:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:33.990+0000 7f47771a7640 1 -- 172.21.15.91:0/907284572 wait complete. 2023-11-27T20:43:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:42:56.585972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:42:58.003354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:43:34.011 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:43:34.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.230+0000 7f4153026640 1 Processor -- start 2023-11-27T20:43:34.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.230+0000 7f4153026640 1 -- start start 2023-11-27T20:43:34.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.231+0000 7f4153026640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f414c155fc0 0x7f414c159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.231+0000 7f4153026640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f414c0c2e60 0x7f414c163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.231+0000 7f4153026640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c06d580 con 0x7f414c0c1ca0 2023-11-27T20:43:34.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.231+0000 7f4153026640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c06dd60 con 0x7f414c155fc0 2023-11-27T20:43:34.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.231+0000 7f4153026640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0c6580 con 0x7f414c0c2e60 2023-11-27T20:43:34.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.232+0000 7f4150dc2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f414c155fc0 0x7f414c159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.232+0000 7f414bfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f414c0c1ca0 0x7f414c0c2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49748/0 (socket says 172.21.15.91:49748) 2023-11-27T20:43:34.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.232+0000 7f414bfff640 1 -- 172.21.15.91:0/1779570072 learned_addr learned my addr 172.21.15.91:0/1779570072 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:34.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.232+0000 7f41515c3640 1 --2- 172.21.15.91:0/1779570072 >> v2:172.21.15.183:3300/0 conn(0x7f414c0c2e60 0x7f414c163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.232+0000 7f414b7fe640 1 -- 172.21.15.91:0/1779570072 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794901805 0 0) 0x7f414c06d580 con 0x7f414c0c1ca0 2023-11-27T20:43:34.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.232+0000 7f414b7fe640 1 -- 172.21.15.91:0/1779570072 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f413c003520 con 0x7f414c0c1ca0 2023-11-27T20:43:34.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.232+0000 7f4150dc2640 1 -- 172.21.15.91:0/1779570072 >> v2:172.21.15.183:3300/0 conn(0x7f414c0c2e60 msgr2=0x7f414c163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:34.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.232+0000 7f4150dc2640 1 --2- 172.21.15.91:0/1779570072 >> v2:172.21.15.183:3300/0 conn(0x7f414c0c2e60 0x7f414c163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.232+0000 7f4150dc2640 1 -- 172.21.15.91:0/1779570072 >> v1:172.21.15.91:6789/0 conn(0x7f414c0c1ca0 legacy=0x7f414c0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.232+0000 7f4150dc2640 1 -- 172.21.15.91:0/1779570072 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0726d0 con 0x7f414c155fc0 2023-11-27T20:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.234+0000 7f4150dc2640 1 --2- 172.21.15.91:0/1779570072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c155fc0 0x7f414c159470 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f41400097a0 tx=0x7f414002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363eb42fc45560d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.234+0000 7f414b7fe640 1 -- 172.21.15.91:0/1779570072 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414002f050 con 0x7f414c155fc0 2023-11-27T20:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.234+0000 7f414b7fe640 1 -- 172.21.15.91:0/1779570072 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140031700 con 0x7f414c155fc0 2023-11-27T20:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.234+0000 7f414b7fe640 1 -- 172.21.15.91:0/1779570072 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140031a90 con 0x7f414c155fc0 2023-11-27T20:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.235+0000 7f4153026640 1 -- 172.21.15.91:0/1779570072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c155fc0 msgr2=0x7f414c159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.235+0000 7f4153026640 1 --2- 172.21.15.91:0/1779570072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c155fc0 0x7f414c159470 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f41400097a0 tx=0x7f414002b7a0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.235+0000 7f4153026640 1 -- 172.21.15.91:0/1779570072 shutdown_connections 2023-11-27T20:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.235+0000 7f4153026640 1 --2- 172.21.15.91:0/1779570072 >> v2:172.21.15.183:3300/0 conn(0x7f414c0c2e60 0x7f414c163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.235+0000 7f4153026640 1 --2- 172.21.15.91:0/1779570072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c155fc0 0x7f414c159470 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.235+0000 7f4153026640 1 -- 172.21.15.91:0/1779570072 >> 172.21.15.91:0/1779570072 conn(0x7f414c06a500 msgr2=0x7f414c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:34.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.235+0000 7f4153026640 1 -- 172.21.15.91:0/1779570072 shutdown_connections 2023-11-27T20:43:34.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.235+0000 7f4153026640 1 -- 172.21.15.91:0/1779570072 wait complete. 2023-11-27T20:43:34.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.237+0000 7f4153026640 1 Processor -- start 2023-11-27T20:43:34.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.237+0000 7f4153026640 1 -- start start 2023-11-27T20:43:34.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.238+0000 7f4153026640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c0c1ca0 0x7f414c1f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.238+0000 7f4153026640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414c0c2e60 0x7f414c0c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.238+0000 7f4153026640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f414c155fc0 0x7f414c1ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.238+0000 7f4153026640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c159520 con 0x7f414c0c1ca0 2023-11-27T20:43:34.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.238+0000 7f4153026640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c1f2af0 con 0x7f414c155fc0 2023-11-27T20:43:34.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.238+0000 7f4153026640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c1e5f10 con 0x7f414c0c2e60 2023-11-27T20:43:34.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.238+0000 7f4150dc2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c0c1ca0 0x7f414c1f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.238+0000 7f4150dc2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c0c1ca0 0x7f414c1f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60284/0 (socket says 172.21.15.91:60284) 2023-11-27T20:43:34.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.238+0000 7f4150dc2640 1 -- 172.21.15.91:0/142045869 learned_addr learned my addr 172.21.15.91:0/142045869 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:34.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.239+0000 7f41515c3640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f414c155fc0 0x7f414c1ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.239+0000 7f414bfff640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414c0c2e60 0x7f414c0c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.239+0000 7f4150dc2640 1 -- 172.21.15.91:0/142045869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414c0c2e60 msgr2=0x7f414c0c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.239+0000 7f4150dc2640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414c0c2e60 0x7f414c0c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.239+0000 7f4150dc2640 1 -- 172.21.15.91:0/142045869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f414c155fc0 msgr2=0x7f414c1ee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.239+0000 7f4150dc2640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f414c155fc0 0x7f414c1ee9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.239+0000 7f4150dc2640 1 -- 172.21.15.91:0/142045869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4140009400 con 0x7f414c0c1ca0 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.239+0000 7f41515c3640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f414c155fc0 0x7f414c1ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.239+0000 7f4150dc2640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c0c1ca0 0x7f414c1f25b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f41400098c0 tx=0x7f41400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.240+0000 7f41497fa640 1 -- 172.21.15.91:0/142045869 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140031500 con 0x7f414c0c1ca0 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.240+0000 7f41497fa640 1 -- 172.21.15.91:0/142045869 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41400339b0 con 0x7f414c0c1ca0 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.240+0000 7f41497fa640 1 -- 172.21.15.91:0/142045869 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140033d60 con 0x7f414c0c1ca0 2023-11-27T20:43:34.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.240+0000 7f4153026640 1 -- 172.21.15.91:0/142045869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c0a54b0 con 0x7f414c0c1ca0 2023-11-27T20:43:34.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.240+0000 7f4153026640 1 -- 172.21.15.91:0/142045869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c1e2a50 con 0x7f414c0c1ca0 2023-11-27T20:43:34.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.241+0000 7f4153026640 1 -- 172.21.15.91:0/142045869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c06dea0 con 0x7f414c0c1ca0 2023-11-27T20:43:34.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.242+0000 7f41497fa640 1 -- 172.21.15.91:0/142045869 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f414003a040 con 0x7f414c0c1ca0 2023-11-27T20:43:34.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.243+0000 7f41497fa640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f413006b1c0 0x7f413006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.243+0000 7f41497fa640 1 -- 172.21.15.91:0/142045869 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f41400aac10 con 0x7f414c0c1ca0 2023-11-27T20:43:34.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.243+0000 7f414bfff640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f413006b1c0 0x7f413006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.244+0000 7f414bfff640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f413006b1c0 0x7f413006d680 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f41380011e0 tx=0x7f4138009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:34.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.247+0000 7f41497fa640 1 -- 172.21.15.91:0/142045869 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4140075930 con 0x7f414c0c1ca0 2023-11-27T20:43:34.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.437+0000 7f4153026640 1 -- 172.21.15.91:0/142045869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f414c068350 con 0x7f414c0c1ca0 2023-11-27T20:43:34.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.438+0000 7f41497fa640 1 -- 172.21.15.91:0/142045869 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41400420a0 con 0x7f414c0c1ca0 2023-11-27T20:43:34.440 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:43:34.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 -- 172.21.15.91:0/142045869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f413006b1c0 msgr2=0x7f413006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f413006b1c0 0x7f413006d680 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f41380011e0 tx=0x7f4138009040 comp rx=0 tx=0).stop 2023-11-27T20:43:34.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 -- 172.21.15.91:0/142045869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c0c1ca0 msgr2=0x7f414c1f25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c0c1ca0 0x7f414c1f25b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f41400098c0 tx=0x7f41400046c0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 -- 172.21.15.91:0/142045869 shutdown_connections 2023-11-27T20:43:34.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f413006b1c0 0x7f413006d680 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f414c155fc0 0x7f414c1ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414c0c2e60 0x7f414c0c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 --2- 172.21.15.91:0/142045869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f414c0c1ca0 0x7f414c1f25b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 -- 172.21.15.91:0/142045869 >> 172.21.15.91:0/142045869 conn(0x7f414c06a500 msgr2=0x7f414c071e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:34.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 -- 172.21.15.91:0/142045869 shutdown_connections 2023-11-27T20:43:34.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.441+0000 7f4153026640 1 -- 172.21.15.91:0/142045869 wait complete. 2023-11-27T20:43:34.460 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:43:34.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.675+0000 7f4899aad640 1 Processor -- start 2023-11-27T20:43:34.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.675+0000 7f4899aad640 1 -- start start 2023-11-27T20:43:34.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.676+0000 7f4899aad640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f489414fd30 0x7f4894152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f4899aad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489406d0a0 0x7f48940a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f4899aad640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48940c64a0 con 0x7f48940a5260 2023-11-27T20:43:34.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f4899aad640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48940c5c00 con 0x7f489414fd30 2023-11-27T20:43:34.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f4899aad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48940c5ee0 con 0x7f489406d0a0 2023-11-27T20:43:34.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f48937fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f489414fd30 0x7f4894152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f48937fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f489414fd30 0x7f4894152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60290/0 (socket says 172.21.15.91:60290) 2023-11-27T20:43:34.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f48937fe640 1 -- 172.21.15.91:0/3645003191 learned_addr learned my addr 172.21.15.91:0/3645003191 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:34.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f48937fe640 1 -- 172.21.15.91:0/3645003191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489406d0a0 msgr2=0x7f48940a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:34.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f48937fe640 1 --2- 172.21.15.91:0/3645003191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489406d0a0 0x7f48940a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f48937fe640 1 -- 172.21.15.91:0/3645003191 >> v1:172.21.15.183:6789/0 conn(0x7f48940a5260 legacy=0x7f48940c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:34.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.677+0000 7f48937fe640 1 -- 172.21.15.91:0/3645003191 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940c61c0 con 0x7f489414fd30 2023-11-27T20:43:34.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.678+0000 7f48937fe640 1 --2- 172.21.15.91:0/3645003191 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 0x7f4894152f20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4884009870 tx=0x7f488402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434e02bb5ff3c6b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.679+0000 7f48927fc640 1 -- 172.21.15.91:0/3645003191 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884031640 con 0x7f489414fd30 2023-11-27T20:43:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.679+0000 7f48927fc640 1 -- 172.21.15.91:0/3645003191 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48840317a0 con 0x7f489414fd30 2023-11-27T20:43:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.679+0000 7f48927fc640 1 -- 172.21.15.91:0/3645003191 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884031b30 con 0x7f489414fd30 2023-11-27T20:43:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.679+0000 7f4899aad640 1 -- 172.21.15.91:0/3645003191 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 msgr2=0x7f4894152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.679+0000 7f4899aad640 1 --2- 172.21.15.91:0/3645003191 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 0x7f4894152f20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4884009870 tx=0x7f488402b8f0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.680+0000 7f4899aad640 1 -- 172.21.15.91:0/3645003191 shutdown_connections 2023-11-27T20:43:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.680+0000 7f4899aad640 1 --2- 172.21.15.91:0/3645003191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489406d0a0 0x7f48940a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.680+0000 7f4899aad640 1 --2- 172.21.15.91:0/3645003191 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 0x7f4894152f20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.680+0000 7f4899aad640 1 -- 172.21.15.91:0/3645003191 >> 172.21.15.91:0/3645003191 conn(0x7f489406a500 msgr2=0x7f489406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.680+0000 7f4899aad640 1 -- 172.21.15.91:0/3645003191 shutdown_connections 2023-11-27T20:43:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.680+0000 7f4899aad640 1 -- 172.21.15.91:0/3645003191 wait complete. 2023-11-27T20:43:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.681+0000 7f4899aad640 1 Processor -- start 2023-11-27T20:43:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.681+0000 7f4899aad640 1 -- start start 2023-11-27T20:43:34.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.682+0000 7f4899aad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489406d0a0 0x7f48941eb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.682+0000 7f4899aad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48940a5260 0x7f48941e9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.682+0000 7f4899aad640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 0x7f48941e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.682+0000 7f4899aad640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48941ec1b0 con 0x7f489414fd30 2023-11-27T20:43:34.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.682+0000 7f4899aad640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48941e9100 con 0x7f48940a5260 2023-11-27T20:43:34.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.682+0000 7f4899aad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48941ebed0 con 0x7f489406d0a0 2023-11-27T20:43:34.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.682+0000 7f4893fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 0x7f48941e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f4893fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 0x7f48941e9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60292/0 (socket says 172.21.15.91:60292) 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f4893fff640 1 -- 172.21.15.91:0/961630478 learned_addr learned my addr 172.21.15.91:0/961630478 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f48937fe640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489406d0a0 0x7f48941eb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f4892ffd640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48940a5260 0x7f48941e9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f4893fff640 1 -- 172.21.15.91:0/961630478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489406d0a0 msgr2=0x7f48941eb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f4893fff640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489406d0a0 0x7f48941eb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f4893fff640 1 -- 172.21.15.91:0/961630478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48940a5260 msgr2=0x7f48941e9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f4893fff640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48940a5260 0x7f48941e9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f4893fff640 1 -- 172.21.15.91:0/961630478 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48840094d0 con 0x7f489414fd30 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f4892ffd640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48940a5260 0x7f48941e9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f4893fff640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 0x7f48941e9ad0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c780 tx=0x7f488c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:34.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.683+0000 7f487bfff640 1 -- 172.21.15.91:0/961630478 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c004b60 con 0x7f489414fd30 2023-11-27T20:43:34.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.684+0000 7f487bfff640 1 -- 172.21.15.91:0/961630478 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c00ce90 con 0x7f489414fd30 2023-11-27T20:43:34.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.684+0000 7f487bfff640 1 -- 172.21.15.91:0/961630478 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c00a850 con 0x7f489414fd30 2023-11-27T20:43:34.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.684+0000 7f4899aad640 1 -- 172.21.15.91:0/961630478 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4894153a00 con 0x7f489414fd30 2023-11-27T20:43:34.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.684+0000 7f4899aad640 1 -- 172.21.15.91:0/961630478 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48940a8790 con 0x7f489414fd30 2023-11-27T20:43:34.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.685+0000 7f4899aad640 1 -- 172.21.15.91:0/961630478 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4894153860 con 0x7f489414fd30 2023-11-27T20:43:34.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.686+0000 7f487bfff640 1 -- 172.21.15.91:0/961630478 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f488c00a9b0 con 0x7f489414fd30 2023-11-27T20:43:34.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.687+0000 7f487bfff640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f488006b1f0 0x7f488006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:34.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.687+0000 7f487bfff640 1 -- 172.21.15.91:0/961630478 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f488c089c40 con 0x7f489414fd30 2023-11-27T20:43:34.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.687+0000 7f48937fe640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f488006b1f0 0x7f488006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:34.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.688+0000 7f48937fe640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f488006b1f0 0x7f488006d6b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4884036000 tx=0x7f488403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:34.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.691+0000 7f487bfff640 1 -- 172.21.15.91:0/961630478 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4894153860 con 0x7f489414fd30 2023-11-27T20:43:34.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.885+0000 7f4899aad640 1 -- 172.21.15.91:0/961630478 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4894153860 con 0x7f489414fd30 2023-11-27T20:43:34.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.885+0000 7f487bfff640 1 -- 172.21.15.91:0/961630478 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v43) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4894153860 con 0x7f489414fd30 2023-11-27T20:43:34.887 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:43:34.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 -- 172.21.15.91:0/961630478 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f488006b1f0 msgr2=0x7f488006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f488006b1f0 0x7f488006d6b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4884036000 tx=0x7f488403c040 comp rx=0 tx=0).stop 2023-11-27T20:43:34.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 -- 172.21.15.91:0/961630478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 msgr2=0x7f48941e9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:34.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 0x7f48941e9ad0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c780 tx=0x7f488c00cc40 comp rx=0 tx=0).stop 2023-11-27T20:43:34.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 -- 172.21.15.91:0/961630478 shutdown_connections 2023-11-27T20:43:34.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f489414fd30 0x7f48941e9ad0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f488006b1f0 0x7f488006d6b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48940a5260 0x7f48941e9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 --2- 172.21.15.91:0/961630478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489406d0a0 0x7f48941eb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:34.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 -- 172.21.15.91:0/961630478 >> 172.21.15.91:0/961630478 conn(0x7f489406a500 msgr2=0x7f489406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:34.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.888+0000 7f4899aad640 1 -- 172.21.15.91:0/961630478 shutdown_connections 2023-11-27T20:43:34.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:34.889+0000 7f4899aad640 1 -- 172.21.15.91:0/961630478 wait complete. 2023-11-27T20:43:34.907 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:43:35.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.110+0000 7f9cec826640 1 Processor -- start 2023-11-27T20:43:35.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.110+0000 7f9cec826640 1 -- start start 2023-11-27T20:43:35.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.112+0000 7f9cec826640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9ce80c1500 0x7f9ce80c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.112+0000 7f9cec826640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce80c06c0 con 0x7f9ce80a9b40 2023-11-27T20:43:35.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.112+0000 7f9cec826640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce80c1020 con 0x7f9ce8155490 2023-11-27T20:43:35.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.112+0000 7f9cec826640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce80a5820 con 0x7f9ce80c1500 2023-11-27T20:43:35.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.112+0000 7f9cdffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f9ce80a9b40 0x7f9ce80c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49752/0 (socket says 172.21.15.91:49752) 2023-11-27T20:43:35.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.112+0000 7f9cdffff640 1 -- 172.21.15.91:0/3576332095 learned_addr learned my addr 172.21.15.91:0/3576332095 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:35.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.112+0000 7f9ce6d9d640 1 --2- 172.21.15.91:0/3576332095 >> v2:172.21.15.183:3300/0 conn(0x7f9ce80c1500 0x7f9ce80c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.112+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146425654 0 0) 0x7f9ce80c06c0 con 0x7f9ce80a9b40 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.112+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cd4003520 con 0x7f9ce80a9b40 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3676135560 0 0) 0x7f9cd4003520 con 0x7f9ce80a9b40 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 >> v2:172.21.15.183:3300/0 conn(0x7f9ce80c1500 msgr2=0x7f9ce80c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 --2- 172.21.15.91:0/3576332095 >> v2:172.21.15.183:3300/0 conn(0x7f9ce80c1500 0x7f9ce80c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 >> v1:172.21.15.183:6789/0 conn(0x7f9ce8155490 legacy=0x7f9ce80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80c0910 con 0x7f9ce80a9b40 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f9cd0001670 con 0x7f9ce80a9b40 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 >> v1:172.21.15.91:6789/0 conn(0x7f9ce80a9b40 legacy=0x7f9ce80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4003970 0x7f9cd4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9cd40047c0 0x7f9cd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cd4005180 0x7f9cd400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd400e290 con 0x7f9cd4005180 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd400e400 con 0x7f9cd4003970 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd400e5c0 con 0x7f9cd40047c0 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.113+0000 7f9ce6d9d640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cd4005180 0x7f9cd400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.114+0000 7f9ce659c640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4003970 0x7f9cd4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.114+0000 7f9ce6d9d640 1 -- 172.21.15.91:0/3576332095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9cd40047c0 msgr2=0x7f9cd4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.114+0000 7f9cdffff640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9cd40047c0 0x7f9cd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.114+0000 7f9ce6d9d640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9cd40047c0 0x7f9cd4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.114+0000 7f9ce6d9d640 1 -- 172.21.15.91:0/3576332095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4003970 msgr2=0x7f9cd4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.114+0000 7f9ce6d9d640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4003970 0x7f9cd4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.114+0000 7f9ce6d9d640 1 -- 172.21.15.91:0/3576332095 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd4003520 con 0x7f9cd4005180 2023-11-27T20:43:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.114+0000 7f9ce659c640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4003970 0x7f9cd4003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.115+0000 7f9ce6d9d640 1 -- 172.21.15.91:0/3576332095 reap_dead start 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.115+0000 7f9ce6d9d640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cd4005180 0x7f9cd400db90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0007330 tx=0x7f9cd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579250f0afb81917 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.115+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce002ccd0 con 0x7f9cd4005180 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.115+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce002ce30 con 0x7f9cd4005180 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.115+0000 7f9ce5d9b640 1 -- 172.21.15.91:0/3576332095 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0003bd0 con 0x7f9cd4005180 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.116+0000 7f9cec826640 1 -- 172.21.15.91:0/3576332095 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cd4005180 msgr2=0x7f9cd400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.116+0000 7f9cec826640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cd4005180 0x7f9cd400db90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0007330 tx=0x7f9cd40057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.116+0000 7f9cec826640 1 -- 172.21.15.91:0/3576332095 shutdown_connections 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.116+0000 7f9cec826640 1 --2- 172.21.15.91:0/3576332095 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cd4005180 0x7f9cd400db90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.116+0000 7f9cec826640 1 -- 172.21.15.91:0/3576332095 >> 172.21.15.91:0/3576332095 conn(0x7f9ce806a500 msgr2=0x7f9ce806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.116+0000 7f9cec826640 1 -- 172.21.15.91:0/3576332095 shutdown_connections 2023-11-27T20:43:35.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.116+0000 7f9cec826640 1 -- 172.21.15.91:0/3576332095 wait complete. 2023-11-27T20:43:35.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.118+0000 7f9cec826640 1 Processor -- start 2023-11-27T20:43:35.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.118+0000 7f9cec826640 1 -- start start 2023-11-27T20:43:35.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.119+0000 7f9cec826640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4005180 0x7f9ce80a7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.119+0000 7f9cec826640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ce8070760 0x7f9ce814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.119+0000 7f9cec826640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ce8070be0 0x7f9ce81504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.119+0000 7f9cec826640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80a4300 con 0x7f9ce8070be0 2023-11-27T20:43:35.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.119+0000 7f9cec826640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce81ea050 con 0x7f9cd4005180 2023-11-27T20:43:35.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.119+0000 7f9cec826640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce81ea330 con 0x7f9ce8070760 2023-11-27T20:43:35.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.119+0000 7f9ce6d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ce8070be0 0x7f9ce81504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.119+0000 7f9ce6d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ce8070be0 0x7f9ce81504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60308/0 (socket says 172.21.15.91:60308) 2023-11-27T20:43:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.119+0000 7f9ce6d9d640 1 -- 172.21.15.91:0/1400368116 learned_addr learned my addr 172.21.15.91:0/1400368116 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.119+0000 7f9ce659c640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4005180 0x7f9ce80a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9ce6d9d640 1 -- 172.21.15.91:0/1400368116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ce8070760 msgr2=0x7f9ce814ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9ce6d9d640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ce8070760 0x7f9ce814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9ce6d9d640 1 -- 172.21.15.91:0/1400368116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4005180 msgr2=0x7f9ce80a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9ce6d9d640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4005180 0x7f9ce80a7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9ce6d9d640 1 -- 172.21.15.91:0/1400368116 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80a4550 con 0x7f9ce8070be0 2023-11-27T20:43:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9ce659c640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4005180 0x7f9ce80a7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9ce6d9d640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ce8070be0 0x7f9ce81504c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0007450 tx=0x7f9ce0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9cdeffd640 1 -- 172.21.15.91:0/1400368116 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00044d0 con 0x7f9ce8070be0 2023-11-27T20:43:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9cdeffd640 1 -- 172.21.15.91:0/1400368116 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce0004650 con 0x7f9ce8070be0 2023-11-27T20:43:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9cdeffd640 1 -- 172.21.15.91:0/1400368116 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0003e30 con 0x7f9ce8070be0 2023-11-27T20:43:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9cec826640 1 -- 172.21.15.91:0/1400368116 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce80a4830 con 0x7f9ce8070be0 2023-11-27T20:43:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.120+0000 7f9cec826640 1 -- 172.21.15.91:0/1400368116 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce80c01f0 con 0x7f9ce8070be0 2023-11-27T20:43:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.121+0000 7f9cec826640 1 -- 172.21.15.91:0/1400368116 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce81ea4f0 con 0x7f9ce8070be0 2023-11-27T20:43:35.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.122+0000 7f9cdeffd640 1 -- 172.21.15.91:0/1400368116 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9ce003b070 con 0x7f9ce8070be0 2023-11-27T20:43:35.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.123+0000 7f9cdeffd640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cc806b1f0 0x7f9cc806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.123+0000 7f9cdeffd640 1 -- 172.21.15.91:0/1400368116 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f9ce00aae50 con 0x7f9ce8070be0 2023-11-27T20:43:35.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.124+0000 7f9ce659c640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cc806b1f0 0x7f9cc806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.124+0000 7f9ce659c640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cc806b1f0 0x7f9cc806d6b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9ce81e7370 tx=0x7f9cd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:35.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.128+0000 7f9cdeffd640 1 -- 172.21.15.91:0/1400368116 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9ce81ea4f0 con 0x7f9ce8070be0 2023-11-27T20:43:35.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.320+0000 7f9cec826640 1 -- 172.21.15.91:0/1400368116 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9ce81ea4f0 con 0x7f9ce8070be0 2023-11-27T20:43:35.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.321+0000 7f9cdeffd640 1 -- 172.21.15.91:0/1400368116 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v43) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9ce81ea4f0 con 0x7f9ce8070be0 2023-11-27T20:43:35.322 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:43:35.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.323+0000 7f9cec826640 1 -- 172.21.15.91:0/1400368116 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cc806b1f0 msgr2=0x7f9cc806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.323+0000 7f9cec826640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cc806b1f0 0x7f9cc806d6b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9ce81e7370 tx=0x7f9cd8009040 comp rx=0 tx=0).stop 2023-11-27T20:43:35.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.323+0000 7f9cec826640 1 -- 172.21.15.91:0/1400368116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ce8070be0 msgr2=0x7f9ce81504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.323+0000 7f9cec826640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ce8070be0 0x7f9ce81504c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0007450 tx=0x7f9ce0004ab0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.324+0000 7f9cec826640 1 -- 172.21.15.91:0/1400368116 shutdown_connections 2023-11-27T20:43:35.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.324+0000 7f9cec826640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ce8070be0 0x7f9ce81504c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.324+0000 7f9cec826640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ce8070760 0x7f9ce814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.324+0000 7f9cec826640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9cc806b1f0 0x7f9cc806d6b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.324+0000 7f9cec826640 1 --2- 172.21.15.91:0/1400368116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9cd4005180 0x7f9ce80a7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.324+0000 7f9cec826640 1 -- 172.21.15.91:0/1400368116 >> 172.21.15.91:0/1400368116 conn(0x7f9ce806a500 msgr2=0x7f9ce80a8440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:35.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.324+0000 7f9cec826640 1 -- 172.21.15.91:0/1400368116 shutdown_connections 2023-11-27T20:43:35.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.324+0000 7f9cec826640 1 -- 172.21.15.91:0/1400368116 wait complete. 2023-11-27T20:43:35.344 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:35.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.551+0000 7fdbf93d0640 1 Processor -- start 2023-11-27T20:43:35.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.551+0000 7fdbf93d0640 1 -- start start 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf93d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbf4155490 0x7fdbf40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf93d0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdbf40a9b40 0x7fdbf40c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf93d0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf40c06c0 con 0x7fdbf40c1500 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf93d0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf40a5820 con 0x7fdbf40a9b40 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf93d0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40c1020 con 0x7fdbf4155490 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf37fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdbf40a9b40 0x7fdbf40c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf37fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdbf40a9b40 0x7fdbf40c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60318/0 (socket says 172.21.15.91:60318) 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf37fe640 1 -- 172.21.15.91:0/434924980 learned_addr learned my addr 172.21.15.91:0/434924980 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf2ffd640 1 --2- 172.21.15.91:0/434924980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbf4155490 0x7fdbf40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf37fe640 1 -- 172.21.15.91:0/434924980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbf4155490 msgr2=0x7fdbf40a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:35.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf37fe640 1 --2- 172.21.15.91:0/434924980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbf4155490 0x7fdbf40a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf37fe640 1 -- 172.21.15.91:0/434924980 >> v1:172.21.15.183:6789/0 conn(0x7fdbf40c1500 legacy=0x7fdbf40a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:35.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.553+0000 7fdbf37fe640 1 -- 172.21.15.91:0/434924980 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf40c0910 con 0x7fdbf40a9b40 2023-11-27T20:43:35.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.555+0000 7fdbf37fe640 1 --2- 172.21.15.91:0/434924980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf40a9b40 0x7fdbf40c24d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009e50 tx=0x7fdbec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85096a23c60b2cc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:35.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.555+0000 7fdbf27fc640 1 -- 172.21.15.91:0/434924980 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec02ca70 con 0x7fdbf40a9b40 2023-11-27T20:43:35.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.555+0000 7fdbf27fc640 1 -- 172.21.15.91:0/434924980 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec02cbd0 con 0x7fdbf40a9b40 2023-11-27T20:43:35.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.555+0000 7fdbf27fc640 1 -- 172.21.15.91:0/434924980 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec0343f0 con 0x7fdbf40a9b40 2023-11-27T20:43:35.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.556+0000 7fdbf93d0640 1 -- 172.21.15.91:0/434924980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf40a9b40 msgr2=0x7fdbf40c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.556+0000 7fdbf93d0640 1 --2- 172.21.15.91:0/434924980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf40a9b40 0x7fdbf40c24d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009e50 tx=0x7fdbec02bed0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.556+0000 7fdbf93d0640 1 -- 172.21.15.91:0/434924980 shutdown_connections 2023-11-27T20:43:35.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.556+0000 7fdbf93d0640 1 --2- 172.21.15.91:0/434924980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf40a9b40 0x7fdbf40c24d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.556+0000 7fdbf93d0640 1 --2- 172.21.15.91:0/434924980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbf4155490 0x7fdbf40a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.556+0000 7fdbf93d0640 1 -- 172.21.15.91:0/434924980 >> 172.21.15.91:0/434924980 conn(0x7fdbf406a500 msgr2=0x7fdbf406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:35.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.556+0000 7fdbf93d0640 1 -- 172.21.15.91:0/434924980 shutdown_connections 2023-11-27T20:43:35.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.556+0000 7fdbf93d0640 1 -- 172.21.15.91:0/434924980 wait complete. 2023-11-27T20:43:35.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.557+0000 7fdbf93d0640 1 Processor -- start 2023-11-27T20:43:35.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.558+0000 7fdbf93d0640 1 -- start start 2023-11-27T20:43:35.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.558+0000 7fdbf93d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbf40c1500 0x7fdbf4151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf93d0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbf4155490 0x7fdbf41edea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf93d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf406d510 0x7fdbf40bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf93d0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf414fe80 con 0x7fdbf406d510 2023-11-27T20:43:35.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf93d0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf415c8d0 con 0x7fdbf4155490 2023-11-27T20:43:35.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf93d0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf41ee3e0 con 0x7fdbf40c1500 2023-11-27T20:43:35.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf406d510 0x7fdbf40bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf406d510 0x7fdbf40bbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60332/0 (socket says 172.21.15.91:60332) 2023-11-27T20:43:35.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf37fe640 1 -- 172.21.15.91:0/2383570388 learned_addr learned my addr 172.21.15.91:0/2383570388 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf37fe640 1 -- 172.21.15.91:0/2383570388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbf40c1500 msgr2=0x7fdbf4151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf37fe640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbf40c1500 0x7fdbf4151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf37fe640 1 -- 172.21.15.91:0/2383570388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbf4155490 msgr2=0x7fdbf41edea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf37fe640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbf4155490 0x7fdbf41edea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.559+0000 7fdbf37fe640 1 -- 172.21.15.91:0/2383570388 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec009b30 con 0x7fdbf406d510 2023-11-27T20:43:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.560+0000 7fdbf37fe640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf406d510 0x7fdbf40bbe80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009e50 tx=0x7fdbec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.560+0000 7fdbeb7fe640 1 -- 172.21.15.91:0/2383570388 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec009510 con 0x7fdbf406d510 2023-11-27T20:43:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.560+0000 7fdbeb7fe640 1 -- 172.21.15.91:0/2383570388 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec03e450 con 0x7fdbf406d510 2023-11-27T20:43:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.560+0000 7fdbeb7fe640 1 -- 172.21.15.91:0/2383570388 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec03e800 con 0x7fdbf406d510 2023-11-27T20:43:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.560+0000 7fdbf93d0640 1 -- 172.21.15.91:0/2383570388 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf415d900 con 0x7fdbf406d510 2023-11-27T20:43:35.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.560+0000 7fdbf93d0640 1 -- 172.21.15.91:0/2383570388 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf415cae0 con 0x7fdbf406d510 2023-11-27T20:43:35.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.561+0000 7fdbf93d0640 1 -- 172.21.15.91:0/2383570388 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf4068350 con 0x7fdbf406d510 2023-11-27T20:43:35.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.562+0000 7fdbeb7fe640 1 -- 172.21.15.91:0/2383570388 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdbec03e960 con 0x7fdbf406d510 2023-11-27T20:43:35.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.563+0000 7fdbeb7fe640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdbd406b1f0 0x7fdbd406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:35.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.563+0000 7fdbeb7fe640 1 -- 172.21.15.91:0/2383570388 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fdbec0ac9a0 con 0x7fdbf406d510 2023-11-27T20:43:35.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.563+0000 7fdbf2ffd640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdbd406b1f0 0x7fdbd406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:35.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.564+0000 7fdbf2ffd640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdbd406b1f0 0x7fdbd406d6b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400a810 tx=0x7fdbe4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:35.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.568+0000 7fdbeb7fe640 1 -- 172.21.15.91:0/2383570388 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdbec077640 con 0x7fdbf406d510 2023-11-27T20:43:35.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.795+0000 7fdbf93d0640 1 -- 172.21.15.91:0/2383570388 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbf4067680 con 0x7fdbf406d510 2023-11-27T20:43:35.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.796+0000 7fdbeb7fe640 1 -- 172.21.15.91:0/2383570388 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fdbec07ac60 con 0x7fdbf406d510 2023-11-27T20:43:35.797 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:35.797 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/32693995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":32693995},{"type":"v1","addr":"172.21.15.183:6834","nonce":32693995}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:58.980635+0000","modified":"2023-11-27T20:43:02.065929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":10,"addr":"172.21.15.91:6837/127433365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":127433365},{"type":"v1","addr":"172.21.15.91:6837","nonce":127433365}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-27T20:43:35.798 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 22 2023-11-27T20:43:35.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.798+0000 7fdbf93d0640 1 -- 172.21.15.91:0/2383570388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdbd406b1f0 msgr2=0x7fdbd406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.798+0000 7fdbf93d0640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdbd406b1f0 0x7fdbd406d6b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400a810 tx=0x7fdbe4008040 comp rx=0 tx=0).stop 2023-11-27T20:43:35.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.799+0000 7fdbf93d0640 1 -- 172.21.15.91:0/2383570388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf406d510 msgr2=0x7fdbf40bbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:35.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.799+0000 7fdbf93d0640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf406d510 0x7fdbf40bbe80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009e50 tx=0x7fdbec004a40 comp rx=0 tx=0).stop 2023-11-27T20:43:35.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.799+0000 7fdbf93d0640 1 -- 172.21.15.91:0/2383570388 shutdown_connections 2023-11-27T20:43:35.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.799+0000 7fdbf93d0640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf406d510 0x7fdbf40bbe80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.799+0000 7fdbf93d0640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdbd406b1f0 0x7fdbd406d6b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.799+0000 7fdbf93d0640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbf4155490 0x7fdbf41edea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.799+0000 7fdbf93d0640 1 --2- 172.21.15.91:0/2383570388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbf40c1500 0x7fdbf4151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:35.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.799+0000 7fdbf93d0640 1 -- 172.21.15.91:0/2383570388 >> 172.21.15.91:0/2383570388 conn(0x7fdbf406a500 msgr2=0x7fdbf40aa940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:35.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.799+0000 7fdbf93d0640 1 -- 172.21.15.91:0/2383570388 shutdown_connections 2023-11-27T20:43:35.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:35.799+0000 7fdbf93d0640 1 -- 172.21.15.91:0/2383570388 wait complete. 2023-11-27T20:43:35.820 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:36.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.031+0000 7fecca306640 1 Processor -- start 2023-11-27T20:43:36.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.031+0000 7fecca306640 1 -- start start 2023-11-27T20:43:36.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.032+0000 7fecca306640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fecc40c52e0 0x7fecc406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.032+0000 7fecca306640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc40a8380 con 0x7fecc414e7f0 2023-11-27T20:43:36.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.032+0000 7fecca306640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc41510b0 con 0x7fecc406cd20 2023-11-27T20:43:36.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.032+0000 7fecca306640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc406bf60 con 0x7fecc40c52e0 2023-11-27T20:43:36.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecc9304640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fecc414e7f0 0x7fecc40c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49762/0 (socket says 172.21.15.91:49762) 2023-11-27T20:43:36.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecc9304640 1 -- 172.21.15.91:0/1236134643 learned_addr learned my addr 172.21.15.91:0/1236134643 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecc8b03640 1 --2- 172.21.15.91:0/1236134643 >> v2:172.21.15.183:3300/0 conn(0x7fecc40c52e0 0x7fecc406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123632080 0 0) 0x7fecc40a8380 con 0x7fecc414e7f0 2023-11-27T20:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb0005730 con 0x7fecc414e7f0 2023-11-27T20:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4022557058 0 0) 0x7fecb0005730 con 0x7fecc414e7f0 2023-11-27T20:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 >> v2:172.21.15.183:3300/0 conn(0x7fecc40c52e0 msgr2=0x7fecc406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecbbfff640 1 --2- 172.21.15.91:0/1236134643 >> v2:172.21.15.183:3300/0 conn(0x7fecc40c52e0 0x7fecc406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 >> v1:172.21.15.183:6789/0 conn(0x7fecc406cd20 legacy=0x7fecc415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc406c240 con 0x7fecc414e7f0 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.033+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fecc0001670 con 0x7fecc414e7f0 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 >> v1:172.21.15.91:6789/0 conn(0x7fecc414e7f0 legacy=0x7fecc40c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecbbfff640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb0005b80 0x7fecb0005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecbbfff640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecb0006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecbbfff640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb00074b0 0x7fecb000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc406bf60 con 0x7fecb00069d0 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb000e380 con 0x7fecb0005b80 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb000e540 con 0x7fecb00074b0 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecc8b03640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecb0006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecc9304640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb0005b80 0x7fecb0005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecc8b03640 1 -- 172.21.15.91:0/1236134643 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb00074b0 msgr2=0x7fecb000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecc9b05640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb00074b0 0x7fecb000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecc8b03640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb00074b0 0x7fecb000db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecc8b03640 1 -- 172.21.15.91:0/1236134643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb0005b80 msgr2=0x7fecb0005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecc8b03640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb0005b80 0x7fecb0005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecc8b03640 1 -- 172.21.15.91:0/1236134643 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb0005730 con 0x7fecb00069d0 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecc9b05640 1 -- 172.21.15.91:0/1236134643 reap_dead start 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.034+0000 7fecc9304640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb0005b80 0x7fecb0005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.035+0000 7fecc8b03640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecb0006e50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fecb400ba00 tx=0x7fecb0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24290f3176d0348 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.036+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb40325f0 con 0x7fecb00069d0 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.036+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb4032750 con 0x7fecb00069d0 2023-11-27T20:43:36.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.036+0000 7fecbbfff640 1 -- 172.21.15.91:0/1236134643 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4032ae0 con 0x7fecb00069d0 2023-11-27T20:43:36.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.036+0000 7fecca306640 1 -- 172.21.15.91:0/1236134643 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 msgr2=0x7fecb0006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.036+0000 7fecca306640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecb0006e50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fecb400ba00 tx=0x7fecb0007a00 comp rx=0 tx=0).stop 2023-11-27T20:43:36.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.036+0000 7fecca306640 1 -- 172.21.15.91:0/1236134643 shutdown_connections 2023-11-27T20:43:36.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.036+0000 7fecca306640 1 --2- 172.21.15.91:0/1236134643 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecb0006e50 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.036+0000 7fecca306640 1 -- 172.21.15.91:0/1236134643 >> 172.21.15.91:0/1236134643 conn(0x7fecc40a77f0 msgr2=0x7fecc40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:36.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.036+0000 7fecca306640 1 -- 172.21.15.91:0/1236134643 shutdown_connections 2023-11-27T20:43:36.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.037+0000 7fecca306640 1 -- 172.21.15.91:0/1236134643 wait complete. 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.038+0000 7fecca306640 1 Processor -- start 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.038+0000 7fecca306640 1 -- start start 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.039+0000 7fecca306640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecc41ee400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.039+0000 7fecca306640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecc4148a90 0x7fecc414c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.039+0000 7fecca306640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecc4150810 0x7fecc414fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.039+0000 7fecca306640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc414ce80 con 0x7fecb00069d0 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.039+0000 7fecca306640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc414f0f0 con 0x7fecc4148a90 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.039+0000 7fecca306640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc414f670 con 0x7fecc4150810 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.039+0000 7fecc9304640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecc41ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.039+0000 7fecc9304640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecc41ee400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60354/0 (socket says 172.21.15.91:60354) 2023-11-27T20:43:36.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.039+0000 7fecc9304640 1 -- 172.21.15.91:0/1860531614 learned_addr learned my addr 172.21.15.91:0/1860531614 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:36.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecc9304640 1 -- 172.21.15.91:0/1860531614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecc4150810 msgr2=0x7fecc414fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecc9304640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecc4150810 0x7fecc414fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecc8b03640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecc4148a90 0x7fecc414c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecc9304640 1 -- 172.21.15.91:0/1860531614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecc4148a90 msgr2=0x7fecc414c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecc9304640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecc4148a90 0x7fecc414c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecc9304640 1 -- 172.21.15.91:0/1860531614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc414c640 con 0x7fecb00069d0 2023-11-27T20:43:36.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecc9304640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecc41ee400 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fecc000d7d0 tx=0x7fecc000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:36.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecb9ffb640 1 -- 172.21.15.91:0/1860531614 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00074e0 con 0x7fecb00069d0 2023-11-27T20:43:36.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecb9ffb640 1 -- 172.21.15.91:0/1860531614 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc0007640 con 0x7fecb00069d0 2023-11-27T20:43:36.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecca306640 1 -- 172.21.15.91:0/1860531614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc414c8c0 con 0x7fecb00069d0 2023-11-27T20:43:36.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.040+0000 7fecb9ffb640 1 -- 172.21.15.91:0/1860531614 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0004a00 con 0x7fecb00069d0 2023-11-27T20:43:36.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.041+0000 7fecca306640 1 -- 172.21.15.91:0/1860531614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc414f300 con 0x7fecb00069d0 2023-11-27T20:43:36.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.042+0000 7fecca306640 1 -- 172.21.15.91:0/1860531614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc40a5140 con 0x7fecb00069d0 2023-11-27T20:43:36.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.043+0000 7fecb9ffb640 1 -- 172.21.15.91:0/1860531614 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fecc0004b60 con 0x7fecb00069d0 2023-11-27T20:43:36.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.044+0000 7fecb9ffb640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feca806b1f0 0x7feca806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.044+0000 7fecb9ffb640 1 -- 172.21.15.91:0/1860531614 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fecc0089700 con 0x7fecb00069d0 2023-11-27T20:43:36.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.044+0000 7fecc8b03640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feca806b1f0 0x7feca806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.045+0000 7fecc8b03640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feca806b1f0 0x7feca806d6b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fecb0006950 tx=0x7fecb403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:36.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.048+0000 7fecb9ffb640 1 -- 172.21.15.91:0/1860531614 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fecc40a5140 con 0x7fecb00069d0 2023-11-27T20:43:36.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.238+0000 7fecca306640 1 -- 172.21.15.91:0/1860531614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecc40a5140 con 0x7fecb00069d0 2023-11-27T20:43:36.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.240+0000 7fecb9ffb640 1 -- 172.21.15.91:0/1860531614 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16765 (secure 0 0 0) 0x7fecc40a5140 con 0x7fecb00069d0 2023-11-27T20:43:36.242 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:36.242 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":43,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:33.543492+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.183:6834/3450105603":"2023-11-28T20:43:30.441853+0000","172.21.15.183:6832/3450105603":"2023-11-28T20:43:30.441853+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.243+0000 7fecca306640 1 -- 172.21.15.91:0/1860531614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feca806b1f0 msgr2=0x7feca806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.243+0000 7fecca306640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feca806b1f0 0x7feca806d6b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fecb0006950 tx=0x7fecb403d040 comp rx=0 tx=0).stop 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.243+0000 7fecca306640 1 -- 172.21.15.91:0/1860531614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 msgr2=0x7fecc41ee400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.243+0000 7fecca306640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecc41ee400 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fecc000d7d0 tx=0x7fecc000dc90 comp rx=0 tx=0).stop 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.243+0000 7fecca306640 1 -- 172.21.15.91:0/1860531614 shutdown_connections 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.243+0000 7fecca306640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecc4150810 0x7fecc414fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.243+0000 7fecca306640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feca806b1f0 0x7feca806d6b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.243+0000 7fecca306640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecc4148a90 0x7fecc414c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.243+0000 7fecca306640 1 --2- 172.21.15.91:0/1860531614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb00069d0 0x7fecc41ee400 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.243+0000 7fecca306640 1 -- 172.21.15.91:0/1860531614 >> 172.21.15.91:0/1860531614 conn(0x7fecc40a77f0 msgr2=0x7fecc41480b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.244+0000 7fecca306640 1 -- 172.21.15.91:0/1860531614 shutdown_connections 2023-11-27T20:43:36.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.244+0000 7fecca306640 1 -- 172.21.15.91:0/1860531614 wait complete. 2023-11-27T20:43:36.263 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-27T20:43:36.263 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:36.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.464+0000 7fbcd66ea640 1 Processor -- start 2023-11-27T20:43:36.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.464+0000 7fbcd66ea640 1 -- start start 2023-11-27T20:43:36.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.465+0000 7fbcd66ea640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbcd00ca450 0x7fbcd00ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.465+0000 7fbcd66ea640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbcd0154580 0x7fbcd0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.465+0000 7fbcd66ea640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd0158a60 con 0x7fbcd014e7c0 2023-11-27T20:43:36.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.465+0000 7fbcd66ea640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd00c5b10 con 0x7fbcd0154580 2023-11-27T20:43:36.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.465+0000 7fbcd66ea640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00c4dd0 con 0x7fbcd00ca450 2023-11-27T20:43:36.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.466+0000 7fbcd56e8640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fbcd014e7c0 0x7fbcd00c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49774/0 (socket says 172.21.15.91:49774) 2023-11-27T20:43:36.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.466+0000 7fbcd56e8640 1 -- 172.21.15.91:0/3396726367 learned_addr learned my addr 172.21.15.91:0/3396726367 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:36.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.466+0000 7fbcd5ee9640 1 --2- 172.21.15.91:0/3396726367 >> v2:172.21.15.91:3300/0 conn(0x7fbcd0154580 0x7fbcd0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.466+0000 7fbcd4ee7640 1 --2- 172.21.15.91:0/3396726367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbcd00ca450 0x7fbcd00ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.466+0000 7fbcc7fff640 1 -- 172.21.15.91:0/3396726367 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768659068 0 0) 0x7fbcd0158a60 con 0x7fbcd014e7c0 2023-11-27T20:43:36.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.466+0000 7fbcd5ee9640 1 -- 172.21.15.91:0/3396726367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbcd00ca450 msgr2=0x7fbcd00ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:36.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.466+0000 7fbcd5ee9640 1 --2- 172.21.15.91:0/3396726367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbcd00ca450 0x7fbcd00ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.466+0000 7fbcd5ee9640 1 -- 172.21.15.91:0/3396726367 >> v1:172.21.15.91:6789/0 conn(0x7fbcd014e7c0 legacy=0x7fbcd00c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.466+0000 7fbcd5ee9640 1 -- 172.21.15.91:0/3396726367 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd0157ca0 con 0x7fbcd0154580 2023-11-27T20:43:36.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.467+0000 7fbcd5ee9640 1 --2- 172.21.15.91:0/3396726367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd0154580 0x7fbcd0154a10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80097a0 tx=0x7fbcc802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f9f54024c262ae server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:36.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.467+0000 7fbcc7fff640 1 -- 172.21.15.91:0/3396726367 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc802f050 con 0x7fbcd0154580 2023-11-27T20:43:36.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.467+0000 7fbcc7fff640 1 -- 172.21.15.91:0/3396726367 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc8031700 con 0x7fbcd0154580 2023-11-27T20:43:36.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.467+0000 7fbcc7fff640 1 -- 172.21.15.91:0/3396726367 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8031a90 con 0x7fbcd0154580 2023-11-27T20:43:36.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.468+0000 7fbcd66ea640 1 -- 172.21.15.91:0/3396726367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd0154580 msgr2=0x7fbcd0154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.468+0000 7fbcd66ea640 1 --2- 172.21.15.91:0/3396726367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd0154580 0x7fbcd0154a10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80097a0 tx=0x7fbcc802b7a0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.468+0000 7fbcd66ea640 1 -- 172.21.15.91:0/3396726367 shutdown_connections 2023-11-27T20:43:36.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.468+0000 7fbcd66ea640 1 --2- 172.21.15.91:0/3396726367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd0154580 0x7fbcd0154a10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.468+0000 7fbcd66ea640 1 --2- 172.21.15.91:0/3396726367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbcd00ca450 0x7fbcd00ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.468+0000 7fbcd66ea640 1 -- 172.21.15.91:0/3396726367 >> 172.21.15.91:0/3396726367 conn(0x7fbcd00abf00 msgr2=0x7fbcd00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:36.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.468+0000 7fbcd66ea640 1 -- 172.21.15.91:0/3396726367 shutdown_connections 2023-11-27T20:43:36.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.468+0000 7fbcd66ea640 1 -- 172.21.15.91:0/3396726367 wait complete. 2023-11-27T20:43:36.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.470+0000 7fbcd66ea640 1 Processor -- start 2023-11-27T20:43:36.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.470+0000 7fbcd66ea640 1 -- start start 2023-11-27T20:43:36.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd66ea640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbcd00ca450 0x7fbcd014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd66ea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd014e7c0 0x7fbcd01ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd66ea640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbcd0154580 0x7fbcd014a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd66ea640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd01edff0 con 0x7fbcd014e7c0 2023-11-27T20:43:36.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd66ea640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd01edd50 con 0x7fbcd00ca450 2023-11-27T20:43:36.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd66ea640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd0156d60 con 0x7fbcd0154580 2023-11-27T20:43:36.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd4ee7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd014e7c0 0x7fbcd01ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd4ee7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd014e7c0 0x7fbcd01ed480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60386/0 (socket says 172.21.15.91:60386) 2023-11-27T20:43:36.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd4ee7640 1 -- 172.21.15.91:0/1312799380 learned_addr learned my addr 172.21.15.91:0/1312799380 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:36.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd4ee7640 1 -- 172.21.15.91:0/1312799380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbcd0154580 msgr2=0x7fbcd014a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd4ee7640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbcd0154580 0x7fbcd014a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd4ee7640 1 -- 172.21.15.91:0/1312799380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbcd00ca450 msgr2=0x7fbcd014bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd4ee7640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbcd00ca450 0x7fbcd014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.471+0000 7fbcd4ee7640 1 -- 172.21.15.91:0/1312799380 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8009400 con 0x7fbcd014e7c0 2023-11-27T20:43:36.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.472+0000 7fbcd4ee7640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd014e7c0 0x7fbcd01ed480 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000c7f0 tx=0x7fbcc000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:36.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.472+0000 7fbcc5ffb640 1 -- 172.21.15.91:0/1312799380 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0004220 con 0x7fbcd014e7c0 2023-11-27T20:43:36.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.472+0000 7fbcc5ffb640 1 -- 172.21.15.91:0/1312799380 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc0004380 con 0x7fbcd014e7c0 2023-11-27T20:43:36.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.472+0000 7fbcd66ea640 1 -- 172.21.15.91:0/1312799380 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd0157040 con 0x7fbcd014e7c0 2023-11-27T20:43:36.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.472+0000 7fbcc5ffb640 1 -- 172.21.15.91:0/1312799380 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0007840 con 0x7fbcd014e7c0 2023-11-27T20:43:36.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.472+0000 7fbcd66ea640 1 -- 172.21.15.91:0/1312799380 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd0156630 con 0x7fbcd014e7c0 2023-11-27T20:43:36.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.473+0000 7fbcd66ea640 1 -- 172.21.15.91:0/1312799380 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd0156bc0 con 0x7fbcd014e7c0 2023-11-27T20:43:36.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.474+0000 7fbcc5ffb640 1 -- 172.21.15.91:0/1312799380 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbcc0007bb0 con 0x7fbcd014e7c0 2023-11-27T20:43:36.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.475+0000 7fbcc5ffb640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbcb406b1c0 0x7fbcb406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.475+0000 7fbcc5ffb640 1 -- 172.21.15.91:0/1312799380 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fbcc0089920 con 0x7fbcd014e7c0 2023-11-27T20:43:36.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.475+0000 7fbcd56e8640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbcb406b1c0 0x7fbcb406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.476+0000 7fbcd56e8640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbcb406b1c0 0x7fbcb406d680 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbccc007fd0 tx=0x7fbccc007ce0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:36.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.479+0000 7fbcc5ffb640 1 -- 172.21.15.91:0/1312799380 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbcd0156bc0 con 0x7fbcd014e7c0 2023-11-27T20:43:36.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.701+0000 7fbcd66ea640 1 -- 172.21.15.91:0/1312799380 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcd0156bc0 con 0x7fbcd014e7c0 2023-11-27T20:43:36.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.702+0000 7fbcc5ffb640 1 -- 172.21.15.91:0/1312799380 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fbcd0156bc0 con 0x7fbcd014e7c0 2023-11-27T20:43:36.704 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:36.704 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/32693995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":32693995},{"type":"v1","addr":"172.21.15.183:6834","nonce":32693995}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:58.980635+0000","modified":"2023-11-27T20:43:02.065929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":10,"addr":"172.21.15.91:6837/127433365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":127433365},{"type":"v1","addr":"172.21.15.91:6837","nonce":127433365}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-27T20:43:36.704 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 22 2023-11-27T20:43:36.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.704+0000 7fbcd66ea640 1 -- 172.21.15.91:0/1312799380 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbcb406b1c0 msgr2=0x7fbcb406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.704+0000 7fbcd66ea640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbcb406b1c0 0x7fbcb406d680 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbccc007fd0 tx=0x7fbccc007ce0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.704+0000 7fbcd66ea640 1 -- 172.21.15.91:0/1312799380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd014e7c0 msgr2=0x7fbcd01ed480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.704+0000 7fbcd66ea640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd014e7c0 0x7fbcd01ed480 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000c7f0 tx=0x7fbcc000ccb0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.704+0000 7fbcd66ea640 1 -- 172.21.15.91:0/1312799380 shutdown_connections 2023-11-27T20:43:36.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.704+0000 7fbcd66ea640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbcd0154580 0x7fbcd014a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.705+0000 7fbcd66ea640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbcd014e7c0 0x7fbcd01ed480 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.705+0000 7fbcd66ea640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbcb406b1c0 0x7fbcb406d680 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.705+0000 7fbcd66ea640 1 --2- 172.21.15.91:0/1312799380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbcd00ca450 0x7fbcd014bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.705+0000 7fbcd66ea640 1 -- 172.21.15.91:0/1312799380 >> 172.21.15.91:0/1312799380 conn(0x7fbcd00abf00 msgr2=0x7fbcd00c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:36.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.705+0000 7fbcd66ea640 1 -- 172.21.15.91:0/1312799380 shutdown_connections 2023-11-27T20:43:36.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.705+0000 7fbcd66ea640 1 -- 172.21.15.91:0/1312799380 wait complete. 2023-11-27T20:43:36.722 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:36.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.919+0000 7f62d56c9640 1 Processor -- start 2023-11-27T20:43:36.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.919+0000 7f62d56c9640 1 -- start start 2023-11-27T20:43:36.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.920+0000 7f62d56c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62d00a9b40 0x7f62d00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62d56c9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f62d00c1500 0x7f62d00c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62d56c9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d00c06c0 con 0x7f62d0155490 2023-11-27T20:43:36.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62d56c9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d00a5820 con 0x7f62d00c1500 2023-11-27T20:43:36.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62d56c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d00c1020 con 0x7f62d00a9b40 2023-11-27T20:43:36.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62ceffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f62d0155490 0x7f62d00a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49788/0 (socket says 172.21.15.91:49788) 2023-11-27T20:43:36.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62cf7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f62d00c1500 0x7f62d00c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62ceffd640 1 -- 172.21.15.91:0/2248287773 learned_addr learned my addr 172.21.15.91:0/2248287773 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:36.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62cf7fe640 1 -- 172.21.15.91:0/2248287773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62d00a9b40 msgr2=0x7f62d00a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:36.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62cf7fe640 1 --2- 172.21.15.91:0/2248287773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62d00a9b40 0x7f62d00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62cf7fe640 1 -- 172.21.15.91:0/2248287773 >> v1:172.21.15.91:6789/0 conn(0x7f62d0155490 legacy=0x7f62d00a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62cf7fe640 1 -- 172.21.15.91:0/2248287773 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d00c0910 con 0x7f62d00c1500 2023-11-27T20:43:36.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.921+0000 7f62ce7fc640 1 -- 172.21.15.91:0/2248287773 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545506979 0 0) 0x7f62d00c06c0 con 0x7f62d0155490 2023-11-27T20:43:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.922+0000 7f62cf7fe640 1 --2- 172.21.15.91:0/2248287773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d00c1500 0x7f62d00c24d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009d90 tx=0x7f62c802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c375743d9a91f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.923+0000 7f62ce7fc640 1 -- 172.21.15.91:0/2248287773 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c802cc50 con 0x7f62d00c1500 2023-11-27T20:43:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.923+0000 7f62ce7fc640 1 -- 172.21.15.91:0/2248287773 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c802cdb0 con 0x7f62d00c1500 2023-11-27T20:43:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.923+0000 7f62ce7fc640 1 -- 172.21.15.91:0/2248287773 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c8034660 con 0x7f62d00c1500 2023-11-27T20:43:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.923+0000 7f62d56c9640 1 -- 172.21.15.91:0/2248287773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d00c1500 msgr2=0x7f62d00c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.923+0000 7f62d56c9640 1 --2- 172.21.15.91:0/2248287773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d00c1500 0x7f62d00c24d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009d90 tx=0x7f62c802bea0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.923+0000 7f62d56c9640 1 -- 172.21.15.91:0/2248287773 shutdown_connections 2023-11-27T20:43:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.923+0000 7f62d56c9640 1 --2- 172.21.15.91:0/2248287773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d00c1500 0x7f62d00c24d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.923+0000 7f62d56c9640 1 --2- 172.21.15.91:0/2248287773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62d00a9b40 0x7f62d00a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.923+0000 7f62d56c9640 1 -- 172.21.15.91:0/2248287773 >> 172.21.15.91:0/2248287773 conn(0x7f62d006a500 msgr2=0x7f62d006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:36.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.924+0000 7f62d56c9640 1 -- 172.21.15.91:0/2248287773 shutdown_connections 2023-11-27T20:43:36.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.924+0000 7f62d56c9640 1 -- 172.21.15.91:0/2248287773 wait complete. 2023-11-27T20:43:36.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.925+0000 7f62d56c9640 1 Processor -- start 2023-11-27T20:43:36.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.925+0000 7f62d56c9640 1 -- start start 2023-11-27T20:43:36.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.926+0000 7f62d56c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62d00c1500 0x7f62d00bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.926+0000 7f62d56c9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d0155490 0x7f62d01e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.926+0000 7f62d56c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62d01ea480 0x7f62d006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.926+0000 7f62d56c9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0071500 con 0x7f62d0155490 2023-11-27T20:43:36.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.926+0000 7f62d56c9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0070ed0 con 0x7f62d01ea480 2023-11-27T20:43:36.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.926+0000 7f62d56c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d01ede60 con 0x7f62d00c1500 2023-11-27T20:43:36.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62c67fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d0155490 0x7f62d01e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62c67fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d0155490 0x7f62d01e9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60404/0 (socket says 172.21.15.91:60404) 2023-11-27T20:43:36.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62c67fc640 1 -- 172.21.15.91:0/3898931533 learned_addr learned my addr 172.21.15.91:0/3898931533 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:36.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62ceffd640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62d00c1500 0x7f62d00bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62cf7fe640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62d01ea480 0x7f62d006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62c67fc640 1 -- 172.21.15.91:0/3898931533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62d00c1500 msgr2=0x7f62d00bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62c67fc640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62d00c1500 0x7f62d00bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62c67fc640 1 -- 172.21.15.91:0/3898931533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62d01ea480 msgr2=0x7f62d006fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:36.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62c67fc640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62d01ea480 0x7f62d006fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:36.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62c67fc640 1 -- 172.21.15.91:0/3898931533 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c8009a70 con 0x7f62d0155490 2023-11-27T20:43:36.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62cf7fe640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62d01ea480 0x7f62d006fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:36.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.927+0000 7f62c67fc640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d0155490 0x7f62d01e9f40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f62b800b4a0 tx=0x7f62b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:36.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.928+0000 7f62c7fff640 1 -- 172.21.15.91:0/3898931533 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8010610 con 0x7f62d0155490 2023-11-27T20:43:36.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.928+0000 7f62d56c9640 1 -- 172.21.15.91:0/3898931533 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d01ee140 con 0x7f62d0155490 2023-11-27T20:43:36.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.928+0000 7f62c7fff640 1 -- 172.21.15.91:0/3898931533 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8010770 con 0x7f62d0155490 2023-11-27T20:43:36.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.928+0000 7f62c7fff640 1 -- 172.21.15.91:0/3898931533 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8010b20 con 0x7f62d0155490 2023-11-27T20:43:36.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.928+0000 7f62d56c9640 1 -- 172.21.15.91:0/3898931533 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d00c4da0 con 0x7f62d0155490 2023-11-27T20:43:36.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.929+0000 7f62d56c9640 1 -- 172.21.15.91:0/3898931533 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d0071640 con 0x7f62d0155490 2023-11-27T20:43:36.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.930+0000 7f62c7fff640 1 -- 172.21.15.91:0/3898931533 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f62b8010c80 con 0x7f62d0155490 2023-11-27T20:43:36.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.931+0000 7f62c7fff640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f62b006b1f0 0x7f62b006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:36.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.931+0000 7f62c7fff640 1 -- 172.21.15.91:0/3898931533 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f62b8089620 con 0x7f62d0155490 2023-11-27T20:43:36.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.931+0000 7f62ceffd640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f62b006b1f0 0x7f62b006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:36.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.932+0000 7f62ceffd640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f62b006b1f0 0x7f62b006d6b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f62c0000f60 tx=0x7f62c0007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:36.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:36.935+0000 7f62c7fff640 1 -- 172.21.15.91:0/3898931533 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f62d0071640 con 0x7f62d0155490 2023-11-27T20:43:37.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.168+0000 7f62d56c9640 1 -- 172.21.15.91:0/3898931533 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62d0071640 con 0x7f62d0155490 2023-11-27T20:43:37.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.169+0000 7f62c7fff640 1 -- 172.21.15.91:0/3898931533 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f62d0071640 con 0x7f62d0155490 2023-11-27T20:43:37.171 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:37.171 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/32693995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":32693995},{"type":"v1","addr":"172.21.15.183:6834","nonce":32693995}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:42:58.980635+0000","modified":"2023-11-27T20:43:02.065929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":10,"addr":"172.21.15.91:6837/127433365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":127433365},{"type":"v1","addr":"172.21.15.91:6837","nonce":127433365}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-27T20:43:37.171 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 22 2023-11-27T20:43:37.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 -- 172.21.15.91:0/3898931533 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f62b006b1f0 msgr2=0x7f62b006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f62b006b1f0 0x7f62b006d6b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f62c0000f60 tx=0x7f62c0007c00 comp rx=0 tx=0).stop 2023-11-27T20:43:37.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 -- 172.21.15.91:0/3898931533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d0155490 msgr2=0x7f62d01e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d0155490 0x7f62d01e9f40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f62b800b4a0 tx=0x7f62b800b960 comp rx=0 tx=0).stop 2023-11-27T20:43:37.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 -- 172.21.15.91:0/3898931533 shutdown_connections 2023-11-27T20:43:37.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f62b006b1f0 0x7f62b006d6b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62d01ea480 0x7f62d006fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62d0155490 0x7f62d01e9f40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 --2- 172.21.15.91:0/3898931533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62d00c1500 0x7f62d00bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 -- 172.21.15.91:0/3898931533 >> 172.21.15.91:0/3898931533 conn(0x7f62d006a500 msgr2=0x7f62d006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:37.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 -- 172.21.15.91:0/3898931533 shutdown_connections 2023-11-27T20:43:37.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.172+0000 7f62d56c9640 1 -- 172.21.15.91:0/3898931533 wait complete. 2023-11-27T20:43:37.194 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:37.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.399+0000 7f8e3c8d3640 1 Processor -- start 2023-11-27T20:43:37.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.400+0000 7f8e3c8d3640 1 -- start start 2023-11-27T20:43:37.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.401+0000 7f8e3c8d3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8e38155490 0x7f8e380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.401+0000 7f8e3c8d3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8e380a9b40 0x7f8e380c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.401+0000 7f8e3c8d3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e380c06c0 con 0x7f8e380c1500 2023-11-27T20:43:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.401+0000 7f8e3c8d3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380a5820 con 0x7f8e38155490 2023-11-27T20:43:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.401+0000 7f8e3c8d3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380c1020 con 0x7f8e380a9b40 2023-11-27T20:43:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.401+0000 7f8e3659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8e38155490 0x7f8e380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.401+0000 7f8e3659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8e38155490 0x7f8e380a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60414/0 (socket says 172.21.15.91:60414) 2023-11-27T20:43:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.401+0000 7f8e2ffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8e380c1500 0x7f8e380a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49802/0 (socket says 172.21.15.91:49802) 2023-11-27T20:43:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.401+0000 7f8e3659c640 1 -- 172.21.15.91:0/3774992306 learned_addr learned my addr 172.21.15.91:0/3774992306 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:37.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.402+0000 7f8e36d9d640 1 --2- 172.21.15.91:0/3774992306 >> v2:172.21.15.183:3300/0 conn(0x7f8e380a9b40 0x7f8e380c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.402+0000 7f8e3659c640 1 -- 172.21.15.91:0/3774992306 >> v2:172.21.15.183:3300/0 conn(0x7f8e380a9b40 msgr2=0x7f8e380c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:37.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.402+0000 7f8e3659c640 1 --2- 172.21.15.91:0/3774992306 >> v2:172.21.15.183:3300/0 conn(0x7f8e380a9b40 0x7f8e380c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.402+0000 7f8e3659c640 1 -- 172.21.15.91:0/3774992306 >> v1:172.21.15.91:6789/0 conn(0x7f8e380c1500 legacy=0x7f8e380a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.402+0000 7f8e3659c640 1 -- 172.21.15.91:0/3774992306 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380c0910 con 0x7f8e38155490 2023-11-27T20:43:37.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.402+0000 7f8e35d9b640 1 -- 172.21.15.91:0/3774992306 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912593560 0 0) 0x7f8e380c06c0 con 0x7f8e380c1500 2023-11-27T20:43:37.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.403+0000 7f8e3659c640 1 --2- 172.21.15.91:0/3774992306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 0x7f8e380a51b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8e38067220 tx=0x7f8e2802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7b7bfcf824fd02 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.403+0000 7f8e35d9b640 1 -- 172.21.15.91:0/3774992306 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28030860 con 0x7f8e38155490 2023-11-27T20:43:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.403+0000 7f8e35d9b640 1 -- 172.21.15.91:0/3774992306 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e280309c0 con 0x7f8e38155490 2023-11-27T20:43:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.403+0000 7f8e35d9b640 1 -- 172.21.15.91:0/3774992306 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28030d50 con 0x7f8e38155490 2023-11-27T20:43:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.404+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3774992306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 msgr2=0x7f8e380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.404+0000 7f8e3c8d3640 1 --2- 172.21.15.91:0/3774992306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 0x7f8e380a51b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8e38067220 tx=0x7f8e2802b9a0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.404+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3774992306 shutdown_connections 2023-11-27T20:43:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.404+0000 7f8e3c8d3640 1 --2- 172.21.15.91:0/3774992306 >> v2:172.21.15.183:3300/0 conn(0x7f8e380a9b40 0x7f8e380c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.404+0000 7f8e3c8d3640 1 --2- 172.21.15.91:0/3774992306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 0x7f8e380a51b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.404+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3774992306 >> 172.21.15.91:0/3774992306 conn(0x7f8e3806a500 msgr2=0x7f8e3806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.404+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3774992306 shutdown_connections 2023-11-27T20:43:37.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.404+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3774992306 wait complete. 2023-11-27T20:43:37.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.406+0000 7f8e3c8d3640 1 Processor -- start 2023-11-27T20:43:37.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.406+0000 7f8e3c8d3640 1 -- start start 2023-11-27T20:43:37.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.407+0000 7f8e3c8d3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e380c1500 0x7f8e381ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.407+0000 7f8e3c8d3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 0x7f8e38071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.407+0000 7f8e3c8d3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e38153de0 0x7f8e38099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.407+0000 7f8e3c8d3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e38154380 con 0x7f8e38155490 2023-11-27T20:43:37.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.407+0000 7f8e3c8d3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e381eabd0 con 0x7f8e380c1500 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.407+0000 7f8e3c8d3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e381526b0 con 0x7f8e38153de0 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.407+0000 7f8e2ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 0x7f8e38071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.407+0000 7f8e2ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 0x7f8e38071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60426/0 (socket says 172.21.15.91:60426) 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.407+0000 7f8e2ffff640 1 -- 172.21.15.91:0/3989329394 learned_addr learned my addr 172.21.15.91:0/3989329394 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e3659c640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e380c1500 0x7f8e381ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e36d9d640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e38153de0 0x7f8e38099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e2ffff640 1 -- 172.21.15.91:0/3989329394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e38153de0 msgr2=0x7f8e38099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e2ffff640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e38153de0 0x7f8e38099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e2ffff640 1 -- 172.21.15.91:0/3989329394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e380c1500 msgr2=0x7f8e381ea690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e2ffff640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e380c1500 0x7f8e381ea690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e2ffff640 1 -- 172.21.15.91:0/3989329394 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280094d0 con 0x7f8e38155490 2023-11-27T20:43:37.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e36d9d640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e38153de0 0x7f8e38099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:37.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e2ffff640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 0x7f8e38071190 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c8c0 tx=0x7f8e2000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:37.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e2effd640 1 -- 172.21.15.91:0/3989329394 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000a640 con 0x7f8e38155490 2023-11-27T20:43:37.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e2effd640 1 -- 172.21.15.91:0/3989329394 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2000a7c0 con 0x7f8e38155490 2023-11-27T20:43:37.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e2effd640 1 -- 172.21.15.91:0/3989329394 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000ab70 con 0x7f8e38155490 2023-11-27T20:43:37.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.408+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3989329394 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e38152990 con 0x7f8e38155490 2023-11-27T20:43:37.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.409+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3989329394 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e38152f50 con 0x7f8e38155490 2023-11-27T20:43:37.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.410+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3989329394 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e38153160 con 0x7f8e38155490 2023-11-27T20:43:37.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.410+0000 7f8e2effd640 1 -- 172.21.15.91:0/3989329394 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8e2000acd0 con 0x7f8e38155490 2023-11-27T20:43:37.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.411+0000 7f8e2effd640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1806b1c0 0x7f8e1806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.411+0000 7f8e2effd640 1 -- 172.21.15.91:0/3989329394 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f8e200890e0 con 0x7f8e38155490 2023-11-27T20:43:37.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.412+0000 7f8e3659c640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1806b1c0 0x7f8e1806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.412+0000 7f8e3659c640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1806b1c0 0x7f8e1806d680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e28036000 tx=0x7f8e2803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:37.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.416+0000 7f8e2effd640 1 -- 172.21.15.91:0/3989329394 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8e20053d60 con 0x7f8e38155490 2023-11-27T20:43:37.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.609+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3989329394 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e38068350 con 0x7f8e38155490 2023-11-27T20:43:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.611+0000 7f8e2effd640 1 -- 172.21.15.91:0/3989329394 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16765 (secure 0 0 0) 0x7f8e20018090 con 0x7f8e38155490 2023-11-27T20:43:37.613 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:37.613 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":43,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:33.543492+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:42:56.585972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:42:58.003354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.183:6834/3450105603":"2023-11-28T20:43:30.441853+0000","172.21.15.183:6832/3450105603":"2023-11-28T20:43:30.441853+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.614+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3989329394 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1806b1c0 msgr2=0x7f8e1806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.614+0000 7f8e3c8d3640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1806b1c0 0x7f8e1806d680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e28036000 tx=0x7f8e2803b040 comp rx=0 tx=0).stop 2023-11-27T20:43:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.614+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3989329394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 msgr2=0x7f8e38071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.614+0000 7f8e3c8d3640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 0x7f8e38071190 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c8c0 tx=0x7f8e2000cd80 comp rx=0 tx=0).stop 2023-11-27T20:43:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.614+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3989329394 shutdown_connections 2023-11-27T20:43:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.614+0000 7f8e3c8d3640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e38153de0 0x7f8e38099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.614+0000 7f8e3c8d3640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e38155490 0x7f8e38071190 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.614+0000 7f8e3c8d3640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1806b1c0 0x7f8e1806d680 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.614+0000 7f8e3c8d3640 1 --2- 172.21.15.91:0/3989329394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e380c1500 0x7f8e381ea690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.614+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3989329394 >> 172.21.15.91:0/3989329394 conn(0x7f8e3806a500 msgr2=0x7f8e380c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:37.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.615+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3989329394 shutdown_connections 2023-11-27T20:43:37.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.615+0000 7f8e3c8d3640 1 -- 172.21.15.91:0/3989329394 wait complete. 2023-11-27T20:43:37.636 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-27T20:43:37.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.846+0000 7f0437687640 1 Processor -- start 2023-11-27T20:43:37.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.846+0000 7f0437687640 1 -- start start 2023-11-27T20:43:37.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.847+0000 7f0437687640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0430155490 0x7f04300a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.848+0000 7f0437687640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04300c06c0 con 0x7f04300a9b40 2023-11-27T20:43:37.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.848+0000 7f0437687640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04300c1020 con 0x7f04300c1500 2023-11-27T20:43:37.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.848+0000 7f0437687640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04300a5820 con 0x7f0430155490 2023-11-27T20:43:37.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.848+0000 7f0435c24640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f04300a9b40 0x7f04300c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49814/0 (socket says 172.21.15.91:49814) 2023-11-27T20:43:37.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.848+0000 7f0435c24640 1 -- 172.21.15.91:0/146388354 learned_addr learned my addr 172.21.15.91:0/146388354 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:37.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.848+0000 7f0435423640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0430155490 0x7f04300a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.848+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564214678 0 0) 0x7f04300c06c0 con 0x7f04300a9b40 2023-11-27T20:43:37.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.848+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f041c005730 con 0x7f04300a9b40 2023-11-27T20:43:37.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3305197721 0 0) 0x7f041c005730 con 0x7f04300a9b40 2023-11-27T20:43:37.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0430155490 msgr2=0x7f04300a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0430155490 0x7f04300a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 >> v1:172.21.15.183:6789/0 conn(0x7f04300c1500 legacy=0x7f04300a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04300c0910 con 0x7f04300a9b40 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f04280019f0 con 0x7f04300a9b40 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 >> v1:172.21.15.91:6789/0 conn(0x7f04300a9b40 legacy=0x7f04300c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f041c005bb0 0x7f041c005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0069d0 0x7f041c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0430155490 0x7f041c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c00dc90 con 0x7f041c005bb0 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c00de00 con 0x7f041c0069d0 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c00dfc0 con 0x7f0430155490 2023-11-27T20:43:37.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.849+0000 7f0435423640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f041c005bb0 0x7f041c005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.850+0000 7f0434c22640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0069d0 0x7f041c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.850+0000 7f0435423640 1 -- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0430155490 msgr2=0x7f041c0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:37.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.850+0000 7f0435423640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0430155490 0x7f041c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.850+0000 7f0435423640 1 -- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0069d0 msgr2=0x7f041c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:37.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.850+0000 7f0435423640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0069d0 0x7f041c006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.850+0000 7f0435423640 1 -- 172.21.15.91:0/146388354 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c005730 con 0x7f041c005bb0 2023-11-27T20:43:37.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.850+0000 7f0434c22640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0069d0 0x7f041c006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:37.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.851+0000 7f0435423640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f041c005bb0 0x7f041c005fd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f042c00ba30 tx=0x7f041c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d34f10928cae6b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:37.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.851+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c032680 con 0x7f041c005bb0 2023-11-27T20:43:37.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.851+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c0327e0 con 0x7f041c005bb0 2023-11-27T20:43:37.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.851+0000 7f0427fff640 1 -- 172.21.15.91:0/146388354 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c032b70 con 0x7f041c005bb0 2023-11-27T20:43:37.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.851+0000 7f0437687640 1 -- 172.21.15.91:0/146388354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f041c005bb0 msgr2=0x7f041c005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.851+0000 7f0437687640 1 --2- 172.21.15.91:0/146388354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f041c005bb0 0x7f041c005fd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f042c00ba30 tx=0x7f041c007a00 comp rx=0 tx=0).stop 2023-11-27T20:43:37.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.851+0000 7f0435c24640 1 -- 172.21.15.91:0/146388354 reap_dead start 2023-11-27T20:43:37.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.852+0000 7f0437687640 1 -- 172.21.15.91:0/146388354 shutdown_connections 2023-11-27T20:43:37.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.852+0000 7f0437687640 1 -- 172.21.15.91:0/146388354 >> 172.21.15.91:0/146388354 conn(0x7f043006a500 msgr2=0x7f043006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:37.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.852+0000 7f0437687640 1 -- 172.21.15.91:0/146388354 shutdown_connections 2023-11-27T20:43:37.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.852+0000 7f0437687640 1 -- 172.21.15.91:0/146388354 wait complete. 2023-11-27T20:43:37.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.853+0000 7f0437687640 1 Processor -- start 2023-11-27T20:43:37.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.854+0000 7f0437687640 1 -- start start 2023-11-27T20:43:37.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.854+0000 7f0437687640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c005bb0 0x7f043014e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.854+0000 7f0437687640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04300be560 0x7f04301e93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.854+0000 7f0437687640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0430071600 0x7f04301e6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.854+0000 7f0437687640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04300be9e0 con 0x7f04300be560 2023-11-27T20:43:37.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.854+0000 7f0437687640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04301e9920 con 0x7f0430071600 2023-11-27T20:43:37.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.854+0000 7f0437687640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04301e5e70 con 0x7f041c005bb0 2023-11-27T20:43:37.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0434c22640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04300be560 0x7f04301e93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0434c22640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04300be560 0x7f04301e93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60436/0 (socket says 172.21.15.91:60436) 2023-11-27T20:43:37.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0434c22640 1 -- 172.21.15.91:0/3889728695 learned_addr learned my addr 172.21.15.91:0/3889728695 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:37.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0435c24640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0430071600 0x7f04301e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0435423640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c005bb0 0x7f043014e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0434c22640 1 -- 172.21.15.91:0/3889728695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c005bb0 msgr2=0x7f043014e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0434c22640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c005bb0 0x7f043014e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0434c22640 1 -- 172.21.15.91:0/3889728695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0430071600 msgr2=0x7f04301e6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:37.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0434c22640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0430071600 0x7f04301e6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:37.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0434c22640 1 -- 172.21.15.91:0/3889728695 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04301e9b50 con 0x7f04300be560 2023-11-27T20:43:37.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.855+0000 7f0435c24640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0430071600 0x7f04301e6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:37.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.856+0000 7f0434c22640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04300be560 0x7f04301e93e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f042000d7a0 tx=0x7f042000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:37.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.856+0000 7f0425ffb640 1 -- 172.21.15.91:0/3889728695 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420017070 con 0x7f04300be560 2023-11-27T20:43:37.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.856+0000 7f0425ffb640 1 -- 172.21.15.91:0/3889728695 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420005070 con 0x7f04300be560 2023-11-27T20:43:37.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.856+0000 7f0425ffb640 1 -- 172.21.15.91:0/3889728695 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420005420 con 0x7f04300be560 2023-11-27T20:43:37.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.856+0000 7f0437687640 1 -- 172.21.15.91:0/3889728695 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04301e9e30 con 0x7f04300be560 2023-11-27T20:43:37.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.856+0000 7f0437687640 1 -- 172.21.15.91:0/3889728695 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04301e6130 con 0x7f04300be560 2023-11-27T20:43:37.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.857+0000 7f0437687640 1 -- 172.21.15.91:0/3889728695 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04300c38b0 con 0x7f04300be560 2023-11-27T20:43:37.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.858+0000 7f0425ffb640 1 -- 172.21.15.91:0/3889728695 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0420007030 con 0x7f04300be560 2023-11-27T20:43:37.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.859+0000 7f0425ffb640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f041406b1f0 0x7f041406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:37.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.859+0000 7f0425ffb640 1 -- 172.21.15.91:0/3889728695 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f0420089300 con 0x7f04300be560 2023-11-27T20:43:37.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.859+0000 7f0435423640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f041406b1f0 0x7f041406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:37.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.860+0000 7f0435423640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f041406b1f0 0x7f041406d6b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f042c00ba00 tx=0x7f042c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:37.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:37.863+0000 7f0425ffb640 1 -- 172.21.15.91:0/3889728695 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0420053f80 con 0x7f04300be560 2023-11-27T20:43:38.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.093+0000 7f0437687640 1 -- 172.21.15.91:0/3889728695 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f0430068350 con 0x7f04300be560 2023-11-27T20:43:38.095 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-11-27T20:43:38.094+0000 7fb57696d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-27T20:43:38.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.098+0000 7f0425ffb640 1 -- 172.21.15.91:0/3889728695 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 163+0+0 (secure 0 0 0) 0x7f04200575a0 con 0x7f04300be560 2023-11-27T20:43:38.099 INFO:teuthology.orchestra.run.smithi091.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T20:43:38.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.101+0000 7f0437687640 1 -- 172.21.15.91:0/3889728695 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f041406b1f0 msgr2=0x7f041406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:38.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.101+0000 7f0437687640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f041406b1f0 0x7f041406d6b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f042c00ba00 tx=0x7f042c03d040 comp rx=0 tx=0).stop 2023-11-27T20:43:38.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.102+0000 7f0437687640 1 -- 172.21.15.91:0/3889728695 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04300be560 msgr2=0x7f04301e93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:38.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.102+0000 7f0437687640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04300be560 0x7f04301e93e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f042000d7a0 tx=0x7f042000dc60 comp rx=0 tx=0).stop 2023-11-27T20:43:38.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.102+0000 7f0437687640 1 -- 172.21.15.91:0/3889728695 shutdown_connections 2023-11-27T20:43:38.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.102+0000 7f0437687640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f041406b1f0 0x7f041406d6b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:38.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.102+0000 7f0437687640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0430071600 0x7f04301e6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:38.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.102+0000 7f0437687640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04300be560 0x7f04301e93e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:38.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.102+0000 7f0437687640 1 --2- 172.21.15.91:0/3889728695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c005bb0 0x7f043014e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:38.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.102+0000 7f0437687640 1 -- 172.21.15.91:0/3889728695 >> 172.21.15.91:0/3889728695 conn(0x7f043006a500 msgr2=0x7f04300c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:38.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.102+0000 7f0437687640 1 -- 172.21.15.91:0/3889728695 shutdown_connections 2023-11-27T20:43:38.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.102+0000 7f0437687640 1 -- 172.21.15.91:0/3889728695 wait complete. 2023-11-27T20:43:38.113 INFO:tasks.ceph.mds.c.smithi091.stderr: -2330> 2023-11-27T20:43:00.597+0000 7f63868b8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:43:38.122 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-27T20:43:38.168 INFO:tasks.ceph.mds.c.smithi091.stdout:starting mds.c at 2023-11-27T20:43:38.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.314+0000 7f1cb3648640 1 Processor -- start 2023-11-27T20:43:38.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.315+0000 7f1cb3648640 1 -- start start 2023-11-27T20:43:38.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.316+0000 7f1cb3648640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac14fd30 0x7f1cac152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:38.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.316+0000 7f1cb3648640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac0c64a0 con 0x7f1cac06d0a0 2023-11-27T20:43:38.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.316+0000 7f1cb3648640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac0c5c00 con 0x7f1cac0c3ea0 2023-11-27T20:43:38.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.316+0000 7f1cb3648640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0c5ee0 con 0x7f1cac14fd30 2023-11-27T20:43:38.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.316+0000 7f1cb0be3640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f1cac06d0a0 0x7f1cac0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49826/0 (socket says 172.21.15.91:49826) 2023-11-27T20:43:38.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.316+0000 7f1cb0be3640 1 -- 172.21.15.91:0/523514523 learned_addr learned my addr 172.21.15.91:0/523514523 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cb13e4640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac14fd30 0x7f1cac152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341922165 0 0) 0x7f1cac0c64a0 con 0x7f1cac06d0a0 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c9c003520 con 0x7f1cac06d0a0 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2972918706 0 0) 0x7f1c9c003520 con 0x7f1cac06d0a0 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac14fd30 msgr2=0x7f1cac152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac14fd30 0x7f1cac152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 >> v1:172.21.15.183:6789/0 conn(0x7f1cac0c3ea0 legacy=0x7f1cac0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0c61c0 con 0x7f1cac06d0a0 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f1c98001670 con 0x7f1cac06d0a0 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cb13e4640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac14fd30 0x7f1cac152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:43:38.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 >> v1:172.21.15.91:6789/0 conn(0x7f1cac06d0a0 legacy=0x7f1cac0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c0039a0 0x7f1c9c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac14fd30 0x7f1c9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c9c004d00 0x7f1c9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0c5ee0 con 0x7f1c9c004d00 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c00ba90 con 0x7f1c9c0039a0 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.317+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c00bc50 con 0x7f1cac14fd30 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.318+0000 7f1cb1be5640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c9c004d00 0x7f1c9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.318+0000 7f1cb13e4640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c0039a0 0x7f1c9c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.318+0000 7f1cb0be3640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac14fd30 0x7f1c9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.318+0000 7f1cb1be5640 1 -- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac14fd30 msgr2=0x7f1c9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.318+0000 7f1cb1be5640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac14fd30 0x7f1c9c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.318+0000 7f1cb1be5640 1 -- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c0039a0 msgr2=0x7f1c9c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:38.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.318+0000 7f1cb1be5640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c0039a0 0x7f1c9c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.318+0000 7f1cb1be5640 1 -- 172.21.15.91:0/523514523 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c003520 con 0x7f1c9c004d00 2023-11-27T20:43:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.318+0000 7f1cb13e4640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c0039a0 0x7f1c9c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:43:38.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.318+0000 7f1cb0be3640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac14fd30 0x7f1c9c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:38.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.319+0000 7f1cb1be5640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c9c004d00 0x7f1c9c005180 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4001740 tx=0x7f1c9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc05f994e8743220 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:38.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.319+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40052d0 con 0x7f1c9c004d00 2023-11-27T20:43:38.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.320+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca402e050 con 0x7f1c9c004d00 2023-11-27T20:43:38.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.320+0000 7f1cabfff640 1 -- 172.21.15.91:0/523514523 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40035f0 con 0x7f1c9c004d00 2023-11-27T20:43:38.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.320+0000 7f1cb3648640 1 -- 172.21.15.91:0/523514523 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c9c004d00 msgr2=0x7f1c9c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:38.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.320+0000 7f1cb3648640 1 --2- 172.21.15.91:0/523514523 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1c9c004d00 0x7f1c9c005180 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4001740 tx=0x7f1c9c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:38.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.320+0000 7f1cb1be5640 1 -- 172.21.15.91:0/523514523 reap_dead start 2023-11-27T20:43:38.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.320+0000 7f1cb3648640 1 -- 172.21.15.91:0/523514523 shutdown_connections 2023-11-27T20:43:38.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.320+0000 7f1cb3648640 1 -- 172.21.15.91:0/523514523 >> 172.21.15.91:0/523514523 conn(0x7f1cac06a500 msgr2=0x7f1cac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:38.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.320+0000 7f1cb3648640 1 -- 172.21.15.91:0/523514523 shutdown_connections 2023-11-27T20:43:38.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.320+0000 7f1cb3648640 1 -- 172.21.15.91:0/523514523 wait complete. 2023-11-27T20:43:38.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.322+0000 7f1cb3648640 1 Processor -- start 2023-11-27T20:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.322+0000 7f1cb3648640 1 -- start start 2023-11-27T20:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.323+0000 7f1cb3648640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cac1e54e0 0x7f1cac1e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.323+0000 7f1cb3648640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cac148d70 0x7f1cac152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.323+0000 7f1cb3648640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac1525d0 0x7f1cac1e6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.323+0000 7f1cb3648640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac148be0 con 0x7f1cac1e54e0 2023-11-27T20:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.323+0000 7f1cb3648640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac071c10 con 0x7f1cac148d70 2023-11-27T20:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.323+0000 7f1cb3648640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac071ef0 con 0x7f1cac1525d0 2023-11-27T20:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.323+0000 7f1cb13e4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cac1e54e0 0x7f1cac1e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:38.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.323+0000 7f1cb13e4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cac1e54e0 0x7f1cac1e58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60458/0 (socket says 172.21.15.91:60458) 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.323+0000 7f1cb13e4640 1 -- 172.21.15.91:0/2200625788 learned_addr learned my addr 172.21.15.91:0/2200625788 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.324+0000 7f1cb0be3640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cac148d70 0x7f1cac152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.324+0000 7f1cb13e4640 1 -- 172.21.15.91:0/2200625788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac1525d0 msgr2=0x7f1cac1e6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.324+0000 7f1cb13e4640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac1525d0 0x7f1cac1e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.324+0000 7f1cb13e4640 1 -- 172.21.15.91:0/2200625788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cac148d70 msgr2=0x7f1cac152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.324+0000 7f1cb13e4640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cac148d70 0x7f1cac152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.324+0000 7f1cb13e4640 1 -- 172.21.15.91:0/2200625788 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac1e9c90 con 0x7f1cac1e54e0 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.324+0000 7f1cb13e4640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cac1e54e0 0x7f1cac1e58c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00046b0 tx=0x7f1ca0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.324+0000 7f1ca9ffb640 1 -- 172.21.15.91:0/2200625788 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0014610 con 0x7f1cac1e54e0 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.324+0000 7f1ca9ffb640 1 -- 172.21.15.91:0/2200625788 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca000f050 con 0x7f1cac1e54e0 2023-11-27T20:43:38.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.324+0000 7f1cb3648640 1 -- 172.21.15.91:0/2200625788 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac1e9f70 con 0x7f1cac1e54e0 2023-11-27T20:43:38.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.325+0000 7f1ca9ffb640 1 -- 172.21.15.91:0/2200625788 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0014970 con 0x7f1cac1e54e0 2023-11-27T20:43:38.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.325+0000 7f1cb3648640 1 -- 172.21.15.91:0/2200625788 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac070f60 con 0x7f1cac1e54e0 2023-11-27T20:43:38.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.326+0000 7f1cb3648640 1 -- 172.21.15.91:0/2200625788 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cac068350 con 0x7f1cac1e54e0 2023-11-27T20:43:38.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.327+0000 7f1ca9ffb640 1 -- 172.21.15.91:0/2200625788 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1ca0014ad0 con 0x7f1cac1e54e0 2023-11-27T20:43:38.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.327+0000 7f1ca9ffb640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1c9006b1f0 0x7f1c9006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:38.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.327+0000 7f1ca9ffb640 1 -- 172.21.15.91:0/2200625788 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5943+0+0 (secure 0 0 0) 0x7f1ca008a300 con 0x7f1cac1e54e0 2023-11-27T20:43:38.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.328+0000 7f1cb0be3640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1c9006b1f0 0x7f1c9006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:38.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.328+0000 7f1cb0be3640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1c9006b1f0 0x7f1c9006d6b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1cac06ad10 tx=0x7f1c98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:38.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.332+0000 7f1ca9ffb640 1 -- 172.21.15.91:0/2200625788 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1ca0054fd0 con 0x7f1cac1e54e0 2023-11-27T20:43:38.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:38.568+0000 7f1cb3648640 1 -- 172.21.15.91:0/2200625788 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1cac0c66d0 con 0x7f1cac1e54e0 2023-11-27T20:43:39.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.102+0000 7f1ca9ffb640 1 -- 172.21.15.91:0/2200625788 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 105+0+0 (secure 0 0 0) 0x7f1ca00585f0 con 0x7f1cac1e54e0 2023-11-27T20:43:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.105+0000 7f1cb3648640 1 -- 172.21.15.91:0/2200625788 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1c9006b1f0 msgr2=0x7f1c9006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.105+0000 7f1cb3648640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1c9006b1f0 0x7f1c9006d6b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1cac06ad10 tx=0x7f1c98009040 comp rx=0 tx=0).stop 2023-11-27T20:43:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.105+0000 7f1cb3648640 1 -- 172.21.15.91:0/2200625788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cac1e54e0 msgr2=0x7f1cac1e58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.105+0000 7f1cb3648640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cac1e54e0 0x7f1cac1e58c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00046b0 tx=0x7f1ca0007700 comp rx=0 tx=0).stop 2023-11-27T20:43:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.105+0000 7f1cb3648640 1 -- 172.21.15.91:0/2200625788 shutdown_connections 2023-11-27T20:43:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.105+0000 7f1cb3648640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cac1525d0 0x7f1cac1e6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.105+0000 7f1cb3648640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1c9006b1f0 0x7f1c9006d6b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.105+0000 7f1cb3648640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cac148d70 0x7f1cac152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.105+0000 7f1cb3648640 1 --2- 172.21.15.91:0/2200625788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cac1e54e0 0x7f1cac1e58c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.105+0000 7f1cb3648640 1 -- 172.21.15.91:0/2200625788 >> 172.21.15.91:0/2200625788 conn(0x7f1cac06a500 msgr2=0x7f1cac150360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.106+0000 7f1cb3648640 1 -- 172.21.15.91:0/2200625788 shutdown_connections 2023-11-27T20:43:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.106+0000 7f1cb3648640 1 -- 172.21.15.91:0/2200625788 wait complete. 2023-11-27T20:43:39.128 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-27T20:43:39.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.389+0000 7f450bd05640 1 Processor -- start 2023-11-27T20:43:39.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.389+0000 7f450bd05640 1 -- start start 2023-11-27T20:43:39.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.390+0000 7f450bd05640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f450414fd60 0x7f45040c0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:39.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.390+0000 7f450bd05640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f450406e1c0 0x7f45040c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:39.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.390+0000 7f450bd05640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f450406bd60 0x7f4504155b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.390+0000 7f450bd05640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450406c820 con 0x7f450414fd60 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.390+0000 7f450bd05640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450406dda0 con 0x7f450406e1c0 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.390+0000 7f450bd05640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450406d750 con 0x7f450406bd60 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f4509aa1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f450414fd60 0x7f45040c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f4509aa1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f450414fd60 0x7f45040c0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60474/0 (socket says 172.21.15.91:60474) 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f4509aa1640 1 -- 172.21.15.91:0/2822852388 learned_addr learned my addr 172.21.15.91:0/2822852388 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f45092a0640 1 --2- 172.21.15.91:0/2822852388 >> v2:172.21.15.183:3300/0 conn(0x7f450406e1c0 0x7f45040c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f4509aa1640 1 -- 172.21.15.91:0/2822852388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f450406bd60 msgr2=0x7f4504155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f450a2a2640 1 --2- 172.21.15.91:0/2822852388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f450406bd60 0x7f4504155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f4509aa1640 1 --2- 172.21.15.91:0/2822852388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f450406bd60 0x7f4504155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f4509aa1640 1 -- 172.21.15.91:0/2822852388 >> v2:172.21.15.183:3300/0 conn(0x7f450406e1c0 msgr2=0x7f45040c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:39.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f4509aa1640 1 --2- 172.21.15.91:0/2822852388 >> v2:172.21.15.183:3300/0 conn(0x7f450406e1c0 0x7f45040c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f4509aa1640 1 -- 172.21.15.91:0/2822852388 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45040c53d0 con 0x7f450414fd60 2023-11-27T20:43:39.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.391+0000 7f45092a0640 1 --2- 172.21.15.91:0/2822852388 >> v2:172.21.15.183:3300/0 conn(0x7f450406e1c0 0x7f45040c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:39.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.392+0000 7f4509aa1640 1 --2- 172.21.15.91:0/2822852388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450414fd60 0x7f45040c0730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f45040bffa0 tx=0x7f450002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2f24a22560d192 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:39.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f4508a9f640 1 -- 172.21.15.91:0/2822852388 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500031750 con 0x7f450414fd60 2023-11-27T20:43:39.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f4508a9f640 1 -- 172.21.15.91:0/2822852388 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45000318b0 con 0x7f450414fd60 2023-11-27T20:43:39.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f4508a9f640 1 -- 172.21.15.91:0/2822852388 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500031c40 con 0x7f450414fd60 2023-11-27T20:43:39.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f450bd05640 1 -- 172.21.15.91:0/2822852388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450414fd60 msgr2=0x7f45040c0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:39.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f450bd05640 1 --2- 172.21.15.91:0/2822852388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450414fd60 0x7f45040c0730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f45040bffa0 tx=0x7f450002b7f0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f450bd05640 1 -- 172.21.15.91:0/2822852388 shutdown_connections 2023-11-27T20:43:39.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f450bd05640 1 --2- 172.21.15.91:0/2822852388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f450406bd60 0x7f4504155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f450bd05640 1 --2- 172.21.15.91:0/2822852388 >> v2:172.21.15.183:3300/0 conn(0x7f450406e1c0 0x7f45040c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f450bd05640 1 --2- 172.21.15.91:0/2822852388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450414fd60 0x7f45040c0730 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f450bd05640 1 -- 172.21.15.91:0/2822852388 >> 172.21.15.91:0/2822852388 conn(0x7f45040c5d30 msgr2=0x7f45040c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:39.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f450bd05640 1 -- 172.21.15.91:0/2822852388 shutdown_connections 2023-11-27T20:43:39.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.393+0000 7f450bd05640 1 -- 172.21.15.91:0/2822852388 wait complete. 2023-11-27T20:43:39.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.395+0000 7f450bd05640 1 Processor -- start 2023-11-27T20:43:39.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.395+0000 7f450bd05640 1 -- start start 2023-11-27T20:43:39.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.396+0000 7f450bd05640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f450406bd60 0x7f4504154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:39.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.396+0000 7f450bd05640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450406e1c0 0x7f45040bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:39.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.396+0000 7f450bd05640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f450414fd60 0x7f450414c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:39.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.396+0000 7f450bd05640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4504153d80 con 0x7f450406e1c0 2023-11-27T20:43:39.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.396+0000 7f450bd05640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45041edb70 con 0x7f450406bd60 2023-11-27T20:43:39.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.396+0000 7f450bd05640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4504152e60 con 0x7f450414fd60 2023-11-27T20:43:39.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.396+0000 7f45092a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450406e1c0 0x7f45040bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:39.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.396+0000 7f45092a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450406e1c0 0x7f45040bf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60478/0 (socket says 172.21.15.91:60478) 2023-11-27T20:43:39.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.396+0000 7f45092a0640 1 -- 172.21.15.91:0/2112904814 learned_addr learned my addr 172.21.15.91:0/2112904814 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:39.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f4509aa1640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f450406bd60 0x7f4504154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:39.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f450a2a2640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f450414fd60 0x7f450414c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:39.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f45092a0640 1 -- 172.21.15.91:0/2112904814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f450414fd60 msgr2=0x7f450414c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:39.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f45092a0640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f450414fd60 0x7f450414c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f45092a0640 1 -- 172.21.15.91:0/2112904814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f450406bd60 msgr2=0x7f4504154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:39.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f45092a0640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f450406bd60 0x7f4504154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:39.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f45092a0640 1 -- 172.21.15.91:0/2112904814 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45000094d0 con 0x7f450406e1c0 2023-11-27T20:43:39.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f45092a0640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450406e1c0 0x7f45040bf3d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c7f0 tx=0x7f44f400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:39.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f44fa7fc640 1 -- 172.21.15.91:0/2112904814 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4007a30 con 0x7f450406e1c0 2023-11-27T20:43:39.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f450bd05640 1 -- 172.21.15.91:0/2112904814 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4504153140 con 0x7f450406e1c0 2023-11-27T20:43:39.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.397+0000 7f44fa7fc640 1 -- 172.21.15.91:0/2112904814 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f4007b90 con 0x7f450406e1c0 2023-11-27T20:43:39.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.398+0000 7f44fa7fc640 1 -- 172.21.15.91:0/2112904814 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400ce40 con 0x7f450406e1c0 2023-11-27T20:43:39.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.398+0000 7f450bd05640 1 -- 172.21.15.91:0/2112904814 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45041ede50 con 0x7f450406e1c0 2023-11-27T20:43:39.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.399+0000 7f450bd05640 1 -- 172.21.15.91:0/2112904814 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4504153380 con 0x7f450406e1c0 2023-11-27T20:43:39.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.400+0000 7f44fa7fc640 1 -- 172.21.15.91:0/2112904814 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f44f40113f0 con 0x7f450406e1c0 2023-11-27T20:43:39.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.401+0000 7f44fa7fc640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f44e806b1c0 0x7f44e806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:39.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.401+0000 7f44fa7fc640 1 -- 172.21.15.91:0/2112904814 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5943+0+0 (secure 0 0 0) 0x7f44f4089c70 con 0x7f450406e1c0 2023-11-27T20:43:39.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.401+0000 7f4509aa1640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f44e806b1c0 0x7f44e806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:39.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.402+0000 7f4509aa1640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f44e806b1c0 0x7f44e806d680 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4500035000 tx=0x7f4500008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:39.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.405+0000 7f44fa7fc640 1 -- 172.21.15.91:0/2112904814 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4504153380 con 0x7f450406e1c0 2023-11-27T20:43:39.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:39.602+0000 7f450bd05640 1 -- 172.21.15.91:0/2112904814 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4504153330 con 0x7f450406e1c0 2023-11-27T20:43:40.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.600+0000 7f44fa7fc640 1 -- 172.21.15.91:0/2112904814 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7f44f401f0e0 con 0x7f450406e1c0 2023-11-27T20:43:40.602 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_metadata' removed 2023-11-27T20:43:40.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.604+0000 7f450bd05640 1 -- 172.21.15.91:0/2112904814 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f44e806b1c0 msgr2=0x7f44e806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:40.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.604+0000 7f450bd05640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f44e806b1c0 0x7f44e806d680 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4500035000 tx=0x7f4500008030 comp rx=0 tx=0).stop 2023-11-27T20:43:40.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.604+0000 7f450bd05640 1 -- 172.21.15.91:0/2112904814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450406e1c0 msgr2=0x7f45040bf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:40.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.604+0000 7f450bd05640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450406e1c0 0x7f45040bf3d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c7f0 tx=0x7f44f400cbf0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.604+0000 7f450bd05640 1 -- 172.21.15.91:0/2112904814 shutdown_connections 2023-11-27T20:43:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.604+0000 7f450bd05640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f450414fd60 0x7f450414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.604+0000 7f450bd05640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f450406e1c0 0x7f45040bf3d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.604+0000 7f450bd05640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f44e806b1c0 0x7f44e806d680 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4500035000 tx=0x7f4500008030 comp rx=0 tx=0).stop 2023-11-27T20:43:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.604+0000 7f450bd05640 1 --2- 172.21.15.91:0/2112904814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f450406bd60 0x7f4504154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.604+0000 7f450bd05640 1 -- 172.21.15.91:0/2112904814 >> 172.21.15.91:0/2112904814 conn(0x7f45040c5d30 msgr2=0x7f45040a8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:40.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.606+0000 7f450bd05640 1 -- 172.21.15.91:0/2112904814 shutdown_connections 2023-11-27T20:43:40.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.606+0000 7f450bd05640 1 -- 172.21.15.91:0/2112904814 wait complete. 2023-11-27T20:43:40.630 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-27T20:43:40.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.837+0000 7ff5591c9640 1 Processor -- start 2023-11-27T20:43:40.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.837+0000 7ff5591c9640 1 -- start start 2023-11-27T20:43:40.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff5591c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff55414fa80 0x7ff55406d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:40.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff5591c9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff554072530 0x7ff5540c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:40.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff5591c9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff554071f70 0x7ff5540c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:40.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff5591c9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55406d160 con 0x7ff554072530 2023-11-27T20:43:40.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff5591c9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5540c0980 con 0x7ff554071f70 2023-11-27T20:43:40.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff5591c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55406c070 con 0x7ff55414fa80 2023-11-27T20:43:40.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff55259c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff554072530 0x7ff5540c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:40.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff55259c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff554072530 0x7ff5540c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60480/0 (socket says 172.21.15.91:60480) 2023-11-27T20:43:40.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff55259c640 1 -- 172.21.15.91:0/992021156 learned_addr learned my addr 172.21.15.91:0/992021156 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:40.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff552d9d640 1 --2- 172.21.15.91:0/992021156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff55414fa80 0x7ff55406d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:40.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.839+0000 7ff55359e640 1 --2- 172.21.15.91:0/992021156 >> v2:172.21.15.183:3300/0 conn(0x7ff554071f70 0x7ff5540c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:40.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.840+0000 7ff55259c640 1 -- 172.21.15.91:0/992021156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff55414fa80 msgr2=0x7ff55406d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:40.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.840+0000 7ff55259c640 1 --2- 172.21.15.91:0/992021156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff55414fa80 0x7ff55406d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.840+0000 7ff55259c640 1 -- 172.21.15.91:0/992021156 >> v2:172.21.15.183:3300/0 conn(0x7ff554071f70 msgr2=0x7ff5540c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:40.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.840+0000 7ff55259c640 1 --2- 172.21.15.91:0/992021156 >> v2:172.21.15.183:3300/0 conn(0x7ff554071f70 0x7ff5540c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.840+0000 7ff55259c640 1 -- 172.21.15.91:0/992021156 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55406dc70 con 0x7ff554072530 2023-11-27T20:43:40.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.840+0000 7ff55359e640 1 --2- 172.21.15.91:0/992021156 >> v2:172.21.15.183:3300/0 conn(0x7ff554071f70 0x7ff5540c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:40.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.841+0000 7ff55259c640 1 --2- 172.21.15.91:0/992021156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554072530 0x7ff5540c5380 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff55406fd50 tx=0x7ff54802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb7deccb82a11e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:40.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.841+0000 7ff551d9b640 1 -- 172.21.15.91:0/992021156 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548031870 con 0x7ff554072530 2023-11-27T20:43:40.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.841+0000 7ff551d9b640 1 -- 172.21.15.91:0/992021156 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5480319d0 con 0x7ff554072530 2023-11-27T20:43:40.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.841+0000 7ff551d9b640 1 -- 172.21.15.91:0/992021156 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548031d60 con 0x7ff554072530 2023-11-27T20:43:40.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.842+0000 7ff5591c9640 1 -- 172.21.15.91:0/992021156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554072530 msgr2=0x7ff5540c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:40.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.842+0000 7ff5591c9640 1 --2- 172.21.15.91:0/992021156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554072530 0x7ff5540c5380 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff55406fd50 tx=0x7ff54802b910 comp rx=0 tx=0).stop 2023-11-27T20:43:40.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.842+0000 7ff5591c9640 1 -- 172.21.15.91:0/992021156 shutdown_connections 2023-11-27T20:43:40.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.842+0000 7ff5591c9640 1 --2- 172.21.15.91:0/992021156 >> v2:172.21.15.183:3300/0 conn(0x7ff554071f70 0x7ff5540c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.842+0000 7ff5591c9640 1 --2- 172.21.15.91:0/992021156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554072530 0x7ff5540c5380 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.842+0000 7ff5591c9640 1 --2- 172.21.15.91:0/992021156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff55414fa80 0x7ff55406d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.842+0000 7ff5591c9640 1 -- 172.21.15.91:0/992021156 >> 172.21.15.91:0/992021156 conn(0x7ff5540c5bc0 msgr2=0x7ff5540c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:40.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.842+0000 7ff5591c9640 1 -- 172.21.15.91:0/992021156 shutdown_connections 2023-11-27T20:43:40.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.842+0000 7ff5591c9640 1 -- 172.21.15.91:0/992021156 wait complete. 2023-11-27T20:43:40.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.844+0000 7ff5591c9640 1 Processor -- start 2023-11-27T20:43:40.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.844+0000 7ff5591c9640 1 -- start start 2023-11-27T20:43:40.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff5591c9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554071f70 0x7ff5540aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:40.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff5591c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff554072530 0x7ff5541e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:40.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff5591c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff55414fa80 0x7ff554070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:40.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff5591c9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540a60c0 con 0x7ff554071f70 2023-11-27T20:43:40.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff5591c9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5541497b0 con 0x7ff55414fa80 2023-11-27T20:43:40.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff5591c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff554071ca0 con 0x7ff554072530 2023-11-27T20:43:40.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff552d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554071f70 0x7ff5540aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:40.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff552d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554071f70 0x7ff5540aaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60494/0 (socket says 172.21.15.91:60494) 2023-11-27T20:43:40.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff552d9d640 1 -- 172.21.15.91:0/1342595642 learned_addr learned my addr 172.21.15.91:0/1342595642 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:40.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff552d9d640 1 -- 172.21.15.91:0/1342595642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff554072530 msgr2=0x7ff5541e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:40.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff552d9d640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff554072530 0x7ff5541e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff552d9d640 1 -- 172.21.15.91:0/1342595642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff55414fa80 msgr2=0x7ff554070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:40.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff552d9d640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff55414fa80 0x7ff554070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:40.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.845+0000 7ff552d9d640 1 -- 172.21.15.91:0/1342595642 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480094d0 con 0x7ff554071f70 2023-11-27T20:43:40.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.846+0000 7ff552d9d640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554071f70 0x7ff5540aaa40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff54400d620 tx=0x7ff54400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:40.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.846+0000 7ff53b7fe640 1 -- 172.21.15.91:0/1342595642 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54400b620 con 0x7ff554071f70 2023-11-27T20:43:40.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.846+0000 7ff53b7fe640 1 -- 172.21.15.91:0/1342595642 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54400b780 con 0x7ff554071f70 2023-11-27T20:43:40.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.846+0000 7ff53b7fe640 1 -- 172.21.15.91:0/1342595642 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54400bb30 con 0x7ff554071f70 2023-11-27T20:43:40.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.846+0000 7ff5591c9640 1 -- 172.21.15.91:0/1342595642 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5541eaa20 con 0x7ff554071f70 2023-11-27T20:43:40.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.846+0000 7ff5591c9640 1 -- 172.21.15.91:0/1342595642 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5541e7730 con 0x7ff554071f70 2023-11-27T20:43:40.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.847+0000 7ff5591c9640 1 -- 172.21.15.91:0/1342595642 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff554068350 con 0x7ff554071f70 2023-11-27T20:43:40.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.848+0000 7ff53b7fe640 1 -- 172.21.15.91:0/1342595642 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff54400bc90 con 0x7ff554071f70 2023-11-27T20:43:40.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.849+0000 7ff53b7fe640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54006b1c0 0x7ff54006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:40.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.849+0000 7ff53b7fe640 1 -- 172.21.15.91:0/1342595642 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5503+0+0 (secure 0 0 0) 0x7ff544089cf0 con 0x7ff554071f70 2023-11-27T20:43:40.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.849+0000 7ff55259c640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54006b1c0 0x7ff54006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:40.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.850+0000 7ff55259c640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54006b1c0 0x7ff54006d680 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff548036000 tx=0x7ff548030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:40.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:40.854+0000 7ff53b7fe640 1 -- 172.21.15.91:0/1342595642 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff54408e070 con 0x7ff554071f70 2023-11-27T20:43:41.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.041+0000 7ff5591c9640 1 -- 172.21.15.91:0/1342595642 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff5540a87a0 con 0x7ff554071f70 2023-11-27T20:43:41.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.611+0000 7ff53b7fe640 1 -- 172.21.15.91:0/1342595642 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v46) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff544054b80 con 0x7ff554071f70 2023-11-27T20:43:41.612 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_data' removed 2023-11-27T20:43:41.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.614+0000 7ff5591c9640 1 -- 172.21.15.91:0/1342595642 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54006b1c0 msgr2=0x7ff54006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:41.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.614+0000 7ff5591c9640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54006b1c0 0x7ff54006d680 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff548036000 tx=0x7ff548030000 comp rx=0 tx=0).stop 2023-11-27T20:43:41.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.615+0000 7ff5591c9640 1 -- 172.21.15.91:0/1342595642 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554071f70 msgr2=0x7ff5540aaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:41.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.615+0000 7ff5591c9640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554071f70 0x7ff5540aaa40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff54400d620 tx=0x7ff54400dae0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.615+0000 7ff5591c9640 1 -- 172.21.15.91:0/1342595642 shutdown_connections 2023-11-27T20:43:41.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.615+0000 7ff5591c9640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54006b1c0 0x7ff54006d680 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.615+0000 7ff5591c9640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff55414fa80 0x7ff554070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.615+0000 7ff5591c9640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff554072530 0x7ff5541e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.615+0000 7ff5591c9640 1 --2- 172.21.15.91:0/1342595642 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff554071f70 0x7ff5540aaa40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.615+0000 7ff5591c9640 1 -- 172.21.15.91:0/1342595642 >> 172.21.15.91:0/1342595642 conn(0x7ff5540c5bc0 msgr2=0x7ff5540c1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:41.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.615+0000 7ff5591c9640 1 -- 172.21.15.91:0/1342595642 shutdown_connections 2023-11-27T20:43:41.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.615+0000 7ff5591c9640 1 -- 172.21.15.91:0/1342595642 wait complete. 2023-11-27T20:43:41.641 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-27T20:43:41.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.839+0000 7ff14c8ff640 1 Processor -- start 2023-11-27T20:43:41.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.839+0000 7ff14c8ff640 1 -- start start 2023-11-27T20:43:41.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.840+0000 7ff14c8ff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff148152960 0x7ff1480c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:41.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.840+0000 7ff14c8ff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1480c5380 con 0x7ff14814f910 2023-11-27T20:43:41.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.840+0000 7ff14c8ff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14814fcf0 con 0x7ff1480c4f20 2023-11-27T20:43:41.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.840+0000 7ff14c8ff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14806c4f0 con 0x7ff148152960 2023-11-27T20:43:41.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.841+0000 7ff146d9d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff14814f910 0x7ff1480a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49832/0 (socket says 172.21.15.91:49832) 2023-11-27T20:43:41.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.841+0000 7ff146d9d640 1 -- 172.21.15.91:0/1016020874 learned_addr learned my addr 172.21.15.91:0/1016020874 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:41.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.841+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945364770 0 0) 0x7ff1480c5380 con 0x7ff14814f910 2023-11-27T20:43:41.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.841+0000 7ff14759e640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff148152960 0x7ff1480c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:41.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.841+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff130003520 con 0x7ff14814f910 2023-11-27T20:43:41.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4194661155 0 0) 0x7ff130003520 con 0x7ff14814f910 2023-11-27T20:43:41.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff148152960 msgr2=0x7ff1480c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:41.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff148152960 0x7ff1480c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 >> v1:172.21.15.183:6789/0 conn(0x7ff1480c4f20 legacy=0x7ff148152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1480c49a0 con 0x7ff14814f910 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7ff138001670 con 0x7ff14814f910 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 >> v1:172.21.15.91:6789/0 conn(0x7ff14814f910 legacy=0x7ff1480a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1300039a0 0x7ff130003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff148152960 0x7ff1300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff130004d00 0x7ff130005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13000bb10 con 0x7ff130004d00 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13000bc50 con 0x7ff1300039a0 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13000bde0 con 0x7ff148152960 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.842+0000 7ff14759e640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff130004d00 0x7ff130005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:41.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.843+0000 7ff14659c640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff148152960 0x7ff1300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:41.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.843+0000 7ff146d9d640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1300039a0 0x7ff130003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:41.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.843+0000 7ff14759e640 1 -- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff148152960 msgr2=0x7ff1300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:41.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.843+0000 7ff14759e640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff148152960 0x7ff1300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.843+0000 7ff14759e640 1 -- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1300039a0 msgr2=0x7ff130003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:41.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.843+0000 7ff14759e640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1300039a0 0x7ff130003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.843+0000 7ff14759e640 1 -- 172.21.15.91:0/1016020874 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130003520 con 0x7ff130004d00 2023-11-27T20:43:41.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.844+0000 7ff14759e640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff130004d00 0x7ff130005180 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff140009fc0 tx=0x7ff1300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792017e1ef8151d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:41.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.844+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14002cbd0 con 0x7ff130004d00 2023-11-27T20:43:41.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.844+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14000f040 con 0x7ff130004d00 2023-11-27T20:43:41.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.844+0000 7ff145d9b640 1 -- 172.21.15.91:0/1016020874 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140034440 con 0x7ff130004d00 2023-11-27T20:43:41.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.845+0000 7ff14c8ff640 1 -- 172.21.15.91:0/1016020874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff130004d00 msgr2=0x7ff130005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:41.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.845+0000 7ff14c8ff640 1 --2- 172.21.15.91:0/1016020874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff130004d00 0x7ff130005180 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff140009fc0 tx=0x7ff1300057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.845+0000 7ff14759e640 1 -- 172.21.15.91:0/1016020874 reap_dead start 2023-11-27T20:43:41.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.845+0000 7ff14c8ff640 1 -- 172.21.15.91:0/1016020874 shutdown_connections 2023-11-27T20:43:41.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.845+0000 7ff14c8ff640 1 -- 172.21.15.91:0/1016020874 >> 172.21.15.91:0/1016020874 conn(0x7ff1480c5b50 msgr2=0x7ff1480c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:41.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.845+0000 7ff14c8ff640 1 -- 172.21.15.91:0/1016020874 shutdown_connections 2023-11-27T20:43:41.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.845+0000 7ff14c8ff640 1 -- 172.21.15.91:0/1016020874 wait complete. 2023-11-27T20:43:41.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.847+0000 7ff14c8ff640 1 Processor -- start 2023-11-27T20:43:41.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.847+0000 7ff14c8ff640 1 -- start start 2023-11-27T20:43:41.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14c8ff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff130004d00 0x7ff148151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:41.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14c8ff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1480727a0 0x7ff1480bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:41.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14c8ff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff148070160 0x7ff148150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:41.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14c8ff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff148150a80 con 0x7ff148070160 2023-11-27T20:43:41.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14c8ff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff148152400 con 0x7ff130004d00 2023-11-27T20:43:41.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14c8ff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff148150430 con 0x7ff1480727a0 2023-11-27T20:43:41.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff148070160 0x7ff148150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:41.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff148070160 0x7ff148150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60512/0 (socket says 172.21.15.91:60512) 2023-11-27T20:43:41.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14759e640 1 -- 172.21.15.91:0/575748067 learned_addr learned my addr 172.21.15.91:0/575748067 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:41.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14759e640 1 -- 172.21.15.91:0/575748067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1480727a0 msgr2=0x7ff1480bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:41.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14759e640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1480727a0 0x7ff1480bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14759e640 1 -- 172.21.15.91:0/575748067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff130004d00 msgr2=0x7ff148151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:41.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14759e640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff130004d00 0x7ff148151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:41.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.848+0000 7ff14759e640 1 -- 172.21.15.91:0/575748067 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff148150710 con 0x7ff148070160 2023-11-27T20:43:41.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.849+0000 7ff14759e640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff148070160 0x7ff148150f10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff140002230 tx=0x7ff140009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:41.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.849+0000 7ff12f7fe640 1 -- 172.21.15.91:0/575748067 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140043070 con 0x7ff148070160 2023-11-27T20:43:41.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.849+0000 7ff12f7fe640 1 -- 172.21.15.91:0/575748067 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff140003990 con 0x7ff148070160 2023-11-27T20:43:41.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.849+0000 7ff14c8ff640 1 -- 172.21.15.91:0/575748067 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1480c1c20 con 0x7ff148070160 2023-11-27T20:43:41.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.849+0000 7ff12f7fe640 1 -- 172.21.15.91:0/575748067 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140003d40 con 0x7ff148070160 2023-11-27T20:43:41.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.849+0000 7ff14c8ff640 1 -- 172.21.15.91:0/575748067 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff148151450 con 0x7ff148070160 2023-11-27T20:43:41.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.851+0000 7ff14c8ff640 1 -- 172.21.15.91:0/575748067 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff148151640 con 0x7ff148070160 2023-11-27T20:43:41.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.851+0000 7ff12f7fe640 1 -- 172.21.15.91:0/575748067 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff140034920 con 0x7ff148070160 2023-11-27T20:43:41.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.852+0000 7ff12f7fe640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff13406b1c0 0x7ff13406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:41.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.852+0000 7ff12f7fe640 1 -- 172.21.15.91:0/575748067 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff1400aaf50 con 0x7ff148070160 2023-11-27T20:43:41.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.852+0000 7ff146d9d640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff13406b1c0 0x7ff13406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:41.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.853+0000 7ff146d9d640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff13406b1c0 0x7ff13406d680 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff138000f60 tx=0x7ff138000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:41.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:41.857+0000 7ff12f7fe640 1 -- 172.21.15.91:0/575748067 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff140075fb0 con 0x7ff148070160 2023-11-27T20:43:42.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.049+0000 7ff14c8ff640 1 -- 172.21.15.91:0/575748067 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff148150290 con 0x7ff148070160 2023-11-27T20:43:42.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.053+0000 7ff12f7fe640 1 -- 172.21.15.91:0/575748067 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff148150290 con 0x7ff148070160 2023-11-27T20:43:42.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 -- 172.21.15.91:0/575748067 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff13406b1c0 msgr2=0x7ff13406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff13406b1c0 0x7ff13406d680 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff138000f60 tx=0x7ff138000ed0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 -- 172.21.15.91:0/575748067 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff148070160 msgr2=0x7ff148150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff148070160 0x7ff148150f10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff140002230 tx=0x7ff140009750 comp rx=0 tx=0).stop 2023-11-27T20:43:42.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 -- 172.21.15.91:0/575748067 shutdown_connections 2023-11-27T20:43:42.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff148070160 0x7ff148150f10 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1480727a0 0x7ff1480bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff13406b1c0 0x7ff13406d680 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 --2- 172.21.15.91:0/575748067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff130004d00 0x7ff148151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 -- 172.21.15.91:0/575748067 >> 172.21.15.91:0/575748067 conn(0x7ff1480c5b50 msgr2=0x7ff14806db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 -- 172.21.15.91:0/575748067 shutdown_connections 2023-11-27T20:43:42.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.056+0000 7ff14c8ff640 1 -- 172.21.15.91:0/575748067 wait complete. 2023-11-27T20:43:42.075 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-11-27T20:43:42.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.283+0000 7fc647c3d640 1 Processor -- start 2023-11-27T20:43:42.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.283+0000 7fc647c3d640 1 -- start start 2023-11-27T20:43:42.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.284+0000 7fc647c3d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc64014fd30 0x7fc640152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.284+0000 7fc647c3d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc64006d0a0 0x7fc6400a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.284+0000 7fc647c3d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6400c64a0 con 0x7fc6400a5260 2023-11-27T20:43:42.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.284+0000 7fc647c3d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6400c5c00 con 0x7fc64014fd30 2023-11-27T20:43:42.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.285+0000 7fc647c3d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400c5ee0 con 0x7fc64006d0a0 2023-11-27T20:43:42.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.285+0000 7fc6461da640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fc6400a5260 0x7fc6400c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49840/0 (socket says 172.21.15.91:49840) 2023-11-27T20:43:42.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.285+0000 7fc6461da640 1 -- 172.21.15.91:0/460045345 learned_addr learned my addr 172.21.15.91:0/460045345 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:42.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.285+0000 7fc6451d8640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc64006d0a0 0x7fc6400a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.285+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755467235 0 0) 0x7fc6400c64a0 con 0x7fc6400a5260 2023-11-27T20:43:42.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.285+0000 7fc6459d9640 1 --2- 172.21.15.91:0/460045345 >> v2:172.21.15.183:3300/0 conn(0x7fc64014fd30 0x7fc640152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.285+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc62c003520 con 0x7fc6400a5260 2023-11-27T20:43:42.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2920886125 0 0) 0x7fc62c003520 con 0x7fc6400a5260 2023-11-27T20:43:42.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc64006d0a0 msgr2=0x7fc6400a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc64006d0a0 0x7fc6400a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 >> v2:172.21.15.183:3300/0 conn(0x7fc64014fd30 msgr2=0x7fc640152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 --2- 172.21.15.91:0/460045345 >> v2:172.21.15.183:3300/0 conn(0x7fc64014fd30 0x7fc640152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6400c61c0 con 0x7fc6400a5260 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fc638001670 con 0x7fc6400a5260 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 >> v1:172.21.15.91:6789/0 conn(0x7fc6400a5260 legacy=0x7fc6400c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc62c003970 0x7fc62c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc62c0047c0 0x7fc62c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc64006d0a0 0x7fc62c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400c5c00 con 0x7fc62c0047c0 2023-11-27T20:43:42.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400c5ee0 con 0x7fc62c003970 2023-11-27T20:43:42.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c00b980 con 0x7fc64006d0a0 2023-11-27T20:43:42.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.286+0000 7fc6451d8640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc62c0047c0 0x7fc62c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.287+0000 7fc6461da640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc64006d0a0 0x7fc62c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.287+0000 7fc6459d9640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc62c003970 0x7fc62c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.287+0000 7fc6451d8640 1 -- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc64006d0a0 msgr2=0x7fc62c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:42.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.287+0000 7fc6451d8640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc64006d0a0 0x7fc62c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.287+0000 7fc6451d8640 1 -- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc62c003970 msgr2=0x7fc62c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:42.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.287+0000 7fc6451d8640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc62c003970 0x7fc62c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.287+0000 7fc6451d8640 1 -- 172.21.15.91:0/460045345 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c003520 con 0x7fc62c0047c0 2023-11-27T20:43:42.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.287+0000 7fc6459d9640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc62c003970 0x7fc62c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.288+0000 7fc6451d8640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc62c0047c0 0x7fc62c004c40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc630009a90 tx=0x7fc62c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab38a25779a7fc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.288+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63002c680 con 0x7fc62c0047c0 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.288+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63002c7e0 con 0x7fc62c0047c0 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.288+0000 7fc6449d7640 1 -- 172.21.15.91:0/460045345 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63002cb70 con 0x7fc62c0047c0 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.289+0000 7fc647c3d640 1 -- 172.21.15.91:0/460045345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc62c0047c0 msgr2=0x7fc62c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.289+0000 7fc647c3d640 1 --2- 172.21.15.91:0/460045345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc62c0047c0 0x7fc62c004c40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc630009a90 tx=0x7fc62c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.289+0000 7fc6461da640 1 -- 172.21.15.91:0/460045345 reap_dead start 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.289+0000 7fc647c3d640 1 -- 172.21.15.91:0/460045345 shutdown_connections 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.289+0000 7fc647c3d640 1 -- 172.21.15.91:0/460045345 >> 172.21.15.91:0/460045345 conn(0x7fc64006a500 msgr2=0x7fc64006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.289+0000 7fc647c3d640 1 -- 172.21.15.91:0/460045345 shutdown_connections 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.289+0000 7fc647c3d640 1 -- 172.21.15.91:0/460045345 wait complete. 2023-11-27T20:43:42.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.290+0000 7fc647c3d640 1 Processor -- start 2023-11-27T20:43:42.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.291+0000 7fc647c3d640 1 -- start start 2023-11-27T20:43:42.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.291+0000 7fc647c3d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc62c0047c0 0x7fc64014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.291+0000 7fc647c3d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6400722d0 0x7fc6400a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.291+0000 7fc647c3d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6400a9e90 0x7fc64006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.291+0000 7fc647c3d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc640155540 con 0x7fc6400a9e90 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.291+0000 7fc647c3d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64014d930 con 0x7fc62c0047c0 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.291+0000 7fc647c3d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc640071090 con 0x7fc6400722d0 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6461da640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6400a9e90 0x7fc64006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6461da640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6400a9e90 0x7fc64006fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60542/0 (socket says 172.21.15.91:60542) 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6461da640 1 -- 172.21.15.91:0/1715775851 learned_addr learned my addr 172.21.15.91:0/1715775851 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6461da640 1 -- 172.21.15.91:0/1715775851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6400722d0 msgr2=0x7fc6400a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6451d8640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6400722d0 0x7fc6400a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6459d9640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc62c0047c0 0x7fc64014d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6461da640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6400722d0 0x7fc6400a9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6461da640 1 -- 172.21.15.91:0/1715775851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc62c0047c0 msgr2=0x7fc64014d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6461da640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc62c0047c0 0x7fc64014d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6461da640 1 -- 172.21.15.91:0/1715775851 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64014d110 con 0x7fc6400a9e90 2023-11-27T20:43:42.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.292+0000 7fc6461da640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6400a9e90 0x7fc64006fda0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc64006b280 tx=0x7fc63800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:42.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.293+0000 7fc6367fc640 1 -- 172.21.15.91:0/1715775851 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63800eed0 con 0x7fc6400a9e90 2023-11-27T20:43:42.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.293+0000 7fc6367fc640 1 -- 172.21.15.91:0/1715775851 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63800c690 con 0x7fc6400a9e90 2023-11-27T20:43:42.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.293+0000 7fc6367fc640 1 -- 172.21.15.91:0/1715775851 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63800ca20 con 0x7fc6400a9e90 2023-11-27T20:43:42.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.293+0000 7fc647c3d640 1 -- 172.21.15.91:0/1715775851 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6401eac80 con 0x7fc6400a9e90 2023-11-27T20:43:42.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.293+0000 7fc647c3d640 1 -- 172.21.15.91:0/1715775851 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6400aa3f0 con 0x7fc6400a9e90 2023-11-27T20:43:42.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.294+0000 7fc647c3d640 1 -- 172.21.15.91:0/1715775851 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6400c1ea0 con 0x7fc6400a9e90 2023-11-27T20:43:42.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.295+0000 7fc6367fc640 1 -- 172.21.15.91:0/1715775851 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc63800cb80 con 0x7fc6400a9e90 2023-11-27T20:43:42.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.296+0000 7fc6367fc640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc62406b1c0 0x7fc62406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.296+0000 7fc6367fc640 1 -- 172.21.15.91:0/1715775851 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc638089380 con 0x7fc6400a9e90 2023-11-27T20:43:42.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.296+0000 7fc6459d9640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc62406b1c0 0x7fc62406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.297+0000 7fc6459d9640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc62406b1c0 0x7fc62406d680 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc63c007440 tx=0x7fc63c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:42.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.300+0000 7fc6367fc640 1 -- 172.21.15.91:0/1715775851 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc6380543e0 con 0x7fc6400a9e90 2023-11-27T20:43:42.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.567+0000 7fc647c3d640 1 -- 172.21.15.91:0/1715775851 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fc640068350 con 0x7fc6400a9e90 2023-11-27T20:43:42.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.613+0000 7fc6367fc640 1 -- 172.21.15.91:0/1715775851 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v141) v1 ==== 159+0+0 (secure 0 0 0) 0x7fc638057a00 con 0x7fc6400a9e90 2023-11-27T20:43:42.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 -- 172.21.15.91:0/1715775851 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc62406b1c0 msgr2=0x7fc62406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc62406b1c0 0x7fc62406d680 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc63c007440 tx=0x7fc63c00b040 comp rx=0 tx=0).stop 2023-11-27T20:43:42.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 -- 172.21.15.91:0/1715775851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6400a9e90 msgr2=0x7fc64006fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6400a9e90 0x7fc64006fda0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc64006b280 tx=0x7fc63800eb90 comp rx=0 tx=0).stop 2023-11-27T20:43:42.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 -- 172.21.15.91:0/1715775851 shutdown_connections 2023-11-27T20:43:42.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc6400a9e90 0x7fc64006fda0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6400722d0 0x7fc6400a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc62406b1c0 0x7fc62406d680 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 --2- 172.21.15.91:0/1715775851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc62c0047c0 0x7fc64014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 -- 172.21.15.91:0/1715775851 >> 172.21.15.91:0/1715775851 conn(0x7fc64006a500 msgr2=0x7fc6400c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:42.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 -- 172.21.15.91:0/1715775851 shutdown_connections 2023-11-27T20:43:42.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.617+0000 7fc647c3d640 1 -- 172.21.15.91:0/1715775851 wait complete. 2023-11-27T20:43:42.636 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-11-27T20:43:42.636 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-11-27T20:43:42.637 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:42.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.849+0000 7fcf22864640 1 Processor -- start 2023-11-27T20:43:42.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.849+0000 7fcf22864640 1 -- start start 2023-11-27T20:43:42.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf22864640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf1c0c45d0 0x7fcf1c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf22864640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcf1c0c3340 0x7fcf1c156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf22864640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0bfdc0 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf22864640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c06e390 con 0x7fcf1c0c3340 2023-11-27T20:43:42.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf22864640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c06ddd0 con 0x7fcf1c0c45d0 2023-11-27T20:43:42.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf20e01640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcf1c0c3340 0x7fcf1c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf20e01640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcf1c0c3340 0x7fcf1c156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60552/0 (socket says 172.21.15.91:60552) 2023-11-27T20:43:42.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf20e01640 1 -- 172.21.15.91:0/3373014218 learned_addr learned my addr 172.21.15.91:0/3373014218 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:42.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf1bfff640 1 --1- 172.21.15.91:0/3373014218 >> v1:172.21.15.91:6789/0 conn(0x7fcf1c0c5ec0 0x7fcf1c0c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49852/0 (socket says 172.21.15.91:49852) 2023-11-27T20:43:42.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf20e01640 1 -- 172.21.15.91:0/3373014218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf1c0c45d0 msgr2=0x7fcf1c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:42.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.851+0000 7fcf1b7fe640 1 --2- 172.21.15.91:0/3373014218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf1c0c45d0 0x7fcf1c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.852+0000 7fcf20e01640 1 --2- 172.21.15.91:0/3373014218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf1c0c45d0 0x7fcf1c155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.852+0000 7fcf20e01640 1 -- 172.21.15.91:0/3373014218 >> v1:172.21.15.91:6789/0 conn(0x7fcf1c0c5ec0 legacy=0x7fcf1c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.852+0000 7fcf20e01640 1 -- 172.21.15.91:0/3373014218 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c06e0b0 con 0x7fcf1c0c3340 2023-11-27T20:43:42.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.852+0000 7fcf1affd640 1 -- 172.21.15.91:0/3373014218 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737629902 0 0) 0x7fcf1c0bfdc0 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.852+0000 7fcf1b7fe640 1 --2- 172.21.15.91:0/3373014218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf1c0c45d0 0x7fcf1c155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:42.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.853+0000 7fcf20e01640 1 --2- 172.21.15.91:0/3373014218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c3340 0x7fcf1c156370 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009e50 tx=0x7fcf1402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4ce64b52139408 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:42.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.853+0000 7fcf1affd640 1 -- 172.21.15.91:0/3373014218 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1402c9e0 con 0x7fcf1c0c3340 2023-11-27T20:43:42.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.853+0000 7fcf1affd640 1 -- 172.21.15.91:0/3373014218 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1402cb40 con 0x7fcf1c0c3340 2023-11-27T20:43:42.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.853+0000 7fcf1affd640 1 -- 172.21.15.91:0/3373014218 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140343f0 con 0x7fcf1c0c3340 2023-11-27T20:43:42.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.853+0000 7fcf22864640 1 -- 172.21.15.91:0/3373014218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c3340 msgr2=0x7fcf1c156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.853+0000 7fcf22864640 1 --2- 172.21.15.91:0/3373014218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c3340 0x7fcf1c156370 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009e50 tx=0x7fcf1402be40 comp rx=0 tx=0).stop 2023-11-27T20:43:42.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.854+0000 7fcf22864640 1 -- 172.21.15.91:0/3373014218 shutdown_connections 2023-11-27T20:43:42.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.854+0000 7fcf22864640 1 --2- 172.21.15.91:0/3373014218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c3340 0x7fcf1c156370 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.854+0000 7fcf22864640 1 --2- 172.21.15.91:0/3373014218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf1c0c45d0 0x7fcf1c155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.854+0000 7fcf22864640 1 -- 172.21.15.91:0/3373014218 >> 172.21.15.91:0/3373014218 conn(0x7fcf1c06a500 msgr2=0x7fcf1c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:42.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.854+0000 7fcf22864640 1 -- 172.21.15.91:0/3373014218 shutdown_connections 2023-11-27T20:43:42.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.854+0000 7fcf22864640 1 -- 172.21.15.91:0/3373014218 wait complete. 2023-11-27T20:43:42.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.855+0000 7fcf22864640 1 Processor -- start 2023-11-27T20:43:42.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.856+0000 7fcf22864640 1 -- start start 2023-11-27T20:43:42.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.856+0000 7fcf22864640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1c0c3340 0x7fcf1c14cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.856+0000 7fcf22864640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf1c0c45d0 0x7fcf1c1eae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.856+0000 7fcf22864640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c5ec0 0x7fcf1c149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.856+0000 7fcf22864640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c14cb00 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf22864640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c14d460 con 0x7fcf1c0c3340 2023-11-27T20:43:42.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf22864640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c14ebf0 con 0x7fcf1c0c45d0 2023-11-27T20:43:42.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf20e01640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c5ec0 0x7fcf1c149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf20e01640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c5ec0 0x7fcf1c149c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60568/0 (socket says 172.21.15.91:60568) 2023-11-27T20:43:42.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf20e01640 1 -- 172.21.15.91:0/1392985670 learned_addr learned my addr 172.21.15.91:0/1392985670 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:42.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf1bfff640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1c0c3340 0x7fcf1c14cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf20e01640 1 -- 172.21.15.91:0/1392985670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf1c0c45d0 msgr2=0x7fcf1c1eae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf20e01640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf1c0c45d0 0x7fcf1c1eae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf20e01640 1 -- 172.21.15.91:0/1392985670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1c0c3340 msgr2=0x7fcf1c14cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:42.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf20e01640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1c0c3340 0x7fcf1c14cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:42.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.857+0000 7fcf20e01640 1 -- 172.21.15.91:0/1392985670 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009b30 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.858+0000 7fcf20e01640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c5ec0 0x7fcf1c149c90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009e50 tx=0x7fcf14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:42.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.858+0000 7fcf18ff9640 1 -- 172.21.15.91:0/1392985670 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1403e450 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.858+0000 7fcf18ff9640 1 -- 172.21.15.91:0/1392985670 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1403e5b0 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.858+0000 7fcf22864640 1 -- 172.21.15.91:0/1392985670 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c14e910 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.858+0000 7fcf18ff9640 1 -- 172.21.15.91:0/1392985670 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1403e960 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.858+0000 7fcf22864640 1 -- 172.21.15.91:0/1392985670 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c14a820 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.859+0000 7fcf22864640 1 -- 172.21.15.91:0/1392985670 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c14cc40 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.860+0000 7fcf18ff9640 1 -- 172.21.15.91:0/1392985670 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcf1403eac0 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.861+0000 7fcf18ff9640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf0806b1f0 0x7fcf0806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:42.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.862+0000 7fcf18ff9640 1 -- 172.21.15.91:0/1392985670 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcf140ac6a0 con 0x7fcf1c0c5ec0 2023-11-27T20:43:42.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.862+0000 7fcf1bfff640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf0806b1f0 0x7fcf0806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:42.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.862+0000 7fcf1bfff640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf0806b1f0 0x7fcf0806d6b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c000f60 tx=0x7fcf0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:42.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:42.866+0000 7fcf18ff9640 1 -- 172.21.15.91:0/1392985670 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcf1c14cc40 con 0x7fcf1c0c5ec0 2023-11-27T20:43:43.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.068+0000 7fcf22864640 1 -- 172.21.15.91:0/1392985670 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf1c14cc40 con 0x7fcf1c0c5ec0 2023-11-27T20:43:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.070+0000 7fcf18ff9640 1 -- 172.21.15.91:0/1392985670 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+13081 (secure 0 0 0) 0x7fcf1c14cc40 con 0x7fcf1c0c5ec0 2023-11-27T20:43:43.072 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:43.072 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":46,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:41.602404+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.91:6837/127433365":"2023-11-28T20:43:38.095712+0000","172.21.15.91:6835/127433365":"2023-11-28T20:43:38.095712+0000","172.21.15.183:6834/3450105603":"2023-11-28T20:43:30.441853+0000","172.21.15.183:6832/3450105603":"2023-11-28T20:43:30.441853+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 -- 172.21.15.91:0/1392985670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf0806b1f0 msgr2=0x7fcf0806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf0806b1f0 0x7fcf0806d6b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c000f60 tx=0x7fcf0c009040 comp rx=0 tx=0).stop 2023-11-27T20:43:43.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 -- 172.21.15.91:0/1392985670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c5ec0 msgr2=0x7fcf1c149c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c5ec0 0x7fcf1c149c90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009e50 tx=0x7fcf14004a40 comp rx=0 tx=0).stop 2023-11-27T20:43:43.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 -- 172.21.15.91:0/1392985670 shutdown_connections 2023-11-27T20:43:43.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf1c0c5ec0 0x7fcf1c149c90 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf1c0c45d0 0x7fcf1c1eae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf0806b1f0 0x7fcf0806d6b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 --2- 172.21.15.91:0/1392985670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1c0c3340 0x7fcf1c14cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 -- 172.21.15.91:0/1392985670 >> 172.21.15.91:0/1392985670 conn(0x7fcf1c06a500 msgr2=0x7fcf1c0c2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:43.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 -- 172.21.15.91:0/1392985670 shutdown_connections 2023-11-27T20:43:43.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.073+0000 7fcf22864640 1 -- 172.21.15.91:0/1392985670 wait complete. 2023-11-27T20:43:43.094 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:43:43.094 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:43:43.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.307+0000 7f5dea39e640 1 Processor -- start 2023-11-27T20:43:43.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.308+0000 7f5dea39e640 1 -- start start 2023-11-27T20:43:43.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.309+0000 7f5dea39e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5de414c2e0 0x7f5de40c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.309+0000 7f5dea39e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5de40c0440 0x7f5de4152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.309+0000 7f5dea39e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5de4072310 0x7f5de40a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.309+0000 7f5dea39e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de4071470 con 0x7f5de414c2e0 2023-11-27T20:43:43.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.309+0000 7f5dea39e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de4071e80 con 0x7f5de4072310 2023-11-27T20:43:43.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.309+0000 7f5dea39e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de414c6c0 con 0x7f5de40c0440 2023-11-27T20:43:43.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.309+0000 7f5de939c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5de414c2e0 0x7f5de40c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:43.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.309+0000 7f5de939c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5de414c2e0 0x7f5de40c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60578/0 (socket says 172.21.15.91:60578) 2023-11-27T20:43:43.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.309+0000 7f5de939c640 1 -- 172.21.15.91:0/2667035223 learned_addr learned my addr 172.21.15.91:0/2667035223 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:43.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.310+0000 7f5de9b9d640 1 --2- 172.21.15.91:0/2667035223 >> v2:172.21.15.183:3300/0 conn(0x7f5de4072310 0x7f5de40a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:43.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.310+0000 7f5de939c640 1 -- 172.21.15.91:0/2667035223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5de40c0440 msgr2=0x7f5de4152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:43.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.310+0000 7f5de939c640 1 --2- 172.21.15.91:0/2667035223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5de40c0440 0x7f5de4152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.310+0000 7f5de939c640 1 -- 172.21.15.91:0/2667035223 >> v2:172.21.15.183:3300/0 conn(0x7f5de4072310 msgr2=0x7f5de40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:43.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.310+0000 7f5de939c640 1 --2- 172.21.15.91:0/2667035223 >> v2:172.21.15.183:3300/0 conn(0x7f5de4072310 0x7f5de40a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.310+0000 7f5de939c640 1 -- 172.21.15.91:0/2667035223 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de4153180 con 0x7f5de414c2e0 2023-11-27T20:43:43.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.311+0000 7f5de939c640 1 --2- 172.21.15.91:0/2667035223 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 0x7f5de40c0c80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5de406f680 tx=0x7f5de002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8b982eed3c695f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:43.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.311+0000 7f5dd7fff640 1 -- 172.21.15.91:0/2667035223 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0031750 con 0x7f5de414c2e0 2023-11-27T20:43:43.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.311+0000 7f5dd7fff640 1 -- 172.21.15.91:0/2667035223 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de00318b0 con 0x7f5de414c2e0 2023-11-27T20:43:43.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.311+0000 7f5dd7fff640 1 -- 172.21.15.91:0/2667035223 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0031c40 con 0x7f5de414c2e0 2023-11-27T20:43:43.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.312+0000 7f5dea39e640 1 -- 172.21.15.91:0/2667035223 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 msgr2=0x7f5de40c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.312+0000 7f5dea39e640 1 --2- 172.21.15.91:0/2667035223 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 0x7f5de40c0c80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5de406f680 tx=0x7f5de002b7f0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.312+0000 7f5dea39e640 1 -- 172.21.15.91:0/2667035223 shutdown_connections 2023-11-27T20:43:43.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.312+0000 7f5dea39e640 1 --2- 172.21.15.91:0/2667035223 >> v2:172.21.15.183:3300/0 conn(0x7f5de4072310 0x7f5de40a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.312+0000 7f5dea39e640 1 --2- 172.21.15.91:0/2667035223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5de40c0440 0x7f5de4152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.312+0000 7f5dea39e640 1 --2- 172.21.15.91:0/2667035223 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 0x7f5de40c0c80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.312+0000 7f5dea39e640 1 -- 172.21.15.91:0/2667035223 >> 172.21.15.91:0/2667035223 conn(0x7f5de40a77f0 msgr2=0x7f5de40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:43.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.312+0000 7f5dea39e640 1 -- 172.21.15.91:0/2667035223 shutdown_connections 2023-11-27T20:43:43.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.312+0000 7f5dea39e640 1 -- 172.21.15.91:0/2667035223 wait complete. 2023-11-27T20:43:43.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.314+0000 7f5dea39e640 1 Processor -- start 2023-11-27T20:43:43.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.314+0000 7f5dea39e640 1 -- start start 2023-11-27T20:43:43.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.315+0000 7f5dea39e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5de4072310 0x7f5de41543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.315+0000 7f5dea39e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de40c0440 0x7f5de40bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.315+0000 7f5dea39e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 0x7f5de406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.315+0000 7f5dea39e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de41ea4d0 con 0x7f5de414c2e0 2023-11-27T20:43:43.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.315+0000 7f5dea39e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40a8ac0 con 0x7f5de40c0440 2023-11-27T20:43:43.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.315+0000 7f5dea39e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de406c6b0 con 0x7f5de4072310 2023-11-27T20:43:43.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.315+0000 7f5de9b9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 0x7f5de406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:43.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.315+0000 7f5de9b9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 0x7f5de406cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60584/0 (socket says 172.21.15.91:60584) 2023-11-27T20:43:43.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.315+0000 7f5de9b9d640 1 -- 172.21.15.91:0/3244818398 learned_addr learned my addr 172.21.15.91:0/3244818398 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:43.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.315+0000 7f5de939c640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5de4072310 0x7f5de41543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:43.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5de9b9d640 1 -- 172.21.15.91:0/3244818398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5de4072310 msgr2=0x7f5de41543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5de9b9d640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5de4072310 0x7f5de41543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5de8b9b640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de40c0440 0x7f5de40bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:43.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5de9b9d640 1 -- 172.21.15.91:0/3244818398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de40c0440 msgr2=0x7f5de40bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5de9b9d640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de40c0440 0x7f5de40bf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5de9b9d640 1 -- 172.21.15.91:0/3244818398 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de00094d0 con 0x7f5de414c2e0 2023-11-27T20:43:43.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5de9b9d640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 0x7f5de406cb40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00cd70 tx=0x7f5ddc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:43.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5dd5ffb640 1 -- 172.21.15.91:0/3244818398 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc003b90 con 0x7f5de414c2e0 2023-11-27T20:43:43.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5dd5ffb640 1 -- 172.21.15.91:0/3244818398 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc003cf0 con 0x7f5de414c2e0 2023-11-27T20:43:43.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5dd5ffb640 1 -- 172.21.15.91:0/3244818398 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc004240 con 0x7f5de414c2e0 2023-11-27T20:43:43.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5dea39e640 1 -- 172.21.15.91:0/3244818398 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de41ea1f0 con 0x7f5de414c2e0 2023-11-27T20:43:43.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.316+0000 7f5dea39e640 1 -- 172.21.15.91:0/3244818398 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de406c340 con 0x7f5de414c2e0 2023-11-27T20:43:43.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.318+0000 7f5dea39e640 1 -- 172.21.15.91:0/3244818398 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de406bec0 con 0x7f5de414c2e0 2023-11-27T20:43:43.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.318+0000 7f5dd5ffb640 1 -- 172.21.15.91:0/3244818398 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5ddc0043a0 con 0x7f5de414c2e0 2023-11-27T20:43:43.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.320+0000 7f5dd5ffb640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5dc806b1c0 0x7f5dc806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.320+0000 7f5dd5ffb640 1 -- 172.21.15.91:0/3244818398 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5ddc012070 con 0x7f5de414c2e0 2023-11-27T20:43:43.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.320+0000 7f5de939c640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5dc806b1c0 0x7f5dc806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:43.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.321+0000 7f5de939c640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5dc806b1c0 0x7f5dc806d680 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5de0035000 tx=0x7f5de0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:43.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.324+0000 7f5dd5ffb640 1 -- 172.21.15.91:0/3244818398 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5de406bec0 con 0x7f5de414c2e0 2023-11-27T20:43:43.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.513+0000 7f5dea39e640 1 -- 172.21.15.91:0/3244818398 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5de406bec0 con 0x7f5de414c2e0 2023-11-27T20:43:43.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.514+0000 7f5dd5ffb640 1 -- 172.21.15.91:0/3244818398 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5de406bec0 con 0x7f5de414c2e0 2023-11-27T20:43:43.516 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:43:43.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 -- 172.21.15.91:0/3244818398 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5dc806b1c0 msgr2=0x7f5dc806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5dc806b1c0 0x7f5dc806d680 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5de0035000 tx=0x7f5de0008030 comp rx=0 tx=0).stop 2023-11-27T20:43:43.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 -- 172.21.15.91:0/3244818398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 msgr2=0x7f5de406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 0x7f5de406cb40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00cd70 tx=0x7f5ddc00a660 comp rx=0 tx=0).stop 2023-11-27T20:43:43.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 -- 172.21.15.91:0/3244818398 shutdown_connections 2023-11-27T20:43:43.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de414c2e0 0x7f5de406cb40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5dc806b1c0 0x7f5dc806d680 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de40c0440 0x7f5de40bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 --2- 172.21.15.91:0/3244818398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5de4072310 0x7f5de41543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 -- 172.21.15.91:0/3244818398 >> 172.21.15.91:0/3244818398 conn(0x7f5de40a77f0 msgr2=0x7f5de40c24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:43.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 -- 172.21.15.91:0/3244818398 shutdown_connections 2023-11-27T20:43:43.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.517+0000 7f5dea39e640 1 -- 172.21.15.91:0/3244818398 wait complete. 2023-11-27T20:43:43.537 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-11-27T20:43:43.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.750+0000 7fa0b1d39640 1 Processor -- start 2023-11-27T20:43:43.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.751+0000 7fa0b1d39640 1 -- start start 2023-11-27T20:43:43.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.752+0000 7fa0b1d39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa0ac0c5ec0 0x7fa0ac0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.752+0000 7fa0b1d39640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0ac0721a0 0x7fa0ac0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.752+0000 7fa0b1d39640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ac0bfdc0 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.752+0000 7fa0b1d39640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac06e390 con 0x7fa0ac0c5ec0 2023-11-27T20:43:43.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.752+0000 7fa0b1d39640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac06ddd0 con 0x7fa0ac0721a0 2023-11-27T20:43:43.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.752+0000 7fa0ab7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa0ac0c5ec0 0x7fa0ac0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:43.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.752+0000 7fa0a3fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa0ac0c45d0 0x7fa0ac155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:49858/0 (socket says 172.21.15.91:49858) 2023-11-27T20:43:43.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.752+0000 7fa0a3fff640 1 -- 172.21.15.91:0/2015747446 learned_addr learned my addr 172.21.15.91:0/2015747446 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:43.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.753+0000 7fa0abfff640 1 --2- 172.21.15.91:0/2015747446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0ac0721a0 0x7fa0ac0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:43.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.753+0000 7fa0aaffd640 1 -- 172.21.15.91:0/2015747446 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293367570 0 0) 0x7fa0ac0bfdc0 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.753+0000 7fa0aaffd640 1 -- 172.21.15.91:0/2015747446 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa098003520 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.753+0000 7fa0ab7fe640 1 -- 172.21.15.91:0/2015747446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0ac0721a0 msgr2=0x7fa0ac0c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:43.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.753+0000 7fa0ab7fe640 1 --2- 172.21.15.91:0/2015747446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0ac0721a0 0x7fa0ac0c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.753+0000 7fa0ab7fe640 1 -- 172.21.15.91:0/2015747446 >> v1:172.21.15.91:6789/0 conn(0x7fa0ac0c45d0 legacy=0x7fa0ac155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.753+0000 7fa0ab7fe640 1 -- 172.21.15.91:0/2015747446 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac06e0b0 con 0x7fa0ac0c5ec0 2023-11-27T20:43:43.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.754+0000 7fa0ab7fe640 1 --2- 172.21.15.91:0/2015747446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c5ec0 0x7fa0ac0c2c30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0097d0 tx=0x7fa09c02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b27aa2025883997 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.754+0000 7fa0aaffd640 1 -- 172.21.15.91:0/2015747446 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0316f0 con 0x7fa0ac0c5ec0 2023-11-27T20:43:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.754+0000 7fa0aaffd640 1 -- 172.21.15.91:0/2015747446 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c031850 con 0x7fa0ac0c5ec0 2023-11-27T20:43:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.754+0000 7fa0aaffd640 1 -- 172.21.15.91:0/2015747446 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c031bc0 con 0x7fa0ac0c5ec0 2023-11-27T20:43:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.755+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2015747446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c5ec0 msgr2=0x7fa0ac0c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.755+0000 7fa0b1d39640 1 --2- 172.21.15.91:0/2015747446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c5ec0 0x7fa0ac0c2c30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0097d0 tx=0x7fa09c02b790 comp rx=0 tx=0).stop 2023-11-27T20:43:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.755+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2015747446 shutdown_connections 2023-11-27T20:43:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.755+0000 7fa0b1d39640 1 --2- 172.21.15.91:0/2015747446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0ac0721a0 0x7fa0ac0c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.755+0000 7fa0b1d39640 1 --2- 172.21.15.91:0/2015747446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c5ec0 0x7fa0ac0c2c30 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.755+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2015747446 >> 172.21.15.91:0/2015747446 conn(0x7fa0ac06a500 msgr2=0x7fa0ac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:43.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.755+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2015747446 shutdown_connections 2023-11-27T20:43:43.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.755+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2015747446 wait complete. 2023-11-27T20:43:43.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.757+0000 7fa0b1d39640 1 Processor -- start 2023-11-27T20:43:43.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.757+0000 7fa0b1d39640 1 -- start start 2023-11-27T20:43:43.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.758+0000 7fa0b1d39640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0ac0721a0 0x7fa0ac0a7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.758+0000 7fa0b1d39640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c45d0 0x7fa0ac1eb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.758+0000 7fa0b1d39640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0ac0c5ec0 0x7fa0ac1e7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.758+0000 7fa0b1d39640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac14f120 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.758+0000 7fa0b1d39640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac14ba00 con 0x7fa0ac0c5ec0 2023-11-27T20:43:43.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.758+0000 7fa0b1d39640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0a7400 con 0x7fa0ac0721a0 2023-11-27T20:43:43.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.758+0000 7fa0a3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c45d0 0x7fa0ac1eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:43.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.758+0000 7fa0a3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c45d0 0x7fa0ac1eb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60608/0 (socket says 172.21.15.91:60608) 2023-11-27T20:43:43.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.758+0000 7fa0a3fff640 1 -- 172.21.15.91:0/2382435737 learned_addr learned my addr 172.21.15.91:0/2382435737 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:43.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0a3fff640 1 -- 172.21.15.91:0/2382435737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0ac0721a0 msgr2=0x7fa0ac0a7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0a3fff640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0ac0721a0 0x7fa0ac0a7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0a3fff640 1 -- 172.21.15.91:0/2382435737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0ac0c5ec0 msgr2=0x7fa0ac1e7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:43.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0a3fff640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0ac0c5ec0 0x7fa0ac1e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:43.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0a3fff640 1 -- 172.21.15.91:0/2382435737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009400 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0a3fff640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c45d0 0x7fa0ac1eb170 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c400 tx=0x7fa09400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:43.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0a8ff9640 1 -- 172.21.15.91:0/2382435737 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094005ce0 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0a8ff9640 1 -- 172.21.15.91:0/2382435737 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094005e60 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0a8ff9640 1 -- 172.21.15.91:0/2382435737 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094007310 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2382435737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac14b720 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.759+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2382435737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac0a7980 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.760+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2382435737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ac0a7ba0 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.761+0000 7fa0a8ff9640 1 -- 172.21.15.91:0/2382435737 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa094007470 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.762+0000 7fa0a8ff9640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa08c06b1c0 0x7fa08c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:43.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.762+0000 7fa0a8ff9640 1 -- 172.21.15.91:0/2382435737 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa094088dd0 con 0x7fa0ac0c45d0 2023-11-27T20:43:43.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.762+0000 7fa0ab7fe640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa08c06b1c0 0x7fa08c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:43.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.763+0000 7fa0ab7fe640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa08c06b1c0 0x7fa08c06d680 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa09c036000 tx=0x7fa09c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:43.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:43.767+0000 7fa0a8ff9640 1 -- 172.21.15.91:0/2382435737 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa094053d90 con 0x7fa0ac0c45d0 2023-11-27T20:43:44.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.025+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2382435737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fa0ac068350 con 0x7fa0ac0c45d0 2023-11-27T20:43:44.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.625+0000 7fa0a8ff9640 1 -- 172.21.15.91:0/2382435737 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v143) v1 ==== 187+0+0 (secure 0 0 0) 0x7fa094017020 con 0x7fa0ac0c45d0 2023-11-27T20:43:44.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2382435737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa08c06b1c0 msgr2=0x7fa08c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:44.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa08c06b1c0 0x7fa08c06d680 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa09c036000 tx=0x7fa09c030000 comp rx=0 tx=0).stop 2023-11-27T20:43:44.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2382435737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c45d0 msgr2=0x7fa0ac1eb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:44.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c45d0 0x7fa0ac1eb170 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c400 tx=0x7fa09400c8c0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2382435737 shutdown_connections 2023-11-27T20:43:44.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa08c06b1c0 0x7fa08c06d680 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0ac0c5ec0 0x7fa0ac1e7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0ac0c45d0 0x7fa0ac1eb170 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 --2- 172.21.15.91:0/2382435737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0ac0721a0 0x7fa0ac0a7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2382435737 >> 172.21.15.91:0/2382435737 conn(0x7fa0ac06a500 msgr2=0x7fa0ac0c2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:44.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2382435737 shutdown_connections 2023-11-27T20:43:44.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.630+0000 7fa0b1d39640 1 -- 172.21.15.91:0/2382435737 wait complete. 2023-11-27T20:43:44.654 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-27T20:43:44.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.870+0000 7f0adeb9e640 1 Processor -- start 2023-11-27T20:43:44.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.871+0000 7f0adeb9e640 1 -- start start 2023-11-27T20:43:44.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.872+0000 7f0adeb9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad80c7e90 0x7f0ad80c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:44.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.872+0000 7f0adeb9e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0ad80c4e50 0x7f0ad806b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:44.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.872+0000 7f0adeb9e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad80bd8d0 con 0x7f0ad814e810 2023-11-27T20:43:44.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.872+0000 7f0adeb9e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad80c6e60 con 0x7f0ad80c4e50 2023-11-27T20:43:44.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.872+0000 7f0adeb9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80c70d0 con 0x7f0ad80c7e90 2023-11-27T20:43:44.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.872+0000 7f0adc93a640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f0ad814e810 0x7f0ad81550c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45858/0 (socket says 172.21.15.91:45858) 2023-11-27T20:43:44.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.872+0000 7f0adc93a640 1 -- 172.21.15.91:0/2981869723 learned_addr learned my addr 172.21.15.91:0/2981869723 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:44.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244277361 0 0) 0x7f0ad80bd8d0 con 0x7f0ad814e810 2023-11-27T20:43:44.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac0003520 con 0x7f0ad814e810 2023-11-27T20:43:44.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad7fff640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad80c7e90 0x7f0ad80c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:44.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0add13b640 1 --2- 172.21.15.91:0/2981869723 >> v2:172.21.15.183:3300/0 conn(0x7f0ad80c4e50 0x7f0ad806b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:44.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2633795391 0 0) 0x7f0ac0003520 con 0x7f0ad814e810 2023-11-27T20:43:44.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad80c7e90 msgr2=0x7f0ad80c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:44.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad80c7e90 0x7f0ad80c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 >> v2:172.21.15.183:3300/0 conn(0x7f0ad80c4e50 msgr2=0x7f0ad806b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:44.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 --2- 172.21.15.91:0/2981869723 >> v2:172.21.15.183:3300/0 conn(0x7f0ad80c4e50 0x7f0ad806b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad80c73b0 con 0x7f0ad814e810 2023-11-27T20:43:44.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f0ac80019f0 con 0x7f0ad814e810 2023-11-27T20:43:44.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 >> v1:172.21.15.91:6789/0 conn(0x7f0ad814e810 legacy=0x7f0ad81550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:44.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ac0003970 0x7f0ac0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:44.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad80c7e90 0x7f0ac00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:44.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 0x7f0ac0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:44.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80c6e60 con 0x7f0ac0004d00 2023-11-27T20:43:44.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80c70d0 con 0x7f0ac0003970 2023-11-27T20:43:44.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.873+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac000ba30 con 0x7f0ad80c7e90 2023-11-27T20:43:44.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.874+0000 7f0add13b640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 0x7f0ac0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:44.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.874+0000 7f0adc93a640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ac0003970 0x7f0ac0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:44.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.874+0000 7f0ad7fff640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad80c7e90 0x7f0ac00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.874+0000 7f0add13b640 1 -- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad80c7e90 msgr2=0x7f0ac00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.874+0000 7f0add13b640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad80c7e90 0x7f0ac00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.874+0000 7f0add13b640 1 -- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ac0003970 msgr2=0x7f0ac0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.874+0000 7f0add13b640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ac0003970 0x7f0ac0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.874+0000 7f0add13b640 1 -- 172.21.15.91:0/2981869723 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac0003520 con 0x7f0ac0004d00 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.875+0000 7f0add13b640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 0x7f0ac0005180 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000ba30 tx=0x7f0ac00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240a74aac4b9a10d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.875+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0032680 con 0x7f0ac0004d00 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.875+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad00327e0 con 0x7f0ac0004d00 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.876+0000 7f0ad77fe640 1 -- 172.21.15.91:0/2981869723 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0032b70 con 0x7f0ac0004d00 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.876+0000 7f0adeb9e640 1 -- 172.21.15.91:0/2981869723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 msgr2=0x7f0ac0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.876+0000 7f0adeb9e640 1 --2- 172.21.15.91:0/2981869723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 0x7f0ac0005180 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000ba30 tx=0x7f0ac00057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.876+0000 7f0add13b640 1 -- 172.21.15.91:0/2981869723 reap_dead start 2023-11-27T20:43:44.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.876+0000 7f0adeb9e640 1 -- 172.21.15.91:0/2981869723 shutdown_connections 2023-11-27T20:43:44.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.876+0000 7f0adeb9e640 1 -- 172.21.15.91:0/2981869723 >> 172.21.15.91:0/2981869723 conn(0x7f0ad80ca170 msgr2=0x7f0ad80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:44.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.876+0000 7f0adeb9e640 1 -- 172.21.15.91:0/2981869723 shutdown_connections 2023-11-27T20:43:44.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.876+0000 7f0adeb9e640 1 -- 172.21.15.91:0/2981869723 wait complete. 2023-11-27T20:43:44.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.878+0000 7f0adeb9e640 1 Processor -- start 2023-11-27T20:43:44.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.878+0000 7f0adeb9e640 1 -- start start 2023-11-27T20:43:44.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.879+0000 7f0adeb9e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 0x7f0ad8146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:44.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.879+0000 7f0adeb9e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ad814ec60 0x7f0ad8147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:44.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.879+0000 7f0adeb9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad8147850 0x7f0ad81e9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:44.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.879+0000 7f0adeb9e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8158b20 con 0x7f0ac0004d00 2023-11-27T20:43:44.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.879+0000 7f0adeb9e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80c2ac0 con 0x7f0ad814ec60 2023-11-27T20:43:44.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.879+0000 7f0adeb9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad81ea980 con 0x7f0ad8147850 2023-11-27T20:43:44.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.879+0000 7f0adc93a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 0x7f0ad8146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:44.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.879+0000 7f0adc93a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 0x7f0ad8146d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50060/0 (socket says 172.21.15.91:50060) 2023-11-27T20:43:44.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.879+0000 7f0adc93a640 1 -- 172.21.15.91:0/504607684 learned_addr learned my addr 172.21.15.91:0/504607684 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:44.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0ad7fff640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ad814ec60 0x7f0ad8147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:44.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0adc93a640 1 -- 172.21.15.91:0/504607684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad8147850 msgr2=0x7f0ad81e9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:44.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0adc93a640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad8147850 0x7f0ad81e9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0adc93a640 1 -- 172.21.15.91:0/504607684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ad814ec60 msgr2=0x7f0ad8147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:44.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0adc93a640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ad814ec60 0x7f0ad8147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:44.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0adc93a640 1 -- 172.21.15.91:0/504607684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad8155fe0 con 0x7f0ac0004d00 2023-11-27T20:43:44.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0ad7fff640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ad814ec60 0x7f0ad8147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:44.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0adc93a640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 0x7f0ad8146d20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8001580 tx=0x7f0ac800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:44.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0ad57fa640 1 -- 172.21.15.91:0/504607684 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac800edf0 con 0x7f0ac0004d00 2023-11-27T20:43:44.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0ad57fa640 1 -- 172.21.15.91:0/504607684 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8013420 con 0x7f0ac0004d00 2023-11-27T20:43:44.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0ad57fa640 1 -- 172.21.15.91:0/504607684 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac80137d0 con 0x7f0ac0004d00 2023-11-27T20:43:44.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.880+0000 7f0adeb9e640 1 -- 172.21.15.91:0/504607684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad81562c0 con 0x7f0ac0004d00 2023-11-27T20:43:44.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.881+0000 7f0adeb9e640 1 -- 172.21.15.91:0/504607684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad81ea290 con 0x7f0ac0004d00 2023-11-27T20:43:44.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.882+0000 7f0adeb9e640 1 -- 172.21.15.91:0/504607684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad8068350 con 0x7f0ac0004d00 2023-11-27T20:43:44.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.883+0000 7f0ad57fa640 1 -- 172.21.15.91:0/504607684 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0ac8013930 con 0x7f0ac0004d00 2023-11-27T20:43:44.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.883+0000 7f0ad57fa640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac406b1c0 0x7f0ac406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:44.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.884+0000 7f0ad57fa640 1 -- 172.21.15.91:0/504607684 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0ac8089ec0 con 0x7f0ac0004d00 2023-11-27T20:43:44.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.884+0000 7f0ad7fff640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac406b1c0 0x7f0ac406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:44.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.884+0000 7f0ad7fff640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac406b1c0 0x7f0ac406d680 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8147d50 tx=0x7f0acc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:44.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:44.888+0000 7f0ad57fa640 1 -- 172.21.15.91:0/504607684 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0ac8054f20 con 0x7f0ac0004d00 2023-11-27T20:43:45.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.078+0000 7f0adeb9e640 1 -- 172.21.15.91:0/504607684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0ad806ca30 con 0x7f0ac0004d00 2023-11-27T20:43:45.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.086+0000 7f0ad57fa640 1 -- 172.21.15.91:0/504607684 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ac8058540 con 0x7f0ac0004d00 2023-11-27T20:43:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.088+0000 7f0adeb9e640 1 -- 172.21.15.91:0/504607684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac406b1c0 msgr2=0x7f0ac406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.088+0000 7f0adeb9e640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac406b1c0 0x7f0ac406d680 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8147d50 tx=0x7f0acc008040 comp rx=0 tx=0).stop 2023-11-27T20:43:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.088+0000 7f0adeb9e640 1 -- 172.21.15.91:0/504607684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 msgr2=0x7f0ad8146d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.088+0000 7f0adeb9e640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 0x7f0ad8146d20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8001580 tx=0x7f0ac800e530 comp rx=0 tx=0).stop 2023-11-27T20:43:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.088+0000 7f0adeb9e640 1 -- 172.21.15.91:0/504607684 shutdown_connections 2023-11-27T20:43:45.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.088+0000 7f0adeb9e640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ad8147850 0x7f0ad81e9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.089+0000 7f0adeb9e640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac406b1c0 0x7f0ac406d680 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.089+0000 7f0adeb9e640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ad814ec60 0x7f0ad8147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.089+0000 7f0adeb9e640 1 --2- 172.21.15.91:0/504607684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ac0004d00 0x7f0ad8146d20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.089+0000 7f0adeb9e640 1 -- 172.21.15.91:0/504607684 >> 172.21.15.91:0/504607684 conn(0x7f0ad80ca170 msgr2=0x7f0ad806b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:45.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.089+0000 7f0adeb9e640 1 -- 172.21.15.91:0/504607684 shutdown_connections 2023-11-27T20:43:45.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.089+0000 7f0adeb9e640 1 -- 172.21.15.91:0/504607684 wait complete. 2023-11-27T20:43:45.109 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-27T20:43:45.109 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:43:45.216 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:43:45.338 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-27T20:43:45.338 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:43:45.338 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:45.397 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-27T20:43:45.397 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:43:45.397 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:43:45.455 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-27T20:43:45.456 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-27T20:43:45.456 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:45.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.675+0000 7fa9a318a640 1 Processor -- start 2023-11-27T20:43:45.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.676+0000 7fa9a318a640 1 -- start start 2023-11-27T20:43:45.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.677+0000 7fa9a318a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c06d0a0 0x7fa99c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:45.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.677+0000 7fa9a318a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa99c0c3ea0 0x7fa99c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:45.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.677+0000 7fa9a318a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c0c64a0 con 0x7fa99c14fd30 2023-11-27T20:43:45.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.677+0000 7fa9a318a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0c5c00 con 0x7fa99c0c3ea0 2023-11-27T20:43:45.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.677+0000 7fa9a318a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c5ee0 con 0x7fa99c06d0a0 2023-11-27T20:43:45.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.677+0000 7fa9a0f26640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa99c14fd30 0x7fa99c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45860/0 (socket says 172.21.15.91:45860) 2023-11-27T20:43:45.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.677+0000 7fa9a0f26640 1 -- 172.21.15.91:0/1231704996 learned_addr learned my addr 172.21.15.91:0/1231704996 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:45.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99bfff640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c06d0a0 0x7fa99c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:45.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa9a1727640 1 --2- 172.21.15.91:0/1231704996 >> v2:172.21.15.183:3300/0 conn(0x7fa99c0c3ea0 0x7fa99c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:45.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538405515 0 0) 0x7fa99c0c64a0 con 0x7fa99c14fd30 2023-11-27T20:43:45.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa98c003520 con 0x7fa99c14fd30 2023-11-27T20:43:45.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3828960650 0 0) 0x7fa98c003520 con 0x7fa99c14fd30 2023-11-27T20:43:45.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c06d0a0 msgr2=0x7fa99c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99b7fe640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c06d0a0 0x7fa99c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 >> v2:172.21.15.183:3300/0 conn(0x7fa99c0c3ea0 msgr2=0x7fa99c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99b7fe640 1 --2- 172.21.15.91:0/1231704996 >> v2:172.21.15.183:3300/0 conn(0x7fa99c0c3ea0 0x7fa99c0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c0c61c0 con 0x7fa99c14fd30 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fa990001670 con 0x7fa99c14fd30 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.678+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 >> v1:172.21.15.91:6789/0 conn(0x7fa99c14fd30 legacy=0x7fa99c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.679+0000 7fa99b7fe640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98c003970 0x7fa98c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.679+0000 7fa99b7fe640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c06d0a0 0x7fa98c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.679+0000 7fa99b7fe640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa98c004d00 0x7fa98c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.679+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c5c00 con 0x7fa98c004d00 2023-11-27T20:43:45.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.679+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c5ee0 con 0x7fa98c003970 2023-11-27T20:43:45.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.679+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c00b980 con 0x7fa99c06d0a0 2023-11-27T20:43:45.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.679+0000 7fa9a1727640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa98c004d00 0x7fa98c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:45.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.679+0000 7fa9a0f26640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98c003970 0x7fa98c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:45.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.679+0000 7fa99bfff640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c06d0a0 0x7fa98c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:45.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.680+0000 7fa9a1727640 1 -- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c06d0a0 msgr2=0x7fa98c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:45.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.680+0000 7fa9a1727640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c06d0a0 0x7fa98c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.680+0000 7fa9a1727640 1 -- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98c003970 msgr2=0x7fa98c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:45.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.680+0000 7fa9a1727640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98c003970 0x7fa98c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.680+0000 7fa9a1727640 1 -- 172.21.15.91:0/1231704996 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c003520 con 0x7fa98c004d00 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.681+0000 7fa9a1727640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa98c004d00 0x7fa98c005180 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa994009fc0 tx=0x7fa98c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20d4d6c267958a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.681+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99402cc60 con 0x7fa98c004d00 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.681+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99400f040 con 0x7fa98c004d00 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.681+0000 7fa99b7fe640 1 -- 172.21.15.91:0/1231704996 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994034440 con 0x7fa98c004d00 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.682+0000 7fa9a318a640 1 -- 172.21.15.91:0/1231704996 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa98c004d00 msgr2=0x7fa98c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.682+0000 7fa9a318a640 1 --2- 172.21.15.91:0/1231704996 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa98c004d00 0x7fa98c005180 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa994009fc0 tx=0x7fa98c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.682+0000 7fa9a1727640 1 -- 172.21.15.91:0/1231704996 reap_dead start 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.682+0000 7fa9a318a640 1 -- 172.21.15.91:0/1231704996 shutdown_connections 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.682+0000 7fa9a318a640 1 -- 172.21.15.91:0/1231704996 >> 172.21.15.91:0/1231704996 conn(0x7fa99c06a500 msgr2=0x7fa99c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.682+0000 7fa9a318a640 1 -- 172.21.15.91:0/1231704996 shutdown_connections 2023-11-27T20:43:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.682+0000 7fa9a318a640 1 -- 172.21.15.91:0/1231704996 wait complete. 2023-11-27T20:43:45.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.684+0000 7fa9a318a640 1 Processor -- start 2023-11-27T20:43:45.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.684+0000 7fa9a318a640 1 -- start start 2023-11-27T20:43:45.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.685+0000 7fa9a318a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa99c155ca0 0x7fa99c14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:45.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.685+0000 7fa9a318a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c0bace0 0x7fa99c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:45.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.685+0000 7fa9a318a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa99c1dbad0 0x7fa99c1dbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:45.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.685+0000 7fa9a318a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c14f500 con 0x7fa99c155ca0 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.685+0000 7fa9a318a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0bc060 con 0x7fa99c1dbad0 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.685+0000 7fa9a318a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c1dcc70 con 0x7fa99c0bace0 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.685+0000 7fa9a0f26640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa99c155ca0 0x7fa99c14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.685+0000 7fa9a0f26640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa99c155ca0 0x7fa99c14e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50082/0 (socket says 172.21.15.91:50082) 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.685+0000 7fa9a0f26640 1 -- 172.21.15.91:0/1708879207 learned_addr learned my addr 172.21.15.91:0/1708879207 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa99bfff640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c0bace0 0x7fa99c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa9a1727640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa99c1dbad0 0x7fa99c1dbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa9a0f26640 1 -- 172.21.15.91:0/1708879207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c0bace0 msgr2=0x7fa99c14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa9a0f26640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c0bace0 0x7fa99c14e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa9a0f26640 1 -- 172.21.15.91:0/1708879207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa99c1dbad0 msgr2=0x7fa99c1dbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa9a0f26640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa99c1dbad0 0x7fa99c1dbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa9a0f26640 1 -- 172.21.15.91:0/1708879207 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c14ede0 con 0x7fa99c155ca0 2023-11-27T20:43:45.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa9a0f26640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa99c155ca0 0x7fa99c14e090 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa990004840 tx=0x7fa99000ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:45.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa9997fa640 1 -- 172.21.15.91:0/1708879207 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990001be0 con 0x7fa99c155ca0 2023-11-27T20:43:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa9997fa640 1 -- 172.21.15.91:0/1708879207 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99000c8a0 con 0x7fa99c155ca0 2023-11-27T20:43:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.686+0000 7fa9997fa640 1 -- 172.21.15.91:0/1708879207 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000cc30 con 0x7fa99c155ca0 2023-11-27T20:43:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.687+0000 7fa9a318a640 1 -- 172.21.15.91:0/1708879207 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c1dcea0 con 0x7fa99c155ca0 2023-11-27T20:43:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.687+0000 7fa9a318a640 1 -- 172.21.15.91:0/1708879207 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c156860 con 0x7fa99c155ca0 2023-11-27T20:43:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.688+0000 7fa9a318a640 1 -- 172.21.15.91:0/1708879207 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c068350 con 0x7fa99c155ca0 2023-11-27T20:43:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.689+0000 7fa9997fa640 1 -- 172.21.15.91:0/1708879207 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa99001d460 con 0x7fa99c155ca0 2023-11-27T20:43:45.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.689+0000 7fa9997fa640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa98006b1c0 0x7fa98006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:45.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.690+0000 7fa9997fa640 1 -- 172.21.15.91:0/1708879207 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa9900898c0 con 0x7fa99c155ca0 2023-11-27T20:43:45.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.690+0000 7fa99bfff640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa98006b1c0 0x7fa98006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:45.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.690+0000 7fa99bfff640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa98006b1c0 0x7fa98006d680 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa99c06d4e0 tx=0x7fa988008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:45.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.695+0000 7fa9997fa640 1 -- 172.21.15.91:0/1708879207 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa990054890 con 0x7fa99c155ca0 2023-11-27T20:43:45.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.922+0000 7fa9a318a640 1 -- 172.21.15.91:0/1708879207 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa99c1e8820 con 0x7fa99c155ca0 2023-11-27T20:43:45.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.924+0000 7fa9997fa640 1 -- 172.21.15.91:0/1708879207 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fa990057eb0 con 0x7fa99c155ca0 2023-11-27T20:43:45.925 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:45.926 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3801097304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3801097304},{"type":"v1","addr":"172.21.15.183:6835","nonce":3801097304}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/32693995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":32693995},{"type":"v1","addr":"172.21.15.183:6834","nonce":32693995}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5019,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1533449258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1533449258},{"type":"v1","addr":"172.21.15.91:6836","nonce":1533449258}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3497792424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":3497792424},{"type":"v1","addr":"172.21.15.91:6837","nonce":3497792424}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[]} 2023-11-27T20:43:45.926 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 24 2023-11-27T20:43:45.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.926+0000 7fa9a318a640 1 -- 172.21.15.91:0/1708879207 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa98006b1c0 msgr2=0x7fa98006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:45.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.926+0000 7fa9a318a640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa98006b1c0 0x7fa98006d680 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa99c06d4e0 tx=0x7fa988008040 comp rx=0 tx=0).stop 2023-11-27T20:43:45.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.926+0000 7fa9a318a640 1 -- 172.21.15.91:0/1708879207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa99c155ca0 msgr2=0x7fa99c14e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:45.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.926+0000 7fa9a318a640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa99c155ca0 0x7fa99c14e090 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa990004840 tx=0x7fa99000ef80 comp rx=0 tx=0).stop 2023-11-27T20:43:45.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.927+0000 7fa9a318a640 1 -- 172.21.15.91:0/1708879207 shutdown_connections 2023-11-27T20:43:45.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.927+0000 7fa9a318a640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa98006b1c0 0x7fa98006d680 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.927+0000 7fa9a318a640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa99c1dbad0 0x7fa99c1dbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.927+0000 7fa9a318a640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa99c0bace0 0x7fa99c14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.927+0000 7fa9a318a640 1 --2- 172.21.15.91:0/1708879207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa99c155ca0 0x7fa99c14e090 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:45.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.927+0000 7fa9a318a640 1 -- 172.21.15.91:0/1708879207 >> 172.21.15.91:0/1708879207 conn(0x7fa99c06a500 msgr2=0x7fa99c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:45.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.927+0000 7fa9a318a640 1 -- 172.21.15.91:0/1708879207 shutdown_connections 2023-11-27T20:43:45.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:45.927+0000 7fa9a318a640 1 -- 172.21.15.91:0/1708879207 wait complete. 2023-11-27T20:43:45.946 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T20:43:45.946 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-27T20:43:45.946 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-27T20:43:45.946 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:43:45.946 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T20:43:45.947 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-27T20:43:45.947 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-27T20:43:45.947 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:43:45.947 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T20:43:45.947 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-27T20:43:45.947 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-27T20:43:45.947 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:43:45.948 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-27T20:43:45.948 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-27T20:43:45.948 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-27T20:43:45.948 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:43:45.962 INFO:tasks.ceph.mds.c:Stopped 2023-11-27T20:43:45.963 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-27T20:43:45.963 INFO:tasks.ceph.mds.a:Stopped 2023-11-27T20:43:45.964 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-27T20:43:45.968 INFO:tasks.ceph.mds.b:Stopped 2023-11-27T20:43:45.968 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-27T20:43:45.973 INFO:tasks.ceph.mds.d:Stopped 2023-11-27T20:43:45.973 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-27T20:43:46.012 INFO:tasks.ceph.mds.c:Started 2023-11-27T20:43:46.012 DEBUG:teuthology.parallel:result is None 2023-11-27T20:43:46.019 INFO:tasks.ceph.mds.a:Started 2023-11-27T20:43:46.019 DEBUG:teuthology.parallel:result is None 2023-11-27T20:43:46.021 INFO:tasks.ceph.mds.b:Started 2023-11-27T20:43:46.021 DEBUG:teuthology.parallel:result is None 2023-11-27T20:43:46.028 INFO:tasks.ceph.mds.d:Started 2023-11-27T20:43:46.028 DEBUG:teuthology.parallel:result is None 2023-11-27T20:43:46.028 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-27T20:43:46.171 INFO:tasks.ceph.mds.a.smithi091.stdout:starting mds.a at 2023-11-27T20:43:46.171 INFO:tasks.ceph.mds.c.smithi091.stdout:starting mds.c at 2023-11-27T20:43:46.184 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-11-27T20:43:46.190 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-11-27T20:43:46.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.219+0000 7ffb9fcb4640 1 Processor -- start 2023-11-27T20:43:46.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.219+0000 7ffb9fcb4640 1 -- start start 2023-11-27T20:43:46.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.220+0000 7ffb9fcb4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb9814e810 0x7ffb981550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:46.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.220+0000 7ffb9fcb4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffb980c7e90 0x7ffb980c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:46.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.220+0000 7ffb9fcb4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb980bd8d0 con 0x7ffb980c4e50 2023-11-27T20:43:46.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.220+0000 7ffb9fcb4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb980c6e60 con 0x7ffb980c7e90 2023-11-27T20:43:46.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.220+0000 7ffb9fcb4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb98155600 con 0x7ffb9814e810 2023-11-27T20:43:46.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.220+0000 7ffb9d24f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffb980c7e90 0x7ffb980c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:46.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.220+0000 7ffb9d24f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffb980c7e90 0x7ffb980c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50124/0 (socket says 172.21.15.91:50124) 2023-11-27T20:43:46.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.220+0000 7ffb9d24f640 1 -- 172.21.15.91:0/3051994309 learned_addr learned my addr 172.21.15.91:0/3051994309 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:46.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.220+0000 7ffb9da50640 1 --2- 172.21.15.91:0/3051994309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb9814e810 0x7ffb981550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:46.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.221+0000 7ffb9d24f640 1 -- 172.21.15.91:0/3051994309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb9814e810 msgr2=0x7ffb981550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:46.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.221+0000 7ffb9d24f640 1 --2- 172.21.15.91:0/3051994309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb9814e810 0x7ffb981550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:46.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.221+0000 7ffb9d24f640 1 -- 172.21.15.91:0/3051994309 >> v1:172.21.15.91:6789/0 conn(0x7ffb980c4e50 legacy=0x7ffb9806b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:46.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.221+0000 7ffb9d24f640 1 -- 172.21.15.91:0/3051994309 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb980c70d0 con 0x7ffb980c7e90 2023-11-27T20:43:46.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.222+0000 7ffb9d24f640 1 --2- 172.21.15.91:0/3051994309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 0x7ffb980c4910 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009870 tx=0x7ffb8802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d865f0ecb7c459f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:46.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.222+0000 7ffb9ca4e640 1 -- 172.21.15.91:0/3051994309 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88031640 con 0x7ffb980c7e90 2023-11-27T20:43:46.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.222+0000 7ffb9ca4e640 1 -- 172.21.15.91:0/3051994309 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb880317a0 con 0x7ffb980c7e90 2023-11-27T20:43:46.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.222+0000 7ffb9ca4e640 1 -- 172.21.15.91:0/3051994309 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88031b30 con 0x7ffb980c7e90 2023-11-27T20:43:46.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.223+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/3051994309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 msgr2=0x7ffb980c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:46.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.223+0000 7ffb9fcb4640 1 --2- 172.21.15.91:0/3051994309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 0x7ffb980c4910 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009870 tx=0x7ffb8802b8f0 comp rx=0 tx=0).stop 2023-11-27T20:43:46.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.223+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/3051994309 shutdown_connections 2023-11-27T20:43:46.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.223+0000 7ffb9fcb4640 1 --2- 172.21.15.91:0/3051994309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 0x7ffb980c4910 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:46.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.223+0000 7ffb9fcb4640 1 --2- 172.21.15.91:0/3051994309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb9814e810 0x7ffb981550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:46.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.223+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/3051994309 >> 172.21.15.91:0/3051994309 conn(0x7ffb980ca170 msgr2=0x7ffb980ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:46.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.223+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/3051994309 shutdown_connections 2023-11-27T20:43:46.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.223+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/3051994309 wait complete. 2023-11-27T20:43:46.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.225+0000 7ffb9fcb4640 1 Processor -- start 2023-11-27T20:43:46.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.225+0000 7ffb9fcb4640 1 -- start start 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9fcb4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb980c4e50 0x7ffb9814ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9fcb4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 0x7ffb980bdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9fcb4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb9814e810 0x7ffb980bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9fcb4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb981eaea0 con 0x7ffb980c7e90 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9fcb4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb98151680 con 0x7ffb980c4e50 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9fcb4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb98151960 con 0x7ffb9814e810 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9d24f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 0x7ffb980bdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9d24f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 0x7ffb980bdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50138/0 (socket says 172.21.15.91:50138) 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9d24f640 1 -- 172.21.15.91:0/1311851133 learned_addr learned my addr 172.21.15.91:0/1311851133 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9da50640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb980c4e50 0x7ffb9814ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9d24f640 1 -- 172.21.15.91:0/1311851133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb9814e810 msgr2=0x7ffb980bfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:46.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9d24f640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb9814e810 0x7ffb980bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:46.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9d24f640 1 -- 172.21.15.91:0/1311851133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb980c4e50 msgr2=0x7ffb9814ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:46.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9d24f640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb980c4e50 0x7ffb9814ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:46.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9d24f640 1 -- 172.21.15.91:0/1311851133 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb880094d0 con 0x7ffb980c7e90 2023-11-27T20:43:46.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.226+0000 7ffb9da50640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb980c4e50 0x7ffb9814ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:43:46.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.227+0000 7ffb9d24f640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 0x7ffb980bdcd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ffb88000c00 tx=0x7ffb880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:46.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.227+0000 7ffb8e7fc640 1 -- 172.21.15.91:0/1311851133 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8803a930 con 0x7ffb980c7e90 2023-11-27T20:43:46.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.227+0000 7ffb8e7fc640 1 -- 172.21.15.91:0/1311851133 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8803aa90 con 0x7ffb980c7e90 2023-11-27T20:43:46.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.227+0000 7ffb8e7fc640 1 -- 172.21.15.91:0/1311851133 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8803ae40 con 0x7ffb980c7e90 2023-11-27T20:43:46.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.227+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/1311851133 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb980be210 con 0x7ffb980c7e90 2023-11-27T20:43:46.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.227+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/1311851133 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb981eb180 con 0x7ffb980c7e90 2023-11-27T20:43:46.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.228+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/1311851133 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb98066cd0 con 0x7ffb980c7e90 2023-11-27T20:43:46.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.229+0000 7ffb8e7fc640 1 -- 172.21.15.91:0/1311851133 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ffb8802f050 con 0x7ffb980c7e90 2023-11-27T20:43:46.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.230+0000 7ffb8e7fc640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb7c06b1f0 0x7ffb7c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:46.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.230+0000 7ffb8e7fc640 1 -- 172.21.15.91:0/1311851133 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ffb880ab520 con 0x7ffb980c7e90 2023-11-27T20:43:46.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.230+0000 7ffb9da50640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb7c06b1f0 0x7ffb7c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:46.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.231+0000 7ffb9da50640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb7c06b1f0 0x7ffb7c06d6b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffb98151d60 tx=0x7ffb94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:46.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.234+0000 7ffb8e7fc640 1 -- 172.21.15.91:0/1311851133 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ffb88076580 con 0x7ffb980c7e90 2023-11-27T20:43:46.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:46.426+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/1311851133 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ffb9814e070 con 0x7ffb980c7e90 2023-11-27T20:43:47.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.218+0000 7ffb8e7fc640 1 -- 172.21.15.91:0/1311851133 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffb88079ba0 con 0x7ffb980c7e90 2023-11-27T20:43:47.220 INFO:teuthology.orchestra.run.smithi091.stderr: removed all blocklist entries 2023-11-27T20:43:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.222+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/1311851133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb7c06b1f0 msgr2=0x7ffb7c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.222+0000 7ffb9fcb4640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb7c06b1f0 0x7ffb7c06d6b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffb98151d60 tx=0x7ffb94008040 comp rx=0 tx=0).stop 2023-11-27T20:43:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.222+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/1311851133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 msgr2=0x7ffb980bdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.222+0000 7ffb9fcb4640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 0x7ffb980bdcd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ffb88000c00 tx=0x7ffb880046c0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.223+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/1311851133 shutdown_connections 2023-11-27T20:43:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.223+0000 7ffb9fcb4640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb9814e810 0x7ffb980bfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.223+0000 7ffb9fcb4640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb980c7e90 0x7ffb980bdcd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.223+0000 7ffb9fcb4640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffb7c06b1f0 0x7ffb7c06d6b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.223+0000 7ffb9fcb4640 1 --2- 172.21.15.91:0/1311851133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb980c4e50 0x7ffb9814ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.223+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/1311851133 >> 172.21.15.91:0/1311851133 conn(0x7ffb980ca170 msgr2=0x7ffb9806b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.223+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/1311851133 shutdown_connections 2023-11-27T20:43:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.223+0000 7ffb9fcb4640 1 -- 172.21.15.91:0/1311851133 wait complete. 2023-11-27T20:43:47.248 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-27T20:43:47.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.455+0000 7fadf5409640 1 Processor -- start 2023-11-27T20:43:47.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.456+0000 7fadf5409640 1 -- start start 2023-11-27T20:43:47.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.457+0000 7fadf5409640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fadf00c45d0 0x7fadf0155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.457+0000 7fadf5409640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf00bfdc0 con 0x7fadf00c3340 2023-11-27T20:43:47.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.457+0000 7fadf5409640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf0156a80 con 0x7fadf00c5ec0 2023-11-27T20:43:47.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.457+0000 7fadf5409640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf006e390 con 0x7fadf00c45d0 2023-11-27T20:43:47.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.458+0000 7fade67fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fadf00c45d0 0x7fadf0155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:47.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.458+0000 7fade67fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fadf00c45d0 0x7fadf0155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50148/0 (socket says 172.21.15.91:50148) 2023-11-27T20:43:47.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.458+0000 7fadef7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fadf00c3340 0x7fadf0156370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45888/0 (socket says 172.21.15.91:45888) 2023-11-27T20:43:47.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.458+0000 7fade67fc640 1 -- 172.21.15.91:0/3415536715 learned_addr learned my addr 172.21.15.91:0/3415536715 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:47.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.458+0000 7fade67fc640 1 -- 172.21.15.91:0/3415536715 >> v1:172.21.15.183:6789/0 conn(0x7fadf00c5ec0 legacy=0x7fadf00c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:47.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.458+0000 7fade67fc640 1 -- 172.21.15.91:0/3415536715 >> v1:172.21.15.91:6789/0 conn(0x7fadf00c3340 legacy=0x7fadf0156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.458+0000 7fade67fc640 1 -- 172.21.15.91:0/3415536715 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf006ddd0 con 0x7fadf00c45d0 2023-11-27T20:43:47.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.459+0000 7fade67fc640 1 --2- 172.21.15.91:0/3415536715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c45d0 0x7fadf0155e30 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fadd80098a0 tx=0x7fadd802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749e89fb56715511 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:47.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.460+0000 7fadee7fc640 1 -- 172.21.15.91:0/3415536715 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80317c0 con 0x7fadf00c45d0 2023-11-27T20:43:47.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.460+0000 7fadee7fc640 1 -- 172.21.15.91:0/3415536715 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd8031920 con 0x7fadf00c45d0 2023-11-27T20:43:47.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.460+0000 7fadee7fc640 1 -- 172.21.15.91:0/3415536715 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8031cb0 con 0x7fadf00c45d0 2023-11-27T20:43:47.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.460+0000 7fadf5409640 1 -- 172.21.15.91:0/3415536715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c45d0 msgr2=0x7fadf0155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.460+0000 7fadf5409640 1 --2- 172.21.15.91:0/3415536715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c45d0 0x7fadf0155e30 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fadd80098a0 tx=0x7fadd802b860 comp rx=0 tx=0).stop 2023-11-27T20:43:47.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.460+0000 7fadf5409640 1 -- 172.21.15.91:0/3415536715 shutdown_connections 2023-11-27T20:43:47.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.460+0000 7fadf5409640 1 --2- 172.21.15.91:0/3415536715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c45d0 0x7fadf0155e30 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.460+0000 7fadf5409640 1 -- 172.21.15.91:0/3415536715 >> 172.21.15.91:0/3415536715 conn(0x7fadf006a500 msgr2=0x7fadf006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:47.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.460+0000 7fadf5409640 1 -- 172.21.15.91:0/3415536715 shutdown_connections 2023-11-27T20:43:47.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.460+0000 7fadf5409640 1 -- 172.21.15.91:0/3415536715 wait complete. 2023-11-27T20:43:47.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.462+0000 7fadf5409640 1 Processor -- start 2023-11-27T20:43:47.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.462+0000 7fadf5409640 1 -- start start 2023-11-27T20:43:47.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.463+0000 7fadf5409640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c3340 0x7fadf00a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.463+0000 7fadf5409640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00c45d0 0x7fadf0150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.463+0000 7fadf5409640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00c5ec0 0x7fadf01edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.463+0000 7fadf5409640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00a5db0 con 0x7fadf00c3340 2023-11-27T20:43:47.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.463+0000 7fadf5409640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00a5b80 con 0x7fadf00c45d0 2023-11-27T20:43:47.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.463+0000 7fadf5409640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf01edb20 con 0x7fadf00c5ec0 2023-11-27T20:43:47.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.463+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c3340 0x7fadf00a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:47.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.463+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c3340 0x7fadf00a5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50150/0 (socket says 172.21.15.91:50150) 2023-11-27T20:43:47.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.463+0000 7fadeeffd640 1 -- 172.21.15.91:0/1444098038 learned_addr learned my addr 172.21.15.91:0/1444098038 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:47.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fadeeffd640 1 -- 172.21.15.91:0/1444098038 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00c5ec0 msgr2=0x7fadf01edfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fadeeffd640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00c5ec0 0x7fadf01edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fade67fc640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00c45d0 0x7fadf0150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:47.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fadeeffd640 1 -- 172.21.15.91:0/1444098038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00c45d0 msgr2=0x7fadf0150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fadeeffd640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00c45d0 0x7fadf0150720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fadeeffd640 1 -- 172.21.15.91:0/1444098038 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80094d0 con 0x7fadf00c3340 2023-11-27T20:43:47.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fadeeffd640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c3340 0x7fadf00a5640 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fade000b420 tx=0x7fade000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:47.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fade7fff640 1 -- 172.21.15.91:0/1444098038 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0011830 con 0x7fadf00c3340 2023-11-27T20:43:47.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fade7fff640 1 -- 172.21.15.91:0/1444098038 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade0011990 con 0x7fadf00c3340 2023-11-27T20:43:47.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fade7fff640 1 -- 172.21.15.91:0/1444098038 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0011d40 con 0x7fadf00c3340 2023-11-27T20:43:47.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fadf5409640 1 -- 172.21.15.91:0/1444098038 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf00a61c0 con 0x7fadf00c3340 2023-11-27T20:43:47.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.464+0000 7fadf5409640 1 -- 172.21.15.91:0/1444098038 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf00a6780 con 0x7fadf00c3340 2023-11-27T20:43:47.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.465+0000 7fadf5409640 1 -- 172.21.15.91:0/1444098038 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf0071a60 con 0x7fadf00c3340 2023-11-27T20:43:47.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.466+0000 7fade7fff640 1 -- 172.21.15.91:0/1444098038 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fade001b460 con 0x7fadf00c3340 2023-11-27T20:43:47.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.467+0000 7fade7fff640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadd006b1c0 0x7fadd006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.467+0000 7fade7fff640 1 -- 172.21.15.91:0/1444098038 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fade0089210 con 0x7fadf00c3340 2023-11-27T20:43:47.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.468+0000 7fade67fc640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadd006b1c0 0x7fadd006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:47.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.468+0000 7fade67fc640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadd006b1c0 0x7fadd006d680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fadd8036000 tx=0x7fadd803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:47.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.472+0000 7fade7fff640 1 -- 172.21.15.91:0/1444098038 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fade0054320 con 0x7fadf00c3340 2023-11-27T20:43:47.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.732+0000 7fadf5409640 1 -- 172.21.15.91:0/1444098038 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fadf0068350 con 0x7fadf00c3340 2023-11-27T20:43:47.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.734+0000 7fade7fff640 1 -- 172.21.15.91:0/1444098038 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5021 (secure 0 0 0) 0x7fade0057940 con 0x7fadf00c3340 2023-11-27T20:43:47.735 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:47.735 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:43:47.735 INFO:teuthology.orchestra.run.smithi091.stdout: "auth_dump": [ 2023-11-27T20:43:47.735 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.735 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.a", 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRlRwaqHRAAqer3j2kHk7wuowivepQUgw==", 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.b", 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRlx9BVAxAA+wJ5xix5GpiENKnZfH/iFw==", 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.736 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.c", 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRlv407LhAAE6ECkLA1z27fwufNKJNIYA==", 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:43:47.737 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.d", 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRl+kFcExAAkuOMQ90ecoxXDkPxO6FDvw==", 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.738 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.0", 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC9/mRlONFOLhAAYUIBkatNBD7/J4D9sfAiaw==", 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.1", 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDB/mRlvE+RDBAACA+NQHmb0QQxYZgXZpslEQ==", 2023-11-27T20:43:47.739 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.2", 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDE/mRleeqGFhAAHwW2F6fQnCdomrsUsdm+8w==", 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:43:47.740 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.3", 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDH/mRlYT1/IBAATkOmqpRab148FbKtb+MifA==", 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.741 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.4", 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDO/mRlebvbIBAARnJZSuaKdb1vs1PoMQNDOw==", 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.5", 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDR/mRl6MgQOxAAw94eeILe8F/405enQHSaiA==", 2023-11-27T20:43:47.742 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.6", 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDV/mRl5Jd9GhAAv9BxPC9a0D6l3ZBcP0ceUg==", 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:43:47.743 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.7", 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDY/mRlllnNJRAAXnAoHjIq7CKkL8c6MC3byg==", 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.744 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.0", 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRlKBgjIhAArHSIgmH/SwVIdiUlROMOfA==", 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow r", 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.1", 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRlsqHoLBAAzs5TAvGaf/SnzmZfDewgAg==", 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:43:47.745 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow r", 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow rw pool=cephfs2_data" 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.admin", 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC3/mRlMswjDhAAq6QNwbsRncp78C5FXSuMZg==", 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow *", 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.746 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.testuser", 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQBj/2RlR8ZeIBAAKBJlovUboYx+59I6/uYa/Q==", 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow rw fsname=cephfs", 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow r fsname=cephfs", 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mgr.x", 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRl8E2qERAA2C9blyASELJzyHJZ3BdIUw==", 2023-11-27T20:43:47.747 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow *", 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile mgr", 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mgr.y", 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRld4txBRAAvOUjPT9j+tXIe6B82dWA0w==", 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow *", 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile mgr", 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:43:47.748 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.749 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:47.749 INFO:teuthology.orchestra.run.smithi091.stdout: ] 2023-11-27T20:43:47.749 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.736+0000 7fadf5409640 1 -- 172.21.15.91:0/1444098038 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadd006b1c0 msgr2=0x7fadd006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.736+0000 7fadf5409640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadd006b1c0 0x7fadd006d680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fadd8036000 tx=0x7fadd803d040 comp rx=0 tx=0).stop 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.736+0000 7fadf5409640 1 -- 172.21.15.91:0/1444098038 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c3340 msgr2=0x7fadf00a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.736+0000 7fadf5409640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c3340 0x7fadf00a5640 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fade000b420 tx=0x7fade000b8e0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.736+0000 7fadf5409640 1 -- 172.21.15.91:0/1444098038 shutdown_connections 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.736+0000 7fadf5409640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00c5ec0 0x7fadf01edfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.736+0000 7fadf5409640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadd006b1c0 0x7fadd006d680 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.736+0000 7fadf5409640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00c45d0 0x7fadf0150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.736+0000 7fadf5409640 1 --2- 172.21.15.91:0/1444098038 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadf00c3340 0x7fadf00a5640 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.736+0000 7fadf5409640 1 -- 172.21.15.91:0/1444098038 >> 172.21.15.91:0/1444098038 conn(0x7fadf006a500 msgr2=0x7fadf006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.737+0000 7fadf5409640 1 -- 172.21.15.91:0/1444098038 shutdown_connections 2023-11-27T20:43:47.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.737+0000 7fadf5409640 1 -- 172.21.15.91:0/1444098038 wait complete. 2023-11-27T20:43:47.757 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-11-27T20:43:47.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.959+0000 7f15b0eda640 1 Processor -- start 2023-11-27T20:43:47.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.959+0000 7f15b0eda640 1 -- start start 2023-11-27T20:43:47.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.960+0000 7f15b0eda640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f15ac0c2ea0 0x7f15ac0c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.960+0000 7f15b0eda640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c4bc0 0x7f15ac0c5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.960+0000 7f15b0eda640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac157bb0 con 0x7f15ac155260 2023-11-27T20:43:47.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.960+0000 7f15b0eda640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac0c5d30 con 0x7f15ac0c2ea0 2023-11-27T20:43:47.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.960+0000 7f15b0eda640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac158a10 con 0x7f15ac0c4bc0 2023-11-27T20:43:47.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.961+0000 7f15aaffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f15ac0c2ea0 0x7f15ac0c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:47.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.961+0000 7f15abfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c4bc0 0x7f15ac0c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:47.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.961+0000 7f15aaffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f15ac0c2ea0 0x7f15ac0c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:39072/0 (socket says 172.21.15.91:39072) 2023-11-27T20:43:47.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.961+0000 7f15aaffd640 1 -- 172.21.15.91:0/1132626973 learned_addr learned my addr 172.21.15.91:0/1132626973 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:47.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.962+0000 7f15aaffd640 1 -- 172.21.15.91:0/1132626973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c4bc0 msgr2=0x7f15ac0c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:47.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.962+0000 7f15aaffd640 1 --2- 172.21.15.91:0/1132626973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c4bc0 0x7f15ac0c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.962+0000 7f15aaffd640 1 -- 172.21.15.91:0/1132626973 >> v1:172.21.15.183:6789/0 conn(0x7f15ac155260 legacy=0x7f15ac06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.962+0000 7f15aaffd640 1 -- 172.21.15.91:0/1132626973 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac157e00 con 0x7f15ac0c2ea0 2023-11-27T20:43:47.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.963+0000 7f15aaffd640 1 --2- 172.21.15.91:0/1132626973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15ac0c2ea0 0x7f15ac0c2640 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1594009870 tx=0x7f159402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55edf4e31b1a515b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:47.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.964+0000 7f15aa7fc640 1 -- 172.21.15.91:0/1132626973 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940317c0 con 0x7f15ac0c2ea0 2023-11-27T20:43:47.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.964+0000 7f15aa7fc640 1 -- 172.21.15.91:0/1132626973 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1594031920 con 0x7f15ac0c2ea0 2023-11-27T20:43:47.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.964+0000 7f15aa7fc640 1 -- 172.21.15.91:0/1132626973 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594031cb0 con 0x7f15ac0c2ea0 2023-11-27T20:43:47.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.965+0000 7f15b0eda640 1 -- 172.21.15.91:0/1132626973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15ac0c2ea0 msgr2=0x7f15ac0c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.965+0000 7f15b0eda640 1 --2- 172.21.15.91:0/1132626973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15ac0c2ea0 0x7f15ac0c2640 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1594009870 tx=0x7f159402b860 comp rx=0 tx=0).stop 2023-11-27T20:43:47.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.965+0000 7f15b0eda640 1 -- 172.21.15.91:0/1132626973 shutdown_connections 2023-11-27T20:43:47.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.965+0000 7f15b0eda640 1 --2- 172.21.15.91:0/1132626973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c4bc0 0x7f15ac0c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.965+0000 7f15b0eda640 1 --2- 172.21.15.91:0/1132626973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15ac0c2ea0 0x7f15ac0c2640 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.965+0000 7f15b0eda640 1 -- 172.21.15.91:0/1132626973 >> 172.21.15.91:0/1132626973 conn(0x7f15ac0a8870 msgr2=0x7f15ac0a8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:47.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.965+0000 7f15b0eda640 1 -- 172.21.15.91:0/1132626973 shutdown_connections 2023-11-27T20:43:47.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.965+0000 7f15b0eda640 1 -- 172.21.15.91:0/1132626973 wait complete. 2023-11-27T20:43:47.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.966+0000 7f15b0eda640 1 Processor -- start 2023-11-27T20:43:47.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.967+0000 7f15b0eda640 1 -- start start 2023-11-27T20:43:47.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.967+0000 7f15b0eda640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c2ea0 0x7f15ac0a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15b0eda640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15ac0c4bc0 0x7f15ac14cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15b0eda640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15ac155260 0x7f15ac14d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15b0eda640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac14de00 con 0x7f15ac155260 2023-11-27T20:43:47.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15b0eda640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac1eaa40 con 0x7f15ac0c4bc0 2023-11-27T20:43:47.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15b0eda640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac06e8c0 con 0x7f15ac0c2ea0 2023-11-27T20:43:47.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15abfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15ac155260 0x7f15ac14d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:47.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15abfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15ac155260 0x7f15ac14d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50164/0 (socket says 172.21.15.91:50164) 2023-11-27T20:43:47.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15abfff640 1 -- 172.21.15.91:0/653687547 learned_addr learned my addr 172.21.15.91:0/653687547 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:47.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15aaffd640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15ac0c4bc0 0x7f15ac14cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:47.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15abfff640 1 -- 172.21.15.91:0/653687547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c2ea0 msgr2=0x7f15ac0a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15ab7fe640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c2ea0 0x7f15ac0a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:47.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15abfff640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c2ea0 0x7f15ac0a9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15abfff640 1 -- 172.21.15.91:0/653687547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15ac0c4bc0 msgr2=0x7f15ac14cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:47.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15abfff640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15ac0c4bc0 0x7f15ac14cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:47.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15abfff640 1 -- 172.21.15.91:0/653687547 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940094d0 con 0x7f15ac155260 2023-11-27T20:43:47.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15aaffd640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15ac0c4bc0 0x7f15ac14cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:47.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.968+0000 7f15ab7fe640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c2ea0 0x7f15ac0a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:47.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.969+0000 7f15abfff640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15ac155260 0x7f15ac14d2a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f15a400e7f0 tx=0x7f15a400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:47.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.969+0000 7f15a3fff640 1 -- 172.21.15.91:0/653687547 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4009510 con 0x7f15ac155260 2023-11-27T20:43:47.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.969+0000 7f15a3fff640 1 -- 172.21.15.91:0/653687547 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400ee40 con 0x7f15ac155260 2023-11-27T20:43:47.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.969+0000 7f15b0eda640 1 -- 172.21.15.91:0/653687547 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac06eba0 con 0x7f15ac155260 2023-11-27T20:43:47.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.969+0000 7f15a3fff640 1 -- 172.21.15.91:0/653687547 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a400cb80 con 0x7f15ac155260 2023-11-27T20:43:47.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.969+0000 7f15b0eda640 1 -- 172.21.15.91:0/653687547 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac14d7e0 con 0x7f15ac155260 2023-11-27T20:43:47.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.970+0000 7f15b0eda640 1 -- 172.21.15.91:0/653687547 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac06ede0 con 0x7f15ac155260 2023-11-27T20:43:47.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.971+0000 7f15a3fff640 1 -- 172.21.15.91:0/653687547 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f15a400cce0 con 0x7f15ac155260 2023-11-27T20:43:47.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.972+0000 7f15a3fff640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158c06b1c0 0x7f158c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:47.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.972+0000 7f15a3fff640 1 -- 172.21.15.91:0/653687547 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f15a4089750 con 0x7f15ac155260 2023-11-27T20:43:47.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.972+0000 7f15ab7fe640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158c06b1c0 0x7f158c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:47.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.973+0000 7f15ab7fe640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158c06b1c0 0x7f158c06d680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f159c001cd0 tx=0x7f159c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:47.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:47.976+0000 7f15a3fff640 1 -- 172.21.15.91:0/653687547 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f15ac06ede0 con 0x7f15ac155260 2023-11-27T20:43:48.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.229+0000 7f15b0eda640 1 -- 172.21.15.91:0/653687547 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f15ac06ede0 con 0x7f15ac155260 2023-11-27T20:43:48.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.234+0000 7f15a3fff640 1 -- 172.21.15.91:0/653687547 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v18) v1 ==== 85+0+0 (secure 0 0 0) 0x7f15ac06ede0 con 0x7f15ac155260 2023-11-27T20:43:48.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.236+0000 7f15b0eda640 1 -- 172.21.15.91:0/653687547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158c06b1c0 msgr2=0x7f158c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.236+0000 7f15b0eda640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158c06b1c0 0x7f158c06d680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f159c001cd0 tx=0x7f159c009040 comp rx=0 tx=0).stop 2023-11-27T20:43:48.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.236+0000 7f15b0eda640 1 -- 172.21.15.91:0/653687547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15ac155260 msgr2=0x7f15ac14d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.236+0000 7f15b0eda640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15ac155260 0x7f15ac14d2a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f15a400e7f0 tx=0x7f15a400ebf0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.237+0000 7f15b0eda640 1 -- 172.21.15.91:0/653687547 shutdown_connections 2023-11-27T20:43:48.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.237+0000 7f15b0eda640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15ac155260 0x7f15ac14d2a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.237+0000 7f15b0eda640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f158c06b1c0 0x7f158c06d680 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.237+0000 7f15b0eda640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15ac0c4bc0 0x7f15ac14cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.237+0000 7f15b0eda640 1 --2- 172.21.15.91:0/653687547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15ac0c2ea0 0x7f15ac0a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.237+0000 7f15b0eda640 1 -- 172.21.15.91:0/653687547 >> 172.21.15.91:0/653687547 conn(0x7f15ac0a8870 msgr2=0x7f15ac06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:48.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.237+0000 7f15b0eda640 1 -- 172.21.15.91:0/653687547 shutdown_connections 2023-11-27T20:43:48.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.237+0000 7f15b0eda640 1 -- 172.21.15.91:0/653687547 wait complete. 2023-11-27T20:43:48.257 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:48.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.461+0000 7f5d779ce640 1 Processor -- start 2023-11-27T20:43:48.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.461+0000 7f5d779ce640 1 -- start start 2023-11-27T20:43:48.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.462+0000 7f5d779ce640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5d700c45d0 0x7f5d70155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.462+0000 7f5d779ce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c3340 0x7f5d70156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.462+0000 7f5d779ce640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d700bfdc0 con 0x7f5d700c5ec0 2023-11-27T20:43:48.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d779ce640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7006e390 con 0x7f5d700c45d0 2023-11-27T20:43:48.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d779ce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7006ddd0 con 0x7f5d700c3340 2023-11-27T20:43:48.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d74f69640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5d700c45d0 0x7f5d70155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d7576a640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f5d700c5ec0 0x7f5d700c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45894/0 (socket says 172.21.15.91:45894) 2023-11-27T20:43:48.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d7576a640 1 -- 172.21.15.91:0/3545547599 learned_addr learned my addr 172.21.15.91:0/3545547599 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:48.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d74f69640 1 -- 172.21.15.91:0/3545547599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c3340 msgr2=0x7f5d70156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d75f6b640 1 --2- 172.21.15.91:0/3545547599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c3340 0x7f5d70156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d6ffff640 1 -- 172.21.15.91:0/3545547599 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174053922 0 0) 0x7f5d700bfdc0 con 0x7f5d700c5ec0 2023-11-27T20:43:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d74f69640 1 --2- 172.21.15.91:0/3545547599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c3340 0x7f5d70156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d74f69640 1 -- 172.21.15.91:0/3545547599 >> v1:172.21.15.91:6789/0 conn(0x7f5d700c5ec0 legacy=0x7f5d700c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.463+0000 7f5d74f69640 1 -- 172.21.15.91:0/3545547599 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7006e0b0 con 0x7f5d700c45d0 2023-11-27T20:43:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.464+0000 7f5d75f6b640 1 --2- 172.21.15.91:0/3545547599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c3340 0x7f5d70156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:48.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.465+0000 7f5d74f69640 1 --2- 172.21.15.91:0/3545547599 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c45d0 0x7f5d70155e30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009dc0 tx=0x7f5d6402bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198d3693a5bfdea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:48.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.465+0000 7f5d6ffff640 1 -- 172.21.15.91:0/3545547599 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6402cb10 con 0x7f5d700c45d0 2023-11-27T20:43:48.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.465+0000 7f5d6ffff640 1 -- 172.21.15.91:0/3545547599 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6402cc70 con 0x7f5d700c45d0 2023-11-27T20:43:48.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.465+0000 7f5d6ffff640 1 -- 172.21.15.91:0/3545547599 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64034440 con 0x7f5d700c45d0 2023-11-27T20:43:48.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.466+0000 7f5d779ce640 1 -- 172.21.15.91:0/3545547599 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c45d0 msgr2=0x7f5d70155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.466+0000 7f5d779ce640 1 --2- 172.21.15.91:0/3545547599 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c45d0 0x7f5d70155e30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009dc0 tx=0x7f5d6402bd60 comp rx=0 tx=0).stop 2023-11-27T20:43:48.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.466+0000 7f5d779ce640 1 -- 172.21.15.91:0/3545547599 shutdown_connections 2023-11-27T20:43:48.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.466+0000 7f5d779ce640 1 --2- 172.21.15.91:0/3545547599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c3340 0x7f5d70156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.466+0000 7f5d779ce640 1 --2- 172.21.15.91:0/3545547599 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c45d0 0x7f5d70155e30 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.466+0000 7f5d779ce640 1 -- 172.21.15.91:0/3545547599 >> 172.21.15.91:0/3545547599 conn(0x7f5d7006a500 msgr2=0x7f5d7006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:48.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.466+0000 7f5d779ce640 1 -- 172.21.15.91:0/3545547599 shutdown_connections 2023-11-27T20:43:48.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.466+0000 7f5d779ce640 1 -- 172.21.15.91:0/3545547599 wait complete. 2023-11-27T20:43:48.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.468+0000 7f5d779ce640 1 Processor -- start 2023-11-27T20:43:48.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.468+0000 7f5d779ce640 1 -- start start 2023-11-27T20:43:48.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.469+0000 7f5d779ce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700c3340 0x7f5d7014c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.469+0000 7f5d779ce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c45d0 0x7f5d7014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.469+0000 7f5d779ce640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c5ec0 0x7f5d700a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.469+0000 7f5d779ce640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700a78b0 con 0x7f5d700c5ec0 2023-11-27T20:43:48.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.469+0000 7f5d779ce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700a6ca0 con 0x7f5d700c3340 2023-11-27T20:43:48.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.469+0000 7f5d779ce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700a6f80 con 0x7f5d700c45d0 2023-11-27T20:43:48.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d75f6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c5ec0 0x7f5d700a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d75f6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c5ec0 0x7f5d700a7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50192/0 (socket says 172.21.15.91:50192) 2023-11-27T20:43:48.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d75f6b640 1 -- 172.21.15.91:0/3459562268 learned_addr learned my addr 172.21.15.91:0/3459562268 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d7576a640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700c3340 0x7f5d7014c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d74f69640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c45d0 0x7f5d7014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d75f6b640 1 -- 172.21.15.91:0/3459562268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c45d0 msgr2=0x7f5d7014b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d75f6b640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c45d0 0x7f5d7014b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d75f6b640 1 -- 172.21.15.91:0/3459562268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700c3340 msgr2=0x7f5d7014c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d75f6b640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700c3340 0x7f5d7014c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d75f6b640 1 -- 172.21.15.91:0/3459562268 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64009a70 con 0x7f5d700c5ec0 2023-11-27T20:43:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d7576a640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700c3340 0x7f5d7014c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.470+0000 7f5d75f6b640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c5ec0 0x7f5d700a7d40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c7f0 tx=0x7f5d6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:48.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.471+0000 7f5d6dffb640 1 -- 172.21.15.91:0/3459562268 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68007820 con 0x7f5d700c5ec0 2023-11-27T20:43:48.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.471+0000 7f5d6dffb640 1 -- 172.21.15.91:0/3459562268 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d68007980 con 0x7f5d700c5ec0 2023-11-27T20:43:48.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.471+0000 7f5d6dffb640 1 -- 172.21.15.91:0/3459562268 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68007d30 con 0x7f5d700c5ec0 2023-11-27T20:43:48.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.471+0000 7f5d779ce640 1 -- 172.21.15.91:0/3459562268 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d700a7260 con 0x7f5d700c5ec0 2023-11-27T20:43:48.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.471+0000 7f5d779ce640 1 -- 172.21.15.91:0/3459562268 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7014bad0 con 0x7f5d700c5ec0 2023-11-27T20:43:48.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.472+0000 7f5d779ce640 1 -- 172.21.15.91:0/3459562268 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d700a7a60 con 0x7f5d700c5ec0 2023-11-27T20:43:48.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.473+0000 7f5d6dffb640 1 -- 172.21.15.91:0/3459562268 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5d680113f0 con 0x7f5d700c5ec0 2023-11-27T20:43:48.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.474+0000 7f5d6dffb640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d5c06b1c0 0x7f5d5c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.474+0000 7f5d6dffb640 1 -- 172.21.15.91:0/3459562268 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d68089a20 con 0x7f5d700c5ec0 2023-11-27T20:43:48.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.474+0000 7f5d7576a640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d5c06b1c0 0x7f5d5c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.475+0000 7f5d7576a640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d5c06b1c0 0x7f5d5c06d680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5d60000f60 tx=0x7f5d60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:48.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.478+0000 7f5d6dffb640 1 -- 172.21.15.91:0/3459562268 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5d700a7a60 con 0x7f5d700c5ec0 2023-11-27T20:43:48.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.659+0000 7f5d779ce640 1 -- 172.21.15.91:0/3459562268 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d700a7a60 con 0x7f5d700c5ec0 2023-11-27T20:43:48.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.660+0000 7f5d6dffb640 1 -- 172.21.15.91:0/3459562268 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+12822 (secure 0 0 0) 0x7f5d700a7a60 con 0x7f5d700c5ec0 2023-11-27T20:43:48.662 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:48.662 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":51,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:47.216265+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:48.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.663+0000 7f5d779ce640 1 -- 172.21.15.91:0/3459562268 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d5c06b1c0 msgr2=0x7f5d5c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.663+0000 7f5d779ce640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d5c06b1c0 0x7f5d5c06d680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5d60000f60 tx=0x7f5d60009040 comp rx=0 tx=0).stop 2023-11-27T20:43:48.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.663+0000 7f5d779ce640 1 -- 172.21.15.91:0/3459562268 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c5ec0 msgr2=0x7f5d700a7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.663+0000 7f5d779ce640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c5ec0 0x7f5d700a7d40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c7f0 tx=0x7f5d6800ccb0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.664+0000 7f5d779ce640 1 -- 172.21.15.91:0/3459562268 shutdown_connections 2023-11-27T20:43:48.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.664+0000 7f5d779ce640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d700c5ec0 0x7f5d700a7d40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.664+0000 7f5d779ce640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d700c45d0 0x7f5d7014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.664+0000 7f5d779ce640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d5c06b1c0 0x7f5d5c06d680 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.664+0000 7f5d779ce640 1 --2- 172.21.15.91:0/3459562268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700c3340 0x7f5d7014c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.664+0000 7f5d779ce640 1 -- 172.21.15.91:0/3459562268 >> 172.21.15.91:0/3459562268 conn(0x7f5d7006a500 msgr2=0x7f5d70072260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:48.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.664+0000 7f5d779ce640 1 -- 172.21.15.91:0/3459562268 shutdown_connections 2023-11-27T20:43:48.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.664+0000 7f5d779ce640 1 -- 172.21.15.91:0/3459562268 wait complete. 2023-11-27T20:43:48.683 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:43:48.683 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:43:48.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.896+0000 7f2851bd7640 1 Processor -- start 2023-11-27T20:43:48.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.897+0000 7f2851bd7640 1 -- start start 2023-11-27T20:43:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.898+0000 7f2851bd7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f284c155fc0 0x7f284c159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.898+0000 7f2851bd7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f284c0c2e60 0x7f284c163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.898+0000 7f2851bd7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c06d580 con 0x7f284c0c1ca0 2023-11-27T20:43:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.898+0000 7f2851bd7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c06dd60 con 0x7f284c155fc0 2023-11-27T20:43:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.898+0000 7f2851bd7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0c6580 con 0x7f284c0c2e60 2023-11-27T20:43:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.899+0000 7f284b7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f284c155fc0 0x7f284c159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.899+0000 7f284bfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f284c0c2e60 0x7f284c163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.899+0000 7f284b7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f284c155fc0 0x7f284c159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:39108/0 (socket says 172.21.15.91:39108) 2023-11-27T20:43:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.899+0000 7f284b7fe640 1 -- 172.21.15.91:0/390786134 learned_addr learned my addr 172.21.15.91:0/390786134 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:48.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.900+0000 7f284bfff640 1 -- 172.21.15.91:0/390786134 >> v2:172.21.15.183:3300/0 conn(0x7f284c155fc0 msgr2=0x7f284c159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:48.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.900+0000 7f284bfff640 1 --2- 172.21.15.91:0/390786134 >> v2:172.21.15.183:3300/0 conn(0x7f284c155fc0 0x7f284c159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.900+0000 7f284bfff640 1 -- 172.21.15.91:0/390786134 >> v1:172.21.15.183:6789/0 conn(0x7f284c0c1ca0 legacy=0x7f284c0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.900+0000 7f284bfff640 1 -- 172.21.15.91:0/390786134 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0726d0 con 0x7f284c0c2e60 2023-11-27T20:43:48.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.900+0000 7f284b7fe640 1 --2- 172.21.15.91:0/390786134 >> v2:172.21.15.183:3300/0 conn(0x7f284c155fc0 0x7f284c159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:43:48.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.901+0000 7f284bfff640 1 --2- 172.21.15.91:0/390786134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f284c0c2e60 0x7f284c163370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28440097a0 tx=0x7f284402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ab7ad31f6b965fb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:48.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.901+0000 7f284a7fc640 1 -- 172.21.15.91:0/390786134 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28440316f0 con 0x7f284c0c2e60 2023-11-27T20:43:48.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.902+0000 7f284a7fc640 1 -- 172.21.15.91:0/390786134 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844031850 con 0x7f284c0c2e60 2023-11-27T20:43:48.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.902+0000 7f284a7fc640 1 -- 172.21.15.91:0/390786134 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844031be0 con 0x7f284c0c2e60 2023-11-27T20:43:48.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.902+0000 7f2851bd7640 1 -- 172.21.15.91:0/390786134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f284c0c2e60 msgr2=0x7f284c163370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.902+0000 7f2851bd7640 1 --2- 172.21.15.91:0/390786134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f284c0c2e60 0x7f284c163370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28440097a0 tx=0x7f284402b790 comp rx=0 tx=0).stop 2023-11-27T20:43:48.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.902+0000 7f2851bd7640 1 -- 172.21.15.91:0/390786134 shutdown_connections 2023-11-27T20:43:48.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.902+0000 7f2851bd7640 1 --2- 172.21.15.91:0/390786134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f284c0c2e60 0x7f284c163370 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.902+0000 7f2851bd7640 1 --2- 172.21.15.91:0/390786134 >> v2:172.21.15.183:3300/0 conn(0x7f284c155fc0 0x7f284c159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.902+0000 7f2851bd7640 1 -- 172.21.15.91:0/390786134 >> 172.21.15.91:0/390786134 conn(0x7f284c06a500 msgr2=0x7f284c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:48.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.903+0000 7f2851bd7640 1 -- 172.21.15.91:0/390786134 shutdown_connections 2023-11-27T20:43:48.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.903+0000 7f2851bd7640 1 -- 172.21.15.91:0/390786134 wait complete. 2023-11-27T20:43:48.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.904+0000 7f2851bd7640 1 Processor -- start 2023-11-27T20:43:48.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.904+0000 7f2851bd7640 1 -- start start 2023-11-27T20:43:48.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.905+0000 7f2851bd7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f284c0c1ca0 0x7f284c0a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.905+0000 7f2851bd7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f284c0c2e60 0x7f284c152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.905+0000 7f2851bd7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f284c155fc0 0x7f284c1527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.905+0000 7f2851bd7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0c4980 con 0x7f284c0c1ca0 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.905+0000 7f2851bd7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0a5e10 con 0x7f284c0c2e60 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.905+0000 7f2851bd7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0a7040 con 0x7f284c155fc0 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.906+0000 7f284b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f284c0c1ca0 0x7f284c0a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.906+0000 7f284b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f284c0c1ca0 0x7f284c0a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50194/0 (socket says 172.21.15.91:50194) 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.906+0000 7f284b7fe640 1 -- 172.21.15.91:0/3186910082 learned_addr learned my addr 172.21.15.91:0/3186910082 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.906+0000 7f284affd640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f284c0c2e60 0x7f284c152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.906+0000 7f284b7fe640 1 -- 172.21.15.91:0/3186910082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f284c155fc0 msgr2=0x7f284c1527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.906+0000 7f284b7fe640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f284c155fc0 0x7f284c1527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.906+0000 7f284b7fe640 1 -- 172.21.15.91:0/3186910082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f284c0c2e60 msgr2=0x7f284c152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.906+0000 7f284b7fe640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f284c0c2e60 0x7f284c152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:48.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.906+0000 7f284b7fe640 1 -- 172.21.15.91:0/3186910082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c009b30 con 0x7f284c0c1ca0 2023-11-27T20:43:48.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.906+0000 7f284b7fe640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f284c0c1ca0 0x7f284c0a46b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f283c009e80 tx=0x7f283c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:48.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.907+0000 7f2843fff640 1 -- 172.21.15.91:0/3186910082 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c00ce60 con 0x7f284c0c1ca0 2023-11-27T20:43:48.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.907+0000 7f2843fff640 1 -- 172.21.15.91:0/3186910082 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c00f040 con 0x7f284c0c1ca0 2023-11-27T20:43:48.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.907+0000 7f2843fff640 1 -- 172.21.15.91:0/3186910082 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c014680 con 0x7f284c0c1ca0 2023-11-27T20:43:48.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.907+0000 7f2851bd7640 1 -- 172.21.15.91:0/3186910082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2844009400 con 0x7f284c0c1ca0 2023-11-27T20:43:48.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.907+0000 7f2851bd7640 1 -- 172.21.15.91:0/3186910082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c1eeb70 con 0x7f284c0c1ca0 2023-11-27T20:43:48.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.908+0000 7f2851bd7640 1 -- 172.21.15.91:0/3186910082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c0c0270 con 0x7f284c0c1ca0 2023-11-27T20:43:48.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.909+0000 7f2843fff640 1 -- 172.21.15.91:0/3186910082 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f283c0147e0 con 0x7f284c0c1ca0 2023-11-27T20:43:48.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.910+0000 7f2843fff640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f282c06b1c0 0x7f282c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:48.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.910+0000 7f2843fff640 1 -- 172.21.15.91:0/3186910082 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f283c08a0b0 con 0x7f284c0c1ca0 2023-11-27T20:43:48.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.910+0000 7f284affd640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f282c06b1c0 0x7f282c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:48.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.910+0000 7f284affd640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f282c06b1c0 0x7f282c06d680 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f284c0c4c50 tx=0x7f2834009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:48.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:48.914+0000 7f2843fff640 1 -- 172.21.15.91:0/3186910082 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f283c0551c0 con 0x7f284c0c1ca0 2023-11-27T20:43:49.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.103+0000 7f2851bd7640 1 -- 172.21.15.91:0/3186910082 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f284c068350 con 0x7f284c0c1ca0 2023-11-27T20:43:49.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.103+0000 7f2843fff640 1 -- 172.21.15.91:0/3186910082 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f283c0587e0 con 0x7f284c0c1ca0 2023-11-27T20:43:49.105 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:43:49.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 -- 172.21.15.91:0/3186910082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f282c06b1c0 msgr2=0x7f282c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f282c06b1c0 0x7f282c06d680 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f284c0c4c50 tx=0x7f2834009040 comp rx=0 tx=0).stop 2023-11-27T20:43:49.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 -- 172.21.15.91:0/3186910082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f284c0c1ca0 msgr2=0x7f284c0a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f284c0c1ca0 0x7f284c0a46b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f283c009e80 tx=0x7f283c00c490 comp rx=0 tx=0).stop 2023-11-27T20:43:49.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 -- 172.21.15.91:0/3186910082 shutdown_connections 2023-11-27T20:43:49.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f284c155fc0 0x7f284c1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f282c06b1c0 0x7f282c06d680 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f284c0c2e60 0x7f284c152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 --2- 172.21.15.91:0/3186910082 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f284c0c1ca0 0x7f284c0a46b0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 -- 172.21.15.91:0/3186910082 >> 172.21.15.91:0/3186910082 conn(0x7f284c06a500 msgr2=0x7f284c070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:49.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 -- 172.21.15.91:0/3186910082 shutdown_connections 2023-11-27T20:43:49.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.106+0000 7f2851bd7640 1 -- 172.21.15.91:0/3186910082 wait complete. 2023-11-27T20:43:49.126 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T20:43:49.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.339+0000 7fceaf33c640 1 Processor -- start 2023-11-27T20:43:49.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.340+0000 7fceaf33c640 1 -- start start 2023-11-27T20:43:49.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.341+0000 7fceaf33c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea806b1d0 0x7fcea80c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.341+0000 7fceaf33c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea8155730 con 0x7fcea8155230 2023-11-27T20:43:49.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.341+0000 7fceaf33c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea80c5650 con 0x7fcea8152170 2023-11-27T20:43:49.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.341+0000 7fceaf33c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea806c9f0 con 0x7fcea806b1d0 2023-11-27T20:43:49.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.342+0000 7fceac8d7640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fcea8155230 0x7fcea8151a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45896/0 (socket says 172.21.15.91:45896) 2023-11-27T20:43:49.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.342+0000 7fceac8d7640 1 -- 172.21.15.91:0/2762729164 learned_addr learned my addr 172.21.15.91:0/2762729164 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:49.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.342+0000 7fcead0d8640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea806b1d0 0x7fcea80c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:49.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.342+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778632599 0 0) 0x7fcea8155730 con 0x7fcea8155230 2023-11-27T20:43:49.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.342+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce94003520 con 0x7fcea8155230 2023-11-27T20:43:49.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1014956557 0 0) 0x7fce94003520 con 0x7fcea8155230 2023-11-27T20:43:49.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea806b1d0 msgr2=0x7fcea80c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:49.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea806b1d0 0x7fcea80c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 >> v1:172.21.15.183:6789/0 conn(0x7fcea8152170 legacy=0x7fcea815f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea80c9c70 con 0x7fcea8155230 2023-11-27T20:43:49.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fce98001670 con 0x7fcea8155230 2023-11-27T20:43:49.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 >> v1:172.21.15.91:6789/0 conn(0x7fcea8155230 legacy=0x7fcea8151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea806b1d0 0x7fce940039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce94003f20 0x7fce940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 0x7fce94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea806c9f0 con 0x7fce94004d00 2023-11-27T20:43:49.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9400bbc0 con 0x7fce94003f20 2023-11-27T20:43:49.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9400bd80 con 0x7fcea806b1d0 2023-11-27T20:43:49.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fcead8d9640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 0x7fce94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:49.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.343+0000 7fceac8d7640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce94003f20 0x7fce940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:49.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.344+0000 7fcead0d8640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea806b1d0 0x7fce940039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:49.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.344+0000 7fcead8d9640 1 -- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea806b1d0 msgr2=0x7fce940039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:49.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.344+0000 7fcead8d9640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea806b1d0 0x7fce940039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.344+0000 7fcead8d9640 1 -- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce94003f20 msgr2=0x7fce940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:49.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.344+0000 7fcead8d9640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce94003f20 0x7fce940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.344+0000 7fcead8d9640 1 -- 172.21.15.91:0/2762729164 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94003520 con 0x7fce94004d00 2023-11-27T20:43:49.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.345+0000 7fcead8d9640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 0x7fce94005180 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcea0001e50 tx=0x7fce940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81550321e32f5c63 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:49.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.345+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0003b70 con 0x7fce94004d00 2023-11-27T20:43:49.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.345+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea0003cd0 con 0x7fce94004d00 2023-11-27T20:43:49.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.345+0000 7fce9ffff640 1 -- 172.21.15.91:0/2762729164 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0005310 con 0x7fce94004d00 2023-11-27T20:43:49.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.345+0000 7fceaf33c640 1 -- 172.21.15.91:0/2762729164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 msgr2=0x7fce94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.345+0000 7fceaf33c640 1 --2- 172.21.15.91:0/2762729164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 0x7fce94005180 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcea0001e50 tx=0x7fce940057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.345+0000 7fcead8d9640 1 -- 172.21.15.91:0/2762729164 reap_dead start 2023-11-27T20:43:49.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.346+0000 7fceaf33c640 1 -- 172.21.15.91:0/2762729164 shutdown_connections 2023-11-27T20:43:49.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.346+0000 7fceaf33c640 1 -- 172.21.15.91:0/2762729164 >> 172.21.15.91:0/2762729164 conn(0x7fcea80ca100 msgr2=0x7fcea80ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:49.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.346+0000 7fceaf33c640 1 -- 172.21.15.91:0/2762729164 shutdown_connections 2023-11-27T20:43:49.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.346+0000 7fceaf33c640 1 -- 172.21.15.91:0/2762729164 wait complete. 2023-11-27T20:43:49.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.347+0000 7fceaf33c640 1 Processor -- start 2023-11-27T20:43:49.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.348+0000 7fceaf33c640 1 -- start start 2023-11-27T20:43:49.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.348+0000 7fceaf33c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 0x7fcea8156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.348+0000 7fceaf33c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea8156dc0 0x7fcea8157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.348+0000 7fceaf33c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcea8148ea0 0x7fcea8148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.348+0000 7fceaf33c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8146d60 con 0x7fce94004d00 2023-11-27T20:43:49.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.348+0000 7fceaf33c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8148cf0 con 0x7fcea8148ea0 2023-11-27T20:43:49.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.348+0000 7fceaf33c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8149be0 con 0x7fcea8156dc0 2023-11-27T20:43:49.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.349+0000 7fcead0d8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 0x7fcea8156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:49.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.349+0000 7fcead0d8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 0x7fcea8156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50218/0 (socket says 172.21.15.91:50218) 2023-11-27T20:43:49.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.349+0000 7fcead0d8640 1 -- 172.21.15.91:0/3367690000 learned_addr learned my addr 172.21.15.91:0/3367690000 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:49.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.349+0000 7fcead0d8640 1 -- 172.21.15.91:0/3367690000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea8156dc0 msgr2=0x7fcea8157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.349+0000 7fcead0d8640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea8156dc0 0x7fcea8157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.349+0000 7fcead0d8640 1 -- 172.21.15.91:0/3367690000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcea8148ea0 msgr2=0x7fcea8148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.349+0000 7fcead0d8640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcea8148ea0 0x7fcea8148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.349+0000 7fcead0d8640 1 -- 172.21.15.91:0/3367690000 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea8156750 con 0x7fce94004d00 2023-11-27T20:43:49.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.349+0000 7fcead0d8640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 0x7fcea8156210 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcea4011660 tx=0x7fcea4011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:49.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.349+0000 7fce9dffb640 1 -- 172.21.15.91:0/3367690000 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400f940 con 0x7fce94004d00 2023-11-27T20:43:49.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.350+0000 7fce9dffb640 1 -- 172.21.15.91:0/3367690000 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea400faa0 con 0x7fce94004d00 2023-11-27T20:43:49.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.350+0000 7fceaf33c640 1 -- 172.21.15.91:0/3367690000 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea8148a10 con 0x7fce94004d00 2023-11-27T20:43:49.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.350+0000 7fce9dffb640 1 -- 172.21.15.91:0/3367690000 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400fe10 con 0x7fce94004d00 2023-11-27T20:43:49.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.350+0000 7fceaf33c640 1 -- 172.21.15.91:0/3367690000 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea8149870 con 0x7fce94004d00 2023-11-27T20:43:49.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.351+0000 7fceaf33c640 1 -- 172.21.15.91:0/3367690000 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea804e840 con 0x7fce94004d00 2023-11-27T20:43:49.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.352+0000 7fce9dffb640 1 -- 172.21.15.91:0/3367690000 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcea4015460 con 0x7fce94004d00 2023-11-27T20:43:49.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.353+0000 7fce9dffb640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fce8c06b1f0 0x7fce8c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.353+0000 7fce9dffb640 1 -- 172.21.15.91:0/3367690000 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcea4089ed0 con 0x7fce94004d00 2023-11-27T20:43:49.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.353+0000 7fceac8d7640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fce8c06b1f0 0x7fce8c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:49.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.353+0000 7fceac8d7640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fce8c06b1f0 0x7fce8c06d6b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcea80a9b20 tx=0x7fce98001d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:49.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.357+0000 7fce9dffb640 1 -- 172.21.15.91:0/3367690000 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcea4054f40 con 0x7fce94004d00 2023-11-27T20:43:49.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.547+0000 7fceaf33c640 1 -- 172.21.15.91:0/3367690000 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcea81493f0 con 0x7fce94004d00 2023-11-27T20:43:49.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.548+0000 7fce9dffb640 1 -- 172.21.15.91:0/3367690000 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcea81493f0 con 0x7fce94004d00 2023-11-27T20:43:49.550 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:49.550 INFO:teuthology.orchestra.run.smithi091.stdout:[ 2023-11-27T20:43:49.550 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:43:49.550 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 1, 2023-11-27T20:43:49.550 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": ".mgr" 2023-11-27T20:43:49.550 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:43:49.550 INFO:teuthology.orchestra.run.smithi091.stdout:] 2023-11-27T20:43:49.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.550+0000 7fceaf33c640 1 -- 172.21.15.91:0/3367690000 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fce8c06b1f0 msgr2=0x7fce8c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.550+0000 7fceaf33c640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fce8c06b1f0 0x7fce8c06d6b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcea80a9b20 tx=0x7fce98001d50 comp rx=0 tx=0).stop 2023-11-27T20:43:49.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.550+0000 7fceaf33c640 1 -- 172.21.15.91:0/3367690000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 msgr2=0x7fcea8156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.550+0000 7fceaf33c640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 0x7fcea8156210 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcea4011660 tx=0x7fcea4011b20 comp rx=0 tx=0).stop 2023-11-27T20:43:49.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.550+0000 7fceaf33c640 1 -- 172.21.15.91:0/3367690000 shutdown_connections 2023-11-27T20:43:49.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.550+0000 7fceaf33c640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fce8c06b1f0 0x7fce8c06d6b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.550+0000 7fceaf33c640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcea8148ea0 0x7fcea8148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.550+0000 7fceaf33c640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcea8156dc0 0x7fcea8157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.550+0000 7fceaf33c640 1 --2- 172.21.15.91:0/3367690000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce94004d00 0x7fcea8156210 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.550+0000 7fceaf33c640 1 -- 172.21.15.91:0/3367690000 >> 172.21.15.91:0/3367690000 conn(0x7fcea80ca100 msgr2=0x7fcea80aa730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:49.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.551+0000 7fceaf33c640 1 -- 172.21.15.91:0/3367690000 shutdown_connections 2023-11-27T20:43:49.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.551+0000 7fceaf33c640 1 -- 172.21.15.91:0/3367690000 wait complete. 2023-11-27T20:43:49.571 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T20:43:49.571 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T20:43:49.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.779+0000 7f3ddc6e7640 1 Processor -- start 2023-11-27T20:43:49.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.779+0000 7f3ddc6e7640 1 -- start start 2023-11-27T20:43:49.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.780+0000 7f3ddc6e7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3dd4072530 0x7f3dd40c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.780+0000 7f3ddc6e7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3dd4071f70 0x7f3dd40c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.780+0000 7f3ddc6e7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd40c0980 con 0x7f3dd414fa80 2023-11-27T20:43:49.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.780+0000 7f3ddc6e7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd406d160 con 0x7f3dd4071f70 2023-11-27T20:43:49.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.780+0000 7f3ddc6e7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd406c070 con 0x7f3dd4072530 2023-11-27T20:43:49.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.781+0000 7f3ddac84640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3dd4071f70 0x7f3dd40c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:49.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.781+0000 7f3ddac84640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3dd4071f70 0x7f3dd40c2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50230/0 (socket says 172.21.15.91:50230) 2023-11-27T20:43:49.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.781+0000 7f3ddac84640 1 -- 172.21.15.91:0/542989123 learned_addr learned my addr 172.21.15.91:0/542989123 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:49.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.781+0000 7f3ddac84640 1 -- 172.21.15.91:0/542989123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3dd4072530 msgr2=0x7f3dd40c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:49.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.781+0000 7f3dd9c82640 1 --2- 172.21.15.91:0/542989123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3dd4072530 0x7f3dd40c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:49.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.781+0000 7f3ddac84640 1 --2- 172.21.15.91:0/542989123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3dd4072530 0x7f3dd40c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.781+0000 7f3ddac84640 1 -- 172.21.15.91:0/542989123 >> v1:172.21.15.183:6789/0 conn(0x7f3dd414fa80 legacy=0x7f3dd406d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:49.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.781+0000 7f3ddac84640 1 -- 172.21.15.91:0/542989123 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd40c20d0 con 0x7f3dd4071f70 2023-11-27T20:43:49.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.782+0000 7f3ddac84640 1 --2- 172.21.15.91:0/542989123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd4071f70 0x7f3dd40c2610 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009e50 tx=0x7f3dcc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b50a7b9cb2517d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:49.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3dd9481640 1 -- 172.21.15.91:0/542989123 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc02ca70 con 0x7f3dd4071f70 2023-11-27T20:43:49.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3dd9481640 1 -- 172.21.15.91:0/542989123 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc02cbd0 con 0x7f3dd4071f70 2023-11-27T20:43:49.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3dd9481640 1 -- 172.21.15.91:0/542989123 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0343f0 con 0x7f3dd4071f70 2023-11-27T20:43:49.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/542989123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd4071f70 msgr2=0x7f3dd40c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3ddc6e7640 1 --2- 172.21.15.91:0/542989123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd4071f70 0x7f3dd40c2610 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009e50 tx=0x7f3dcc02bed0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/542989123 shutdown_connections 2023-11-27T20:43:49.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3ddc6e7640 1 --2- 172.21.15.91:0/542989123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd4071f70 0x7f3dd40c2610 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3ddc6e7640 1 --2- 172.21.15.91:0/542989123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3dd4072530 0x7f3dd40c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/542989123 >> 172.21.15.91:0/542989123 conn(0x7f3dd40c5bc0 msgr2=0x7f3dd40c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:49.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/542989123 shutdown_connections 2023-11-27T20:43:49.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.783+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/542989123 wait complete. 2023-11-27T20:43:49.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.785+0000 7f3ddc6e7640 1 Processor -- start 2023-11-27T20:43:49.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.785+0000 7f3ddc6e7640 1 -- start start 2023-11-27T20:43:49.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.786+0000 7f3ddc6e7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3dd4071f70 0x7f3dd40c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.786+0000 7f3ddc6e7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3dd4072530 0x7f3dd41e9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.786+0000 7f3ddc6e7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd414fa80 0x7f3dd41ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.786+0000 7f3ddc6e7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd4146e20 con 0x7f3dd414fa80 2023-11-27T20:43:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.786+0000 7f3ddc6e7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd4147540 con 0x7f3dd4071f70 2023-11-27T20:43:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.786+0000 7f3ddc6e7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd4147790 con 0x7f3dd4072530 2023-11-27T20:43:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.787+0000 7f3ddac84640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd414fa80 0x7f3dd41ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.787+0000 7f3ddac84640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd414fa80 0x7f3dd41ea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50244/0 (socket says 172.21.15.91:50244) 2023-11-27T20:43:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.787+0000 7f3ddac84640 1 -- 172.21.15.91:0/1501481054 learned_addr learned my addr 172.21.15.91:0/1501481054 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:49.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.787+0000 7f3ddac84640 1 -- 172.21.15.91:0/1501481054 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3dd4072530 msgr2=0x7f3dd41e9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.787+0000 7f3ddac84640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3dd4072530 0x7f3dd41e9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.787+0000 7f3ddac84640 1 -- 172.21.15.91:0/1501481054 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3dd4071f70 msgr2=0x7f3dd40c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:49.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.787+0000 7f3ddac84640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3dd4071f70 0x7f3dd40c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:49.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.787+0000 7f3ddac84640 1 -- 172.21.15.91:0/1501481054 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc009b30 con 0x7f3dd414fa80 2023-11-27T20:43:49.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.787+0000 7f3ddac84640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd414fa80 0x7f3dd41ea2a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc036040 tx=0x7f3dcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:49.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.788+0000 7f3dcaffd640 1 -- 172.21.15.91:0/1501481054 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc009510 con 0x7f3dd414fa80 2023-11-27T20:43:49.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.788+0000 7f3dcaffd640 1 -- 172.21.15.91:0/1501481054 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc03e450 con 0x7f3dd414fa80 2023-11-27T20:43:49.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.788+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/1501481054 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd41edfc0 con 0x7f3dd414fa80 2023-11-27T20:43:49.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.788+0000 7f3dcaffd640 1 -- 172.21.15.91:0/1501481054 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc03e800 con 0x7f3dd414fa80 2023-11-27T20:43:49.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.788+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/1501481054 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd41edc90 con 0x7f3dd414fa80 2023-11-27T20:43:49.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.789+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/1501481054 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd4147140 con 0x7f3dd414fa80 2023-11-27T20:43:49.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.790+0000 7f3dcaffd640 1 -- 172.21.15.91:0/1501481054 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3dcc03e960 con 0x7f3dd414fa80 2023-11-27T20:43:49.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.791+0000 7f3dcaffd640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3db806b1c0 0x7f3db806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:49.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.791+0000 7f3dcaffd640 1 -- 172.21.15.91:0/1501481054 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3dcc0ac450 con 0x7f3dd414fa80 2023-11-27T20:43:49.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.791+0000 7f3dda483640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3db806b1c0 0x7f3db806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:49.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.792+0000 7f3dda483640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3db806b1c0 0x7f3db806d680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0006fd0 tx=0x7f3dd0006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:49.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.795+0000 7f3dcaffd640 1 -- 172.21.15.91:0/1501481054 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3dd4147140 con 0x7f3dd414fa80 2023-11-27T20:43:49.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:49.988+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/1501481054 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3dd4147140 con 0x7f3dd414fa80 2023-11-27T20:43:50.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.667+0000 7f3dcaffd640 1 -- 172.21.15.91:0/1501481054 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3dd4147140 con 0x7f3dd414fa80 2023-11-27T20:43:50.669 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' created 2023-11-27T20:43:50.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/1501481054 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3db806b1c0 msgr2=0x7f3db806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:50.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3db806b1c0 0x7f3db806d680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0006fd0 tx=0x7f3dd0006bc0 comp rx=0 tx=0).stop 2023-11-27T20:43:50.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/1501481054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd414fa80 msgr2=0x7f3dd41ea2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:50.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd414fa80 0x7f3dd41ea2a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc036040 tx=0x7f3dcc004a40 comp rx=0 tx=0).stop 2023-11-27T20:43:50.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/1501481054 shutdown_connections 2023-11-27T20:43:50.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3dd414fa80 0x7f3dd41ea2a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:50.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3dd4072530 0x7f3dd41e9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:50.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3db806b1c0 0x7f3db806d680 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:50.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 --2- 172.21.15.91:0/1501481054 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3dd4071f70 0x7f3dd40c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:50.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/1501481054 >> 172.21.15.91:0/1501481054 conn(0x7f3dd40c5bc0 msgr2=0x7f3dd40c25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:50.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/1501481054 shutdown_connections 2023-11-27T20:43:50.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.672+0000 7f3ddc6e7640 1 -- 172.21.15.91:0/1501481054 wait complete. 2023-11-27T20:43:50.702 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T20:43:50.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.915+0000 7fd257e2b640 1 Processor -- start 2023-11-27T20:43:50.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.915+0000 7fd257e2b640 1 -- start start 2023-11-27T20:43:50.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.916+0000 7fd257e2b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd25014fd30 0x7fd250152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:50.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.917+0000 7fd257e2b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2500c64a0 con 0x7fd25006d0a0 2023-11-27T20:43:50.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.917+0000 7fd257e2b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2500c5c00 con 0x7fd2500c3ea0 2023-11-27T20:43:50.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.917+0000 7fd257e2b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500c5ee0 con 0x7fd25014fd30 2023-11-27T20:43:50.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.917+0000 7fd2553c6640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd25006d0a0 0x7fd2500a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45898/0 (socket says 172.21.15.91:45898) 2023-11-27T20:43:50.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.917+0000 7fd2553c6640 1 -- 172.21.15.91:0/1912773133 learned_addr learned my addr 172.21.15.91:0/1912773133 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:50.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.917+0000 7fd255bc7640 1 --2- 172.21.15.91:0/1912773133 >> v2:172.21.15.183:3300/0 conn(0x7fd25014fd30 0x7fd250152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:50.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.918+0000 7fd254bc5640 1 -- 172.21.15.91:0/1912773133 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527609631 0 0) 0x7fd2500c64a0 con 0x7fd25006d0a0 2023-11-27T20:43:50.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.918+0000 7fd254bc5640 1 -- 172.21.15.91:0/1912773133 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23c003520 con 0x7fd25006d0a0 2023-11-27T20:43:50.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.918+0000 7fd255bc7640 1 -- 172.21.15.91:0/1912773133 >> v1:172.21.15.183:6789/0 conn(0x7fd2500c3ea0 legacy=0x7fd2500c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:50.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.918+0000 7fd255bc7640 1 -- 172.21.15.91:0/1912773133 >> v1:172.21.15.91:6789/0 conn(0x7fd25006d0a0 legacy=0x7fd2500a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:50.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.918+0000 7fd254bc5640 1 -- 172.21.15.91:0/1912773133 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1905563608 0 0) 0x7fd23c003520 con 0x7fd25006d0a0 2023-11-27T20:43:50.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.918+0000 7fd255bc7640 1 -- 172.21.15.91:0/1912773133 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500c61c0 con 0x7fd25014fd30 2023-11-27T20:43:50.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.920+0000 7fd255bc7640 1 --2- 172.21.15.91:0/1912773133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25014fd30 0x7fd250152f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0097a0 tx=0x7fd24c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c67f501686f02e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:50.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.920+0000 7fd254bc5640 1 -- 172.21.15.91:0/1912773133 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c02f050 con 0x7fd25014fd30 2023-11-27T20:43:50.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.920+0000 7fd254bc5640 1 -- 172.21.15.91:0/1912773133 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c031500 con 0x7fd25014fd30 2023-11-27T20:43:50.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.920+0000 7fd254bc5640 1 -- 172.21.15.91:0/1912773133 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240001670 con 0x7fd25014fd30 2023-11-27T20:43:50.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.921+0000 7fd257e2b640 1 -- 172.21.15.91:0/1912773133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25014fd30 msgr2=0x7fd250152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:50.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.921+0000 7fd257e2b640 1 --2- 172.21.15.91:0/1912773133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25014fd30 0x7fd250152f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0097a0 tx=0x7fd24c02b820 comp rx=0 tx=0).stop 2023-11-27T20:43:50.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.921+0000 7fd257e2b640 1 -- 172.21.15.91:0/1912773133 shutdown_connections 2023-11-27T20:43:50.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.921+0000 7fd257e2b640 1 --2- 172.21.15.91:0/1912773133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25014fd30 0x7fd250152f20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:50.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.921+0000 7fd257e2b640 1 -- 172.21.15.91:0/1912773133 >> 172.21.15.91:0/1912773133 conn(0x7fd25006a500 msgr2=0x7fd25006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:50.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.922+0000 7fd257e2b640 1 -- 172.21.15.91:0/1912773133 shutdown_connections 2023-11-27T20:43:50.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.922+0000 7fd257e2b640 1 -- 172.21.15.91:0/1912773133 wait complete. 2023-11-27T20:43:50.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.923+0000 7fd257e2b640 1 Processor -- start 2023-11-27T20:43:50.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.923+0000 7fd257e2b640 1 -- start start 2023-11-27T20:43:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.924+0000 7fd257e2b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25006d0a0 0x7fd25014f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.924+0000 7fd257e2b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2500c3ea0 0x7fd250155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.924+0000 7fd257e2b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd25014fd30 0x7fd25014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.924+0000 7fd257e2b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2501ee370 con 0x7fd25014fd30 2023-11-27T20:43:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.924+0000 7fd257e2b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25014f7e0 con 0x7fd25006d0a0 2023-11-27T20:43:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.924+0000 7fd257e2b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2501ed5b0 con 0x7fd2500c3ea0 2023-11-27T20:43:50.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2563c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd25014fd30 0x7fd25014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:50.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2563c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd25014fd30 0x7fd25014e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50260/0 (socket says 172.21.15.91:50260) 2023-11-27T20:43:50.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2563c8640 1 -- 172.21.15.91:0/337650762 learned_addr learned my addr 172.21.15.91:0/337650762 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:50.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd255bc7640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25006d0a0 0x7fd25014f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2553c6640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2500c3ea0 0x7fd250155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2563c8640 1 -- 172.21.15.91:0/337650762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2500c3ea0 msgr2=0x7fd250155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2563c8640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2500c3ea0 0x7fd250155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2563c8640 1 -- 172.21.15.91:0/337650762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25006d0a0 msgr2=0x7fd25014f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2563c8640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25006d0a0 0x7fd25014f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:50.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2563c8640 1 -- 172.21.15.91:0/337650762 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c009400 con 0x7fd25014fd30 2023-11-27T20:43:50.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2553c6640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2500c3ea0 0x7fd250155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:50.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.925+0000 7fd2563c8640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd25014fd30 0x7fd25014e4b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd24800c7a0 tx=0x7fd24800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:50.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.926+0000 7fd2467fc640 1 -- 172.21.15.91:0/337650762 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248003b70 con 0x7fd25014fd30 2023-11-27T20:43:50.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.926+0000 7fd2467fc640 1 -- 172.21.15.91:0/337650762 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd248003cf0 con 0x7fd25014fd30 2023-11-27T20:43:50.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.926+0000 7fd2467fc640 1 -- 172.21.15.91:0/337650762 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248003ea0 con 0x7fd25014fd30 2023-11-27T20:43:50.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.926+0000 7fd257e2b640 1 -- 172.21.15.91:0/337650762 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2501ed890 con 0x7fd25014fd30 2023-11-27T20:43:50.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.926+0000 7fd257e2b640 1 -- 172.21.15.91:0/337650762 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2501ede50 con 0x7fd25014fd30 2023-11-27T20:43:50.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.927+0000 7fd257e2b640 1 -- 172.21.15.91:0/337650762 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd250068350 con 0x7fd25014fd30 2023-11-27T20:43:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.928+0000 7fd2467fc640 1 -- 172.21.15.91:0/337650762 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd24800aa30 con 0x7fd25014fd30 2023-11-27T20:43:50.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.929+0000 7fd2467fc640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd23406b1c0 0x7fd23406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.929+0000 7fd2467fc640 1 -- 172.21.15.91:0/337650762 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd248089590 con 0x7fd25014fd30 2023-11-27T20:43:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.929+0000 7fd255bc7640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd23406b1c0 0x7fd23406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:50.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.930+0000 7fd255bc7640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd23406b1c0 0x7fd23406d680 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd24c035000 tx=0x7fd24c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:50.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:50.934+0000 7fd2467fc640 1 -- 172.21.15.91:0/337650762 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd248054530 con 0x7fd25014fd30 2023-11-27T20:43:51.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.124+0000 7fd257e2b640 1 -- 172.21.15.91:0/337650762 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd2500c66d0 con 0x7fd25014fd30 2023-11-27T20:43:51.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.674+0000 7fd2467fc640 1 -- 172.21.15.91:0/337650762 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd248057b50 con 0x7fd25014fd30 2023-11-27T20:43:51.675 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' created 2023-11-27T20:43:51.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.677+0000 7fd257e2b640 1 -- 172.21.15.91:0/337650762 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd23406b1c0 msgr2=0x7fd23406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:51.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.677+0000 7fd257e2b640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd23406b1c0 0x7fd23406d680 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd24c035000 tx=0x7fd24c008030 comp rx=0 tx=0).stop 2023-11-27T20:43:51.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.678+0000 7fd257e2b640 1 -- 172.21.15.91:0/337650762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd25014fd30 msgr2=0x7fd25014e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:51.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.678+0000 7fd257e2b640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd25014fd30 0x7fd25014e4b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd24800c7a0 tx=0x7fd24800cc60 comp rx=0 tx=0).stop 2023-11-27T20:43:51.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.678+0000 7fd257e2b640 1 -- 172.21.15.91:0/337650762 shutdown_connections 2023-11-27T20:43:51.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.678+0000 7fd257e2b640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd25014fd30 0x7fd25014e4b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:51.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.678+0000 7fd257e2b640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2500c3ea0 0x7fd250155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:51.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.678+0000 7fd257e2b640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd23406b1c0 0x7fd23406d680 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:51.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.678+0000 7fd257e2b640 1 --2- 172.21.15.91:0/337650762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25006d0a0 0x7fd25014f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:51.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.678+0000 7fd257e2b640 1 -- 172.21.15.91:0/337650762 >> 172.21.15.91:0/337650762 conn(0x7fd25006a500 msgr2=0x7fd2500a83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:51.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.678+0000 7fd257e2b640 1 -- 172.21.15.91:0/337650762 shutdown_connections 2023-11-27T20:43:51.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.679+0000 7fd257e2b640 1 -- 172.21.15.91:0/337650762 wait complete. 2023-11-27T20:43:51.716 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T20:43:51.793 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:51.800 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:51.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.901+0000 7feef2252640 1 Processor -- start 2023-11-27T20:43:51.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.901+0000 7feef2252640 1 -- start start 2023-11-27T20:43:51.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.902+0000 7feef2252640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feeec14c2e0 0x7feeec0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:51.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.902+0000 7feef2252640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec071e80 con 0x7feeec0c0440 2023-11-27T20:43:51.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.902+0000 7feef2252640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec14c6c0 con 0x7feeec072310 2023-11-27T20:43:51.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.902+0000 7feef2252640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec071470 con 0x7feeec14c2e0 2023-11-27T20:43:51.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.902+0000 7feef0a4f640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7feeec0c0440 0x7feeec152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45912/0 (socket says 172.21.15.91:45912) 2023-11-27T20:43:51.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.902+0000 7feef0a4f640 1 -- 172.21.15.91:0/834161146 learned_addr learned my addr 172.21.15.91:0/834161146 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:51.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.903+0000 7feef1250640 1 --2- 172.21.15.91:0/834161146 >> v2:172.21.15.183:3300/0 conn(0x7feeec14c2e0 0x7feeec0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:51.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.903+0000 7feee3fff640 1 -- 172.21.15.91:0/834161146 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279859995 0 0) 0x7feeec071e80 con 0x7feeec0c0440 2023-11-27T20:43:51.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.903+0000 7feee3fff640 1 -- 172.21.15.91:0/834161146 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed8003520 con 0x7feeec0c0440 2023-11-27T20:43:51.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.903+0000 7feef1250640 1 -- 172.21.15.91:0/834161146 >> v1:172.21.15.183:6789/0 conn(0x7feeec072310 legacy=0x7feeec0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:51.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.903+0000 7feef1250640 1 -- 172.21.15.91:0/834161146 >> v1:172.21.15.91:6789/0 conn(0x7feeec0c0440 legacy=0x7feeec152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:51.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.903+0000 7feef1250640 1 -- 172.21.15.91:0/834161146 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec06fdc0 con 0x7feeec14c2e0 2023-11-27T20:43:51.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.904+0000 7feef1250640 1 --2- 172.21.15.91:0/834161146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feeec14c2e0 0x7feeec0c0c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feee80097a0 tx=0x7feee802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11f85451c4eea9ca server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:51.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.905+0000 7feee3fff640 1 -- 172.21.15.91:0/834161146 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee802e070 con 0x7feeec14c2e0 2023-11-27T20:43:51.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.905+0000 7feee3fff640 1 -- 172.21.15.91:0/834161146 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee80315a0 con 0x7feeec14c2e0 2023-11-27T20:43:51.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.905+0000 7feee3fff640 1 -- 172.21.15.91:0/834161146 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8031910 con 0x7feeec14c2e0 2023-11-27T20:43:51.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.905+0000 7feef2252640 1 -- 172.21.15.91:0/834161146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feeec14c2e0 msgr2=0x7feeec0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.905+0000 7feef2252640 1 --2- 172.21.15.91:0/834161146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feeec14c2e0 0x7feeec0c0c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feee80097a0 tx=0x7feee802b840 comp rx=0 tx=0).stop 2023-11-27T20:43:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.905+0000 7feef2252640 1 -- 172.21.15.91:0/834161146 shutdown_connections 2023-11-27T20:43:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.905+0000 7feef2252640 1 --2- 172.21.15.91:0/834161146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feeec14c2e0 0x7feeec0c0c80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.905+0000 7feef2252640 1 -- 172.21.15.91:0/834161146 >> 172.21.15.91:0/834161146 conn(0x7feeec0a77f0 msgr2=0x7feeec0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.905+0000 7feef2252640 1 -- 172.21.15.91:0/834161146 shutdown_connections 2023-11-27T20:43:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.906+0000 7feef2252640 1 -- 172.21.15.91:0/834161146 wait complete. 2023-11-27T20:43:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.907+0000 7feef2252640 1 Processor -- start 2023-11-27T20:43:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.907+0000 7feef2252640 1 -- start start 2023-11-27T20:43:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.908+0000 7feef2252640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feeec072310 0x7feeec1ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.908+0000 7feef2252640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feeec0c0440 0x7feeec14aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.908+0000 7feef2252640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feeec14c2e0 0x7feeec0ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.908+0000 7feef2252640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0a98c0 con 0x7feeec14c2e0 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.908+0000 7feef2252640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec1eadf0 con 0x7feeec072310 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.908+0000 7feef2252640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0a8d70 con 0x7feeec0c0440 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1a51640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feeec14c2e0 0x7feeec0ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1a51640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feeec14c2e0 0x7feeec0ab160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50266/0 (socket says 172.21.15.91:50266) 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1a51640 1 -- 172.21.15.91:0/3619498342 learned_addr learned my addr 172.21.15.91:0/3619498342 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1250640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feeec072310 0x7feeec1ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef0a4f640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feeec0c0440 0x7feeec14aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1a51640 1 -- 172.21.15.91:0/3619498342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feeec0c0440 msgr2=0x7feeec14aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1a51640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feeec0c0440 0x7feeec14aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1a51640 1 -- 172.21.15.91:0/3619498342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feeec072310 msgr2=0x7feeec1ea8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:51.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1a51640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feeec072310 0x7feeec1ea8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:51.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1a51640 1 -- 172.21.15.91:0/3619498342 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee8009400 con 0x7feeec14c2e0 2023-11-27T20:43:51.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1250640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feeec072310 0x7feeec1ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:43:51.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.909+0000 7feef1a51640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feeec14c2e0 0x7feeec0ab160 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7feee400c7d0 tx=0x7feee400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:51.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.910+0000 7feee1ffb640 1 -- 172.21.15.91:0/3619498342 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4003b70 con 0x7feeec14c2e0 2023-11-27T20:43:51.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.910+0000 7feee1ffb640 1 -- 172.21.15.91:0/3619498342 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee4003cf0 con 0x7feeec14c2e0 2023-11-27T20:43:51.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.910+0000 7feee1ffb640 1 -- 172.21.15.91:0/3619498342 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400aa90 con 0x7feeec14c2e0 2023-11-27T20:43:51.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.910+0000 7feef2252640 1 -- 172.21.15.91:0/3619498342 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec0a8a90 con 0x7feeec14c2e0 2023-11-27T20:43:51.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.910+0000 7feef2252640 1 -- 172.21.15.91:0/3619498342 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec0a9550 con 0x7feeec14c2e0 2023-11-27T20:43:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.911+0000 7feef2252640 1 -- 172.21.15.91:0/3619498342 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec04e840 con 0x7feeec14c2e0 2023-11-27T20:43:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.912+0000 7feee1ffb640 1 -- 172.21.15.91:0/3619498342 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7feee400abf0 con 0x7feeec14c2e0 2023-11-27T20:43:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.913+0000 7feee1ffb640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feed006b1f0 0x7feed006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.913+0000 7feee1ffb640 1 -- 172.21.15.91:0/3619498342 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5609+0+0 (secure 0 0 0) 0x7feee4089770 con 0x7feeec14c2e0 2023-11-27T20:43:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.913+0000 7feef1250640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feed006b1f0 0x7feed006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:51.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.914+0000 7feef1250640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feed006b1f0 0x7feed006d6b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feee8036000 tx=0x7feee8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:51.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:51.918+0000 7feee1ffb640 1 -- 172.21.15.91:0/3619498342 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7feee4054590 con 0x7feeec14c2e0 2023-11-27T20:43:52.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.146+0000 7feef2252640 1 -- 172.21.15.91:0/3619498342 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7feeec0c5380 con 0x7feeec14c2e0 2023-11-27T20:43:52.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.721+0000 7feee1ffb640 1 -- 172.21.15.91:0/3619498342 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7feee4003e60 con 0x7feeec14c2e0 2023-11-27T20:43:52.724 INFO:teuthology.orchestra.run.smithi091.stderr:new fs with metadata pool 8 and data pool 9 2023-11-27T20:43:52.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.727+0000 7feef2252640 1 -- 172.21.15.91:0/3619498342 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feed006b1f0 msgr2=0x7feed006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:52.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.727+0000 7feef2252640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feed006b1f0 0x7feed006d6b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feee8036000 tx=0x7feee8008030 comp rx=0 tx=0).stop 2023-11-27T20:43:52.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.727+0000 7feef2252640 1 -- 172.21.15.91:0/3619498342 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feeec14c2e0 msgr2=0x7feeec0ab160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:52.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.727+0000 7feef2252640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feeec14c2e0 0x7feeec0ab160 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7feee400c7d0 tx=0x7feee400cc90 comp rx=0 tx=0).stop 2023-11-27T20:43:52.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.727+0000 7feef2252640 1 -- 172.21.15.91:0/3619498342 shutdown_connections 2023-11-27T20:43:52.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.727+0000 7feef2252640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feeec14c2e0 0x7feeec0ab160 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:52.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.727+0000 7feef2252640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feeec0c0440 0x7feeec14aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:52.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.727+0000 7feef2252640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feed006b1f0 0x7feed006d6b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:52.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.727+0000 7feef2252640 1 --2- 172.21.15.91:0/3619498342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feeec072310 0x7feeec1ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:52.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.727+0000 7feef2252640 1 -- 172.21.15.91:0/3619498342 >> 172.21.15.91:0/3619498342 conn(0x7feeec0a77f0 msgr2=0x7feeec0bf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:52.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.728+0000 7feef2252640 1 -- 172.21.15.91:0/3619498342 shutdown_connections 2023-11-27T20:43:52.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.728+0000 7feef2252640 1 -- 172.21.15.91:0/3619498342 wait complete. 2023-11-27T20:43:52.764 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:52.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.986+0000 7fdb2f59e640 1 Processor -- start 2023-11-27T20:43:52.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.987+0000 7fdb2f59e640 1 -- start start 2023-11-27T20:43:52.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.988+0000 7fdb2f59e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdb3014e7f0 0x7fdb300c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:52.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.988+0000 7fdb2f59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb300c52e0 0x7fdb3006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:52.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.988+0000 7fdb2f59e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb300a8380 con 0x7fdb3006cd20 2023-11-27T20:43:52.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.988+0000 7fdb2f59e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb301510b0 con 0x7fdb3014e7f0 2023-11-27T20:43:52.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.988+0000 7fdb2f59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3006bf60 con 0x7fdb300c52e0 2023-11-27T20:43:52.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.988+0000 7fdb2e59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdb3014e7f0 0x7fdb300c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:52.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.989+0000 7fdb2e59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdb3014e7f0 0x7fdb300c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50282/0 (socket says 172.21.15.91:50282) 2023-11-27T20:43:52.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.989+0000 7fdb2e59c640 1 -- 172.21.15.91:0/3503452959 learned_addr learned my addr 172.21.15.91:0/3503452959 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:52.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.989+0000 7fdb25d9b640 1 --2- 172.21.15.91:0/3503452959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb300c52e0 0x7fdb3006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:52.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.989+0000 7fdb2e59c640 1 -- 172.21.15.91:0/3503452959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb300c52e0 msgr2=0x7fdb3006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:52.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.989+0000 7fdb2e59c640 1 --2- 172.21.15.91:0/3503452959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb300c52e0 0x7fdb3006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:52.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.989+0000 7fdb2e59c640 1 -- 172.21.15.91:0/3503452959 >> v1:172.21.15.183:6789/0 conn(0x7fdb3006cd20 legacy=0x7fdb301546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:52.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.989+0000 7fdb2e59c640 1 -- 172.21.15.91:0/3503452959 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3006c240 con 0x7fdb3014e7f0 2023-11-27T20:43:52.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.990+0000 7fdb2e59c640 1 --2- 172.21.15.91:0/3503452959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb3014e7f0 0x7fdb300c0440 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009870 tx=0x7fdb2002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4825eea044173eb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:52.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.990+0000 7fdb2dd9b640 1 -- 172.21.15.91:0/3503452959 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb200317c0 con 0x7fdb3014e7f0 2023-11-27T20:43:52.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.990+0000 7fdb2dd9b640 1 -- 172.21.15.91:0/3503452959 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb20031920 con 0x7fdb3014e7f0 2023-11-27T20:43:52.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.990+0000 7fdb2dd9b640 1 -- 172.21.15.91:0/3503452959 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20031cb0 con 0x7fdb3014e7f0 2023-11-27T20:43:52.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.991+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3503452959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb3014e7f0 msgr2=0x7fdb300c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:52.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.991+0000 7fdb2f59e640 1 --2- 172.21.15.91:0/3503452959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb3014e7f0 0x7fdb300c0440 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009870 tx=0x7fdb2002b860 comp rx=0 tx=0).stop 2023-11-27T20:43:52.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.991+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3503452959 shutdown_connections 2023-11-27T20:43:52.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.991+0000 7fdb2f59e640 1 --2- 172.21.15.91:0/3503452959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb300c52e0 0x7fdb3006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:52.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.991+0000 7fdb2f59e640 1 --2- 172.21.15.91:0/3503452959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb3014e7f0 0x7fdb300c0440 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:52.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.991+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3503452959 >> 172.21.15.91:0/3503452959 conn(0x7fdb300a77f0 msgr2=0x7fdb300a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:52.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.991+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3503452959 shutdown_connections 2023-11-27T20:43:52.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.991+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3503452959 wait complete. 2023-11-27T20:43:52.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.993+0000 7fdb2f59e640 1 Processor -- start 2023-11-27T20:43:52.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.993+0000 7fdb2f59e640 1 -- start start 2023-11-27T20:43:52.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb2f59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb3006cd20 0x7fdb30147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:52.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb2f59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb300c52e0 0x7fdb300a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:52.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb2f59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb3014e7f0 0x7fdb3014fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:52.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb2f59e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb301ea5c0 con 0x7fdb300c52e0 2023-11-27T20:43:52.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb2f59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb301edfa0 con 0x7fdb3014e7f0 2023-11-27T20:43:52.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb2f59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb301e9f70 con 0x7fdb3006cd20 2023-11-27T20:43:52.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb25d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb300c52e0 0x7fdb300a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:52.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb25d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb300c52e0 0x7fdb300a5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50292/0 (socket says 172.21.15.91:50292) 2023-11-27T20:43:52.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb25d9b640 1 -- 172.21.15.91:0/3893546068 learned_addr learned my addr 172.21.15.91:0/3893546068 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:52.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb2ed9d640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb3014e7f0 0x7fdb3014fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:52.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb25d9b640 1 -- 172.21.15.91:0/3893546068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb3006cd20 msgr2=0x7fdb30147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:52.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb2e59c640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb3006cd20 0x7fdb30147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:52.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb25d9b640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb3006cd20 0x7fdb30147530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:52.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb25d9b640 1 -- 172.21.15.91:0/3893546068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb3014e7f0 msgr2=0x7fdb3014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:52.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb25d9b640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb3014e7f0 0x7fdb3014fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:52.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb25d9b640 1 -- 172.21.15.91:0/3893546068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb200094d0 con 0x7fdb300c52e0 2023-11-27T20:43:52.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.994+0000 7fdb2ed9d640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb3014e7f0 0x7fdb3014fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:52.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.995+0000 7fdb25d9b640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb300c52e0 0x7fdb300a5760 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800d800 tx=0x7fdb1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:52.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.995+0000 7fdb277fe640 1 -- 172.21.15.91:0/3893546068 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800b6c0 con 0x7fdb300c52e0 2023-11-27T20:43:52.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.995+0000 7fdb277fe640 1 -- 172.21.15.91:0/3893546068 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1800b820 con 0x7fdb300c52e0 2023-11-27T20:43:52.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.995+0000 7fdb277fe640 1 -- 172.21.15.91:0/3893546068 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800bbb0 con 0x7fdb300c52e0 2023-11-27T20:43:52.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.995+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3893546068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb301ea250 con 0x7fdb300c52e0 2023-11-27T20:43:52.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.995+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3893546068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb301eaa50 con 0x7fdb300c52e0 2023-11-27T20:43:52.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.996+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3893546068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb301e9dc0 con 0x7fdb300c52e0 2023-11-27T20:43:52.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.997+0000 7fdb277fe640 1 -- 172.21.15.91:0/3893546068 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdb1800bd10 con 0x7fdb300c52e0 2023-11-27T20:43:52.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.998+0000 7fdb277fe640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb1006b1c0 0x7fdb1006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:52.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.998+0000 7fdb277fe640 1 -- 172.21.15.91:0/3893546068 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb18089f90 con 0x7fdb300c52e0 2023-11-27T20:43:52.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.998+0000 7fdb2e59c640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb1006b1c0 0x7fdb1006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:52.999+0000 7fdb2e59c640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb1006b1c0 0x7fdb1006d680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdb20036000 tx=0x7fdb2003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:53.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.003+0000 7fdb277fe640 1 -- 172.21.15.91:0/3893546068 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdb18054cb0 con 0x7fdb300c52e0 2023-11-27T20:43:53.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.188+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3893546068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb3004e840 con 0x7fdb300c52e0 2023-11-27T20:43:53.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.190+0000 7fdb277fe640 1 -- 172.21.15.91:0/3893546068 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16543 (secure 0 0 0) 0x7fdb180582d0 con 0x7fdb300c52e0 2023-11-27T20:43:53.194 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:53.194 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":54,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:52.148712+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:53.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3893546068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb1006b1c0 msgr2=0x7fdb1006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb1006b1c0 0x7fdb1006d680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdb20036000 tx=0x7fdb2003d040 comp rx=0 tx=0).stop 2023-11-27T20:43:53.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3893546068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb300c52e0 msgr2=0x7fdb300a5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb300c52e0 0x7fdb300a5760 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800d800 tx=0x7fdb1800dcc0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3893546068 shutdown_connections 2023-11-27T20:43:53.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdb1006b1c0 0x7fdb1006d680 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb3014e7f0 0x7fdb3014fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb300c52e0 0x7fdb300a5760 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 --2- 172.21.15.91:0/3893546068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb3006cd20 0x7fdb30147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3893546068 >> 172.21.15.91:0/3893546068 conn(0x7fdb300a77f0 msgr2=0x7fdb300c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:53.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3893546068 shutdown_connections 2023-11-27T20:43:53.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.194+0000 7fdb2f59e640 1 -- 172.21.15.91:0/3893546068 wait complete. 2023-11-27T20:43:53.211 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:53.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.418+0000 7ff34133c640 1 Processor -- start 2023-11-27T20:43:53.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.418+0000 7ff34133c640 1 -- start start 2023-11-27T20:43:53.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.420+0000 7ff34133c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff33c0a9b40 0x7ff33c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.420+0000 7ff34133c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c0c1500 0x7ff33c0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.420+0000 7ff34133c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c0c06c0 con 0x7ff33c155490 2023-11-27T20:43:53.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.420+0000 7ff34133c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0a5820 con 0x7ff33c0a9b40 2023-11-27T20:43:53.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.420+0000 7ff34133c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0c1020 con 0x7ff33c0c1500 2023-11-27T20:43:53.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.420+0000 7ff33affd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff33c155490 0x7ff33c0a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45914/0 (socket says 172.21.15.91:45914) 2023-11-27T20:43:53.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.420+0000 7ff33affd640 1 -- 172.21.15.91:0/1706880912 learned_addr learned my addr 172.21.15.91:0/1706880912 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:53.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff33a7fc640 1 --2- 172.21.15.91:0/1706880912 >> v2:172.21.15.183:3300/0 conn(0x7ff33c0a9b40 0x7ff33c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051575188 0 0) 0x7ff33c0c06c0 con 0x7ff33c155490 2023-11-27T20:43:53.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff33b7fe640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c0c1500 0x7ff33c0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff324003520 con 0x7ff33c155490 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 48029519 0 0) 0x7ff324003520 con 0x7ff33c155490 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c0c1500 msgr2=0x7ff33c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c0c1500 0x7ff33c0c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 >> v2:172.21.15.183:3300/0 conn(0x7ff33c0a9b40 msgr2=0x7ff33c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 --2- 172.21.15.91:0/1706880912 >> v2:172.21.15.183:3300/0 conn(0x7ff33c0a9b40 0x7ff33c0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0c0910 con 0x7ff33c155490 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7ff32c001670 con 0x7ff33c155490 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 >> v1:172.21.15.91:6789/0 conn(0x7ff33c155490 legacy=0x7ff33c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff324003970 0x7ff324003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3240047c0 0x7ff324004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c0c1500 0x7ff324005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0c1020 con 0x7ff3240047c0 2023-11-27T20:43:53.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32400b980 con 0x7ff324003970 2023-11-27T20:43:53.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32400baf0 con 0x7ff33c0c1500 2023-11-27T20:43:53.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.421+0000 7ff33a7fc640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3240047c0 0x7ff324004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.422+0000 7ff33affd640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff324003970 0x7ff324003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.422+0000 7ff33b7fe640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c0c1500 0x7ff324005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.422+0000 7ff33a7fc640 1 -- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c0c1500 msgr2=0x7ff324005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:53.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.422+0000 7ff33a7fc640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c0c1500 0x7ff324005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.422+0000 7ff33a7fc640 1 -- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff324003970 msgr2=0x7ff324003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:53.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.422+0000 7ff33a7fc640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff324003970 0x7ff324003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.422+0000 7ff33a7fc640 1 -- 172.21.15.91:0/1706880912 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324003520 con 0x7ff3240047c0 2023-11-27T20:43:53.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.423+0000 7ff33a7fc640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3240047c0 0x7ff324004c40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff330009ac0 tx=0x7ff3240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3005d31c5cb7504c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:53.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.423+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33002c710 con 0x7ff3240047c0 2023-11-27T20:43:53.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.423+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33002c870 con 0x7ff3240047c0 2023-11-27T20:43:53.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.423+0000 7ff339ffb640 1 -- 172.21.15.91:0/1706880912 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33002cc00 con 0x7ff3240047c0 2023-11-27T20:43:53.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.424+0000 7ff34133c640 1 -- 172.21.15.91:0/1706880912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3240047c0 msgr2=0x7ff324004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.424+0000 7ff34133c640 1 --2- 172.21.15.91:0/1706880912 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3240047c0 0x7ff324004c40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff330009ac0 tx=0x7ff3240057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.424+0000 7ff33b7fe640 1 -- 172.21.15.91:0/1706880912 reap_dead start 2023-11-27T20:43:53.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.424+0000 7ff34133c640 1 -- 172.21.15.91:0/1706880912 shutdown_connections 2023-11-27T20:43:53.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.424+0000 7ff34133c640 1 -- 172.21.15.91:0/1706880912 >> 172.21.15.91:0/1706880912 conn(0x7ff33c06a500 msgr2=0x7ff33c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:53.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.424+0000 7ff34133c640 1 -- 172.21.15.91:0/1706880912 shutdown_connections 2023-11-27T20:43:53.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.424+0000 7ff34133c640 1 -- 172.21.15.91:0/1706880912 wait complete. 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.426+0000 7ff34133c640 1 Processor -- start 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.426+0000 7ff34133c640 1 -- start start 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff34133c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3240047c0 0x7ff33c1ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff34133c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c1db2a0 0x7ff33c0a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff34133c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff33c0a6480 0x7ff33c14daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff34133c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0a72f0 con 0x7ff33c0a6480 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff34133c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0a7540 con 0x7ff3240047c0 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff34133c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c1edfd0 con 0x7ff33c1db2a0 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff33b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff33c0a6480 0x7ff33c14daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff33b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff33c0a6480 0x7ff33c14daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50308/0 (socket says 172.21.15.91:50308) 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff33b7fe640 1 -- 172.21.15.91:0/1990030633 learned_addr learned my addr 172.21.15.91:0/1990030633 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:53.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff33b7fe640 1 -- 172.21.15.91:0/1990030633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c1db2a0 msgr2=0x7ff33c0a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff33b7fe640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c1db2a0 0x7ff33c0a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff33b7fe640 1 -- 172.21.15.91:0/1990030633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3240047c0 msgr2=0x7ff33c1ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff33b7fe640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3240047c0 0x7ff33c1ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.427+0000 7ff33b7fe640 1 -- 172.21.15.91:0/1990030633 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c1ee2b0 con 0x7ff33c0a6480 2023-11-27T20:43:53.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.428+0000 7ff33b7fe640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff33c0a6480 0x7ff33c14daa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff33c067240 tx=0x7ff33400e510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:53.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.428+0000 7ff3237fe640 1 -- 172.21.15.91:0/1990030633 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400edf0 con 0x7ff33c0a6480 2023-11-27T20:43:53.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.428+0000 7ff3237fe640 1 -- 172.21.15.91:0/1990030633 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33400f040 con 0x7ff33c0a6480 2023-11-27T20:43:53.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.428+0000 7ff3237fe640 1 -- 172.21.15.91:0/1990030633 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334015650 con 0x7ff33c0a6480 2023-11-27T20:43:53.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.428+0000 7ff34133c640 1 -- 172.21.15.91:0/1990030633 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c071a00 con 0x7ff33c0a6480 2023-11-27T20:43:53.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.428+0000 7ff34133c640 1 -- 172.21.15.91:0/1990030633 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c14eb20 con 0x7ff33c0a6480 2023-11-27T20:43:53.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.429+0000 7ff34133c640 1 -- 172.21.15.91:0/1990030633 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c068350 con 0x7ff33c0a6480 2023-11-27T20:43:53.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.430+0000 7ff3237fe640 1 -- 172.21.15.91:0/1990030633 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff3340157b0 con 0x7ff33c0a6480 2023-11-27T20:43:53.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.431+0000 7ff3237fe640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff32806b1c0 0x7ff32806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.432+0000 7ff3237fe640 1 -- 172.21.15.91:0/1990030633 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff33408a2a0 con 0x7ff33c0a6480 2023-11-27T20:43:53.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.432+0000 7ff33affd640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff32806b1c0 0x7ff32806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.432+0000 7ff33affd640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff32806b1c0 0x7ff32806d680 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff32c001050 tx=0x7ff32c000fe0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:53.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.436+0000 7ff3237fe640 1 -- 172.21.15.91:0/1990030633 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff334054fc0 con 0x7ff33c0a6480 2023-11-27T20:43:53.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.632+0000 7ff34133c640 1 -- 172.21.15.91:0/1990030633 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff33c0a69e0 con 0x7ff33c0a6480 2023-11-27T20:43:53.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.634+0000 7ff3237fe640 1 -- 172.21.15.91:0/1990030633 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16543 (secure 0 0 0) 0x7ff3340585e0 con 0x7ff33c0a6480 2023-11-27T20:43:53.635 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:53.635 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":54,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:52.148712+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:53.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 -- 172.21.15.91:0/1990030633 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff32806b1c0 msgr2=0x7ff32806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff32806b1c0 0x7ff32806d680 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff32c001050 tx=0x7ff32c000fe0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 -- 172.21.15.91:0/1990030633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff33c0a6480 msgr2=0x7ff33c14daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff33c0a6480 0x7ff33c14daa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff33c067240 tx=0x7ff33400e510 comp rx=0 tx=0).stop 2023-11-27T20:43:53.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 -- 172.21.15.91:0/1990030633 shutdown_connections 2023-11-27T20:43:53.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff33c0a6480 0x7ff33c14daa0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff33c1db2a0 0x7ff33c0a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff32806b1c0 0x7ff32806d680 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 --2- 172.21.15.91:0/1990030633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3240047c0 0x7ff33c1ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 -- 172.21.15.91:0/1990030633 >> 172.21.15.91:0/1990030633 conn(0x7ff33c06a500 msgr2=0x7ff33c0c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:53.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 -- 172.21.15.91:0/1990030633 shutdown_connections 2023-11-27T20:43:53.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.637+0000 7ff34133c640 1 -- 172.21.15.91:0/1990030633 wait complete. 2023-11-27T20:43:53.657 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T20:43:53.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.865+0000 7f3b85716640 1 Processor -- start 2023-11-27T20:43:53.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.865+0000 7f3b85716640 1 -- start start 2023-11-27T20:43:53.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.866+0000 7f3b85716640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3b80155490 0x7f3b800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.866+0000 7f3b85716640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b800c1500 0x7f3b800a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.866+0000 7f3b85716640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b800c06c0 con 0x7f3b800c4080 2023-11-27T20:43:53.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.866+0000 7f3b85716640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b800a5820 con 0x7f3b80155490 2023-11-27T20:43:53.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.866+0000 7f3b85716640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800c1020 con 0x7f3b800c1500 2023-11-27T20:43:53.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.867+0000 7f3b7effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3b80155490 0x7f3b800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.867+0000 7f3b7effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3b80155490 0x7f3b800a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41190/0 (socket says 172.21.15.91:41190) 2023-11-27T20:43:53.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.867+0000 7f3b7effd640 1 -- 172.21.15.91:0/3769996571 learned_addr learned my addr 172.21.15.91:0/3769996571 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:53.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.867+0000 7f3b7effd640 1 -- 172.21.15.91:0/3769996571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b800c1500 msgr2=0x7f3b800a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:53.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.867+0000 7f3b7effd640 1 --2- 172.21.15.91:0/3769996571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b800c1500 0x7f3b800a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.867+0000 7f3b7effd640 1 -- 172.21.15.91:0/3769996571 >> v1:172.21.15.91:6789/0 conn(0x7f3b800c4080 legacy=0x7f3b800c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.867+0000 7f3b7effd640 1 -- 172.21.15.91:0/3769996571 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800c0910 con 0x7f3b80155490 2023-11-27T20:43:53.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.867+0000 7f3b7dffb640 1 -- 172.21.15.91:0/3769996571 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063546742 0 0) 0x7f3b800c06c0 con 0x7f3b800c4080 2023-11-27T20:43:53.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.868+0000 7f3b7effd640 1 --2- 172.21.15.91:0/3769996571 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b80155490 0x7f3b800a51b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000bb10 tx=0x7f3b7002e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cda921e300a456 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:53.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.868+0000 7f3b7dffb640 1 -- 172.21.15.91:0/3769996571 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7002ee80 con 0x7f3b80155490 2023-11-27T20:43:53.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.868+0000 7f3b7dffb640 1 -- 172.21.15.91:0/3769996571 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b70036440 con 0x7f3b80155490 2023-11-27T20:43:53.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.868+0000 7f3b7dffb640 1 -- 172.21.15.91:0/3769996571 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700367b0 con 0x7f3b80155490 2023-11-27T20:43:53.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.869+0000 7f3b85716640 1 -- 172.21.15.91:0/3769996571 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b80155490 msgr2=0x7f3b800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.869+0000 7f3b85716640 1 --2- 172.21.15.91:0/3769996571 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b80155490 0x7f3b800a51b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000bb10 tx=0x7f3b7002e0d0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.869+0000 7f3b85716640 1 -- 172.21.15.91:0/3769996571 shutdown_connections 2023-11-27T20:43:53.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.869+0000 7f3b85716640 1 --2- 172.21.15.91:0/3769996571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b800c1500 0x7f3b800a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.869+0000 7f3b85716640 1 --2- 172.21.15.91:0/3769996571 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b80155490 0x7f3b800a51b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.869+0000 7f3b85716640 1 -- 172.21.15.91:0/3769996571 >> 172.21.15.91:0/3769996571 conn(0x7f3b8006a500 msgr2=0x7f3b8006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:53.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.869+0000 7f3b85716640 1 -- 172.21.15.91:0/3769996571 shutdown_connections 2023-11-27T20:43:53.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.869+0000 7f3b85716640 1 -- 172.21.15.91:0/3769996571 wait complete. 2023-11-27T20:43:53.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.871+0000 7f3b85716640 1 Processor -- start 2023-11-27T20:43:53.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.871+0000 7f3b85716640 1 -- start start 2023-11-27T20:43:53.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b85716640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b800c1500 0x7f3b801dea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b85716640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b800c4080 0x7f3b801ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b85716640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b80155490 0x7f3b801ebab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b85716640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801def90 con 0x7f3b800c4080 2023-11-27T20:43:53.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b85716640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801eb060 con 0x7f3b800c1500 2023-11-27T20:43:53.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b85716640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801edba0 con 0x7f3b80155490 2023-11-27T20:43:53.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b7e7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b800c4080 0x7f3b801ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b7e7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b800c4080 0x7f3b801ed360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41192/0 (socket says 172.21.15.91:41192) 2023-11-27T20:43:53.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b7e7fc640 1 -- 172.21.15.91:0/2418390753 learned_addr learned my addr 172.21.15.91:0/2418390753 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:53.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b7e7fc640 1 -- 172.21.15.91:0/2418390753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b80155490 msgr2=0x7f3b801ebab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b7e7fc640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b80155490 0x7f3b801ebab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b7e7fc640 1 -- 172.21.15.91:0/2418390753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b800c1500 msgr2=0x7f3b801dea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:53.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b7e7fc640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b800c1500 0x7f3b801dea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:53.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.872+0000 7f3b7e7fc640 1 -- 172.21.15.91:0/2418390753 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7000b770 con 0x7f3b800c4080 2023-11-27T20:43:53.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.873+0000 7f3b7e7fc640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b800c4080 0x7f3b801ed360 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400b4a0 tx=0x7f3b7400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:53.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.873+0000 7f3b677fe640 1 -- 172.21.15.91:0/2418390753 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74010610 con 0x7f3b800c4080 2023-11-27T20:43:53.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.873+0000 7f3b677fe640 1 -- 172.21.15.91:0/2418390753 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b74010770 con 0x7f3b800c4080 2023-11-27T20:43:53.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.873+0000 7f3b85716640 1 -- 172.21.15.91:0/2418390753 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b801ede80 con 0x7f3b800c4080 2023-11-27T20:43:53.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.873+0000 7f3b677fe640 1 -- 172.21.15.91:0/2418390753 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74010b20 con 0x7f3b800c4080 2023-11-27T20:43:53.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.873+0000 7f3b85716640 1 -- 172.21.15.91:0/2418390753 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b801eb590 con 0x7f3b800c4080 2023-11-27T20:43:53.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.874+0000 7f3b85716640 1 -- 172.21.15.91:0/2418390753 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b80068350 con 0x7f3b800c4080 2023-11-27T20:43:53.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.875+0000 7f3b677fe640 1 -- 172.21.15.91:0/2418390753 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3b74010c80 con 0x7f3b800c4080 2023-11-27T20:43:53.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.876+0000 7f3b677fe640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b6c06b1f0 0x7f3b6c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:53.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.876+0000 7f3b677fe640 1 -- 172.21.15.91:0/2418390753 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b740895f0 con 0x7f3b800c4080 2023-11-27T20:43:53.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.876+0000 7f3b7effd640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b6c06b1f0 0x7f3b6c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:53.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.877+0000 7f3b7effd640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b6c06b1f0 0x7f3b6c06d6b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b70038000 tx=0x7f3b70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:53.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:53.880+0000 7f3b677fe640 1 -- 172.21.15.91:0/2418390753 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3b740543b0 con 0x7f3b800c4080 2023-11-27T20:43:54.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.109+0000 7f3b85716640 1 -- 172.21.15.91:0/2418390753 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3b801ee010 con 0x7f3b800c4080 2023-11-27T20:43:54.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.737+0000 7f3b677fe640 1 -- 172.21.15.91:0/2418390753 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3b740579d0 con 0x7f3b800c4080 2023-11-27T20:43:54.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.741+0000 7f3b85716640 1 -- 172.21.15.91:0/2418390753 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b6c06b1f0 msgr2=0x7f3b6c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:54.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b6c06b1f0 0x7f3b6c06d6b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b70038000 tx=0x7f3b70008040 comp rx=0 tx=0).stop 2023-11-27T20:43:54.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 -- 172.21.15.91:0/2418390753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b800c4080 msgr2=0x7f3b801ed360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:54.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b800c4080 0x7f3b801ed360 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400b4a0 tx=0x7f3b7400b960 comp rx=0 tx=0).stop 2023-11-27T20:43:54.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 -- 172.21.15.91:0/2418390753 shutdown_connections 2023-11-27T20:43:54.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b80155490 0x7f3b801ebab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:54.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b800c4080 0x7f3b801ed360 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:54.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b6c06b1f0 0x7f3b6c06d6b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:54.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 --2- 172.21.15.91:0/2418390753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b800c1500 0x7f3b801dea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:54.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 -- 172.21.15.91:0/2418390753 >> 172.21.15.91:0/2418390753 conn(0x7f3b8006a500 msgr2=0x7f3b800c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:54.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 -- 172.21.15.91:0/2418390753 shutdown_connections 2023-11-27T20:43:54.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.742+0000 7f3b85716640 1 -- 172.21.15.91:0/2418390753 wait complete. 2023-11-27T20:43:54.764 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T20:43:54.764 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T20:43:54.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.973+0000 7feaed1de640 1 Processor -- start 2023-11-27T20:43:54.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.973+0000 7feaed1de640 1 -- start start 2023-11-27T20:43:54.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.974+0000 7feaed1de640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feae814ebe0 0x7feae80bbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:54.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.974+0000 7feaed1de640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feae81555b0 0x7feae80c1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feaed1de640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae8151b00 con 0x7feae814efc0 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feaed1de640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae81526a0 con 0x7feae81555b0 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feaed1de640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80bc060 con 0x7feae814ebe0 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feae759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feae81555b0 0x7feae80c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feae759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feae81555b0 0x7feae80c1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41194/0 (socket says 172.21.15.91:41194) 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feae759e640 1 -- 172.21.15.91:0/3778426868 learned_addr learned my addr 172.21.15.91:0/3778426868 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feae6d9d640 1 --2- 172.21.15.91:0/3778426868 >> v2:172.21.15.183:3300/0 conn(0x7feae814ebe0 0x7feae80bbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feae759e640 1 -- 172.21.15.91:0/3778426868 >> v2:172.21.15.183:3300/0 conn(0x7feae814ebe0 msgr2=0x7feae80bbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feae759e640 1 --2- 172.21.15.91:0/3778426868 >> v2:172.21.15.183:3300/0 conn(0x7feae814ebe0 0x7feae80bbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feae759e640 1 -- 172.21.15.91:0/3778426868 >> v1:172.21.15.183:6789/0 conn(0x7feae814efc0 legacy=0x7feae8151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:54.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.975+0000 7feae759e640 1 -- 172.21.15.91:0/3778426868 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae806e1f0 con 0x7feae81555b0 2023-11-27T20:43:54.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.976+0000 7feae759e640 1 --2- 172.21.15.91:0/3778426868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae81555b0 0x7feae80c1680 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7feae806f5c0 tx=0x7feae002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8fa5050ef89586 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:54.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.977+0000 7feae659c640 1 -- 172.21.15.91:0/3778426868 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00317e0 con 0x7feae81555b0 2023-11-27T20:43:54.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.977+0000 7feae659c640 1 -- 172.21.15.91:0/3778426868 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae0031940 con 0x7feae81555b0 2023-11-27T20:43:54.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.977+0000 7feae659c640 1 -- 172.21.15.91:0/3778426868 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0031cd0 con 0x7feae81555b0 2023-11-27T20:43:54.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.977+0000 7feaed1de640 1 -- 172.21.15.91:0/3778426868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae81555b0 msgr2=0x7feae80c1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:54.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.977+0000 7feaed1de640 1 --2- 172.21.15.91:0/3778426868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae81555b0 0x7feae80c1680 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7feae806f5c0 tx=0x7feae002b880 comp rx=0 tx=0).stop 2023-11-27T20:43:54.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.978+0000 7feaed1de640 1 -- 172.21.15.91:0/3778426868 shutdown_connections 2023-11-27T20:43:54.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.978+0000 7feaed1de640 1 --2- 172.21.15.91:0/3778426868 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae81555b0 0x7feae80c1680 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:54.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.978+0000 7feaed1de640 1 --2- 172.21.15.91:0/3778426868 >> v2:172.21.15.183:3300/0 conn(0x7feae814ebe0 0x7feae80bbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:54.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.978+0000 7feaed1de640 1 -- 172.21.15.91:0/3778426868 >> 172.21.15.91:0/3778426868 conn(0x7feae80a7970 msgr2=0x7feae80a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:54.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.978+0000 7feaed1de640 1 -- 172.21.15.91:0/3778426868 shutdown_connections 2023-11-27T20:43:54.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.978+0000 7feaed1de640 1 -- 172.21.15.91:0/3778426868 wait complete. 2023-11-27T20:43:54.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.979+0000 7feaed1de640 1 Processor -- start 2023-11-27T20:43:54.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.979+0000 7feaed1de640 1 -- start start 2023-11-27T20:43:54.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.980+0000 7feaed1de640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae814ebe0 0x7feae81ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:54.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.980+0000 7feaed1de640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feae814efc0 0x7feae8147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:54.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.980+0000 7feaed1de640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feae81555b0 0x7feae8154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:54.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.980+0000 7feaed1de640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8150f10 con 0x7feae814ebe0 2023-11-27T20:43:54.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.980+0000 7feaed1de640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8153ce0 con 0x7feae814efc0 2023-11-27T20:43:54.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.980+0000 7feaed1de640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae8153f80 con 0x7feae81555b0 2023-11-27T20:43:54.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.980+0000 7feae6d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae814ebe0 0x7feae81ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:54.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.981+0000 7feae6d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae814ebe0 0x7feae81ea3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41196/0 (socket says 172.21.15.91:41196) 2023-11-27T20:43:54.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.981+0000 7feae6d9d640 1 -- 172.21.15.91:0/1543384299 learned_addr learned my addr 172.21.15.91:0/1543384299 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:54.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.981+0000 7feade59c640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feae814efc0 0x7feae8147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:54.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.981+0000 7feae6d9d640 1 -- 172.21.15.91:0/1543384299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feae81555b0 msgr2=0x7feae8154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:54.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.981+0000 7feae6d9d640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feae81555b0 0x7feae8154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:54.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.981+0000 7feae6d9d640 1 -- 172.21.15.91:0/1543384299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feae814efc0 msgr2=0x7feae8147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:54.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.981+0000 7feae6d9d640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feae814efc0 0x7feae8147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:54.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.981+0000 7feae6d9d640 1 -- 172.21.15.91:0/1543384299 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00094d0 con 0x7feae814ebe0 2023-11-27T20:43:54.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.981+0000 7feade59c640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feae814efc0 0x7feae8147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:54.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.981+0000 7feae6d9d640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae814ebe0 0x7feae81ea3f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fead8007e40 tx=0x7fead800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:54.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.982+0000 7feadffff640 1 -- 172.21.15.91:0/1543384299 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8014620 con 0x7feae814ebe0 2023-11-27T20:43:54.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.982+0000 7feadffff640 1 -- 172.21.15.91:0/1543384299 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead800ee90 con 0x7feae814ebe0 2023-11-27T20:43:54.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.982+0000 7feadffff640 1 -- 172.21.15.91:0/1543384299 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80149c0 con 0x7feae814ebe0 2023-11-27T20:43:54.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.982+0000 7feaed1de640 1 -- 172.21.15.91:0/1543384299 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae8150670 con 0x7feae814ebe0 2023-11-27T20:43:54.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.982+0000 7feaed1de640 1 -- 172.21.15.91:0/1543384299 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae8150c30 con 0x7feae814ebe0 2023-11-27T20:43:54.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.983+0000 7feaed1de640 1 -- 172.21.15.91:0/1543384299 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae8072b80 con 0x7feae814ebe0 2023-11-27T20:43:54.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.984+0000 7feadffff640 1 -- 172.21.15.91:0/1543384299 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fead8014b20 con 0x7feae814ebe0 2023-11-27T20:43:54.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.985+0000 7feadffff640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 0x7feac806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:54.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.985+0000 7feadffff640 1 -- 172.21.15.91:0/1543384299 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fead808a370 con 0x7feae814ebe0 2023-11-27T20:43:54.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.985+0000 7feade59c640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 0x7feac806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:54.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.986+0000 7feade59c640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 0x7feac806d680 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feae806e000 tx=0x7fead0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:54.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:54.989+0000 7feadffff640 1 -- 172.21.15.91:0/1543384299 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fead8055090 con 0x7feae814ebe0 2023-11-27T20:43:55.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:55.216+0000 7feaed1de640 1 -- 172.21.15.91:0/1543384299 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feae8067e50 con 0x7feae814ebe0 2023-11-27T20:43:56.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.220+0000 7feadffff640 1 -- 172.21.15.91:0/1543384299 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fead80586b0 con 0x7feae814ebe0 2023-11-27T20:43:56.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 -- 172.21.15.91:0/1543384299 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 msgr2=0x7feac806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 0x7feac806d680 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feae806e000 tx=0x7fead0009040 comp rx=0 tx=0).stop 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 -- 172.21.15.91:0/1543384299 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae814ebe0 msgr2=0x7feae81ea3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae814ebe0 0x7feae81ea3f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fead8007e40 tx=0x7fead800e4b0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 -- 172.21.15.91:0/1543384299 shutdown_connections 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feae81555b0 0x7feae8154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 0x7feac806d680 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feae814efc0 0x7feae8147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 --2- 172.21.15.91:0/1543384299 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae814ebe0 0x7feae81ea3f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 -- 172.21.15.91:0/1543384299 >> 172.21.15.91:0/1543384299 conn(0x7feae80a7970 msgr2=0x7feae80bc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 -- 172.21.15.91:0/1543384299 shutdown_connections 2023-11-27T20:43:56.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.224+0000 7feaed1de640 1 -- 172.21.15.91:0/1543384299 wait complete. 2023-11-27T20:43:56.247 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T20:43:56.247 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:56.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.463+0000 7f7426153640 1 Processor -- start 2023-11-27T20:43:56.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.463+0000 7f7426153640 1 -- start start 2023-11-27T20:43:56.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.464+0000 7f7426153640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f74200c5ec0 0x7f74200c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.464+0000 7f7426153640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74200bfdc0 con 0x7f74200c45d0 2023-11-27T20:43:56.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.464+0000 7f7426153640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742006ddd0 con 0x7f74200721a0 2023-11-27T20:43:56.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.464+0000 7f7426153640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742006e390 con 0x7f74200c5ec0 2023-11-27T20:43:56.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.465+0000 7f741f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f74200c5ec0 0x7f74200c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:56.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.465+0000 7f741f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f74200c5ec0 0x7f74200c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41212/0 (socket says 172.21.15.91:41212) 2023-11-27T20:43:56.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.465+0000 7f741f7fe640 1 -- 172.21.15.91:0/1740457316 learned_addr learned my addr 172.21.15.91:0/1740457316 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:56.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.465+0000 7f7417fff640 1 --1- 172.21.15.91:0/1740457316 >> v1:172.21.15.91:6789/0 conn(0x7f74200c45d0 0x7f7420155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:43682/0 (socket says 172.21.15.91:43682) 2023-11-27T20:43:56.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.465+0000 7f741f7fe640 1 -- 172.21.15.91:0/1740457316 >> v1:172.21.15.183:6789/0 conn(0x7f74200721a0 legacy=0x7f7420156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:56.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.465+0000 7f741f7fe640 1 -- 172.21.15.91:0/1740457316 >> v1:172.21.15.91:6789/0 conn(0x7f74200c45d0 legacy=0x7f7420155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.465+0000 7f741f7fe640 1 -- 172.21.15.91:0/1740457316 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742006e0b0 con 0x7f74200c5ec0 2023-11-27T20:43:56.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.466+0000 7f741f7fe640 1 --2- 172.21.15.91:0/1740457316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c5ec0 0x7f74200c2c30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f74100098a0 tx=0x7f741002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3351f941c873581 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:56.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.466+0000 7f741effd640 1 -- 172.21.15.91:0/1740457316 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100317c0 con 0x7f74200c5ec0 2023-11-27T20:43:56.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.467+0000 7f741effd640 1 -- 172.21.15.91:0/1740457316 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410031920 con 0x7f74200c5ec0 2023-11-27T20:43:56.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.467+0000 7f741effd640 1 -- 172.21.15.91:0/1740457316 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410031cb0 con 0x7f74200c5ec0 2023-11-27T20:43:56.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.467+0000 7f7426153640 1 -- 172.21.15.91:0/1740457316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c5ec0 msgr2=0x7f74200c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.467+0000 7f7426153640 1 --2- 172.21.15.91:0/1740457316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c5ec0 0x7f74200c2c30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f74100098a0 tx=0x7f741002b860 comp rx=0 tx=0).stop 2023-11-27T20:43:56.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.467+0000 7f7426153640 1 -- 172.21.15.91:0/1740457316 shutdown_connections 2023-11-27T20:43:56.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.467+0000 7f7426153640 1 --2- 172.21.15.91:0/1740457316 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c5ec0 0x7f74200c2c30 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.467+0000 7f7426153640 1 -- 172.21.15.91:0/1740457316 >> 172.21.15.91:0/1740457316 conn(0x7f742006a500 msgr2=0x7f742006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:56.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.467+0000 7f7426153640 1 -- 172.21.15.91:0/1740457316 shutdown_connections 2023-11-27T20:43:56.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.467+0000 7f7426153640 1 -- 172.21.15.91:0/1740457316 wait complete. 2023-11-27T20:43:56.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.469+0000 7f7426153640 1 Processor -- start 2023-11-27T20:43:56.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.469+0000 7f7426153640 1 -- start start 2023-11-27T20:43:56.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.470+0000 7f7426153640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74200721a0 0x7f7420152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.470+0000 7f7426153640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c45d0 0x7f74200a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.470+0000 7f7426153640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74200c5ec0 0x7f74201edd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.470+0000 7f7426153640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7420154780 con 0x7f74200c45d0 2023-11-27T20:43:56.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.470+0000 7f7426153640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74201ed5e0 con 0x7f74200721a0 2023-11-27T20:43:56.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.470+0000 7f7426153640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74201ed880 con 0x7f74200c5ec0 2023-11-27T20:43:56.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.470+0000 7f7417fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c45d0 0x7f74200a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:56.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.470+0000 7f7417fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c45d0 0x7f74200a9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41226/0 (socket says 172.21.15.91:41226) 2023-11-27T20:43:56.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.470+0000 7f7417fff640 1 -- 172.21.15.91:0/3198141805 learned_addr learned my addr 172.21.15.91:0/3198141805 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:56.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.471+0000 7f7417fff640 1 -- 172.21.15.91:0/3198141805 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74200c5ec0 msgr2=0x7f74201edd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.471+0000 7f7417fff640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74200c5ec0 0x7f74201edd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.471+0000 7f7417fff640 1 -- 172.21.15.91:0/3198141805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74200721a0 msgr2=0x7f7420152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.471+0000 7f7417fff640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74200721a0 0x7f7420152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.471+0000 7f7417fff640 1 -- 172.21.15.91:0/3198141805 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100094d0 con 0x7f74200c45d0 2023-11-27T20:43:56.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.471+0000 7f7417fff640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c45d0 0x7f74200a9e20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f740800c450 tx=0x7f740800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:56.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.471+0000 7f741cff9640 1 -- 172.21.15.91:0/3198141805 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408007480 con 0x7f74200c45d0 2023-11-27T20:43:56.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.471+0000 7f741cff9640 1 -- 172.21.15.91:0/3198141805 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74080075e0 con 0x7f74200c45d0 2023-11-27T20:43:56.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.471+0000 7f741cff9640 1 -- 172.21.15.91:0/3198141805 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408004a00 con 0x7f74200c45d0 2023-11-27T20:43:56.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.471+0000 7f7426153640 1 -- 172.21.15.91:0/3198141805 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74200a87c0 con 0x7f74200c45d0 2023-11-27T20:43:56.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.472+0000 7f7426153640 1 -- 172.21.15.91:0/3198141805 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7420154c70 con 0x7f74200c45d0 2023-11-27T20:43:56.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.473+0000 7f7426153640 1 -- 172.21.15.91:0/3198141805 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7420068350 con 0x7f74200c45d0 2023-11-27T20:43:56.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.474+0000 7f741cff9640 1 -- 172.21.15.91:0/3198141805 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7408004b60 con 0x7f74200c45d0 2023-11-27T20:43:56.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.475+0000 7f741cff9640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f740006b1c0 0x7f740006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.475+0000 7f741cff9640 1 -- 172.21.15.91:0/3198141805 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7408088bc0 con 0x7f74200c45d0 2023-11-27T20:43:56.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.475+0000 7f741f7fe640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f740006b1c0 0x7f740006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:56.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.476+0000 7f741f7fe640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f740006b1c0 0x7f740006d680 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7410036000 tx=0x7f7410030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:56.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.480+0000 7f741cff9640 1 -- 172.21.15.91:0/3198141805 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f74080538e0 con 0x7f74200c45d0 2023-11-27T20:43:56.648 INFO:tasks.ceph.mds.c.smithi091.stderr:2023-11-27T20:43:56.647+0000 7f3dd458b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:43:56.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.710+0000 7f7426153640 1 -- 172.21.15.91:0/3198141805 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74201ed9c0 con 0x7f74200c45d0 2023-11-27T20:43:56.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.711+0000 7f741cff9640 1 -- 172.21.15.91:0/3198141805 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f74201ed9c0 con 0x7f74200c45d0 2023-11-27T20:43:56.711 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:56.711 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1107018884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1107018884},{"type":"v1","addr":"172.21.15.91:6836","nonce":1107018884}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:43:52.149238+0000","modified":"2023-11-27T20:43:55.217623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/42700883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":42700883},{"type":"v1","addr":"172.21.15.91:6837","nonce":42700883}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-27T20:43:56.712 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 30 2023-11-27T20:43:56.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 -- 172.21.15.91:0/3198141805 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f740006b1c0 msgr2=0x7f740006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f740006b1c0 0x7f740006d680 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7410036000 tx=0x7f7410030000 comp rx=0 tx=0).stop 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 -- 172.21.15.91:0/3198141805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c45d0 msgr2=0x7f74200a9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c45d0 0x7f74200a9e20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f740800c450 tx=0x7f740800c910 comp rx=0 tx=0).stop 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 -- 172.21.15.91:0/3198141805 shutdown_connections 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74200c5ec0 0x7f74201edd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f74200c45d0 0x7f74200a9e20 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f740006b1c0 0x7f740006d680 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 --2- 172.21.15.91:0/3198141805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74200721a0 0x7f7420152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 -- 172.21.15.91:0/3198141805 >> 172.21.15.91:0/3198141805 conn(0x7f742006a500 msgr2=0x7f74201557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 -- 172.21.15.91:0/3198141805 shutdown_connections 2023-11-27T20:43:56.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.714+0000 7f7426153640 1 -- 172.21.15.91:0/3198141805 wait complete. 2023-11-27T20:43:56.734 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:43:56.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.942+0000 7f80449d5640 1 Processor -- start 2023-11-27T20:43:56.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.942+0000 7f80449d5640 1 -- start start 2023-11-27T20:43:56.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.943+0000 7f80449d5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80400a9b40 0x7f80400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.943+0000 7f80449d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80400c1500 0x7f80400c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.943+0000 7f80449d5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80400c06c0 con 0x7f8040155490 2023-11-27T20:43:56.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.943+0000 7f80449d5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80400a5820 con 0x7f80400a9b40 2023-11-27T20:43:56.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.943+0000 7f80449d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80400c1020 con 0x7f80400c1500 2023-11-27T20:43:56.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.944+0000 7f8037fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80400a9b40 0x7f80400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:56.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.944+0000 7f8037fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80400a9b40 0x7f80400a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41230/0 (socket says 172.21.15.91:41230) 2023-11-27T20:43:56.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.944+0000 7f8037fff640 1 -- 172.21.15.91:0/3049978732 learned_addr learned my addr 172.21.15.91:0/3049978732 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:56.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.944+0000 7f8037fff640 1 -- 172.21.15.91:0/3049978732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80400c1500 msgr2=0x7f80400c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:56.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.944+0000 7f8037fff640 1 --2- 172.21.15.91:0/3049978732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80400c1500 0x7f80400c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.944+0000 7f8037fff640 1 -- 172.21.15.91:0/3049978732 >> v1:172.21.15.183:6789/0 conn(0x7f8040155490 legacy=0x7f80400a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:56.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.944+0000 7f8037fff640 1 -- 172.21.15.91:0/3049978732 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80400c0910 con 0x7f80400a9b40 2023-11-27T20:43:56.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.945+0000 7f8037fff640 1 --2- 172.21.15.91:0/3049978732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400a9b40 0x7f80400a51b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8028009870 tx=0x7f802802db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da72b8ffd9d7ea90 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:56.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f803dd9b640 1 -- 172.21.15.91:0/3049978732 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802802f8e0 con 0x7f80400a9b40 2023-11-27T20:43:56.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f803dd9b640 1 -- 172.21.15.91:0/3049978732 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802802fa40 con 0x7f80400a9b40 2023-11-27T20:43:56.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f803dd9b640 1 -- 172.21.15.91:0/3049978732 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802802fdd0 con 0x7f80400a9b40 2023-11-27T20:43:56.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f80449d5640 1 -- 172.21.15.91:0/3049978732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400a9b40 msgr2=0x7f80400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f80449d5640 1 --2- 172.21.15.91:0/3049978732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400a9b40 0x7f80400a51b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8028009870 tx=0x7f802802db20 comp rx=0 tx=0).stop 2023-11-27T20:43:56.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f80449d5640 1 -- 172.21.15.91:0/3049978732 shutdown_connections 2023-11-27T20:43:56.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f80449d5640 1 --2- 172.21.15.91:0/3049978732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80400c1500 0x7f80400c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f80449d5640 1 --2- 172.21.15.91:0/3049978732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400a9b40 0x7f80400a51b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f80449d5640 1 -- 172.21.15.91:0/3049978732 >> 172.21.15.91:0/3049978732 conn(0x7f804006a500 msgr2=0x7f804006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:56.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f80449d5640 1 -- 172.21.15.91:0/3049978732 shutdown_connections 2023-11-27T20:43:56.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.946+0000 7f80449d5640 1 -- 172.21.15.91:0/3049978732 wait complete. 2023-11-27T20:43:56.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.948+0000 7f80449d5640 1 Processor -- start 2023-11-27T20:43:56.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.948+0000 7f80449d5640 1 -- start start 2023-11-27T20:43:56.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.949+0000 7f80449d5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400c1500 0x7f804014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.949+0000 7f80449d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040155490 0x7f80401513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.949+0000 7f80449d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040151920 0x7f804014fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.949+0000 7f80449d5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804014bf20 con 0x7f80400c1500 2023-11-27T20:43:56.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.949+0000 7f80449d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804014ddd0 con 0x7f8040151920 2023-11-27T20:43:56.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.949+0000 7f80449d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804014b6c0 con 0x7f8040155490 2023-11-27T20:43:56.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.949+0000 7f803e59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400c1500 0x7f804014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:56.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.949+0000 7f803e59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400c1500 0x7f804014e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41240/0 (socket says 172.21.15.91:41240) 2023-11-27T20:43:56.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.949+0000 7f803e59c640 1 -- 172.21.15.91:0/4049807271 learned_addr learned my addr 172.21.15.91:0/4049807271 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f803e59c640 1 -- 172.21.15.91:0/4049807271 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040155490 msgr2=0x7f80401513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f803e59c640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040155490 0x7f80401513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f803e59c640 1 -- 172.21.15.91:0/4049807271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040151920 msgr2=0x7f804014fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f803ed9d640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040151920 0x7f804014fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f803e59c640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040151920 0x7f804014fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f803e59c640 1 -- 172.21.15.91:0/4049807271 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80280094d0 con 0x7f80400c1500 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f803e59c640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400c1500 0x7f804014e250 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f803000b410 tx=0x7f803000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f8036ffd640 1 -- 172.21.15.91:0/4049807271 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030011830 con 0x7f80400c1500 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f8036ffd640 1 -- 172.21.15.91:0/4049807271 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8030011990 con 0x7f80400c1500 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f8036ffd640 1 -- 172.21.15.91:0/4049807271 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030011d40 con 0x7f80400c1500 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f80449d5640 1 -- 172.21.15.91:0/4049807271 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804014b960 con 0x7f80400c1500 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.950+0000 7f80449d5640 1 -- 172.21.15.91:0/4049807271 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8040150dc0 con 0x7f80400c1500 2023-11-27T20:43:56.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.951+0000 7f80449d5640 1 -- 172.21.15.91:0/4049807271 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8040068350 con 0x7f80400c1500 2023-11-27T20:43:56.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.952+0000 7f8036ffd640 1 -- 172.21.15.91:0/4049807271 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f803001a400 con 0x7f80400c1500 2023-11-27T20:43:56.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.953+0000 7f8036ffd640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f802006b1c0 0x7f802006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:56.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.953+0000 7f8036ffd640 1 -- 172.21.15.91:0/4049807271 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8030089bf0 con 0x7f80400c1500 2023-11-27T20:43:56.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.954+0000 7f8037fff640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f802006b1c0 0x7f802006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:56.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.954+0000 7f8037fff640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f802006b1c0 0x7f802006d680 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8028038000 tx=0x7f8028032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:56.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:56.958+0000 7f8036ffd640 1 -- 172.21.15.91:0/4049807271 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8030054920 con 0x7f80400c1500 2023-11-27T20:43:57.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.148+0000 7f80449d5640 1 -- 172.21.15.91:0/4049807271 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80400c5a20 con 0x7f80400c1500 2023-11-27T20:43:57.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.149+0000 7f8036ffd640 1 -- 172.21.15.91:0/4049807271 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f8030015020 con 0x7f80400c1500 2023-11-27T20:43:57.150 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:57.150 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":55,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:53.715787+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:43:57.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 -- 172.21.15.91:0/4049807271 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f802006b1c0 msgr2=0x7f802006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f802006b1c0 0x7f802006d680 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8028038000 tx=0x7f8028032000 comp rx=0 tx=0).stop 2023-11-27T20:43:57.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 -- 172.21.15.91:0/4049807271 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400c1500 msgr2=0x7f804014e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400c1500 0x7f804014e250 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f803000b410 tx=0x7f803000b8d0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 -- 172.21.15.91:0/4049807271 shutdown_connections 2023-11-27T20:43:57.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f802006b1c0 0x7f802006d680 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040151920 0x7f804014fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040155490 0x7f80401513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 --2- 172.21.15.91:0/4049807271 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80400c1500 0x7f804014e250 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 -- 172.21.15.91:0/4049807271 >> 172.21.15.91:0/4049807271 conn(0x7f804006a500 msgr2=0x7f80400c4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:57.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 -- 172.21.15.91:0/4049807271 shutdown_connections 2023-11-27T20:43:57.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.153+0000 7f80449d5640 1 -- 172.21.15.91:0/4049807271 wait complete. 2023-11-27T20:43:57.172 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T20:43:57.172 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:43:57.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.380+0000 7efdbfe6e640 1 Processor -- start 2023-11-27T20:43:57.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.380+0000 7efdbfe6e640 1 -- start start 2023-11-27T20:43:57.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.381+0000 7efdbfe6e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c45d0 0x7efdb8155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.381+0000 7efdbfe6e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efdb80c3340 0x7efdb8156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.381+0000 7efdbfe6e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb80bfdc0 con 0x7efdb80c5ec0 2023-11-27T20:43:57.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.381+0000 7efdbfe6e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb806e390 con 0x7efdb80c3340 2023-11-27T20:43:57.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.381+0000 7efdbfe6e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb806ddd0 con 0x7efdb80c45d0 2023-11-27T20:43:57.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.382+0000 7efdbdc0a640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7efdb80c5ec0 0x7efdb80c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:43690/0 (socket says 172.21.15.91:43690) 2023-11-27T20:43:57.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.382+0000 7efdbdc0a640 1 -- 172.21.15.91:0/751636295 learned_addr learned my addr 172.21.15.91:0/751636295 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:57.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.382+0000 7efdbe40b640 1 --2- 172.21.15.91:0/751636295 >> v2:172.21.15.91:3300/0 conn(0x7efdb80c3340 0x7efdb8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.382+0000 7efdbd409640 1 --2- 172.21.15.91:0/751636295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c45d0 0x7efdb8155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.382+0000 7efdbcc08640 1 -- 172.21.15.91:0/751636295 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853560790 0 0) 0x7efdb80bfdc0 con 0x7efdb80c5ec0 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.382+0000 7efdbcc08640 1 -- 172.21.15.91:0/751636295 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda4003520 con 0x7efdb80c5ec0 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.382+0000 7efdbe40b640 1 -- 172.21.15.91:0/751636295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c45d0 msgr2=0x7efdb8155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.382+0000 7efdbe40b640 1 --2- 172.21.15.91:0/751636295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c45d0 0x7efdb8155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.382+0000 7efdbe40b640 1 -- 172.21.15.91:0/751636295 >> v1:172.21.15.91:6789/0 conn(0x7efdb80c5ec0 legacy=0x7efdb80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.382+0000 7efdbe40b640 1 -- 172.21.15.91:0/751636295 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb806e0b0 con 0x7efdb80c3340 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.383+0000 7efdbe40b640 1 --2- 172.21.15.91:0/751636295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c3340 0x7efdb8156370 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009d90 tx=0x7efdb002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ca4702e6d1d36d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbcc08640 1 -- 172.21.15.91:0/751636295 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb002cb30 con 0x7efdb80c3340 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbcc08640 1 -- 172.21.15.91:0/751636295 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb002cc90 con 0x7efdb80c3340 2023-11-27T20:43:57.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbcc08640 1 -- 172.21.15.91:0/751636295 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0034440 con 0x7efdb80c3340 2023-11-27T20:43:57.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbfe6e640 1 -- 172.21.15.91:0/751636295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c3340 msgr2=0x7efdb8156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbfe6e640 1 --2- 172.21.15.91:0/751636295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c3340 0x7efdb8156370 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009d90 tx=0x7efdb002bd80 comp rx=0 tx=0).stop 2023-11-27T20:43:57.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbfe6e640 1 -- 172.21.15.91:0/751636295 shutdown_connections 2023-11-27T20:43:57.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbfe6e640 1 --2- 172.21.15.91:0/751636295 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c3340 0x7efdb8156370 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbfe6e640 1 --2- 172.21.15.91:0/751636295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c45d0 0x7efdb8155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbfe6e640 1 -- 172.21.15.91:0/751636295 >> 172.21.15.91:0/751636295 conn(0x7efdb806a500 msgr2=0x7efdb806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:57.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbfe6e640 1 -- 172.21.15.91:0/751636295 shutdown_connections 2023-11-27T20:43:57.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.384+0000 7efdbfe6e640 1 -- 172.21.15.91:0/751636295 wait complete. 2023-11-27T20:43:57.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.386+0000 7efdbfe6e640 1 Processor -- start 2023-11-27T20:43:57.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.386+0000 7efdbfe6e640 1 -- start start 2023-11-27T20:43:57.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.387+0000 7efdbfe6e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c3340 0x7efdb814f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.387+0000 7efdbfe6e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb80c45d0 0x7efdb80a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.387+0000 7efdbfe6e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c5ec0 0x7efdb814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.387+0000 7efdbfe6e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80a8770 con 0x7efdb80c5ec0 2023-11-27T20:43:57.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.387+0000 7efdbfe6e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80a5e60 con 0x7efdb80c45d0 2023-11-27T20:43:57.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.387+0000 7efdbfe6e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8158410 con 0x7efdb80c3340 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.387+0000 7efdbe40b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c5ec0 0x7efdb814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.387+0000 7efdbe40b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c5ec0 0x7efdb814ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41272/0 (socket says 172.21.15.91:41272) 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.387+0000 7efdbe40b640 1 -- 172.21.15.91:0/2889966246 learned_addr learned my addr 172.21.15.91:0/2889966246 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbd409640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb80c45d0 0x7efdb80a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbe40b640 1 -- 172.21.15.91:0/2889966246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c3340 msgr2=0x7efdb814f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbdc0a640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c3340 0x7efdb814f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbe40b640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c3340 0x7efdb814f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbe40b640 1 -- 172.21.15.91:0/2889966246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb80c45d0 msgr2=0x7efdb80a9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbe40b640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb80c45d0 0x7efdb80a9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbe40b640 1 -- 172.21.15.91:0/2889966246 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0009a70 con 0x7efdb80c5ec0 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbdc0a640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c3340 0x7efdb814f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:57.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbd409640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb80c45d0 0x7efdb80a9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:57.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbe40b640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c5ec0 0x7efdb814ccc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009d90 tx=0x7efdb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:57.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdae7fc640 1 -- 172.21.15.91:0/2889966246 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0040450 con 0x7efdb80c5ec0 2023-11-27T20:43:57.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdae7fc640 1 -- 172.21.15.91:0/2889966246 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb00405d0 con 0x7efdb80c5ec0 2023-11-27T20:43:57.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdae7fc640 1 -- 172.21.15.91:0/2889966246 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0040980 con 0x7efdb80c5ec0 2023-11-27T20:43:57.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.388+0000 7efdbfe6e640 1 -- 172.21.15.91:0/2889966246 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb80a5910 con 0x7efdb80c5ec0 2023-11-27T20:43:57.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.389+0000 7efdbfe6e640 1 -- 172.21.15.91:0/2889966246 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb814fdd0 con 0x7efdb80c5ec0 2023-11-27T20:43:57.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.390+0000 7efdbfe6e640 1 -- 172.21.15.91:0/2889966246 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb81581e0 con 0x7efdb80c5ec0 2023-11-27T20:43:57.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.390+0000 7efdae7fc640 1 -- 172.21.15.91:0/2889966246 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efdb0040ae0 con 0x7efdb80c5ec0 2023-11-27T20:43:57.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.391+0000 7efdae7fc640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd9c06b1c0 0x7efd9c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.391+0000 7efdae7fc640 1 -- 172.21.15.91:0/2889966246 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdb00ac690 con 0x7efdb80c5ec0 2023-11-27T20:43:57.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.392+0000 7efdbdc0a640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd9c06b1c0 0x7efd9c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.392+0000 7efdbdc0a640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd9c06b1c0 0x7efd9c06d680 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efdb40011e0 tx=0x7efdb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:57.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.396+0000 7efdae7fc640 1 -- 172.21.15.91:0/2889966246 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efdb81581e0 con 0x7efdb80c5ec0 2023-11-27T20:43:57.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.583+0000 7efdbfe6e640 1 -- 172.21.15.91:0/2889966246 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdb80c21e0 con 0x7efd9c06b1c0 2023-11-27T20:43:57.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.606+0000 7efdae7fc640 1 -- 172.21.15.91:0/2889966246 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286445 (secure 0 0 0) 0x7efdb80c21e0 con 0x7efd9c06b1c0 2023-11-27T20:43:57.612 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:57.613 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:43:57.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.611+0000 7efdbfe6e640 1 -- 172.21.15.91:0/2889966246 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd9c06b1c0 msgr2=0x7efd9c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.611+0000 7efdbfe6e640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd9c06b1c0 0x7efd9c06d680 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efdb40011e0 tx=0x7efdb4009040 comp rx=0 tx=0).stop 2023-11-27T20:43:57.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.611+0000 7efdbfe6e640 1 -- 172.21.15.91:0/2889966246 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c5ec0 msgr2=0x7efdb814ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.611+0000 7efdbfe6e640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c5ec0 0x7efdb814ccc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009d90 tx=0x7efdb0004a40 comp rx=0 tx=0).stop 2023-11-27T20:43:57.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.611+0000 7efdbfe6e640 1 -- 172.21.15.91:0/2889966246 shutdown_connections 2023-11-27T20:43:57.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.611+0000 7efdbfe6e640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdb80c5ec0 0x7efdb814ccc0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.611+0000 7efdbfe6e640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd9c06b1c0 0x7efd9c06d680 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.612+0000 7efdbfe6e640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb80c45d0 0x7efdb80a9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.612+0000 7efdbfe6e640 1 --2- 172.21.15.91:0/2889966246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb80c3340 0x7efdb814f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.612+0000 7efdbfe6e640 1 -- 172.21.15.91:0/2889966246 >> 172.21.15.91:0/2889966246 conn(0x7efdb806a500 msgr2=0x7efdb8070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:57.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.612+0000 7efdbfe6e640 1 -- 172.21.15.91:0/2889966246 shutdown_connections 2023-11-27T20:43:57.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.612+0000 7efdbfe6e640 1 -- 172.21.15.91:0/2889966246 wait complete. 2023-11-27T20:43:57.632 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-11-27T20:43:57.419588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226592,"kb_used_data":6228,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748128,"statfs":{"total":773094113280,"available":772862083072,"internally_reserved":0,"allocated":6377472,"data_stored":3390938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001746"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.744760+0000","last_change":"2023-11-27T20:43:52.742706+0000","last_active":"2023-11-27T20:43:52.744760+0000","last_peered":"2023-11-27T20:43:52.744760+0000","last_clean":"2023-11-27T20:43:52.744760+0000","last_became_active":"2023-11-27T20:43:52.742447+0000","last_became_peered":"2023-11-27T20:43:52.742447+0000","last_unstale":"2023-11-27T20:43:52.744760+0000","last_undegraded":"2023-11-27T20:43:52.744760+0000","last_fullsized":"2023-11-27T20:43:52.744760+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:06.598413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.750109+0000","last_change":"2023-11-27T20:43:52.741446+0000","last_active":"2023-11-27T20:43:52.750109+0000","last_peered":"2023-11-27T20:43:52.750109+0000","last_clean":"2023-11-27T20:43:52.750109+0000","last_became_active":"2023-11-27T20:43:52.741105+0000","last_became_peered":"2023-11-27T20:43:52.741105+0000","last_unstale":"2023-11-27T20:43:52.750109+0000","last_undegraded":"2023-11-27T20:43:52.750109+0000","last_fullsized":"2023-11-27T20:43:52.750109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749613+0000","last_change":"2023-11-27T20:43:52.737240+0000","last_active":"2023-11-27T20:43:52.749613+0000","last_peered":"2023-11-27T20:43:52.749613+0000","last_clean":"2023-11-27T20:43:52.749613+0000","last_became_active":"2023-11-27T20:43:52.736781+0000","last_became_peered":"2023-11-27T20:43:52.736781+0000","last_unstale":"2023-11-27T20:43:52.749613+0000","last_undegraded":"2023-11-27T20:43:52.749613+0000","last_fullsized":"2023-11-27T20:43:52.749613+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:17.775804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.747237+0000","last_change":"2023-11-27T20:43:52.738199+0000","last_active":"2023-11-27T20:43:52.747237+0000","last_peered":"2023-11-27T20:43:52.747237+0000","last_clean":"2023-11-27T20:43:52.747237+0000","last_became_active":"2023-11-27T20:43:52.737298+0000","last_became_peered":"2023-11-27T20:43:52.737298+0000","last_unstale":"2023-11-27T20:43:52.747237+0000","last_undegraded":"2023-11-27T20:43:52.747237+0000","last_fullsized":"2023-11-27T20:43:52.747237+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:23.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.748767+0000","last_change":"2023-11-27T20:43:52.745287+0000","last_active":"2023-11-27T20:43:52.748767+0000","last_peered":"2023-11-27T20:43:52.748767+0000","last_clean":"2023-11-27T20:43:52.748767+0000","last_became_active":"2023-11-27T20:43:52.744817+0000","last_became_peered":"2023-11-27T20:43:52.744817+0000","last_unstale":"2023-11-27T20:43:52.748767+0000","last_undegraded":"2023-11-27T20:43:52.748767+0000","last_fullsized":"2023-11-27T20:43:52.748767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:48.129616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757537+0000","last_change":"2023-11-27T20:43:52.737877+0000","last_active":"2023-11-27T20:43:52.757537+0000","last_peered":"2023-11-27T20:43:52.757537+0000","last_clean":"2023-11-27T20:43:52.757537+0000","last_became_active":"2023-11-27T20:43:52.737566+0000","last_became_peered":"2023-11-27T20:43:52.737566+0000","last_unstale":"2023-11-27T20:43:52.757537+0000","last_undegraded":"2023-11-27T20:43:52.757537+0000","last_fullsized":"2023-11-27T20:43:52.757537+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:22.440110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.742677+0000","last_change":"2023-11-27T20:43:52.738797+0000","last_active":"2023-11-27T20:43:52.742677+0000","last_peered":"2023-11-27T20:43:52.742677+0000","last_clean":"2023-11-27T20:43:52.742677+0000","last_became_active":"2023-11-27T20:43:52.738444+0000","last_became_peered":"2023-11-27T20:43:52.738444+0000","last_unstale":"2023-11-27T20:43:52.742677+0000","last_undegraded":"2023-11-27T20:43:52.742677+0000","last_fullsized":"2023-11-27T20:43:52.742677+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:56.115106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.755511+0000","last_change":"2023-11-27T20:43:52.742425+0000","last_active":"2023-11-27T20:43:52.755511+0000","last_peered":"2023-11-27T20:43:52.755511+0000","last_clean":"2023-11-27T20:43:52.755511+0000","last_became_active":"2023-11-27T20:43:52.741079+0000","last_became_peered":"2023-11-27T20:43:52.741079+0000","last_unstale":"2023-11-27T20:43:52.755511+0000","last_undegraded":"2023-11-27T20:43:52.755511+0000","last_fullsized":"2023-11-27T20:43:52.755511+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.754734+0000","last_change":"2023-11-27T20:43:52.749527+0000","last_active":"2023-11-27T20:43:52.754734+0000","last_peered":"2023-11-27T20:43:52.754734+0000","last_clean":"2023-11-27T20:43:52.754734+0000","last_became_active":"2023-11-27T20:43:52.749261+0000","last_became_peered":"2023-11-27T20:43:52.749261+0000","last_unstale":"2023-11-27T20:43:52.754734+0000","last_undegraded":"2023-11-27T20:43:52.754734+0000","last_fullsized":"2023-11-27T20:43:52.754734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:21.512849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.739937+0000","last_change":"2023-11-27T20:43:52.724633+0000","last_active":"2023-11-27T20:43:52.739937+0000","last_peered":"2023-11-27T20:43:52.739937+0000","last_clean":"2023-11-27T20:43:52.739937+0000","last_became_active":"2023-11-27T20:43:52.724319+0000","last_became_peered":"2023-11-27T20:43:52.724319+0000","last_unstale":"2023-11-27T20:43:52.739937+0000","last_undegraded":"2023-11-27T20:43:52.739937+0000","last_fullsized":"2023-11-27T20:43:52.739937+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:55.156190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.748220+0000","last_change":"2023-11-27T20:43:52.740239+0000","last_active":"2023-11-27T20:43:52.748220+0000","last_peered":"2023-11-27T20:43:52.748220+0000","last_clean":"2023-11-27T20:43:52.748220+0000","last_became_active":"2023-11-27T20:43:52.739953+0000","last_became_peered":"2023-11-27T20:43:52.739953+0000","last_unstale":"2023-11-27T20:43:52.748220+0000","last_undegraded":"2023-11-27T20:43:52.748220+0000","last_fullsized":"2023-11-27T20:43:52.748220+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:13:36.872593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.741380+0000","last_change":"2023-11-27T20:43:52.736636+0000","last_active":"2023-11-27T20:43:52.741380+0000","last_peered":"2023-11-27T20:43:52.741380+0000","last_clean":"2023-11-27T20:43:52.741380+0000","last_became_active":"2023-11-27T20:43:52.730532+0000","last_became_peered":"2023-11-27T20:43:52.730532+0000","last_unstale":"2023-11-27T20:43:52.741380+0000","last_undegraded":"2023-11-27T20:43:52.741380+0000","last_fullsized":"2023-11-27T20:43:52.741380+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:15.078720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.738245+0000","last_change":"2023-11-27T20:43:52.734813+0000","last_active":"2023-11-27T20:43:52.738245+0000","last_peered":"2023-11-27T20:43:52.738245+0000","last_clean":"2023-11-27T20:43:52.738245+0000","last_became_active":"2023-11-27T20:43:52.734472+0000","last_became_peered":"2023-11-27T20:43:52.734472+0000","last_unstale":"2023-11-27T20:43:52.738245+0000","last_undegraded":"2023-11-27T20:43:52.738245+0000","last_fullsized":"2023-11-27T20:43:52.738245+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.713015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.739736+0000","last_change":"2023-11-27T20:43:52.737259+0000","last_active":"2023-11-27T20:43:52.739736+0000","last_peered":"2023-11-27T20:43:52.739736+0000","last_clean":"2023-11-27T20:43:52.739736+0000","last_became_active":"2023-11-27T20:43:52.735819+0000","last_became_peered":"2023-11-27T20:43:52.735819+0000","last_unstale":"2023-11-27T20:43:52.739736+0000","last_undegraded":"2023-11-27T20:43:52.739736+0000","last_fullsized":"2023-11-27T20:43:52.739736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:53.640628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749683+0000","last_change":"2023-11-27T20:43:52.743966+0000","last_active":"2023-11-27T20:43:52.749683+0000","last_peered":"2023-11-27T20:43:52.749683+0000","last_clean":"2023-11-27T20:43:52.749683+0000","last_became_active":"2023-11-27T20:43:52.743629+0000","last_became_peered":"2023-11-27T20:43:52.743629+0000","last_unstale":"2023-11-27T20:43:52.749683+0000","last_undegraded":"2023-11-27T20:43:52.749683+0000","last_fullsized":"2023-11-27T20:43:52.749683+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:18:19.921000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757918+0000","last_change":"2023-11-27T20:43:52.745826+0000","last_active":"2023-11-27T20:43:52.757918+0000","last_peered":"2023-11-27T20:43:52.757918+0000","last_clean":"2023-11-27T20:43:52.757918+0000","last_became_active":"2023-11-27T20:43:52.745542+0000","last_became_peered":"2023-11-27T20:43:52.745542+0000","last_unstale":"2023-11-27T20:43:52.757918+0000","last_undegraded":"2023-11-27T20:43:52.757918+0000","last_fullsized":"2023-11-27T20:43:52.757918+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:09.361546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.739506+0000","last_change":"2023-11-27T20:43:52.722794+0000","last_active":"2023-11-27T20:43:52.739506+0000","last_peered":"2023-11-27T20:43:52.739506+0000","last_clean":"2023-11-27T20:43:52.739506+0000","last_became_active":"2023-11-27T20:43:52.722489+0000","last_became_peered":"2023-11-27T20:43:52.722489+0000","last_unstale":"2023-11-27T20:43:52.739506+0000","last_undegraded":"2023-11-27T20:43:52.739506+0000","last_fullsized":"2023-11-27T20:43:52.739506+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:54.288377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757083+0000","last_change":"2023-11-27T20:43:52.755856+0000","last_active":"2023-11-27T20:43:52.757083+0000","last_peered":"2023-11-27T20:43:52.757083+0000","last_clean":"2023-11-27T20:43:52.757083+0000","last_became_active":"2023-11-27T20:43:52.755447+0000","last_became_peered":"2023-11-27T20:43:52.755447+0000","last_unstale":"2023-11-27T20:43:52.757083+0000","last_undegraded":"2023-11-27T20:43:52.757083+0000","last_fullsized":"2023-11-27T20:43:52.757083+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:19.914604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745551+0000","last_change":"2023-11-27T20:43:52.743704+0000","last_active":"2023-11-27T20:43:52.745551+0000","last_peered":"2023-11-27T20:43:52.745551+0000","last_clean":"2023-11-27T20:43:52.745551+0000","last_became_active":"2023-11-27T20:43:52.743440+0000","last_became_peered":"2023-11-27T20:43:52.743440+0000","last_unstale":"2023-11-27T20:43:52.745551+0000","last_undegraded":"2023-11-27T20:43:52.745551+0000","last_fullsized":"2023-11-27T20:43:52.745551+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:08:26.832464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757803+0000","last_change":"2023-11-27T20:43:52.753806+0000","last_active":"2023-11-27T20:43:52.757803+0000","last_peered":"2023-11-27T20:43:52.757803+0000","last_clean":"2023-11-27T20:43:52.757803+0000","last_became_active":"2023-11-27T20:43:52.753119+0000","last_became_peered":"2023-11-27T20:43:52.753119+0000","last_unstale":"2023-11-27T20:43:52.757803+0000","last_undegraded":"2023-11-27T20:43:52.757803+0000","last_fullsized":"2023-11-27T20:43:52.757803+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745030+0000","last_change":"2023-11-27T20:43:52.738852+0000","last_active":"2023-11-27T20:43:52.745030+0000","last_peered":"2023-11-27T20:43:52.745030+0000","last_clean":"2023-11-27T20:43:52.745030+0000","last_became_active":"2023-11-27T20:43:52.738571+0000","last_became_peered":"2023-11-27T20:43:52.738571+0000","last_unstale":"2023-11-27T20:43:52.745030+0000","last_undegraded":"2023-11-27T20:43:52.745030+0000","last_fullsized":"2023-11-27T20:43:52.745030+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:16.298882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.744065+0000","last_change":"2023-11-27T20:43:52.734845+0000","last_active":"2023-11-27T20:43:52.744065+0000","last_peered":"2023-11-27T20:43:52.744065+0000","last_clean":"2023-11-27T20:43:52.744065+0000","last_became_active":"2023-11-27T20:43:52.734288+0000","last_became_peered":"2023-11-27T20:43:52.734288+0000","last_unstale":"2023-11-27T20:43:52.744065+0000","last_undegraded":"2023-11-27T20:43:52.744065+0000","last_fullsized":"2023-11-27T20:43:52.744065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745544+0000","last_change":"2023-11-27T20:43:52.741528+0000","last_active":"2023-11-27T20:43:52.745544+0000","last_peered":"2023-11-27T20:43:52.745544+0000","last_clean":"2023-11-27T20:43:52.745544+0000","last_became_active":"2023-11-27T20:43:52.741247+0000","last_became_peered":"2023-11-27T20:43:52.741247+0000","last_unstale":"2023-11-27T20:43:52.745544+0000","last_undegraded":"2023-11-27T20:43:52.745544+0000","last_fullsized":"2023-11-27T20:43:52.745544+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:06.257254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.751890+0000","last_change":"2023-11-27T20:43:52.749184+0000","last_active":"2023-11-27T20:43:52.751890+0000","last_peered":"2023-11-27T20:43:52.751890+0000","last_clean":"2023-11-27T20:43:52.751890+0000","last_became_active":"2023-11-27T20:43:52.747304+0000","last_became_peered":"2023-11-27T20:43:52.747304+0000","last_unstale":"2023-11-27T20:43:52.751890+0000","last_undegraded":"2023-11-27T20:43:52.751890+0000","last_fullsized":"2023-11-27T20:43:52.751890+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:26.493343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.748578+0000","last_change":"2023-11-27T20:43:52.746466+0000","last_active":"2023-11-27T20:43:52.748578+0000","last_peered":"2023-11-27T20:43:52.748578+0000","last_clean":"2023-11-27T20:43:52.748578+0000","last_became_active":"2023-11-27T20:43:52.746197+0000","last_became_peered":"2023-11-27T20:43:52.746197+0000","last_unstale":"2023-11-27T20:43:52.748578+0000","last_undegraded":"2023-11-27T20:43:52.748578+0000","last_fullsized":"2023-11-27T20:43:52.748578+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:04:26.417281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.747117+0000","last_change":"2023-11-27T20:43:52.739506+0000","last_active":"2023-11-27T20:43:52.747117+0000","last_peered":"2023-11-27T20:43:52.747117+0000","last_clean":"2023-11-27T20:43:52.747117+0000","last_became_active":"2023-11-27T20:43:52.739234+0000","last_became_peered":"2023-11-27T20:43:52.739234+0000","last_unstale":"2023-11-27T20:43:52.747117+0000","last_undegraded":"2023-11-27T20:43:52.747117+0000","last_fullsized":"2023-11-27T20:43:52.747117+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:16.298882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.761772+0000","last_change":"2023-11-27T20:43:52.758309+0000","last_active":"2023-11-27T20:43:52.761772+0000","last_peered":"2023-11-27T20:43:52.761772+0000","last_clean":"2023-11-27T20:43:52.761772+0000","last_became_active":"2023-11-27T20:43:52.755787+0000","last_became_peered":"2023-11-27T20:43:52.755787+0000","last_unstale":"2023-11-27T20:43:52.761772+0000","last_undegraded":"2023-11-27T20:43:52.761772+0000","last_fullsized":"2023-11-27T20:43:52.761772+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.747286+0000","last_change":"2023-11-27T20:43:52.743954+0000","last_active":"2023-11-27T20:43:52.747286+0000","last_peered":"2023-11-27T20:43:52.747286+0000","last_clean":"2023-11-27T20:43:52.747286+0000","last_became_active":"2023-11-27T20:43:52.743696+0000","last_became_peered":"2023-11-27T20:43:52.743696+0000","last_unstale":"2023-11-27T20:43:52.747286+0000","last_undegraded":"2023-11-27T20:43:52.747286+0000","last_fullsized":"2023-11-27T20:43:52.747286+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:23.796379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749978+0000","last_change":"2023-11-27T20:43:52.740150+0000","last_active":"2023-11-27T20:43:52.749978+0000","last_peered":"2023-11-27T20:43:52.749978+0000","last_clean":"2023-11-27T20:43:52.749978+0000","last_became_active":"2023-11-27T20:43:52.735557+0000","last_became_peered":"2023-11-27T20:43:52.735557+0000","last_unstale":"2023-11-27T20:43:52.749978+0000","last_undegraded":"2023-11-27T20:43:52.749978+0000","last_fullsized":"2023-11-27T20:43:52.749978+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.747290+0000","last_change":"2023-11-27T20:43:52.743341+0000","last_active":"2023-11-27T20:43:52.747290+0000","last_peered":"2023-11-27T20:43:52.747290+0000","last_clean":"2023-11-27T20:43:52.747290+0000","last_became_active":"2023-11-27T20:43:52.742947+0000","last_became_peered":"2023-11-27T20:43:52.742947+0000","last_unstale":"2023-11-27T20:43:52.747290+0000","last_undegraded":"2023-11-27T20:43:52.747290+0000","last_fullsized":"2023-11-27T20:43:52.747290+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:42.590467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.751527+0000","last_change":"2023-11-27T20:43:52.746463+0000","last_active":"2023-11-27T20:43:52.751527+0000","last_peered":"2023-11-27T20:43:52.751527+0000","last_clean":"2023-11-27T20:43:52.751527+0000","last_became_active":"2023-11-27T20:43:52.746028+0000","last_became_peered":"2023-11-27T20:43:52.746028+0000","last_unstale":"2023-11-27T20:43:52.751527+0000","last_undegraded":"2023-11-27T20:43:52.751527+0000","last_fullsized":"2023-11-27T20:43:52.751527+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:35.468352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.761611+0000","last_change":"2023-11-27T20:43:52.757800+0000","last_active":"2023-11-27T20:43:52.761611+0000","last_peered":"2023-11-27T20:43:52.761611+0000","last_clean":"2023-11-27T20:43:52.761611+0000","last_became_active":"2023-11-27T20:43:52.755994+0000","last_became_peered":"2023-11-27T20:43:52.755994+0000","last_unstale":"2023-11-27T20:43:52.761611+0000","last_undegraded":"2023-11-27T20:43:52.761611+0000","last_fullsized":"2023-11-27T20:43:52.761611+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:28.943589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.758969+0000","last_change":"2023-11-27T20:43:52.755932+0000","last_active":"2023-11-27T20:43:52.758969+0000","last_peered":"2023-11-27T20:43:52.758969+0000","last_clean":"2023-11-27T20:43:52.758969+0000","last_became_active":"2023-11-27T20:43:52.751888+0000","last_became_peered":"2023-11-27T20:43:52.751888+0000","last_unstale":"2023-11-27T20:43:52.758969+0000","last_undegraded":"2023-11-27T20:43:52.758969+0000","last_fullsized":"2023-11-27T20:43:52.758969+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:19.914604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.756816+0000","last_change":"2023-11-27T20:43:51.704982+0000","last_active":"2023-11-27T20:43:52.756816+0000","last_peered":"2023-11-27T20:43:52.756816+0000","last_clean":"2023-11-27T20:43:52.756816+0000","last_became_active":"2023-11-27T20:43:51.703346+0000","last_became_peered":"2023-11-27T20:43:51.703346+0000","last_unstale":"2023-11-27T20:43:52.756816+0000","last_undegraded":"2023-11-27T20:43:52.756816+0000","last_fullsized":"2023-11-27T20:43:52.756816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:53.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745236+0000","last_change":"2023-11-27T20:43:52.736197+0000","last_active":"2023-11-27T20:43:52.745236+0000","last_peered":"2023-11-27T20:43:52.745236+0000","last_clean":"2023-11-27T20:43:52.745236+0000","last_became_active":"2023-11-27T20:43:52.735889+0000","last_became_peered":"2023-11-27T20:43:52.735889+0000","last_unstale":"2023-11-27T20:43:52.745236+0000","last_undegraded":"2023-11-27T20:43:52.745236+0000","last_fullsized":"2023-11-27T20:43:52.745236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:42.684238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745411+0000","last_change":"2023-11-27T20:43:51.711368+0000","last_active":"2023-11-27T20:43:52.745411+0000","last_peered":"2023-11-27T20:43:52.745411+0000","last_clean":"2023-11-27T20:43:52.745411+0000","last_became_active":"2023-11-27T20:43:51.711087+0000","last_became_peered":"2023-11-27T20:43:51.711087+0000","last_unstale":"2023-11-27T20:43:52.745411+0000","last_undegraded":"2023-11-27T20:43:52.745411+0000","last_fullsized":"2023-11-27T20:43:52.745411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:54.352803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.764716+0000","last_change":"2023-11-27T20:43:52.759667+0000","last_active":"2023-11-27T20:43:52.764716+0000","last_peered":"2023-11-27T20:43:52.764716+0000","last_clean":"2023-11-27T20:43:52.764716+0000","last_became_active":"2023-11-27T20:43:52.759386+0000","last_became_peered":"2023-11-27T20:43:52.759386+0000","last_unstale":"2023-11-27T20:43:52.764716+0000","last_undegraded":"2023-11-27T20:43:52.764716+0000","last_fullsized":"2023-11-27T20:43:52.764716+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.758770+0000","last_change":"2023-11-27T20:43:51.699372+0000","last_active":"2023-11-27T20:43:52.758770+0000","last_peered":"2023-11-27T20:43:52.758770+0000","last_clean":"2023-11-27T20:43:52.758770+0000","last_became_active":"2023-11-27T20:43:51.698989+0000","last_became_peered":"2023-11-27T20:43:51.698989+0000","last_unstale":"2023-11-27T20:43:52.758770+0000","last_undegraded":"2023-11-27T20:43:52.758770+0000","last_fullsized":"2023-11-27T20:43:52.758770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:29.612413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.758397+0000","last_change":"2023-11-27T20:43:52.746554+0000","last_active":"2023-11-27T20:43:52.758397+0000","last_peered":"2023-11-27T20:43:52.758397+0000","last_clean":"2023-11-27T20:43:52.758397+0000","last_became_active":"2023-11-27T20:43:52.746133+0000","last_became_peered":"2023-11-27T20:43:52.746133+0000","last_unstale":"2023-11-27T20:43:52.758397+0000","last_undegraded":"2023-11-27T20:43:52.758397+0000","last_fullsized":"2023-11-27T20:43:52.758397+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:16.298882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.755010+0000","last_change":"2023-11-27T20:43:51.707254+0000","last_active":"2023-11-27T20:43:52.755010+0000","last_peered":"2023-11-27T20:43:52.755010+0000","last_clean":"2023-11-27T20:43:52.755010+0000","last_became_active":"2023-11-27T20:43:51.706908+0000","last_became_peered":"2023-11-27T20:43:51.706908+0000","last_unstale":"2023-11-27T20:43:52.755010+0000","last_undegraded":"2023-11-27T20:43:52.755010+0000","last_fullsized":"2023-11-27T20:43:52.755010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:04.233780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.744042+0000","last_change":"2023-11-27T20:43:52.734666+0000","last_active":"2023-11-27T20:43:52.744042+0000","last_peered":"2023-11-27T20:43:52.744042+0000","last_clean":"2023-11-27T20:43:52.744042+0000","last_became_active":"2023-11-27T20:43:52.733983+0000","last_became_peered":"2023-11-27T20:43:52.733983+0000","last_unstale":"2023-11-27T20:43:52.744042+0000","last_undegraded":"2023-11-27T20:43:52.744042+0000","last_fullsized":"2023-11-27T20:43:52.744042+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749812+0000","last_change":"2023-11-27T20:43:51.711467+0000","last_active":"2023-11-27T20:43:52.749812+0000","last_peered":"2023-11-27T20:43:52.749812+0000","last_clean":"2023-11-27T20:43:52.749812+0000","last_became_active":"2023-11-27T20:43:51.711141+0000","last_became_peered":"2023-11-27T20:43:51.711141+0000","last_unstale":"2023-11-27T20:43:52.749812+0000","last_undegraded":"2023-11-27T20:43:52.749812+0000","last_fullsized":"2023-11-27T20:43:52.749812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:14.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.750010+0000","last_change":"2023-11-27T20:43:52.740355+0000","last_active":"2023-11-27T20:43:52.750010+0000","last_peered":"2023-11-27T20:43:52.750010+0000","last_clean":"2023-11-27T20:43:52.750010+0000","last_became_active":"2023-11-27T20:43:52.739879+0000","last_became_peered":"2023-11-27T20:43:52.739879+0000","last_unstale":"2023-11-27T20:43:52.750010+0000","last_undegraded":"2023-11-27T20:43:52.750010+0000","last_fullsized":"2023-11-27T20:43:52.750010+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.751744+0000","last_change":"2023-11-27T20:43:51.701819+0000","last_active":"2023-11-27T20:43:52.751744+0000","last_peered":"2023-11-27T20:43:52.751744+0000","last_clean":"2023-11-27T20:43:52.751744+0000","last_became_active":"2023-11-27T20:43:51.701542+0000","last_became_peered":"2023-11-27T20:43:51.701542+0000","last_unstale":"2023-11-27T20:43:52.751744+0000","last_undegraded":"2023-11-27T20:43:52.751744+0000","last_fullsized":"2023-11-27T20:43:52.751744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:53.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.739721+0000","last_change":"2023-11-27T20:43:52.735677+0000","last_active":"2023-11-27T20:43:52.739721+0000","last_peered":"2023-11-27T20:43:52.739721+0000","last_clean":"2023-11-27T20:43:52.739721+0000","last_became_active":"2023-11-27T20:43:52.734624+0000","last_became_peered":"2023-11-27T20:43:52.734624+0000","last_unstale":"2023-11-27T20:43:52.739721+0000","last_undegraded":"2023-11-27T20:43:52.739721+0000","last_fullsized":"2023-11-27T20:43:52.739721+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:11.250665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.713544+0000","last_change":"2023-11-27T20:43:51.706490+0000","last_active":"2023-11-27T20:43:52.713544+0000","last_peered":"2023-11-27T20:43:52.713544+0000","last_clean":"2023-11-27T20:43:52.713544+0000","last_became_active":"2023-11-27T20:43:51.706181+0000","last_became_peered":"2023-11-27T20:43:51.706181+0000","last_unstale":"2023-11-27T20:43:52.713544+0000","last_undegraded":"2023-11-27T20:43:52.713544+0000","last_fullsized":"2023-11-27T20:43:52.713544+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:41.580304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.738465+0000","last_change":"2023-11-27T20:43:52.732611+0000","last_active":"2023-11-27T20:43:52.738465+0000","last_peered":"2023-11-27T20:43:52.738465+0000","last_clean":"2023-11-27T20:43:52.738465+0000","last_became_active":"2023-11-27T20:43:52.732338+0000","last_became_peered":"2023-11-27T20:43:52.732338+0000","last_unstale":"2023-11-27T20:43:52.738465+0000","last_undegraded":"2023-11-27T20:43:52.738465+0000","last_fullsized":"2023-11-27T20:43:52.738465+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:28.943589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.731414+0000","last_change":"2023-11-27T20:43:51.712506+0000","last_active":"2023-11-27T20:43:52.731414+0000","last_peered":"2023-11-27T20:43:52.731414+0000","last_clean":"2023-11-27T20:43:52.731414+0000","last_became_active":"2023-11-27T20:43:51.712167+0000","last_became_peered":"2023-11-27T20:43:51.712167+0000","last_unstale":"2023-11-27T20:43:52.731414+0000","last_undegraded":"2023-11-27T20:43:52.731414+0000","last_fullsized":"2023-11-27T20:43:52.731414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:20.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.748624+0000","last_change":"2023-11-27T20:43:52.743697+0000","last_active":"2023-11-27T20:43:52.748624+0000","last_peered":"2023-11-27T20:43:52.748624+0000","last_clean":"2023-11-27T20:43:52.748624+0000","last_became_active":"2023-11-27T20:43:52.743405+0000","last_became_peered":"2023-11-27T20:43:52.743405+0000","last_unstale":"2023-11-27T20:43:52.748624+0000","last_undegraded":"2023-11-27T20:43:52.748624+0000","last_fullsized":"2023-11-27T20:43:52.748624+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:56:31.278989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.729329+0000","last_change":"2023-11-27T20:43:51.716942+0000","last_active":"2023-11-27T20:43:52.729329+0000","last_peered":"2023-11-27T20:43:52.729329+0000","last_clean":"2023-11-27T20:43:52.729329+0000","last_became_active":"2023-11-27T20:43:51.716549+0000","last_became_peered":"2023-11-27T20:43:51.716549+0000","last_unstale":"2023-11-27T20:43:52.729329+0000","last_undegraded":"2023-11-27T20:43:52.729329+0000","last_fullsized":"2023-11-27T20:43:52.729329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.752835+0000","last_change":"2023-11-27T20:43:52.747269+0000","last_active":"2023-11-27T20:43:52.752835+0000","last_peered":"2023-11-27T20:43:52.752835+0000","last_clean":"2023-11-27T20:43:52.752835+0000","last_became_active":"2023-11-27T20:43:52.746473+0000","last_became_peered":"2023-11-27T20:43:52.746473+0000","last_unstale":"2023-11-27T20:43:52.752835+0000","last_undegraded":"2023-11-27T20:43:52.752835+0000","last_fullsized":"2023-11-27T20:43:52.752835+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:54.865083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.722089+0000","last_change":"2023-11-27T20:43:51.711346+0000","last_active":"2023-11-27T20:43:52.722089+0000","last_peered":"2023-11-27T20:43:52.722089+0000","last_clean":"2023-11-27T20:43:52.722089+0000","last_became_active":"2023-11-27T20:43:51.711060+0000","last_became_peered":"2023-11-27T20:43:51.711060+0000","last_unstale":"2023-11-27T20:43:52.722089+0000","last_undegraded":"2023-11-27T20:43:52.722089+0000","last_fullsized":"2023-11-27T20:43:52.722089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:18.330525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745870+0000","last_change":"2023-11-27T20:43:52.738413+0000","last_active":"2023-11-27T20:43:52.745870+0000","last_peered":"2023-11-27T20:43:52.745870+0000","last_clean":"2023-11-27T20:43:52.745870+0000","last_became_active":"2023-11-27T20:43:52.738105+0000","last_became_peered":"2023-11-27T20:43:52.738105+0000","last_unstale":"2023-11-27T20:43:52.745870+0000","last_undegraded":"2023-11-27T20:43:52.745870+0000","last_fullsized":"2023-11-27T20:43:52.745870+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.713015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.756966+0000","last_change":"2023-11-27T20:43:51.716907+0000","last_active":"2023-11-27T20:43:52.756966+0000","last_peered":"2023-11-27T20:43:52.756966+0000","last_clean":"2023-11-27T20:43:52.756966+0000","last_became_active":"2023-11-27T20:43:51.716616+0000","last_became_peered":"2023-11-27T20:43:51.716616+0000","last_unstale":"2023-11-27T20:43:52.756966+0000","last_undegraded":"2023-11-27T20:43:52.756966+0000","last_fullsized":"2023-11-27T20:43:52.756966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749632+0000","last_change":"2023-11-27T20:43:52.740853+0000","last_active":"2023-11-27T20:43:52.749632+0000","last_peered":"2023-11-27T20:43:52.749632+0000","last_clean":"2023-11-27T20:43:52.749632+0000","last_became_active":"2023-11-27T20:43:52.740468+0000","last_became_peered":"2023-11-27T20:43:52.740468+0000","last_unstale":"2023-11-27T20:43:52.749632+0000","last_undegraded":"2023-11-27T20:43:52.749632+0000","last_fullsized":"2023-11-27T20:43:52.749632+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:23.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.764884+0000","last_change":"2023-11-27T20:43:51.711651+0000","last_active":"2023-11-27T20:43:52.764884+0000","last_peered":"2023-11-27T20:43:52.764884+0000","last_clean":"2023-11-27T20:43:52.764884+0000","last_became_active":"2023-11-27T20:43:51.711270+0000","last_became_peered":"2023-11-27T20:43:51.711270+0000","last_unstale":"2023-11-27T20:43:52.764884+0000","last_undegraded":"2023-11-27T20:43:52.764884+0000","last_fullsized":"2023-11-27T20:43:52.764884+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:07.560276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.740034+0000","last_change":"2023-11-27T20:43:52.731258+0000","last_active":"2023-11-27T20:43:52.740034+0000","last_peered":"2023-11-27T20:43:52.740034+0000","last_clean":"2023-11-27T20:43:52.740034+0000","last_became_active":"2023-11-27T20:43:52.730701+0000","last_became_peered":"2023-11-27T20:43:52.730701+0000","last_unstale":"2023-11-27T20:43:52.740034+0000","last_undegraded":"2023-11-27T20:43:52.740034+0000","last_fullsized":"2023-11-27T20:43:52.740034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:17.775804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757293+0000","last_change":"2023-11-27T20:43:51.709141+0000","last_active":"2023-11-27T20:43:52.757293+0000","last_peered":"2023-11-27T20:43:52.757293+0000","last_clean":"2023-11-27T20:43:52.757293+0000","last_became_active":"2023-11-27T20:43:51.708864+0000","last_became_peered":"2023-11-27T20:43:51.708864+0000","last_unstale":"2023-11-27T20:43:52.757293+0000","last_undegraded":"2023-11-27T20:43:52.757293+0000","last_fullsized":"2023-11-27T20:43:52.757293+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:29.585661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.744129+0000","last_change":"2023-11-27T20:43:52.736912+0000","last_active":"2023-11-27T20:43:52.744129+0000","last_peered":"2023-11-27T20:43:52.744129+0000","last_clean":"2023-11-27T20:43:52.744129+0000","last_became_active":"2023-11-27T20:43:52.735675+0000","last_became_peered":"2023-11-27T20:43:52.735675+0000","last_unstale":"2023-11-27T20:43:52.744129+0000","last_undegraded":"2023-11-27T20:43:52.744129+0000","last_fullsized":"2023-11-27T20:43:52.744129+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.707822+0000","last_change":"2023-11-27T20:43:51.711938+0000","last_active":"2023-11-27T20:43:52.707822+0000","last_peered":"2023-11-27T20:43:52.707822+0000","last_clean":"2023-11-27T20:43:52.707822+0000","last_became_active":"2023-11-27T20:43:51.711617+0000","last_became_peered":"2023-11-27T20:43:51.711617+0000","last_unstale":"2023-11-27T20:43:52.707822+0000","last_undegraded":"2023-11-27T20:43:52.707822+0000","last_fullsized":"2023-11-27T20:43:52.707822+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:54.146026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.748799+0000","last_change":"2023-11-27T20:43:52.742672+0000","last_active":"2023-11-27T20:43:52.748799+0000","last_peered":"2023-11-27T20:43:52.748799+0000","last_clean":"2023-11-27T20:43:52.748799+0000","last_became_active":"2023-11-27T20:43:52.742066+0000","last_became_peered":"2023-11-27T20:43:52.742066+0000","last_unstale":"2023-11-27T20:43:52.748799+0000","last_undegraded":"2023-11-27T20:43:52.748799+0000","last_fullsized":"2023-11-27T20:43:52.748799+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:46.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.713811+0000","last_change":"2023-11-27T20:43:51.711077+0000","last_active":"2023-11-27T20:43:52.713811+0000","last_peered":"2023-11-27T20:43:52.713811+0000","last_clean":"2023-11-27T20:43:52.713811+0000","last_became_active":"2023-11-27T20:43:51.710820+0000","last_became_peered":"2023-11-27T20:43:51.710820+0000","last_unstale":"2023-11-27T20:43:52.713811+0000","last_undegraded":"2023-11-27T20:43:52.713811+0000","last_fullsized":"2023-11-27T20:43:52.713811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:21.429946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745567+0000","last_change":"2023-11-27T20:43:52.742494+0000","last_active":"2023-11-27T20:43:52.745567+0000","last_peered":"2023-11-27T20:43:52.745567+0000","last_clean":"2023-11-27T20:43:52.745567+0000","last_became_active":"2023-11-27T20:43:52.742174+0000","last_became_peered":"2023-11-27T20:43:52.742174+0000","last_unstale":"2023-11-27T20:43:52.745567+0000","last_undegraded":"2023-11-27T20:43:52.745567+0000","last_fullsized":"2023-11-27T20:43:52.745567+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:01.982839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.756166+0000","last_change":"2023-11-27T20:43:51.714679+0000","last_active":"2023-11-27T20:43:52.756166+0000","last_peered":"2023-11-27T20:43:52.756166+0000","last_clean":"2023-11-27T20:43:52.756166+0000","last_became_active":"2023-11-27T20:43:51.714406+0000","last_became_peered":"2023-11-27T20:43:51.714406+0000","last_unstale":"2023-11-27T20:43:52.756166+0000","last_undegraded":"2023-11-27T20:43:52.756166+0000","last_fullsized":"2023-11-27T20:43:52.756166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:27.933426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.746469+0000","last_change":"2023-11-27T20:43:52.743633+0000","last_active":"2023-11-27T20:43:52.746469+0000","last_peered":"2023-11-27T20:43:52.746469+0000","last_clean":"2023-11-27T20:43:52.746469+0000","last_became_active":"2023-11-27T20:43:52.743243+0000","last_became_peered":"2023-11-27T20:43:52.743243+0000","last_unstale":"2023-11-27T20:43:52.746469+0000","last_undegraded":"2023-11-27T20:43:52.746469+0000","last_fullsized":"2023-11-27T20:43:52.746469+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:05.243944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.756494+0000","last_change":"2023-11-27T20:43:51.714371+0000","last_active":"2023-11-27T20:43:52.756494+0000","last_peered":"2023-11-27T20:43:52.756494+0000","last_clean":"2023-11-27T20:43:52.756494+0000","last_became_active":"2023-11-27T20:43:51.714034+0000","last_became_peered":"2023-11-27T20:43:51.714034+0000","last_unstale":"2023-11-27T20:43:52.756494+0000","last_undegraded":"2023-11-27T20:43:52.756494+0000","last_fullsized":"2023-11-27T20:43:52.756494+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.746556+0000","last_change":"2023-11-27T20:43:52.741261+0000","last_active":"2023-11-27T20:43:52.746556+0000","last_peered":"2023-11-27T20:43:52.746556+0000","last_clean":"2023-11-27T20:43:52.746556+0000","last_became_active":"2023-11-27T20:43:52.740962+0000","last_became_peered":"2023-11-27T20:43:52.740962+0000","last_unstale":"2023-11-27T20:43:52.746556+0000","last_undegraded":"2023-11-27T20:43:52.746556+0000","last_fullsized":"2023-11-27T20:43:52.746556+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:06.257254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.758116+0000","last_change":"2023-11-27T20:43:51.708347+0000","last_active":"2023-11-27T20:43:52.758116+0000","last_peered":"2023-11-27T20:43:52.758116+0000","last_clean":"2023-11-27T20:43:52.758116+0000","last_became_active":"2023-11-27T20:43:51.707976+0000","last_became_peered":"2023-11-27T20:43:51.707976+0000","last_unstale":"2023-11-27T20:43:52.758116+0000","last_undegraded":"2023-11-27T20:43:52.758116+0000","last_fullsized":"2023-11-27T20:43:52.758116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.753356+0000","last_change":"2023-11-27T20:43:52.740074+0000","last_active":"2023-11-27T20:43:52.753356+0000","last_peered":"2023-11-27T20:43:52.753356+0000","last_clean":"2023-11-27T20:43:52.753356+0000","last_became_active":"2023-11-27T20:43:52.739760+0000","last_became_peered":"2023-11-27T20:43:52.739760+0000","last_unstale":"2023-11-27T20:43:52.753356+0000","last_undegraded":"2023-11-27T20:43:52.753356+0000","last_fullsized":"2023-11-27T20:43:52.753356+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.755078+0000","last_change":"2023-11-27T20:43:51.707359+0000","last_active":"2023-11-27T20:43:52.755078+0000","last_peered":"2023-11-27T20:43:52.755078+0000","last_clean":"2023-11-27T20:43:52.755078+0000","last_became_active":"2023-11-27T20:43:51.707036+0000","last_became_peered":"2023-11-27T20:43:51.707036+0000","last_unstale":"2023-11-27T20:43:52.755078+0000","last_undegraded":"2023-11-27T20:43:52.755078+0000","last_fullsized":"2023-11-27T20:43:52.755078+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.753721+0000","last_change":"2023-11-27T20:43:52.749840+0000","last_active":"2023-11-27T20:43:52.753721+0000","last_peered":"2023-11-27T20:43:52.753721+0000","last_clean":"2023-11-27T20:43:52.753721+0000","last_became_active":"2023-11-27T20:43:52.749390+0000","last_became_peered":"2023-11-27T20:43:52.749390+0000","last_unstale":"2023-11-27T20:43:52.753721+0000","last_undegraded":"2023-11-27T20:43:52.753721+0000","last_fullsized":"2023-11-27T20:43:52.753721+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:54.288377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.744707+0000","last_change":"2023-11-27T20:43:51.704467+0000","last_active":"2023-11-27T20:43:52.744707+0000","last_peered":"2023-11-27T20:43:52.744707+0000","last_clean":"2023-11-27T20:43:52.744707+0000","last_became_active":"2023-11-27T20:43:51.704172+0000","last_became_peered":"2023-11-27T20:43:51.704172+0000","last_unstale":"2023-11-27T20:43:52.744707+0000","last_undegraded":"2023-11-27T20:43:52.744707+0000","last_fullsized":"2023-11-27T20:43:52.744707+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:44.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.740012+0000","last_change":"2023-11-27T20:43:52.730278+0000","last_active":"2023-11-27T20:43:52.740012+0000","last_peered":"2023-11-27T20:43:52.740012+0000","last_clean":"2023-11-27T20:43:52.740012+0000","last_became_active":"2023-11-27T20:43:52.729894+0000","last_became_peered":"2023-11-27T20:43:52.729894+0000","last_unstale":"2023-11-27T20:43:52.740012+0000","last_undegraded":"2023-11-27T20:43:52.740012+0000","last_fullsized":"2023-11-27T20:43:52.740012+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:54.865083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.755732+0000","last_change":"2023-11-27T20:43:51.709579+0000","last_active":"2023-11-27T20:43:52.755732+0000","last_peered":"2023-11-27T20:43:52.755732+0000","last_clean":"2023-11-27T20:43:52.755732+0000","last_became_active":"2023-11-27T20:43:51.709194+0000","last_became_peered":"2023-11-27T20:43:51.709194+0000","last_unstale":"2023-11-27T20:43:52.755732+0000","last_undegraded":"2023-11-27T20:43:52.755732+0000","last_fullsized":"2023-11-27T20:43:52.755732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:01.414182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757597+0000","last_change":"2023-11-27T20:43:52.750078+0000","last_active":"2023-11-27T20:43:52.757597+0000","last_peered":"2023-11-27T20:43:52.757597+0000","last_clean":"2023-11-27T20:43:52.757597+0000","last_became_active":"2023-11-27T20:43:52.749770+0000","last_became_peered":"2023-11-27T20:43:52.749770+0000","last_unstale":"2023-11-27T20:43:52.757597+0000","last_undegraded":"2023-11-27T20:43:52.757597+0000","last_fullsized":"2023-11-27T20:43:52.757597+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.705294+0000","last_change":"2023-11-27T20:43:51.708599+0000","last_active":"2023-11-27T20:43:52.705294+0000","last_peered":"2023-11-27T20:43:52.705294+0000","last_clean":"2023-11-27T20:43:52.705294+0000","last_became_active":"2023-11-27T20:43:51.708311+0000","last_became_peered":"2023-11-27T20:43:51.708311+0000","last_unstale":"2023-11-27T20:43:52.705294+0000","last_undegraded":"2023-11-27T20:43:52.705294+0000","last_fullsized":"2023-11-27T20:43:52.705294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:39.603520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757884+0000","last_change":"2023-11-27T20:43:52.745035+0000","last_active":"2023-11-27T20:43:52.757884+0000","last_peered":"2023-11-27T20:43:52.757884+0000","last_clean":"2023-11-27T20:43:52.757884+0000","last_became_active":"2023-11-27T20:43:52.744540+0000","last_became_peered":"2023-11-27T20:43:52.744540+0000","last_unstale":"2023-11-27T20:43:52.757884+0000","last_undegraded":"2023-11-27T20:43:52.757884+0000","last_fullsized":"2023-11-27T20:43:52.757884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:05.243944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.713068+0000","last_change":"2023-11-27T20:43:51.703755+0000","last_active":"2023-11-27T20:43:52.713068+0000","last_peered":"2023-11-27T20:43:52.713068+0000","last_clean":"2023-11-27T20:43:52.713068+0000","last_became_active":"2023-11-27T20:43:51.700051+0000","last_became_peered":"2023-11-27T20:43:51.700051+0000","last_unstale":"2023-11-27T20:43:52.713068+0000","last_undegraded":"2023-11-27T20:43:52.713068+0000","last_fullsized":"2023-11-27T20:43:52.713068+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:00.972675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.742456+0000","last_change":"2023-11-27T20:43:52.735455+0000","last_active":"2023-11-27T20:43:52.742456+0000","last_peered":"2023-11-27T20:43:52.742456+0000","last_clean":"2023-11-27T20:43:52.742456+0000","last_became_active":"2023-11-27T20:43:52.735128+0000","last_became_peered":"2023-11-27T20:43:52.735128+0000","last_unstale":"2023-11-27T20:43:52.742456+0000","last_undegraded":"2023-11-27T20:43:52.742456+0000","last_fullsized":"2023-11-27T20:43:52.742456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.761871+0000","last_change":"2023-11-27T20:43:51.711208+0000","last_active":"2023-11-27T20:43:52.761871+0000","last_peered":"2023-11-27T20:43:52.761871+0000","last_clean":"2023-11-27T20:43:52.761871+0000","last_became_active":"2023-11-27T20:43:51.710936+0000","last_became_peered":"2023-11-27T20:43:51.710936+0000","last_unstale":"2023-11-27T20:43:52.761871+0000","last_undegraded":"2023-11-27T20:43:52.761871+0000","last_fullsized":"2023-11-27T20:43:52.761871+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:20.570705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.746533+0000","last_change":"2023-11-27T20:43:52.739121+0000","last_active":"2023-11-27T20:43:52.746533+0000","last_peered":"2023-11-27T20:43:52.746533+0000","last_clean":"2023-11-27T20:43:52.746533+0000","last_became_active":"2023-11-27T20:43:52.738758+0000","last_became_peered":"2023-11-27T20:43:52.738758+0000","last_unstale":"2023-11-27T20:43:52.746533+0000","last_undegraded":"2023-11-27T20:43:52.746533+0000","last_fullsized":"2023-11-27T20:43:52.746533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:17.887527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.733558+0000","last_change":"2023-11-27T20:43:51.703349+0000","last_active":"2023-11-27T20:43:52.733558+0000","last_peered":"2023-11-27T20:43:52.733558+0000","last_clean":"2023-11-27T20:43:52.733558+0000","last_became_active":"2023-11-27T20:43:51.703049+0000","last_became_peered":"2023-11-27T20:43:51.703049+0000","last_unstale":"2023-11-27T20:43:52.733558+0000","last_undegraded":"2023-11-27T20:43:52.733558+0000","last_fullsized":"2023-11-27T20:43:52.733558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745662+0000","last_change":"2023-11-27T20:43:52.738313+0000","last_active":"2023-11-27T20:43:52.745662+0000","last_peered":"2023-11-27T20:43:52.745662+0000","last_clean":"2023-11-27T20:43:52.745662+0000","last_became_active":"2023-11-27T20:43:52.738011+0000","last_became_peered":"2023-11-27T20:43:52.738011+0000","last_unstale":"2023-11-27T20:43:52.745662+0000","last_undegraded":"2023-11-27T20:43:52.745662+0000","last_fullsized":"2023-11-27T20:43:52.745662+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:26.493343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.708567+0000","last_change":"2023-11-27T20:43:51.711343+0000","last_active":"2023-11-27T20:43:52.708567+0000","last_peered":"2023-11-27T20:43:52.708567+0000","last_clean":"2023-11-27T20:43:52.708567+0000","last_became_active":"2023-11-27T20:43:51.708458+0000","last_became_peered":"2023-11-27T20:43:51.708458+0000","last_unstale":"2023-11-27T20:43:52.708567+0000","last_undegraded":"2023-11-27T20:43:52.708567+0000","last_fullsized":"2023-11-27T20:43:52.708567+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:41.674074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.758378+0000","last_change":"2023-11-27T20:43:52.746396+0000","last_active":"2023-11-27T20:43:52.758378+0000","last_peered":"2023-11-27T20:43:52.758378+0000","last_clean":"2023-11-27T20:43:52.758378+0000","last_became_active":"2023-11-27T20:43:52.745787+0000","last_became_peered":"2023-11-27T20:43:52.745787+0000","last_unstale":"2023-11-27T20:43:52.758378+0000","last_undegraded":"2023-11-27T20:43:52.758378+0000","last_fullsized":"2023-11-27T20:43:52.758378+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:42.590467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.717114+0000","last_change":"2023-11-27T20:43:51.711230+0000","last_active":"2023-11-27T20:43:52.717114+0000","last_peered":"2023-11-27T20:43:52.717114+0000","last_clean":"2023-11-27T20:43:52.717114+0000","last_became_active":"2023-11-27T20:43:51.709149+0000","last_became_peered":"2023-11-27T20:43:51.709149+0000","last_unstale":"2023-11-27T20:43:52.717114+0000","last_undegraded":"2023-11-27T20:43:52.717114+0000","last_fullsized":"2023-11-27T20:43:52.717114+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:18.904440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749888+0000","last_change":"2023-11-27T20:43:52.740586+0000","last_active":"2023-11-27T20:43:52.749888+0000","last_peered":"2023-11-27T20:43:52.749888+0000","last_clean":"2023-11-27T20:43:52.749888+0000","last_became_active":"2023-11-27T20:43:52.739765+0000","last_became_peered":"2023-11-27T20:43:52.739765+0000","last_unstale":"2023-11-27T20:43:52.749888+0000","last_undegraded":"2023-11-27T20:43:52.749888+0000","last_fullsized":"2023-11-27T20:43:52.749888+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.705438+0000","last_change":"2023-11-27T20:43:51.701630+0000","last_active":"2023-11-27T20:43:52.705438+0000","last_peered":"2023-11-27T20:43:52.705438+0000","last_clean":"2023-11-27T20:43:52.705438+0000","last_became_active":"2023-11-27T20:43:51.701326+0000","last_became_peered":"2023-11-27T20:43:51.701326+0000","last_unstale":"2023-11-27T20:43:52.705438+0000","last_undegraded":"2023-11-27T20:43:52.705438+0000","last_fullsized":"2023-11-27T20:43:52.705438+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:15.707938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.753844+0000","last_change":"2023-11-27T20:43:52.751182+0000","last_active":"2023-11-27T20:43:52.753844+0000","last_peered":"2023-11-27T20:43:52.753844+0000","last_clean":"2023-11-27T20:43:52.753844+0000","last_became_active":"2023-11-27T20:43:52.750848+0000","last_became_peered":"2023-11-27T20:43:52.750848+0000","last_unstale":"2023-11-27T20:43:52.753844+0000","last_undegraded":"2023-11-27T20:43:52.753844+0000","last_fullsized":"2023-11-27T20:43:52.753844+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:22.440110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.732246+0000","last_change":"2023-11-27T20:43:51.712306+0000","last_active":"2023-11-27T20:43:52.732246+0000","last_peered":"2023-11-27T20:43:52.732246+0000","last_clean":"2023-11-27T20:43:52.732246+0000","last_became_active":"2023-11-27T20:43:51.712011+0000","last_became_peered":"2023-11-27T20:43:51.712011+0000","last_unstale":"2023-11-27T20:43:52.732246+0000","last_undegraded":"2023-11-27T20:43:52.732246+0000","last_fullsized":"2023-11-27T20:43:52.732246+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:16.877363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.739723+0000","last_change":"2023-11-27T20:43:52.726119+0000","last_active":"2023-11-27T20:43:52.739723+0000","last_peered":"2023-11-27T20:43:52.739723+0000","last_clean":"2023-11-27T20:43:52.739723+0000","last_became_active":"2023-11-27T20:43:52.725822+0000","last_became_peered":"2023-11-27T20:43:52.725822+0000","last_unstale":"2023-11-27T20:43:52.739723+0000","last_undegraded":"2023-11-27T20:43:52.739723+0000","last_fullsized":"2023-11-27T20:43:52.739723+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:11.250665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.705270+0000","last_change":"2023-11-27T20:43:51.701670+0000","last_active":"2023-11-27T20:43:52.705270+0000","last_peered":"2023-11-27T20:43:52.705270+0000","last_clean":"2023-11-27T20:43:52.705270+0000","last_became_active":"2023-11-27T20:43:51.701405+0000","last_became_peered":"2023-11-27T20:43:51.701405+0000","last_unstale":"2023-11-27T20:43:52.705270+0000","last_undegraded":"2023-11-27T20:43:52.705270+0000","last_fullsized":"2023-11-27T20:43:52.705270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:37.579894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.738389+0000","last_change":"2023-11-27T20:43:52.723905+0000","last_active":"2023-11-27T20:43:52.738389+0000","last_peered":"2023-11-27T20:43:52.738389+0000","last_clean":"2023-11-27T20:43:52.738389+0000","last_became_active":"2023-11-27T20:43:52.723296+0000","last_became_peered":"2023-11-27T20:43:52.723296+0000","last_unstale":"2023-11-27T20:43:52.738389+0000","last_undegraded":"2023-11-27T20:43:52.738389+0000","last_fullsized":"2023-11-27T20:43:52.738389+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:19.914604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.716037+0000","last_change":"2023-11-27T20:43:51.707532+0000","last_active":"2023-11-27T20:43:52.716037+0000","last_peered":"2023-11-27T20:43:52.716037+0000","last_clean":"2023-11-27T20:43:52.716037+0000","last_became_active":"2023-11-27T20:43:51.705976+0000","last_became_peered":"2023-11-27T20:43:51.705976+0000","last_unstale":"2023-11-27T20:43:52.716037+0000","last_undegraded":"2023-11-27T20:43:52.716037+0000","last_fullsized":"2023-11-27T20:43:52.716037+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:01.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757821+0000","last_change":"2023-11-27T20:43:52.752685+0000","last_active":"2023-11-27T20:43:52.757821+0000","last_peered":"2023-11-27T20:43:52.757821+0000","last_clean":"2023-11-27T20:43:52.757821+0000","last_became_active":"2023-11-27T20:43:52.748686+0000","last_became_peered":"2023-11-27T20:43:52.748686+0000","last_unstale":"2023-11-27T20:43:52.757821+0000","last_undegraded":"2023-11-27T20:43:52.757821+0000","last_fullsized":"2023-11-27T20:43:52.757821+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:54.739325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.708409+0000","last_change":"2023-11-27T20:43:51.700471+0000","last_active":"2023-11-27T20:43:52.708409+0000","last_peered":"2023-11-27T20:43:52.708409+0000","last_clean":"2023-11-27T20:43:52.708409+0000","last_became_active":"2023-11-27T20:43:51.700088+0000","last_became_peered":"2023-11-27T20:43:51.700088+0000","last_unstale":"2023-11-27T20:43:52.708409+0000","last_undegraded":"2023-11-27T20:43:52.708409+0000","last_fullsized":"2023-11-27T20:43:52.708409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:13:35.862430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-27T20:43:51.709215+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:43:51.709215+0000","last_peered":"2023-11-27T20:43:51.709215+0000","last_clean":"2023-11-27T20:43:51.709215+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:43:51.709215+0000","last_undegraded":"2023-11-27T20:43:51.709215+0000","last_fullsized":"2023-11-27T20:43:51.709215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1228800,"data_stored":861265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1579999999999999,"15min":1.163},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.181,"5min":1.2290000000000001,"15min":1.2370000000000001},"min":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.74,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.82499999999999996}]},{"osd":1,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.47,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.607,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3460000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.282,"15min":1.3080000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.484,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":0.88},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.248,"15min":1.2589999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6379999999999999,"5min":1.909,"15min":1.909},"last":1.24}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.361,"15min":1.397},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6779999999999999,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.47,"15min":1.496},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6879999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.397}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.724,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.5429999999999999,"15min":1.6040000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.623,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.202}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4770000000000001,"15min":1.5049999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.948,"5min":2.044,"15min":2.044},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.5660000000000001,"15min":1.5940000000000001},"min":{"1min":0.69499999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8169999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.4930000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.653,"15min":1.6759999999999999},"min":{"1min":0.80200000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.0179999999999998,"5min":2.508,"15min":2.508},"last":1.613},{"interface":"front","average":{"1min":1.425,"5min":1.6559999999999999,"15min":1.694},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.724,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.6619999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":277672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.679,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.647},{"interface":"front","average":{"1min":1.157,"5min":1.306,"15min":1.331},"min":{"1min":0.65200000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6399999999999999,"5min":2.581,"15min":2.581},"last":1.3160000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2549999999999999,"15min":1.2769999999999999},"min":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5349999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.359},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.151,"15min":1.167},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.506,"5min":2.823,"15min":2.823},"last":1.389}]},{"osd":2,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0760000000000001,"15min":1.081},"min":{"1min":0.79100000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4790000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.2,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.86899999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.679,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.5720000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.349,"15min":1.387},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.71,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.095},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.7849999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4319999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.605,"15min":1.631},"min":{"1min":0.97699999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.994,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.623,"15min":1.663},"min":{"1min":0.82799999999999996,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.804,"5min":3.536,"15min":3.536},"last":1.6100000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.393,"15min":1.4079999999999999},"min":{"1min":0.81200000000000006,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9359999999999999,"5min":2.355,"15min":2.355},"last":1.24},{"interface":"front","average":{"1min":1.49,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.753,"5min":0.623,"15min":0.623},"max":{"1min":1.8819999999999999,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.71}]},{"osd":7,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.6519999999999999,"15min":1.6919999999999999},"min":{"1min":0.88500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":3.645,"15min":3.645},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.569,"15min":1.589},"min":{"1min":1.006,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.032,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.51}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":278324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.1379999999999999,"15min":1.163},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5800000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.1579999999999999,"15min":1.1839999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6619999999999999,"5min":2.04,"15min":2.04},"last":0.879}]},{"osd":1,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.181,"15min":1.2050000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.4630000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.3340000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.27,"15min":1.294},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.73,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.1950000000000001,"15min":1.214},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7470000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.268}]},{"osd":3,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.3660000000000001,"15min":1.399},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5900000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.2},{"interface":"front","average":{"1min":1.216,"5min":1.4359999999999999,"15min":1.472},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.637,"5min":4.016,"15min":4.016},"last":1.0860000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3580000000000001,"15min":1.3919999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.79,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.514},{"interface":"front","average":{"1min":1.292,"5min":1.585,"15min":1.6339999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8140000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.3100000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.619,"15min":1.671},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.724,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.573,"15min":1.6120000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.016,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.6020000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.6379999999999999,"15min":1.6819999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.871,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.708,"15min":1.76},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8380000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.637}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":279284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.014,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.999},{"interface":"front","average":{"1min":1.099,"5min":1.0840000000000001,"15min":1.0820000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.034,"15min":1.008},"min":{"1min":0.80400000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":3.5289999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.222,"15min":1.22},"min":{"1min":0.64500000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.74,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":3.9430000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2170000000000001,"15min":1.2110000000000001},"min":{"1min":0.69799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":2.1520000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.292,"15min":1.294},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.395}]},{"osd":3,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.85199999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.599,"5min":1.778,"15min":1.778},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.3600000000000001,"15min":1.343},"min":{"1min":0.91400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.2989999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.266,"15min":1.284},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.516},{"interface":"front","average":{"1min":1.421,"5min":1.431,"15min":1.4330000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.145}]},{"osd":6,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.651,"5min":2.157,"15min":2.157},"last":1.462},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.595,"15min":1.605},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.887,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.242}]},{"osd":7,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5089999999999999,"15min":1.5009999999999999},"min":{"1min":1.179,"5min":1.016,"15min":1.016},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.696,"5min":1.6679999999999999,"15min":1.6639999999999999},"min":{"1min":1.22,"5min":1.004,"15min":1.004},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.339}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":277728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":1.0009999999999999,"15min":1.0389999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.258,"5min":3.641,"15min":3.641},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97199999999999998,"15min":1.014},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0449999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.91400000000000003}]},{"osd":1,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.399,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.097,"15min":1.121},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4099999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.63100000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0960000000000001,"15min":1.117},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.444,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.135},"min":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.746,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.0109999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.3029999999999999,"15min":1.337},"min":{"1min":0.84499999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.365,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.4330000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.4179999999999999,"15min":1.4379999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.982,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.452,"15min":1.482},"min":{"1min":0.874,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.714,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.054}]},{"osd":6,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.5189999999999999,"15min":1.544},"min":{"1min":0.96799999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.823,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.492,"15min":1.522},"min":{"1min":0.89000000000000001,"5min":0.878,"15min":0.878},"max":{"1min":1.8560000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.2789999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.5209999999999999,"15min":1.5580000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.929,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.415},{"interface":"front","average":{"1min":1.413,"5min":1.4890000000000001,"15min":1.5009999999999999},"min":{"1min":1.002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.7410000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":0.81399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":277728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1259999999999999,"5min":1.228,"15min":1.228},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.93300000000000005},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2270000000000001,"5min":1.972,"15min":1.972},"last":0.94299999999999995}]},{"osd":1,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.98099999999999998,"15min":1.014},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1890000000000001,"5min":1.522,"15min":1.522},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.96499999999999997,"15min":0.98799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.431,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.264}]},{"osd":3,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.96099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.996},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0740000000000001,"15min":1.101},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4770000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.111}]},{"osd":4,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.1850000000000001,"15min":1.21},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4299999999999999,"5min":1.669,"15min":1.669},"last":1.173},{"interface":"front","average":{"1min":1.169,"5min":1.3540000000000001,"15min":1.385},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.595}]},{"osd":5,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.3009999999999999,"15min":1.3260000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.601,"5min":2.48,"15min":2.48},"last":1.349},{"interface":"front","average":{"1min":1.198,"5min":1.4510000000000001,"15min":1.4930000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9930000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.4830000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3640000000000001,"15min":1.381},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.972,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.331},{"interface":"front","average":{"1min":1.202,"5min":1.4890000000000001,"15min":1.5369999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.831,"5min":3.302,"15min":3.302},"last":1.302}]},{"osd":7,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.46,"15min":1.496},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.1070000000000002,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.4330000000000001,"15min":1.4810000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.581,"5min":2.73,"15min":2.73},"last":1.5229999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":277672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0940000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.75},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.5449999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.86299999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.97099999999999997,"15min":0.98999999999999999},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3740000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0429999999999999,"15min":1.0469999999999999},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.518,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.1599999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0489999999999999,"15min":1.0329999999999999},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7370000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.01},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.083,"15min":1.087},"min":{"1min":0.66600000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6140000000000001,"5min":2.044,"15min":2.044},"last":1.27}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1799999999999999,"15min":1.1890000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3640000000000001,"15min":1.3540000000000001},"min":{"1min":0.88500000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.1099999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.3560000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9810000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.25,"15min":1.2330000000000001},"min":{"1min":0.79100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1659999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.117}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.3380000000000001,"15min":1.3180000000000001},"min":{"1min":1.095,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1230000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.52},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.357},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.732,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.2450000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.4690000000000001,"15min":1.476},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1949999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.47},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.5960000000000001,"15min":1.5880000000000001},"min":{"1min":1.143,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.7469999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.5840000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1228800,"data_stored":861265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.85299999999999998,"15min":0.84199999999999997},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.85099999999999998,"15min":0.83499999999999996},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.143},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.242}]},{"osd":3,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.91300000000000003,"15min":0.89700000000000002},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.8320000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.494}]},{"osd":4,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2470000000000001,"15min":1.246},"min":{"1min":0.76900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9430000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.1970000000000001,"15min":1.1919999999999999},"min":{"1min":0.89700000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.575,"5min":2.391,"15min":2.391},"last":1.1000000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.81399999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.0750000000000002,"5min":3.028,"15min":3.028},"last":1.625},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.3129999999999999},"min":{"1min":0.77700000000000002,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.246,"5min":2.718,"15min":2.718},"last":1.667}]},{"osd":6,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3120000000000001},"min":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7909999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.423,"15min":1.4239999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.1509999999999998,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.724}]},{"osd":7,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3540000000000001,"15min":1.355},"min":{"1min":0.84699999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.835,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.405},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3560000000000001,"15min":1.3600000000000001},"min":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8500000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.385}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:43:57.638 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:43:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.893+0000 7f9f8f217640 1 Processor -- start 2023-11-27T20:43:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.893+0000 7f9f8f217640 1 -- start start 2023-11-27T20:43:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.894+0000 7f9f8f217640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f88155490 0x7f9f880a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.894+0000 7f9f8f217640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9f880c1500 0x7f9f880a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.894+0000 7f9f8f217640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f880c06c0 con 0x7f9f880c4080 2023-11-27T20:43:57.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.894+0000 7f9f8f217640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f880a5820 con 0x7f9f880c1500 2023-11-27T20:43:57.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.894+0000 7f9f8f217640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880c1020 con 0x7f9f88155490 2023-11-27T20:43:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.895+0000 7f9f87fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9f880c1500 0x7f9f880a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.895+0000 7f9f87fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9f880c1500 0x7f9f880a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41274/0 (socket says 172.21.15.91:41274) 2023-11-27T20:43:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.895+0000 7f9f87fff640 1 -- 172.21.15.91:0/1962954372 learned_addr learned my addr 172.21.15.91:0/1962954372 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.895+0000 7f9f8cfb3640 1 --2- 172.21.15.91:0/1962954372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f88155490 0x7f9f880a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.895+0000 7f9f87fff640 1 -- 172.21.15.91:0/1962954372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f88155490 msgr2=0x7f9f880a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.895+0000 7f9f87fff640 1 --2- 172.21.15.91:0/1962954372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f88155490 0x7f9f880a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.895+0000 7f9f87fff640 1 -- 172.21.15.91:0/1962954372 >> v1:172.21.15.183:6789/0 conn(0x7f9f880c4080 legacy=0x7f9f880c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.895+0000 7f9f87fff640 1 -- 172.21.15.91:0/1962954372 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f880c0910 con 0x7f9f880c1500 2023-11-27T20:43:57.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.897+0000 7f9f87fff640 1 --2- 172.21.15.91:0/1962954372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f880c1500 0x7f9f880a9430 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009e50 tx=0x7f9f7c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b462ddf4bc2febc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:57.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.897+0000 7f9f877fe640 1 -- 172.21.15.91:0/1962954372 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c02c9e0 con 0x7f9f880c1500 2023-11-27T20:43:57.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.897+0000 7f9f877fe640 1 -- 172.21.15.91:0/1962954372 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c02cb40 con 0x7f9f880c1500 2023-11-27T20:43:57.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.897+0000 7f9f877fe640 1 -- 172.21.15.91:0/1962954372 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0343f0 con 0x7f9f880c1500 2023-11-27T20:43:57.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.898+0000 7f9f8f217640 1 -- 172.21.15.91:0/1962954372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f880c1500 msgr2=0x7f9f880a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.898+0000 7f9f8f217640 1 --2- 172.21.15.91:0/1962954372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f880c1500 0x7f9f880a9430 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009e50 tx=0x7f9f7c02be40 comp rx=0 tx=0).stop 2023-11-27T20:43:57.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.898+0000 7f9f8f217640 1 -- 172.21.15.91:0/1962954372 shutdown_connections 2023-11-27T20:43:57.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.898+0000 7f9f8f217640 1 --2- 172.21.15.91:0/1962954372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f880c1500 0x7f9f880a9430 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.898+0000 7f9f8f217640 1 --2- 172.21.15.91:0/1962954372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f88155490 0x7f9f880a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.898+0000 7f9f8f217640 1 -- 172.21.15.91:0/1962954372 >> 172.21.15.91:0/1962954372 conn(0x7f9f8806a500 msgr2=0x7f9f8806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:57.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.898+0000 7f9f8f217640 1 -- 172.21.15.91:0/1962954372 shutdown_connections 2023-11-27T20:43:57.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.898+0000 7f9f8f217640 1 -- 172.21.15.91:0/1962954372 wait complete. 2023-11-27T20:43:57.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.900+0000 7f9f8f217640 1 Processor -- start 2023-11-27T20:43:57.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.900+0000 7f9f8f217640 1 -- start start 2023-11-27T20:43:57.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.901+0000 7f9f8f217640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f880c1500 0x7f9f8814e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.901+0000 7f9f8f217640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f880c4080 0x7f9f881490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.901+0000 7f9f8f217640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f88155490 0x7f9f881495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.901+0000 7f9f8f217640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88070570 con 0x7f9f88155490 2023-11-27T20:43:57.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.901+0000 7f9f8f217640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88152cd0 con 0x7f9f880c1500 2023-11-27T20:43:57.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.901+0000 7f9f8f217640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88146f60 con 0x7f9f880c4080 2023-11-27T20:43:57.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.901+0000 7f9f8d7b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f88155490 0x7f9f881495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.901+0000 7f9f8d7b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f88155490 0x7f9f881495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41286/0 (socket says 172.21.15.91:41286) 2023-11-27T20:43:57.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.901+0000 7f9f8d7b4640 1 -- 172.21.15.91:0/2945528064 learned_addr learned my addr 172.21.15.91:0/2945528064 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:57.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.901+0000 7f9f8cfb3640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f880c1500 0x7f9f8814e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f8d7b4640 1 -- 172.21.15.91:0/2945528064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f880c4080 msgr2=0x7f9f881490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f87fff640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f880c4080 0x7f9f881490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f8d7b4640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f880c4080 0x7f9f881490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f8d7b4640 1 -- 172.21.15.91:0/2945528064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f880c1500 msgr2=0x7f9f8814e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:57.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f8d7b4640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f880c1500 0x7f9f8814e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:57.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f8d7b4640 1 -- 172.21.15.91:0/2945528064 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009b30 con 0x7f9f88155490 2023-11-27T20:43:57.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f8cfb3640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f880c1500 0x7f9f8814e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:57.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f8d7b4640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f88155490 0x7f9f881495f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000c410 tx=0x7f9f8000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:57.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f857fa640 1 -- 172.21.15.91:0/2945528064 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80011790 con 0x7f9f88155490 2023-11-27T20:43:57.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f857fa640 1 -- 172.21.15.91:0/2945528064 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f800118f0 con 0x7f9f88155490 2023-11-27T20:43:57.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f857fa640 1 -- 172.21.15.91:0/2945528064 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80011ca0 con 0x7f9f88155490 2023-11-27T20:43:57.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f8f217640 1 -- 172.21.15.91:0/2945528064 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f88147240 con 0x7f9f88155490 2023-11-27T20:43:57.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.902+0000 7f9f8f217640 1 -- 172.21.15.91:0/2945528064 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f88072020 con 0x7f9f88155490 2023-11-27T20:43:57.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.904+0000 7f9f8f217640 1 -- 172.21.15.91:0/2945528064 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f88068350 con 0x7f9f88155490 2023-11-27T20:43:57.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.905+0000 7f9f857fa640 1 -- 172.21.15.91:0/2945528064 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9f8001c460 con 0x7f9f88155490 2023-11-27T20:43:57.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.906+0000 7f9f857fa640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f7406b1c0 0x7f9f7406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:57.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.906+0000 7f9f857fa640 1 -- 172.21.15.91:0/2945528064 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f800896d0 con 0x7f9f88155490 2023-11-27T20:43:57.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.906+0000 7f9f8cfb3640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f7406b1c0 0x7f9f7406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:57.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.907+0000 7f9f8cfb3640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f7406b1c0 0x7f9f7406d680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800b820 tx=0x7f9f78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:57.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:57.910+0000 7f9f857fa640 1 -- 172.21.15.91:0/2945528064 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9f80054400 con 0x7f9f88155490 2023-11-27T20:43:58.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.100+0000 7f9f8f217640 1 -- 172.21.15.91:0/2945528064 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f88155870 con 0x7f9f7406b1c0 2023-11-27T20:43:58.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.113+0000 7f9f857fa640 1 -- 172.21.15.91:0/2945528064 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286445 (secure 0 0 0) 0x7f9f7800c040 con 0x7f9f7406b1c0 2023-11-27T20:43:58.117 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:58.118 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:43:58.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.117+0000 7f9f8f217640 1 -- 172.21.15.91:0/2945528064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f7406b1c0 msgr2=0x7f9f7406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.117+0000 7f9f8f217640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f7406b1c0 0x7f9f7406d680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800b820 tx=0x7f9f78008040 comp rx=0 tx=0).stop 2023-11-27T20:43:58.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.117+0000 7f9f8f217640 1 -- 172.21.15.91:0/2945528064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f88155490 msgr2=0x7f9f881495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.117+0000 7f9f8f217640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f88155490 0x7f9f881495f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000c410 tx=0x7f9f8000c8d0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.117+0000 7f9f8f217640 1 -- 172.21.15.91:0/2945528064 shutdown_connections 2023-11-27T20:43:58.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.117+0000 7f9f8f217640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f88155490 0x7f9f881495f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.117+0000 7f9f8f217640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f880c4080 0x7f9f881490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.118+0000 7f9f8f217640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9f7406b1c0 0x7f9f7406d680 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.118+0000 7f9f8f217640 1 --2- 172.21.15.91:0/2945528064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f880c1500 0x7f9f8814e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.118+0000 7f9f8f217640 1 -- 172.21.15.91:0/2945528064 >> 172.21.15.91:0/2945528064 conn(0x7f9f8806a500 msgr2=0x7f9f880a81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:58.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.118+0000 7f9f8f217640 1 -- 172.21.15.91:0/2945528064 shutdown_connections 2023-11-27T20:43:58.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.118+0000 7f9f8f217640 1 -- 172.21.15.91:0/2945528064 wait complete. 2023-11-27T20:43:58.138 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-11-27T20:43:57.419588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226592,"kb_used_data":6228,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748128,"statfs":{"total":773094113280,"available":772862083072,"internally_reserved":0,"allocated":6377472,"data_stored":3390938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001746"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.744760+0000","last_change":"2023-11-27T20:43:52.742706+0000","last_active":"2023-11-27T20:43:52.744760+0000","last_peered":"2023-11-27T20:43:52.744760+0000","last_clean":"2023-11-27T20:43:52.744760+0000","last_became_active":"2023-11-27T20:43:52.742447+0000","last_became_peered":"2023-11-27T20:43:52.742447+0000","last_unstale":"2023-11-27T20:43:52.744760+0000","last_undegraded":"2023-11-27T20:43:52.744760+0000","last_fullsized":"2023-11-27T20:43:52.744760+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:47:06.598413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.750109+0000","last_change":"2023-11-27T20:43:52.741446+0000","last_active":"2023-11-27T20:43:52.750109+0000","last_peered":"2023-11-27T20:43:52.750109+0000","last_clean":"2023-11-27T20:43:52.750109+0000","last_became_active":"2023-11-27T20:43:52.741105+0000","last_became_peered":"2023-11-27T20:43:52.741105+0000","last_unstale":"2023-11-27T20:43:52.750109+0000","last_undegraded":"2023-11-27T20:43:52.750109+0000","last_fullsized":"2023-11-27T20:43:52.750109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749613+0000","last_change":"2023-11-27T20:43:52.737240+0000","last_active":"2023-11-27T20:43:52.749613+0000","last_peered":"2023-11-27T20:43:52.749613+0000","last_clean":"2023-11-27T20:43:52.749613+0000","last_became_active":"2023-11-27T20:43:52.736781+0000","last_became_peered":"2023-11-27T20:43:52.736781+0000","last_unstale":"2023-11-27T20:43:52.749613+0000","last_undegraded":"2023-11-27T20:43:52.749613+0000","last_fullsized":"2023-11-27T20:43:52.749613+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:17.775804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.747237+0000","last_change":"2023-11-27T20:43:52.738199+0000","last_active":"2023-11-27T20:43:52.747237+0000","last_peered":"2023-11-27T20:43:52.747237+0000","last_clean":"2023-11-27T20:43:52.747237+0000","last_became_active":"2023-11-27T20:43:52.737298+0000","last_became_peered":"2023-11-27T20:43:52.737298+0000","last_unstale":"2023-11-27T20:43:52.747237+0000","last_undegraded":"2023-11-27T20:43:52.747237+0000","last_fullsized":"2023-11-27T20:43:52.747237+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:23.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.748767+0000","last_change":"2023-11-27T20:43:52.745287+0000","last_active":"2023-11-27T20:43:52.748767+0000","last_peered":"2023-11-27T20:43:52.748767+0000","last_clean":"2023-11-27T20:43:52.748767+0000","last_became_active":"2023-11-27T20:43:52.744817+0000","last_became_peered":"2023-11-27T20:43:52.744817+0000","last_unstale":"2023-11-27T20:43:52.748767+0000","last_undegraded":"2023-11-27T20:43:52.748767+0000","last_fullsized":"2023-11-27T20:43:52.748767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:08:48.129616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757537+0000","last_change":"2023-11-27T20:43:52.737877+0000","last_active":"2023-11-27T20:43:52.757537+0000","last_peered":"2023-11-27T20:43:52.757537+0000","last_clean":"2023-11-27T20:43:52.757537+0000","last_became_active":"2023-11-27T20:43:52.737566+0000","last_became_peered":"2023-11-27T20:43:52.737566+0000","last_unstale":"2023-11-27T20:43:52.757537+0000","last_undegraded":"2023-11-27T20:43:52.757537+0000","last_fullsized":"2023-11-27T20:43:52.757537+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:22.440110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.742677+0000","last_change":"2023-11-27T20:43:52.738797+0000","last_active":"2023-11-27T20:43:52.742677+0000","last_peered":"2023-11-27T20:43:52.742677+0000","last_clean":"2023-11-27T20:43:52.742677+0000","last_became_active":"2023-11-27T20:43:52.738444+0000","last_became_peered":"2023-11-27T20:43:52.738444+0000","last_unstale":"2023-11-27T20:43:52.742677+0000","last_undegraded":"2023-11-27T20:43:52.742677+0000","last_fullsized":"2023-11-27T20:43:52.742677+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:56.115106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.755511+0000","last_change":"2023-11-27T20:43:52.742425+0000","last_active":"2023-11-27T20:43:52.755511+0000","last_peered":"2023-11-27T20:43:52.755511+0000","last_clean":"2023-11-27T20:43:52.755511+0000","last_became_active":"2023-11-27T20:43:52.741079+0000","last_became_peered":"2023-11-27T20:43:52.741079+0000","last_unstale":"2023-11-27T20:43:52.755511+0000","last_undegraded":"2023-11-27T20:43:52.755511+0000","last_fullsized":"2023-11-27T20:43:52.755511+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.754734+0000","last_change":"2023-11-27T20:43:52.749527+0000","last_active":"2023-11-27T20:43:52.754734+0000","last_peered":"2023-11-27T20:43:52.754734+0000","last_clean":"2023-11-27T20:43:52.754734+0000","last_became_active":"2023-11-27T20:43:52.749261+0000","last_became_peered":"2023-11-27T20:43:52.749261+0000","last_unstale":"2023-11-27T20:43:52.754734+0000","last_undegraded":"2023-11-27T20:43:52.754734+0000","last_fullsized":"2023-11-27T20:43:52.754734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:21.512849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.739937+0000","last_change":"2023-11-27T20:43:52.724633+0000","last_active":"2023-11-27T20:43:52.739937+0000","last_peered":"2023-11-27T20:43:52.739937+0000","last_clean":"2023-11-27T20:43:52.739937+0000","last_became_active":"2023-11-27T20:43:52.724319+0000","last_became_peered":"2023-11-27T20:43:52.724319+0000","last_unstale":"2023-11-27T20:43:52.739937+0000","last_undegraded":"2023-11-27T20:43:52.739937+0000","last_fullsized":"2023-11-27T20:43:52.739937+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:55.156190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.748220+0000","last_change":"2023-11-27T20:43:52.740239+0000","last_active":"2023-11-27T20:43:52.748220+0000","last_peered":"2023-11-27T20:43:52.748220+0000","last_clean":"2023-11-27T20:43:52.748220+0000","last_became_active":"2023-11-27T20:43:52.739953+0000","last_became_peered":"2023-11-27T20:43:52.739953+0000","last_unstale":"2023-11-27T20:43:52.748220+0000","last_undegraded":"2023-11-27T20:43:52.748220+0000","last_fullsized":"2023-11-27T20:43:52.748220+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:13:36.872593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.741380+0000","last_change":"2023-11-27T20:43:52.736636+0000","last_active":"2023-11-27T20:43:52.741380+0000","last_peered":"2023-11-27T20:43:52.741380+0000","last_clean":"2023-11-27T20:43:52.741380+0000","last_became_active":"2023-11-27T20:43:52.730532+0000","last_became_peered":"2023-11-27T20:43:52.730532+0000","last_unstale":"2023-11-27T20:43:52.741380+0000","last_undegraded":"2023-11-27T20:43:52.741380+0000","last_fullsized":"2023-11-27T20:43:52.741380+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:15.078720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.738245+0000","last_change":"2023-11-27T20:43:52.734813+0000","last_active":"2023-11-27T20:43:52.738245+0000","last_peered":"2023-11-27T20:43:52.738245+0000","last_clean":"2023-11-27T20:43:52.738245+0000","last_became_active":"2023-11-27T20:43:52.734472+0000","last_became_peered":"2023-11-27T20:43:52.734472+0000","last_unstale":"2023-11-27T20:43:52.738245+0000","last_undegraded":"2023-11-27T20:43:52.738245+0000","last_fullsized":"2023-11-27T20:43:52.738245+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.713015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.739736+0000","last_change":"2023-11-27T20:43:52.737259+0000","last_active":"2023-11-27T20:43:52.739736+0000","last_peered":"2023-11-27T20:43:52.739736+0000","last_clean":"2023-11-27T20:43:52.739736+0000","last_became_active":"2023-11-27T20:43:52.735819+0000","last_became_peered":"2023-11-27T20:43:52.735819+0000","last_unstale":"2023-11-27T20:43:52.739736+0000","last_undegraded":"2023-11-27T20:43:52.739736+0000","last_fullsized":"2023-11-27T20:43:52.739736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:04:53.640628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749683+0000","last_change":"2023-11-27T20:43:52.743966+0000","last_active":"2023-11-27T20:43:52.749683+0000","last_peered":"2023-11-27T20:43:52.749683+0000","last_clean":"2023-11-27T20:43:52.749683+0000","last_became_active":"2023-11-27T20:43:52.743629+0000","last_became_peered":"2023-11-27T20:43:52.743629+0000","last_unstale":"2023-11-27T20:43:52.749683+0000","last_undegraded":"2023-11-27T20:43:52.749683+0000","last_fullsized":"2023-11-27T20:43:52.749683+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:18:19.921000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757918+0000","last_change":"2023-11-27T20:43:52.745826+0000","last_active":"2023-11-27T20:43:52.757918+0000","last_peered":"2023-11-27T20:43:52.757918+0000","last_clean":"2023-11-27T20:43:52.757918+0000","last_became_active":"2023-11-27T20:43:52.745542+0000","last_became_peered":"2023-11-27T20:43:52.745542+0000","last_unstale":"2023-11-27T20:43:52.757918+0000","last_undegraded":"2023-11-27T20:43:52.757918+0000","last_fullsized":"2023-11-27T20:43:52.757918+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:09.361546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.739506+0000","last_change":"2023-11-27T20:43:52.722794+0000","last_active":"2023-11-27T20:43:52.739506+0000","last_peered":"2023-11-27T20:43:52.739506+0000","last_clean":"2023-11-27T20:43:52.739506+0000","last_became_active":"2023-11-27T20:43:52.722489+0000","last_became_peered":"2023-11-27T20:43:52.722489+0000","last_unstale":"2023-11-27T20:43:52.739506+0000","last_undegraded":"2023-11-27T20:43:52.739506+0000","last_fullsized":"2023-11-27T20:43:52.739506+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:54.288377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757083+0000","last_change":"2023-11-27T20:43:52.755856+0000","last_active":"2023-11-27T20:43:52.757083+0000","last_peered":"2023-11-27T20:43:52.757083+0000","last_clean":"2023-11-27T20:43:52.757083+0000","last_became_active":"2023-11-27T20:43:52.755447+0000","last_became_peered":"2023-11-27T20:43:52.755447+0000","last_unstale":"2023-11-27T20:43:52.757083+0000","last_undegraded":"2023-11-27T20:43:52.757083+0000","last_fullsized":"2023-11-27T20:43:52.757083+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:19.914604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745551+0000","last_change":"2023-11-27T20:43:52.743704+0000","last_active":"2023-11-27T20:43:52.745551+0000","last_peered":"2023-11-27T20:43:52.745551+0000","last_clean":"2023-11-27T20:43:52.745551+0000","last_became_active":"2023-11-27T20:43:52.743440+0000","last_became_peered":"2023-11-27T20:43:52.743440+0000","last_unstale":"2023-11-27T20:43:52.745551+0000","last_undegraded":"2023-11-27T20:43:52.745551+0000","last_fullsized":"2023-11-27T20:43:52.745551+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:08:26.832464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757803+0000","last_change":"2023-11-27T20:43:52.753806+0000","last_active":"2023-11-27T20:43:52.757803+0000","last_peered":"2023-11-27T20:43:52.757803+0000","last_clean":"2023-11-27T20:43:52.757803+0000","last_became_active":"2023-11-27T20:43:52.753119+0000","last_became_peered":"2023-11-27T20:43:52.753119+0000","last_unstale":"2023-11-27T20:43:52.757803+0000","last_undegraded":"2023-11-27T20:43:52.757803+0000","last_fullsized":"2023-11-27T20:43:52.757803+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745030+0000","last_change":"2023-11-27T20:43:52.738852+0000","last_active":"2023-11-27T20:43:52.745030+0000","last_peered":"2023-11-27T20:43:52.745030+0000","last_clean":"2023-11-27T20:43:52.745030+0000","last_became_active":"2023-11-27T20:43:52.738571+0000","last_became_peered":"2023-11-27T20:43:52.738571+0000","last_unstale":"2023-11-27T20:43:52.745030+0000","last_undegraded":"2023-11-27T20:43:52.745030+0000","last_fullsized":"2023-11-27T20:43:52.745030+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:16.298882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.744065+0000","last_change":"2023-11-27T20:43:52.734845+0000","last_active":"2023-11-27T20:43:52.744065+0000","last_peered":"2023-11-27T20:43:52.744065+0000","last_clean":"2023-11-27T20:43:52.744065+0000","last_became_active":"2023-11-27T20:43:52.734288+0000","last_became_peered":"2023-11-27T20:43:52.734288+0000","last_unstale":"2023-11-27T20:43:52.744065+0000","last_undegraded":"2023-11-27T20:43:52.744065+0000","last_fullsized":"2023-11-27T20:43:52.744065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745544+0000","last_change":"2023-11-27T20:43:52.741528+0000","last_active":"2023-11-27T20:43:52.745544+0000","last_peered":"2023-11-27T20:43:52.745544+0000","last_clean":"2023-11-27T20:43:52.745544+0000","last_became_active":"2023-11-27T20:43:52.741247+0000","last_became_peered":"2023-11-27T20:43:52.741247+0000","last_unstale":"2023-11-27T20:43:52.745544+0000","last_undegraded":"2023-11-27T20:43:52.745544+0000","last_fullsized":"2023-11-27T20:43:52.745544+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:06.257254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.751890+0000","last_change":"2023-11-27T20:43:52.749184+0000","last_active":"2023-11-27T20:43:52.751890+0000","last_peered":"2023-11-27T20:43:52.751890+0000","last_clean":"2023-11-27T20:43:52.751890+0000","last_became_active":"2023-11-27T20:43:52.747304+0000","last_became_peered":"2023-11-27T20:43:52.747304+0000","last_unstale":"2023-11-27T20:43:52.751890+0000","last_undegraded":"2023-11-27T20:43:52.751890+0000","last_fullsized":"2023-11-27T20:43:52.751890+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:26.493343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.748578+0000","last_change":"2023-11-27T20:43:52.746466+0000","last_active":"2023-11-27T20:43:52.748578+0000","last_peered":"2023-11-27T20:43:52.748578+0000","last_clean":"2023-11-27T20:43:52.748578+0000","last_became_active":"2023-11-27T20:43:52.746197+0000","last_became_peered":"2023-11-27T20:43:52.746197+0000","last_unstale":"2023-11-27T20:43:52.748578+0000","last_undegraded":"2023-11-27T20:43:52.748578+0000","last_fullsized":"2023-11-27T20:43:52.748578+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:04:26.417281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.747117+0000","last_change":"2023-11-27T20:43:52.739506+0000","last_active":"2023-11-27T20:43:52.747117+0000","last_peered":"2023-11-27T20:43:52.747117+0000","last_clean":"2023-11-27T20:43:52.747117+0000","last_became_active":"2023-11-27T20:43:52.739234+0000","last_became_peered":"2023-11-27T20:43:52.739234+0000","last_unstale":"2023-11-27T20:43:52.747117+0000","last_undegraded":"2023-11-27T20:43:52.747117+0000","last_fullsized":"2023-11-27T20:43:52.747117+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:16.298882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.761772+0000","last_change":"2023-11-27T20:43:52.758309+0000","last_active":"2023-11-27T20:43:52.761772+0000","last_peered":"2023-11-27T20:43:52.761772+0000","last_clean":"2023-11-27T20:43:52.761772+0000","last_became_active":"2023-11-27T20:43:52.755787+0000","last_became_peered":"2023-11-27T20:43:52.755787+0000","last_unstale":"2023-11-27T20:43:52.761772+0000","last_undegraded":"2023-11-27T20:43:52.761772+0000","last_fullsized":"2023-11-27T20:43:52.761772+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.747286+0000","last_change":"2023-11-27T20:43:52.743954+0000","last_active":"2023-11-27T20:43:52.747286+0000","last_peered":"2023-11-27T20:43:52.747286+0000","last_clean":"2023-11-27T20:43:52.747286+0000","last_became_active":"2023-11-27T20:43:52.743696+0000","last_became_peered":"2023-11-27T20:43:52.743696+0000","last_unstale":"2023-11-27T20:43:52.747286+0000","last_undegraded":"2023-11-27T20:43:52.747286+0000","last_fullsized":"2023-11-27T20:43:52.747286+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:23.796379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749978+0000","last_change":"2023-11-27T20:43:52.740150+0000","last_active":"2023-11-27T20:43:52.749978+0000","last_peered":"2023-11-27T20:43:52.749978+0000","last_clean":"2023-11-27T20:43:52.749978+0000","last_became_active":"2023-11-27T20:43:52.735557+0000","last_became_peered":"2023-11-27T20:43:52.735557+0000","last_unstale":"2023-11-27T20:43:52.749978+0000","last_undegraded":"2023-11-27T20:43:52.749978+0000","last_fullsized":"2023-11-27T20:43:52.749978+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.747290+0000","last_change":"2023-11-27T20:43:52.743341+0000","last_active":"2023-11-27T20:43:52.747290+0000","last_peered":"2023-11-27T20:43:52.747290+0000","last_clean":"2023-11-27T20:43:52.747290+0000","last_became_active":"2023-11-27T20:43:52.742947+0000","last_became_peered":"2023-11-27T20:43:52.742947+0000","last_unstale":"2023-11-27T20:43:52.747290+0000","last_undegraded":"2023-11-27T20:43:52.747290+0000","last_fullsized":"2023-11-27T20:43:52.747290+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:42.590467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.751527+0000","last_change":"2023-11-27T20:43:52.746463+0000","last_active":"2023-11-27T20:43:52.751527+0000","last_peered":"2023-11-27T20:43:52.751527+0000","last_clean":"2023-11-27T20:43:52.751527+0000","last_became_active":"2023-11-27T20:43:52.746028+0000","last_became_peered":"2023-11-27T20:43:52.746028+0000","last_unstale":"2023-11-27T20:43:52.751527+0000","last_undegraded":"2023-11-27T20:43:52.751527+0000","last_fullsized":"2023-11-27T20:43:52.751527+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:35.468352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.761611+0000","last_change":"2023-11-27T20:43:52.757800+0000","last_active":"2023-11-27T20:43:52.761611+0000","last_peered":"2023-11-27T20:43:52.761611+0000","last_clean":"2023-11-27T20:43:52.761611+0000","last_became_active":"2023-11-27T20:43:52.755994+0000","last_became_peered":"2023-11-27T20:43:52.755994+0000","last_unstale":"2023-11-27T20:43:52.761611+0000","last_undegraded":"2023-11-27T20:43:52.761611+0000","last_fullsized":"2023-11-27T20:43:52.761611+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:28.943589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.758969+0000","last_change":"2023-11-27T20:43:52.755932+0000","last_active":"2023-11-27T20:43:52.758969+0000","last_peered":"2023-11-27T20:43:52.758969+0000","last_clean":"2023-11-27T20:43:52.758969+0000","last_became_active":"2023-11-27T20:43:52.751888+0000","last_became_peered":"2023-11-27T20:43:52.751888+0000","last_unstale":"2023-11-27T20:43:52.758969+0000","last_undegraded":"2023-11-27T20:43:52.758969+0000","last_fullsized":"2023-11-27T20:43:52.758969+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:19.914604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.756816+0000","last_change":"2023-11-27T20:43:51.704982+0000","last_active":"2023-11-27T20:43:52.756816+0000","last_peered":"2023-11-27T20:43:52.756816+0000","last_clean":"2023-11-27T20:43:52.756816+0000","last_became_active":"2023-11-27T20:43:51.703346+0000","last_became_peered":"2023-11-27T20:43:51.703346+0000","last_unstale":"2023-11-27T20:43:52.756816+0000","last_undegraded":"2023-11-27T20:43:52.756816+0000","last_fullsized":"2023-11-27T20:43:52.756816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:53.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745236+0000","last_change":"2023-11-27T20:43:52.736197+0000","last_active":"2023-11-27T20:43:52.745236+0000","last_peered":"2023-11-27T20:43:52.745236+0000","last_clean":"2023-11-27T20:43:52.745236+0000","last_became_active":"2023-11-27T20:43:52.735889+0000","last_became_peered":"2023-11-27T20:43:52.735889+0000","last_unstale":"2023-11-27T20:43:52.745236+0000","last_undegraded":"2023-11-27T20:43:52.745236+0000","last_fullsized":"2023-11-27T20:43:52.745236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:42.684238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745411+0000","last_change":"2023-11-27T20:43:51.711368+0000","last_active":"2023-11-27T20:43:52.745411+0000","last_peered":"2023-11-27T20:43:52.745411+0000","last_clean":"2023-11-27T20:43:52.745411+0000","last_became_active":"2023-11-27T20:43:51.711087+0000","last_became_peered":"2023-11-27T20:43:51.711087+0000","last_unstale":"2023-11-27T20:43:52.745411+0000","last_undegraded":"2023-11-27T20:43:52.745411+0000","last_fullsized":"2023-11-27T20:43:52.745411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:54.352803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.764716+0000","last_change":"2023-11-27T20:43:52.759667+0000","last_active":"2023-11-27T20:43:52.764716+0000","last_peered":"2023-11-27T20:43:52.764716+0000","last_clean":"2023-11-27T20:43:52.764716+0000","last_became_active":"2023-11-27T20:43:52.759386+0000","last_became_peered":"2023-11-27T20:43:52.759386+0000","last_unstale":"2023-11-27T20:43:52.764716+0000","last_undegraded":"2023-11-27T20:43:52.764716+0000","last_fullsized":"2023-11-27T20:43:52.764716+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.758770+0000","last_change":"2023-11-27T20:43:51.699372+0000","last_active":"2023-11-27T20:43:52.758770+0000","last_peered":"2023-11-27T20:43:52.758770+0000","last_clean":"2023-11-27T20:43:52.758770+0000","last_became_active":"2023-11-27T20:43:51.698989+0000","last_became_peered":"2023-11-27T20:43:51.698989+0000","last_unstale":"2023-11-27T20:43:52.758770+0000","last_undegraded":"2023-11-27T20:43:52.758770+0000","last_fullsized":"2023-11-27T20:43:52.758770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:29.612413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.758397+0000","last_change":"2023-11-27T20:43:52.746554+0000","last_active":"2023-11-27T20:43:52.758397+0000","last_peered":"2023-11-27T20:43:52.758397+0000","last_clean":"2023-11-27T20:43:52.758397+0000","last_became_active":"2023-11-27T20:43:52.746133+0000","last_became_peered":"2023-11-27T20:43:52.746133+0000","last_unstale":"2023-11-27T20:43:52.758397+0000","last_undegraded":"2023-11-27T20:43:52.758397+0000","last_fullsized":"2023-11-27T20:43:52.758397+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:16.298882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.755010+0000","last_change":"2023-11-27T20:43:51.707254+0000","last_active":"2023-11-27T20:43:52.755010+0000","last_peered":"2023-11-27T20:43:52.755010+0000","last_clean":"2023-11-27T20:43:52.755010+0000","last_became_active":"2023-11-27T20:43:51.706908+0000","last_became_peered":"2023-11-27T20:43:51.706908+0000","last_unstale":"2023-11-27T20:43:52.755010+0000","last_undegraded":"2023-11-27T20:43:52.755010+0000","last_fullsized":"2023-11-27T20:43:52.755010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:04.233780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.744042+0000","last_change":"2023-11-27T20:43:52.734666+0000","last_active":"2023-11-27T20:43:52.744042+0000","last_peered":"2023-11-27T20:43:52.744042+0000","last_clean":"2023-11-27T20:43:52.744042+0000","last_became_active":"2023-11-27T20:43:52.733983+0000","last_became_peered":"2023-11-27T20:43:52.733983+0000","last_unstale":"2023-11-27T20:43:52.744042+0000","last_undegraded":"2023-11-27T20:43:52.744042+0000","last_fullsized":"2023-11-27T20:43:52.744042+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749812+0000","last_change":"2023-11-27T20:43:51.711467+0000","last_active":"2023-11-27T20:43:52.749812+0000","last_peered":"2023-11-27T20:43:52.749812+0000","last_clean":"2023-11-27T20:43:52.749812+0000","last_became_active":"2023-11-27T20:43:51.711141+0000","last_became_peered":"2023-11-27T20:43:51.711141+0000","last_unstale":"2023-11-27T20:43:52.749812+0000","last_undegraded":"2023-11-27T20:43:52.749812+0000","last_fullsized":"2023-11-27T20:43:52.749812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:14.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.750010+0000","last_change":"2023-11-27T20:43:52.740355+0000","last_active":"2023-11-27T20:43:52.750010+0000","last_peered":"2023-11-27T20:43:52.750010+0000","last_clean":"2023-11-27T20:43:52.750010+0000","last_became_active":"2023-11-27T20:43:52.739879+0000","last_became_peered":"2023-11-27T20:43:52.739879+0000","last_unstale":"2023-11-27T20:43:52.750010+0000","last_undegraded":"2023-11-27T20:43:52.750010+0000","last_fullsized":"2023-11-27T20:43:52.750010+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.751744+0000","last_change":"2023-11-27T20:43:51.701819+0000","last_active":"2023-11-27T20:43:52.751744+0000","last_peered":"2023-11-27T20:43:52.751744+0000","last_clean":"2023-11-27T20:43:52.751744+0000","last_became_active":"2023-11-27T20:43:51.701542+0000","last_became_peered":"2023-11-27T20:43:51.701542+0000","last_unstale":"2023-11-27T20:43:52.751744+0000","last_undegraded":"2023-11-27T20:43:52.751744+0000","last_fullsized":"2023-11-27T20:43:52.751744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:53.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.739721+0000","last_change":"2023-11-27T20:43:52.735677+0000","last_active":"2023-11-27T20:43:52.739721+0000","last_peered":"2023-11-27T20:43:52.739721+0000","last_clean":"2023-11-27T20:43:52.739721+0000","last_became_active":"2023-11-27T20:43:52.734624+0000","last_became_peered":"2023-11-27T20:43:52.734624+0000","last_unstale":"2023-11-27T20:43:52.739721+0000","last_undegraded":"2023-11-27T20:43:52.739721+0000","last_fullsized":"2023-11-27T20:43:52.739721+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:11.250665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.713544+0000","last_change":"2023-11-27T20:43:51.706490+0000","last_active":"2023-11-27T20:43:52.713544+0000","last_peered":"2023-11-27T20:43:52.713544+0000","last_clean":"2023-11-27T20:43:52.713544+0000","last_became_active":"2023-11-27T20:43:51.706181+0000","last_became_peered":"2023-11-27T20:43:51.706181+0000","last_unstale":"2023-11-27T20:43:52.713544+0000","last_undegraded":"2023-11-27T20:43:52.713544+0000","last_fullsized":"2023-11-27T20:43:52.713544+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:41.580304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.738465+0000","last_change":"2023-11-27T20:43:52.732611+0000","last_active":"2023-11-27T20:43:52.738465+0000","last_peered":"2023-11-27T20:43:52.738465+0000","last_clean":"2023-11-27T20:43:52.738465+0000","last_became_active":"2023-11-27T20:43:52.732338+0000","last_became_peered":"2023-11-27T20:43:52.732338+0000","last_unstale":"2023-11-27T20:43:52.738465+0000","last_undegraded":"2023-11-27T20:43:52.738465+0000","last_fullsized":"2023-11-27T20:43:52.738465+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:28.943589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.731414+0000","last_change":"2023-11-27T20:43:51.712506+0000","last_active":"2023-11-27T20:43:52.731414+0000","last_peered":"2023-11-27T20:43:52.731414+0000","last_clean":"2023-11-27T20:43:52.731414+0000","last_became_active":"2023-11-27T20:43:51.712167+0000","last_became_peered":"2023-11-27T20:43:51.712167+0000","last_unstale":"2023-11-27T20:43:52.731414+0000","last_undegraded":"2023-11-27T20:43:52.731414+0000","last_fullsized":"2023-11-27T20:43:52.731414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:20.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.748624+0000","last_change":"2023-11-27T20:43:52.743697+0000","last_active":"2023-11-27T20:43:52.748624+0000","last_peered":"2023-11-27T20:43:52.748624+0000","last_clean":"2023-11-27T20:43:52.748624+0000","last_became_active":"2023-11-27T20:43:52.743405+0000","last_became_peered":"2023-11-27T20:43:52.743405+0000","last_unstale":"2023-11-27T20:43:52.748624+0000","last_undegraded":"2023-11-27T20:43:52.748624+0000","last_fullsized":"2023-11-27T20:43:52.748624+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:56:31.278989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.729329+0000","last_change":"2023-11-27T20:43:51.716942+0000","last_active":"2023-11-27T20:43:52.729329+0000","last_peered":"2023-11-27T20:43:52.729329+0000","last_clean":"2023-11-27T20:43:52.729329+0000","last_became_active":"2023-11-27T20:43:51.716549+0000","last_became_peered":"2023-11-27T20:43:51.716549+0000","last_unstale":"2023-11-27T20:43:52.729329+0000","last_undegraded":"2023-11-27T20:43:52.729329+0000","last_fullsized":"2023-11-27T20:43:52.729329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.752835+0000","last_change":"2023-11-27T20:43:52.747269+0000","last_active":"2023-11-27T20:43:52.752835+0000","last_peered":"2023-11-27T20:43:52.752835+0000","last_clean":"2023-11-27T20:43:52.752835+0000","last_became_active":"2023-11-27T20:43:52.746473+0000","last_became_peered":"2023-11-27T20:43:52.746473+0000","last_unstale":"2023-11-27T20:43:52.752835+0000","last_undegraded":"2023-11-27T20:43:52.752835+0000","last_fullsized":"2023-11-27T20:43:52.752835+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:54.865083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.722089+0000","last_change":"2023-11-27T20:43:51.711346+0000","last_active":"2023-11-27T20:43:52.722089+0000","last_peered":"2023-11-27T20:43:52.722089+0000","last_clean":"2023-11-27T20:43:52.722089+0000","last_became_active":"2023-11-27T20:43:51.711060+0000","last_became_peered":"2023-11-27T20:43:51.711060+0000","last_unstale":"2023-11-27T20:43:52.722089+0000","last_undegraded":"2023-11-27T20:43:52.722089+0000","last_fullsized":"2023-11-27T20:43:52.722089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:18.330525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745870+0000","last_change":"2023-11-27T20:43:52.738413+0000","last_active":"2023-11-27T20:43:52.745870+0000","last_peered":"2023-11-27T20:43:52.745870+0000","last_clean":"2023-11-27T20:43:52.745870+0000","last_became_active":"2023-11-27T20:43:52.738105+0000","last_became_peered":"2023-11-27T20:43:52.738105+0000","last_unstale":"2023-11-27T20:43:52.745870+0000","last_undegraded":"2023-11-27T20:43:52.745870+0000","last_fullsized":"2023-11-27T20:43:52.745870+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.713015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.756966+0000","last_change":"2023-11-27T20:43:51.716907+0000","last_active":"2023-11-27T20:43:52.756966+0000","last_peered":"2023-11-27T20:43:52.756966+0000","last_clean":"2023-11-27T20:43:52.756966+0000","last_became_active":"2023-11-27T20:43:51.716616+0000","last_became_peered":"2023-11-27T20:43:51.716616+0000","last_unstale":"2023-11-27T20:43:52.756966+0000","last_undegraded":"2023-11-27T20:43:52.756966+0000","last_fullsized":"2023-11-27T20:43:52.756966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749632+0000","last_change":"2023-11-27T20:43:52.740853+0000","last_active":"2023-11-27T20:43:52.749632+0000","last_peered":"2023-11-27T20:43:52.749632+0000","last_clean":"2023-11-27T20:43:52.749632+0000","last_became_active":"2023-11-27T20:43:52.740468+0000","last_became_peered":"2023-11-27T20:43:52.740468+0000","last_unstale":"2023-11-27T20:43:52.749632+0000","last_undegraded":"2023-11-27T20:43:52.749632+0000","last_fullsized":"2023-11-27T20:43:52.749632+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:23.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.764884+0000","last_change":"2023-11-27T20:43:51.711651+0000","last_active":"2023-11-27T20:43:52.764884+0000","last_peered":"2023-11-27T20:43:52.764884+0000","last_clean":"2023-11-27T20:43:52.764884+0000","last_became_active":"2023-11-27T20:43:51.711270+0000","last_became_peered":"2023-11-27T20:43:51.711270+0000","last_unstale":"2023-11-27T20:43:52.764884+0000","last_undegraded":"2023-11-27T20:43:52.764884+0000","last_fullsized":"2023-11-27T20:43:52.764884+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:07.560276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.740034+0000","last_change":"2023-11-27T20:43:52.731258+0000","last_active":"2023-11-27T20:43:52.740034+0000","last_peered":"2023-11-27T20:43:52.740034+0000","last_clean":"2023-11-27T20:43:52.740034+0000","last_became_active":"2023-11-27T20:43:52.730701+0000","last_became_peered":"2023-11-27T20:43:52.730701+0000","last_unstale":"2023-11-27T20:43:52.740034+0000","last_undegraded":"2023-11-27T20:43:52.740034+0000","last_fullsized":"2023-11-27T20:43:52.740034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:17.775804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757293+0000","last_change":"2023-11-27T20:43:51.709141+0000","last_active":"2023-11-27T20:43:52.757293+0000","last_peered":"2023-11-27T20:43:52.757293+0000","last_clean":"2023-11-27T20:43:52.757293+0000","last_became_active":"2023-11-27T20:43:51.708864+0000","last_became_peered":"2023-11-27T20:43:51.708864+0000","last_unstale":"2023-11-27T20:43:52.757293+0000","last_undegraded":"2023-11-27T20:43:52.757293+0000","last_fullsized":"2023-11-27T20:43:52.757293+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:29.585661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.744129+0000","last_change":"2023-11-27T20:43:52.736912+0000","last_active":"2023-11-27T20:43:52.744129+0000","last_peered":"2023-11-27T20:43:52.744129+0000","last_clean":"2023-11-27T20:43:52.744129+0000","last_became_active":"2023-11-27T20:43:52.735675+0000","last_became_peered":"2023-11-27T20:43:52.735675+0000","last_unstale":"2023-11-27T20:43:52.744129+0000","last_undegraded":"2023-11-27T20:43:52.744129+0000","last_fullsized":"2023-11-27T20:43:52.744129+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.707822+0000","last_change":"2023-11-27T20:43:51.711938+0000","last_active":"2023-11-27T20:43:52.707822+0000","last_peered":"2023-11-27T20:43:52.707822+0000","last_clean":"2023-11-27T20:43:52.707822+0000","last_became_active":"2023-11-27T20:43:51.711617+0000","last_became_peered":"2023-11-27T20:43:51.711617+0000","last_unstale":"2023-11-27T20:43:52.707822+0000","last_undegraded":"2023-11-27T20:43:52.707822+0000","last_fullsized":"2023-11-27T20:43:52.707822+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:54.146026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.748799+0000","last_change":"2023-11-27T20:43:52.742672+0000","last_active":"2023-11-27T20:43:52.748799+0000","last_peered":"2023-11-27T20:43:52.748799+0000","last_clean":"2023-11-27T20:43:52.748799+0000","last_became_active":"2023-11-27T20:43:52.742066+0000","last_became_peered":"2023-11-27T20:43:52.742066+0000","last_unstale":"2023-11-27T20:43:52.748799+0000","last_undegraded":"2023-11-27T20:43:52.748799+0000","last_fullsized":"2023-11-27T20:43:52.748799+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:46.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.713811+0000","last_change":"2023-11-27T20:43:51.711077+0000","last_active":"2023-11-27T20:43:52.713811+0000","last_peered":"2023-11-27T20:43:52.713811+0000","last_clean":"2023-11-27T20:43:52.713811+0000","last_became_active":"2023-11-27T20:43:51.710820+0000","last_became_peered":"2023-11-27T20:43:51.710820+0000","last_unstale":"2023-11-27T20:43:52.713811+0000","last_undegraded":"2023-11-27T20:43:52.713811+0000","last_fullsized":"2023-11-27T20:43:52.713811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:21.429946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745567+0000","last_change":"2023-11-27T20:43:52.742494+0000","last_active":"2023-11-27T20:43:52.745567+0000","last_peered":"2023-11-27T20:43:52.745567+0000","last_clean":"2023-11-27T20:43:52.745567+0000","last_became_active":"2023-11-27T20:43:52.742174+0000","last_became_peered":"2023-11-27T20:43:52.742174+0000","last_unstale":"2023-11-27T20:43:52.745567+0000","last_undegraded":"2023-11-27T20:43:52.745567+0000","last_fullsized":"2023-11-27T20:43:52.745567+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:01.982839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.756166+0000","last_change":"2023-11-27T20:43:51.714679+0000","last_active":"2023-11-27T20:43:52.756166+0000","last_peered":"2023-11-27T20:43:52.756166+0000","last_clean":"2023-11-27T20:43:52.756166+0000","last_became_active":"2023-11-27T20:43:51.714406+0000","last_became_peered":"2023-11-27T20:43:51.714406+0000","last_unstale":"2023-11-27T20:43:52.756166+0000","last_undegraded":"2023-11-27T20:43:52.756166+0000","last_fullsized":"2023-11-27T20:43:52.756166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:27.933426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.746469+0000","last_change":"2023-11-27T20:43:52.743633+0000","last_active":"2023-11-27T20:43:52.746469+0000","last_peered":"2023-11-27T20:43:52.746469+0000","last_clean":"2023-11-27T20:43:52.746469+0000","last_became_active":"2023-11-27T20:43:52.743243+0000","last_became_peered":"2023-11-27T20:43:52.743243+0000","last_unstale":"2023-11-27T20:43:52.746469+0000","last_undegraded":"2023-11-27T20:43:52.746469+0000","last_fullsized":"2023-11-27T20:43:52.746469+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:05.243944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.756494+0000","last_change":"2023-11-27T20:43:51.714371+0000","last_active":"2023-11-27T20:43:52.756494+0000","last_peered":"2023-11-27T20:43:52.756494+0000","last_clean":"2023-11-27T20:43:52.756494+0000","last_became_active":"2023-11-27T20:43:51.714034+0000","last_became_peered":"2023-11-27T20:43:51.714034+0000","last_unstale":"2023-11-27T20:43:52.756494+0000","last_undegraded":"2023-11-27T20:43:52.756494+0000","last_fullsized":"2023-11-27T20:43:52.756494+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.746556+0000","last_change":"2023-11-27T20:43:52.741261+0000","last_active":"2023-11-27T20:43:52.746556+0000","last_peered":"2023-11-27T20:43:52.746556+0000","last_clean":"2023-11-27T20:43:52.746556+0000","last_became_active":"2023-11-27T20:43:52.740962+0000","last_became_peered":"2023-11-27T20:43:52.740962+0000","last_unstale":"2023-11-27T20:43:52.746556+0000","last_undegraded":"2023-11-27T20:43:52.746556+0000","last_fullsized":"2023-11-27T20:43:52.746556+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:06.257254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.758116+0000","last_change":"2023-11-27T20:43:51.708347+0000","last_active":"2023-11-27T20:43:52.758116+0000","last_peered":"2023-11-27T20:43:52.758116+0000","last_clean":"2023-11-27T20:43:52.758116+0000","last_became_active":"2023-11-27T20:43:51.707976+0000","last_became_peered":"2023-11-27T20:43:51.707976+0000","last_unstale":"2023-11-27T20:43:52.758116+0000","last_undegraded":"2023-11-27T20:43:52.758116+0000","last_fullsized":"2023-11-27T20:43:52.758116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.753356+0000","last_change":"2023-11-27T20:43:52.740074+0000","last_active":"2023-11-27T20:43:52.753356+0000","last_peered":"2023-11-27T20:43:52.753356+0000","last_clean":"2023-11-27T20:43:52.753356+0000","last_became_active":"2023-11-27T20:43:52.739760+0000","last_became_peered":"2023-11-27T20:43:52.739760+0000","last_unstale":"2023-11-27T20:43:52.753356+0000","last_undegraded":"2023-11-27T20:43:52.753356+0000","last_fullsized":"2023-11-27T20:43:52.753356+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.755078+0000","last_change":"2023-11-27T20:43:51.707359+0000","last_active":"2023-11-27T20:43:52.755078+0000","last_peered":"2023-11-27T20:43:52.755078+0000","last_clean":"2023-11-27T20:43:52.755078+0000","last_became_active":"2023-11-27T20:43:51.707036+0000","last_became_peered":"2023-11-27T20:43:51.707036+0000","last_unstale":"2023-11-27T20:43:52.755078+0000","last_undegraded":"2023-11-27T20:43:52.755078+0000","last_fullsized":"2023-11-27T20:43:52.755078+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.753721+0000","last_change":"2023-11-27T20:43:52.749840+0000","last_active":"2023-11-27T20:43:52.753721+0000","last_peered":"2023-11-27T20:43:52.753721+0000","last_clean":"2023-11-27T20:43:52.753721+0000","last_became_active":"2023-11-27T20:43:52.749390+0000","last_became_peered":"2023-11-27T20:43:52.749390+0000","last_unstale":"2023-11-27T20:43:52.753721+0000","last_undegraded":"2023-11-27T20:43:52.753721+0000","last_fullsized":"2023-11-27T20:43:52.753721+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:54.288377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.744707+0000","last_change":"2023-11-27T20:43:51.704467+0000","last_active":"2023-11-27T20:43:52.744707+0000","last_peered":"2023-11-27T20:43:52.744707+0000","last_clean":"2023-11-27T20:43:52.744707+0000","last_became_active":"2023-11-27T20:43:51.704172+0000","last_became_peered":"2023-11-27T20:43:51.704172+0000","last_unstale":"2023-11-27T20:43:52.744707+0000","last_undegraded":"2023-11-27T20:43:52.744707+0000","last_fullsized":"2023-11-27T20:43:52.744707+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:44.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.740012+0000","last_change":"2023-11-27T20:43:52.730278+0000","last_active":"2023-11-27T20:43:52.740012+0000","last_peered":"2023-11-27T20:43:52.740012+0000","last_clean":"2023-11-27T20:43:52.740012+0000","last_became_active":"2023-11-27T20:43:52.729894+0000","last_became_peered":"2023-11-27T20:43:52.729894+0000","last_unstale":"2023-11-27T20:43:52.740012+0000","last_undegraded":"2023-11-27T20:43:52.740012+0000","last_fullsized":"2023-11-27T20:43:52.740012+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:54.865083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.755732+0000","last_change":"2023-11-27T20:43:51.709579+0000","last_active":"2023-11-27T20:43:52.755732+0000","last_peered":"2023-11-27T20:43:52.755732+0000","last_clean":"2023-11-27T20:43:52.755732+0000","last_became_active":"2023-11-27T20:43:51.709194+0000","last_became_peered":"2023-11-27T20:43:51.709194+0000","last_unstale":"2023-11-27T20:43:52.755732+0000","last_undegraded":"2023-11-27T20:43:52.755732+0000","last_fullsized":"2023-11-27T20:43:52.755732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:01.414182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757597+0000","last_change":"2023-11-27T20:43:52.750078+0000","last_active":"2023-11-27T20:43:52.757597+0000","last_peered":"2023-11-27T20:43:52.757597+0000","last_clean":"2023-11-27T20:43:52.757597+0000","last_became_active":"2023-11-27T20:43:52.749770+0000","last_became_peered":"2023-11-27T20:43:52.749770+0000","last_unstale":"2023-11-27T20:43:52.757597+0000","last_undegraded":"2023-11-27T20:43:52.757597+0000","last_fullsized":"2023-11-27T20:43:52.757597+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.705294+0000","last_change":"2023-11-27T20:43:51.708599+0000","last_active":"2023-11-27T20:43:52.705294+0000","last_peered":"2023-11-27T20:43:52.705294+0000","last_clean":"2023-11-27T20:43:52.705294+0000","last_became_active":"2023-11-27T20:43:51.708311+0000","last_became_peered":"2023-11-27T20:43:51.708311+0000","last_unstale":"2023-11-27T20:43:52.705294+0000","last_undegraded":"2023-11-27T20:43:52.705294+0000","last_fullsized":"2023-11-27T20:43:52.705294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:39.603520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757884+0000","last_change":"2023-11-27T20:43:52.745035+0000","last_active":"2023-11-27T20:43:52.757884+0000","last_peered":"2023-11-27T20:43:52.757884+0000","last_clean":"2023-11-27T20:43:52.757884+0000","last_became_active":"2023-11-27T20:43:52.744540+0000","last_became_peered":"2023-11-27T20:43:52.744540+0000","last_unstale":"2023-11-27T20:43:52.757884+0000","last_undegraded":"2023-11-27T20:43:52.757884+0000","last_fullsized":"2023-11-27T20:43:52.757884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:05.243944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.713068+0000","last_change":"2023-11-27T20:43:51.703755+0000","last_active":"2023-11-27T20:43:52.713068+0000","last_peered":"2023-11-27T20:43:52.713068+0000","last_clean":"2023-11-27T20:43:52.713068+0000","last_became_active":"2023-11-27T20:43:51.700051+0000","last_became_peered":"2023-11-27T20:43:51.700051+0000","last_unstale":"2023-11-27T20:43:52.713068+0000","last_undegraded":"2023-11-27T20:43:52.713068+0000","last_fullsized":"2023-11-27T20:43:52.713068+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:00.972675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.742456+0000","last_change":"2023-11-27T20:43:52.735455+0000","last_active":"2023-11-27T20:43:52.742456+0000","last_peered":"2023-11-27T20:43:52.742456+0000","last_clean":"2023-11-27T20:43:52.742456+0000","last_became_active":"2023-11-27T20:43:52.735128+0000","last_became_peered":"2023-11-27T20:43:52.735128+0000","last_unstale":"2023-11-27T20:43:52.742456+0000","last_undegraded":"2023-11-27T20:43:52.742456+0000","last_fullsized":"2023-11-27T20:43:52.742456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.761871+0000","last_change":"2023-11-27T20:43:51.711208+0000","last_active":"2023-11-27T20:43:52.761871+0000","last_peered":"2023-11-27T20:43:52.761871+0000","last_clean":"2023-11-27T20:43:52.761871+0000","last_became_active":"2023-11-27T20:43:51.710936+0000","last_became_peered":"2023-11-27T20:43:51.710936+0000","last_unstale":"2023-11-27T20:43:52.761871+0000","last_undegraded":"2023-11-27T20:43:52.761871+0000","last_fullsized":"2023-11-27T20:43:52.761871+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:20.570705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.746533+0000","last_change":"2023-11-27T20:43:52.739121+0000","last_active":"2023-11-27T20:43:52.746533+0000","last_peered":"2023-11-27T20:43:52.746533+0000","last_clean":"2023-11-27T20:43:52.746533+0000","last_became_active":"2023-11-27T20:43:52.738758+0000","last_became_peered":"2023-11-27T20:43:52.738758+0000","last_unstale":"2023-11-27T20:43:52.746533+0000","last_undegraded":"2023-11-27T20:43:52.746533+0000","last_fullsized":"2023-11-27T20:43:52.746533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:17.887527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.733558+0000","last_change":"2023-11-27T20:43:51.703349+0000","last_active":"2023-11-27T20:43:52.733558+0000","last_peered":"2023-11-27T20:43:52.733558+0000","last_clean":"2023-11-27T20:43:52.733558+0000","last_became_active":"2023-11-27T20:43:51.703049+0000","last_became_peered":"2023-11-27T20:43:51.703049+0000","last_unstale":"2023-11-27T20:43:52.733558+0000","last_undegraded":"2023-11-27T20:43:52.733558+0000","last_fullsized":"2023-11-27T20:43:52.733558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.745662+0000","last_change":"2023-11-27T20:43:52.738313+0000","last_active":"2023-11-27T20:43:52.745662+0000","last_peered":"2023-11-27T20:43:52.745662+0000","last_clean":"2023-11-27T20:43:52.745662+0000","last_became_active":"2023-11-27T20:43:52.738011+0000","last_became_peered":"2023-11-27T20:43:52.738011+0000","last_unstale":"2023-11-27T20:43:52.745662+0000","last_undegraded":"2023-11-27T20:43:52.745662+0000","last_fullsized":"2023-11-27T20:43:52.745662+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:31:26.493343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.708567+0000","last_change":"2023-11-27T20:43:51.711343+0000","last_active":"2023-11-27T20:43:52.708567+0000","last_peered":"2023-11-27T20:43:52.708567+0000","last_clean":"2023-11-27T20:43:52.708567+0000","last_became_active":"2023-11-27T20:43:51.708458+0000","last_became_peered":"2023-11-27T20:43:51.708458+0000","last_unstale":"2023-11-27T20:43:52.708567+0000","last_undegraded":"2023-11-27T20:43:52.708567+0000","last_fullsized":"2023-11-27T20:43:52.708567+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:41.674074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.758378+0000","last_change":"2023-11-27T20:43:52.746396+0000","last_active":"2023-11-27T20:43:52.758378+0000","last_peered":"2023-11-27T20:43:52.758378+0000","last_clean":"2023-11-27T20:43:52.758378+0000","last_became_active":"2023-11-27T20:43:52.745787+0000","last_became_peered":"2023-11-27T20:43:52.745787+0000","last_unstale":"2023-11-27T20:43:52.758378+0000","last_undegraded":"2023-11-27T20:43:52.758378+0000","last_fullsized":"2023-11-27T20:43:52.758378+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:42.590467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.717114+0000","last_change":"2023-11-27T20:43:51.711230+0000","last_active":"2023-11-27T20:43:52.717114+0000","last_peered":"2023-11-27T20:43:52.717114+0000","last_clean":"2023-11-27T20:43:52.717114+0000","last_became_active":"2023-11-27T20:43:51.709149+0000","last_became_peered":"2023-11-27T20:43:51.709149+0000","last_unstale":"2023-11-27T20:43:52.717114+0000","last_undegraded":"2023-11-27T20:43:52.717114+0000","last_fullsized":"2023-11-27T20:43:52.717114+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:18.904440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.749888+0000","last_change":"2023-11-27T20:43:52.740586+0000","last_active":"2023-11-27T20:43:52.749888+0000","last_peered":"2023-11-27T20:43:52.749888+0000","last_clean":"2023-11-27T20:43:52.749888+0000","last_became_active":"2023-11-27T20:43:52.739765+0000","last_became_peered":"2023-11-27T20:43:52.739765+0000","last_unstale":"2023-11-27T20:43:52.749888+0000","last_undegraded":"2023-11-27T20:43:52.749888+0000","last_fullsized":"2023-11-27T20:43:52.749888+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.705438+0000","last_change":"2023-11-27T20:43:51.701630+0000","last_active":"2023-11-27T20:43:52.705438+0000","last_peered":"2023-11-27T20:43:52.705438+0000","last_clean":"2023-11-27T20:43:52.705438+0000","last_became_active":"2023-11-27T20:43:51.701326+0000","last_became_peered":"2023-11-27T20:43:51.701326+0000","last_unstale":"2023-11-27T20:43:52.705438+0000","last_undegraded":"2023-11-27T20:43:52.705438+0000","last_fullsized":"2023-11-27T20:43:52.705438+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:15.707938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.753844+0000","last_change":"2023-11-27T20:43:52.751182+0000","last_active":"2023-11-27T20:43:52.753844+0000","last_peered":"2023-11-27T20:43:52.753844+0000","last_clean":"2023-11-27T20:43:52.753844+0000","last_became_active":"2023-11-27T20:43:52.750848+0000","last_became_peered":"2023-11-27T20:43:52.750848+0000","last_unstale":"2023-11-27T20:43:52.753844+0000","last_undegraded":"2023-11-27T20:43:52.753844+0000","last_fullsized":"2023-11-27T20:43:52.753844+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:22.440110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.732246+0000","last_change":"2023-11-27T20:43:51.712306+0000","last_active":"2023-11-27T20:43:52.732246+0000","last_peered":"2023-11-27T20:43:52.732246+0000","last_clean":"2023-11-27T20:43:52.732246+0000","last_became_active":"2023-11-27T20:43:51.712011+0000","last_became_peered":"2023-11-27T20:43:51.712011+0000","last_unstale":"2023-11-27T20:43:52.732246+0000","last_undegraded":"2023-11-27T20:43:52.732246+0000","last_fullsized":"2023-11-27T20:43:52.732246+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:16.877363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.739723+0000","last_change":"2023-11-27T20:43:52.726119+0000","last_active":"2023-11-27T20:43:52.739723+0000","last_peered":"2023-11-27T20:43:52.739723+0000","last_clean":"2023-11-27T20:43:52.739723+0000","last_became_active":"2023-11-27T20:43:52.725822+0000","last_became_peered":"2023-11-27T20:43:52.725822+0000","last_unstale":"2023-11-27T20:43:52.739723+0000","last_undegraded":"2023-11-27T20:43:52.739723+0000","last_fullsized":"2023-11-27T20:43:52.739723+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:11.250665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.705270+0000","last_change":"2023-11-27T20:43:51.701670+0000","last_active":"2023-11-27T20:43:52.705270+0000","last_peered":"2023-11-27T20:43:52.705270+0000","last_clean":"2023-11-27T20:43:52.705270+0000","last_became_active":"2023-11-27T20:43:51.701405+0000","last_became_peered":"2023-11-27T20:43:51.701405+0000","last_unstale":"2023-11-27T20:43:52.705270+0000","last_undegraded":"2023-11-27T20:43:52.705270+0000","last_fullsized":"2023-11-27T20:43:52.705270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:37.579894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.738389+0000","last_change":"2023-11-27T20:43:52.723905+0000","last_active":"2023-11-27T20:43:52.738389+0000","last_peered":"2023-11-27T20:43:52.738389+0000","last_clean":"2023-11-27T20:43:52.738389+0000","last_became_active":"2023-11-27T20:43:52.723296+0000","last_became_peered":"2023-11-27T20:43:52.723296+0000","last_unstale":"2023-11-27T20:43:52.738389+0000","last_undegraded":"2023-11-27T20:43:52.738389+0000","last_fullsized":"2023-11-27T20:43:52.738389+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:19.914604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.716037+0000","last_change":"2023-11-27T20:43:51.707532+0000","last_active":"2023-11-27T20:43:52.716037+0000","last_peered":"2023-11-27T20:43:52.716037+0000","last_clean":"2023-11-27T20:43:52.716037+0000","last_became_active":"2023-11-27T20:43:51.705976+0000","last_became_peered":"2023-11-27T20:43:51.705976+0000","last_unstale":"2023-11-27T20:43:52.716037+0000","last_undegraded":"2023-11-27T20:43:52.716037+0000","last_fullsized":"2023-11-27T20:43:52.716037+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:01.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.757821+0000","last_change":"2023-11-27T20:43:52.752685+0000","last_active":"2023-11-27T20:43:52.757821+0000","last_peered":"2023-11-27T20:43:52.757821+0000","last_clean":"2023-11-27T20:43:52.757821+0000","last_became_active":"2023-11-27T20:43:52.748686+0000","last_became_peered":"2023-11-27T20:43:52.748686+0000","last_unstale":"2023-11-27T20:43:52.757821+0000","last_undegraded":"2023-11-27T20:43:52.757821+0000","last_fullsized":"2023-11-27T20:43:52.757821+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:54.739325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-27T20:43:52.708409+0000","last_change":"2023-11-27T20:43:51.700471+0000","last_active":"2023-11-27T20:43:52.708409+0000","last_peered":"2023-11-27T20:43:52.708409+0000","last_clean":"2023-11-27T20:43:52.708409+0000","last_became_active":"2023-11-27T20:43:51.700088+0000","last_became_peered":"2023-11-27T20:43:51.700088+0000","last_unstale":"2023-11-27T20:43:52.708409+0000","last_undegraded":"2023-11-27T20:43:52.708409+0000","last_fullsized":"2023-11-27T20:43:52.708409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:13:35.862430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-27T20:43:51.709215+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:43:51.709215+0000","last_peered":"2023-11-27T20:43:51.709215+0000","last_clean":"2023-11-27T20:43:51.709215+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:43:51.709215+0000","last_undegraded":"2023-11-27T20:43:51.709215+0000","last_fullsized":"2023-11-27T20:43:51.709215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1228800,"data_stored":861265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1579999999999999,"15min":1.163},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.181,"5min":1.2290000000000001,"15min":1.2370000000000001},"min":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.74,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.82499999999999996}]},{"osd":1,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.47,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.607,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3460000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.282,"15min":1.3080000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.484,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":0.88},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.248,"15min":1.2589999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6379999999999999,"5min":1.909,"15min":1.909},"last":1.24}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.361,"15min":1.397},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6779999999999999,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.47,"15min":1.496},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6879999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.397}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.724,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.5429999999999999,"15min":1.6040000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.623,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.202}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4770000000000001,"15min":1.5049999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.948,"5min":2.044,"15min":2.044},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.5660000000000001,"15min":1.5940000000000001},"min":{"1min":0.69499999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8169999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.4930000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.653,"15min":1.6759999999999999},"min":{"1min":0.80200000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.0179999999999998,"5min":2.508,"15min":2.508},"last":1.613},{"interface":"front","average":{"1min":1.425,"5min":1.6559999999999999,"15min":1.694},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.724,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.6619999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":277672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.679,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.647},{"interface":"front","average":{"1min":1.157,"5min":1.306,"15min":1.331},"min":{"1min":0.65200000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6399999999999999,"5min":2.581,"15min":2.581},"last":1.3160000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2549999999999999,"15min":1.2769999999999999},"min":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5349999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.359},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.151,"15min":1.167},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.506,"5min":2.823,"15min":2.823},"last":1.389}]},{"osd":2,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0760000000000001,"15min":1.081},"min":{"1min":0.79100000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4790000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.2,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.86899999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.679,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.5720000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.349,"15min":1.387},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.71,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.095},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.7849999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4319999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.605,"15min":1.631},"min":{"1min":0.97699999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.994,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.623,"15min":1.663},"min":{"1min":0.82799999999999996,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.804,"5min":3.536,"15min":3.536},"last":1.6100000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.393,"15min":1.4079999999999999},"min":{"1min":0.81200000000000006,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9359999999999999,"5min":2.355,"15min":2.355},"last":1.24},{"interface":"front","average":{"1min":1.49,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.753,"5min":0.623,"15min":0.623},"max":{"1min":1.8819999999999999,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.71}]},{"osd":7,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.6519999999999999,"15min":1.6919999999999999},"min":{"1min":0.88500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":3.645,"15min":3.645},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.569,"15min":1.589},"min":{"1min":1.006,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.032,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.51}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":278324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.1379999999999999,"15min":1.163},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5800000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.1579999999999999,"15min":1.1839999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6619999999999999,"5min":2.04,"15min":2.04},"last":0.879}]},{"osd":1,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.181,"15min":1.2050000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.4630000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.3340000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.27,"15min":1.294},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.73,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.1950000000000001,"15min":1.214},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7470000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.268}]},{"osd":3,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.3660000000000001,"15min":1.399},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5900000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.2},{"interface":"front","average":{"1min":1.216,"5min":1.4359999999999999,"15min":1.472},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.637,"5min":4.016,"15min":4.016},"last":1.0860000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3580000000000001,"15min":1.3919999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.79,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.514},{"interface":"front","average":{"1min":1.292,"5min":1.585,"15min":1.6339999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8140000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.3100000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.619,"15min":1.671},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.724,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.573,"15min":1.6120000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.016,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.6020000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.6379999999999999,"15min":1.6819999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.871,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.708,"15min":1.76},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8380000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.637}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":279284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.014,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.999},{"interface":"front","average":{"1min":1.099,"5min":1.0840000000000001,"15min":1.0820000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.034,"15min":1.008},"min":{"1min":0.80400000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":3.5289999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.222,"15min":1.22},"min":{"1min":0.64500000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.74,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":3.9430000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2170000000000001,"15min":1.2110000000000001},"min":{"1min":0.69799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":2.1520000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.292,"15min":1.294},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.395}]},{"osd":3,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.85199999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.599,"5min":1.778,"15min":1.778},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.3600000000000001,"15min":1.343},"min":{"1min":0.91400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.2989999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.266,"15min":1.284},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.516},{"interface":"front","average":{"1min":1.421,"5min":1.431,"15min":1.4330000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.145}]},{"osd":6,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.651,"5min":2.157,"15min":2.157},"last":1.462},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.595,"15min":1.605},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.887,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.242}]},{"osd":7,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5089999999999999,"15min":1.5009999999999999},"min":{"1min":1.179,"5min":1.016,"15min":1.016},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.696,"5min":1.6679999999999999,"15min":1.6639999999999999},"min":{"1min":1.22,"5min":1.004,"15min":1.004},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.339}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":277728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":1.0009999999999999,"15min":1.0389999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.258,"5min":3.641,"15min":3.641},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97199999999999998,"15min":1.014},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0449999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.91400000000000003}]},{"osd":1,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.399,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.097,"15min":1.121},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4099999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.63100000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0960000000000001,"15min":1.117},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.444,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.135},"min":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.746,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.0109999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.3029999999999999,"15min":1.337},"min":{"1min":0.84499999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.365,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.4330000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.4179999999999999,"15min":1.4379999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.982,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.452,"15min":1.482},"min":{"1min":0.874,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.714,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.054}]},{"osd":6,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.5189999999999999,"15min":1.544},"min":{"1min":0.96799999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.823,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.492,"15min":1.522},"min":{"1min":0.89000000000000001,"5min":0.878,"15min":0.878},"max":{"1min":1.8560000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.2789999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.5209999999999999,"15min":1.5580000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.929,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.415},{"interface":"front","average":{"1min":1.413,"5min":1.4890000000000001,"15min":1.5009999999999999},"min":{"1min":1.002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.7410000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":0.81399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":277728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1259999999999999,"5min":1.228,"15min":1.228},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.93300000000000005},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2270000000000001,"5min":1.972,"15min":1.972},"last":0.94299999999999995}]},{"osd":1,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.98099999999999998,"15min":1.014},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1890000000000001,"5min":1.522,"15min":1.522},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.96499999999999997,"15min":0.98799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.431,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.264}]},{"osd":3,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.96099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.996},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0740000000000001,"15min":1.101},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4770000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.111}]},{"osd":4,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.1850000000000001,"15min":1.21},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4299999999999999,"5min":1.669,"15min":1.669},"last":1.173},{"interface":"front","average":{"1min":1.169,"5min":1.3540000000000001,"15min":1.385},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.595}]},{"osd":5,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.3009999999999999,"15min":1.3260000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.601,"5min":2.48,"15min":2.48},"last":1.349},{"interface":"front","average":{"1min":1.198,"5min":1.4510000000000001,"15min":1.4930000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9930000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.4830000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3640000000000001,"15min":1.381},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.972,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.331},{"interface":"front","average":{"1min":1.202,"5min":1.4890000000000001,"15min":1.5369999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.831,"5min":3.302,"15min":3.302},"last":1.302}]},{"osd":7,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.46,"15min":1.496},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.1070000000000002,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.4330000000000001,"15min":1.4810000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.581,"5min":2.73,"15min":2.73},"last":1.5229999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":277672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0940000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.75},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.5449999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.86299999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.97099999999999997,"15min":0.98999999999999999},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3740000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0429999999999999,"15min":1.0469999999999999},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.518,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.1599999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0489999999999999,"15min":1.0329999999999999},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7370000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.01},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.083,"15min":1.087},"min":{"1min":0.66600000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6140000000000001,"5min":2.044,"15min":2.044},"last":1.27}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1799999999999999,"15min":1.1890000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3640000000000001,"15min":1.3540000000000001},"min":{"1min":0.88500000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.1099999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.3560000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9810000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.25,"15min":1.2330000000000001},"min":{"1min":0.79100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1659999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.117}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.3380000000000001,"15min":1.3180000000000001},"min":{"1min":1.095,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1230000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.52},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.357},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.732,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.2450000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.4690000000000001,"15min":1.476},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1949999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.47},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.5960000000000001,"15min":1.5880000000000001},"min":{"1min":1.143,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.7469999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.5840000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1228800,"data_stored":861265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.85299999999999998,"15min":0.84199999999999997},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.85099999999999998,"15min":0.83499999999999996},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.143},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.242}]},{"osd":3,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.91300000000000003,"15min":0.89700000000000002},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.8320000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.494}]},{"osd":4,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2470000000000001,"15min":1.246},"min":{"1min":0.76900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9430000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.1970000000000001,"15min":1.1919999999999999},"min":{"1min":0.89700000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.575,"5min":2.391,"15min":2.391},"last":1.1000000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.81399999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.0750000000000002,"5min":3.028,"15min":3.028},"last":1.625},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.3129999999999999},"min":{"1min":0.77700000000000002,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.246,"5min":2.718,"15min":2.718},"last":1.667}]},{"osd":6,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3120000000000001},"min":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7909999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.423,"15min":1.4239999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.1509999999999998,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.724}]},{"osd":7,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3540000000000001,"15min":1.355},"min":{"1min":0.84699999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.835,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.405},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3560000000000001,"15min":1.3600000000000001},"min":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8500000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.385}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:43:58.143 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T20:43:58.144 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-27T20:43:58.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.408+0000 7ff571abb640 1 Processor -- start 2023-11-27T20:43:58.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.409+0000 7ff571abb640 1 -- start start 2023-11-27T20:43:58.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.410+0000 7ff571abb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff56c13d6e0 0x7ff56c158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.410+0000 7ff571abb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c157cb0 con 0x7ff56c13d0d0 2023-11-27T20:43:58.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.410+0000 7ff571abb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c06ef10 con 0x7ff56c13dc30 2023-11-27T20:43:58.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.410+0000 7ff571abb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c06b350 con 0x7ff56c13d6e0 2023-11-27T20:43:58.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.410+0000 7ff56b7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff56c13d0d0 0x7ff56c06e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:43702/0 (socket says 172.21.15.91:43702) 2023-11-27T20:43:58.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.410+0000 7ff56b7fe640 1 -- 172.21.15.91:0/2564753682 learned_addr learned my addr 172.21.15.91:0/2564753682 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:58.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56affd640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff56c13d6e0 0x7ff56c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362113324 0 0) 0x7ff56c157cb0 con 0x7ff56c13d0d0 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff558003520 con 0x7ff56c13d0d0 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 594340001 0 0) 0x7ff558003520 con 0x7ff56c13d0d0 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff56c13d6e0 msgr2=0x7ff56c158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff56c13d6e0 0x7ff56c158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 >> v1:172.21.15.183:6789/0 conn(0x7ff56c13dc30 legacy=0x7ff56c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c06b0b0 con 0x7ff56c13d0d0 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7ff55c0019f0 con 0x7ff56c13d0d0 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 >> v1:172.21.15.91:6789/0 conn(0x7ff56c13d0d0 legacy=0x7ff56c06e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5580039a0 0x7ff558003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580047c0 0x7ff558004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff56c13d6e0 0x7ff558005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c06b350 con 0x7ff5580039a0 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55800ba30 con 0x7ff5580047c0 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.411+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55800bbc0 con 0x7ff56c13d6e0 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.412+0000 7ff56b7fe640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5580039a0 0x7ff558003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.412+0000 7ff56affd640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580047c0 0x7ff558004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.412+0000 7ff56bfff640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff56c13d6e0 0x7ff558005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.412+0000 7ff56b7fe640 1 -- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff56c13d6e0 msgr2=0x7ff558005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.412+0000 7ff56b7fe640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff56c13d6e0 0x7ff558005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.412+0000 7ff56b7fe640 1 -- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580047c0 msgr2=0x7ff558004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.412+0000 7ff56b7fe640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580047c0 0x7ff558004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.412+0000 7ff56b7fe640 1 -- 172.21.15.91:0/2564753682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558003520 con 0x7ff5580039a0 2023-11-27T20:43:58.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.412+0000 7ff56affd640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580047c0 0x7ff558004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:58.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.413+0000 7ff56b7fe640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5580039a0 0x7ff558003da0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00a840 tx=0x7ff5580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34331c0c3e2139f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:58.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.414+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c034630 con 0x7ff5580039a0 2023-11-27T20:43:58.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.414+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c02f070 con 0x7ff5580039a0 2023-11-27T20:43:58.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.414+0000 7ff56a7fc640 1 -- 172.21.15.91:0/2564753682 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0349d0 con 0x7ff5580039a0 2023-11-27T20:43:58.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.414+0000 7ff571abb640 1 -- 172.21.15.91:0/2564753682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5580039a0 msgr2=0x7ff558003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.414+0000 7ff571abb640 1 --2- 172.21.15.91:0/2564753682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5580039a0 0x7ff558003da0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00a840 tx=0x7ff5580057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.414+0000 7ff56bfff640 1 -- 172.21.15.91:0/2564753682 reap_dead start 2023-11-27T20:43:58.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.414+0000 7ff571abb640 1 -- 172.21.15.91:0/2564753682 shutdown_connections 2023-11-27T20:43:58.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.414+0000 7ff571abb640 1 -- 172.21.15.91:0/2564753682 >> 172.21.15.91:0/2564753682 conn(0x7ff56c0c39e0 msgr2=0x7ff56c0c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:58.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.414+0000 7ff571abb640 1 -- 172.21.15.91:0/2564753682 shutdown_connections 2023-11-27T20:43:58.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.414+0000 7ff571abb640 1 -- 172.21.15.91:0/2564753682 wait complete. 2023-11-27T20:43:58.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.416+0000 7ff571abb640 1 Processor -- start 2023-11-27T20:43:58.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.416+0000 7ff571abb640 1 -- start start 2023-11-27T20:43:58.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.417+0000 7ff571abb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580039a0 0x7ff56c139790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.417+0000 7ff571abb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff56c156ab0 0x7ff56c1e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.417+0000 7ff571abb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff56c155200 0x7ff56c1e7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.417+0000 7ff571abb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c154120 con 0x7ff56c156ab0 2023-11-27T20:43:58.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.417+0000 7ff571abb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c1579c0 con 0x7ff56c155200 2023-11-27T20:43:58.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.417+0000 7ff571abb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c1ea910 con 0x7ff5580039a0 2023-11-27T20:43:58.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.417+0000 7ff56affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff56c156ab0 0x7ff56c1e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.417+0000 7ff56affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff56c156ab0 0x7ff56c1e6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41308/0 (socket says 172.21.15.91:41308) 2023-11-27T20:43:58.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.417+0000 7ff56affd640 1 -- 172.21.15.91:0/1513709385 learned_addr learned my addr 172.21.15.91:0/1513709385 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:58.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff56b7fe640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580039a0 0x7ff56c139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff56affd640 1 -- 172.21.15.91:0/1513709385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580039a0 msgr2=0x7ff56c139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff56affd640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580039a0 0x7ff56c139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff56bfff640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff56c155200 0x7ff56c1e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff56affd640 1 -- 172.21.15.91:0/1513709385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff56c155200 msgr2=0x7ff56c1e7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff56affd640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff56c155200 0x7ff56c1e7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff56affd640 1 -- 172.21.15.91:0/1513709385 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c1575e0 con 0x7ff56c156ab0 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff56affd640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff56c156ab0 0x7ff56c1e6fe0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff554010890 tx=0x7ff554010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff563fff640 1 -- 172.21.15.91:0/1513709385 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400eb00 con 0x7ff56c156ab0 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff563fff640 1 -- 172.21.15.91:0/1513709385 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55400ec60 con 0x7ff56c156ab0 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff563fff640 1 -- 172.21.15.91:0/1513709385 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55401c400 con 0x7ff56c156ab0 2023-11-27T20:43:58.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.418+0000 7ff571abb640 1 -- 172.21.15.91:0/1513709385 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c139cd0 con 0x7ff56c156ab0 2023-11-27T20:43:58.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.419+0000 7ff571abb640 1 -- 172.21.15.91:0/1513709385 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c0c6790 con 0x7ff56c156ab0 2023-11-27T20:43:58.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.420+0000 7ff571abb640 1 -- 172.21.15.91:0/1513709385 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c04e840 con 0x7ff56c156ab0 2023-11-27T20:43:58.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.421+0000 7ff563fff640 1 -- 172.21.15.91:0/1513709385 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff55401c560 con 0x7ff56c156ab0 2023-11-27T20:43:58.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.422+0000 7ff563fff640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54c06b1c0 0x7ff54c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.422+0000 7ff563fff640 1 -- 172.21.15.91:0/1513709385 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff554089e80 con 0x7ff56c156ab0 2023-11-27T20:43:58.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.423+0000 7ff56b7fe640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54c06b1c0 0x7ff54c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.423+0000 7ff56b7fe640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54c06b1c0 0x7ff54c06d680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff55c034000 tx=0x7ff55c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:58.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.427+0000 7ff563fff640 1 -- 172.21.15.91:0/1513709385 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff554054c60 con 0x7ff56c156ab0 2023-11-27T20:43:58.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.686+0000 7ff571abb640 1 -- 172.21.15.91:0/1513709385 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff56c06d1b0 con 0x7ff56c156ab0 2023-11-27T20:43:58.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.690+0000 7ff563fff640 1 -- 172.21.15.91:0/1513709385 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff5540210e0 con 0x7ff56c156ab0 2023-11-27T20:43:58.691 INFO:teuthology.orchestra.run.smithi091.stdout:[client.0] 2023-11-27T20:43:58.691 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5/mRlKBgjIhAArHSIgmH/SwVIdiUlROMOfA== 2023-11-27T20:43:58.691 INFO:teuthology.orchestra.run.smithi091.stdout: caps mds = "allow" 2023-11-27T20:43:58.691 INFO:teuthology.orchestra.run.smithi091.stdout: caps mon = "allow r" 2023-11-27T20:43:58.691 INFO:teuthology.orchestra.run.smithi091.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-27T20:43:58.692 INFO:teuthology.orchestra.run.smithi091.stderr:updated caps for client.0 2023-11-27T20:43:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 -- 172.21.15.91:0/1513709385 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54c06b1c0 msgr2=0x7ff54c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54c06b1c0 0x7ff54c06d680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff55c034000 tx=0x7ff55c02f000 comp rx=0 tx=0).stop 2023-11-27T20:43:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 -- 172.21.15.91:0/1513709385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff56c156ab0 msgr2=0x7ff56c1e6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff56c156ab0 0x7ff56c1e6fe0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff554010890 tx=0x7ff554010d50 comp rx=0 tx=0).stop 2023-11-27T20:43:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 -- 172.21.15.91:0/1513709385 shutdown_connections 2023-11-27T20:43:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff54c06b1c0 0x7ff54c06d680 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff56c155200 0x7ff56c1e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff56c156ab0 0x7ff56c1e6fe0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 --2- 172.21.15.91:0/1513709385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580039a0 0x7ff56c139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 -- 172.21.15.91:0/1513709385 >> 172.21.15.91:0/1513709385 conn(0x7ff56c0c39e0 msgr2=0x7ff56c158360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:58.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.693+0000 7ff571abb640 1 -- 172.21.15.91:0/1513709385 shutdown_connections 2023-11-27T20:43:58.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.694+0000 7ff571abb640 1 -- 172.21.15.91:0/1513709385 wait complete. 2023-11-27T20:43:58.714 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:43:58.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.917+0000 7f8d0637c640 1 Processor -- start 2023-11-27T20:43:58.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.917+0000 7f8d0637c640 1 -- start start 2023-11-27T20:43:58.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.918+0000 7f8d0637c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8d0014fd30 0x7f8d00152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.918+0000 7f8d0637c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d000c64a0 con 0x7f8d0006d0a0 2023-11-27T20:43:58.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.918+0000 7f8d0637c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d000c5c00 con 0x7f8d000c3ea0 2023-11-27T20:43:58.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.918+0000 7f8d0637c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d000c5ee0 con 0x7f8d0014fd30 2023-11-27T20:43:58.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.919+0000 7f8cff7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8d0006d0a0 0x7f8d000a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:43704/0 (socket says 172.21.15.91:43704) 2023-11-27T20:43:58.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.919+0000 7f8cff7fe640 1 -- 172.21.15.91:0/1993821479 learned_addr learned my addr 172.21.15.91:0/1993821479 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:43:58.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.919+0000 7f8cfffff640 1 --2- 172.21.15.91:0/1993821479 >> v2:172.21.15.183:3300/0 conn(0x7f8d0014fd30 0x7f8d00152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.919+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590278640 0 0) 0x7f8d000c64a0 con 0x7f8d0006d0a0 2023-11-27T20:43:58.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.919+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cec003520 con 0x7f8d0006d0a0 2023-11-27T20:43:58.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.919+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2229277637 0 0) 0x7f8cec003520 con 0x7f8d0006d0a0 2023-11-27T20:43:58.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.919+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 >> v2:172.21.15.183:3300/0 conn(0x7f8d0014fd30 msgr2=0x7f8d00152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:58.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.919+0000 7f8cfeffd640 1 --2- 172.21.15.91:0/1993821479 >> v2:172.21.15.183:3300/0 conn(0x7f8d0014fd30 0x7f8d00152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.919+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 >> v1:172.21.15.183:6789/0 conn(0x7f8d000c3ea0 legacy=0x7f8d000c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:58.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000c61c0 con 0x7f8d0006d0a0 2023-11-27T20:43:58.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f8ce80019f0 con 0x7f8d0006d0a0 2023-11-27T20:43:58.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 >> v1:172.21.15.91:6789/0 conn(0x7f8d0006d0a0 legacy=0x7f8d000a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cfeffd640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cec003970 0x7f8cec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cfeffd640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cec0047c0 0x7f8cec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cfeffd640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cec005180 0x7f8cec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000c5ee0 con 0x7f8cec005180 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec00c020 con 0x7f8cec0047c0 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec00c1e0 con 0x7f8cec003970 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8d04919640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cec005180 0x7f8cec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cfffff640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cec003970 0x7f8cec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.920+0000 7f8cff7fe640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cec0047c0 0x7f8cec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.921+0000 7f8d04919640 1 -- 172.21.15.91:0/1993821479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cec003970 msgr2=0x7f8cec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.921+0000 7f8d04919640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cec003970 0x7f8cec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.921+0000 7f8d04919640 1 -- 172.21.15.91:0/1993821479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cec0047c0 msgr2=0x7f8cec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.921+0000 7f8d04919640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cec0047c0 0x7f8cec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.921+0000 7f8d04919640 1 -- 172.21.15.91:0/1993821479 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec003520 con 0x7f8cec005180 2023-11-27T20:43:58.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.921+0000 7f8d04919640 1 -- 172.21.15.91:0/1993821479 reap_dead start 2023-11-27T20:43:58.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.922+0000 7f8d04919640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cec005180 0x7f8cec00b980 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8001750 tx=0x7f8cec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1638afaa6e475f3b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:58.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.922+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80052d0 con 0x7f8cec005180 2023-11-27T20:43:58.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.922+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf802e050 con 0x7f8cec005180 2023-11-27T20:43:58.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.922+0000 7f8cfeffd640 1 -- 172.21.15.91:0/1993821479 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8003830 con 0x7f8cec005180 2023-11-27T20:43:58.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.923+0000 7f8d0637c640 1 -- 172.21.15.91:0/1993821479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cec005180 msgr2=0x7f8cec00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.923+0000 7f8d0637c640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cec005180 0x7f8cec00b980 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8001750 tx=0x7f8cec0057f0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.923+0000 7f8d0637c640 1 -- 172.21.15.91:0/1993821479 shutdown_connections 2023-11-27T20:43:58.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.923+0000 7f8d0637c640 1 --2- 172.21.15.91:0/1993821479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cec005180 0x7f8cec00b980 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.923+0000 7f8d0637c640 1 -- 172.21.15.91:0/1993821479 >> 172.21.15.91:0/1993821479 conn(0x7f8d0006a500 msgr2=0x7f8d0006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:58.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.923+0000 7f8d0637c640 1 -- 172.21.15.91:0/1993821479 shutdown_connections 2023-11-27T20:43:58.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.923+0000 7f8d0637c640 1 -- 172.21.15.91:0/1993821479 wait complete. 2023-11-27T20:43:58.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.925+0000 7f8d0637c640 1 Processor -- start 2023-11-27T20:43:58.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.925+0000 7f8d0637c640 1 -- start start 2023-11-27T20:43:58.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.926+0000 7f8d0637c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cec005180 0x7f8d00154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.926+0000 7f8d0637c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d001490a0 0x7f8d001e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.926+0000 7f8d0637c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d00154f40 0x7f8d001553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.926+0000 7f8d0637c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000a6ac0 con 0x7f8d00154f40 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.926+0000 7f8d0637c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000a6770 con 0x7f8cec005180 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.926+0000 7f8d0637c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d001562c0 con 0x7f8d001490a0 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.926+0000 7f8d04919640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d00154f40 0x7f8d001553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.926+0000 7f8d04919640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d00154f40 0x7f8d001553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41324/0 (socket says 172.21.15.91:41324) 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.926+0000 7f8d04919640 1 -- 172.21.15.91:0/2001890688 learned_addr learned my addr 172.21.15.91:0/2001890688 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8cff7fe640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d001490a0 0x7f8d001e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8cfffff640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cec005180 0x7f8d00154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8d04919640 1 -- 172.21.15.91:0/2001890688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d001490a0 msgr2=0x7f8d001e8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8d04919640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d001490a0 0x7f8d001e8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8d04919640 1 -- 172.21.15.91:0/2001890688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cec005180 msgr2=0x7f8d00154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8d04919640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cec005180 0x7f8d00154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:58.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8d04919640 1 -- 172.21.15.91:0/2001890688 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d001e86a0 con 0x7f8d00154f40 2023-11-27T20:43:58.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8d04919640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d00154f40 0x7f8d001553d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8001870 tx=0x7f8cf8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:58.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8cfcff9640 1 -- 172.21.15.91:0/2001890688 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8039070 con 0x7f8d00154f40 2023-11-27T20:43:58.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8cfcff9640 1 -- 172.21.15.91:0/2001890688 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf80052e0 con 0x7f8d00154f40 2023-11-27T20:43:58.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.927+0000 7f8cfcff9640 1 -- 172.21.15.91:0/2001890688 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8007030 con 0x7f8d00154f40 2023-11-27T20:43:58.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.928+0000 7f8d0637c640 1 -- 172.21.15.91:0/2001890688 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d000a6490 con 0x7f8d00154f40 2023-11-27T20:43:58.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.928+0000 7f8d0637c640 1 -- 172.21.15.91:0/2001890688 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d00155910 con 0x7f8d00154f40 2023-11-27T20:43:58.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.929+0000 7f8d0637c640 1 -- 172.21.15.91:0/2001890688 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d001e8830 con 0x7f8d00154f40 2023-11-27T20:43:58.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.930+0000 7f8cfcff9640 1 -- 172.21.15.91:0/2001890688 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8cf803c020 con 0x7f8d00154f40 2023-11-27T20:43:58.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.930+0000 7f8cfcff9640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8ce006b1c0 0x7f8ce006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:58.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.931+0000 7f8cfcff9640 1 -- 172.21.15.91:0/2001890688 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cf80a9e00 con 0x7f8d00154f40 2023-11-27T20:43:58.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.931+0000 7f8cfffff640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8ce006b1c0 0x7f8ce006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:58.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.932+0000 7f8cfffff640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8ce006b1c0 0x7f8ce006d680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009990 tx=0x7f8cf0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:58.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:58.935+0000 7f8cfcff9640 1 -- 172.21.15.91:0/2001890688 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8cf8074bd0 con 0x7f8d00154f40 2023-11-27T20:43:59.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.158+0000 7f8d0637c640 1 -- 172.21.15.91:0/2001890688 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d00068350 con 0x7f8d00154f40 2023-11-27T20:43:59.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.159+0000 7f8cfcff9640 1 -- 172.21.15.91:0/2001890688 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f8cf80781f0 con 0x7f8d00154f40 2023-11-27T20:43:59.160 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:43:59.160 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1107018884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1107018884},{"type":"v1","addr":"172.21.15.91:6836","nonce":1107018884}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:43:52.149238+0000","modified":"2023-11-27T20:43:55.217623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/42700883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":42700883},{"type":"v1","addr":"172.21.15.91:6837","nonce":42700883}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-27T20:43:59.160 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 30 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 -- 172.21.15.91:0/2001890688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8ce006b1c0 msgr2=0x7f8ce006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8ce006b1c0 0x7f8ce006d680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009990 tx=0x7f8cf0008040 comp rx=0 tx=0).stop 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 -- 172.21.15.91:0/2001890688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d00154f40 msgr2=0x7f8d001553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d00154f40 0x7f8d001553d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8001870 tx=0x7f8cf8001120 comp rx=0 tx=0).stop 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 -- 172.21.15.91:0/2001890688 shutdown_connections 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d00154f40 0x7f8d001553d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d001490a0 0x7f8d001e8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8ce006b1c0 0x7f8ce006d680 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 --2- 172.21.15.91:0/2001890688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cec005180 0x7f8d00154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 -- 172.21.15.91:0/2001890688 >> 172.21.15.91:0/2001890688 conn(0x7f8d0006a500 msgr2=0x7f8d0006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:59.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 -- 172.21.15.91:0/2001890688 shutdown_connections 2023-11-27T20:43:59.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.162+0000 7f8d0637c640 1 -- 172.21.15.91:0/2001890688 wait complete. 2023-11-27T20:43:59.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T20:43:52.149238+0000', 'modified': '2023-11-27T20:43:55.217623+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5793}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5793': {'gid': 5793, 'name': 'c', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.91:6837/42700883', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6834', 'nonce': 42700883}, {'type': 'v1', 'addr': '172.21.15.91:6837', 'nonce': 42700883}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T20:43:59.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T20:43:59.584 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-27T20:43:59.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.807+0000 7ffa5aaa6640 1 Processor -- start 2023-11-27T20:43:59.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.807+0000 7ffa5aaa6640 1 -- start start 2023-11-27T20:43:59.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.809+0000 7ffa5aaa6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffa5414ed10 0x7ffa54070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.809+0000 7ffa5aaa6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffa54071930 0x7ffa5415be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.809+0000 7ffa5aaa6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa54072400 con 0x7ffa540c18e0 2023-11-27T20:43:59.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.809+0000 7ffa5aaa6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5406e340 con 0x7ffa54071930 2023-11-27T20:43:59.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.809+0000 7ffa5aaa6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa54152170 con 0x7ffa5414ed10 2023-11-27T20:43:59.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.809+0000 7ffa59043640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffa54071930 0x7ffa5415be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.809+0000 7ffa59043640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffa54071930 0x7ffa5415be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41334/0 (socket says 172.21.15.91:41334) 2023-11-27T20:43:59.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.809+0000 7ffa59043640 1 -- 172.21.15.91:0/809781913 learned_addr learned my addr 172.21.15.91:0/809781913 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:59.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.810+0000 7ffa58842640 1 --2- 172.21.15.91:0/809781913 >> v2:172.21.15.183:3300/0 conn(0x7ffa5414ed10 0x7ffa54070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.810+0000 7ffa59043640 1 -- 172.21.15.91:0/809781913 >> v2:172.21.15.183:3300/0 conn(0x7ffa5414ed10 msgr2=0x7ffa54070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:59.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.810+0000 7ffa59043640 1 --2- 172.21.15.91:0/809781913 >> v2:172.21.15.183:3300/0 conn(0x7ffa5414ed10 0x7ffa54070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.810+0000 7ffa59043640 1 -- 172.21.15.91:0/809781913 >> v1:172.21.15.183:6789/0 conn(0x7ffa540c18e0 legacy=0x7ffa5406e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:59.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.810+0000 7ffa59043640 1 -- 172.21.15.91:0/809781913 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5406dfd0 con 0x7ffa54071930 2023-11-27T20:43:59.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.811+0000 7ffa59043640 1 --2- 172.21.15.91:0/809781913 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa54071930 0x7ffa5415be60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ffa54070e60 tx=0x7ffa4c02dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab71551c8d6314b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:59.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.811+0000 7ffa4b7fe640 1 -- 172.21.15.91:0/809781913 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c02ed70 con 0x7ffa54071930 2023-11-27T20:43:59.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.811+0000 7ffa4b7fe640 1 -- 172.21.15.91:0/809781913 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c036440 con 0x7ffa54071930 2023-11-27T20:43:59.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.811+0000 7ffa4b7fe640 1 -- 172.21.15.91:0/809781913 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0367d0 con 0x7ffa54071930 2023-11-27T20:43:59.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.812+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/809781913 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa54071930 msgr2=0x7ffa5415be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.812+0000 7ffa5aaa6640 1 --2- 172.21.15.91:0/809781913 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa54071930 0x7ffa5415be60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ffa54070e60 tx=0x7ffa4c02dfc0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.812+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/809781913 shutdown_connections 2023-11-27T20:43:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.812+0000 7ffa5aaa6640 1 --2- 172.21.15.91:0/809781913 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa54071930 0x7ffa5415be60 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.812+0000 7ffa5aaa6640 1 --2- 172.21.15.91:0/809781913 >> v2:172.21.15.183:3300/0 conn(0x7ffa5414ed10 0x7ffa54070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.812+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/809781913 >> 172.21.15.91:0/809781913 conn(0x7ffa540c6ee0 msgr2=0x7ffa540c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.812+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/809781913 shutdown_connections 2023-11-27T20:43:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.812+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/809781913 wait complete. 2023-11-27T20:43:59.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.814+0000 7ffa5aaa6640 1 Processor -- start 2023-11-27T20:43:59.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.814+0000 7ffa5aaa6640 1 -- start start 2023-11-27T20:43:59.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.815+0000 7ffa5aaa6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa54071930 0x7ffa541ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.815+0000 7ffa5aaa6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa540c18e0 0x7ffa54140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.815+0000 7ffa5aaa6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa5414ed10 0x7ffa54140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.815+0000 7ffa5aaa6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa541ee4d0 con 0x7ffa540c18e0 2023-11-27T20:43:59.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.815+0000 7ffa5aaa6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540ac150 con 0x7ffa54071930 2023-11-27T20:43:59.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.815+0000 7ffa5aaa6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa541ee1f0 con 0x7ffa5414ed10 2023-11-27T20:43:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.815+0000 7ffa4bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa540c18e0 0x7ffa54140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa4bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa540c18e0 0x7ffa54140740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41336/0 (socket says 172.21.15.91:41336) 2023-11-27T20:43:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1602975071 learned_addr learned my addr 172.21.15.91:0/1602975071 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa58842640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa54071930 0x7ffa541ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1602975071 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa5414ed10 msgr2=0x7ffa54140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa5414ed10 0x7ffa54140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1602975071 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa54071930 msgr2=0x7ffa541ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa54071930 0x7ffa541ed790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1602975071 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c00b770 con 0x7ffa540c18e0 2023-11-27T20:43:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa540c18e0 0x7ffa54140740 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c400 tx=0x7ffa4400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa497fa640 1 -- 172.21.15.91:0/1602975071 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44011790 con 0x7ffa540c18e0 2023-11-27T20:43:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa497fa640 1 -- 172.21.15.91:0/1602975071 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa44011930 con 0x7ffa540c18e0 2023-11-27T20:43:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa497fa640 1 -- 172.21.15.91:0/1602975071 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44011ce0 con 0x7ffa540c18e0 2023-11-27T20:43:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.816+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/1602975071 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa54142360 con 0x7ffa540c18e0 2023-11-27T20:43:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.817+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/1602975071 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa541411c0 con 0x7ffa540c18e0 2023-11-27T20:43:59.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.819+0000 7ffa497fa640 1 -- 172.21.15.91:0/1602975071 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ffa4401c460 con 0x7ffa540c18e0 2023-11-27T20:43:59.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.820+0000 7ffa497fa640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa4006b1c0 0x7ffa4006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.820+0000 7ffa497fa640 1 -- 172.21.15.91:0/1602975071 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa440899a0 con 0x7ffa540c18e0 2023-11-27T20:43:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.821+0000 7ffa58842640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa4006b1c0 0x7ffa4006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.821+0000 7ffa5d638740 1 Processor -- start 2023-11-27T20:43:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.821+0000 7ffa5d638740 1 -- start start 2023-11-27T20:43:59.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.821+0000 7ffa58842640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa4006b1c0 0x7ffa4006d680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009e90 tx=0x7ffa5000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:59.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.822+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f334c960 0x55f9f334cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.822+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f33136b0 0x55f9f334fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.822+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f3350170 0x55f9f330cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.822+0000 7ffa5d638740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f3270880 con 0x55f9f3350170 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.822+0000 7ffa5d638740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f327fae0 con 0x55f9f334c960 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.822+0000 7ffa5d638740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9f327d1d0 con 0x55f9f33136b0 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.822+0000 7ffa59043640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f3350170 0x55f9f330cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa59043640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f3350170 0x55f9f330cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41348/0 (socket says 172.21.15.91:41348) 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa59043640 1 -- 172.21.15.91:0/623817109 learned_addr learned my addr 172.21.15.91:0/623817109 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa58842640 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f334c960 0x55f9f334cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f33136b0 0x55f9f334fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa59043640 1 -- 172.21.15.91:0/623817109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f33136b0 msgr2=0x55f9f334fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa59043640 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f33136b0 0x55f9f334fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa59043640 1 -- 172.21.15.91:0/623817109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f334c960 msgr2=0x55f9f334cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa59043640 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f334c960 0x55f9f334cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa59043640 1 -- 172.21.15.91:0/623817109 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9f3240860 con 0x55f9f3350170 2023-11-27T20:43:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa58842640 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f334c960 0x55f9f334cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f33136b0 0x55f9f334fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa59043640 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f3350170 0x55f9f330cba0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c02e000 tx=0x7ffa4c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53aab01287a5c7f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.823+0000 7ffa3a7fc640 1 -- 172.21.15.91:0/623817109 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c02edf0 con 0x55f9f3350170 2023-11-27T20:43:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa3a7fc640 1 -- 172.21.15.91:0/623817109 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c0365b0 con 0x55f9f3350170 2023-11-27T20:43:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa3a7fc640 1 -- 172.21.15.91:0/623817109 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c036920 con 0x55f9f3350170 2023-11-27T20:43:59.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa5d638740 1 -- 172.21.15.91:0/623817109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f3350170 msgr2=0x55f9f330cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa5d638740 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f3350170 0x55f9f330cba0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c02e000 tx=0x7ffa4c030000 comp rx=0 tx=0).stop 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa5d638740 1 -- 172.21.15.91:0/623817109 shutdown_connections 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa5d638740 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f3350170 0x55f9f330cba0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa5d638740 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f33136b0 0x55f9f334fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa5d638740 1 --2- 172.21.15.91:0/623817109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f334c960 0x55f9f334cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa5d638740 1 -- 172.21.15.91:0/623817109 >> 172.21.15.91:0/623817109 conn(0x55f9f32d3c70 msgr2=0x55f9f3333700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa5d638740 1 -- 172.21.15.91:0/623817109 shutdown_connections 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.824+0000 7ffa5d638740 1 -- 172.21.15.91:0/623817109 wait complete. 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.825+0000 7ffa5d638740 1 -- start start 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.825+0000 7ffa5d638740 1 Processor -- start 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.826+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f334b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.826+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.826+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f33536d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.826+0000 7ffa5d638740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f3278ac0 con 0x55f9f334c960 2023-11-27T20:43:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.826+0000 7ffa5d638740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f32152f0 con 0x55f9f33136b0 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.826+0000 7ffa5d638740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9f3232c70 con 0x55f9f3350170 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.826+0000 7ffa5d638740 10 client.0 _ll_register_callbacks cb 0x55f9f32373b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa4bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa4bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41350/0 (socket says 172.21.15.91:41350) 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa4bfff640 1 -- 172.21.15.91:0/3991511869 learned_addr learned my addr 172.21.15.91:0/3991511869 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa4bfff640 1 -- 172.21.15.91:0/3991511869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 msgr2=0x55f9f33536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f33536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa4bfff640 1 -- 172.21.15.91:0/3991511869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 msgr2=0x55f9f334b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa58842640 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f334b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f334b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa4bfff640 1 -- 172.21.15.91:0/3991511869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5406dfd0 con 0x55f9f334c960 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332970 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffa440037a0 tx=0x7ffa44058bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649b1ea4f586fa23 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:59.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa337fe640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa337fe640 1 -- 172.21.15.91:0/3991511869 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44060690 con 0x55f9f334c960 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.827+0000 7ffa337fe640 1 -- 172.21.15.91:0/3991511869 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa44054aa0 con 0x55f9f334c960 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa5d638740 1 -- 172.21.15.91:0/3991511869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9f3271aa0 con 0x55f9f334c960 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa337fe640 1 -- 172.21.15.91:0/3991511869 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa44054c60 con 0x55f9f334c960 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa5d638740 10 client.5940 fetch_fsmap learned FSMap version 30 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa5d638740 1 -- 172.21.15.91:0/3991511869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55f9f3277140 con 0x55f9f334c960 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa337fe640 1 -- 172.21.15.91:0/3991511869 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9f3271aa0 con 0x55f9f334c960 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa337fe640 1 -- 172.21.15.91:0/3991511869 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ffa44057880 con 0x55f9f334c960 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa5d638740 10 client.5940 fetch_fsmap finished waiting for FSMap version 30 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa5d638740 10 client.5940 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa5d638740 20 client.5940 populate_metadata read hostname 'smithi091' 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa5d638740 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.91:6834/42700883,v1:172.21.15.91:6837/42700883] conn(0x55f9f3361960 0x55f9f3361d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa5d638740 4 client.5940 mds_command: new command op to 5793 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T20:43:59.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa5d638740 1 -- 172.21.15.91:0/3991511869 --> [v2:172.21.15.91:6834/42700883,v1:172.21.15.91:6837/42700883] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9f32717c0 con 0x55f9f3361960 2023-11-27T20:43:59.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.828+0000 7ffa58842640 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.91:6834/42700883,v1:172.21.15.91:6837/42700883] conn(0x55f9f3361960 0x55f9f3361d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.829+0000 7ffa58842640 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.91:6834/42700883,v1:172.21.15.91:6837/42700883] conn(0x55f9f3361960 0x55f9f3361d40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e286127216356572 server_cookie=d9373412099db280 in_seq=0 out_seq=0 2023-11-27T20:43:59.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.829+0000 7ffa337fe640 10 client.5940 ms_handle_connect on v2:172.21.15.91:6834/42700883 2023-11-27T20:43:59.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa337fe640 1 -- 172.21.15.91:0/3991511869 <== mds.0 v2:172.21.15.91:6834/42700883 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f9f32717c0 con 0x55f9f3361960 2023-11-27T20:43:59.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa337fe640 10 client.5940 handle_command_reply: tid=0 2023-11-27T20:43:59.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 client.5940 shutdown 2023-11-27T20:43:59.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 -- 172.21.15.91:0/3991511869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 msgr2=0x55f9f3332970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332970 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffa440037a0 tx=0x7ffa44058bd0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 -- 172.21.15.91:0/3991511869 shutdown_connections 2023-11-27T20:43:59.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.91:6834/42700883,v1:172.21.15.91:6837/42700883] conn(0x55f9f3361960 0x55f9f3361d40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f33536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332970 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 --2- 172.21.15.91:0/3991511869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f334b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa337fe640 0 client.5940 ms_handle_reset on v2:172.21.15.91:6834/42700883 2023-11-27T20:43:59.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 -- 172.21.15.91:0/3991511869 >> 172.21.15.91:0/3991511869 conn(0x55f9f32d3c70 msgr2=0x55f9f330cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:59.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 -- 172.21.15.91:0/3991511869 shutdown_connections 2023-11-27T20:43:59.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 1 -- 172.21.15.91:0/3991511869 wait complete. 2023-11-27T20:43:59.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.830+0000 7ffa5d638740 20 client.5940 trim_cache size 0 max 16384 2023-11-27T20:43:59.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.847+0000 7ffa5d638740 1 Processor -- start 2023-11-27T20:43:59.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.847+0000 7ffa5d638740 1 -- start start 2023-11-27T20:43:59.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.848+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f334b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.848+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.848+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f3367d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.848+0000 7ffa5d638740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f2fdbf20 con 0x55f9f334c960 2023-11-27T20:43:59.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.848+0000 7ffa5d638740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f33086f0 con 0x55f9f33136b0 2023-11-27T20:43:59.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.848+0000 7ffa5d638740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9f3346990 con 0x55f9f3350170 2023-11-27T20:43:59.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.848+0000 7ffa4bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.848+0000 7ffa4bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41358/0 (socket says 172.21.15.91:41358) 2023-11-27T20:43:59.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.848+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1093897504 learned_addr learned my addr 172.21.15.91:0/1093897504 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:59.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa58842640 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f334b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa59043640 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f3367d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1093897504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 msgr2=0x55f9f3367d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:59.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f3367d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1093897504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 msgr2=0x55f9f334b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:59.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f334b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1093897504 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9f3214b80 con 0x55f9f334c960 2023-11-27T20:43:59.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa59043640 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f3367d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:59.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa58842640 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f334b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:43:59.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332780 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400a040 tx=0x7ffa44014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113ee7cb2ccc3505 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:59.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa3affd640 1 -- 172.21.15.91:0/1093897504 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa440038a0 con 0x55f9f334c960 2023-11-27T20:43:59.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa3affd640 1 -- 172.21.15.91:0/1093897504 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4400e040 con 0x55f9f334c960 2023-11-27T20:43:59.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.849+0000 7ffa3affd640 1 -- 172.21.15.91:0/1093897504 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44060690 con 0x55f9f334c960 2023-11-27T20:43:59.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.850+0000 7ffa5d638740 1 -- 172.21.15.91:0/1093897504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 msgr2=0x55f9f3332780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.850+0000 7ffa5d638740 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332780 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400a040 tx=0x7ffa44014000 comp rx=0 tx=0).stop 2023-11-27T20:43:59.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.850+0000 7ffa5d638740 1 -- 172.21.15.91:0/1093897504 shutdown_connections 2023-11-27T20:43:59.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.850+0000 7ffa5d638740 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f3367d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.850+0000 7ffa5d638740 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f3332780 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.850+0000 7ffa5d638740 1 --2- 172.21.15.91:0/1093897504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f334b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.850+0000 7ffa5d638740 1 -- 172.21.15.91:0/1093897504 >> 172.21.15.91:0/1093897504 conn(0x55f9f32d3c70 msgr2=0x55f9f334f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:59.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.850+0000 7ffa5d638740 1 -- 172.21.15.91:0/1093897504 shutdown_connections 2023-11-27T20:43:59.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.850+0000 7ffa5d638740 1 -- 172.21.15.91:0/1093897504 wait complete. 2023-11-27T20:43:59.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.851+0000 7ffa5d638740 1 -- start start 2023-11-27T20:43:59.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.851+0000 7ffa5d638740 1 Processor -- start 2023-11-27T20:43:59.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f335bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f335e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa5d638740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f33b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa5d638740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f335ef10 con 0x55f9f334c960 2023-11-27T20:43:59.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa5d638740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f3368860 con 0x55f9f33136b0 2023-11-27T20:43:59.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa5d638740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9f3367d70 con 0x55f9f3350170 2023-11-27T20:43:59.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa5d638740 10 client.0 _ll_register_callbacks cb 0x7ffa440546d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:43:59.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa4bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f335e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa4bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f335e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41362/0 (socket says 172.21.15.91:41362) 2023-11-27T20:43:59.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1388571743 learned_addr learned my addr 172.21.15.91:0/1388571743 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:43:59.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1388571743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 msgr2=0x55f9f33b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:59.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f33b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1388571743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 msgr2=0x55f9f335bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:43:59.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f335bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.852+0000 7ffa4bfff640 1 -- 172.21.15.91:0/1388571743 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9f3277140 con 0x55f9f334c960 2023-11-27T20:43:59.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa4bfff640 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f335e370 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ffa44058090 tx=0x7ffa44087da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82465a14a870d899 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:43:59.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa337fe640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T20:43:59.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa337fe640 1 -- 172.21.15.91:0/1388571743 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4400e040 con 0x55f9f334c960 2023-11-27T20:43:59.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa337fe640 1 -- 172.21.15.91:0/1388571743 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa44060690 con 0x55f9f334c960 2023-11-27T20:43:59.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa5d638740 1 -- 172.21.15.91:0/1388571743 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9f2f796c0 con 0x55f9f334c960 2023-11-27T20:43:59.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa337fe640 1 -- 172.21.15.91:0/1388571743 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa440602d0 con 0x55f9f334c960 2023-11-27T20:43:59.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa5d638740 10 client.5946 fetch_fsmap learned FSMap version 30 2023-11-27T20:43:59.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa5d638740 1 -- 172.21.15.91:0/1388571743 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55f9f323a170 con 0x55f9f334c960 2023-11-27T20:43:59.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa337fe640 1 -- 172.21.15.91:0/1388571743 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9f2f796c0 con 0x55f9f334c960 2023-11-27T20:43:59.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa337fe640 1 -- 172.21.15.91:0/1388571743 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ffa4405e290 con 0x55f9f334c960 2023-11-27T20:43:59.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa5d638740 10 client.5946 fetch_fsmap finished waiting for FSMap version 30 2023-11-27T20:43:59.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa5d638740 10 client.5946 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-27T20:43:59.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa5d638740 20 client.5946 populate_metadata read hostname 'smithi091' 2023-11-27T20:43:59.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa5d638740 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.91:6834/42700883,v1:172.21.15.91:6837/42700883] conn(0x55f9f33b6910 0x55f9f334d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:43:59.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa5d638740 4 client.5946 mds_command: new command op to 5793 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T20:43:59.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.853+0000 7ffa5d638740 1 -- 172.21.15.91:0/1388571743 --> [v2:172.21.15.91:6834/42700883,v1:172.21.15.91:6837/42700883] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f9f2fccd10 con 0x55f9f33b6910 2023-11-27T20:43:59.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.854+0000 7ffa58842640 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.91:6834/42700883,v1:172.21.15.91:6837/42700883] conn(0x55f9f33b6910 0x55f9f334d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:43:59.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.854+0000 7ffa58842640 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.91:6834/42700883,v1:172.21.15.91:6837/42700883] conn(0x55f9f33b6910 0x55f9f334d830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86a40cb4ddee5f53 server_cookie=775cb4ccf152ecf0 in_seq=0 out_seq=0 2023-11-27T20:43:59.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.854+0000 7ffa337fe640 10 client.5946 ms_handle_connect on v2:172.21.15.91:6834/42700883 2023-11-27T20:43:59.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.854+0000 7ffa337fe640 1 -- 172.21.15.91:0/1388571743 <== mds.0 v2:172.21.15.91:6834/42700883 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x55f9f2fccd10 con 0x55f9f33b6910 2023-11-27T20:43:59.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.854+0000 7ffa337fe640 10 client.5946 handle_command_reply: tid=0 2023-11-27T20:43:59.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.854+0000 7ffa5d638740 1 client.5946 shutdown 2023-11-27T20:43:59.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.854+0000 7ffa5d638740 1 -- 172.21.15.91:0/1388571743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 msgr2=0x55f9f335e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.854+0000 7ffa5d638740 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f335e370 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ffa44058090 tx=0x7ffa44087da0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5d638740 1 -- 172.21.15.91:0/1388571743 shutdown_connections 2023-11-27T20:43:59.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5d638740 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.91:6834/42700883,v1:172.21.15.91:6837/42700883] conn(0x55f9f33b6910 0x55f9f334d830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5d638740 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55f9f3350170 0x55f9f33b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5d638740 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9f334c960 0x55f9f335e370 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5d638740 1 --2- 172.21.15.91:0/1388571743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f9f33136b0 0x55f9f335bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa337fe640 0 client.5946 ms_handle_reset on v2:172.21.15.91:6834/42700883 2023-11-27T20:43:59.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5d638740 1 -- 172.21.15.91:0/1388571743 >> 172.21.15.91:0/1388571743 conn(0x55f9f32d3c70 msgr2=0x55f9f334cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:59.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5d638740 1 -- 172.21.15.91:0/1388571743 shutdown_connections 2023-11-27T20:43:59.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5d638740 1 -- 172.21.15.91:0/1388571743 wait complete. 2023-11-27T20:43:59.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5d638740 20 client.5946 trim_cache size 0 max 16384 2023-11-27T20:43:59.879 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:43:59.879 INFO:teuthology.orchestra.run.smithi091.stdout: "cluster_fsid": "76812701-65a9-4deb-87af-ef00110d1601", 2023-11-27T20:43:59.880 INFO:teuthology.orchestra.run.smithi091.stdout: "whoami": 0, 2023-11-27T20:43:59.880 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 5793, 2023-11-27T20:43:59.880 INFO:teuthology.orchestra.run.smithi091.stdout: "want_state": "up:active", 2023-11-27T20:43:59.880 INFO:teuthology.orchestra.run.smithi091.stdout: "state": "up:active", 2023-11-27T20:43:59.880 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs", 2023-11-27T20:43:59.880 INFO:teuthology.orchestra.run.smithi091.stdout: "rank_uptime": 7.13598161, 2023-11-27T20:43:59.881 INFO:teuthology.orchestra.run.smithi091.stdout: "mdsmap_epoch": 30, 2023-11-27T20:43:59.881 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch": 55, 2023-11-27T20:43:59.881 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch_barrier": 55, 2023-11-27T20:43:59.881 INFO:teuthology.orchestra.run.smithi091.stdout: "uptime": 13.679394429 2023-11-27T20:43:59.881 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:43:59.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/1602975071 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa4006b1c0 msgr2=0x7ffa4006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5aaa6640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa4006b1c0 0x7ffa4006d680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009e90 tx=0x7ffa5000b040 comp rx=0 tx=0).stop 2023-11-27T20:43:59.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/1602975071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa540c18e0 msgr2=0x7ffa54140740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:43:59.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.855+0000 7ffa5aaa6640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa540c18e0 0x7ffa54140740 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c400 tx=0x7ffa4400c8c0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.856+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/1602975071 shutdown_connections 2023-11-27T20:43:59.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.856+0000 7ffa5aaa6640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa5414ed10 0x7ffa54140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.856+0000 7ffa5aaa6640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa540c18e0 0x7ffa54140740 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.856+0000 7ffa5aaa6640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ffa4006b1c0 0x7ffa4006d680 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.856+0000 7ffa5aaa6640 1 --2- 172.21.15.91:0/1602975071 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa54071930 0x7ffa541ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:43:59.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.856+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/1602975071 >> 172.21.15.91:0/1602975071 conn(0x7ffa540c6ee0 msgr2=0x7ffa54070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:43:59.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.856+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/1602975071 shutdown_connections 2023-11-27T20:43:59.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:43:59.856+0000 7ffa5aaa6640 1 -- 172.21.15.91:0/1602975071 wait complete. 2023-11-27T20:43:59.886 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:44:00.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.087+0000 7ff520b3c640 1 Processor -- start 2023-11-27T20:44:00.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.088+0000 7ff520b3c640 1 -- start start 2023-11-27T20:44:00.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.089+0000 7ff520b3c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff51c0c52e0 0x7ff51c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:00.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.089+0000 7ff520b3c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c0a8380 con 0x7ff51c14e7f0 2023-11-27T20:44:00.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.089+0000 7ff520b3c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c1510b0 con 0x7ff51c06cd20 2023-11-27T20:44:00.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.089+0000 7ff520b3c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c06bf60 con 0x7ff51c0c52e0 2023-11-27T20:44:00.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.089+0000 7ff513fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff51c0c52e0 0x7ff51c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:00.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.089+0000 7ff513fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff51c0c52e0 0x7ff51c06d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41370/0 (socket says 172.21.15.91:41370) 2023-11-27T20:44:00.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.089+0000 7ff513fff640 1 -- 172.21.15.91:0/1486661770 learned_addr learned my addr 172.21.15.91:0/1486661770 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:00.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.089+0000 7ff51b7fe640 1 --1- 172.21.15.91:0/1486661770 >> v1:172.21.15.91:6789/0 conn(0x7ff51c14e7f0 0x7ff51c0c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:43714/0 (socket says 172.21.15.91:43714) 2023-11-27T20:44:00.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.090+0000 7ff513fff640 1 -- 172.21.15.91:0/1486661770 >> v1:172.21.15.183:6789/0 conn(0x7ff51c06cd20 legacy=0x7ff51c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:00.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.090+0000 7ff513fff640 1 -- 172.21.15.91:0/1486661770 >> v1:172.21.15.91:6789/0 conn(0x7ff51c14e7f0 legacy=0x7ff51c0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:00.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.090+0000 7ff513fff640 1 -- 172.21.15.91:0/1486661770 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c06c240 con 0x7ff51c0c52e0 2023-11-27T20:44:00.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.091+0000 7ff513fff640 1 --2- 172.21.15.91:0/1486661770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 0x7ff51c06d1e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff504009870 tx=0x7ff50402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d09586bed1c5b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:00.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.091+0000 7ff51affd640 1 -- 172.21.15.91:0/1486661770 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504031870 con 0x7ff51c0c52e0 2023-11-27T20:44:00.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.091+0000 7ff51affd640 1 -- 172.21.15.91:0/1486661770 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5040319d0 con 0x7ff51c0c52e0 2023-11-27T20:44:00.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.091+0000 7ff51affd640 1 -- 172.21.15.91:0/1486661770 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504031d60 con 0x7ff51c0c52e0 2023-11-27T20:44:00.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.092+0000 7ff520b3c640 1 -- 172.21.15.91:0/1486661770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 msgr2=0x7ff51c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:00.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.092+0000 7ff520b3c640 1 --2- 172.21.15.91:0/1486661770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 0x7ff51c06d1e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff504009870 tx=0x7ff50402b910 comp rx=0 tx=0).stop 2023-11-27T20:44:00.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.092+0000 7ff520b3c640 1 -- 172.21.15.91:0/1486661770 shutdown_connections 2023-11-27T20:44:00.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.092+0000 7ff520b3c640 1 --2- 172.21.15.91:0/1486661770 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 0x7ff51c06d1e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:00.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.092+0000 7ff520b3c640 1 -- 172.21.15.91:0/1486661770 >> 172.21.15.91:0/1486661770 conn(0x7ff51c0a77f0 msgr2=0x7ff51c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:00.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.092+0000 7ff520b3c640 1 -- 172.21.15.91:0/1486661770 shutdown_connections 2023-11-27T20:44:00.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.092+0000 7ff520b3c640 1 -- 172.21.15.91:0/1486661770 wait complete. 2023-11-27T20:44:00.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.094+0000 7ff520b3c640 1 Processor -- start 2023-11-27T20:44:00.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.094+0000 7ff520b3c640 1 -- start start 2023-11-27T20:44:00.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff520b3c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c06cd20 0x7ff51c1da980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:00.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff520b3c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 0x7ff51c1422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:00.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff520b3c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c14e7f0 0x7ff51c1427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:00.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff520b3c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1e5ab0 con 0x7ff51c0c52e0 2023-11-27T20:44:00.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff520b3c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1e5d70 con 0x7ff51c14e7f0 2023-11-27T20:44:00.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff520b3c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1e6050 con 0x7ff51c06cd20 2023-11-27T20:44:00.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff513fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 0x7ff51c1422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:00.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff513fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 0x7ff51c1422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41384/0 (socket says 172.21.15.91:41384) 2023-11-27T20:44:00.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff513fff640 1 -- 172.21.15.91:0/2587025754 learned_addr learned my addr 172.21.15.91:0/2587025754 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:00.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff513fff640 1 -- 172.21.15.91:0/2587025754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c06cd20 msgr2=0x7ff51c1da980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:00.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff513fff640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c06cd20 0x7ff51c1da980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:00.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff513fff640 1 -- 172.21.15.91:0/2587025754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c14e7f0 msgr2=0x7ff51c1427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:00.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff513fff640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c14e7f0 0x7ff51c1427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:00.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.095+0000 7ff513fff640 1 -- 172.21.15.91:0/2587025754 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040094d0 con 0x7ff51c0c52e0 2023-11-27T20:44:00.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.096+0000 7ff513fff640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 0x7ff51c1422a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff504009870 tx=0x7ff5040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:00.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.096+0000 7ff518ff9640 1 -- 172.21.15.91:0/2587025754 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504031820 con 0x7ff51c0c52e0 2023-11-27T20:44:00.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.096+0000 7ff518ff9640 1 -- 172.21.15.91:0/2587025754 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5040443f0 con 0x7ff51c0c52e0 2023-11-27T20:44:00.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.096+0000 7ff518ff9640 1 -- 172.21.15.91:0/2587025754 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040447a0 con 0x7ff51c0c52e0 2023-11-27T20:44:00.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.096+0000 7ff520b3c640 1 -- 172.21.15.91:0/2587025754 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c1e6330 con 0x7ff51c0c52e0 2023-11-27T20:44:00.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.096+0000 7ff520b3c640 1 -- 172.21.15.91:0/2587025754 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c142d20 con 0x7ff51c0c52e0 2023-11-27T20:44:00.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.097+0000 7ff520b3c640 1 -- 172.21.15.91:0/2587025754 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c1e6850 con 0x7ff51c0c52e0 2023-11-27T20:44:00.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.098+0000 7ff518ff9640 1 -- 172.21.15.91:0/2587025754 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff50404d450 con 0x7ff51c0c52e0 2023-11-27T20:44:00.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.099+0000 7ff518ff9640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4fc06b1c0 0x7ff4fc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:00.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.099+0000 7ff518ff9640 1 -- 172.21.15.91:0/2587025754 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff50402d040 con 0x7ff51c0c52e0 2023-11-27T20:44:00.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.099+0000 7ff51b7fe640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4fc06b1c0 0x7ff4fc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:00.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.100+0000 7ff51b7fe640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4fc06b1c0 0x7ff4fc06d680 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff50c001540 tx=0x7ff50c0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:00.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.104+0000 7ff518ff9640 1 -- 172.21.15.91:0/2587025754 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff5040dee90 con 0x7ff51c0c52e0 2023-11-27T20:44:00.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.326+0000 7ff520b3c640 1 -- 172.21.15.91:0/2587025754 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff51c04e840 con 0x7ff51c0c52e0 2023-11-27T20:44:00.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.326+0000 7ff518ff9640 1 -- 172.21.15.91:0/2587025754 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff504076f50 con 0x7ff51c0c52e0 2023-11-27T20:44:00.327 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:44:00.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 -- 172.21.15.91:0/2587025754 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4fc06b1c0 msgr2=0x7ff4fc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4fc06b1c0 0x7ff4fc06d680 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff50c001540 tx=0x7ff50c0079c0 comp rx=0 tx=0).stop 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 -- 172.21.15.91:0/2587025754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 msgr2=0x7ff51c1422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 0x7ff51c1422a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff504009870 tx=0x7ff5040046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 -- 172.21.15.91:0/2587025754 shutdown_connections 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff4fc06b1c0 0x7ff4fc06d680 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c14e7f0 0x7ff51c1427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c0c52e0 0x7ff51c1422a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 --2- 172.21.15.91:0/2587025754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c06cd20 0x7ff51c1da980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 -- 172.21.15.91:0/2587025754 >> 172.21.15.91:0/2587025754 conn(0x7ff51c0a77f0 msgr2=0x7ff51c146670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 -- 172.21.15.91:0/2587025754 shutdown_connections 2023-11-27T20:44:00.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:00.329+0000 7ff520b3c640 1 -- 172.21.15.91:0/2587025754 wait complete. 2023-11-27T20:44:00.347 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T20:44:00.347 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:44:00.347 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-27T20:44:00.347 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T20:44:00.347 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:44:00.347 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T20:44:00.347 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:44:00.347 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:44:00.347 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:44:00.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:00.348 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-27T20:44:00.394 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-27T20:44:00.395 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 42182sec preferred_lft 42182sec 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:00.396 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::c0c6:34ff:feb5:e67/64 scope link 2023-11-27T20:44:00.397 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:00.397 INFO:teuthology.orchestra.run.smithi091.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:44:00.397 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:44:00.397 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::d8e3:6ff:fe8b:3b7f/64 scope link 2023-11-27T20:44:00.397 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:00.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:00.398 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:44:00.483 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-27T20:44:00.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:00.487 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-27T20:44:00.542 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-27T20:44:00.542 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:44:00.542 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:44:00.542 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:44:00.542 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:44:00.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:00.543 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:44:00.543 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:44:00.543 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:44:00.543 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:44:00.543 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:44:00.543 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:44:00.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:00.727 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T20:44:00.780 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T20:44:00.780 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:44:00.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:00.781 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-11-27T20:44:00.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:44:00.872 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T20:44:00.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:44:00.926 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:44:00.975 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:44:00.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:00.975 DEBUG:teuthology.orchestra.run.smithi091:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:44:01.115 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:44:01.115 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:44:01.115 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:44:01.139 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:44:01.139 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:44:01.139 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:44:01.139 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:44:01.139 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:44:01.167 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:44:01.167 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:44:01.168 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:44:01.168 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:44:01.168 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:44:01.168 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:44:01.168 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:44:01.168 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:44:01.169 INFO:teuthology.orchestra.run.smithi091.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-27T20:44:01.169 INFO:teuthology.orchestra.run.smithi091.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:44:01.170 INFO:teuthology.orchestra.run.smithi091.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:44:01.170 INFO:teuthology.orchestra.run.smithi091.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:44:01.170 INFO:teuthology.orchestra.run.smithi091.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:44:01.175 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:44:01.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:01.175 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:44:01.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:01.262 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:44:01.323 INFO:teuthology.orchestra.run.smithi091.stdout:client4739 2023-11-27T20:44:01.324 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:44:01.324 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:01.374 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:44:01.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.583+0000 7f88c17b0640 1 Processor -- start 2023-11-27T20:44:01.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.583+0000 7f88c17b0640 1 -- start start 2023-11-27T20:44:01.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.585+0000 7f88c17b0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f88bc151fd0 0x7f88bc06e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:01.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.585+0000 7f88c17b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88bc0c3400 0x7f88bc06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:01.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.585+0000 7f88c17b0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f88bc06aa40 0x7f88bc157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:01.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.585+0000 7f88c17b0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88bc06ee50 con 0x7f88bc06aa40 2023-11-27T20:44:01.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.585+0000 7f88c17b0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88bc071fd0 con 0x7f88bc151fd0 2023-11-27T20:44:01.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.585+0000 7f88c17b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc072220 con 0x7f88bc0c3400 2023-11-27T20:44:01.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.585+0000 7f88bb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f88bc06aa40 0x7f88bc157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:01.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.586+0000 7f88bb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f88bc06aa40 0x7f88bc157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41386/0 (socket says 172.21.15.91:41386) 2023-11-27T20:44:01.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.586+0000 7f88bb7fe640 1 -- 172.21.15.91:0/1746301250 learned_addr learned my addr 172.21.15.91:0/1746301250 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.586+0000 7f88baffd640 1 --2- 172.21.15.91:0/1746301250 >> v2:172.21.15.183:3300/0 conn(0x7f88bc151fd0 0x7f88bc06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.586+0000 7f88ba7fc640 1 --2- 172.21.15.91:0/1746301250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88bc0c3400 0x7f88bc06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.586+0000 7f88bb7fe640 1 -- 172.21.15.91:0/1746301250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88bc0c3400 msgr2=0x7f88bc06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.586+0000 7f88bb7fe640 1 --2- 172.21.15.91:0/1746301250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88bc0c3400 0x7f88bc06a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.586+0000 7f88bb7fe640 1 -- 172.21.15.91:0/1746301250 >> v2:172.21.15.183:3300/0 conn(0x7f88bc151fd0 msgr2=0x7f88bc06e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:01.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.586+0000 7f88bb7fe640 1 --2- 172.21.15.91:0/1746301250 >> v2:172.21.15.183:3300/0 conn(0x7f88bc151fd0 0x7f88bc06e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.586+0000 7f88bb7fe640 1 -- 172.21.15.91:0/1746301250 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc06e0d0 con 0x7f88bc06aa40 2023-11-27T20:44:01.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.587+0000 7f88bb7fe640 1 --2- 172.21.15.91:0/1746301250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 0x7f88bc157fe0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0c17b0 tx=0x7f88b402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb71e30e561fd156 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:01.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.587+0000 7f88b9ffb640 1 -- 172.21.15.91:0/1746301250 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b402ca80 con 0x7f88bc06aa40 2023-11-27T20:44:01.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.587+0000 7f88b9ffb640 1 -- 172.21.15.91:0/1746301250 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b402cbe0 con 0x7f88bc06aa40 2023-11-27T20:44:01.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.588+0000 7f88b9ffb640 1 -- 172.21.15.91:0/1746301250 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40343f0 con 0x7f88bc06aa40 2023-11-27T20:44:01.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.588+0000 7f88c17b0640 1 -- 172.21.15.91:0/1746301250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 msgr2=0x7f88bc157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:01.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.588+0000 7f88c17b0640 1 --2- 172.21.15.91:0/1746301250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 0x7f88bc157fe0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0c17b0 tx=0x7f88b402bee0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.588+0000 7f88c17b0640 1 -- 172.21.15.91:0/1746301250 shutdown_connections 2023-11-27T20:44:01.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.588+0000 7f88c17b0640 1 --2- 172.21.15.91:0/1746301250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 0x7f88bc157fe0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.588+0000 7f88c17b0640 1 --2- 172.21.15.91:0/1746301250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88bc0c3400 0x7f88bc06a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.588+0000 7f88c17b0640 1 --2- 172.21.15.91:0/1746301250 >> v2:172.21.15.183:3300/0 conn(0x7f88bc151fd0 0x7f88bc06e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.588+0000 7f88c17b0640 1 -- 172.21.15.91:0/1746301250 >> 172.21.15.91:0/1746301250 conn(0x7f88bc0c6ee0 msgr2=0x7f88bc0c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:01.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.589+0000 7f88c17b0640 1 -- 172.21.15.91:0/1746301250 shutdown_connections 2023-11-27T20:44:01.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.589+0000 7f88c17b0640 1 -- 172.21.15.91:0/1746301250 wait complete. 2023-11-27T20:44:01.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.590+0000 7f88c17b0640 1 Processor -- start 2023-11-27T20:44:01.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.590+0000 7f88c17b0640 1 -- start start 2023-11-27T20:44:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.591+0000 7f88c17b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 0x7f88bc14a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.591+0000 7f88c17b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88bc0c3400 0x7f88bc14ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.591+0000 7f88c17b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88bc151fd0 0x7f88bc0aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.591+0000 7f88c17b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc0a88b0 con 0x7f88bc06aa40 2023-11-27T20:44:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.591+0000 7f88c17b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc1497e0 con 0x7f88bc0c3400 2023-11-27T20:44:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.591+0000 7f88c17b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc14e5c0 con 0x7f88bc151fd0 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.592+0000 7f88baffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 0x7f88bc14a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.592+0000 7f88baffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 0x7f88bc14a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41402/0 (socket says 172.21.15.91:41402) 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.592+0000 7f88baffd640 1 -- 172.21.15.91:0/3198778640 learned_addr learned my addr 172.21.15.91:0/3198778640 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.592+0000 7f88ba7fc640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88bc0c3400 0x7f88bc14ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.592+0000 7f88baffd640 1 -- 172.21.15.91:0/3198778640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88bc151fd0 msgr2=0x7f88bc0aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.592+0000 7f88baffd640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88bc151fd0 0x7f88bc0aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.592+0000 7f88baffd640 1 -- 172.21.15.91:0/3198778640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88bc0c3400 msgr2=0x7f88bc14ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.592+0000 7f88baffd640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88bc0c3400 0x7f88bc14ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.592+0000 7f88baffd640 1 -- 172.21.15.91:0/3198778640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009b30 con 0x7f88bc06aa40 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.592+0000 7f88baffd640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 0x7f88bc14a000 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00d5f0 tx=0x7f88ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.593+0000 7f88a37fe640 1 -- 172.21.15.91:0/3198778640 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0125f0 con 0x7f88bc06aa40 2023-11-27T20:44:01.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.593+0000 7f88a37fe640 1 -- 172.21.15.91:0/3198778640 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac012750 con 0x7f88bc06aa40 2023-11-27T20:44:01.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.593+0000 7f88a37fe640 1 -- 172.21.15.91:0/3198778640 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac012b00 con 0x7f88bc06aa40 2023-11-27T20:44:01.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.593+0000 7f88c17b0640 1 -- 172.21.15.91:0/3198778640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88bc149500 con 0x7f88bc06aa40 2023-11-27T20:44:01.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.593+0000 7f88c17b0640 1 -- 172.21.15.91:0/3198778640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc14e250 con 0x7f88bc06aa40 2023-11-27T20:44:01.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.594+0000 7f88c17b0640 1 -- 172.21.15.91:0/3198778640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88bc14ddd0 con 0x7f88bc06aa40 2023-11-27T20:44:01.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.595+0000 7f88a37fe640 1 -- 172.21.15.91:0/3198778640 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f88ac012c60 con 0x7f88bc06aa40 2023-11-27T20:44:01.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.596+0000 7f88a37fe640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88a806b1c0 0x7f88a806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:01.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.596+0000 7f88a37fe640 1 -- 172.21.15.91:0/3198778640 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88ac089e90 con 0x7f88bc06aa40 2023-11-27T20:44:01.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.596+0000 7f88ba7fc640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88a806b1c0 0x7f88a806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:01.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.597+0000 7f88ba7fc640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88a806b1c0 0x7f88a806d680 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0c69b0 tx=0x7f88b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:01.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.601+0000 7f88a37fe640 1 -- 172.21.15.91:0/3198778640 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f88bc14ddd0 con 0x7f88bc06aa40 2023-11-27T20:44:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.830+0000 7f88c17b0640 1 -- 172.21.15.91:0/3198778640 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88bc14ddd0 con 0x7f88bc06aa40 2023-11-27T20:44:01.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.831+0000 7f88a37fe640 1 -- 172.21.15.91:0/3198778640 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f88bc14ddd0 con 0x7f88bc06aa40 2023-11-27T20:44:01.831 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:44:01.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 -- 172.21.15.91:0/3198778640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88a806b1c0 msgr2=0x7f88a806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:01.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88a806b1c0 0x7f88a806d680 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0c69b0 tx=0x7f88b0008040 comp rx=0 tx=0).stop 2023-11-27T20:44:01.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 -- 172.21.15.91:0/3198778640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 msgr2=0x7f88bc14a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:01.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 0x7f88bc14a000 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00d5f0 tx=0x7f88ac00dab0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 -- 172.21.15.91:0/3198778640 shutdown_connections 2023-11-27T20:44:01.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88bc151fd0 0x7f88bc0aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88a806b1c0 0x7f88a806d680 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88bc0c3400 0x7f88bc14ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 --2- 172.21.15.91:0/3198778640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88bc06aa40 0x7f88bc14a000 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:01.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 -- 172.21.15.91:0/3198778640 >> 172.21.15.91:0/3198778640 conn(0x7f88bc0c6ee0 msgr2=0x7f88bc0c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:01.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 -- 172.21.15.91:0/3198778640 shutdown_connections 2023-11-27T20:44:01.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:01.833+0000 7f88c17b0640 1 -- 172.21.15.91:0/3198778640 wait complete. 2023-11-27T20:44:01.851 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T20:44:01.851 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:44:01.851 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-27T20:44:01.852 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-27T20:44:01.852 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T20:44:01.852 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T20:44:01.852 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:44:01.852 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:44:01.852 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:44:01.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:01.852 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-27T20:44:01.913 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:44:01.913 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:44:01.913 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:44:01.913 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:01.913 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-27T20:44:01.914 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:01.914 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:01.914 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:01.914 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-27T20:44:01.914 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:01.914 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:01.914 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-27T20:44:01.914 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:01.914 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:01.914 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:44:01.915 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:01.915 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:44:01.915 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42217sec preferred_lft 42217sec 2023-11-27T20:44:01.915 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-27T20:44:01.915 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:01.915 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:44:01.915 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:01.915 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:44:01.915 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:01.915 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8479:57ff:fe06:e35b/64 scope link 2023-11-27T20:44:01.916 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:01.916 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:44:01.916 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T20:44:01.916 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::40e4:26ff:fe7f:e25/64 scope link 2023-11-27T20:44:01.916 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:01.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:01.918 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:44:02.009 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-27T20:44:02.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:02.013 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-27T20:44:02.068 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-27T20:44:02.068 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:44:02.068 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:44:02.068 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:44:02.068 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:44:02.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:02.069 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:44:02.069 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:44:02.069 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:44:02.070 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:44:02.070 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:44:02.070 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:44:02.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:02.251 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-27T20:44:02.305 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-27T20:44:02.306 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:44:02.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:02.306 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-11-27T20:44:02.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:44:02.401 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-27T20:44:02.455 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:44:02.455 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:44:02.456 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:44:02.506 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:44:02.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:02.507 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:44:02.643 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:44:02.643 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:44:02.643 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:44:02.665 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:44:02.665 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:44:02.665 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:44:02.665 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:44:02.665 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:44:02.693 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:44:02.694 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:44:02.694 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:44:02.694 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:44:02.694 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:44:02.694 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:44:02.695 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:44:02.695 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:44:02.695 INFO:teuthology.orchestra.run.smithi183.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-27T20:44:02.696 INFO:teuthology.orchestra.run.smithi183.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:44:02.696 INFO:teuthology.orchestra.run.smithi183.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:44:02.696 INFO:teuthology.orchestra.run.smithi183.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:44:02.696 INFO:teuthology.orchestra.run.smithi183.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:44:02.699 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:44:02.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:02.699 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:44:02.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:02.785 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:44:02.838 INFO:teuthology.orchestra.run.smithi183.stdout:client5059 2023-11-27T20:44:02.839 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:44:02.839 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:02.888 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-27T20:44:03.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.113+0000 7ff539b48640 1 Processor -- start 2023-11-27T20:44:03.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.114+0000 7ff539b48640 1 -- start start 2023-11-27T20:44:03.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.115+0000 7ff539b48640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff53414fd30 0x7ff534152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.115+0000 7ff539b48640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340c64a0 con 0x7ff5340c3ea0 2023-11-27T20:44:03.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.115+0000 7ff539b48640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340c5c00 con 0x7ff53406d0a0 2023-11-27T20:44:03.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.115+0000 7ff539b48640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5340c5ee0 con 0x7ff53414fd30 2023-11-27T20:44:03.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.116+0000 7ff533fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff5340c3ea0 0x7ff5340c4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:43728/0 (socket says 172.21.15.91:43728) 2023-11-27T20:44:03.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.116+0000 7ff533fff640 1 -- 172.21.15.91:0/4149315628 learned_addr learned my addr 172.21.15.91:0/4149315628 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:03.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.116+0000 7ff5337fe640 1 --2- 172.21.15.91:0/4149315628 >> v2:172.21.15.183:3300/0 conn(0x7ff53414fd30 0x7ff534152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.116+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568685526 0 0) 0x7ff5340c64a0 con 0x7ff5340c3ea0 2023-11-27T20:44:03.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.116+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff51c003520 con 0x7ff5340c3ea0 2023-11-27T20:44:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.116+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2038366658 0 0) 0x7ff51c003520 con 0x7ff5340c3ea0 2023-11-27T20:44:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 >> v2:172.21.15.183:3300/0 conn(0x7ff53414fd30 msgr2=0x7ff534152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 --2- 172.21.15.91:0/4149315628 >> v2:172.21.15.183:3300/0 conn(0x7ff53414fd30 0x7ff534152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 >> v1:172.21.15.183:6789/0 conn(0x7ff53406d0a0 legacy=0x7ff5340a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340c61c0 con 0x7ff5340c3ea0 2023-11-27T20:44:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7ff52c0019f0 con 0x7ff5340c3ea0 2023-11-27T20:44:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 >> v1:172.21.15.91:6789/0 conn(0x7ff5340c3ea0 legacy=0x7ff5340c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 --2- 172.21.15.91:0/4149315628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c003970 0x7ff51c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 --2- 172.21.15.91:0/4149315628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c0047c0 0x7ff51c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 --2- 172.21.15.91:0/4149315628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c005180 0x7ff51c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340c5ee0 con 0x7ff51c003970 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c00c020 con 0x7ff51c005180 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c00c1e0 con 0x7ff51c0047c0 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5337fe640 1 --2- 172.21.15.91:0/4149315628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c003970 0x7ff51c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5337fe640 1 -- 172.21.15.91:0/4149315628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c0047c0 msgr2=0x7ff51c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff532ffd640 1 --2- 172.21.15.91:0/4149315628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c0047c0 0x7ff51c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5337fe640 1 --2- 172.21.15.91:0/4149315628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c0047c0 0x7ff51c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5337fe640 1 -- 172.21.15.91:0/4149315628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c005180 msgr2=0x7ff51c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.117+0000 7ff5337fe640 1 --2- 172.21.15.91:0/4149315628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff51c005180 0x7ff51c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.118+0000 7ff533fff640 1 -- 172.21.15.91:0/4149315628 reap_dead start 2023-11-27T20:44:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.118+0000 7ff5337fe640 1 -- 172.21.15.91:0/4149315628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c003520 con 0x7ff51c003970 2023-11-27T20:44:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.119+0000 7ff5337fe640 1 --2- 172.21.15.91:0/4149315628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c003970 0x7ff51c003d90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff524009ac0 tx=0x7ff51c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3f7115f536bc1a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.119+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52402c710 con 0x7ff51c003970 2023-11-27T20:44:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.119+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52402c870 con 0x7ff51c003970 2023-11-27T20:44:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.119+0000 7ff5327fc640 1 -- 172.21.15.91:0/4149315628 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52402cc00 con 0x7ff51c003970 2023-11-27T20:44:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.119+0000 7ff539b48640 1 -- 172.21.15.91:0/4149315628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c003970 msgr2=0x7ff51c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.119+0000 7ff539b48640 1 --2- 172.21.15.91:0/4149315628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c003970 0x7ff51c003d90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff524009ac0 tx=0x7ff51c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.119+0000 7ff539b48640 1 -- 172.21.15.91:0/4149315628 shutdown_connections 2023-11-27T20:44:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.119+0000 7ff539b48640 1 --2- 172.21.15.91:0/4149315628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff51c003970 0x7ff51c003d90 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.119+0000 7ff539b48640 1 -- 172.21.15.91:0/4149315628 >> 172.21.15.91:0/4149315628 conn(0x7ff53406a500 msgr2=0x7ff53406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.120+0000 7ff539b48640 1 -- 172.21.15.91:0/4149315628 shutdown_connections 2023-11-27T20:44:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.120+0000 7ff539b48640 1 -- 172.21.15.91:0/4149315628 wait complete. 2023-11-27T20:44:03.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.121+0000 7ff539b48640 1 Processor -- start 2023-11-27T20:44:03.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.121+0000 7ff539b48640 1 -- start start 2023-11-27T20:44:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.122+0000 7ff539b48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c003970 0x7ff5341de510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.122+0000 7ff539b48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5340a6c30 0x7ff5341edc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.122+0000 7ff539b48640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5341ee190 0x7ff5341dec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.122+0000 7ff539b48640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534152180 con 0x7ff5341ee190 2023-11-27T20:44:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.122+0000 7ff539b48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534152460 con 0x7ff5340a6c30 2023-11-27T20:44:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.122+0000 7ff539b48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5341dbe70 con 0x7ff51c003970 2023-11-27T20:44:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff533fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5341ee190 0x7ff5341dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff533fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5341ee190 0x7ff5341dec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41412/0 (socket says 172.21.15.91:41412) 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff533fff640 1 -- 172.21.15.91:0/2327552347 learned_addr learned my addr 172.21.15.91:0/2327552347 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff5337fe640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c003970 0x7ff5341de510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff532ffd640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5340a6c30 0x7ff5341edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff533fff640 1 -- 172.21.15.91:0/2327552347 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c003970 msgr2=0x7ff5341de510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff533fff640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c003970 0x7ff5341de510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff533fff640 1 -- 172.21.15.91:0/2327552347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5340a6c30 msgr2=0x7ff5341edc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff533fff640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5340a6c30 0x7ff5341edc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff533fff640 1 -- 172.21.15.91:0/2327552347 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5341dc150 con 0x7ff5341ee190 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff5337fe640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c003970 0x7ff5341de510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.123+0000 7ff533fff640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5341ee190 0x7ff5341dec00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff53406b320 tx=0x7ff52c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.124+0000 7ff51bfff640 1 -- 172.21.15.91:0/2327552347 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00cea0 con 0x7ff5341ee190 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.124+0000 7ff51bfff640 1 -- 172.21.15.91:0/2327552347 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c00a610 con 0x7ff5341ee190 2023-11-27T20:44:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.124+0000 7ff51bfff640 1 -- 172.21.15.91:0/2327552347 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00a9a0 con 0x7ff5341ee190 2023-11-27T20:44:03.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.124+0000 7ff539b48640 1 -- 172.21.15.91:0/2327552347 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5341dc430 con 0x7ff5341ee190 2023-11-27T20:44:03.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.124+0000 7ff539b48640 1 -- 172.21.15.91:0/2327552347 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5341ee610 con 0x7ff5341ee190 2023-11-27T20:44:03.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.125+0000 7ff539b48640 1 -- 172.21.15.91:0/2327552347 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5341ed970 con 0x7ff5341ee190 2023-11-27T20:44:03.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.126+0000 7ff51bfff640 1 -- 172.21.15.91:0/2327552347 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff52c00ab00 con 0x7ff5341ee190 2023-11-27T20:44:03.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.127+0000 7ff51bfff640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff52006b1f0 0x7ff52006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.127+0000 7ff51bfff640 1 -- 172.21.15.91:0/2327552347 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff52c0892d0 con 0x7ff5341ee190 2023-11-27T20:44:03.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.127+0000 7ff5337fe640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff52006b1f0 0x7ff52006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.128+0000 7ff5337fe640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff52006b1f0 0x7ff52006d6b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff524036000 tx=0x7ff524030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:03.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.132+0000 7ff51bfff640 1 -- 172.21.15.91:0/2327552347 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff5341ed970 con 0x7ff5341ee190 2023-11-27T20:44:03.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.389+0000 7ff539b48640 1 -- 172.21.15.91:0/2327552347 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7ff5341ed970 con 0x7ff5341ee190 2023-11-27T20:44:03.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.390+0000 7ff51bfff640 1 -- 172.21.15.91:0/2327552347 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v19) v1 ==== 84+0+0 (secure 0 0 0) 0x7ff5341ed970 con 0x7ff5341ee190 2023-11-27T20:44:03.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.393+0000 7ff539b48640 1 -- 172.21.15.91:0/2327552347 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff52006b1f0 msgr2=0x7ff52006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.393+0000 7ff539b48640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff52006b1f0 0x7ff52006d6b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff524036000 tx=0x7ff524030000 comp rx=0 tx=0).stop 2023-11-27T20:44:03.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.393+0000 7ff539b48640 1 -- 172.21.15.91:0/2327552347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5341ee190 msgr2=0x7ff5341dec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.393+0000 7ff539b48640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5341ee190 0x7ff5341dec00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff53406b320 tx=0x7ff52c00cc50 comp rx=0 tx=0).stop 2023-11-27T20:44:03.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.393+0000 7ff539b48640 1 -- 172.21.15.91:0/2327552347 shutdown_connections 2023-11-27T20:44:03.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.393+0000 7ff539b48640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5341ee190 0x7ff5341dec00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.393+0000 7ff539b48640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff52006b1f0 0x7ff52006d6b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.394+0000 7ff539b48640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5340a6c30 0x7ff5341edc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.394+0000 7ff539b48640 1 --2- 172.21.15.91:0/2327552347 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff51c003970 0x7ff5341de510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.394+0000 7ff539b48640 1 -- 172.21.15.91:0/2327552347 >> 172.21.15.91:0/2327552347 conn(0x7ff53406a500 msgr2=0x7ff5340712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:03.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.394+0000 7ff539b48640 1 -- 172.21.15.91:0/2327552347 shutdown_connections 2023-11-27T20:44:03.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.394+0000 7ff539b48640 1 -- 172.21.15.91:0/2327552347 wait complete. 2023-11-27T20:44:03.415 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:03.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.626+0000 7f7b5761e640 1 Processor -- start 2023-11-27T20:44:03.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.626+0000 7f7b5761e640 1 -- start start 2023-11-27T20:44:03.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.627+0000 7f7b5761e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7b500c5ec0 0x7f7b500c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.627+0000 7f7b5761e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b500c45d0 0x7f7b500c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.628+0000 7f7b5761e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b500bfdc0 con 0x7f7b500721a0 2023-11-27T20:44:03.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.628+0000 7f7b5761e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5006e390 con 0x7f7b500c5ec0 2023-11-27T20:44:03.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.628+0000 7f7b5761e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5006ddd0 con 0x7f7b500c45d0 2023-11-27T20:44:03.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.628+0000 7f7b55bbb640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f7b500721a0 0x7f7b50155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:43738/0 (socket says 172.21.15.91:43738) 2023-11-27T20:44:03.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.628+0000 7f7b55bbb640 1 -- 172.21.15.91:0/714302596 learned_addr learned my addr 172.21.15.91:0/714302596 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:03.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.628+0000 7f7b54bb9640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b500c45d0 0x7f7b500c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.628+0000 7f7b553ba640 1 --2- 172.21.15.91:0/714302596 >> v2:172.21.15.183:3300/0 conn(0x7f7b500c5ec0 0x7f7b500c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.628+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668002620 0 0) 0x7f7b500bfdc0 con 0x7f7b500721a0 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.628+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b3c003520 con 0x7f7b500721a0 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2137232104 0 0) 0x7f7b3c003520 con 0x7f7b500721a0 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b500c45d0 msgr2=0x7f7b500c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b500c45d0 0x7f7b500c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 >> v2:172.21.15.183:3300/0 conn(0x7f7b500c5ec0 msgr2=0x7f7b500c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 --2- 172.21.15.91:0/714302596 >> v2:172.21.15.183:3300/0 conn(0x7f7b500c5ec0 0x7f7b500c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5006e0b0 con 0x7f7b500721a0 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f7b48001670 con 0x7f7b500721a0 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 >> v1:172.21.15.91:6789/0 conn(0x7f7b500721a0 legacy=0x7f7b50155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b3c003970 0x7f7b3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b3c0047c0 0x7f7b3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b3c005180 0x7f7b3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5006e390 con 0x7f7b3c005180 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5006ddd0 con 0x7f7b3c003970 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c00c050 con 0x7f7b3c0047c0 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b54bb9640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b500c45d0 0x7f7b500c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.629+0000 7f7b55bbb640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b3c005180 0x7f7b3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.630+0000 7f7b55bbb640 1 -- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b3c0047c0 msgr2=0x7f7b3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.630+0000 7f7b55bbb640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b3c0047c0 0x7f7b3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.630+0000 7f7b55bbb640 1 -- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b3c003970 msgr2=0x7f7b3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.630+0000 7f7b553ba640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b3c003970 0x7f7b3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.630+0000 7f7b55bbb640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b3c003970 0x7f7b3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.630+0000 7f7b55bbb640 1 -- 172.21.15.91:0/714302596 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c003520 con 0x7f7b3c005180 2023-11-27T20:44:03.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.630+0000 7f7b553ba640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b3c003970 0x7f7b3c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:03.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.631+0000 7f7b55bbb640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b3c005180 0x7f7b3c00b980 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c240 tx=0x7f7b3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6023b9b0128f7d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:03.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.631+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4802cb00 con 0x7f7b3c005180 2023-11-27T20:44:03.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.631+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4802cc60 con 0x7f7b3c005180 2023-11-27T20:44:03.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.631+0000 7f7b47fff640 1 -- 172.21.15.91:0/714302596 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48005af0 con 0x7f7b3c005180 2023-11-27T20:44:03.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.631+0000 7f7b5761e640 1 -- 172.21.15.91:0/714302596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b3c005180 msgr2=0x7f7b3c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.631+0000 7f7b5761e640 1 --2- 172.21.15.91:0/714302596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b3c005180 0x7f7b3c00b980 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c240 tx=0x7f7b3c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.632+0000 7f7b55bbb640 1 -- 172.21.15.91:0/714302596 reap_dead start 2023-11-27T20:44:03.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.632+0000 7f7b5761e640 1 -- 172.21.15.91:0/714302596 shutdown_connections 2023-11-27T20:44:03.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.632+0000 7f7b5761e640 1 -- 172.21.15.91:0/714302596 >> 172.21.15.91:0/714302596 conn(0x7f7b5006a500 msgr2=0x7f7b5006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:03.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.632+0000 7f7b5761e640 1 -- 172.21.15.91:0/714302596 shutdown_connections 2023-11-27T20:44:03.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.632+0000 7f7b5761e640 1 -- 172.21.15.91:0/714302596 wait complete. 2023-11-27T20:44:03.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.633+0000 7f7b5761e640 1 Processor -- start 2023-11-27T20:44:03.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.634+0000 7f7b5761e640 1 -- start start 2023-11-27T20:44:03.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.634+0000 7f7b5761e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b3c005180 0x7f7b5014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.634+0000 7f7b5761e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b50155650 0x7f7b50151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.634+0000 7f7b5761e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b501524c0 0x7f7b500aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.634+0000 7f7b5761e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b50150410 con 0x7f7b501524c0 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.634+0000 7f7b5761e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b50150900 con 0x7f7b3c005180 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.634+0000 7f7b5761e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b501ea680 con 0x7f7b50155650 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b55bbb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b501524c0 0x7f7b500aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b55bbb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b501524c0 0x7f7b500aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41434/0 (socket says 172.21.15.91:41434) 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b55bbb640 1 -- 172.21.15.91:0/2947334262 learned_addr learned my addr 172.21.15.91:0/2947334262 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b54bb9640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b50155650 0x7f7b50151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b553ba640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b3c005180 0x7f7b5014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b55bbb640 1 -- 172.21.15.91:0/2947334262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b50155650 msgr2=0x7f7b50151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b55bbb640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b50155650 0x7f7b50151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b55bbb640 1 -- 172.21.15.91:0/2947334262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b3c005180 msgr2=0x7f7b5014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b55bbb640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b3c005180 0x7f7b5014fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b55bbb640 1 -- 172.21.15.91:0/2947334262 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b501ea960 con 0x7f7b501524c0 2023-11-27T20:44:03.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.635+0000 7f7b55bbb640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b501524c0 0x7f7b500aa370 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c240 tx=0x7f7b48001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:03.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.636+0000 7f7b45ffb640 1 -- 172.21.15.91:0/2947334262 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4803c040 con 0x7f7b501524c0 2023-11-27T20:44:03.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.636+0000 7f7b45ffb640 1 -- 172.21.15.91:0/2947334262 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b48001630 con 0x7f7b501524c0 2023-11-27T20:44:03.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.636+0000 7f7b45ffb640 1 -- 172.21.15.91:0/2947334262 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48007270 con 0x7f7b501524c0 2023-11-27T20:44:03.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.636+0000 7f7b5761e640 1 -- 172.21.15.91:0/2947334262 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b500a9b70 con 0x7f7b501524c0 2023-11-27T20:44:03.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.636+0000 7f7b5761e640 1 -- 172.21.15.91:0/2947334262 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b50150590 con 0x7f7b501524c0 2023-11-27T20:44:03.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.637+0000 7f7b5761e640 1 -- 172.21.15.91:0/2947334262 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b500aa090 con 0x7f7b501524c0 2023-11-27T20:44:03.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.638+0000 7f7b45ffb640 1 -- 172.21.15.91:0/2947334262 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7b48032070 con 0x7f7b501524c0 2023-11-27T20:44:03.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.639+0000 7f7b45ffb640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7b3406b1f0 0x7f7b3406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:03.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.640+0000 7f7b45ffb640 1 -- 172.21.15.91:0/2947334262 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b480aa910 con 0x7f7b501524c0 2023-11-27T20:44:03.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.640+0000 7f7b553ba640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7b3406b1f0 0x7f7b3406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:03.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.640+0000 7f7b553ba640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7b3406b1f0 0x7f7b3406d6b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c007440 tx=0x7f7b4c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:03.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.644+0000 7f7b45ffb640 1 -- 172.21.15.91:0/2947334262 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7b500aa090 con 0x7f7b501524c0 2023-11-27T20:44:03.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.834+0000 7f7b5761e640 1 -- 172.21.15.91:0/2947334262 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b500aa090 con 0x7f7b501524c0 2023-11-27T20:44:03.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.836+0000 7f7b45ffb640 1 -- 172.21.15.91:0/2947334262 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f7b500aa090 con 0x7f7b501524c0 2023-11-27T20:44:03.842 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:03.842 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":55,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:43:53.715787+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:03.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 -- 172.21.15.91:0/2947334262 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7b3406b1f0 msgr2=0x7f7b3406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7b3406b1f0 0x7f7b3406d6b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c007440 tx=0x7f7b4c00b040 comp rx=0 tx=0).stop 2023-11-27T20:44:03.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 -- 172.21.15.91:0/2947334262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b501524c0 msgr2=0x7f7b500aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:03.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b501524c0 0x7f7b500aa370 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c240 tx=0x7f7b48001a70 comp rx=0 tx=0).stop 2023-11-27T20:44:03.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 -- 172.21.15.91:0/2947334262 shutdown_connections 2023-11-27T20:44:03.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b501524c0 0x7f7b500aa370 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b50155650 0x7f7b50151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7b3406b1f0 0x7f7b3406d6b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 --2- 172.21.15.91:0/2947334262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b3c005180 0x7f7b5014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:03.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 -- 172.21.15.91:0/2947334262 >> 172.21.15.91:0/2947334262 conn(0x7f7b5006a500 msgr2=0x7f7b500c26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:03.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 -- 172.21.15.91:0/2947334262 shutdown_connections 2023-11-27T20:44:03.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:03.839+0000 7f7b5761e640 1 -- 172.21.15.91:0/2947334262 wait complete. 2023-11-27T20:44:03.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:43:50.043742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:43:51.176510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:44:03.859 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:44:04.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.069+0000 7fa545ee5640 1 Processor -- start 2023-11-27T20:44:04.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.070+0000 7fa545ee5640 1 -- start start 2023-11-27T20:44:04.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.071+0000 7fa545ee5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa5400ab850 0x7fa540152370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.071+0000 7fa545ee5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa5401528b0 0x7fa54006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.071+0000 7fa545ee5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5400aae20 con 0x7fa54014faf0 2023-11-27T20:44:04.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.071+0000 7fa545ee5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5400c2fe0 con 0x7fa5400ab850 2023-11-27T20:44:04.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.071+0000 7fa545ee5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5400a99e0 con 0x7fa5401528b0 2023-11-27T20:44:04.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.072+0000 7fa537fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa5400ab850 0x7fa540152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.072+0000 7fa537fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa5400ab850 0x7fa540152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41612/0 (socket says 172.21.15.91:41612) 2023-11-27T20:44:04.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.072+0000 7fa537fff640 1 -- 172.21.15.91:0/874928197 learned_addr learned my addr 172.21.15.91:0/874928197 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:04.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.072+0000 7fa537fff640 1 -- 172.21.15.91:0/874928197 >> v2:172.21.15.183:3300/0 conn(0x7fa5401528b0 msgr2=0x7fa54006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:04.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.072+0000 7fa537fff640 1 --2- 172.21.15.91:0/874928197 >> v2:172.21.15.183:3300/0 conn(0x7fa5401528b0 0x7fa54006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.072+0000 7fa537fff640 1 -- 172.21.15.91:0/874928197 >> v1:172.21.15.183:6789/0 conn(0x7fa54014faf0 legacy=0x7fa54006e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:04.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.072+0000 7fa537fff640 1 -- 172.21.15.91:0/874928197 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5400c2780 con 0x7fa5400ab850 2023-11-27T20:44:04.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.073+0000 7fa537fff640 1 --2- 172.21.15.91:0/874928197 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5400ab850 0x7fa540152370 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa540066d30 tx=0x7fa52802b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d6c68595ac0e38 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:04.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.073+0000 7fa53effd640 1 -- 172.21.15.91:0/874928197 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528031800 con 0x7fa5400ab850 2023-11-27T20:44:04.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.073+0000 7fa53effd640 1 -- 172.21.15.91:0/874928197 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528031960 con 0x7fa5400ab850 2023-11-27T20:44:04.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.073+0000 7fa53effd640 1 -- 172.21.15.91:0/874928197 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528031cf0 con 0x7fa5400ab850 2023-11-27T20:44:04.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.074+0000 7fa545ee5640 1 -- 172.21.15.91:0/874928197 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5400ab850 msgr2=0x7fa540152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.074+0000 7fa545ee5640 1 --2- 172.21.15.91:0/874928197 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5400ab850 0x7fa540152370 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa540066d30 tx=0x7fa52802b8a0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.074+0000 7fa545ee5640 1 -- 172.21.15.91:0/874928197 shutdown_connections 2023-11-27T20:44:04.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.074+0000 7fa545ee5640 1 --2- 172.21.15.91:0/874928197 >> v2:172.21.15.183:3300/0 conn(0x7fa5401528b0 0x7fa54006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.074+0000 7fa545ee5640 1 --2- 172.21.15.91:0/874928197 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5400ab850 0x7fa540152370 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.074+0000 7fa545ee5640 1 -- 172.21.15.91:0/874928197 >> 172.21.15.91:0/874928197 conn(0x7fa5400c3120 msgr2=0x7fa5400c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:04.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.074+0000 7fa545ee5640 1 -- 172.21.15.91:0/874928197 shutdown_connections 2023-11-27T20:44:04.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.074+0000 7fa545ee5640 1 -- 172.21.15.91:0/874928197 wait complete. 2023-11-27T20:44:04.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.076+0000 7fa545ee5640 1 Processor -- start 2023-11-27T20:44:04.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.076+0000 7fa545ee5640 1 -- start start 2023-11-27T20:44:04.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.077+0000 7fa545ee5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5400ab850 0x7fa5400bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.077+0000 7fa545ee5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54014faf0 0x7fa540151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.077+0000 7fa545ee5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5401528b0 0x7fa5401520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.077+0000 7fa545ee5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400c5ab0 con 0x7fa5401528b0 2023-11-27T20:44:04.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.077+0000 7fa545ee5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401ee0a0 con 0x7fa54014faf0 2023-11-27T20:44:04.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.077+0000 7fa545ee5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401ee5d0 con 0x7fa5400ab850 2023-11-27T20:44:04.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.077+0000 7fa53ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5401528b0 0x7fa5401520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.077+0000 7fa53ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5401528b0 0x7fa5401520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41626/0 (socket says 172.21.15.91:41626) 2023-11-27T20:44:04.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.077+0000 7fa53ffff640 1 -- 172.21.15.91:0/888366517 learned_addr learned my addr 172.21.15.91:0/888366517 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:04.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa537fff640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54014faf0 0x7fa540151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53f7fe640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5400ab850 0x7fa5400bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53ffff640 1 -- 172.21.15.91:0/888366517 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5400ab850 msgr2=0x7fa5400bfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53ffff640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5400ab850 0x7fa5400bfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53ffff640 1 -- 172.21.15.91:0/888366517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54014faf0 msgr2=0x7fa540151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53ffff640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54014faf0 0x7fa540151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53ffff640 1 -- 172.21.15.91:0/888366517 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5280094d0 con 0x7fa5401528b0 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53f7fe640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5400ab850 0x7fa5400bfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa537fff640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54014faf0 0x7fa540151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53ffff640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5401528b0 0x7fa5401520d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa53800b970 tx=0x7fa53800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53cff9640 1 -- 172.21.15.91:0/888366517 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53800cb40 con 0x7fa5401528b0 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53cff9640 1 -- 172.21.15.91:0/888366517 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53800ccc0 con 0x7fa5401528b0 2023-11-27T20:44:04.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa53cff9640 1 -- 172.21.15.91:0/888366517 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538014680 con 0x7fa5401528b0 2023-11-27T20:44:04.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.078+0000 7fa545ee5640 1 -- 172.21.15.91:0/888366517 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5400714f0 con 0x7fa5401528b0 2023-11-27T20:44:04.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.079+0000 7fa545ee5640 1 -- 172.21.15.91:0/888366517 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540070ea0 con 0x7fa5401528b0 2023-11-27T20:44:04.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.080+0000 7fa545ee5640 1 -- 172.21.15.91:0/888366517 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5400a9850 con 0x7fa5401528b0 2023-11-27T20:44:04.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.081+0000 7fa53cff9640 1 -- 172.21.15.91:0/888366517 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa53801d3b0 con 0x7fa5401528b0 2023-11-27T20:44:04.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.081+0000 7fa53cff9640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52006b1f0 0x7fa52006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.081+0000 7fa53cff9640 1 -- 172.21.15.91:0/888366517 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa538089900 con 0x7fa5401528b0 2023-11-27T20:44:04.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.082+0000 7fa53f7fe640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52006b1f0 0x7fa52006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.082+0000 7fa53f7fe640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52006b1f0 0x7fa52006d6b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa530007fd0 tx=0x7fa530009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:04.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.086+0000 7fa53cff9640 1 -- 172.21.15.91:0/888366517 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa5380546c0 con 0x7fa5401528b0 2023-11-27T20:44:04.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.274+0000 7fa545ee5640 1 -- 172.21.15.91:0/888366517 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa540068350 con 0x7fa5401528b0 2023-11-27T20:44:04.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.275+0000 7fa53cff9640 1 -- 172.21.15.91:0/888366517 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa538019020 con 0x7fa5401528b0 2023-11-27T20:44:04.276 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:44:04.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.277+0000 7fa545ee5640 1 -- 172.21.15.91:0/888366517 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52006b1f0 msgr2=0x7fa52006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.277+0000 7fa545ee5640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52006b1f0 0x7fa52006d6b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa530007fd0 tx=0x7fa530009040 comp rx=0 tx=0).stop 2023-11-27T20:44:04.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.277+0000 7fa545ee5640 1 -- 172.21.15.91:0/888366517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5401528b0 msgr2=0x7fa5401520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.277+0000 7fa545ee5640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5401528b0 0x7fa5401520d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa53800b970 tx=0x7fa53800be30 comp rx=0 tx=0).stop 2023-11-27T20:44:04.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.278+0000 7fa545ee5640 1 -- 172.21.15.91:0/888366517 shutdown_connections 2023-11-27T20:44:04.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.278+0000 7fa545ee5640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5401528b0 0x7fa5401520d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.278+0000 7fa545ee5640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52006b1f0 0x7fa52006d6b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.278+0000 7fa545ee5640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54014faf0 0x7fa540151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.278+0000 7fa545ee5640 1 --2- 172.21.15.91:0/888366517 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5400ab850 0x7fa5400bfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.278+0000 7fa545ee5640 1 -- 172.21.15.91:0/888366517 >> 172.21.15.91:0/888366517 conn(0x7fa5400c3120 msgr2=0x7fa54006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:04.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.278+0000 7fa545ee5640 1 -- 172.21.15.91:0/888366517 shutdown_connections 2023-11-27T20:44:04.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.278+0000 7fa545ee5640 1 -- 172.21.15.91:0/888366517 wait complete. 2023-11-27T20:44:04.297 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:44:04.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.514+0000 7f4775a61640 1 Processor -- start 2023-11-27T20:44:04.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.515+0000 7f4775a61640 1 -- start start 2023-11-27T20:44:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.516+0000 7f4775a61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770155490 0x7f47700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.516+0000 7f4775a61640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700c06c0 con 0x7f47700a9b40 2023-11-27T20:44:04.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.516+0000 7f4775a61640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700c1020 con 0x7f47700c1500 2023-11-27T20:44:04.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.516+0000 7f4775a61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47700a5820 con 0x7f4770155490 2023-11-27T20:44:04.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476f7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f47700a9b40 0x7f47700c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50908/0 (socket says 172.21.15.91:50908) 2023-11-27T20:44:04.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476f7fe640 1 -- 172.21.15.91:0/1435256940 learned_addr learned my addr 172.21.15.91:0/1435256940 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:04.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476effd640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770155490 0x7f47700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585577145 0 0) 0x7f47700c06c0 con 0x7f47700a9b40 2023-11-27T20:44:04.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f475c003520 con 0x7f47700a9b40 2023-11-27T20:44:04.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1124381550 0 0) 0x7f475c003520 con 0x7f47700a9b40 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770155490 msgr2=0x7f47700a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476dffb640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770155490 0x7f47700a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 >> v1:172.21.15.183:6789/0 conn(0x7f47700c1500 legacy=0x7f47700a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47700c0910 con 0x7f47700a9b40 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.517+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f4768001670 con 0x7f47700a9b40 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 >> v1:172.21.15.91:6789/0 conn(0x7f47700a9b40 legacy=0x7f47700c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476dffb640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c0039a0 0x7f475c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476dffb640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770155490 0x7f475c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476dffb640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c004d00 0x7f475c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c00ba30 con 0x7f475c004d00 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c00bb70 con 0x7f475c0039a0 2023-11-27T20:44:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c00bd30 con 0x7f4770155490 2023-11-27T20:44:04.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476f7fe640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c004d00 0x7f475c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476effd640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c0039a0 0x7f475c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476f7fe640 1 -- 172.21.15.91:0/1435256940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770155490 msgr2=0x7f475c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:04.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476f7fe640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4770155490 0x7f475c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476f7fe640 1 -- 172.21.15.91:0/1435256940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c0039a0 msgr2=0x7f475c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:04.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476f7fe640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c0039a0 0x7f475c003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.518+0000 7f476f7fe640 1 -- 172.21.15.91:0/1435256940 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c003520 con 0x7f475c004d00 2023-11-27T20:44:04.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.519+0000 7f476f7fe640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c004d00 0x7f475c005180 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4770067240 tx=0x7f475c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5e27c9359773cd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:04.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.520+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476802ec40 con 0x7f475c004d00 2023-11-27T20:44:04.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.520+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476802edc0 con 0x7f475c004d00 2023-11-27T20:44:04.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.520+0000 7f476dffb640 1 -- 172.21.15.91:0/1435256940 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768005b10 con 0x7f475c004d00 2023-11-27T20:44:04.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.520+0000 7f4775a61640 1 -- 172.21.15.91:0/1435256940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c004d00 msgr2=0x7f475c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.520+0000 7f4775a61640 1 --2- 172.21.15.91:0/1435256940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f475c004d00 0x7f475c005180 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4770067240 tx=0x7f475c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.520+0000 7f476f7fe640 1 -- 172.21.15.91:0/1435256940 reap_dead start 2023-11-27T20:44:04.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.520+0000 7f4775a61640 1 -- 172.21.15.91:0/1435256940 shutdown_connections 2023-11-27T20:44:04.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.520+0000 7f4775a61640 1 -- 172.21.15.91:0/1435256940 >> 172.21.15.91:0/1435256940 conn(0x7f477006a500 msgr2=0x7f477006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:04.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.521+0000 7f4775a61640 1 -- 172.21.15.91:0/1435256940 shutdown_connections 2023-11-27T20:44:04.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.521+0000 7f4775a61640 1 -- 172.21.15.91:0/1435256940 wait complete. 2023-11-27T20:44:04.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.522+0000 7f4775a61640 1 Processor -- start 2023-11-27T20:44:04.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.522+0000 7f4775a61640 1 -- start start 2023-11-27T20:44:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.523+0000 7f4775a61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c004d00 0x7f47700aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.523+0000 7f4775a61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4770151670 0x7f47701df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.523+0000 7f4775a61640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47701df610 0x7f47701dba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.523+0000 7f4775a61640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47701ed0f0 con 0x7f47701df610 2023-11-27T20:44:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.523+0000 7f4775a61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47701ed340 con 0x7f4770151670 2023-11-27T20:44:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.523+0000 7f4775a61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47701ed620 con 0x7f475c004d00 2023-11-27T20:44:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.524+0000 7f476f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47701df610 0x7f47701dba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.524+0000 7f476f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47701df610 0x7f47701dba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41646/0 (socket says 172.21.15.91:41646) 2023-11-27T20:44:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.524+0000 7f476f7fe640 1 -- 172.21.15.91:0/531024690 learned_addr learned my addr 172.21.15.91:0/531024690 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:04.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.524+0000 7f476f7fe640 1 -- 172.21.15.91:0/531024690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c004d00 msgr2=0x7f47700aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.524+0000 7f476f7fe640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c004d00 0x7f47700aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.524+0000 7f476f7fe640 1 -- 172.21.15.91:0/531024690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4770151670 msgr2=0x7f47701df0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.524+0000 7f476f7fe640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4770151670 0x7f47701df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.524+0000 7f476f7fe640 1 -- 172.21.15.91:0/531024690 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47701ed900 con 0x7f47701df610 2023-11-27T20:44:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.524+0000 7f476f7fe640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47701df610 0x7f47701dba90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4768000c00 tx=0x7f4768001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.524+0000 7f4767fff640 1 -- 172.21.15.91:0/531024690 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768006270 con 0x7f47701df610 2023-11-27T20:44:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.525+0000 7f4767fff640 1 -- 172.21.15.91:0/531024690 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47680063d0 con 0x7f47701df610 2023-11-27T20:44:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.525+0000 7f4767fff640 1 -- 172.21.15.91:0/531024690 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476800f1d0 con 0x7f47701df610 2023-11-27T20:44:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.525+0000 7f4775a61640 1 -- 172.21.15.91:0/531024690 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47701edbe0 con 0x7f47701df610 2023-11-27T20:44:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.525+0000 7f4775a61640 1 -- 172.21.15.91:0/531024690 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47700aac80 con 0x7f47701df610 2023-11-27T20:44:04.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.526+0000 7f4775a61640 1 -- 172.21.15.91:0/531024690 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4770068350 con 0x7f47701df610 2023-11-27T20:44:04.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.527+0000 7f4767fff640 1 -- 172.21.15.91:0/531024690 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4768034070 con 0x7f47701df610 2023-11-27T20:44:04.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.528+0000 7f4767fff640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475006b1f0 0x7f475006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.528+0000 7f4767fff640 1 -- 172.21.15.91:0/531024690 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47680aa8a0 con 0x7f47701df610 2023-11-27T20:44:04.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.528+0000 7f476effd640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475006b1f0 0x7f475006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.529+0000 7f476effd640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475006b1f0 0x7f475006d6b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f47700ab280 tx=0x7f4760009750 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:04.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.532+0000 7f4767fff640 1 -- 172.21.15.91:0/531024690 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f47680755c0 con 0x7f47701df610 2023-11-27T20:44:04.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.723+0000 7f4775a61640 1 -- 172.21.15.91:0/531024690 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4770153e60 con 0x7f47701df610 2023-11-27T20:44:04.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.724+0000 7f4767fff640 1 -- 172.21.15.91:0/531024690 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f476803c0a0 con 0x7f47701df610 2023-11-27T20:44:04.726 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 -- 172.21.15.91:0/531024690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475006b1f0 msgr2=0x7f475006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475006b1f0 0x7f475006d6b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f47700ab280 tx=0x7f4760009750 comp rx=0 tx=0).stop 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 -- 172.21.15.91:0/531024690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47701df610 msgr2=0x7f47701dba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47701df610 0x7f47701dba90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4768000c00 tx=0x7f4768001a00 comp rx=0 tx=0).stop 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 -- 172.21.15.91:0/531024690 shutdown_connections 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47701df610 0x7f47701dba90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f475006b1f0 0x7f475006d6b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4770151670 0x7f47701df0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 --2- 172.21.15.91:0/531024690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c004d00 0x7f47700aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 -- 172.21.15.91:0/531024690 >> 172.21.15.91:0/531024690 conn(0x7f477006a500 msgr2=0x7f47700c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 -- 172.21.15.91:0/531024690 shutdown_connections 2023-11-27T20:44:04.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.727+0000 7f4775a61640 1 -- 172.21.15.91:0/531024690 wait complete. 2023-11-27T20:44:04.747 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:44:04.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.957+0000 7fef70ea3640 1 Processor -- start 2023-11-27T20:44:04.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.957+0000 7fef70ea3640 1 -- start start 2023-11-27T20:44:04.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.958+0000 7fef70ea3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef6c14e7c0 0x7fef6c0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.958+0000 7fef70ea3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef6c0c4c00 0x7fef6c0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.958+0000 7fef70ea3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fef6c0ca990 0x7fef6c154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.958+0000 7fef70ea3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c0c5b10 con 0x7fef6c14e7c0 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.958+0000 7fef70ea3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c158a60 con 0x7fef6c0ca990 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.958+0000 7fef70ea3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c157ca0 con 0x7fef6c0c4c00 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.959+0000 7fef6b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef6c14e7c0 0x7fef6c0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.959+0000 7fef6b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef6c14e7c0 0x7fef6c0c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41654/0 (socket says 172.21.15.91:41654) 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.959+0000 7fef6b7fe640 1 -- 172.21.15.91:0/3896466312 learned_addr learned my addr 172.21.15.91:0/3896466312 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.959+0000 7fef6b7fe640 1 -- 172.21.15.91:0/3896466312 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef6c0c4c00 msgr2=0x7fef6c0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.959+0000 7fef6b7fe640 1 --2- 172.21.15.91:0/3896466312 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef6c0c4c00 0x7fef6c0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.959+0000 7fef6b7fe640 1 -- 172.21.15.91:0/3896466312 >> v2:172.21.15.183:3300/0 conn(0x7fef6c0ca990 msgr2=0x7fef6c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.959+0000 7fef6b7fe640 1 --2- 172.21.15.91:0/3896466312 >> v2:172.21.15.183:3300/0 conn(0x7fef6c0ca990 0x7fef6c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.959+0000 7fef6b7fe640 1 -- 172.21.15.91:0/3896466312 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c157f80 con 0x7fef6c14e7c0 2023-11-27T20:44:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.960+0000 7fef6b7fe640 1 --2- 172.21.15.91:0/3896466312 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c14e7c0 0x7fef6c0c46c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fef6c08b9d0 tx=0x7fef5c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b65b51ab714f1a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.960+0000 7fef6a7fc640 1 -- 172.21.15.91:0/3896466312 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c031740 con 0x7fef6c14e7c0 2023-11-27T20:44:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.960+0000 7fef6a7fc640 1 -- 172.21.15.91:0/3896466312 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c0318a0 con 0x7fef6c14e7c0 2023-11-27T20:44:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.960+0000 7fef6a7fc640 1 -- 172.21.15.91:0/3896466312 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c031c30 con 0x7fef6c14e7c0 2023-11-27T20:44:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.961+0000 7fef70ea3640 1 -- 172.21.15.91:0/3896466312 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c14e7c0 msgr2=0x7fef6c0c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.961+0000 7fef70ea3640 1 --2- 172.21.15.91:0/3896466312 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c14e7c0 0x7fef6c0c46c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fef6c08b9d0 tx=0x7fef5c02b7e0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.961+0000 7fef70ea3640 1 -- 172.21.15.91:0/3896466312 shutdown_connections 2023-11-27T20:44:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.961+0000 7fef70ea3640 1 --2- 172.21.15.91:0/3896466312 >> v2:172.21.15.183:3300/0 conn(0x7fef6c0ca990 0x7fef6c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.961+0000 7fef70ea3640 1 --2- 172.21.15.91:0/3896466312 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef6c0c4c00 0x7fef6c0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.961+0000 7fef70ea3640 1 --2- 172.21.15.91:0/3896466312 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c14e7c0 0x7fef6c0c46c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.961+0000 7fef70ea3640 1 -- 172.21.15.91:0/3896466312 >> 172.21.15.91:0/3896466312 conn(0x7fef6c0abf00 msgr2=0x7fef6c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.961+0000 7fef70ea3640 1 -- 172.21.15.91:0/3896466312 shutdown_connections 2023-11-27T20:44:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.961+0000 7fef70ea3640 1 -- 172.21.15.91:0/3896466312 wait complete. 2023-11-27T20:44:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.963+0000 7fef70ea3640 1 Processor -- start 2023-11-27T20:44:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.963+0000 7fef70ea3640 1 -- start start 2023-11-27T20:44:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef70ea3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c0c4c00 0x7fef6c14d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef70ea3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef6c0ca990 0x7fef6c143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef70ea3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef6c14e7c0 0x7fef6c1ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef70ea3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c155b30 con 0x7fef6c0c4c00 2023-11-27T20:44:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef70ea3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0c1f60 con 0x7fef6c0ca990 2023-11-27T20:44:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef70ea3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c155850 con 0x7fef6c14e7c0 2023-11-27T20:44:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef6b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c0c4c00 0x7fef6c14d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef6b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c0c4c00 0x7fef6c14d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41666/0 (socket says 172.21.15.91:41666) 2023-11-27T20:44:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef6b7fe640 1 -- 172.21.15.91:0/3842265554 learned_addr learned my addr 172.21.15.91:0/3842265554 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef6bfff640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef6c14e7c0 0x7fef6c1ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef6b7fe640 1 -- 172.21.15.91:0/3842265554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef6c14e7c0 msgr2=0x7fef6c1ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef6b7fe640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef6c14e7c0 0x7fef6c1ed630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef6affd640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef6c0ca990 0x7fef6c143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef6b7fe640 1 -- 172.21.15.91:0/3842265554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef6c0ca990 msgr2=0x7fef6c143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef6b7fe640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef6c0ca990 0x7fef6c143e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.964+0000 7fef6b7fe640 1 -- 172.21.15.91:0/3842265554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0094d0 con 0x7fef6c0c4c00 2023-11-27T20:44:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.965+0000 7fef6b7fe640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c0c4c00 0x7fef6c14d970 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fef5c000c00 tx=0x7fef5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.965+0000 7fef53fff640 1 -- 172.21.15.91:0/3842265554 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c033c50 con 0x7fef6c0c4c00 2023-11-27T20:44:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.965+0000 7fef53fff640 1 -- 172.21.15.91:0/3842265554 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c033db0 con 0x7fef6c0c4c00 2023-11-27T20:44:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.965+0000 7fef70ea3640 1 -- 172.21.15.91:0/3842265554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c0c1950 con 0x7fef6c0c4c00 2023-11-27T20:44:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.965+0000 7fef53fff640 1 -- 172.21.15.91:0/3842265554 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c03d6b0 con 0x7fef6c0c4c00 2023-11-27T20:44:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.965+0000 7fef70ea3640 1 -- 172.21.15.91:0/3842265554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c1578d0 con 0x7fef6c0c4c00 2023-11-27T20:44:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.966+0000 7fef70ea3640 1 -- 172.21.15.91:0/3842265554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c04e840 con 0x7fef6c0c4c00 2023-11-27T20:44:04.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.967+0000 7fef53fff640 1 -- 172.21.15.91:0/3842265554 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fef5c03a040 con 0x7fef6c0c4c00 2023-11-27T20:44:04.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.968+0000 7fef53fff640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fef5806b1c0 0x7fef5806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:04.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.968+0000 7fef53fff640 1 -- 172.21.15.91:0/3842265554 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef5c0ab8e0 con 0x7fef6c0c4c00 2023-11-27T20:44:04.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.969+0000 7fef6affd640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fef5806b1c0 0x7fef5806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:04.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.969+0000 7fef6affd640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fef5806b1c0 0x7fef5806d680 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fef6c155660 tx=0x7fef60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:04.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:04.973+0000 7fef53fff640 1 -- 172.21.15.91:0/3842265554 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fef5c0766a0 con 0x7fef6c0c4c00 2023-11-27T20:44:05.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.161+0000 7fef70ea3640 1 -- 172.21.15.91:0/3842265554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef6c0c7c40 con 0x7fef6c0c4c00 2023-11-27T20:44:05.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.162+0000 7fef53fff640 1 -- 172.21.15.91:0/3842265554 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef5c0380a0 con 0x7fef6c0c4c00 2023-11-27T20:44:05.164 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:44:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 -- 172.21.15.91:0/3842265554 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fef5806b1c0 msgr2=0x7fef5806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fef5806b1c0 0x7fef5806d680 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fef6c155660 tx=0x7fef60008040 comp rx=0 tx=0).stop 2023-11-27T20:44:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 -- 172.21.15.91:0/3842265554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c0c4c00 msgr2=0x7fef6c14d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c0c4c00 0x7fef6c14d970 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fef5c000c00 tx=0x7fef5c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 -- 172.21.15.91:0/3842265554 shutdown_connections 2023-11-27T20:44:05.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef6c14e7c0 0x7fef6c1ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fef5806b1c0 0x7fef5806d680 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef6c0ca990 0x7fef6c143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 --2- 172.21.15.91:0/3842265554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef6c0c4c00 0x7fef6c14d970 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 -- 172.21.15.91:0/3842265554 >> 172.21.15.91:0/3842265554 conn(0x7fef6c0abf00 msgr2=0x7fef6c146cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:05.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 -- 172.21.15.91:0/3842265554 shutdown_connections 2023-11-27T20:44:05.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.165+0000 7fef70ea3640 1 -- 172.21.15.91:0/3842265554 wait complete. 2023-11-27T20:44:05.184 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T20:44:05.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.382+0000 7f9fdcff5640 1 Processor -- start 2023-11-27T20:44:05.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.382+0000 7f9fdcff5640 1 -- start start 2023-11-27T20:44:05.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.383+0000 7f9fdcff5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fd8152f20 0x7f9fd80c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.383+0000 7f9fdcff5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd80c64a0 con 0x7f9fd806d0a0 2023-11-27T20:44:05.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.383+0000 7f9fdcff5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd80c5c00 con 0x7f9fd814fd30 2023-11-27T20:44:05.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.383+0000 7f9fdcff5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80c5ee0 con 0x7f9fd8152f20 2023-11-27T20:44:05.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.383+0000 7f9fcdd9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f9fd806d0a0 0x7f9fd80c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50914/0 (socket says 172.21.15.91:50914) 2023-11-27T20:44:05.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fcdd9b640 1 -- 172.21.15.91:0/944202789 learned_addr learned my addr 172.21.15.91:0/944202789 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:05.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153877375 0 0) 0x7f9fd80c64a0 con 0x7f9fd806d0a0 2023-11-27T20:44:05.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd6d9d640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fd8152f20 0x7f9fd80c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fc4003520 con 0x7f9fd806d0a0 2023-11-27T20:44:05.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869209224 0 0) 0x7f9fc4003520 con 0x7f9fd806d0a0 2023-11-27T20:44:05.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fd8152f20 msgr2=0x7f9fd80c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:05.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd5d9b640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fd8152f20 0x7f9fd80c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 >> v1:172.21.15.183:6789/0 conn(0x7f9fd814fd30 legacy=0x7f9fd80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80c61c0 con 0x7f9fd806d0a0 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f9fc0001670 con 0x7f9fd806d0a0 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 >> v1:172.21.15.91:6789/0 conn(0x7f9fd806d0a0 legacy=0x7f9fd80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.384+0000 7f9fd5d9b640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fd8152f20 0x7f9fc40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd5d9b640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fc4003fd0 0x7f9fc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd5d9b640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fc4004d00 0x7f9fc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80c5ee0 con 0x7f9fc4004d00 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc400bb40 con 0x7f9fc4003fd0 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc400bd00 con 0x7f9fd8152f20 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd6d9d640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fc4004d00 0x7f9fc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd6d9d640 1 -- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fd8152f20 msgr2=0x7f9fc40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd659c640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fd8152f20 0x7f9fc40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fcdd9b640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fc4003fd0 0x7f9fc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd6d9d640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fd8152f20 0x7f9fc40039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd6d9d640 1 -- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fc4003fd0 msgr2=0x7f9fc40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:05.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd6d9d640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fc4003fd0 0x7f9fc40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.385+0000 7f9fd6d9d640 1 -- 172.21.15.91:0/944202789 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc4003520 con 0x7f9fc4004d00 2023-11-27T20:44:05.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.386+0000 7f9fd6d9d640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fc4004d00 0x7f9fc4005180 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0007360 tx=0x7f9fc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175290f7fe0d2943 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:05.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.386+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd002ccd0 con 0x7f9fc4004d00 2023-11-27T20:44:05.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.386+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd002ce30 con 0x7f9fc4004d00 2023-11-27T20:44:05.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.386+0000 7f9fd5d9b640 1 -- 172.21.15.91:0/944202789 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0034660 con 0x7f9fc4004d00 2023-11-27T20:44:05.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.387+0000 7f9fdcff5640 1 -- 172.21.15.91:0/944202789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fc4004d00 msgr2=0x7f9fc4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.387+0000 7f9fdcff5640 1 --2- 172.21.15.91:0/944202789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fc4004d00 0x7f9fc4005180 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0007360 tx=0x7f9fc40057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.387+0000 7f9fd6d9d640 1 -- 172.21.15.91:0/944202789 reap_dead start 2023-11-27T20:44:05.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.387+0000 7f9fdcff5640 1 -- 172.21.15.91:0/944202789 shutdown_connections 2023-11-27T20:44:05.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.387+0000 7f9fdcff5640 1 -- 172.21.15.91:0/944202789 >> 172.21.15.91:0/944202789 conn(0x7f9fd806a500 msgr2=0x7f9fd806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:05.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.387+0000 7f9fdcff5640 1 -- 172.21.15.91:0/944202789 shutdown_connections 2023-11-27T20:44:05.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.387+0000 7f9fdcff5640 1 -- 172.21.15.91:0/944202789 wait complete. 2023-11-27T20:44:05.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.389+0000 7f9fdcff5640 1 Processor -- start 2023-11-27T20:44:05.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.389+0000 7f9fdcff5640 1 -- start start 2023-11-27T20:44:05.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fdcff5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fc4004d00 0x7f9fd8071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fdcff5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fd81566a0 0x7f9fd814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fdcff5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fd814d400 0x7f9fd80a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fdcff5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80aae70 con 0x7f9fd81566a0 2023-11-27T20:44:05.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fdcff5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80a89a0 con 0x7f9fd814d400 2023-11-27T20:44:05.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fdcff5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd81eabc0 con 0x7f9fc4004d00 2023-11-27T20:44:05.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fcdd9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fd81566a0 0x7f9fd814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fcdd9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fd81566a0 0x7f9fd814cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41678/0 (socket says 172.21.15.91:41678) 2023-11-27T20:44:05.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fcdd9b640 1 -- 172.21.15.91:0/267840489 learned_addr learned my addr 172.21.15.91:0/267840489 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:05.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fcdd9b640 1 -- 172.21.15.91:0/267840489 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fc4004d00 msgr2=0x7f9fd8071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fcdd9b640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fc4004d00 0x7f9fd8071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fcdd9b640 1 -- 172.21.15.91:0/267840489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fd814d400 msgr2=0x7f9fd80a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fcdd9b640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fd814d400 0x7f9fd80a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.390+0000 7f9fcdd9b640 1 -- 172.21.15.91:0/267840489 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80a8c40 con 0x7f9fd81566a0 2023-11-27T20:44:05.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.391+0000 7f9fcdd9b640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fd81566a0 0x7f9fd814cec0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000d810 tx=0x7f9fc000dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:05.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.391+0000 7f9fcf7fe640 1 -- 172.21.15.91:0/267840489 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00074e0 con 0x7f9fd81566a0 2023-11-27T20:44:05.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.391+0000 7f9fcf7fe640 1 -- 172.21.15.91:0/267840489 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc0007640 con 0x7f9fd81566a0 2023-11-27T20:44:05.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.391+0000 7f9fdcff5640 1 -- 172.21.15.91:0/267840489 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd81eaea0 con 0x7f9fd81566a0 2023-11-27T20:44:05.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.391+0000 7f9fcf7fe640 1 -- 172.21.15.91:0/267840489 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0004a00 con 0x7f9fd81566a0 2023-11-27T20:44:05.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.391+0000 7f9fdcff5640 1 -- 172.21.15.91:0/267840489 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd814d8b0 con 0x7f9fd81566a0 2023-11-27T20:44:05.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.392+0000 7f9fdcff5640 1 -- 172.21.15.91:0/267840489 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd80a8e80 con 0x7f9fd81566a0 2023-11-27T20:44:05.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.393+0000 7f9fcf7fe640 1 -- 172.21.15.91:0/267840489 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9fc0004b60 con 0x7f9fd81566a0 2023-11-27T20:44:05.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.394+0000 7f9fcf7fe640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9fb806b1c0 0x7f9fb806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.394+0000 7f9fcf7fe640 1 -- 172.21.15.91:0/267840489 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fc0089440 con 0x7f9fd81566a0 2023-11-27T20:44:05.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.394+0000 7f9fd659c640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9fb806b1c0 0x7f9fb806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.395+0000 7f9fd659c640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9fb806b1c0 0x7f9fb806d680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8001640 tx=0x7f9fc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:05.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.399+0000 7f9fcf7fe640 1 -- 172.21.15.91:0/267840489 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9fd80a8e80 con 0x7f9fd81566a0 2023-11-27T20:44:05.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.581+0000 7f9fdcff5640 1 -- 172.21.15.91:0/267840489 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9fd80a8e80 con 0x7f9fd81566a0 2023-11-27T20:44:05.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.582+0000 7f9fcf7fe640 1 -- 172.21.15.91:0/267840489 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) v1 ==== 84+0+207 (secure 0 0 0) 0x7f9fd80a8e80 con 0x7f9fd81566a0 2023-11-27T20:44:05.583 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:05.583 INFO:teuthology.orchestra.run.smithi091.stdout:[ 2023-11-27T20:44:05.583 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:44:05.583 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 1, 2023-11-27T20:44:05.583 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": ".mgr" 2023-11-27T20:44:05.583 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:44:05.584 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:44:05.584 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 8, 2023-11-27T20:44:05.584 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": "cephfs_metadata" 2023-11-27T20:44:05.584 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:44:05.584 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:44:05.584 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 9, 2023-11-27T20:44:05.584 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": "cephfs_data" 2023-11-27T20:44:05.584 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:44:05.584 INFO:teuthology.orchestra.run.smithi091.stdout:] 2023-11-27T20:44:05.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 -- 172.21.15.91:0/267840489 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9fb806b1c0 msgr2=0x7f9fb806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9fb806b1c0 0x7f9fb806d680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8001640 tx=0x7f9fc8009040 comp rx=0 tx=0).stop 2023-11-27T20:44:05.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 -- 172.21.15.91:0/267840489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fd81566a0 msgr2=0x7f9fd814cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fd81566a0 0x7f9fd814cec0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000d810 tx=0x7f9fc000dcd0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 -- 172.21.15.91:0/267840489 shutdown_connections 2023-11-27T20:44:05.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9fb806b1c0 0x7f9fb806d680 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fd814d400 0x7f9fd80a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9fd81566a0 0x7f9fd814cec0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 --2- 172.21.15.91:0/267840489 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fc4004d00 0x7f9fd8071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 -- 172.21.15.91:0/267840489 >> 172.21.15.91:0/267840489 conn(0x7f9fd806a500 msgr2=0x7f9fd80a6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:05.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.584+0000 7f9fdcff5640 1 -- 172.21.15.91:0/267840489 shutdown_connections 2023-11-27T20:44:05.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.585+0000 7f9fdcff5640 1 -- 172.21.15.91:0/267840489 wait complete. 2023-11-27T20:44:05.604 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-27T20:44:05.604 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-27T20:44:05.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.811+0000 7f4a824fc640 1 Processor -- start 2023-11-27T20:44:05.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.812+0000 7f4a824fc640 1 -- start start 2023-11-27T20:44:05.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.813+0000 7f4a824fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c0c4660 0x7f4a7c071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.813+0000 7f4a824fc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7c0a9560 con 0x7f4a7c0c4180 2023-11-27T20:44:05.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.813+0000 7f4a824fc640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7c0a9820 con 0x7f4a7c0aa940 2023-11-27T20:44:05.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.813+0000 7f4a824fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c0c3120 con 0x7f4a7c0c4660 2023-11-27T20:44:05.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a80a99640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f4a7c0c4180 0x7f4a7c15ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50922/0 (socket says 172.21.15.91:50922) 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a80a99640 1 -- 172.21.15.91:0/2207964381 learned_addr learned my addr 172.21.15.91:0/2207964381 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a7b7fe640 1 --2- 172.21.15.91:0/2207964381 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c0c4660 0x7f4a7c071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043227083 0 0) 0x7f4a7c0a9560 con 0x7f4a7c0c4180 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a68003520 con 0x7f4a7c0c4180 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1260722695 0 0) 0x7f4a68003520 con 0x7f4a7c0c4180 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c0c4660 msgr2=0x7f4a7c071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a7affd640 1 --2- 172.21.15.91:0/2207964381 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c0c4660 0x7f4a7c071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 >> v1:172.21.15.183:6789/0 conn(0x7f4a7c0aa940 legacy=0x7f4a7c0a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c0c4b50 con 0x7f4a7c0c4180 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f4a74001670 con 0x7f4a7c0c4180 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.814+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 >> v1:172.21.15.91:6789/0 conn(0x7f4a7c0c4180 legacy=0x7f4a7c15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7affd640 1 --2- 172.21.15.91:0/2207964381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 0x7f4a68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7affd640 1 --2- 172.21.15.91:0/2207964381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a680047c0 0x7f4a68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7affd640 1 --2- 172.21.15.91:0/2207964381 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c0c4660 0x7f4a680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c0c3120 con 0x7f4a680039a0 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6800bab0 con 0x7f4a680047c0 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6800bc70 con 0x7f4a7c0c4660 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7bfff640 1 --2- 172.21.15.91:0/2207964381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 0x7f4a68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7bfff640 1 -- 172.21.15.91:0/2207964381 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c0c4660 msgr2=0x7f4a680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7bfff640 1 --2- 172.21.15.91:0/2207964381 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c0c4660 0x7f4a680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7bfff640 1 -- 172.21.15.91:0/2207964381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a680047c0 msgr2=0x7f4a68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7bfff640 1 --2- 172.21.15.91:0/2207964381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a680047c0 0x7f4a68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.815+0000 7f4a7bfff640 1 -- 172.21.15.91:0/2207964381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68003520 con 0x7f4a680039a0 2023-11-27T20:44:05.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.816+0000 7f4a7bfff640 1 --2- 172.21.15.91:0/2207964381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 0x7f4a68003dc0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c001750 tx=0x7f4a680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1843951a98d603b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:05.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.816+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0052d0 con 0x7f4a680039a0 2023-11-27T20:44:05.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.816+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c02e050 con 0x7f4a680039a0 2023-11-27T20:44:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.816+0000 7f4a7affd640 1 -- 172.21.15.91:0/2207964381 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0035f0 con 0x7f4a680039a0 2023-11-27T20:44:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.817+0000 7f4a824fc640 1 -- 172.21.15.91:0/2207964381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 msgr2=0x7f4a68003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.817+0000 7f4a824fc640 1 --2- 172.21.15.91:0/2207964381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 0x7f4a68003dc0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c001750 tx=0x7f4a680057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.817+0000 7f4a80a99640 1 -- 172.21.15.91:0/2207964381 reap_dead start 2023-11-27T20:44:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.817+0000 7f4a824fc640 1 -- 172.21.15.91:0/2207964381 shutdown_connections 2023-11-27T20:44:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.817+0000 7f4a824fc640 1 -- 172.21.15.91:0/2207964381 >> 172.21.15.91:0/2207964381 conn(0x7f4a7c0c5bc0 msgr2=0x7f4a7c0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.817+0000 7f4a824fc640 1 -- 172.21.15.91:0/2207964381 shutdown_connections 2023-11-27T20:44:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.817+0000 7f4a824fc640 1 -- 172.21.15.91:0/2207964381 wait complete. 2023-11-27T20:44:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.819+0000 7f4a824fc640 1 Processor -- start 2023-11-27T20:44:05.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.819+0000 7f4a824fc640 1 -- start start 2023-11-27T20:44:05.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.820+0000 7f4a824fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 0x7f4a7c1d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.820+0000 7f4a824fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c1d61a0 0x7f4a7c1d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.820+0000 7f4a824fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a7c1d65a0 0x7f4a7c1d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.820+0000 7f4a824fc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c1d5ae0 con 0x7f4a680039a0 2023-11-27T20:44:05.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.820+0000 7f4a824fc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c1d6bd0 con 0x7f4a7c1d65a0 2023-11-27T20:44:05.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.820+0000 7f4a824fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c1e7e10 con 0x7f4a7c1d61a0 2023-11-27T20:44:05.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.820+0000 7f4a7bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 0x7f4a7c1d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.820+0000 7f4a7bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 0x7f4a7c1d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41690/0 (socket says 172.21.15.91:41690) 2023-11-27T20:44:05.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.820+0000 7f4a7bfff640 1 -- 172.21.15.91:0/2505216350 learned_addr learned my addr 172.21.15.91:0/2505216350 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:05.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a7bfff640 1 -- 172.21.15.91:0/2505216350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c1d61a0 msgr2=0x7f4a7c1d38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a7b7fe640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c1d61a0 0x7f4a7c1d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a80a99640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a7c1d65a0 0x7f4a7c1d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a7bfff640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c1d61a0 0x7f4a7c1d38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a7bfff640 1 -- 172.21.15.91:0/2505216350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a7c1d65a0 msgr2=0x7f4a7c1d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:05.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a7bfff640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a7c1d65a0 0x7f4a7c1d3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:05.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a7bfff640 1 -- 172.21.15.91:0/2505216350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c1d6e50 con 0x7f4a680039a0 2023-11-27T20:44:05.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a7bfff640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 0x7f4a7c1d55a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c008fd0 tx=0x7f4a6c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:05.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a78ff9640 1 -- 172.21.15.91:0/2505216350 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0076c0 con 0x7f4a680039a0 2023-11-27T20:44:05.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a78ff9640 1 -- 172.21.15.91:0/2505216350 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c007a30 con 0x7f4a680039a0 2023-11-27T20:44:05.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a78ff9640 1 -- 172.21.15.91:0/2505216350 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c006be0 con 0x7f4a680039a0 2023-11-27T20:44:05.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.821+0000 7f4a824fc640 1 -- 172.21.15.91:0/2505216350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7c1d7130 con 0x7f4a680039a0 2023-11-27T20:44:05.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.822+0000 7f4a824fc640 1 -- 172.21.15.91:0/2505216350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7c1d4440 con 0x7f4a680039a0 2023-11-27T20:44:05.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.823+0000 7f4a824fc640 1 -- 172.21.15.91:0/2505216350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7c067950 con 0x7f4a680039a0 2023-11-27T20:44:05.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.823+0000 7f4a78ff9640 1 -- 172.21.15.91:0/2505216350 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4a6c006d40 con 0x7f4a680039a0 2023-11-27T20:44:05.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.825+0000 7f4a78ff9640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 0x7f4a5c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:05.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.825+0000 7f4a78ff9640 1 -- 172.21.15.91:0/2505216350 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a6c0aba80 con 0x7f4a680039a0 2023-11-27T20:44:05.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.825+0000 7f4a7b7fe640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 0x7f4a5c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:05.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.826+0000 7f4a7b7fe640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 0x7f4a5c06d680 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0c3440 tx=0x7f4a6400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:05.829+0000 7f4a78ff9640 1 -- 172.21.15.91:0/2505216350 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4a6c076840 con 0x7f4a680039a0 2023-11-27T20:44:06.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.004+0000 7f4a824fc640 1 -- 172.21.15.91:0/2505216350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4a7c0ab150 con 0x7f4a680039a0 2023-11-27T20:44:06.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.494+0000 7f4a78ff9640 1 -- 172.21.15.91:0/2505216350 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v56) v1 ==== 140+0+0 (secure 0 0 0) 0x7f4a6c04b0b0 con 0x7f4a680039a0 2023-11-27T20:44:06.496 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_metadata' created 2023-11-27T20:44:06.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.497+0000 7f4a824fc640 1 -- 172.21.15.91:0/2505216350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 msgr2=0x7f4a5c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:06.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.497+0000 7f4a824fc640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 0x7f4a5c06d680 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0c3440 tx=0x7f4a6400b040 comp rx=0 tx=0).stop 2023-11-27T20:44:06.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.497+0000 7f4a824fc640 1 -- 172.21.15.91:0/2505216350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 msgr2=0x7f4a7c1d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:06.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.497+0000 7f4a824fc640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 0x7f4a7c1d55a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c008fd0 tx=0x7f4a6c001120 comp rx=0 tx=0).stop 2023-11-27T20:44:06.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.498+0000 7f4a824fc640 1 -- 172.21.15.91:0/2505216350 shutdown_connections 2023-11-27T20:44:06.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.498+0000 7f4a824fc640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4a5c06b1c0 0x7f4a5c06d680 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:06.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.498+0000 7f4a824fc640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a7c1d65a0 0x7f4a7c1d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:06.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.498+0000 7f4a824fc640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a7c1d61a0 0x7f4a7c1d38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:06.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.498+0000 7f4a824fc640 1 --2- 172.21.15.91:0/2505216350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a680039a0 0x7f4a7c1d55a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:06.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.498+0000 7f4a824fc640 1 -- 172.21.15.91:0/2505216350 >> 172.21.15.91:0/2505216350 conn(0x7f4a7c0c5bc0 msgr2=0x7f4a7c06c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:06.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.498+0000 7f4a824fc640 1 -- 172.21.15.91:0/2505216350 shutdown_connections 2023-11-27T20:44:06.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.499+0000 7f4a824fc640 1 -- 172.21.15.91:0/2505216350 wait complete. 2023-11-27T20:44:06.527 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T20:44:06.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.728+0000 7f01d8383640 1 Processor -- start 2023-11-27T20:44:06.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.728+0000 7f01d8383640 1 -- start start 2023-11-27T20:44:06.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.730+0000 7f01d8383640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d0151cc0 0x7f01d0155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:06.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.730+0000 7f01d8383640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f01d00c7ec0 0x7f01d0157d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:06.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.730+0000 7f01d8383640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d01556d0 con 0x7f01d00c4940 2023-11-27T20:44:06.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.730+0000 7f01d8383640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d0154740 con 0x7f01d00c7ec0 2023-11-27T20:44:06.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.730+0000 7f01d8383640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d006c760 con 0x7f01d0151cc0 2023-11-27T20:44:06.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.730+0000 7f01d6920640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f01d00c4940 0x7f01d00c69d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50928/0 (socket says 172.21.15.91:50928) 2023-11-27T20:44:06.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.730+0000 7f01d6920640 1 -- 172.21.15.91:0/2745192801 learned_addr learned my addr 172.21.15.91:0/2745192801 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:06.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.730+0000 7f01d611f640 1 --2- 172.21.15.91:0/2745192801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d0151cc0 0x7f01d0155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:06.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.730+0000 7f01d591e640 1 --2- 172.21.15.91:0/2745192801 >> v2:172.21.15.183:3300/0 conn(0x7f01d00c7ec0 0x7f01d0157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:06.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.731+0000 7f01d511d640 1 -- 172.21.15.91:0/2745192801 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136872916 0 0) 0x7f01c8001490 con 0x7f01d00c4940 2023-11-27T20:44:06.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.731+0000 7f01d511d640 1 -- 172.21.15.91:0/2745192801 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01bc003520 con 0x7f01d00c4940 2023-11-27T20:44:06.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.731+0000 7f01d511d640 1 -- 172.21.15.91:0/2745192801 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 545862723 0 0) 0x7f01bc003520 con 0x7f01d00c4940 2023-11-27T20:44:06.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.731+0000 7f01d591e640 1 -- 172.21.15.91:0/2745192801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d0151cc0 msgr2=0x7f01d0155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:06.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.731+0000 7f01d591e640 1 --2- 172.21.15.91:0/2745192801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d0151cc0 0x7f01d0155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:06.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.731+0000 7f01d591e640 1 -- 172.21.15.91:0/2745192801 >> v1:172.21.15.91:6789/0 conn(0x7f01d00c4940 legacy=0x7f01d00c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:06.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.731+0000 7f01d591e640 1 -- 172.21.15.91:0/2745192801 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d00c8470 con 0x7f01d00c7ec0 2023-11-27T20:44:06.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.732+0000 7f01d591e640 1 --2- 172.21.15.91:0/2745192801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d00c7ec0 0x7f01d0157d30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f01c00097a0 tx=0x7f01c002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c62d95e29d04ab7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:06.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.733+0000 7f01d511d640 1 -- 172.21.15.91:0/2745192801 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8001b80 con 0x7f01d00c7ec0 2023-11-27T20:44:06.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.733+0000 7f01d511d640 1 -- 172.21.15.91:0/2745192801 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c002e050 con 0x7f01d00c7ec0 2023-11-27T20:44:06.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.733+0000 7f01d511d640 1 -- 172.21.15.91:0/2745192801 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0030730 con 0x7f01d00c7ec0 2023-11-27T20:44:06.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.734+0000 7f01d8383640 1 -- 172.21.15.91:0/2745192801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d00c7ec0 msgr2=0x7f01d0157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:06.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.734+0000 7f01d8383640 1 --2- 172.21.15.91:0/2745192801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d00c7ec0 0x7f01d0157d30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f01c00097a0 tx=0x7f01c002b790 comp rx=0 tx=0).stop 2023-11-27T20:44:06.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.734+0000 7f01d8383640 1 -- 172.21.15.91:0/2745192801 shutdown_connections 2023-11-27T20:44:06.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.734+0000 7f01d8383640 1 --2- 172.21.15.91:0/2745192801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d00c7ec0 0x7f01d0157d30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:06.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.734+0000 7f01d8383640 1 --2- 172.21.15.91:0/2745192801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d0151cc0 0x7f01d0155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:06.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.734+0000 7f01d8383640 1 -- 172.21.15.91:0/2745192801 >> 172.21.15.91:0/2745192801 conn(0x7f01d0071e10 msgr2=0x7f01d0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:06.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.734+0000 7f01d8383640 1 -- 172.21.15.91:0/2745192801 shutdown_connections 2023-11-27T20:44:06.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.734+0000 7f01d8383640 1 -- 172.21.15.91:0/2745192801 wait complete. 2023-11-27T20:44:06.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.736+0000 7f01d8383640 1 Processor -- start 2023-11-27T20:44:06.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.736+0000 7f01d8383640 1 -- start start 2023-11-27T20:44:06.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.737+0000 7f01d8383640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d00c4940 0x7f01d0153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:06.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.737+0000 7f01d8383640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d00c7ec0 0x7f01d0146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:06.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.737+0000 7f01d8383640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01d0151cc0 0x7f01d01474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:06.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d8383640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d01e9ed0 con 0x7f01d0151cc0 2023-11-27T20:44:06.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d8383640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0147a00 con 0x7f01d00c7ec0 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d8383640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0157d20 con 0x7f01d00c4940 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d6920640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01d0151cc0 0x7f01d01474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d6920640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01d0151cc0 0x7f01d01474c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41694/0 (socket says 172.21.15.91:41694) 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d6920640 1 -- 172.21.15.91:0/1856863495 learned_addr learned my addr 172.21.15.91:0/1856863495 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d591e640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d00c7ec0 0x7f01d0146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d611f640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d00c4940 0x7f01d0153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d6920640 1 -- 172.21.15.91:0/1856863495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d00c4940 msgr2=0x7f01d0153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d6920640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d00c4940 0x7f01d0153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d6920640 1 -- 172.21.15.91:0/1856863495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d00c7ec0 msgr2=0x7f01d0146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d6920640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d00c7ec0 0x7f01d0146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:06.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d6920640 1 -- 172.21.15.91:0/1856863495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0009400 con 0x7f01d0151cc0 2023-11-27T20:44:06.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d591e640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d00c7ec0 0x7f01d0146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:06.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.738+0000 7f01d611f640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d00c4940 0x7f01d0153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:06.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.739+0000 7f01d6920640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01d0151cc0 0x7f01d01474c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f01c800cc60 tx=0x7f01c800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:06.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.739+0000 7f01c6ffd640 1 -- 172.21.15.91:0/1856863495 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c800ce70 con 0x7f01d0151cc0 2023-11-27T20:44:06.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.739+0000 7f01c6ffd640 1 -- 172.21.15.91:0/1856863495 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8012400 con 0x7f01d0151cc0 2023-11-27T20:44:06.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.739+0000 7f01c6ffd640 1 -- 172.21.15.91:0/1856863495 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80127b0 con 0x7f01d0151cc0 2023-11-27T20:44:06.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.739+0000 7f01d8383640 1 -- 172.21.15.91:0/1856863495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d01e7b80 con 0x7f01d0151cc0 2023-11-27T20:44:06.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.739+0000 7f01d8383640 1 -- 172.21.15.91:0/1856863495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d0157f70 con 0x7f01d0151cc0 2023-11-27T20:44:06.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.740+0000 7f01d8383640 1 -- 172.21.15.91:0/1856863495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d01ea040 con 0x7f01d0151cc0 2023-11-27T20:44:06.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.742+0000 7f01c6ffd640 1 -- 172.21.15.91:0/1856863495 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f01c8012910 con 0x7f01d0151cc0 2023-11-27T20:44:06.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.742+0000 7f01c6ffd640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f01b406b1c0 0x7f01b406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:06.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.743+0000 7f01c6ffd640 1 -- 172.21.15.91:0/1856863495 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f01c808a060 con 0x7f01d0151cc0 2023-11-27T20:44:06.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.743+0000 7f01d611f640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f01b406b1c0 0x7f01b406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:06.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.744+0000 7f01d611f640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f01b406b1c0 0x7f01b406d680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009ac0 tx=0x7f01cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:06.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.747+0000 7f01c6ffd640 1 -- 172.21.15.91:0/1856863495 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f01d01ea040 con 0x7f01d0151cc0 2023-11-27T20:44:06.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:06.937+0000 7f01d8383640 1 -- 172.21.15.91:0/1856863495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f01d01556d0 con 0x7f01d0151cc0 2023-11-27T20:44:07.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.510+0000 7f01c6ffd640 1 -- 172.21.15.91:0/1856863495 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v57) v1 ==== 172+0+0 (secure 0 0 0) 0x7f01d01556d0 con 0x7f01d0151cc0 2023-11-27T20:44:07.512 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_data' created 2023-11-27T20:44:07.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 -- 172.21.15.91:0/1856863495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f01b406b1c0 msgr2=0x7f01b406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:07.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f01b406b1c0 0x7f01b406d680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009ac0 tx=0x7f01cc008040 comp rx=0 tx=0).stop 2023-11-27T20:44:07.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 -- 172.21.15.91:0/1856863495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01d0151cc0 msgr2=0x7f01d01474c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:07.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01d0151cc0 0x7f01d01474c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f01c800cc60 tx=0x7f01c800a430 comp rx=0 tx=0).stop 2023-11-27T20:44:07.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 -- 172.21.15.91:0/1856863495 shutdown_connections 2023-11-27T20:44:07.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01d0151cc0 0x7f01d01474c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:07.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f01b406b1c0 0x7f01b406d680 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:07.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01d00c7ec0 0x7f01d0146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:07.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 --2- 172.21.15.91:0/1856863495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01d00c4940 0x7f01d0153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:07.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 -- 172.21.15.91:0/1856863495 >> 172.21.15.91:0/1856863495 conn(0x7f01d0071e10 msgr2=0x7f01d014b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:07.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.513+0000 7f01d8383640 1 -- 172.21.15.91:0/1856863495 shutdown_connections 2023-11-27T20:44:07.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.514+0000 7f01d8383640 1 -- 172.21.15.91:0/1856863495 wait complete. 2023-11-27T20:44:07.546 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-27T20:44:07.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.735+0000 7f3220981640 1 Processor -- start 2023-11-27T20:44:07.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.735+0000 7f3220981640 1 -- start start 2023-11-27T20:44:07.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.736+0000 7f3220981640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f321c155f60 0x7f321c0c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:07.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.736+0000 7f3220981640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f321c0c1100 0x7f321c15c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:07.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.737+0000 7f3220981640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c159800 con 0x7f321c06e000 2023-11-27T20:44:07.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.737+0000 7f3220981640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c06c440 con 0x7f321c0c1100 2023-11-27T20:44:07.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.737+0000 7f3220981640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c156340 con 0x7f321c155f60 2023-11-27T20:44:07.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.737+0000 7f321bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f321c0c1100 0x7f321c15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:07.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.737+0000 7f321bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f321c0c1100 0x7f321c15c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41698/0 (socket says 172.21.15.91:41698) 2023-11-27T20:44:07.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.737+0000 7f321bfff640 1 -- 172.21.15.91:0/2893578074 learned_addr learned my addr 172.21.15.91:0/2893578074 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:07.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.737+0000 7f321bfff640 1 -- 172.21.15.91:0/2893578074 >> v2:172.21.15.183:3300/0 conn(0x7f321c155f60 msgr2=0x7f321c0c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:07.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.737+0000 7f321bfff640 1 --2- 172.21.15.91:0/2893578074 >> v2:172.21.15.183:3300/0 conn(0x7f321c155f60 0x7f321c0c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:07.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.737+0000 7f321bfff640 1 -- 172.21.15.91:0/2893578074 >> v1:172.21.15.183:6789/0 conn(0x7f321c06e000 legacy=0x7f321c15be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:07.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.737+0000 7f321bfff640 1 -- 172.21.15.91:0/2893578074 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c158a40 con 0x7f321c0c1100 2023-11-27T20:44:07.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.738+0000 7f321bfff640 1 --2- 172.21.15.91:0/2893578074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 0x7f321c15c530 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f321c0678c0 tx=0x7f321402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d37f37a53c4d301 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:07.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.739+0000 7f321affd640 1 -- 172.21.15.91:0/2893578074 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321402ca80 con 0x7f321c0c1100 2023-11-27T20:44:07.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.739+0000 7f321affd640 1 -- 172.21.15.91:0/2893578074 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321402cbe0 con 0x7f321c0c1100 2023-11-27T20:44:07.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.739+0000 7f321affd640 1 -- 172.21.15.91:0/2893578074 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32140343f0 con 0x7f321c0c1100 2023-11-27T20:44:07.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.739+0000 7f3220981640 1 -- 172.21.15.91:0/2893578074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 msgr2=0x7f321c15c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:07.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.739+0000 7f3220981640 1 --2- 172.21.15.91:0/2893578074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 0x7f321c15c530 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f321c0678c0 tx=0x7f321402bee0 comp rx=0 tx=0).stop 2023-11-27T20:44:07.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.739+0000 7f3220981640 1 -- 172.21.15.91:0/2893578074 shutdown_connections 2023-11-27T20:44:07.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.739+0000 7f3220981640 1 --2- 172.21.15.91:0/2893578074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 0x7f321c15c530 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:07.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.739+0000 7f3220981640 1 --2- 172.21.15.91:0/2893578074 >> v2:172.21.15.183:3300/0 conn(0x7f321c155f60 0x7f321c0c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:07.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.740+0000 7f3220981640 1 -- 172.21.15.91:0/2893578074 >> 172.21.15.91:0/2893578074 conn(0x7f321c0a77f0 msgr2=0x7f321c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:07.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.740+0000 7f3220981640 1 -- 172.21.15.91:0/2893578074 shutdown_connections 2023-11-27T20:44:07.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.740+0000 7f3220981640 1 -- 172.21.15.91:0/2893578074 wait complete. 2023-11-27T20:44:07.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.741+0000 7f3220981640 1 Processor -- start 2023-11-27T20:44:07.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.742+0000 7f3220981640 1 -- start start 2023-11-27T20:44:07.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.742+0000 7f3220981640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c06e000 0x7f321c0ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:07.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.742+0000 7f3220981640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 0x7f321c15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:07.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.742+0000 7f3220981640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f321c155f60 0x7f321c1f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:07.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.742+0000 7f3220981640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c15cd80 con 0x7f321c0c1100 2023-11-27T20:44:07.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.742+0000 7f3220981640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c15add0 con 0x7f321c06e000 2023-11-27T20:44:07.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.742+0000 7f3220981640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c1528e0 con 0x7f321c155f60 2023-11-27T20:44:07.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.743+0000 7f3212ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 0x7f321c15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:07.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.743+0000 7f3212ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 0x7f321c15a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41712/0 (socket says 172.21.15.91:41712) 2023-11-27T20:44:07.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.743+0000 7f3212ffd640 1 -- 172.21.15.91:0/3509928308 learned_addr learned my addr 172.21.15.91:0/3509928308 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.743+0000 7f3212ffd640 1 -- 172.21.15.91:0/3509928308 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f321c155f60 msgr2=0x7f321c1f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.743+0000 7f3212ffd640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f321c155f60 0x7f321c1f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.743+0000 7f3212ffd640 1 -- 172.21.15.91:0/3509928308 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c06e000 msgr2=0x7f321c0ab7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.743+0000 7f3212ffd640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c06e000 0x7f321c0ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.743+0000 7f3212ffd640 1 -- 172.21.15.91:0/3509928308 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3214009b30 con 0x7f321c0c1100 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.743+0000 7f3212ffd640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 0x7f321c15a890 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f320400c410 tx=0x7f320400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.744+0000 7f3218ff9640 1 -- 172.21.15.91:0/3509928308 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040035f0 con 0x7f321c0c1100 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.744+0000 7f3218ff9640 1 -- 172.21.15.91:0/3509928308 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3204003750 con 0x7f321c0c1100 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.744+0000 7f3218ff9640 1 -- 172.21.15.91:0/3509928308 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204003b00 con 0x7f321c0c1100 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.744+0000 7f3220981640 1 -- 172.21.15.91:0/3509928308 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321c15afb0 con 0x7f321c0c1100 2023-11-27T20:44:07.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.744+0000 7f3220981640 1 -- 172.21.15.91:0/3509928308 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c1f2850 con 0x7f321c0c1100 2023-11-27T20:44:07.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.745+0000 7f3220981640 1 -- 172.21.15.91:0/3509928308 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321c04e840 con 0x7f321c0c1100 2023-11-27T20:44:07.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.746+0000 7f3218ff9640 1 -- 172.21.15.91:0/3509928308 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3204003c60 con 0x7f321c0c1100 2023-11-27T20:44:07.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.747+0000 7f3218ff9640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31fc06b1c0 0x7f31fc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:07.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.747+0000 7f3218ff9640 1 -- 172.21.15.91:0/3509928308 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f3204088ec0 con 0x7f321c0c1100 2023-11-27T20:44:07.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.747+0000 7f321b7fe640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31fc06b1c0 0x7f31fc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:07.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.748+0000 7f321b7fe640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31fc06b1c0 0x7f31fc06d680 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f320c009670 tx=0x7f320c006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:07.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.753+0000 7f3218ff9640 1 -- 172.21.15.91:0/3509928308 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3204053990 con 0x7f321c0c1100 2023-11-27T20:44:07.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:07.978+0000 7f3220981640 1 -- 172.21.15.91:0/3509928308 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f321c0ab530 con 0x7f321c0c1100 2023-11-27T20:44:08.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.534+0000 7f3218ff9640 1 -- 172.21.15.91:0/3509928308 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v31) v1 ==== 177+0+0 (secure 0 0 0) 0x7f3204056fb0 con 0x7f321c0c1100 2023-11-27T20:44:08.537 INFO:teuthology.orchestra.run.smithi091.stderr:new fs with metadata pool 10 and data pool 11 2023-11-27T20:44:08.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.540+0000 7f3220981640 1 -- 172.21.15.91:0/3509928308 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31fc06b1c0 msgr2=0x7f31fc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:08.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.540+0000 7f3220981640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31fc06b1c0 0x7f31fc06d680 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f320c009670 tx=0x7f320c006bf0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.540+0000 7f3220981640 1 -- 172.21.15.91:0/3509928308 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 msgr2=0x7f321c15a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:08.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.540+0000 7f3220981640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 0x7f321c15a890 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f320400c410 tx=0x7f320400c8d0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.541+0000 7f3220981640 1 -- 172.21.15.91:0/3509928308 shutdown_connections 2023-11-27T20:44:08.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.541+0000 7f3220981640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f321c155f60 0x7f321c1f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.541+0000 7f3220981640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321c0c1100 0x7f321c15a890 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.541+0000 7f3220981640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31fc06b1c0 0x7f31fc06d680 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.541+0000 7f3220981640 1 --2- 172.21.15.91:0/3509928308 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f321c06e000 0x7f321c0ab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.541+0000 7f3220981640 1 -- 172.21.15.91:0/3509928308 >> 172.21.15.91:0/3509928308 conn(0x7f321c0a77f0 msgr2=0x7f321c1566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:08.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.542+0000 7f3220981640 1 -- 172.21.15.91:0/3509928308 shutdown_connections 2023-11-27T20:44:08.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.542+0000 7f3220981640 1 -- 172.21.15.91:0/3509928308 wait complete. 2023-11-27T20:44:08.574 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:08.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.754+0000 7f27e8f90640 1 Processor -- start 2023-11-27T20:44:08.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.754+0000 7f27e8f90640 1 -- start start 2023-11-27T20:44:08.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.756+0000 7f27e8f90640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f27e4152f20 0x7f27e40c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:08.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.756+0000 7f27e8f90640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40c64a0 con 0x7f27e406d0a0 2023-11-27T20:44:08.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.756+0000 7f27e8f90640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40c5c00 con 0x7f27e414fd30 2023-11-27T20:44:08.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.756+0000 7f27e8f90640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40c5ee0 con 0x7f27e4152f20 2023-11-27T20:44:08.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.756+0000 7f27e2d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f27e4152f20 0x7f27e40c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:08.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.756+0000 7f27e2d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f27e4152f20 0x7f27e40c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41724/0 (socket says 172.21.15.91:41724) 2023-11-27T20:44:08.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.756+0000 7f27e2d9d640 1 -- 172.21.15.91:0/3056783094 learned_addr learned my addr 172.21.15.91:0/3056783094 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:08.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.756+0000 7f27e1d9b640 1 --1- 172.21.15.91:0/3056783094 >> v1:172.21.15.91:6789/0 conn(0x7f27e406d0a0 0x7f27e40c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50934/0 (socket says 172.21.15.91:50934) 2023-11-27T20:44:08.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.757+0000 7f27e2d9d640 1 -- 172.21.15.91:0/3056783094 >> v1:172.21.15.183:6789/0 conn(0x7f27e414fd30 legacy=0x7f27e40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:08.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.757+0000 7f27e2d9d640 1 -- 172.21.15.91:0/3056783094 >> v1:172.21.15.91:6789/0 conn(0x7f27e406d0a0 legacy=0x7f27e40c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:08.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.757+0000 7f27e2d9d640 1 -- 172.21.15.91:0/3056783094 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40c61c0 con 0x7f27e4152f20 2023-11-27T20:44:08.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.758+0000 7f27e2d9d640 1 --2- 172.21.15.91:0/3056783094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e4152f20 0x7f27e40c45b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009e50 tx=0x7f27dc02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b273e761e4eacc91 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:08.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.758+0000 7f27e159a640 1 -- 172.21.15.91:0/3056783094 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc02cb10 con 0x7f27e4152f20 2023-11-27T20:44:08.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.758+0000 7f27e159a640 1 -- 172.21.15.91:0/3056783094 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc02cc70 con 0x7f27e4152f20 2023-11-27T20:44:08.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.758+0000 7f27e159a640 1 -- 172.21.15.91:0/3056783094 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0343f0 con 0x7f27e4152f20 2023-11-27T20:44:08.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.759+0000 7f27e8f90640 1 -- 172.21.15.91:0/3056783094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e4152f20 msgr2=0x7f27e40c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:08.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.759+0000 7f27e8f90640 1 --2- 172.21.15.91:0/3056783094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e4152f20 0x7f27e40c45b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009e50 tx=0x7f27dc02bf70 comp rx=0 tx=0).stop 2023-11-27T20:44:08.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.759+0000 7f27e8f90640 1 -- 172.21.15.91:0/3056783094 shutdown_connections 2023-11-27T20:44:08.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.759+0000 7f27e8f90640 1 --2- 172.21.15.91:0/3056783094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e4152f20 0x7f27e40c45b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.759+0000 7f27e8f90640 1 -- 172.21.15.91:0/3056783094 >> 172.21.15.91:0/3056783094 conn(0x7f27e406a500 msgr2=0x7f27e406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:08.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.759+0000 7f27e8f90640 1 -- 172.21.15.91:0/3056783094 shutdown_connections 2023-11-27T20:44:08.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.759+0000 7f27e8f90640 1 -- 172.21.15.91:0/3056783094 wait complete. 2023-11-27T20:44:08.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.761+0000 7f27e8f90640 1 Processor -- start 2023-11-27T20:44:08.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.761+0000 7f27e8f90640 1 -- start start 2023-11-27T20:44:08.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e8f90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e406d0a0 0x7f27e4155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:08.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e8f90640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e414fd30 0x7f27e41551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:08.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e8f90640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4152f20 0x7f27e41edae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:08.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e8f90640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e41dc430 con 0x7f27e414fd30 2023-11-27T20:44:08.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e8f90640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e41ee790 con 0x7f27e4152f20 2023-11-27T20:44:08.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e8f90640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4156440 con 0x7f27e406d0a0 2023-11-27T20:44:08.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e1d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e414fd30 0x7f27e41551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:08.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e1d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e414fd30 0x7f27e41551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41732/0 (socket says 172.21.15.91:41732) 2023-11-27T20:44:08.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e1d9b640 1 -- 172.21.15.91:0/2241384589 learned_addr learned my addr 172.21.15.91:0/2241384589 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:08.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e1d9b640 1 -- 172.21.15.91:0/2241384589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e406d0a0 msgr2=0x7f27e4155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:08.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e1d9b640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e406d0a0 0x7f27e4155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e1d9b640 1 -- 172.21.15.91:0/2241384589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4152f20 msgr2=0x7f27e41edae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:08.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e1d9b640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4152f20 0x7f27e41edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.762+0000 7f27e1d9b640 1 -- 172.21.15.91:0/2241384589 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc009b30 con 0x7f27e414fd30 2023-11-27T20:44:08.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.763+0000 7f27e1d9b640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e414fd30 0x7f27e41551d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f27d800c480 tx=0x7f27d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:08.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.763+0000 7f27d2ffd640 1 -- 172.21.15.91:0/2241384589 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8007480 con 0x7f27e414fd30 2023-11-27T20:44:08.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.763+0000 7f27d2ffd640 1 -- 172.21.15.91:0/2241384589 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d80075e0 con 0x7f27e414fd30 2023-11-27T20:44:08.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.763+0000 7f27d2ffd640 1 -- 172.21.15.91:0/2241384589 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8004a00 con 0x7f27e414fd30 2023-11-27T20:44:08.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.763+0000 7f27e8f90640 1 -- 172.21.15.91:0/2241384589 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e4153a00 con 0x7f27e414fd30 2023-11-27T20:44:08.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.763+0000 7f27e8f90640 1 -- 172.21.15.91:0/2241384589 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e4155710 con 0x7f27e414fd30 2023-11-27T20:44:08.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.764+0000 7f27e8f90640 1 -- 172.21.15.91:0/2241384589 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e4153c40 con 0x7f27e414fd30 2023-11-27T20:44:08.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.765+0000 7f27d2ffd640 1 -- 172.21.15.91:0/2241384589 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f27d8004b60 con 0x7f27e414fd30 2023-11-27T20:44:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.766+0000 7f27d2ffd640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f27c406b1c0 0x7f27c406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.766+0000 7f27d2ffd640 1 -- 172.21.15.91:0/2241384589 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f27d8088ea0 con 0x7f27e414fd30 2023-11-27T20:44:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.766+0000 7f27e259c640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f27c406b1c0 0x7f27c406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:08.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.767+0000 7f27e259c640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f27c406b1c0 0x7f27c406d680 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27d4003cc0 tx=0x7f27d40079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:08.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.770+0000 7f27d2ffd640 1 -- 172.21.15.91:0/2241384589 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f27e4153c40 con 0x7f27e414fd30 2023-11-27T20:44:08.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.961+0000 7f27e8f90640 1 -- 172.21.15.91:0/2241384589 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27e4153c40 con 0x7f27e414fd30 2023-11-27T20:44:08.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.964+0000 7f27d2ffd640 1 -- 172.21.15.91:0/2241384589 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20258 (secure 0 0 0) 0x7f27e4153c40 con 0x7f27e414fd30 2023-11-27T20:44:08.966 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:08.966 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":58,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:07.980399+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:08.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.967+0000 7f27e8f90640 1 -- 172.21.15.91:0/2241384589 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f27c406b1c0 msgr2=0x7f27c406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:08.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.967+0000 7f27e8f90640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f27c406b1c0 0x7f27c406d680 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27d4003cc0 tx=0x7f27d40079b0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.967+0000 7f27e8f90640 1 -- 172.21.15.91:0/2241384589 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e414fd30 msgr2=0x7f27e41551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:08.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.967+0000 7f27e8f90640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e414fd30 0x7f27e41551d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f27d800c480 tx=0x7f27d800c940 comp rx=0 tx=0).stop 2023-11-27T20:44:08.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.967+0000 7f27e8f90640 1 -- 172.21.15.91:0/2241384589 shutdown_connections 2023-11-27T20:44:08.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.967+0000 7f27e8f90640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f27c406b1c0 0x7f27c406d680 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.967+0000 7f27e8f90640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4152f20 0x7f27e41edae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.967+0000 7f27e8f90640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27e414fd30 0x7f27e41551d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.967+0000 7f27e8f90640 1 --2- 172.21.15.91:0/2241384589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e406d0a0 0x7f27e4155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:08.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.967+0000 7f27e8f90640 1 -- 172.21.15.91:0/2241384589 >> 172.21.15.91:0/2241384589 conn(0x7f27e406a500 msgr2=0x7f27e40bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:08.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.968+0000 7f27e8f90640 1 -- 172.21.15.91:0/2241384589 shutdown_connections 2023-11-27T20:44:08.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:08.968+0000 7f27e8f90640 1 -- 172.21.15.91:0/2241384589 wait complete. 2023-11-27T20:44:08.987 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:09.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.200+0000 7fa017b8a640 1 Processor -- start 2023-11-27T20:44:09.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.201+0000 7fa017b8a640 1 -- start start 2023-11-27T20:44:09.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.202+0000 7fa017b8a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0100c45d0 0x7fa010155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.202+0000 7fa017b8a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0100bfdc0 con 0x7fa0100c5ec0 2023-11-27T20:44:09.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.202+0000 7fa017b8a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa010156a80 con 0x7fa0100c3340 2023-11-27T20:44:09.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.202+0000 7fa017b8a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01006e390 con 0x7fa0100c45d0 2023-11-27T20:44:09.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa015926640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa0100c5ec0 0x7fa0100c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50946/0 (socket says 172.21.15.91:50946) 2023-11-27T20:44:09.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa015926640 1 -- 172.21.15.91:0/3460094573 learned_addr learned my addr 172.21.15.91:0/3460094573 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:09.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa015125640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0100c45d0 0x7fa010155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971554372 0 0) 0x7fa0100bfdc0 con 0x7fa0100c5ec0 2023-11-27T20:44:09.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ffc003520 con 0x7fa0100c5ec0 2023-11-27T20:44:09.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699789499 0 0) 0x7f9ffc003520 con 0x7fa0100c5ec0 2023-11-27T20:44:09.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0100c45d0 msgr2=0x7fa010155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:09.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0100c45d0 0x7fa010155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 >> v1:172.21.15.183:6789/0 conn(0x7fa0100c3340 legacy=0x7fa010156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01006ddd0 con 0x7fa0100c5ec0 2023-11-27T20:44:09.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fa00c001670 con 0x7fa0100c5ec0 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 >> v1:172.21.15.91:6789/0 conn(0x7fa0100c5ec0 legacy=0x7fa0100c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ffc0039a0 0x7f9ffc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ffc0047c0 0x7f9ffc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0100c45d0 0x7f9ffc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.203+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01006e390 con 0x7f9ffc0039a0 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.204+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc005510 con 0x7f9ffc0047c0 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.204+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc00bec0 con 0x7fa0100c45d0 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.204+0000 7fa015926640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ffc0039a0 0x7f9ffc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.204+0000 7fa015125640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ffc0047c0 0x7f9ffc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.204+0000 7fa015926640 1 -- 172.21.15.91:0/3460094573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0100c45d0 msgr2=0x7f9ffc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.204+0000 7fa015926640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0100c45d0 0x7f9ffc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.204+0000 7fa015926640 1 -- 172.21.15.91:0/3460094573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ffc0047c0 msgr2=0x7f9ffc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:09.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.204+0000 7fa015926640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ffc0047c0 0x7f9ffc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.204+0000 7fa015926640 1 -- 172.21.15.91:0/3460094573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc003520 con 0x7f9ffc0039a0 2023-11-27T20:44:09.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.205+0000 7fa015926640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ffc0039a0 0x7f9ffc003de0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c240 tx=0x7f9ffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336df265a0d2b9e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:09.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.206+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c005ad0 con 0x7f9ffc0039a0 2023-11-27T20:44:09.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.206+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c005c30 con 0x7f9ffc0039a0 2023-11-27T20:44:09.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.206+0000 7fa014924640 1 -- 172.21.15.91:0/3460094573 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c02c8b0 con 0x7f9ffc0039a0 2023-11-27T20:44:09.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.206+0000 7fa017b8a640 1 -- 172.21.15.91:0/3460094573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ffc0039a0 msgr2=0x7f9ffc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.206+0000 7fa017b8a640 1 --2- 172.21.15.91:0/3460094573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9ffc0039a0 0x7f9ffc003de0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c240 tx=0x7f9ffc0057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.206+0000 7fa016127640 1 -- 172.21.15.91:0/3460094573 reap_dead start 2023-11-27T20:44:09.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.206+0000 7fa017b8a640 1 -- 172.21.15.91:0/3460094573 shutdown_connections 2023-11-27T20:44:09.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.206+0000 7fa017b8a640 1 -- 172.21.15.91:0/3460094573 >> 172.21.15.91:0/3460094573 conn(0x7fa01006a500 msgr2=0x7fa01006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:09.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.206+0000 7fa017b8a640 1 -- 172.21.15.91:0/3460094573 shutdown_connections 2023-11-27T20:44:09.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.206+0000 7fa017b8a640 1 -- 172.21.15.91:0/3460094573 wait complete. 2023-11-27T20:44:09.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.208+0000 7fa017b8a640 1 Processor -- start 2023-11-27T20:44:09.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.208+0000 7fa017b8a640 1 -- start start 2023-11-27T20:44:09.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.209+0000 7fa017b8a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ffc0039a0 0x7fa0100a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.209+0000 7fa017b8a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa010150d40 0x7fa0100c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.209+0000 7fa017b8a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0101512c0 0x7fa010151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.209+0000 7fa017b8a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0101ea3f0 con 0x7fa010150d40 2023-11-27T20:44:09.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.209+0000 7fa017b8a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100a47c0 con 0x7f9ffc0039a0 2023-11-27T20:44:09.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.209+0000 7fa017b8a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0101ea6b0 con 0x7fa0101512c0 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.209+0000 7fa015125640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa010150d40 0x7fa0100c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.209+0000 7fa015125640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa010150d40 0x7fa0100c13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41756/0 (socket says 172.21.15.91:41756) 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.209+0000 7fa015125640 1 -- 172.21.15.91:0/2840844027 learned_addr learned my addr 172.21.15.91:0/2840844027 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa015926640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ffc0039a0 0x7fa0100a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa016127640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0101512c0 0x7fa010151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa015125640 1 -- 172.21.15.91:0/2840844027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0101512c0 msgr2=0x7fa010151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa015125640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0101512c0 0x7fa010151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa015125640 1 -- 172.21.15.91:0/2840844027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ffc0039a0 msgr2=0x7fa0100a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa015125640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ffc0039a0 0x7fa0100a41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa015125640 1 -- 172.21.15.91:0/2840844027 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0101ea990 con 0x7fa010150d40 2023-11-27T20:44:09.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa015926640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ffc0039a0 0x7fa0100a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:09.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa015125640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa010150d40 0x7fa0100c13f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa004010890 tx=0x7fa004010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:09.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa0027fc640 1 -- 172.21.15.91:0/2840844027 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004009550 con 0x7fa010150d40 2023-11-27T20:44:09.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa0027fc640 1 -- 172.21.15.91:0/2840844027 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00400eb60 con 0x7fa010150d40 2023-11-27T20:44:09.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa017b8a640 1 -- 172.21.15.91:0/2840844027 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0101eac70 con 0x7fa010150d40 2023-11-27T20:44:09.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.210+0000 7fa0027fc640 1 -- 172.21.15.91:0/2840844027 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00401c400 con 0x7fa010150d40 2023-11-27T20:44:09.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.211+0000 7fa017b8a640 1 -- 172.21.15.91:0/2840844027 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0101eb190 con 0x7fa010150d40 2023-11-27T20:44:09.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.212+0000 7fa017b8a640 1 -- 172.21.15.91:0/2840844027 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa010068350 con 0x7fa010150d40 2023-11-27T20:44:09.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.213+0000 7fa0027fc640 1 -- 172.21.15.91:0/2840844027 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa00401c560 con 0x7fa010150d40 2023-11-27T20:44:09.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.214+0000 7fa0027fc640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9ff406b1f0 0x7f9ff406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.214+0000 7fa0027fc640 1 -- 172.21.15.91:0/2840844027 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa00408a080 con 0x7fa010150d40 2023-11-27T20:44:09.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.214+0000 7fa015926640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9ff406b1f0 0x7f9ff406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.215+0000 7fa015926640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9ff406b1f0 0x7f9ff406d6b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa00c034000 tx=0x7fa00c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:09.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.218+0000 7fa0027fc640 1 -- 172.21.15.91:0/2840844027 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa004054b90 con 0x7fa010150d40 2023-11-27T20:44:09.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.411+0000 7fa017b8a640 1 -- 172.21.15.91:0/2840844027 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa01006a8e0 con 0x7fa010150d40 2023-11-27T20:44:09.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.413+0000 7fa0027fc640 1 -- 172.21.15.91:0/2840844027 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20258 (secure 0 0 0) 0x7fa0040581b0 con 0x7fa010150d40 2023-11-27T20:44:09.415 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:09.415 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":58,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:07.980399+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 -- 172.21.15.91:0/2840844027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9ff406b1f0 msgr2=0x7f9ff406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9ff406b1f0 0x7f9ff406d6b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa00c034000 tx=0x7fa00c009030 comp rx=0 tx=0).stop 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 -- 172.21.15.91:0/2840844027 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa010150d40 msgr2=0x7fa0100c13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa010150d40 0x7fa0100c13f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa004010890 tx=0x7fa004010d50 comp rx=0 tx=0).stop 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 -- 172.21.15.91:0/2840844027 shutdown_connections 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0101512c0 0x7fa010151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa010150d40 0x7fa0100c13f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9ff406b1f0 0x7f9ff406d6b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 --2- 172.21.15.91:0/2840844027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ffc0039a0 0x7fa0100a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 -- 172.21.15.91:0/2840844027 >> 172.21.15.91:0/2840844027 conn(0x7fa01006a500 msgr2=0x7fa010072570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:09.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.416+0000 7fa017b8a640 1 -- 172.21.15.91:0/2840844027 shutdown_connections 2023-11-27T20:44:09.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.417+0000 7fa017b8a640 1 -- 172.21.15.91:0/2840844027 wait complete. 2023-11-27T20:44:09.437 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-27T20:44:09.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.655+0000 7fde3815a640 1 Processor -- start 2023-11-27T20:44:09.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.656+0000 7fde3815a640 1 -- start start 2023-11-27T20:44:09.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.657+0000 7fde3815a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fde30155190 0x7fde301600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.657+0000 7fde3815a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde30154740 con 0x7fde300c7ec0 2023-11-27T20:44:09.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.657+0000 7fde3815a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3006c760 con 0x7fde30151cc0 2023-11-27T20:44:09.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.657+0000 7fde3815a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300c8470 con 0x7fde30155190 2023-11-27T20:44:09.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.657+0000 7fde356f5640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fde300c7ec0 0x7fde300c4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50950/0 (socket says 172.21.15.91:50950) 2023-11-27T20:44:09.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.657+0000 7fde356f5640 1 -- 172.21.15.91:0/487537929 learned_addr learned my addr 172.21.15.91:0/487537929 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde366f7640 1 --2- 172.21.15.91:0/487537929 >> v2:172.21.15.183:3300/0 conn(0x7fde30155190 0x7fde301600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598921219 0 0) 0x7fde30154740 con 0x7fde300c7ec0 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde18003520 con 0x7fde300c7ec0 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4058309118 0 0) 0x7fde18003520 con 0x7fde300c7ec0 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 >> v2:172.21.15.183:3300/0 conn(0x7fde30155190 msgr2=0x7fde301600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 --2- 172.21.15.91:0/487537929 >> v2:172.21.15.183:3300/0 conn(0x7fde30155190 0x7fde301600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 >> v1:172.21.15.183:6789/0 conn(0x7fde30151cc0 legacy=0x7fde30157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300c8750 con 0x7fde300c7ec0 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fde24001670 con 0x7fde300c7ec0 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 >> v1:172.21.15.91:6789/0 conn(0x7fde300c7ec0 legacy=0x7fde300c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde18003970 0x7fde18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde180047c0 0x7fde18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde18005180 0x7fde1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde300c8470 con 0x7fde18005180 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1800c0d0 con 0x7fde18003970 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.658+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1800c290 con 0x7fde180047c0 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.659+0000 7fde366f7640 1 --2- 172.21.15.91:0/487537929 >> v2:172.21.15.183:3300/0 conn(0x7fde30155190 0x7fde301600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.659+0000 7fde366f7640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde18005180 0x7fde1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.659+0000 7fde356f5640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde180047c0 0x7fde18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.659+0000 7fde366f7640 1 -- 172.21.15.91:0/487537929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde180047c0 msgr2=0x7fde18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.659+0000 7fde366f7640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde180047c0 0x7fde18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.659+0000 7fde366f7640 1 -- 172.21.15.91:0/487537929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde18003970 msgr2=0x7fde18003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.659+0000 7fde366f7640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde18003970 0x7fde18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.659+0000 7fde366f7640 1 -- 172.21.15.91:0/487537929 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18003520 con 0x7fde18005180 2023-11-27T20:44:09.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.659+0000 7fde356f5640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde180047c0 0x7fde18004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.660+0000 7fde366f7640 1 -- 172.21.15.91:0/487537929 reap_dead start 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.661+0000 7fde366f7640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde18005180 0x7fde1800b980 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fde280098a0 tx=0x7fde180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349d4cf2b3d95083 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.661+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28037600 con 0x7fde18005180 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.661+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde28037760 con 0x7fde18005180 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.661+0000 7fde34ef4640 1 -- 172.21.15.91:0/487537929 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28037ad0 con 0x7fde18005180 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.661+0000 7fde3815a640 1 -- 172.21.15.91:0/487537929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde18005180 msgr2=0x7fde1800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.661+0000 7fde3815a640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde18005180 0x7fde1800b980 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fde280098a0 tx=0x7fde180057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.661+0000 7fde3815a640 1 -- 172.21.15.91:0/487537929 shutdown_connections 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.661+0000 7fde3815a640 1 --2- 172.21.15.91:0/487537929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde18005180 0x7fde1800b980 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.661+0000 7fde3815a640 1 -- 172.21.15.91:0/487537929 >> 172.21.15.91:0/487537929 conn(0x7fde30071e10 msgr2=0x7fde30072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:09.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.662+0000 7fde3815a640 1 -- 172.21.15.91:0/487537929 shutdown_connections 2023-11-27T20:44:09.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.662+0000 7fde3815a640 1 -- 172.21.15.91:0/487537929 wait complete. 2023-11-27T20:44:09.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.663+0000 7fde3815a640 1 Processor -- start 2023-11-27T20:44:09.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.663+0000 7fde3815a640 1 -- start start 2023-11-27T20:44:09.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.664+0000 7fde3815a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde18005180 0x7fde30153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.664+0000 7fde3815a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde300c1090 0x7fde3014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.664+0000 7fde3815a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde30150400 0x7fde300c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.664+0000 7fde3815a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde30150be0 con 0x7fde30150400 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.664+0000 7fde3815a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde301e9cd0 con 0x7fde300c1090 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.664+0000 7fde3815a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde30150900 con 0x7fde18005180 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.665+0000 7fde366f7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde30150400 0x7fde300c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.665+0000 7fde366f7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde30150400 0x7fde300c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41784/0 (socket says 172.21.15.91:41784) 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.665+0000 7fde366f7640 1 -- 172.21.15.91:0/2986531933 learned_addr learned my addr 172.21.15.91:0/2986531933 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.665+0000 7fde366f7640 1 -- 172.21.15.91:0/2986531933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde18005180 msgr2=0x7fde30153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.665+0000 7fde366f7640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde18005180 0x7fde30153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.665+0000 7fde366f7640 1 -- 172.21.15.91:0/2986531933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde300c1090 msgr2=0x7fde3014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.665+0000 7fde366f7640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde300c1090 0x7fde3014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.665+0000 7fde366f7640 1 -- 172.21.15.91:0/2986531933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde301e9ee0 con 0x7fde30150400 2023-11-27T20:44:09.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.665+0000 7fde366f7640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde30150400 0x7fde300c24a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fde2802bff0 tx=0x7fde28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:09.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.666+0000 7fde2e7fc640 1 -- 172.21.15.91:0/2986531933 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2802f800 con 0x7fde30150400 2023-11-27T20:44:09.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.666+0000 7fde2e7fc640 1 -- 172.21.15.91:0/2986531933 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2802f980 con 0x7fde30150400 2023-11-27T20:44:09.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.666+0000 7fde2e7fc640 1 -- 172.21.15.91:0/2986531933 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2802fd30 con 0x7fde30150400 2023-11-27T20:44:09.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.666+0000 7fde3815a640 1 -- 172.21.15.91:0/2986531933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde301ea1c0 con 0x7fde30150400 2023-11-27T20:44:09.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.666+0000 7fde3815a640 1 -- 172.21.15.91:0/2986531933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde30153db0 con 0x7fde30150400 2023-11-27T20:44:09.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.667+0000 7fde3815a640 1 -- 172.21.15.91:0/2986531933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde301ea6e0 con 0x7fde30150400 2023-11-27T20:44:09.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.668+0000 7fde2e7fc640 1 -- 172.21.15.91:0/2986531933 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fde28042440 con 0x7fde30150400 2023-11-27T20:44:09.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.669+0000 7fde2e7fc640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde1c06b1c0 0x7fde1c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:09.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.669+0000 7fde2e7fc640 1 -- 172.21.15.91:0/2986531933 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fde2803e040 con 0x7fde30150400 2023-11-27T20:44:09.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.669+0000 7fde35ef6640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde1c06b1c0 0x7fde1c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:09.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.670+0000 7fde35ef6640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde1c06b1c0 0x7fde1c06d680 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde20001cb0 tx=0x7fde20007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:09.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.673+0000 7fde2e7fc640 1 -- 172.21.15.91:0/2986531933 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fde301ea6e0 con 0x7fde30150400 2023-11-27T20:44:09.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:09.902+0000 7fde3815a640 1 -- 172.21.15.91:0/2986531933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fde301ea6e0 con 0x7fde30150400 2023-11-27T20:44:10.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.544+0000 7fde2e7fc640 1 -- 172.21.15.91:0/2986531933 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 119+0+0 (secure 0 0 0) 0x7fde301ea6e0 con 0x7fde30150400 2023-11-27T20:44:10.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 -- 172.21.15.91:0/2986531933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde1c06b1c0 msgr2=0x7fde1c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:10.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde1c06b1c0 0x7fde1c06d680 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde20001cb0 tx=0x7fde20007d30 comp rx=0 tx=0).stop 2023-11-27T20:44:10.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 -- 172.21.15.91:0/2986531933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde30150400 msgr2=0x7fde300c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:10.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde30150400 0x7fde300c24a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fde2802bff0 tx=0x7fde28004730 comp rx=0 tx=0).stop 2023-11-27T20:44:10.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 -- 172.21.15.91:0/2986531933 shutdown_connections 2023-11-27T20:44:10.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde30150400 0x7fde300c24a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:10.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde1c06b1c0 0x7fde1c06d680 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:10.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde300c1090 0x7fde3014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:10.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 --2- 172.21.15.91:0/2986531933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde18005180 0x7fde30153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:10.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 -- 172.21.15.91:0/2986531933 >> 172.21.15.91:0/2986531933 conn(0x7fde30071e10 msgr2=0x7fde300c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:10.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 -- 172.21.15.91:0/2986531933 shutdown_connections 2023-11-27T20:44:10.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.548+0000 7fde3815a640 1 -- 172.21.15.91:0/2986531933 wait complete. 2023-11-27T20:44:10.568 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T20:44:10.569 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-27T20:44:10.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.778+0000 7efc25460640 1 Processor -- start 2023-11-27T20:44:10.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.779+0000 7efc25460640 1 -- start start 2023-11-27T20:44:10.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.780+0000 7efc25460640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc2014e7c0 0x7efc200c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:10.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.780+0000 7efc25460640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efc200c4c00 0x7efc200ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:10.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.780+0000 7efc25460640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc20158a60 con 0x7efc200ca990 2023-11-27T20:44:10.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.780+0000 7efc25460640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc200c5b10 con 0x7efc200c4c00 2023-11-27T20:44:10.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.780+0000 7efc25460640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc20157ca0 con 0x7efc2014e7c0 2023-11-27T20:44:10.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.780+0000 7efc1f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efc200c4c00 0x7efc200ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:10.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.780+0000 7efc1f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efc200c4c00 0x7efc200ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41800/0 (socket says 172.21.15.91:41800) 2023-11-27T20:44:10.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.780+0000 7efc1f7fe640 1 -- 172.21.15.91:0/4131971842 learned_addr learned my addr 172.21.15.91:0/4131971842 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:10.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.780+0000 7efc1ffff640 1 --2- 172.21.15.91:0/4131971842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc2014e7c0 0x7efc200c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:10.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.780+0000 7efc1f7fe640 1 -- 172.21.15.91:0/4131971842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc2014e7c0 msgr2=0x7efc200c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:10.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.781+0000 7efc1f7fe640 1 --2- 172.21.15.91:0/4131971842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc2014e7c0 0x7efc200c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:10.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.781+0000 7efc1f7fe640 1 -- 172.21.15.91:0/4131971842 >> v1:172.21.15.91:6789/0 conn(0x7efc200ca990 legacy=0x7efc20154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:10.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.781+0000 7efc1f7fe640 1 -- 172.21.15.91:0/4131971842 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20157f80 con 0x7efc200c4c00 2023-11-27T20:44:10.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.781+0000 7efc1effd640 1 -- 172.21.15.91:0/4131971842 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677502793 0 0) 0x7efc20158a60 con 0x7efc200ca990 2023-11-27T20:44:10.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.781+0000 7efc1ffff640 1 --2- 172.21.15.91:0/4131971842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc2014e7c0 0x7efc200c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:10.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.782+0000 7efc1f7fe640 1 --2- 172.21.15.91:0/4131971842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200c4c00 0x7efc200ca450 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7efc08009870 tx=0x7efc0802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93479dac389ca01 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:10.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.782+0000 7efc1effd640 1 -- 172.21.15.91:0/4131971842 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080317d0 con 0x7efc200c4c00 2023-11-27T20:44:10.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.782+0000 7efc1effd640 1 -- 172.21.15.91:0/4131971842 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08031930 con 0x7efc200c4c00 2023-11-27T20:44:10.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.782+0000 7efc1effd640 1 -- 172.21.15.91:0/4131971842 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08031cc0 con 0x7efc200c4c00 2023-11-27T20:44:10.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.783+0000 7efc25460640 1 -- 172.21.15.91:0/4131971842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200c4c00 msgr2=0x7efc200ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:10.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.783+0000 7efc25460640 1 --2- 172.21.15.91:0/4131971842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200c4c00 0x7efc200ca450 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7efc08009870 tx=0x7efc0802b870 comp rx=0 tx=0).stop 2023-11-27T20:44:10.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.783+0000 7efc25460640 1 -- 172.21.15.91:0/4131971842 shutdown_connections 2023-11-27T20:44:10.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.783+0000 7efc25460640 1 --2- 172.21.15.91:0/4131971842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200c4c00 0x7efc200ca450 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:10.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.783+0000 7efc25460640 1 --2- 172.21.15.91:0/4131971842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc2014e7c0 0x7efc200c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:10.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.783+0000 7efc25460640 1 -- 172.21.15.91:0/4131971842 >> 172.21.15.91:0/4131971842 conn(0x7efc200abf00 msgr2=0x7efc200c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:10.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.783+0000 7efc25460640 1 -- 172.21.15.91:0/4131971842 shutdown_connections 2023-11-27T20:44:10.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.783+0000 7efc25460640 1 -- 172.21.15.91:0/4131971842 wait complete. 2023-11-27T20:44:10.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.784+0000 7efc25460640 1 Processor -- start 2023-11-27T20:44:10.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.785+0000 7efc25460640 1 -- start start 2023-11-27T20:44:10.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.785+0000 7efc25460640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc200c4c00 0x7efc2014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:10.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.785+0000 7efc25460640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200ca990 0x7efc200aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:10.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc25460640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc2014e7c0 0x7efc201ea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:10.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc25460640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc201e9a90 con 0x7efc200ca990 2023-11-27T20:44:10.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc25460640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc201e7730 con 0x7efc2014e7c0 2023-11-27T20:44:10.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc25460640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2014fea0 con 0x7efc200c4c00 2023-11-27T20:44:10.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc1f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200ca990 0x7efc200aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:10.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc1f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200ca990 0x7efc200aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41804/0 (socket says 172.21.15.91:41804) 2023-11-27T20:44:10.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc1f7fe640 1 -- 172.21.15.91:0/3620609486 learned_addr learned my addr 172.21.15.91:0/3620609486 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:10.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc1f7fe640 1 -- 172.21.15.91:0/3620609486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc200c4c00 msgr2=0x7efc2014da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:10.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc1f7fe640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc200c4c00 0x7efc2014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:10.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc1f7fe640 1 -- 172.21.15.91:0/3620609486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc2014e7c0 msgr2=0x7efc201ea1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:10.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc24c5f640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc2014e7c0 0x7efc201ea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:10.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc1f7fe640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc2014e7c0 0x7efc201ea1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:10.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.786+0000 7efc1f7fe640 1 -- 172.21.15.91:0/3620609486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc080094d0 con 0x7efc200ca990 2023-11-27T20:44:10.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.787+0000 7efc1f7fe640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200ca990 0x7efc200aab10 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efc0802b8b0 tx=0x7efc080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:10.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.787+0000 7efc1cff9640 1 -- 172.21.15.91:0/3620609486 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08032970 con 0x7efc200ca990 2023-11-27T20:44:10.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.787+0000 7efc1cff9640 1 -- 172.21.15.91:0/3620609486 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08032ad0 con 0x7efc200ca990 2023-11-27T20:44:10.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.787+0000 7efc1cff9640 1 -- 172.21.15.91:0/3620609486 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08032e80 con 0x7efc200ca990 2023-11-27T20:44:10.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.787+0000 7efc25460640 1 -- 172.21.15.91:0/3620609486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc20150180 con 0x7efc200ca990 2023-11-27T20:44:10.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.787+0000 7efc25460640 1 -- 172.21.15.91:0/3620609486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc20150460 con 0x7efc200ca990 2023-11-27T20:44:10.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.788+0000 7efc25460640 1 -- 172.21.15.91:0/3620609486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc201e9ee0 con 0x7efc200ca990 2023-11-27T20:44:10.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.789+0000 7efc1cff9640 1 -- 172.21.15.91:0/3620609486 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efc08030070 con 0x7efc200ca990 2023-11-27T20:44:10.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.790+0000 7efc1cff9640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc0006b1f0 0x7efc0006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:10.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.790+0000 7efc1cff9640 1 -- 172.21.15.91:0/3620609486 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efc080abd20 con 0x7efc200ca990 2023-11-27T20:44:10.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.790+0000 7efc1ffff640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc0006b1f0 0x7efc0006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:10.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.791+0000 7efc1ffff640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc0006b1f0 0x7efc0006d6b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efc10008e00 tx=0x7efc10008330 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:10.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:10.795+0000 7efc1cff9640 1 -- 172.21.15.91:0/3620609486 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efc201e9ee0 con 0x7efc200ca990 2023-11-27T20:44:11.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.022+0000 7efc25460640 1 -- 172.21.15.91:0/3620609486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efc201e9ee0 con 0x7efc200ca990 2023-11-27T20:44:11.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.558+0000 7efc1cff9640 1 -- 172.21.15.91:0/3620609486 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 123+0+0 (secure 0 0 0) 0x7efc201e9ee0 con 0x7efc200ca990 2023-11-27T20:44:11.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 -- 172.21.15.91:0/3620609486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc0006b1f0 msgr2=0x7efc0006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc0006b1f0 0x7efc0006d6b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efc10008e00 tx=0x7efc10008330 comp rx=0 tx=0).stop 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 -- 172.21.15.91:0/3620609486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200ca990 msgr2=0x7efc200aab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200ca990 0x7efc200aab10 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efc0802b8b0 tx=0x7efc080046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 -- 172.21.15.91:0/3620609486 shutdown_connections 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc0006b1f0 0x7efc0006d6b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc2014e7c0 0x7efc201ea1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc200ca990 0x7efc200aab10 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 --2- 172.21.15.91:0/3620609486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc200c4c00 0x7efc2014da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 -- 172.21.15.91:0/3620609486 >> 172.21.15.91:0/3620609486 conn(0x7efc200abf00 msgr2=0x7efc20148360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 -- 172.21.15.91:0/3620609486 shutdown_connections 2023-11-27T20:44:11.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.562+0000 7efc25460640 1 -- 172.21.15.91:0/3620609486 wait complete. 2023-11-27T20:44:11.583 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-27T20:44:11.584 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:44:11.646 INFO:tasks.ceph.mds.a.smithi091.stderr:2023-11-27T20:44:11.644+0000 7fa03b48e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:44:11.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.778+0000 7fa258b53640 1 Processor -- start 2023-11-27T20:44:11.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.779+0000 7fa258b53640 1 -- start start 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.780+0000 7fa258b53640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa25406d0a0 0x7fa254152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.780+0000 7fa258b53640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa2540c3ea0 0x7fa2540c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.780+0000 7fa258b53640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2540c64a0 con 0x7fa25414fd30 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.780+0000 7fa258b53640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2540c5c00 con 0x7fa25406d0a0 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.780+0000 7fa258b53640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2540c5ee0 con 0x7fa2540c3ea0 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa25259c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa25414fd30 0x7fa2540a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50962/0 (socket says 172.21.15.91:50962) 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa25259c640 1 -- 172.21.15.91:0/2941293051 learned_addr learned my addr 172.21.15.91:0/2941293051 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa24bfff640 1 --2- 172.21.15.91:0/2941293051 >> v2:172.21.15.91:3300/0 conn(0x7fa25406d0a0 0x7fa254152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa252d9d640 1 --2- 172.21.15.91:0/2941293051 >> v2:172.21.15.183:3300/0 conn(0x7fa2540c3ea0 0x7fa2540c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa251d9b640 1 -- 172.21.15.91:0/2941293051 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081748392 0 0) 0x7fa2540c64a0 con 0x7fa25414fd30 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa251d9b640 1 -- 172.21.15.91:0/2941293051 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa240003520 con 0x7fa25414fd30 2023-11-27T20:44:11.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa24bfff640 1 -- 172.21.15.91:0/2941293051 >> v2:172.21.15.183:3300/0 conn(0x7fa2540c3ea0 msgr2=0x7fa2540c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:11.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa24bfff640 1 --2- 172.21.15.91:0/2941293051 >> v2:172.21.15.183:3300/0 conn(0x7fa2540c3ea0 0x7fa2540c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa24bfff640 1 -- 172.21.15.91:0/2941293051 >> v1:172.21.15.91:6789/0 conn(0x7fa25414fd30 legacy=0x7fa2540a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:11.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa24bfff640 1 -- 172.21.15.91:0/2941293051 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2540c61c0 con 0x7fa25406d0a0 2023-11-27T20:44:11.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.781+0000 7fa252d9d640 1 --2- 172.21.15.91:0/2941293051 >> v2:172.21.15.183:3300/0 conn(0x7fa2540c3ea0 0x7fa2540c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:44:11.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.783+0000 7fa24bfff640 1 --2- 172.21.15.91:0/2941293051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25406d0a0 0x7fa254152f20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa25406e430 tx=0x7fa23c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a137b2c61a97b1cb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:11.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.783+0000 7fa251d9b640 1 -- 172.21.15.91:0/2941293051 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c031830 con 0x7fa25406d0a0 2023-11-27T20:44:11.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.783+0000 7fa251d9b640 1 -- 172.21.15.91:0/2941293051 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c031990 con 0x7fa25406d0a0 2023-11-27T20:44:11.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.783+0000 7fa251d9b640 1 -- 172.21.15.91:0/2941293051 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c031d20 con 0x7fa25406d0a0 2023-11-27T20:44:11.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.784+0000 7fa258b53640 1 -- 172.21.15.91:0/2941293051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25406d0a0 msgr2=0x7fa254152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:11.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.784+0000 7fa258b53640 1 --2- 172.21.15.91:0/2941293051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25406d0a0 0x7fa254152f20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa25406e430 tx=0x7fa23c02b8d0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.784+0000 7fa258b53640 1 -- 172.21.15.91:0/2941293051 shutdown_connections 2023-11-27T20:44:11.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.784+0000 7fa258b53640 1 --2- 172.21.15.91:0/2941293051 >> v2:172.21.15.183:3300/0 conn(0x7fa2540c3ea0 0x7fa2540c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.784+0000 7fa258b53640 1 --2- 172.21.15.91:0/2941293051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25406d0a0 0x7fa254152f20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.784+0000 7fa258b53640 1 -- 172.21.15.91:0/2941293051 >> 172.21.15.91:0/2941293051 conn(0x7fa25406a500 msgr2=0x7fa25406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:11.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.784+0000 7fa258b53640 1 -- 172.21.15.91:0/2941293051 shutdown_connections 2023-11-27T20:44:11.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.784+0000 7fa258b53640 1 -- 172.21.15.91:0/2941293051 wait complete. 2023-11-27T20:44:11.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.786+0000 7fa258b53640 1 Processor -- start 2023-11-27T20:44:11.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.786+0000 7fa258b53640 1 -- start start 2023-11-27T20:44:11.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa258b53640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25406d0a0 0x7fa25414ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:11.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa258b53640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2540c3ea0 0x7fa254154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:11.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa258b53640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25414fd30 0x7fa254154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa258b53640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2541eadf0 con 0x7fa25414fd30 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa258b53640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25414bf70 con 0x7fa2540c3ea0 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa258b53640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25414bc40 con 0x7fa25406d0a0 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa252d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25414fd30 0x7fa254154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa252d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25414fd30 0x7fa254154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41826/0 (socket says 172.21.15.91:41826) 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa252d9d640 1 -- 172.21.15.91:0/3160043435 learned_addr learned my addr 172.21.15.91:0/3160043435 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa24bfff640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2540c3ea0 0x7fa254154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.787+0000 7fa25259c640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25406d0a0 0x7fa25414ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa252d9d640 1 -- 172.21.15.91:0/3160043435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25406d0a0 msgr2=0x7fa25414ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa252d9d640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25406d0a0 0x7fa25414ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa252d9d640 1 -- 172.21.15.91:0/3160043435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2540c3ea0 msgr2=0x7fa254154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:11.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa252d9d640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2540c3ea0 0x7fa254154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:11.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa252d9d640 1 -- 172.21.15.91:0/3160043435 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c009400 con 0x7fa25414fd30 2023-11-27T20:44:11.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa25259c640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25406d0a0 0x7fa25414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:11.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa252d9d640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25414fd30 0x7fa254154570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa24c007f20 tx=0x7fa24c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:11.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa24affd640 1 -- 172.21.15.91:0/3160043435 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00dee0 con 0x7fa25414fd30 2023-11-27T20:44:11.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa24affd640 1 -- 172.21.15.91:0/3160043435 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c00f040 con 0x7fa25414fd30 2023-11-27T20:44:11.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa24affd640 1 -- 172.21.15.91:0/3160043435 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c003dd0 con 0x7fa25414fd30 2023-11-27T20:44:11.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa258b53640 1 -- 172.21.15.91:0/3160043435 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2541eafe0 con 0x7fa25414fd30 2023-11-27T20:44:11.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.788+0000 7fa258b53640 1 -- 172.21.15.91:0/3160043435 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2541eb2c0 con 0x7fa25414fd30 2023-11-27T20:44:11.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.789+0000 7fa258b53640 1 -- 172.21.15.91:0/3160043435 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa254068350 con 0x7fa25414fd30 2023-11-27T20:44:11.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.790+0000 7fa24affd640 1 -- 172.21.15.91:0/3160043435 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa24c004030 con 0x7fa25414fd30 2023-11-27T20:44:11.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.791+0000 7fa24affd640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa23406b1f0 0x7fa23406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:11.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.791+0000 7fa24affd640 1 -- 172.21.15.91:0/3160043435 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa24c08a1c0 con 0x7fa25414fd30 2023-11-27T20:44:11.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.791+0000 7fa25259c640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa23406b1f0 0x7fa23406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:11.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.792+0000 7fa25259c640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa23406b1f0 0x7fa23406d6b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa2440011e0 tx=0x7fa244009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:11.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:11.795+0000 7fa24affd640 1 -- 172.21.15.91:0/3160043435 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa24c054af0 con 0x7fa25414fd30 2023-11-27T20:44:12.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.004+0000 7fa258b53640 1 -- 172.21.15.91:0/3160043435 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa25414c0b0 con 0x7fa25414fd30 2023-11-27T20:44:12.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.005+0000 7fa24affd640 1 -- 172.21.15.91:0/3160043435 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6132 (secure 0 0 0) 0x7fa24c058110 con 0x7fa25414fd30 2023-11-27T20:44:12.007 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:12.007 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:43:52.149238+0000","modified":"2023-11-27T20:43:55.217623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/42700883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":42700883},{"type":"v1","addr":"172.21.15.91:6837","nonce":42700883}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:44:07.981170+0000","modified":"2023-11-27T20:44:11.024916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5790},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5790":{"gid":5790,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6836/1107018884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1107018884},{"type":"v1","addr":"172.21.15.91:6836","nonce":1107018884}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-27T20:44:12.008 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 35 2023-11-27T20:44:12.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 -- 172.21.15.91:0/3160043435 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa23406b1f0 msgr2=0x7fa23406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa23406b1f0 0x7fa23406d6b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa2440011e0 tx=0x7fa244009040 comp rx=0 tx=0).stop 2023-11-27T20:44:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 -- 172.21.15.91:0/3160043435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25414fd30 msgr2=0x7fa254154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25414fd30 0x7fa254154570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa24c007f20 tx=0x7fa24c00d560 comp rx=0 tx=0).stop 2023-11-27T20:44:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 -- 172.21.15.91:0/3160043435 shutdown_connections 2023-11-27T20:44:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa25414fd30 0x7fa254154570 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa23406b1f0 0x7fa23406d6b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2540c3ea0 0x7fa254154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 --2- 172.21.15.91:0/3160043435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25406d0a0 0x7fa25414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 -- 172.21.15.91:0/3160043435 >> 172.21.15.91:0/3160043435 conn(0x7fa25406a500 msgr2=0x7fa2540c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:12.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 -- 172.21.15.91:0/3160043435 shutdown_connections 2023-11-27T20:44:12.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.008+0000 7fa258b53640 1 -- 172.21.15.91:0/3160043435 wait complete. 2023-11-27T20:44:12.027 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:12.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.234+0000 7f7a07fff640 1 Processor -- start 2023-11-27T20:44:12.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.234+0000 7f7a07fff640 1 -- start start 2023-11-27T20:44:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.235+0000 7f7a07fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7a0814c2e0 0x7f7a080c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.235+0000 7f7a07fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7a080c0440 0x7f7a08152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.235+0000 7f7a07fff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a08071e80 con 0x7f7a08072310 2023-11-27T20:44:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.235+0000 7f7a07fff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a08071470 con 0x7f7a0814c2e0 2023-11-27T20:44:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.235+0000 7f7a07fff640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0814c6c0 con 0x7f7a080c0440 2023-11-27T20:44:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.235+0000 7f7a06ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7a0814c2e0 0x7f7a080c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.235+0000 7f7a077fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f7a08072310 0x7f7a080a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50976/0 (socket says 172.21.15.91:50976) 2023-11-27T20:44:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.235+0000 7f7a06ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7a0814c2e0 0x7f7a080c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41840/0 (socket says 172.21.15.91:41840) 2023-11-27T20:44:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.235+0000 7f7a077fe640 1 -- 172.21.15.91:0/3070962292 learned_addr learned my addr 172.21.15.91:0/3070962292 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.236+0000 7f7a067fc640 1 --2- 172.21.15.91:0/3070962292 >> v2:172.21.15.183:3300/0 conn(0x7f7a080c0440 0x7f7a08152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.236+0000 7f7a06ffd640 1 -- 172.21.15.91:0/3070962292 >> v2:172.21.15.183:3300/0 conn(0x7f7a080c0440 msgr2=0x7f7a08152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.236+0000 7f7a06ffd640 1 --2- 172.21.15.91:0/3070962292 >> v2:172.21.15.183:3300/0 conn(0x7f7a080c0440 0x7f7a08152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.236+0000 7f7a06ffd640 1 -- 172.21.15.91:0/3070962292 >> v1:172.21.15.91:6789/0 conn(0x7f7a08072310 legacy=0x7f7a080a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.236+0000 7f7a06ffd640 1 -- 172.21.15.91:0/3070962292 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08153180 con 0x7f7a0814c2e0 2023-11-27T20:44:12.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.236+0000 7f7a05ffb640 1 -- 172.21.15.91:0/3070962292 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978752351 0 0) 0x7f7a08071e80 con 0x7f7a08072310 2023-11-27T20:44:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.237+0000 7f7a06ffd640 1 --2- 172.21.15.91:0/3070962292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 0x7f7a080c0c80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7a080678c0 tx=0x7f79f802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a8a475b0ea0c71 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.237+0000 7f7a05ffb640 1 -- 172.21.15.91:0/3070962292 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8031710 con 0x7f7a0814c2e0 2023-11-27T20:44:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.237+0000 7f7a05ffb640 1 -- 172.21.15.91:0/3070962292 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f802f050 con 0x7f7a0814c2e0 2023-11-27T20:44:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.237+0000 7f7a05ffb640 1 -- 172.21.15.91:0/3070962292 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8031a90 con 0x7f7a0814c2e0 2023-11-27T20:44:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.238+0000 7f7a07fff640 1 -- 172.21.15.91:0/3070962292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 msgr2=0x7f7a080c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.238+0000 7f7a07fff640 1 --2- 172.21.15.91:0/3070962292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 0x7f7a080c0c80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7a080678c0 tx=0x7f79f802b7b0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.238+0000 7f7a07fff640 1 -- 172.21.15.91:0/3070962292 shutdown_connections 2023-11-27T20:44:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.238+0000 7f7a07fff640 1 --2- 172.21.15.91:0/3070962292 >> v2:172.21.15.183:3300/0 conn(0x7f7a080c0440 0x7f7a08152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.238+0000 7f7a07fff640 1 --2- 172.21.15.91:0/3070962292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 0x7f7a080c0c80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.238+0000 7f7a07fff640 1 -- 172.21.15.91:0/3070962292 >> 172.21.15.91:0/3070962292 conn(0x7f7a080a77f0 msgr2=0x7f7a080a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:12.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.238+0000 7f7a07fff640 1 -- 172.21.15.91:0/3070962292 shutdown_connections 2023-11-27T20:44:12.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.238+0000 7f7a07fff640 1 -- 172.21.15.91:0/3070962292 wait complete. 2023-11-27T20:44:12.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.240+0000 7f7a07fff640 1 Processor -- start 2023-11-27T20:44:12.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.240+0000 7f7a07fff640 1 -- start start 2023-11-27T20:44:12.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a08072310 0x7f7a081471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a080c0440 0x7f7a080bee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 0x7f7a081eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a07fff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081ea3b0 con 0x7f7a0814c2e0 2023-11-27T20:44:12.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a07fff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0814ce90 con 0x7f7a08072310 2023-11-27T20:44:12.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a07fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081476e0 con 0x7f7a080c0440 2023-11-27T20:44:12.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a077fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 0x7f7a081eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a077fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 0x7f7a081eaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41848/0 (socket says 172.21.15.91:41848) 2023-11-27T20:44:12.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a077fe640 1 -- 172.21.15.91:0/663958819 learned_addr learned my addr 172.21.15.91:0/663958819 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a077fe640 1 -- 172.21.15.91:0/663958819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a080c0440 msgr2=0x7f7a080bee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a06ffd640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a08072310 0x7f7a081471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a077fe640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a080c0440 0x7f7a080bee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a077fe640 1 -- 172.21.15.91:0/663958819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a08072310 msgr2=0x7f7a081471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a077fe640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a08072310 0x7f7a081471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a077fe640 1 -- 172.21.15.91:0/663958819 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f8009400 con 0x7f7a0814c2e0 2023-11-27T20:44:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.241+0000 7f7a06ffd640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a08072310 0x7f7a081471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.242+0000 7f7a077fe640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 0x7f7a081eaf90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000c7e0 tx=0x7f7a0000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:12.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.242+0000 7f79effff640 1 -- 172.21.15.91:0/663958819 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000a640 con 0x7f7a0814c2e0 2023-11-27T20:44:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.242+0000 7f79effff640 1 -- 172.21.15.91:0/663958819 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0000a7c0 con 0x7f7a0814c2e0 2023-11-27T20:44:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.242+0000 7f79effff640 1 -- 172.21.15.91:0/663958819 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000ab70 con 0x7f7a0814c2e0 2023-11-27T20:44:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.242+0000 7f7a07fff640 1 -- 172.21.15.91:0/663958819 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a081e9aa0 con 0x7f7a0814c2e0 2023-11-27T20:44:12.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.242+0000 7f7a07fff640 1 -- 172.21.15.91:0/663958819 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a081e9d60 con 0x7f7a0814c2e0 2023-11-27T20:44:12.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.243+0000 7f7a07fff640 1 -- 172.21.15.91:0/663958819 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a081ea520 con 0x7f7a0814c2e0 2023-11-27T20:44:12.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.244+0000 7f79effff640 1 -- 172.21.15.91:0/663958819 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7a0000acd0 con 0x7f7a0814c2e0 2023-11-27T20:44:12.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.245+0000 7f79effff640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79f406b1c0 0x7f79f406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.245+0000 7f79effff640 1 -- 172.21.15.91:0/663958819 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7a000893b0 con 0x7f7a0814c2e0 2023-11-27T20:44:12.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.245+0000 7f7a06ffd640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79f406b1c0 0x7f79f406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.246+0000 7f7a06ffd640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79f406b1c0 0x7f79f406d680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f79f8035000 tx=0x7f79f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:12.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.249+0000 7f79effff640 1 -- 172.21.15.91:0/663958819 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7a00053d70 con 0x7f7a0814c2e0 2023-11-27T20:44:12.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.440+0000 7f7a07fff640 1 -- 172.21.15.91:0/663958819 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a0804e840 con 0x7f7a0814c2e0 2023-11-27T20:44:12.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.444+0000 7f79effff640 1 -- 172.21.15.91:0/663958819 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+20245 (secure 0 0 0) 0x7f7a00018090 con 0x7f7a0814c2e0 2023-11-27T20:44:12.446 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:12.446 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":59,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:09.523882+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:12.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 -- 172.21.15.91:0/663958819 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79f406b1c0 msgr2=0x7f79f406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79f406b1c0 0x7f79f406d680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f79f8035000 tx=0x7f79f8008030 comp rx=0 tx=0).stop 2023-11-27T20:44:12.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 -- 172.21.15.91:0/663958819 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 msgr2=0x7f7a081eaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 0x7f7a081eaf90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000c7e0 tx=0x7f7a0000cca0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 -- 172.21.15.91:0/663958819 shutdown_connections 2023-11-27T20:44:12.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a0814c2e0 0x7f7a081eaf90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a080c0440 0x7f7a080bee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f79f406b1c0 0x7f79f406d680 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 --2- 172.21.15.91:0/663958819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a08072310 0x7f7a081471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 -- 172.21.15.91:0/663958819 >> 172.21.15.91:0/663958819 conn(0x7f7a080a77f0 msgr2=0x7f7a080a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:12.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 -- 172.21.15.91:0/663958819 shutdown_connections 2023-11-27T20:44:12.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.447+0000 7f7a07fff640 1 -- 172.21.15.91:0/663958819 wait complete. 2023-11-27T20:44:12.468 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T20:44:12.468 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:44:12.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.674+0000 7f319f0b4640 1 Processor -- start 2023-11-27T20:44:12.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.674+0000 7f319f0b4640 1 -- start start 2023-11-27T20:44:12.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.676+0000 7f319f0b4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31980c6680 0x7f31980c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.676+0000 7f319f0b4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980a6bc0 0x7f31980c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.676+0000 7f319f0b4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31980c4220 con 0x7f31980c7950 2023-11-27T20:44:12.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.676+0000 7f319f0b4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31980c2e80 con 0x7f31980c6680 2023-11-27T20:44:12.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.676+0000 7f319f0b4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31980c2ba0 con 0x7f31980a6bc0 2023-11-27T20:44:12.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.676+0000 7f319ce50640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31980c6680 0x7f31980c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.676+0000 7f319ce50640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31980c6680 0x7f31980c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41852/0 (socket says 172.21.15.91:41852) 2023-11-27T20:44:12.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.676+0000 7f319ce50640 1 -- 172.21.15.91:0/993585587 learned_addr learned my addr 172.21.15.91:0/993585587 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:12.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.677+0000 7f3197fff640 1 --2- 172.21.15.91:0/993585587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980a6bc0 0x7f31980c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.677+0000 7f319ce50640 1 -- 172.21.15.91:0/993585587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980a6bc0 msgr2=0x7f31980c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:12.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.677+0000 7f319ce50640 1 --2- 172.21.15.91:0/993585587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980a6bc0 0x7f31980c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.677+0000 7f319ce50640 1 -- 172.21.15.91:0/993585587 >> v1:172.21.15.183:6789/0 conn(0x7f31980c7950 legacy=0x7f31980c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:12.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.677+0000 7f319ce50640 1 -- 172.21.15.91:0/993585587 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980c32e0 con 0x7f31980c6680 2023-11-27T20:44:12.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.678+0000 7f319ce50640 1 --2- 172.21.15.91:0/993585587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 0x7f31980c6a60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3188009870 tx=0x7f318802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa77c1a88eb9f041 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:12.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.678+0000 7f31977fe640 1 -- 172.21.15.91:0/993585587 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188031740 con 0x7f31980c6680 2023-11-27T20:44:12.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.679+0000 7f31977fe640 1 -- 172.21.15.91:0/993585587 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31880318a0 con 0x7f31980c6680 2023-11-27T20:44:12.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.679+0000 7f31977fe640 1 -- 172.21.15.91:0/993585587 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188031c30 con 0x7f31980c6680 2023-11-27T20:44:12.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.679+0000 7f319f0b4640 1 -- 172.21.15.91:0/993585587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 msgr2=0x7f31980c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.679+0000 7f319f0b4640 1 --2- 172.21.15.91:0/993585587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 0x7f31980c6a60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3188009870 tx=0x7f318802b7e0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.679+0000 7f319f0b4640 1 -- 172.21.15.91:0/993585587 shutdown_connections 2023-11-27T20:44:12.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.679+0000 7f319f0b4640 1 --2- 172.21.15.91:0/993585587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980a6bc0 0x7f31980c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.679+0000 7f319f0b4640 1 --2- 172.21.15.91:0/993585587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 0x7f31980c6a60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.679+0000 7f319f0b4640 1 -- 172.21.15.91:0/993585587 >> 172.21.15.91:0/993585587 conn(0x7f31980c7e30 msgr2=0x7f31980c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:12.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.679+0000 7f319f0b4640 1 -- 172.21.15.91:0/993585587 shutdown_connections 2023-11-27T20:44:12.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.679+0000 7f319f0b4640 1 -- 172.21.15.91:0/993585587 wait complete. 2023-11-27T20:44:12.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.681+0000 7f319f0b4640 1 Processor -- start 2023-11-27T20:44:12.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.681+0000 7f319f0b4640 1 -- start start 2023-11-27T20:44:12.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.682+0000 7f319f0b4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980a6bc0 0x7f3198152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.682+0000 7f319f0b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 0x7f31981470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.682+0000 7f319f0b4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31980c7950 0x7f3198147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.682+0000 7f319f0b4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31981edea0 con 0x7f31980c6680 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.682+0000 7f319f0b4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980a8ee0 con 0x7f31980c7950 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.682+0000 7f319f0b4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31981ee090 con 0x7f31980a6bc0 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.682+0000 7f3197fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 0x7f31981470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.682+0000 7f3197fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 0x7f31981470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41868/0 (socket says 172.21.15.91:41868) 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.682+0000 7f3197fff640 1 -- 172.21.15.91:0/2752682502 learned_addr learned my addr 172.21.15.91:0/2752682502 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f319ce50640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980a6bc0 0x7f3198152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f319d651640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31980c7950 0x7f3198147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f3197fff640 1 -- 172.21.15.91:0/2752682502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980a6bc0 msgr2=0x7f3198152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f3197fff640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980a6bc0 0x7f3198152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f3197fff640 1 -- 172.21.15.91:0/2752682502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31980c7950 msgr2=0x7f3198147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f3197fff640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31980c7950 0x7f3198147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f3197fff640 1 -- 172.21.15.91:0/2752682502 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880094d0 con 0x7f31980c6680 2023-11-27T20:44:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f319d651640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31980c7950 0x7f3198147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:12.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f3197fff640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 0x7f31981470d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f318000d5f0 tx=0x7f318000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:12.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f31957fa640 1 -- 172.21.15.91:0/2752682502 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800125f0 con 0x7f31980c6680 2023-11-27T20:44:12.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f31957fa640 1 -- 172.21.15.91:0/2752682502 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3180012750 con 0x7f31980c6680 2023-11-27T20:44:12.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f319f0b4640 1 -- 172.21.15.91:0/2752682502 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31980a9180 con 0x7f31980c6680 2023-11-27T20:44:12.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.683+0000 7f31957fa640 1 -- 172.21.15.91:0/2752682502 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180012b00 con 0x7f31980c6680 2023-11-27T20:44:12.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.684+0000 7f319f0b4640 1 -- 172.21.15.91:0/2752682502 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31981ee370 con 0x7f31980c6680 2023-11-27T20:44:12.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.685+0000 7f319f0b4640 1 -- 172.21.15.91:0/2752682502 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3198068350 con 0x7f31980c6680 2023-11-27T20:44:12.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.686+0000 7f31957fa640 1 -- 172.21.15.91:0/2752682502 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3180012c60 con 0x7f31980c6680 2023-11-27T20:44:12.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.687+0000 7f31957fa640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f317806b1c0 0x7f317806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:12.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.687+0000 7f31957fa640 1 -- 172.21.15.91:0/2752682502 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f318008a270 con 0x7f31980c6680 2023-11-27T20:44:12.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.687+0000 7f319ce50640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f317806b1c0 0x7f317806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:12.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.688+0000 7f319ce50640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f317806b1c0 0x7f317806d680 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3188035000 tx=0x7f3188008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:12.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.691+0000 7f31957fa640 1 -- 172.21.15.91:0/2752682502 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3180054c40 con 0x7f31980c6680 2023-11-27T20:44:12.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.875+0000 7f319f0b4640 1 -- 172.21.15.91:0/2752682502 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31981ee200 con 0x7f317806b1c0 2023-11-27T20:44:12.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.888+0000 7f31957fa640 1 -- 172.21.15.91:0/2752682502 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+519894 (secure 0 0 0) 0x7f31981ee200 con 0x7f317806b1c0 2023-11-27T20:44:12.897 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:12.901 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:44:12.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.898+0000 7f319f0b4640 1 -- 172.21.15.91:0/2752682502 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f317806b1c0 msgr2=0x7f317806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.898+0000 7f319f0b4640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f317806b1c0 0x7f317806d680 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3188035000 tx=0x7f3188008030 comp rx=0 tx=0).stop 2023-11-27T20:44:12.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.898+0000 7f319f0b4640 1 -- 172.21.15.91:0/2752682502 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 msgr2=0x7f31981470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:12.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.898+0000 7f319f0b4640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 0x7f31981470d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f318000d5f0 tx=0x7f318000dab0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.898+0000 7f319f0b4640 1 -- 172.21.15.91:0/2752682502 shutdown_connections 2023-11-27T20:44:12.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.898+0000 7f319f0b4640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f317806b1c0 0x7f317806d680 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.898+0000 7f319f0b4640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31980c7950 0x7f3198147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.898+0000 7f319f0b4640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31980c6680 0x7f31981470d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.898+0000 7f319f0b4640 1 --2- 172.21.15.91:0/2752682502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980a6bc0 0x7f3198152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:12.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.898+0000 7f319f0b4640 1 -- 172.21.15.91:0/2752682502 >> 172.21.15.91:0/2752682502 conn(0x7f31980c7e30 msgr2=0x7f319806c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:12.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.899+0000 7f319f0b4640 1 -- 172.21.15.91:0/2752682502 shutdown_connections 2023-11-27T20:44:12.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:12.899+0000 7f319f0b4640 1 -- 172.21.15.91:0/2752682502 wait complete. 2023-11-27T20:44:12.917 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-11-27T20:44:11.423710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235224,"kb_used_data":6556,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739496,"statfs":{"total":773094113280,"available":772853243904,"internally_reserved":0,"allocated":6713344,"data_stored":3563600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.927206"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528239+0000","last_change":"2023-11-27T20:44:07.528239+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528239+0000","last_undegraded":"2023-11-27T20:44:07.528239+0000","last_fullsized":"2023-11-27T20:44:07.528239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507747+0000","last_change":"2023-11-27T20:43:52.742706+0000","last_active":"2023-11-27T20:44:06.507747+0000","last_peered":"2023-11-27T20:44:06.507747+0000","last_clean":"2023-11-27T20:44:06.507747+0000","last_became_active":"2023-11-27T20:43:52.742447+0000","last_became_peered":"2023-11-27T20:43:52.742447+0000","last_unstale":"2023-11-27T20:44:06.507747+0000","last_undegraded":"2023-11-27T20:44:06.507747+0000","last_fullsized":"2023-11-27T20:44:06.507747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:10.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531466+0000","last_change":"2023-11-27T20:44:07.531466+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531466+0000","last_undegraded":"2023-11-27T20:44:07.531466+0000","last_fullsized":"2023-11-27T20:44:07.531466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514019+0000","last_change":"2023-11-27T20:43:52.741446+0000","last_active":"2023-11-27T20:44:06.514019+0000","last_peered":"2023-11-27T20:44:06.514019+0000","last_clean":"2023-11-27T20:44:06.514019+0000","last_became_active":"2023-11-27T20:43:52.741105+0000","last_became_peered":"2023-11-27T20:43:52.741105+0000","last_unstale":"2023-11-27T20:44:06.514019+0000","last_undegraded":"2023-11-27T20:44:06.514019+0000","last_fullsized":"2023-11-27T20:44:06.514019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:03.285901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.541507+0000","last_change":"2023-11-27T20:44:07.541507+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.541507+0000","last_undegraded":"2023-11-27T20:44:07.541507+0000","last_fullsized":"2023-11-27T20:44:07.541507+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513834+0000","last_change":"2023-11-27T20:43:52.737240+0000","last_active":"2023-11-27T20:44:06.513834+0000","last_peered":"2023-11-27T20:44:06.513834+0000","last_clean":"2023-11-27T20:44:06.513834+0000","last_became_active":"2023-11-27T20:43:52.736781+0000","last_became_peered":"2023-11-27T20:43:52.736781+0000","last_unstale":"2023-11-27T20:44:06.513834+0000","last_undegraded":"2023-11-27T20:44:06.513834+0000","last_fullsized":"2023-11-27T20:44:06.513834+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527473+0000","last_change":"2023-11-27T20:44:07.527473+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527473+0000","last_undegraded":"2023-11-27T20:44:07.527473+0000","last_fullsized":"2023-11-27T20:44:07.527473+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521084+0000","last_change":"2023-11-27T20:43:52.738199+0000","last_active":"2023-11-27T20:44:06.521084+0000","last_peered":"2023-11-27T20:44:06.521084+0000","last_clean":"2023-11-27T20:44:06.521084+0000","last_became_active":"2023-11-27T20:43:52.737298+0000","last_became_peered":"2023-11-27T20:43:52.737298+0000","last_unstale":"2023-11-27T20:44:06.521084+0000","last_undegraded":"2023-11-27T20:44:06.521084+0000","last_fullsized":"2023-11-27T20:44:06.521084+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:54.739325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531917+0000","last_change":"2023-11-27T20:44:07.531917+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531917+0000","last_undegraded":"2023-11-27T20:44:07.531917+0000","last_fullsized":"2023-11-27T20:44:07.531917+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506135+0000","last_change":"2023-11-27T20:43:52.745287+0000","last_active":"2023-11-27T20:44:06.506135+0000","last_peered":"2023-11-27T20:44:06.506135+0000","last_clean":"2023-11-27T20:44:06.506135+0000","last_became_active":"2023-11-27T20:43:52.744817+0000","last_became_peered":"2023-11-27T20:43:52.744817+0000","last_unstale":"2023-11-27T20:44:06.506135+0000","last_undegraded":"2023-11-27T20:44:06.506135+0000","last_fullsized":"2023-11-27T20:44:06.506135+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:59.992569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525264+0000","last_change":"2023-11-27T20:44:07.525264+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525264+0000","last_undegraded":"2023-11-27T20:44:07.525264+0000","last_fullsized":"2023-11-27T20:44:07.525264+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511440+0000","last_change":"2023-11-27T20:43:52.737877+0000","last_active":"2023-11-27T20:44:06.511440+0000","last_peered":"2023-11-27T20:44:06.511440+0000","last_clean":"2023-11-27T20:44:06.511440+0000","last_became_active":"2023-11-27T20:43:52.737566+0000","last_became_peered":"2023-11-27T20:43:52.737566+0000","last_unstale":"2023-11-27T20:44:06.511440+0000","last_undegraded":"2023-11-27T20:44:06.511440+0000","last_fullsized":"2023-11-27T20:44:06.511440+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526887+0000","last_change":"2023-11-27T20:44:07.526887+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526887+0000","last_undegraded":"2023-11-27T20:44:07.526887+0000","last_fullsized":"2023-11-27T20:44:07.526887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505272+0000","last_change":"2023-11-27T20:43:52.738797+0000","last_active":"2023-11-27T20:44:06.505272+0000","last_peered":"2023-11-27T20:44:06.505272+0000","last_clean":"2023-11-27T20:44:06.505272+0000","last_became_active":"2023-11-27T20:43:52.738444+0000","last_became_peered":"2023-11-27T20:43:52.738444+0000","last_unstale":"2023-11-27T20:44:06.505272+0000","last_undegraded":"2023-11-27T20:44:06.505272+0000","last_fullsized":"2023-11-27T20:44:06.505272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:23.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526581+0000","last_change":"2023-11-27T20:44:07.526581+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526581+0000","last_undegraded":"2023-11-27T20:44:07.526581+0000","last_fullsized":"2023-11-27T20:44:07.526581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511067+0000","last_change":"2023-11-27T20:43:52.742425+0000","last_active":"2023-11-27T20:44:06.511067+0000","last_peered":"2023-11-27T20:44:06.511067+0000","last_clean":"2023-11-27T20:44:06.511067+0000","last_became_active":"2023-11-27T20:43:52.741079+0000","last_became_peered":"2023-11-27T20:43:52.741079+0000","last_unstale":"2023-11-27T20:44:06.511067+0000","last_undegraded":"2023-11-27T20:44:06.511067+0000","last_fullsized":"2023-11-27T20:44:06.511067+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:21.581873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.540259+0000","last_change":"2023-11-27T20:44:07.540259+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.540259+0000","last_undegraded":"2023-11-27T20:44:07.540259+0000","last_fullsized":"2023-11-27T20:44:07.540259+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.509318+0000","last_change":"2023-11-27T20:43:52.749527+0000","last_active":"2023-11-27T20:44:06.509318+0000","last_peered":"2023-11-27T20:44:06.509318+0000","last_clean":"2023-11-27T20:44:06.509318+0000","last_became_active":"2023-11-27T20:43:52.749261+0000","last_became_peered":"2023-11-27T20:43:52.749261+0000","last_unstale":"2023-11-27T20:44:06.509318+0000","last_undegraded":"2023-11-27T20:44:06.509318+0000","last_fullsized":"2023-11-27T20:44:06.509318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:22.440110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531049+0000","last_change":"2023-11-27T20:44:07.531049+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531049+0000","last_undegraded":"2023-11-27T20:44:07.531049+0000","last_fullsized":"2023-11-27T20:44:07.531049+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500881+0000","last_change":"2023-11-27T20:43:52.724633+0000","last_active":"2023-11-27T20:44:06.500881+0000","last_peered":"2023-11-27T20:44:06.500881+0000","last_clean":"2023-11-27T20:44:06.500881+0000","last_became_active":"2023-11-27T20:43:52.724319+0000","last_became_peered":"2023-11-27T20:43:52.724319+0000","last_unstale":"2023-11-27T20:44:06.500881+0000","last_undegraded":"2023-11-27T20:44:06.500881+0000","last_fullsized":"2023-11-27T20:44:06.500881+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:56.115106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.535763+0000","last_change":"2023-11-27T20:44:07.535763+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.535763+0000","last_undegraded":"2023-11-27T20:44:07.535763+0000","last_fullsized":"2023-11-27T20:44:07.535763+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500638+0000","last_change":"2023-11-27T20:43:52.740239+0000","last_active":"2023-11-27T20:44:06.500638+0000","last_peered":"2023-11-27T20:44:06.500638+0000","last_clean":"2023-11-27T20:44:06.500638+0000","last_became_active":"2023-11-27T20:43:52.739953+0000","last_became_peered":"2023-11-27T20:43:52.739953+0000","last_unstale":"2023-11-27T20:44:06.500638+0000","last_undegraded":"2023-11-27T20:44:06.500638+0000","last_fullsized":"2023-11-27T20:44:06.500638+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:21.512849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530979+0000","last_change":"2023-11-27T20:44:07.530979+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530979+0000","last_undegraded":"2023-11-27T20:44:07.530979+0000","last_fullsized":"2023-11-27T20:44:07.530979+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521359+0000","last_change":"2023-11-27T20:43:52.736636+0000","last_active":"2023-11-27T20:44:06.521359+0000","last_peered":"2023-11-27T20:44:06.521359+0000","last_clean":"2023-11-27T20:44:06.521359+0000","last_became_active":"2023-11-27T20:43:52.730532+0000","last_became_peered":"2023-11-27T20:43:52.730532+0000","last_unstale":"2023-11-27T20:44:06.521359+0000","last_undegraded":"2023-11-27T20:44:06.521359+0000","last_fullsized":"2023-11-27T20:44:06.521359+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537228+0000","last_change":"2023-11-27T20:44:07.537228+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537228+0000","last_undegraded":"2023-11-27T20:44:07.537228+0000","last_fullsized":"2023-11-27T20:44:07.537228+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.520579+0000","last_change":"2023-11-27T20:43:52.734813+0000","last_active":"2023-11-27T20:44:06.520579+0000","last_peered":"2023-11-27T20:44:06.520579+0000","last_clean":"2023-11-27T20:44:06.520579+0000","last_became_active":"2023-11-27T20:43:52.734472+0000","last_became_peered":"2023-11-27T20:43:52.734472+0000","last_unstale":"2023-11-27T20:44:06.520579+0000","last_undegraded":"2023-11-27T20:44:06.520579+0000","last_fullsized":"2023-11-27T20:44:06.520579+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:00.871014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521140+0000","last_change":"2023-11-27T20:44:07.521140+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521140+0000","last_undegraded":"2023-11-27T20:44:07.521140+0000","last_fullsized":"2023-11-27T20:44:07.521140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.503259+0000","last_change":"2023-11-27T20:43:52.737259+0000","last_active":"2023-11-27T20:44:06.503259+0000","last_peered":"2023-11-27T20:44:06.503259+0000","last_clean":"2023-11-27T20:44:06.503259+0000","last_became_active":"2023-11-27T20:43:52.735819+0000","last_became_peered":"2023-11-27T20:43:52.735819+0000","last_unstale":"2023-11-27T20:44:06.503259+0000","last_undegraded":"2023-11-27T20:44:06.503259+0000","last_fullsized":"2023-11-27T20:44:06.503259+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:42.590467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530684+0000","last_change":"2023-11-27T20:44:07.530684+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530684+0000","last_undegraded":"2023-11-27T20:44:07.530684+0000","last_fullsized":"2023-11-27T20:44:07.530684+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505502+0000","last_change":"2023-11-27T20:43:52.743966+0000","last_active":"2023-11-27T20:44:06.505502+0000","last_peered":"2023-11-27T20:44:06.505502+0000","last_clean":"2023-11-27T20:44:06.505502+0000","last_became_active":"2023-11-27T20:43:52.743629+0000","last_became_peered":"2023-11-27T20:43:52.743629+0000","last_unstale":"2023-11-27T20:44:06.505502+0000","last_undegraded":"2023-11-27T20:44:06.505502+0000","last_fullsized":"2023-11-27T20:44:06.505502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:06.257254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527533+0000","last_change":"2023-11-27T20:44:07.527533+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527533+0000","last_undegraded":"2023-11-27T20:44:07.527533+0000","last_fullsized":"2023-11-27T20:44:07.527533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511481+0000","last_change":"2023-11-27T20:43:52.745826+0000","last_active":"2023-11-27T20:44:06.511481+0000","last_peered":"2023-11-27T20:44:06.511481+0000","last_clean":"2023-11-27T20:44:06.511481+0000","last_became_active":"2023-11-27T20:43:52.745542+0000","last_became_peered":"2023-11-27T20:43:52.745542+0000","last_unstale":"2023-11-27T20:44:06.511481+0000","last_undegraded":"2023-11-27T20:44:06.511481+0000","last_fullsized":"2023-11-27T20:44:06.511481+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:30.595824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525282+0000","last_change":"2023-11-27T20:44:07.525282+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525282+0000","last_undegraded":"2023-11-27T20:44:07.525282+0000","last_fullsized":"2023-11-27T20:44:07.525282+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514319+0000","last_change":"2023-11-27T20:43:52.722794+0000","last_active":"2023-11-27T20:44:06.514319+0000","last_peered":"2023-11-27T20:44:06.514319+0000","last_clean":"2023-11-27T20:44:06.514319+0000","last_became_active":"2023-11-27T20:43:52.722489+0000","last_became_peered":"2023-11-27T20:43:52.722489+0000","last_unstale":"2023-11-27T20:44:06.514319+0000","last_undegraded":"2023-11-27T20:44:06.514319+0000","last_fullsized":"2023-11-27T20:44:06.514319+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:33:24.275033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530733+0000","last_change":"2023-11-27T20:44:07.530733+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530733+0000","last_undegraded":"2023-11-27T20:44:07.530733+0000","last_fullsized":"2023-11-27T20:44:07.530733+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519150+0000","last_change":"2023-11-27T20:43:52.755856+0000","last_active":"2023-11-27T20:44:06.519150+0000","last_peered":"2023-11-27T20:44:06.519150+0000","last_clean":"2023-11-27T20:44:06.519150+0000","last_became_active":"2023-11-27T20:43:52.755447+0000","last_became_peered":"2023-11-27T20:43:52.755447+0000","last_unstale":"2023-11-27T20:44:06.519150+0000","last_undegraded":"2023-11-27T20:44:06.519150+0000","last_fullsized":"2023-11-27T20:44:06.519150+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528962+0000","last_change":"2023-11-27T20:44:07.528962+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528962+0000","last_undegraded":"2023-11-27T20:44:07.528962+0000","last_fullsized":"2023-11-27T20:44:07.528962+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507626+0000","last_change":"2023-11-27T20:43:52.743704+0000","last_active":"2023-11-27T20:44:06.507626+0000","last_peered":"2023-11-27T20:44:06.507626+0000","last_clean":"2023-11-27T20:44:06.507626+0000","last_became_active":"2023-11-27T20:43:52.743440+0000","last_became_peered":"2023-11-27T20:43:52.743440+0000","last_unstale":"2023-11-27T20:44:06.507626+0000","last_undegraded":"2023-11-27T20:44:06.507626+0000","last_fullsized":"2023-11-27T20:44:06.507626+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:40.038308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529520+0000","last_change":"2023-11-27T20:44:07.529520+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529520+0000","last_undegraded":"2023-11-27T20:44:07.529520+0000","last_fullsized":"2023-11-27T20:44:07.529520+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513801+0000","last_change":"2023-11-27T20:43:52.753806+0000","last_active":"2023-11-27T20:44:06.513801+0000","last_peered":"2023-11-27T20:44:06.513801+0000","last_clean":"2023-11-27T20:44:06.513801+0000","last_became_active":"2023-11-27T20:43:52.753119+0000","last_became_peered":"2023-11-27T20:43:52.753119+0000","last_unstale":"2023-11-27T20:44:06.513801+0000","last_undegraded":"2023-11-27T20:44:06.513801+0000","last_fullsized":"2023-11-27T20:44:06.513801+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:44.226522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537041+0000","last_change":"2023-11-27T20:44:07.537041+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537041+0000","last_undegraded":"2023-11-27T20:44:07.537041+0000","last_fullsized":"2023-11-27T20:44:07.537041+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516707+0000","last_change":"2023-11-27T20:43:52.738852+0000","last_active":"2023-11-27T20:44:06.516707+0000","last_peered":"2023-11-27T20:44:06.516707+0000","last_clean":"2023-11-27T20:44:06.516707+0000","last_became_active":"2023-11-27T20:43:52.738571+0000","last_became_peered":"2023-11-27T20:43:52.738571+0000","last_unstale":"2023-11-27T20:44:06.516707+0000","last_undegraded":"2023-11-27T20:44:06.516707+0000","last_fullsized":"2023-11-27T20:44:06.516707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539485+0000","last_change":"2023-11-27T20:44:07.539485+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539485+0000","last_undegraded":"2023-11-27T20:44:07.539485+0000","last_fullsized":"2023-11-27T20:44:07.539485+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511365+0000","last_change":"2023-11-27T20:43:52.734845+0000","last_active":"2023-11-27T20:44:06.511365+0000","last_peered":"2023-11-27T20:44:06.511365+0000","last_clean":"2023-11-27T20:44:06.511365+0000","last_became_active":"2023-11-27T20:43:52.734288+0000","last_became_peered":"2023-11-27T20:43:52.734288+0000","last_unstale":"2023-11-27T20:44:06.511365+0000","last_undegraded":"2023-11-27T20:44:06.511365+0000","last_fullsized":"2023-11-27T20:44:06.511365+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:08:45.447871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521111+0000","last_change":"2023-11-27T20:44:07.521111+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521111+0000","last_undegraded":"2023-11-27T20:44:07.521111+0000","last_fullsized":"2023-11-27T20:44:07.521111+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518661+0000","last_change":"2023-11-27T20:43:52.741528+0000","last_active":"2023-11-27T20:44:06.518661+0000","last_peered":"2023-11-27T20:44:06.518661+0000","last_clean":"2023-11-27T20:44:06.518661+0000","last_became_active":"2023-11-27T20:43:52.741247+0000","last_became_peered":"2023-11-27T20:43:52.741247+0000","last_unstale":"2023-11-27T20:44:06.518661+0000","last_undegraded":"2023-11-27T20:44:06.518661+0000","last_fullsized":"2023-11-27T20:44:06.518661+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521167+0000","last_change":"2023-11-27T20:44:07.521167+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521167+0000","last_undegraded":"2023-11-27T20:44:07.521167+0000","last_fullsized":"2023-11-27T20:44:07.521167+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517222+0000","last_change":"2023-11-27T20:43:52.749184+0000","last_active":"2023-11-27T20:44:06.517222+0000","last_peered":"2023-11-27T20:44:06.517222+0000","last_clean":"2023-11-27T20:44:06.517222+0000","last_became_active":"2023-11-27T20:43:52.747304+0000","last_became_peered":"2023-11-27T20:43:52.747304+0000","last_unstale":"2023-11-27T20:44:06.517222+0000","last_undegraded":"2023-11-27T20:44:06.517222+0000","last_fullsized":"2023-11-27T20:44:06.517222+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:21.580869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527612+0000","last_change":"2023-11-27T20:44:07.527612+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527612+0000","last_undegraded":"2023-11-27T20:44:07.527612+0000","last_fullsized":"2023-11-27T20:44:07.527612+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507945+0000","last_change":"2023-11-27T20:43:52.746466+0000","last_active":"2023-11-27T20:44:06.507945+0000","last_peered":"2023-11-27T20:44:06.507945+0000","last_clean":"2023-11-27T20:44:06.507945+0000","last_became_active":"2023-11-27T20:43:52.746197+0000","last_became_peered":"2023-11-27T20:43:52.746197+0000","last_unstale":"2023-11-27T20:44:06.507945+0000","last_undegraded":"2023-11-27T20:44:06.507945+0000","last_fullsized":"2023-11-27T20:44:06.507945+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:53.742011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.522993+0000","last_change":"2023-11-27T20:44:07.522993+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.522993+0000","last_undegraded":"2023-11-27T20:44:07.522993+0000","last_fullsized":"2023-11-27T20:44:07.522993+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521583+0000","last_change":"2023-11-27T20:43:52.739506+0000","last_active":"2023-11-27T20:44:06.521583+0000","last_peered":"2023-11-27T20:44:06.521583+0000","last_clean":"2023-11-27T20:44:06.521583+0000","last_became_active":"2023-11-27T20:43:52.739234+0000","last_became_peered":"2023-11-27T20:43:52.739234+0000","last_unstale":"2023-11-27T20:44:06.521583+0000","last_undegraded":"2023-11-27T20:44:06.521583+0000","last_fullsized":"2023-11-27T20:44:06.521583+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:32.431178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524843+0000","last_change":"2023-11-27T20:44:07.524843+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524843+0000","last_undegraded":"2023-11-27T20:44:07.524843+0000","last_fullsized":"2023-11-27T20:44:07.524843+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513010+0000","last_change":"2023-11-27T20:43:52.758309+0000","last_active":"2023-11-27T20:44:06.513010+0000","last_peered":"2023-11-27T20:44:06.513010+0000","last_clean":"2023-11-27T20:44:06.513010+0000","last_became_active":"2023-11-27T20:43:52.755787+0000","last_became_peered":"2023-11-27T20:43:52.755787+0000","last_unstale":"2023-11-27T20:44:06.513010+0000","last_undegraded":"2023-11-27T20:44:06.513010+0000","last_fullsized":"2023-11-27T20:44:06.513010+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.536848+0000","last_change":"2023-11-27T20:44:07.536848+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.536848+0000","last_undegraded":"2023-11-27T20:44:07.536848+0000","last_fullsized":"2023-11-27T20:44:07.536848+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506125+0000","last_change":"2023-11-27T20:43:52.743954+0000","last_active":"2023-11-27T20:44:06.506125+0000","last_peered":"2023-11-27T20:44:06.506125+0000","last_clean":"2023-11-27T20:44:06.506125+0000","last_became_active":"2023-11-27T20:43:52.743696+0000","last_became_peered":"2023-11-27T20:43:52.743696+0000","last_unstale":"2023-11-27T20:44:06.506125+0000","last_undegraded":"2023-11-27T20:44:06.506125+0000","last_fullsized":"2023-11-27T20:44:06.506125+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:35.875636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530894+0000","last_change":"2023-11-27T20:44:07.530894+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530894+0000","last_undegraded":"2023-11-27T20:44:07.530894+0000","last_fullsized":"2023-11-27T20:44:07.530894+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513909+0000","last_change":"2023-11-27T20:43:52.740150+0000","last_active":"2023-11-27T20:44:06.513909+0000","last_peered":"2023-11-27T20:44:06.513909+0000","last_clean":"2023-11-27T20:44:06.513909+0000","last_became_active":"2023-11-27T20:43:52.735557+0000","last_became_peered":"2023-11-27T20:43:52.735557+0000","last_unstale":"2023-11-27T20:44:06.513909+0000","last_undegraded":"2023-11-27T20:44:06.513909+0000","last_fullsized":"2023-11-27T20:44:06.513909+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:26:49.710558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.522867+0000","last_change":"2023-11-27T20:44:07.522867+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.522867+0000","last_undegraded":"2023-11-27T20:44:07.522867+0000","last_fullsized":"2023-11-27T20:44:07.522867+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513742+0000","last_change":"2023-11-27T20:43:52.743341+0000","last_active":"2023-11-27T20:44:06.513742+0000","last_peered":"2023-11-27T20:44:06.513742+0000","last_clean":"2023-11-27T20:44:06.513742+0000","last_became_active":"2023-11-27T20:43:52.742947+0000","last_became_peered":"2023-11-27T20:43:52.742947+0000","last_unstale":"2023-11-27T20:44:06.513742+0000","last_undegraded":"2023-11-27T20:44:06.513742+0000","last_fullsized":"2023-11-27T20:44:06.513742+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:30.595824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525868+0000","last_change":"2023-11-27T20:44:07.525868+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525868+0000","last_undegraded":"2023-11-27T20:44:07.525868+0000","last_fullsized":"2023-11-27T20:44:07.525868+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505911+0000","last_change":"2023-11-27T20:43:52.746463+0000","last_active":"2023-11-27T20:44:06.505911+0000","last_peered":"2023-11-27T20:44:06.505911+0000","last_clean":"2023-11-27T20:44:06.505911+0000","last_became_active":"2023-11-27T20:43:52.746028+0000","last_became_peered":"2023-11-27T20:43:52.746028+0000","last_unstale":"2023-11-27T20:44:06.505911+0000","last_undegraded":"2023-11-27T20:44:06.505911+0000","last_fullsized":"2023-11-27T20:44:06.505911+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:00.873986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.532834+0000","last_change":"2023-11-27T20:44:07.532834+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.532834+0000","last_undegraded":"2023-11-27T20:44:07.532834+0000","last_fullsized":"2023-11-27T20:44:07.532834+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511596+0000","last_change":"2023-11-27T20:43:52.757800+0000","last_active":"2023-11-27T20:44:06.511596+0000","last_peered":"2023-11-27T20:44:06.511596+0000","last_clean":"2023-11-27T20:44:06.511596+0000","last_became_active":"2023-11-27T20:43:52.755994+0000","last_became_peered":"2023-11-27T20:43:52.755994+0000","last_unstale":"2023-11-27T20:44:06.511596+0000","last_undegraded":"2023-11-27T20:44:06.511596+0000","last_fullsized":"2023-11-27T20:44:06.511596+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528764+0000","last_change":"2023-11-27T20:44:07.528764+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528764+0000","last_undegraded":"2023-11-27T20:44:07.528764+0000","last_fullsized":"2023-11-27T20:44:07.528764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.545677+0000","last_change":"2023-11-27T20:44:07.540451+0000","last_active":"2023-11-27T20:44:07.545677+0000","last_peered":"2023-11-27T20:44:07.545677+0000","last_clean":"2023-11-27T20:44:07.545677+0000","last_became_active":"2023-11-27T20:44:07.540140+0000","last_became_peered":"2023-11-27T20:44:07.540140+0000","last_unstale":"2023-11-27T20:44:07.545677+0000","last_undegraded":"2023-11-27T20:44:07.545677+0000","last_fullsized":"2023-11-27T20:44:07.545677+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:34.727698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513103+0000","last_change":"2023-11-27T20:43:52.755932+0000","last_active":"2023-11-27T20:44:06.513103+0000","last_peered":"2023-11-27T20:44:06.513103+0000","last_clean":"2023-11-27T20:44:06.513103+0000","last_became_active":"2023-11-27T20:43:52.751888+0000","last_became_peered":"2023-11-27T20:43:52.751888+0000","last_unstale":"2023-11-27T20:44:06.513103+0000","last_undegraded":"2023-11-27T20:44:06.513103+0000","last_fullsized":"2023-11-27T20:44:06.513103+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:19.340689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513396+0000","last_change":"2023-11-27T20:43:51.704982+0000","last_active":"2023-11-27T20:44:06.513396+0000","last_peered":"2023-11-27T20:44:06.513396+0000","last_clean":"2023-11-27T20:44:06.513396+0000","last_became_active":"2023-11-27T20:43:51.703346+0000","last_became_peered":"2023-11-27T20:43:51.703346+0000","last_unstale":"2023-11-27T20:44:06.513396+0000","last_undegraded":"2023-11-27T20:44:06.513396+0000","last_fullsized":"2023-11-27T20:44:06.513396+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:53.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539753+0000","last_change":"2023-11-27T20:44:07.539753+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539753+0000","last_undegraded":"2023-11-27T20:44:07.539753+0000","last_fullsized":"2023-11-27T20:44:07.539753+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.551999+0000","last_change":"2023-11-27T20:44:07.548707+0000","last_active":"2023-11-27T20:44:07.551999+0000","last_peered":"2023-11-27T20:44:07.551999+0000","last_clean":"2023-11-27T20:44:07.551999+0000","last_became_active":"2023-11-27T20:44:07.544542+0000","last_became_peered":"2023-11-27T20:44:07.544542+0000","last_unstale":"2023-11-27T20:44:07.551999+0000","last_undegraded":"2023-11-27T20:44:07.551999+0000","last_fullsized":"2023-11-27T20:44:07.551999+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:08.453722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500681+0000","last_change":"2023-11-27T20:43:52.736197+0000","last_active":"2023-11-27T20:44:06.500681+0000","last_peered":"2023-11-27T20:44:06.500681+0000","last_clean":"2023-11-27T20:44:06.500681+0000","last_became_active":"2023-11-27T20:43:52.735889+0000","last_became_peered":"2023-11-27T20:43:52.735889+0000","last_unstale":"2023-11-27T20:44:06.500681+0000","last_undegraded":"2023-11-27T20:44:06.500681+0000","last_fullsized":"2023-11-27T20:44:06.500681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:46.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514100+0000","last_change":"2023-11-27T20:43:51.711368+0000","last_active":"2023-11-27T20:44:06.514100+0000","last_peered":"2023-11-27T20:44:06.514100+0000","last_clean":"2023-11-27T20:44:06.514100+0000","last_became_active":"2023-11-27T20:43:51.711087+0000","last_became_peered":"2023-11-27T20:43:51.711087+0000","last_unstale":"2023-11-27T20:44:06.514100+0000","last_undegraded":"2023-11-27T20:44:06.514100+0000","last_fullsized":"2023-11-27T20:44:06.514100+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:54.352803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.536855+0000","last_change":"2023-11-27T20:44:07.536855+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.536855+0000","last_undegraded":"2023-11-27T20:44:07.536855+0000","last_fullsized":"2023-11-27T20:44:07.536855+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.556568+0000","last_change":"2023-11-27T20:44:07.554191+0000","last_active":"2023-11-27T20:44:07.556568+0000","last_peered":"2023-11-27T20:44:07.556568+0000","last_clean":"2023-11-27T20:44:07.556568+0000","last_became_active":"2023-11-27T20:44:07.553915+0000","last_became_peered":"2023-11-27T20:44:07.553915+0000","last_unstale":"2023-11-27T20:44:07.556568+0000","last_undegraded":"2023-11-27T20:44:07.556568+0000","last_fullsized":"2023-11-27T20:44:07.556568+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:50.983600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512394+0000","last_change":"2023-11-27T20:43:52.759667+0000","last_active":"2023-11-27T20:44:06.512394+0000","last_peered":"2023-11-27T20:44:06.512394+0000","last_clean":"2023-11-27T20:44:06.512394+0000","last_became_active":"2023-11-27T20:43:52.759386+0000","last_became_peered":"2023-11-27T20:43:52.759386+0000","last_unstale":"2023-11-27T20:44:06.512394+0000","last_undegraded":"2023-11-27T20:44:06.512394+0000","last_fullsized":"2023-11-27T20:44:06.512394+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513309+0000","last_change":"2023-11-27T20:43:51.699372+0000","last_active":"2023-11-27T20:44:06.513309+0000","last_peered":"2023-11-27T20:44:06.513309+0000","last_clean":"2023-11-27T20:44:06.513309+0000","last_became_active":"2023-11-27T20:43:51.698989+0000","last_became_peered":"2023-11-27T20:43:51.698989+0000","last_unstale":"2023-11-27T20:44:06.513309+0000","last_undegraded":"2023-11-27T20:44:06.513309+0000","last_fullsized":"2023-11-27T20:44:06.513309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:29.612413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527825+0000","last_change":"2023-11-27T20:44:07.527825+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527825+0000","last_undegraded":"2023-11-27T20:44:07.527825+0000","last_fullsized":"2023-11-27T20:44:07.527825+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.544789+0000","last_change":"2023-11-27T20:44:07.543034+0000","last_active":"2023-11-27T20:44:07.544789+0000","last_peered":"2023-11-27T20:44:07.544789+0000","last_clean":"2023-11-27T20:44:07.544789+0000","last_became_active":"2023-11-27T20:44:07.542752+0000","last_became_peered":"2023-11-27T20:44:07.542752+0000","last_unstale":"2023-11-27T20:44:07.544789+0000","last_undegraded":"2023-11-27T20:44:07.544789+0000","last_fullsized":"2023-11-27T20:44:07.544789+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:10.575183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513504+0000","last_change":"2023-11-27T20:43:52.746554+0000","last_active":"2023-11-27T20:44:06.513504+0000","last_peered":"2023-11-27T20:44:06.513504+0000","last_clean":"2023-11-27T20:44:06.513504+0000","last_became_active":"2023-11-27T20:43:52.746133+0000","last_became_peered":"2023-11-27T20:43:52.746133+0000","last_unstale":"2023-11-27T20:44:06.513504+0000","last_undegraded":"2023-11-27T20:44:06.513504+0000","last_fullsized":"2023-11-27T20:44:06.513504+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:55.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521352+0000","last_change":"2023-11-27T20:43:51.707254+0000","last_active":"2023-11-27T20:44:06.521352+0000","last_peered":"2023-11-27T20:44:06.521352+0000","last_clean":"2023-11-27T20:44:06.521352+0000","last_became_active":"2023-11-27T20:43:51.706908+0000","last_became_peered":"2023-11-27T20:43:51.706908+0000","last_unstale":"2023-11-27T20:44:06.521352+0000","last_undegraded":"2023-11-27T20:44:06.521352+0000","last_fullsized":"2023-11-27T20:44:06.521352+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:04.233780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526427+0000","last_change":"2023-11-27T20:44:07.526427+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526427+0000","last_undegraded":"2023-11-27T20:44:07.526427+0000","last_fullsized":"2023-11-27T20:44:07.526427+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.539459+0000","last_change":"2023-11-27T20:44:07.535849+0000","last_active":"2023-11-27T20:44:07.539459+0000","last_peered":"2023-11-27T20:44:07.539459+0000","last_clean":"2023-11-27T20:44:07.539459+0000","last_became_active":"2023-11-27T20:44:07.535564+0000","last_became_peered":"2023-11-27T20:44:07.535564+0000","last_unstale":"2023-11-27T20:44:07.539459+0000","last_undegraded":"2023-11-27T20:44:07.539459+0000","last_fullsized":"2023-11-27T20:44:07.539459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:29.891814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511441+0000","last_change":"2023-11-27T20:43:52.734666+0000","last_active":"2023-11-27T20:44:06.511441+0000","last_peered":"2023-11-27T20:44:06.511441+0000","last_clean":"2023-11-27T20:44:06.511441+0000","last_became_active":"2023-11-27T20:43:52.733983+0000","last_became_peered":"2023-11-27T20:43:52.733983+0000","last_unstale":"2023-11-27T20:44:06.511441+0000","last_undegraded":"2023-11-27T20:44:06.511441+0000","last_fullsized":"2023-11-27T20:44:06.511441+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:55.762089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507244+0000","last_change":"2023-11-27T20:43:51.711467+0000","last_active":"2023-11-27T20:44:06.507244+0000","last_peered":"2023-11-27T20:44:06.507244+0000","last_clean":"2023-11-27T20:44:06.507244+0000","last_became_active":"2023-11-27T20:43:51.711141+0000","last_became_peered":"2023-11-27T20:43:51.711141+0000","last_unstale":"2023-11-27T20:44:06.507244+0000","last_undegraded":"2023-11-27T20:44:06.507244+0000","last_fullsized":"2023-11-27T20:44:06.507244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:14.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530389+0000","last_change":"2023-11-27T20:44:07.530389+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530389+0000","last_undegraded":"2023-11-27T20:44:07.530389+0000","last_fullsized":"2023-11-27T20:44:07.530389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547796+0000","last_change":"2023-11-27T20:44:07.546578+0000","last_active":"2023-11-27T20:44:07.547796+0000","last_peered":"2023-11-27T20:44:07.547796+0000","last_clean":"2023-11-27T20:44:07.547796+0000","last_became_active":"2023-11-27T20:44:07.545547+0000","last_became_peered":"2023-11-27T20:44:07.545547+0000","last_unstale":"2023-11-27T20:44:07.547796+0000","last_undegraded":"2023-11-27T20:44:07.547796+0000","last_fullsized":"2023-11-27T20:44:07.547796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:55.426778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513740+0000","last_change":"2023-11-27T20:43:52.740355+0000","last_active":"2023-11-27T20:44:06.513740+0000","last_peered":"2023-11-27T20:44:06.513740+0000","last_clean":"2023-11-27T20:44:06.513740+0000","last_became_active":"2023-11-27T20:43:52.739879+0000","last_became_peered":"2023-11-27T20:43:52.739879+0000","last_unstale":"2023-11-27T20:44:06.513740+0000","last_undegraded":"2023-11-27T20:44:06.513740+0000","last_fullsized":"2023-11-27T20:44:06.513740+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:08:26.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511517+0000","last_change":"2023-11-27T20:43:51.701819+0000","last_active":"2023-11-27T20:44:06.511517+0000","last_peered":"2023-11-27T20:44:06.511517+0000","last_clean":"2023-11-27T20:44:06.511517+0000","last_became_active":"2023-11-27T20:43:51.701542+0000","last_became_peered":"2023-11-27T20:43:51.701542+0000","last_unstale":"2023-11-27T20:44:06.511517+0000","last_undegraded":"2023-11-27T20:44:06.511517+0000","last_fullsized":"2023-11-27T20:44:06.511517+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:53.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529870+0000","last_change":"2023-11-27T20:44:07.529870+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529870+0000","last_undegraded":"2023-11-27T20:44:07.529870+0000","last_fullsized":"2023-11-27T20:44:07.529870+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.544729+0000","last_change":"2023-11-27T20:44:07.538342+0000","last_active":"2023-11-27T20:44:07.544729+0000","last_peered":"2023-11-27T20:44:07.544729+0000","last_clean":"2023-11-27T20:44:07.544729+0000","last_became_active":"2023-11-27T20:44:07.538037+0000","last_became_peered":"2023-11-27T20:44:07.538037+0000","last_unstale":"2023-11-27T20:44:07.544729+0000","last_undegraded":"2023-11-27T20:44:07.544729+0000","last_fullsized":"2023-11-27T20:44:07.544729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:29:08.542478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515412+0000","last_change":"2023-11-27T20:43:52.735677+0000","last_active":"2023-11-27T20:44:06.515412+0000","last_peered":"2023-11-27T20:44:06.515412+0000","last_clean":"2023-11-27T20:44:06.515412+0000","last_became_active":"2023-11-27T20:43:52.734624+0000","last_became_peered":"2023-11-27T20:43:52.734624+0000","last_unstale":"2023-11-27T20:44:06.515412+0000","last_undegraded":"2023-11-27T20:44:06.515412+0000","last_fullsized":"2023-11-27T20:44:06.515412+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:42.798849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519354+0000","last_change":"2023-11-27T20:43:51.706490+0000","last_active":"2023-11-27T20:44:06.519354+0000","last_peered":"2023-11-27T20:44:06.519354+0000","last_clean":"2023-11-27T20:44:06.519354+0000","last_became_active":"2023-11-27T20:43:51.706181+0000","last_became_peered":"2023-11-27T20:43:51.706181+0000","last_unstale":"2023-11-27T20:44:06.519354+0000","last_undegraded":"2023-11-27T20:44:06.519354+0000","last_fullsized":"2023-11-27T20:44:06.519354+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:41.580304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523700+0000","last_change":"2023-11-27T20:44:07.523700+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523700+0000","last_undegraded":"2023-11-27T20:44:07.523700+0000","last_fullsized":"2023-11-27T20:44:07.523700+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.548497+0000","last_change":"2023-11-27T20:44:07.543638+0000","last_active":"2023-11-27T20:44:07.548497+0000","last_peered":"2023-11-27T20:44:07.548497+0000","last_clean":"2023-11-27T20:44:07.548497+0000","last_became_active":"2023-11-27T20:44:07.543049+0000","last_became_peered":"2023-11-27T20:44:07.543049+0000","last_unstale":"2023-11-27T20:44:07.548497+0000","last_undegraded":"2023-11-27T20:44:07.548497+0000","last_fullsized":"2023-11-27T20:44:07.548497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:38.215762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511164+0000","last_change":"2023-11-27T20:43:52.732611+0000","last_active":"2023-11-27T20:44:06.511164+0000","last_peered":"2023-11-27T20:44:06.511164+0000","last_clean":"2023-11-27T20:44:06.511164+0000","last_became_active":"2023-11-27T20:43:52.732338+0000","last_became_peered":"2023-11-27T20:43:52.732338+0000","last_unstale":"2023-11-27T20:44:06.511164+0000","last_undegraded":"2023-11-27T20:44:06.511164+0000","last_fullsized":"2023-11-27T20:44:06.511164+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:36.170506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506363+0000","last_change":"2023-11-27T20:43:51.712506+0000","last_active":"2023-11-27T20:44:06.506363+0000","last_peered":"2023-11-27T20:44:06.506363+0000","last_clean":"2023-11-27T20:44:06.506363+0000","last_became_active":"2023-11-27T20:43:51.712167+0000","last_became_peered":"2023-11-27T20:43:51.712167+0000","last_unstale":"2023-11-27T20:44:06.506363+0000","last_undegraded":"2023-11-27T20:44:06.506363+0000","last_fullsized":"2023-11-27T20:44:06.506363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:20.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528088+0000","last_change":"2023-11-27T20:44:07.528088+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528088+0000","last_undegraded":"2023-11-27T20:44:07.528088+0000","last_fullsized":"2023-11-27T20:44:07.528088+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547939+0000","last_change":"2023-11-27T20:44:07.541198+0000","last_active":"2023-11-27T20:44:07.547939+0000","last_peered":"2023-11-27T20:44:07.547939+0000","last_clean":"2023-11-27T20:44:07.547939+0000","last_became_active":"2023-11-27T20:44:07.540715+0000","last_became_peered":"2023-11-27T20:44:07.540715+0000","last_unstale":"2023-11-27T20:44:07.547939+0000","last_undegraded":"2023-11-27T20:44:07.547939+0000","last_fullsized":"2023-11-27T20:44:07.547939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:33:36.245172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.509400+0000","last_change":"2023-11-27T20:43:52.743697+0000","last_active":"2023-11-27T20:44:06.509400+0000","last_peered":"2023-11-27T20:44:06.509400+0000","last_clean":"2023-11-27T20:44:06.509400+0000","last_became_active":"2023-11-27T20:43:52.743405+0000","last_became_peered":"2023-11-27T20:43:52.743405+0000","last_unstale":"2023-11-27T20:44:06.509400+0000","last_undegraded":"2023-11-27T20:44:06.509400+0000","last_fullsized":"2023-11-27T20:44:06.509400+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519933+0000","last_change":"2023-11-27T20:43:51.716942+0000","last_active":"2023-11-27T20:44:06.519933+0000","last_peered":"2023-11-27T20:44:06.519933+0000","last_clean":"2023-11-27T20:44:06.519933+0000","last_became_active":"2023-11-27T20:43:51.716549+0000","last_became_peered":"2023-11-27T20:43:51.716549+0000","last_unstale":"2023-11-27T20:44:06.519933+0000","last_undegraded":"2023-11-27T20:44:06.519933+0000","last_fullsized":"2023-11-27T20:44:06.519933+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529398+0000","last_change":"2023-11-27T20:44:07.529398+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529398+0000","last_undegraded":"2023-11-27T20:44:07.529398+0000","last_fullsized":"2023-11-27T20:44:07.529398+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.543312+0000","last_change":"2023-11-27T20:44:07.540741+0000","last_active":"2023-11-27T20:44:07.543312+0000","last_peered":"2023-11-27T20:44:07.543312+0000","last_clean":"2023-11-27T20:44:07.543312+0000","last_became_active":"2023-11-27T20:44:07.540459+0000","last_became_peered":"2023-11-27T20:44:07.540459+0000","last_unstale":"2023-11-27T20:44:07.543312+0000","last_undegraded":"2023-11-27T20:44:07.543312+0000","last_fullsized":"2023-11-27T20:44:07.543312+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:38.215762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519822+0000","last_change":"2023-11-27T20:43:52.747269+0000","last_active":"2023-11-27T20:44:06.519822+0000","last_peered":"2023-11-27T20:44:06.519822+0000","last_clean":"2023-11-27T20:44:06.519822+0000","last_became_active":"2023-11-27T20:43:52.746473+0000","last_became_peered":"2023-11-27T20:43:52.746473+0000","last_unstale":"2023-11-27T20:44:06.519822+0000","last_undegraded":"2023-11-27T20:44:06.519822+0000","last_fullsized":"2023-11-27T20:44:06.519822+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:55.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514190+0000","last_change":"2023-11-27T20:43:51.711346+0000","last_active":"2023-11-27T20:44:06.514190+0000","last_peered":"2023-11-27T20:44:06.514190+0000","last_clean":"2023-11-27T20:44:06.514190+0000","last_became_active":"2023-11-27T20:43:51.711060+0000","last_became_peered":"2023-11-27T20:43:51.711060+0000","last_unstale":"2023-11-27T20:44:06.514190+0000","last_undegraded":"2023-11-27T20:44:06.514190+0000","last_fullsized":"2023-11-27T20:44:06.514190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:18.330525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531925+0000","last_change":"2023-11-27T20:44:07.531925+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531925+0000","last_undegraded":"2023-11-27T20:44:07.531925+0000","last_fullsized":"2023-11-27T20:44:07.531925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.541276+0000","last_change":"2023-11-27T20:44:07.537248+0000","last_active":"2023-11-27T20:44:07.541276+0000","last_peered":"2023-11-27T20:44:07.541276+0000","last_clean":"2023-11-27T20:44:07.541276+0000","last_became_active":"2023-11-27T20:44:07.535963+0000","last_became_peered":"2023-11-27T20:44:07.535963+0000","last_unstale":"2023-11-27T20:44:07.541276+0000","last_undegraded":"2023-11-27T20:44:07.541276+0000","last_fullsized":"2023-11-27T20:44:07.541276+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:43.756684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500291+0000","last_change":"2023-11-27T20:43:52.738413+0000","last_active":"2023-11-27T20:44:06.500291+0000","last_peered":"2023-11-27T20:44:06.500291+0000","last_clean":"2023-11-27T20:44:06.500291+0000","last_became_active":"2023-11-27T20:43:52.738105+0000","last_became_peered":"2023-11-27T20:43:52.738105+0000","last_unstale":"2023-11-27T20:44:06.500291+0000","last_undegraded":"2023-11-27T20:44:06.500291+0000","last_fullsized":"2023-11-27T20:44:06.500291+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:00.871014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518398+0000","last_change":"2023-11-27T20:43:51.716907+0000","last_active":"2023-11-27T20:44:06.518398+0000","last_peered":"2023-11-27T20:44:06.518398+0000","last_clean":"2023-11-27T20:44:06.518398+0000","last_became_active":"2023-11-27T20:43:51.716616+0000","last_became_peered":"2023-11-27T20:43:51.716616+0000","last_unstale":"2023-11-27T20:44:06.518398+0000","last_undegraded":"2023-11-27T20:44:06.518398+0000","last_fullsized":"2023-11-27T20:44:06.518398+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.538067+0000","last_change":"2023-11-27T20:44:07.538067+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.538067+0000","last_undegraded":"2023-11-27T20:44:07.538067+0000","last_fullsized":"2023-11-27T20:44:07.538067+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.556080+0000","last_change":"2023-11-27T20:44:07.553474+0000","last_active":"2023-11-27T20:44:07.556080+0000","last_peered":"2023-11-27T20:44:07.556080+0000","last_clean":"2023-11-27T20:44:07.556080+0000","last_became_active":"2023-11-27T20:44:07.553184+0000","last_became_peered":"2023-11-27T20:44:07.553184+0000","last_unstale":"2023-11-27T20:44:07.556080+0000","last_undegraded":"2023-11-27T20:44:07.556080+0000","last_fullsized":"2023-11-27T20:44:07.556080+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:21.070349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517989+0000","last_change":"2023-11-27T20:43:52.740853+0000","last_active":"2023-11-27T20:44:06.517989+0000","last_peered":"2023-11-27T20:44:06.517989+0000","last_clean":"2023-11-27T20:44:06.517989+0000","last_became_active":"2023-11-27T20:43:52.740468+0000","last_became_peered":"2023-11-27T20:43:52.740468+0000","last_unstale":"2023-11-27T20:44:06.517989+0000","last_undegraded":"2023-11-27T20:44:06.517989+0000","last_fullsized":"2023-11-27T20:44:06.517989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'8","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.508060+0000","last_change":"2023-11-27T20:43:51.711651+0000","last_active":"2023-11-27T20:44:06.508060+0000","last_peered":"2023-11-27T20:44:06.508060+0000","last_clean":"2023-11-27T20:44:06.508060+0000","last_became_active":"2023-11-27T20:43:51.711270+0000","last_became_peered":"2023-11-27T20:43:51.711270+0000","last_unstale":"2023-11-27T20:44:06.508060+0000","last_undegraded":"2023-11-27T20:44:06.508060+0000","last_fullsized":"2023-11-27T20:44:06.508060+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:07.560276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.532546+0000","last_change":"2023-11-27T20:44:07.532546+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.532546+0000","last_undegraded":"2023-11-27T20:44:07.532546+0000","last_fullsized":"2023-11-27T20:44:07.532546+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552434+0000","last_change":"2023-11-27T20:44:07.550573+0000","last_active":"2023-11-27T20:44:07.552434+0000","last_peered":"2023-11-27T20:44:07.552434+0000","last_clean":"2023-11-27T20:44:07.552434+0000","last_became_active":"2023-11-27T20:44:07.549497+0000","last_became_peered":"2023-11-27T20:44:07.549497+0000","last_unstale":"2023-11-27T20:44:07.552434+0000","last_undegraded":"2023-11-27T20:44:07.552434+0000","last_fullsized":"2023-11-27T20:44:07.552434+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:17.251945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517767+0000","last_change":"2023-11-27T20:43:52.731258+0000","last_active":"2023-11-27T20:44:06.517767+0000","last_peered":"2023-11-27T20:44:06.517767+0000","last_clean":"2023-11-27T20:44:06.517767+0000","last_became_active":"2023-11-27T20:43:52.730701+0000","last_became_peered":"2023-11-27T20:43:52.730701+0000","last_unstale":"2023-11-27T20:44:06.517767+0000","last_undegraded":"2023-11-27T20:44:06.517767+0000","last_fullsized":"2023-11-27T20:44:06.517767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:28.943589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513829+0000","last_change":"2023-11-27T20:43:51.709141+0000","last_active":"2023-11-27T20:44:06.513829+0000","last_peered":"2023-11-27T20:44:06.513829+0000","last_clean":"2023-11-27T20:44:06.513829+0000","last_became_active":"2023-11-27T20:43:51.708864+0000","last_became_peered":"2023-11-27T20:43:51.708864+0000","last_unstale":"2023-11-27T20:44:06.513829+0000","last_undegraded":"2023-11-27T20:44:06.513829+0000","last_fullsized":"2023-11-27T20:44:06.513829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:29.585661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531534+0000","last_change":"2023-11-27T20:44:07.531534+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531534+0000","last_undegraded":"2023-11-27T20:44:07.531534+0000","last_fullsized":"2023-11-27T20:44:07.531534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.555776+0000","last_change":"2023-11-27T20:44:07.553337+0000","last_active":"2023-11-27T20:44:07.555776+0000","last_peered":"2023-11-27T20:44:07.555776+0000","last_clean":"2023-11-27T20:44:07.555776+0000","last_became_active":"2023-11-27T20:44:07.552962+0000","last_became_peered":"2023-11-27T20:44:07.552962+0000","last_unstale":"2023-11-27T20:44:07.555776+0000","last_undegraded":"2023-11-27T20:44:07.555776+0000","last_fullsized":"2023-11-27T20:44:07.555776+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:16:09.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516879+0000","last_change":"2023-11-27T20:43:52.736912+0000","last_active":"2023-11-27T20:44:06.516879+0000","last_peered":"2023-11-27T20:44:06.516879+0000","last_clean":"2023-11-27T20:44:06.516879+0000","last_became_active":"2023-11-27T20:43:52.735675+0000","last_became_peered":"2023-11-27T20:43:52.735675+0000","last_unstale":"2023-11-27T20:44:06.516879+0000","last_undegraded":"2023-11-27T20:44:06.516879+0000","last_fullsized":"2023-11-27T20:44:06.516879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517569+0000","last_change":"2023-11-27T20:43:51.711938+0000","last_active":"2023-11-27T20:44:06.517569+0000","last_peered":"2023-11-27T20:44:06.517569+0000","last_clean":"2023-11-27T20:44:06.517569+0000","last_became_active":"2023-11-27T20:43:51.711617+0000","last_became_peered":"2023-11-27T20:43:51.711617+0000","last_unstale":"2023-11-27T20:44:06.517569+0000","last_undegraded":"2023-11-27T20:44:06.517569+0000","last_fullsized":"2023-11-27T20:44:06.517569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:54.146026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537759+0000","last_change":"2023-11-27T20:44:07.537759+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537759+0000","last_undegraded":"2023-11-27T20:44:07.537759+0000","last_fullsized":"2023-11-27T20:44:07.537759+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.553685+0000","last_change":"2023-11-27T20:44:07.550581+0000","last_active":"2023-11-27T20:44:07.553685+0000","last_peered":"2023-11-27T20:44:07.553685+0000","last_clean":"2023-11-27T20:44:07.553685+0000","last_became_active":"2023-11-27T20:44:07.549832+0000","last_became_peered":"2023-11-27T20:44:07.549832+0000","last_unstale":"2023-11-27T20:44:07.553685+0000","last_undegraded":"2023-11-27T20:44:07.553685+0000","last_fullsized":"2023-11-27T20:44:07.553685+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:32.588898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506128+0000","last_change":"2023-11-27T20:43:52.742672+0000","last_active":"2023-11-27T20:44:06.506128+0000","last_peered":"2023-11-27T20:44:06.506128+0000","last_clean":"2023-11-27T20:44:06.506128+0000","last_became_active":"2023-11-27T20:43:52.742066+0000","last_became_peered":"2023-11-27T20:43:52.742066+0000","last_unstale":"2023-11-27T20:44:06.506128+0000","last_undegraded":"2023-11-27T20:44:06.506128+0000","last_fullsized":"2023-11-27T20:44:06.506128+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:01.982839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519493+0000","last_change":"2023-11-27T20:43:51.711077+0000","last_active":"2023-11-27T20:44:06.519493+0000","last_peered":"2023-11-27T20:44:06.519493+0000","last_clean":"2023-11-27T20:44:06.519493+0000","last_became_active":"2023-11-27T20:43:51.710820+0000","last_became_peered":"2023-11-27T20:43:51.710820+0000","last_unstale":"2023-11-27T20:44:06.519493+0000","last_undegraded":"2023-11-27T20:44:06.519493+0000","last_fullsized":"2023-11-27T20:44:06.519493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:21.429946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529666+0000","last_change":"2023-11-27T20:44:07.529666+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529666+0000","last_undegraded":"2023-11-27T20:44:07.529666+0000","last_fullsized":"2023-11-27T20:44:07.529666+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.549409+0000","last_change":"2023-11-27T20:44:07.547343+0000","last_active":"2023-11-27T20:44:07.549409+0000","last_peered":"2023-11-27T20:44:07.549409+0000","last_clean":"2023-11-27T20:44:07.549409+0000","last_became_active":"2023-11-27T20:44:07.547004+0000","last_became_peered":"2023-11-27T20:44:07.547004+0000","last_unstale":"2023-11-27T20:44:07.549409+0000","last_undegraded":"2023-11-27T20:44:07.549409+0000","last_fullsized":"2023-11-27T20:44:07.549409+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:32.700621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518818+0000","last_change":"2023-11-27T20:43:52.742494+0000","last_active":"2023-11-27T20:44:06.518818+0000","last_peered":"2023-11-27T20:44:06.518818+0000","last_clean":"2023-11-27T20:44:06.518818+0000","last_became_active":"2023-11-27T20:43:52.742174+0000","last_became_peered":"2023-11-27T20:43:52.742174+0000","last_unstale":"2023-11-27T20:44:06.518818+0000","last_undegraded":"2023-11-27T20:44:06.518818+0000","last_fullsized":"2023-11-27T20:44:06.518818+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515344+0000","last_change":"2023-11-27T20:43:51.714679+0000","last_active":"2023-11-27T20:44:06.515344+0000","last_peered":"2023-11-27T20:44:06.515344+0000","last_clean":"2023-11-27T20:44:06.515344+0000","last_became_active":"2023-11-27T20:43:51.714406+0000","last_became_peered":"2023-11-27T20:43:51.714406+0000","last_unstale":"2023-11-27T20:44:06.515344+0000","last_undegraded":"2023-11-27T20:44:06.515344+0000","last_fullsized":"2023-11-27T20:44:06.515344+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:27.933426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530632+0000","last_change":"2023-11-27T20:44:07.530632+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530632+0000","last_undegraded":"2023-11-27T20:44:07.530632+0000","last_fullsized":"2023-11-27T20:44:07.530632+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.548455+0000","last_change":"2023-11-27T20:44:07.544501+0000","last_active":"2023-11-27T20:44:07.548455+0000","last_peered":"2023-11-27T20:44:07.548455+0000","last_clean":"2023-11-27T20:44:07.548455+0000","last_became_active":"2023-11-27T20:44:07.542118+0000","last_became_peered":"2023-11-27T20:44:07.542118+0000","last_unstale":"2023-11-27T20:44:07.548455+0000","last_undegraded":"2023-11-27T20:44:07.548455+0000","last_fullsized":"2023-11-27T20:44:07.548455+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:23.383534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519295+0000","last_change":"2023-11-27T20:43:52.743633+0000","last_active":"2023-11-27T20:44:06.519295+0000","last_peered":"2023-11-27T20:44:06.519295+0000","last_clean":"2023-11-27T20:44:06.519295+0000","last_became_active":"2023-11-27T20:43:52.743243+0000","last_became_peered":"2023-11-27T20:43:52.743243+0000","last_unstale":"2023-11-27T20:44:06.519295+0000","last_undegraded":"2023-11-27T20:44:06.519295+0000","last_fullsized":"2023-11-27T20:44:06.519295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514358+0000","last_change":"2023-11-27T20:43:51.714371+0000","last_active":"2023-11-27T20:44:06.514358+0000","last_peered":"2023-11-27T20:44:06.514358+0000","last_clean":"2023-11-27T20:44:06.514358+0000","last_became_active":"2023-11-27T20:43:51.714034+0000","last_became_peered":"2023-11-27T20:43:51.714034+0000","last_unstale":"2023-11-27T20:44:06.514358+0000","last_undegraded":"2023-11-27T20:44:06.514358+0000","last_fullsized":"2023-11-27T20:44:06.514358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528667+0000","last_change":"2023-11-27T20:44:07.528667+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528667+0000","last_undegraded":"2023-11-27T20:44:07.528667+0000","last_fullsized":"2023-11-27T20:44:07.528667+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.555914+0000","last_change":"2023-11-27T20:44:07.552420+0000","last_active":"2023-11-27T20:44:07.555914+0000","last_peered":"2023-11-27T20:44:07.555914+0000","last_clean":"2023-11-27T20:44:07.555914+0000","last_became_active":"2023-11-27T20:44:07.552130+0000","last_became_peered":"2023-11-27T20:44:07.552130+0000","last_unstale":"2023-11-27T20:44:07.555914+0000","last_undegraded":"2023-11-27T20:44:07.555914+0000","last_fullsized":"2023-11-27T20:44:07.555914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:48.971506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521884+0000","last_change":"2023-11-27T20:43:52.741261+0000","last_active":"2023-11-27T20:44:06.521884+0000","last_peered":"2023-11-27T20:44:06.521884+0000","last_clean":"2023-11-27T20:44:06.521884+0000","last_became_active":"2023-11-27T20:43:52.740962+0000","last_became_peered":"2023-11-27T20:43:52.740962+0000","last_unstale":"2023-11-27T20:44:06.521884+0000","last_undegraded":"2023-11-27T20:44:06.521884+0000","last_fullsized":"2023-11-27T20:44:06.521884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513200+0000","last_change":"2023-11-27T20:43:51.708347+0000","last_active":"2023-11-27T20:44:06.513200+0000","last_peered":"2023-11-27T20:44:06.513200+0000","last_clean":"2023-11-27T20:44:06.513200+0000","last_became_active":"2023-11-27T20:43:51.707976+0000","last_became_peered":"2023-11-27T20:43:51.707976+0000","last_unstale":"2023-11-27T20:44:06.513200+0000","last_undegraded":"2023-11-27T20:44:06.513200+0000","last_fullsized":"2023-11-27T20:44:06.513200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523039+0000","last_change":"2023-11-27T20:44:07.523039+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523039+0000","last_undegraded":"2023-11-27T20:44:07.523039+0000","last_fullsized":"2023-11-27T20:44:07.523039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552454+0000","last_change":"2023-11-27T20:44:07.551592+0000","last_active":"2023-11-27T20:44:07.552454+0000","last_peered":"2023-11-27T20:44:07.552454+0000","last_clean":"2023-11-27T20:44:07.552454+0000","last_became_active":"2023-11-27T20:44:07.546829+0000","last_became_peered":"2023-11-27T20:44:07.546829+0000","last_unstale":"2023-11-27T20:44:07.552454+0000","last_undegraded":"2023-11-27T20:44:07.552454+0000","last_fullsized":"2023-11-27T20:44:07.552454+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:16.795933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513832+0000","last_change":"2023-11-27T20:43:52.740074+0000","last_active":"2023-11-27T20:44:06.513832+0000","last_peered":"2023-11-27T20:44:06.513832+0000","last_clean":"2023-11-27T20:44:06.513832+0000","last_became_active":"2023-11-27T20:43:52.739760+0000","last_became_peered":"2023-11-27T20:43:52.739760+0000","last_unstale":"2023-11-27T20:44:06.513832+0000","last_undegraded":"2023-11-27T20:44:06.513832+0000","last_fullsized":"2023-11-27T20:44:06.513832+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:48:56.029031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521593+0000","last_change":"2023-11-27T20:43:51.707359+0000","last_active":"2023-11-27T20:44:06.521593+0000","last_peered":"2023-11-27T20:44:06.521593+0000","last_clean":"2023-11-27T20:44:06.521593+0000","last_became_active":"2023-11-27T20:43:51.707036+0000","last_became_peered":"2023-11-27T20:43:51.707036+0000","last_unstale":"2023-11-27T20:44:06.521593+0000","last_undegraded":"2023-11-27T20:44:06.521593+0000","last_fullsized":"2023-11-27T20:44:06.521593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537488+0000","last_change":"2023-11-27T20:44:07.537488+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537488+0000","last_undegraded":"2023-11-27T20:44:07.537488+0000","last_fullsized":"2023-11-27T20:44:07.537488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547197+0000","last_change":"2023-11-27T20:44:07.542732+0000","last_active":"2023-11-27T20:44:07.547197+0000","last_peered":"2023-11-27T20:44:07.547197+0000","last_clean":"2023-11-27T20:44:07.547197+0000","last_became_active":"2023-11-27T20:44:07.542131+0000","last_became_peered":"2023-11-27T20:44:07.542131+0000","last_unstale":"2023-11-27T20:44:07.547197+0000","last_undegraded":"2023-11-27T20:44:07.547197+0000","last_fullsized":"2023-11-27T20:44:07.547197+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:47.244273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518144+0000","last_change":"2023-11-27T20:43:52.749840+0000","last_active":"2023-11-27T20:44:06.518144+0000","last_peered":"2023-11-27T20:44:06.518144+0000","last_clean":"2023-11-27T20:44:06.518144+0000","last_became_active":"2023-11-27T20:43:52.749390+0000","last_became_peered":"2023-11-27T20:43:52.749390+0000","last_unstale":"2023-11-27T20:44:06.518144+0000","last_undegraded":"2023-11-27T20:44:06.518144+0000","last_fullsized":"2023-11-27T20:44:06.518144+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512519+0000","last_change":"2023-11-27T20:43:51.704467+0000","last_active":"2023-11-27T20:44:06.512519+0000","last_peered":"2023-11-27T20:44:06.512519+0000","last_clean":"2023-11-27T20:44:06.512519+0000","last_became_active":"2023-11-27T20:43:51.704172+0000","last_became_peered":"2023-11-27T20:43:51.704172+0000","last_unstale":"2023-11-27T20:44:06.512519+0000","last_undegraded":"2023-11-27T20:44:06.512519+0000","last_fullsized":"2023-11-27T20:44:06.512519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:44.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524398+0000","last_change":"2023-11-27T20:44:07.524398+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524398+0000","last_undegraded":"2023-11-27T20:44:07.524398+0000","last_fullsized":"2023-11-27T20:44:07.524398+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552575+0000","last_change":"2023-11-27T20:44:07.551204+0000","last_active":"2023-11-27T20:44:07.552575+0000","last_peered":"2023-11-27T20:44:07.552575+0000","last_clean":"2023-11-27T20:44:07.552575+0000","last_became_active":"2023-11-27T20:44:07.550936+0000","last_became_peered":"2023-11-27T20:44:07.550936+0000","last_unstale":"2023-11-27T20:44:07.552575+0000","last_undegraded":"2023-11-27T20:44:07.552575+0000","last_fullsized":"2023-11-27T20:44:07.552575+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:17:14.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517804+0000","last_change":"2023-11-27T20:43:52.730278+0000","last_active":"2023-11-27T20:44:06.517804+0000","last_peered":"2023-11-27T20:44:06.517804+0000","last_clean":"2023-11-27T20:44:06.517804+0000","last_became_active":"2023-11-27T20:43:52.729894+0000","last_became_peered":"2023-11-27T20:43:52.729894+0000","last_unstale":"2023-11-27T20:44:06.517804+0000","last_undegraded":"2023-11-27T20:44:06.517804+0000","last_fullsized":"2023-11-27T20:44:06.517804+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:54.288377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513991+0000","last_change":"2023-11-27T20:43:51.709579+0000","last_active":"2023-11-27T20:44:06.513991+0000","last_peered":"2023-11-27T20:44:06.513991+0000","last_clean":"2023-11-27T20:44:06.513991+0000","last_became_active":"2023-11-27T20:43:51.709194+0000","last_became_peered":"2023-11-27T20:43:51.709194+0000","last_unstale":"2023-11-27T20:44:06.513991+0000","last_undegraded":"2023-11-27T20:44:06.513991+0000","last_fullsized":"2023-11-27T20:44:06.513991+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:01.414182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523350+0000","last_change":"2023-11-27T20:44:07.523350+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523350+0000","last_undegraded":"2023-11-27T20:44:07.523350+0000","last_fullsized":"2023-11-27T20:44:07.523350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.553873+0000","last_change":"2023-11-27T20:44:07.547935+0000","last_active":"2023-11-27T20:44:07.553873+0000","last_peered":"2023-11-27T20:44:07.553873+0000","last_clean":"2023-11-27T20:44:07.553873+0000","last_became_active":"2023-11-27T20:44:07.547663+0000","last_became_peered":"2023-11-27T20:44:07.547663+0000","last_unstale":"2023-11-27T20:44:07.553873+0000","last_undegraded":"2023-11-27T20:44:07.553873+0000","last_fullsized":"2023-11-27T20:44:07.553873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:56:07.645663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512173+0000","last_change":"2023-11-27T20:43:52.750078+0000","last_active":"2023-11-27T20:44:06.512173+0000","last_peered":"2023-11-27T20:44:06.512173+0000","last_clean":"2023-11-27T20:44:06.512173+0000","last_became_active":"2023-11-27T20:43:52.749770+0000","last_became_peered":"2023-11-27T20:43:52.749770+0000","last_unstale":"2023-11-27T20:44:06.512173+0000","last_undegraded":"2023-11-27T20:44:06.512173+0000","last_fullsized":"2023-11-27T20:44:06.512173+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500103+0000","last_change":"2023-11-27T20:43:51.708599+0000","last_active":"2023-11-27T20:44:06.500103+0000","last_peered":"2023-11-27T20:44:06.500103+0000","last_clean":"2023-11-27T20:44:06.500103+0000","last_became_active":"2023-11-27T20:43:51.708311+0000","last_became_peered":"2023-11-27T20:43:51.708311+0000","last_unstale":"2023-11-27T20:44:06.500103+0000","last_undegraded":"2023-11-27T20:44:06.500103+0000","last_fullsized":"2023-11-27T20:44:06.500103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:39.603520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525440+0000","last_change":"2023-11-27T20:44:07.525440+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525440+0000","last_undegraded":"2023-11-27T20:44:07.525440+0000","last_fullsized":"2023-11-27T20:44:07.525440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547438+0000","last_change":"2023-11-27T20:44:07.543371+0000","last_active":"2023-11-27T20:44:07.547438+0000","last_peered":"2023-11-27T20:44:07.547438+0000","last_clean":"2023-11-27T20:44:07.547438+0000","last_became_active":"2023-11-27T20:44:07.542654+0000","last_became_peered":"2023-11-27T20:44:07.542654+0000","last_unstale":"2023-11-27T20:44:07.547438+0000","last_undegraded":"2023-11-27T20:44:07.547438+0000","last_fullsized":"2023-11-27T20:44:07.547438+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:29.891814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512999+0000","last_change":"2023-11-27T20:43:52.745035+0000","last_active":"2023-11-27T20:44:06.512999+0000","last_peered":"2023-11-27T20:44:06.512999+0000","last_clean":"2023-11-27T20:44:06.512999+0000","last_became_active":"2023-11-27T20:43:52.744540+0000","last_became_peered":"2023-11-27T20:43:52.744540+0000","last_unstale":"2023-11-27T20:44:06.512999+0000","last_undegraded":"2023-11-27T20:44:06.512999+0000","last_fullsized":"2023-11-27T20:44:06.512999+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517954+0000","last_change":"2023-11-27T20:43:51.703755+0000","last_active":"2023-11-27T20:44:06.517954+0000","last_peered":"2023-11-27T20:44:06.517954+0000","last_clean":"2023-11-27T20:44:06.517954+0000","last_became_active":"2023-11-27T20:43:51.700051+0000","last_became_peered":"2023-11-27T20:43:51.700051+0000","last_unstale":"2023-11-27T20:44:06.517954+0000","last_undegraded":"2023-11-27T20:44:06.517954+0000","last_fullsized":"2023-11-27T20:44:06.517954+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:00.972675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537506+0000","last_change":"2023-11-27T20:44:07.537506+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537506+0000","last_undegraded":"2023-11-27T20:44:07.537506+0000","last_fullsized":"2023-11-27T20:44:07.537506+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547864+0000","last_change":"2023-11-27T20:44:07.546057+0000","last_active":"2023-11-27T20:44:07.547864+0000","last_peered":"2023-11-27T20:44:07.547864+0000","last_clean":"2023-11-27T20:44:07.547864+0000","last_became_active":"2023-11-27T20:44:07.543702+0000","last_became_peered":"2023-11-27T20:44:07.543702+0000","last_unstale":"2023-11-27T20:44:07.547864+0000","last_undegraded":"2023-11-27T20:44:07.547864+0000","last_fullsized":"2023-11-27T20:44:07.547864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:31.531196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521707+0000","last_change":"2023-11-27T20:43:52.735455+0000","last_active":"2023-11-27T20:44:06.521707+0000","last_peered":"2023-11-27T20:44:06.521707+0000","last_clean":"2023-11-27T20:44:06.521707+0000","last_became_active":"2023-11-27T20:43:52.735128+0000","last_became_peered":"2023-11-27T20:43:52.735128+0000","last_unstale":"2023-11-27T20:44:06.521707+0000","last_undegraded":"2023-11-27T20:44:06.521707+0000","last_fullsized":"2023-11-27T20:44:06.521707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500775+0000","last_change":"2023-11-27T20:43:51.711208+0000","last_active":"2023-11-27T20:44:06.500775+0000","last_peered":"2023-11-27T20:44:06.500775+0000","last_clean":"2023-11-27T20:44:06.500775+0000","last_became_active":"2023-11-27T20:43:51.710936+0000","last_became_peered":"2023-11-27T20:43:51.710936+0000","last_unstale":"2023-11-27T20:44:06.500775+0000","last_undegraded":"2023-11-27T20:44:06.500775+0000","last_fullsized":"2023-11-27T20:44:06.500775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:20.570705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539096+0000","last_change":"2023-11-27T20:44:07.539096+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539096+0000","last_undegraded":"2023-11-27T20:44:07.539096+0000","last_fullsized":"2023-11-27T20:44:07.539096+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.546342+0000","last_change":"2023-11-27T20:44:07.545626+0000","last_active":"2023-11-27T20:44:07.546342+0000","last_peered":"2023-11-27T20:44:07.546342+0000","last_clean":"2023-11-27T20:44:07.546342+0000","last_became_active":"2023-11-27T20:44:07.545085+0000","last_became_peered":"2023-11-27T20:44:07.545085+0000","last_unstale":"2023-11-27T20:44:07.546342+0000","last_undegraded":"2023-11-27T20:44:07.546342+0000","last_fullsized":"2023-11-27T20:44:07.546342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:39.893393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521932+0000","last_change":"2023-11-27T20:43:52.739121+0000","last_active":"2023-11-27T20:44:06.521932+0000","last_peered":"2023-11-27T20:44:06.521932+0000","last_clean":"2023-11-27T20:44:06.521932+0000","last_became_active":"2023-11-27T20:43:52.738758+0000","last_became_peered":"2023-11-27T20:43:52.738758+0000","last_unstale":"2023-11-27T20:44:06.521932+0000","last_undegraded":"2023-11-27T20:44:06.521932+0000","last_fullsized":"2023-11-27T20:44:06.521932+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513320+0000","last_change":"2023-11-27T20:43:51.703349+0000","last_active":"2023-11-27T20:44:06.513320+0000","last_peered":"2023-11-27T20:44:06.513320+0000","last_clean":"2023-11-27T20:44:06.513320+0000","last_became_active":"2023-11-27T20:43:51.703049+0000","last_became_peered":"2023-11-27T20:43:51.703049+0000","last_unstale":"2023-11-27T20:44:06.513320+0000","last_undegraded":"2023-11-27T20:44:06.513320+0000","last_fullsized":"2023-11-27T20:44:06.513320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530552+0000","last_change":"2023-11-27T20:44:07.530552+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530552+0000","last_undegraded":"2023-11-27T20:44:07.530552+0000","last_fullsized":"2023-11-27T20:44:07.530552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.550112+0000","last_change":"2023-11-27T20:44:07.543027+0000","last_active":"2023-11-27T20:44:07.550112+0000","last_peered":"2023-11-27T20:44:07.550112+0000","last_clean":"2023-11-27T20:44:07.550112+0000","last_became_active":"2023-11-27T20:44:07.541400+0000","last_became_peered":"2023-11-27T20:44:07.541400+0000","last_unstale":"2023-11-27T20:44:07.550112+0000","last_undegraded":"2023-11-27T20:44:07.550112+0000","last_fullsized":"2023-11-27T20:44:07.550112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:56:46.092083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500391+0000","last_change":"2023-11-27T20:43:52.738313+0000","last_active":"2023-11-27T20:44:06.500391+0000","last_peered":"2023-11-27T20:44:06.500391+0000","last_clean":"2023-11-27T20:44:06.500391+0000","last_became_active":"2023-11-27T20:43:52.738011+0000","last_became_peered":"2023-11-27T20:43:52.738011+0000","last_unstale":"2023-11-27T20:44:06.500391+0000","last_undegraded":"2023-11-27T20:44:06.500391+0000","last_fullsized":"2023-11-27T20:44:06.500391+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:18:19.921000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521006+0000","last_change":"2023-11-27T20:43:51.711343+0000","last_active":"2023-11-27T20:44:06.521006+0000","last_peered":"2023-11-27T20:44:06.521006+0000","last_clean":"2023-11-27T20:44:06.521006+0000","last_became_active":"2023-11-27T20:43:51.708458+0000","last_became_peered":"2023-11-27T20:43:51.708458+0000","last_unstale":"2023-11-27T20:44:06.521006+0000","last_undegraded":"2023-11-27T20:44:06.521006+0000","last_fullsized":"2023-11-27T20:44:06.521006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:41.674074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537058+0000","last_change":"2023-11-27T20:44:07.537058+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537058+0000","last_undegraded":"2023-11-27T20:44:07.537058+0000","last_fullsized":"2023-11-27T20:44:07.537058+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552520+0000","last_change":"2023-11-27T20:44:07.550591+0000","last_active":"2023-11-27T20:44:07.552520+0000","last_peered":"2023-11-27T20:44:07.552520+0000","last_clean":"2023-11-27T20:44:07.552520+0000","last_became_active":"2023-11-27T20:44:07.548839+0000","last_became_peered":"2023-11-27T20:44:07.548839+0000","last_unstale":"2023-11-27T20:44:07.552520+0000","last_undegraded":"2023-11-27T20:44:07.552520+0000","last_fullsized":"2023-11-27T20:44:07.552520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:40.418150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513151+0000","last_change":"2023-11-27T20:43:52.746396+0000","last_active":"2023-11-27T20:44:06.513151+0000","last_peered":"2023-11-27T20:44:06.513151+0000","last_clean":"2023-11-27T20:44:06.513151+0000","last_became_active":"2023-11-27T20:43:52.745787+0000","last_became_peered":"2023-11-27T20:43:52.745787+0000","last_unstale":"2023-11-27T20:44:06.513151+0000","last_undegraded":"2023-11-27T20:44:06.513151+0000","last_fullsized":"2023-11-27T20:44:06.513151+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:02.424346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521543+0000","last_change":"2023-11-27T20:43:51.711230+0000","last_active":"2023-11-27T20:44:06.521543+0000","last_peered":"2023-11-27T20:44:06.521543+0000","last_clean":"2023-11-27T20:44:06.521543+0000","last_became_active":"2023-11-27T20:43:51.709149+0000","last_became_peered":"2023-11-27T20:43:51.709149+0000","last_unstale":"2023-11-27T20:44:06.521543+0000","last_undegraded":"2023-11-27T20:44:06.521543+0000","last_fullsized":"2023-11-27T20:44:06.521543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:18.904440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531539+0000","last_change":"2023-11-27T20:44:07.531539+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531539+0000","last_undegraded":"2023-11-27T20:44:07.531539+0000","last_fullsized":"2023-11-27T20:44:07.531539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.550961+0000","last_change":"2023-11-27T20:44:07.548314+0000","last_active":"2023-11-27T20:44:07.550961+0000","last_peered":"2023-11-27T20:44:07.550961+0000","last_clean":"2023-11-27T20:44:07.550961+0000","last_became_active":"2023-11-27T20:44:07.547981+0000","last_became_peered":"2023-11-27T20:44:07.547981+0000","last_unstale":"2023-11-27T20:44:07.550961+0000","last_undegraded":"2023-11-27T20:44:07.550961+0000","last_fullsized":"2023-11-27T20:44:07.550961+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:09:09.101471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511517+0000","last_change":"2023-11-27T20:43:52.740586+0000","last_active":"2023-11-27T20:44:06.511517+0000","last_peered":"2023-11-27T20:44:06.511517+0000","last_clean":"2023-11-27T20:44:06.511517+0000","last_became_active":"2023-11-27T20:43:52.739765+0000","last_became_peered":"2023-11-27T20:43:52.739765+0000","last_unstale":"2023-11-27T20:44:06.511517+0000","last_undegraded":"2023-11-27T20:44:06.511517+0000","last_fullsized":"2023-11-27T20:44:06.511517+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:52.832569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500131+0000","last_change":"2023-11-27T20:43:51.701630+0000","last_active":"2023-11-27T20:44:06.500131+0000","last_peered":"2023-11-27T20:44:06.500131+0000","last_clean":"2023-11-27T20:44:06.500131+0000","last_became_active":"2023-11-27T20:43:51.701326+0000","last_became_peered":"2023-11-27T20:43:51.701326+0000","last_unstale":"2023-11-27T20:44:06.500131+0000","last_undegraded":"2023-11-27T20:44:06.500131+0000","last_fullsized":"2023-11-27T20:44:06.500131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:15.707938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523119+0000","last_change":"2023-11-27T20:44:07.523119+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523119+0000","last_undegraded":"2023-11-27T20:44:07.523119+0000","last_fullsized":"2023-11-27T20:44:07.523119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552065+0000","last_change":"2023-11-27T20:44:07.550274+0000","last_active":"2023-11-27T20:44:07.552065+0000","last_peered":"2023-11-27T20:44:07.552065+0000","last_clean":"2023-11-27T20:44:07.552065+0000","last_became_active":"2023-11-27T20:44:07.545265+0000","last_became_peered":"2023-11-27T20:44:07.545265+0000","last_unstale":"2023-11-27T20:44:07.552065+0000","last_undegraded":"2023-11-27T20:44:07.552065+0000","last_fullsized":"2023-11-27T20:44:07.552065+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:36.239607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517029+0000","last_change":"2023-11-27T20:43:52.751182+0000","last_active":"2023-11-27T20:44:06.517029+0000","last_peered":"2023-11-27T20:44:06.517029+0000","last_clean":"2023-11-27T20:44:06.517029+0000","last_became_active":"2023-11-27T20:43:52.750848+0000","last_became_peered":"2023-11-27T20:43:52.750848+0000","last_unstale":"2023-11-27T20:44:06.517029+0000","last_undegraded":"2023-11-27T20:44:06.517029+0000","last_fullsized":"2023-11-27T20:44:06.517029+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506341+0000","last_change":"2023-11-27T20:43:51.712306+0000","last_active":"2023-11-27T20:44:06.506341+0000","last_peered":"2023-11-27T20:44:06.506341+0000","last_clean":"2023-11-27T20:44:06.506341+0000","last_became_active":"2023-11-27T20:43:51.712011+0000","last_became_peered":"2023-11-27T20:43:51.712011+0000","last_unstale":"2023-11-27T20:44:06.506341+0000","last_undegraded":"2023-11-27T20:44:06.506341+0000","last_fullsized":"2023-11-27T20:44:06.506341+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:16.877363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526405+0000","last_change":"2023-11-27T20:44:07.526405+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526405+0000","last_undegraded":"2023-11-27T20:44:07.526405+0000","last_fullsized":"2023-11-27T20:44:07.526405+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.558304+0000","last_change":"2023-11-27T20:44:07.553422+0000","last_active":"2023-11-27T20:44:07.558304+0000","last_peered":"2023-11-27T20:44:07.558304+0000","last_clean":"2023-11-27T20:44:07.558304+0000","last_became_active":"2023-11-27T20:44:07.553073+0000","last_became_peered":"2023-11-27T20:44:07.553073+0000","last_unstale":"2023-11-27T20:44:07.558304+0000","last_undegraded":"2023-11-27T20:44:07.558304+0000","last_fullsized":"2023-11-27T20:44:07.558304+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:26.063759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.499837+0000","last_change":"2023-11-27T20:43:52.726119+0000","last_active":"2023-11-27T20:44:06.499837+0000","last_peered":"2023-11-27T20:44:06.499837+0000","last_clean":"2023-11-27T20:44:06.499837+0000","last_became_active":"2023-11-27T20:43:52.725822+0000","last_became_peered":"2023-11-27T20:43:52.725822+0000","last_unstale":"2023-11-27T20:44:06.499837+0000","last_undegraded":"2023-11-27T20:44:06.499837+0000","last_fullsized":"2023-11-27T20:44:06.499837+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:42.798849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.499819+0000","last_change":"2023-11-27T20:43:51.701670+0000","last_active":"2023-11-27T20:44:06.499819+0000","last_peered":"2023-11-27T20:44:06.499819+0000","last_clean":"2023-11-27T20:44:06.499819+0000","last_became_active":"2023-11-27T20:43:51.701405+0000","last_became_peered":"2023-11-27T20:43:51.701405+0000","last_unstale":"2023-11-27T20:44:06.499819+0000","last_undegraded":"2023-11-27T20:44:06.499819+0000","last_fullsized":"2023-11-27T20:44:06.499819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:37.579894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527434+0000","last_change":"2023-11-27T20:44:07.527434+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527434+0000","last_undegraded":"2023-11-27T20:44:07.527434+0000","last_fullsized":"2023-11-27T20:44:07.527434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.543558+0000","last_change":"2023-11-27T20:44:07.541134+0000","last_active":"2023-11-27T20:44:07.543558+0000","last_peered":"2023-11-27T20:44:07.543558+0000","last_clean":"2023-11-27T20:44:07.543558+0000","last_became_active":"2023-11-27T20:44:07.540882+0000","last_became_peered":"2023-11-27T20:44:07.540882+0000","last_unstale":"2023-11-27T20:44:07.543558+0000","last_undegraded":"2023-11-27T20:44:07.543558+0000","last_fullsized":"2023-11-27T20:44:07.543558+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:32.700621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511249+0000","last_change":"2023-11-27T20:43:52.723905+0000","last_active":"2023-11-27T20:44:06.511249+0000","last_peered":"2023-11-27T20:44:06.511249+0000","last_clean":"2023-11-27T20:44:06.511249+0000","last_became_active":"2023-11-27T20:43:52.723296+0000","last_became_peered":"2023-11-27T20:43:52.723296+0000","last_unstale":"2023-11-27T20:44:06.511249+0000","last_undegraded":"2023-11-27T20:44:06.511249+0000","last_fullsized":"2023-11-27T20:44:06.511249+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:25.080298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511226+0000","last_change":"2023-11-27T20:43:51.707532+0000","last_active":"2023-11-27T20:44:06.511226+0000","last_peered":"2023-11-27T20:44:06.511226+0000","last_clean":"2023-11-27T20:44:06.511226+0000","last_became_active":"2023-11-27T20:43:51.705976+0000","last_became_peered":"2023-11-27T20:43:51.705976+0000","last_unstale":"2023-11-27T20:44:06.511226+0000","last_undegraded":"2023-11-27T20:44:06.511226+0000","last_fullsized":"2023-11-27T20:44:06.511226+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:01.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524671+0000","last_change":"2023-11-27T20:44:07.524671+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524671+0000","last_undegraded":"2023-11-27T20:44:07.524671+0000","last_fullsized":"2023-11-27T20:44:07.524671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547414+0000","last_change":"2023-11-27T20:44:07.543228+0000","last_active":"2023-11-27T20:44:07.547414+0000","last_peered":"2023-11-27T20:44:07.547414+0000","last_clean":"2023-11-27T20:44:07.547414+0000","last_became_active":"2023-11-27T20:44:07.540038+0000","last_became_peered":"2023-11-27T20:44:07.540038+0000","last_unstale":"2023-11-27T20:44:07.547414+0000","last_undegraded":"2023-11-27T20:44:07.547414+0000","last_fullsized":"2023-11-27T20:44:07.547414+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:32.588898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511086+0000","last_change":"2023-11-27T20:43:52.752685+0000","last_active":"2023-11-27T20:44:06.511086+0000","last_peered":"2023-11-27T20:44:06.511086+0000","last_clean":"2023-11-27T20:44:06.511086+0000","last_became_active":"2023-11-27T20:43:52.748686+0000","last_became_peered":"2023-11-27T20:43:52.748686+0000","last_unstale":"2023-11-27T20:44:06.511086+0000","last_undegraded":"2023-11-27T20:44:06.511086+0000","last_fullsized":"2023-11-27T20:44:06.511086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:34.158412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516360+0000","last_change":"2023-11-27T20:43:51.700471+0000","last_active":"2023-11-27T20:44:06.516360+0000","last_peered":"2023-11-27T20:44:06.516360+0000","last_clean":"2023-11-27T20:44:06.516360+0000","last_became_active":"2023-11-27T20:43:51.700088+0000","last_became_peered":"2023-11-27T20:43:51.700088+0000","last_unstale":"2023-11-27T20:44:06.516360+0000","last_undegraded":"2023-11-27T20:44:06.516360+0000","last_fullsized":"2023-11-27T20:44:06.516360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:13:35.862430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515700+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:44:06.515700+0000","last_peered":"2023-11-27T20:44:06.515700+0000","last_clean":"2023-11-27T20:44:06.515700+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:44:06.515700+0000","last_undegraded":"2023-11-27T20:44:06.515700+0000","last_fullsized":"2023-11-27T20:44:06.515700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":881171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1579999999999999,"15min":1.163},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.181,"5min":1.2290000000000001,"15min":1.2370000000000001},"min":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.74,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.528}]},{"osd":1,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.47,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.165},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.607,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3480000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.282,"15min":1.3080000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.484,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.3},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.248,"15min":1.2589999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6379999999999999,"5min":1.909,"15min":1.909},"last":1.0489999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.361,"15min":1.397},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6779999999999999,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.113},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.47,"15min":1.496},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6879999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.244}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.724,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.5429999999999999,"15min":1.6040000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.623,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.2090000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4770000000000001,"15min":1.5049999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.948,"5min":2.044,"15min":2.044},"last":1.415},{"interface":"front","average":{"1min":1.399,"5min":1.5660000000000001,"15min":1.5940000000000001},"min":{"1min":0.69499999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8169999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.629}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.653,"15min":1.6759999999999999},"min":{"1min":0.80200000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.0179999999999998,"5min":2.508,"15min":2.508},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.6559999999999999,"15min":1.694},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.724,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.7749999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":684032,"data_stored":297773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.679,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.306,"15min":1.331},"min":{"1min":0.65200000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6399999999999999,"5min":2.581,"15min":2.581},"last":0.92800000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2549999999999999,"15min":1.2769999999999999},"min":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5349999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.151,"15min":1.167},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.506,"5min":2.823,"15min":2.823},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0760000000000001,"15min":1.081},"min":{"1min":0.79100000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4790000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.2,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.86899999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.679,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.101}]},{"osd":3,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.349,"15min":1.387},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.71,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.7849999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.1990000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.605,"15min":1.631},"min":{"1min":0.97699999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.994,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.623,"15min":1.663},"min":{"1min":0.82799999999999996,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.804,"5min":3.536,"15min":3.536},"last":1.1559999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.393,"15min":1.4079999999999999},"min":{"1min":0.81200000000000006,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9359999999999999,"5min":2.355,"15min":2.355},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.753,"5min":0.623,"15min":0.623},"max":{"1min":1.8819999999999999,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.2649999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.6519999999999999,"15min":1.6919999999999999},"min":{"1min":0.88500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":3.645,"15min":3.645},"last":1.242},{"interface":"front","average":{"1min":1.452,"5min":1.569,"15min":1.589},"min":{"1min":1.006,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.032,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.4590000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":298425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.1379999999999999,"15min":1.163},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5800000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.1579999999999999,"15min":1.1839999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6619999999999999,"5min":2.04,"15min":2.04},"last":1.367}]},{"osd":1,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.181,"15min":1.2050000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.4630000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.242}]},{"osd":2,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.27,"15min":1.294},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.73,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.268},{"interface":"front","average":{"1min":1.081,"5min":1.1950000000000001,"15min":1.214},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7470000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.556}]},{"osd":3,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.3660000000000001,"15min":1.399},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5900000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.4359999999999999,"15min":1.472},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.637,"5min":4.016,"15min":4.016},"last":1.206}]},{"osd":4,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3580000000000001,"15min":1.3919999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.79,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.873},{"interface":"front","average":{"1min":1.292,"5min":1.585,"15min":1.6339999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8140000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.1439999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.619,"15min":1.671},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.724,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.573,"15min":1.6120000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.016,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.405}]},{"osd":7,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.6379999999999999,"15min":1.6819999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.871,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.599},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.708,"15min":1.76},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8380000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.3160000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":300880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.014,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.0840000000000001,"15min":1.0820000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.034,"15min":1.008},"min":{"1min":0.80400000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.222,"15min":1.22},"min":{"1min":0.64500000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.74,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.29}]},{"osd":2,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2170000000000001,"15min":1.2110000000000001},"min":{"1min":0.69799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.343},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.292,"15min":1.294},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.53}]},{"osd":3,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.85199999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.599,"5min":1.778,"15min":1.778},"last":1.024},{"interface":"front","average":{"1min":1.464,"5min":1.3600000000000001,"15min":1.343},"min":{"1min":0.91400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.4710000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.266,"15min":1.284},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.109},{"interface":"front","average":{"1min":1.421,"5min":1.431,"15min":1.4330000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.0569999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.651,"5min":2.157,"15min":2.157},"last":1.242},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.595,"15min":1.605},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.887,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.385}]},{"osd":7,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5089999999999999,"15min":1.5009999999999999},"min":{"1min":1.179,"5min":1.016,"15min":1.016},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.6679999999999999,"15min":1.6639999999999999},"min":{"1min":1.22,"5min":1.004,"15min":1.004},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.5840000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":1.0009999999999999,"15min":1.0389999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.258,"5min":3.641,"15min":3.641},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97199999999999998,"15min":1.014},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0449999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.399,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.097,"15min":1.121},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4099999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.0880000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0960000000000001,"15min":1.117},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.444,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.135},"min":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.746,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.85299999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.3029999999999999,"15min":1.337},"min":{"1min":0.84499999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.365,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.4330000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.4179999999999999,"15min":1.4379999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.982,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.052},{"interface":"front","average":{"1min":1.272,"5min":1.452,"15min":1.482},"min":{"1min":0.874,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.714,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.3049999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.5189999999999999,"15min":1.544},"min":{"1min":0.96799999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.823,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.492,"15min":1.522},"min":{"1min":0.89000000000000001,"5min":0.878,"15min":0.878},"max":{"1min":1.8560000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.5209999999999999,"15min":1.5580000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.929,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.167},{"interface":"front","average":{"1min":1.413,"5min":1.4890000000000001,"15min":1.5009999999999999},"min":{"1min":1.002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.7410000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.2869999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1259999999999999,"5min":1.228,"15min":1.228},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.93300000000000005},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2270000000000001,"5min":1.972,"15min":1.972},"last":1.4750000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.98099999999999998,"15min":1.014},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1890000000000001,"5min":1.522,"15min":1.522},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.96499999999999997,"15min":0.98799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.431,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.022}]},{"osd":3,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.96099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0740000000000001,"15min":1.101},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4770000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1359999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.1850000000000001,"15min":1.21},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4299999999999999,"5min":1.669,"15min":1.669},"last":1.431},{"interface":"front","average":{"1min":1.169,"5min":1.3540000000000001,"15min":1.385},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.252}]},{"osd":5,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.3009999999999999,"15min":1.3260000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.601,"5min":2.48,"15min":2.48},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.4510000000000001,"15min":1.4930000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9930000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.5129999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3640000000000001,"15min":1.381},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.972,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.383},{"interface":"front","average":{"1min":1.202,"5min":1.4890000000000001,"15min":1.5369999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.831,"5min":3.302,"15min":3.302},"last":1.339}]},{"osd":7,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.46,"15min":1.496},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.1070000000000002,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.4330000000000001,"15min":1.4810000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.581,"5min":2.73,"15min":2.73},"last":1.0740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":688128,"data_stored":297863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0940000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.5449999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.97099999999999997,"15min":0.98999999999999999},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3740000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0429999999999999,"15min":1.0469999999999999},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.518,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0489999999999999,"15min":1.0329999999999999},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7370000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.083,"15min":1.087},"min":{"1min":0.66600000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6140000000000001,"5min":2.044,"15min":2.044},"last":0.70699999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1799999999999999,"15min":1.1890000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3640000000000001,"15min":1.3540000000000001},"min":{"1min":0.88500000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.1099999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.0409999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9810000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.02},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.25,"15min":1.2330000000000001},"min":{"1min":0.79100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1659999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.2490000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.3380000000000001,"15min":1.3180000000000001},"min":{"1min":1.095,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1230000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.357},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.732,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.3240000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.4690000000000001,"15min":1.476},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1949999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.5960000000000001,"15min":1.5880000000000001},"min":{"1min":1.143,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.7469999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.3049999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1294336,"data_stored":891830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.85299999999999998,"15min":0.84199999999999997},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.5649999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.85099999999999998,"15min":0.83499999999999996},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.173}]},{"osd":3,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.91300000000000003,"15min":0.89700000000000002},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.8320000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.0549999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2470000000000001,"15min":1.246},"min":{"1min":0.76900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9430000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.1970000000000001,"15min":1.1919999999999999},"min":{"1min":0.89700000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.575,"5min":2.391,"15min":2.391},"last":1.4019999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.81399999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.0750000000000002,"5min":3.028,"15min":3.028},"last":1.373},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.3129999999999999},"min":{"1min":0.77700000000000002,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.246,"5min":2.718,"15min":2.718},"last":1.341}]},{"osd":6,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3120000000000001},"min":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7909999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.105},{"interface":"front","average":{"1min":1.415,"5min":1.423,"15min":1.4239999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.1509999999999998,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.238}]},{"osd":7,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3540000000000001,"15min":1.355},"min":{"1min":0.84699999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.835,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3560000000000001,"15min":1.3600000000000001},"min":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8500000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.476}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:44:12.929 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:44:13.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.158+0000 7fbe3e475640 1 Processor -- start 2023-11-27T20:44:13.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.158+0000 7fbe3e475640 1 -- start start 2023-11-27T20:44:13.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.159+0000 7fbe3e475640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38155490 0x7fbe380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.160+0000 7fbe3e475640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe380c06c0 con 0x7fbe380a9b40 2023-11-27T20:44:13.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.160+0000 7fbe3e475640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe380c1020 con 0x7fbe380c1500 2023-11-27T20:44:13.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.160+0000 7fbe3e475640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380a5820 con 0x7fbe38155490 2023-11-27T20:44:13.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.160+0000 7fbe3ca12640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fbe380a9b40 0x7fbe380c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50986/0 (socket says 172.21.15.91:50986) 2023-11-27T20:44:13.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.160+0000 7fbe3ca12640 1 -- 172.21.15.91:0/2332330278 learned_addr learned my addr 172.21.15.91:0/2332330278 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:13.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.160+0000 7fbe37fff640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38155490 0x7fbe380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.160+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90115776 0 0) 0x7fbe380c06c0 con 0x7fbe380a9b40 2023-11-27T20:44:13.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe24003520 con 0x7fbe380a9b40 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784801400 0 0) 0x7fbe24003520 con 0x7fbe380a9b40 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38155490 msgr2=0x7fbe380a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38155490 0x7fbe380a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 >> v1:172.21.15.183:6789/0 conn(0x7fbe380c1500 legacy=0x7fbe380a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380c0910 con 0x7fbe380a9b40 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fbe300019f0 con 0x7fbe380a9b40 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 >> v1:172.21.15.91:6789/0 conn(0x7fbe380a9b40 legacy=0x7fbe380c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38155490 0x7fbe240039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe24003f20 0x7fbe240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe24004d00 0x7fbe24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2400ba30 con 0x7fbe24004d00 2023-11-27T20:44:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2400bba0 con 0x7fbe24003f20 2023-11-27T20:44:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2400bd60 con 0x7fbe38155490 2023-11-27T20:44:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.161+0000 7fbe3ca12640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe24004d00 0x7fbe24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.162+0000 7fbe37fff640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38155490 0x7fbe240039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.162+0000 7fbe2ffff640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe24003f20 0x7fbe240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.162+0000 7fbe3ca12640 1 -- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38155490 msgr2=0x7fbe240039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.162+0000 7fbe3ca12640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38155490 0x7fbe240039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.162+0000 7fbe3ca12640 1 -- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe24003f20 msgr2=0x7fbe240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.162+0000 7fbe3ca12640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe24003f20 0x7fbe240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.162+0000 7fbe3ca12640 1 -- 172.21.15.91:0/2332330278 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe24003520 con 0x7fbe24004d00 2023-11-27T20:44:13.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.163+0000 7fbe3ca12640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe24004d00 0x7fbe24005180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbe38072ad0 tx=0x7fbe240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c95212c1315bb56 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:13.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.163+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe300072d0 con 0x7fbe24004d00 2023-11-27T20:44:13.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.163+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3002f070 con 0x7fbe24004d00 2023-11-27T20:44:13.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.163+0000 7fbe377fe640 1 -- 172.21.15.91:0/2332330278 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30007690 con 0x7fbe24004d00 2023-11-27T20:44:13.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.164+0000 7fbe3e475640 1 -- 172.21.15.91:0/2332330278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe24004d00 msgr2=0x7fbe24005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.164+0000 7fbe3e475640 1 --2- 172.21.15.91:0/2332330278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe24004d00 0x7fbe24005180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbe38072ad0 tx=0x7fbe240057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.164+0000 7fbe3ca12640 1 -- 172.21.15.91:0/2332330278 reap_dead start 2023-11-27T20:44:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.164+0000 7fbe3e475640 1 -- 172.21.15.91:0/2332330278 shutdown_connections 2023-11-27T20:44:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.164+0000 7fbe3e475640 1 -- 172.21.15.91:0/2332330278 >> 172.21.15.91:0/2332330278 conn(0x7fbe3806a500 msgr2=0x7fbe3806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.164+0000 7fbe3e475640 1 -- 172.21.15.91:0/2332330278 shutdown_connections 2023-11-27T20:44:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.164+0000 7fbe3e475640 1 -- 172.21.15.91:0/2332330278 wait complete. 2023-11-27T20:44:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.165+0000 7fbe3e475640 1 Processor -- start 2023-11-27T20:44:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.166+0000 7fbe3e475640 1 -- start start 2023-11-27T20:44:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.166+0000 7fbe3e475640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe381eb1f0 0x7fbe381eb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.166+0000 7fbe3e475640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe380be100 0x7fbe380be580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.166+0000 7fbe3e475640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38151570 0x7fbe381519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.166+0000 7fbe3e475640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38156520 con 0x7fbe381eb1f0 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.166+0000 7fbe3e475640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3815a3f0 con 0x7fbe380be100 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.166+0000 7fbe3e475640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38156d30 con 0x7fbe38151570 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe37fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe381eb1f0 0x7fbe381eb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe37fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe381eb1f0 0x7fbe381eb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41882/0 (socket says 172.21.15.91:41882) 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe37fff640 1 -- 172.21.15.91:0/3569570464 learned_addr learned my addr 172.21.15.91:0/3569570464 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe37fff640 1 -- 172.21.15.91:0/3569570464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38151570 msgr2=0x7fbe381519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe37fff640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38151570 0x7fbe381519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe2ffff640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe380be100 0x7fbe380be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe37fff640 1 -- 172.21.15.91:0/3569570464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe380be100 msgr2=0x7fbe380be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe37fff640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe380be100 0x7fbe380be580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe37fff640 1 -- 172.21.15.91:0/3569570464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe38153570 con 0x7fbe381eb1f0 2023-11-27T20:44:13.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe37fff640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe381eb1f0 0x7fbe381eb5d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbe28011580 tx=0x7fbe28011a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:13.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.167+0000 7fbe357fa640 1 -- 172.21.15.91:0/3569570464 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28015870 con 0x7fbe381eb1f0 2023-11-27T20:44:13.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.168+0000 7fbe357fa640 1 -- 172.21.15.91:0/3569570464 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe280159d0 con 0x7fbe381eb1f0 2023-11-27T20:44:13.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.168+0000 7fbe3e475640 1 -- 172.21.15.91:0/3569570464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe38156770 con 0x7fbe381eb1f0 2023-11-27T20:44:13.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.168+0000 7fbe357fa640 1 -- 172.21.15.91:0/3569570464 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28015d40 con 0x7fbe381eb1f0 2023-11-27T20:44:13.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.168+0000 7fbe3e475640 1 -- 172.21.15.91:0/3569570464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe38152d70 con 0x7fbe381eb1f0 2023-11-27T20:44:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.169+0000 7fbe3e475640 1 -- 172.21.15.91:0/3569570464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe38068350 con 0x7fbe381eb1f0 2023-11-27T20:44:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.170+0000 7fbe357fa640 1 -- 172.21.15.91:0/3569570464 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbe2800f460 con 0x7fbe381eb1f0 2023-11-27T20:44:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.171+0000 7fbe357fa640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbe1806b1c0 0x7fbe1806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.171+0000 7fbe357fa640 1 -- 172.21.15.91:0/3569570464 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbe2808a220 con 0x7fbe381eb1f0 2023-11-27T20:44:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.171+0000 7fbe2ffff640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbe1806b1c0 0x7fbe1806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.172+0000 7fbe2ffff640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbe1806b1c0 0x7fbe1806d680 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbe20007fd0 tx=0x7fbe20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:13.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.175+0000 7fbe357fa640 1 -- 172.21.15.91:0/3569570464 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbe28054c00 con 0x7fbe381eb1f0 2023-11-27T20:44:13.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.348+0000 7fbe3e475640 1 -- 172.21.15.91:0/3569570464 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe38155870 con 0x7fbe1806b1c0 2023-11-27T20:44:13.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.362+0000 7fbe357fa640 1 -- 172.21.15.91:0/3569570464 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+519894 (secure 0 0 0) 0x7fbe2000d050 con 0x7fbe1806b1c0 2023-11-27T20:44:13.371 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:13.375 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:44:13.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.371+0000 7fbe3e475640 1 -- 172.21.15.91:0/3569570464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbe1806b1c0 msgr2=0x7fbe1806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.371+0000 7fbe3e475640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbe1806b1c0 0x7fbe1806d680 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbe20007fd0 tx=0x7fbe20009040 comp rx=0 tx=0).stop 2023-11-27T20:44:13.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.371+0000 7fbe3e475640 1 -- 172.21.15.91:0/3569570464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe381eb1f0 msgr2=0x7fbe381eb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.371+0000 7fbe3e475640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe381eb1f0 0x7fbe381eb5d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbe28011580 tx=0x7fbe28011a40 comp rx=0 tx=0).stop 2023-11-27T20:44:13.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.371+0000 7fbe3e475640 1 -- 172.21.15.91:0/3569570464 shutdown_connections 2023-11-27T20:44:13.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.371+0000 7fbe3e475640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe38151570 0x7fbe381519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.371+0000 7fbe3e475640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbe1806b1c0 0x7fbe1806d680 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.371+0000 7fbe3e475640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe380be100 0x7fbe380be580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.371+0000 7fbe3e475640 1 --2- 172.21.15.91:0/3569570464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe381eb1f0 0x7fbe381eb5d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.371+0000 7fbe3e475640 1 -- 172.21.15.91:0/3569570464 >> 172.21.15.91:0/3569570464 conn(0x7fbe3806a500 msgr2=0x7fbe3806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:13.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.372+0000 7fbe3e475640 1 -- 172.21.15.91:0/3569570464 shutdown_connections 2023-11-27T20:44:13.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.372+0000 7fbe3e475640 1 -- 172.21.15.91:0/3569570464 wait complete. 2023-11-27T20:44:13.390 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-11-27T20:44:11.423710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235224,"kb_used_data":6556,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739496,"statfs":{"total":773094113280,"available":772853243904,"internally_reserved":0,"allocated":6713344,"data_stored":3563600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.927206"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528239+0000","last_change":"2023-11-27T20:44:07.528239+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528239+0000","last_undegraded":"2023-11-27T20:44:07.528239+0000","last_fullsized":"2023-11-27T20:44:07.528239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507747+0000","last_change":"2023-11-27T20:43:52.742706+0000","last_active":"2023-11-27T20:44:06.507747+0000","last_peered":"2023-11-27T20:44:06.507747+0000","last_clean":"2023-11-27T20:44:06.507747+0000","last_became_active":"2023-11-27T20:43:52.742447+0000","last_became_peered":"2023-11-27T20:43:52.742447+0000","last_unstale":"2023-11-27T20:44:06.507747+0000","last_undegraded":"2023-11-27T20:44:06.507747+0000","last_fullsized":"2023-11-27T20:44:06.507747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:10.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531466+0000","last_change":"2023-11-27T20:44:07.531466+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531466+0000","last_undegraded":"2023-11-27T20:44:07.531466+0000","last_fullsized":"2023-11-27T20:44:07.531466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514019+0000","last_change":"2023-11-27T20:43:52.741446+0000","last_active":"2023-11-27T20:44:06.514019+0000","last_peered":"2023-11-27T20:44:06.514019+0000","last_clean":"2023-11-27T20:44:06.514019+0000","last_became_active":"2023-11-27T20:43:52.741105+0000","last_became_peered":"2023-11-27T20:43:52.741105+0000","last_unstale":"2023-11-27T20:44:06.514019+0000","last_undegraded":"2023-11-27T20:44:06.514019+0000","last_fullsized":"2023-11-27T20:44:06.514019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:03.285901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.541507+0000","last_change":"2023-11-27T20:44:07.541507+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.541507+0000","last_undegraded":"2023-11-27T20:44:07.541507+0000","last_fullsized":"2023-11-27T20:44:07.541507+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513834+0000","last_change":"2023-11-27T20:43:52.737240+0000","last_active":"2023-11-27T20:44:06.513834+0000","last_peered":"2023-11-27T20:44:06.513834+0000","last_clean":"2023-11-27T20:44:06.513834+0000","last_became_active":"2023-11-27T20:43:52.736781+0000","last_became_peered":"2023-11-27T20:43:52.736781+0000","last_unstale":"2023-11-27T20:44:06.513834+0000","last_undegraded":"2023-11-27T20:44:06.513834+0000","last_fullsized":"2023-11-27T20:44:06.513834+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527473+0000","last_change":"2023-11-27T20:44:07.527473+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527473+0000","last_undegraded":"2023-11-27T20:44:07.527473+0000","last_fullsized":"2023-11-27T20:44:07.527473+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521084+0000","last_change":"2023-11-27T20:43:52.738199+0000","last_active":"2023-11-27T20:44:06.521084+0000","last_peered":"2023-11-27T20:44:06.521084+0000","last_clean":"2023-11-27T20:44:06.521084+0000","last_became_active":"2023-11-27T20:43:52.737298+0000","last_became_peered":"2023-11-27T20:43:52.737298+0000","last_unstale":"2023-11-27T20:44:06.521084+0000","last_undegraded":"2023-11-27T20:44:06.521084+0000","last_fullsized":"2023-11-27T20:44:06.521084+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:54.739325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531917+0000","last_change":"2023-11-27T20:44:07.531917+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531917+0000","last_undegraded":"2023-11-27T20:44:07.531917+0000","last_fullsized":"2023-11-27T20:44:07.531917+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506135+0000","last_change":"2023-11-27T20:43:52.745287+0000","last_active":"2023-11-27T20:44:06.506135+0000","last_peered":"2023-11-27T20:44:06.506135+0000","last_clean":"2023-11-27T20:44:06.506135+0000","last_became_active":"2023-11-27T20:43:52.744817+0000","last_became_peered":"2023-11-27T20:43:52.744817+0000","last_unstale":"2023-11-27T20:44:06.506135+0000","last_undegraded":"2023-11-27T20:44:06.506135+0000","last_fullsized":"2023-11-27T20:44:06.506135+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:59.992569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525264+0000","last_change":"2023-11-27T20:44:07.525264+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525264+0000","last_undegraded":"2023-11-27T20:44:07.525264+0000","last_fullsized":"2023-11-27T20:44:07.525264+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511440+0000","last_change":"2023-11-27T20:43:52.737877+0000","last_active":"2023-11-27T20:44:06.511440+0000","last_peered":"2023-11-27T20:44:06.511440+0000","last_clean":"2023-11-27T20:44:06.511440+0000","last_became_active":"2023-11-27T20:43:52.737566+0000","last_became_peered":"2023-11-27T20:43:52.737566+0000","last_unstale":"2023-11-27T20:44:06.511440+0000","last_undegraded":"2023-11-27T20:44:06.511440+0000","last_fullsized":"2023-11-27T20:44:06.511440+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526887+0000","last_change":"2023-11-27T20:44:07.526887+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526887+0000","last_undegraded":"2023-11-27T20:44:07.526887+0000","last_fullsized":"2023-11-27T20:44:07.526887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505272+0000","last_change":"2023-11-27T20:43:52.738797+0000","last_active":"2023-11-27T20:44:06.505272+0000","last_peered":"2023-11-27T20:44:06.505272+0000","last_clean":"2023-11-27T20:44:06.505272+0000","last_became_active":"2023-11-27T20:43:52.738444+0000","last_became_peered":"2023-11-27T20:43:52.738444+0000","last_unstale":"2023-11-27T20:44:06.505272+0000","last_undegraded":"2023-11-27T20:44:06.505272+0000","last_fullsized":"2023-11-27T20:44:06.505272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:23.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526581+0000","last_change":"2023-11-27T20:44:07.526581+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526581+0000","last_undegraded":"2023-11-27T20:44:07.526581+0000","last_fullsized":"2023-11-27T20:44:07.526581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511067+0000","last_change":"2023-11-27T20:43:52.742425+0000","last_active":"2023-11-27T20:44:06.511067+0000","last_peered":"2023-11-27T20:44:06.511067+0000","last_clean":"2023-11-27T20:44:06.511067+0000","last_became_active":"2023-11-27T20:43:52.741079+0000","last_became_peered":"2023-11-27T20:43:52.741079+0000","last_unstale":"2023-11-27T20:44:06.511067+0000","last_undegraded":"2023-11-27T20:44:06.511067+0000","last_fullsized":"2023-11-27T20:44:06.511067+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:21.581873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.540259+0000","last_change":"2023-11-27T20:44:07.540259+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.540259+0000","last_undegraded":"2023-11-27T20:44:07.540259+0000","last_fullsized":"2023-11-27T20:44:07.540259+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.509318+0000","last_change":"2023-11-27T20:43:52.749527+0000","last_active":"2023-11-27T20:44:06.509318+0000","last_peered":"2023-11-27T20:44:06.509318+0000","last_clean":"2023-11-27T20:44:06.509318+0000","last_became_active":"2023-11-27T20:43:52.749261+0000","last_became_peered":"2023-11-27T20:43:52.749261+0000","last_unstale":"2023-11-27T20:44:06.509318+0000","last_undegraded":"2023-11-27T20:44:06.509318+0000","last_fullsized":"2023-11-27T20:44:06.509318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:22.440110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531049+0000","last_change":"2023-11-27T20:44:07.531049+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531049+0000","last_undegraded":"2023-11-27T20:44:07.531049+0000","last_fullsized":"2023-11-27T20:44:07.531049+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500881+0000","last_change":"2023-11-27T20:43:52.724633+0000","last_active":"2023-11-27T20:44:06.500881+0000","last_peered":"2023-11-27T20:44:06.500881+0000","last_clean":"2023-11-27T20:44:06.500881+0000","last_became_active":"2023-11-27T20:43:52.724319+0000","last_became_peered":"2023-11-27T20:43:52.724319+0000","last_unstale":"2023-11-27T20:44:06.500881+0000","last_undegraded":"2023-11-27T20:44:06.500881+0000","last_fullsized":"2023-11-27T20:44:06.500881+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:56.115106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.535763+0000","last_change":"2023-11-27T20:44:07.535763+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.535763+0000","last_undegraded":"2023-11-27T20:44:07.535763+0000","last_fullsized":"2023-11-27T20:44:07.535763+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500638+0000","last_change":"2023-11-27T20:43:52.740239+0000","last_active":"2023-11-27T20:44:06.500638+0000","last_peered":"2023-11-27T20:44:06.500638+0000","last_clean":"2023-11-27T20:44:06.500638+0000","last_became_active":"2023-11-27T20:43:52.739953+0000","last_became_peered":"2023-11-27T20:43:52.739953+0000","last_unstale":"2023-11-27T20:44:06.500638+0000","last_undegraded":"2023-11-27T20:44:06.500638+0000","last_fullsized":"2023-11-27T20:44:06.500638+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:21.512849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530979+0000","last_change":"2023-11-27T20:44:07.530979+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530979+0000","last_undegraded":"2023-11-27T20:44:07.530979+0000","last_fullsized":"2023-11-27T20:44:07.530979+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521359+0000","last_change":"2023-11-27T20:43:52.736636+0000","last_active":"2023-11-27T20:44:06.521359+0000","last_peered":"2023-11-27T20:44:06.521359+0000","last_clean":"2023-11-27T20:44:06.521359+0000","last_became_active":"2023-11-27T20:43:52.730532+0000","last_became_peered":"2023-11-27T20:43:52.730532+0000","last_unstale":"2023-11-27T20:44:06.521359+0000","last_undegraded":"2023-11-27T20:44:06.521359+0000","last_fullsized":"2023-11-27T20:44:06.521359+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537228+0000","last_change":"2023-11-27T20:44:07.537228+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537228+0000","last_undegraded":"2023-11-27T20:44:07.537228+0000","last_fullsized":"2023-11-27T20:44:07.537228+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.520579+0000","last_change":"2023-11-27T20:43:52.734813+0000","last_active":"2023-11-27T20:44:06.520579+0000","last_peered":"2023-11-27T20:44:06.520579+0000","last_clean":"2023-11-27T20:44:06.520579+0000","last_became_active":"2023-11-27T20:43:52.734472+0000","last_became_peered":"2023-11-27T20:43:52.734472+0000","last_unstale":"2023-11-27T20:44:06.520579+0000","last_undegraded":"2023-11-27T20:44:06.520579+0000","last_fullsized":"2023-11-27T20:44:06.520579+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:00.871014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521140+0000","last_change":"2023-11-27T20:44:07.521140+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521140+0000","last_undegraded":"2023-11-27T20:44:07.521140+0000","last_fullsized":"2023-11-27T20:44:07.521140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.503259+0000","last_change":"2023-11-27T20:43:52.737259+0000","last_active":"2023-11-27T20:44:06.503259+0000","last_peered":"2023-11-27T20:44:06.503259+0000","last_clean":"2023-11-27T20:44:06.503259+0000","last_became_active":"2023-11-27T20:43:52.735819+0000","last_became_peered":"2023-11-27T20:43:52.735819+0000","last_unstale":"2023-11-27T20:44:06.503259+0000","last_undegraded":"2023-11-27T20:44:06.503259+0000","last_fullsized":"2023-11-27T20:44:06.503259+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:42.590467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530684+0000","last_change":"2023-11-27T20:44:07.530684+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530684+0000","last_undegraded":"2023-11-27T20:44:07.530684+0000","last_fullsized":"2023-11-27T20:44:07.530684+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505502+0000","last_change":"2023-11-27T20:43:52.743966+0000","last_active":"2023-11-27T20:44:06.505502+0000","last_peered":"2023-11-27T20:44:06.505502+0000","last_clean":"2023-11-27T20:44:06.505502+0000","last_became_active":"2023-11-27T20:43:52.743629+0000","last_became_peered":"2023-11-27T20:43:52.743629+0000","last_unstale":"2023-11-27T20:44:06.505502+0000","last_undegraded":"2023-11-27T20:44:06.505502+0000","last_fullsized":"2023-11-27T20:44:06.505502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:06.257254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527533+0000","last_change":"2023-11-27T20:44:07.527533+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527533+0000","last_undegraded":"2023-11-27T20:44:07.527533+0000","last_fullsized":"2023-11-27T20:44:07.527533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511481+0000","last_change":"2023-11-27T20:43:52.745826+0000","last_active":"2023-11-27T20:44:06.511481+0000","last_peered":"2023-11-27T20:44:06.511481+0000","last_clean":"2023-11-27T20:44:06.511481+0000","last_became_active":"2023-11-27T20:43:52.745542+0000","last_became_peered":"2023-11-27T20:43:52.745542+0000","last_unstale":"2023-11-27T20:44:06.511481+0000","last_undegraded":"2023-11-27T20:44:06.511481+0000","last_fullsized":"2023-11-27T20:44:06.511481+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:30.595824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525282+0000","last_change":"2023-11-27T20:44:07.525282+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525282+0000","last_undegraded":"2023-11-27T20:44:07.525282+0000","last_fullsized":"2023-11-27T20:44:07.525282+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514319+0000","last_change":"2023-11-27T20:43:52.722794+0000","last_active":"2023-11-27T20:44:06.514319+0000","last_peered":"2023-11-27T20:44:06.514319+0000","last_clean":"2023-11-27T20:44:06.514319+0000","last_became_active":"2023-11-27T20:43:52.722489+0000","last_became_peered":"2023-11-27T20:43:52.722489+0000","last_unstale":"2023-11-27T20:44:06.514319+0000","last_undegraded":"2023-11-27T20:44:06.514319+0000","last_fullsized":"2023-11-27T20:44:06.514319+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:33:24.275033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530733+0000","last_change":"2023-11-27T20:44:07.530733+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530733+0000","last_undegraded":"2023-11-27T20:44:07.530733+0000","last_fullsized":"2023-11-27T20:44:07.530733+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519150+0000","last_change":"2023-11-27T20:43:52.755856+0000","last_active":"2023-11-27T20:44:06.519150+0000","last_peered":"2023-11-27T20:44:06.519150+0000","last_clean":"2023-11-27T20:44:06.519150+0000","last_became_active":"2023-11-27T20:43:52.755447+0000","last_became_peered":"2023-11-27T20:43:52.755447+0000","last_unstale":"2023-11-27T20:44:06.519150+0000","last_undegraded":"2023-11-27T20:44:06.519150+0000","last_fullsized":"2023-11-27T20:44:06.519150+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528962+0000","last_change":"2023-11-27T20:44:07.528962+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528962+0000","last_undegraded":"2023-11-27T20:44:07.528962+0000","last_fullsized":"2023-11-27T20:44:07.528962+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507626+0000","last_change":"2023-11-27T20:43:52.743704+0000","last_active":"2023-11-27T20:44:06.507626+0000","last_peered":"2023-11-27T20:44:06.507626+0000","last_clean":"2023-11-27T20:44:06.507626+0000","last_became_active":"2023-11-27T20:43:52.743440+0000","last_became_peered":"2023-11-27T20:43:52.743440+0000","last_unstale":"2023-11-27T20:44:06.507626+0000","last_undegraded":"2023-11-27T20:44:06.507626+0000","last_fullsized":"2023-11-27T20:44:06.507626+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:40.038308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529520+0000","last_change":"2023-11-27T20:44:07.529520+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529520+0000","last_undegraded":"2023-11-27T20:44:07.529520+0000","last_fullsized":"2023-11-27T20:44:07.529520+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513801+0000","last_change":"2023-11-27T20:43:52.753806+0000","last_active":"2023-11-27T20:44:06.513801+0000","last_peered":"2023-11-27T20:44:06.513801+0000","last_clean":"2023-11-27T20:44:06.513801+0000","last_became_active":"2023-11-27T20:43:52.753119+0000","last_became_peered":"2023-11-27T20:43:52.753119+0000","last_unstale":"2023-11-27T20:44:06.513801+0000","last_undegraded":"2023-11-27T20:44:06.513801+0000","last_fullsized":"2023-11-27T20:44:06.513801+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:44.226522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537041+0000","last_change":"2023-11-27T20:44:07.537041+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537041+0000","last_undegraded":"2023-11-27T20:44:07.537041+0000","last_fullsized":"2023-11-27T20:44:07.537041+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516707+0000","last_change":"2023-11-27T20:43:52.738852+0000","last_active":"2023-11-27T20:44:06.516707+0000","last_peered":"2023-11-27T20:44:06.516707+0000","last_clean":"2023-11-27T20:44:06.516707+0000","last_became_active":"2023-11-27T20:43:52.738571+0000","last_became_peered":"2023-11-27T20:43:52.738571+0000","last_unstale":"2023-11-27T20:44:06.516707+0000","last_undegraded":"2023-11-27T20:44:06.516707+0000","last_fullsized":"2023-11-27T20:44:06.516707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539485+0000","last_change":"2023-11-27T20:44:07.539485+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539485+0000","last_undegraded":"2023-11-27T20:44:07.539485+0000","last_fullsized":"2023-11-27T20:44:07.539485+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511365+0000","last_change":"2023-11-27T20:43:52.734845+0000","last_active":"2023-11-27T20:44:06.511365+0000","last_peered":"2023-11-27T20:44:06.511365+0000","last_clean":"2023-11-27T20:44:06.511365+0000","last_became_active":"2023-11-27T20:43:52.734288+0000","last_became_peered":"2023-11-27T20:43:52.734288+0000","last_unstale":"2023-11-27T20:44:06.511365+0000","last_undegraded":"2023-11-27T20:44:06.511365+0000","last_fullsized":"2023-11-27T20:44:06.511365+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:08:45.447871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521111+0000","last_change":"2023-11-27T20:44:07.521111+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521111+0000","last_undegraded":"2023-11-27T20:44:07.521111+0000","last_fullsized":"2023-11-27T20:44:07.521111+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518661+0000","last_change":"2023-11-27T20:43:52.741528+0000","last_active":"2023-11-27T20:44:06.518661+0000","last_peered":"2023-11-27T20:44:06.518661+0000","last_clean":"2023-11-27T20:44:06.518661+0000","last_became_active":"2023-11-27T20:43:52.741247+0000","last_became_peered":"2023-11-27T20:43:52.741247+0000","last_unstale":"2023-11-27T20:44:06.518661+0000","last_undegraded":"2023-11-27T20:44:06.518661+0000","last_fullsized":"2023-11-27T20:44:06.518661+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521167+0000","last_change":"2023-11-27T20:44:07.521167+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521167+0000","last_undegraded":"2023-11-27T20:44:07.521167+0000","last_fullsized":"2023-11-27T20:44:07.521167+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517222+0000","last_change":"2023-11-27T20:43:52.749184+0000","last_active":"2023-11-27T20:44:06.517222+0000","last_peered":"2023-11-27T20:44:06.517222+0000","last_clean":"2023-11-27T20:44:06.517222+0000","last_became_active":"2023-11-27T20:43:52.747304+0000","last_became_peered":"2023-11-27T20:43:52.747304+0000","last_unstale":"2023-11-27T20:44:06.517222+0000","last_undegraded":"2023-11-27T20:44:06.517222+0000","last_fullsized":"2023-11-27T20:44:06.517222+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:21.580869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527612+0000","last_change":"2023-11-27T20:44:07.527612+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527612+0000","last_undegraded":"2023-11-27T20:44:07.527612+0000","last_fullsized":"2023-11-27T20:44:07.527612+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507945+0000","last_change":"2023-11-27T20:43:52.746466+0000","last_active":"2023-11-27T20:44:06.507945+0000","last_peered":"2023-11-27T20:44:06.507945+0000","last_clean":"2023-11-27T20:44:06.507945+0000","last_became_active":"2023-11-27T20:43:52.746197+0000","last_became_peered":"2023-11-27T20:43:52.746197+0000","last_unstale":"2023-11-27T20:44:06.507945+0000","last_undegraded":"2023-11-27T20:44:06.507945+0000","last_fullsized":"2023-11-27T20:44:06.507945+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:53.742011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.522993+0000","last_change":"2023-11-27T20:44:07.522993+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.522993+0000","last_undegraded":"2023-11-27T20:44:07.522993+0000","last_fullsized":"2023-11-27T20:44:07.522993+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521583+0000","last_change":"2023-11-27T20:43:52.739506+0000","last_active":"2023-11-27T20:44:06.521583+0000","last_peered":"2023-11-27T20:44:06.521583+0000","last_clean":"2023-11-27T20:44:06.521583+0000","last_became_active":"2023-11-27T20:43:52.739234+0000","last_became_peered":"2023-11-27T20:43:52.739234+0000","last_unstale":"2023-11-27T20:44:06.521583+0000","last_undegraded":"2023-11-27T20:44:06.521583+0000","last_fullsized":"2023-11-27T20:44:06.521583+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:32.431178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524843+0000","last_change":"2023-11-27T20:44:07.524843+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524843+0000","last_undegraded":"2023-11-27T20:44:07.524843+0000","last_fullsized":"2023-11-27T20:44:07.524843+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513010+0000","last_change":"2023-11-27T20:43:52.758309+0000","last_active":"2023-11-27T20:44:06.513010+0000","last_peered":"2023-11-27T20:44:06.513010+0000","last_clean":"2023-11-27T20:44:06.513010+0000","last_became_active":"2023-11-27T20:43:52.755787+0000","last_became_peered":"2023-11-27T20:43:52.755787+0000","last_unstale":"2023-11-27T20:44:06.513010+0000","last_undegraded":"2023-11-27T20:44:06.513010+0000","last_fullsized":"2023-11-27T20:44:06.513010+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.536848+0000","last_change":"2023-11-27T20:44:07.536848+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.536848+0000","last_undegraded":"2023-11-27T20:44:07.536848+0000","last_fullsized":"2023-11-27T20:44:07.536848+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506125+0000","last_change":"2023-11-27T20:43:52.743954+0000","last_active":"2023-11-27T20:44:06.506125+0000","last_peered":"2023-11-27T20:44:06.506125+0000","last_clean":"2023-11-27T20:44:06.506125+0000","last_became_active":"2023-11-27T20:43:52.743696+0000","last_became_peered":"2023-11-27T20:43:52.743696+0000","last_unstale":"2023-11-27T20:44:06.506125+0000","last_undegraded":"2023-11-27T20:44:06.506125+0000","last_fullsized":"2023-11-27T20:44:06.506125+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:35.875636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530894+0000","last_change":"2023-11-27T20:44:07.530894+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530894+0000","last_undegraded":"2023-11-27T20:44:07.530894+0000","last_fullsized":"2023-11-27T20:44:07.530894+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513909+0000","last_change":"2023-11-27T20:43:52.740150+0000","last_active":"2023-11-27T20:44:06.513909+0000","last_peered":"2023-11-27T20:44:06.513909+0000","last_clean":"2023-11-27T20:44:06.513909+0000","last_became_active":"2023-11-27T20:43:52.735557+0000","last_became_peered":"2023-11-27T20:43:52.735557+0000","last_unstale":"2023-11-27T20:44:06.513909+0000","last_undegraded":"2023-11-27T20:44:06.513909+0000","last_fullsized":"2023-11-27T20:44:06.513909+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:26:49.710558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.522867+0000","last_change":"2023-11-27T20:44:07.522867+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.522867+0000","last_undegraded":"2023-11-27T20:44:07.522867+0000","last_fullsized":"2023-11-27T20:44:07.522867+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513742+0000","last_change":"2023-11-27T20:43:52.743341+0000","last_active":"2023-11-27T20:44:06.513742+0000","last_peered":"2023-11-27T20:44:06.513742+0000","last_clean":"2023-11-27T20:44:06.513742+0000","last_became_active":"2023-11-27T20:43:52.742947+0000","last_became_peered":"2023-11-27T20:43:52.742947+0000","last_unstale":"2023-11-27T20:44:06.513742+0000","last_undegraded":"2023-11-27T20:44:06.513742+0000","last_fullsized":"2023-11-27T20:44:06.513742+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:30.595824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525868+0000","last_change":"2023-11-27T20:44:07.525868+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525868+0000","last_undegraded":"2023-11-27T20:44:07.525868+0000","last_fullsized":"2023-11-27T20:44:07.525868+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505911+0000","last_change":"2023-11-27T20:43:52.746463+0000","last_active":"2023-11-27T20:44:06.505911+0000","last_peered":"2023-11-27T20:44:06.505911+0000","last_clean":"2023-11-27T20:44:06.505911+0000","last_became_active":"2023-11-27T20:43:52.746028+0000","last_became_peered":"2023-11-27T20:43:52.746028+0000","last_unstale":"2023-11-27T20:44:06.505911+0000","last_undegraded":"2023-11-27T20:44:06.505911+0000","last_fullsized":"2023-11-27T20:44:06.505911+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:00.873986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.532834+0000","last_change":"2023-11-27T20:44:07.532834+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.532834+0000","last_undegraded":"2023-11-27T20:44:07.532834+0000","last_fullsized":"2023-11-27T20:44:07.532834+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511596+0000","last_change":"2023-11-27T20:43:52.757800+0000","last_active":"2023-11-27T20:44:06.511596+0000","last_peered":"2023-11-27T20:44:06.511596+0000","last_clean":"2023-11-27T20:44:06.511596+0000","last_became_active":"2023-11-27T20:43:52.755994+0000","last_became_peered":"2023-11-27T20:43:52.755994+0000","last_unstale":"2023-11-27T20:44:06.511596+0000","last_undegraded":"2023-11-27T20:44:06.511596+0000","last_fullsized":"2023-11-27T20:44:06.511596+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528764+0000","last_change":"2023-11-27T20:44:07.528764+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528764+0000","last_undegraded":"2023-11-27T20:44:07.528764+0000","last_fullsized":"2023-11-27T20:44:07.528764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.545677+0000","last_change":"2023-11-27T20:44:07.540451+0000","last_active":"2023-11-27T20:44:07.545677+0000","last_peered":"2023-11-27T20:44:07.545677+0000","last_clean":"2023-11-27T20:44:07.545677+0000","last_became_active":"2023-11-27T20:44:07.540140+0000","last_became_peered":"2023-11-27T20:44:07.540140+0000","last_unstale":"2023-11-27T20:44:07.545677+0000","last_undegraded":"2023-11-27T20:44:07.545677+0000","last_fullsized":"2023-11-27T20:44:07.545677+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:34.727698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513103+0000","last_change":"2023-11-27T20:43:52.755932+0000","last_active":"2023-11-27T20:44:06.513103+0000","last_peered":"2023-11-27T20:44:06.513103+0000","last_clean":"2023-11-27T20:44:06.513103+0000","last_became_active":"2023-11-27T20:43:52.751888+0000","last_became_peered":"2023-11-27T20:43:52.751888+0000","last_unstale":"2023-11-27T20:44:06.513103+0000","last_undegraded":"2023-11-27T20:44:06.513103+0000","last_fullsized":"2023-11-27T20:44:06.513103+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:19.340689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513396+0000","last_change":"2023-11-27T20:43:51.704982+0000","last_active":"2023-11-27T20:44:06.513396+0000","last_peered":"2023-11-27T20:44:06.513396+0000","last_clean":"2023-11-27T20:44:06.513396+0000","last_became_active":"2023-11-27T20:43:51.703346+0000","last_became_peered":"2023-11-27T20:43:51.703346+0000","last_unstale":"2023-11-27T20:44:06.513396+0000","last_undegraded":"2023-11-27T20:44:06.513396+0000","last_fullsized":"2023-11-27T20:44:06.513396+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:53.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539753+0000","last_change":"2023-11-27T20:44:07.539753+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539753+0000","last_undegraded":"2023-11-27T20:44:07.539753+0000","last_fullsized":"2023-11-27T20:44:07.539753+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.551999+0000","last_change":"2023-11-27T20:44:07.548707+0000","last_active":"2023-11-27T20:44:07.551999+0000","last_peered":"2023-11-27T20:44:07.551999+0000","last_clean":"2023-11-27T20:44:07.551999+0000","last_became_active":"2023-11-27T20:44:07.544542+0000","last_became_peered":"2023-11-27T20:44:07.544542+0000","last_unstale":"2023-11-27T20:44:07.551999+0000","last_undegraded":"2023-11-27T20:44:07.551999+0000","last_fullsized":"2023-11-27T20:44:07.551999+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:08.453722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500681+0000","last_change":"2023-11-27T20:43:52.736197+0000","last_active":"2023-11-27T20:44:06.500681+0000","last_peered":"2023-11-27T20:44:06.500681+0000","last_clean":"2023-11-27T20:44:06.500681+0000","last_became_active":"2023-11-27T20:43:52.735889+0000","last_became_peered":"2023-11-27T20:43:52.735889+0000","last_unstale":"2023-11-27T20:44:06.500681+0000","last_undegraded":"2023-11-27T20:44:06.500681+0000","last_fullsized":"2023-11-27T20:44:06.500681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:46.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514100+0000","last_change":"2023-11-27T20:43:51.711368+0000","last_active":"2023-11-27T20:44:06.514100+0000","last_peered":"2023-11-27T20:44:06.514100+0000","last_clean":"2023-11-27T20:44:06.514100+0000","last_became_active":"2023-11-27T20:43:51.711087+0000","last_became_peered":"2023-11-27T20:43:51.711087+0000","last_unstale":"2023-11-27T20:44:06.514100+0000","last_undegraded":"2023-11-27T20:44:06.514100+0000","last_fullsized":"2023-11-27T20:44:06.514100+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:54.352803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.536855+0000","last_change":"2023-11-27T20:44:07.536855+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.536855+0000","last_undegraded":"2023-11-27T20:44:07.536855+0000","last_fullsized":"2023-11-27T20:44:07.536855+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.556568+0000","last_change":"2023-11-27T20:44:07.554191+0000","last_active":"2023-11-27T20:44:07.556568+0000","last_peered":"2023-11-27T20:44:07.556568+0000","last_clean":"2023-11-27T20:44:07.556568+0000","last_became_active":"2023-11-27T20:44:07.553915+0000","last_became_peered":"2023-11-27T20:44:07.553915+0000","last_unstale":"2023-11-27T20:44:07.556568+0000","last_undegraded":"2023-11-27T20:44:07.556568+0000","last_fullsized":"2023-11-27T20:44:07.556568+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:50.983600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512394+0000","last_change":"2023-11-27T20:43:52.759667+0000","last_active":"2023-11-27T20:44:06.512394+0000","last_peered":"2023-11-27T20:44:06.512394+0000","last_clean":"2023-11-27T20:44:06.512394+0000","last_became_active":"2023-11-27T20:43:52.759386+0000","last_became_peered":"2023-11-27T20:43:52.759386+0000","last_unstale":"2023-11-27T20:44:06.512394+0000","last_undegraded":"2023-11-27T20:44:06.512394+0000","last_fullsized":"2023-11-27T20:44:06.512394+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513309+0000","last_change":"2023-11-27T20:43:51.699372+0000","last_active":"2023-11-27T20:44:06.513309+0000","last_peered":"2023-11-27T20:44:06.513309+0000","last_clean":"2023-11-27T20:44:06.513309+0000","last_became_active":"2023-11-27T20:43:51.698989+0000","last_became_peered":"2023-11-27T20:43:51.698989+0000","last_unstale":"2023-11-27T20:44:06.513309+0000","last_undegraded":"2023-11-27T20:44:06.513309+0000","last_fullsized":"2023-11-27T20:44:06.513309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:29.612413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527825+0000","last_change":"2023-11-27T20:44:07.527825+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527825+0000","last_undegraded":"2023-11-27T20:44:07.527825+0000","last_fullsized":"2023-11-27T20:44:07.527825+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.544789+0000","last_change":"2023-11-27T20:44:07.543034+0000","last_active":"2023-11-27T20:44:07.544789+0000","last_peered":"2023-11-27T20:44:07.544789+0000","last_clean":"2023-11-27T20:44:07.544789+0000","last_became_active":"2023-11-27T20:44:07.542752+0000","last_became_peered":"2023-11-27T20:44:07.542752+0000","last_unstale":"2023-11-27T20:44:07.544789+0000","last_undegraded":"2023-11-27T20:44:07.544789+0000","last_fullsized":"2023-11-27T20:44:07.544789+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:10.575183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513504+0000","last_change":"2023-11-27T20:43:52.746554+0000","last_active":"2023-11-27T20:44:06.513504+0000","last_peered":"2023-11-27T20:44:06.513504+0000","last_clean":"2023-11-27T20:44:06.513504+0000","last_became_active":"2023-11-27T20:43:52.746133+0000","last_became_peered":"2023-11-27T20:43:52.746133+0000","last_unstale":"2023-11-27T20:44:06.513504+0000","last_undegraded":"2023-11-27T20:44:06.513504+0000","last_fullsized":"2023-11-27T20:44:06.513504+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:55.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521352+0000","last_change":"2023-11-27T20:43:51.707254+0000","last_active":"2023-11-27T20:44:06.521352+0000","last_peered":"2023-11-27T20:44:06.521352+0000","last_clean":"2023-11-27T20:44:06.521352+0000","last_became_active":"2023-11-27T20:43:51.706908+0000","last_became_peered":"2023-11-27T20:43:51.706908+0000","last_unstale":"2023-11-27T20:44:06.521352+0000","last_undegraded":"2023-11-27T20:44:06.521352+0000","last_fullsized":"2023-11-27T20:44:06.521352+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:04.233780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526427+0000","last_change":"2023-11-27T20:44:07.526427+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526427+0000","last_undegraded":"2023-11-27T20:44:07.526427+0000","last_fullsized":"2023-11-27T20:44:07.526427+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.539459+0000","last_change":"2023-11-27T20:44:07.535849+0000","last_active":"2023-11-27T20:44:07.539459+0000","last_peered":"2023-11-27T20:44:07.539459+0000","last_clean":"2023-11-27T20:44:07.539459+0000","last_became_active":"2023-11-27T20:44:07.535564+0000","last_became_peered":"2023-11-27T20:44:07.535564+0000","last_unstale":"2023-11-27T20:44:07.539459+0000","last_undegraded":"2023-11-27T20:44:07.539459+0000","last_fullsized":"2023-11-27T20:44:07.539459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:29.891814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511441+0000","last_change":"2023-11-27T20:43:52.734666+0000","last_active":"2023-11-27T20:44:06.511441+0000","last_peered":"2023-11-27T20:44:06.511441+0000","last_clean":"2023-11-27T20:44:06.511441+0000","last_became_active":"2023-11-27T20:43:52.733983+0000","last_became_peered":"2023-11-27T20:43:52.733983+0000","last_unstale":"2023-11-27T20:44:06.511441+0000","last_undegraded":"2023-11-27T20:44:06.511441+0000","last_fullsized":"2023-11-27T20:44:06.511441+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:55.762089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507244+0000","last_change":"2023-11-27T20:43:51.711467+0000","last_active":"2023-11-27T20:44:06.507244+0000","last_peered":"2023-11-27T20:44:06.507244+0000","last_clean":"2023-11-27T20:44:06.507244+0000","last_became_active":"2023-11-27T20:43:51.711141+0000","last_became_peered":"2023-11-27T20:43:51.711141+0000","last_unstale":"2023-11-27T20:44:06.507244+0000","last_undegraded":"2023-11-27T20:44:06.507244+0000","last_fullsized":"2023-11-27T20:44:06.507244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:14.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530389+0000","last_change":"2023-11-27T20:44:07.530389+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530389+0000","last_undegraded":"2023-11-27T20:44:07.530389+0000","last_fullsized":"2023-11-27T20:44:07.530389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547796+0000","last_change":"2023-11-27T20:44:07.546578+0000","last_active":"2023-11-27T20:44:07.547796+0000","last_peered":"2023-11-27T20:44:07.547796+0000","last_clean":"2023-11-27T20:44:07.547796+0000","last_became_active":"2023-11-27T20:44:07.545547+0000","last_became_peered":"2023-11-27T20:44:07.545547+0000","last_unstale":"2023-11-27T20:44:07.547796+0000","last_undegraded":"2023-11-27T20:44:07.547796+0000","last_fullsized":"2023-11-27T20:44:07.547796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:55.426778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513740+0000","last_change":"2023-11-27T20:43:52.740355+0000","last_active":"2023-11-27T20:44:06.513740+0000","last_peered":"2023-11-27T20:44:06.513740+0000","last_clean":"2023-11-27T20:44:06.513740+0000","last_became_active":"2023-11-27T20:43:52.739879+0000","last_became_peered":"2023-11-27T20:43:52.739879+0000","last_unstale":"2023-11-27T20:44:06.513740+0000","last_undegraded":"2023-11-27T20:44:06.513740+0000","last_fullsized":"2023-11-27T20:44:06.513740+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:08:26.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511517+0000","last_change":"2023-11-27T20:43:51.701819+0000","last_active":"2023-11-27T20:44:06.511517+0000","last_peered":"2023-11-27T20:44:06.511517+0000","last_clean":"2023-11-27T20:44:06.511517+0000","last_became_active":"2023-11-27T20:43:51.701542+0000","last_became_peered":"2023-11-27T20:43:51.701542+0000","last_unstale":"2023-11-27T20:44:06.511517+0000","last_undegraded":"2023-11-27T20:44:06.511517+0000","last_fullsized":"2023-11-27T20:44:06.511517+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:53.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529870+0000","last_change":"2023-11-27T20:44:07.529870+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529870+0000","last_undegraded":"2023-11-27T20:44:07.529870+0000","last_fullsized":"2023-11-27T20:44:07.529870+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.544729+0000","last_change":"2023-11-27T20:44:07.538342+0000","last_active":"2023-11-27T20:44:07.544729+0000","last_peered":"2023-11-27T20:44:07.544729+0000","last_clean":"2023-11-27T20:44:07.544729+0000","last_became_active":"2023-11-27T20:44:07.538037+0000","last_became_peered":"2023-11-27T20:44:07.538037+0000","last_unstale":"2023-11-27T20:44:07.544729+0000","last_undegraded":"2023-11-27T20:44:07.544729+0000","last_fullsized":"2023-11-27T20:44:07.544729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:29:08.542478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515412+0000","last_change":"2023-11-27T20:43:52.735677+0000","last_active":"2023-11-27T20:44:06.515412+0000","last_peered":"2023-11-27T20:44:06.515412+0000","last_clean":"2023-11-27T20:44:06.515412+0000","last_became_active":"2023-11-27T20:43:52.734624+0000","last_became_peered":"2023-11-27T20:43:52.734624+0000","last_unstale":"2023-11-27T20:44:06.515412+0000","last_undegraded":"2023-11-27T20:44:06.515412+0000","last_fullsized":"2023-11-27T20:44:06.515412+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:42.798849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519354+0000","last_change":"2023-11-27T20:43:51.706490+0000","last_active":"2023-11-27T20:44:06.519354+0000","last_peered":"2023-11-27T20:44:06.519354+0000","last_clean":"2023-11-27T20:44:06.519354+0000","last_became_active":"2023-11-27T20:43:51.706181+0000","last_became_peered":"2023-11-27T20:43:51.706181+0000","last_unstale":"2023-11-27T20:44:06.519354+0000","last_undegraded":"2023-11-27T20:44:06.519354+0000","last_fullsized":"2023-11-27T20:44:06.519354+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:41.580304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523700+0000","last_change":"2023-11-27T20:44:07.523700+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523700+0000","last_undegraded":"2023-11-27T20:44:07.523700+0000","last_fullsized":"2023-11-27T20:44:07.523700+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.548497+0000","last_change":"2023-11-27T20:44:07.543638+0000","last_active":"2023-11-27T20:44:07.548497+0000","last_peered":"2023-11-27T20:44:07.548497+0000","last_clean":"2023-11-27T20:44:07.548497+0000","last_became_active":"2023-11-27T20:44:07.543049+0000","last_became_peered":"2023-11-27T20:44:07.543049+0000","last_unstale":"2023-11-27T20:44:07.548497+0000","last_undegraded":"2023-11-27T20:44:07.548497+0000","last_fullsized":"2023-11-27T20:44:07.548497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:38.215762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511164+0000","last_change":"2023-11-27T20:43:52.732611+0000","last_active":"2023-11-27T20:44:06.511164+0000","last_peered":"2023-11-27T20:44:06.511164+0000","last_clean":"2023-11-27T20:44:06.511164+0000","last_became_active":"2023-11-27T20:43:52.732338+0000","last_became_peered":"2023-11-27T20:43:52.732338+0000","last_unstale":"2023-11-27T20:44:06.511164+0000","last_undegraded":"2023-11-27T20:44:06.511164+0000","last_fullsized":"2023-11-27T20:44:06.511164+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:36.170506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506363+0000","last_change":"2023-11-27T20:43:51.712506+0000","last_active":"2023-11-27T20:44:06.506363+0000","last_peered":"2023-11-27T20:44:06.506363+0000","last_clean":"2023-11-27T20:44:06.506363+0000","last_became_active":"2023-11-27T20:43:51.712167+0000","last_became_peered":"2023-11-27T20:43:51.712167+0000","last_unstale":"2023-11-27T20:44:06.506363+0000","last_undegraded":"2023-11-27T20:44:06.506363+0000","last_fullsized":"2023-11-27T20:44:06.506363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:20.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528088+0000","last_change":"2023-11-27T20:44:07.528088+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528088+0000","last_undegraded":"2023-11-27T20:44:07.528088+0000","last_fullsized":"2023-11-27T20:44:07.528088+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547939+0000","last_change":"2023-11-27T20:44:07.541198+0000","last_active":"2023-11-27T20:44:07.547939+0000","last_peered":"2023-11-27T20:44:07.547939+0000","last_clean":"2023-11-27T20:44:07.547939+0000","last_became_active":"2023-11-27T20:44:07.540715+0000","last_became_peered":"2023-11-27T20:44:07.540715+0000","last_unstale":"2023-11-27T20:44:07.547939+0000","last_undegraded":"2023-11-27T20:44:07.547939+0000","last_fullsized":"2023-11-27T20:44:07.547939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:33:36.245172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.509400+0000","last_change":"2023-11-27T20:43:52.743697+0000","last_active":"2023-11-27T20:44:06.509400+0000","last_peered":"2023-11-27T20:44:06.509400+0000","last_clean":"2023-11-27T20:44:06.509400+0000","last_became_active":"2023-11-27T20:43:52.743405+0000","last_became_peered":"2023-11-27T20:43:52.743405+0000","last_unstale":"2023-11-27T20:44:06.509400+0000","last_undegraded":"2023-11-27T20:44:06.509400+0000","last_fullsized":"2023-11-27T20:44:06.509400+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519933+0000","last_change":"2023-11-27T20:43:51.716942+0000","last_active":"2023-11-27T20:44:06.519933+0000","last_peered":"2023-11-27T20:44:06.519933+0000","last_clean":"2023-11-27T20:44:06.519933+0000","last_became_active":"2023-11-27T20:43:51.716549+0000","last_became_peered":"2023-11-27T20:43:51.716549+0000","last_unstale":"2023-11-27T20:44:06.519933+0000","last_undegraded":"2023-11-27T20:44:06.519933+0000","last_fullsized":"2023-11-27T20:44:06.519933+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529398+0000","last_change":"2023-11-27T20:44:07.529398+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529398+0000","last_undegraded":"2023-11-27T20:44:07.529398+0000","last_fullsized":"2023-11-27T20:44:07.529398+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.543312+0000","last_change":"2023-11-27T20:44:07.540741+0000","last_active":"2023-11-27T20:44:07.543312+0000","last_peered":"2023-11-27T20:44:07.543312+0000","last_clean":"2023-11-27T20:44:07.543312+0000","last_became_active":"2023-11-27T20:44:07.540459+0000","last_became_peered":"2023-11-27T20:44:07.540459+0000","last_unstale":"2023-11-27T20:44:07.543312+0000","last_undegraded":"2023-11-27T20:44:07.543312+0000","last_fullsized":"2023-11-27T20:44:07.543312+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:38.215762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519822+0000","last_change":"2023-11-27T20:43:52.747269+0000","last_active":"2023-11-27T20:44:06.519822+0000","last_peered":"2023-11-27T20:44:06.519822+0000","last_clean":"2023-11-27T20:44:06.519822+0000","last_became_active":"2023-11-27T20:43:52.746473+0000","last_became_peered":"2023-11-27T20:43:52.746473+0000","last_unstale":"2023-11-27T20:44:06.519822+0000","last_undegraded":"2023-11-27T20:44:06.519822+0000","last_fullsized":"2023-11-27T20:44:06.519822+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:55.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514190+0000","last_change":"2023-11-27T20:43:51.711346+0000","last_active":"2023-11-27T20:44:06.514190+0000","last_peered":"2023-11-27T20:44:06.514190+0000","last_clean":"2023-11-27T20:44:06.514190+0000","last_became_active":"2023-11-27T20:43:51.711060+0000","last_became_peered":"2023-11-27T20:43:51.711060+0000","last_unstale":"2023-11-27T20:44:06.514190+0000","last_undegraded":"2023-11-27T20:44:06.514190+0000","last_fullsized":"2023-11-27T20:44:06.514190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:18.330525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531925+0000","last_change":"2023-11-27T20:44:07.531925+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531925+0000","last_undegraded":"2023-11-27T20:44:07.531925+0000","last_fullsized":"2023-11-27T20:44:07.531925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.541276+0000","last_change":"2023-11-27T20:44:07.537248+0000","last_active":"2023-11-27T20:44:07.541276+0000","last_peered":"2023-11-27T20:44:07.541276+0000","last_clean":"2023-11-27T20:44:07.541276+0000","last_became_active":"2023-11-27T20:44:07.535963+0000","last_became_peered":"2023-11-27T20:44:07.535963+0000","last_unstale":"2023-11-27T20:44:07.541276+0000","last_undegraded":"2023-11-27T20:44:07.541276+0000","last_fullsized":"2023-11-27T20:44:07.541276+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:43.756684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500291+0000","last_change":"2023-11-27T20:43:52.738413+0000","last_active":"2023-11-27T20:44:06.500291+0000","last_peered":"2023-11-27T20:44:06.500291+0000","last_clean":"2023-11-27T20:44:06.500291+0000","last_became_active":"2023-11-27T20:43:52.738105+0000","last_became_peered":"2023-11-27T20:43:52.738105+0000","last_unstale":"2023-11-27T20:44:06.500291+0000","last_undegraded":"2023-11-27T20:44:06.500291+0000","last_fullsized":"2023-11-27T20:44:06.500291+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:00.871014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518398+0000","last_change":"2023-11-27T20:43:51.716907+0000","last_active":"2023-11-27T20:44:06.518398+0000","last_peered":"2023-11-27T20:44:06.518398+0000","last_clean":"2023-11-27T20:44:06.518398+0000","last_became_active":"2023-11-27T20:43:51.716616+0000","last_became_peered":"2023-11-27T20:43:51.716616+0000","last_unstale":"2023-11-27T20:44:06.518398+0000","last_undegraded":"2023-11-27T20:44:06.518398+0000","last_fullsized":"2023-11-27T20:44:06.518398+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.538067+0000","last_change":"2023-11-27T20:44:07.538067+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.538067+0000","last_undegraded":"2023-11-27T20:44:07.538067+0000","last_fullsized":"2023-11-27T20:44:07.538067+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.556080+0000","last_change":"2023-11-27T20:44:07.553474+0000","last_active":"2023-11-27T20:44:07.556080+0000","last_peered":"2023-11-27T20:44:07.556080+0000","last_clean":"2023-11-27T20:44:07.556080+0000","last_became_active":"2023-11-27T20:44:07.553184+0000","last_became_peered":"2023-11-27T20:44:07.553184+0000","last_unstale":"2023-11-27T20:44:07.556080+0000","last_undegraded":"2023-11-27T20:44:07.556080+0000","last_fullsized":"2023-11-27T20:44:07.556080+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:21.070349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517989+0000","last_change":"2023-11-27T20:43:52.740853+0000","last_active":"2023-11-27T20:44:06.517989+0000","last_peered":"2023-11-27T20:44:06.517989+0000","last_clean":"2023-11-27T20:44:06.517989+0000","last_became_active":"2023-11-27T20:43:52.740468+0000","last_became_peered":"2023-11-27T20:43:52.740468+0000","last_unstale":"2023-11-27T20:44:06.517989+0000","last_undegraded":"2023-11-27T20:44:06.517989+0000","last_fullsized":"2023-11-27T20:44:06.517989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'8","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.508060+0000","last_change":"2023-11-27T20:43:51.711651+0000","last_active":"2023-11-27T20:44:06.508060+0000","last_peered":"2023-11-27T20:44:06.508060+0000","last_clean":"2023-11-27T20:44:06.508060+0000","last_became_active":"2023-11-27T20:43:51.711270+0000","last_became_peered":"2023-11-27T20:43:51.711270+0000","last_unstale":"2023-11-27T20:44:06.508060+0000","last_undegraded":"2023-11-27T20:44:06.508060+0000","last_fullsized":"2023-11-27T20:44:06.508060+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:07.560276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.532546+0000","last_change":"2023-11-27T20:44:07.532546+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.532546+0000","last_undegraded":"2023-11-27T20:44:07.532546+0000","last_fullsized":"2023-11-27T20:44:07.532546+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552434+0000","last_change":"2023-11-27T20:44:07.550573+0000","last_active":"2023-11-27T20:44:07.552434+0000","last_peered":"2023-11-27T20:44:07.552434+0000","last_clean":"2023-11-27T20:44:07.552434+0000","last_became_active":"2023-11-27T20:44:07.549497+0000","last_became_peered":"2023-11-27T20:44:07.549497+0000","last_unstale":"2023-11-27T20:44:07.552434+0000","last_undegraded":"2023-11-27T20:44:07.552434+0000","last_fullsized":"2023-11-27T20:44:07.552434+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:17.251945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517767+0000","last_change":"2023-11-27T20:43:52.731258+0000","last_active":"2023-11-27T20:44:06.517767+0000","last_peered":"2023-11-27T20:44:06.517767+0000","last_clean":"2023-11-27T20:44:06.517767+0000","last_became_active":"2023-11-27T20:43:52.730701+0000","last_became_peered":"2023-11-27T20:43:52.730701+0000","last_unstale":"2023-11-27T20:44:06.517767+0000","last_undegraded":"2023-11-27T20:44:06.517767+0000","last_fullsized":"2023-11-27T20:44:06.517767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:28.943589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513829+0000","last_change":"2023-11-27T20:43:51.709141+0000","last_active":"2023-11-27T20:44:06.513829+0000","last_peered":"2023-11-27T20:44:06.513829+0000","last_clean":"2023-11-27T20:44:06.513829+0000","last_became_active":"2023-11-27T20:43:51.708864+0000","last_became_peered":"2023-11-27T20:43:51.708864+0000","last_unstale":"2023-11-27T20:44:06.513829+0000","last_undegraded":"2023-11-27T20:44:06.513829+0000","last_fullsized":"2023-11-27T20:44:06.513829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:29.585661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531534+0000","last_change":"2023-11-27T20:44:07.531534+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531534+0000","last_undegraded":"2023-11-27T20:44:07.531534+0000","last_fullsized":"2023-11-27T20:44:07.531534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.555776+0000","last_change":"2023-11-27T20:44:07.553337+0000","last_active":"2023-11-27T20:44:07.555776+0000","last_peered":"2023-11-27T20:44:07.555776+0000","last_clean":"2023-11-27T20:44:07.555776+0000","last_became_active":"2023-11-27T20:44:07.552962+0000","last_became_peered":"2023-11-27T20:44:07.552962+0000","last_unstale":"2023-11-27T20:44:07.555776+0000","last_undegraded":"2023-11-27T20:44:07.555776+0000","last_fullsized":"2023-11-27T20:44:07.555776+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:16:09.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516879+0000","last_change":"2023-11-27T20:43:52.736912+0000","last_active":"2023-11-27T20:44:06.516879+0000","last_peered":"2023-11-27T20:44:06.516879+0000","last_clean":"2023-11-27T20:44:06.516879+0000","last_became_active":"2023-11-27T20:43:52.735675+0000","last_became_peered":"2023-11-27T20:43:52.735675+0000","last_unstale":"2023-11-27T20:44:06.516879+0000","last_undegraded":"2023-11-27T20:44:06.516879+0000","last_fullsized":"2023-11-27T20:44:06.516879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517569+0000","last_change":"2023-11-27T20:43:51.711938+0000","last_active":"2023-11-27T20:44:06.517569+0000","last_peered":"2023-11-27T20:44:06.517569+0000","last_clean":"2023-11-27T20:44:06.517569+0000","last_became_active":"2023-11-27T20:43:51.711617+0000","last_became_peered":"2023-11-27T20:43:51.711617+0000","last_unstale":"2023-11-27T20:44:06.517569+0000","last_undegraded":"2023-11-27T20:44:06.517569+0000","last_fullsized":"2023-11-27T20:44:06.517569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:54.146026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537759+0000","last_change":"2023-11-27T20:44:07.537759+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537759+0000","last_undegraded":"2023-11-27T20:44:07.537759+0000","last_fullsized":"2023-11-27T20:44:07.537759+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.553685+0000","last_change":"2023-11-27T20:44:07.550581+0000","last_active":"2023-11-27T20:44:07.553685+0000","last_peered":"2023-11-27T20:44:07.553685+0000","last_clean":"2023-11-27T20:44:07.553685+0000","last_became_active":"2023-11-27T20:44:07.549832+0000","last_became_peered":"2023-11-27T20:44:07.549832+0000","last_unstale":"2023-11-27T20:44:07.553685+0000","last_undegraded":"2023-11-27T20:44:07.553685+0000","last_fullsized":"2023-11-27T20:44:07.553685+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:32.588898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506128+0000","last_change":"2023-11-27T20:43:52.742672+0000","last_active":"2023-11-27T20:44:06.506128+0000","last_peered":"2023-11-27T20:44:06.506128+0000","last_clean":"2023-11-27T20:44:06.506128+0000","last_became_active":"2023-11-27T20:43:52.742066+0000","last_became_peered":"2023-11-27T20:43:52.742066+0000","last_unstale":"2023-11-27T20:44:06.506128+0000","last_undegraded":"2023-11-27T20:44:06.506128+0000","last_fullsized":"2023-11-27T20:44:06.506128+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:01.982839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519493+0000","last_change":"2023-11-27T20:43:51.711077+0000","last_active":"2023-11-27T20:44:06.519493+0000","last_peered":"2023-11-27T20:44:06.519493+0000","last_clean":"2023-11-27T20:44:06.519493+0000","last_became_active":"2023-11-27T20:43:51.710820+0000","last_became_peered":"2023-11-27T20:43:51.710820+0000","last_unstale":"2023-11-27T20:44:06.519493+0000","last_undegraded":"2023-11-27T20:44:06.519493+0000","last_fullsized":"2023-11-27T20:44:06.519493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:21.429946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529666+0000","last_change":"2023-11-27T20:44:07.529666+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529666+0000","last_undegraded":"2023-11-27T20:44:07.529666+0000","last_fullsized":"2023-11-27T20:44:07.529666+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.549409+0000","last_change":"2023-11-27T20:44:07.547343+0000","last_active":"2023-11-27T20:44:07.549409+0000","last_peered":"2023-11-27T20:44:07.549409+0000","last_clean":"2023-11-27T20:44:07.549409+0000","last_became_active":"2023-11-27T20:44:07.547004+0000","last_became_peered":"2023-11-27T20:44:07.547004+0000","last_unstale":"2023-11-27T20:44:07.549409+0000","last_undegraded":"2023-11-27T20:44:07.549409+0000","last_fullsized":"2023-11-27T20:44:07.549409+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:32.700621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518818+0000","last_change":"2023-11-27T20:43:52.742494+0000","last_active":"2023-11-27T20:44:06.518818+0000","last_peered":"2023-11-27T20:44:06.518818+0000","last_clean":"2023-11-27T20:44:06.518818+0000","last_became_active":"2023-11-27T20:43:52.742174+0000","last_became_peered":"2023-11-27T20:43:52.742174+0000","last_unstale":"2023-11-27T20:44:06.518818+0000","last_undegraded":"2023-11-27T20:44:06.518818+0000","last_fullsized":"2023-11-27T20:44:06.518818+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515344+0000","last_change":"2023-11-27T20:43:51.714679+0000","last_active":"2023-11-27T20:44:06.515344+0000","last_peered":"2023-11-27T20:44:06.515344+0000","last_clean":"2023-11-27T20:44:06.515344+0000","last_became_active":"2023-11-27T20:43:51.714406+0000","last_became_peered":"2023-11-27T20:43:51.714406+0000","last_unstale":"2023-11-27T20:44:06.515344+0000","last_undegraded":"2023-11-27T20:44:06.515344+0000","last_fullsized":"2023-11-27T20:44:06.515344+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:27.933426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530632+0000","last_change":"2023-11-27T20:44:07.530632+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530632+0000","last_undegraded":"2023-11-27T20:44:07.530632+0000","last_fullsized":"2023-11-27T20:44:07.530632+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.548455+0000","last_change":"2023-11-27T20:44:07.544501+0000","last_active":"2023-11-27T20:44:07.548455+0000","last_peered":"2023-11-27T20:44:07.548455+0000","last_clean":"2023-11-27T20:44:07.548455+0000","last_became_active":"2023-11-27T20:44:07.542118+0000","last_became_peered":"2023-11-27T20:44:07.542118+0000","last_unstale":"2023-11-27T20:44:07.548455+0000","last_undegraded":"2023-11-27T20:44:07.548455+0000","last_fullsized":"2023-11-27T20:44:07.548455+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:23.383534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519295+0000","last_change":"2023-11-27T20:43:52.743633+0000","last_active":"2023-11-27T20:44:06.519295+0000","last_peered":"2023-11-27T20:44:06.519295+0000","last_clean":"2023-11-27T20:44:06.519295+0000","last_became_active":"2023-11-27T20:43:52.743243+0000","last_became_peered":"2023-11-27T20:43:52.743243+0000","last_unstale":"2023-11-27T20:44:06.519295+0000","last_undegraded":"2023-11-27T20:44:06.519295+0000","last_fullsized":"2023-11-27T20:44:06.519295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514358+0000","last_change":"2023-11-27T20:43:51.714371+0000","last_active":"2023-11-27T20:44:06.514358+0000","last_peered":"2023-11-27T20:44:06.514358+0000","last_clean":"2023-11-27T20:44:06.514358+0000","last_became_active":"2023-11-27T20:43:51.714034+0000","last_became_peered":"2023-11-27T20:43:51.714034+0000","last_unstale":"2023-11-27T20:44:06.514358+0000","last_undegraded":"2023-11-27T20:44:06.514358+0000","last_fullsized":"2023-11-27T20:44:06.514358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528667+0000","last_change":"2023-11-27T20:44:07.528667+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528667+0000","last_undegraded":"2023-11-27T20:44:07.528667+0000","last_fullsized":"2023-11-27T20:44:07.528667+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.555914+0000","last_change":"2023-11-27T20:44:07.552420+0000","last_active":"2023-11-27T20:44:07.555914+0000","last_peered":"2023-11-27T20:44:07.555914+0000","last_clean":"2023-11-27T20:44:07.555914+0000","last_became_active":"2023-11-27T20:44:07.552130+0000","last_became_peered":"2023-11-27T20:44:07.552130+0000","last_unstale":"2023-11-27T20:44:07.555914+0000","last_undegraded":"2023-11-27T20:44:07.555914+0000","last_fullsized":"2023-11-27T20:44:07.555914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:48.971506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521884+0000","last_change":"2023-11-27T20:43:52.741261+0000","last_active":"2023-11-27T20:44:06.521884+0000","last_peered":"2023-11-27T20:44:06.521884+0000","last_clean":"2023-11-27T20:44:06.521884+0000","last_became_active":"2023-11-27T20:43:52.740962+0000","last_became_peered":"2023-11-27T20:43:52.740962+0000","last_unstale":"2023-11-27T20:44:06.521884+0000","last_undegraded":"2023-11-27T20:44:06.521884+0000","last_fullsized":"2023-11-27T20:44:06.521884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513200+0000","last_change":"2023-11-27T20:43:51.708347+0000","last_active":"2023-11-27T20:44:06.513200+0000","last_peered":"2023-11-27T20:44:06.513200+0000","last_clean":"2023-11-27T20:44:06.513200+0000","last_became_active":"2023-11-27T20:43:51.707976+0000","last_became_peered":"2023-11-27T20:43:51.707976+0000","last_unstale":"2023-11-27T20:44:06.513200+0000","last_undegraded":"2023-11-27T20:44:06.513200+0000","last_fullsized":"2023-11-27T20:44:06.513200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523039+0000","last_change":"2023-11-27T20:44:07.523039+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523039+0000","last_undegraded":"2023-11-27T20:44:07.523039+0000","last_fullsized":"2023-11-27T20:44:07.523039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552454+0000","last_change":"2023-11-27T20:44:07.551592+0000","last_active":"2023-11-27T20:44:07.552454+0000","last_peered":"2023-11-27T20:44:07.552454+0000","last_clean":"2023-11-27T20:44:07.552454+0000","last_became_active":"2023-11-27T20:44:07.546829+0000","last_became_peered":"2023-11-27T20:44:07.546829+0000","last_unstale":"2023-11-27T20:44:07.552454+0000","last_undegraded":"2023-11-27T20:44:07.552454+0000","last_fullsized":"2023-11-27T20:44:07.552454+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:16.795933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513832+0000","last_change":"2023-11-27T20:43:52.740074+0000","last_active":"2023-11-27T20:44:06.513832+0000","last_peered":"2023-11-27T20:44:06.513832+0000","last_clean":"2023-11-27T20:44:06.513832+0000","last_became_active":"2023-11-27T20:43:52.739760+0000","last_became_peered":"2023-11-27T20:43:52.739760+0000","last_unstale":"2023-11-27T20:44:06.513832+0000","last_undegraded":"2023-11-27T20:44:06.513832+0000","last_fullsized":"2023-11-27T20:44:06.513832+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:48:56.029031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521593+0000","last_change":"2023-11-27T20:43:51.707359+0000","last_active":"2023-11-27T20:44:06.521593+0000","last_peered":"2023-11-27T20:44:06.521593+0000","last_clean":"2023-11-27T20:44:06.521593+0000","last_became_active":"2023-11-27T20:43:51.707036+0000","last_became_peered":"2023-11-27T20:43:51.707036+0000","last_unstale":"2023-11-27T20:44:06.521593+0000","last_undegraded":"2023-11-27T20:44:06.521593+0000","last_fullsized":"2023-11-27T20:44:06.521593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537488+0000","last_change":"2023-11-27T20:44:07.537488+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537488+0000","last_undegraded":"2023-11-27T20:44:07.537488+0000","last_fullsized":"2023-11-27T20:44:07.537488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547197+0000","last_change":"2023-11-27T20:44:07.542732+0000","last_active":"2023-11-27T20:44:07.547197+0000","last_peered":"2023-11-27T20:44:07.547197+0000","last_clean":"2023-11-27T20:44:07.547197+0000","last_became_active":"2023-11-27T20:44:07.542131+0000","last_became_peered":"2023-11-27T20:44:07.542131+0000","last_unstale":"2023-11-27T20:44:07.547197+0000","last_undegraded":"2023-11-27T20:44:07.547197+0000","last_fullsized":"2023-11-27T20:44:07.547197+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:47.244273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518144+0000","last_change":"2023-11-27T20:43:52.749840+0000","last_active":"2023-11-27T20:44:06.518144+0000","last_peered":"2023-11-27T20:44:06.518144+0000","last_clean":"2023-11-27T20:44:06.518144+0000","last_became_active":"2023-11-27T20:43:52.749390+0000","last_became_peered":"2023-11-27T20:43:52.749390+0000","last_unstale":"2023-11-27T20:44:06.518144+0000","last_undegraded":"2023-11-27T20:44:06.518144+0000","last_fullsized":"2023-11-27T20:44:06.518144+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512519+0000","last_change":"2023-11-27T20:43:51.704467+0000","last_active":"2023-11-27T20:44:06.512519+0000","last_peered":"2023-11-27T20:44:06.512519+0000","last_clean":"2023-11-27T20:44:06.512519+0000","last_became_active":"2023-11-27T20:43:51.704172+0000","last_became_peered":"2023-11-27T20:43:51.704172+0000","last_unstale":"2023-11-27T20:44:06.512519+0000","last_undegraded":"2023-11-27T20:44:06.512519+0000","last_fullsized":"2023-11-27T20:44:06.512519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:44.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524398+0000","last_change":"2023-11-27T20:44:07.524398+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524398+0000","last_undegraded":"2023-11-27T20:44:07.524398+0000","last_fullsized":"2023-11-27T20:44:07.524398+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552575+0000","last_change":"2023-11-27T20:44:07.551204+0000","last_active":"2023-11-27T20:44:07.552575+0000","last_peered":"2023-11-27T20:44:07.552575+0000","last_clean":"2023-11-27T20:44:07.552575+0000","last_became_active":"2023-11-27T20:44:07.550936+0000","last_became_peered":"2023-11-27T20:44:07.550936+0000","last_unstale":"2023-11-27T20:44:07.552575+0000","last_undegraded":"2023-11-27T20:44:07.552575+0000","last_fullsized":"2023-11-27T20:44:07.552575+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:17:14.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517804+0000","last_change":"2023-11-27T20:43:52.730278+0000","last_active":"2023-11-27T20:44:06.517804+0000","last_peered":"2023-11-27T20:44:06.517804+0000","last_clean":"2023-11-27T20:44:06.517804+0000","last_became_active":"2023-11-27T20:43:52.729894+0000","last_became_peered":"2023-11-27T20:43:52.729894+0000","last_unstale":"2023-11-27T20:44:06.517804+0000","last_undegraded":"2023-11-27T20:44:06.517804+0000","last_fullsized":"2023-11-27T20:44:06.517804+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:54.288377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513991+0000","last_change":"2023-11-27T20:43:51.709579+0000","last_active":"2023-11-27T20:44:06.513991+0000","last_peered":"2023-11-27T20:44:06.513991+0000","last_clean":"2023-11-27T20:44:06.513991+0000","last_became_active":"2023-11-27T20:43:51.709194+0000","last_became_peered":"2023-11-27T20:43:51.709194+0000","last_unstale":"2023-11-27T20:44:06.513991+0000","last_undegraded":"2023-11-27T20:44:06.513991+0000","last_fullsized":"2023-11-27T20:44:06.513991+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:01.414182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523350+0000","last_change":"2023-11-27T20:44:07.523350+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523350+0000","last_undegraded":"2023-11-27T20:44:07.523350+0000","last_fullsized":"2023-11-27T20:44:07.523350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.553873+0000","last_change":"2023-11-27T20:44:07.547935+0000","last_active":"2023-11-27T20:44:07.553873+0000","last_peered":"2023-11-27T20:44:07.553873+0000","last_clean":"2023-11-27T20:44:07.553873+0000","last_became_active":"2023-11-27T20:44:07.547663+0000","last_became_peered":"2023-11-27T20:44:07.547663+0000","last_unstale":"2023-11-27T20:44:07.553873+0000","last_undegraded":"2023-11-27T20:44:07.553873+0000","last_fullsized":"2023-11-27T20:44:07.553873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:56:07.645663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512173+0000","last_change":"2023-11-27T20:43:52.750078+0000","last_active":"2023-11-27T20:44:06.512173+0000","last_peered":"2023-11-27T20:44:06.512173+0000","last_clean":"2023-11-27T20:44:06.512173+0000","last_became_active":"2023-11-27T20:43:52.749770+0000","last_became_peered":"2023-11-27T20:43:52.749770+0000","last_unstale":"2023-11-27T20:44:06.512173+0000","last_undegraded":"2023-11-27T20:44:06.512173+0000","last_fullsized":"2023-11-27T20:44:06.512173+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500103+0000","last_change":"2023-11-27T20:43:51.708599+0000","last_active":"2023-11-27T20:44:06.500103+0000","last_peered":"2023-11-27T20:44:06.500103+0000","last_clean":"2023-11-27T20:44:06.500103+0000","last_became_active":"2023-11-27T20:43:51.708311+0000","last_became_peered":"2023-11-27T20:43:51.708311+0000","last_unstale":"2023-11-27T20:44:06.500103+0000","last_undegraded":"2023-11-27T20:44:06.500103+0000","last_fullsized":"2023-11-27T20:44:06.500103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:39.603520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525440+0000","last_change":"2023-11-27T20:44:07.525440+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525440+0000","last_undegraded":"2023-11-27T20:44:07.525440+0000","last_fullsized":"2023-11-27T20:44:07.525440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547438+0000","last_change":"2023-11-27T20:44:07.543371+0000","last_active":"2023-11-27T20:44:07.547438+0000","last_peered":"2023-11-27T20:44:07.547438+0000","last_clean":"2023-11-27T20:44:07.547438+0000","last_became_active":"2023-11-27T20:44:07.542654+0000","last_became_peered":"2023-11-27T20:44:07.542654+0000","last_unstale":"2023-11-27T20:44:07.547438+0000","last_undegraded":"2023-11-27T20:44:07.547438+0000","last_fullsized":"2023-11-27T20:44:07.547438+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:29.891814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512999+0000","last_change":"2023-11-27T20:43:52.745035+0000","last_active":"2023-11-27T20:44:06.512999+0000","last_peered":"2023-11-27T20:44:06.512999+0000","last_clean":"2023-11-27T20:44:06.512999+0000","last_became_active":"2023-11-27T20:43:52.744540+0000","last_became_peered":"2023-11-27T20:43:52.744540+0000","last_unstale":"2023-11-27T20:44:06.512999+0000","last_undegraded":"2023-11-27T20:44:06.512999+0000","last_fullsized":"2023-11-27T20:44:06.512999+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517954+0000","last_change":"2023-11-27T20:43:51.703755+0000","last_active":"2023-11-27T20:44:06.517954+0000","last_peered":"2023-11-27T20:44:06.517954+0000","last_clean":"2023-11-27T20:44:06.517954+0000","last_became_active":"2023-11-27T20:43:51.700051+0000","last_became_peered":"2023-11-27T20:43:51.700051+0000","last_unstale":"2023-11-27T20:44:06.517954+0000","last_undegraded":"2023-11-27T20:44:06.517954+0000","last_fullsized":"2023-11-27T20:44:06.517954+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:00.972675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537506+0000","last_change":"2023-11-27T20:44:07.537506+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537506+0000","last_undegraded":"2023-11-27T20:44:07.537506+0000","last_fullsized":"2023-11-27T20:44:07.537506+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547864+0000","last_change":"2023-11-27T20:44:07.546057+0000","last_active":"2023-11-27T20:44:07.547864+0000","last_peered":"2023-11-27T20:44:07.547864+0000","last_clean":"2023-11-27T20:44:07.547864+0000","last_became_active":"2023-11-27T20:44:07.543702+0000","last_became_peered":"2023-11-27T20:44:07.543702+0000","last_unstale":"2023-11-27T20:44:07.547864+0000","last_undegraded":"2023-11-27T20:44:07.547864+0000","last_fullsized":"2023-11-27T20:44:07.547864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:31.531196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521707+0000","last_change":"2023-11-27T20:43:52.735455+0000","last_active":"2023-11-27T20:44:06.521707+0000","last_peered":"2023-11-27T20:44:06.521707+0000","last_clean":"2023-11-27T20:44:06.521707+0000","last_became_active":"2023-11-27T20:43:52.735128+0000","last_became_peered":"2023-11-27T20:43:52.735128+0000","last_unstale":"2023-11-27T20:44:06.521707+0000","last_undegraded":"2023-11-27T20:44:06.521707+0000","last_fullsized":"2023-11-27T20:44:06.521707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500775+0000","last_change":"2023-11-27T20:43:51.711208+0000","last_active":"2023-11-27T20:44:06.500775+0000","last_peered":"2023-11-27T20:44:06.500775+0000","last_clean":"2023-11-27T20:44:06.500775+0000","last_became_active":"2023-11-27T20:43:51.710936+0000","last_became_peered":"2023-11-27T20:43:51.710936+0000","last_unstale":"2023-11-27T20:44:06.500775+0000","last_undegraded":"2023-11-27T20:44:06.500775+0000","last_fullsized":"2023-11-27T20:44:06.500775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:20.570705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539096+0000","last_change":"2023-11-27T20:44:07.539096+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539096+0000","last_undegraded":"2023-11-27T20:44:07.539096+0000","last_fullsized":"2023-11-27T20:44:07.539096+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.546342+0000","last_change":"2023-11-27T20:44:07.545626+0000","last_active":"2023-11-27T20:44:07.546342+0000","last_peered":"2023-11-27T20:44:07.546342+0000","last_clean":"2023-11-27T20:44:07.546342+0000","last_became_active":"2023-11-27T20:44:07.545085+0000","last_became_peered":"2023-11-27T20:44:07.545085+0000","last_unstale":"2023-11-27T20:44:07.546342+0000","last_undegraded":"2023-11-27T20:44:07.546342+0000","last_fullsized":"2023-11-27T20:44:07.546342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:39.893393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521932+0000","last_change":"2023-11-27T20:43:52.739121+0000","last_active":"2023-11-27T20:44:06.521932+0000","last_peered":"2023-11-27T20:44:06.521932+0000","last_clean":"2023-11-27T20:44:06.521932+0000","last_became_active":"2023-11-27T20:43:52.738758+0000","last_became_peered":"2023-11-27T20:43:52.738758+0000","last_unstale":"2023-11-27T20:44:06.521932+0000","last_undegraded":"2023-11-27T20:44:06.521932+0000","last_fullsized":"2023-11-27T20:44:06.521932+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513320+0000","last_change":"2023-11-27T20:43:51.703349+0000","last_active":"2023-11-27T20:44:06.513320+0000","last_peered":"2023-11-27T20:44:06.513320+0000","last_clean":"2023-11-27T20:44:06.513320+0000","last_became_active":"2023-11-27T20:43:51.703049+0000","last_became_peered":"2023-11-27T20:43:51.703049+0000","last_unstale":"2023-11-27T20:44:06.513320+0000","last_undegraded":"2023-11-27T20:44:06.513320+0000","last_fullsized":"2023-11-27T20:44:06.513320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530552+0000","last_change":"2023-11-27T20:44:07.530552+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530552+0000","last_undegraded":"2023-11-27T20:44:07.530552+0000","last_fullsized":"2023-11-27T20:44:07.530552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.550112+0000","last_change":"2023-11-27T20:44:07.543027+0000","last_active":"2023-11-27T20:44:07.550112+0000","last_peered":"2023-11-27T20:44:07.550112+0000","last_clean":"2023-11-27T20:44:07.550112+0000","last_became_active":"2023-11-27T20:44:07.541400+0000","last_became_peered":"2023-11-27T20:44:07.541400+0000","last_unstale":"2023-11-27T20:44:07.550112+0000","last_undegraded":"2023-11-27T20:44:07.550112+0000","last_fullsized":"2023-11-27T20:44:07.550112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:56:46.092083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500391+0000","last_change":"2023-11-27T20:43:52.738313+0000","last_active":"2023-11-27T20:44:06.500391+0000","last_peered":"2023-11-27T20:44:06.500391+0000","last_clean":"2023-11-27T20:44:06.500391+0000","last_became_active":"2023-11-27T20:43:52.738011+0000","last_became_peered":"2023-11-27T20:43:52.738011+0000","last_unstale":"2023-11-27T20:44:06.500391+0000","last_undegraded":"2023-11-27T20:44:06.500391+0000","last_fullsized":"2023-11-27T20:44:06.500391+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:18:19.921000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521006+0000","last_change":"2023-11-27T20:43:51.711343+0000","last_active":"2023-11-27T20:44:06.521006+0000","last_peered":"2023-11-27T20:44:06.521006+0000","last_clean":"2023-11-27T20:44:06.521006+0000","last_became_active":"2023-11-27T20:43:51.708458+0000","last_became_peered":"2023-11-27T20:43:51.708458+0000","last_unstale":"2023-11-27T20:44:06.521006+0000","last_undegraded":"2023-11-27T20:44:06.521006+0000","last_fullsized":"2023-11-27T20:44:06.521006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:41.674074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537058+0000","last_change":"2023-11-27T20:44:07.537058+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537058+0000","last_undegraded":"2023-11-27T20:44:07.537058+0000","last_fullsized":"2023-11-27T20:44:07.537058+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552520+0000","last_change":"2023-11-27T20:44:07.550591+0000","last_active":"2023-11-27T20:44:07.552520+0000","last_peered":"2023-11-27T20:44:07.552520+0000","last_clean":"2023-11-27T20:44:07.552520+0000","last_became_active":"2023-11-27T20:44:07.548839+0000","last_became_peered":"2023-11-27T20:44:07.548839+0000","last_unstale":"2023-11-27T20:44:07.552520+0000","last_undegraded":"2023-11-27T20:44:07.552520+0000","last_fullsized":"2023-11-27T20:44:07.552520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:40.418150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513151+0000","last_change":"2023-11-27T20:43:52.746396+0000","last_active":"2023-11-27T20:44:06.513151+0000","last_peered":"2023-11-27T20:44:06.513151+0000","last_clean":"2023-11-27T20:44:06.513151+0000","last_became_active":"2023-11-27T20:43:52.745787+0000","last_became_peered":"2023-11-27T20:43:52.745787+0000","last_unstale":"2023-11-27T20:44:06.513151+0000","last_undegraded":"2023-11-27T20:44:06.513151+0000","last_fullsized":"2023-11-27T20:44:06.513151+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:02.424346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521543+0000","last_change":"2023-11-27T20:43:51.711230+0000","last_active":"2023-11-27T20:44:06.521543+0000","last_peered":"2023-11-27T20:44:06.521543+0000","last_clean":"2023-11-27T20:44:06.521543+0000","last_became_active":"2023-11-27T20:43:51.709149+0000","last_became_peered":"2023-11-27T20:43:51.709149+0000","last_unstale":"2023-11-27T20:44:06.521543+0000","last_undegraded":"2023-11-27T20:44:06.521543+0000","last_fullsized":"2023-11-27T20:44:06.521543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:18.904440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531539+0000","last_change":"2023-11-27T20:44:07.531539+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531539+0000","last_undegraded":"2023-11-27T20:44:07.531539+0000","last_fullsized":"2023-11-27T20:44:07.531539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.550961+0000","last_change":"2023-11-27T20:44:07.548314+0000","last_active":"2023-11-27T20:44:07.550961+0000","last_peered":"2023-11-27T20:44:07.550961+0000","last_clean":"2023-11-27T20:44:07.550961+0000","last_became_active":"2023-11-27T20:44:07.547981+0000","last_became_peered":"2023-11-27T20:44:07.547981+0000","last_unstale":"2023-11-27T20:44:07.550961+0000","last_undegraded":"2023-11-27T20:44:07.550961+0000","last_fullsized":"2023-11-27T20:44:07.550961+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:09:09.101471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511517+0000","last_change":"2023-11-27T20:43:52.740586+0000","last_active":"2023-11-27T20:44:06.511517+0000","last_peered":"2023-11-27T20:44:06.511517+0000","last_clean":"2023-11-27T20:44:06.511517+0000","last_became_active":"2023-11-27T20:43:52.739765+0000","last_became_peered":"2023-11-27T20:43:52.739765+0000","last_unstale":"2023-11-27T20:44:06.511517+0000","last_undegraded":"2023-11-27T20:44:06.511517+0000","last_fullsized":"2023-11-27T20:44:06.511517+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:52.832569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500131+0000","last_change":"2023-11-27T20:43:51.701630+0000","last_active":"2023-11-27T20:44:06.500131+0000","last_peered":"2023-11-27T20:44:06.500131+0000","last_clean":"2023-11-27T20:44:06.500131+0000","last_became_active":"2023-11-27T20:43:51.701326+0000","last_became_peered":"2023-11-27T20:43:51.701326+0000","last_unstale":"2023-11-27T20:44:06.500131+0000","last_undegraded":"2023-11-27T20:44:06.500131+0000","last_fullsized":"2023-11-27T20:44:06.500131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:15.707938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523119+0000","last_change":"2023-11-27T20:44:07.523119+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523119+0000","last_undegraded":"2023-11-27T20:44:07.523119+0000","last_fullsized":"2023-11-27T20:44:07.523119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552065+0000","last_change":"2023-11-27T20:44:07.550274+0000","last_active":"2023-11-27T20:44:07.552065+0000","last_peered":"2023-11-27T20:44:07.552065+0000","last_clean":"2023-11-27T20:44:07.552065+0000","last_became_active":"2023-11-27T20:44:07.545265+0000","last_became_peered":"2023-11-27T20:44:07.545265+0000","last_unstale":"2023-11-27T20:44:07.552065+0000","last_undegraded":"2023-11-27T20:44:07.552065+0000","last_fullsized":"2023-11-27T20:44:07.552065+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:36.239607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517029+0000","last_change":"2023-11-27T20:43:52.751182+0000","last_active":"2023-11-27T20:44:06.517029+0000","last_peered":"2023-11-27T20:44:06.517029+0000","last_clean":"2023-11-27T20:44:06.517029+0000","last_became_active":"2023-11-27T20:43:52.750848+0000","last_became_peered":"2023-11-27T20:43:52.750848+0000","last_unstale":"2023-11-27T20:44:06.517029+0000","last_undegraded":"2023-11-27T20:44:06.517029+0000","last_fullsized":"2023-11-27T20:44:06.517029+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506341+0000","last_change":"2023-11-27T20:43:51.712306+0000","last_active":"2023-11-27T20:44:06.506341+0000","last_peered":"2023-11-27T20:44:06.506341+0000","last_clean":"2023-11-27T20:44:06.506341+0000","last_became_active":"2023-11-27T20:43:51.712011+0000","last_became_peered":"2023-11-27T20:43:51.712011+0000","last_unstale":"2023-11-27T20:44:06.506341+0000","last_undegraded":"2023-11-27T20:44:06.506341+0000","last_fullsized":"2023-11-27T20:44:06.506341+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:16.877363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526405+0000","last_change":"2023-11-27T20:44:07.526405+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526405+0000","last_undegraded":"2023-11-27T20:44:07.526405+0000","last_fullsized":"2023-11-27T20:44:07.526405+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.558304+0000","last_change":"2023-11-27T20:44:07.553422+0000","last_active":"2023-11-27T20:44:07.558304+0000","last_peered":"2023-11-27T20:44:07.558304+0000","last_clean":"2023-11-27T20:44:07.558304+0000","last_became_active":"2023-11-27T20:44:07.553073+0000","last_became_peered":"2023-11-27T20:44:07.553073+0000","last_unstale":"2023-11-27T20:44:07.558304+0000","last_undegraded":"2023-11-27T20:44:07.558304+0000","last_fullsized":"2023-11-27T20:44:07.558304+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:26.063759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.499837+0000","last_change":"2023-11-27T20:43:52.726119+0000","last_active":"2023-11-27T20:44:06.499837+0000","last_peered":"2023-11-27T20:44:06.499837+0000","last_clean":"2023-11-27T20:44:06.499837+0000","last_became_active":"2023-11-27T20:43:52.725822+0000","last_became_peered":"2023-11-27T20:43:52.725822+0000","last_unstale":"2023-11-27T20:44:06.499837+0000","last_undegraded":"2023-11-27T20:44:06.499837+0000","last_fullsized":"2023-11-27T20:44:06.499837+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:42.798849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.499819+0000","last_change":"2023-11-27T20:43:51.701670+0000","last_active":"2023-11-27T20:44:06.499819+0000","last_peered":"2023-11-27T20:44:06.499819+0000","last_clean":"2023-11-27T20:44:06.499819+0000","last_became_active":"2023-11-27T20:43:51.701405+0000","last_became_peered":"2023-11-27T20:43:51.701405+0000","last_unstale":"2023-11-27T20:44:06.499819+0000","last_undegraded":"2023-11-27T20:44:06.499819+0000","last_fullsized":"2023-11-27T20:44:06.499819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:37.579894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527434+0000","last_change":"2023-11-27T20:44:07.527434+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527434+0000","last_undegraded":"2023-11-27T20:44:07.527434+0000","last_fullsized":"2023-11-27T20:44:07.527434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.543558+0000","last_change":"2023-11-27T20:44:07.541134+0000","last_active":"2023-11-27T20:44:07.543558+0000","last_peered":"2023-11-27T20:44:07.543558+0000","last_clean":"2023-11-27T20:44:07.543558+0000","last_became_active":"2023-11-27T20:44:07.540882+0000","last_became_peered":"2023-11-27T20:44:07.540882+0000","last_unstale":"2023-11-27T20:44:07.543558+0000","last_undegraded":"2023-11-27T20:44:07.543558+0000","last_fullsized":"2023-11-27T20:44:07.543558+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:32.700621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511249+0000","last_change":"2023-11-27T20:43:52.723905+0000","last_active":"2023-11-27T20:44:06.511249+0000","last_peered":"2023-11-27T20:44:06.511249+0000","last_clean":"2023-11-27T20:44:06.511249+0000","last_became_active":"2023-11-27T20:43:52.723296+0000","last_became_peered":"2023-11-27T20:43:52.723296+0000","last_unstale":"2023-11-27T20:44:06.511249+0000","last_undegraded":"2023-11-27T20:44:06.511249+0000","last_fullsized":"2023-11-27T20:44:06.511249+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:25.080298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511226+0000","last_change":"2023-11-27T20:43:51.707532+0000","last_active":"2023-11-27T20:44:06.511226+0000","last_peered":"2023-11-27T20:44:06.511226+0000","last_clean":"2023-11-27T20:44:06.511226+0000","last_became_active":"2023-11-27T20:43:51.705976+0000","last_became_peered":"2023-11-27T20:43:51.705976+0000","last_unstale":"2023-11-27T20:44:06.511226+0000","last_undegraded":"2023-11-27T20:44:06.511226+0000","last_fullsized":"2023-11-27T20:44:06.511226+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:01.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524671+0000","last_change":"2023-11-27T20:44:07.524671+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524671+0000","last_undegraded":"2023-11-27T20:44:07.524671+0000","last_fullsized":"2023-11-27T20:44:07.524671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547414+0000","last_change":"2023-11-27T20:44:07.543228+0000","last_active":"2023-11-27T20:44:07.547414+0000","last_peered":"2023-11-27T20:44:07.547414+0000","last_clean":"2023-11-27T20:44:07.547414+0000","last_became_active":"2023-11-27T20:44:07.540038+0000","last_became_peered":"2023-11-27T20:44:07.540038+0000","last_unstale":"2023-11-27T20:44:07.547414+0000","last_undegraded":"2023-11-27T20:44:07.547414+0000","last_fullsized":"2023-11-27T20:44:07.547414+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:32.588898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511086+0000","last_change":"2023-11-27T20:43:52.752685+0000","last_active":"2023-11-27T20:44:06.511086+0000","last_peered":"2023-11-27T20:44:06.511086+0000","last_clean":"2023-11-27T20:44:06.511086+0000","last_became_active":"2023-11-27T20:43:52.748686+0000","last_became_peered":"2023-11-27T20:43:52.748686+0000","last_unstale":"2023-11-27T20:44:06.511086+0000","last_undegraded":"2023-11-27T20:44:06.511086+0000","last_fullsized":"2023-11-27T20:44:06.511086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:34.158412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516360+0000","last_change":"2023-11-27T20:43:51.700471+0000","last_active":"2023-11-27T20:44:06.516360+0000","last_peered":"2023-11-27T20:44:06.516360+0000","last_clean":"2023-11-27T20:44:06.516360+0000","last_became_active":"2023-11-27T20:43:51.700088+0000","last_became_peered":"2023-11-27T20:43:51.700088+0000","last_unstale":"2023-11-27T20:44:06.516360+0000","last_undegraded":"2023-11-27T20:44:06.516360+0000","last_fullsized":"2023-11-27T20:44:06.516360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:13:35.862430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515700+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:44:06.515700+0000","last_peered":"2023-11-27T20:44:06.515700+0000","last_clean":"2023-11-27T20:44:06.515700+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:44:06.515700+0000","last_undegraded":"2023-11-27T20:44:06.515700+0000","last_fullsized":"2023-11-27T20:44:06.515700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":881171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1579999999999999,"15min":1.163},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.181,"5min":1.2290000000000001,"15min":1.2370000000000001},"min":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.74,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.528}]},{"osd":1,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.47,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.165},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.607,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3480000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.282,"15min":1.3080000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.484,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.3},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.248,"15min":1.2589999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6379999999999999,"5min":1.909,"15min":1.909},"last":1.0489999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.361,"15min":1.397},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6779999999999999,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.113},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.47,"15min":1.496},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6879999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.244}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.724,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.5429999999999999,"15min":1.6040000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.623,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.2090000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4770000000000001,"15min":1.5049999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.948,"5min":2.044,"15min":2.044},"last":1.415},{"interface":"front","average":{"1min":1.399,"5min":1.5660000000000001,"15min":1.5940000000000001},"min":{"1min":0.69499999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8169999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.629}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.653,"15min":1.6759999999999999},"min":{"1min":0.80200000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.0179999999999998,"5min":2.508,"15min":2.508},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.6559999999999999,"15min":1.694},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.724,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.7749999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":684032,"data_stored":297773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.679,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.306,"15min":1.331},"min":{"1min":0.65200000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6399999999999999,"5min":2.581,"15min":2.581},"last":0.92800000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2549999999999999,"15min":1.2769999999999999},"min":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5349999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.151,"15min":1.167},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.506,"5min":2.823,"15min":2.823},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0760000000000001,"15min":1.081},"min":{"1min":0.79100000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4790000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.2,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.86899999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.679,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.101}]},{"osd":3,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.349,"15min":1.387},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.71,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.7849999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.1990000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.605,"15min":1.631},"min":{"1min":0.97699999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.994,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.623,"15min":1.663},"min":{"1min":0.82799999999999996,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.804,"5min":3.536,"15min":3.536},"last":1.1559999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.393,"15min":1.4079999999999999},"min":{"1min":0.81200000000000006,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9359999999999999,"5min":2.355,"15min":2.355},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.753,"5min":0.623,"15min":0.623},"max":{"1min":1.8819999999999999,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.2649999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.6519999999999999,"15min":1.6919999999999999},"min":{"1min":0.88500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":3.645,"15min":3.645},"last":1.242},{"interface":"front","average":{"1min":1.452,"5min":1.569,"15min":1.589},"min":{"1min":1.006,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.032,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.4590000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":298425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.1379999999999999,"15min":1.163},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5800000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.1579999999999999,"15min":1.1839999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6619999999999999,"5min":2.04,"15min":2.04},"last":1.367}]},{"osd":1,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.181,"15min":1.2050000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.4630000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.242}]},{"osd":2,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.27,"15min":1.294},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.73,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.268},{"interface":"front","average":{"1min":1.081,"5min":1.1950000000000001,"15min":1.214},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7470000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.556}]},{"osd":3,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.3660000000000001,"15min":1.399},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5900000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.4359999999999999,"15min":1.472},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.637,"5min":4.016,"15min":4.016},"last":1.206}]},{"osd":4,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3580000000000001,"15min":1.3919999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.79,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.873},{"interface":"front","average":{"1min":1.292,"5min":1.585,"15min":1.6339999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8140000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.1439999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.619,"15min":1.671},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.724,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.573,"15min":1.6120000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.016,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.405}]},{"osd":7,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.6379999999999999,"15min":1.6819999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.871,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.599},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.708,"15min":1.76},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8380000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.3160000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":300880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.014,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.0840000000000001,"15min":1.0820000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.034,"15min":1.008},"min":{"1min":0.80400000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.222,"15min":1.22},"min":{"1min":0.64500000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.74,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.29}]},{"osd":2,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2170000000000001,"15min":1.2110000000000001},"min":{"1min":0.69799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.343},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.292,"15min":1.294},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.53}]},{"osd":3,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.85199999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.599,"5min":1.778,"15min":1.778},"last":1.024},{"interface":"front","average":{"1min":1.464,"5min":1.3600000000000001,"15min":1.343},"min":{"1min":0.91400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.4710000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.266,"15min":1.284},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.109},{"interface":"front","average":{"1min":1.421,"5min":1.431,"15min":1.4330000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.0569999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.651,"5min":2.157,"15min":2.157},"last":1.242},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.595,"15min":1.605},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.887,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.385}]},{"osd":7,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5089999999999999,"15min":1.5009999999999999},"min":{"1min":1.179,"5min":1.016,"15min":1.016},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.6679999999999999,"15min":1.6639999999999999},"min":{"1min":1.22,"5min":1.004,"15min":1.004},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.5840000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":1.0009999999999999,"15min":1.0389999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.258,"5min":3.641,"15min":3.641},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97199999999999998,"15min":1.014},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0449999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.399,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.097,"15min":1.121},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4099999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.0880000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0960000000000001,"15min":1.117},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.444,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.135},"min":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.746,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.85299999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.3029999999999999,"15min":1.337},"min":{"1min":0.84499999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.365,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.4330000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.4179999999999999,"15min":1.4379999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.982,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.052},{"interface":"front","average":{"1min":1.272,"5min":1.452,"15min":1.482},"min":{"1min":0.874,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.714,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.3049999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.5189999999999999,"15min":1.544},"min":{"1min":0.96799999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.823,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.492,"15min":1.522},"min":{"1min":0.89000000000000001,"5min":0.878,"15min":0.878},"max":{"1min":1.8560000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.5209999999999999,"15min":1.5580000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.929,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.167},{"interface":"front","average":{"1min":1.413,"5min":1.4890000000000001,"15min":1.5009999999999999},"min":{"1min":1.002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.7410000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.2869999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1259999999999999,"5min":1.228,"15min":1.228},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.93300000000000005},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2270000000000001,"5min":1.972,"15min":1.972},"last":1.4750000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.98099999999999998,"15min":1.014},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1890000000000001,"5min":1.522,"15min":1.522},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.96499999999999997,"15min":0.98799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.431,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.022}]},{"osd":3,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.96099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0740000000000001,"15min":1.101},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4770000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1359999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.1850000000000001,"15min":1.21},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4299999999999999,"5min":1.669,"15min":1.669},"last":1.431},{"interface":"front","average":{"1min":1.169,"5min":1.3540000000000001,"15min":1.385},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.252}]},{"osd":5,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.3009999999999999,"15min":1.3260000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.601,"5min":2.48,"15min":2.48},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.4510000000000001,"15min":1.4930000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9930000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.5129999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3640000000000001,"15min":1.381},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.972,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.383},{"interface":"front","average":{"1min":1.202,"5min":1.4890000000000001,"15min":1.5369999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.831,"5min":3.302,"15min":3.302},"last":1.339}]},{"osd":7,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.46,"15min":1.496},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.1070000000000002,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.4330000000000001,"15min":1.4810000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.581,"5min":2.73,"15min":2.73},"last":1.0740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":688128,"data_stored":297863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0940000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.5449999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.97099999999999997,"15min":0.98999999999999999},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3740000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0429999999999999,"15min":1.0469999999999999},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.518,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0489999999999999,"15min":1.0329999999999999},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7370000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.083,"15min":1.087},"min":{"1min":0.66600000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6140000000000001,"5min":2.044,"15min":2.044},"last":0.70699999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1799999999999999,"15min":1.1890000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3640000000000001,"15min":1.3540000000000001},"min":{"1min":0.88500000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.1099999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.0409999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9810000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.02},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.25,"15min":1.2330000000000001},"min":{"1min":0.79100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1659999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.2490000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.3380000000000001,"15min":1.3180000000000001},"min":{"1min":1.095,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1230000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.357},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.732,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.3240000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.4690000000000001,"15min":1.476},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1949999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.5960000000000001,"15min":1.5880000000000001},"min":{"1min":1.143,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.7469999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.3049999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1294336,"data_stored":891830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.85299999999999998,"15min":0.84199999999999997},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.5649999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.85099999999999998,"15min":0.83499999999999996},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.173}]},{"osd":3,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.91300000000000003,"15min":0.89700000000000002},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.8320000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.0549999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2470000000000001,"15min":1.246},"min":{"1min":0.76900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9430000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.1970000000000001,"15min":1.1919999999999999},"min":{"1min":0.89700000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.575,"5min":2.391,"15min":2.391},"last":1.4019999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.81399999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.0750000000000002,"5min":3.028,"15min":3.028},"last":1.373},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.3129999999999999},"min":{"1min":0.77700000000000002,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.246,"5min":2.718,"15min":2.718},"last":1.341}]},{"osd":6,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3120000000000001},"min":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7909999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.105},{"interface":"front","average":{"1min":1.415,"5min":1.423,"15min":1.4239999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.1509999999999998,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.238}]},{"osd":7,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3540000000000001,"15min":1.355},"min":{"1min":0.84699999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.835,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3560000000000001,"15min":1.3600000000000001},"min":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8500000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.476}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:44:13.400 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:44:13.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.646+0000 7f13a9613640 1 Processor -- start 2023-11-27T20:44:13.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.646+0000 7f13a9613640 1 -- start start 2023-11-27T20:44:13.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.647+0000 7f13a9613640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13a414e6f0 0x7f13a40c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.647+0000 7f13a9613640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f13a40a4dd0 0x7f13a406bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.647+0000 7f13a9613640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f13a4151240 0x7f13a41516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.647+0000 7f13a9613640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a40c52e0 con 0x7f13a40a4dd0 2023-11-27T20:44:13.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.647+0000 7f13a9613640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a40c54f0 con 0x7f13a4151240 2023-11-27T20:44:13.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.647+0000 7f13a9613640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a40c57d0 con 0x7f13a414e6f0 2023-11-27T20:44:13.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.648+0000 7f139bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f13a40a4dd0 0x7f13a406bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.648+0000 7f139bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f13a40a4dd0 0x7f13a406bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41890/0 (socket says 172.21.15.91:41890) 2023-11-27T20:44:13.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.648+0000 7f139bfff640 1 -- 172.21.15.91:0/2058135093 learned_addr learned my addr 172.21.15.91:0/2058135093 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:13.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.648+0000 7f13a8e12640 1 --2- 172.21.15.91:0/2058135093 >> v2:172.21.15.183:3300/0 conn(0x7f13a4151240 0x7f13a41516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.648+0000 7f13a3fff640 1 --2- 172.21.15.91:0/2058135093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13a414e6f0 0x7f13a40c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.648+0000 7f139bfff640 1 -- 172.21.15.91:0/2058135093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13a414e6f0 msgr2=0x7f13a40c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:13.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.648+0000 7f139bfff640 1 --2- 172.21.15.91:0/2058135093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13a414e6f0 0x7f13a40c19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.648+0000 7f139bfff640 1 -- 172.21.15.91:0/2058135093 >> v2:172.21.15.183:3300/0 conn(0x7f13a4151240 msgr2=0x7f13a41516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:13.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.648+0000 7f139bfff640 1 --2- 172.21.15.91:0/2058135093 >> v2:172.21.15.183:3300/0 conn(0x7f13a4151240 0x7f13a41516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.648+0000 7f139bfff640 1 -- 172.21.15.91:0/2058135093 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a40c0ef0 con 0x7f13a40a4dd0 2023-11-27T20:44:13.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.649+0000 7f139bfff640 1 --2- 172.21.15.91:0/2058135093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a40a4dd0 0x7f13a406bec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f138c009870 tx=0x7f138c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420bcfbda2b94f9f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:13.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a37fe640 1 -- 172.21.15.91:0/2058135093 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0317c0 con 0x7f13a40a4dd0 2023-11-27T20:44:13.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a37fe640 1 -- 172.21.15.91:0/2058135093 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c031920 con 0x7f13a40a4dd0 2023-11-27T20:44:13.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a37fe640 1 -- 172.21.15.91:0/2058135093 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c031cb0 con 0x7f13a40a4dd0 2023-11-27T20:44:13.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a9613640 1 -- 172.21.15.91:0/2058135093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a40a4dd0 msgr2=0x7f13a406bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a9613640 1 --2- 172.21.15.91:0/2058135093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a40a4dd0 0x7f13a406bec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f138c009870 tx=0x7f138c02b860 comp rx=0 tx=0).stop 2023-11-27T20:44:13.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a9613640 1 -- 172.21.15.91:0/2058135093 shutdown_connections 2023-11-27T20:44:13.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a9613640 1 --2- 172.21.15.91:0/2058135093 >> v2:172.21.15.183:3300/0 conn(0x7f13a4151240 0x7f13a41516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a9613640 1 --2- 172.21.15.91:0/2058135093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a40a4dd0 0x7f13a406bec0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a9613640 1 --2- 172.21.15.91:0/2058135093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13a414e6f0 0x7f13a40c19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a9613640 1 -- 172.21.15.91:0/2058135093 >> 172.21.15.91:0/2058135093 conn(0x7f13a40a77f0 msgr2=0x7f13a40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:13.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a9613640 1 -- 172.21.15.91:0/2058135093 shutdown_connections 2023-11-27T20:44:13.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.650+0000 7f13a9613640 1 -- 172.21.15.91:0/2058135093 wait complete. 2023-11-27T20:44:13.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.652+0000 7f13a9613640 1 Processor -- start 2023-11-27T20:44:13.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.652+0000 7f13a9613640 1 -- start start 2023-11-27T20:44:13.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.653+0000 7f13a9613640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13a40a4dd0 0x7f13a415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.653+0000 7f13a9613640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a414e6f0 0x7f13a41ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.653+0000 7f13a9613640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13a4151240 0x7f13a41ea660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.653+0000 7f13a9613640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a414f1e0 con 0x7f13a414e6f0 2023-11-27T20:44:13.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.653+0000 7f13a9613640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a414ca20 con 0x7f13a4151240 2023-11-27T20:44:13.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.653+0000 7f13a9613640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a41ee240 con 0x7f13a40a4dd0 2023-11-27T20:44:13.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.653+0000 7f139bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a414e6f0 0x7f13a41ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.653+0000 7f139bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a414e6f0 0x7f13a41ea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41906/0 (socket says 172.21.15.91:41906) 2023-11-27T20:44:13.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.653+0000 7f139bfff640 1 -- 172.21.15.91:0/3769931457 learned_addr learned my addr 172.21.15.91:0/3769931457 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:13.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f139bfff640 1 -- 172.21.15.91:0/3769931457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13a40a4dd0 msgr2=0x7f13a415a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f139bfff640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13a40a4dd0 0x7f13a415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f139bfff640 1 -- 172.21.15.91:0/3769931457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13a4151240 msgr2=0x7f13a41ea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f139bfff640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13a4151240 0x7f13a41ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f139bfff640 1 -- 172.21.15.91:0/3769931457 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0094d0 con 0x7f13a414e6f0 2023-11-27T20:44:13.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f139bfff640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a414e6f0 0x7f13a41ea120 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f138c000c00 tx=0x7f138c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:13.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f13a17fa640 1 -- 172.21.15.91:0/3769931457 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0329a0 con 0x7f13a414e6f0 2023-11-27T20:44:13.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f13a17fa640 1 -- 172.21.15.91:0/3769931457 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c032b20 con 0x7f13a414e6f0 2023-11-27T20:44:13.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f13a17fa640 1 -- 172.21.15.91:0/3769931457 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0453f0 con 0x7f13a414e6f0 2023-11-27T20:44:13.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f13a9613640 1 -- 172.21.15.91:0/3769931457 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a41ee520 con 0x7f13a414e6f0 2023-11-27T20:44:13.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.654+0000 7f13a9613640 1 -- 172.21.15.91:0/3769931457 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a414dd50 con 0x7f13a414e6f0 2023-11-27T20:44:13.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.655+0000 7f13a9613640 1 -- 172.21.15.91:0/3769931457 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a4067950 con 0x7f13a414e6f0 2023-11-27T20:44:13.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.656+0000 7f13a17fa640 1 -- 172.21.15.91:0/3769931457 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f138c04d3f0 con 0x7f13a414e6f0 2023-11-27T20:44:13.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.657+0000 7f13a17fa640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f138406b1c0 0x7f138406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:13.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.657+0000 7f13a17fa640 1 -- 172.21.15.91:0/3769931457 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f138c0abd30 con 0x7f13a414e6f0 2023-11-27T20:44:13.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.658+0000 7f13a3fff640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f138406b1c0 0x7f138406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:13.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.658+0000 7f13a3fff640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f138406b1c0 0x7f138406d680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1394006fd0 tx=0x7f1394008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:13.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.662+0000 7f13a17fa640 1 -- 172.21.15.91:0/3769931457 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f138c0766f0 con 0x7f13a414e6f0 2023-11-27T20:44:13.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.848+0000 7f13a9613640 1 -- 172.21.15.91:0/3769931457 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13a40c14b0 con 0x7f138406b1c0 2023-11-27T20:44:13.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.868+0000 7f13a17fa640 1 -- 172.21.15.91:0/3769931457 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+519894 (secure 0 0 0) 0x7f139400ae20 con 0x7f138406b1c0 2023-11-27T20:44:13.877 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:13.880 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:44:13.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 -- 172.21.15.91:0/3769931457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f138406b1c0 msgr2=0x7f138406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f138406b1c0 0x7f138406d680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1394006fd0 tx=0x7f1394008040 comp rx=0 tx=0).stop 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 -- 172.21.15.91:0/3769931457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a414e6f0 msgr2=0x7f13a41ea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a414e6f0 0x7f13a41ea120 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f138c000c00 tx=0x7f138c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 -- 172.21.15.91:0/3769931457 shutdown_connections 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f138406b1c0 0x7f138406d680 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13a4151240 0x7f13a41ea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a414e6f0 0x7f13a41ea120 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 --2- 172.21.15.91:0/3769931457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13a40a4dd0 0x7f13a415a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 -- 172.21.15.91:0/3769931457 >> 172.21.15.91:0/3769931457 conn(0x7f13a40a77f0 msgr2=0x7f13a40c41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 -- 172.21.15.91:0/3769931457 shutdown_connections 2023-11-27T20:44:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:13.878+0000 7f13a9613640 1 -- 172.21.15.91:0/3769931457 wait complete. 2023-11-27T20:44:13.902 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-11-27T20:44:13.424364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235224,"kb_used_data":6556,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739496,"statfs":{"total":773094113280,"available":772853243904,"internally_reserved":0,"allocated":6713344,"data_stored":3563600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001682"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528239+0000","last_change":"2023-11-27T20:44:07.528239+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528239+0000","last_undegraded":"2023-11-27T20:44:07.528239+0000","last_fullsized":"2023-11-27T20:44:07.528239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507747+0000","last_change":"2023-11-27T20:43:52.742706+0000","last_active":"2023-11-27T20:44:06.507747+0000","last_peered":"2023-11-27T20:44:06.507747+0000","last_clean":"2023-11-27T20:44:06.507747+0000","last_became_active":"2023-11-27T20:43:52.742447+0000","last_became_peered":"2023-11-27T20:43:52.742447+0000","last_unstale":"2023-11-27T20:44:06.507747+0000","last_undegraded":"2023-11-27T20:44:06.507747+0000","last_fullsized":"2023-11-27T20:44:06.507747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:10.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531466+0000","last_change":"2023-11-27T20:44:07.531466+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531466+0000","last_undegraded":"2023-11-27T20:44:07.531466+0000","last_fullsized":"2023-11-27T20:44:07.531466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514019+0000","last_change":"2023-11-27T20:43:52.741446+0000","last_active":"2023-11-27T20:44:06.514019+0000","last_peered":"2023-11-27T20:44:06.514019+0000","last_clean":"2023-11-27T20:44:06.514019+0000","last_became_active":"2023-11-27T20:43:52.741105+0000","last_became_peered":"2023-11-27T20:43:52.741105+0000","last_unstale":"2023-11-27T20:44:06.514019+0000","last_undegraded":"2023-11-27T20:44:06.514019+0000","last_fullsized":"2023-11-27T20:44:06.514019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:03.285901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.541507+0000","last_change":"2023-11-27T20:44:07.541507+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.541507+0000","last_undegraded":"2023-11-27T20:44:07.541507+0000","last_fullsized":"2023-11-27T20:44:07.541507+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513834+0000","last_change":"2023-11-27T20:43:52.737240+0000","last_active":"2023-11-27T20:44:06.513834+0000","last_peered":"2023-11-27T20:44:06.513834+0000","last_clean":"2023-11-27T20:44:06.513834+0000","last_became_active":"2023-11-27T20:43:52.736781+0000","last_became_peered":"2023-11-27T20:43:52.736781+0000","last_unstale":"2023-11-27T20:44:06.513834+0000","last_undegraded":"2023-11-27T20:44:06.513834+0000","last_fullsized":"2023-11-27T20:44:06.513834+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527473+0000","last_change":"2023-11-27T20:44:07.527473+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527473+0000","last_undegraded":"2023-11-27T20:44:07.527473+0000","last_fullsized":"2023-11-27T20:44:07.527473+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521084+0000","last_change":"2023-11-27T20:43:52.738199+0000","last_active":"2023-11-27T20:44:06.521084+0000","last_peered":"2023-11-27T20:44:06.521084+0000","last_clean":"2023-11-27T20:44:06.521084+0000","last_became_active":"2023-11-27T20:43:52.737298+0000","last_became_peered":"2023-11-27T20:43:52.737298+0000","last_unstale":"2023-11-27T20:44:06.521084+0000","last_undegraded":"2023-11-27T20:44:06.521084+0000","last_fullsized":"2023-11-27T20:44:06.521084+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:54.739325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531917+0000","last_change":"2023-11-27T20:44:07.531917+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531917+0000","last_undegraded":"2023-11-27T20:44:07.531917+0000","last_fullsized":"2023-11-27T20:44:07.531917+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506135+0000","last_change":"2023-11-27T20:43:52.745287+0000","last_active":"2023-11-27T20:44:06.506135+0000","last_peered":"2023-11-27T20:44:06.506135+0000","last_clean":"2023-11-27T20:44:06.506135+0000","last_became_active":"2023-11-27T20:43:52.744817+0000","last_became_peered":"2023-11-27T20:43:52.744817+0000","last_unstale":"2023-11-27T20:44:06.506135+0000","last_undegraded":"2023-11-27T20:44:06.506135+0000","last_fullsized":"2023-11-27T20:44:06.506135+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:59.992569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525264+0000","last_change":"2023-11-27T20:44:07.525264+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525264+0000","last_undegraded":"2023-11-27T20:44:07.525264+0000","last_fullsized":"2023-11-27T20:44:07.525264+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511440+0000","last_change":"2023-11-27T20:43:52.737877+0000","last_active":"2023-11-27T20:44:06.511440+0000","last_peered":"2023-11-27T20:44:06.511440+0000","last_clean":"2023-11-27T20:44:06.511440+0000","last_became_active":"2023-11-27T20:43:52.737566+0000","last_became_peered":"2023-11-27T20:43:52.737566+0000","last_unstale":"2023-11-27T20:44:06.511440+0000","last_undegraded":"2023-11-27T20:44:06.511440+0000","last_fullsized":"2023-11-27T20:44:06.511440+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526887+0000","last_change":"2023-11-27T20:44:07.526887+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526887+0000","last_undegraded":"2023-11-27T20:44:07.526887+0000","last_fullsized":"2023-11-27T20:44:07.526887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505272+0000","last_change":"2023-11-27T20:43:52.738797+0000","last_active":"2023-11-27T20:44:06.505272+0000","last_peered":"2023-11-27T20:44:06.505272+0000","last_clean":"2023-11-27T20:44:06.505272+0000","last_became_active":"2023-11-27T20:43:52.738444+0000","last_became_peered":"2023-11-27T20:43:52.738444+0000","last_unstale":"2023-11-27T20:44:06.505272+0000","last_undegraded":"2023-11-27T20:44:06.505272+0000","last_fullsized":"2023-11-27T20:44:06.505272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:23.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526581+0000","last_change":"2023-11-27T20:44:07.526581+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526581+0000","last_undegraded":"2023-11-27T20:44:07.526581+0000","last_fullsized":"2023-11-27T20:44:07.526581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511067+0000","last_change":"2023-11-27T20:43:52.742425+0000","last_active":"2023-11-27T20:44:06.511067+0000","last_peered":"2023-11-27T20:44:06.511067+0000","last_clean":"2023-11-27T20:44:06.511067+0000","last_became_active":"2023-11-27T20:43:52.741079+0000","last_became_peered":"2023-11-27T20:43:52.741079+0000","last_unstale":"2023-11-27T20:44:06.511067+0000","last_undegraded":"2023-11-27T20:44:06.511067+0000","last_fullsized":"2023-11-27T20:44:06.511067+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:21.581873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.540259+0000","last_change":"2023-11-27T20:44:07.540259+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.540259+0000","last_undegraded":"2023-11-27T20:44:07.540259+0000","last_fullsized":"2023-11-27T20:44:07.540259+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.509318+0000","last_change":"2023-11-27T20:43:52.749527+0000","last_active":"2023-11-27T20:44:06.509318+0000","last_peered":"2023-11-27T20:44:06.509318+0000","last_clean":"2023-11-27T20:44:06.509318+0000","last_became_active":"2023-11-27T20:43:52.749261+0000","last_became_peered":"2023-11-27T20:43:52.749261+0000","last_unstale":"2023-11-27T20:44:06.509318+0000","last_undegraded":"2023-11-27T20:44:06.509318+0000","last_fullsized":"2023-11-27T20:44:06.509318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:22.440110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531049+0000","last_change":"2023-11-27T20:44:07.531049+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531049+0000","last_undegraded":"2023-11-27T20:44:07.531049+0000","last_fullsized":"2023-11-27T20:44:07.531049+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500881+0000","last_change":"2023-11-27T20:43:52.724633+0000","last_active":"2023-11-27T20:44:06.500881+0000","last_peered":"2023-11-27T20:44:06.500881+0000","last_clean":"2023-11-27T20:44:06.500881+0000","last_became_active":"2023-11-27T20:43:52.724319+0000","last_became_peered":"2023-11-27T20:43:52.724319+0000","last_unstale":"2023-11-27T20:44:06.500881+0000","last_undegraded":"2023-11-27T20:44:06.500881+0000","last_fullsized":"2023-11-27T20:44:06.500881+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:56.115106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.535763+0000","last_change":"2023-11-27T20:44:07.535763+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.535763+0000","last_undegraded":"2023-11-27T20:44:07.535763+0000","last_fullsized":"2023-11-27T20:44:07.535763+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500638+0000","last_change":"2023-11-27T20:43:52.740239+0000","last_active":"2023-11-27T20:44:06.500638+0000","last_peered":"2023-11-27T20:44:06.500638+0000","last_clean":"2023-11-27T20:44:06.500638+0000","last_became_active":"2023-11-27T20:43:52.739953+0000","last_became_peered":"2023-11-27T20:43:52.739953+0000","last_unstale":"2023-11-27T20:44:06.500638+0000","last_undegraded":"2023-11-27T20:44:06.500638+0000","last_fullsized":"2023-11-27T20:44:06.500638+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:21.512849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530979+0000","last_change":"2023-11-27T20:44:07.530979+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530979+0000","last_undegraded":"2023-11-27T20:44:07.530979+0000","last_fullsized":"2023-11-27T20:44:07.530979+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521359+0000","last_change":"2023-11-27T20:43:52.736636+0000","last_active":"2023-11-27T20:44:06.521359+0000","last_peered":"2023-11-27T20:44:06.521359+0000","last_clean":"2023-11-27T20:44:06.521359+0000","last_became_active":"2023-11-27T20:43:52.730532+0000","last_became_peered":"2023-11-27T20:43:52.730532+0000","last_unstale":"2023-11-27T20:44:06.521359+0000","last_undegraded":"2023-11-27T20:44:06.521359+0000","last_fullsized":"2023-11-27T20:44:06.521359+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537228+0000","last_change":"2023-11-27T20:44:07.537228+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537228+0000","last_undegraded":"2023-11-27T20:44:07.537228+0000","last_fullsized":"2023-11-27T20:44:07.537228+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.520579+0000","last_change":"2023-11-27T20:43:52.734813+0000","last_active":"2023-11-27T20:44:06.520579+0000","last_peered":"2023-11-27T20:44:06.520579+0000","last_clean":"2023-11-27T20:44:06.520579+0000","last_became_active":"2023-11-27T20:43:52.734472+0000","last_became_peered":"2023-11-27T20:43:52.734472+0000","last_unstale":"2023-11-27T20:44:06.520579+0000","last_undegraded":"2023-11-27T20:44:06.520579+0000","last_fullsized":"2023-11-27T20:44:06.520579+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:00.871014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521140+0000","last_change":"2023-11-27T20:44:07.521140+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521140+0000","last_undegraded":"2023-11-27T20:44:07.521140+0000","last_fullsized":"2023-11-27T20:44:07.521140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.503259+0000","last_change":"2023-11-27T20:43:52.737259+0000","last_active":"2023-11-27T20:44:06.503259+0000","last_peered":"2023-11-27T20:44:06.503259+0000","last_clean":"2023-11-27T20:44:06.503259+0000","last_became_active":"2023-11-27T20:43:52.735819+0000","last_became_peered":"2023-11-27T20:43:52.735819+0000","last_unstale":"2023-11-27T20:44:06.503259+0000","last_undegraded":"2023-11-27T20:44:06.503259+0000","last_fullsized":"2023-11-27T20:44:06.503259+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:42.590467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530684+0000","last_change":"2023-11-27T20:44:07.530684+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530684+0000","last_undegraded":"2023-11-27T20:44:07.530684+0000","last_fullsized":"2023-11-27T20:44:07.530684+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505502+0000","last_change":"2023-11-27T20:43:52.743966+0000","last_active":"2023-11-27T20:44:06.505502+0000","last_peered":"2023-11-27T20:44:06.505502+0000","last_clean":"2023-11-27T20:44:06.505502+0000","last_became_active":"2023-11-27T20:43:52.743629+0000","last_became_peered":"2023-11-27T20:43:52.743629+0000","last_unstale":"2023-11-27T20:44:06.505502+0000","last_undegraded":"2023-11-27T20:44:06.505502+0000","last_fullsized":"2023-11-27T20:44:06.505502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:06.257254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527533+0000","last_change":"2023-11-27T20:44:07.527533+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527533+0000","last_undegraded":"2023-11-27T20:44:07.527533+0000","last_fullsized":"2023-11-27T20:44:07.527533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511481+0000","last_change":"2023-11-27T20:43:52.745826+0000","last_active":"2023-11-27T20:44:06.511481+0000","last_peered":"2023-11-27T20:44:06.511481+0000","last_clean":"2023-11-27T20:44:06.511481+0000","last_became_active":"2023-11-27T20:43:52.745542+0000","last_became_peered":"2023-11-27T20:43:52.745542+0000","last_unstale":"2023-11-27T20:44:06.511481+0000","last_undegraded":"2023-11-27T20:44:06.511481+0000","last_fullsized":"2023-11-27T20:44:06.511481+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:30.595824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525282+0000","last_change":"2023-11-27T20:44:07.525282+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525282+0000","last_undegraded":"2023-11-27T20:44:07.525282+0000","last_fullsized":"2023-11-27T20:44:07.525282+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514319+0000","last_change":"2023-11-27T20:43:52.722794+0000","last_active":"2023-11-27T20:44:06.514319+0000","last_peered":"2023-11-27T20:44:06.514319+0000","last_clean":"2023-11-27T20:44:06.514319+0000","last_became_active":"2023-11-27T20:43:52.722489+0000","last_became_peered":"2023-11-27T20:43:52.722489+0000","last_unstale":"2023-11-27T20:44:06.514319+0000","last_undegraded":"2023-11-27T20:44:06.514319+0000","last_fullsized":"2023-11-27T20:44:06.514319+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:33:24.275033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530733+0000","last_change":"2023-11-27T20:44:07.530733+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530733+0000","last_undegraded":"2023-11-27T20:44:07.530733+0000","last_fullsized":"2023-11-27T20:44:07.530733+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519150+0000","last_change":"2023-11-27T20:43:52.755856+0000","last_active":"2023-11-27T20:44:06.519150+0000","last_peered":"2023-11-27T20:44:06.519150+0000","last_clean":"2023-11-27T20:44:06.519150+0000","last_became_active":"2023-11-27T20:43:52.755447+0000","last_became_peered":"2023-11-27T20:43:52.755447+0000","last_unstale":"2023-11-27T20:44:06.519150+0000","last_undegraded":"2023-11-27T20:44:06.519150+0000","last_fullsized":"2023-11-27T20:44:06.519150+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528962+0000","last_change":"2023-11-27T20:44:07.528962+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528962+0000","last_undegraded":"2023-11-27T20:44:07.528962+0000","last_fullsized":"2023-11-27T20:44:07.528962+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507626+0000","last_change":"2023-11-27T20:43:52.743704+0000","last_active":"2023-11-27T20:44:06.507626+0000","last_peered":"2023-11-27T20:44:06.507626+0000","last_clean":"2023-11-27T20:44:06.507626+0000","last_became_active":"2023-11-27T20:43:52.743440+0000","last_became_peered":"2023-11-27T20:43:52.743440+0000","last_unstale":"2023-11-27T20:44:06.507626+0000","last_undegraded":"2023-11-27T20:44:06.507626+0000","last_fullsized":"2023-11-27T20:44:06.507626+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:40.038308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529520+0000","last_change":"2023-11-27T20:44:07.529520+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529520+0000","last_undegraded":"2023-11-27T20:44:07.529520+0000","last_fullsized":"2023-11-27T20:44:07.529520+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513801+0000","last_change":"2023-11-27T20:43:52.753806+0000","last_active":"2023-11-27T20:44:06.513801+0000","last_peered":"2023-11-27T20:44:06.513801+0000","last_clean":"2023-11-27T20:44:06.513801+0000","last_became_active":"2023-11-27T20:43:52.753119+0000","last_became_peered":"2023-11-27T20:43:52.753119+0000","last_unstale":"2023-11-27T20:44:06.513801+0000","last_undegraded":"2023-11-27T20:44:06.513801+0000","last_fullsized":"2023-11-27T20:44:06.513801+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:44.226522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537041+0000","last_change":"2023-11-27T20:44:07.537041+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537041+0000","last_undegraded":"2023-11-27T20:44:07.537041+0000","last_fullsized":"2023-11-27T20:44:07.537041+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516707+0000","last_change":"2023-11-27T20:43:52.738852+0000","last_active":"2023-11-27T20:44:06.516707+0000","last_peered":"2023-11-27T20:44:06.516707+0000","last_clean":"2023-11-27T20:44:06.516707+0000","last_became_active":"2023-11-27T20:43:52.738571+0000","last_became_peered":"2023-11-27T20:43:52.738571+0000","last_unstale":"2023-11-27T20:44:06.516707+0000","last_undegraded":"2023-11-27T20:44:06.516707+0000","last_fullsized":"2023-11-27T20:44:06.516707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539485+0000","last_change":"2023-11-27T20:44:07.539485+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539485+0000","last_undegraded":"2023-11-27T20:44:07.539485+0000","last_fullsized":"2023-11-27T20:44:07.539485+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511365+0000","last_change":"2023-11-27T20:43:52.734845+0000","last_active":"2023-11-27T20:44:06.511365+0000","last_peered":"2023-11-27T20:44:06.511365+0000","last_clean":"2023-11-27T20:44:06.511365+0000","last_became_active":"2023-11-27T20:43:52.734288+0000","last_became_peered":"2023-11-27T20:43:52.734288+0000","last_unstale":"2023-11-27T20:44:06.511365+0000","last_undegraded":"2023-11-27T20:44:06.511365+0000","last_fullsized":"2023-11-27T20:44:06.511365+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:08:45.447871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521111+0000","last_change":"2023-11-27T20:44:07.521111+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521111+0000","last_undegraded":"2023-11-27T20:44:07.521111+0000","last_fullsized":"2023-11-27T20:44:07.521111+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518661+0000","last_change":"2023-11-27T20:43:52.741528+0000","last_active":"2023-11-27T20:44:06.518661+0000","last_peered":"2023-11-27T20:44:06.518661+0000","last_clean":"2023-11-27T20:44:06.518661+0000","last_became_active":"2023-11-27T20:43:52.741247+0000","last_became_peered":"2023-11-27T20:43:52.741247+0000","last_unstale":"2023-11-27T20:44:06.518661+0000","last_undegraded":"2023-11-27T20:44:06.518661+0000","last_fullsized":"2023-11-27T20:44:06.518661+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521167+0000","last_change":"2023-11-27T20:44:07.521167+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521167+0000","last_undegraded":"2023-11-27T20:44:07.521167+0000","last_fullsized":"2023-11-27T20:44:07.521167+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517222+0000","last_change":"2023-11-27T20:43:52.749184+0000","last_active":"2023-11-27T20:44:06.517222+0000","last_peered":"2023-11-27T20:44:06.517222+0000","last_clean":"2023-11-27T20:44:06.517222+0000","last_became_active":"2023-11-27T20:43:52.747304+0000","last_became_peered":"2023-11-27T20:43:52.747304+0000","last_unstale":"2023-11-27T20:44:06.517222+0000","last_undegraded":"2023-11-27T20:44:06.517222+0000","last_fullsized":"2023-11-27T20:44:06.517222+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:21.580869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527612+0000","last_change":"2023-11-27T20:44:07.527612+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527612+0000","last_undegraded":"2023-11-27T20:44:07.527612+0000","last_fullsized":"2023-11-27T20:44:07.527612+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507945+0000","last_change":"2023-11-27T20:43:52.746466+0000","last_active":"2023-11-27T20:44:06.507945+0000","last_peered":"2023-11-27T20:44:06.507945+0000","last_clean":"2023-11-27T20:44:06.507945+0000","last_became_active":"2023-11-27T20:43:52.746197+0000","last_became_peered":"2023-11-27T20:43:52.746197+0000","last_unstale":"2023-11-27T20:44:06.507945+0000","last_undegraded":"2023-11-27T20:44:06.507945+0000","last_fullsized":"2023-11-27T20:44:06.507945+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:53.742011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.522993+0000","last_change":"2023-11-27T20:44:07.522993+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.522993+0000","last_undegraded":"2023-11-27T20:44:07.522993+0000","last_fullsized":"2023-11-27T20:44:07.522993+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521583+0000","last_change":"2023-11-27T20:43:52.739506+0000","last_active":"2023-11-27T20:44:06.521583+0000","last_peered":"2023-11-27T20:44:06.521583+0000","last_clean":"2023-11-27T20:44:06.521583+0000","last_became_active":"2023-11-27T20:43:52.739234+0000","last_became_peered":"2023-11-27T20:43:52.739234+0000","last_unstale":"2023-11-27T20:44:06.521583+0000","last_undegraded":"2023-11-27T20:44:06.521583+0000","last_fullsized":"2023-11-27T20:44:06.521583+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:32.431178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524843+0000","last_change":"2023-11-27T20:44:07.524843+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524843+0000","last_undegraded":"2023-11-27T20:44:07.524843+0000","last_fullsized":"2023-11-27T20:44:07.524843+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513010+0000","last_change":"2023-11-27T20:43:52.758309+0000","last_active":"2023-11-27T20:44:06.513010+0000","last_peered":"2023-11-27T20:44:06.513010+0000","last_clean":"2023-11-27T20:44:06.513010+0000","last_became_active":"2023-11-27T20:43:52.755787+0000","last_became_peered":"2023-11-27T20:43:52.755787+0000","last_unstale":"2023-11-27T20:44:06.513010+0000","last_undegraded":"2023-11-27T20:44:06.513010+0000","last_fullsized":"2023-11-27T20:44:06.513010+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.536848+0000","last_change":"2023-11-27T20:44:07.536848+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.536848+0000","last_undegraded":"2023-11-27T20:44:07.536848+0000","last_fullsized":"2023-11-27T20:44:07.536848+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506125+0000","last_change":"2023-11-27T20:43:52.743954+0000","last_active":"2023-11-27T20:44:06.506125+0000","last_peered":"2023-11-27T20:44:06.506125+0000","last_clean":"2023-11-27T20:44:06.506125+0000","last_became_active":"2023-11-27T20:43:52.743696+0000","last_became_peered":"2023-11-27T20:43:52.743696+0000","last_unstale":"2023-11-27T20:44:06.506125+0000","last_undegraded":"2023-11-27T20:44:06.506125+0000","last_fullsized":"2023-11-27T20:44:06.506125+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:35.875636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530894+0000","last_change":"2023-11-27T20:44:07.530894+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530894+0000","last_undegraded":"2023-11-27T20:44:07.530894+0000","last_fullsized":"2023-11-27T20:44:07.530894+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513909+0000","last_change":"2023-11-27T20:43:52.740150+0000","last_active":"2023-11-27T20:44:06.513909+0000","last_peered":"2023-11-27T20:44:06.513909+0000","last_clean":"2023-11-27T20:44:06.513909+0000","last_became_active":"2023-11-27T20:43:52.735557+0000","last_became_peered":"2023-11-27T20:43:52.735557+0000","last_unstale":"2023-11-27T20:44:06.513909+0000","last_undegraded":"2023-11-27T20:44:06.513909+0000","last_fullsized":"2023-11-27T20:44:06.513909+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:26:49.710558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.522867+0000","last_change":"2023-11-27T20:44:07.522867+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.522867+0000","last_undegraded":"2023-11-27T20:44:07.522867+0000","last_fullsized":"2023-11-27T20:44:07.522867+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513742+0000","last_change":"2023-11-27T20:43:52.743341+0000","last_active":"2023-11-27T20:44:06.513742+0000","last_peered":"2023-11-27T20:44:06.513742+0000","last_clean":"2023-11-27T20:44:06.513742+0000","last_became_active":"2023-11-27T20:43:52.742947+0000","last_became_peered":"2023-11-27T20:43:52.742947+0000","last_unstale":"2023-11-27T20:44:06.513742+0000","last_undegraded":"2023-11-27T20:44:06.513742+0000","last_fullsized":"2023-11-27T20:44:06.513742+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:30.595824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525868+0000","last_change":"2023-11-27T20:44:07.525868+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525868+0000","last_undegraded":"2023-11-27T20:44:07.525868+0000","last_fullsized":"2023-11-27T20:44:07.525868+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505911+0000","last_change":"2023-11-27T20:43:52.746463+0000","last_active":"2023-11-27T20:44:06.505911+0000","last_peered":"2023-11-27T20:44:06.505911+0000","last_clean":"2023-11-27T20:44:06.505911+0000","last_became_active":"2023-11-27T20:43:52.746028+0000","last_became_peered":"2023-11-27T20:43:52.746028+0000","last_unstale":"2023-11-27T20:44:06.505911+0000","last_undegraded":"2023-11-27T20:44:06.505911+0000","last_fullsized":"2023-11-27T20:44:06.505911+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:00.873986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.532834+0000","last_change":"2023-11-27T20:44:07.532834+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.532834+0000","last_undegraded":"2023-11-27T20:44:07.532834+0000","last_fullsized":"2023-11-27T20:44:07.532834+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511596+0000","last_change":"2023-11-27T20:43:52.757800+0000","last_active":"2023-11-27T20:44:06.511596+0000","last_peered":"2023-11-27T20:44:06.511596+0000","last_clean":"2023-11-27T20:44:06.511596+0000","last_became_active":"2023-11-27T20:43:52.755994+0000","last_became_peered":"2023-11-27T20:43:52.755994+0000","last_unstale":"2023-11-27T20:44:06.511596+0000","last_undegraded":"2023-11-27T20:44:06.511596+0000","last_fullsized":"2023-11-27T20:44:06.511596+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528764+0000","last_change":"2023-11-27T20:44:07.528764+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528764+0000","last_undegraded":"2023-11-27T20:44:07.528764+0000","last_fullsized":"2023-11-27T20:44:07.528764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.545677+0000","last_change":"2023-11-27T20:44:07.540451+0000","last_active":"2023-11-27T20:44:07.545677+0000","last_peered":"2023-11-27T20:44:07.545677+0000","last_clean":"2023-11-27T20:44:07.545677+0000","last_became_active":"2023-11-27T20:44:07.540140+0000","last_became_peered":"2023-11-27T20:44:07.540140+0000","last_unstale":"2023-11-27T20:44:07.545677+0000","last_undegraded":"2023-11-27T20:44:07.545677+0000","last_fullsized":"2023-11-27T20:44:07.545677+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:34.727698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513103+0000","last_change":"2023-11-27T20:43:52.755932+0000","last_active":"2023-11-27T20:44:06.513103+0000","last_peered":"2023-11-27T20:44:06.513103+0000","last_clean":"2023-11-27T20:44:06.513103+0000","last_became_active":"2023-11-27T20:43:52.751888+0000","last_became_peered":"2023-11-27T20:43:52.751888+0000","last_unstale":"2023-11-27T20:44:06.513103+0000","last_undegraded":"2023-11-27T20:44:06.513103+0000","last_fullsized":"2023-11-27T20:44:06.513103+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:19.340689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513396+0000","last_change":"2023-11-27T20:43:51.704982+0000","last_active":"2023-11-27T20:44:06.513396+0000","last_peered":"2023-11-27T20:44:06.513396+0000","last_clean":"2023-11-27T20:44:06.513396+0000","last_became_active":"2023-11-27T20:43:51.703346+0000","last_became_peered":"2023-11-27T20:43:51.703346+0000","last_unstale":"2023-11-27T20:44:06.513396+0000","last_undegraded":"2023-11-27T20:44:06.513396+0000","last_fullsized":"2023-11-27T20:44:06.513396+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:53.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539753+0000","last_change":"2023-11-27T20:44:07.539753+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539753+0000","last_undegraded":"2023-11-27T20:44:07.539753+0000","last_fullsized":"2023-11-27T20:44:07.539753+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.551999+0000","last_change":"2023-11-27T20:44:07.548707+0000","last_active":"2023-11-27T20:44:07.551999+0000","last_peered":"2023-11-27T20:44:07.551999+0000","last_clean":"2023-11-27T20:44:07.551999+0000","last_became_active":"2023-11-27T20:44:07.544542+0000","last_became_peered":"2023-11-27T20:44:07.544542+0000","last_unstale":"2023-11-27T20:44:07.551999+0000","last_undegraded":"2023-11-27T20:44:07.551999+0000","last_fullsized":"2023-11-27T20:44:07.551999+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:08.453722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500681+0000","last_change":"2023-11-27T20:43:52.736197+0000","last_active":"2023-11-27T20:44:06.500681+0000","last_peered":"2023-11-27T20:44:06.500681+0000","last_clean":"2023-11-27T20:44:06.500681+0000","last_became_active":"2023-11-27T20:43:52.735889+0000","last_became_peered":"2023-11-27T20:43:52.735889+0000","last_unstale":"2023-11-27T20:44:06.500681+0000","last_undegraded":"2023-11-27T20:44:06.500681+0000","last_fullsized":"2023-11-27T20:44:06.500681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:46.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514100+0000","last_change":"2023-11-27T20:43:51.711368+0000","last_active":"2023-11-27T20:44:06.514100+0000","last_peered":"2023-11-27T20:44:06.514100+0000","last_clean":"2023-11-27T20:44:06.514100+0000","last_became_active":"2023-11-27T20:43:51.711087+0000","last_became_peered":"2023-11-27T20:43:51.711087+0000","last_unstale":"2023-11-27T20:44:06.514100+0000","last_undegraded":"2023-11-27T20:44:06.514100+0000","last_fullsized":"2023-11-27T20:44:06.514100+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:54.352803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.536855+0000","last_change":"2023-11-27T20:44:07.536855+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.536855+0000","last_undegraded":"2023-11-27T20:44:07.536855+0000","last_fullsized":"2023-11-27T20:44:07.536855+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.556568+0000","last_change":"2023-11-27T20:44:07.554191+0000","last_active":"2023-11-27T20:44:07.556568+0000","last_peered":"2023-11-27T20:44:07.556568+0000","last_clean":"2023-11-27T20:44:07.556568+0000","last_became_active":"2023-11-27T20:44:07.553915+0000","last_became_peered":"2023-11-27T20:44:07.553915+0000","last_unstale":"2023-11-27T20:44:07.556568+0000","last_undegraded":"2023-11-27T20:44:07.556568+0000","last_fullsized":"2023-11-27T20:44:07.556568+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:50.983600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512394+0000","last_change":"2023-11-27T20:43:52.759667+0000","last_active":"2023-11-27T20:44:06.512394+0000","last_peered":"2023-11-27T20:44:06.512394+0000","last_clean":"2023-11-27T20:44:06.512394+0000","last_became_active":"2023-11-27T20:43:52.759386+0000","last_became_peered":"2023-11-27T20:43:52.759386+0000","last_unstale":"2023-11-27T20:44:06.512394+0000","last_undegraded":"2023-11-27T20:44:06.512394+0000","last_fullsized":"2023-11-27T20:44:06.512394+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513309+0000","last_change":"2023-11-27T20:43:51.699372+0000","last_active":"2023-11-27T20:44:06.513309+0000","last_peered":"2023-11-27T20:44:06.513309+0000","last_clean":"2023-11-27T20:44:06.513309+0000","last_became_active":"2023-11-27T20:43:51.698989+0000","last_became_peered":"2023-11-27T20:43:51.698989+0000","last_unstale":"2023-11-27T20:44:06.513309+0000","last_undegraded":"2023-11-27T20:44:06.513309+0000","last_fullsized":"2023-11-27T20:44:06.513309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:29.612413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527825+0000","last_change":"2023-11-27T20:44:07.527825+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527825+0000","last_undegraded":"2023-11-27T20:44:07.527825+0000","last_fullsized":"2023-11-27T20:44:07.527825+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.544789+0000","last_change":"2023-11-27T20:44:07.543034+0000","last_active":"2023-11-27T20:44:07.544789+0000","last_peered":"2023-11-27T20:44:07.544789+0000","last_clean":"2023-11-27T20:44:07.544789+0000","last_became_active":"2023-11-27T20:44:07.542752+0000","last_became_peered":"2023-11-27T20:44:07.542752+0000","last_unstale":"2023-11-27T20:44:07.544789+0000","last_undegraded":"2023-11-27T20:44:07.544789+0000","last_fullsized":"2023-11-27T20:44:07.544789+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:10.575183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513504+0000","last_change":"2023-11-27T20:43:52.746554+0000","last_active":"2023-11-27T20:44:06.513504+0000","last_peered":"2023-11-27T20:44:06.513504+0000","last_clean":"2023-11-27T20:44:06.513504+0000","last_became_active":"2023-11-27T20:43:52.746133+0000","last_became_peered":"2023-11-27T20:43:52.746133+0000","last_unstale":"2023-11-27T20:44:06.513504+0000","last_undegraded":"2023-11-27T20:44:06.513504+0000","last_fullsized":"2023-11-27T20:44:06.513504+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:55.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521352+0000","last_change":"2023-11-27T20:43:51.707254+0000","last_active":"2023-11-27T20:44:06.521352+0000","last_peered":"2023-11-27T20:44:06.521352+0000","last_clean":"2023-11-27T20:44:06.521352+0000","last_became_active":"2023-11-27T20:43:51.706908+0000","last_became_peered":"2023-11-27T20:43:51.706908+0000","last_unstale":"2023-11-27T20:44:06.521352+0000","last_undegraded":"2023-11-27T20:44:06.521352+0000","last_fullsized":"2023-11-27T20:44:06.521352+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:04.233780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526427+0000","last_change":"2023-11-27T20:44:07.526427+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526427+0000","last_undegraded":"2023-11-27T20:44:07.526427+0000","last_fullsized":"2023-11-27T20:44:07.526427+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.539459+0000","last_change":"2023-11-27T20:44:07.535849+0000","last_active":"2023-11-27T20:44:07.539459+0000","last_peered":"2023-11-27T20:44:07.539459+0000","last_clean":"2023-11-27T20:44:07.539459+0000","last_became_active":"2023-11-27T20:44:07.535564+0000","last_became_peered":"2023-11-27T20:44:07.535564+0000","last_unstale":"2023-11-27T20:44:07.539459+0000","last_undegraded":"2023-11-27T20:44:07.539459+0000","last_fullsized":"2023-11-27T20:44:07.539459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:29.891814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511441+0000","last_change":"2023-11-27T20:43:52.734666+0000","last_active":"2023-11-27T20:44:06.511441+0000","last_peered":"2023-11-27T20:44:06.511441+0000","last_clean":"2023-11-27T20:44:06.511441+0000","last_became_active":"2023-11-27T20:43:52.733983+0000","last_became_peered":"2023-11-27T20:43:52.733983+0000","last_unstale":"2023-11-27T20:44:06.511441+0000","last_undegraded":"2023-11-27T20:44:06.511441+0000","last_fullsized":"2023-11-27T20:44:06.511441+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:55.762089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507244+0000","last_change":"2023-11-27T20:43:51.711467+0000","last_active":"2023-11-27T20:44:06.507244+0000","last_peered":"2023-11-27T20:44:06.507244+0000","last_clean":"2023-11-27T20:44:06.507244+0000","last_became_active":"2023-11-27T20:43:51.711141+0000","last_became_peered":"2023-11-27T20:43:51.711141+0000","last_unstale":"2023-11-27T20:44:06.507244+0000","last_undegraded":"2023-11-27T20:44:06.507244+0000","last_fullsized":"2023-11-27T20:44:06.507244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:14.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530389+0000","last_change":"2023-11-27T20:44:07.530389+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530389+0000","last_undegraded":"2023-11-27T20:44:07.530389+0000","last_fullsized":"2023-11-27T20:44:07.530389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547796+0000","last_change":"2023-11-27T20:44:07.546578+0000","last_active":"2023-11-27T20:44:07.547796+0000","last_peered":"2023-11-27T20:44:07.547796+0000","last_clean":"2023-11-27T20:44:07.547796+0000","last_became_active":"2023-11-27T20:44:07.545547+0000","last_became_peered":"2023-11-27T20:44:07.545547+0000","last_unstale":"2023-11-27T20:44:07.547796+0000","last_undegraded":"2023-11-27T20:44:07.547796+0000","last_fullsized":"2023-11-27T20:44:07.547796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:55.426778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513740+0000","last_change":"2023-11-27T20:43:52.740355+0000","last_active":"2023-11-27T20:44:06.513740+0000","last_peered":"2023-11-27T20:44:06.513740+0000","last_clean":"2023-11-27T20:44:06.513740+0000","last_became_active":"2023-11-27T20:43:52.739879+0000","last_became_peered":"2023-11-27T20:43:52.739879+0000","last_unstale":"2023-11-27T20:44:06.513740+0000","last_undegraded":"2023-11-27T20:44:06.513740+0000","last_fullsized":"2023-11-27T20:44:06.513740+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:08:26.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511517+0000","last_change":"2023-11-27T20:43:51.701819+0000","last_active":"2023-11-27T20:44:06.511517+0000","last_peered":"2023-11-27T20:44:06.511517+0000","last_clean":"2023-11-27T20:44:06.511517+0000","last_became_active":"2023-11-27T20:43:51.701542+0000","last_became_peered":"2023-11-27T20:43:51.701542+0000","last_unstale":"2023-11-27T20:44:06.511517+0000","last_undegraded":"2023-11-27T20:44:06.511517+0000","last_fullsized":"2023-11-27T20:44:06.511517+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:53.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529870+0000","last_change":"2023-11-27T20:44:07.529870+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529870+0000","last_undegraded":"2023-11-27T20:44:07.529870+0000","last_fullsized":"2023-11-27T20:44:07.529870+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.544729+0000","last_change":"2023-11-27T20:44:07.538342+0000","last_active":"2023-11-27T20:44:07.544729+0000","last_peered":"2023-11-27T20:44:07.544729+0000","last_clean":"2023-11-27T20:44:07.544729+0000","last_became_active":"2023-11-27T20:44:07.538037+0000","last_became_peered":"2023-11-27T20:44:07.538037+0000","last_unstale":"2023-11-27T20:44:07.544729+0000","last_undegraded":"2023-11-27T20:44:07.544729+0000","last_fullsized":"2023-11-27T20:44:07.544729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:29:08.542478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515412+0000","last_change":"2023-11-27T20:43:52.735677+0000","last_active":"2023-11-27T20:44:06.515412+0000","last_peered":"2023-11-27T20:44:06.515412+0000","last_clean":"2023-11-27T20:44:06.515412+0000","last_became_active":"2023-11-27T20:43:52.734624+0000","last_became_peered":"2023-11-27T20:43:52.734624+0000","last_unstale":"2023-11-27T20:44:06.515412+0000","last_undegraded":"2023-11-27T20:44:06.515412+0000","last_fullsized":"2023-11-27T20:44:06.515412+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:42.798849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519354+0000","last_change":"2023-11-27T20:43:51.706490+0000","last_active":"2023-11-27T20:44:06.519354+0000","last_peered":"2023-11-27T20:44:06.519354+0000","last_clean":"2023-11-27T20:44:06.519354+0000","last_became_active":"2023-11-27T20:43:51.706181+0000","last_became_peered":"2023-11-27T20:43:51.706181+0000","last_unstale":"2023-11-27T20:44:06.519354+0000","last_undegraded":"2023-11-27T20:44:06.519354+0000","last_fullsized":"2023-11-27T20:44:06.519354+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:41.580304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523700+0000","last_change":"2023-11-27T20:44:07.523700+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523700+0000","last_undegraded":"2023-11-27T20:44:07.523700+0000","last_fullsized":"2023-11-27T20:44:07.523700+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.548497+0000","last_change":"2023-11-27T20:44:07.543638+0000","last_active":"2023-11-27T20:44:07.548497+0000","last_peered":"2023-11-27T20:44:07.548497+0000","last_clean":"2023-11-27T20:44:07.548497+0000","last_became_active":"2023-11-27T20:44:07.543049+0000","last_became_peered":"2023-11-27T20:44:07.543049+0000","last_unstale":"2023-11-27T20:44:07.548497+0000","last_undegraded":"2023-11-27T20:44:07.548497+0000","last_fullsized":"2023-11-27T20:44:07.548497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:38.215762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511164+0000","last_change":"2023-11-27T20:43:52.732611+0000","last_active":"2023-11-27T20:44:06.511164+0000","last_peered":"2023-11-27T20:44:06.511164+0000","last_clean":"2023-11-27T20:44:06.511164+0000","last_became_active":"2023-11-27T20:43:52.732338+0000","last_became_peered":"2023-11-27T20:43:52.732338+0000","last_unstale":"2023-11-27T20:44:06.511164+0000","last_undegraded":"2023-11-27T20:44:06.511164+0000","last_fullsized":"2023-11-27T20:44:06.511164+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:36.170506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506363+0000","last_change":"2023-11-27T20:43:51.712506+0000","last_active":"2023-11-27T20:44:06.506363+0000","last_peered":"2023-11-27T20:44:06.506363+0000","last_clean":"2023-11-27T20:44:06.506363+0000","last_became_active":"2023-11-27T20:43:51.712167+0000","last_became_peered":"2023-11-27T20:43:51.712167+0000","last_unstale":"2023-11-27T20:44:06.506363+0000","last_undegraded":"2023-11-27T20:44:06.506363+0000","last_fullsized":"2023-11-27T20:44:06.506363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:20.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528088+0000","last_change":"2023-11-27T20:44:07.528088+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528088+0000","last_undegraded":"2023-11-27T20:44:07.528088+0000","last_fullsized":"2023-11-27T20:44:07.528088+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547939+0000","last_change":"2023-11-27T20:44:07.541198+0000","last_active":"2023-11-27T20:44:07.547939+0000","last_peered":"2023-11-27T20:44:07.547939+0000","last_clean":"2023-11-27T20:44:07.547939+0000","last_became_active":"2023-11-27T20:44:07.540715+0000","last_became_peered":"2023-11-27T20:44:07.540715+0000","last_unstale":"2023-11-27T20:44:07.547939+0000","last_undegraded":"2023-11-27T20:44:07.547939+0000","last_fullsized":"2023-11-27T20:44:07.547939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:33:36.245172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.509400+0000","last_change":"2023-11-27T20:43:52.743697+0000","last_active":"2023-11-27T20:44:06.509400+0000","last_peered":"2023-11-27T20:44:06.509400+0000","last_clean":"2023-11-27T20:44:06.509400+0000","last_became_active":"2023-11-27T20:43:52.743405+0000","last_became_peered":"2023-11-27T20:43:52.743405+0000","last_unstale":"2023-11-27T20:44:06.509400+0000","last_undegraded":"2023-11-27T20:44:06.509400+0000","last_fullsized":"2023-11-27T20:44:06.509400+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519933+0000","last_change":"2023-11-27T20:43:51.716942+0000","last_active":"2023-11-27T20:44:06.519933+0000","last_peered":"2023-11-27T20:44:06.519933+0000","last_clean":"2023-11-27T20:44:06.519933+0000","last_became_active":"2023-11-27T20:43:51.716549+0000","last_became_peered":"2023-11-27T20:43:51.716549+0000","last_unstale":"2023-11-27T20:44:06.519933+0000","last_undegraded":"2023-11-27T20:44:06.519933+0000","last_fullsized":"2023-11-27T20:44:06.519933+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529398+0000","last_change":"2023-11-27T20:44:07.529398+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529398+0000","last_undegraded":"2023-11-27T20:44:07.529398+0000","last_fullsized":"2023-11-27T20:44:07.529398+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.543312+0000","last_change":"2023-11-27T20:44:07.540741+0000","last_active":"2023-11-27T20:44:07.543312+0000","last_peered":"2023-11-27T20:44:07.543312+0000","last_clean":"2023-11-27T20:44:07.543312+0000","last_became_active":"2023-11-27T20:44:07.540459+0000","last_became_peered":"2023-11-27T20:44:07.540459+0000","last_unstale":"2023-11-27T20:44:07.543312+0000","last_undegraded":"2023-11-27T20:44:07.543312+0000","last_fullsized":"2023-11-27T20:44:07.543312+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:38.215762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519822+0000","last_change":"2023-11-27T20:43:52.747269+0000","last_active":"2023-11-27T20:44:06.519822+0000","last_peered":"2023-11-27T20:44:06.519822+0000","last_clean":"2023-11-27T20:44:06.519822+0000","last_became_active":"2023-11-27T20:43:52.746473+0000","last_became_peered":"2023-11-27T20:43:52.746473+0000","last_unstale":"2023-11-27T20:44:06.519822+0000","last_undegraded":"2023-11-27T20:44:06.519822+0000","last_fullsized":"2023-11-27T20:44:06.519822+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:55.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514190+0000","last_change":"2023-11-27T20:43:51.711346+0000","last_active":"2023-11-27T20:44:06.514190+0000","last_peered":"2023-11-27T20:44:06.514190+0000","last_clean":"2023-11-27T20:44:06.514190+0000","last_became_active":"2023-11-27T20:43:51.711060+0000","last_became_peered":"2023-11-27T20:43:51.711060+0000","last_unstale":"2023-11-27T20:44:06.514190+0000","last_undegraded":"2023-11-27T20:44:06.514190+0000","last_fullsized":"2023-11-27T20:44:06.514190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:18.330525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531925+0000","last_change":"2023-11-27T20:44:07.531925+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531925+0000","last_undegraded":"2023-11-27T20:44:07.531925+0000","last_fullsized":"2023-11-27T20:44:07.531925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.541276+0000","last_change":"2023-11-27T20:44:07.537248+0000","last_active":"2023-11-27T20:44:07.541276+0000","last_peered":"2023-11-27T20:44:07.541276+0000","last_clean":"2023-11-27T20:44:07.541276+0000","last_became_active":"2023-11-27T20:44:07.535963+0000","last_became_peered":"2023-11-27T20:44:07.535963+0000","last_unstale":"2023-11-27T20:44:07.541276+0000","last_undegraded":"2023-11-27T20:44:07.541276+0000","last_fullsized":"2023-11-27T20:44:07.541276+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:43.756684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500291+0000","last_change":"2023-11-27T20:43:52.738413+0000","last_active":"2023-11-27T20:44:06.500291+0000","last_peered":"2023-11-27T20:44:06.500291+0000","last_clean":"2023-11-27T20:44:06.500291+0000","last_became_active":"2023-11-27T20:43:52.738105+0000","last_became_peered":"2023-11-27T20:43:52.738105+0000","last_unstale":"2023-11-27T20:44:06.500291+0000","last_undegraded":"2023-11-27T20:44:06.500291+0000","last_fullsized":"2023-11-27T20:44:06.500291+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:00.871014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518398+0000","last_change":"2023-11-27T20:43:51.716907+0000","last_active":"2023-11-27T20:44:06.518398+0000","last_peered":"2023-11-27T20:44:06.518398+0000","last_clean":"2023-11-27T20:44:06.518398+0000","last_became_active":"2023-11-27T20:43:51.716616+0000","last_became_peered":"2023-11-27T20:43:51.716616+0000","last_unstale":"2023-11-27T20:44:06.518398+0000","last_undegraded":"2023-11-27T20:44:06.518398+0000","last_fullsized":"2023-11-27T20:44:06.518398+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.538067+0000","last_change":"2023-11-27T20:44:07.538067+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.538067+0000","last_undegraded":"2023-11-27T20:44:07.538067+0000","last_fullsized":"2023-11-27T20:44:07.538067+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.556080+0000","last_change":"2023-11-27T20:44:07.553474+0000","last_active":"2023-11-27T20:44:07.556080+0000","last_peered":"2023-11-27T20:44:07.556080+0000","last_clean":"2023-11-27T20:44:07.556080+0000","last_became_active":"2023-11-27T20:44:07.553184+0000","last_became_peered":"2023-11-27T20:44:07.553184+0000","last_unstale":"2023-11-27T20:44:07.556080+0000","last_undegraded":"2023-11-27T20:44:07.556080+0000","last_fullsized":"2023-11-27T20:44:07.556080+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:21.070349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517989+0000","last_change":"2023-11-27T20:43:52.740853+0000","last_active":"2023-11-27T20:44:06.517989+0000","last_peered":"2023-11-27T20:44:06.517989+0000","last_clean":"2023-11-27T20:44:06.517989+0000","last_became_active":"2023-11-27T20:43:52.740468+0000","last_became_peered":"2023-11-27T20:43:52.740468+0000","last_unstale":"2023-11-27T20:44:06.517989+0000","last_undegraded":"2023-11-27T20:44:06.517989+0000","last_fullsized":"2023-11-27T20:44:06.517989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'8","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.508060+0000","last_change":"2023-11-27T20:43:51.711651+0000","last_active":"2023-11-27T20:44:06.508060+0000","last_peered":"2023-11-27T20:44:06.508060+0000","last_clean":"2023-11-27T20:44:06.508060+0000","last_became_active":"2023-11-27T20:43:51.711270+0000","last_became_peered":"2023-11-27T20:43:51.711270+0000","last_unstale":"2023-11-27T20:44:06.508060+0000","last_undegraded":"2023-11-27T20:44:06.508060+0000","last_fullsized":"2023-11-27T20:44:06.508060+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:07.560276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.532546+0000","last_change":"2023-11-27T20:44:07.532546+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.532546+0000","last_undegraded":"2023-11-27T20:44:07.532546+0000","last_fullsized":"2023-11-27T20:44:07.532546+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552434+0000","last_change":"2023-11-27T20:44:07.550573+0000","last_active":"2023-11-27T20:44:07.552434+0000","last_peered":"2023-11-27T20:44:07.552434+0000","last_clean":"2023-11-27T20:44:07.552434+0000","last_became_active":"2023-11-27T20:44:07.549497+0000","last_became_peered":"2023-11-27T20:44:07.549497+0000","last_unstale":"2023-11-27T20:44:07.552434+0000","last_undegraded":"2023-11-27T20:44:07.552434+0000","last_fullsized":"2023-11-27T20:44:07.552434+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:17.251945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517767+0000","last_change":"2023-11-27T20:43:52.731258+0000","last_active":"2023-11-27T20:44:06.517767+0000","last_peered":"2023-11-27T20:44:06.517767+0000","last_clean":"2023-11-27T20:44:06.517767+0000","last_became_active":"2023-11-27T20:43:52.730701+0000","last_became_peered":"2023-11-27T20:43:52.730701+0000","last_unstale":"2023-11-27T20:44:06.517767+0000","last_undegraded":"2023-11-27T20:44:06.517767+0000","last_fullsized":"2023-11-27T20:44:06.517767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:28.943589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513829+0000","last_change":"2023-11-27T20:43:51.709141+0000","last_active":"2023-11-27T20:44:06.513829+0000","last_peered":"2023-11-27T20:44:06.513829+0000","last_clean":"2023-11-27T20:44:06.513829+0000","last_became_active":"2023-11-27T20:43:51.708864+0000","last_became_peered":"2023-11-27T20:43:51.708864+0000","last_unstale":"2023-11-27T20:44:06.513829+0000","last_undegraded":"2023-11-27T20:44:06.513829+0000","last_fullsized":"2023-11-27T20:44:06.513829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:29.585661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531534+0000","last_change":"2023-11-27T20:44:07.531534+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531534+0000","last_undegraded":"2023-11-27T20:44:07.531534+0000","last_fullsized":"2023-11-27T20:44:07.531534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.555776+0000","last_change":"2023-11-27T20:44:07.553337+0000","last_active":"2023-11-27T20:44:07.555776+0000","last_peered":"2023-11-27T20:44:07.555776+0000","last_clean":"2023-11-27T20:44:07.555776+0000","last_became_active":"2023-11-27T20:44:07.552962+0000","last_became_peered":"2023-11-27T20:44:07.552962+0000","last_unstale":"2023-11-27T20:44:07.555776+0000","last_undegraded":"2023-11-27T20:44:07.555776+0000","last_fullsized":"2023-11-27T20:44:07.555776+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:16:09.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516879+0000","last_change":"2023-11-27T20:43:52.736912+0000","last_active":"2023-11-27T20:44:06.516879+0000","last_peered":"2023-11-27T20:44:06.516879+0000","last_clean":"2023-11-27T20:44:06.516879+0000","last_became_active":"2023-11-27T20:43:52.735675+0000","last_became_peered":"2023-11-27T20:43:52.735675+0000","last_unstale":"2023-11-27T20:44:06.516879+0000","last_undegraded":"2023-11-27T20:44:06.516879+0000","last_fullsized":"2023-11-27T20:44:06.516879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517569+0000","last_change":"2023-11-27T20:43:51.711938+0000","last_active":"2023-11-27T20:44:06.517569+0000","last_peered":"2023-11-27T20:44:06.517569+0000","last_clean":"2023-11-27T20:44:06.517569+0000","last_became_active":"2023-11-27T20:43:51.711617+0000","last_became_peered":"2023-11-27T20:43:51.711617+0000","last_unstale":"2023-11-27T20:44:06.517569+0000","last_undegraded":"2023-11-27T20:44:06.517569+0000","last_fullsized":"2023-11-27T20:44:06.517569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:54.146026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537759+0000","last_change":"2023-11-27T20:44:07.537759+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537759+0000","last_undegraded":"2023-11-27T20:44:07.537759+0000","last_fullsized":"2023-11-27T20:44:07.537759+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.553685+0000","last_change":"2023-11-27T20:44:07.550581+0000","last_active":"2023-11-27T20:44:07.553685+0000","last_peered":"2023-11-27T20:44:07.553685+0000","last_clean":"2023-11-27T20:44:07.553685+0000","last_became_active":"2023-11-27T20:44:07.549832+0000","last_became_peered":"2023-11-27T20:44:07.549832+0000","last_unstale":"2023-11-27T20:44:07.553685+0000","last_undegraded":"2023-11-27T20:44:07.553685+0000","last_fullsized":"2023-11-27T20:44:07.553685+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:32.588898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506128+0000","last_change":"2023-11-27T20:43:52.742672+0000","last_active":"2023-11-27T20:44:06.506128+0000","last_peered":"2023-11-27T20:44:06.506128+0000","last_clean":"2023-11-27T20:44:06.506128+0000","last_became_active":"2023-11-27T20:43:52.742066+0000","last_became_peered":"2023-11-27T20:43:52.742066+0000","last_unstale":"2023-11-27T20:44:06.506128+0000","last_undegraded":"2023-11-27T20:44:06.506128+0000","last_fullsized":"2023-11-27T20:44:06.506128+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:01.982839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519493+0000","last_change":"2023-11-27T20:43:51.711077+0000","last_active":"2023-11-27T20:44:06.519493+0000","last_peered":"2023-11-27T20:44:06.519493+0000","last_clean":"2023-11-27T20:44:06.519493+0000","last_became_active":"2023-11-27T20:43:51.710820+0000","last_became_peered":"2023-11-27T20:43:51.710820+0000","last_unstale":"2023-11-27T20:44:06.519493+0000","last_undegraded":"2023-11-27T20:44:06.519493+0000","last_fullsized":"2023-11-27T20:44:06.519493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:21.429946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529666+0000","last_change":"2023-11-27T20:44:07.529666+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529666+0000","last_undegraded":"2023-11-27T20:44:07.529666+0000","last_fullsized":"2023-11-27T20:44:07.529666+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.549409+0000","last_change":"2023-11-27T20:44:07.547343+0000","last_active":"2023-11-27T20:44:07.549409+0000","last_peered":"2023-11-27T20:44:07.549409+0000","last_clean":"2023-11-27T20:44:07.549409+0000","last_became_active":"2023-11-27T20:44:07.547004+0000","last_became_peered":"2023-11-27T20:44:07.547004+0000","last_unstale":"2023-11-27T20:44:07.549409+0000","last_undegraded":"2023-11-27T20:44:07.549409+0000","last_fullsized":"2023-11-27T20:44:07.549409+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:32.700621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518818+0000","last_change":"2023-11-27T20:43:52.742494+0000","last_active":"2023-11-27T20:44:06.518818+0000","last_peered":"2023-11-27T20:44:06.518818+0000","last_clean":"2023-11-27T20:44:06.518818+0000","last_became_active":"2023-11-27T20:43:52.742174+0000","last_became_peered":"2023-11-27T20:43:52.742174+0000","last_unstale":"2023-11-27T20:44:06.518818+0000","last_undegraded":"2023-11-27T20:44:06.518818+0000","last_fullsized":"2023-11-27T20:44:06.518818+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515344+0000","last_change":"2023-11-27T20:43:51.714679+0000","last_active":"2023-11-27T20:44:06.515344+0000","last_peered":"2023-11-27T20:44:06.515344+0000","last_clean":"2023-11-27T20:44:06.515344+0000","last_became_active":"2023-11-27T20:43:51.714406+0000","last_became_peered":"2023-11-27T20:43:51.714406+0000","last_unstale":"2023-11-27T20:44:06.515344+0000","last_undegraded":"2023-11-27T20:44:06.515344+0000","last_fullsized":"2023-11-27T20:44:06.515344+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:27.933426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530632+0000","last_change":"2023-11-27T20:44:07.530632+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530632+0000","last_undegraded":"2023-11-27T20:44:07.530632+0000","last_fullsized":"2023-11-27T20:44:07.530632+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.548455+0000","last_change":"2023-11-27T20:44:07.544501+0000","last_active":"2023-11-27T20:44:07.548455+0000","last_peered":"2023-11-27T20:44:07.548455+0000","last_clean":"2023-11-27T20:44:07.548455+0000","last_became_active":"2023-11-27T20:44:07.542118+0000","last_became_peered":"2023-11-27T20:44:07.542118+0000","last_unstale":"2023-11-27T20:44:07.548455+0000","last_undegraded":"2023-11-27T20:44:07.548455+0000","last_fullsized":"2023-11-27T20:44:07.548455+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:23.383534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519295+0000","last_change":"2023-11-27T20:43:52.743633+0000","last_active":"2023-11-27T20:44:06.519295+0000","last_peered":"2023-11-27T20:44:06.519295+0000","last_clean":"2023-11-27T20:44:06.519295+0000","last_became_active":"2023-11-27T20:43:52.743243+0000","last_became_peered":"2023-11-27T20:43:52.743243+0000","last_unstale":"2023-11-27T20:44:06.519295+0000","last_undegraded":"2023-11-27T20:44:06.519295+0000","last_fullsized":"2023-11-27T20:44:06.519295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514358+0000","last_change":"2023-11-27T20:43:51.714371+0000","last_active":"2023-11-27T20:44:06.514358+0000","last_peered":"2023-11-27T20:44:06.514358+0000","last_clean":"2023-11-27T20:44:06.514358+0000","last_became_active":"2023-11-27T20:43:51.714034+0000","last_became_peered":"2023-11-27T20:43:51.714034+0000","last_unstale":"2023-11-27T20:44:06.514358+0000","last_undegraded":"2023-11-27T20:44:06.514358+0000","last_fullsized":"2023-11-27T20:44:06.514358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528667+0000","last_change":"2023-11-27T20:44:07.528667+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528667+0000","last_undegraded":"2023-11-27T20:44:07.528667+0000","last_fullsized":"2023-11-27T20:44:07.528667+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.555914+0000","last_change":"2023-11-27T20:44:07.552420+0000","last_active":"2023-11-27T20:44:07.555914+0000","last_peered":"2023-11-27T20:44:07.555914+0000","last_clean":"2023-11-27T20:44:07.555914+0000","last_became_active":"2023-11-27T20:44:07.552130+0000","last_became_peered":"2023-11-27T20:44:07.552130+0000","last_unstale":"2023-11-27T20:44:07.555914+0000","last_undegraded":"2023-11-27T20:44:07.555914+0000","last_fullsized":"2023-11-27T20:44:07.555914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:48.971506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521884+0000","last_change":"2023-11-27T20:43:52.741261+0000","last_active":"2023-11-27T20:44:06.521884+0000","last_peered":"2023-11-27T20:44:06.521884+0000","last_clean":"2023-11-27T20:44:06.521884+0000","last_became_active":"2023-11-27T20:43:52.740962+0000","last_became_peered":"2023-11-27T20:43:52.740962+0000","last_unstale":"2023-11-27T20:44:06.521884+0000","last_undegraded":"2023-11-27T20:44:06.521884+0000","last_fullsized":"2023-11-27T20:44:06.521884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513200+0000","last_change":"2023-11-27T20:43:51.708347+0000","last_active":"2023-11-27T20:44:06.513200+0000","last_peered":"2023-11-27T20:44:06.513200+0000","last_clean":"2023-11-27T20:44:06.513200+0000","last_became_active":"2023-11-27T20:43:51.707976+0000","last_became_peered":"2023-11-27T20:43:51.707976+0000","last_unstale":"2023-11-27T20:44:06.513200+0000","last_undegraded":"2023-11-27T20:44:06.513200+0000","last_fullsized":"2023-11-27T20:44:06.513200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523039+0000","last_change":"2023-11-27T20:44:07.523039+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523039+0000","last_undegraded":"2023-11-27T20:44:07.523039+0000","last_fullsized":"2023-11-27T20:44:07.523039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552454+0000","last_change":"2023-11-27T20:44:07.551592+0000","last_active":"2023-11-27T20:44:07.552454+0000","last_peered":"2023-11-27T20:44:07.552454+0000","last_clean":"2023-11-27T20:44:07.552454+0000","last_became_active":"2023-11-27T20:44:07.546829+0000","last_became_peered":"2023-11-27T20:44:07.546829+0000","last_unstale":"2023-11-27T20:44:07.552454+0000","last_undegraded":"2023-11-27T20:44:07.552454+0000","last_fullsized":"2023-11-27T20:44:07.552454+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:16.795933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513832+0000","last_change":"2023-11-27T20:43:52.740074+0000","last_active":"2023-11-27T20:44:06.513832+0000","last_peered":"2023-11-27T20:44:06.513832+0000","last_clean":"2023-11-27T20:44:06.513832+0000","last_became_active":"2023-11-27T20:43:52.739760+0000","last_became_peered":"2023-11-27T20:43:52.739760+0000","last_unstale":"2023-11-27T20:44:06.513832+0000","last_undegraded":"2023-11-27T20:44:06.513832+0000","last_fullsized":"2023-11-27T20:44:06.513832+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:48:56.029031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521593+0000","last_change":"2023-11-27T20:43:51.707359+0000","last_active":"2023-11-27T20:44:06.521593+0000","last_peered":"2023-11-27T20:44:06.521593+0000","last_clean":"2023-11-27T20:44:06.521593+0000","last_became_active":"2023-11-27T20:43:51.707036+0000","last_became_peered":"2023-11-27T20:43:51.707036+0000","last_unstale":"2023-11-27T20:44:06.521593+0000","last_undegraded":"2023-11-27T20:44:06.521593+0000","last_fullsized":"2023-11-27T20:44:06.521593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537488+0000","last_change":"2023-11-27T20:44:07.537488+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537488+0000","last_undegraded":"2023-11-27T20:44:07.537488+0000","last_fullsized":"2023-11-27T20:44:07.537488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547197+0000","last_change":"2023-11-27T20:44:07.542732+0000","last_active":"2023-11-27T20:44:07.547197+0000","last_peered":"2023-11-27T20:44:07.547197+0000","last_clean":"2023-11-27T20:44:07.547197+0000","last_became_active":"2023-11-27T20:44:07.542131+0000","last_became_peered":"2023-11-27T20:44:07.542131+0000","last_unstale":"2023-11-27T20:44:07.547197+0000","last_undegraded":"2023-11-27T20:44:07.547197+0000","last_fullsized":"2023-11-27T20:44:07.547197+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:47.244273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518144+0000","last_change":"2023-11-27T20:43:52.749840+0000","last_active":"2023-11-27T20:44:06.518144+0000","last_peered":"2023-11-27T20:44:06.518144+0000","last_clean":"2023-11-27T20:44:06.518144+0000","last_became_active":"2023-11-27T20:43:52.749390+0000","last_became_peered":"2023-11-27T20:43:52.749390+0000","last_unstale":"2023-11-27T20:44:06.518144+0000","last_undegraded":"2023-11-27T20:44:06.518144+0000","last_fullsized":"2023-11-27T20:44:06.518144+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512519+0000","last_change":"2023-11-27T20:43:51.704467+0000","last_active":"2023-11-27T20:44:06.512519+0000","last_peered":"2023-11-27T20:44:06.512519+0000","last_clean":"2023-11-27T20:44:06.512519+0000","last_became_active":"2023-11-27T20:43:51.704172+0000","last_became_peered":"2023-11-27T20:43:51.704172+0000","last_unstale":"2023-11-27T20:44:06.512519+0000","last_undegraded":"2023-11-27T20:44:06.512519+0000","last_fullsized":"2023-11-27T20:44:06.512519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:44.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524398+0000","last_change":"2023-11-27T20:44:07.524398+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524398+0000","last_undegraded":"2023-11-27T20:44:07.524398+0000","last_fullsized":"2023-11-27T20:44:07.524398+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552575+0000","last_change":"2023-11-27T20:44:07.551204+0000","last_active":"2023-11-27T20:44:07.552575+0000","last_peered":"2023-11-27T20:44:07.552575+0000","last_clean":"2023-11-27T20:44:07.552575+0000","last_became_active":"2023-11-27T20:44:07.550936+0000","last_became_peered":"2023-11-27T20:44:07.550936+0000","last_unstale":"2023-11-27T20:44:07.552575+0000","last_undegraded":"2023-11-27T20:44:07.552575+0000","last_fullsized":"2023-11-27T20:44:07.552575+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:17:14.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517804+0000","last_change":"2023-11-27T20:43:52.730278+0000","last_active":"2023-11-27T20:44:06.517804+0000","last_peered":"2023-11-27T20:44:06.517804+0000","last_clean":"2023-11-27T20:44:06.517804+0000","last_became_active":"2023-11-27T20:43:52.729894+0000","last_became_peered":"2023-11-27T20:43:52.729894+0000","last_unstale":"2023-11-27T20:44:06.517804+0000","last_undegraded":"2023-11-27T20:44:06.517804+0000","last_fullsized":"2023-11-27T20:44:06.517804+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:54.288377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513991+0000","last_change":"2023-11-27T20:43:51.709579+0000","last_active":"2023-11-27T20:44:06.513991+0000","last_peered":"2023-11-27T20:44:06.513991+0000","last_clean":"2023-11-27T20:44:06.513991+0000","last_became_active":"2023-11-27T20:43:51.709194+0000","last_became_peered":"2023-11-27T20:43:51.709194+0000","last_unstale":"2023-11-27T20:44:06.513991+0000","last_undegraded":"2023-11-27T20:44:06.513991+0000","last_fullsized":"2023-11-27T20:44:06.513991+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:01.414182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523350+0000","last_change":"2023-11-27T20:44:07.523350+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523350+0000","last_undegraded":"2023-11-27T20:44:07.523350+0000","last_fullsized":"2023-11-27T20:44:07.523350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.553873+0000","last_change":"2023-11-27T20:44:07.547935+0000","last_active":"2023-11-27T20:44:07.553873+0000","last_peered":"2023-11-27T20:44:07.553873+0000","last_clean":"2023-11-27T20:44:07.553873+0000","last_became_active":"2023-11-27T20:44:07.547663+0000","last_became_peered":"2023-11-27T20:44:07.547663+0000","last_unstale":"2023-11-27T20:44:07.553873+0000","last_undegraded":"2023-11-27T20:44:07.553873+0000","last_fullsized":"2023-11-27T20:44:07.553873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:56:07.645663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512173+0000","last_change":"2023-11-27T20:43:52.750078+0000","last_active":"2023-11-27T20:44:06.512173+0000","last_peered":"2023-11-27T20:44:06.512173+0000","last_clean":"2023-11-27T20:44:06.512173+0000","last_became_active":"2023-11-27T20:43:52.749770+0000","last_became_peered":"2023-11-27T20:43:52.749770+0000","last_unstale":"2023-11-27T20:44:06.512173+0000","last_undegraded":"2023-11-27T20:44:06.512173+0000","last_fullsized":"2023-11-27T20:44:06.512173+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500103+0000","last_change":"2023-11-27T20:43:51.708599+0000","last_active":"2023-11-27T20:44:06.500103+0000","last_peered":"2023-11-27T20:44:06.500103+0000","last_clean":"2023-11-27T20:44:06.500103+0000","last_became_active":"2023-11-27T20:43:51.708311+0000","last_became_peered":"2023-11-27T20:43:51.708311+0000","last_unstale":"2023-11-27T20:44:06.500103+0000","last_undegraded":"2023-11-27T20:44:06.500103+0000","last_fullsized":"2023-11-27T20:44:06.500103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:39.603520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525440+0000","last_change":"2023-11-27T20:44:07.525440+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525440+0000","last_undegraded":"2023-11-27T20:44:07.525440+0000","last_fullsized":"2023-11-27T20:44:07.525440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547438+0000","last_change":"2023-11-27T20:44:07.543371+0000","last_active":"2023-11-27T20:44:07.547438+0000","last_peered":"2023-11-27T20:44:07.547438+0000","last_clean":"2023-11-27T20:44:07.547438+0000","last_became_active":"2023-11-27T20:44:07.542654+0000","last_became_peered":"2023-11-27T20:44:07.542654+0000","last_unstale":"2023-11-27T20:44:07.547438+0000","last_undegraded":"2023-11-27T20:44:07.547438+0000","last_fullsized":"2023-11-27T20:44:07.547438+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:29.891814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512999+0000","last_change":"2023-11-27T20:43:52.745035+0000","last_active":"2023-11-27T20:44:06.512999+0000","last_peered":"2023-11-27T20:44:06.512999+0000","last_clean":"2023-11-27T20:44:06.512999+0000","last_became_active":"2023-11-27T20:43:52.744540+0000","last_became_peered":"2023-11-27T20:43:52.744540+0000","last_unstale":"2023-11-27T20:44:06.512999+0000","last_undegraded":"2023-11-27T20:44:06.512999+0000","last_fullsized":"2023-11-27T20:44:06.512999+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517954+0000","last_change":"2023-11-27T20:43:51.703755+0000","last_active":"2023-11-27T20:44:06.517954+0000","last_peered":"2023-11-27T20:44:06.517954+0000","last_clean":"2023-11-27T20:44:06.517954+0000","last_became_active":"2023-11-27T20:43:51.700051+0000","last_became_peered":"2023-11-27T20:43:51.700051+0000","last_unstale":"2023-11-27T20:44:06.517954+0000","last_undegraded":"2023-11-27T20:44:06.517954+0000","last_fullsized":"2023-11-27T20:44:06.517954+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:00.972675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537506+0000","last_change":"2023-11-27T20:44:07.537506+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537506+0000","last_undegraded":"2023-11-27T20:44:07.537506+0000","last_fullsized":"2023-11-27T20:44:07.537506+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547864+0000","last_change":"2023-11-27T20:44:07.546057+0000","last_active":"2023-11-27T20:44:07.547864+0000","last_peered":"2023-11-27T20:44:07.547864+0000","last_clean":"2023-11-27T20:44:07.547864+0000","last_became_active":"2023-11-27T20:44:07.543702+0000","last_became_peered":"2023-11-27T20:44:07.543702+0000","last_unstale":"2023-11-27T20:44:07.547864+0000","last_undegraded":"2023-11-27T20:44:07.547864+0000","last_fullsized":"2023-11-27T20:44:07.547864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:31.531196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521707+0000","last_change":"2023-11-27T20:43:52.735455+0000","last_active":"2023-11-27T20:44:06.521707+0000","last_peered":"2023-11-27T20:44:06.521707+0000","last_clean":"2023-11-27T20:44:06.521707+0000","last_became_active":"2023-11-27T20:43:52.735128+0000","last_became_peered":"2023-11-27T20:43:52.735128+0000","last_unstale":"2023-11-27T20:44:06.521707+0000","last_undegraded":"2023-11-27T20:44:06.521707+0000","last_fullsized":"2023-11-27T20:44:06.521707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500775+0000","last_change":"2023-11-27T20:43:51.711208+0000","last_active":"2023-11-27T20:44:06.500775+0000","last_peered":"2023-11-27T20:44:06.500775+0000","last_clean":"2023-11-27T20:44:06.500775+0000","last_became_active":"2023-11-27T20:43:51.710936+0000","last_became_peered":"2023-11-27T20:43:51.710936+0000","last_unstale":"2023-11-27T20:44:06.500775+0000","last_undegraded":"2023-11-27T20:44:06.500775+0000","last_fullsized":"2023-11-27T20:44:06.500775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:20.570705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539096+0000","last_change":"2023-11-27T20:44:07.539096+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539096+0000","last_undegraded":"2023-11-27T20:44:07.539096+0000","last_fullsized":"2023-11-27T20:44:07.539096+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.546342+0000","last_change":"2023-11-27T20:44:07.545626+0000","last_active":"2023-11-27T20:44:07.546342+0000","last_peered":"2023-11-27T20:44:07.546342+0000","last_clean":"2023-11-27T20:44:07.546342+0000","last_became_active":"2023-11-27T20:44:07.545085+0000","last_became_peered":"2023-11-27T20:44:07.545085+0000","last_unstale":"2023-11-27T20:44:07.546342+0000","last_undegraded":"2023-11-27T20:44:07.546342+0000","last_fullsized":"2023-11-27T20:44:07.546342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:39.893393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521932+0000","last_change":"2023-11-27T20:43:52.739121+0000","last_active":"2023-11-27T20:44:06.521932+0000","last_peered":"2023-11-27T20:44:06.521932+0000","last_clean":"2023-11-27T20:44:06.521932+0000","last_became_active":"2023-11-27T20:43:52.738758+0000","last_became_peered":"2023-11-27T20:43:52.738758+0000","last_unstale":"2023-11-27T20:44:06.521932+0000","last_undegraded":"2023-11-27T20:44:06.521932+0000","last_fullsized":"2023-11-27T20:44:06.521932+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513320+0000","last_change":"2023-11-27T20:43:51.703349+0000","last_active":"2023-11-27T20:44:06.513320+0000","last_peered":"2023-11-27T20:44:06.513320+0000","last_clean":"2023-11-27T20:44:06.513320+0000","last_became_active":"2023-11-27T20:43:51.703049+0000","last_became_peered":"2023-11-27T20:43:51.703049+0000","last_unstale":"2023-11-27T20:44:06.513320+0000","last_undegraded":"2023-11-27T20:44:06.513320+0000","last_fullsized":"2023-11-27T20:44:06.513320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530552+0000","last_change":"2023-11-27T20:44:07.530552+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530552+0000","last_undegraded":"2023-11-27T20:44:07.530552+0000","last_fullsized":"2023-11-27T20:44:07.530552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.550112+0000","last_change":"2023-11-27T20:44:07.543027+0000","last_active":"2023-11-27T20:44:07.550112+0000","last_peered":"2023-11-27T20:44:07.550112+0000","last_clean":"2023-11-27T20:44:07.550112+0000","last_became_active":"2023-11-27T20:44:07.541400+0000","last_became_peered":"2023-11-27T20:44:07.541400+0000","last_unstale":"2023-11-27T20:44:07.550112+0000","last_undegraded":"2023-11-27T20:44:07.550112+0000","last_fullsized":"2023-11-27T20:44:07.550112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:56:46.092083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500391+0000","last_change":"2023-11-27T20:43:52.738313+0000","last_active":"2023-11-27T20:44:06.500391+0000","last_peered":"2023-11-27T20:44:06.500391+0000","last_clean":"2023-11-27T20:44:06.500391+0000","last_became_active":"2023-11-27T20:43:52.738011+0000","last_became_peered":"2023-11-27T20:43:52.738011+0000","last_unstale":"2023-11-27T20:44:06.500391+0000","last_undegraded":"2023-11-27T20:44:06.500391+0000","last_fullsized":"2023-11-27T20:44:06.500391+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:18:19.921000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521006+0000","last_change":"2023-11-27T20:43:51.711343+0000","last_active":"2023-11-27T20:44:06.521006+0000","last_peered":"2023-11-27T20:44:06.521006+0000","last_clean":"2023-11-27T20:44:06.521006+0000","last_became_active":"2023-11-27T20:43:51.708458+0000","last_became_peered":"2023-11-27T20:43:51.708458+0000","last_unstale":"2023-11-27T20:44:06.521006+0000","last_undegraded":"2023-11-27T20:44:06.521006+0000","last_fullsized":"2023-11-27T20:44:06.521006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:41.674074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537058+0000","last_change":"2023-11-27T20:44:07.537058+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537058+0000","last_undegraded":"2023-11-27T20:44:07.537058+0000","last_fullsized":"2023-11-27T20:44:07.537058+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552520+0000","last_change":"2023-11-27T20:44:07.550591+0000","last_active":"2023-11-27T20:44:07.552520+0000","last_peered":"2023-11-27T20:44:07.552520+0000","last_clean":"2023-11-27T20:44:07.552520+0000","last_became_active":"2023-11-27T20:44:07.548839+0000","last_became_peered":"2023-11-27T20:44:07.548839+0000","last_unstale":"2023-11-27T20:44:07.552520+0000","last_undegraded":"2023-11-27T20:44:07.552520+0000","last_fullsized":"2023-11-27T20:44:07.552520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:40.418150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513151+0000","last_change":"2023-11-27T20:43:52.746396+0000","last_active":"2023-11-27T20:44:06.513151+0000","last_peered":"2023-11-27T20:44:06.513151+0000","last_clean":"2023-11-27T20:44:06.513151+0000","last_became_active":"2023-11-27T20:43:52.745787+0000","last_became_peered":"2023-11-27T20:43:52.745787+0000","last_unstale":"2023-11-27T20:44:06.513151+0000","last_undegraded":"2023-11-27T20:44:06.513151+0000","last_fullsized":"2023-11-27T20:44:06.513151+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:02.424346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521543+0000","last_change":"2023-11-27T20:43:51.711230+0000","last_active":"2023-11-27T20:44:06.521543+0000","last_peered":"2023-11-27T20:44:06.521543+0000","last_clean":"2023-11-27T20:44:06.521543+0000","last_became_active":"2023-11-27T20:43:51.709149+0000","last_became_peered":"2023-11-27T20:43:51.709149+0000","last_unstale":"2023-11-27T20:44:06.521543+0000","last_undegraded":"2023-11-27T20:44:06.521543+0000","last_fullsized":"2023-11-27T20:44:06.521543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:18.904440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531539+0000","last_change":"2023-11-27T20:44:07.531539+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531539+0000","last_undegraded":"2023-11-27T20:44:07.531539+0000","last_fullsized":"2023-11-27T20:44:07.531539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.550961+0000","last_change":"2023-11-27T20:44:07.548314+0000","last_active":"2023-11-27T20:44:07.550961+0000","last_peered":"2023-11-27T20:44:07.550961+0000","last_clean":"2023-11-27T20:44:07.550961+0000","last_became_active":"2023-11-27T20:44:07.547981+0000","last_became_peered":"2023-11-27T20:44:07.547981+0000","last_unstale":"2023-11-27T20:44:07.550961+0000","last_undegraded":"2023-11-27T20:44:07.550961+0000","last_fullsized":"2023-11-27T20:44:07.550961+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:09:09.101471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511517+0000","last_change":"2023-11-27T20:43:52.740586+0000","last_active":"2023-11-27T20:44:06.511517+0000","last_peered":"2023-11-27T20:44:06.511517+0000","last_clean":"2023-11-27T20:44:06.511517+0000","last_became_active":"2023-11-27T20:43:52.739765+0000","last_became_peered":"2023-11-27T20:43:52.739765+0000","last_unstale":"2023-11-27T20:44:06.511517+0000","last_undegraded":"2023-11-27T20:44:06.511517+0000","last_fullsized":"2023-11-27T20:44:06.511517+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:52.832569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500131+0000","last_change":"2023-11-27T20:43:51.701630+0000","last_active":"2023-11-27T20:44:06.500131+0000","last_peered":"2023-11-27T20:44:06.500131+0000","last_clean":"2023-11-27T20:44:06.500131+0000","last_became_active":"2023-11-27T20:43:51.701326+0000","last_became_peered":"2023-11-27T20:43:51.701326+0000","last_unstale":"2023-11-27T20:44:06.500131+0000","last_undegraded":"2023-11-27T20:44:06.500131+0000","last_fullsized":"2023-11-27T20:44:06.500131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:15.707938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523119+0000","last_change":"2023-11-27T20:44:07.523119+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523119+0000","last_undegraded":"2023-11-27T20:44:07.523119+0000","last_fullsized":"2023-11-27T20:44:07.523119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552065+0000","last_change":"2023-11-27T20:44:07.550274+0000","last_active":"2023-11-27T20:44:07.552065+0000","last_peered":"2023-11-27T20:44:07.552065+0000","last_clean":"2023-11-27T20:44:07.552065+0000","last_became_active":"2023-11-27T20:44:07.545265+0000","last_became_peered":"2023-11-27T20:44:07.545265+0000","last_unstale":"2023-11-27T20:44:07.552065+0000","last_undegraded":"2023-11-27T20:44:07.552065+0000","last_fullsized":"2023-11-27T20:44:07.552065+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:36.239607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517029+0000","last_change":"2023-11-27T20:43:52.751182+0000","last_active":"2023-11-27T20:44:06.517029+0000","last_peered":"2023-11-27T20:44:06.517029+0000","last_clean":"2023-11-27T20:44:06.517029+0000","last_became_active":"2023-11-27T20:43:52.750848+0000","last_became_peered":"2023-11-27T20:43:52.750848+0000","last_unstale":"2023-11-27T20:44:06.517029+0000","last_undegraded":"2023-11-27T20:44:06.517029+0000","last_fullsized":"2023-11-27T20:44:06.517029+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506341+0000","last_change":"2023-11-27T20:43:51.712306+0000","last_active":"2023-11-27T20:44:06.506341+0000","last_peered":"2023-11-27T20:44:06.506341+0000","last_clean":"2023-11-27T20:44:06.506341+0000","last_became_active":"2023-11-27T20:43:51.712011+0000","last_became_peered":"2023-11-27T20:43:51.712011+0000","last_unstale":"2023-11-27T20:44:06.506341+0000","last_undegraded":"2023-11-27T20:44:06.506341+0000","last_fullsized":"2023-11-27T20:44:06.506341+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:16.877363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526405+0000","last_change":"2023-11-27T20:44:07.526405+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526405+0000","last_undegraded":"2023-11-27T20:44:07.526405+0000","last_fullsized":"2023-11-27T20:44:07.526405+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.558304+0000","last_change":"2023-11-27T20:44:07.553422+0000","last_active":"2023-11-27T20:44:07.558304+0000","last_peered":"2023-11-27T20:44:07.558304+0000","last_clean":"2023-11-27T20:44:07.558304+0000","last_became_active":"2023-11-27T20:44:07.553073+0000","last_became_peered":"2023-11-27T20:44:07.553073+0000","last_unstale":"2023-11-27T20:44:07.558304+0000","last_undegraded":"2023-11-27T20:44:07.558304+0000","last_fullsized":"2023-11-27T20:44:07.558304+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:26.063759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.499837+0000","last_change":"2023-11-27T20:43:52.726119+0000","last_active":"2023-11-27T20:44:06.499837+0000","last_peered":"2023-11-27T20:44:06.499837+0000","last_clean":"2023-11-27T20:44:06.499837+0000","last_became_active":"2023-11-27T20:43:52.725822+0000","last_became_peered":"2023-11-27T20:43:52.725822+0000","last_unstale":"2023-11-27T20:44:06.499837+0000","last_undegraded":"2023-11-27T20:44:06.499837+0000","last_fullsized":"2023-11-27T20:44:06.499837+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:42.798849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.499819+0000","last_change":"2023-11-27T20:43:51.701670+0000","last_active":"2023-11-27T20:44:06.499819+0000","last_peered":"2023-11-27T20:44:06.499819+0000","last_clean":"2023-11-27T20:44:06.499819+0000","last_became_active":"2023-11-27T20:43:51.701405+0000","last_became_peered":"2023-11-27T20:43:51.701405+0000","last_unstale":"2023-11-27T20:44:06.499819+0000","last_undegraded":"2023-11-27T20:44:06.499819+0000","last_fullsized":"2023-11-27T20:44:06.499819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:37.579894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527434+0000","last_change":"2023-11-27T20:44:07.527434+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527434+0000","last_undegraded":"2023-11-27T20:44:07.527434+0000","last_fullsized":"2023-11-27T20:44:07.527434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.543558+0000","last_change":"2023-11-27T20:44:07.541134+0000","last_active":"2023-11-27T20:44:07.543558+0000","last_peered":"2023-11-27T20:44:07.543558+0000","last_clean":"2023-11-27T20:44:07.543558+0000","last_became_active":"2023-11-27T20:44:07.540882+0000","last_became_peered":"2023-11-27T20:44:07.540882+0000","last_unstale":"2023-11-27T20:44:07.543558+0000","last_undegraded":"2023-11-27T20:44:07.543558+0000","last_fullsized":"2023-11-27T20:44:07.543558+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:32.700621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511249+0000","last_change":"2023-11-27T20:43:52.723905+0000","last_active":"2023-11-27T20:44:06.511249+0000","last_peered":"2023-11-27T20:44:06.511249+0000","last_clean":"2023-11-27T20:44:06.511249+0000","last_became_active":"2023-11-27T20:43:52.723296+0000","last_became_peered":"2023-11-27T20:43:52.723296+0000","last_unstale":"2023-11-27T20:44:06.511249+0000","last_undegraded":"2023-11-27T20:44:06.511249+0000","last_fullsized":"2023-11-27T20:44:06.511249+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:25.080298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511226+0000","last_change":"2023-11-27T20:43:51.707532+0000","last_active":"2023-11-27T20:44:06.511226+0000","last_peered":"2023-11-27T20:44:06.511226+0000","last_clean":"2023-11-27T20:44:06.511226+0000","last_became_active":"2023-11-27T20:43:51.705976+0000","last_became_peered":"2023-11-27T20:43:51.705976+0000","last_unstale":"2023-11-27T20:44:06.511226+0000","last_undegraded":"2023-11-27T20:44:06.511226+0000","last_fullsized":"2023-11-27T20:44:06.511226+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:01.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524671+0000","last_change":"2023-11-27T20:44:07.524671+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524671+0000","last_undegraded":"2023-11-27T20:44:07.524671+0000","last_fullsized":"2023-11-27T20:44:07.524671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547414+0000","last_change":"2023-11-27T20:44:07.543228+0000","last_active":"2023-11-27T20:44:07.547414+0000","last_peered":"2023-11-27T20:44:07.547414+0000","last_clean":"2023-11-27T20:44:07.547414+0000","last_became_active":"2023-11-27T20:44:07.540038+0000","last_became_peered":"2023-11-27T20:44:07.540038+0000","last_unstale":"2023-11-27T20:44:07.547414+0000","last_undegraded":"2023-11-27T20:44:07.547414+0000","last_fullsized":"2023-11-27T20:44:07.547414+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:32.588898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511086+0000","last_change":"2023-11-27T20:43:52.752685+0000","last_active":"2023-11-27T20:44:06.511086+0000","last_peered":"2023-11-27T20:44:06.511086+0000","last_clean":"2023-11-27T20:44:06.511086+0000","last_became_active":"2023-11-27T20:43:52.748686+0000","last_became_peered":"2023-11-27T20:43:52.748686+0000","last_unstale":"2023-11-27T20:44:06.511086+0000","last_undegraded":"2023-11-27T20:44:06.511086+0000","last_fullsized":"2023-11-27T20:44:06.511086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:34.158412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516360+0000","last_change":"2023-11-27T20:43:51.700471+0000","last_active":"2023-11-27T20:44:06.516360+0000","last_peered":"2023-11-27T20:44:06.516360+0000","last_clean":"2023-11-27T20:44:06.516360+0000","last_became_active":"2023-11-27T20:43:51.700088+0000","last_became_peered":"2023-11-27T20:43:51.700088+0000","last_unstale":"2023-11-27T20:44:06.516360+0000","last_undegraded":"2023-11-27T20:44:06.516360+0000","last_fullsized":"2023-11-27T20:44:06.516360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:13:35.862430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515700+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:44:06.515700+0000","last_peered":"2023-11-27T20:44:06.515700+0000","last_clean":"2023-11-27T20:44:06.515700+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:44:06.515700+0000","last_undegraded":"2023-11-27T20:44:06.515700+0000","last_fullsized":"2023-11-27T20:44:06.515700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":881171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1579999999999999,"15min":1.163},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.181,"5min":1.2290000000000001,"15min":1.2370000000000001},"min":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.74,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.528}]},{"osd":1,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.47,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.165},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.607,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3480000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.282,"15min":1.3080000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.484,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.3},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.248,"15min":1.2589999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6379999999999999,"5min":1.909,"15min":1.909},"last":1.0489999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.361,"15min":1.397},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6779999999999999,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.113},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.47,"15min":1.496},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6879999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.244}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.724,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.5429999999999999,"15min":1.6040000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.623,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.2090000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4770000000000001,"15min":1.5049999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.948,"5min":2.044,"15min":2.044},"last":1.415},{"interface":"front","average":{"1min":1.399,"5min":1.5660000000000001,"15min":1.5940000000000001},"min":{"1min":0.69499999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8169999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.629}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.653,"15min":1.6759999999999999},"min":{"1min":0.80200000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.0179999999999998,"5min":2.508,"15min":2.508},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.6559999999999999,"15min":1.694},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.724,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.7749999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":684032,"data_stored":297773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.679,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.306,"15min":1.331},"min":{"1min":0.65200000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6399999999999999,"5min":2.581,"15min":2.581},"last":0.92800000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2549999999999999,"15min":1.2769999999999999},"min":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5349999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.151,"15min":1.167},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.506,"5min":2.823,"15min":2.823},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0760000000000001,"15min":1.081},"min":{"1min":0.79100000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4790000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.2,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.86899999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.679,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.101}]},{"osd":3,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.349,"15min":1.387},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.71,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.7849999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.1990000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.605,"15min":1.631},"min":{"1min":0.97699999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.994,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.623,"15min":1.663},"min":{"1min":0.82799999999999996,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.804,"5min":3.536,"15min":3.536},"last":1.1559999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.393,"15min":1.4079999999999999},"min":{"1min":0.81200000000000006,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9359999999999999,"5min":2.355,"15min":2.355},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.753,"5min":0.623,"15min":0.623},"max":{"1min":1.8819999999999999,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.2649999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.6519999999999999,"15min":1.6919999999999999},"min":{"1min":0.88500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":3.645,"15min":3.645},"last":1.242},{"interface":"front","average":{"1min":1.452,"5min":1.569,"15min":1.589},"min":{"1min":1.006,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.032,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.4590000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":298425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.1379999999999999,"15min":1.163},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5800000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.1579999999999999,"15min":1.1839999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6619999999999999,"5min":2.04,"15min":2.04},"last":1.367}]},{"osd":1,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.181,"15min":1.2050000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.4630000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.242}]},{"osd":2,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.27,"15min":1.294},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.73,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.268},{"interface":"front","average":{"1min":1.081,"5min":1.1950000000000001,"15min":1.214},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7470000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.556}]},{"osd":3,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.3660000000000001,"15min":1.399},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5900000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.4359999999999999,"15min":1.472},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.637,"5min":4.016,"15min":4.016},"last":1.206}]},{"osd":4,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3580000000000001,"15min":1.3919999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.79,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.873},{"interface":"front","average":{"1min":1.292,"5min":1.585,"15min":1.6339999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8140000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.1439999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.619,"15min":1.671},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.724,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.573,"15min":1.6120000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.016,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.405}]},{"osd":7,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.6379999999999999,"15min":1.6819999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.871,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.599},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.708,"15min":1.76},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8380000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.3160000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":300880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.014,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.0840000000000001,"15min":1.0820000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.034,"15min":1.008},"min":{"1min":0.80400000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.222,"15min":1.22},"min":{"1min":0.64500000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.74,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.29}]},{"osd":2,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2170000000000001,"15min":1.2110000000000001},"min":{"1min":0.69799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.343},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.292,"15min":1.294},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.53}]},{"osd":3,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.85199999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.599,"5min":1.778,"15min":1.778},"last":1.024},{"interface":"front","average":{"1min":1.464,"5min":1.3600000000000001,"15min":1.343},"min":{"1min":0.91400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.4710000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.266,"15min":1.284},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.109},{"interface":"front","average":{"1min":1.421,"5min":1.431,"15min":1.4330000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.0569999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.651,"5min":2.157,"15min":2.157},"last":1.242},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.595,"15min":1.605},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.887,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.385}]},{"osd":7,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5089999999999999,"15min":1.5009999999999999},"min":{"1min":1.179,"5min":1.016,"15min":1.016},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.6679999999999999,"15min":1.6639999999999999},"min":{"1min":1.22,"5min":1.004,"15min":1.004},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.5840000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":1.0009999999999999,"15min":1.0389999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.258,"5min":3.641,"15min":3.641},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97199999999999998,"15min":1.014},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0449999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.399,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.097,"15min":1.121},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4099999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.0880000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0960000000000001,"15min":1.117},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.444,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.135},"min":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.746,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.85299999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.3029999999999999,"15min":1.337},"min":{"1min":0.84499999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.365,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.4330000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.4179999999999999,"15min":1.4379999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.982,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.052},{"interface":"front","average":{"1min":1.272,"5min":1.452,"15min":1.482},"min":{"1min":0.874,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.714,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.3049999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.5189999999999999,"15min":1.544},"min":{"1min":0.96799999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.823,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.492,"15min":1.522},"min":{"1min":0.89000000000000001,"5min":0.878,"15min":0.878},"max":{"1min":1.8560000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.5209999999999999,"15min":1.5580000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.929,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.167},{"interface":"front","average":{"1min":1.413,"5min":1.4890000000000001,"15min":1.5009999999999999},"min":{"1min":1.002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.7410000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.2869999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1259999999999999,"5min":1.228,"15min":1.228},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.93300000000000005},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2270000000000001,"5min":1.972,"15min":1.972},"last":1.4750000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.98099999999999998,"15min":1.014},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1890000000000001,"5min":1.522,"15min":1.522},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.96499999999999997,"15min":0.98799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.431,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.022}]},{"osd":3,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.96099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0740000000000001,"15min":1.101},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4770000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1359999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.1850000000000001,"15min":1.21},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4299999999999999,"5min":1.669,"15min":1.669},"last":1.431},{"interface":"front","average":{"1min":1.169,"5min":1.3540000000000001,"15min":1.385},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.252}]},{"osd":5,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.3009999999999999,"15min":1.3260000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.601,"5min":2.48,"15min":2.48},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.4510000000000001,"15min":1.4930000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9930000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.5129999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3640000000000001,"15min":1.381},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.972,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.383},{"interface":"front","average":{"1min":1.202,"5min":1.4890000000000001,"15min":1.5369999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.831,"5min":3.302,"15min":3.302},"last":1.339}]},{"osd":7,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.46,"15min":1.496},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.1070000000000002,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.4330000000000001,"15min":1.4810000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.581,"5min":2.73,"15min":2.73},"last":1.0740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":688128,"data_stored":297863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0940000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.5449999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.97099999999999997,"15min":0.98999999999999999},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3740000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0429999999999999,"15min":1.0469999999999999},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.518,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0489999999999999,"15min":1.0329999999999999},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7370000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.083,"15min":1.087},"min":{"1min":0.66600000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6140000000000001,"5min":2.044,"15min":2.044},"last":0.70699999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1799999999999999,"15min":1.1890000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3640000000000001,"15min":1.3540000000000001},"min":{"1min":0.88500000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.1099999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.0409999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9810000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.02},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.25,"15min":1.2330000000000001},"min":{"1min":0.79100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1659999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.2490000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.3380000000000001,"15min":1.3180000000000001},"min":{"1min":1.095,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1230000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.357},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.732,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.3240000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.4690000000000001,"15min":1.476},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1949999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.5960000000000001,"15min":1.5880000000000001},"min":{"1min":1.143,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.7469999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.3049999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1294336,"data_stored":891830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.85299999999999998,"15min":0.84199999999999997},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.5649999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.85099999999999998,"15min":0.83499999999999996},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.173}]},{"osd":3,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.91300000000000003,"15min":0.89700000000000002},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.8320000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.0549999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2470000000000001,"15min":1.246},"min":{"1min":0.76900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9430000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.1970000000000001,"15min":1.1919999999999999},"min":{"1min":0.89700000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.575,"5min":2.391,"15min":2.391},"last":1.4019999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.81399999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.0750000000000002,"5min":3.028,"15min":3.028},"last":1.373},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.3129999999999999},"min":{"1min":0.77700000000000002,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.246,"5min":2.718,"15min":2.718},"last":1.341}]},{"osd":6,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3120000000000001},"min":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7909999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.105},{"interface":"front","average":{"1min":1.415,"5min":1.423,"15min":1.4239999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.1509999999999998,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.238}]},{"osd":7,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3540000000000001,"15min":1.355},"min":{"1min":0.84699999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.835,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3560000000000001,"15min":1.3600000000000001},"min":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8500000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.476}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:44:13.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-11-27T20:44:13.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.528239+0000', 'last_change': '2023-11-27T20:44:07.528239+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.528239+0000', 'last_undegraded': '2023-11-27T20:44:07.528239+0000', 'last_fullsized': '2023-11-27T20:44:07.528239+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:44:13.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-11-27T20:44:13.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.531466+0000', 'last_change': '2023-11-27T20:44:07.531466+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.531466+0000', 'last_undegraded': '2023-11-27T20:44:07.531466+0000', 'last_fullsized': '2023-11-27T20:44:07.531466+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:44:13.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-11-27T20:44:13.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.541507+0000', 'last_change': '2023-11-27T20:44:07.541507+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.541507+0000', 'last_undegraded': '2023-11-27T20:44:07.541507+0000', 'last_fullsized': '2023-11-27T20:44:07.541507+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-11-27T20:44:13.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.527473+0000', 'last_change': '2023-11-27T20:44:07.527473+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.527473+0000', 'last_undegraded': '2023-11-27T20:44:07.527473+0000', 'last_fullsized': '2023-11-27T20:44:07.527473+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:44:13.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-11-27T20:44:13.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.531917+0000', 'last_change': '2023-11-27T20:44:07.531917+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.531917+0000', 'last_undegraded': '2023-11-27T20:44:07.531917+0000', 'last_fullsized': '2023-11-27T20:44:07.531917+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:44:13.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-11-27T20:44:13.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.525264+0000', 'last_change': '2023-11-27T20:44:07.525264+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.525264+0000', 'last_undegraded': '2023-11-27T20:44:07.525264+0000', 'last_fullsized': '2023-11-27T20:44:07.525264+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:44:13.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-11-27T20:44:13.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.526887+0000', 'last_change': '2023-11-27T20:44:07.526887+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.526887+0000', 'last_undegraded': '2023-11-27T20:44:07.526887+0000', 'last_fullsized': '2023-11-27T20:44:07.526887+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:44:13.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-11-27T20:44:13.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.526581+0000', 'last_change': '2023-11-27T20:44:07.526581+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.526581+0000', 'last_undegraded': '2023-11-27T20:44:07.526581+0000', 'last_fullsized': '2023-11-27T20:44:07.526581+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:44:13.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-11-27T20:44:13.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.540259+0000', 'last_change': '2023-11-27T20:44:07.540259+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.540259+0000', 'last_undegraded': '2023-11-27T20:44:07.540259+0000', 'last_fullsized': '2023-11-27T20:44:07.540259+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-11-27T20:44:13.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.531049+0000', 'last_change': '2023-11-27T20:44:07.531049+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.531049+0000', 'last_undegraded': '2023-11-27T20:44:07.531049+0000', 'last_fullsized': '2023-11-27T20:44:07.531049+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:44:13.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-11-27T20:44:13.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.535763+0000', 'last_change': '2023-11-27T20:44:07.535763+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.535763+0000', 'last_undegraded': '2023-11-27T20:44:07.535763+0000', 'last_fullsized': '2023-11-27T20:44:07.535763+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:44:13.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.530979+0000', 'last_change': '2023-11-27T20:44:07.530979+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.530979+0000', 'last_undegraded': '2023-11-27T20:44:07.530979+0000', 'last_fullsized': '2023-11-27T20:44:07.530979+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.537228+0000', 'last_change': '2023-11-27T20:44:07.537228+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.537228+0000', 'last_undegraded': '2023-11-27T20:44:07.537228+0000', 'last_fullsized': '2023-11-27T20:44:07.537228+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.521140+0000', 'last_change': '2023-11-27T20:44:07.521140+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.521140+0000', 'last_undegraded': '2023-11-27T20:44:07.521140+0000', 'last_fullsized': '2023-11-27T20:44:07.521140+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.530684+0000', 'last_change': '2023-11-27T20:44:07.530684+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.530684+0000', 'last_undegraded': '2023-11-27T20:44:07.530684+0000', 'last_fullsized': '2023-11-27T20:44:07.530684+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.527533+0000', 'last_change': '2023-11-27T20:44:07.527533+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.527533+0000', 'last_undegraded': '2023-11-27T20:44:07.527533+0000', 'last_fullsized': '2023-11-27T20:44:07.527533+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-11-27T20:44:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.525282+0000', 'last_change': '2023-11-27T20:44:07.525282+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.525282+0000', 'last_undegraded': '2023-11-27T20:44:07.525282+0000', 'last_fullsized': '2023-11-27T20:44:07.525282+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:44:13.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-11-27T20:44:13.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.530733+0000', 'last_change': '2023-11-27T20:44:07.530733+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.530733+0000', 'last_undegraded': '2023-11-27T20:44:07.530733+0000', 'last_fullsized': '2023-11-27T20:44:07.530733+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:44:13.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-11-27T20:44:13.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.528962+0000', 'last_change': '2023-11-27T20:44:07.528962+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.528962+0000', 'last_undegraded': '2023-11-27T20:44:07.528962+0000', 'last_fullsized': '2023-11-27T20:44:07.528962+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:44:13.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-11-27T20:44:13.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.529520+0000', 'last_change': '2023-11-27T20:44:07.529520+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.529520+0000', 'last_undegraded': '2023-11-27T20:44:07.529520+0000', 'last_fullsized': '2023-11-27T20:44:07.529520+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:44:13.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-11-27T20:44:13.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.537041+0000', 'last_change': '2023-11-27T20:44:07.537041+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.537041+0000', 'last_undegraded': '2023-11-27T20:44:07.537041+0000', 'last_fullsized': '2023-11-27T20:44:07.537041+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-11-27T20:44:13.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.539485+0000', 'last_change': '2023-11-27T20:44:07.539485+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.539485+0000', 'last_undegraded': '2023-11-27T20:44:07.539485+0000', 'last_fullsized': '2023-11-27T20:44:07.539485+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-11-27T20:44:13.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.521111+0000', 'last_change': '2023-11-27T20:44:07.521111+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.521111+0000', 'last_undegraded': '2023-11-27T20:44:07.521111+0000', 'last_fullsized': '2023-11-27T20:44:07.521111+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:44:13.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-11-27T20:44:13.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.521167+0000', 'last_change': '2023-11-27T20:44:07.521167+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.521167+0000', 'last_undegraded': '2023-11-27T20:44:07.521167+0000', 'last_fullsized': '2023-11-27T20:44:07.521167+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:44:13.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-11-27T20:44:13.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.527612+0000', 'last_change': '2023-11-27T20:44:07.527612+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.527612+0000', 'last_undegraded': '2023-11-27T20:44:07.527612+0000', 'last_fullsized': '2023-11-27T20:44:07.527612+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:44:13.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-11-27T20:44:13.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.522993+0000', 'last_change': '2023-11-27T20:44:07.522993+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.522993+0000', 'last_undegraded': '2023-11-27T20:44:07.522993+0000', 'last_fullsized': '2023-11-27T20:44:07.522993+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:44:13.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-11-27T20:44:13.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.524843+0000', 'last_change': '2023-11-27T20:44:07.524843+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.524843+0000', 'last_undegraded': '2023-11-27T20:44:07.524843+0000', 'last_fullsized': '2023-11-27T20:44:07.524843+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:44:13.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-11-27T20:44:13.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.536848+0000', 'last_change': '2023-11-27T20:44:07.536848+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.536848+0000', 'last_undegraded': '2023-11-27T20:44:07.536848+0000', 'last_fullsized': '2023-11-27T20:44:07.536848+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:44:13.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-11-27T20:44:13.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.530894+0000', 'last_change': '2023-11-27T20:44:07.530894+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.530894+0000', 'last_undegraded': '2023-11-27T20:44:07.530894+0000', 'last_fullsized': '2023-11-27T20:44:07.530894+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:44:13.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-11-27T20:44:13.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.522867+0000', 'last_change': '2023-11-27T20:44:07.522867+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.522867+0000', 'last_undegraded': '2023-11-27T20:44:07.522867+0000', 'last_fullsized': '2023-11-27T20:44:07.522867+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:44:13.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-11-27T20:44:13.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.525868+0000', 'last_change': '2023-11-27T20:44:07.525868+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.525868+0000', 'last_undegraded': '2023-11-27T20:44:07.525868+0000', 'last_fullsized': '2023-11-27T20:44:07.525868+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:44:13.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-11-27T20:44:13.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.532834+0000', 'last_change': '2023-11-27T20:44:07.532834+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.532834+0000', 'last_undegraded': '2023-11-27T20:44:07.532834+0000', 'last_fullsized': '2023-11-27T20:44:07.532834+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:44:13.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-11-27T20:44:13.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.528764+0000', 'last_change': '2023-11-27T20:44:07.528764+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.528764+0000', 'last_undegraded': '2023-11-27T20:44:07.528764+0000', 'last_fullsized': '2023-11-27T20:44:07.528764+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:44:13.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-11-27T20:44:13.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.539753+0000', 'last_change': '2023-11-27T20:44:07.539753+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.539753+0000', 'last_undegraded': '2023-11-27T20:44:07.539753+0000', 'last_fullsized': '2023-11-27T20:44:07.539753+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-11-27T20:44:13.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.536855+0000', 'last_change': '2023-11-27T20:44:07.536855+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.536855+0000', 'last_undegraded': '2023-11-27T20:44:07.536855+0000', 'last_fullsized': '2023-11-27T20:44:07.536855+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-11-27T20:44:13.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.527825+0000', 'last_change': '2023-11-27T20:44:07.527825+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.527825+0000', 'last_undegraded': '2023-11-27T20:44:07.527825+0000', 'last_fullsized': '2023-11-27T20:44:07.527825+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:44:13.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-11-27T20:44:13.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.526427+0000', 'last_change': '2023-11-27T20:44:07.526427+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.526427+0000', 'last_undegraded': '2023-11-27T20:44:07.526427+0000', 'last_fullsized': '2023-11-27T20:44:07.526427+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:44:13.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-11-27T20:44:13.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.530389+0000', 'last_change': '2023-11-27T20:44:07.530389+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.530389+0000', 'last_undegraded': '2023-11-27T20:44:07.530389+0000', 'last_fullsized': '2023-11-27T20:44:07.530389+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:44:13.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-11-27T20:44:13.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.529870+0000', 'last_change': '2023-11-27T20:44:07.529870+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.529870+0000', 'last_undegraded': '2023-11-27T20:44:07.529870+0000', 'last_fullsized': '2023-11-27T20:44:07.529870+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:44:13.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-11-27T20:44:13.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.523700+0000', 'last_change': '2023-11-27T20:44:07.523700+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.523700+0000', 'last_undegraded': '2023-11-27T20:44:07.523700+0000', 'last_fullsized': '2023-11-27T20:44:07.523700+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:44:13.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-11-27T20:44:13.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.528088+0000', 'last_change': '2023-11-27T20:44:07.528088+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.528088+0000', 'last_undegraded': '2023-11-27T20:44:07.528088+0000', 'last_fullsized': '2023-11-27T20:44:07.528088+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:44:13.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-11-27T20:44:13.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.529398+0000', 'last_change': '2023-11-27T20:44:07.529398+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.529398+0000', 'last_undegraded': '2023-11-27T20:44:07.529398+0000', 'last_fullsized': '2023-11-27T20:44:07.529398+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:44:13.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-11-27T20:44:13.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.531925+0000', 'last_change': '2023-11-27T20:44:07.531925+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.531925+0000', 'last_undegraded': '2023-11-27T20:44:07.531925+0000', 'last_fullsized': '2023-11-27T20:44:07.531925+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:44:13.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-11-27T20:44:13.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.538067+0000', 'last_change': '2023-11-27T20:44:07.538067+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.538067+0000', 'last_undegraded': '2023-11-27T20:44:07.538067+0000', 'last_fullsized': '2023-11-27T20:44:07.538067+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-11-27T20:44:13.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.532546+0000', 'last_change': '2023-11-27T20:44:07.532546+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.532546+0000', 'last_undegraded': '2023-11-27T20:44:07.532546+0000', 'last_fullsized': '2023-11-27T20:44:07.532546+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:44:13.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-11-27T20:44:13.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.531534+0000', 'last_change': '2023-11-27T20:44:07.531534+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.531534+0000', 'last_undegraded': '2023-11-27T20:44:07.531534+0000', 'last_fullsized': '2023-11-27T20:44:07.531534+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:44:13.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-11-27T20:44:13.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.537759+0000', 'last_change': '2023-11-27T20:44:07.537759+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.537759+0000', 'last_undegraded': '2023-11-27T20:44:07.537759+0000', 'last_fullsized': '2023-11-27T20:44:07.537759+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-11-27T20:44:13.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.529666+0000', 'last_change': '2023-11-27T20:44:07.529666+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.529666+0000', 'last_undegraded': '2023-11-27T20:44:07.529666+0000', 'last_fullsized': '2023-11-27T20:44:07.529666+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:44:13.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-11-27T20:44:13.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.530632+0000', 'last_change': '2023-11-27T20:44:07.530632+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.530632+0000', 'last_undegraded': '2023-11-27T20:44:07.530632+0000', 'last_fullsized': '2023-11-27T20:44:07.530632+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:44:13.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-11-27T20:44:13.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.528667+0000', 'last_change': '2023-11-27T20:44:07.528667+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.528667+0000', 'last_undegraded': '2023-11-27T20:44:07.528667+0000', 'last_fullsized': '2023-11-27T20:44:07.528667+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:44:13.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-11-27T20:44:13.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.523039+0000', 'last_change': '2023-11-27T20:44:07.523039+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.523039+0000', 'last_undegraded': '2023-11-27T20:44:07.523039+0000', 'last_fullsized': '2023-11-27T20:44:07.523039+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T20:44:13.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-11-27T20:44:13.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.537488+0000', 'last_change': '2023-11-27T20:44:07.537488+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.537488+0000', 'last_undegraded': '2023-11-27T20:44:07.537488+0000', 'last_fullsized': '2023-11-27T20:44:07.537488+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-11-27T20:44:13.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.524398+0000', 'last_change': '2023-11-27T20:44:07.524398+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.524398+0000', 'last_undegraded': '2023-11-27T20:44:07.524398+0000', 'last_fullsized': '2023-11-27T20:44:07.524398+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:44:13.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-11-27T20:44:13.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.523350+0000', 'last_change': '2023-11-27T20:44:07.523350+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.523350+0000', 'last_undegraded': '2023-11-27T20:44:07.523350+0000', 'last_fullsized': '2023-11-27T20:44:07.523350+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:44:13.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-11-27T20:44:13.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.525440+0000', 'last_change': '2023-11-27T20:44:07.525440+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.525440+0000', 'last_undegraded': '2023-11-27T20:44:07.525440+0000', 'last_fullsized': '2023-11-27T20:44:07.525440+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:44:13.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-11-27T20:44:13.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.537506+0000', 'last_change': '2023-11-27T20:44:07.537506+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.537506+0000', 'last_undegraded': '2023-11-27T20:44:07.537506+0000', 'last_fullsized': '2023-11-27T20:44:07.537506+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-11-27T20:44:13.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.539096+0000', 'last_change': '2023-11-27T20:44:07.539096+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.539096+0000', 'last_undegraded': '2023-11-27T20:44:07.539096+0000', 'last_fullsized': '2023-11-27T20:44:07.539096+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-27T20:44:13.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-11-27T20:44:13.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.530552+0000', 'last_change': '2023-11-27T20:44:07.530552+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.530552+0000', 'last_undegraded': '2023-11-27T20:44:07.530552+0000', 'last_fullsized': '2023-11-27T20:44:07.530552+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T20:44:13.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-11-27T20:44:13.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.537058+0000', 'last_change': '2023-11-27T20:44:07.537058+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.537058+0000', 'last_undegraded': '2023-11-27T20:44:07.537058+0000', 'last_fullsized': '2023-11-27T20:44:07.537058+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T20:44:13.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-11-27T20:44:13.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.531539+0000', 'last_change': '2023-11-27T20:44:07.531539+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.531539+0000', 'last_undegraded': '2023-11-27T20:44:07.531539+0000', 'last_fullsized': '2023-11-27T20:44:07.531539+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T20:44:13.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-11-27T20:44:13.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.523119+0000', 'last_change': '2023-11-27T20:44:07.523119+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.523119+0000', 'last_undegraded': '2023-11-27T20:44:07.523119+0000', 'last_fullsized': '2023-11-27T20:44:07.523119+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:44:13.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-11-27T20:44:13.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.526405+0000', 'last_change': '2023-11-27T20:44:07.526405+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.526405+0000', 'last_undegraded': '2023-11-27T20:44:07.526405+0000', 'last_fullsized': '2023-11-27T20:44:07.526405+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T20:44:13.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-11-27T20:44:13.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.527434+0000', 'last_change': '2023-11-27T20:44:07.527434+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.527434+0000', 'last_undegraded': '2023-11-27T20:44:07.527434+0000', 'last_fullsized': '2023-11-27T20:44:07.527434+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T20:44:13.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-11-27T20:44:13.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2023-11-27T20:44:07.524671+0000', 'last_change': '2023-11-27T20:44:07.524671+0000', 'last_active': '2023-11-27T20:44:07.495928+0000', 'last_peered': '2023-11-27T20:44:07.495928+0000', 'last_clean': '2023-11-27T20:44:07.495928+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T20:44:07.524671+0000', 'last_undegraded': '2023-11-27T20:44:07.524671+0000', 'last_fullsized': '2023-11-27T20:44:07.524671+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'last_clean_scrub_stamp': '2023-11-27T20:44:07.495928+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T20:44:13.933 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-27T20:44:14.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.160+0000 7f6015c4f640 1 Processor -- start 2023-11-27T20:44:14.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.160+0000 7f6015c4f640 1 -- start start 2023-11-27T20:44:14.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.161+0000 7f6015c4f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6010155490 0x7f60100a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.161+0000 7f6015c4f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f60100a9b40 0x7f60100c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f6015c4f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60100c06c0 con 0x7f60100c1500 2023-11-27T20:44:14.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f6015c4f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60100a5820 con 0x7f60100a9b40 2023-11-27T20:44:14.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f6015c4f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60100c1020 con 0x7f6010155490 2023-11-27T20:44:14.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f600ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f60100a9b40 0x7f60100c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:14.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f600effd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f60100c1500 0x7f60100a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39488/0 (socket says 172.21.15.91:39488) 2023-11-27T20:44:14.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f600effd640 1 -- 172.21.15.91:0/315071549 learned_addr learned my addr 172.21.15.91:0/315071549 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:14.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f600ffff640 1 -- 172.21.15.91:0/315071549 >> v2:172.21.15.183:3300/0 conn(0x7f6010155490 msgr2=0x7f60100a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:14.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f600ffff640 1 --2- 172.21.15.91:0/315071549 >> v2:172.21.15.183:3300/0 conn(0x7f6010155490 0x7f60100a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f600ffff640 1 -- 172.21.15.91:0/315071549 >> v1:172.21.15.91:6789/0 conn(0x7f60100c1500 legacy=0x7f60100a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f600ffff640 1 -- 172.21.15.91:0/315071549 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60100c0910 con 0x7f60100a9b40 2023-11-27T20:44:14.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.162+0000 7f600e7fc640 1 -- 172.21.15.91:0/315071549 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202358594 0 0) 0x7f60100c06c0 con 0x7f60100c1500 2023-11-27T20:44:14.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.164+0000 7f600ffff640 1 --2- 172.21.15.91:0/315071549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a9b40 0x7f60100c24d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f601006dff0 tx=0x7f600802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa5a309765060d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:14.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.164+0000 7f600e7fc640 1 -- 172.21.15.91:0/315071549 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600802cc70 con 0x7f60100a9b40 2023-11-27T20:44:14.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.164+0000 7f600e7fc640 1 -- 172.21.15.91:0/315071549 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600802cdd0 con 0x7f60100a9b40 2023-11-27T20:44:14.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.164+0000 7f600e7fc640 1 -- 172.21.15.91:0/315071549 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008034660 con 0x7f60100a9b40 2023-11-27T20:44:14.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.165+0000 7f6015c4f640 1 -- 172.21.15.91:0/315071549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a9b40 msgr2=0x7f60100c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.165+0000 7f6015c4f640 1 --2- 172.21.15.91:0/315071549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a9b40 0x7f60100c24d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f601006dff0 tx=0x7f600802bec0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.165+0000 7f6015c4f640 1 -- 172.21.15.91:0/315071549 shutdown_connections 2023-11-27T20:44:14.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.165+0000 7f6015c4f640 1 --2- 172.21.15.91:0/315071549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a9b40 0x7f60100c24d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.165+0000 7f6015c4f640 1 --2- 172.21.15.91:0/315071549 >> v2:172.21.15.183:3300/0 conn(0x7f6010155490 0x7f60100a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.165+0000 7f6015c4f640 1 -- 172.21.15.91:0/315071549 >> 172.21.15.91:0/315071549 conn(0x7f601006a500 msgr2=0x7f601006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:14.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.165+0000 7f6015c4f640 1 -- 172.21.15.91:0/315071549 shutdown_connections 2023-11-27T20:44:14.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.165+0000 7f6015c4f640 1 -- 172.21.15.91:0/315071549 wait complete. 2023-11-27T20:44:14.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.166+0000 7f6015c4f640 1 Processor -- start 2023-11-27T20:44:14.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.167+0000 7f6015c4f640 1 -- start start 2023-11-27T20:44:14.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.167+0000 7f6015c4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60100c1500 0x7f60101ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.167+0000 7f6015c4f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6010155490 0x7f60101537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f6015c4f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a70f0 0x7f601014d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f6015c4f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60100717d0 con 0x7f60100a70f0 2023-11-27T20:44:14.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f6015c4f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60100a6240 con 0x7f6010155490 2023-11-27T20:44:14.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f6015c4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60100a6a10 con 0x7f60100c1500 2023-11-27T20:44:14.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a70f0 0x7f601014d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:14.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a70f0 0x7f601014d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36034/0 (socket says 172.21.15.91:36034) 2023-11-27T20:44:14.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600ffff640 1 -- 172.21.15.91:0/2199259443 learned_addr learned my addr 172.21.15.91:0/2199259443 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:14.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600ffff640 1 -- 172.21.15.91:0/2199259443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60100c1500 msgr2=0x7f60101ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600f7fe640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60100c1500 0x7f60101ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:14.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600effd640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6010155490 0x7f60101537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:14.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600ffff640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60100c1500 0x7f60101ed8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600ffff640 1 -- 172.21.15.91:0/2199259443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6010155490 msgr2=0x7f60101537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600ffff640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6010155490 0x7f60101537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600ffff640 1 -- 172.21.15.91:0/2199259443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008009a70 con 0x7f60100a70f0 2023-11-27T20:44:14.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.168+0000 7f600f7fe640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60100c1500 0x7f60101ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:14.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.169+0000 7f600ffff640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a70f0 0x7f601014d080 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f600802c4d0 tx=0x7f6008004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:14.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.169+0000 7f5ff7fff640 1 -- 172.21.15.91:0/2199259443 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008003990 con 0x7f60100a70f0 2023-11-27T20:44:14.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.169+0000 7f5ff7fff640 1 -- 172.21.15.91:0/2199259443 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6008003af0 con 0x7f60100a70f0 2023-11-27T20:44:14.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.169+0000 7f5ff7fff640 1 -- 172.21.15.91:0/2199259443 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008003e80 con 0x7f60100a70f0 2023-11-27T20:44:14.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.169+0000 7f6015c4f640 1 -- 172.21.15.91:0/2199259443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601006ff60 con 0x7f60100a70f0 2023-11-27T20:44:14.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.169+0000 7f6015c4f640 1 -- 172.21.15.91:0/2199259443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60100a6730 con 0x7f60100a70f0 2023-11-27T20:44:14.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.170+0000 7f6015c4f640 1 -- 172.21.15.91:0/2199259443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60100700f0 con 0x7f60100a70f0 2023-11-27T20:44:14.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.171+0000 7f5ff7fff640 1 -- 172.21.15.91:0/2199259443 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6008004000 con 0x7f60100a70f0 2023-11-27T20:44:14.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.172+0000 7f5ff7fff640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ffc06b1f0 0x7f5ffc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.172+0000 7f5ff7fff640 1 -- 172.21.15.91:0/2199259443 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f60080aca00 con 0x7f60100a70f0 2023-11-27T20:44:14.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.172+0000 7f600f7fe640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ffc06b1f0 0x7f5ffc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:14.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.173+0000 7f600f7fe640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ffc06b1f0 0x7f5ffc06d6b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f600000a870 tx=0x7f6000008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:14.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.176+0000 7f5ff7fff640 1 -- 172.21.15.91:0/2199259443 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6008077330 con 0x7f60100a70f0 2023-11-27T20:44:14.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.436+0000 7f6015c4f640 1 -- 172.21.15.91:0/2199259443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6010068350 con 0x7f60100a70f0 2023-11-27T20:44:14.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.437+0000 7f5ff7fff640 1 -- 172.21.15.91:0/2199259443 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1299 (secure 0 0 0) 0x7f600807a950 con 0x7f60100a70f0 2023-11-27T20:44:14.439 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:14.439 INFO:teuthology.orchestra.run.smithi091.stdout:{"fsid":"76812701-65a9-4deb-87af-ef00110d1601","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":184,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1701117682,"num_in_osds":8,"osd_in_since":1701117673,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129},{"state_name":"creating+peering","count":64}],"num_pgs":193,"num_pools":5,"num_objects":24,"data_bytes":594273,"bytes_used":240869376,"bytes_avail":772853243904,"bytes_total":773094113280,"inactive_pgs_ratio":0.33160620927810669},"fsmap":{"epoch":35,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":5790},{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5793}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-11-27T20:43:31.412167+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-27T20:44:14.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.439+0000 7f6015c4f640 1 -- 172.21.15.91:0/2199259443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ffc06b1f0 msgr2=0x7f5ffc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.439+0000 7f6015c4f640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ffc06b1f0 0x7f5ffc06d6b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f600000a870 tx=0x7f6000008040 comp rx=0 tx=0).stop 2023-11-27T20:44:14.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.439+0000 7f6015c4f640 1 -- 172.21.15.91:0/2199259443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a70f0 msgr2=0x7f601014d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.439+0000 7f6015c4f640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a70f0 0x7f601014d080 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f600802c4d0 tx=0x7f6008004a40 comp rx=0 tx=0).stop 2023-11-27T20:44:14.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.440+0000 7f6015c4f640 1 -- 172.21.15.91:0/2199259443 shutdown_connections 2023-11-27T20:44:14.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.440+0000 7f6015c4f640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60100a70f0 0x7f601014d080 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.440+0000 7f6015c4f640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5ffc06b1f0 0x7f5ffc06d6b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.440+0000 7f6015c4f640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6010155490 0x7f60101537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.440+0000 7f6015c4f640 1 --2- 172.21.15.91:0/2199259443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60100c1500 0x7f60101ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.440+0000 7f6015c4f640 1 -- 172.21.15.91:0/2199259443 >> 172.21.15.91:0/2199259443 conn(0x7f601006a500 msgr2=0x7f60100c4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.440+0000 7f6015c4f640 1 -- 172.21.15.91:0/2199259443 shutdown_connections 2023-11-27T20:44:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.440+0000 7f6015c4f640 1 -- 172.21.15.91:0/2199259443 wait complete. 2023-11-27T20:44:14.459 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-27T20:44:14.459 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:44:14.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.668+0000 7f323fc17640 1 Processor -- start 2023-11-27T20:44:14.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.668+0000 7f323fc17640 1 -- start start 2023-11-27T20:44:14.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323fc17640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f323814fd30 0x7f3238152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323fc17640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f323806d0a0 0x7f32380a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323fc17640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32380a5260 0x7f32380c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323fc17640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32380c64a0 con 0x7f32380a5260 2023-11-27T20:44:14.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323fc17640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32380c5c00 con 0x7f323806d0a0 2023-11-27T20:44:14.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323fc17640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32380c5ee0 con 0x7f323814fd30 2023-11-27T20:44:14.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323e1b4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32380a5260 0x7f32380c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:14.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323e1b4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32380a5260 0x7f32380c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36048/0 (socket says 172.21.15.91:36048) 2023-11-27T20:44:14.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323e1b4640 1 -- 172.21.15.91:0/1936758298 learned_addr learned my addr 172.21.15.91:0/1936758298 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:14.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323d9b3640 1 --2- 172.21.15.91:0/1936758298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f323814fd30 0x7f3238152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:14.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323d1b2640 1 --2- 172.21.15.91:0/1936758298 >> v2:172.21.15.183:3300/0 conn(0x7f323806d0a0 0x7f32380a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:14.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323e1b4640 1 -- 172.21.15.91:0/1936758298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f323814fd30 msgr2=0x7f3238152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:14.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323e1b4640 1 --2- 172.21.15.91:0/1936758298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f323814fd30 0x7f3238152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323e1b4640 1 -- 172.21.15.91:0/1936758298 >> v2:172.21.15.183:3300/0 conn(0x7f323806d0a0 msgr2=0x7f32380a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:14.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.670+0000 7f323e1b4640 1 --2- 172.21.15.91:0/1936758298 >> v2:172.21.15.183:3300/0 conn(0x7f323806d0a0 0x7f32380a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.671+0000 7f323e1b4640 1 -- 172.21.15.91:0/1936758298 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32380c61c0 con 0x7f32380a5260 2023-11-27T20:44:14.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.671+0000 7f323d1b2640 1 --2- 172.21.15.91:0/1936758298 >> v2:172.21.15.183:3300/0 conn(0x7f323806d0a0 0x7f32380a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:14.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.672+0000 7f323e1b4640 1 --2- 172.21.15.91:0/1936758298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32380a5260 0x7f32380c3ea0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f323806b280 tx=0x7f323002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae1d1313355ebc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:14.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.672+0000 7f323c9b1640 1 -- 172.21.15.91:0/1936758298 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323002ca70 con 0x7f32380a5260 2023-11-27T20:44:14.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.672+0000 7f323c9b1640 1 -- 172.21.15.91:0/1936758298 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323002cbd0 con 0x7f32380a5260 2023-11-27T20:44:14.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.672+0000 7f323c9b1640 1 -- 172.21.15.91:0/1936758298 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32300343f0 con 0x7f32380a5260 2023-11-27T20:44:14.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.673+0000 7f323fc17640 1 -- 172.21.15.91:0/1936758298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32380a5260 msgr2=0x7f32380c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.673+0000 7f323fc17640 1 --2- 172.21.15.91:0/1936758298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32380a5260 0x7f32380c3ea0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f323806b280 tx=0x7f323002bed0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.673+0000 7f323fc17640 1 -- 172.21.15.91:0/1936758298 shutdown_connections 2023-11-27T20:44:14.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.673+0000 7f323fc17640 1 --2- 172.21.15.91:0/1936758298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32380a5260 0x7f32380c3ea0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.673+0000 7f323fc17640 1 --2- 172.21.15.91:0/1936758298 >> v2:172.21.15.183:3300/0 conn(0x7f323806d0a0 0x7f32380a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.673+0000 7f323fc17640 1 --2- 172.21.15.91:0/1936758298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f323814fd30 0x7f3238152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.673+0000 7f323fc17640 1 -- 172.21.15.91:0/1936758298 >> 172.21.15.91:0/1936758298 conn(0x7f323806a500 msgr2=0x7f323806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:14.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.673+0000 7f323fc17640 1 -- 172.21.15.91:0/1936758298 shutdown_connections 2023-11-27T20:44:14.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.673+0000 7f323fc17640 1 -- 172.21.15.91:0/1936758298 wait complete. 2023-11-27T20:44:14.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.674+0000 7f323fc17640 1 Processor -- start 2023-11-27T20:44:14.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.675+0000 7f323fc17640 1 -- start start 2023-11-27T20:44:14.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.675+0000 7f323fc17640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f323806d0a0 0x7f32380a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.675+0000 7f323fc17640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32380a5260 0x7f32381dbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.675+0000 7f323fc17640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f323814fd30 0x7f32381ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.675+0000 7f323fc17640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323814f4a0 con 0x7f323806d0a0 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.675+0000 7f323fc17640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32380aac10 con 0x7f323814fd30 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.675+0000 7f323fc17640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32380aa900 con 0x7f32380a5260 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.676+0000 7f323d9b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f323806d0a0 0x7f32380a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.676+0000 7f323d9b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f323806d0a0 0x7f32380a9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36054/0 (socket says 172.21.15.91:36054) 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.676+0000 7f323d9b3640 1 -- 172.21.15.91:0/1041437060 learned_addr learned my addr 172.21.15.91:0/1041437060 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.676+0000 7f323d9b3640 1 -- 172.21.15.91:0/1041437060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32380a5260 msgr2=0x7f32381dbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.676+0000 7f323d9b3640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32380a5260 0x7f32381dbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.676+0000 7f323d9b3640 1 -- 172.21.15.91:0/1041437060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f323814fd30 msgr2=0x7f32381ddef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.676+0000 7f323d9b3640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f323814fd30 0x7f32381ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.676+0000 7f323d9b3640 1 -- 172.21.15.91:0/1041437060 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3230009b30 con 0x7f323806d0a0 2023-11-27T20:44:14.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.676+0000 7f323d9b3640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f323806d0a0 0x7f32380a9580 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f323400d5f0 tx=0x7f323400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:14.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.677+0000 7f322e7fc640 1 -- 172.21.15.91:0/1041437060 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340125f0 con 0x7f323806d0a0 2023-11-27T20:44:14.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.677+0000 7f322e7fc640 1 -- 172.21.15.91:0/1041437060 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234012750 con 0x7f323806d0a0 2023-11-27T20:44:14.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.677+0000 7f322e7fc640 1 -- 172.21.15.91:0/1041437060 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234012b00 con 0x7f323806d0a0 2023-11-27T20:44:14.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.677+0000 7f323fc17640 1 -- 172.21.15.91:0/1041437060 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32381dd7d0 con 0x7f323806d0a0 2023-11-27T20:44:14.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.677+0000 7f323fc17640 1 -- 172.21.15.91:0/1041437060 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323814ed70 con 0x7f323806d0a0 2023-11-27T20:44:14.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.678+0000 7f323fc17640 1 -- 172.21.15.91:0/1041437060 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323814ef90 con 0x7f323806d0a0 2023-11-27T20:44:14.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.679+0000 7f322e7fc640 1 -- 172.21.15.91:0/1041437060 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3234012c60 con 0x7f323806d0a0 2023-11-27T20:44:14.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.680+0000 7f322e7fc640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f321c06b1c0 0x7f321c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:14.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.680+0000 7f322e7fc640 1 -- 172.21.15.91:0/1041437060 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f323408a1c0 con 0x7f323806d0a0 2023-11-27T20:44:14.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.680+0000 7f323d1b2640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f321c06b1c0 0x7f321c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:14.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.681+0000 7f323d1b2640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f321c06b1c0 0x7f321c06d680 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f32381ee5d0 tx=0x7f3228008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:14.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.684+0000 7f322e7fc640 1 -- 172.21.15.91:0/1041437060 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3234054c20 con 0x7f323806d0a0 2023-11-27T20:44:14.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.871+0000 7f323fc17640 1 -- 172.21.15.91:0/1041437060 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32380c43e0 con 0x7f321c06b1c0 2023-11-27T20:44:14.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.909+0000 7f322e7fc640 1 -- 172.21.15.91:0/1041437060 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+519894 (secure 0 0 0) 0x7f322800a4a0 con 0x7f321c06b1c0 2023-11-27T20:44:14.917 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:14.922 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:44:14.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.920+0000 7f323fc17640 1 -- 172.21.15.91:0/1041437060 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f321c06b1c0 msgr2=0x7f321c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.920+0000 7f323fc17640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f321c06b1c0 0x7f321c06d680 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f32381ee5d0 tx=0x7f3228008040 comp rx=0 tx=0).stop 2023-11-27T20:44:14.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.920+0000 7f323fc17640 1 -- 172.21.15.91:0/1041437060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f323806d0a0 msgr2=0x7f32380a9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:14.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.920+0000 7f323fc17640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f323806d0a0 0x7f32380a9580 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f323400d5f0 tx=0x7f323400dab0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.920+0000 7f323fc17640 1 -- 172.21.15.91:0/1041437060 shutdown_connections 2023-11-27T20:44:14.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.920+0000 7f323fc17640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f321c06b1c0 0x7f321c06d680 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.920+0000 7f323fc17640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f323814fd30 0x7f32381ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.920+0000 7f323fc17640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32380a5260 0x7f32381dbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.920+0000 7f323fc17640 1 --2- 172.21.15.91:0/1041437060 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f323806d0a0 0x7f32380a9580 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:14.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.920+0000 7f323fc17640 1 -- 172.21.15.91:0/1041437060 >> 172.21.15.91:0/1041437060 conn(0x7f323806a500 msgr2=0x7f32380bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:14.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.921+0000 7f323fc17640 1 -- 172.21.15.91:0/1041437060 shutdown_connections 2023-11-27T20:44:14.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:14.921+0000 7f323fc17640 1 -- 172.21.15.91:0/1041437060 wait complete. 2023-11-27T20:44:14.946 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-11-27T20:44:13.424364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235224,"kb_used_data":6556,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739496,"statfs":{"total":773094113280,"available":772853243904,"internally_reserved":0,"allocated":6713344,"data_stored":3563600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001682"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528239+0000","last_change":"2023-11-27T20:44:07.528239+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528239+0000","last_undegraded":"2023-11-27T20:44:07.528239+0000","last_fullsized":"2023-11-27T20:44:07.528239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507747+0000","last_change":"2023-11-27T20:43:52.742706+0000","last_active":"2023-11-27T20:44:06.507747+0000","last_peered":"2023-11-27T20:44:06.507747+0000","last_clean":"2023-11-27T20:44:06.507747+0000","last_became_active":"2023-11-27T20:43:52.742447+0000","last_became_peered":"2023-11-27T20:43:52.742447+0000","last_unstale":"2023-11-27T20:44:06.507747+0000","last_undegraded":"2023-11-27T20:44:06.507747+0000","last_fullsized":"2023-11-27T20:44:06.507747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:10.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531466+0000","last_change":"2023-11-27T20:44:07.531466+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531466+0000","last_undegraded":"2023-11-27T20:44:07.531466+0000","last_fullsized":"2023-11-27T20:44:07.531466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514019+0000","last_change":"2023-11-27T20:43:52.741446+0000","last_active":"2023-11-27T20:44:06.514019+0000","last_peered":"2023-11-27T20:44:06.514019+0000","last_clean":"2023-11-27T20:44:06.514019+0000","last_became_active":"2023-11-27T20:43:52.741105+0000","last_became_peered":"2023-11-27T20:43:52.741105+0000","last_unstale":"2023-11-27T20:44:06.514019+0000","last_undegraded":"2023-11-27T20:44:06.514019+0000","last_fullsized":"2023-11-27T20:44:06.514019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:03.285901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.541507+0000","last_change":"2023-11-27T20:44:07.541507+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.541507+0000","last_undegraded":"2023-11-27T20:44:07.541507+0000","last_fullsized":"2023-11-27T20:44:07.541507+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513834+0000","last_change":"2023-11-27T20:43:52.737240+0000","last_active":"2023-11-27T20:44:06.513834+0000","last_peered":"2023-11-27T20:44:06.513834+0000","last_clean":"2023-11-27T20:44:06.513834+0000","last_became_active":"2023-11-27T20:43:52.736781+0000","last_became_peered":"2023-11-27T20:43:52.736781+0000","last_unstale":"2023-11-27T20:44:06.513834+0000","last_undegraded":"2023-11-27T20:44:06.513834+0000","last_fullsized":"2023-11-27T20:44:06.513834+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527473+0000","last_change":"2023-11-27T20:44:07.527473+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527473+0000","last_undegraded":"2023-11-27T20:44:07.527473+0000","last_fullsized":"2023-11-27T20:44:07.527473+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521084+0000","last_change":"2023-11-27T20:43:52.738199+0000","last_active":"2023-11-27T20:44:06.521084+0000","last_peered":"2023-11-27T20:44:06.521084+0000","last_clean":"2023-11-27T20:44:06.521084+0000","last_became_active":"2023-11-27T20:43:52.737298+0000","last_became_peered":"2023-11-27T20:43:52.737298+0000","last_unstale":"2023-11-27T20:44:06.521084+0000","last_undegraded":"2023-11-27T20:44:06.521084+0000","last_fullsized":"2023-11-27T20:44:06.521084+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:54.739325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531917+0000","last_change":"2023-11-27T20:44:07.531917+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531917+0000","last_undegraded":"2023-11-27T20:44:07.531917+0000","last_fullsized":"2023-11-27T20:44:07.531917+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506135+0000","last_change":"2023-11-27T20:43:52.745287+0000","last_active":"2023-11-27T20:44:06.506135+0000","last_peered":"2023-11-27T20:44:06.506135+0000","last_clean":"2023-11-27T20:44:06.506135+0000","last_became_active":"2023-11-27T20:43:52.744817+0000","last_became_peered":"2023-11-27T20:43:52.744817+0000","last_unstale":"2023-11-27T20:44:06.506135+0000","last_undegraded":"2023-11-27T20:44:06.506135+0000","last_fullsized":"2023-11-27T20:44:06.506135+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:59.992569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525264+0000","last_change":"2023-11-27T20:44:07.525264+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525264+0000","last_undegraded":"2023-11-27T20:44:07.525264+0000","last_fullsized":"2023-11-27T20:44:07.525264+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511440+0000","last_change":"2023-11-27T20:43:52.737877+0000","last_active":"2023-11-27T20:44:06.511440+0000","last_peered":"2023-11-27T20:44:06.511440+0000","last_clean":"2023-11-27T20:44:06.511440+0000","last_became_active":"2023-11-27T20:43:52.737566+0000","last_became_peered":"2023-11-27T20:43:52.737566+0000","last_unstale":"2023-11-27T20:44:06.511440+0000","last_undegraded":"2023-11-27T20:44:06.511440+0000","last_fullsized":"2023-11-27T20:44:06.511440+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526887+0000","last_change":"2023-11-27T20:44:07.526887+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526887+0000","last_undegraded":"2023-11-27T20:44:07.526887+0000","last_fullsized":"2023-11-27T20:44:07.526887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505272+0000","last_change":"2023-11-27T20:43:52.738797+0000","last_active":"2023-11-27T20:44:06.505272+0000","last_peered":"2023-11-27T20:44:06.505272+0000","last_clean":"2023-11-27T20:44:06.505272+0000","last_became_active":"2023-11-27T20:43:52.738444+0000","last_became_peered":"2023-11-27T20:43:52.738444+0000","last_unstale":"2023-11-27T20:44:06.505272+0000","last_undegraded":"2023-11-27T20:44:06.505272+0000","last_fullsized":"2023-11-27T20:44:06.505272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:23.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526581+0000","last_change":"2023-11-27T20:44:07.526581+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526581+0000","last_undegraded":"2023-11-27T20:44:07.526581+0000","last_fullsized":"2023-11-27T20:44:07.526581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511067+0000","last_change":"2023-11-27T20:43:52.742425+0000","last_active":"2023-11-27T20:44:06.511067+0000","last_peered":"2023-11-27T20:44:06.511067+0000","last_clean":"2023-11-27T20:44:06.511067+0000","last_became_active":"2023-11-27T20:43:52.741079+0000","last_became_peered":"2023-11-27T20:43:52.741079+0000","last_unstale":"2023-11-27T20:44:06.511067+0000","last_undegraded":"2023-11-27T20:44:06.511067+0000","last_fullsized":"2023-11-27T20:44:06.511067+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:21.581873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.540259+0000","last_change":"2023-11-27T20:44:07.540259+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.540259+0000","last_undegraded":"2023-11-27T20:44:07.540259+0000","last_fullsized":"2023-11-27T20:44:07.540259+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.509318+0000","last_change":"2023-11-27T20:43:52.749527+0000","last_active":"2023-11-27T20:44:06.509318+0000","last_peered":"2023-11-27T20:44:06.509318+0000","last_clean":"2023-11-27T20:44:06.509318+0000","last_became_active":"2023-11-27T20:43:52.749261+0000","last_became_peered":"2023-11-27T20:43:52.749261+0000","last_unstale":"2023-11-27T20:44:06.509318+0000","last_undegraded":"2023-11-27T20:44:06.509318+0000","last_fullsized":"2023-11-27T20:44:06.509318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:22.440110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531049+0000","last_change":"2023-11-27T20:44:07.531049+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531049+0000","last_undegraded":"2023-11-27T20:44:07.531049+0000","last_fullsized":"2023-11-27T20:44:07.531049+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500881+0000","last_change":"2023-11-27T20:43:52.724633+0000","last_active":"2023-11-27T20:44:06.500881+0000","last_peered":"2023-11-27T20:44:06.500881+0000","last_clean":"2023-11-27T20:44:06.500881+0000","last_became_active":"2023-11-27T20:43:52.724319+0000","last_became_peered":"2023-11-27T20:43:52.724319+0000","last_unstale":"2023-11-27T20:44:06.500881+0000","last_undegraded":"2023-11-27T20:44:06.500881+0000","last_fullsized":"2023-11-27T20:44:06.500881+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:56.115106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.535763+0000","last_change":"2023-11-27T20:44:07.535763+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.535763+0000","last_undegraded":"2023-11-27T20:44:07.535763+0000","last_fullsized":"2023-11-27T20:44:07.535763+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500638+0000","last_change":"2023-11-27T20:43:52.740239+0000","last_active":"2023-11-27T20:44:06.500638+0000","last_peered":"2023-11-27T20:44:06.500638+0000","last_clean":"2023-11-27T20:44:06.500638+0000","last_became_active":"2023-11-27T20:43:52.739953+0000","last_became_peered":"2023-11-27T20:43:52.739953+0000","last_unstale":"2023-11-27T20:44:06.500638+0000","last_undegraded":"2023-11-27T20:44:06.500638+0000","last_fullsized":"2023-11-27T20:44:06.500638+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:21.512849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530979+0000","last_change":"2023-11-27T20:44:07.530979+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530979+0000","last_undegraded":"2023-11-27T20:44:07.530979+0000","last_fullsized":"2023-11-27T20:44:07.530979+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521359+0000","last_change":"2023-11-27T20:43:52.736636+0000","last_active":"2023-11-27T20:44:06.521359+0000","last_peered":"2023-11-27T20:44:06.521359+0000","last_clean":"2023-11-27T20:44:06.521359+0000","last_became_active":"2023-11-27T20:43:52.730532+0000","last_became_peered":"2023-11-27T20:43:52.730532+0000","last_unstale":"2023-11-27T20:44:06.521359+0000","last_undegraded":"2023-11-27T20:44:06.521359+0000","last_fullsized":"2023-11-27T20:44:06.521359+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537228+0000","last_change":"2023-11-27T20:44:07.537228+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537228+0000","last_undegraded":"2023-11-27T20:44:07.537228+0000","last_fullsized":"2023-11-27T20:44:07.537228+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.520579+0000","last_change":"2023-11-27T20:43:52.734813+0000","last_active":"2023-11-27T20:44:06.520579+0000","last_peered":"2023-11-27T20:44:06.520579+0000","last_clean":"2023-11-27T20:44:06.520579+0000","last_became_active":"2023-11-27T20:43:52.734472+0000","last_became_peered":"2023-11-27T20:43:52.734472+0000","last_unstale":"2023-11-27T20:44:06.520579+0000","last_undegraded":"2023-11-27T20:44:06.520579+0000","last_fullsized":"2023-11-27T20:44:06.520579+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:00.871014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521140+0000","last_change":"2023-11-27T20:44:07.521140+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521140+0000","last_undegraded":"2023-11-27T20:44:07.521140+0000","last_fullsized":"2023-11-27T20:44:07.521140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.503259+0000","last_change":"2023-11-27T20:43:52.737259+0000","last_active":"2023-11-27T20:44:06.503259+0000","last_peered":"2023-11-27T20:44:06.503259+0000","last_clean":"2023-11-27T20:44:06.503259+0000","last_became_active":"2023-11-27T20:43:52.735819+0000","last_became_peered":"2023-11-27T20:43:52.735819+0000","last_unstale":"2023-11-27T20:44:06.503259+0000","last_undegraded":"2023-11-27T20:44:06.503259+0000","last_fullsized":"2023-11-27T20:44:06.503259+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:42.590467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530684+0000","last_change":"2023-11-27T20:44:07.530684+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530684+0000","last_undegraded":"2023-11-27T20:44:07.530684+0000","last_fullsized":"2023-11-27T20:44:07.530684+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505502+0000","last_change":"2023-11-27T20:43:52.743966+0000","last_active":"2023-11-27T20:44:06.505502+0000","last_peered":"2023-11-27T20:44:06.505502+0000","last_clean":"2023-11-27T20:44:06.505502+0000","last_became_active":"2023-11-27T20:43:52.743629+0000","last_became_peered":"2023-11-27T20:43:52.743629+0000","last_unstale":"2023-11-27T20:44:06.505502+0000","last_undegraded":"2023-11-27T20:44:06.505502+0000","last_fullsized":"2023-11-27T20:44:06.505502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:06.257254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527533+0000","last_change":"2023-11-27T20:44:07.527533+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527533+0000","last_undegraded":"2023-11-27T20:44:07.527533+0000","last_fullsized":"2023-11-27T20:44:07.527533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511481+0000","last_change":"2023-11-27T20:43:52.745826+0000","last_active":"2023-11-27T20:44:06.511481+0000","last_peered":"2023-11-27T20:44:06.511481+0000","last_clean":"2023-11-27T20:44:06.511481+0000","last_became_active":"2023-11-27T20:43:52.745542+0000","last_became_peered":"2023-11-27T20:43:52.745542+0000","last_unstale":"2023-11-27T20:44:06.511481+0000","last_undegraded":"2023-11-27T20:44:06.511481+0000","last_fullsized":"2023-11-27T20:44:06.511481+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:30.595824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525282+0000","last_change":"2023-11-27T20:44:07.525282+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525282+0000","last_undegraded":"2023-11-27T20:44:07.525282+0000","last_fullsized":"2023-11-27T20:44:07.525282+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514319+0000","last_change":"2023-11-27T20:43:52.722794+0000","last_active":"2023-11-27T20:44:06.514319+0000","last_peered":"2023-11-27T20:44:06.514319+0000","last_clean":"2023-11-27T20:44:06.514319+0000","last_became_active":"2023-11-27T20:43:52.722489+0000","last_became_peered":"2023-11-27T20:43:52.722489+0000","last_unstale":"2023-11-27T20:44:06.514319+0000","last_undegraded":"2023-11-27T20:44:06.514319+0000","last_fullsized":"2023-11-27T20:44:06.514319+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:33:24.275033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530733+0000","last_change":"2023-11-27T20:44:07.530733+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530733+0000","last_undegraded":"2023-11-27T20:44:07.530733+0000","last_fullsized":"2023-11-27T20:44:07.530733+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519150+0000","last_change":"2023-11-27T20:43:52.755856+0000","last_active":"2023-11-27T20:44:06.519150+0000","last_peered":"2023-11-27T20:44:06.519150+0000","last_clean":"2023-11-27T20:44:06.519150+0000","last_became_active":"2023-11-27T20:43:52.755447+0000","last_became_peered":"2023-11-27T20:43:52.755447+0000","last_unstale":"2023-11-27T20:44:06.519150+0000","last_undegraded":"2023-11-27T20:44:06.519150+0000","last_fullsized":"2023-11-27T20:44:06.519150+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528962+0000","last_change":"2023-11-27T20:44:07.528962+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528962+0000","last_undegraded":"2023-11-27T20:44:07.528962+0000","last_fullsized":"2023-11-27T20:44:07.528962+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507626+0000","last_change":"2023-11-27T20:43:52.743704+0000","last_active":"2023-11-27T20:44:06.507626+0000","last_peered":"2023-11-27T20:44:06.507626+0000","last_clean":"2023-11-27T20:44:06.507626+0000","last_became_active":"2023-11-27T20:43:52.743440+0000","last_became_peered":"2023-11-27T20:43:52.743440+0000","last_unstale":"2023-11-27T20:44:06.507626+0000","last_undegraded":"2023-11-27T20:44:06.507626+0000","last_fullsized":"2023-11-27T20:44:06.507626+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:40.038308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529520+0000","last_change":"2023-11-27T20:44:07.529520+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529520+0000","last_undegraded":"2023-11-27T20:44:07.529520+0000","last_fullsized":"2023-11-27T20:44:07.529520+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513801+0000","last_change":"2023-11-27T20:43:52.753806+0000","last_active":"2023-11-27T20:44:06.513801+0000","last_peered":"2023-11-27T20:44:06.513801+0000","last_clean":"2023-11-27T20:44:06.513801+0000","last_became_active":"2023-11-27T20:43:52.753119+0000","last_became_peered":"2023-11-27T20:43:52.753119+0000","last_unstale":"2023-11-27T20:44:06.513801+0000","last_undegraded":"2023-11-27T20:44:06.513801+0000","last_fullsized":"2023-11-27T20:44:06.513801+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:44.226522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537041+0000","last_change":"2023-11-27T20:44:07.537041+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537041+0000","last_undegraded":"2023-11-27T20:44:07.537041+0000","last_fullsized":"2023-11-27T20:44:07.537041+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516707+0000","last_change":"2023-11-27T20:43:52.738852+0000","last_active":"2023-11-27T20:44:06.516707+0000","last_peered":"2023-11-27T20:44:06.516707+0000","last_clean":"2023-11-27T20:44:06.516707+0000","last_became_active":"2023-11-27T20:43:52.738571+0000","last_became_peered":"2023-11-27T20:43:52.738571+0000","last_unstale":"2023-11-27T20:44:06.516707+0000","last_undegraded":"2023-11-27T20:44:06.516707+0000","last_fullsized":"2023-11-27T20:44:06.516707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539485+0000","last_change":"2023-11-27T20:44:07.539485+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539485+0000","last_undegraded":"2023-11-27T20:44:07.539485+0000","last_fullsized":"2023-11-27T20:44:07.539485+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511365+0000","last_change":"2023-11-27T20:43:52.734845+0000","last_active":"2023-11-27T20:44:06.511365+0000","last_peered":"2023-11-27T20:44:06.511365+0000","last_clean":"2023-11-27T20:44:06.511365+0000","last_became_active":"2023-11-27T20:43:52.734288+0000","last_became_peered":"2023-11-27T20:43:52.734288+0000","last_unstale":"2023-11-27T20:44:06.511365+0000","last_undegraded":"2023-11-27T20:44:06.511365+0000","last_fullsized":"2023-11-27T20:44:06.511365+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:08:45.447871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521111+0000","last_change":"2023-11-27T20:44:07.521111+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521111+0000","last_undegraded":"2023-11-27T20:44:07.521111+0000","last_fullsized":"2023-11-27T20:44:07.521111+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518661+0000","last_change":"2023-11-27T20:43:52.741528+0000","last_active":"2023-11-27T20:44:06.518661+0000","last_peered":"2023-11-27T20:44:06.518661+0000","last_clean":"2023-11-27T20:44:06.518661+0000","last_became_active":"2023-11-27T20:43:52.741247+0000","last_became_peered":"2023-11-27T20:43:52.741247+0000","last_unstale":"2023-11-27T20:44:06.518661+0000","last_undegraded":"2023-11-27T20:44:06.518661+0000","last_fullsized":"2023-11-27T20:44:06.518661+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.521167+0000","last_change":"2023-11-27T20:44:07.521167+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.521167+0000","last_undegraded":"2023-11-27T20:44:07.521167+0000","last_fullsized":"2023-11-27T20:44:07.521167+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517222+0000","last_change":"2023-11-27T20:43:52.749184+0000","last_active":"2023-11-27T20:44:06.517222+0000","last_peered":"2023-11-27T20:44:06.517222+0000","last_clean":"2023-11-27T20:44:06.517222+0000","last_became_active":"2023-11-27T20:43:52.747304+0000","last_became_peered":"2023-11-27T20:43:52.747304+0000","last_unstale":"2023-11-27T20:44:06.517222+0000","last_undegraded":"2023-11-27T20:44:06.517222+0000","last_fullsized":"2023-11-27T20:44:06.517222+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:21.580869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527612+0000","last_change":"2023-11-27T20:44:07.527612+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527612+0000","last_undegraded":"2023-11-27T20:44:07.527612+0000","last_fullsized":"2023-11-27T20:44:07.527612+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507945+0000","last_change":"2023-11-27T20:43:52.746466+0000","last_active":"2023-11-27T20:44:06.507945+0000","last_peered":"2023-11-27T20:44:06.507945+0000","last_clean":"2023-11-27T20:44:06.507945+0000","last_became_active":"2023-11-27T20:43:52.746197+0000","last_became_peered":"2023-11-27T20:43:52.746197+0000","last_unstale":"2023-11-27T20:44:06.507945+0000","last_undegraded":"2023-11-27T20:44:06.507945+0000","last_fullsized":"2023-11-27T20:44:06.507945+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:53.742011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.522993+0000","last_change":"2023-11-27T20:44:07.522993+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.522993+0000","last_undegraded":"2023-11-27T20:44:07.522993+0000","last_fullsized":"2023-11-27T20:44:07.522993+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521583+0000","last_change":"2023-11-27T20:43:52.739506+0000","last_active":"2023-11-27T20:44:06.521583+0000","last_peered":"2023-11-27T20:44:06.521583+0000","last_clean":"2023-11-27T20:44:06.521583+0000","last_became_active":"2023-11-27T20:43:52.739234+0000","last_became_peered":"2023-11-27T20:43:52.739234+0000","last_unstale":"2023-11-27T20:44:06.521583+0000","last_undegraded":"2023-11-27T20:44:06.521583+0000","last_fullsized":"2023-11-27T20:44:06.521583+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:32.431178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524843+0000","last_change":"2023-11-27T20:44:07.524843+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524843+0000","last_undegraded":"2023-11-27T20:44:07.524843+0000","last_fullsized":"2023-11-27T20:44:07.524843+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513010+0000","last_change":"2023-11-27T20:43:52.758309+0000","last_active":"2023-11-27T20:44:06.513010+0000","last_peered":"2023-11-27T20:44:06.513010+0000","last_clean":"2023-11-27T20:44:06.513010+0000","last_became_active":"2023-11-27T20:43:52.755787+0000","last_became_peered":"2023-11-27T20:43:52.755787+0000","last_unstale":"2023-11-27T20:44:06.513010+0000","last_undegraded":"2023-11-27T20:44:06.513010+0000","last_fullsized":"2023-11-27T20:44:06.513010+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.536848+0000","last_change":"2023-11-27T20:44:07.536848+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.536848+0000","last_undegraded":"2023-11-27T20:44:07.536848+0000","last_fullsized":"2023-11-27T20:44:07.536848+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506125+0000","last_change":"2023-11-27T20:43:52.743954+0000","last_active":"2023-11-27T20:44:06.506125+0000","last_peered":"2023-11-27T20:44:06.506125+0000","last_clean":"2023-11-27T20:44:06.506125+0000","last_became_active":"2023-11-27T20:43:52.743696+0000","last_became_peered":"2023-11-27T20:43:52.743696+0000","last_unstale":"2023-11-27T20:44:06.506125+0000","last_undegraded":"2023-11-27T20:44:06.506125+0000","last_fullsized":"2023-11-27T20:44:06.506125+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:35.875636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530894+0000","last_change":"2023-11-27T20:44:07.530894+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530894+0000","last_undegraded":"2023-11-27T20:44:07.530894+0000","last_fullsized":"2023-11-27T20:44:07.530894+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513909+0000","last_change":"2023-11-27T20:43:52.740150+0000","last_active":"2023-11-27T20:44:06.513909+0000","last_peered":"2023-11-27T20:44:06.513909+0000","last_clean":"2023-11-27T20:44:06.513909+0000","last_became_active":"2023-11-27T20:43:52.735557+0000","last_became_peered":"2023-11-27T20:43:52.735557+0000","last_unstale":"2023-11-27T20:44:06.513909+0000","last_undegraded":"2023-11-27T20:44:06.513909+0000","last_fullsized":"2023-11-27T20:44:06.513909+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:26:49.710558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.522867+0000","last_change":"2023-11-27T20:44:07.522867+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.522867+0000","last_undegraded":"2023-11-27T20:44:07.522867+0000","last_fullsized":"2023-11-27T20:44:07.522867+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513742+0000","last_change":"2023-11-27T20:43:52.743341+0000","last_active":"2023-11-27T20:44:06.513742+0000","last_peered":"2023-11-27T20:44:06.513742+0000","last_clean":"2023-11-27T20:44:06.513742+0000","last_became_active":"2023-11-27T20:43:52.742947+0000","last_became_peered":"2023-11-27T20:43:52.742947+0000","last_unstale":"2023-11-27T20:44:06.513742+0000","last_undegraded":"2023-11-27T20:44:06.513742+0000","last_fullsized":"2023-11-27T20:44:06.513742+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:30.595824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525868+0000","last_change":"2023-11-27T20:44:07.525868+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525868+0000","last_undegraded":"2023-11-27T20:44:07.525868+0000","last_fullsized":"2023-11-27T20:44:07.525868+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.505911+0000","last_change":"2023-11-27T20:43:52.746463+0000","last_active":"2023-11-27T20:44:06.505911+0000","last_peered":"2023-11-27T20:44:06.505911+0000","last_clean":"2023-11-27T20:44:06.505911+0000","last_became_active":"2023-11-27T20:43:52.746028+0000","last_became_peered":"2023-11-27T20:43:52.746028+0000","last_unstale":"2023-11-27T20:44:06.505911+0000","last_undegraded":"2023-11-27T20:44:06.505911+0000","last_fullsized":"2023-11-27T20:44:06.505911+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:00.873986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.532834+0000","last_change":"2023-11-27T20:44:07.532834+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.532834+0000","last_undegraded":"2023-11-27T20:44:07.532834+0000","last_fullsized":"2023-11-27T20:44:07.532834+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511596+0000","last_change":"2023-11-27T20:43:52.757800+0000","last_active":"2023-11-27T20:44:06.511596+0000","last_peered":"2023-11-27T20:44:06.511596+0000","last_clean":"2023-11-27T20:44:06.511596+0000","last_became_active":"2023-11-27T20:43:52.755994+0000","last_became_peered":"2023-11-27T20:43:52.755994+0000","last_unstale":"2023-11-27T20:44:06.511596+0000","last_undegraded":"2023-11-27T20:44:06.511596+0000","last_fullsized":"2023-11-27T20:44:06.511596+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528764+0000","last_change":"2023-11-27T20:44:07.528764+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528764+0000","last_undegraded":"2023-11-27T20:44:07.528764+0000","last_fullsized":"2023-11-27T20:44:07.528764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.545677+0000","last_change":"2023-11-27T20:44:07.540451+0000","last_active":"2023-11-27T20:44:07.545677+0000","last_peered":"2023-11-27T20:44:07.545677+0000","last_clean":"2023-11-27T20:44:07.545677+0000","last_became_active":"2023-11-27T20:44:07.540140+0000","last_became_peered":"2023-11-27T20:44:07.540140+0000","last_unstale":"2023-11-27T20:44:07.545677+0000","last_undegraded":"2023-11-27T20:44:07.545677+0000","last_fullsized":"2023-11-27T20:44:07.545677+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:34.727698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513103+0000","last_change":"2023-11-27T20:43:52.755932+0000","last_active":"2023-11-27T20:44:06.513103+0000","last_peered":"2023-11-27T20:44:06.513103+0000","last_clean":"2023-11-27T20:44:06.513103+0000","last_became_active":"2023-11-27T20:43:52.751888+0000","last_became_peered":"2023-11-27T20:43:52.751888+0000","last_unstale":"2023-11-27T20:44:06.513103+0000","last_undegraded":"2023-11-27T20:44:06.513103+0000","last_fullsized":"2023-11-27T20:44:06.513103+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:19.340689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513396+0000","last_change":"2023-11-27T20:43:51.704982+0000","last_active":"2023-11-27T20:44:06.513396+0000","last_peered":"2023-11-27T20:44:06.513396+0000","last_clean":"2023-11-27T20:44:06.513396+0000","last_became_active":"2023-11-27T20:43:51.703346+0000","last_became_peered":"2023-11-27T20:43:51.703346+0000","last_unstale":"2023-11-27T20:44:06.513396+0000","last_undegraded":"2023-11-27T20:44:06.513396+0000","last_fullsized":"2023-11-27T20:44:06.513396+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:53.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539753+0000","last_change":"2023-11-27T20:44:07.539753+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539753+0000","last_undegraded":"2023-11-27T20:44:07.539753+0000","last_fullsized":"2023-11-27T20:44:07.539753+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.551999+0000","last_change":"2023-11-27T20:44:07.548707+0000","last_active":"2023-11-27T20:44:07.551999+0000","last_peered":"2023-11-27T20:44:07.551999+0000","last_clean":"2023-11-27T20:44:07.551999+0000","last_became_active":"2023-11-27T20:44:07.544542+0000","last_became_peered":"2023-11-27T20:44:07.544542+0000","last_unstale":"2023-11-27T20:44:07.551999+0000","last_undegraded":"2023-11-27T20:44:07.551999+0000","last_fullsized":"2023-11-27T20:44:07.551999+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:08.453722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500681+0000","last_change":"2023-11-27T20:43:52.736197+0000","last_active":"2023-11-27T20:44:06.500681+0000","last_peered":"2023-11-27T20:44:06.500681+0000","last_clean":"2023-11-27T20:44:06.500681+0000","last_became_active":"2023-11-27T20:43:52.735889+0000","last_became_peered":"2023-11-27T20:43:52.735889+0000","last_unstale":"2023-11-27T20:44:06.500681+0000","last_undegraded":"2023-11-27T20:44:06.500681+0000","last_fullsized":"2023-11-27T20:44:06.500681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:46.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514100+0000","last_change":"2023-11-27T20:43:51.711368+0000","last_active":"2023-11-27T20:44:06.514100+0000","last_peered":"2023-11-27T20:44:06.514100+0000","last_clean":"2023-11-27T20:44:06.514100+0000","last_became_active":"2023-11-27T20:43:51.711087+0000","last_became_peered":"2023-11-27T20:43:51.711087+0000","last_unstale":"2023-11-27T20:44:06.514100+0000","last_undegraded":"2023-11-27T20:44:06.514100+0000","last_fullsized":"2023-11-27T20:44:06.514100+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:54.352803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.536855+0000","last_change":"2023-11-27T20:44:07.536855+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.536855+0000","last_undegraded":"2023-11-27T20:44:07.536855+0000","last_fullsized":"2023-11-27T20:44:07.536855+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.556568+0000","last_change":"2023-11-27T20:44:07.554191+0000","last_active":"2023-11-27T20:44:07.556568+0000","last_peered":"2023-11-27T20:44:07.556568+0000","last_clean":"2023-11-27T20:44:07.556568+0000","last_became_active":"2023-11-27T20:44:07.553915+0000","last_became_peered":"2023-11-27T20:44:07.553915+0000","last_unstale":"2023-11-27T20:44:07.556568+0000","last_undegraded":"2023-11-27T20:44:07.556568+0000","last_fullsized":"2023-11-27T20:44:07.556568+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:50.983600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512394+0000","last_change":"2023-11-27T20:43:52.759667+0000","last_active":"2023-11-27T20:44:06.512394+0000","last_peered":"2023-11-27T20:44:06.512394+0000","last_clean":"2023-11-27T20:44:06.512394+0000","last_became_active":"2023-11-27T20:43:52.759386+0000","last_became_peered":"2023-11-27T20:43:52.759386+0000","last_unstale":"2023-11-27T20:44:06.512394+0000","last_undegraded":"2023-11-27T20:44:06.512394+0000","last_fullsized":"2023-11-27T20:44:06.512394+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513309+0000","last_change":"2023-11-27T20:43:51.699372+0000","last_active":"2023-11-27T20:44:06.513309+0000","last_peered":"2023-11-27T20:44:06.513309+0000","last_clean":"2023-11-27T20:44:06.513309+0000","last_became_active":"2023-11-27T20:43:51.698989+0000","last_became_peered":"2023-11-27T20:43:51.698989+0000","last_unstale":"2023-11-27T20:44:06.513309+0000","last_undegraded":"2023-11-27T20:44:06.513309+0000","last_fullsized":"2023-11-27T20:44:06.513309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:29.612413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527825+0000","last_change":"2023-11-27T20:44:07.527825+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527825+0000","last_undegraded":"2023-11-27T20:44:07.527825+0000","last_fullsized":"2023-11-27T20:44:07.527825+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.544789+0000","last_change":"2023-11-27T20:44:07.543034+0000","last_active":"2023-11-27T20:44:07.544789+0000","last_peered":"2023-11-27T20:44:07.544789+0000","last_clean":"2023-11-27T20:44:07.544789+0000","last_became_active":"2023-11-27T20:44:07.542752+0000","last_became_peered":"2023-11-27T20:44:07.542752+0000","last_unstale":"2023-11-27T20:44:07.544789+0000","last_undegraded":"2023-11-27T20:44:07.544789+0000","last_fullsized":"2023-11-27T20:44:07.544789+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:10.575183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513504+0000","last_change":"2023-11-27T20:43:52.746554+0000","last_active":"2023-11-27T20:44:06.513504+0000","last_peered":"2023-11-27T20:44:06.513504+0000","last_clean":"2023-11-27T20:44:06.513504+0000","last_became_active":"2023-11-27T20:43:52.746133+0000","last_became_peered":"2023-11-27T20:43:52.746133+0000","last_unstale":"2023-11-27T20:44:06.513504+0000","last_undegraded":"2023-11-27T20:44:06.513504+0000","last_fullsized":"2023-11-27T20:44:06.513504+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:55.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521352+0000","last_change":"2023-11-27T20:43:51.707254+0000","last_active":"2023-11-27T20:44:06.521352+0000","last_peered":"2023-11-27T20:44:06.521352+0000","last_clean":"2023-11-27T20:44:06.521352+0000","last_became_active":"2023-11-27T20:43:51.706908+0000","last_became_peered":"2023-11-27T20:43:51.706908+0000","last_unstale":"2023-11-27T20:44:06.521352+0000","last_undegraded":"2023-11-27T20:44:06.521352+0000","last_fullsized":"2023-11-27T20:44:06.521352+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:04.233780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526427+0000","last_change":"2023-11-27T20:44:07.526427+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526427+0000","last_undegraded":"2023-11-27T20:44:07.526427+0000","last_fullsized":"2023-11-27T20:44:07.526427+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.539459+0000","last_change":"2023-11-27T20:44:07.535849+0000","last_active":"2023-11-27T20:44:07.539459+0000","last_peered":"2023-11-27T20:44:07.539459+0000","last_clean":"2023-11-27T20:44:07.539459+0000","last_became_active":"2023-11-27T20:44:07.535564+0000","last_became_peered":"2023-11-27T20:44:07.535564+0000","last_unstale":"2023-11-27T20:44:07.539459+0000","last_undegraded":"2023-11-27T20:44:07.539459+0000","last_fullsized":"2023-11-27T20:44:07.539459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:29.891814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511441+0000","last_change":"2023-11-27T20:43:52.734666+0000","last_active":"2023-11-27T20:44:06.511441+0000","last_peered":"2023-11-27T20:44:06.511441+0000","last_clean":"2023-11-27T20:44:06.511441+0000","last_became_active":"2023-11-27T20:43:52.733983+0000","last_became_peered":"2023-11-27T20:43:52.733983+0000","last_unstale":"2023-11-27T20:44:06.511441+0000","last_undegraded":"2023-11-27T20:44:06.511441+0000","last_fullsized":"2023-11-27T20:44:06.511441+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:55.762089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.507244+0000","last_change":"2023-11-27T20:43:51.711467+0000","last_active":"2023-11-27T20:44:06.507244+0000","last_peered":"2023-11-27T20:44:06.507244+0000","last_clean":"2023-11-27T20:44:06.507244+0000","last_became_active":"2023-11-27T20:43:51.711141+0000","last_became_peered":"2023-11-27T20:43:51.711141+0000","last_unstale":"2023-11-27T20:44:06.507244+0000","last_undegraded":"2023-11-27T20:44:06.507244+0000","last_fullsized":"2023-11-27T20:44:06.507244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:14.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530389+0000","last_change":"2023-11-27T20:44:07.530389+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530389+0000","last_undegraded":"2023-11-27T20:44:07.530389+0000","last_fullsized":"2023-11-27T20:44:07.530389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547796+0000","last_change":"2023-11-27T20:44:07.546578+0000","last_active":"2023-11-27T20:44:07.547796+0000","last_peered":"2023-11-27T20:44:07.547796+0000","last_clean":"2023-11-27T20:44:07.547796+0000","last_became_active":"2023-11-27T20:44:07.545547+0000","last_became_peered":"2023-11-27T20:44:07.545547+0000","last_unstale":"2023-11-27T20:44:07.547796+0000","last_undegraded":"2023-11-27T20:44:07.547796+0000","last_fullsized":"2023-11-27T20:44:07.547796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:55.426778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513740+0000","last_change":"2023-11-27T20:43:52.740355+0000","last_active":"2023-11-27T20:44:06.513740+0000","last_peered":"2023-11-27T20:44:06.513740+0000","last_clean":"2023-11-27T20:44:06.513740+0000","last_became_active":"2023-11-27T20:43:52.739879+0000","last_became_peered":"2023-11-27T20:43:52.739879+0000","last_unstale":"2023-11-27T20:44:06.513740+0000","last_undegraded":"2023-11-27T20:44:06.513740+0000","last_fullsized":"2023-11-27T20:44:06.513740+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:08:26.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511517+0000","last_change":"2023-11-27T20:43:51.701819+0000","last_active":"2023-11-27T20:44:06.511517+0000","last_peered":"2023-11-27T20:44:06.511517+0000","last_clean":"2023-11-27T20:44:06.511517+0000","last_became_active":"2023-11-27T20:43:51.701542+0000","last_became_peered":"2023-11-27T20:43:51.701542+0000","last_unstale":"2023-11-27T20:44:06.511517+0000","last_undegraded":"2023-11-27T20:44:06.511517+0000","last_fullsized":"2023-11-27T20:44:06.511517+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:53.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529870+0000","last_change":"2023-11-27T20:44:07.529870+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529870+0000","last_undegraded":"2023-11-27T20:44:07.529870+0000","last_fullsized":"2023-11-27T20:44:07.529870+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.544729+0000","last_change":"2023-11-27T20:44:07.538342+0000","last_active":"2023-11-27T20:44:07.544729+0000","last_peered":"2023-11-27T20:44:07.544729+0000","last_clean":"2023-11-27T20:44:07.544729+0000","last_became_active":"2023-11-27T20:44:07.538037+0000","last_became_peered":"2023-11-27T20:44:07.538037+0000","last_unstale":"2023-11-27T20:44:07.544729+0000","last_undegraded":"2023-11-27T20:44:07.544729+0000","last_fullsized":"2023-11-27T20:44:07.544729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:29:08.542478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515412+0000","last_change":"2023-11-27T20:43:52.735677+0000","last_active":"2023-11-27T20:44:06.515412+0000","last_peered":"2023-11-27T20:44:06.515412+0000","last_clean":"2023-11-27T20:44:06.515412+0000","last_became_active":"2023-11-27T20:43:52.734624+0000","last_became_peered":"2023-11-27T20:43:52.734624+0000","last_unstale":"2023-11-27T20:44:06.515412+0000","last_undegraded":"2023-11-27T20:44:06.515412+0000","last_fullsized":"2023-11-27T20:44:06.515412+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:42.798849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519354+0000","last_change":"2023-11-27T20:43:51.706490+0000","last_active":"2023-11-27T20:44:06.519354+0000","last_peered":"2023-11-27T20:44:06.519354+0000","last_clean":"2023-11-27T20:44:06.519354+0000","last_became_active":"2023-11-27T20:43:51.706181+0000","last_became_peered":"2023-11-27T20:43:51.706181+0000","last_unstale":"2023-11-27T20:44:06.519354+0000","last_undegraded":"2023-11-27T20:44:06.519354+0000","last_fullsized":"2023-11-27T20:44:06.519354+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:41.580304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523700+0000","last_change":"2023-11-27T20:44:07.523700+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523700+0000","last_undegraded":"2023-11-27T20:44:07.523700+0000","last_fullsized":"2023-11-27T20:44:07.523700+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.548497+0000","last_change":"2023-11-27T20:44:07.543638+0000","last_active":"2023-11-27T20:44:07.548497+0000","last_peered":"2023-11-27T20:44:07.548497+0000","last_clean":"2023-11-27T20:44:07.548497+0000","last_became_active":"2023-11-27T20:44:07.543049+0000","last_became_peered":"2023-11-27T20:44:07.543049+0000","last_unstale":"2023-11-27T20:44:07.548497+0000","last_undegraded":"2023-11-27T20:44:07.548497+0000","last_fullsized":"2023-11-27T20:44:07.548497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:38.215762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511164+0000","last_change":"2023-11-27T20:43:52.732611+0000","last_active":"2023-11-27T20:44:06.511164+0000","last_peered":"2023-11-27T20:44:06.511164+0000","last_clean":"2023-11-27T20:44:06.511164+0000","last_became_active":"2023-11-27T20:43:52.732338+0000","last_became_peered":"2023-11-27T20:43:52.732338+0000","last_unstale":"2023-11-27T20:44:06.511164+0000","last_undegraded":"2023-11-27T20:44:06.511164+0000","last_fullsized":"2023-11-27T20:44:06.511164+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:36.170506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506363+0000","last_change":"2023-11-27T20:43:51.712506+0000","last_active":"2023-11-27T20:44:06.506363+0000","last_peered":"2023-11-27T20:44:06.506363+0000","last_clean":"2023-11-27T20:44:06.506363+0000","last_became_active":"2023-11-27T20:43:51.712167+0000","last_became_peered":"2023-11-27T20:43:51.712167+0000","last_unstale":"2023-11-27T20:44:06.506363+0000","last_undegraded":"2023-11-27T20:44:06.506363+0000","last_fullsized":"2023-11-27T20:44:06.506363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:20.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528088+0000","last_change":"2023-11-27T20:44:07.528088+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528088+0000","last_undegraded":"2023-11-27T20:44:07.528088+0000","last_fullsized":"2023-11-27T20:44:07.528088+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547939+0000","last_change":"2023-11-27T20:44:07.541198+0000","last_active":"2023-11-27T20:44:07.547939+0000","last_peered":"2023-11-27T20:44:07.547939+0000","last_clean":"2023-11-27T20:44:07.547939+0000","last_became_active":"2023-11-27T20:44:07.540715+0000","last_became_peered":"2023-11-27T20:44:07.540715+0000","last_unstale":"2023-11-27T20:44:07.547939+0000","last_undegraded":"2023-11-27T20:44:07.547939+0000","last_fullsized":"2023-11-27T20:44:07.547939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:33:36.245172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.509400+0000","last_change":"2023-11-27T20:43:52.743697+0000","last_active":"2023-11-27T20:44:06.509400+0000","last_peered":"2023-11-27T20:44:06.509400+0000","last_clean":"2023-11-27T20:44:06.509400+0000","last_became_active":"2023-11-27T20:43:52.743405+0000","last_became_peered":"2023-11-27T20:43:52.743405+0000","last_unstale":"2023-11-27T20:44:06.509400+0000","last_undegraded":"2023-11-27T20:44:06.509400+0000","last_fullsized":"2023-11-27T20:44:06.509400+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519933+0000","last_change":"2023-11-27T20:43:51.716942+0000","last_active":"2023-11-27T20:44:06.519933+0000","last_peered":"2023-11-27T20:44:06.519933+0000","last_clean":"2023-11-27T20:44:06.519933+0000","last_became_active":"2023-11-27T20:43:51.716549+0000","last_became_peered":"2023-11-27T20:43:51.716549+0000","last_unstale":"2023-11-27T20:44:06.519933+0000","last_undegraded":"2023-11-27T20:44:06.519933+0000","last_fullsized":"2023-11-27T20:44:06.519933+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529398+0000","last_change":"2023-11-27T20:44:07.529398+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529398+0000","last_undegraded":"2023-11-27T20:44:07.529398+0000","last_fullsized":"2023-11-27T20:44:07.529398+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.543312+0000","last_change":"2023-11-27T20:44:07.540741+0000","last_active":"2023-11-27T20:44:07.543312+0000","last_peered":"2023-11-27T20:44:07.543312+0000","last_clean":"2023-11-27T20:44:07.543312+0000","last_became_active":"2023-11-27T20:44:07.540459+0000","last_became_peered":"2023-11-27T20:44:07.540459+0000","last_unstale":"2023-11-27T20:44:07.543312+0000","last_undegraded":"2023-11-27T20:44:07.543312+0000","last_fullsized":"2023-11-27T20:44:07.543312+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:38.215762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519822+0000","last_change":"2023-11-27T20:43:52.747269+0000","last_active":"2023-11-27T20:44:06.519822+0000","last_peered":"2023-11-27T20:44:06.519822+0000","last_clean":"2023-11-27T20:44:06.519822+0000","last_became_active":"2023-11-27T20:43:52.746473+0000","last_became_peered":"2023-11-27T20:43:52.746473+0000","last_unstale":"2023-11-27T20:44:06.519822+0000","last_undegraded":"2023-11-27T20:44:06.519822+0000","last_fullsized":"2023-11-27T20:44:06.519822+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:55.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514190+0000","last_change":"2023-11-27T20:43:51.711346+0000","last_active":"2023-11-27T20:44:06.514190+0000","last_peered":"2023-11-27T20:44:06.514190+0000","last_clean":"2023-11-27T20:44:06.514190+0000","last_became_active":"2023-11-27T20:43:51.711060+0000","last_became_peered":"2023-11-27T20:43:51.711060+0000","last_unstale":"2023-11-27T20:44:06.514190+0000","last_undegraded":"2023-11-27T20:44:06.514190+0000","last_fullsized":"2023-11-27T20:44:06.514190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:18.330525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531925+0000","last_change":"2023-11-27T20:44:07.531925+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531925+0000","last_undegraded":"2023-11-27T20:44:07.531925+0000","last_fullsized":"2023-11-27T20:44:07.531925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.541276+0000","last_change":"2023-11-27T20:44:07.537248+0000","last_active":"2023-11-27T20:44:07.541276+0000","last_peered":"2023-11-27T20:44:07.541276+0000","last_clean":"2023-11-27T20:44:07.541276+0000","last_became_active":"2023-11-27T20:44:07.535963+0000","last_became_peered":"2023-11-27T20:44:07.535963+0000","last_unstale":"2023-11-27T20:44:07.541276+0000","last_undegraded":"2023-11-27T20:44:07.541276+0000","last_fullsized":"2023-11-27T20:44:07.541276+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:43.756684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500291+0000","last_change":"2023-11-27T20:43:52.738413+0000","last_active":"2023-11-27T20:44:06.500291+0000","last_peered":"2023-11-27T20:44:06.500291+0000","last_clean":"2023-11-27T20:44:06.500291+0000","last_became_active":"2023-11-27T20:43:52.738105+0000","last_became_peered":"2023-11-27T20:43:52.738105+0000","last_unstale":"2023-11-27T20:44:06.500291+0000","last_undegraded":"2023-11-27T20:44:06.500291+0000","last_fullsized":"2023-11-27T20:44:06.500291+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:00.871014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518398+0000","last_change":"2023-11-27T20:43:51.716907+0000","last_active":"2023-11-27T20:44:06.518398+0000","last_peered":"2023-11-27T20:44:06.518398+0000","last_clean":"2023-11-27T20:44:06.518398+0000","last_became_active":"2023-11-27T20:43:51.716616+0000","last_became_peered":"2023-11-27T20:43:51.716616+0000","last_unstale":"2023-11-27T20:44:06.518398+0000","last_undegraded":"2023-11-27T20:44:06.518398+0000","last_fullsized":"2023-11-27T20:44:06.518398+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.538067+0000","last_change":"2023-11-27T20:44:07.538067+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.538067+0000","last_undegraded":"2023-11-27T20:44:07.538067+0000","last_fullsized":"2023-11-27T20:44:07.538067+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.556080+0000","last_change":"2023-11-27T20:44:07.553474+0000","last_active":"2023-11-27T20:44:07.556080+0000","last_peered":"2023-11-27T20:44:07.556080+0000","last_clean":"2023-11-27T20:44:07.556080+0000","last_became_active":"2023-11-27T20:44:07.553184+0000","last_became_peered":"2023-11-27T20:44:07.553184+0000","last_unstale":"2023-11-27T20:44:07.556080+0000","last_undegraded":"2023-11-27T20:44:07.556080+0000","last_fullsized":"2023-11-27T20:44:07.556080+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:21.070349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517989+0000","last_change":"2023-11-27T20:43:52.740853+0000","last_active":"2023-11-27T20:44:06.517989+0000","last_peered":"2023-11-27T20:44:06.517989+0000","last_clean":"2023-11-27T20:44:06.517989+0000","last_became_active":"2023-11-27T20:43:52.740468+0000","last_became_peered":"2023-11-27T20:43:52.740468+0000","last_unstale":"2023-11-27T20:44:06.517989+0000","last_undegraded":"2023-11-27T20:44:06.517989+0000","last_fullsized":"2023-11-27T20:44:06.517989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'8","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.508060+0000","last_change":"2023-11-27T20:43:51.711651+0000","last_active":"2023-11-27T20:44:06.508060+0000","last_peered":"2023-11-27T20:44:06.508060+0000","last_clean":"2023-11-27T20:44:06.508060+0000","last_became_active":"2023-11-27T20:43:51.711270+0000","last_became_peered":"2023-11-27T20:43:51.711270+0000","last_unstale":"2023-11-27T20:44:06.508060+0000","last_undegraded":"2023-11-27T20:44:06.508060+0000","last_fullsized":"2023-11-27T20:44:06.508060+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:07.560276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.532546+0000","last_change":"2023-11-27T20:44:07.532546+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.532546+0000","last_undegraded":"2023-11-27T20:44:07.532546+0000","last_fullsized":"2023-11-27T20:44:07.532546+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552434+0000","last_change":"2023-11-27T20:44:07.550573+0000","last_active":"2023-11-27T20:44:07.552434+0000","last_peered":"2023-11-27T20:44:07.552434+0000","last_clean":"2023-11-27T20:44:07.552434+0000","last_became_active":"2023-11-27T20:44:07.549497+0000","last_became_peered":"2023-11-27T20:44:07.549497+0000","last_unstale":"2023-11-27T20:44:07.552434+0000","last_undegraded":"2023-11-27T20:44:07.552434+0000","last_fullsized":"2023-11-27T20:44:07.552434+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:17.251945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517767+0000","last_change":"2023-11-27T20:43:52.731258+0000","last_active":"2023-11-27T20:44:06.517767+0000","last_peered":"2023-11-27T20:44:06.517767+0000","last_clean":"2023-11-27T20:44:06.517767+0000","last_became_active":"2023-11-27T20:43:52.730701+0000","last_became_peered":"2023-11-27T20:43:52.730701+0000","last_unstale":"2023-11-27T20:44:06.517767+0000","last_undegraded":"2023-11-27T20:44:06.517767+0000","last_fullsized":"2023-11-27T20:44:06.517767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:28.943589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513829+0000","last_change":"2023-11-27T20:43:51.709141+0000","last_active":"2023-11-27T20:44:06.513829+0000","last_peered":"2023-11-27T20:44:06.513829+0000","last_clean":"2023-11-27T20:44:06.513829+0000","last_became_active":"2023-11-27T20:43:51.708864+0000","last_became_peered":"2023-11-27T20:43:51.708864+0000","last_unstale":"2023-11-27T20:44:06.513829+0000","last_undegraded":"2023-11-27T20:44:06.513829+0000","last_fullsized":"2023-11-27T20:44:06.513829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:29.585661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531534+0000","last_change":"2023-11-27T20:44:07.531534+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531534+0000","last_undegraded":"2023-11-27T20:44:07.531534+0000","last_fullsized":"2023-11-27T20:44:07.531534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.555776+0000","last_change":"2023-11-27T20:44:07.553337+0000","last_active":"2023-11-27T20:44:07.555776+0000","last_peered":"2023-11-27T20:44:07.555776+0000","last_clean":"2023-11-27T20:44:07.555776+0000","last_became_active":"2023-11-27T20:44:07.552962+0000","last_became_peered":"2023-11-27T20:44:07.552962+0000","last_unstale":"2023-11-27T20:44:07.555776+0000","last_undegraded":"2023-11-27T20:44:07.555776+0000","last_fullsized":"2023-11-27T20:44:07.555776+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:16:09.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516879+0000","last_change":"2023-11-27T20:43:52.736912+0000","last_active":"2023-11-27T20:44:06.516879+0000","last_peered":"2023-11-27T20:44:06.516879+0000","last_clean":"2023-11-27T20:44:06.516879+0000","last_became_active":"2023-11-27T20:43:52.735675+0000","last_became_peered":"2023-11-27T20:43:52.735675+0000","last_unstale":"2023-11-27T20:44:06.516879+0000","last_undegraded":"2023-11-27T20:44:06.516879+0000","last_fullsized":"2023-11-27T20:44:06.516879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517569+0000","last_change":"2023-11-27T20:43:51.711938+0000","last_active":"2023-11-27T20:44:06.517569+0000","last_peered":"2023-11-27T20:44:06.517569+0000","last_clean":"2023-11-27T20:44:06.517569+0000","last_became_active":"2023-11-27T20:43:51.711617+0000","last_became_peered":"2023-11-27T20:43:51.711617+0000","last_unstale":"2023-11-27T20:44:06.517569+0000","last_undegraded":"2023-11-27T20:44:06.517569+0000","last_fullsized":"2023-11-27T20:44:06.517569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:54.146026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537759+0000","last_change":"2023-11-27T20:44:07.537759+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537759+0000","last_undegraded":"2023-11-27T20:44:07.537759+0000","last_fullsized":"2023-11-27T20:44:07.537759+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.553685+0000","last_change":"2023-11-27T20:44:07.550581+0000","last_active":"2023-11-27T20:44:07.553685+0000","last_peered":"2023-11-27T20:44:07.553685+0000","last_clean":"2023-11-27T20:44:07.553685+0000","last_became_active":"2023-11-27T20:44:07.549832+0000","last_became_peered":"2023-11-27T20:44:07.549832+0000","last_unstale":"2023-11-27T20:44:07.553685+0000","last_undegraded":"2023-11-27T20:44:07.553685+0000","last_fullsized":"2023-11-27T20:44:07.553685+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:32.588898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506128+0000","last_change":"2023-11-27T20:43:52.742672+0000","last_active":"2023-11-27T20:44:06.506128+0000","last_peered":"2023-11-27T20:44:06.506128+0000","last_clean":"2023-11-27T20:44:06.506128+0000","last_became_active":"2023-11-27T20:43:52.742066+0000","last_became_peered":"2023-11-27T20:43:52.742066+0000","last_unstale":"2023-11-27T20:44:06.506128+0000","last_undegraded":"2023-11-27T20:44:06.506128+0000","last_fullsized":"2023-11-27T20:44:06.506128+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:01.982839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519493+0000","last_change":"2023-11-27T20:43:51.711077+0000","last_active":"2023-11-27T20:44:06.519493+0000","last_peered":"2023-11-27T20:44:06.519493+0000","last_clean":"2023-11-27T20:44:06.519493+0000","last_became_active":"2023-11-27T20:43:51.710820+0000","last_became_peered":"2023-11-27T20:43:51.710820+0000","last_unstale":"2023-11-27T20:44:06.519493+0000","last_undegraded":"2023-11-27T20:44:06.519493+0000","last_fullsized":"2023-11-27T20:44:06.519493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:21.429946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.529666+0000","last_change":"2023-11-27T20:44:07.529666+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.529666+0000","last_undegraded":"2023-11-27T20:44:07.529666+0000","last_fullsized":"2023-11-27T20:44:07.529666+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.549409+0000","last_change":"2023-11-27T20:44:07.547343+0000","last_active":"2023-11-27T20:44:07.549409+0000","last_peered":"2023-11-27T20:44:07.549409+0000","last_clean":"2023-11-27T20:44:07.549409+0000","last_became_active":"2023-11-27T20:44:07.547004+0000","last_became_peered":"2023-11-27T20:44:07.547004+0000","last_unstale":"2023-11-27T20:44:07.549409+0000","last_undegraded":"2023-11-27T20:44:07.549409+0000","last_fullsized":"2023-11-27T20:44:07.549409+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:32.700621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518818+0000","last_change":"2023-11-27T20:43:52.742494+0000","last_active":"2023-11-27T20:44:06.518818+0000","last_peered":"2023-11-27T20:44:06.518818+0000","last_clean":"2023-11-27T20:44:06.518818+0000","last_became_active":"2023-11-27T20:43:52.742174+0000","last_became_peered":"2023-11-27T20:43:52.742174+0000","last_unstale":"2023-11-27T20:44:06.518818+0000","last_undegraded":"2023-11-27T20:44:06.518818+0000","last_fullsized":"2023-11-27T20:44:06.518818+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515344+0000","last_change":"2023-11-27T20:43:51.714679+0000","last_active":"2023-11-27T20:44:06.515344+0000","last_peered":"2023-11-27T20:44:06.515344+0000","last_clean":"2023-11-27T20:44:06.515344+0000","last_became_active":"2023-11-27T20:43:51.714406+0000","last_became_peered":"2023-11-27T20:43:51.714406+0000","last_unstale":"2023-11-27T20:44:06.515344+0000","last_undegraded":"2023-11-27T20:44:06.515344+0000","last_fullsized":"2023-11-27T20:44:06.515344+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:27.933426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530632+0000","last_change":"2023-11-27T20:44:07.530632+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530632+0000","last_undegraded":"2023-11-27T20:44:07.530632+0000","last_fullsized":"2023-11-27T20:44:07.530632+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.548455+0000","last_change":"2023-11-27T20:44:07.544501+0000","last_active":"2023-11-27T20:44:07.548455+0000","last_peered":"2023-11-27T20:44:07.548455+0000","last_clean":"2023-11-27T20:44:07.548455+0000","last_became_active":"2023-11-27T20:44:07.542118+0000","last_became_peered":"2023-11-27T20:44:07.542118+0000","last_unstale":"2023-11-27T20:44:07.548455+0000","last_undegraded":"2023-11-27T20:44:07.548455+0000","last_fullsized":"2023-11-27T20:44:07.548455+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:23.383534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.519295+0000","last_change":"2023-11-27T20:43:52.743633+0000","last_active":"2023-11-27T20:44:06.519295+0000","last_peered":"2023-11-27T20:44:06.519295+0000","last_clean":"2023-11-27T20:44:06.519295+0000","last_became_active":"2023-11-27T20:43:52.743243+0000","last_became_peered":"2023-11-27T20:43:52.743243+0000","last_unstale":"2023-11-27T20:44:06.519295+0000","last_undegraded":"2023-11-27T20:44:06.519295+0000","last_fullsized":"2023-11-27T20:44:06.519295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.514358+0000","last_change":"2023-11-27T20:43:51.714371+0000","last_active":"2023-11-27T20:44:06.514358+0000","last_peered":"2023-11-27T20:44:06.514358+0000","last_clean":"2023-11-27T20:44:06.514358+0000","last_became_active":"2023-11-27T20:43:51.714034+0000","last_became_peered":"2023-11-27T20:43:51.714034+0000","last_unstale":"2023-11-27T20:44:06.514358+0000","last_undegraded":"2023-11-27T20:44:06.514358+0000","last_fullsized":"2023-11-27T20:44:06.514358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.528667+0000","last_change":"2023-11-27T20:44:07.528667+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.528667+0000","last_undegraded":"2023-11-27T20:44:07.528667+0000","last_fullsized":"2023-11-27T20:44:07.528667+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.555914+0000","last_change":"2023-11-27T20:44:07.552420+0000","last_active":"2023-11-27T20:44:07.555914+0000","last_peered":"2023-11-27T20:44:07.555914+0000","last_clean":"2023-11-27T20:44:07.555914+0000","last_became_active":"2023-11-27T20:44:07.552130+0000","last_became_peered":"2023-11-27T20:44:07.552130+0000","last_unstale":"2023-11-27T20:44:07.555914+0000","last_undegraded":"2023-11-27T20:44:07.555914+0000","last_fullsized":"2023-11-27T20:44:07.555914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:48.971506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521884+0000","last_change":"2023-11-27T20:43:52.741261+0000","last_active":"2023-11-27T20:44:06.521884+0000","last_peered":"2023-11-27T20:44:06.521884+0000","last_clean":"2023-11-27T20:44:06.521884+0000","last_became_active":"2023-11-27T20:43:52.740962+0000","last_became_peered":"2023-11-27T20:43:52.740962+0000","last_unstale":"2023-11-27T20:44:06.521884+0000","last_undegraded":"2023-11-27T20:44:06.521884+0000","last_fullsized":"2023-11-27T20:44:06.521884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513200+0000","last_change":"2023-11-27T20:43:51.708347+0000","last_active":"2023-11-27T20:44:06.513200+0000","last_peered":"2023-11-27T20:44:06.513200+0000","last_clean":"2023-11-27T20:44:06.513200+0000","last_became_active":"2023-11-27T20:43:51.707976+0000","last_became_peered":"2023-11-27T20:43:51.707976+0000","last_unstale":"2023-11-27T20:44:06.513200+0000","last_undegraded":"2023-11-27T20:44:06.513200+0000","last_fullsized":"2023-11-27T20:44:06.513200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523039+0000","last_change":"2023-11-27T20:44:07.523039+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523039+0000","last_undegraded":"2023-11-27T20:44:07.523039+0000","last_fullsized":"2023-11-27T20:44:07.523039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552454+0000","last_change":"2023-11-27T20:44:07.551592+0000","last_active":"2023-11-27T20:44:07.552454+0000","last_peered":"2023-11-27T20:44:07.552454+0000","last_clean":"2023-11-27T20:44:07.552454+0000","last_became_active":"2023-11-27T20:44:07.546829+0000","last_became_peered":"2023-11-27T20:44:07.546829+0000","last_unstale":"2023-11-27T20:44:07.552454+0000","last_undegraded":"2023-11-27T20:44:07.552454+0000","last_fullsized":"2023-11-27T20:44:07.552454+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:16.795933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513832+0000","last_change":"2023-11-27T20:43:52.740074+0000","last_active":"2023-11-27T20:44:06.513832+0000","last_peered":"2023-11-27T20:44:06.513832+0000","last_clean":"2023-11-27T20:44:06.513832+0000","last_became_active":"2023-11-27T20:43:52.739760+0000","last_became_peered":"2023-11-27T20:43:52.739760+0000","last_unstale":"2023-11-27T20:44:06.513832+0000","last_undegraded":"2023-11-27T20:44:06.513832+0000","last_fullsized":"2023-11-27T20:44:06.513832+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:48:56.029031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521593+0000","last_change":"2023-11-27T20:43:51.707359+0000","last_active":"2023-11-27T20:44:06.521593+0000","last_peered":"2023-11-27T20:44:06.521593+0000","last_clean":"2023-11-27T20:44:06.521593+0000","last_became_active":"2023-11-27T20:43:51.707036+0000","last_became_peered":"2023-11-27T20:43:51.707036+0000","last_unstale":"2023-11-27T20:44:06.521593+0000","last_undegraded":"2023-11-27T20:44:06.521593+0000","last_fullsized":"2023-11-27T20:44:06.521593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537488+0000","last_change":"2023-11-27T20:44:07.537488+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537488+0000","last_undegraded":"2023-11-27T20:44:07.537488+0000","last_fullsized":"2023-11-27T20:44:07.537488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547197+0000","last_change":"2023-11-27T20:44:07.542732+0000","last_active":"2023-11-27T20:44:07.547197+0000","last_peered":"2023-11-27T20:44:07.547197+0000","last_clean":"2023-11-27T20:44:07.547197+0000","last_became_active":"2023-11-27T20:44:07.542131+0000","last_became_peered":"2023-11-27T20:44:07.542131+0000","last_unstale":"2023-11-27T20:44:07.547197+0000","last_undegraded":"2023-11-27T20:44:07.547197+0000","last_fullsized":"2023-11-27T20:44:07.547197+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:47.244273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.518144+0000","last_change":"2023-11-27T20:43:52.749840+0000","last_active":"2023-11-27T20:44:06.518144+0000","last_peered":"2023-11-27T20:44:06.518144+0000","last_clean":"2023-11-27T20:44:06.518144+0000","last_became_active":"2023-11-27T20:43:52.749390+0000","last_became_peered":"2023-11-27T20:43:52.749390+0000","last_unstale":"2023-11-27T20:44:06.518144+0000","last_undegraded":"2023-11-27T20:44:06.518144+0000","last_fullsized":"2023-11-27T20:44:06.518144+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512519+0000","last_change":"2023-11-27T20:43:51.704467+0000","last_active":"2023-11-27T20:44:06.512519+0000","last_peered":"2023-11-27T20:44:06.512519+0000","last_clean":"2023-11-27T20:44:06.512519+0000","last_became_active":"2023-11-27T20:43:51.704172+0000","last_became_peered":"2023-11-27T20:43:51.704172+0000","last_unstale":"2023-11-27T20:44:06.512519+0000","last_undegraded":"2023-11-27T20:44:06.512519+0000","last_fullsized":"2023-11-27T20:44:06.512519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:44.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524398+0000","last_change":"2023-11-27T20:44:07.524398+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524398+0000","last_undegraded":"2023-11-27T20:44:07.524398+0000","last_fullsized":"2023-11-27T20:44:07.524398+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552575+0000","last_change":"2023-11-27T20:44:07.551204+0000","last_active":"2023-11-27T20:44:07.552575+0000","last_peered":"2023-11-27T20:44:07.552575+0000","last_clean":"2023-11-27T20:44:07.552575+0000","last_became_active":"2023-11-27T20:44:07.550936+0000","last_became_peered":"2023-11-27T20:44:07.550936+0000","last_unstale":"2023-11-27T20:44:07.552575+0000","last_undegraded":"2023-11-27T20:44:07.552575+0000","last_fullsized":"2023-11-27T20:44:07.552575+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:17:14.216974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517804+0000","last_change":"2023-11-27T20:43:52.730278+0000","last_active":"2023-11-27T20:44:06.517804+0000","last_peered":"2023-11-27T20:44:06.517804+0000","last_clean":"2023-11-27T20:44:06.517804+0000","last_became_active":"2023-11-27T20:43:52.729894+0000","last_became_peered":"2023-11-27T20:43:52.729894+0000","last_unstale":"2023-11-27T20:44:06.517804+0000","last_undegraded":"2023-11-27T20:44:06.517804+0000","last_fullsized":"2023-11-27T20:44:06.517804+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:54.288377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513991+0000","last_change":"2023-11-27T20:43:51.709579+0000","last_active":"2023-11-27T20:44:06.513991+0000","last_peered":"2023-11-27T20:44:06.513991+0000","last_clean":"2023-11-27T20:44:06.513991+0000","last_became_active":"2023-11-27T20:43:51.709194+0000","last_became_peered":"2023-11-27T20:43:51.709194+0000","last_unstale":"2023-11-27T20:44:06.513991+0000","last_undegraded":"2023-11-27T20:44:06.513991+0000","last_fullsized":"2023-11-27T20:44:06.513991+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:01.414182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523350+0000","last_change":"2023-11-27T20:44:07.523350+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523350+0000","last_undegraded":"2023-11-27T20:44:07.523350+0000","last_fullsized":"2023-11-27T20:44:07.523350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.553873+0000","last_change":"2023-11-27T20:44:07.547935+0000","last_active":"2023-11-27T20:44:07.553873+0000","last_peered":"2023-11-27T20:44:07.553873+0000","last_clean":"2023-11-27T20:44:07.553873+0000","last_became_active":"2023-11-27T20:44:07.547663+0000","last_became_peered":"2023-11-27T20:44:07.547663+0000","last_unstale":"2023-11-27T20:44:07.553873+0000","last_undegraded":"2023-11-27T20:44:07.553873+0000","last_fullsized":"2023-11-27T20:44:07.553873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:56:07.645663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512173+0000","last_change":"2023-11-27T20:43:52.750078+0000","last_active":"2023-11-27T20:44:06.512173+0000","last_peered":"2023-11-27T20:44:06.512173+0000","last_clean":"2023-11-27T20:44:06.512173+0000","last_became_active":"2023-11-27T20:43:52.749770+0000","last_became_peered":"2023-11-27T20:43:52.749770+0000","last_unstale":"2023-11-27T20:44:06.512173+0000","last_undegraded":"2023-11-27T20:44:06.512173+0000","last_fullsized":"2023-11-27T20:44:06.512173+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500103+0000","last_change":"2023-11-27T20:43:51.708599+0000","last_active":"2023-11-27T20:44:06.500103+0000","last_peered":"2023-11-27T20:44:06.500103+0000","last_clean":"2023-11-27T20:44:06.500103+0000","last_became_active":"2023-11-27T20:43:51.708311+0000","last_became_peered":"2023-11-27T20:43:51.708311+0000","last_unstale":"2023-11-27T20:44:06.500103+0000","last_undegraded":"2023-11-27T20:44:06.500103+0000","last_fullsized":"2023-11-27T20:44:06.500103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:39.603520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.525440+0000","last_change":"2023-11-27T20:44:07.525440+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.525440+0000","last_undegraded":"2023-11-27T20:44:07.525440+0000","last_fullsized":"2023-11-27T20:44:07.525440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547438+0000","last_change":"2023-11-27T20:44:07.543371+0000","last_active":"2023-11-27T20:44:07.547438+0000","last_peered":"2023-11-27T20:44:07.547438+0000","last_clean":"2023-11-27T20:44:07.547438+0000","last_became_active":"2023-11-27T20:44:07.542654+0000","last_became_peered":"2023-11-27T20:44:07.542654+0000","last_unstale":"2023-11-27T20:44:07.547438+0000","last_undegraded":"2023-11-27T20:44:07.547438+0000","last_fullsized":"2023-11-27T20:44:07.547438+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:29.891814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.512999+0000","last_change":"2023-11-27T20:43:52.745035+0000","last_active":"2023-11-27T20:44:06.512999+0000","last_peered":"2023-11-27T20:44:06.512999+0000","last_clean":"2023-11-27T20:44:06.512999+0000","last_became_active":"2023-11-27T20:43:52.744540+0000","last_became_peered":"2023-11-27T20:43:52.744540+0000","last_unstale":"2023-11-27T20:44:06.512999+0000","last_undegraded":"2023-11-27T20:44:06.512999+0000","last_fullsized":"2023-11-27T20:44:06.512999+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517954+0000","last_change":"2023-11-27T20:43:51.703755+0000","last_active":"2023-11-27T20:44:06.517954+0000","last_peered":"2023-11-27T20:44:06.517954+0000","last_clean":"2023-11-27T20:44:06.517954+0000","last_became_active":"2023-11-27T20:43:51.700051+0000","last_became_peered":"2023-11-27T20:43:51.700051+0000","last_unstale":"2023-11-27T20:44:06.517954+0000","last_undegraded":"2023-11-27T20:44:06.517954+0000","last_fullsized":"2023-11-27T20:44:06.517954+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:00.972675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537506+0000","last_change":"2023-11-27T20:44:07.537506+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537506+0000","last_undegraded":"2023-11-27T20:44:07.537506+0000","last_fullsized":"2023-11-27T20:44:07.537506+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547864+0000","last_change":"2023-11-27T20:44:07.546057+0000","last_active":"2023-11-27T20:44:07.547864+0000","last_peered":"2023-11-27T20:44:07.547864+0000","last_clean":"2023-11-27T20:44:07.547864+0000","last_became_active":"2023-11-27T20:44:07.543702+0000","last_became_peered":"2023-11-27T20:44:07.543702+0000","last_unstale":"2023-11-27T20:44:07.547864+0000","last_undegraded":"2023-11-27T20:44:07.547864+0000","last_fullsized":"2023-11-27T20:44:07.547864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:31.531196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521707+0000","last_change":"2023-11-27T20:43:52.735455+0000","last_active":"2023-11-27T20:44:06.521707+0000","last_peered":"2023-11-27T20:44:06.521707+0000","last_clean":"2023-11-27T20:44:06.521707+0000","last_became_active":"2023-11-27T20:43:52.735128+0000","last_became_peered":"2023-11-27T20:43:52.735128+0000","last_unstale":"2023-11-27T20:44:06.521707+0000","last_undegraded":"2023-11-27T20:44:06.521707+0000","last_fullsized":"2023-11-27T20:44:06.521707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500775+0000","last_change":"2023-11-27T20:43:51.711208+0000","last_active":"2023-11-27T20:44:06.500775+0000","last_peered":"2023-11-27T20:44:06.500775+0000","last_clean":"2023-11-27T20:44:06.500775+0000","last_became_active":"2023-11-27T20:43:51.710936+0000","last_became_peered":"2023-11-27T20:43:51.710936+0000","last_unstale":"2023-11-27T20:44:06.500775+0000","last_undegraded":"2023-11-27T20:44:06.500775+0000","last_fullsized":"2023-11-27T20:44:06.500775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:20.570705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.539096+0000","last_change":"2023-11-27T20:44:07.539096+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.539096+0000","last_undegraded":"2023-11-27T20:44:07.539096+0000","last_fullsized":"2023-11-27T20:44:07.539096+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.546342+0000","last_change":"2023-11-27T20:44:07.545626+0000","last_active":"2023-11-27T20:44:07.546342+0000","last_peered":"2023-11-27T20:44:07.546342+0000","last_clean":"2023-11-27T20:44:07.546342+0000","last_became_active":"2023-11-27T20:44:07.545085+0000","last_became_peered":"2023-11-27T20:44:07.545085+0000","last_unstale":"2023-11-27T20:44:07.546342+0000","last_undegraded":"2023-11-27T20:44:07.546342+0000","last_fullsized":"2023-11-27T20:44:07.546342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:39.893393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521932+0000","last_change":"2023-11-27T20:43:52.739121+0000","last_active":"2023-11-27T20:44:06.521932+0000","last_peered":"2023-11-27T20:44:06.521932+0000","last_clean":"2023-11-27T20:44:06.521932+0000","last_became_active":"2023-11-27T20:43:52.738758+0000","last_became_peered":"2023-11-27T20:43:52.738758+0000","last_unstale":"2023-11-27T20:44:06.521932+0000","last_undegraded":"2023-11-27T20:44:06.521932+0000","last_fullsized":"2023-11-27T20:44:06.521932+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513320+0000","last_change":"2023-11-27T20:43:51.703349+0000","last_active":"2023-11-27T20:44:06.513320+0000","last_peered":"2023-11-27T20:44:06.513320+0000","last_clean":"2023-11-27T20:44:06.513320+0000","last_became_active":"2023-11-27T20:43:51.703049+0000","last_became_peered":"2023-11-27T20:43:51.703049+0000","last_unstale":"2023-11-27T20:44:06.513320+0000","last_undegraded":"2023-11-27T20:44:06.513320+0000","last_fullsized":"2023-11-27T20:44:06.513320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.530552+0000","last_change":"2023-11-27T20:44:07.530552+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.530552+0000","last_undegraded":"2023-11-27T20:44:07.530552+0000","last_fullsized":"2023-11-27T20:44:07.530552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.550112+0000","last_change":"2023-11-27T20:44:07.543027+0000","last_active":"2023-11-27T20:44:07.550112+0000","last_peered":"2023-11-27T20:44:07.550112+0000","last_clean":"2023-11-27T20:44:07.550112+0000","last_became_active":"2023-11-27T20:44:07.541400+0000","last_became_peered":"2023-11-27T20:44:07.541400+0000","last_unstale":"2023-11-27T20:44:07.550112+0000","last_undegraded":"2023-11-27T20:44:07.550112+0000","last_fullsized":"2023-11-27T20:44:07.550112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:56:46.092083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500391+0000","last_change":"2023-11-27T20:43:52.738313+0000","last_active":"2023-11-27T20:44:06.500391+0000","last_peered":"2023-11-27T20:44:06.500391+0000","last_clean":"2023-11-27T20:44:06.500391+0000","last_became_active":"2023-11-27T20:43:52.738011+0000","last_became_peered":"2023-11-27T20:43:52.738011+0000","last_unstale":"2023-11-27T20:44:06.500391+0000","last_undegraded":"2023-11-27T20:44:06.500391+0000","last_fullsized":"2023-11-27T20:44:06.500391+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:18:19.921000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521006+0000","last_change":"2023-11-27T20:43:51.711343+0000","last_active":"2023-11-27T20:44:06.521006+0000","last_peered":"2023-11-27T20:44:06.521006+0000","last_clean":"2023-11-27T20:44:06.521006+0000","last_became_active":"2023-11-27T20:43:51.708458+0000","last_became_peered":"2023-11-27T20:43:51.708458+0000","last_unstale":"2023-11-27T20:44:06.521006+0000","last_undegraded":"2023-11-27T20:44:06.521006+0000","last_fullsized":"2023-11-27T20:44:06.521006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:41.674074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.537058+0000","last_change":"2023-11-27T20:44:07.537058+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.537058+0000","last_undegraded":"2023-11-27T20:44:07.537058+0000","last_fullsized":"2023-11-27T20:44:07.537058+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552520+0000","last_change":"2023-11-27T20:44:07.550591+0000","last_active":"2023-11-27T20:44:07.552520+0000","last_peered":"2023-11-27T20:44:07.552520+0000","last_clean":"2023-11-27T20:44:07.552520+0000","last_became_active":"2023-11-27T20:44:07.548839+0000","last_became_peered":"2023-11-27T20:44:07.548839+0000","last_unstale":"2023-11-27T20:44:07.552520+0000","last_undegraded":"2023-11-27T20:44:07.552520+0000","last_fullsized":"2023-11-27T20:44:07.552520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:40.418150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.513151+0000","last_change":"2023-11-27T20:43:52.746396+0000","last_active":"2023-11-27T20:44:06.513151+0000","last_peered":"2023-11-27T20:44:06.513151+0000","last_clean":"2023-11-27T20:44:06.513151+0000","last_became_active":"2023-11-27T20:43:52.745787+0000","last_became_peered":"2023-11-27T20:43:52.745787+0000","last_unstale":"2023-11-27T20:44:06.513151+0000","last_undegraded":"2023-11-27T20:44:06.513151+0000","last_fullsized":"2023-11-27T20:44:06.513151+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:02.424346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.521543+0000","last_change":"2023-11-27T20:43:51.711230+0000","last_active":"2023-11-27T20:44:06.521543+0000","last_peered":"2023-11-27T20:44:06.521543+0000","last_clean":"2023-11-27T20:44:06.521543+0000","last_became_active":"2023-11-27T20:43:51.709149+0000","last_became_peered":"2023-11-27T20:43:51.709149+0000","last_unstale":"2023-11-27T20:44:06.521543+0000","last_undegraded":"2023-11-27T20:44:06.521543+0000","last_fullsized":"2023-11-27T20:44:06.521543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:18.904440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.531539+0000","last_change":"2023-11-27T20:44:07.531539+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.531539+0000","last_undegraded":"2023-11-27T20:44:07.531539+0000","last_fullsized":"2023-11-27T20:44:07.531539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.550961+0000","last_change":"2023-11-27T20:44:07.548314+0000","last_active":"2023-11-27T20:44:07.550961+0000","last_peered":"2023-11-27T20:44:07.550961+0000","last_clean":"2023-11-27T20:44:07.550961+0000","last_became_active":"2023-11-27T20:44:07.547981+0000","last_became_peered":"2023-11-27T20:44:07.547981+0000","last_unstale":"2023-11-27T20:44:07.550961+0000","last_undegraded":"2023-11-27T20:44:07.550961+0000","last_fullsized":"2023-11-27T20:44:07.550961+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:09:09.101471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511517+0000","last_change":"2023-11-27T20:43:52.740586+0000","last_active":"2023-11-27T20:44:06.511517+0000","last_peered":"2023-11-27T20:44:06.511517+0000","last_clean":"2023-11-27T20:44:06.511517+0000","last_became_active":"2023-11-27T20:43:52.739765+0000","last_became_peered":"2023-11-27T20:43:52.739765+0000","last_unstale":"2023-11-27T20:44:06.511517+0000","last_undegraded":"2023-11-27T20:44:06.511517+0000","last_fullsized":"2023-11-27T20:44:06.511517+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:52.832569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.500131+0000","last_change":"2023-11-27T20:43:51.701630+0000","last_active":"2023-11-27T20:44:06.500131+0000","last_peered":"2023-11-27T20:44:06.500131+0000","last_clean":"2023-11-27T20:44:06.500131+0000","last_became_active":"2023-11-27T20:43:51.701326+0000","last_became_peered":"2023-11-27T20:43:51.701326+0000","last_unstale":"2023-11-27T20:44:06.500131+0000","last_undegraded":"2023-11-27T20:44:06.500131+0000","last_fullsized":"2023-11-27T20:44:06.500131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:15.707938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.523119+0000","last_change":"2023-11-27T20:44:07.523119+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.523119+0000","last_undegraded":"2023-11-27T20:44:07.523119+0000","last_fullsized":"2023-11-27T20:44:07.523119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.552065+0000","last_change":"2023-11-27T20:44:07.550274+0000","last_active":"2023-11-27T20:44:07.552065+0000","last_peered":"2023-11-27T20:44:07.552065+0000","last_clean":"2023-11-27T20:44:07.552065+0000","last_became_active":"2023-11-27T20:44:07.545265+0000","last_became_peered":"2023-11-27T20:44:07.545265+0000","last_unstale":"2023-11-27T20:44:07.552065+0000","last_undegraded":"2023-11-27T20:44:07.552065+0000","last_fullsized":"2023-11-27T20:44:07.552065+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:36.239607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.517029+0000","last_change":"2023-11-27T20:43:52.751182+0000","last_active":"2023-11-27T20:44:06.517029+0000","last_peered":"2023-11-27T20:44:06.517029+0000","last_clean":"2023-11-27T20:44:06.517029+0000","last_became_active":"2023-11-27T20:43:52.750848+0000","last_became_peered":"2023-11-27T20:43:52.750848+0000","last_unstale":"2023-11-27T20:44:06.517029+0000","last_undegraded":"2023-11-27T20:44:06.517029+0000","last_fullsized":"2023-11-27T20:44:06.517029+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.506341+0000","last_change":"2023-11-27T20:43:51.712306+0000","last_active":"2023-11-27T20:44:06.506341+0000","last_peered":"2023-11-27T20:44:06.506341+0000","last_clean":"2023-11-27T20:44:06.506341+0000","last_became_active":"2023-11-27T20:43:51.712011+0000","last_became_peered":"2023-11-27T20:43:51.712011+0000","last_unstale":"2023-11-27T20:44:06.506341+0000","last_undegraded":"2023-11-27T20:44:06.506341+0000","last_fullsized":"2023-11-27T20:44:06.506341+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:16.877363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.526405+0000","last_change":"2023-11-27T20:44:07.526405+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.526405+0000","last_undegraded":"2023-11-27T20:44:07.526405+0000","last_fullsized":"2023-11-27T20:44:07.526405+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.558304+0000","last_change":"2023-11-27T20:44:07.553422+0000","last_active":"2023-11-27T20:44:07.558304+0000","last_peered":"2023-11-27T20:44:07.558304+0000","last_clean":"2023-11-27T20:44:07.558304+0000","last_became_active":"2023-11-27T20:44:07.553073+0000","last_became_peered":"2023-11-27T20:44:07.553073+0000","last_unstale":"2023-11-27T20:44:07.558304+0000","last_undegraded":"2023-11-27T20:44:07.558304+0000","last_fullsized":"2023-11-27T20:44:07.558304+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:10:26.063759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.499837+0000","last_change":"2023-11-27T20:43:52.726119+0000","last_active":"2023-11-27T20:44:06.499837+0000","last_peered":"2023-11-27T20:44:06.499837+0000","last_clean":"2023-11-27T20:44:06.499837+0000","last_became_active":"2023-11-27T20:43:52.725822+0000","last_became_peered":"2023-11-27T20:43:52.725822+0000","last_unstale":"2023-11-27T20:44:06.499837+0000","last_undegraded":"2023-11-27T20:44:06.499837+0000","last_fullsized":"2023-11-27T20:44:06.499837+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:42.798849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.499819+0000","last_change":"2023-11-27T20:43:51.701670+0000","last_active":"2023-11-27T20:44:06.499819+0000","last_peered":"2023-11-27T20:44:06.499819+0000","last_clean":"2023-11-27T20:44:06.499819+0000","last_became_active":"2023-11-27T20:43:51.701405+0000","last_became_peered":"2023-11-27T20:43:51.701405+0000","last_unstale":"2023-11-27T20:44:06.499819+0000","last_undegraded":"2023-11-27T20:44:06.499819+0000","last_fullsized":"2023-11-27T20:44:06.499819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:37.579894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.527434+0000","last_change":"2023-11-27T20:44:07.527434+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.527434+0000","last_undegraded":"2023-11-27T20:44:07.527434+0000","last_fullsized":"2023-11-27T20:44:07.527434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.543558+0000","last_change":"2023-11-27T20:44:07.541134+0000","last_active":"2023-11-27T20:44:07.543558+0000","last_peered":"2023-11-27T20:44:07.543558+0000","last_clean":"2023-11-27T20:44:07.543558+0000","last_became_active":"2023-11-27T20:44:07.540882+0000","last_became_peered":"2023-11-27T20:44:07.540882+0000","last_unstale":"2023-11-27T20:44:07.543558+0000","last_undegraded":"2023-11-27T20:44:07.543558+0000","last_fullsized":"2023-11-27T20:44:07.543558+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:32.700621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511249+0000","last_change":"2023-11-27T20:43:52.723905+0000","last_active":"2023-11-27T20:44:06.511249+0000","last_peered":"2023-11-27T20:44:06.511249+0000","last_clean":"2023-11-27T20:44:06.511249+0000","last_became_active":"2023-11-27T20:43:52.723296+0000","last_became_peered":"2023-11-27T20:43:52.723296+0000","last_unstale":"2023-11-27T20:44:06.511249+0000","last_undegraded":"2023-11-27T20:44:06.511249+0000","last_fullsized":"2023-11-27T20:44:06.511249+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:25.080298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511226+0000","last_change":"2023-11-27T20:43:51.707532+0000","last_active":"2023-11-27T20:44:06.511226+0000","last_peered":"2023-11-27T20:44:06.511226+0000","last_clean":"2023-11-27T20:44:06.511226+0000","last_became_active":"2023-11-27T20:43:51.705976+0000","last_became_peered":"2023-11-27T20:43:51.705976+0000","last_unstale":"2023-11-27T20:44:06.511226+0000","last_undegraded":"2023-11-27T20:44:06.511226+0000","last_fullsized":"2023-11-27T20:44:06.511226+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:01.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-27T20:44:07.524671+0000","last_change":"2023-11-27T20:44:07.524671+0000","last_active":"2023-11-27T20:44:07.495928+0000","last_peered":"2023-11-27T20:44:07.495928+0000","last_clean":"2023-11-27T20:44:07.495928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T20:44:07.524671+0000","last_undegraded":"2023-11-27T20:44:07.524671+0000","last_fullsized":"2023-11-27T20:44:07.524671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-27T20:44:07.547414+0000","last_change":"2023-11-27T20:44:07.543228+0000","last_active":"2023-11-27T20:44:07.547414+0000","last_peered":"2023-11-27T20:44:07.547414+0000","last_clean":"2023-11-27T20:44:07.547414+0000","last_became_active":"2023-11-27T20:44:07.540038+0000","last_became_peered":"2023-11-27T20:44:07.540038+0000","last_unstale":"2023-11-27T20:44:07.547414+0000","last_undegraded":"2023-11-27T20:44:07.547414+0000","last_fullsized":"2023-11-27T20:44:07.547414+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:32.588898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.511086+0000","last_change":"2023-11-27T20:43:52.752685+0000","last_active":"2023-11-27T20:44:06.511086+0000","last_peered":"2023-11-27T20:44:06.511086+0000","last_clean":"2023-11-27T20:44:06.511086+0000","last_became_active":"2023-11-27T20:43:52.748686+0000","last_became_peered":"2023-11-27T20:43:52.748686+0000","last_unstale":"2023-11-27T20:44:06.511086+0000","last_undegraded":"2023-11-27T20:44:06.511086+0000","last_fullsized":"2023-11-27T20:44:06.511086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:34.158412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.516360+0000","last_change":"2023-11-27T20:43:51.700471+0000","last_active":"2023-11-27T20:44:06.516360+0000","last_peered":"2023-11-27T20:44:06.516360+0000","last_clean":"2023-11-27T20:44:06.516360+0000","last_became_active":"2023-11-27T20:43:51.700088+0000","last_became_peered":"2023-11-27T20:43:51.700088+0000","last_unstale":"2023-11-27T20:44:06.516360+0000","last_undegraded":"2023-11-27T20:44:06.516360+0000","last_fullsized":"2023-11-27T20:44:06.516360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:13:35.862430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-27T20:44:06.515700+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:44:06.515700+0000","last_peered":"2023-11-27T20:44:06.515700+0000","last_clean":"2023-11-27T20:44:06.515700+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:44:06.515700+0000","last_undegraded":"2023-11-27T20:44:06.515700+0000","last_fullsized":"2023-11-27T20:44:06.515700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":881171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1579999999999999,"15min":1.163},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.181,"5min":1.2290000000000001,"15min":1.2370000000000001},"min":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.74,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.528}]},{"osd":1,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.47,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.165},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.607,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3480000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.282,"15min":1.3080000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.484,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.3},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.248,"15min":1.2589999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6379999999999999,"5min":1.909,"15min":1.909},"last":1.0489999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.361,"15min":1.397},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6779999999999999,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.113},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.47,"15min":1.496},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6879999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.244}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.724,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.5429999999999999,"15min":1.6040000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.623,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.2090000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4770000000000001,"15min":1.5049999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.948,"5min":2.044,"15min":2.044},"last":1.415},{"interface":"front","average":{"1min":1.399,"5min":1.5660000000000001,"15min":1.5940000000000001},"min":{"1min":0.69499999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8169999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.629}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.653,"15min":1.6759999999999999},"min":{"1min":0.80200000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.0179999999999998,"5min":2.508,"15min":2.508},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.6559999999999999,"15min":1.694},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.724,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.7749999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":684032,"data_stored":297773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.679,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.306,"15min":1.331},"min":{"1min":0.65200000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6399999999999999,"5min":2.581,"15min":2.581},"last":0.92800000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2549999999999999,"15min":1.2769999999999999},"min":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5349999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.151,"15min":1.167},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.506,"5min":2.823,"15min":2.823},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0760000000000001,"15min":1.081},"min":{"1min":0.79100000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4790000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.2,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.86899999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.679,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.101}]},{"osd":3,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.349,"15min":1.387},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.71,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.7849999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.1990000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.605,"15min":1.631},"min":{"1min":0.97699999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.994,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.623,"15min":1.663},"min":{"1min":0.82799999999999996,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.804,"5min":3.536,"15min":3.536},"last":1.1559999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.393,"15min":1.4079999999999999},"min":{"1min":0.81200000000000006,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9359999999999999,"5min":2.355,"15min":2.355},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.753,"5min":0.623,"15min":0.623},"max":{"1min":1.8819999999999999,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.2649999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.6519999999999999,"15min":1.6919999999999999},"min":{"1min":0.88500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":3.645,"15min":3.645},"last":1.242},{"interface":"front","average":{"1min":1.452,"5min":1.569,"15min":1.589},"min":{"1min":1.006,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.032,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.4590000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":298425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.1379999999999999,"15min":1.163},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5800000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.1579999999999999,"15min":1.1839999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6619999999999999,"5min":2.04,"15min":2.04},"last":1.367}]},{"osd":1,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.181,"15min":1.2050000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.4630000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.242}]},{"osd":2,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.27,"15min":1.294},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.73,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.268},{"interface":"front","average":{"1min":1.081,"5min":1.1950000000000001,"15min":1.214},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7470000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.556}]},{"osd":3,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.3660000000000001,"15min":1.399},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5900000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.4359999999999999,"15min":1.472},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.637,"5min":4.016,"15min":4.016},"last":1.206}]},{"osd":4,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3580000000000001,"15min":1.3919999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.79,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.873},{"interface":"front","average":{"1min":1.292,"5min":1.585,"15min":1.6339999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8140000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.1439999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.619,"15min":1.671},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.724,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.573,"15min":1.6120000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.016,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.405}]},{"osd":7,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.6379999999999999,"15min":1.6819999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.871,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.599},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.708,"15min":1.76},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8380000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.3160000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":300880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.014,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.0840000000000001,"15min":1.0820000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.034,"15min":1.008},"min":{"1min":0.80400000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.222,"15min":1.22},"min":{"1min":0.64500000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.74,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.29}]},{"osd":2,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2170000000000001,"15min":1.2110000000000001},"min":{"1min":0.69799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.343},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.292,"15min":1.294},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.53}]},{"osd":3,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.85199999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.599,"5min":1.778,"15min":1.778},"last":1.024},{"interface":"front","average":{"1min":1.464,"5min":1.3600000000000001,"15min":1.343},"min":{"1min":0.91400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.4710000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.266,"15min":1.284},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.109},{"interface":"front","average":{"1min":1.421,"5min":1.431,"15min":1.4330000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.0569999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.651,"5min":2.157,"15min":2.157},"last":1.242},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.595,"15min":1.605},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.887,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.385}]},{"osd":7,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5089999999999999,"15min":1.5009999999999999},"min":{"1min":1.179,"5min":1.016,"15min":1.016},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.696,"5min":1.6679999999999999,"15min":1.6639999999999999},"min":{"1min":1.22,"5min":1.004,"15min":1.004},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.5840000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":1.0009999999999999,"15min":1.0389999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.258,"5min":3.641,"15min":3.641},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97199999999999998,"15min":1.014},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0449999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.399,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.097,"15min":1.121},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4099999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.0880000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0960000000000001,"15min":1.117},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.444,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.135},"min":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.746,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.85299999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.3029999999999999,"15min":1.337},"min":{"1min":0.84499999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.365,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.4330000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.4179999999999999,"15min":1.4379999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.982,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.052},{"interface":"front","average":{"1min":1.272,"5min":1.452,"15min":1.482},"min":{"1min":0.874,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.714,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.3049999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.5189999999999999,"15min":1.544},"min":{"1min":0.96799999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.823,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.492,"15min":1.522},"min":{"1min":0.89000000000000001,"5min":0.878,"15min":0.878},"max":{"1min":1.8560000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.5209999999999999,"15min":1.5580000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.929,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.167},{"interface":"front","average":{"1min":1.413,"5min":1.4890000000000001,"15min":1.5009999999999999},"min":{"1min":1.002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.7410000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.2869999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1259999999999999,"5min":1.228,"15min":1.228},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.93300000000000005},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2270000000000001,"5min":1.972,"15min":1.972},"last":1.4750000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.98099999999999998,"15min":1.014},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1890000000000001,"5min":1.522,"15min":1.522},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.96499999999999997,"15min":0.98799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.431,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.022}]},{"osd":3,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.96099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0740000000000001,"15min":1.101},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4770000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1359999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.1850000000000001,"15min":1.21},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4299999999999999,"5min":1.669,"15min":1.669},"last":1.431},{"interface":"front","average":{"1min":1.169,"5min":1.3540000000000001,"15min":1.385},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.252}]},{"osd":5,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.3009999999999999,"15min":1.3260000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.601,"5min":2.48,"15min":2.48},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.4510000000000001,"15min":1.4930000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9930000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.5129999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3640000000000001,"15min":1.381},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.972,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.383},{"interface":"front","average":{"1min":1.202,"5min":1.4890000000000001,"15min":1.5369999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.831,"5min":3.302,"15min":3.302},"last":1.339}]},{"osd":7,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.46,"15min":1.496},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.1070000000000002,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.4330000000000001,"15min":1.4810000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.581,"5min":2.73,"15min":2.73},"last":1.0740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":688128,"data_stored":297863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0940000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.5449999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.97099999999999997,"15min":0.98999999999999999},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3740000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0429999999999999,"15min":1.0469999999999999},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.518,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0489999999999999,"15min":1.0329999999999999},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7370000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.083,"15min":1.087},"min":{"1min":0.66600000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6140000000000001,"5min":2.044,"15min":2.044},"last":0.70699999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1799999999999999,"15min":1.1890000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3640000000000001,"15min":1.3540000000000001},"min":{"1min":0.88500000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.1099999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.0409999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9810000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.02},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.25,"15min":1.2330000000000001},"min":{"1min":0.79100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1659999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.2490000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.3380000000000001,"15min":1.3180000000000001},"min":{"1min":1.095,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1230000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.357},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.732,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.3240000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.4690000000000001,"15min":1.476},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1949999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.5960000000000001,"15min":1.5880000000000001},"min":{"1min":1.143,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.7469999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.3049999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1294336,"data_stored":891830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.85299999999999998,"15min":0.84199999999999997},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.5649999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.85099999999999998,"15min":0.83499999999999996},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.173}]},{"osd":3,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.91300000000000003,"15min":0.89700000000000002},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.8320000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.0549999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2470000000000001,"15min":1.246},"min":{"1min":0.76900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9430000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.1970000000000001,"15min":1.1919999999999999},"min":{"1min":0.89700000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.575,"5min":2.391,"15min":2.391},"last":1.4019999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.81399999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.0750000000000002,"5min":3.028,"15min":3.028},"last":1.373},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.3129999999999999},"min":{"1min":0.77700000000000002,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.246,"5min":2.718,"15min":2.718},"last":1.341}]},{"osd":6,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3120000000000001},"min":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7909999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.105},{"interface":"front","average":{"1min":1.415,"5min":1.423,"15min":1.4239999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.1509999999999998,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.238}]},{"osd":7,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3540000000000001,"15min":1.355},"min":{"1min":0.84699999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.835,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3560000000000001,"15min":1.3600000000000001},"min":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8500000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.476}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:44:17.957 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:44:18.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.179+0000 7fdf05810640 1 Processor -- start 2023-11-27T20:44:18.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.179+0000 7fdf05810640 1 -- start start 2023-11-27T20:44:18.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.181+0000 7fdf05810640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdf000c2e60 0x7fdf00164380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.181+0000 7fdf05810640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0006d580 con 0x7fdf000c1ca0 2023-11-27T20:44:18.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.181+0000 7fdf05810640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf000726d0 con 0x7fdf00155fc0 2023-11-27T20:44:18.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.181+0000 7fdf05810640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0006dd60 con 0x7fdf000c2e60 2023-11-27T20:44:18.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.181+0000 7fdef67fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fdf000c1ca0 0x7fdf000c2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39504/0 (socket says 172.21.15.91:39504) 2023-11-27T20:44:18.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.181+0000 7fdef67fc640 1 -- 172.21.15.91:0/2296383580 learned_addr learned my addr 172.21.15.91:0/2296383580 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:18.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.181+0000 7fdeff7fe640 1 --2- 172.21.15.91:0/2296383580 >> v2:172.21.15.91:3300/0 conn(0x7fdf000c2e60 0x7fdf00164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:18.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.182+0000 7fdeff7fe640 1 -- 172.21.15.91:0/2296383580 >> v1:172.21.15.183:6789/0 conn(0x7fdf00155fc0 legacy=0x7fdf00159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:18.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.182+0000 7fdeff7fe640 1 -- 172.21.15.91:0/2296383580 >> v1:172.21.15.91:6789/0 conn(0x7fdf000c1ca0 legacy=0x7fdf000c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.182+0000 7fdefe7fc640 1 -- 172.21.15.91:0/2296383580 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135121689 0 0) 0x7fdf0006d580 con 0x7fdf000c1ca0 2023-11-27T20:44:18.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.182+0000 7fdeff7fe640 1 -- 172.21.15.91:0/2296383580 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0006da80 con 0x7fdf000c2e60 2023-11-27T20:44:18.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.183+0000 7fdeff7fe640 1 --2- 172.21.15.91:0/2296383580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf000c2e60 0x7fdf00164380 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009dc0 tx=0x7fdef802bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2888aa1c268e2cf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:18.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.183+0000 7fdefe7fc640 1 -- 172.21.15.91:0/2296383580 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef802cb20 con 0x7fdf000c2e60 2023-11-27T20:44:18.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.183+0000 7fdefe7fc640 1 -- 172.21.15.91:0/2296383580 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef802cc80 con 0x7fdf000c2e60 2023-11-27T20:44:18.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.183+0000 7fdefe7fc640 1 -- 172.21.15.91:0/2296383580 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8034440 con 0x7fdf000c2e60 2023-11-27T20:44:18.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.184+0000 7fdf05810640 1 -- 172.21.15.91:0/2296383580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf000c2e60 msgr2=0x7fdf00164380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.184+0000 7fdf05810640 1 --2- 172.21.15.91:0/2296383580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf000c2e60 0x7fdf00164380 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009dc0 tx=0x7fdef802bd70 comp rx=0 tx=0).stop 2023-11-27T20:44:18.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.184+0000 7fdf05810640 1 -- 172.21.15.91:0/2296383580 shutdown_connections 2023-11-27T20:44:18.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.184+0000 7fdf05810640 1 --2- 172.21.15.91:0/2296383580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf000c2e60 0x7fdf00164380 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.184+0000 7fdf05810640 1 -- 172.21.15.91:0/2296383580 >> 172.21.15.91:0/2296383580 conn(0x7fdf0006a500 msgr2=0x7fdf0006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:18.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.184+0000 7fdf05810640 1 -- 172.21.15.91:0/2296383580 shutdown_connections 2023-11-27T20:44:18.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.184+0000 7fdf05810640 1 -- 172.21.15.91:0/2296383580 wait complete. 2023-11-27T20:44:18.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.185+0000 7fdf05810640 1 Processor -- start 2023-11-27T20:44:18.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.186+0000 7fdf05810640 1 -- start start 2023-11-27T20:44:18.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.186+0000 7fdf05810640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf000c1ca0 0x7fdf000aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.186+0000 7fdf05810640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf000c2e60 0x7fdf0015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.186+0000 7fdf05810640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf00155fc0 0x7fdf0015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.186+0000 7fdf05810640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf00159a90 con 0x7fdf00155fc0 2023-11-27T20:44:18.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.186+0000 7fdf05810640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf001594f0 con 0x7fdf000c1ca0 2023-11-27T20:44:18.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.186+0000 7fdf05810640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf001597b0 con 0x7fdf000c2e60 2023-11-27T20:44:18.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.187+0000 7fdeff7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf00155fc0 0x7fdf0015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:18.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.187+0000 7fdeff7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf00155fc0 0x7fdf0015af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36078/0 (socket says 172.21.15.91:36078) 2023-11-27T20:44:18.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.187+0000 7fdeff7fe640 1 -- 172.21.15.91:0/1202690927 learned_addr learned my addr 172.21.15.91:0/1202690927 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:18.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.187+0000 7fdeff7fe640 1 -- 172.21.15.91:0/1202690927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf000c2e60 msgr2=0x7fdf0015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.187+0000 7fdeff7fe640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf000c2e60 0x7fdf0015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.187+0000 7fdeff7fe640 1 -- 172.21.15.91:0/1202690927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf000c1ca0 msgr2=0x7fdf000aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.187+0000 7fdeff7fe640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf000c1ca0 0x7fdf000aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.187+0000 7fdeff7fe640 1 -- 172.21.15.91:0/1202690927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8009a70 con 0x7fdf00155fc0 2023-11-27T20:44:18.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.187+0000 7fdeff7fe640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf00155fc0 0x7fdf0015af90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdef8037040 tx=0x7fdef8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:18.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.188+0000 7fdefcff9640 1 -- 172.21.15.91:0/1202690927 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef803e610 con 0x7fdf00155fc0 2023-11-27T20:44:18.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.188+0000 7fdefcff9640 1 -- 172.21.15.91:0/1202690927 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef803e770 con 0x7fdf00155fc0 2023-11-27T20:44:18.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.188+0000 7fdefcff9640 1 -- 172.21.15.91:0/1202690927 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef803eb20 con 0x7fdf00155fc0 2023-11-27T20:44:18.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.188+0000 7fdf05810640 1 -- 172.21.15.91:0/1202690927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0015a530 con 0x7fdf00155fc0 2023-11-27T20:44:18.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.188+0000 7fdf05810640 1 -- 172.21.15.91:0/1202690927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf000a4550 con 0x7fdf00155fc0 2023-11-27T20:44:18.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.189+0000 7fdf05810640 1 -- 172.21.15.91:0/1202690927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0015a390 con 0x7fdf00155fc0 2023-11-27T20:44:18.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.190+0000 7fdefcff9640 1 -- 172.21.15.91:0/1202690927 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdef803b050 con 0x7fdf00155fc0 2023-11-27T20:44:18.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.191+0000 7fdefcff9640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdee006b1c0 0x7fdee006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.191+0000 7fdefcff9640 1 -- 172.21.15.91:0/1202690927 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fdef80ac710 con 0x7fdf00155fc0 2023-11-27T20:44:18.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.191+0000 7fdefeffd640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdee006b1c0 0x7fdee006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:18.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.192+0000 7fdefeffd640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdee006b1c0 0x7fdee006d680 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdef0006fd0 tx=0x7fdef0006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:18.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.196+0000 7fdefcff9640 1 -- 172.21.15.91:0/1202690927 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdf0015a390 con 0x7fdf00155fc0 2023-11-27T20:44:18.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.391+0000 7fdf05810640 1 -- 172.21.15.91:0/1202690927 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf000723a0 con 0x7fdee006b1c0 2023-11-27T20:44:18.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.418+0000 7fdefcff9640 1 -- 172.21.15.91:0/1202690927 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525057 (secure 0 0 0) 0x7fdef0013430 con 0x7fdee006b1c0 2023-11-27T20:44:18.427 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:18.430 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:44:18.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 -- 172.21.15.91:0/1202690927 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdee006b1c0 msgr2=0x7fdee006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdee006b1c0 0x7fdee006d680 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdef0006fd0 tx=0x7fdef0006bc0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 -- 172.21.15.91:0/1202690927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf00155fc0 msgr2=0x7fdf0015af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf00155fc0 0x7fdf0015af90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdef8037040 tx=0x7fdef8004a40 comp rx=0 tx=0).stop 2023-11-27T20:44:18.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 -- 172.21.15.91:0/1202690927 shutdown_connections 2023-11-27T20:44:18.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf00155fc0 0x7fdf0015af90 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf000c2e60 0x7fdf0015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdee006b1c0 0x7fdee006d680 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 --2- 172.21.15.91:0/1202690927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf000c1ca0 0x7fdf000aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 -- 172.21.15.91:0/1202690927 >> 172.21.15.91:0/1202690927 conn(0x7fdf0006a500 msgr2=0x7fdf00070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:18.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 -- 172.21.15.91:0/1202690927 shutdown_connections 2023-11-27T20:44:18.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.426+0000 7fdf05810640 1 -- 172.21.15.91:0/1202690927 wait complete. 2023-11-27T20:44:18.446 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2023-11-27T20:44:18.253745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":381,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239624,"kb_used_data":6824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735096,"statfs":{"total":773094113280,"available":772848738304,"internally_reserved":0,"allocated":6987776,"data_stored":3693870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.717337"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.139946+0000","last_change":"2023-11-27T20:44:08.534615+0000","last_active":"2023-11-27T20:44:11.139946+0000","last_peered":"2023-11-27T20:44:11.139946+0000","last_clean":"2023-11-27T20:44:11.139946+0000","last_became_active":"2023-11-27T20:44:08.534335+0000","last_became_peered":"2023-11-27T20:44:08.534335+0000","last_unstale":"2023-11-27T20:44:11.139946+0000","last_undegraded":"2023-11-27T20:44:11.139946+0000","last_fullsized":"2023-11-27T20:44:11.139946+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:28.874637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.544011+0000","last_change":"2023-11-27T20:43:52.742706+0000","last_active":"2023-11-27T20:44:08.544011+0000","last_peered":"2023-11-27T20:44:08.544011+0000","last_clean":"2023-11-27T20:44:08.544011+0000","last_became_active":"2023-11-27T20:43:52.742447+0000","last_became_peered":"2023-11-27T20:43:52.742447+0000","last_unstale":"2023-11-27T20:44:08.544011+0000","last_undegraded":"2023-11-27T20:44:08.544011+0000","last_fullsized":"2023-11-27T20:44:08.544011+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:10.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.543928+0000","last_change":"2023-11-27T20:44:08.543760+0000","last_active":"2023-11-27T20:44:09.543928+0000","last_peered":"2023-11-27T20:44:09.543928+0000","last_clean":"2023-11-27T20:44:09.543928+0000","last_became_active":"2023-11-27T20:44:08.540063+0000","last_became_peered":"2023-11-27T20:44:08.540063+0000","last_unstale":"2023-11-27T20:44:09.543928+0000","last_undegraded":"2023-11-27T20:44:09.543928+0000","last_fullsized":"2023-11-27T20:44:09.543928+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:16:10.566652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.511851+0000","last_change":"2023-11-27T20:43:52.741446+0000","last_active":"2023-11-27T20:44:08.511851+0000","last_peered":"2023-11-27T20:44:08.511851+0000","last_clean":"2023-11-27T20:44:08.511851+0000","last_became_active":"2023-11-27T20:43:52.741105+0000","last_became_peered":"2023-11-27T20:43:52.741105+0000","last_unstale":"2023-11-27T20:44:08.511851+0000","last_undegraded":"2023-11-27T20:44:08.511851+0000","last_fullsized":"2023-11-27T20:44:08.511851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:03.285901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.143272+0000","last_change":"2023-11-27T20:44:08.557030+0000","last_active":"2023-11-27T20:44:11.143272+0000","last_peered":"2023-11-27T20:44:11.143272+0000","last_clean":"2023-11-27T20:44:11.143272+0000","last_became_active":"2023-11-27T20:44:08.556706+0000","last_became_peered":"2023-11-27T20:44:08.556706+0000","last_unstale":"2023-11-27T20:44:11.143272+0000","last_undegraded":"2023-11-27T20:44:11.143272+0000","last_fullsized":"2023-11-27T20:44:11.143272+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:37:35.629061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.522151+0000","last_change":"2023-11-27T20:43:52.737240+0000","last_active":"2023-11-27T20:44:08.522151+0000","last_peered":"2023-11-27T20:44:08.522151+0000","last_clean":"2023-11-27T20:44:08.522151+0000","last_became_active":"2023-11-27T20:43:52.736781+0000","last_became_peered":"2023-11-27T20:43:52.736781+0000","last_unstale":"2023-11-27T20:44:08.522151+0000","last_undegraded":"2023-11-27T20:44:08.522151+0000","last_fullsized":"2023-11-27T20:44:08.522151+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.897387+0000","last_change":"2023-11-27T20:44:08.543331+0000","last_active":"2023-11-27T20:44:10.897387+0000","last_peered":"2023-11-27T20:44:10.897387+0000","last_clean":"2023-11-27T20:44:10.897387+0000","last_became_active":"2023-11-27T20:44:08.543052+0000","last_became_peered":"2023-11-27T20:44:08.543052+0000","last_unstale":"2023-11-27T20:44:10.897387+0000","last_undegraded":"2023-11-27T20:44:10.897387+0000","last_fullsized":"2023-11-27T20:44:10.897387+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:49.985739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.523545+0000","last_change":"2023-11-27T20:43:52.738199+0000","last_active":"2023-11-27T20:44:08.523545+0000","last_peered":"2023-11-27T20:44:08.523545+0000","last_clean":"2023-11-27T20:44:08.523545+0000","last_became_active":"2023-11-27T20:43:52.737298+0000","last_became_peered":"2023-11-27T20:43:52.737298+0000","last_unstale":"2023-11-27T20:44:08.523545+0000","last_undegraded":"2023-11-27T20:44:08.523545+0000","last_fullsized":"2023-11-27T20:44:08.523545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:54.739325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.138577+0000","last_change":"2023-11-27T20:44:08.554352+0000","last_active":"2023-11-27T20:44:11.138577+0000","last_peered":"2023-11-27T20:44:11.138577+0000","last_clean":"2023-11-27T20:44:11.138577+0000","last_became_active":"2023-11-27T20:44:08.553931+0000","last_became_peered":"2023-11-27T20:44:08.553931+0000","last_unstale":"2023-11-27T20:44:11.138577+0000","last_undegraded":"2023-11-27T20:44:11.138577+0000","last_fullsized":"2023-11-27T20:44:11.138577+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:27:05.537885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.543522+0000","last_change":"2023-11-27T20:43:52.745287+0000","last_active":"2023-11-27T20:44:08.543522+0000","last_peered":"2023-11-27T20:44:08.543522+0000","last_clean":"2023-11-27T20:44:08.543522+0000","last_became_active":"2023-11-27T20:43:52.744817+0000","last_became_peered":"2023-11-27T20:43:52.744817+0000","last_unstale":"2023-11-27T20:44:08.543522+0000","last_undegraded":"2023-11-27T20:44:08.543522+0000","last_fullsized":"2023-11-27T20:44:08.543522+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:15:59.992569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.895307+0000","last_change":"2023-11-27T20:44:08.543519+0000","last_active":"2023-11-27T20:44:10.895307+0000","last_peered":"2023-11-27T20:44:10.895307+0000","last_clean":"2023-11-27T20:44:10.895307+0000","last_became_active":"2023-11-27T20:44:08.543202+0000","last_became_peered":"2023-11-27T20:44:08.543202+0000","last_unstale":"2023-11-27T20:44:10.895307+0000","last_undegraded":"2023-11-27T20:44:10.895307+0000","last_fullsized":"2023-11-27T20:44:10.895307+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:41.432382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.533922+0000","last_change":"2023-11-27T20:43:52.737877+0000","last_active":"2023-11-27T20:44:08.533922+0000","last_peered":"2023-11-27T20:44:08.533922+0000","last_clean":"2023-11-27T20:44:08.533922+0000","last_became_active":"2023-11-27T20:43:52.737566+0000","last_became_peered":"2023-11-27T20:43:52.737566+0000","last_unstale":"2023-11-27T20:44:08.533922+0000","last_undegraded":"2023-11-27T20:44:08.533922+0000","last_fullsized":"2023-11-27T20:44:08.533922+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.539693+0000","last_change":"2023-11-27T20:44:08.551410+0000","last_active":"2023-11-27T20:44:09.539693+0000","last_peered":"2023-11-27T20:44:09.539693+0000","last_clean":"2023-11-27T20:44:09.539693+0000","last_became_active":"2023-11-27T20:44:08.550661+0000","last_became_peered":"2023-11-27T20:44:08.550661+0000","last_unstale":"2023-11-27T20:44:09.539693+0000","last_undegraded":"2023-11-27T20:44:09.539693+0000","last_fullsized":"2023-11-27T20:44:09.539693+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:30.906047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.528957+0000","last_change":"2023-11-27T20:43:52.738797+0000","last_active":"2023-11-27T20:44:08.528957+0000","last_peered":"2023-11-27T20:44:08.528957+0000","last_clean":"2023-11-27T20:44:08.528957+0000","last_became_active":"2023-11-27T20:43:52.738444+0000","last_became_peered":"2023-11-27T20:43:52.738444+0000","last_unstale":"2023-11-27T20:44:08.528957+0000","last_undegraded":"2023-11-27T20:44:08.528957+0000","last_fullsized":"2023-11-27T20:44:08.528957+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:23.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.895883+0000","last_change":"2023-11-27T20:44:08.536318+0000","last_active":"2023-11-27T20:44:10.895883+0000","last_peered":"2023-11-27T20:44:10.895883+0000","last_clean":"2023-11-27T20:44:10.895883+0000","last_became_active":"2023-11-27T20:44:08.535983+0000","last_became_peered":"2023-11-27T20:44:08.535983+0000","last_unstale":"2023-11-27T20:44:10.895883+0000","last_undegraded":"2023-11-27T20:44:10.895883+0000","last_fullsized":"2023-11-27T20:44:10.895883+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:54.841573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.509665+0000","last_change":"2023-11-27T20:43:52.742425+0000","last_active":"2023-11-27T20:44:08.509665+0000","last_peered":"2023-11-27T20:44:08.509665+0000","last_clean":"2023-11-27T20:44:08.509665+0000","last_became_active":"2023-11-27T20:43:52.741079+0000","last_became_peered":"2023-11-27T20:43:52.741079+0000","last_unstale":"2023-11-27T20:44:08.509665+0000","last_undegraded":"2023-11-27T20:44:08.509665+0000","last_fullsized":"2023-11-27T20:44:08.509665+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:21.581873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.142410+0000","last_change":"2023-11-27T20:44:08.537828+0000","last_active":"2023-11-27T20:44:11.142410+0000","last_peered":"2023-11-27T20:44:11.142410+0000","last_clean":"2023-11-27T20:44:11.142410+0000","last_became_active":"2023-11-27T20:44:08.537481+0000","last_became_peered":"2023-11-27T20:44:08.537481+0000","last_unstale":"2023-11-27T20:44:11.142410+0000","last_undegraded":"2023-11-27T20:44:11.142410+0000","last_fullsized":"2023-11-27T20:44:11.142410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:51:48.283436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.532849+0000","last_change":"2023-11-27T20:43:52.749527+0000","last_active":"2023-11-27T20:44:08.532849+0000","last_peered":"2023-11-27T20:44:08.532849+0000","last_clean":"2023-11-27T20:44:08.532849+0000","last_became_active":"2023-11-27T20:43:52.749261+0000","last_became_peered":"2023-11-27T20:43:52.749261+0000","last_unstale":"2023-11-27T20:44:08.532849+0000","last_undegraded":"2023-11-27T20:44:08.532849+0000","last_fullsized":"2023-11-27T20:44:08.532849+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:22.440110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.543487+0000","last_change":"2023-11-27T20:44:08.559004+0000","last_active":"2023-11-27T20:44:09.543487+0000","last_peered":"2023-11-27T20:44:09.543487+0000","last_clean":"2023-11-27T20:44:09.543487+0000","last_became_active":"2023-11-27T20:44:08.557378+0000","last_became_peered":"2023-11-27T20:44:08.557378+0000","last_unstale":"2023-11-27T20:44:09.543487+0000","last_undegraded":"2023-11-27T20:44:09.543487+0000","last_fullsized":"2023-11-27T20:44:09.543487+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:44.770916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.533719+0000","last_change":"2023-11-27T20:43:52.724633+0000","last_active":"2023-11-27T20:44:08.533719+0000","last_peered":"2023-11-27T20:44:08.533719+0000","last_clean":"2023-11-27T20:44:08.533719+0000","last_became_active":"2023-11-27T20:43:52.724319+0000","last_became_peered":"2023-11-27T20:43:52.724319+0000","last_unstale":"2023-11-27T20:44:08.533719+0000","last_undegraded":"2023-11-27T20:44:08.533719+0000","last_fullsized":"2023-11-27T20:44:08.533719+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:31:56.115106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.540263+0000","last_change":"2023-11-27T20:44:08.560786+0000","last_active":"2023-11-27T20:44:09.540263+0000","last_peered":"2023-11-27T20:44:09.540263+0000","last_clean":"2023-11-27T20:44:09.540263+0000","last_became_active":"2023-11-27T20:44:08.560523+0000","last_became_peered":"2023-11-27T20:44:08.560523+0000","last_unstale":"2023-11-27T20:44:09.540263+0000","last_undegraded":"2023-11-27T20:44:09.540263+0000","last_fullsized":"2023-11-27T20:44:09.540263+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:39.229994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.529574+0000","last_change":"2023-11-27T20:43:52.740239+0000","last_active":"2023-11-27T20:44:08.529574+0000","last_peered":"2023-11-27T20:44:08.529574+0000","last_clean":"2023-11-27T20:44:08.529574+0000","last_became_active":"2023-11-27T20:43:52.739953+0000","last_became_peered":"2023-11-27T20:43:52.739953+0000","last_unstale":"2023-11-27T20:44:08.529574+0000","last_undegraded":"2023-11-27T20:44:08.529574+0000","last_fullsized":"2023-11-27T20:44:08.529574+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:21.512849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.543224+0000","last_change":"2023-11-27T20:44:08.555162+0000","last_active":"2023-11-27T20:44:09.543224+0000","last_peered":"2023-11-27T20:44:09.543224+0000","last_clean":"2023-11-27T20:44:09.543224+0000","last_became_active":"2023-11-27T20:44:08.554883+0000","last_became_peered":"2023-11-27T20:44:08.554883+0000","last_unstale":"2023-11-27T20:44:09.543224+0000","last_undegraded":"2023-11-27T20:44:09.543224+0000","last_fullsized":"2023-11-27T20:44:09.543224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:40.907625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.523820+0000","last_change":"2023-11-27T20:43:52.736636+0000","last_active":"2023-11-27T20:44:08.523820+0000","last_peered":"2023-11-27T20:44:08.523820+0000","last_clean":"2023-11-27T20:44:08.523820+0000","last_became_active":"2023-11-27T20:43:52.730532+0000","last_became_peered":"2023-11-27T20:43:52.730532+0000","last_unstale":"2023-11-27T20:44:08.523820+0000","last_undegraded":"2023-11-27T20:44:08.523820+0000","last_fullsized":"2023-11-27T20:44:08.523820+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.381360+0000","last_change":"2023-11-27T20:44:08.556245+0000","last_active":"2023-11-27T20:44:10.381360+0000","last_peered":"2023-11-27T20:44:10.381360+0000","last_clean":"2023-11-27T20:44:10.381360+0000","last_became_active":"2023-11-27T20:44:08.555917+0000","last_became_peered":"2023-11-27T20:44:08.555917+0000","last_unstale":"2023-11-27T20:44:10.381360+0000","last_undegraded":"2023-11-27T20:44:10.381360+0000","last_fullsized":"2023-11-27T20:44:10.381360+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:33:37.259404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.513175+0000","last_change":"2023-11-27T20:43:52.734813+0000","last_active":"2023-11-27T20:44:08.513175+0000","last_peered":"2023-11-27T20:44:08.513175+0000","last_clean":"2023-11-27T20:44:08.513175+0000","last_became_active":"2023-11-27T20:43:52.734472+0000","last_became_peered":"2023-11-27T20:43:52.734472+0000","last_unstale":"2023-11-27T20:44:08.513175+0000","last_undegraded":"2023-11-27T20:44:08.513175+0000","last_fullsized":"2023-11-27T20:44:08.513175+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:00.871014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.540905+0000","last_change":"2023-11-27T20:44:08.543171+0000","last_active":"2023-11-27T20:44:09.540905+0000","last_peered":"2023-11-27T20:44:09.540905+0000","last_clean":"2023-11-27T20:44:09.540905+0000","last_became_active":"2023-11-27T20:44:08.542211+0000","last_became_peered":"2023-11-27T20:44:08.542211+0000","last_unstale":"2023-11-27T20:44:09.540905+0000","last_undegraded":"2023-11-27T20:44:09.540905+0000","last_fullsized":"2023-11-27T20:44:09.540905+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:18.251672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.530657+0000","last_change":"2023-11-27T20:43:52.737259+0000","last_active":"2023-11-27T20:44:08.530657+0000","last_peered":"2023-11-27T20:44:08.530657+0000","last_clean":"2023-11-27T20:44:08.530657+0000","last_became_active":"2023-11-27T20:43:52.735819+0000","last_became_peered":"2023-11-27T20:43:52.735819+0000","last_unstale":"2023-11-27T20:44:08.530657+0000","last_undegraded":"2023-11-27T20:44:08.530657+0000","last_fullsized":"2023-11-27T20:44:08.530657+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:42.590467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.381799+0000","last_change":"2023-11-27T20:44:08.543061+0000","last_active":"2023-11-27T20:44:10.381799+0000","last_peered":"2023-11-27T20:44:10.381799+0000","last_clean":"2023-11-27T20:44:10.381799+0000","last_became_active":"2023-11-27T20:44:08.539760+0000","last_became_peered":"2023-11-27T20:44:08.539760+0000","last_unstale":"2023-11-27T20:44:10.381799+0000","last_undegraded":"2023-11-27T20:44:10.381799+0000","last_fullsized":"2023-11-27T20:44:10.381799+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:48.510706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.529048+0000","last_change":"2023-11-27T20:43:52.743966+0000","last_active":"2023-11-27T20:44:08.529048+0000","last_peered":"2023-11-27T20:44:08.529048+0000","last_clean":"2023-11-27T20:44:08.529048+0000","last_became_active":"2023-11-27T20:43:52.743629+0000","last_became_peered":"2023-11-27T20:43:52.743629+0000","last_unstale":"2023-11-27T20:44:08.529048+0000","last_undegraded":"2023-11-27T20:44:08.529048+0000","last_fullsized":"2023-11-27T20:44:08.529048+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:06.257254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.539667+0000","last_change":"2023-11-27T20:44:08.552699+0000","last_active":"2023-11-27T20:44:09.539667+0000","last_peered":"2023-11-27T20:44:09.539667+0000","last_clean":"2023-11-27T20:44:09.539667+0000","last_became_active":"2023-11-27T20:44:08.551576+0000","last_became_peered":"2023-11-27T20:44:08.551576+0000","last_unstale":"2023-11-27T20:44:09.539667+0000","last_undegraded":"2023-11-27T20:44:09.539667+0000","last_fullsized":"2023-11-27T20:44:09.539667+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:24.397766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.533210+0000","last_change":"2023-11-27T20:43:52.745826+0000","last_active":"2023-11-27T20:44:08.533210+0000","last_peered":"2023-11-27T20:44:08.533210+0000","last_clean":"2023-11-27T20:44:08.533210+0000","last_became_active":"2023-11-27T20:43:52.745542+0000","last_became_peered":"2023-11-27T20:43:52.745542+0000","last_unstale":"2023-11-27T20:44:08.533210+0000","last_undegraded":"2023-11-27T20:44:08.533210+0000","last_fullsized":"2023-11-27T20:44:08.533210+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:30.595824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.896502+0000","last_change":"2023-11-27T20:44:08.538754+0000","last_active":"2023-11-27T20:44:10.896502+0000","last_peered":"2023-11-27T20:44:10.896502+0000","last_clean":"2023-11-27T20:44:10.896502+0000","last_became_active":"2023-11-27T20:44:08.538409+0000","last_became_peered":"2023-11-27T20:44:08.538409+0000","last_unstale":"2023-11-27T20:44:10.896502+0000","last_undegraded":"2023-11-27T20:44:10.896502+0000","last_fullsized":"2023-11-27T20:44:10.896502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:18.251672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.513475+0000","last_change":"2023-11-27T20:43:52.722794+0000","last_active":"2023-11-27T20:44:08.513475+0000","last_peered":"2023-11-27T20:44:08.513475+0000","last_clean":"2023-11-27T20:44:08.513475+0000","last_became_active":"2023-11-27T20:43:52.722489+0000","last_became_peered":"2023-11-27T20:43:52.722489+0000","last_unstale":"2023-11-27T20:44:08.513475+0000","last_undegraded":"2023-11-27T20:44:08.513475+0000","last_fullsized":"2023-11-27T20:44:08.513475+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:33:24.275033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.381907+0000","last_change":"2023-11-27T20:44:08.539922+0000","last_active":"2023-11-27T20:44:10.381907+0000","last_peered":"2023-11-27T20:44:10.381907+0000","last_clean":"2023-11-27T20:44:10.381907+0000","last_became_active":"2023-11-27T20:44:08.539609+0000","last_became_peered":"2023-11-27T20:44:08.539609+0000","last_unstale":"2023-11-27T20:44:10.381907+0000","last_undegraded":"2023-11-27T20:44:10.381907+0000","last_fullsized":"2023-11-27T20:44:10.381907+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:18:40.548158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.519018+0000","last_change":"2023-11-27T20:43:52.755856+0000","last_active":"2023-11-27T20:44:08.519018+0000","last_peered":"2023-11-27T20:44:08.519018+0000","last_clean":"2023-11-27T20:44:08.519018+0000","last_became_active":"2023-11-27T20:43:52.755447+0000","last_became_peered":"2023-11-27T20:43:52.755447+0000","last_unstale":"2023-11-27T20:44:08.519018+0000","last_undegraded":"2023-11-27T20:44:08.519018+0000","last_fullsized":"2023-11-27T20:44:08.519018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.540470+0000","last_change":"2023-11-27T20:44:08.559958+0000","last_active":"2023-11-27T20:44:09.540470+0000","last_peered":"2023-11-27T20:44:09.540470+0000","last_clean":"2023-11-27T20:44:09.540470+0000","last_became_active":"2023-11-27T20:44:08.559701+0000","last_became_peered":"2023-11-27T20:44:08.559701+0000","last_unstale":"2023-11-27T20:44:09.540470+0000","last_undegraded":"2023-11-27T20:44:09.540470+0000","last_fullsized":"2023-11-27T20:44:09.540470+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:17.810165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.548799+0000","last_change":"2023-11-27T20:43:52.743704+0000","last_active":"2023-11-27T20:44:08.548799+0000","last_peered":"2023-11-27T20:44:08.548799+0000","last_clean":"2023-11-27T20:44:08.548799+0000","last_became_active":"2023-11-27T20:43:52.743440+0000","last_became_peered":"2023-11-27T20:43:52.743440+0000","last_unstale":"2023-11-27T20:44:08.548799+0000","last_undegraded":"2023-11-27T20:44:08.548799+0000","last_fullsized":"2023-11-27T20:44:08.548799+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:17:40.038308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.544323+0000","last_change":"2023-11-27T20:44:08.542953+0000","last_active":"2023-11-27T20:44:09.544323+0000","last_peered":"2023-11-27T20:44:09.544323+0000","last_clean":"2023-11-27T20:44:09.544323+0000","last_became_active":"2023-11-27T20:44:08.542621+0000","last_became_peered":"2023-11-27T20:44:08.542621+0000","last_unstale":"2023-11-27T20:44:09.544323+0000","last_undegraded":"2023-11-27T20:44:09.544323+0000","last_fullsized":"2023-11-27T20:44:09.544323+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:48.258505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.510949+0000","last_change":"2023-11-27T20:43:52.753806+0000","last_active":"2023-11-27T20:44:08.510949+0000","last_peered":"2023-11-27T20:44:08.510949+0000","last_clean":"2023-11-27T20:44:08.510949+0000","last_became_active":"2023-11-27T20:43:52.753119+0000","last_became_peered":"2023-11-27T20:43:52.753119+0000","last_unstale":"2023-11-27T20:44:08.510949+0000","last_undegraded":"2023-11-27T20:44:08.510949+0000","last_fullsized":"2023-11-27T20:44:08.510949+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:44.226522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.141335+0000","last_change":"2023-11-27T20:44:08.532175+0000","last_active":"2023-11-27T20:44:11.141335+0000","last_peered":"2023-11-27T20:44:11.141335+0000","last_clean":"2023-11-27T20:44:11.141335+0000","last_became_active":"2023-11-27T20:44:08.531913+0000","last_became_peered":"2023-11-27T20:44:08.531913+0000","last_unstale":"2023-11-27T20:44:11.141335+0000","last_undegraded":"2023-11-27T20:44:11.141335+0000","last_fullsized":"2023-11-27T20:44:11.141335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:53:48.510706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.514449+0000","last_change":"2023-11-27T20:43:52.738852+0000","last_active":"2023-11-27T20:44:08.514449+0000","last_peered":"2023-11-27T20:44:08.514449+0000","last_clean":"2023-11-27T20:44:08.514449+0000","last_became_active":"2023-11-27T20:43:52.738571+0000","last_became_peered":"2023-11-27T20:43:52.738571+0000","last_unstale":"2023-11-27T20:44:08.514449+0000","last_undegraded":"2023-11-27T20:44:08.514449+0000","last_fullsized":"2023-11-27T20:44:08.514449+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.141082+0000","last_change":"2023-11-27T20:44:08.537153+0000","last_active":"2023-11-27T20:44:11.141082+0000","last_peered":"2023-11-27T20:44:11.141082+0000","last_clean":"2023-11-27T20:44:11.141082+0000","last_became_active":"2023-11-27T20:44:08.536908+0000","last_became_peered":"2023-11-27T20:44:08.536908+0000","last_unstale":"2023-11-27T20:44:11.141082+0000","last_undegraded":"2023-11-27T20:44:11.141082+0000","last_fullsized":"2023-11-27T20:44:11.141082+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:28.766238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.510315+0000","last_change":"2023-11-27T20:43:52.734845+0000","last_active":"2023-11-27T20:44:08.510315+0000","last_peered":"2023-11-27T20:44:08.510315+0000","last_clean":"2023-11-27T20:44:08.510315+0000","last_became_active":"2023-11-27T20:43:52.734288+0000","last_became_peered":"2023-11-27T20:43:52.734288+0000","last_unstale":"2023-11-27T20:44:08.510315+0000","last_undegraded":"2023-11-27T20:44:08.510315+0000","last_fullsized":"2023-11-27T20:44:08.510315+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:08:45.447871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.542264+0000","last_change":"2023-11-27T20:44:08.546841+0000","last_active":"2023-11-27T20:44:09.542264+0000","last_peered":"2023-11-27T20:44:09.542264+0000","last_clean":"2023-11-27T20:44:09.542264+0000","last_became_active":"2023-11-27T20:44:08.546537+0000","last_became_peered":"2023-11-27T20:44:08.546537+0000","last_unstale":"2023-11-27T20:44:09.542264+0000","last_undegraded":"2023-11-27T20:44:09.542264+0000","last_fullsized":"2023-11-27T20:44:09.542264+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:49.985739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.514026+0000","last_change":"2023-11-27T20:43:52.741528+0000","last_active":"2023-11-27T20:44:08.514026+0000","last_peered":"2023-11-27T20:44:08.514026+0000","last_clean":"2023-11-27T20:44:08.514026+0000","last_became_active":"2023-11-27T20:43:52.741247+0000","last_became_peered":"2023-11-27T20:43:52.741247+0000","last_unstale":"2023-11-27T20:44:08.514026+0000","last_undegraded":"2023-11-27T20:44:08.514026+0000","last_fullsized":"2023-11-27T20:44:08.514026+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.541631+0000","last_change":"2023-11-27T20:44:08.555930+0000","last_active":"2023-11-27T20:44:09.541631+0000","last_peered":"2023-11-27T20:44:09.541631+0000","last_clean":"2023-11-27T20:44:09.541631+0000","last_became_active":"2023-11-27T20:44:08.555612+0000","last_became_peered":"2023-11-27T20:44:08.555612+0000","last_unstale":"2023-11-27T20:44:09.541631+0000","last_undegraded":"2023-11-27T20:44:09.541631+0000","last_fullsized":"2023-11-27T20:44:09.541631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:37.409199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.518236+0000","last_change":"2023-11-27T20:43:52.749184+0000","last_active":"2023-11-27T20:44:08.518236+0000","last_peered":"2023-11-27T20:44:08.518236+0000","last_clean":"2023-11-27T20:44:08.518236+0000","last_became_active":"2023-11-27T20:43:52.747304+0000","last_became_peered":"2023-11-27T20:43:52.747304+0000","last_unstale":"2023-11-27T20:44:08.518236+0000","last_undegraded":"2023-11-27T20:44:08.518236+0000","last_fullsized":"2023-11-27T20:44:08.518236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:21.580869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.140132+0000","last_change":"2023-11-27T20:44:08.531681+0000","last_active":"2023-11-27T20:44:11.140132+0000","last_peered":"2023-11-27T20:44:11.140132+0000","last_clean":"2023-11-27T20:44:11.140132+0000","last_became_active":"2023-11-27T20:44:08.531351+0000","last_became_peered":"2023-11-27T20:44:08.531351+0000","last_unstale":"2023-11-27T20:44:11.140132+0000","last_undegraded":"2023-11-27T20:44:11.140132+0000","last_fullsized":"2023-11-27T20:44:11.140132+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:59.739437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.544181+0000","last_change":"2023-11-27T20:43:52.746466+0000","last_active":"2023-11-27T20:44:08.544181+0000","last_peered":"2023-11-27T20:44:08.544181+0000","last_clean":"2023-11-27T20:44:08.544181+0000","last_became_active":"2023-11-27T20:43:52.746197+0000","last_became_peered":"2023-11-27T20:43:52.746197+0000","last_unstale":"2023-11-27T20:44:08.544181+0000","last_undegraded":"2023-11-27T20:44:08.544181+0000","last_fullsized":"2023-11-27T20:44:08.544181+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:53.742011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.542292+0000","last_change":"2023-11-27T20:44:08.552571+0000","last_active":"2023-11-27T20:44:09.542292+0000","last_peered":"2023-11-27T20:44:09.542292+0000","last_clean":"2023-11-27T20:44:09.542292+0000","last_became_active":"2023-11-27T20:44:08.552258+0000","last_became_peered":"2023-11-27T20:44:08.552258+0000","last_unstale":"2023-11-27T20:44:09.542292+0000","last_undegraded":"2023-11-27T20:44:09.542292+0000","last_fullsized":"2023-11-27T20:44:09.542292+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:51.997832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.528564+0000","last_change":"2023-11-27T20:43:52.739506+0000","last_active":"2023-11-27T20:44:08.528564+0000","last_peered":"2023-11-27T20:44:08.528564+0000","last_clean":"2023-11-27T20:44:08.528564+0000","last_became_active":"2023-11-27T20:43:52.739234+0000","last_became_peered":"2023-11-27T20:43:52.739234+0000","last_unstale":"2023-11-27T20:44:08.528564+0000","last_undegraded":"2023-11-27T20:44:08.528564+0000","last_fullsized":"2023-11-27T20:44:08.528564+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:32.431178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.542681+0000","last_change":"2023-11-27T20:44:08.547189+0000","last_active":"2023-11-27T20:44:09.542681+0000","last_peered":"2023-11-27T20:44:09.542681+0000","last_clean":"2023-11-27T20:44:09.542681+0000","last_became_active":"2023-11-27T20:44:08.546325+0000","last_became_peered":"2023-11-27T20:44:08.546325+0000","last_unstale":"2023-11-27T20:44:09.542681+0000","last_undegraded":"2023-11-27T20:44:09.542681+0000","last_fullsized":"2023-11-27T20:44:09.542681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:11.589415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534857+0000","last_change":"2023-11-27T20:43:52.758309+0000","last_active":"2023-11-27T20:44:08.534857+0000","last_peered":"2023-11-27T20:44:08.534857+0000","last_clean":"2023-11-27T20:44:08.534857+0000","last_became_active":"2023-11-27T20:43:52.755787+0000","last_became_peered":"2023-11-27T20:43:52.755787+0000","last_unstale":"2023-11-27T20:44:08.534857+0000","last_undegraded":"2023-11-27T20:44:08.534857+0000","last_fullsized":"2023-11-27T20:44:08.534857+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.139975+0000","last_change":"2023-11-27T20:44:08.539019+0000","last_active":"2023-11-27T20:44:11.139975+0000","last_peered":"2023-11-27T20:44:11.139975+0000","last_clean":"2023-11-27T20:44:11.139975+0000","last_became_active":"2023-11-27T20:44:08.538734+0000","last_became_peered":"2023-11-27T20:44:08.538734+0000","last_unstale":"2023-11-27T20:44:11.139975+0000","last_undegraded":"2023-11-27T20:44:11.139975+0000","last_fullsized":"2023-11-27T20:44:11.139975+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:19.113227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.536053+0000","last_change":"2023-11-27T20:43:52.743954+0000","last_active":"2023-11-27T20:44:08.536053+0000","last_peered":"2023-11-27T20:44:08.536053+0000","last_clean":"2023-11-27T20:44:08.536053+0000","last_became_active":"2023-11-27T20:43:52.743696+0000","last_became_peered":"2023-11-27T20:43:52.743696+0000","last_unstale":"2023-11-27T20:44:08.536053+0000","last_undegraded":"2023-11-27T20:44:08.536053+0000","last_fullsized":"2023-11-27T20:44:08.536053+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:35.875636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.138864+0000","last_change":"2023-11-27T20:44:08.556195+0000","last_active":"2023-11-27T20:44:11.138864+0000","last_peered":"2023-11-27T20:44:11.138864+0000","last_clean":"2023-11-27T20:44:11.138864+0000","last_became_active":"2023-11-27T20:44:08.555739+0000","last_became_peered":"2023-11-27T20:44:08.555739+0000","last_unstale":"2023-11-27T20:44:11.138864+0000","last_undegraded":"2023-11-27T20:44:11.138864+0000","last_fullsized":"2023-11-27T20:44:11.138864+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:49:11.856357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.511862+0000","last_change":"2023-11-27T20:43:52.740150+0000","last_active":"2023-11-27T20:44:08.511862+0000","last_peered":"2023-11-27T20:44:08.511862+0000","last_clean":"2023-11-27T20:44:08.511862+0000","last_became_active":"2023-11-27T20:43:52.735557+0000","last_became_peered":"2023-11-27T20:43:52.735557+0000","last_unstale":"2023-11-27T20:44:08.511862+0000","last_undegraded":"2023-11-27T20:44:08.511862+0000","last_fullsized":"2023-11-27T20:44:08.511862+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:26:49.710558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.896880+0000","last_change":"2023-11-27T20:44:08.534828+0000","last_active":"2023-11-27T20:44:10.896880+0000","last_peered":"2023-11-27T20:44:10.896880+0000","last_clean":"2023-11-27T20:44:10.896880+0000","last_became_active":"2023-11-27T20:44:08.531094+0000","last_became_peered":"2023-11-27T20:44:08.531094+0000","last_unstale":"2023-11-27T20:44:10.896880+0000","last_undegraded":"2023-11-27T20:44:10.896880+0000","last_fullsized":"2023-11-27T20:44:10.896880+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:09:01.275198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.514018+0000","last_change":"2023-11-27T20:43:52.743341+0000","last_active":"2023-11-27T20:44:08.514018+0000","last_peered":"2023-11-27T20:44:08.514018+0000","last_clean":"2023-11-27T20:44:08.514018+0000","last_became_active":"2023-11-27T20:43:52.742947+0000","last_became_peered":"2023-11-27T20:43:52.742947+0000","last_unstale":"2023-11-27T20:44:08.514018+0000","last_undegraded":"2023-11-27T20:44:08.514018+0000","last_fullsized":"2023-11-27T20:44:08.514018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:30.595824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.139782+0000","last_change":"2023-11-27T20:44:08.533230+0000","last_active":"2023-11-27T20:44:11.139782+0000","last_peered":"2023-11-27T20:44:11.139782+0000","last_clean":"2023-11-27T20:44:11.139782+0000","last_became_active":"2023-11-27T20:44:08.532909+0000","last_became_peered":"2023-11-27T20:44:08.532909+0000","last_unstale":"2023-11-27T20:44:11.139782+0000","last_undegraded":"2023-11-27T20:44:11.139782+0000","last_fullsized":"2023-11-27T20:44:11.139782+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:37:29.530516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.546979+0000","last_change":"2023-11-27T20:43:52.746463+0000","last_active":"2023-11-27T20:44:08.546979+0000","last_peered":"2023-11-27T20:44:08.546979+0000","last_clean":"2023-11-27T20:44:08.546979+0000","last_became_active":"2023-11-27T20:43:52.746028+0000","last_became_peered":"2023-11-27T20:43:52.746028+0000","last_unstale":"2023-11-27T20:44:08.546979+0000","last_undegraded":"2023-11-27T20:44:08.546979+0000","last_fullsized":"2023-11-27T20:44:08.546979+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:55:00.873986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.140371+0000","last_change":"2023-11-27T20:44:08.541096+0000","last_active":"2023-11-27T20:44:11.140371+0000","last_peered":"2023-11-27T20:44:11.140371+0000","last_clean":"2023-11-27T20:44:11.140371+0000","last_became_active":"2023-11-27T20:44:08.540803+0000","last_became_peered":"2023-11-27T20:44:08.540803+0000","last_unstale":"2023-11-27T20:44:11.140371+0000","last_undegraded":"2023-11-27T20:44:11.140371+0000","last_fullsized":"2023-11-27T20:44:11.140371+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:34:21.732983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534421+0000","last_change":"2023-11-27T20:43:52.757800+0000","last_active":"2023-11-27T20:44:08.534421+0000","last_peered":"2023-11-27T20:44:08.534421+0000","last_clean":"2023-11-27T20:44:08.534421+0000","last_became_active":"2023-11-27T20:43:52.755994+0000","last_became_peered":"2023-11-27T20:43:52.755994+0000","last_unstale":"2023-11-27T20:44:08.534421+0000","last_undegraded":"2023-11-27T20:44:08.534421+0000","last_fullsized":"2023-11-27T20:44:08.534421+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.896769+0000","last_change":"2023-11-27T20:44:08.538357+0000","last_active":"2023-11-27T20:44:10.896769+0000","last_peered":"2023-11-27T20:44:10.896769+0000","last_clean":"2023-11-27T20:44:10.896769+0000","last_became_active":"2023-11-27T20:44:08.538051+0000","last_became_peered":"2023-11-27T20:44:08.538051+0000","last_unstale":"2023-11-27T20:44:10.896769+0000","last_undegraded":"2023-11-27T20:44:10.896769+0000","last_fullsized":"2023-11-27T20:44:10.896769+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:37.409199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.564459+0000","last_change":"2023-11-27T20:44:07.540451+0000","last_active":"2023-11-27T20:44:08.564459+0000","last_peered":"2023-11-27T20:44:08.564459+0000","last_clean":"2023-11-27T20:44:08.564459+0000","last_became_active":"2023-11-27T20:44:07.540140+0000","last_became_peered":"2023-11-27T20:44:07.540140+0000","last_unstale":"2023-11-27T20:44:08.564459+0000","last_undegraded":"2023-11-27T20:44:08.564459+0000","last_fullsized":"2023-11-27T20:44:08.564459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:10:10.176061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534562+0000","last_change":"2023-11-27T20:43:52.755932+0000","last_active":"2023-11-27T20:44:08.534562+0000","last_peered":"2023-11-27T20:44:08.534562+0000","last_clean":"2023-11-27T20:44:08.534562+0000","last_became_active":"2023-11-27T20:43:52.751888+0000","last_became_peered":"2023-11-27T20:43:52.751888+0000","last_unstale":"2023-11-27T20:44:08.534562+0000","last_undegraded":"2023-11-27T20:44:08.534562+0000","last_fullsized":"2023-11-27T20:44:08.534562+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:19.340689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534074+0000","last_change":"2023-11-27T20:43:51.704982+0000","last_active":"2023-11-27T20:44:08.534074+0000","last_peered":"2023-11-27T20:44:08.534074+0000","last_clean":"2023-11-27T20:44:08.534074+0000","last_became_active":"2023-11-27T20:43:51.703346+0000","last_became_peered":"2023-11-27T20:43:51.703346+0000","last_unstale":"2023-11-27T20:44:08.534074+0000","last_undegraded":"2023-11-27T20:44:08.534074+0000","last_fullsized":"2023-11-27T20:44:08.534074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:53.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.142388+0000","last_change":"2023-11-27T20:44:08.537415+0000","last_active":"2023-11-27T20:44:11.142388+0000","last_peered":"2023-11-27T20:44:11.142388+0000","last_clean":"2023-11-27T20:44:11.142388+0000","last_became_active":"2023-11-27T20:44:08.537146+0000","last_became_peered":"2023-11-27T20:44:08.537146+0000","last_unstale":"2023-11-27T20:44:11.142388+0000","last_undegraded":"2023-11-27T20:44:11.142388+0000","last_fullsized":"2023-11-27T20:44:11.142388+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:57.308929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.565070+0000","last_change":"2023-11-27T20:44:07.548707+0000","last_active":"2023-11-27T20:44:08.565070+0000","last_peered":"2023-11-27T20:44:08.565070+0000","last_clean":"2023-11-27T20:44:08.565070+0000","last_became_active":"2023-11-27T20:44:07.544542+0000","last_became_peered":"2023-11-27T20:44:07.544542+0000","last_unstale":"2023-11-27T20:44:08.565070+0000","last_undegraded":"2023-11-27T20:44:08.565070+0000","last_fullsized":"2023-11-27T20:44:08.565070+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:15.279939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.538388+0000","last_change":"2023-11-27T20:43:52.736197+0000","last_active":"2023-11-27T20:44:08.538388+0000","last_peered":"2023-11-27T20:44:08.538388+0000","last_clean":"2023-11-27T20:44:08.538388+0000","last_became_active":"2023-11-27T20:43:52.735889+0000","last_became_peered":"2023-11-27T20:43:52.735889+0000","last_unstale":"2023-11-27T20:44:08.538388+0000","last_undegraded":"2023-11-27T20:44:08.538388+0000","last_fullsized":"2023-11-27T20:44:08.538388+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:46.677833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.512103+0000","last_change":"2023-11-27T20:43:51.711368+0000","last_active":"2023-11-27T20:44:08.512103+0000","last_peered":"2023-11-27T20:44:08.512103+0000","last_clean":"2023-11-27T20:44:08.512103+0000","last_became_active":"2023-11-27T20:43:51.711087+0000","last_became_peered":"2023-11-27T20:43:51.711087+0000","last_unstale":"2023-11-27T20:44:08.512103+0000","last_undegraded":"2023-11-27T20:44:08.512103+0000","last_fullsized":"2023-11-27T20:44:08.512103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:54.352803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.142240+0000","last_change":"2023-11-27T20:44:08.538935+0000","last_active":"2023-11-27T20:44:11.142240+0000","last_peered":"2023-11-27T20:44:11.142240+0000","last_clean":"2023-11-27T20:44:11.142240+0000","last_became_active":"2023-11-27T20:44:08.538588+0000","last_became_peered":"2023-11-27T20:44:08.538588+0000","last_unstale":"2023-11-27T20:44:11.142240+0000","last_undegraded":"2023-11-27T20:44:11.142240+0000","last_fullsized":"2023-11-27T20:44:11.142240+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:52:07.693441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"58'4","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.565207+0000","last_change":"2023-11-27T20:44:07.554191+0000","last_active":"2023-11-27T20:44:08.565207+0000","last_peered":"2023-11-27T20:44:08.565207+0000","last_clean":"2023-11-27T20:44:08.565207+0000","last_became_active":"2023-11-27T20:44:07.553915+0000","last_became_peered":"2023-11-27T20:44:07.553915+0000","last_unstale":"2023-11-27T20:44:08.565207+0000","last_undegraded":"2023-11-27T20:44:08.565207+0000","last_fullsized":"2023-11-27T20:44:08.565207+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:18.098995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534254+0000","last_change":"2023-11-27T20:43:52.759667+0000","last_active":"2023-11-27T20:44:08.534254+0000","last_peered":"2023-11-27T20:44:08.534254+0000","last_clean":"2023-11-27T20:44:08.534254+0000","last_became_active":"2023-11-27T20:43:52.759386+0000","last_became_peered":"2023-11-27T20:43:52.759386+0000","last_unstale":"2023-11-27T20:44:08.534254+0000","last_undegraded":"2023-11-27T20:44:08.534254+0000","last_fullsized":"2023-11-27T20:44:08.534254+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:02.438851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.535119+0000","last_change":"2023-11-27T20:43:51.699372+0000","last_active":"2023-11-27T20:44:08.535119+0000","last_peered":"2023-11-27T20:44:08.535119+0000","last_clean":"2023-11-27T20:44:08.535119+0000","last_became_active":"2023-11-27T20:43:51.698989+0000","last_became_peered":"2023-11-27T20:43:51.698989+0000","last_unstale":"2023-11-27T20:44:08.535119+0000","last_undegraded":"2023-11-27T20:44:08.535119+0000","last_fullsized":"2023-11-27T20:44:08.535119+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:29.612413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.540719+0000","last_change":"2023-11-27T20:44:08.561392+0000","last_active":"2023-11-27T20:44:09.540719+0000","last_peered":"2023-11-27T20:44:09.540719+0000","last_clean":"2023-11-27T20:44:09.540719+0000","last_became_active":"2023-11-27T20:44:08.560778+0000","last_became_peered":"2023-11-27T20:44:08.560778+0000","last_unstale":"2023-11-27T20:44:09.540719+0000","last_undegraded":"2023-11-27T20:44:09.540719+0000","last_fullsized":"2023-11-27T20:44:09.540719+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:58.417794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.558053+0000","last_change":"2023-11-27T20:44:07.543034+0000","last_active":"2023-11-27T20:44:08.558053+0000","last_peered":"2023-11-27T20:44:08.558053+0000","last_clean":"2023-11-27T20:44:08.558053+0000","last_became_active":"2023-11-27T20:44:07.542752+0000","last_became_peered":"2023-11-27T20:44:07.542752+0000","last_unstale":"2023-11-27T20:44:08.558053+0000","last_undegraded":"2023-11-27T20:44:08.558053+0000","last_fullsized":"2023-11-27T20:44:08.558053+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:05:42.158852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534950+0000","last_change":"2023-11-27T20:43:52.746554+0000","last_active":"2023-11-27T20:44:08.534950+0000","last_peered":"2023-11-27T20:44:08.534950+0000","last_clean":"2023-11-27T20:44:08.534950+0000","last_became_active":"2023-11-27T20:43:52.746133+0000","last_became_peered":"2023-11-27T20:43:52.746133+0000","last_unstale":"2023-11-27T20:44:08.534950+0000","last_undegraded":"2023-11-27T20:44:08.534950+0000","last_fullsized":"2023-11-27T20:44:08.534950+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:55.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.524091+0000","last_change":"2023-11-27T20:43:51.707254+0000","last_active":"2023-11-27T20:44:08.524091+0000","last_peered":"2023-11-27T20:44:08.524091+0000","last_clean":"2023-11-27T20:44:08.524091+0000","last_became_active":"2023-11-27T20:43:51.706908+0000","last_became_peered":"2023-11-27T20:43:51.706908+0000","last_unstale":"2023-11-27T20:44:08.524091+0000","last_undegraded":"2023-11-27T20:44:08.524091+0000","last_fullsized":"2023-11-27T20:44:08.524091+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:04.233780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.539221+0000","last_change":"2023-11-27T20:44:08.554150+0000","last_active":"2023-11-27T20:44:09.539221+0000","last_peered":"2023-11-27T20:44:09.539221+0000","last_clean":"2023-11-27T20:44:09.539221+0000","last_became_active":"2023-11-27T20:44:08.552304+0000","last_became_peered":"2023-11-27T20:44:08.552304+0000","last_unstale":"2023-11-27T20:44:09.539221+0000","last_undegraded":"2023-11-27T20:44:09.539221+0000","last_fullsized":"2023-11-27T20:44:09.539221+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:56:47.106315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.523875+0000","last_change":"2023-11-27T20:44:07.535849+0000","last_active":"2023-11-27T20:44:08.523875+0000","last_peered":"2023-11-27T20:44:08.523875+0000","last_clean":"2023-11-27T20:44:08.523875+0000","last_became_active":"2023-11-27T20:44:07.535564+0000","last_became_peered":"2023-11-27T20:44:07.535564+0000","last_unstale":"2023-11-27T20:44:08.523875+0000","last_undegraded":"2023-11-27T20:44:08.523875+0000","last_fullsized":"2023-11-27T20:44:08.523875+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:37:09.678178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.510546+0000","last_change":"2023-11-27T20:43:52.734666+0000","last_active":"2023-11-27T20:44:08.510546+0000","last_peered":"2023-11-27T20:44:08.510546+0000","last_clean":"2023-11-27T20:44:08.510546+0000","last_became_active":"2023-11-27T20:43:52.733983+0000","last_became_peered":"2023-11-27T20:43:52.733983+0000","last_unstale":"2023-11-27T20:44:08.510546+0000","last_undegraded":"2023-11-27T20:44:08.510546+0000","last_fullsized":"2023-11-27T20:44:08.510546+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:55.762089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.532049+0000","last_change":"2023-11-27T20:43:51.711467+0000","last_active":"2023-11-27T20:44:08.532049+0000","last_peered":"2023-11-27T20:44:08.532049+0000","last_clean":"2023-11-27T20:44:08.532049+0000","last_became_active":"2023-11-27T20:43:51.711141+0000","last_became_peered":"2023-11-27T20:43:51.711141+0000","last_unstale":"2023-11-27T20:44:08.532049+0000","last_undegraded":"2023-11-27T20:44:08.532049+0000","last_fullsized":"2023-11-27T20:44:08.532049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:14.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.381481+0000","last_change":"2023-11-27T20:44:08.548338+0000","last_active":"2023-11-27T20:44:10.381481+0000","last_peered":"2023-11-27T20:44:10.381481+0000","last_clean":"2023-11-27T20:44:10.381481+0000","last_became_active":"2023-11-27T20:44:08.548012+0000","last_became_peered":"2023-11-27T20:44:08.548012+0000","last_unstale":"2023-11-27T20:44:10.381481+0000","last_undegraded":"2023-11-27T20:44:10.381481+0000","last_fullsized":"2023-11-27T20:44:10.381481+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:08:28.766238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.537010+0000","last_change":"2023-11-27T20:44:07.546578+0000","last_active":"2023-11-27T20:44:08.537010+0000","last_peered":"2023-11-27T20:44:08.537010+0000","last_clean":"2023-11-27T20:44:08.537010+0000","last_became_active":"2023-11-27T20:44:07.545547+0000","last_became_peered":"2023-11-27T20:44:07.545547+0000","last_unstale":"2023-11-27T20:44:08.537010+0000","last_undegraded":"2023-11-27T20:44:08.537010+0000","last_fullsized":"2023-11-27T20:44:08.537010+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:36.393963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.511236+0000","last_change":"2023-11-27T20:43:52.740355+0000","last_active":"2023-11-27T20:44:08.511236+0000","last_peered":"2023-11-27T20:44:08.511236+0000","last_clean":"2023-11-27T20:44:08.511236+0000","last_became_active":"2023-11-27T20:43:52.739879+0000","last_became_peered":"2023-11-27T20:43:52.739879+0000","last_unstale":"2023-11-27T20:44:08.511236+0000","last_undegraded":"2023-11-27T20:44:08.511236+0000","last_fullsized":"2023-11-27T20:44:08.511236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:08:26.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534241+0000","last_change":"2023-11-27T20:43:51.701819+0000","last_active":"2023-11-27T20:44:08.534241+0000","last_peered":"2023-11-27T20:44:08.534241+0000","last_clean":"2023-11-27T20:44:08.534241+0000","last_became_active":"2023-11-27T20:43:51.701542+0000","last_became_peered":"2023-11-27T20:43:51.701542+0000","last_unstale":"2023-11-27T20:44:08.534241+0000","last_undegraded":"2023-11-27T20:44:08.534241+0000","last_fullsized":"2023-11-27T20:44:08.534241+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:53.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.140764+0000","last_change":"2023-11-27T20:44:08.535404+0000","last_active":"2023-11-27T20:44:11.140764+0000","last_peered":"2023-11-27T20:44:11.140764+0000","last_clean":"2023-11-27T20:44:11.140764+0000","last_became_active":"2023-11-27T20:44:08.532601+0000","last_became_peered":"2023-11-27T20:44:08.532601+0000","last_unstale":"2023-11-27T20:44:11.140764+0000","last_undegraded":"2023-11-27T20:44:11.140764+0000","last_fullsized":"2023-11-27T20:44:11.140764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:05:43.173084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.559241+0000","last_change":"2023-11-27T20:44:07.538342+0000","last_active":"2023-11-27T20:44:08.559241+0000","last_peered":"2023-11-27T20:44:08.559241+0000","last_clean":"2023-11-27T20:44:08.559241+0000","last_became_active":"2023-11-27T20:44:07.538037+0000","last_became_peered":"2023-11-27T20:44:07.538037+0000","last_unstale":"2023-11-27T20:44:08.559241+0000","last_undegraded":"2023-11-27T20:44:08.559241+0000","last_fullsized":"2023-11-27T20:44:08.559241+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:52:06.679209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.516497+0000","last_change":"2023-11-27T20:43:52.735677+0000","last_active":"2023-11-27T20:44:08.516497+0000","last_peered":"2023-11-27T20:44:08.516497+0000","last_clean":"2023-11-27T20:44:08.516497+0000","last_became_active":"2023-11-27T20:43:52.734624+0000","last_became_peered":"2023-11-27T20:43:52.734624+0000","last_unstale":"2023-11-27T20:44:08.516497+0000","last_undegraded":"2023-11-27T20:44:08.516497+0000","last_fullsized":"2023-11-27T20:44:08.516497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:42.798849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.530510+0000","last_change":"2023-11-27T20:43:51.706490+0000","last_active":"2023-11-27T20:44:08.530510+0000","last_peered":"2023-11-27T20:44:08.530510+0000","last_clean":"2023-11-27T20:44:08.530510+0000","last_became_active":"2023-11-27T20:43:51.706181+0000","last_became_peered":"2023-11-27T20:43:51.706181+0000","last_unstale":"2023-11-27T20:44:08.530510+0000","last_undegraded":"2023-11-27T20:44:08.530510+0000","last_fullsized":"2023-11-27T20:44:08.530510+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:59:41.580304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.541926+0000","last_change":"2023-11-27T20:44:08.542637+0000","last_active":"2023-11-27T20:44:09.541926+0000","last_peered":"2023-11-27T20:44:09.541926+0000","last_clean":"2023-11-27T20:44:09.541926+0000","last_became_active":"2023-11-27T20:44:08.542312+0000","last_became_peered":"2023-11-27T20:44:08.542312+0000","last_unstale":"2023-11-27T20:44:09.541926+0000","last_undegraded":"2023-11-27T20:44:09.541926+0000","last_fullsized":"2023-11-27T20:44:09.541926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:09:01.275198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.557651+0000","last_change":"2023-11-27T20:44:07.543638+0000","last_active":"2023-11-27T20:44:08.557651+0000","last_peered":"2023-11-27T20:44:08.557651+0000","last_clean":"2023-11-27T20:44:08.557651+0000","last_became_active":"2023-11-27T20:44:07.543049+0000","last_became_peered":"2023-11-27T20:44:07.543049+0000","last_unstale":"2023-11-27T20:44:08.557651+0000","last_undegraded":"2023-11-27T20:44:08.557651+0000","last_fullsized":"2023-11-27T20:44:08.557651+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:16:09.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.509999+0000","last_change":"2023-11-27T20:43:52.732611+0000","last_active":"2023-11-27T20:44:08.509999+0000","last_peered":"2023-11-27T20:44:08.509999+0000","last_clean":"2023-11-27T20:44:08.509999+0000","last_became_active":"2023-11-27T20:43:52.732338+0000","last_became_peered":"2023-11-27T20:43:52.732338+0000","last_unstale":"2023-11-27T20:44:08.509999+0000","last_undegraded":"2023-11-27T20:44:08.509999+0000","last_fullsized":"2023-11-27T20:44:08.509999+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:36.170506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.530927+0000","last_change":"2023-11-27T20:43:51.712506+0000","last_active":"2023-11-27T20:44:08.530927+0000","last_peered":"2023-11-27T20:44:08.530927+0000","last_clean":"2023-11-27T20:44:08.530927+0000","last_became_active":"2023-11-27T20:43:51.712167+0000","last_became_peered":"2023-11-27T20:43:51.712167+0000","last_unstale":"2023-11-27T20:44:08.530927+0000","last_undegraded":"2023-11-27T20:44:08.530927+0000","last_fullsized":"2023-11-27T20:44:08.530927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:20.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.896472+0000","last_change":"2023-11-27T20:44:08.540526+0000","last_active":"2023-11-27T20:44:10.896472+0000","last_peered":"2023-11-27T20:44:10.896472+0000","last_clean":"2023-11-27T20:44:10.896472+0000","last_became_active":"2023-11-27T20:44:08.540230+0000","last_became_peered":"2023-11-27T20:44:08.540230+0000","last_unstale":"2023-11-27T20:44:10.896472+0000","last_undegraded":"2023-11-27T20:44:10.896472+0000","last_fullsized":"2023-11-27T20:44:10.896472+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:10:11.190293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"58'3","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.559616+0000","last_change":"2023-11-27T20:44:07.541198+0000","last_active":"2023-11-27T20:44:08.559616+0000","last_peered":"2023-11-27T20:44:08.559616+0000","last_clean":"2023-11-27T20:44:08.559616+0000","last_became_active":"2023-11-27T20:44:07.540715+0000","last_became_peered":"2023-11-27T20:44:07.540715+0000","last_unstale":"2023-11-27T20:44:08.559616+0000","last_undegraded":"2023-11-27T20:44:08.559616+0000","last_fullsized":"2023-11-27T20:44:08.559616+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:07.064946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534426+0000","last_change":"2023-11-27T20:43:52.743697+0000","last_active":"2023-11-27T20:44:08.534426+0000","last_peered":"2023-11-27T20:44:08.534426+0000","last_clean":"2023-11-27T20:44:08.534426+0000","last_became_active":"2023-11-27T20:43:52.743405+0000","last_became_peered":"2023-11-27T20:43:52.743405+0000","last_unstale":"2023-11-27T20:44:08.534426+0000","last_undegraded":"2023-11-27T20:44:08.534426+0000","last_fullsized":"2023-11-27T20:44:08.534426+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:03:08.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.522423+0000","last_change":"2023-11-27T20:43:51.716942+0000","last_active":"2023-11-27T20:44:08.522423+0000","last_peered":"2023-11-27T20:44:08.522423+0000","last_clean":"2023-11-27T20:44:08.522423+0000","last_became_active":"2023-11-27T20:43:51.716549+0000","last_became_peered":"2023-11-27T20:43:51.716549+0000","last_unstale":"2023-11-27T20:44:08.522423+0000","last_undegraded":"2023-11-27T20:44:08.522423+0000","last_fullsized":"2023-11-27T20:44:08.522423+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.540081+0000","last_change":"2023-11-27T20:44:08.561425+0000","last_active":"2023-11-27T20:44:09.540081+0000","last_peered":"2023-11-27T20:44:09.540081+0000","last_clean":"2023-11-27T20:44:09.540081+0000","last_became_active":"2023-11-27T20:44:08.561117+0000","last_became_peered":"2023-11-27T20:44:08.561117+0000","last_unstale":"2023-11-27T20:44:09.540081+0000","last_undegraded":"2023-11-27T20:44:09.540081+0000","last_fullsized":"2023-11-27T20:44:09.540081+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:33.714854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"58'6","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.568096+0000","last_change":"2023-11-27T20:44:07.540741+0000","last_active":"2023-11-27T20:44:08.568096+0000","last_peered":"2023-11-27T20:44:08.568096+0000","last_clean":"2023-11-27T20:44:08.568096+0000","last_became_active":"2023-11-27T20:44:07.540459+0000","last_became_peered":"2023-11-27T20:44:07.540459+0000","last_unstale":"2023-11-27T20:44:08.568096+0000","last_undegraded":"2023-11-27T20:44:08.568096+0000","last_fullsized":"2023-11-27T20:44:08.568096+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:24.174640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.522324+0000","last_change":"2023-11-27T20:43:52.747269+0000","last_active":"2023-11-27T20:44:08.522324+0000","last_peered":"2023-11-27T20:44:08.522324+0000","last_clean":"2023-11-27T20:44:08.522324+0000","last_became_active":"2023-11-27T20:43:52.746473+0000","last_became_peered":"2023-11-27T20:43:52.746473+0000","last_unstale":"2023-11-27T20:44:08.522324+0000","last_undegraded":"2023-11-27T20:44:08.522324+0000","last_fullsized":"2023-11-27T20:44:08.522324+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:09:55.362967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.512362+0000","last_change":"2023-11-27T20:43:51.711346+0000","last_active":"2023-11-27T20:44:08.512362+0000","last_peered":"2023-11-27T20:44:08.512362+0000","last_clean":"2023-11-27T20:44:08.512362+0000","last_became_active":"2023-11-27T20:43:51.711060+0000","last_became_peered":"2023-11-27T20:43:51.711060+0000","last_unstale":"2023-11-27T20:44:08.512362+0000","last_undegraded":"2023-11-27T20:44:08.512362+0000","last_fullsized":"2023-11-27T20:44:08.512362+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:18.330525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.140159+0000","last_change":"2023-11-27T20:44:08.540700+0000","last_active":"2023-11-27T20:44:11.140159+0000","last_peered":"2023-11-27T20:44:11.140159+0000","last_clean":"2023-11-27T20:44:11.140159+0000","last_became_active":"2023-11-27T20:44:08.539876+0000","last_became_peered":"2023-11-27T20:44:08.539876+0000","last_unstale":"2023-11-27T20:44:11.140159+0000","last_undegraded":"2023-11-27T20:44:11.140159+0000","last_fullsized":"2023-11-27T20:44:11.140159+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:33:40.102360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.532874+0000","last_change":"2023-11-27T20:44:07.537248+0000","last_active":"2023-11-27T20:44:08.532874+0000","last_peered":"2023-11-27T20:44:08.532874+0000","last_clean":"2023-11-27T20:44:08.532874+0000","last_became_active":"2023-11-27T20:44:07.535963+0000","last_became_peered":"2023-11-27T20:44:07.535963+0000","last_unstale":"2023-11-27T20:44:08.532874+0000","last_undegraded":"2023-11-27T20:44:08.532874+0000","last_fullsized":"2023-11-27T20:44:08.532874+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:53.827341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.524585+0000","last_change":"2023-11-27T20:43:52.738413+0000","last_active":"2023-11-27T20:44:08.524585+0000","last_peered":"2023-11-27T20:44:08.524585+0000","last_clean":"2023-11-27T20:44:08.524585+0000","last_became_active":"2023-11-27T20:43:52.738105+0000","last_became_peered":"2023-11-27T20:43:52.738105+0000","last_unstale":"2023-11-27T20:44:08.524585+0000","last_undegraded":"2023-11-27T20:44:08.524585+0000","last_fullsized":"2023-11-27T20:44:08.524585+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:00.871014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.522573+0000","last_change":"2023-11-27T20:43:51.716907+0000","last_active":"2023-11-27T20:44:08.522573+0000","last_peered":"2023-11-27T20:44:08.522573+0000","last_clean":"2023-11-27T20:44:08.522573+0000","last_became_active":"2023-11-27T20:43:51.716616+0000","last_became_peered":"2023-11-27T20:43:51.716616+0000","last_unstale":"2023-11-27T20:44:08.522573+0000","last_undegraded":"2023-11-27T20:44:08.522573+0000","last_fullsized":"2023-11-27T20:44:08.522573+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.143430+0000","last_change":"2023-11-27T20:44:08.539402+0000","last_active":"2023-11-27T20:44:11.143430+0000","last_peered":"2023-11-27T20:44:11.143430+0000","last_clean":"2023-11-27T20:44:11.143430+0000","last_became_active":"2023-11-27T20:44:08.539134+0000","last_became_peered":"2023-11-27T20:44:08.539134+0000","last_unstale":"2023-11-27T20:44:11.143430+0000","last_undegraded":"2023-11-27T20:44:11.143430+0000","last_fullsized":"2023-11-27T20:44:11.143430+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:45.324261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.517638+0000","last_change":"2023-11-27T20:44:07.553474+0000","last_active":"2023-11-27T20:44:08.517638+0000","last_peered":"2023-11-27T20:44:08.517638+0000","last_clean":"2023-11-27T20:44:08.517638+0000","last_became_active":"2023-11-27T20:44:07.553184+0000","last_became_peered":"2023-11-27T20:44:07.553184+0000","last_unstale":"2023-11-27T20:44:08.517638+0000","last_undegraded":"2023-11-27T20:44:08.517638+0000","last_fullsized":"2023-11-27T20:44:08.517638+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:54.305443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.522278+0000","last_change":"2023-11-27T20:43:52.740853+0000","last_active":"2023-11-27T20:44:08.522278+0000","last_peered":"2023-11-27T20:44:08.522278+0000","last_clean":"2023-11-27T20:44:08.522278+0000","last_became_active":"2023-11-27T20:43:52.740468+0000","last_became_peered":"2023-11-27T20:43:52.740468+0000","last_unstale":"2023-11-27T20:44:08.522278+0000","last_undegraded":"2023-11-27T20:44:08.522278+0000","last_fullsized":"2023-11-27T20:44:08.522278+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:48:00.466844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'8","reported_seq":24,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.532641+0000","last_change":"2023-11-27T20:43:51.711651+0000","last_active":"2023-11-27T20:44:08.532641+0000","last_peered":"2023-11-27T20:44:08.532641+0000","last_clean":"2023-11-27T20:44:08.532641+0000","last_became_active":"2023-11-27T20:43:51.711270+0000","last_became_peered":"2023-11-27T20:43:51.711270+0000","last_unstale":"2023-11-27T20:44:08.532641+0000","last_undegraded":"2023-11-27T20:44:08.532641+0000","last_fullsized":"2023-11-27T20:44:08.532641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:07.560276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.381355+0000","last_change":"2023-11-27T20:44:08.538798+0000","last_active":"2023-11-27T20:44:10.381355+0000","last_peered":"2023-11-27T20:44:10.381355+0000","last_clean":"2023-11-27T20:44:10.381355+0000","last_became_active":"2023-11-27T20:44:08.538445+0000","last_became_peered":"2023-11-27T20:44:08.538445+0000","last_unstale":"2023-11-27T20:44:10.381355+0000","last_undegraded":"2023-11-27T20:44:10.381355+0000","last_fullsized":"2023-11-27T20:44:10.381355+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:29:09.556710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.530364+0000","last_change":"2023-11-27T20:44:07.550573+0000","last_active":"2023-11-27T20:44:08.530364+0000","last_peered":"2023-11-27T20:44:08.530364+0000","last_clean":"2023-11-27T20:44:08.530364+0000","last_became_active":"2023-11-27T20:44:07.549497+0000","last_became_peered":"2023-11-27T20:44:07.549497+0000","last_unstale":"2023-11-27T20:44:08.530364+0000","last_undegraded":"2023-11-27T20:44:08.530364+0000","last_fullsized":"2023-11-27T20:44:08.530364+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:08:41.346692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.524102+0000","last_change":"2023-11-27T20:43:52.731258+0000","last_active":"2023-11-27T20:44:08.524102+0000","last_peered":"2023-11-27T20:44:08.524102+0000","last_clean":"2023-11-27T20:44:08.524102+0000","last_became_active":"2023-11-27T20:43:52.730701+0000","last_became_peered":"2023-11-27T20:43:52.730701+0000","last_unstale":"2023-11-27T20:44:08.524102+0000","last_undegraded":"2023-11-27T20:44:08.524102+0000","last_fullsized":"2023-11-27T20:44:08.524102+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:28.943589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.511648+0000","last_change":"2023-11-27T20:43:51.709141+0000","last_active":"2023-11-27T20:44:08.511648+0000","last_peered":"2023-11-27T20:44:08.511648+0000","last_clean":"2023-11-27T20:44:08.511648+0000","last_became_active":"2023-11-27T20:43:51.708864+0000","last_became_peered":"2023-11-27T20:43:51.708864+0000","last_unstale":"2023-11-27T20:44:08.511648+0000","last_undegraded":"2023-11-27T20:44:08.511648+0000","last_fullsized":"2023-11-27T20:44:08.511648+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:29.585661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.539391+0000","last_change":"2023-11-27T20:44:08.551937+0000","last_active":"2023-11-27T20:44:09.539391+0000","last_peered":"2023-11-27T20:44:09.539391+0000","last_clean":"2023-11-27T20:44:09.539391+0000","last_became_active":"2023-11-27T20:44:08.550021+0000","last_became_peered":"2023-11-27T20:44:08.550021+0000","last_unstale":"2023-11-27T20:44:09.539391+0000","last_undegraded":"2023-11-27T20:44:09.539391+0000","last_fullsized":"2023-11-27T20:44:09.539391+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:15:37.253839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"58'8","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.567520+0000","last_change":"2023-11-27T20:44:07.553337+0000","last_active":"2023-11-27T20:44:08.567520+0000","last_peered":"2023-11-27T20:44:08.567520+0000","last_clean":"2023-11-27T20:44:08.567520+0000","last_became_active":"2023-11-27T20:44:07.552962+0000","last_became_peered":"2023-11-27T20:44:07.552962+0000","last_unstale":"2023-11-27T20:44:08.567520+0000","last_undegraded":"2023-11-27T20:44:08.567520+0000","last_fullsized":"2023-11-27T20:44:08.567520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:27:45.408919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.514697+0000","last_change":"2023-11-27T20:43:52.736912+0000","last_active":"2023-11-27T20:44:08.514697+0000","last_peered":"2023-11-27T20:44:08.514697+0000","last_clean":"2023-11-27T20:44:08.514697+0000","last_became_active":"2023-11-27T20:43:52.735675+0000","last_became_peered":"2023-11-27T20:43:52.735675+0000","last_unstale":"2023-11-27T20:44:08.514697+0000","last_undegraded":"2023-11-27T20:44:08.514697+0000","last_fullsized":"2023-11-27T20:44:08.514697+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.517812+0000","last_change":"2023-11-27T20:43:51.711938+0000","last_active":"2023-11-27T20:44:08.517812+0000","last_peered":"2023-11-27T20:44:08.517812+0000","last_clean":"2023-11-27T20:44:08.517812+0000","last_became_active":"2023-11-27T20:43:51.711617+0000","last_became_peered":"2023-11-27T20:43:51.711617+0000","last_unstale":"2023-11-27T20:44:08.517812+0000","last_undegraded":"2023-11-27T20:44:08.517812+0000","last_fullsized":"2023-11-27T20:44:08.517812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:19:54.146026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.141536+0000","last_change":"2023-11-27T20:44:08.543950+0000","last_active":"2023-11-27T20:44:11.141536+0000","last_peered":"2023-11-27T20:44:11.141536+0000","last_clean":"2023-11-27T20:44:11.141536+0000","last_became_active":"2023-11-27T20:44:08.543647+0000","last_became_peered":"2023-11-27T20:44:08.543647+0000","last_unstale":"2023-11-27T20:44:11.141536+0000","last_undegraded":"2023-11-27T20:44:11.141536+0000","last_fullsized":"2023-11-27T20:44:11.141536+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:18:40.548158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.556896+0000","last_change":"2023-11-27T20:44:07.550581+0000","last_active":"2023-11-27T20:44:08.556896+0000","last_peered":"2023-11-27T20:44:08.556896+0000","last_clean":"2023-11-27T20:44:08.556896+0000","last_became_active":"2023-11-27T20:44:07.549832+0000","last_became_peered":"2023-11-27T20:44:07.549832+0000","last_unstale":"2023-11-27T20:44:08.556896+0000","last_undegraded":"2023-11-27T20:44:08.556896+0000","last_fullsized":"2023-11-27T20:44:08.556896+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:20.057038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.530562+0000","last_change":"2023-11-27T20:43:52.742672+0000","last_active":"2023-11-27T20:44:08.530562+0000","last_peered":"2023-11-27T20:44:08.530562+0000","last_clean":"2023-11-27T20:44:08.530562+0000","last_became_active":"2023-11-27T20:43:52.742066+0000","last_became_peered":"2023-11-27T20:43:52.742066+0000","last_unstale":"2023-11-27T20:44:08.530562+0000","last_undegraded":"2023-11-27T20:44:08.530562+0000","last_fullsized":"2023-11-27T20:44:08.530562+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:01.982839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.530591+0000","last_change":"2023-11-27T20:43:51.711077+0000","last_active":"2023-11-27T20:44:08.530591+0000","last_peered":"2023-11-27T20:44:08.530591+0000","last_clean":"2023-11-27T20:44:08.530591+0000","last_became_active":"2023-11-27T20:43:51.710820+0000","last_became_peered":"2023-11-27T20:43:51.710820+0000","last_unstale":"2023-11-27T20:44:08.530591+0000","last_undegraded":"2023-11-27T20:44:08.530591+0000","last_fullsized":"2023-11-27T20:44:08.530591+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:21.429946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.139631+0000","last_change":"2023-11-27T20:44:08.542449+0000","last_active":"2023-11-27T20:44:11.139631+0000","last_peered":"2023-11-27T20:44:11.139631+0000","last_clean":"2023-11-27T20:44:11.139631+0000","last_became_active":"2023-11-27T20:44:08.542192+0000","last_became_peered":"2023-11-27T20:44:08.542192+0000","last_unstale":"2023-11-27T20:44:11.139631+0000","last_undegraded":"2023-11-27T20:44:11.139631+0000","last_fullsized":"2023-11-27T20:44:11.139631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:00.053848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.517556+0000","last_change":"2023-11-27T20:44:07.547343+0000","last_active":"2023-11-27T20:44:08.517556+0000","last_peered":"2023-11-27T20:44:08.517556+0000","last_clean":"2023-11-27T20:44:08.517556+0000","last_became_active":"2023-11-27T20:44:07.547004+0000","last_became_peered":"2023-11-27T20:44:07.547004+0000","last_unstale":"2023-11-27T20:44:08.517556+0000","last_undegraded":"2023-11-27T20:44:08.517556+0000","last_fullsized":"2023-11-27T20:44:08.517556+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:47.244273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.514497+0000","last_change":"2023-11-27T20:43:52.742494+0000","last_active":"2023-11-27T20:44:08.514497+0000","last_peered":"2023-11-27T20:44:08.514497+0000","last_clean":"2023-11-27T20:44:08.514497+0000","last_became_active":"2023-11-27T20:43:52.742174+0000","last_became_peered":"2023-11-27T20:43:52.742174+0000","last_unstale":"2023-11-27T20:44:08.514497+0000","last_undegraded":"2023-11-27T20:44:08.514497+0000","last_fullsized":"2023-11-27T20:44:08.514497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:45.754942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":24,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.512010+0000","last_change":"2023-11-27T20:43:51.714679+0000","last_active":"2023-11-27T20:44:08.512010+0000","last_peered":"2023-11-27T20:44:08.512010+0000","last_clean":"2023-11-27T20:44:08.512010+0000","last_became_active":"2023-11-27T20:43:51.714406+0000","last_became_peered":"2023-11-27T20:43:51.714406+0000","last_unstale":"2023-11-27T20:44:08.512010+0000","last_undegraded":"2023-11-27T20:44:08.512010+0000","last_fullsized":"2023-11-27T20:44:08.512010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:57:27.933426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.543620+0000","last_change":"2023-11-27T20:44:08.544480+0000","last_active":"2023-11-27T20:44:09.543620+0000","last_peered":"2023-11-27T20:44:09.543620+0000","last_clean":"2023-11-27T20:44:09.543620+0000","last_became_active":"2023-11-27T20:44:08.544129+0000","last_became_peered":"2023-11-27T20:44:08.544129+0000","last_unstale":"2023-11-27T20:44:09.543620+0000","last_undegraded":"2023-11-27T20:44:09.543620+0000","last_fullsized":"2023-11-27T20:44:09.543620+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:09:10.115703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.553363+0000","last_change":"2023-11-27T20:44:07.544501+0000","last_active":"2023-11-27T20:44:08.553363+0000","last_peered":"2023-11-27T20:44:08.553363+0000","last_clean":"2023-11-27T20:44:08.553363+0000","last_became_active":"2023-11-27T20:44:07.542118+0000","last_became_peered":"2023-11-27T20:44:07.542118+0000","last_unstale":"2023-11-27T20:44:08.553363+0000","last_undegraded":"2023-11-27T20:44:08.553363+0000","last_fullsized":"2023-11-27T20:44:08.553363+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:45.435671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.519164+0000","last_change":"2023-11-27T20:43:52.743633+0000","last_active":"2023-11-27T20:44:08.519164+0000","last_peered":"2023-11-27T20:44:08.519164+0000","last_clean":"2023-11-27T20:44:08.519164+0000","last_became_active":"2023-11-27T20:43:52.743243+0000","last_became_peered":"2023-11-27T20:43:52.743243+0000","last_unstale":"2023-11-27T20:44:08.519164+0000","last_undegraded":"2023-11-27T20:44:08.519164+0000","last_fullsized":"2023-11-27T20:44:08.519164+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:39.014247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.513738+0000","last_change":"2023-11-27T20:43:51.714371+0000","last_active":"2023-11-27T20:44:08.513738+0000","last_peered":"2023-11-27T20:44:08.513738+0000","last_clean":"2023-11-27T20:44:08.513738+0000","last_became_active":"2023-11-27T20:43:51.714034+0000","last_became_peered":"2023-11-27T20:43:51.714034+0000","last_unstale":"2023-11-27T20:44:08.513738+0000","last_undegraded":"2023-11-27T20:44:08.513738+0000","last_fullsized":"2023-11-27T20:44:08.513738+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.540188+0000","last_change":"2023-11-27T20:44:08.555195+0000","last_active":"2023-11-27T20:44:09.540188+0000","last_peered":"2023-11-27T20:44:09.540188+0000","last_clean":"2023-11-27T20:44:09.540188+0000","last_became_active":"2023-11-27T20:44:08.554953+0000","last_became_peered":"2023-11-27T20:44:08.554953+0000","last_unstale":"2023-11-27T20:44:09.540188+0000","last_undegraded":"2023-11-27T20:44:09.540188+0000","last_fullsized":"2023-11-27T20:44:09.540188+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:33.603130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.515434+0000","last_change":"2023-11-27T20:44:07.552420+0000","last_active":"2023-11-27T20:44:08.515434+0000","last_peered":"2023-11-27T20:44:08.515434+0000","last_clean":"2023-11-27T20:44:08.515434+0000","last_became_active":"2023-11-27T20:44:07.552130+0000","last_became_peered":"2023-11-27T20:44:07.552130+0000","last_unstale":"2023-11-27T20:44:08.515434+0000","last_undegraded":"2023-11-27T20:44:08.515434+0000","last_fullsized":"2023-11-27T20:44:08.515434+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:08:41.346692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.523424+0000","last_change":"2023-11-27T20:43:52.741261+0000","last_active":"2023-11-27T20:44:08.523424+0000","last_peered":"2023-11-27T20:44:08.523424+0000","last_clean":"2023-11-27T20:44:08.523424+0000","last_became_active":"2023-11-27T20:43:52.740962+0000","last_became_peered":"2023-11-27T20:43:52.740962+0000","last_unstale":"2023-11-27T20:44:08.523424+0000","last_undegraded":"2023-11-27T20:44:08.523424+0000","last_fullsized":"2023-11-27T20:44:08.523424+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:39.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534679+0000","last_change":"2023-11-27T20:43:51.708347+0000","last_active":"2023-11-27T20:44:08.534679+0000","last_peered":"2023-11-27T20:44:08.534679+0000","last_clean":"2023-11-27T20:44:08.534679+0000","last_became_active":"2023-11-27T20:43:51.707976+0000","last_became_peered":"2023-11-27T20:43:51.707976+0000","last_unstale":"2023-11-27T20:44:08.534679+0000","last_undegraded":"2023-11-27T20:44:08.534679+0000","last_fullsized":"2023-11-27T20:44:08.534679+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:15:53.729162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.543602+0000","last_change":"2023-11-27T20:44:08.543535+0000","last_active":"2023-11-27T20:44:09.543602+0000","last_peered":"2023-11-27T20:44:09.543602+0000","last_clean":"2023-11-27T20:44:09.543602+0000","last_became_active":"2023-11-27T20:44:08.543133+0000","last_became_peered":"2023-11-27T20:44:08.543133+0000","last_unstale":"2023-11-27T20:44:09.543602+0000","last_undegraded":"2023-11-27T20:44:09.543602+0000","last_fullsized":"2023-11-27T20:44:09.543602+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:56:08.659895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.559881+0000","last_change":"2023-11-27T20:44:07.551592+0000","last_active":"2023-11-27T20:44:08.559881+0000","last_peered":"2023-11-27T20:44:08.559881+0000","last_clean":"2023-11-27T20:44:08.559881+0000","last_became_active":"2023-11-27T20:44:07.546829+0000","last_became_peered":"2023-11-27T20:44:07.546829+0000","last_unstale":"2023-11-27T20:44:08.559881+0000","last_undegraded":"2023-11-27T20:44:08.559881+0000","last_fullsized":"2023-11-27T20:44:08.559881+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:02:37.253204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.510945+0000","last_change":"2023-11-27T20:43:52.740074+0000","last_active":"2023-11-27T20:44:08.510945+0000","last_peered":"2023-11-27T20:44:08.510945+0000","last_clean":"2023-11-27T20:44:08.510945+0000","last_became_active":"2023-11-27T20:43:52.739760+0000","last_became_peered":"2023-11-27T20:43:52.739760+0000","last_unstale":"2023-11-27T20:44:08.510945+0000","last_undegraded":"2023-11-27T20:44:08.510945+0000","last_fullsized":"2023-11-27T20:44:08.510945+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:48:56.029031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.525194+0000","last_change":"2023-11-27T20:43:51.707359+0000","last_active":"2023-11-27T20:44:08.525194+0000","last_peered":"2023-11-27T20:44:08.525194+0000","last_clean":"2023-11-27T20:44:08.525194+0000","last_became_active":"2023-11-27T20:43:51.707036+0000","last_became_peered":"2023-11-27T20:43:51.707036+0000","last_unstale":"2023-11-27T20:44:08.525194+0000","last_undegraded":"2023-11-27T20:44:08.525194+0000","last_fullsized":"2023-11-27T20:44:08.525194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:31:08.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.143766+0000","last_change":"2023-11-27T20:44:08.542567+0000","last_active":"2023-11-27T20:44:11.143766+0000","last_peered":"2023-11-27T20:44:11.143766+0000","last_clean":"2023-11-27T20:44:11.143766+0000","last_became_active":"2023-11-27T20:44:08.542305+0000","last_became_peered":"2023-11-27T20:44:08.542305+0000","last_unstale":"2023-11-27T20:44:11.143766+0000","last_undegraded":"2023-11-27T20:44:11.143766+0000","last_fullsized":"2023-11-27T20:44:11.143766+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:12:35.751246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.564830+0000","last_change":"2023-11-27T20:44:07.542732+0000","last_active":"2023-11-27T20:44:08.564830+0000","last_peered":"2023-11-27T20:44:08.564830+0000","last_clean":"2023-11-27T20:44:08.564830+0000","last_became_active":"2023-11-27T20:44:07.542131+0000","last_became_peered":"2023-11-27T20:44:07.542131+0000","last_unstale":"2023-11-27T20:44:08.564830+0000","last_undegraded":"2023-11-27T20:44:08.564830+0000","last_fullsized":"2023-11-27T20:44:08.564830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:34.153783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.522382+0000","last_change":"2023-11-27T20:43:52.749840+0000","last_active":"2023-11-27T20:44:08.522382+0000","last_peered":"2023-11-27T20:44:08.522382+0000","last_clean":"2023-11-27T20:44:08.522382+0000","last_became_active":"2023-11-27T20:43:52.749390+0000","last_became_peered":"2023-11-27T20:43:52.749390+0000","last_unstale":"2023-11-27T20:44:08.522382+0000","last_undegraded":"2023-11-27T20:44:08.522382+0000","last_fullsized":"2023-11-27T20:44:08.522382+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534296+0000","last_change":"2023-11-27T20:43:51.704467+0000","last_active":"2023-11-27T20:44:08.534296+0000","last_peered":"2023-11-27T20:44:08.534296+0000","last_clean":"2023-11-27T20:44:08.534296+0000","last_became_active":"2023-11-27T20:43:51.704172+0000","last_became_peered":"2023-11-27T20:43:51.704172+0000","last_unstale":"2023-11-27T20:44:08.534296+0000","last_undegraded":"2023-11-27T20:44:08.534296+0000","last_fullsized":"2023-11-27T20:44:08.534296+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:44.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.138641+0000","last_change":"2023-11-27T20:44:08.536544+0000","last_active":"2023-11-27T20:44:11.138641+0000","last_peered":"2023-11-27T20:44:11.138641+0000","last_clean":"2023-11-27T20:44:11.138641+0000","last_became_active":"2023-11-27T20:44:08.536164+0000","last_became_peered":"2023-11-27T20:44:08.536164+0000","last_unstale":"2023-11-27T20:44:11.138641+0000","last_undegraded":"2023-11-27T20:44:11.138641+0000","last_fullsized":"2023-11-27T20:44:11.138641+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:12:45.324261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.530170+0000","last_change":"2023-11-27T20:44:07.551204+0000","last_active":"2023-11-27T20:44:08.530170+0000","last_peered":"2023-11-27T20:44:08.530170+0000","last_clean":"2023-11-27T20:44:08.530170+0000","last_became_active":"2023-11-27T20:44:07.550936+0000","last_became_peered":"2023-11-27T20:44:07.550936+0000","last_unstale":"2023-11-27T20:44:08.530170+0000","last_undegraded":"2023-11-27T20:44:08.530170+0000","last_fullsized":"2023-11-27T20:44:08.530170+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:56:07.645663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.524325+0000","last_change":"2023-11-27T20:43:52.730278+0000","last_active":"2023-11-27T20:44:08.524325+0000","last_peered":"2023-11-27T20:44:08.524325+0000","last_clean":"2023-11-27T20:44:08.524325+0000","last_became_active":"2023-11-27T20:43:52.729894+0000","last_became_peered":"2023-11-27T20:43:52.729894+0000","last_unstale":"2023-11-27T20:44:08.524325+0000","last_undegraded":"2023-11-27T20:44:08.524325+0000","last_fullsized":"2023-11-27T20:44:08.524325+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:08:54.288377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.513390+0000","last_change":"2023-11-27T20:43:51.709579+0000","last_active":"2023-11-27T20:44:08.513390+0000","last_peered":"2023-11-27T20:44:08.513390+0000","last_clean":"2023-11-27T20:44:08.513390+0000","last_became_active":"2023-11-27T20:43:51.709194+0000","last_became_peered":"2023-11-27T20:43:51.709194+0000","last_unstale":"2023-11-27T20:44:08.513390+0000","last_undegraded":"2023-11-27T20:44:08.513390+0000","last_fullsized":"2023-11-27T20:44:08.513390+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:01.414182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.138792+0000","last_change":"2023-11-27T20:44:08.532025+0000","last_active":"2023-11-27T20:44:11.138792+0000","last_peered":"2023-11-27T20:44:11.138792+0000","last_clean":"2023-11-27T20:44:11.138792+0000","last_became_active":"2023-11-27T20:44:08.531709+0000","last_became_peered":"2023-11-27T20:44:08.531709+0000","last_unstale":"2023-11-27T20:44:11.138792+0000","last_undegraded":"2023-11-27T20:44:11.138792+0000","last_fullsized":"2023-11-27T20:44:11.138792+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:42:46.384826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.533370+0000","last_change":"2023-11-27T20:44:07.547935+0000","last_active":"2023-11-27T20:44:08.533370+0000","last_peered":"2023-11-27T20:44:08.533370+0000","last_clean":"2023-11-27T20:44:08.533370+0000","last_became_active":"2023-11-27T20:44:07.547663+0000","last_became_peered":"2023-11-27T20:44:07.547663+0000","last_unstale":"2023-11-27T20:44:08.533370+0000","last_undegraded":"2023-11-27T20:44:08.533370+0000","last_fullsized":"2023-11-27T20:44:08.533370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:09:36.314604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534138+0000","last_change":"2023-11-27T20:43:52.750078+0000","last_active":"2023-11-27T20:44:08.534138+0000","last_peered":"2023-11-27T20:44:08.534138+0000","last_clean":"2023-11-27T20:44:08.534138+0000","last_became_active":"2023-11-27T20:43:52.749770+0000","last_became_peered":"2023-11-27T20:43:52.749770+0000","last_unstale":"2023-11-27T20:44:08.534138+0000","last_undegraded":"2023-11-27T20:44:08.534138+0000","last_fullsized":"2023-11-27T20:44:08.534138+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:38:25.605056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.523030+0000","last_change":"2023-11-27T20:43:51.708599+0000","last_active":"2023-11-27T20:44:08.523030+0000","last_peered":"2023-11-27T20:44:08.523030+0000","last_clean":"2023-11-27T20:44:08.523030+0000","last_became_active":"2023-11-27T20:43:51.708311+0000","last_became_peered":"2023-11-27T20:43:51.708311+0000","last_unstale":"2023-11-27T20:44:08.523030+0000","last_undegraded":"2023-11-27T20:44:08.523030+0000","last_fullsized":"2023-11-27T20:44:08.523030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:55:39.603520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.139204+0000","last_change":"2023-11-27T20:44:08.536933+0000","last_active":"2023-11-27T20:44:11.139204+0000","last_peered":"2023-11-27T20:44:11.139204+0000","last_clean":"2023-11-27T20:44:11.139204+0000","last_became_active":"2023-11-27T20:44:08.536635+0000","last_became_peered":"2023-11-27T20:44:08.536635+0000","last_unstale":"2023-11-27T20:44:11.139204+0000","last_undegraded":"2023-11-27T20:44:11.139204+0000","last_fullsized":"2023-11-27T20:44:11.139204+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:35:15.237532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.517645+0000","last_change":"2023-11-27T20:44:07.543371+0000","last_active":"2023-11-27T20:44:08.517645+0000","last_peered":"2023-11-27T20:44:08.517645+0000","last_clean":"2023-11-27T20:44:08.517645+0000","last_became_active":"2023-11-27T20:44:07.542654+0000","last_became_peered":"2023-11-27T20:44:07.542654+0000","last_unstale":"2023-11-27T20:44:08.517645+0000","last_undegraded":"2023-11-27T20:44:08.517645+0000","last_fullsized":"2023-11-27T20:44:08.517645+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:17.156520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.533663+0000","last_change":"2023-11-27T20:43:52.745035+0000","last_active":"2023-11-27T20:44:08.533663+0000","last_peered":"2023-11-27T20:44:08.533663+0000","last_clean":"2023-11-27T20:44:08.533663+0000","last_became_active":"2023-11-27T20:43:52.744540+0000","last_became_peered":"2023-11-27T20:43:52.744540+0000","last_unstale":"2023-11-27T20:44:08.533663+0000","last_undegraded":"2023-11-27T20:44:08.533663+0000","last_fullsized":"2023-11-27T20:44:08.533663+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:54.957375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.524075+0000","last_change":"2023-11-27T20:43:51.703755+0000","last_active":"2023-11-27T20:44:08.524075+0000","last_peered":"2023-11-27T20:44:08.524075+0000","last_clean":"2023-11-27T20:44:08.524075+0000","last_became_active":"2023-11-27T20:43:51.700051+0000","last_became_peered":"2023-11-27T20:43:51.700051+0000","last_unstale":"2023-11-27T20:44:08.524075+0000","last_undegraded":"2023-11-27T20:44:08.524075+0000","last_fullsized":"2023-11-27T20:44:08.524075+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:25:00.972675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.142487+0000","last_change":"2023-11-27T20:44:08.539225+0000","last_active":"2023-11-27T20:44:11.142487+0000","last_peered":"2023-11-27T20:44:11.142487+0000","last_clean":"2023-11-27T20:44:11.142487+0000","last_became_active":"2023-11-27T20:44:08.538670+0000","last_became_peered":"2023-11-27T20:44:08.538670+0000","last_unstale":"2023-11-27T20:44:11.142487+0000","last_undegraded":"2023-11-27T20:44:11.142487+0000","last_fullsized":"2023-11-27T20:44:11.142487+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:46:41.629895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.549169+0000","last_change":"2023-11-27T20:44:07.546057+0000","last_active":"2023-11-27T20:44:08.549169+0000","last_peered":"2023-11-27T20:44:08.549169+0000","last_clean":"2023-11-27T20:44:08.549169+0000","last_became_active":"2023-11-27T20:44:07.543702+0000","last_became_peered":"2023-11-27T20:44:07.543702+0000","last_unstale":"2023-11-27T20:44:08.549169+0000","last_undegraded":"2023-11-27T20:44:08.549169+0000","last_fullsized":"2023-11-27T20:44:08.549169+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:05:08.453722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.528767+0000","last_change":"2023-11-27T20:43:52.735455+0000","last_active":"2023-11-27T20:44:08.528767+0000","last_peered":"2023-11-27T20:44:08.528767+0000","last_clean":"2023-11-27T20:44:08.528767+0000","last_became_active":"2023-11-27T20:43:52.735128+0000","last_became_peered":"2023-11-27T20:43:52.735128+0000","last_unstale":"2023-11-27T20:44:08.528767+0000","last_undegraded":"2023-11-27T20:44:08.528767+0000","last_fullsized":"2023-11-27T20:44:08.528767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:08:30.622576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.538486+0000","last_change":"2023-11-27T20:43:51.711208+0000","last_active":"2023-11-27T20:44:08.538486+0000","last_peered":"2023-11-27T20:44:08.538486+0000","last_clean":"2023-11-27T20:44:08.538486+0000","last_became_active":"2023-11-27T20:43:51.710936+0000","last_became_peered":"2023-11-27T20:43:51.710936+0000","last_unstale":"2023-11-27T20:44:08.538486+0000","last_undegraded":"2023-11-27T20:44:08.538486+0000","last_fullsized":"2023-11-27T20:44:08.538486+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:20.570705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.142982+0000","last_change":"2023-11-27T20:44:08.535434+0000","last_active":"2023-11-27T20:44:11.142982+0000","last_peered":"2023-11-27T20:44:11.142982+0000","last_clean":"2023-11-27T20:44:11.142982+0000","last_became_active":"2023-11-27T20:44:08.535104+0000","last_became_peered":"2023-11-27T20:44:08.535104+0000","last_unstale":"2023-11-27T20:44:11.142982+0000","last_undegraded":"2023-11-27T20:44:11.142982+0000","last_fullsized":"2023-11-27T20:44:11.142982+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:23:08.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534152+0000","last_change":"2023-11-27T20:44:07.545626+0000","last_active":"2023-11-27T20:44:08.534152+0000","last_peered":"2023-11-27T20:44:08.534152+0000","last_clean":"2023-11-27T20:44:08.534152+0000","last_became_active":"2023-11-27T20:44:07.545085+0000","last_became_peered":"2023-11-27T20:44:07.545085+0000","last_unstale":"2023-11-27T20:44:08.534152+0000","last_undegraded":"2023-11-27T20:44:08.534152+0000","last_fullsized":"2023-11-27T20:44:08.534152+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:34:20.718751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.525477+0000","last_change":"2023-11-27T20:43:52.739121+0000","last_active":"2023-11-27T20:44:08.525477+0000","last_peered":"2023-11-27T20:44:08.525477+0000","last_clean":"2023-11-27T20:44:08.525477+0000","last_became_active":"2023-11-27T20:43:52.738758+0000","last_became_peered":"2023-11-27T20:43:52.738758+0000","last_unstale":"2023-11-27T20:44:08.525477+0000","last_undegraded":"2023-11-27T20:44:08.525477+0000","last_fullsized":"2023-11-27T20:44:08.525477+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:02.343426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"55'1","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.534792+0000","last_change":"2023-11-27T20:43:51.703349+0000","last_active":"2023-11-27T20:44:08.534792+0000","last_peered":"2023-11-27T20:44:08.534792+0000","last_clean":"2023-11-27T20:44:08.534792+0000","last_became_active":"2023-11-27T20:43:51.703049+0000","last_became_peered":"2023-11-27T20:43:51.703049+0000","last_unstale":"2023-11-27T20:44:08.534792+0000","last_undegraded":"2023-11-27T20:44:08.534792+0000","last_fullsized":"2023-11-27T20:44:08.534792+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:33:31.421015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.382596+0000","last_change":"2023-11-27T20:44:08.556306+0000","last_active":"2023-11-27T20:44:10.382596+0000","last_peered":"2023-11-27T20:44:10.382596+0000","last_clean":"2023-11-27T20:44:10.382596+0000","last_became_active":"2023-11-27T20:44:08.555761+0000","last_became_peered":"2023-11-27T20:44:08.555761+0000","last_unstale":"2023-11-27T20:44:10.382596+0000","last_undegraded":"2023-11-27T20:44:10.382596+0000","last_fullsized":"2023-11-27T20:44:10.382596+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:52:07.693441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.559677+0000","last_change":"2023-11-27T20:44:07.543027+0000","last_active":"2023-11-27T20:44:08.559677+0000","last_peered":"2023-11-27T20:44:08.559677+0000","last_clean":"2023-11-27T20:44:08.559677+0000","last_became_active":"2023-11-27T20:44:07.541400+0000","last_became_peered":"2023-11-27T20:44:07.541400+0000","last_unstale":"2023-11-27T20:44:08.559677+0000","last_undegraded":"2023-11-27T20:44:08.559677+0000","last_fullsized":"2023-11-27T20:44:08.559677+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:37:09.678178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.524378+0000","last_change":"2023-11-27T20:43:52.738313+0000","last_active":"2023-11-27T20:44:08.524378+0000","last_peered":"2023-11-27T20:44:08.524378+0000","last_clean":"2023-11-27T20:44:08.524378+0000","last_became_active":"2023-11-27T20:43:52.738011+0000","last_became_peered":"2023-11-27T20:43:52.738011+0000","last_unstale":"2023-11-27T20:44:08.524378+0000","last_undegraded":"2023-11-27T20:44:08.524378+0000","last_fullsized":"2023-11-27T20:44:08.524378+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:18:19.921000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.518885+0000","last_change":"2023-11-27T20:43:51.711343+0000","last_active":"2023-11-27T20:44:08.518885+0000","last_peered":"2023-11-27T20:44:08.518885+0000","last_clean":"2023-11-27T20:44:08.518885+0000","last_became_active":"2023-11-27T20:43:51.708458+0000","last_became_peered":"2023-11-27T20:43:51.708458+0000","last_unstale":"2023-11-27T20:44:08.518885+0000","last_undegraded":"2023-11-27T20:44:08.518885+0000","last_fullsized":"2023-11-27T20:44:08.518885+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:39:41.674074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.140222+0000","last_change":"2023-11-27T20:44:08.541475+0000","last_active":"2023-11-27T20:44:11.140222+0000","last_peered":"2023-11-27T20:44:11.140222+0000","last_clean":"2023-11-27T20:44:11.140222+0000","last_became_active":"2023-11-27T20:44:08.541276+0000","last_became_peered":"2023-11-27T20:44:08.541276+0000","last_unstale":"2023-11-27T20:44:11.140222+0000","last_undegraded":"2023-11-27T20:44:11.140222+0000","last_fullsized":"2023-11-27T20:44:11.140222+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:09:37.328836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.140285+0000","last_change":"2023-11-27T20:44:07.550591+0000","last_active":"2023-11-27T20:44:11.140285+0000","last_peered":"2023-11-27T20:44:11.140285+0000","last_clean":"2023-11-27T20:44:11.140285+0000","last_became_active":"2023-11-27T20:44:07.548839+0000","last_became_peered":"2023-11-27T20:44:07.548839+0000","last_unstale":"2023-11-27T20:44:11.140285+0000","last_undegraded":"2023-11-27T20:44:11.140285+0000","last_fullsized":"2023-11-27T20:44:11.140285+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:39.893393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.535025+0000","last_change":"2023-11-27T20:43:52.746396+0000","last_active":"2023-11-27T20:44:08.535025+0000","last_peered":"2023-11-27T20:44:08.535025+0000","last_clean":"2023-11-27T20:44:08.535025+0000","last_became_active":"2023-11-27T20:43:52.745787+0000","last_became_peered":"2023-11-27T20:43:52.745787+0000","last_unstale":"2023-11-27T20:44:08.535025+0000","last_undegraded":"2023-11-27T20:44:08.535025+0000","last_fullsized":"2023-11-27T20:44:08.535025+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:02.424346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.524328+0000","last_change":"2023-11-27T20:43:51.711230+0000","last_active":"2023-11-27T20:44:08.524328+0000","last_peered":"2023-11-27T20:44:08.524328+0000","last_clean":"2023-11-27T20:44:08.524328+0000","last_became_active":"2023-11-27T20:43:51.709149+0000","last_became_peered":"2023-11-27T20:43:51.709149+0000","last_unstale":"2023-11-27T20:44:08.524328+0000","last_undegraded":"2023-11-27T20:44:08.524328+0000","last_fullsized":"2023-11-27T20:44:08.524328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:18.904440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.543267+0000","last_change":"2023-11-27T20:44:08.543352+0000","last_active":"2023-11-27T20:44:09.543267+0000","last_peered":"2023-11-27T20:44:09.543267+0000","last_clean":"2023-11-27T20:44:09.543267+0000","last_became_active":"2023-11-27T20:44:08.537449+0000","last_became_peered":"2023-11-27T20:44:08.537449+0000","last_unstale":"2023-11-27T20:44:09.543267+0000","last_undegraded":"2023-11-27T20:44:09.543267+0000","last_fullsized":"2023-11-27T20:44:09.543267+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:28:35.741930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.528859+0000","last_change":"2023-11-27T20:44:07.548314+0000","last_active":"2023-11-27T20:44:08.528859+0000","last_peered":"2023-11-27T20:44:08.528859+0000","last_clean":"2023-11-27T20:44:08.528859+0000","last_became_active":"2023-11-27T20:44:07.547981+0000","last_became_peered":"2023-11-27T20:44:07.547981+0000","last_unstale":"2023-11-27T20:44:08.528859+0000","last_undegraded":"2023-11-27T20:44:08.528859+0000","last_fullsized":"2023-11-27T20:44:08.528859+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:54.305443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.510595+0000","last_change":"2023-11-27T20:43:52.740586+0000","last_active":"2023-11-27T20:44:08.510595+0000","last_peered":"2023-11-27T20:44:08.510595+0000","last_clean":"2023-11-27T20:44:08.510595+0000","last_became_active":"2023-11-27T20:43:52.739765+0000","last_became_peered":"2023-11-27T20:43:52.739765+0000","last_unstale":"2023-11-27T20:44:08.510595+0000","last_undegraded":"2023-11-27T20:44:08.510595+0000","last_fullsized":"2023-11-27T20:44:08.510595+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:55:52.832569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.524952+0000","last_change":"2023-11-27T20:43:51.701630+0000","last_active":"2023-11-27T20:44:08.524952+0000","last_peered":"2023-11-27T20:44:08.524952+0000","last_clean":"2023-11-27T20:44:08.524952+0000","last_became_active":"2023-11-27T20:43:51.701326+0000","last_became_peered":"2023-11-27T20:43:51.701326+0000","last_unstale":"2023-11-27T20:44:08.524952+0000","last_undegraded":"2023-11-27T20:44:08.524952+0000","last_fullsized":"2023-11-27T20:44:08.524952+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:35:15.707938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.895452+0000","last_change":"2023-11-27T20:44:08.529801+0000","last_active":"2023-11-27T20:44:10.895452+0000","last_peered":"2023-11-27T20:44:10.895452+0000","last_clean":"2023-11-27T20:44:10.895452+0000","last_became_active":"2023-11-27T20:44:08.529524+0000","last_became_peered":"2023-11-27T20:44:08.529524+0000","last_unstale":"2023-11-27T20:44:10.895452+0000","last_undegraded":"2023-11-27T20:44:10.895452+0000","last_fullsized":"2023-11-27T20:44:10.895452+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:09:18.266177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.513768+0000","last_change":"2023-11-27T20:44:07.550274+0000","last_active":"2023-11-27T20:44:08.513768+0000","last_peered":"2023-11-27T20:44:08.513768+0000","last_clean":"2023-11-27T20:44:08.513768+0000","last_became_active":"2023-11-27T20:44:07.545265+0000","last_became_peered":"2023-11-27T20:44:07.545265+0000","last_unstale":"2023-11-27T20:44:08.513768+0000","last_undegraded":"2023-11-27T20:44:08.513768+0000","last_fullsized":"2023-11-27T20:44:08.513768+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:20.057038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.514962+0000","last_change":"2023-11-27T20:43:52.751182+0000","last_active":"2023-11-27T20:44:08.514962+0000","last_peered":"2023-11-27T20:44:08.514962+0000","last_clean":"2023-11-27T20:44:08.514962+0000","last_became_active":"2023-11-27T20:43:52.750848+0000","last_became_peered":"2023-11-27T20:43:52.750848+0000","last_unstale":"2023-11-27T20:44:08.514962+0000","last_undegraded":"2023-11-27T20:44:08.514962+0000","last_fullsized":"2023-11-27T20:44:08.514962+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:16:59.403879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.531129+0000","last_change":"2023-11-27T20:43:51.712306+0000","last_active":"2023-11-27T20:44:08.531129+0000","last_peered":"2023-11-27T20:44:08.531129+0000","last_clean":"2023-11-27T20:44:08.531129+0000","last_became_active":"2023-11-27T20:43:51.712011+0000","last_became_peered":"2023-11-27T20:43:51.712011+0000","last_unstale":"2023-11-27T20:44:08.531129+0000","last_undegraded":"2023-11-27T20:44:08.531129+0000","last_fullsized":"2023-11-27T20:44:08.531129+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:16.877363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:09.540362+0000","last_change":"2023-11-27T20:44:08.538483+0000","last_active":"2023-11-27T20:44:09.540362+0000","last_peered":"2023-11-27T20:44:09.540362+0000","last_clean":"2023-11-27T20:44:09.540362+0000","last_became_active":"2023-11-27T20:44:08.538120+0000","last_became_peered":"2023-11-27T20:44:08.538120+0000","last_unstale":"2023-11-27T20:44:09.540362+0000","last_undegraded":"2023-11-27T20:44:09.540362+0000","last_fullsized":"2023-11-27T20:44:09.540362+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:22.084581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.538003+0000","last_change":"2023-11-27T20:44:07.553422+0000","last_active":"2023-11-27T20:44:08.538003+0000","last_peered":"2023-11-27T20:44:08.538003+0000","last_clean":"2023-11-27T20:44:08.538003+0000","last_became_active":"2023-11-27T20:44:07.553073+0000","last_became_peered":"2023-11-27T20:44:07.553073+0000","last_unstale":"2023-11-27T20:44:08.538003+0000","last_undegraded":"2023-11-27T20:44:08.538003+0000","last_fullsized":"2023-11-27T20:44:08.538003+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:57.611943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.522333+0000","last_change":"2023-11-27T20:43:52.726119+0000","last_active":"2023-11-27T20:44:08.522333+0000","last_peered":"2023-11-27T20:44:08.522333+0000","last_clean":"2023-11-27T20:44:08.522333+0000","last_became_active":"2023-11-27T20:43:52.725822+0000","last_became_peered":"2023-11-27T20:43:52.725822+0000","last_unstale":"2023-11-27T20:44:08.522333+0000","last_undegraded":"2023-11-27T20:44:08.522333+0000","last_fullsized":"2023-11-27T20:44:08.522333+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:13:42.798849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.523150+0000","last_change":"2023-11-27T20:43:51.701670+0000","last_active":"2023-11-27T20:44:08.523150+0000","last_peered":"2023-11-27T20:44:08.523150+0000","last_clean":"2023-11-27T20:44:08.523150+0000","last_became_active":"2023-11-27T20:43:51.701405+0000","last_became_peered":"2023-11-27T20:43:51.701405+0000","last_unstale":"2023-11-27T20:44:08.523150+0000","last_undegraded":"2023-11-27T20:44:08.523150+0000","last_fullsized":"2023-11-27T20:44:08.523150+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:37.579894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:10.896465+0000","last_change":"2023-11-27T20:44:08.537807+0000","last_active":"2023-11-27T20:44:10.896465+0000","last_peered":"2023-11-27T20:44:10.896465+0000","last_clean":"2023-11-27T20:44:10.896465+0000","last_became_active":"2023-11-27T20:44:08.537409+0000","last_became_peered":"2023-11-27T20:44:08.537409+0000","last_unstale":"2023-11-27T20:44:10.896465+0000","last_undegraded":"2023-11-27T20:44:10.896465+0000","last_fullsized":"2023-11-27T20:44:10.896465+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:33:35.168015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.522560+0000","last_change":"2023-11-27T20:44:07.541134+0000","last_active":"2023-11-27T20:44:08.522560+0000","last_peered":"2023-11-27T20:44:08.522560+0000","last_clean":"2023-11-27T20:44:08.522560+0000","last_became_active":"2023-11-27T20:44:07.540882+0000","last_became_peered":"2023-11-27T20:44:07.540882+0000","last_unstale":"2023-11-27T20:44:08.522560+0000","last_undegraded":"2023-11-27T20:44:08.522560+0000","last_fullsized":"2023-11-27T20:44:08.522560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:31.111976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.510882+0000","last_change":"2023-11-27T20:43:52.723905+0000","last_active":"2023-11-27T20:44:08.510882+0000","last_peered":"2023-11-27T20:44:08.510882+0000","last_clean":"2023-11-27T20:44:08.510882+0000","last_became_active":"2023-11-27T20:43:52.723296+0000","last_became_peered":"2023-11-27T20:43:52.723296+0000","last_unstale":"2023-11-27T20:44:08.510882+0000","last_undegraded":"2023-11-27T20:44:08.510882+0000","last_fullsized":"2023-11-27T20:44:08.510882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:56:25.080298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.510334+0000","last_change":"2023-11-27T20:43:51.707532+0000","last_active":"2023-11-27T20:44:08.510334+0000","last_peered":"2023-11-27T20:44:08.510334+0000","last_clean":"2023-11-27T20:44:08.510334+0000","last_became_active":"2023-11-27T20:43:51.705976+0000","last_became_peered":"2023-11-27T20:43:51.705976+0000","last_unstale":"2023-11-27T20:44:08.510334+0000","last_undegraded":"2023-11-27T20:44:08.510334+0000","last_fullsized":"2023-11-27T20:44:08.510334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:53:01.333262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-27T20:44:11.138690+0000","last_change":"2023-11-27T20:44:08.543302+0000","last_active":"2023-11-27T20:44:11.138690+0000","last_peered":"2023-11-27T20:44:11.138690+0000","last_clean":"2023-11-27T20:44:11.138690+0000","last_became_active":"2023-11-27T20:44:08.542879+0000","last_became_peered":"2023-11-27T20:44:08.542879+0000","last_unstale":"2023-11-27T20:44:11.138690+0000","last_undegraded":"2023-11-27T20:44:11.138690+0000","last_fullsized":"2023-11-27T20:44:11.138690+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:07.495928+0000","last_clean_scrub_stamp":"2023-11-27T20:44:07.495928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:12:35.751246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.562575+0000","last_change":"2023-11-27T20:44:07.543228+0000","last_active":"2023-11-27T20:44:08.562575+0000","last_peered":"2023-11-27T20:44:08.562575+0000","last_clean":"2023-11-27T20:44:08.562575+0000","last_became_active":"2023-11-27T20:44:07.540038+0000","last_became_peered":"2023-11-27T20:44:07.540038+0000","last_unstale":"2023-11-27T20:44:08.562575+0000","last_undegraded":"2023-11-27T20:44:08.562575+0000","last_fullsized":"2023-11-27T20:44:08.562575+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:44:06.481696+0000","last_clean_scrub_stamp":"2023-11-27T20:44:06.481696+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:14:31.111976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.509890+0000","last_change":"2023-11-27T20:43:52.752685+0000","last_active":"2023-11-27T20:44:08.509890+0000","last_peered":"2023-11-27T20:44:08.509890+0000","last_clean":"2023-11-27T20:44:08.509890+0000","last_became_active":"2023-11-27T20:43:52.748686+0000","last_became_peered":"2023-11-27T20:43:52.748686+0000","last_unstale":"2023-11-27T20:44:08.509890+0000","last_undegraded":"2023-11-27T20:44:08.509890+0000","last_fullsized":"2023-11-27T20:44:08.509890+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:51.668601+0000","last_clean_scrub_stamp":"2023-11-27T20:43:51.668601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:40:34.158412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.518753+0000","last_change":"2023-11-27T20:43:51.700471+0000","last_active":"2023-11-27T20:44:08.518753+0000","last_peered":"2023-11-27T20:44:08.518753+0000","last_clean":"2023-11-27T20:44:08.518753+0000","last_became_active":"2023-11-27T20:43:51.700088+0000","last_became_peered":"2023-11-27T20:43:51.700088+0000","last_unstale":"2023-11-27T20:44:08.518753+0000","last_undegraded":"2023-11-27T20:44:08.518753+0000","last_fullsized":"2023-11-27T20:44:08.518753+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:43:50.658438+0000","last_clean_scrub_stamp":"2023-11-27T20:43:50.658438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:13:35.862430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-27T20:44:08.513827+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:44:08.513827+0000","last_peered":"2023-11-27T20:44:08.513827+0000","last_clean":"2023-11-27T20:44:08.513827+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:44:08.513827+0000","last_undegraded":"2023-11-27T20:44:08.513827+0000","last_fullsized":"2023-11-27T20:44:08.513827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":903707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1579999999999999,"15min":1.163},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.181,"5min":1.2290000000000001,"15min":1.2370000000000001},"min":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.74,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.99399999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.47,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.607,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.163}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.282,"15min":1.3080000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.484,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.103},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.248,"15min":1.2589999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6379999999999999,"5min":1.909,"15min":1.909},"last":1.2090000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.361,"15min":1.397},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6779999999999999,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.569},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.47,"15min":1.496},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6879999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.403}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.724,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.5429999999999999,"15min":1.6040000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.623,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.3640000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4770000000000001,"15min":1.5049999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.948,"5min":2.044,"15min":2.044},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.5660000000000001,"15min":1.5940000000000001},"min":{"1min":0.69499999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8169999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.2589999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.653,"15min":1.6759999999999999},"min":{"1min":0.80200000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.0179999999999998,"5min":2.508,"15min":2.508},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.6559999999999999,"15min":1.694},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.724,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.4730000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":716800,"data_stored":312655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.679,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.208},{"interface":"front","average":{"1min":1.157,"5min":1.306,"15min":1.331},"min":{"1min":0.65200000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6399999999999999,"5min":2.581,"15min":2.581},"last":0.54200000000000004}]},{"osd":1,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2549999999999999,"15min":1.2769999999999999},"min":{"1min":0.81200000000000006,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5349999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.151,"15min":1.167},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.506,"5min":2.823,"15min":2.823},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0760000000000001,"15min":1.081},"min":{"1min":0.79100000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4790000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.2,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.86899999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.679,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.90700000000000003}]},{"osd":3,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.349,"15min":1.387},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.71,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.879},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.7849999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.016}]},{"osd":4,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.605,"15min":1.631},"min":{"1min":0.97699999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.994,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.623,"15min":1.663},"min":{"1min":0.82799999999999996,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.804,"5min":3.536,"15min":3.536},"last":1.077}]},{"osd":5,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.393,"15min":1.4079999999999999},"min":{"1min":0.81200000000000006,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.9359999999999999,"5min":2.355,"15min":2.355},"last":1.159},{"interface":"front","average":{"1min":1.49,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.753,"5min":0.623,"15min":0.623},"max":{"1min":1.8819999999999999,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.321}]},{"osd":7,"last update":"Mon Nov 27 20:43:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.6519999999999999,"15min":1.6919999999999999},"min":{"1min":0.88500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1659999999999999,"5min":3.645,"15min":3.645},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.569,"15min":1.589},"min":{"1min":1.006,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.032,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.361}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":313305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.1379999999999999,"15min":1.163},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5800000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.1579999999999999,"15min":1.1839999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6619999999999999,"5min":2.04,"15min":2.04},"last":1.367}]},{"osd":1,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.181,"15min":1.2050000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.4630000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.242}]},{"osd":2,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.27,"15min":1.294},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.73,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.268},{"interface":"front","average":{"1min":1.081,"5min":1.1950000000000001,"15min":1.214},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7470000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.556}]},{"osd":3,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.3660000000000001,"15min":1.399},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5900000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.4359999999999999,"15min":1.472},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.637,"5min":4.016,"15min":4.016},"last":1.206}]},{"osd":4,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3580000000000001,"15min":1.3919999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.79,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.873},{"interface":"front","average":{"1min":1.292,"5min":1.585,"15min":1.6339999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8140000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.1439999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.619,"15min":1.671},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.724,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.573,"15min":1.6120000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.016,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.405}]},{"osd":7,"last update":"Mon Nov 27 20:43:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.6379999999999999,"15min":1.6819999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.871,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.599},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.708,"15min":1.76},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8380000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.3160000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":315740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.014,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.0840000000000001,"15min":1.0820000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0760000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.034,"15min":1.008},"min":{"1min":0.80400000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.234,"5min":1.222,"15min":1.22},"min":{"1min":0.64500000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.74,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.84899999999999998}]},{"osd":2,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2170000000000001,"15min":1.2110000000000001},"min":{"1min":0.69799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.248},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.292,"15min":1.294},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.2170000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.165,"15min":1.175},"min":{"1min":0.85199999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.599,"5min":1.778,"15min":1.778},"last":1.304},{"interface":"front","average":{"1min":1.464,"5min":1.3600000000000001,"15min":1.343},"min":{"1min":0.91400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.278}]},{"osd":5,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.266,"15min":1.284},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.04},{"interface":"front","average":{"1min":1.421,"5min":1.431,"15min":1.4330000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.4179999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.651,"5min":2.157,"15min":2.157},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.595,"15min":1.605},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.887,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.3300000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5089999999999999,"15min":1.5009999999999999},"min":{"1min":1.179,"5min":1.016,"15min":1.016},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.716},{"interface":"front","average":{"1min":1.696,"5min":1.6679999999999999,"15min":1.6639999999999999},"min":{"1min":1.22,"5min":1.004,"15min":1.004},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.857}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":724992,"data_stored":312731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":1.0009999999999999,"15min":1.0389999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.258,"5min":3.641,"15min":3.641},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97199999999999998,"15min":1.014},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0449999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.72299999999999998}]},{"osd":1,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.399,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.097,"15min":1.121},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4099999999999999,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.752}]},{"osd":2,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0960000000000001,"15min":1.117},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.444,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.1180000000000001,"15min":1.135},"min":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.746,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.70299999999999996}]},{"osd":4,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.3029999999999999,"15min":1.337},"min":{"1min":0.84499999999999997,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.365,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3720000000000001,"15min":1.4039999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.4330000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.89100000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.4179999999999999,"15min":1.4379999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.982,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.077},{"interface":"front","average":{"1min":1.272,"5min":1.452,"15min":1.482},"min":{"1min":0.874,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.714,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.167}]},{"osd":6,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.5189999999999999,"15min":1.544},"min":{"1min":0.96799999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.823,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.03},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.492,"15min":1.522},"min":{"1min":0.89000000000000001,"5min":0.878,"15min":0.878},"max":{"1min":1.8560000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.141}]},{"osd":7,"last update":"Mon Nov 27 20:43:28 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.5209999999999999,"15min":1.5580000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.929,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.4890000000000001,"15min":1.5009999999999999},"min":{"1min":1.002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.7410000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.0049999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":314231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.80800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1259999999999999,"5min":1.228,"15min":1.228},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.93300000000000005},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2270000000000001,"5min":1.972,"15min":1.972},"last":0.85099999999999998}]},{"osd":1,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.98099999999999998,"15min":1.014},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1890000000000001,"5min":1.522,"15min":1.522},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.96499999999999997,"15min":0.98799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.431,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.2729999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.96099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.151},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0740000000000001,"15min":1.101},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4770000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.0549999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.1850000000000001,"15min":1.21},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4299999999999999,"5min":1.669,"15min":1.669},"last":1.367},{"interface":"front","average":{"1min":1.169,"5min":1.3540000000000001,"15min":1.385},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.331}]},{"osd":5,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.3009999999999999,"15min":1.3260000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.601,"5min":2.48,"15min":2.48},"last":1.466},{"interface":"front","average":{"1min":1.198,"5min":1.4510000000000001,"15min":1.4930000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.9930000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.226}]},{"osd":6,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3640000000000001,"15min":1.381},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.972,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.488},{"interface":"front","average":{"1min":1.202,"5min":1.4890000000000001,"15min":1.5369999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.831,"5min":3.302,"15min":3.302},"last":1.427}]},{"osd":7,"last update":"Mon Nov 27 20:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.46,"15min":1.496},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.1070000000000002,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.4330000000000001,"15min":1.4810000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.581,"5min":2.73,"15min":2.73},"last":1.6419999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":314881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0940000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.89600000000000002,"15min":0.88100000000000001},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.5449999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.94999999999999996}]},{"osd":2,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.97099999999999997,"15min":0.98999999999999999},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3740000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.113},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0429999999999999,"15min":1.0469999999999999},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.518,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.149}]},{"osd":3,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0489999999999999,"15min":1.0329999999999999},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7370000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.012},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.083,"15min":1.087},"min":{"1min":0.66600000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6140000000000001,"5min":2.044,"15min":2.044},"last":1.0569999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1799999999999999,"15min":1.1890000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3640000000000001,"15min":1.3540000000000001},"min":{"1min":0.88500000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.1099999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.5649999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2589999999999999,"15min":1.2370000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9810000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.514},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.25,"15min":1.2330000000000001},"min":{"1min":0.79100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1659999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.7609999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.3380000000000001,"15min":1.3180000000000001},"min":{"1min":1.095,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.1230000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.659},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.357},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.732,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.3540000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.4690000000000001,"15min":1.476},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1949999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.726},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.5960000000000001,"15min":1.5880000000000001},"min":{"1min":1.143,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.7469999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.3979999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":906620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.405},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.85299999999999998,"15min":0.84199999999999997},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0029999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.85099999999999998,"15min":0.83499999999999996},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.425}]},{"osd":3,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.91300000000000003,"15min":0.89700000000000002},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.8320000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.3360000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2470000000000001,"15min":1.246},"min":{"1min":0.76900000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9430000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.597},{"interface":"front","average":{"1min":1.228,"5min":1.1970000000000001,"15min":1.1919999999999999},"min":{"1min":0.89700000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.575,"5min":2.391,"15min":2.391},"last":1.45}]},{"osd":5,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.347,"15min":1.3540000000000001},"min":{"1min":0.81399999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.0750000000000002,"5min":3.028,"15min":3.028},"last":1.482},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.3129999999999999},"min":{"1min":0.77700000000000002,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.246,"5min":2.718,"15min":2.718},"last":1.194}]},{"osd":6,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.306,"15min":1.3120000000000001},"min":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7909999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.248},{"interface":"front","average":{"1min":1.415,"5min":1.423,"15min":1.4239999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.1509999999999998,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.6819999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3540000000000001,"15min":1.355},"min":{"1min":0.84699999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.835,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3560000000000001,"15min":1.3600000000000001},"min":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8500000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3759999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:44:18.458 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T20:44:18.458 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-27T20:44:18.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.712+0000 7f4e99f2c640 1 Processor -- start 2023-11-27T20:44:18.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.712+0000 7f4e99f2c640 1 -- start start 2023-11-27T20:44:18.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.714+0000 7f4e99f2c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4e940c3400 0x7f4e9406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.714+0000 7f4e99f2c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4e94157fe0 0x7f4e94158430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.714+0000 7f4e99f2c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e94071fd0 con 0x7f4e94151fd0 2023-11-27T20:44:18.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.714+0000 7f4e99f2c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9406ee50 con 0x7f4e94157fe0 2023-11-27T20:44:18.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.714+0000 7f4e99f2c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e94072220 con 0x7f4e940c3400 2023-11-27T20:44:18.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.714+0000 7f4e93fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4e94157fe0 0x7f4e94158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:18.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.714+0000 7f4e93fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4e94157fe0 0x7f4e94158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36082/0 (socket says 172.21.15.91:36082) 2023-11-27T20:44:18.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.714+0000 7f4e93fff640 1 -- 172.21.15.91:0/3793455975 learned_addr learned my addr 172.21.15.91:0/3793455975 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:18.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.715+0000 7f4e93fff640 1 -- 172.21.15.91:0/3793455975 >> v2:172.21.15.183:3300/0 conn(0x7f4e940c3400 msgr2=0x7f4e9406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:18.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.715+0000 7f4e8bfff640 1 --2- 172.21.15.91:0/3793455975 >> v2:172.21.15.183:3300/0 conn(0x7f4e940c3400 0x7f4e9406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:18.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.715+0000 7f4e93fff640 1 --2- 172.21.15.91:0/3793455975 >> v2:172.21.15.183:3300/0 conn(0x7f4e940c3400 0x7f4e9406e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.715+0000 7f4e93fff640 1 -- 172.21.15.91:0/3793455975 >> v1:172.21.15.183:6789/0 conn(0x7f4e94151fd0 legacy=0x7f4e9406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:18.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.715+0000 7f4e93fff640 1 -- 172.21.15.91:0/3793455975 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9406e0d0 con 0x7f4e94157fe0 2023-11-27T20:44:18.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.715+0000 7f4e8bfff640 1 --2- 172.21.15.91:0/3793455975 >> v2:172.21.15.183:3300/0 conn(0x7f4e940c3400 0x7f4e9406e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:18.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.716+0000 7f4e93fff640 1 --2- 172.21.15.91:0/3793455975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94157fe0 0x7f4e94158430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4e9406ddb0 tx=0x7f4e8c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf8b070182d52d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:18.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.716+0000 7f4e92ffd640 1 -- 172.21.15.91:0/3793455975 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c02c9f0 con 0x7f4e94157fe0 2023-11-27T20:44:18.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.716+0000 7f4e92ffd640 1 -- 172.21.15.91:0/3793455975 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8c02cb50 con 0x7f4e94157fe0 2023-11-27T20:44:18.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.716+0000 7f4e92ffd640 1 -- 172.21.15.91:0/3793455975 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c0343f0 con 0x7f4e94157fe0 2023-11-27T20:44:18.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.717+0000 7f4e99f2c640 1 -- 172.21.15.91:0/3793455975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94157fe0 msgr2=0x7f4e94158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.717+0000 7f4e99f2c640 1 --2- 172.21.15.91:0/3793455975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94157fe0 0x7f4e94158430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4e9406ddb0 tx=0x7f4e8c02be50 comp rx=0 tx=0).stop 2023-11-27T20:44:18.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.717+0000 7f4e99f2c640 1 -- 172.21.15.91:0/3793455975 shutdown_connections 2023-11-27T20:44:18.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.717+0000 7f4e99f2c640 1 --2- 172.21.15.91:0/3793455975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94157fe0 0x7f4e94158430 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.717+0000 7f4e99f2c640 1 --2- 172.21.15.91:0/3793455975 >> v2:172.21.15.183:3300/0 conn(0x7f4e940c3400 0x7f4e9406e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.717+0000 7f4e99f2c640 1 -- 172.21.15.91:0/3793455975 >> 172.21.15.91:0/3793455975 conn(0x7f4e940c6ee0 msgr2=0x7f4e940c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:18.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.717+0000 7f4e99f2c640 1 -- 172.21.15.91:0/3793455975 shutdown_connections 2023-11-27T20:44:18.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.717+0000 7f4e99f2c640 1 -- 172.21.15.91:0/3793455975 wait complete. 2023-11-27T20:44:18.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.719+0000 7f4e99f2c640 1 Processor -- start 2023-11-27T20:44:18.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.719+0000 7f4e99f2c640 1 -- start start 2023-11-27T20:44:18.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.720+0000 7f4e99f2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e940c3400 0x7f4e941442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.720+0000 7f4e99f2c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94151fd0 0x7f4e94145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.720+0000 7f4e99f2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94157fe0 0x7f4e9414a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.720+0000 7f4e99f2c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940a8ff0 con 0x7f4e94151fd0 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.720+0000 7f4e99f2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9414a200 con 0x7f4e94157fe0 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.720+0000 7f4e99f2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e941ee490 con 0x7f4e940c3400 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.720+0000 7f4e8bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94151fd0 0x7f4e94145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.720+0000 7f4e8bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94151fd0 0x7f4e94145af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36092/0 (socket says 172.21.15.91:36092) 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.720+0000 7f4e8bfff640 1 -- 172.21.15.91:0/882913461 learned_addr learned my addr 172.21.15.91:0/882913461 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.720+0000 7f4e93fff640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94157fe0 0x7f4e9414a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e8bfff640 1 -- 172.21.15.91:0/882913461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e940c3400 msgr2=0x7f4e941442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e8bfff640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e940c3400 0x7f4e941442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e8bfff640 1 -- 172.21.15.91:0/882913461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94157fe0 msgr2=0x7f4e9414a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e8bfff640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94157fe0 0x7f4e9414a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e8bfff640 1 -- 172.21.15.91:0/882913461 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c009b30 con 0x7f4e94151fd0 2023-11-27T20:44:18.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e93fff640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94157fe0 0x7f4e9414a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:18.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e8bfff640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94151fd0 0x7f4e94145af0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00c7f0 tx=0x7f4e7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:18.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e90ff9640 1 -- 172.21.15.91:0/882913461 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00cea0 con 0x7f4e94151fd0 2023-11-27T20:44:18.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e90ff9640 1 -- 172.21.15.91:0/882913461 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c004230 con 0x7f4e94151fd0 2023-11-27T20:44:18.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e90ff9640 1 -- 172.21.15.91:0/882913461 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c007830 con 0x7f4e94151fd0 2023-11-27T20:44:18.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e99f2c640 1 -- 172.21.15.91:0/882913461 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e94149bb0 con 0x7f4e94151fd0 2023-11-27T20:44:18.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.721+0000 7f4e99f2c640 1 -- 172.21.15.91:0/882913461 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e941447e0 con 0x7f4e94151fd0 2023-11-27T20:44:18.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.722+0000 7f4e99f2c640 1 -- 172.21.15.91:0/882913461 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e94068350 con 0x7f4e94151fd0 2023-11-27T20:44:18.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.723+0000 7f4e90ff9640 1 -- 172.21.15.91:0/882913461 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4e7c007990 con 0x7f4e94151fd0 2023-11-27T20:44:18.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.724+0000 7f4e90ff9640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4e7406b1c0 0x7f4e7406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:18.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.724+0000 7f4e90ff9640 1 -- 172.21.15.91:0/882913461 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f4e7c089d50 con 0x7f4e94151fd0 2023-11-27T20:44:18.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.724+0000 7f4e937fe640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4e7406b1c0 0x7f4e7406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:18.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.725+0000 7f4e937fe640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4e7406b1c0 0x7f4e7406d680 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4e94146a50 tx=0x7f4e840079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:18.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.729+0000 7f4e90ff9640 1 -- 172.21.15.91:0/882913461 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4e7c0546e0 con 0x7f4e94151fd0 2023-11-27T20:44:18.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.988+0000 7f4e99f2c640 1 -- 172.21.15.91:0/882913461 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f4e940c7c60 con 0x7f4e94151fd0 2023-11-27T20:44:18.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.992+0000 7f4e90ff9640 1 -- 172.21.15.91:0/882913461 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v20) v1 ==== 185+0+142 (secure 0 0 0) 0x7f4e7c01e0e0 con 0x7f4e94151fd0 2023-11-27T20:44:18.994 INFO:teuthology.orchestra.run.smithi091.stdout:[client.1] 2023-11-27T20:44:18.994 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5/mRlsqHoLBAAzs5TAvGaf/SnzmZfDewgAg== 2023-11-27T20:44:18.994 INFO:teuthology.orchestra.run.smithi091.stdout: caps mds = "allow" 2023-11-27T20:44:18.994 INFO:teuthology.orchestra.run.smithi091.stdout: caps mon = "allow r" 2023-11-27T20:44:18.994 INFO:teuthology.orchestra.run.smithi091.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-27T20:44:18.995 INFO:teuthology.orchestra.run.smithi091.stderr:updated caps for client.1 2023-11-27T20:44:18.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.995+0000 7f4e99f2c640 1 -- 172.21.15.91:0/882913461 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4e7406b1c0 msgr2=0x7f4e7406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.995+0000 7f4e99f2c640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4e7406b1c0 0x7f4e7406d680 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4e94146a50 tx=0x7f4e840079b0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.995+0000 7f4e99f2c640 1 -- 172.21.15.91:0/882913461 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94151fd0 msgr2=0x7f4e94145af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:18.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.995+0000 7f4e99f2c640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94151fd0 0x7f4e94145af0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00c7f0 tx=0x7f4e7c00ccb0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.995+0000 7f4e99f2c640 1 -- 172.21.15.91:0/882913461 shutdown_connections 2023-11-27T20:44:18.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.995+0000 7f4e99f2c640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4e7406b1c0 0x7f4e7406d680 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.995+0000 7f4e99f2c640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94157fe0 0x7f4e9414a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.995+0000 7f4e99f2c640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e94151fd0 0x7f4e94145af0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.995+0000 7f4e99f2c640 1 --2- 172.21.15.91:0/882913461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e940c3400 0x7f4e941442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:18.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.996+0000 7f4e99f2c640 1 -- 172.21.15.91:0/882913461 >> 172.21.15.91:0/882913461 conn(0x7f4e940c6ee0 msgr2=0x7f4e94070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:18.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.996+0000 7f4e99f2c640 1 -- 172.21.15.91:0/882913461 shutdown_connections 2023-11-27T20:44:18.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:18.996+0000 7f4e99f2c640 1 -- 172.21.15.91:0/882913461 wait complete. 2023-11-27T20:44:19.016 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:44:19.016 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:19.076 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:44:19.076 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:19.132 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:19.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.349+0000 7fc4422ee640 1 Processor -- start 2023-11-27T20:44:19.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.349+0000 7fc4422ee640 1 -- start start 2023-11-27T20:44:19.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.351+0000 7fc4422ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c155490 0x7fc43c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.351+0000 7fc4422ee640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c0c06c0 con 0x7fc43c0c1500 2023-11-27T20:44:19.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.351+0000 7fc4422ee640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c0c1020 con 0x7fc43c0a9b40 2023-11-27T20:44:19.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.351+0000 7fc4422ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0a5820 con 0x7fc43c155490 2023-11-27T20:44:19.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.351+0000 7fc433fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fc43c0c1500 0x7fc43c0a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39520/0 (socket says 172.21.15.91:39520) 2023-11-27T20:44:19.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.351+0000 7fc433fff640 1 -- 172.21.15.91:0/1659631701 learned_addr learned my addr 172.21.15.91:0/1659631701 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:19.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.351+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370384190 0 0) 0x7fc43c0c06c0 con 0x7fc43c0c1500 2023-11-27T20:44:19.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc428005730 con 0x7fc43c0c1500 2023-11-27T20:44:19.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43bfff640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c155490 0x7fc43c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 639009983 0 0) 0x7fc428005730 con 0x7fc43c0c1500 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c155490 msgr2=0x7fc43c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c155490 0x7fc43c0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 >> v1:172.21.15.183:6789/0 conn(0x7fc43c0a9b40 legacy=0x7fc43c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0c0910 con 0x7fc43c0c1500 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fc424001670 con 0x7fc43c0c1500 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 >> v1:172.21.15.91:6789/0 conn(0x7fc43c0c1500 legacy=0x7fc43c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c155490 0x7fc428005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4280061e0 0x7fc4280069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc428006f10 0x7fc428007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42800dd20 con 0x7fc4280061e0 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42800de90 con 0x7fc428006f10 2023-11-27T20:44:19.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42800e050 con 0x7fc43c155490 2023-11-27T20:44:19.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.352+0000 7fc433fff640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4280061e0 0x7fc4280069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.353+0000 7fc43bfff640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c155490 0x7fc428005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.353+0000 7fc44088b640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc428006f10 0x7fc428007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.353+0000 7fc433fff640 1 -- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c155490 msgr2=0x7fc428005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:19.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.353+0000 7fc433fff640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c155490 0x7fc428005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.353+0000 7fc433fff640 1 -- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc428006f10 msgr2=0x7fc428007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:19.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.353+0000 7fc433fff640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc428006f10 0x7fc428007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.353+0000 7fc433fff640 1 -- 172.21.15.91:0/1659631701 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428005730 con 0x7fc4280061e0 2023-11-27T20:44:19.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.353+0000 7fc44088b640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc428006f10 0x7fc428007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:19.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.354+0000 7fc433fff640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4280061e0 0x7fc4280069d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc42400c240 tx=0x7fc428007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfde163a1b9c1af server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:19.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.354+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424005ad0 con 0x7fc4280061e0 2023-11-27T20:44:19.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.354+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc424005c30 con 0x7fc4280061e0 2023-11-27T20:44:19.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.354+0000 7fc43b7fe640 1 -- 172.21.15.91:0/1659631701 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42402caf0 con 0x7fc4280061e0 2023-11-27T20:44:19.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.355+0000 7fc4422ee640 1 -- 172.21.15.91:0/1659631701 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4280061e0 msgr2=0x7fc4280069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.355+0000 7fc4422ee640 1 --2- 172.21.15.91:0/1659631701 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4280061e0 0x7fc4280069d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc42400c240 tx=0x7fc428007a00 comp rx=0 tx=0).stop 2023-11-27T20:44:19.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.355+0000 7fc44088b640 1 -- 172.21.15.91:0/1659631701 reap_dead start 2023-11-27T20:44:19.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.355+0000 7fc4422ee640 1 -- 172.21.15.91:0/1659631701 shutdown_connections 2023-11-27T20:44:19.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.355+0000 7fc4422ee640 1 -- 172.21.15.91:0/1659631701 >> 172.21.15.91:0/1659631701 conn(0x7fc43c06a500 msgr2=0x7fc43c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:19.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.355+0000 7fc4422ee640 1 -- 172.21.15.91:0/1659631701 shutdown_connections 2023-11-27T20:44:19.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.355+0000 7fc4422ee640 1 -- 172.21.15.91:0/1659631701 wait complete. 2023-11-27T20:44:19.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.357+0000 7fc4422ee640 1 Processor -- start 2023-11-27T20:44:19.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.357+0000 7fc4422ee640 1 -- start start 2023-11-27T20:44:19.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc4422ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4280061e0 0x7fc43c1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc4422ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c071660 0x7fc43c14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc4422ee640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc43c14e530 0x7fc43c0bafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc4422ee640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c14fed0 con 0x7fc43c14e530 2023-11-27T20:44:19.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc4422ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c14e9b0 con 0x7fc4280061e0 2023-11-27T20:44:19.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc4422ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c1511b0 con 0x7fc43c071660 2023-11-27T20:44:19.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc44088b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc43c14e530 0x7fc43c0bafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc44088b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc43c14e530 0x7fc43c0bafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36114/0 (socket says 172.21.15.91:36114) 2023-11-27T20:44:19.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc44088b640 1 -- 172.21.15.91:0/3539021708 learned_addr learned my addr 172.21.15.91:0/3539021708 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:19.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc44088b640 1 -- 172.21.15.91:0/3539021708 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c071660 msgr2=0x7fc43c14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc43bfff640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4280061e0 0x7fc43c1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc44088b640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c071660 0x7fc43c14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc44088b640 1 -- 172.21.15.91:0/3539021708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4280061e0 msgr2=0x7fc43c1518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc44088b640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4280061e0 0x7fc43c1518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.358+0000 7fc44088b640 1 -- 172.21.15.91:0/3539021708 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c151e00 con 0x7fc43c14e530 2023-11-27T20:44:19.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.359+0000 7fc44088b640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc43c14e530 0x7fc43c0bafc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc43c067240 tx=0x7fc43400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:19.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.359+0000 7fc4397fa640 1 -- 172.21.15.91:0/3539021708 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434006d50 con 0x7fc43c14e530 2023-11-27T20:44:19.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.359+0000 7fc4397fa640 1 -- 172.21.15.91:0/3539021708 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc434003970 con 0x7fc43c14e530 2023-11-27T20:44:19.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.359+0000 7fc4397fa640 1 -- 172.21.15.91:0/3539021708 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434003d20 con 0x7fc43c14e530 2023-11-27T20:44:19.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.359+0000 7fc4422ee640 1 -- 172.21.15.91:0/3539021708 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c14fbf0 con 0x7fc43c14e530 2023-11-27T20:44:19.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.359+0000 7fc4422ee640 1 -- 172.21.15.91:0/3539021708 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c150e40 con 0x7fc43c14e530 2023-11-27T20:44:19.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.360+0000 7fc4422ee640 1 -- 172.21.15.91:0/3539021708 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c1509c0 con 0x7fc43c14e530 2023-11-27T20:44:19.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.361+0000 7fc4397fa640 1 -- 172.21.15.91:0/3539021708 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc434005070 con 0x7fc43c14e530 2023-11-27T20:44:19.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.362+0000 7fc4397fa640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc41c06b1c0 0x7fc41c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.362+0000 7fc4397fa640 1 -- 172.21.15.91:0/3539021708 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fc434089c30 con 0x7fc43c14e530 2023-11-27T20:44:19.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.362+0000 7fc43bfff640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc41c06b1c0 0x7fc41c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.363+0000 7fc43bfff640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc41c06b1c0 0x7fc41c06d680 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006fd0 tx=0x7fc42c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:19.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.366+0000 7fc4397fa640 1 -- 172.21.15.91:0/3539021708 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc43c1509c0 con 0x7fc43c14e530 2023-11-27T20:44:19.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.558+0000 7fc4422ee640 1 -- 172.21.15.91:0/3539021708 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc43c1509c0 con 0x7fc43c14e530 2023-11-27T20:44:19.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.560+0000 7fc4397fa640 1 -- 172.21.15.91:0/3539021708 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+20342 (secure 0 0 0) 0x7fc43c1509c0 con 0x7fc43c14e530 2023-11-27T20:44:19.562 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:19.562 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":61,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:18.243029+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:19.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 -- 172.21.15.91:0/3539021708 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc41c06b1c0 msgr2=0x7fc41c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc41c06b1c0 0x7fc41c06d680 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006fd0 tx=0x7fc42c008040 comp rx=0 tx=0).stop 2023-11-27T20:44:19.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 -- 172.21.15.91:0/3539021708 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc43c14e530 msgr2=0x7fc43c0bafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc43c14e530 0x7fc43c0bafc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc43c067240 tx=0x7fc43400dc00 comp rx=0 tx=0).stop 2023-11-27T20:44:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 -- 172.21.15.91:0/3539021708 shutdown_connections 2023-11-27T20:44:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc43c14e530 0x7fc43c0bafc0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc43c071660 0x7fc43c14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc41c06b1c0 0x7fc41c06d680 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 --2- 172.21.15.91:0/3539021708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4280061e0 0x7fc43c1518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 -- 172.21.15.91:0/3539021708 >> 172.21.15.91:0/3539021708 conn(0x7fc43c06a500 msgr2=0x7fc43c0a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 -- 172.21.15.91:0/3539021708 shutdown_connections 2023-11-27T20:44:19.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.563+0000 7fc4422ee640 1 -- 172.21.15.91:0/3539021708 wait complete. 2023-11-27T20:44:19.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:43:50.043742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:43:51.176510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:44:06.059576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:44:06.989345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:44:19.583 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:44:19.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.792+0000 7f1075d7c640 1 Processor -- start 2023-11-27T20:44:19.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.792+0000 7f1075d7c640 1 -- start start 2023-11-27T20:44:19.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.794+0000 7f1075d7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f107014e7f0 0x7f10700c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.794+0000 7f1075d7c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f10700c52e0 0x7f107006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.794+0000 7f1075d7c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10700a8380 con 0x7f107006cd20 2023-11-27T20:44:19.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.794+0000 7f1075d7c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10701510b0 con 0x7f10700c52e0 2023-11-27T20:44:19.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.794+0000 7f1075d7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107006bf60 con 0x7f107014e7f0 2023-11-27T20:44:19.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.794+0000 7f107557b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f107006cd20 0x7f10701546a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39532/0 (socket says 172.21.15.91:39532) 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.794+0000 7f107557b640 1 -- 172.21.15.91:0/735753740 learned_addr learned my addr 172.21.15.91:0/735753740 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f1074d7a640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f107014e7f0 0x7f10700c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106ffff640 1 --2- 172.21.15.91:0/735753740 >> v2:172.21.15.183:3300/0 conn(0x7f10700c52e0 0x7f107006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510988009 0 0) 0x7f10700a8380 con 0x7f107006cd20 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1058005730 con 0x7f107006cd20 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2261388521 0 0) 0x7f1058005730 con 0x7f107006cd20 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f107014e7f0 msgr2=0x7f10700c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f107014e7f0 0x7f10700c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 >> v2:172.21.15.183:3300/0 conn(0x7f10700c52e0 msgr2=0x7f107006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 --2- 172.21.15.91:0/735753740 >> v2:172.21.15.183:3300/0 conn(0x7f10700c52e0 0x7f107006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107006c240 con 0x7f107006cd20 2023-11-27T20:44:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f10680019f0 con 0x7f107006cd20 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 >> v1:172.21.15.91:6789/0 conn(0x7f107006cd20 legacy=0x7f10701546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f107014e7f0 0x7f1058005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.795+0000 7f106f7fe640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1058006100 0x7f10580069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f106f7fe640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1058006f10 0x7f1058007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10701510b0 con 0x7f1058006f10 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107006bf60 con 0x7f1058006100 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105800dbe0 con 0x7f107014e7f0 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f107557b640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1058006f10 0x7f1058007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f1074d7a640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f107014e7f0 0x7f1058005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f107557b640 1 -- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f107014e7f0 msgr2=0x7f1058005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f107557b640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f107014e7f0 0x7f1058005b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f106ffff640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1058006100 0x7f10580069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f107557b640 1 -- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1058006100 msgr2=0x7f10580069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:19.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f107557b640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1058006100 0x7f10580069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.796+0000 7f107557b640 1 -- 172.21.15.91:0/735753740 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058005730 con 0x7f1058006f10 2023-11-27T20:44:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.797+0000 7f107557b640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1058006f10 0x7f1058007390 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f10700a5730 tx=0x7f1058007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a0c52eb1629062 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.798+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068034630 con 0x7f1058006f10 2023-11-27T20:44:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.798+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106802f070 con 0x7f1058006f10 2023-11-27T20:44:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.798+0000 7f106f7fe640 1 -- 172.21.15.91:0/735753740 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10680349d0 con 0x7f1058006f10 2023-11-27T20:44:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.798+0000 7f1075d7c640 1 -- 172.21.15.91:0/735753740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1058006f10 msgr2=0x7f1058007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.798+0000 7f1075d7c640 1 --2- 172.21.15.91:0/735753740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1058006f10 0x7f1058007390 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f10700a5730 tx=0x7f1058007a00 comp rx=0 tx=0).stop 2023-11-27T20:44:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.798+0000 7f107557b640 1 -- 172.21.15.91:0/735753740 reap_dead start 2023-11-27T20:44:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.799+0000 7f1075d7c640 1 -- 172.21.15.91:0/735753740 shutdown_connections 2023-11-27T20:44:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.799+0000 7f1075d7c640 1 -- 172.21.15.91:0/735753740 >> 172.21.15.91:0/735753740 conn(0x7f10700a77f0 msgr2=0x7f10700a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.799+0000 7f1075d7c640 1 -- 172.21.15.91:0/735753740 shutdown_connections 2023-11-27T20:44:19.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.799+0000 7f1075d7c640 1 -- 172.21.15.91:0/735753740 wait complete. 2023-11-27T20:44:19.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.800+0000 7f1075d7c640 1 Processor -- start 2023-11-27T20:44:19.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.801+0000 7f1075d7c640 1 -- start start 2023-11-27T20:44:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.801+0000 7f1075d7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1058006f10 0x7f10701e9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f1075d7c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f107014b530 0x7f10701e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f1075d7c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1070154880 0x7f1070153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f1075d7c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107014bd80 con 0x7f1070154880 2023-11-27T20:44:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f1075d7c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070149eb0 con 0x7f107014b530 2023-11-27T20:44:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f1075d7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107014baa0 con 0x7f1058006f10 2023-11-27T20:44:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f107557b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1070154880 0x7f1070153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f107557b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1070154880 0x7f1070153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36136/0 (socket says 172.21.15.91:36136) 2023-11-27T20:44:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f107557b640 1 -- 172.21.15.91:0/2079736572 learned_addr learned my addr 172.21.15.91:0/2079736572 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f106ffff640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f107014b530 0x7f10701e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f1074d7a640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1058006f10 0x7f10701e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f107557b640 1 -- 172.21.15.91:0/2079736572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1058006f10 msgr2=0x7f10701e9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f107557b640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1058006f10 0x7f10701e9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f107557b640 1 -- 172.21.15.91:0/2079736572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f107014b530 msgr2=0x7f10701e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:19.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f107557b640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f107014b530 0x7f10701e7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:19.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.802+0000 7f107557b640 1 -- 172.21.15.91:0/2079736572 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070149860 con 0x7f1070154880 2023-11-27T20:44:19.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.803+0000 7f107557b640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1070154880 0x7f1070153d10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f106802cb00 tx=0x7f10700a8510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.803+0000 7f106d7fa640 1 -- 172.21.15.91:0/2079736572 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068034840 con 0x7f1070154880 2023-11-27T20:44:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.803+0000 7f106d7fa640 1 -- 172.21.15.91:0/2079736572 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10680349a0 con 0x7f1070154880 2023-11-27T20:44:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.803+0000 7f106d7fa640 1 -- 172.21.15.91:0/2079736572 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068034d10 con 0x7f1070154880 2023-11-27T20:44:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.803+0000 7f1075d7c640 1 -- 172.21.15.91:0/2079736572 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1070149b40 con 0x7f1070154880 2023-11-27T20:44:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.803+0000 7f1075d7c640 1 -- 172.21.15.91:0/2079736572 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10701551b0 con 0x7f1070154880 2023-11-27T20:44:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.804+0000 7f1075d7c640 1 -- 172.21.15.91:0/2079736572 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107004e840 con 0x7f1070154880 2023-11-27T20:44:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.805+0000 7f106d7fa640 1 -- 172.21.15.91:0/2079736572 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1068031030 con 0x7f1070154880 2023-11-27T20:44:19.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.806+0000 7f106d7fa640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f105c06b1c0 0x7f105c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:19.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.806+0000 7f106d7fa640 1 -- 172.21.15.91:0/2079736572 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f106802ce40 con 0x7f1070154880 2023-11-27T20:44:19.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.806+0000 7f1074d7a640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f105c06b1c0 0x7f105c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:19.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.807+0000 7f1074d7a640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f105c06b1c0 0x7f105c06d680 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1064009910 tx=0x7f1064008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:19.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:19.811+0000 7f106d7fa640 1 -- 172.21.15.91:0/2079736572 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1068076c20 con 0x7f1070154880 2023-11-27T20:44:20.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.001+0000 7f1075d7c640 1 -- 172.21.15.91:0/2079736572 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f107004e840 con 0x7f1070154880 2023-11-27T20:44:20.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.001+0000 7f106d7fa640 1 -- 172.21.15.91:0/2079736572 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1068001ff0 con 0x7f1070154880 2023-11-27T20:44:20.003 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:44:20.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 -- 172.21.15.91:0/2079736572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f105c06b1c0 msgr2=0x7f105c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f105c06b1c0 0x7f105c06d680 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1064009910 tx=0x7f1064008040 comp rx=0 tx=0).stop 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 -- 172.21.15.91:0/2079736572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1070154880 msgr2=0x7f1070153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1070154880 0x7f1070153d10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f106802cb00 tx=0x7f10700a8510 comp rx=0 tx=0).stop 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 -- 172.21.15.91:0/2079736572 shutdown_connections 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1070154880 0x7f1070153d10 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f105c06b1c0 0x7f105c06d680 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f107014b530 0x7f10701e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 --2- 172.21.15.91:0/2079736572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1058006f10 0x7f10701e9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 -- 172.21.15.91:0/2079736572 >> 172.21.15.91:0/2079736572 conn(0x7f10700a77f0 msgr2=0x7f10700c41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 -- 172.21.15.91:0/2079736572 shutdown_connections 2023-11-27T20:44:20.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.004+0000 7f1075d7c640 1 -- 172.21.15.91:0/2079736572 wait complete. 2023-11-27T20:44:20.023 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:44:20.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.236+0000 7fd7ef518640 1 Processor -- start 2023-11-27T20:44:20.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.237+0000 7fd7ef518640 1 -- start start 2023-11-27T20:44:20.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7ef518640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e8155490 0x7fd7e80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7ef518640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd7e80a9b40 0x7fd7e80c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7ef518640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e80c06c0 con 0x7fd7e80c1500 2023-11-27T20:44:20.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7ef518640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e80a5820 con 0x7fd7e80a9b40 2023-11-27T20:44:20.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7ef518640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80c1020 con 0x7fd7e8155490 2023-11-27T20:44:20.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7ecab3640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd7e80c1500 0x7fd7e80a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39534/0 (socket says 172.21.15.91:39534) 2023-11-27T20:44:20.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7ecab3640 1 -- 172.21.15.91:0/2712010947 learned_addr learned my addr 172.21.15.91:0/2712010947 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:20.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7edab5640 1 --2- 172.21.15.91:0/2712010947 >> v2:172.21.15.183:3300/0 conn(0x7fd7e80a9b40 0x7fd7e80c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7ed2b4640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e8155490 0x7fd7e80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46055205 0 0) 0x7fd7e80c06c0 con 0x7fd7e80c1500 2023-11-27T20:44:20.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.238+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d8003520 con 0x7fd7e80c1500 2023-11-27T20:44:20.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3433887507 0 0) 0x7fd7d8003520 con 0x7fd7e80c1500 2023-11-27T20:44:20.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e8155490 msgr2=0x7fd7e80a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:20.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e8155490 0x7fd7e80a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 >> v2:172.21.15.183:3300/0 conn(0x7fd7e80a9b40 msgr2=0x7fd7e80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:20.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 --2- 172.21.15.91:0/2712010947 >> v2:172.21.15.183:3300/0 conn(0x7fd7e80a9b40 0x7fd7e80c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80c0910 con 0x7fd7e80c1500 2023-11-27T20:44:20.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fd7d4001670 con 0x7fd7e80c1500 2023-11-27T20:44:20.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 >> v1:172.21.15.91:6789/0 conn(0x7fd7e80c1500 legacy=0x7fd7e80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 0x7fd7d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7d80047c0 0x7fd7d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e8155490 0x7fd7d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80c1020 con 0x7fd7d8003970 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d800b980 con 0x7fd7d80047c0 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d800bac0 con 0x7fd7e8155490 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.239+0000 7fd7ed2b4640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 0x7fd7d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.240+0000 7fd7ecab3640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7d80047c0 0x7fd7d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.240+0000 7fd7ed2b4640 1 -- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e8155490 msgr2=0x7fd7d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.240+0000 7fd7ed2b4640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e8155490 0x7fd7d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.240+0000 7fd7ed2b4640 1 -- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7d80047c0 msgr2=0x7fd7d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:20.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.240+0000 7fd7ed2b4640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7d80047c0 0x7fd7d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.240+0000 7fd7ed2b4640 1 -- 172.21.15.91:0/2712010947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8003520 con 0x7fd7d8003970 2023-11-27T20:44:20.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.240+0000 7fd7ecab3640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7d80047c0 0x7fd7d8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:20.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.241+0000 7fd7ed2b4640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 0x7fd7d8003d90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009fc0 tx=0x7fd7d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9582b01b97e75f5a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:20.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.241+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02cc60 con 0x7fd7d8003970 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.241+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc00f040 con 0x7fd7d8003970 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.241+0000 7fd7e7fff640 1 -- 172.21.15.91:0/2712010947 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc034440 con 0x7fd7d8003970 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.242+0000 7fd7ef518640 1 -- 172.21.15.91:0/2712010947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 msgr2=0x7fd7d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.242+0000 7fd7ef518640 1 --2- 172.21.15.91:0/2712010947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 0x7fd7d8003d90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009fc0 tx=0x7fd7d80057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.242+0000 7fd7edab5640 1 -- 172.21.15.91:0/2712010947 reap_dead start 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.242+0000 7fd7ef518640 1 -- 172.21.15.91:0/2712010947 shutdown_connections 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.242+0000 7fd7ef518640 1 -- 172.21.15.91:0/2712010947 >> 172.21.15.91:0/2712010947 conn(0x7fd7e806a500 msgr2=0x7fd7e806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.242+0000 7fd7ef518640 1 -- 172.21.15.91:0/2712010947 shutdown_connections 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.242+0000 7fd7ef518640 1 -- 172.21.15.91:0/2712010947 wait complete. 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.244+0000 7fd7ef518640 1 Processor -- start 2023-11-27T20:44:20.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.244+0000 7fd7ef518640 1 -- start start 2023-11-27T20:44:20.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ef518640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 0x7fd7e809de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ef518640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e809e880 0x7fd7e806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ef518640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e81506d0 0x7fd7e80bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ef518640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e809f1a0 con 0x7fd7d8003970 2023-11-27T20:44:20.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ef518640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80c03c0 con 0x7fd7e809e880 2023-11-27T20:44:20.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ef518640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e809edf0 con 0x7fd7e81506d0 2023-11-27T20:44:20.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ed2b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 0x7fd7e809de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ed2b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 0x7fd7e809de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36150/0 (socket says 172.21.15.91:36150) 2023-11-27T20:44:20.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ed2b4640 1 -- 172.21.15.91:0/4011816117 learned_addr learned my addr 172.21.15.91:0/4011816117 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:20.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ed2b4640 1 -- 172.21.15.91:0/4011816117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e81506d0 msgr2=0x7fd7e80bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ed2b4640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e81506d0 0x7fd7e80bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ed2b4640 1 -- 172.21.15.91:0/4011816117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e809e880 msgr2=0x7fd7e806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ecab3640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e809e880 0x7fd7e806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ed2b4640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e809e880 0x7fd7e806fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ed2b4640 1 -- 172.21.15.91:0/4011816117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e81ee080 con 0x7fd7d8003970 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.245+0000 7fd7ecab3640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e809e880 0x7fd7e806fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.246+0000 7fd7ed2b4640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 0x7fd7e809de70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc037040 tx=0x7fd7dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.246+0000 7fd7e5ffb640 1 -- 172.21.15.91:0/4011816117 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc034cd0 con 0x7fd7d8003970 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.246+0000 7fd7e5ffb640 1 -- 172.21.15.91:0/4011816117 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc034e30 con 0x7fd7d8003970 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.246+0000 7fd7ef518640 1 -- 172.21.15.91:0/4011816117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e81edda0 con 0x7fd7d8003970 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.246+0000 7fd7e5ffb640 1 -- 172.21.15.91:0/4011816117 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc040670 con 0x7fd7d8003970 2023-11-27T20:44:20.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.246+0000 7fd7ef518640 1 -- 172.21.15.91:0/4011816117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e8150b50 con 0x7fd7d8003970 2023-11-27T20:44:20.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.247+0000 7fd7ef518640 1 -- 172.21.15.91:0/4011816117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e8068350 con 0x7fd7d8003970 2023-11-27T20:44:20.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.248+0000 7fd7e5ffb640 1 -- 172.21.15.91:0/4011816117 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd7dc0407d0 con 0x7fd7d8003970 2023-11-27T20:44:20.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.249+0000 7fd7e5ffb640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7cc06b1f0 0x7fd7cc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.249+0000 7fd7e5ffb640 1 -- 172.21.15.91:0/4011816117 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fd7dc0ac680 con 0x7fd7d8003970 2023-11-27T20:44:20.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.249+0000 7fd7ecab3640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7cc06b1f0 0x7fd7cc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.250+0000 7fd7ecab3640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7cc06b1f0 0x7fd7cc06d6b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40017a0 tx=0x7fd7d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:20.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.254+0000 7fd7e5ffb640 1 -- 172.21.15.91:0/4011816117 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd7dc077130 con 0x7fd7d8003970 2023-11-27T20:44:20.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.435+0000 7fd7ef518640 1 -- 172.21.15.91:0/4011816117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd7e809e660 con 0x7fd7d8003970 2023-11-27T20:44:20.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.436+0000 7fd7e5ffb640 1 -- 172.21.15.91:0/4011816117 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7dc07a750 con 0x7fd7d8003970 2023-11-27T20:44:20.437 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:44:20.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 -- 172.21.15.91:0/4011816117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7cc06b1f0 msgr2=0x7fd7cc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7cc06b1f0 0x7fd7cc06d6b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40017a0 tx=0x7fd7d4009040 comp rx=0 tx=0).stop 2023-11-27T20:44:20.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 -- 172.21.15.91:0/4011816117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 msgr2=0x7fd7e809de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 0x7fd7e809de70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc037040 tx=0x7fd7dc009750 comp rx=0 tx=0).stop 2023-11-27T20:44:20.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 -- 172.21.15.91:0/4011816117 shutdown_connections 2023-11-27T20:44:20.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7e81506d0 0x7fd7e80bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd7cc06b1f0 0x7fd7cc06d6b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e809e880 0x7fd7e806fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 --2- 172.21.15.91:0/4011816117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7d8003970 0x7fd7e809de70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 -- 172.21.15.91:0/4011816117 >> 172.21.15.91:0/4011816117 conn(0x7fd7e806a500 msgr2=0x7fd7e81546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:20.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 -- 172.21.15.91:0/4011816117 shutdown_connections 2023-11-27T20:44:20.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.438+0000 7fd7ef518640 1 -- 172.21.15.91:0/4011816117 wait complete. 2023-11-27T20:44:20.457 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:44:20.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.668+0000 7f4953848640 1 Processor -- start 2023-11-27T20:44:20.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.668+0000 7f4953848640 1 -- start start 2023-11-27T20:44:20.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.669+0000 7f4953848640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f494c152f20 0x7f494c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.669+0000 7f4953848640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c0c64a0 con 0x7f494c14fd30 2023-11-27T20:44:20.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.669+0000 7f4953848640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c0c5c00 con 0x7f494c06d0a0 2023-11-27T20:44:20.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.669+0000 7f4953848640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c0c5ee0 con 0x7f494c152f20 2023-11-27T20:44:20.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f49515e4640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f494c14fd30 0x7f494c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39536/0 (socket says 172.21.15.91:39536) 2023-11-27T20:44:20.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f49515e4640 1 -- 172.21.15.91:0/1841428449 learned_addr learned my addr 172.21.15.91:0/1841428449 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:20.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615982216 0 0) 0x7f494c0c64a0 con 0x7f494c14fd30 2023-11-27T20:44:20.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4938003520 con 0x7f494c14fd30 2023-11-27T20:44:20.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f4951de5640 1 --2- 172.21.15.91:0/1841428449 >> v2:172.21.15.183:3300/0 conn(0x7f494c152f20 0x7f494c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2077570887 0 0) 0x7f4938003520 con 0x7f494c14fd30 2023-11-27T20:44:20.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 >> v2:172.21.15.183:3300/0 conn(0x7f494c152f20 msgr2=0x7f494c0c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:20.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f4943fff640 1 --2- 172.21.15.91:0/1841428449 >> v2:172.21.15.183:3300/0 conn(0x7f494c152f20 0x7f494c0c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 >> v1:172.21.15.183:6789/0 conn(0x7f494c06d0a0 legacy=0x7f494c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:20.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0c61c0 con 0x7f494c14fd30 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f4948001670 con 0x7f494c14fd30 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.670+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 >> v1:172.21.15.91:6789/0 conn(0x7f494c14fd30 legacy=0x7f494c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4943fff640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4938003970 0x7f4938003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4943fff640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49380047c0 0x7f4938004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4943fff640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f493800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0c5ee0 con 0x7f4938005180 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493800c0b0 con 0x7f4938003970 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493800c270 con 0x7f49380047c0 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4951de5640 1 --2- 172.21.15.91:0/1841428449 >> v2:172.21.15.183:3300/0 conn(0x7f494c152f20 0x7f494c0c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4951de5640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f493800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f49515e4640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4938003970 0x7f4938003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4951de5640 1 -- 172.21.15.91:0/1841428449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49380047c0 msgr2=0x7f4938004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:20.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4951de5640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49380047c0 0x7f4938004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4951de5640 1 -- 172.21.15.91:0/1841428449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4938003970 msgr2=0x7f4938003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:20.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4951de5640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4938003970 0x7f4938003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f4951de5640 1 -- 172.21.15.91:0/1841428449 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938003520 con 0x7f4938005180 2023-11-27T20:44:20.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.671+0000 7f49515e4640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4938003970 0x7f4938003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:20.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.672+0000 7f4951de5640 1 -- 172.21.15.91:0/1841428449 reap_dead start 2023-11-27T20:44:20.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.672+0000 7f4951de5640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f493800b980 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f49440073b0 tx=0x7f49380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781c3631a7e503e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:20.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.673+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494402cd90 con 0x7f4938005180 2023-11-27T20:44:20.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.673+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4944034440 con 0x7f4938005180 2023-11-27T20:44:20.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.673+0000 7f4943fff640 1 -- 172.21.15.91:0/1841428449 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49440347d0 con 0x7f4938005180 2023-11-27T20:44:20.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.673+0000 7f4953848640 1 -- 172.21.15.91:0/1841428449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 msgr2=0x7f493800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.673+0000 7f4953848640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f493800b980 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f49440073b0 tx=0x7f49380057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.673+0000 7f4953848640 1 -- 172.21.15.91:0/1841428449 shutdown_connections 2023-11-27T20:44:20.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.673+0000 7f4953848640 1 --2- 172.21.15.91:0/1841428449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f493800b980 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.673+0000 7f4953848640 1 -- 172.21.15.91:0/1841428449 >> 172.21.15.91:0/1841428449 conn(0x7f494c06a500 msgr2=0x7f494c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:20.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.673+0000 7f4953848640 1 -- 172.21.15.91:0/1841428449 shutdown_connections 2023-11-27T20:44:20.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.673+0000 7f4953848640 1 -- 172.21.15.91:0/1841428449 wait complete. 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.675+0000 7f4953848640 1 Processor -- start 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.675+0000 7f4953848640 1 -- start start 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.676+0000 7f4953848640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f494c0c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.676+0000 7f4953848640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f494c14d160 0x7f494c144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.676+0000 7f4953848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f494c14d6b0 0x7f494c1453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.676+0000 7f4953848640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0a75b0 con 0x7f4938005180 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.676+0000 7f4953848640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1ed580 con 0x7f494c14d160 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.676+0000 7f4953848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1ed860 con 0x7f494c14d6b0 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.676+0000 7f49515e4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f494c0c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.676+0000 7f49515e4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f494c0c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36162/0 (socket says 172.21.15.91:36162) 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.676+0000 7f49515e4640 1 -- 172.21.15.91:0/4138782531 learned_addr learned my addr 172.21.15.91:0/4138782531 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f49515e4640 1 -- 172.21.15.91:0/4138782531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f494c14d6b0 msgr2=0x7f494c1453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f49515e4640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f494c14d6b0 0x7f494c1453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f4950de3640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f494c14d160 0x7f494c144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f49515e4640 1 -- 172.21.15.91:0/4138782531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f494c14d160 msgr2=0x7f494c144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f49515e4640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f494c14d160 0x7f494c144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f49515e4640 1 -- 172.21.15.91:0/4138782531 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c1edb40 con 0x7f4938005180 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f4950de3640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f494c14d160 0x7f494c144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f49515e4640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f494c0c2820 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f49480018e0 tx=0x7f494800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f4941ffb640 1 -- 172.21.15.91:0/4138782531 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49480074e0 con 0x7f4938005180 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f4941ffb640 1 -- 172.21.15.91:0/4138782531 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4948007640 con 0x7f4938005180 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f4941ffb640 1 -- 172.21.15.91:0/4138782531 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948004a00 con 0x7f4938005180 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.677+0000 7f4953848640 1 -- 172.21.15.91:0/4138782531 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c1ede20 con 0x7f4938005180 2023-11-27T20:44:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.678+0000 7f4953848640 1 -- 172.21.15.91:0/4138782531 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c0a82b0 con 0x7f4938005180 2023-11-27T20:44:20.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.679+0000 7f4953848640 1 -- 172.21.15.91:0/4138782531 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c068350 con 0x7f4938005180 2023-11-27T20:44:20.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.679+0000 7f4941ffb640 1 -- 172.21.15.91:0/4138782531 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4948004b60 con 0x7f4938005180 2023-11-27T20:44:20.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.680+0000 7f4941ffb640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1f0 0x7f493006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:20.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.680+0000 7f4941ffb640 1 -- 172.21.15.91:0/4138782531 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f4948089690 con 0x7f4938005180 2023-11-27T20:44:20.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.681+0000 7f4950de3640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1f0 0x7f493006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:20.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.681+0000 7f4950de3640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1f0 0x7f493006d6b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f494c14f250 tx=0x7f493c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:20.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.685+0000 7f4941ffb640 1 -- 172.21.15.91:0/4138782531 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f49480540c0 con 0x7f4938005180 2023-11-27T20:44:20.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.862+0000 7f4953848640 1 -- 172.21.15.91:0/4138782531 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f494c0a4cc0 con 0x7f4938005180 2023-11-27T20:44:20.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.863+0000 7f4941ffb640 1 -- 172.21.15.91:0/4138782531 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49480576e0 con 0x7f4938005180 2023-11-27T20:44:20.864 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:44:20.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 -- 172.21.15.91:0/4138782531 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1f0 msgr2=0x7f493006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1f0 0x7f493006d6b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f494c14f250 tx=0x7f493c009040 comp rx=0 tx=0).stop 2023-11-27T20:44:20.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 -- 172.21.15.91:0/4138782531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 msgr2=0x7f494c0c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:20.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f494c0c2820 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f49480018e0 tx=0x7f494800dd20 comp rx=0 tx=0).stop 2023-11-27T20:44:20.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 -- 172.21.15.91:0/4138782531 shutdown_connections 2023-11-27T20:44:20.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f494c14d6b0 0x7f494c1453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1f0 0x7f493006d6b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f494c14d160 0x7f494c144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 --2- 172.21.15.91:0/4138782531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4938005180 0x7f494c0c2820 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:20.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 -- 172.21.15.91:0/4138782531 >> 172.21.15.91:0/4138782531 conn(0x7f494c06a500 msgr2=0x7f494c06fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:20.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.865+0000 7f4953848640 1 -- 172.21.15.91:0/4138782531 shutdown_connections 2023-11-27T20:44:20.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:20.866+0000 7f4953848640 1 -- 172.21.15.91:0/4138782531 wait complete. 2023-11-27T20:44:20.884 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:44:21.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.092+0000 7fd01f490640 1 Processor -- start 2023-11-27T20:44:21.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.092+0000 7fd01f490640 1 -- start start 2023-11-27T20:44:21.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.093+0000 7fd01f490640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd0180c5ec0 0x7fd0180c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.093+0000 7fd01f490640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0180c45d0 0x7fd0180c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.094+0000 7fd01f490640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0180bfdc0 con 0x7fd0180721a0 2023-11-27T20:44:21.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.094+0000 7fd01f490640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01806e390 con 0x7fd0180c45d0 2023-11-27T20:44:21.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.094+0000 7fd01f490640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01806ddd0 con 0x7fd0180c5ec0 2023-11-27T20:44:21.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.094+0000 7fd01ca2b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0180c45d0 0x7fd0180c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.094+0000 7fd01ca2b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0180c45d0 0x7fd0180c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36164/0 (socket says 172.21.15.91:36164) 2023-11-27T20:44:21.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.094+0000 7fd01ca2b640 1 -- 172.21.15.91:0/3885667712 learned_addr learned my addr 172.21.15.91:0/3885667712 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:21.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.094+0000 7fd01d22c640 1 --2- 172.21.15.91:0/3885667712 >> v2:172.21.15.183:3300/0 conn(0x7fd0180c5ec0 0x7fd0180c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.094+0000 7fd01ca2b640 1 -- 172.21.15.91:0/3885667712 >> v2:172.21.15.183:3300/0 conn(0x7fd0180c5ec0 msgr2=0x7fd0180c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:21.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.094+0000 7fd01ca2b640 1 --2- 172.21.15.91:0/3885667712 >> v2:172.21.15.183:3300/0 conn(0x7fd0180c5ec0 0x7fd0180c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.094+0000 7fd01ca2b640 1 -- 172.21.15.91:0/3885667712 >> v1:172.21.15.183:6789/0 conn(0x7fd0180721a0 legacy=0x7fd018155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:21.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.095+0000 7fd01ca2b640 1 -- 172.21.15.91:0/3885667712 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01806e0b0 con 0x7fd0180c45d0 2023-11-27T20:44:21.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.096+0000 7fd01ca2b640 1 --2- 172.21.15.91:0/3885667712 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 0x7fd0180c3170 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd01806b250 tx=0x7fd00802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9903c740aa10444a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:21.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.096+0000 7fd00ffff640 1 -- 172.21.15.91:0/3885667712 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008031750 con 0x7fd0180c45d0 2023-11-27T20:44:21.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.096+0000 7fd00ffff640 1 -- 172.21.15.91:0/3885667712 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0080318b0 con 0x7fd0180c45d0 2023-11-27T20:44:21.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.096+0000 7fd00ffff640 1 -- 172.21.15.91:0/3885667712 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008031c40 con 0x7fd0180c45d0 2023-11-27T20:44:21.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.097+0000 7fd01f490640 1 -- 172.21.15.91:0/3885667712 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 msgr2=0x7fd0180c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.097+0000 7fd01f490640 1 --2- 172.21.15.91:0/3885667712 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 0x7fd0180c3170 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd01806b250 tx=0x7fd00802b7f0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.097+0000 7fd01f490640 1 -- 172.21.15.91:0/3885667712 shutdown_connections 2023-11-27T20:44:21.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.097+0000 7fd01f490640 1 --2- 172.21.15.91:0/3885667712 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 0x7fd0180c3170 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.097+0000 7fd01f490640 1 --2- 172.21.15.91:0/3885667712 >> v2:172.21.15.183:3300/0 conn(0x7fd0180c5ec0 0x7fd0180c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.097+0000 7fd01f490640 1 -- 172.21.15.91:0/3885667712 >> 172.21.15.91:0/3885667712 conn(0x7fd01806a500 msgr2=0x7fd01806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:21.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.097+0000 7fd01f490640 1 -- 172.21.15.91:0/3885667712 shutdown_connections 2023-11-27T20:44:21.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.097+0000 7fd01f490640 1 -- 172.21.15.91:0/3885667712 wait complete. 2023-11-27T20:44:21.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.099+0000 7fd01f490640 1 Processor -- start 2023-11-27T20:44:21.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.099+0000 7fd01f490640 1 -- start start 2023-11-27T20:44:21.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.099+0000 7fd01f490640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0180721a0 0x7fd018099b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.099+0000 7fd01f490640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 0x7fd0180a7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01f490640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0180c5ec0 0x7fd0181ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01f490640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180a72d0 con 0x7fd0180c45d0 2023-11-27T20:44:21.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01f490640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180a75b0 con 0x7fd0180c5ec0 2023-11-27T20:44:21.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01f490640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd018158ca0 con 0x7fd0180721a0 2023-11-27T20:44:21.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01ca2b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 0x7fd0180a7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01ca2b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 0x7fd0180a7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36178/0 (socket says 172.21.15.91:36178) 2023-11-27T20:44:21.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01ca2b640 1 -- 172.21.15.91:0/288874671 learned_addr learned my addr 172.21.15.91:0/288874671 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:21.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01ca2b640 1 -- 172.21.15.91:0/288874671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0180721a0 msgr2=0x7fd018099b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01ca2b640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0180721a0 0x7fd018099b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01ca2b640 1 -- 172.21.15.91:0/288874671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0180c5ec0 msgr2=0x7fd0181ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01da2d640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0180c5ec0 0x7fd0181ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01ca2b640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0180c5ec0 0x7fd0181ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01ca2b640 1 -- 172.21.15.91:0/288874671 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080094d0 con 0x7fd0180c45d0 2023-11-27T20:44:21.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.100+0000 7fd01da2d640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0180c5ec0 0x7fd0181ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:21.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.101+0000 7fd01ca2b640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 0x7fd0180a7a40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd00802b830 tx=0x7fd0080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:21.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.101+0000 7fd00dffb640 1 -- 172.21.15.91:0/288874671 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008033c80 con 0x7fd0180c45d0 2023-11-27T20:44:21.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.101+0000 7fd00dffb640 1 -- 172.21.15.91:0/288874671 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd008033de0 con 0x7fd0180c45d0 2023-11-27T20:44:21.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.101+0000 7fd00dffb640 1 -- 172.21.15.91:0/288874671 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00803c620 con 0x7fd0180c45d0 2023-11-27T20:44:21.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.101+0000 7fd01f490640 1 -- 172.21.15.91:0/288874671 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0181556d0 con 0x7fd0180c45d0 2023-11-27T20:44:21.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.101+0000 7fd01f490640 1 -- 172.21.15.91:0/288874671 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd018155c90 con 0x7fd0180c45d0 2023-11-27T20:44:21.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.102+0000 7fd01f490640 1 -- 172.21.15.91:0/288874671 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd018068350 con 0x7fd0180c45d0 2023-11-27T20:44:21.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.104+0000 7fd00dffb640 1 -- 172.21.15.91:0/288874671 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd00803a040 con 0x7fd0180c45d0 2023-11-27T20:44:21.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.104+0000 7fd00dffb640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcffc06b1c0 0x7fcffc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.105+0000 7fd00dffb640 1 -- 172.21.15.91:0/288874671 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fd0080aba10 con 0x7fd0180c45d0 2023-11-27T20:44:21.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.105+0000 7fd01d22c640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcffc06b1c0 0x7fcffc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.105+0000 7fd01d22c640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcffc06b1c0 0x7fcffc06d680 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd014006fd0 tx=0x7fd014008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:21.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.109+0000 7fd00dffb640 1 -- 172.21.15.91:0/288874671 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd0080763a0 con 0x7fd0180c45d0 2023-11-27T20:44:21.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.286+0000 7fd01f490640 1 -- 172.21.15.91:0/288874671 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0180a76f0 con 0x7fd0180c45d0 2023-11-27T20:44:21.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.287+0000 7fd00dffb640 1 -- 172.21.15.91:0/288874671 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v61) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd0080799c0 con 0x7fd0180c45d0 2023-11-27T20:44:21.288 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:44:21.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.289+0000 7fd01f490640 1 -- 172.21.15.91:0/288874671 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcffc06b1c0 msgr2=0x7fcffc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.289+0000 7fd01f490640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcffc06b1c0 0x7fcffc06d680 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd014006fd0 tx=0x7fd014008040 comp rx=0 tx=0).stop 2023-11-27T20:44:21.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.289+0000 7fd01f490640 1 -- 172.21.15.91:0/288874671 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 msgr2=0x7fd0180a7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.289+0000 7fd01f490640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 0x7fd0180a7a40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd00802b830 tx=0x7fd0080046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.289+0000 7fd01f490640 1 -- 172.21.15.91:0/288874671 shutdown_connections 2023-11-27T20:44:21.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.289+0000 7fd01f490640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcffc06b1c0 0x7fcffc06d680 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.290+0000 7fd01f490640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0180c5ec0 0x7fd0181ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.290+0000 7fd01f490640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0180c45d0 0x7fd0180a7a40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.290+0000 7fd01f490640 1 --2- 172.21.15.91:0/288874671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0180721a0 0x7fd018099b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.290+0000 7fd01f490640 1 -- 172.21.15.91:0/288874671 >> 172.21.15.91:0/288874671 conn(0x7fd01806a500 msgr2=0x7fd01806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:21.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.290+0000 7fd01f490640 1 -- 172.21.15.91:0/288874671 shutdown_connections 2023-11-27T20:44:21.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.290+0000 7fd01f490640 1 -- 172.21.15.91:0/288874671 wait complete. 2023-11-27T20:44:21.308 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:44:21.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.518+0000 7f99c9ca6640 1 Processor -- start 2023-11-27T20:44:21.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.518+0000 7f99c9ca6640 1 -- start start 2023-11-27T20:44:21.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.520+0000 7f99c9ca6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99c4073a00 0x7f99c406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.520+0000 7f99c9ca6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c406aa40 con 0x7f99c4158030 2023-11-27T20:44:21.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.520+0000 7f99c9ca6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c40c00d0 con 0x7f99c4157c50 2023-11-27T20:44:21.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.520+0000 7f99c9ca6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c40c1e00 con 0x7f99c4073a00 2023-11-27T20:44:21.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.520+0000 7f99c3fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f99c4158030 0x7f99c415efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39540/0 (socket says 172.21.15.91:39540) 2023-11-27T20:44:21.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.520+0000 7f99c3fff640 1 -- 172.21.15.91:0/1215259723 learned_addr learned my addr 172.21.15.91:0/1215259723 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:21.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.520+0000 7f99baffd640 1 --2- 172.21.15.91:0/1215259723 >> v2:172.21.15.183:3300/0 conn(0x7f99c4073a00 0x7f99c406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.520+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688545756 0 0) 0x7f99c406aa40 con 0x7f99c4158030 2023-11-27T20:44:21.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b0003520 con 0x7f99c4158030 2023-11-27T20:44:21.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210691385 0 0) 0x7f99b0003520 con 0x7f99c4158030 2023-11-27T20:44:21.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 >> v2:172.21.15.183:3300/0 conn(0x7f99c4073a00 msgr2=0x7f99c406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:21.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 --2- 172.21.15.91:0/1215259723 >> v2:172.21.15.183:3300/0 conn(0x7f99c4073a00 0x7f99c406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 >> v1:172.21.15.183:6789/0 conn(0x7f99c4157c50 legacy=0x7f99c40c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c40bfa80 con 0x7f99c4158030 2023-11-27T20:44:21.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f99bc001670 con 0x7f99c4158030 2023-11-27T20:44:21.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 >> v1:172.21.15.91:6789/0 conn(0x7f99c4158030 legacy=0x7f99c415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b0003970 0x7f99b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b00047c0 0x7f99b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b0005180 0x7f99b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40c1e00 con 0x7f99b00047c0 2023-11-27T20:44:21.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b000c020 con 0x7f99b0005180 2023-11-27T20:44:21.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b000c1e0 con 0x7f99b0003970 2023-11-27T20:44:21.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.521+0000 7f99baffd640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b00047c0 0x7f99b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.522+0000 7f99c3fff640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b0005180 0x7f99b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.522+0000 7f99baffd640 1 -- 172.21.15.91:0/1215259723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b0003970 msgr2=0x7f99b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:21.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.522+0000 7f99baffd640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b0003970 0x7f99b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.522+0000 7f99baffd640 1 -- 172.21.15.91:0/1215259723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b0005180 msgr2=0x7f99b000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:21.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.522+0000 7f99baffd640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b0005180 0x7f99b000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.522+0000 7f99baffd640 1 -- 172.21.15.91:0/1215259723 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0003520 con 0x7f99b00047c0 2023-11-27T20:44:21.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.522+0000 7f99c3fff640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b0005180 0x7f99b000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:21.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.522+0000 7f99c3fff640 1 -- 172.21.15.91:0/1215259723 reap_dead start 2023-11-27T20:44:21.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.523+0000 7f99baffd640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b00047c0 0x7f99b0004c40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009a90 tx=0x7f99b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553a68738656a9e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:21.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.523+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac02c680 con 0x7f99b00047c0 2023-11-27T20:44:21.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.523+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac02c7e0 con 0x7f99b00047c0 2023-11-27T20:44:21.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.523+0000 7f99c2ffd640 1 -- 172.21.15.91:0/1215259723 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac02cb70 con 0x7f99b00047c0 2023-11-27T20:44:21.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.524+0000 7f99c9ca6640 1 -- 172.21.15.91:0/1215259723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b00047c0 msgr2=0x7f99b0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.524+0000 7f99c9ca6640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b00047c0 0x7f99b0004c40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009a90 tx=0x7f99b00057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.524+0000 7f99c9ca6640 1 -- 172.21.15.91:0/1215259723 shutdown_connections 2023-11-27T20:44:21.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.524+0000 7f99c9ca6640 1 --2- 172.21.15.91:0/1215259723 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99b00047c0 0x7f99b0004c40 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.524+0000 7f99c9ca6640 1 -- 172.21.15.91:0/1215259723 >> 172.21.15.91:0/1215259723 conn(0x7f99c40c30b0 msgr2=0x7f99c40c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:21.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.524+0000 7f99c9ca6640 1 -- 172.21.15.91:0/1215259723 shutdown_connections 2023-11-27T20:44:21.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.524+0000 7f99c9ca6640 1 -- 172.21.15.91:0/1215259723 wait complete. 2023-11-27T20:44:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.526+0000 7f99c9ca6640 1 Processor -- start 2023-11-27T20:44:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.526+0000 7f99c9ca6640 1 -- start start 2023-11-27T20:44:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.526+0000 7f99c9ca6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b00047c0 0x7f99c41ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99c9ca6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99c4151790 0x7f99c4149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99c9ca6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c41ede30 0x7f99c41498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99c9ca6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c41ee650 con 0x7f99c4151790 2023-11-27T20:44:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99c9ca6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c4151e70 con 0x7f99b00047c0 2023-11-27T20:44:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99c9ca6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40abea0 con 0x7f99c41ede30 2023-11-27T20:44:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99baffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99c4151790 0x7f99c4149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99baffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99c4151790 0x7f99c4149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36198/0 (socket says 172.21.15.91:36198) 2023-11-27T20:44:21.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99baffd640 1 -- 172.21.15.91:0/555821559 learned_addr learned my addr 172.21.15.91:0/555821559 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:21.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99baffd640 1 -- 172.21.15.91:0/555821559 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c41ede30 msgr2=0x7f99c41498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99baffd640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c41ede30 0x7f99c41498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99baffd640 1 -- 172.21.15.91:0/555821559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b00047c0 msgr2=0x7f99c41ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99baffd640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b00047c0 0x7f99c41ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.527+0000 7f99baffd640 1 -- 172.21.15.91:0/555821559 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c40ab160 con 0x7f99c4151790 2023-11-27T20:44:21.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.528+0000 7f99baffd640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99c4151790 0x7f99c4149360 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f99ac037040 tx=0x7f99ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.528+0000 7f99c0ff9640 1 -- 172.21.15.91:0/555821559 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac003810 con 0x7f99c4151790 2023-11-27T20:44:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.528+0000 7f99c0ff9640 1 -- 172.21.15.91:0/555821559 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac003970 con 0x7f99c4151790 2023-11-27T20:44:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.528+0000 7f99c9ca6640 1 -- 172.21.15.91:0/555821559 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c41520c0 con 0x7f99c4151790 2023-11-27T20:44:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.528+0000 7f99c0ff9640 1 -- 172.21.15.91:0/555821559 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac003d20 con 0x7f99c4151790 2023-11-27T20:44:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.528+0000 7f99c9ca6640 1 -- 172.21.15.91:0/555821559 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c40ac380 con 0x7f99c4151790 2023-11-27T20:44:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.529+0000 7f99c9ca6640 1 -- 172.21.15.91:0/555821559 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c4066b40 con 0x7f99c4151790 2023-11-27T20:44:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.530+0000 7f99c0ff9640 1 -- 172.21.15.91:0/555821559 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f99ac034440 con 0x7f99c4151790 2023-11-27T20:44:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.531+0000 7f99c0ff9640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99a406b1c0 0x7f99a406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.531+0000 7f99c0ff9640 1 -- 172.21.15.91:0/555821559 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f99ac0abd30 con 0x7f99c4151790 2023-11-27T20:44:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.531+0000 7f99c37fe640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99a406b1c0 0x7f99a406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.532+0000 7f99c37fe640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99a406b1c0 0x7f99a406d680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f99b4001cb0 tx=0x7f99b4007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.535+0000 7f99c0ff9640 1 -- 172.21.15.91:0/555821559 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f99ac07a320 con 0x7f99c4151790 2023-11-27T20:44:21.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.725+0000 7f99c9ca6640 1 -- 172.21.15.91:0/555821559 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f99c40abd00 con 0x7f99c4151790 2023-11-27T20:44:21.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.726+0000 7f99c0ff9640 1 -- 172.21.15.91:0/555821559 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v61) v1 ==== 101+0+11 (secure 0 0 0) 0x7f99c40abd00 con 0x7f99c4151790 2023-11-27T20:44:21.728 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:44:21.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 -- 172.21.15.91:0/555821559 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99a406b1c0 msgr2=0x7f99a406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99a406b1c0 0x7f99a406d680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f99b4001cb0 tx=0x7f99b4007d30 comp rx=0 tx=0).stop 2023-11-27T20:44:21.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 -- 172.21.15.91:0/555821559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99c4151790 msgr2=0x7f99c4149360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99c4151790 0x7f99c4149360 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f99ac037040 tx=0x7f99ac004730 comp rx=0 tx=0).stop 2023-11-27T20:44:21.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 -- 172.21.15.91:0/555821559 shutdown_connections 2023-11-27T20:44:21.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c41ede30 0x7f99c41498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99c4151790 0x7f99c4149360 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99a406b1c0 0x7f99a406d680 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 --2- 172.21.15.91:0/555821559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b00047c0 0x7f99c41ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 -- 172.21.15.91:0/555821559 >> 172.21.15.91:0/555821559 conn(0x7f99c40c30b0 msgr2=0x7f99c41566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:21.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 -- 172.21.15.91:0/555821559 shutdown_connections 2023-11-27T20:44:21.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.729+0000 7f99c9ca6640 1 -- 172.21.15.91:0/555821559 wait complete. 2023-11-27T20:44:21.750 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:44:21.918 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:21.928 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:21.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.947+0000 7fdcccb00640 1 Processor -- start 2023-11-27T20:44:21.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.948+0000 7fdcccb00640 1 -- start start 2023-11-27T20:44:21.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.949+0000 7fdcccb00640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdcc80c5ec0 0x7fdcc80c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.949+0000 7fdcccb00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 0x7fdcc80c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.949+0000 7fdcccb00640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc80bfdc0 con 0x7fdcc80721a0 2023-11-27T20:44:21.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.949+0000 7fdcccb00640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc806e390 con 0x7fdcc80c5ec0 2023-11-27T20:44:21.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.949+0000 7fdcccb00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc806ddd0 con 0x7fdcc80c45d0 2023-11-27T20:44:21.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.949+0000 7fdcbffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 0x7fdcc80c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.949+0000 7fdcbffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 0x7fdcc80c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:52586/0 (socket says 172.21.15.91:52586) 2023-11-27T20:44:21.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.949+0000 7fdcbffff640 1 -- 172.21.15.91:0/1800124802 learned_addr learned my addr 172.21.15.91:0/1800124802 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:21.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.949+0000 7fdcc659c640 1 --2- 172.21.15.91:0/1800124802 >> v2:172.21.15.183:3300/0 conn(0x7fdcc80c5ec0 0x7fdcc80c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.950+0000 7fdcbffff640 1 -- 172.21.15.91:0/1800124802 >> v2:172.21.15.183:3300/0 conn(0x7fdcc80c5ec0 msgr2=0x7fdcc80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:21.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.950+0000 7fdcbffff640 1 --2- 172.21.15.91:0/1800124802 >> v2:172.21.15.183:3300/0 conn(0x7fdcc80c5ec0 0x7fdcc80c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.950+0000 7fdcbffff640 1 -- 172.21.15.91:0/1800124802 >> v1:172.21.15.183:6789/0 conn(0x7fdcc80721a0 legacy=0x7fdcc8155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.950+0000 7fdcbffff640 1 -- 172.21.15.91:0/1800124802 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc806e0b0 con 0x7fdcc80c45d0 2023-11-27T20:44:21.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.951+0000 7fdcbffff640 1 --2- 172.21.15.91:0/1800124802 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 0x7fdcc80c3170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009870 tx=0x7fdcb002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8439f7b5e285ce23 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:21.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.952+0000 7fdcc5d9b640 1 -- 172.21.15.91:0/1800124802 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00317c0 con 0x7fdcc80c45d0 2023-11-27T20:44:21.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.952+0000 7fdcc5d9b640 1 -- 172.21.15.91:0/1800124802 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb0031920 con 0x7fdcc80c45d0 2023-11-27T20:44:21.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.952+0000 7fdcc5d9b640 1 -- 172.21.15.91:0/1800124802 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0031cb0 con 0x7fdcc80c45d0 2023-11-27T20:44:21.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.952+0000 7fdcccb00640 1 -- 172.21.15.91:0/1800124802 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 msgr2=0x7fdcc80c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.952+0000 7fdcccb00640 1 --2- 172.21.15.91:0/1800124802 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 0x7fdcc80c3170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009870 tx=0x7fdcb002b860 comp rx=0 tx=0).stop 2023-11-27T20:44:21.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.952+0000 7fdcccb00640 1 -- 172.21.15.91:0/1800124802 shutdown_connections 2023-11-27T20:44:21.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.952+0000 7fdcccb00640 1 --2- 172.21.15.91:0/1800124802 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 0x7fdcc80c3170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.952+0000 7fdcccb00640 1 --2- 172.21.15.91:0/1800124802 >> v2:172.21.15.183:3300/0 conn(0x7fdcc80c5ec0 0x7fdcc80c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.952+0000 7fdcccb00640 1 -- 172.21.15.91:0/1800124802 >> 172.21.15.91:0/1800124802 conn(0x7fdcc806a500 msgr2=0x7fdcc806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:21.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.953+0000 7fdcccb00640 1 -- 172.21.15.91:0/1800124802 shutdown_connections 2023-11-27T20:44:21.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.953+0000 7fdcccb00640 1 -- 172.21.15.91:0/1800124802 wait complete. 2023-11-27T20:44:21.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.954+0000 7fdcccb00640 1 Processor -- start 2023-11-27T20:44:21.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.954+0000 7fdcccb00640 1 -- start start 2023-11-27T20:44:21.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.955+0000 7fdcccb00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc80721a0 0x7fdcc81576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.955+0000 7fdcccb00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 0x7fdcc80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.955+0000 7fdcccb00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcc80c5ec0 0x7fdcc80a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.955+0000 7fdcccb00640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc8099e30 con 0x7fdcc80721a0 2023-11-27T20:44:21.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.955+0000 7fdcccb00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc809a240 con 0x7fdcc80c5ec0 2023-11-27T20:44:21.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.955+0000 7fdcccb00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc81eb210 con 0x7fdcc80c45d0 2023-11-27T20:44:21.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcc659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc80721a0 0x7fdcc81576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcc659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc80721a0 0x7fdcc81576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36208/0 (socket says 172.21.15.91:36208) 2023-11-27T20:44:21.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcc659c640 1 -- 172.21.15.91:0/3211067348 learned_addr learned my addr 172.21.15.91:0/3211067348 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:21.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcbffff640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 0x7fdcc80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcc6d9d640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcc80c5ec0 0x7fdcc80a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcc659c640 1 -- 172.21.15.91:0/3211067348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 msgr2=0x7fdcc80a3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcc659c640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 0x7fdcc80a3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcc659c640 1 -- 172.21.15.91:0/3211067348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcc80c5ec0 msgr2=0x7fdcc80a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:21.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcc659c640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcc80c5ec0 0x7fdcc80a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:21.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcc659c640 1 -- 172.21.15.91:0/3211067348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb00094d0 con 0x7fdcc80721a0 2023-11-27T20:44:21.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.956+0000 7fdcc659c640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc80721a0 0x7fdcc81576a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800e870 tx=0x7fdcb800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:21.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.957+0000 7fdcbeffd640 1 -- 172.21.15.91:0/3211067348 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80094f0 con 0x7fdcc80721a0 2023-11-27T20:44:21.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.957+0000 7fdcbeffd640 1 -- 172.21.15.91:0/3211067348 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb800c940 con 0x7fdcc80721a0 2023-11-27T20:44:21.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.957+0000 7fdcbeffd640 1 -- 172.21.15.91:0/3211067348 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800ccf0 con 0x7fdcc80721a0 2023-11-27T20:44:21.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.957+0000 7fdcccb00640 1 -- 172.21.15.91:0/3211067348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc8150670 con 0x7fdcc80721a0 2023-11-27T20:44:21.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.957+0000 7fdcccb00640 1 -- 172.21.15.91:0/3211067348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc8099b90 con 0x7fdcc80721a0 2023-11-27T20:44:21.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.958+0000 7fdcccb00640 1 -- 172.21.15.91:0/3211067348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc81eafe0 con 0x7fdcc80721a0 2023-11-27T20:44:21.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.959+0000 7fdcbeffd640 1 -- 172.21.15.91:0/3211067348 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdcb8013470 con 0x7fdcc80721a0 2023-11-27T20:44:21.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.960+0000 7fdcbeffd640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdca806b1c0 0x7fdca806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:21.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.960+0000 7fdcbeffd640 1 -- 172.21.15.91:0/3211067348 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fdcb8089ee0 con 0x7fdcc80721a0 2023-11-27T20:44:21.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.960+0000 7fdcbffff640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdca806b1c0 0x7fdca806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:21.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.961+0000 7fdcbffff640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdca806b1c0 0x7fdca806d680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0036000 tx=0x7fdcb003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:21.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:21.965+0000 7fdcbeffd640 1 -- 172.21.15.91:0/3211067348 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdcc81eafe0 con 0x7fdcc80721a0 2023-11-27T20:44:22.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.167+0000 7fdcccb00640 1 -- 172.21.15.91:0/3211067348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdcc81eafe0 con 0x7fdcc80721a0 2023-11-27T20:44:22.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.168+0000 7fdcbeffd640 1 -- 172.21.15.91:0/3211067348 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdcc81eafe0 con 0x7fdcc80721a0 2023-11-27T20:44:22.169 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:44:22.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.170+0000 7fdcccb00640 1 -- 172.21.15.91:0/3211067348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdca806b1c0 msgr2=0x7fdca806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:22.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.170+0000 7fdcccb00640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdca806b1c0 0x7fdca806d680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0036000 tx=0x7fdcb003d040 comp rx=0 tx=0).stop 2023-11-27T20:44:22.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.170+0000 7fdcccb00640 1 -- 172.21.15.91:0/3211067348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc80721a0 msgr2=0x7fdcc81576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:22.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.170+0000 7fdcccb00640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc80721a0 0x7fdcc81576a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800e870 tx=0x7fdcb800ed30 comp rx=0 tx=0).stop 2023-11-27T20:44:22.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.171+0000 7fdcccb00640 1 -- 172.21.15.91:0/3211067348 shutdown_connections 2023-11-27T20:44:22.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.171+0000 7fdcccb00640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdca806b1c0 0x7fdca806d680 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.171+0000 7fdcccb00640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcc80c5ec0 0x7fdcc80a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.171+0000 7fdcccb00640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcc80c45d0 0x7fdcc80a3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.171+0000 7fdcccb00640 1 --2- 172.21.15.91:0/3211067348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc80721a0 0x7fdcc81576a0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.171+0000 7fdcccb00640 1 -- 172.21.15.91:0/3211067348 >> 172.21.15.91:0/3211067348 conn(0x7fdcc806a500 msgr2=0x7fdcc806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:22.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.171+0000 7fdcccb00640 1 -- 172.21.15.91:0/3211067348 shutdown_connections 2023-11-27T20:44:22.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.171+0000 7fdcccb00640 1 -- 172.21.15.91:0/3211067348 wait complete. 2023-11-27T20:44:22.191 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-27T20:44:22.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:22.191 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-27T20:44:22.311 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:44:22.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:22.311 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-27T20:44:22.366 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:44:22.366 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:22.417 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-27T20:44:22.417 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:44:22.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.633+0000 7fba07c9b640 1 Processor -- start 2023-11-27T20:44:22.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.633+0000 7fba07c9b640 1 -- start start 2023-11-27T20:44:22.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.634+0000 7fba07c9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fba000a9b40 0x7fba000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:22.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.634+0000 7fba07c9b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba000c06c0 con 0x7fba00155490 2023-11-27T20:44:22.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.634+0000 7fba07c9b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba000c1020 con 0x7fba000c1500 2023-11-27T20:44:22.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.634+0000 7fba07c9b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba000a5820 con 0x7fba000a9b40 2023-11-27T20:44:22.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.635+0000 7fba05a37640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fba00155490 0x7fba000a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39554/0 (socket says 172.21.15.91:39554) 2023-11-27T20:44:22.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.635+0000 7fba05a37640 1 -- 172.21.15.91:0/302179876 learned_addr learned my addr 172.21.15.91:0/302179876 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:22.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.635+0000 7fba05236640 1 --2- 172.21.15.91:0/302179876 >> v2:172.21.15.91:3300/0 conn(0x7fba000a9b40 0x7fba000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:22.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.635+0000 7fba04a35640 1 -- 172.21.15.91:0/302179876 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524913563 0 0) 0x7fba000c06c0 con 0x7fba00155490 2023-11-27T20:44:22.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.635+0000 7fba04a35640 1 -- 172.21.15.91:0/302179876 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e8005730 con 0x7fba00155490 2023-11-27T20:44:22.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.635+0000 7fba05236640 1 -- 172.21.15.91:0/302179876 >> v1:172.21.15.183:6789/0 conn(0x7fba000c1500 legacy=0x7fba000c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:22.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.635+0000 7fba05236640 1 -- 172.21.15.91:0/302179876 >> v1:172.21.15.91:6789/0 conn(0x7fba00155490 legacy=0x7fba000a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:22.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.635+0000 7fba05236640 1 -- 172.21.15.91:0/302179876 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000c0910 con 0x7fba000a9b40 2023-11-27T20:44:22.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.637+0000 7fba05236640 1 --2- 172.21.15.91:0/302179876 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba000a9b40 0x7fba000a51b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40097a0 tx=0x7fb9f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def29457140b1cf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:22.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.637+0000 7fba04a35640 1 -- 172.21.15.91:0/302179876 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4031830 con 0x7fba000a9b40 2023-11-27T20:44:22.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.637+0000 7fba04a35640 1 -- 172.21.15.91:0/302179876 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f4031990 con 0x7fba000a9b40 2023-11-27T20:44:22.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.637+0000 7fba04a35640 1 -- 172.21.15.91:0/302179876 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4031d20 con 0x7fba000a9b40 2023-11-27T20:44:22.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.637+0000 7fba07c9b640 1 -- 172.21.15.91:0/302179876 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba000a9b40 msgr2=0x7fba000a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:22.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.637+0000 7fba07c9b640 1 --2- 172.21.15.91:0/302179876 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba000a9b40 0x7fba000a51b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40097a0 tx=0x7fb9f402b8d0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.637+0000 7fba07c9b640 1 -- 172.21.15.91:0/302179876 shutdown_connections 2023-11-27T20:44:22.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.637+0000 7fba07c9b640 1 --2- 172.21.15.91:0/302179876 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba000a9b40 0x7fba000a51b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.638+0000 7fba07c9b640 1 -- 172.21.15.91:0/302179876 >> 172.21.15.91:0/302179876 conn(0x7fba0006a500 msgr2=0x7fba0006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:22.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.638+0000 7fba07c9b640 1 -- 172.21.15.91:0/302179876 shutdown_connections 2023-11-27T20:44:22.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.638+0000 7fba07c9b640 1 -- 172.21.15.91:0/302179876 wait complete. 2023-11-27T20:44:22.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.639+0000 7fba07c9b640 1 Processor -- start 2023-11-27T20:44:22.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.640+0000 7fba07c9b640 1 -- start start 2023-11-27T20:44:22.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.640+0000 7fba07c9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba000c1500 0x7fba000aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:22.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.640+0000 7fba07c9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba00155490 0x7fba00071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:22.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.640+0000 7fba07c9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba000a5970 0x7fba001ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:22.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.640+0000 7fba07c9b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba000aae90 con 0x7fba00155490 2023-11-27T20:44:22.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.640+0000 7fba07c9b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba001ed920 con 0x7fba000c1500 2023-11-27T20:44:22.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.640+0000 7fba07c9b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000aabb0 con 0x7fba000a5970 2023-11-27T20:44:22.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.641+0000 7fba05236640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba00155490 0x7fba00071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:22.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.641+0000 7fba05236640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba00155490 0x7fba00071320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:36228/0 (socket says 172.21.15.91:36228) 2023-11-27T20:44:22.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.641+0000 7fba05236640 1 -- 172.21.15.91:0/117305317 learned_addr learned my addr 172.21.15.91:0/117305317 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:22.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.641+0000 7fba05236640 1 -- 172.21.15.91:0/117305317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba000a5970 msgr2=0x7fba001ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:22.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.641+0000 7fba05236640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba000a5970 0x7fba001ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.641+0000 7fba05236640 1 -- 172.21.15.91:0/117305317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba000c1500 msgr2=0x7fba000aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:22.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.641+0000 7fba05a37640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba000c1500 0x7fba000aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:22.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.641+0000 7fba05236640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba000c1500 0x7fba000aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.641+0000 7fba05236640 1 -- 172.21.15.91:0/117305317 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f4009400 con 0x7fba00155490 2023-11-27T20:44:22.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.641+0000 7fba05a37640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba000c1500 0x7fba000aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:22.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.642+0000 7fba05236640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba00155490 0x7fba00071320 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40098c0 tx=0x7fb9f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:22.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.642+0000 7fb9fe7fc640 1 -- 172.21.15.91:0/117305317 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f403a6f0 con 0x7fba00155490 2023-11-27T20:44:22.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.642+0000 7fb9fe7fc640 1 -- 172.21.15.91:0/117305317 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f403a850 con 0x7fba00155490 2023-11-27T20:44:22.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.642+0000 7fb9fe7fc640 1 -- 172.21.15.91:0/117305317 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f403ac00 con 0x7fba00155490 2023-11-27T20:44:22.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.642+0000 7fba07c9b640 1 -- 172.21.15.91:0/117305317 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba001edbc0 con 0x7fba00155490 2023-11-27T20:44:22.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.642+0000 7fba07c9b640 1 -- 172.21.15.91:0/117305317 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba000a6ff0 con 0x7fba00155490 2023-11-27T20:44:22.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.643+0000 7fba07c9b640 1 -- 172.21.15.91:0/117305317 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba001ed780 con 0x7fba00155490 2023-11-27T20:44:22.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.644+0000 7fb9fe7fc640 1 -- 172.21.15.91:0/117305317 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb9f4030380 con 0x7fba00155490 2023-11-27T20:44:22.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.645+0000 7fb9fe7fc640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9ec06b1f0 0x7fb9ec06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:22.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.645+0000 7fb9fe7fc640 1 -- 172.21.15.91:0/117305317 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fb9f40ab630 con 0x7fba00155490 2023-11-27T20:44:22.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.645+0000 7fba05a37640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9ec06b1f0 0x7fb9ec06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:22.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.646+0000 7fba05a37640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9ec06b1f0 0x7fb9ec06d6b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0001560 tx=0x7fb9f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:22.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.649+0000 7fb9fe7fc640 1 -- 172.21.15.91:0/117305317 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fba001ed780 con 0x7fba00155490 2023-11-27T20:44:22.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.879+0000 7fba07c9b640 1 -- 172.21.15.91:0/117305317 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fba001ee0e0 con 0x7fba00155490 2023-11-27T20:44:22.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.880+0000 7fb9fe7fc640 1 -- 172.21.15.91:0/117305317 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+149 (secure 0 0 0) 0x7fba001ee0e0 con 0x7fba00155490 2023-11-27T20:44:22.882 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:44:22.882 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-27T20:44:22.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.882+0000 7fba07c9b640 1 -- 172.21.15.91:0/117305317 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9ec06b1f0 msgr2=0x7fb9ec06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:22.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9ec06b1f0 0x7fb9ec06d6b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0001560 tx=0x7fb9f0009040 comp rx=0 tx=0).stop 2023-11-27T20:44:22.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 -- 172.21.15.91:0/117305317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba00155490 msgr2=0x7fba00071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:22.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba00155490 0x7fba00071320 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40098c0 tx=0x7fb9f40046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 -- 172.21.15.91:0/117305317 shutdown_connections 2023-11-27T20:44:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba000a5970 0x7fba001ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba00155490 0x7fba00071320 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb9ec06b1f0 0x7fb9ec06d6b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 --2- 172.21.15.91:0/117305317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba000c1500 0x7fba000aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 -- 172.21.15.91:0/117305317 >> 172.21.15.91:0/117305317 conn(0x7fba0006a500 msgr2=0x7fba00152620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 -- 172.21.15.91:0/117305317 shutdown_connections 2023-11-27T20:44:22.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:22.883+0000 7fba07c9b640 1 -- 172.21.15.91:0/117305317 wait complete. 2023-11-27T20:44:22.903 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-27T20:44:22.903 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:44:22.903 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-27T20:44:22.903 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-27T20:44:22.903 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T20:44:22.903 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-27T20:44:22.903 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:44:22.903 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:44:22.903 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:44:22.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:22.904 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-27T20:44:22.963 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:44:22.963 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:44:22.963 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:44:22.964 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:22.965 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:44:22.965 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42196sec preferred_lft 42196sec 2023-11-27T20:44:22.965 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-27T20:44:22.965 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:22.965 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:44:22.965 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:22.965 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:44:22.965 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:22.965 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8479:57ff:fe06:e35b/64 scope link 2023-11-27T20:44:22.965 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:22.966 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:44:22.966 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T20:44:22.966 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::40e4:26ff:fe7f:e25/64 scope link 2023-11-27T20:44:22.966 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:22.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:22.967 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:44:23.060 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-27T20:44:23.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:23.065 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-27T20:44:23.119 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-27T20:44:23.119 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:44:23.119 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:44:23.119 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:44:23.119 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:44:23.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:23.119 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:44:23.120 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:44:23.120 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:44:23.120 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:44:23.120 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:44:23.120 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:44:23.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:23.303 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-27T20:44:23.352 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-27T20:44:23.353 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:44:23.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:23.353 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-11-27T20:44:23.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:44:23.446 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-27T20:44:23.503 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:44:23.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:44:23.503 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:44:23.557 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:44:23.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:23.620 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:44:23.766 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:44:23.766 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-27T20:44:23.767 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:44:23.788 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:44:23.788 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-27T20:44:23.788 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:44:23.788 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:44:23.788 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:44:23.815 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:44:23.815 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-27T20:44:23.815 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:44:23.815 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:44:23.815 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:44:23.816 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:44:23.816 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:44:23.816 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:44:23.817 INFO:teuthology.orchestra.run.smithi183.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-27T20:44:23.817 INFO:teuthology.orchestra.run.smithi183.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:44:23.817 INFO:teuthology.orchestra.run.smithi183.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:44:23.817 INFO:teuthology.orchestra.run.smithi183.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:44:23.817 INFO:teuthology.orchestra.run.smithi183.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:44:23.821 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:44:23.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:23.821 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:44:23.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:23.902 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:44:23.977 INFO:teuthology.orchestra.run.smithi183.stdout:client5137 2023-11-27T20:44:23.978 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:44:23.978 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:24.034 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-11-27T20:44:24.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.268+0000 7f03f0924640 1 Processor -- start 2023-11-27T20:44:24.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.269+0000 7f03f0924640 1 -- start start 2023-11-27T20:44:24.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.270+0000 7f03f0924640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f03ec14e7c0 0x7f03ec0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.270+0000 7f03f0924640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec0c4c00 0x7f03ec0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.270+0000 7f03f0924640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec158a60 con 0x7f03ec0ca990 2023-11-27T20:44:24.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.270+0000 7f03f0924640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec0c5b10 con 0x7f03ec14e7c0 2023-11-27T20:44:24.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.270+0000 7f03f0924640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec157ca0 con 0x7f03ec0c4c00 2023-11-27T20:44:24.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.270+0000 7f03eb59e640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f03ec0ca990 0x7f03ec154580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45458/0 (socket says 172.21.15.91:45458) 2023-11-27T20:44:24.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.270+0000 7f03eb59e640 1 -- 172.21.15.91:0/502373883 learned_addr learned my addr 172.21.15.91:0/502373883 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:24.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03ead9d640 1 --2- 172.21.15.91:0/502373883 >> v2:172.21.15.183:3300/0 conn(0x7f03ec14e7c0 0x7f03ec0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03ea59c640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec0c4c00 0x7f03ec0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776218638 0 0) 0x7f03ec158a60 con 0x7f03ec0ca990 2023-11-27T20:44:24.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d8003520 con 0x7f03ec0ca990 2023-11-27T20:44:24.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3165987814 0 0) 0x7f03d8003520 con 0x7f03ec0ca990 2023-11-27T20:44:24.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec0c4c00 msgr2=0x7f03ec0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:24.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec0c4c00 0x7f03ec0ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 >> v2:172.21.15.183:3300/0 conn(0x7f03ec14e7c0 msgr2=0x7f03ec0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:24.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 --2- 172.21.15.91:0/502373883 >> v2:172.21.15.183:3300/0 conn(0x7f03ec14e7c0 0x7f03ec0c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec157f80 con 0x7f03ec0ca990 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f03e4001670 con 0x7f03ec0ca990 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03ead9d640 1 --2- 172.21.15.91:0/502373883 >> v2:172.21.15.183:3300/0 conn(0x7f03ec14e7c0 0x7f03ec0c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 >> v1:172.21.15.91:6789/0 conn(0x7f03ec0ca990 legacy=0x7f03ec154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 0x7f03d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d80047c0 0x7f03d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.271+0000 7f03e9d9b640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec0c4c00 0x7f03d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec157ca0 con 0x7f03d8003970 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d800ba30 con 0x7f03d80047c0 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d800bbf0 con 0x7f03ec0c4c00 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03ead9d640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 0x7f03d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03ea59c640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d80047c0 0x7f03d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03eb59e640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec0c4c00 0x7f03d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03ead9d640 1 -- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec0c4c00 msgr2=0x7f03d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:24.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03ead9d640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec0c4c00 0x7f03d8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03ead9d640 1 -- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d80047c0 msgr2=0x7f03d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:24.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03ead9d640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d80047c0 0x7f03d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03ead9d640 1 -- 172.21.15.91:0/502373883 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8003520 con 0x7f03d8003970 2023-11-27T20:44:24.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.272+0000 7f03ea59c640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03d80047c0 0x7f03d8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:24.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.273+0000 7f03ead9d640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 0x7f03d8003d90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0073e0 tx=0x7f03d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1b2f9c9d3a8183 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:24.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.274+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc02cdc0 con 0x7f03d8003970 2023-11-27T20:44:24.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.274+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc034440 con 0x7f03d8003970 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.274+0000 7f03e9d9b640 1 -- 172.21.15.91:0/502373883 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc0347b0 con 0x7f03d8003970 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.274+0000 7f03f0924640 1 -- 172.21.15.91:0/502373883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 msgr2=0x7f03d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.274+0000 7f03f0924640 1 --2- 172.21.15.91:0/502373883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 0x7f03d8003d90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0073e0 tx=0x7f03d80057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.274+0000 7f03eb59e640 1 -- 172.21.15.91:0/502373883 reap_dead start 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.274+0000 7f03f0924640 1 -- 172.21.15.91:0/502373883 shutdown_connections 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.274+0000 7f03f0924640 1 -- 172.21.15.91:0/502373883 >> 172.21.15.91:0/502373883 conn(0x7f03ec0abf00 msgr2=0x7f03ec0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.274+0000 7f03f0924640 1 -- 172.21.15.91:0/502373883 shutdown_connections 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.274+0000 7f03f0924640 1 -- 172.21.15.91:0/502373883 wait complete. 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.276+0000 7f03f0924640 1 Processor -- start 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.276+0000 7f03f0924640 1 -- start start 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.277+0000 7f03f0924640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 0x7f03ec0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.277+0000 7f03f0924640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec14eba0 0x7f03ec14f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.277+0000 7f03f0924640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03ec14fcf0 0x7f03ec143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.277+0000 7f03f0924640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec151b00 con 0x7f03d8003970 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.277+0000 7f03f0924640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0aa780 con 0x7f03ec14fcf0 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.277+0000 7f03f0924640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0bd360 con 0x7f03ec14eba0 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.277+0000 7f03ead9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 0x7f03ec0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.277+0000 7f03ead9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 0x7f03ec0a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48312/0 (socket says 172.21.15.91:48312) 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.277+0000 7f03ead9d640 1 -- 172.21.15.91:0/318064696 learned_addr learned my addr 172.21.15.91:0/318064696 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.278+0000 7f03eb59e640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03ec14fcf0 0x7f03ec143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.278+0000 7f03ea59c640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec14eba0 0x7f03ec14f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.278+0000 7f03ead9d640 1 -- 172.21.15.91:0/318064696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec14eba0 msgr2=0x7f03ec14f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.278+0000 7f03ead9d640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec14eba0 0x7f03ec14f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.278+0000 7f03ead9d640 1 -- 172.21.15.91:0/318064696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03ec14fcf0 msgr2=0x7f03ec143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.278+0000 7f03ead9d640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03ec14fcf0 0x7f03ec143e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.278+0000 7f03ead9d640 1 -- 172.21.15.91:0/318064696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec151540 con 0x7f03d8003970 2023-11-27T20:44:24.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.278+0000 7f03ead9d640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 0x7f03ec0a9eb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f03dc037040 tx=0x7f03dc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:24.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.278+0000 7f03e37fe640 1 -- 172.21.15.91:0/318064696 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc03e8d0 con 0x7f03d8003970 2023-11-27T20:44:24.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.278+0000 7f03e37fe640 1 -- 172.21.15.91:0/318064696 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc03ea50 con 0x7f03d8003970 2023-11-27T20:44:24.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.279+0000 7f03f0924640 1 -- 172.21.15.91:0/318064696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec151820 con 0x7f03d8003970 2023-11-27T20:44:24.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.279+0000 7f03e37fe640 1 -- 172.21.15.91:0/318064696 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc03ee00 con 0x7f03d8003970 2023-11-27T20:44:24.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.279+0000 7f03f0924640 1 -- 172.21.15.91:0/318064696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec0a9720 con 0x7f03d8003970 2023-11-27T20:44:24.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.280+0000 7f03f0924640 1 -- 172.21.15.91:0/318064696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec0aa5d0 con 0x7f03d8003970 2023-11-27T20:44:24.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.281+0000 7f03e37fe640 1 -- 172.21.15.91:0/318064696 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f03dc03d3a0 con 0x7f03d8003970 2023-11-27T20:44:24.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.282+0000 7f03e37fe640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03cc06b1f0 0x7f03cc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.282+0000 7f03e37fe640 1 -- 172.21.15.91:0/318064696 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f03dc0ac6c0 con 0x7f03d8003970 2023-11-27T20:44:24.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.282+0000 7f03ea59c640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03cc06b1f0 0x7f03cc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.283+0000 7f03ea59c640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03cc06b1f0 0x7f03cc06d6b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f03ec148c40 tx=0x7f03d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:24.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.286+0000 7f03e37fe640 1 -- 172.21.15.91:0/318064696 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f03dc077100 con 0x7f03d8003970 2023-11-27T20:44:24.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.551+0000 7f03f0924640 1 -- 172.21.15.91:0/318064696 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f03ec04e840 con 0x7f03d8003970 2023-11-27T20:44:24.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.557+0000 7f03e37fe640 1 -- 172.21.15.91:0/318064696 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v21) v1 ==== 291+0+0 (secure 0 0 0) 0x7f03dc07a720 con 0x7f03d8003970 2023-11-27T20:44:24.558 INFO:teuthology.orchestra.run.smithi091.stderr:added key for client.testuser 2023-11-27T20:44:24.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.560+0000 7f03f0924640 1 -- 172.21.15.91:0/318064696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03cc06b1f0 msgr2=0x7f03cc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:24.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.560+0000 7f03f0924640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03cc06b1f0 0x7f03cc06d6b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f03ec148c40 tx=0x7f03d4008040 comp rx=0 tx=0).stop 2023-11-27T20:44:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.560+0000 7f03f0924640 1 -- 172.21.15.91:0/318064696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 msgr2=0x7f03ec0a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.560+0000 7f03f0924640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 0x7f03ec0a9eb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f03dc037040 tx=0x7f03dc004ab0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.560+0000 7f03f0924640 1 -- 172.21.15.91:0/318064696 shutdown_connections 2023-11-27T20:44:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.560+0000 7f03f0924640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03cc06b1f0 0x7f03cc06d6b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.560+0000 7f03f0924640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03ec14fcf0 0x7f03ec143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.560+0000 7f03f0924640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03ec14eba0 0x7f03ec14f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.560+0000 7f03f0924640 1 --2- 172.21.15.91:0/318064696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03d8003970 0x7f03ec0a9eb0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.561+0000 7f03f0924640 1 -- 172.21.15.91:0/318064696 >> 172.21.15.91:0/318064696 conn(0x7f03ec0abf00 msgr2=0x7f03ec06b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.561+0000 7f03f0924640 1 -- 172.21.15.91:0/318064696 shutdown_connections 2023-11-27T20:44:24.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.561+0000 7f03f0924640 1 -- 172.21.15.91:0/318064696 wait complete. 2023-11-27T20:44:24.582 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-11-27T20:44:24.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.794+0000 7f503d32c640 1 Processor -- start 2023-11-27T20:44:24.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.794+0000 7f503d32c640 1 -- start start 2023-11-27T20:44:24.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.795+0000 7f503d32c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f50380a5240 0x7f50380c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.795+0000 7f503d32c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f50380c3bc0 0x7f5038154500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.796+0000 7f503d32c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50380aadc0 con 0x7f50380c2c90 2023-11-27T20:44:24.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.796+0000 7f503d32c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5038151be0 con 0x7f50380c3bc0 2023-11-27T20:44:24.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.796+0000 7f503d32c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50380c4170 con 0x7f50380a5240 2023-11-27T20:44:24.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.796+0000 7f502e7fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f50380c3bc0 0x7f5038154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.796+0000 7f502e7fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f50380c3bc0 0x7f5038154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48316/0 (socket says 172.21.15.91:48316) 2023-11-27T20:44:24.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.796+0000 7f502e7fc640 1 -- 172.21.15.91:0/1949069413 learned_addr learned my addr 172.21.15.91:0/1949069413 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:24.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.796+0000 7f502e7fc640 1 -- 172.21.15.91:0/1949069413 >> v2:172.21.15.183:3300/0 conn(0x7f50380a5240 msgr2=0x7f50380c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:24.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.796+0000 7f502e7fc640 1 --2- 172.21.15.91:0/1949069413 >> v2:172.21.15.183:3300/0 conn(0x7f50380a5240 0x7f50380c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.796+0000 7f502e7fc640 1 -- 172.21.15.91:0/1949069413 >> v1:172.21.15.183:6789/0 conn(0x7f50380c2c90 legacy=0x7f5038154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:24.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.796+0000 7f502e7fc640 1 -- 172.21.15.91:0/1949069413 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50380c4450 con 0x7f50380c3bc0 2023-11-27T20:44:24.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.797+0000 7f502e7fc640 1 --2- 172.21.15.91:0/1949069413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c3bc0 0x7f5038154500 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f503806b310 tx=0x7f502002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57422d6a16940f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:24.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.798+0000 7f50367fc640 1 -- 172.21.15.91:0/1949069413 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502002c9f0 con 0x7f50380c3bc0 2023-11-27T20:44:24.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.798+0000 7f50367fc640 1 -- 172.21.15.91:0/1949069413 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502002cb50 con 0x7f50380c3bc0 2023-11-27T20:44:24.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.798+0000 7f50367fc640 1 -- 172.21.15.91:0/1949069413 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200343f0 con 0x7f50380c3bc0 2023-11-27T20:44:24.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.798+0000 7f503d32c640 1 -- 172.21.15.91:0/1949069413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c3bc0 msgr2=0x7f5038154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:24.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.798+0000 7f503d32c640 1 --2- 172.21.15.91:0/1949069413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c3bc0 0x7f5038154500 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f503806b310 tx=0x7f502002be50 comp rx=0 tx=0).stop 2023-11-27T20:44:24.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.799+0000 7f503d32c640 1 -- 172.21.15.91:0/1949069413 shutdown_connections 2023-11-27T20:44:24.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.799+0000 7f503d32c640 1 --2- 172.21.15.91:0/1949069413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c3bc0 0x7f5038154500 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.799+0000 7f503d32c640 1 --2- 172.21.15.91:0/1949069413 >> v2:172.21.15.183:3300/0 conn(0x7f50380a5240 0x7f50380c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.799+0000 7f503d32c640 1 -- 172.21.15.91:0/1949069413 >> 172.21.15.91:0/1949069413 conn(0x7f503806a500 msgr2=0x7f503806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:24.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.799+0000 7f503d32c640 1 -- 172.21.15.91:0/1949069413 shutdown_connections 2023-11-27T20:44:24.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.799+0000 7f503d32c640 1 -- 172.21.15.91:0/1949069413 wait complete. 2023-11-27T20:44:24.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.800+0000 7f503d32c640 1 Processor -- start 2023-11-27T20:44:24.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.800+0000 7f503d32c640 1 -- start start 2023-11-27T20:44:24.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.801+0000 7f503d32c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50380a5240 0x7f50381e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.801+0000 7f503d32c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c2c90 0x7f50381db5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.801+0000 7f503d32c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50380c3bc0 0x7f503814fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.801+0000 7f503d32c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50381e65b0 con 0x7f50380c2c90 2023-11-27T20:44:24.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.801+0000 7f503d32c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503814f6f0 con 0x7f50380c3bc0 2023-11-27T20:44:24.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.801+0000 7f503d32c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50381e6a70 con 0x7f50380a5240 2023-11-27T20:44:24.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.802+0000 7f502e7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c2c90 0x7f50381db5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.802+0000 7f502e7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c2c90 0x7f50381db5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48328/0 (socket says 172.21.15.91:48328) 2023-11-27T20:44:24.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.802+0000 7f502e7fc640 1 -- 172.21.15.91:0/3223613547 learned_addr learned my addr 172.21.15.91:0/3223613547 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:24.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.802+0000 7f502e7fc640 1 -- 172.21.15.91:0/3223613547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50380a5240 msgr2=0x7f50381e9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:24.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.802+0000 7f5036ffd640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50380a5240 0x7f50381e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.802+0000 7f502e7fc640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50380a5240 0x7f50381e9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.802+0000 7f502e7fc640 1 -- 172.21.15.91:0/3223613547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50380c3bc0 msgr2=0x7f503814fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:24.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.802+0000 7f502e7fc640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50380c3bc0 0x7f503814fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:24.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.802+0000 7f502e7fc640 1 -- 172.21.15.91:0/3223613547 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020009b30 con 0x7f50380c2c90 2023-11-27T20:44:24.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.802+0000 7f502e7fc640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c2c90 0x7f50381db5f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f50200093e0 tx=0x7f5020004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:24.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.803+0000 7f502ffff640 1 -- 172.21.15.91:0/3223613547 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502003e450 con 0x7f50380c2c90 2023-11-27T20:44:24.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.803+0000 7f502ffff640 1 -- 172.21.15.91:0/3223613547 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502003e5b0 con 0x7f50380c2c90 2023-11-27T20:44:24.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.803+0000 7f502ffff640 1 -- 172.21.15.91:0/3223613547 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502003e960 con 0x7f50380c2c90 2023-11-27T20:44:24.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.803+0000 7f503d32c640 1 -- 172.21.15.91:0/3223613547 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50381e6790 con 0x7f50380c2c90 2023-11-27T20:44:24.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.803+0000 7f503d32c640 1 -- 172.21.15.91:0/3223613547 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50381e9440 con 0x7f50380c2c90 2023-11-27T20:44:24.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.804+0000 7f503d32c640 1 -- 172.21.15.91:0/3223613547 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5038068350 con 0x7f50380c2c90 2023-11-27T20:44:24.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.805+0000 7f502ffff640 1 -- 172.21.15.91:0/3223613547 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f502003eac0 con 0x7f50380c2c90 2023-11-27T20:44:24.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.806+0000 7f502ffff640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f501806b1f0 0x7f501806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:24.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.806+0000 7f502ffff640 1 -- 172.21.15.91:0/3223613547 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f50200aca40 con 0x7f50380c2c90 2023-11-27T20:44:24.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.806+0000 7f5036ffd640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f501806b1f0 0x7f501806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:24.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.807+0000 7f5036ffd640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f501806b1f0 0x7f501806d6b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f502800a750 tx=0x7f5028008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:24.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:24.810+0000 7f502ffff640 1 -- 172.21.15.91:0/3223613547 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f50200773d0 con 0x7f50380c2c90 2023-11-27T20:44:25.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.071+0000 7f503d32c640 1 -- 172.21.15.91:0/3223613547 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f50380c6770 con 0x7f50380c2c90 2023-11-27T20:44:25.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.072+0000 7f502ffff640 1 -- 172.21.15.91:0/3223613547 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v21) v1 ==== 85+0+245 (secure 0 0 0) 0x7f502007a9f0 con 0x7f50380c2c90 2023-11-27T20:44:25.073 INFO:teuthology.orchestra.run.smithi091.stdout:[client.testuser] 2023-11-27T20:44:25.073 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCo/2RlzjcFIRAA6CAAN8BdP+PWaUAriMDQ1Q== 2023-11-27T20:44:25.074 INFO:teuthology.orchestra.run.smithi091.stdout: caps mds = "allow rw fsname=cephfs" 2023-11-27T20:44:25.074 INFO:teuthology.orchestra.run.smithi091.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-11-27T20:44:25.074 INFO:teuthology.orchestra.run.smithi091.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-27T20:44:25.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.074+0000 7f503d32c640 1 -- 172.21.15.91:0/3223613547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f501806b1f0 msgr2=0x7f501806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:25.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.074+0000 7f503d32c640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f501806b1f0 0x7f501806d6b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f502800a750 tx=0x7f5028008040 comp rx=0 tx=0).stop 2023-11-27T20:44:25.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.074+0000 7f503d32c640 1 -- 172.21.15.91:0/3223613547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c2c90 msgr2=0x7f50381db5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:25.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.074+0000 7f503d32c640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c2c90 0x7f50381db5f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f50200093e0 tx=0x7f5020004a40 comp rx=0 tx=0).stop 2023-11-27T20:44:25.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.075+0000 7f503d32c640 1 -- 172.21.15.91:0/3223613547 shutdown_connections 2023-11-27T20:44:25.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.075+0000 7f503d32c640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f501806b1f0 0x7f501806d6b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.075+0000 7f503d32c640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50380c3bc0 0x7f503814fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.075+0000 7f503d32c640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50380c2c90 0x7f50381db5f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.075+0000 7f503d32c640 1 --2- 172.21.15.91:0/3223613547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50380a5240 0x7f50381e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.075+0000 7f503d32c640 1 -- 172.21.15.91:0/3223613547 >> 172.21.15.91:0/3223613547 conn(0x7f503806a500 msgr2=0x7f5038146110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:25.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.075+0000 7f503d32c640 1 -- 172.21.15.91:0/3223613547 shutdown_connections 2023-11-27T20:44:25.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.075+0000 7f503d32c640 1 -- 172.21.15.91:0/3223613547 wait complete. 2023-11-27T20:44:25.096 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-27T20:44:25.148 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.OcWavdnfcl 2023-11-27T20:44:25.148 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:44:25.149 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/tmp/tmp.OcWavdnfcl 2023-11-27T20:44:25.204 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:44:25.204 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:25.305 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:44:25.305 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:25.359 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:25.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.576+0000 7fd0b7802640 1 Processor -- start 2023-11-27T20:44:25.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.576+0000 7fd0b7802640 1 -- start start 2023-11-27T20:44:25.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.577+0000 7fd0b7802640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd0b014fd30 0x7fd0b0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:25.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.577+0000 7fd0b7802640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0b006d0a0 0x7fd0b00a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:25.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.577+0000 7fd0b7802640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b00c64a0 con 0x7fd0b00a5260 2023-11-27T20:44:25.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.577+0000 7fd0b7802640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b00c5c00 con 0x7fd0b006d0a0 2023-11-27T20:44:25.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.577+0000 7fd0b7802640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b00c5ee0 con 0x7fd0b014fd30 2023-11-27T20:44:25.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.577+0000 7fd0b4d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0b006d0a0 0x7fd0b00a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:25.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.578+0000 7fd0b4d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0b006d0a0 0x7fd0b00a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48332/0 (socket says 172.21.15.91:48332) 2023-11-27T20:44:25.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.578+0000 7fd0b4d9d640 1 -- 172.21.15.91:0/1104246222 learned_addr learned my addr 172.21.15.91:0/1104246222 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.578+0000 7fd0b4d9d640 1 -- 172.21.15.91:0/1104246222 >> v2:172.21.15.183:3300/0 conn(0x7fd0b014fd30 msgr2=0x7fd0b0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.578+0000 7fd0b4d9d640 1 --2- 172.21.15.91:0/1104246222 >> v2:172.21.15.183:3300/0 conn(0x7fd0b014fd30 0x7fd0b0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.578+0000 7fd0b4d9d640 1 -- 172.21.15.91:0/1104246222 >> v1:172.21.15.183:6789/0 conn(0x7fd0b00a5260 legacy=0x7fd0b00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.578+0000 7fd0b4d9d640 1 -- 172.21.15.91:0/1104246222 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00c61c0 con 0x7fd0b006d0a0 2023-11-27T20:44:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.579+0000 7fd0b4d9d640 1 --2- 172.21.15.91:0/1104246222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b006d0a0 0x7fd0b00a4d20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd0b006b200 tx=0x7fd0a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e7a8d2205e1113 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:25.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.579+0000 7fd0a7fff640 1 -- 172.21.15.91:0/1104246222 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0031870 con 0x7fd0b006d0a0 2023-11-27T20:44:25.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.579+0000 7fd0a7fff640 1 -- 172.21.15.91:0/1104246222 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a00319d0 con 0x7fd0b006d0a0 2023-11-27T20:44:25.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.579+0000 7fd0a7fff640 1 -- 172.21.15.91:0/1104246222 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0031d60 con 0x7fd0b006d0a0 2023-11-27T20:44:25.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.580+0000 7fd0b7802640 1 -- 172.21.15.91:0/1104246222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b006d0a0 msgr2=0x7fd0b00a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:25.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.580+0000 7fd0b7802640 1 --2- 172.21.15.91:0/1104246222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b006d0a0 0x7fd0b00a4d20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd0b006b200 tx=0x7fd0a002b910 comp rx=0 tx=0).stop 2023-11-27T20:44:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.580+0000 7fd0b7802640 1 -- 172.21.15.91:0/1104246222 shutdown_connections 2023-11-27T20:44:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.580+0000 7fd0b7802640 1 --2- 172.21.15.91:0/1104246222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b006d0a0 0x7fd0b00a4d20 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.580+0000 7fd0b7802640 1 --2- 172.21.15.91:0/1104246222 >> v2:172.21.15.183:3300/0 conn(0x7fd0b014fd30 0x7fd0b0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.580+0000 7fd0b7802640 1 -- 172.21.15.91:0/1104246222 >> 172.21.15.91:0/1104246222 conn(0x7fd0b006a500 msgr2=0x7fd0b006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.580+0000 7fd0b7802640 1 -- 172.21.15.91:0/1104246222 shutdown_connections 2023-11-27T20:44:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.580+0000 7fd0b7802640 1 -- 172.21.15.91:0/1104246222 wait complete. 2023-11-27T20:44:25.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.582+0000 7fd0b7802640 1 Processor -- start 2023-11-27T20:44:25.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.582+0000 7fd0b7802640 1 -- start start 2023-11-27T20:44:25.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.583+0000 7fd0b7802640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0b006d0a0 0x7fd0b00708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:25.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.583+0000 7fd0b7802640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0b00a5260 0x7fd0b01ea290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:25.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.583+0000 7fd0b7802640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b014fd30 0x7fd0b01ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:25.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.583+0000 7fd0b7802640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01dc770 con 0x7fd0b014fd30 2023-11-27T20:44:25.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.583+0000 7fd0b7802640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01ead10 con 0x7fd0b00a5260 2023-11-27T20:44:25.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.583+0000 7fd0b7802640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00a8e70 con 0x7fd0b006d0a0 2023-11-27T20:44:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.583+0000 7fd0b5d9f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b014fd30 0x7fd0b01ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.583+0000 7fd0b5d9f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b014fd30 0x7fd0b01ea7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48340/0 (socket says 172.21.15.91:48340) 2023-11-27T20:44:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.583+0000 7fd0b5d9f640 1 -- 172.21.15.91:0/1671780973 learned_addr learned my addr 172.21.15.91:0/1671780973 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0b559e640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0b006d0a0 0x7fd0b00708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0b4d9d640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0b00a5260 0x7fd0b01ea290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0b5d9f640 1 -- 172.21.15.91:0/1671780973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0b006d0a0 msgr2=0x7fd0b00708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0b5d9f640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0b006d0a0 0x7fd0b00708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0b5d9f640 1 -- 172.21.15.91:0/1671780973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0b00a5260 msgr2=0x7fd0b01ea290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0b5d9f640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0b00a5260 0x7fd0b01ea290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0b5d9f640 1 -- 172.21.15.91:0/1671780973 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00094d0 con 0x7fd0b014fd30 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0b5d9f640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b014fd30 0x7fd0b01ea7d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c780 tx=0x7fd0a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0a5ffb640 1 -- 172.21.15.91:0/1671780973 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8003d80 con 0x7fd0b014fd30 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0a5ffb640 1 -- 172.21.15.91:0/1671780973 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a800ce90 con 0x7fd0b014fd30 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0a5ffb640 1 -- 172.21.15.91:0/1671780973 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a80052b0 con 0x7fd0b014fd30 2023-11-27T20:44:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0b7802640 1 -- 172.21.15.91:0/1671780973 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b01dbd00 con 0x7fd0b014fd30 2023-11-27T20:44:25.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.584+0000 7fd0b7802640 1 -- 172.21.15.91:0/1671780973 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b01ee590 con 0x7fd0b014fd30 2023-11-27T20:44:25.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.586+0000 7fd0b7802640 1 -- 172.21.15.91:0/1671780973 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b01dbe90 con 0x7fd0b014fd30 2023-11-27T20:44:25.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.587+0000 7fd0a5ffb640 1 -- 172.21.15.91:0/1671780973 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd0a8005410 con 0x7fd0b014fd30 2023-11-27T20:44:25.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.587+0000 7fd0a5ffb640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd09406b1c0 0x7fd09406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:25.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.588+0000 7fd0a5ffb640 1 -- 172.21.15.91:0/1671780973 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fd0a8089290 con 0x7fd0b014fd30 2023-11-27T20:44:25.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.588+0000 7fd0b559e640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd09406b1c0 0x7fd09406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:25.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.588+0000 7fd0b559e640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd09406b1c0 0x7fd09406d680 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00a770 tx=0x7fd0ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:25.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.592+0000 7fd0a5ffb640 1 -- 172.21.15.91:0/1671780973 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd0a8053c20 con 0x7fd0b014fd30 2023-11-27T20:44:25.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.783+0000 7fd0b7802640 1 -- 172.21.15.91:0/1671780973 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0b0068350 con 0x7fd0b014fd30 2023-11-27T20:44:25.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.786+0000 7fd0a5ffb640 1 -- 172.21.15.91:0/1671780973 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+20342 (secure 0 0 0) 0x7fd0a8057240 con 0x7fd0b014fd30 2023-11-27T20:44:25.787 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:25.788 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":61,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:18.243029+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:25.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 -- 172.21.15.91:0/1671780973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd09406b1c0 msgr2=0x7fd09406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:25.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd09406b1c0 0x7fd09406d680 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00a770 tx=0x7fd0ac008040 comp rx=0 tx=0).stop 2023-11-27T20:44:25.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 -- 172.21.15.91:0/1671780973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b014fd30 msgr2=0x7fd0b01ea7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:25.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b014fd30 0x7fd0b01ea7d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c780 tx=0x7fd0a800cc40 comp rx=0 tx=0).stop 2023-11-27T20:44:25.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 -- 172.21.15.91:0/1671780973 shutdown_connections 2023-11-27T20:44:25.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b014fd30 0x7fd0b01ea7d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd09406b1c0 0x7fd09406d680 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0b00a5260 0x7fd0b01ea290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 --2- 172.21.15.91:0/1671780973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0b006d0a0 0x7fd0b00708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:25.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 -- 172.21.15.91:0/1671780973 >> 172.21.15.91:0/1671780973 conn(0x7fd0b006a500 msgr2=0x7fd0b00c30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:25.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 -- 172.21.15.91:0/1671780973 shutdown_connections 2023-11-27T20:44:25.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:25.789+0000 7fd0b7802640 1 -- 172.21.15.91:0/1671780973 wait complete. 2023-11-27T20:44:25.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:43:50.043742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:43:51.176510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:44:06.059576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:44:06.989345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:44:25.812 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:44:26.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.022+0000 7f9b119e6640 1 Processor -- start 2023-11-27T20:44:26.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.022+0000 7f9b119e6640 1 -- start start 2023-11-27T20:44:26.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.023+0000 7f9b119e6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9b0c0ca450 0x7f9b0c0ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.023+0000 7f9b119e6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b0c154580 0x7f9b0c154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.023+0000 7f9b119e6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0c158a60 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.023+0000 7f9b119e6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0c0c5b10 con 0x7f9b0c0ca450 2023-11-27T20:44:26.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.023+0000 7f9b119e6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c0c4dd0 con 0x7f9b0c154580 2023-11-27T20:44:26.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.024+0000 7f9b0bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9b0c0ca450 0x7f9b0c0ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.024+0000 7f9b109e4640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f9b0c14e7c0 0x7f9b0c0c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45470/0 (socket says 172.21.15.91:45470) 2023-11-27T20:44:26.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.024+0000 7f9b109e4640 1 -- 172.21.15.91:0/1828730627 learned_addr learned my addr 172.21.15.91:0/1828730627 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:26.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.024+0000 7f9b0bfff640 1 -- 172.21.15.91:0/1828730627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b0c154580 msgr2=0x7f9b0c154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:26.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.024+0000 7f9b0bfff640 1 --2- 172.21.15.91:0/1828730627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b0c154580 0x7f9b0c154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.024+0000 7f9b0bfff640 1 -- 172.21.15.91:0/1828730627 >> v1:172.21.15.91:6789/0 conn(0x7f9b0c14e7c0 legacy=0x7f9b0c0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.024+0000 7f9b0bfff640 1 -- 172.21.15.91:0/1828730627 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c157ca0 con 0x7f9b0c0ca450 2023-11-27T20:44:26.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.025+0000 7f9b0bfff640 1 --2- 172.21.15.91:0/1828730627 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c0ca450 0x7f9b0c0ca8d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9af80097a0 tx=0x7f9af802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532003b8e92a1a57 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:26.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b0b7fe640 1 -- 172.21.15.91:0/1828730627 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80316f0 con 0x7f9b0c0ca450 2023-11-27T20:44:26.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b0b7fe640 1 -- 172.21.15.91:0/1828730627 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8031850 con 0x7f9b0c0ca450 2023-11-27T20:44:26.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b0b7fe640 1 -- 172.21.15.91:0/1828730627 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8031be0 con 0x7f9b0c0ca450 2023-11-27T20:44:26.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b119e6640 1 -- 172.21.15.91:0/1828730627 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c0ca450 msgr2=0x7f9b0c0ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b119e6640 1 --2- 172.21.15.91:0/1828730627 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c0ca450 0x7f9b0c0ca8d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9af80097a0 tx=0x7f9af802b790 comp rx=0 tx=0).stop 2023-11-27T20:44:26.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b119e6640 1 -- 172.21.15.91:0/1828730627 shutdown_connections 2023-11-27T20:44:26.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b119e6640 1 --2- 172.21.15.91:0/1828730627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b0c154580 0x7f9b0c154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b119e6640 1 --2- 172.21.15.91:0/1828730627 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c0ca450 0x7f9b0c0ca8d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b119e6640 1 -- 172.21.15.91:0/1828730627 >> 172.21.15.91:0/1828730627 conn(0x7f9b0c0abf00 msgr2=0x7f9b0c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:26.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b119e6640 1 -- 172.21.15.91:0/1828730627 shutdown_connections 2023-11-27T20:44:26.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.026+0000 7f9b119e6640 1 -- 172.21.15.91:0/1828730627 wait complete. 2023-11-27T20:44:26.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.028+0000 7f9b119e6640 1 Processor -- start 2023-11-27T20:44:26.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.028+0000 7f9b119e6640 1 -- start start 2023-11-27T20:44:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.029+0000 7f9b119e6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b0c0ca450 0x7f9b0c14d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.029+0000 7f9b119e6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c14e7c0 0x7f9b0c147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.029+0000 7f9b119e6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b0c154580 0x7f9b0c148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.029+0000 7f9b119e6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c1ee170 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.029+0000 7f9b119e6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c148540 con 0x7f9b0c154580 2023-11-27T20:44:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.029+0000 7f9b119e6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c155440 con 0x7f9b0c0ca450 2023-11-27T20:44:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b0bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c14e7c0 0x7f9b0c147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b0bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c14e7c0 0x7f9b0c147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48360/0 (socket says 172.21.15.91:48360) 2023-11-27T20:44:26.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b0bfff640 1 -- 172.21.15.91:0/2385960616 learned_addr learned my addr 172.21.15.91:0/2385960616 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:26.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b109e4640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b0c0ca450 0x7f9b0c14d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b111e5640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b0c154580 0x7f9b0c148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b0bfff640 1 -- 172.21.15.91:0/2385960616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b0c0ca450 msgr2=0x7f9b0c14d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b0bfff640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b0c0ca450 0x7f9b0c14d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b0bfff640 1 -- 172.21.15.91:0/2385960616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b0c154580 msgr2=0x7f9b0c148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b0bfff640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b0c154580 0x7f9b0c148000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b0bfff640 1 -- 172.21.15.91:0/2385960616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8009400 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.030+0000 7f9b0bfff640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c14e7c0 0x7f9b0c147ac0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9af8000c00 tx=0x7f9af80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.031+0000 7f9b097fa640 1 -- 172.21.15.91:0/2385960616 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8034890 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.031+0000 7f9b097fa640 1 -- 172.21.15.91:0/2385960616 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8034a10 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.031+0000 7f9b097fa640 1 -- 172.21.15.91:0/2385960616 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8034dc0 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.031+0000 7f9b119e6640 1 -- 172.21.15.91:0/2385960616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c157360 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.031+0000 7f9b119e6640 1 -- 172.21.15.91:0/2385960616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0c0c1250 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.032+0000 7f9b119e6640 1 -- 172.21.15.91:0/2385960616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0c04e840 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.033+0000 7f9b097fa640 1 -- 172.21.15.91:0/2385960616 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9af803b040 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.034+0000 7f9b097fa640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9af006b1f0 0x7f9af006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.034+0000 7f9b097fa640 1 -- 172.21.15.91:0/2385960616 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f9af80ab6f0 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.034+0000 7f9b109e4640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9af006b1f0 0x7f9af006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.035+0000 7f9b109e4640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9af006b1f0 0x7f9af006d6b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9b00005880 tx=0x7f9b00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:26.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.038+0000 7f9b097fa640 1 -- 172.21.15.91:0/2385960616 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9af8076120 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.227+0000 7f9b119e6640 1 -- 172.21.15.91:0/2385960616 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b0c0c7c40 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.228+0000 7f9b097fa640 1 -- 172.21.15.91:0/2385960616 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9af8079740 con 0x7f9b0c14e7c0 2023-11-27T20:44:26.230 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:44:26.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 -- 172.21.15.91:0/2385960616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9af006b1f0 msgr2=0x7f9af006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9af006b1f0 0x7f9af006d6b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9b00005880 tx=0x7f9b00009040 comp rx=0 tx=0).stop 2023-11-27T20:44:26.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 -- 172.21.15.91:0/2385960616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c14e7c0 msgr2=0x7f9b0c147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c14e7c0 0x7f9b0c147ac0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9af8000c00 tx=0x7f9af80046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 -- 172.21.15.91:0/2385960616 shutdown_connections 2023-11-27T20:44:26.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9af006b1f0 0x7f9af006d6b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b0c154580 0x7f9b0c148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b0c14e7c0 0x7f9b0c147ac0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 --2- 172.21.15.91:0/2385960616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b0c0ca450 0x7f9b0c14d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 -- 172.21.15.91:0/2385960616 >> 172.21.15.91:0/2385960616 conn(0x7f9b0c0abf00 msgr2=0x7f9b0c06caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:26.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 -- 172.21.15.91:0/2385960616 shutdown_connections 2023-11-27T20:44:26.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.231+0000 7f9b119e6640 1 -- 172.21.15.91:0/2385960616 wait complete. 2023-11-27T20:44:26.250 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:44:26.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.452+0000 7f51c8809640 1 Processor -- start 2023-11-27T20:44:26.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.452+0000 7f51c8809640 1 -- start start 2023-11-27T20:44:26.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.454+0000 7f51c8809640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f51c40a9b40 0x7f51c40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.454+0000 7f51c8809640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c40c1500 0x7f51c40c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.454+0000 7f51c8809640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c40c06c0 con 0x7f51c4155490 2023-11-27T20:44:26.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.454+0000 7f51c8809640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c40a5820 con 0x7f51c40a9b40 2023-11-27T20:44:26.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.454+0000 7f51c8809640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c40c1020 con 0x7f51c40c1500 2023-11-27T20:44:26.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.454+0000 7f51c2d9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c40c1500 0x7f51c40c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.454+0000 7f51c2d9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c40c1500 0x7f51c40c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:57776/0 (socket says 172.21.15.91:57776) 2023-11-27T20:44:26.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.454+0000 7f51c2d9d640 1 -- 172.21.15.91:0/2691390512 learned_addr learned my addr 172.21.15.91:0/2691390512 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:26.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.455+0000 7f51c1d9b640 1 --2- 172.21.15.91:0/2691390512 >> v2:172.21.15.183:3300/0 conn(0x7f51c40a9b40 0x7f51c40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.455+0000 7f51c2d9d640 1 -- 172.21.15.91:0/2691390512 >> v2:172.21.15.183:3300/0 conn(0x7f51c40a9b40 msgr2=0x7f51c40a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:26.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.455+0000 7f51c2d9d640 1 --2- 172.21.15.91:0/2691390512 >> v2:172.21.15.183:3300/0 conn(0x7f51c40a9b40 0x7f51c40a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.455+0000 7f51c2d9d640 1 -- 172.21.15.91:0/2691390512 >> v1:172.21.15.183:6789/0 conn(0x7f51c4155490 legacy=0x7f51c40a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.455+0000 7f51c2d9d640 1 -- 172.21.15.91:0/2691390512 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c40c0910 con 0x7f51c40c1500 2023-11-27T20:44:26.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.456+0000 7f51c2d9d640 1 --2- 172.21.15.91:0/2691390512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c40c1500 0x7f51c40c24d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009e50 tx=0x7f51bc02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f5ea6a060a2aa80 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:26.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.457+0000 7f51c159a640 1 -- 172.21.15.91:0/2691390512 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc02cb00 con 0x7f51c40c1500 2023-11-27T20:44:26.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.457+0000 7f51c159a640 1 -- 172.21.15.91:0/2691390512 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc02cc60 con 0x7f51c40c1500 2023-11-27T20:44:26.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.457+0000 7f51c159a640 1 -- 172.21.15.91:0/2691390512 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0343f0 con 0x7f51c40c1500 2023-11-27T20:44:26.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.458+0000 7f51c8809640 1 -- 172.21.15.91:0/2691390512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c40c1500 msgr2=0x7f51c40c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.458+0000 7f51c8809640 1 --2- 172.21.15.91:0/2691390512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c40c1500 0x7f51c40c24d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009e50 tx=0x7f51bc02bf60 comp rx=0 tx=0).stop 2023-11-27T20:44:26.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.458+0000 7f51c8809640 1 -- 172.21.15.91:0/2691390512 shutdown_connections 2023-11-27T20:44:26.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.458+0000 7f51c8809640 1 --2- 172.21.15.91:0/2691390512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c40c1500 0x7f51c40c24d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.458+0000 7f51c8809640 1 --2- 172.21.15.91:0/2691390512 >> v2:172.21.15.183:3300/0 conn(0x7f51c40a9b40 0x7f51c40a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.458+0000 7f51c8809640 1 -- 172.21.15.91:0/2691390512 >> 172.21.15.91:0/2691390512 conn(0x7f51c406a500 msgr2=0x7f51c406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:26.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.458+0000 7f51c8809640 1 -- 172.21.15.91:0/2691390512 shutdown_connections 2023-11-27T20:44:26.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.458+0000 7f51c8809640 1 -- 172.21.15.91:0/2691390512 wait complete. 2023-11-27T20:44:26.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.460+0000 7f51c8809640 1 Processor -- start 2023-11-27T20:44:26.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.460+0000 7f51c8809640 1 -- start start 2023-11-27T20:44:26.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c8809640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51c40c1500 0x7f51c414a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c8809640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c4155490 0x7f51c41ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c8809640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51c4149d60 0x7f51c41491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c8809640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c414b7d0 con 0x7f51c40c1500 2023-11-27T20:44:26.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c8809640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c414e610 con 0x7f51c4149d60 2023-11-27T20:44:26.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c8809640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c414a940 con 0x7f51c4155490 2023-11-27T20:44:26.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c259c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51c40c1500 0x7f51c414a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c259c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51c40c1500 0x7f51c414a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48370/0 (socket says 172.21.15.91:48370) 2023-11-27T20:44:26.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c259c640 1 -- 172.21.15.91:0/4043132508 learned_addr learned my addr 172.21.15.91:0/4043132508 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:26.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c1d9b640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c4155490 0x7f51c41ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c259c640 1 -- 172.21.15.91:0/4043132508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c4155490 msgr2=0x7f51c41ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c259c640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c4155490 0x7f51c41ed620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c259c640 1 -- 172.21.15.91:0/4043132508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51c4149d60 msgr2=0x7f51c41491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c259c640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51c4149d60 0x7f51c41491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.461+0000 7f51c259c640 1 -- 172.21.15.91:0/4043132508 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc009b30 con 0x7f51c40c1500 2023-11-27T20:44:26.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.462+0000 7f51c259c640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51c40c1500 0x7f51c414a290 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c400 tx=0x7f51b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:26.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.462+0000 7f51b2ffd640 1 -- 172.21.15.91:0/4043132508 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40052d0 con 0x7f51c40c1500 2023-11-27T20:44:26.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.462+0000 7f51b2ffd640 1 -- 172.21.15.91:0/4043132508 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4005430 con 0x7f51c40c1500 2023-11-27T20:44:26.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.462+0000 7f51b2ffd640 1 -- 172.21.15.91:0/4043132508 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4003830 con 0x7f51c40c1500 2023-11-27T20:44:26.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.462+0000 7f51c8809640 1 -- 172.21.15.91:0/4043132508 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c41ee0a0 con 0x7f51c40c1500 2023-11-27T20:44:26.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.462+0000 7f51c8809640 1 -- 172.21.15.91:0/4043132508 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c40c5b40 con 0x7f51c40c1500 2023-11-27T20:44:26.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.463+0000 7f51c8809640 1 -- 172.21.15.91:0/4043132508 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c4068350 con 0x7f51c40c1500 2023-11-27T20:44:26.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.464+0000 7f51b2ffd640 1 -- 172.21.15.91:0/4043132508 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f51b4003990 con 0x7f51c40c1500 2023-11-27T20:44:26.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.465+0000 7f51b2ffd640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f51a406b1f0 0x7f51a406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.465+0000 7f51b2ffd640 1 -- 172.21.15.91:0/4043132508 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f51b4089260 con 0x7f51c40c1500 2023-11-27T20:44:26.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.465+0000 7f51c1d9b640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f51a406b1f0 0x7f51a406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.466+0000 7f51c1d9b640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f51a406b1f0 0x7f51a406d6b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f51c40c56c0 tx=0x7f51b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:26.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.469+0000 7f51b2ffd640 1 -- 172.21.15.91:0/4043132508 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f51b4053c70 con 0x7f51c40c1500 2023-11-27T20:44:26.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.661+0000 7f51c8809640 1 -- 172.21.15.91:0/4043132508 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51c41ee290 con 0x7f51c40c1500 2023-11-27T20:44:26.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.662+0000 7f51b2ffd640 1 -- 172.21.15.91:0/4043132508 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51b4057290 con 0x7f51c40c1500 2023-11-27T20:44:26.664 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:44:26.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 -- 172.21.15.91:0/4043132508 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f51a406b1f0 msgr2=0x7f51a406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f51a406b1f0 0x7f51a406d6b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f51c40c56c0 tx=0x7f51b8008040 comp rx=0 tx=0).stop 2023-11-27T20:44:26.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 -- 172.21.15.91:0/4043132508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51c40c1500 msgr2=0x7f51c414a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51c40c1500 0x7f51c414a290 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c400 tx=0x7f51b400c8c0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 -- 172.21.15.91:0/4043132508 shutdown_connections 2023-11-27T20:44:26.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f51a406b1f0 0x7f51a406d6b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51c4149d60 0x7f51c41491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c4155490 0x7f51c41ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 --2- 172.21.15.91:0/4043132508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51c40c1500 0x7f51c414a290 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 -- 172.21.15.91:0/4043132508 >> 172.21.15.91:0/4043132508 conn(0x7f51c406a500 msgr2=0x7f51c40aa710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:26.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 -- 172.21.15.91:0/4043132508 shutdown_connections 2023-11-27T20:44:26.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.665+0000 7f51c8809640 1 -- 172.21.15.91:0/4043132508 wait complete. 2023-11-27T20:44:26.685 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:44:26.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.895+0000 7f4f5653c640 1 Processor -- start 2023-11-27T20:44:26.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.896+0000 7f4f5653c640 1 -- start start 2023-11-27T20:44:26.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.897+0000 7f4f5653c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f500a6bc0 0x7f4f500c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.897+0000 7f4f5653c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f500c4220 con 0x7f4f500c7950 2023-11-27T20:44:26.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.897+0000 7f4f5653c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f500c2ba0 con 0x7f4f500c6680 2023-11-27T20:44:26.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.897+0000 7f4f5653c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500c2e80 con 0x7f4f500a6bc0 2023-11-27T20:44:26.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.897+0000 7f4f54ad9640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f4f500c7950 0x7f4f500c1ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45484/0 (socket says 172.21.15.91:45484) 2023-11-27T20:44:26.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.897+0000 7f4f54ad9640 1 -- 172.21.15.91:0/2936391930 learned_addr learned my addr 172.21.15.91:0/2936391930 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:26.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.897+0000 7f4f4f7fe640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f500a6bc0 0x7f4f500c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540288891 0 0) 0x7f4f48001490 con 0x7f4f500c7950 2023-11-27T20:44:26.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f3c003520 con 0x7f4f500c7950 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2177877948 0 0) 0x7f4f3c003520 con 0x7f4f500c7950 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f500a6bc0 msgr2=0x7f4f500c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f500a6bc0 0x7f4f500c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 >> v1:172.21.15.183:6789/0 conn(0x7f4f500c6680 legacy=0x7f4f500c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f500c32e0 con 0x7f4f500c7950 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f4f48001b80 con 0x7f4f500c7950 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 >> v1:172.21.15.91:6789/0 conn(0x7f4f500c7950 legacy=0x7f4f500c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f3c0039a0 0x7f4f3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f3c0047c0 0x7f4f3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f500a6bc0 0x7f4f3c005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c00bb10 con 0x7f4f3c0047c0 2023-11-27T20:44:26.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c00bc80 con 0x7f4f3c0039a0 2023-11-27T20:44:26.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.898+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c00be40 con 0x7f4f500a6bc0 2023-11-27T20:44:26.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.899+0000 7f4f4f7fe640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f3c0047c0 0x7f4f3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.899+0000 7f4f54ad9640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f500a6bc0 0x7f4f3c005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.899+0000 7f4f4ffff640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f3c0039a0 0x7f4f3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.899+0000 7f4f4f7fe640 1 -- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f500a6bc0 msgr2=0x7f4f3c005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:26.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.899+0000 7f4f4f7fe640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f500a6bc0 0x7f4f3c005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.899+0000 7f4f4f7fe640 1 -- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f3c0039a0 msgr2=0x7f4f3c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:26.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.899+0000 7f4f4f7fe640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f3c0039a0 0x7f4f3c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.899+0000 7f4f4f7fe640 1 -- 172.21.15.91:0/2936391930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c003520 con 0x7f4f3c0047c0 2023-11-27T20:44:26.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.899+0000 7f4f4ffff640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f3c0039a0 0x7f4f3c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:26.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.900+0000 7f4f4f7fe640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f3c0047c0 0x7f4f3c004c40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009ac0 tx=0x7f4f3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebe34d0b802989a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:26.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.900+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3802c6b0 con 0x7f4f3c0047c0 2023-11-27T20:44:26.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.900+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3802c810 con 0x7f4f3c0047c0 2023-11-27T20:44:26.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.900+0000 7f4f4effd640 1 -- 172.21.15.91:0/2936391930 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3802cba0 con 0x7f4f3c0047c0 2023-11-27T20:44:26.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.901+0000 7f4f5653c640 1 -- 172.21.15.91:0/2936391930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f3c0047c0 msgr2=0x7f4f3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.901+0000 7f4f5653c640 1 --2- 172.21.15.91:0/2936391930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f3c0047c0 0x7f4f3c004c40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009ac0 tx=0x7f4f3c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.901+0000 7f4f54ad9640 1 -- 172.21.15.91:0/2936391930 reap_dead start 2023-11-27T20:44:26.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.901+0000 7f4f5653c640 1 -- 172.21.15.91:0/2936391930 shutdown_connections 2023-11-27T20:44:26.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.901+0000 7f4f5653c640 1 -- 172.21.15.91:0/2936391930 >> 172.21.15.91:0/2936391930 conn(0x7f4f500c7e30 msgr2=0x7f4f500c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:26.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.901+0000 7f4f5653c640 1 -- 172.21.15.91:0/2936391930 shutdown_connections 2023-11-27T20:44:26.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.901+0000 7f4f5653c640 1 -- 172.21.15.91:0/2936391930 wait complete. 2023-11-27T20:44:26.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.903+0000 7f4f5653c640 1 Processor -- start 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.903+0000 7f4f5653c640 1 -- start start 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f5653c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f3c0047c0 0x7f4f50157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f5653c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f5006fdd0 0x7f4f50149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f5653c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f501581a0 0x7f4f50149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f5653c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f501eaea0 con 0x7f4f5006fdd0 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f5653c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f501ea260 con 0x7f4f3c0047c0 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f5653c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f501ea500 con 0x7f4f501581a0 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f4f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f5006fdd0 0x7f4f50149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f4f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f5006fdd0 0x7f4f50149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48388/0 (socket says 172.21.15.91:48388) 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f4f7fe640 1 -- 172.21.15.91:0/3967121298 learned_addr learned my addr 172.21.15.91:0/3967121298 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f4f7fe640 1 -- 172.21.15.91:0/3967121298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f501581a0 msgr2=0x7f4f50149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f4f7fe640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f501581a0 0x7f4f50149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f4f7fe640 1 -- 172.21.15.91:0/3967121298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f3c0047c0 msgr2=0x7f4f50157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:26.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f4ffff640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f3c0047c0 0x7f4f50157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f4f7fe640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f3c0047c0 0x7f4f50157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:26.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.904+0000 7f4f4f7fe640 1 -- 172.21.15.91:0/3967121298 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f501ea7e0 con 0x7f4f5006fdd0 2023-11-27T20:44:26.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.905+0000 7f4f4f7fe640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f5006fdd0 0x7f4f50149040 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009ac0 tx=0x7f4f38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:26.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.905+0000 7f4f4cff9640 1 -- 172.21.15.91:0/3967121298 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38003810 con 0x7f4f5006fdd0 2023-11-27T20:44:26.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.905+0000 7f4f4cff9640 1 -- 172.21.15.91:0/3967121298 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f38003970 con 0x7f4f5006fdd0 2023-11-27T20:44:26.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.905+0000 7f4f4cff9640 1 -- 172.21.15.91:0/3967121298 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38003d00 con 0x7f4f5006fdd0 2023-11-27T20:44:26.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.905+0000 7f4f5653c640 1 -- 172.21.15.91:0/3967121298 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f501eaac0 con 0x7f4f5006fdd0 2023-11-27T20:44:26.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.905+0000 7f4f5653c640 1 -- 172.21.15.91:0/3967121298 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f501ed6c0 con 0x7f4f5006fdd0 2023-11-27T20:44:26.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.906+0000 7f4f5653c640 1 -- 172.21.15.91:0/3967121298 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f500aab00 con 0x7f4f5006fdd0 2023-11-27T20:44:26.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.907+0000 7f4f4cff9640 1 -- 172.21.15.91:0/3967121298 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4f38040450 con 0x7f4f5006fdd0 2023-11-27T20:44:26.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.908+0000 7f4f4cff9640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4f3006b1f0 0x7f4f3006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:26.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.908+0000 7f4f4cff9640 1 -- 172.21.15.91:0/3967121298 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f4f380abce0 con 0x7f4f5006fdd0 2023-11-27T20:44:26.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.908+0000 7f4f4ffff640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4f3006b1f0 0x7f4f3006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:26.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.909+0000 7f4f4ffff640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4f3006b1f0 0x7f4f3006d6b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4f40007fd0 tx=0x7f4f40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:26.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:26.912+0000 7f4f4cff9640 1 -- 172.21.15.91:0/3967121298 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4f500aab00 con 0x7f4f5006fdd0 2023-11-27T20:44:27.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.103+0000 7f4f5653c640 1 -- 172.21.15.91:0/3967121298 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f500aab00 con 0x7f4f5006fdd0 2023-11-27T20:44:27.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.104+0000 7f4f4cff9640 1 -- 172.21.15.91:0/3967121298 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f500aab00 con 0x7f4f5006fdd0 2023-11-27T20:44:27.106 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:44:27.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 -- 172.21.15.91:0/3967121298 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4f3006b1f0 msgr2=0x7f4f3006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4f3006b1f0 0x7f4f3006d6b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4f40007fd0 tx=0x7f4f40009040 comp rx=0 tx=0).stop 2023-11-27T20:44:27.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 -- 172.21.15.91:0/3967121298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f5006fdd0 msgr2=0x7f4f50149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f5006fdd0 0x7f4f50149040 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009ac0 tx=0x7f4f38004730 comp rx=0 tx=0).stop 2023-11-27T20:44:27.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 -- 172.21.15.91:0/3967121298 shutdown_connections 2023-11-27T20:44:27.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f501581a0 0x7f4f50149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f5006fdd0 0x7f4f50149040 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4f3006b1f0 0x7f4f3006d6b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 --2- 172.21.15.91:0/3967121298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f3c0047c0 0x7f4f50157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 -- 172.21.15.91:0/3967121298 >> 172.21.15.91:0/3967121298 conn(0x7f4f500c7e30 msgr2=0x7f4f501505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:27.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 -- 172.21.15.91:0/3967121298 shutdown_connections 2023-11-27T20:44:27.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.107+0000 7f4f5653c640 1 -- 172.21.15.91:0/3967121298 wait complete. 2023-11-27T20:44:27.128 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:44:27.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.333+0000 7f707744f640 1 Processor -- start 2023-11-27T20:44:27.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.334+0000 7f707744f640 1 -- start start 2023-11-27T20:44:27.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.335+0000 7f707744f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707006d0a0 0x7f7070152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.335+0000 7f707744f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f70700c3ea0 0x7f70700c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.335+0000 7f707744f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70700c64a0 con 0x7f707014fd30 2023-11-27T20:44:27.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.335+0000 7f707744f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70700c5c00 con 0x7f70700c3ea0 2023-11-27T20:44:27.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.335+0000 7f707744f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70700c5ee0 con 0x7f707006d0a0 2023-11-27T20:44:27.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.335+0000 7f70759ec640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f70700c3ea0 0x7f70700c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.335+0000 7f70759ec640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f70700c3ea0 0x7f70700c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48390/0 (socket says 172.21.15.91:48390) 2023-11-27T20:44:27.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.335+0000 7f70759ec640 1 -- 172.21.15.91:0/2903896163 learned_addr learned my addr 172.21.15.91:0/2903896163 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:27.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.336+0000 7f70749ea640 1 --2- 172.21.15.91:0/2903896163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707006d0a0 0x7f7070152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.336+0000 7f70759ec640 1 -- 172.21.15.91:0/2903896163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707006d0a0 msgr2=0x7f7070152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:27.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.336+0000 7f70759ec640 1 --2- 172.21.15.91:0/2903896163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707006d0a0 0x7f7070152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.336+0000 7f70759ec640 1 -- 172.21.15.91:0/2903896163 >> v1:172.21.15.183:6789/0 conn(0x7f707014fd30 legacy=0x7f70700a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:27.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.336+0000 7f70759ec640 1 -- 172.21.15.91:0/2903896163 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70700c61c0 con 0x7f70700c3ea0 2023-11-27T20:44:27.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.337+0000 7f70759ec640 1 --2- 172.21.15.91:0/2903896163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 0x7f70700c4330 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7068009e50 tx=0x7f706802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854086a5898ff091 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:27.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.337+0000 7f7067fff640 1 -- 172.21.15.91:0/2903896163 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706802ca70 con 0x7f70700c3ea0 2023-11-27T20:44:27.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.337+0000 7f7067fff640 1 -- 172.21.15.91:0/2903896163 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706802cbd0 con 0x7f70700c3ea0 2023-11-27T20:44:27.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.337+0000 7f7067fff640 1 -- 172.21.15.91:0/2903896163 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70680343f0 con 0x7f70700c3ea0 2023-11-27T20:44:27.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.338+0000 7f707744f640 1 -- 172.21.15.91:0/2903896163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 msgr2=0x7f70700c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.338+0000 7f707744f640 1 --2- 172.21.15.91:0/2903896163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 0x7f70700c4330 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7068009e50 tx=0x7f706802bed0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.338+0000 7f707744f640 1 -- 172.21.15.91:0/2903896163 shutdown_connections 2023-11-27T20:44:27.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.338+0000 7f707744f640 1 --2- 172.21.15.91:0/2903896163 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 0x7f70700c4330 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.338+0000 7f707744f640 1 --2- 172.21.15.91:0/2903896163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707006d0a0 0x7f7070152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.338+0000 7f707744f640 1 -- 172.21.15.91:0/2903896163 >> 172.21.15.91:0/2903896163 conn(0x7f707006a500 msgr2=0x7f707006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:27.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.338+0000 7f707744f640 1 -- 172.21.15.91:0/2903896163 shutdown_connections 2023-11-27T20:44:27.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.338+0000 7f707744f640 1 -- 172.21.15.91:0/2903896163 wait complete. 2023-11-27T20:44:27.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.340+0000 7f707744f640 1 Processor -- start 2023-11-27T20:44:27.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.340+0000 7f707744f640 1 -- start start 2023-11-27T20:44:27.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f707744f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707006d0a0 0x7f7070155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f707744f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 0x7f707014f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f707744f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f707014fd30 0x7f707014f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f707744f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70701dd2d0 con 0x7f70700c3ea0 2023-11-27T20:44:27.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f707744f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70700aa7f0 con 0x7f707014fd30 2023-11-27T20:44:27.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f707744f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70700aa2f0 con 0x7f707006d0a0 2023-11-27T20:44:27.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f70749ea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 0x7f707014f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f70749ea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 0x7f707014f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48398/0 (socket says 172.21.15.91:48398) 2023-11-27T20:44:27.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f70749ea640 1 -- 172.21.15.91:0/3506558713 learned_addr learned my addr 172.21.15.91:0/3506558713 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:27.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f70749ea640 1 -- 172.21.15.91:0/3506558713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707006d0a0 msgr2=0x7f7070155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f70749ea640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707006d0a0 0x7f7070155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f70749ea640 1 -- 172.21.15.91:0/3506558713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f707014fd30 msgr2=0x7f707014f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f70759ec640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f707014fd30 0x7f707014f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.341+0000 7f70749ea640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f707014fd30 0x7f707014f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.342+0000 7f70749ea640 1 -- 172.21.15.91:0/3506558713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7068009b30 con 0x7f70700c3ea0 2023-11-27T20:44:27.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.342+0000 7f70749ea640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 0x7f707014f000 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f706000c7c0 tx=0x7f706000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:27.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.342+0000 7f7065ffb640 1 -- 172.21.15.91:0/3506558713 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060007820 con 0x7f70700c3ea0 2023-11-27T20:44:27.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.342+0000 7f7065ffb640 1 -- 172.21.15.91:0/3506558713 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7060007980 con 0x7f70700c3ea0 2023-11-27T20:44:27.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.342+0000 7f7065ffb640 1 -- 172.21.15.91:0/3506558713 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060007cf0 con 0x7f70700c3ea0 2023-11-27T20:44:27.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.342+0000 7f707744f640 1 -- 172.21.15.91:0/3506558713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70700a9530 con 0x7f70700c3ea0 2023-11-27T20:44:27.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.342+0000 7f707744f640 1 -- 172.21.15.91:0/3506558713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70700a9af0 con 0x7f70700c3ea0 2023-11-27T20:44:27.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.343+0000 7f707744f640 1 -- 172.21.15.91:0/3506558713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7070068350 con 0x7f70700c3ea0 2023-11-27T20:44:27.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.345+0000 7f7065ffb640 1 -- 172.21.15.91:0/3506558713 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f70600113f0 con 0x7f70700c3ea0 2023-11-27T20:44:27.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.345+0000 7f7065ffb640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f705406b1f0 0x7f705406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.345+0000 7f7065ffb640 1 -- 172.21.15.91:0/3506558713 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f7060089a10 con 0x7f70700c3ea0 2023-11-27T20:44:27.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.346+0000 7f70751eb640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f705406b1f0 0x7f705406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.346+0000 7f70751eb640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f705406b1f0 0x7f705406d6b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f706c003cc0 tx=0x7f706c0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:27.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.350+0000 7f7065ffb640 1 -- 172.21.15.91:0/3506558713 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7060054440 con 0x7f70700c3ea0 2023-11-27T20:44:27.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.540+0000 7f707744f640 1 -- 172.21.15.91:0/3506558713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70700c66d0 con 0x7f70700c3ea0 2023-11-27T20:44:27.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.541+0000 7f7065ffb640 1 -- 172.21.15.91:0/3506558713 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v61) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7060057a60 con 0x7f70700c3ea0 2023-11-27T20:44:27.543 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:44:27.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 -- 172.21.15.91:0/3506558713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f705406b1f0 msgr2=0x7f705406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f705406b1f0 0x7f705406d6b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f706c003cc0 tx=0x7f706c0079b0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 -- 172.21.15.91:0/3506558713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 msgr2=0x7f707014f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 0x7f707014f000 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f706000c7c0 tx=0x7f706000cc80 comp rx=0 tx=0).stop 2023-11-27T20:44:27.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 -- 172.21.15.91:0/3506558713 shutdown_connections 2023-11-27T20:44:27.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f705406b1f0 0x7f705406d6b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f707014fd30 0x7f707014f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70700c3ea0 0x7f707014f000 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 --2- 172.21.15.91:0/3506558713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f707006d0a0 0x7f7070155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 -- 172.21.15.91:0/3506558713 >> 172.21.15.91:0/3506558713 conn(0x7f707006a500 msgr2=0x7f7070152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:27.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 -- 172.21.15.91:0/3506558713 shutdown_connections 2023-11-27T20:44:27.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.544+0000 7f707744f640 1 -- 172.21.15.91:0/3506558713 wait complete. 2023-11-27T20:44:27.564 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:44:27.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.778+0000 7f56d09d6640 1 Processor -- start 2023-11-27T20:44:27.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.778+0000 7f56d09d6640 1 -- start start 2023-11-27T20:44:27.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.779+0000 7f56d09d6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc0c0440 0x7f56cc0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.779+0000 7f56d09d6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f56cc072310 0x7f56cc0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.779+0000 7f56d09d6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc071e80 con 0x7f56cc14c2e0 2023-11-27T20:44:27.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.779+0000 7f56d09d6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc071470 con 0x7f56cc072310 2023-11-27T20:44:27.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.779+0000 7f56d09d6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc14c6c0 con 0x7f56cc0c0440 2023-11-27T20:44:27.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.780+0000 7f56cad9d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f56cc14c2e0 0x7f56cc152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45494/0 (socket says 172.21.15.91:45494) 2023-11-27T20:44:27.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.780+0000 7f56cad9d640 1 -- 172.21.15.91:0/1809613964 learned_addr learned my addr 172.21.15.91:0/1809613964 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:27.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.780+0000 7f56ca59c640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc0c0440 0x7f56cc0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.780+0000 7f56cb59e640 1 --2- 172.21.15.91:0/1809613964 >> v2:172.21.15.183:3300/0 conn(0x7f56cc072310 0x7f56cc0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.780+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840546676 0 0) 0x7f56cc071e80 con 0x7f56cc14c2e0 2023-11-27T20:44:27.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.780+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b4003520 con 0x7f56cc14c2e0 2023-11-27T20:44:27.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3420044302 0 0) 0x7f56b4003520 con 0x7f56cc14c2e0 2023-11-27T20:44:27.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc0c0440 msgr2=0x7f56cc0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:27.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc0c0440 0x7f56cc0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 >> v2:172.21.15.183:3300/0 conn(0x7f56cc072310 msgr2=0x7f56cc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:27.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 --2- 172.21.15.91:0/1809613964 >> v2:172.21.15.183:3300/0 conn(0x7f56cc072310 0x7f56cc0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc06fdc0 con 0x7f56cc14c2e0 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f56bc001670 con 0x7f56cc14c2e0 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 >> v1:172.21.15.91:6789/0 conn(0x7f56cc14c2e0 legacy=0x7f56cc152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc0c0440 0x7f56b4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b4003ef0 0x7f56b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b4004d00 0x7f56b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc14c6c0 con 0x7f56b4004d00 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b400ba90 con 0x7f56b4003ef0 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b400bc50 con 0x7f56cc0c0440 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56cb59e640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b4004d00 0x7f56b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56cad9d640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc0c0440 0x7f56b4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.781+0000 7f56cb59e640 1 -- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc0c0440 msgr2=0x7f56b4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:27.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.782+0000 7f56ca59c640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b4003ef0 0x7f56b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.782+0000 7f56cb59e640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc0c0440 0x7f56b4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.782+0000 7f56cb59e640 1 -- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b4003ef0 msgr2=0x7f56b40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:27.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.782+0000 7f56cb59e640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b4003ef0 0x7f56b40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.782+0000 7f56cb59e640 1 -- 172.21.15.91:0/1809613964 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b4003520 con 0x7f56b4004d00 2023-11-27T20:44:27.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.782+0000 7f56cad9d640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc0c0440 0x7f56b4003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:27.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.783+0000 7f56cb59e640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b4004d00 0x7f56b4005180 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f56c4007360 tx=0x7f56b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658841e7931e33cf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:27.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.783+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c402ccf0 con 0x7f56b4004d00 2023-11-27T20:44:27.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.783+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c402ce50 con 0x7f56b4004d00 2023-11-27T20:44:27.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.783+0000 7f56c9d9b640 1 -- 172.21.15.91:0/1809613964 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4034660 con 0x7f56b4004d00 2023-11-27T20:44:27.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.783+0000 7f56d09d6640 1 -- 172.21.15.91:0/1809613964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b4004d00 msgr2=0x7f56b4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.783+0000 7f56d09d6640 1 --2- 172.21.15.91:0/1809613964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b4004d00 0x7f56b4005180 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f56c4007360 tx=0x7f56b40057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.784+0000 7f56cb59e640 1 -- 172.21.15.91:0/1809613964 reap_dead start 2023-11-27T20:44:27.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.784+0000 7f56d09d6640 1 -- 172.21.15.91:0/1809613964 shutdown_connections 2023-11-27T20:44:27.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.784+0000 7f56d09d6640 1 -- 172.21.15.91:0/1809613964 >> 172.21.15.91:0/1809613964 conn(0x7f56cc0a77f0 msgr2=0x7f56cc0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:27.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.784+0000 7f56d09d6640 1 -- 172.21.15.91:0/1809613964 shutdown_connections 2023-11-27T20:44:27.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.784+0000 7f56d09d6640 1 -- 172.21.15.91:0/1809613964 wait complete. 2023-11-27T20:44:27.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.785+0000 7f56d09d6640 1 Processor -- start 2023-11-27T20:44:27.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.786+0000 7f56d09d6640 1 -- start start 2023-11-27T20:44:27.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.786+0000 7f56d09d6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b4004d00 0x7f56cc155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.786+0000 7f56d09d6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc06dcd0 0x7f56cc1ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56d09d6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1ea8c0 0x7f56cc1e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56d09d6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc14fc20 con 0x7f56cc06dcd0 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56d09d6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc1ea430 con 0x7f56b4004d00 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56d09d6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc14f940 con 0x7f56cc1ea8c0 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56ca59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc06dcd0 0x7f56cc1ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56ca59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc06dcd0 0x7f56cc1ed230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48426/0 (socket says 172.21.15.91:48426) 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56ca59c640 1 -- 172.21.15.91:0/1403152896 learned_addr learned my addr 172.21.15.91:0/1403152896 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56ca59c640 1 -- 172.21.15.91:0/1403152896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1ea8c0 msgr2=0x7f56cc1e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56ca59c640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1ea8c0 0x7f56cc1e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56ca59c640 1 -- 172.21.15.91:0/1403152896 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b4004d00 msgr2=0x7f56cc155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56ca59c640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b4004d00 0x7f56cc155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56ca59c640 1 -- 172.21.15.91:0/1403152896 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc1e9de0 con 0x7f56cc06dcd0 2023-11-27T20:44:27.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.787+0000 7f56ca59c640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc06dcd0 0x7f56cc1ed230 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f56c0010860 tx=0x7f56c0010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:27.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.788+0000 7f56b37fe640 1 -- 172.21.15.91:0/1403152896 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0009610 con 0x7f56cc06dcd0 2023-11-27T20:44:27.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.788+0000 7f56b37fe640 1 -- 172.21.15.91:0/1403152896 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c000ea80 con 0x7f56cc06dcd0 2023-11-27T20:44:27.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.788+0000 7f56b37fe640 1 -- 172.21.15.91:0/1403152896 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c000ee10 con 0x7f56cc06dcd0 2023-11-27T20:44:27.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.788+0000 7f56d09d6640 1 -- 172.21.15.91:0/1403152896 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc1ea0c0 con 0x7f56cc06dcd0 2023-11-27T20:44:27.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.788+0000 7f56d09d6640 1 -- 172.21.15.91:0/1403152896 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc1e77f0 con 0x7f56cc06dcd0 2023-11-27T20:44:27.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.789+0000 7f56d09d6640 1 -- 172.21.15.91:0/1403152896 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc1e9c40 con 0x7f56cc06dcd0 2023-11-27T20:44:27.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.790+0000 7f56b37fe640 1 -- 172.21.15.91:0/1403152896 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f56c001c400 con 0x7f56cc06dcd0 2023-11-27T20:44:27.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.791+0000 7f56b37fe640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f56b806b1c0 0x7f56b806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:27.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.791+0000 7f56b37fe640 1 -- 172.21.15.91:0/1403152896 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f56c008a300 con 0x7f56cc06dcd0 2023-11-27T20:44:27.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.792+0000 7f56cad9d640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f56b806b1c0 0x7f56b806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:27.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.792+0000 7f56cad9d640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f56b806b1c0 0x7f56b806d680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f56bc000f60 tx=0x7f56bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:27.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.796+0000 7f56b37fe640 1 -- 172.21.15.91:0/1403152896 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f56cc1e9c40 con 0x7f56cc06dcd0 2023-11-27T20:44:27.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.987+0000 7f56d09d6640 1 -- 172.21.15.91:0/1403152896 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f56cc1e9c40 con 0x7f56cc06dcd0 2023-11-27T20:44:27.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.988+0000 7f56b37fe640 1 -- 172.21.15.91:0/1403152896 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v61) v1 ==== 101+0+11 (secure 0 0 0) 0x7f56cc1e9c40 con 0x7f56cc06dcd0 2023-11-27T20:44:27.989 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:44:27.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.990+0000 7f56d09d6640 1 -- 172.21.15.91:0/1403152896 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f56b806b1c0 msgr2=0x7f56b806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.990+0000 7f56d09d6640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f56b806b1c0 0x7f56b806d680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f56bc000f60 tx=0x7f56bc009040 comp rx=0 tx=0).stop 2023-11-27T20:44:27.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.990+0000 7f56d09d6640 1 -- 172.21.15.91:0/1403152896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc06dcd0 msgr2=0x7f56cc1ed230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:27.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.990+0000 7f56d09d6640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc06dcd0 0x7f56cc1ed230 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f56c0010860 tx=0x7f56c0010d20 comp rx=0 tx=0).stop 2023-11-27T20:44:27.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.991+0000 7f56d09d6640 1 -- 172.21.15.91:0/1403152896 shutdown_connections 2023-11-27T20:44:27.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.991+0000 7f56d09d6640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1ea8c0 0x7f56cc1e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.991+0000 7f56d09d6640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56cc06dcd0 0x7f56cc1ed230 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.991+0000 7f56d09d6640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f56b806b1c0 0x7f56b806d680 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.991+0000 7f56d09d6640 1 --2- 172.21.15.91:0/1403152896 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b4004d00 0x7f56cc155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:27.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.991+0000 7f56d09d6640 1 -- 172.21.15.91:0/1403152896 >> 172.21.15.91:0/1403152896 conn(0x7f56cc0a77f0 msgr2=0x7f56cc0c24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:27.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.991+0000 7f56d09d6640 1 -- 172.21.15.91:0/1403152896 shutdown_connections 2023-11-27T20:44:27.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:27.991+0000 7f56d09d6640 1 -- 172.21.15.91:0/1403152896 wait complete. 2023-11-27T20:44:28.012 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:44:28.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.207+0000 7f042a948640 1 Processor -- start 2023-11-27T20:44:28.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.208+0000 7f042a948640 1 -- start start 2023-11-27T20:44:28.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.209+0000 7f042a948640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04240c1500 0x7f04240c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.209+0000 7f042a948640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04240c06c0 con 0x7f0424155490 2023-11-27T20:44:28.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.209+0000 7f042a948640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04240c1020 con 0x7f04240a9b40 2023-11-27T20:44:28.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.209+0000 7f042a948640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04240a5820 con 0x7f04240c1500 2023-11-27T20:44:28.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.209+0000 7f0423fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f0424155490 0x7f04240a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45498/0 (socket says 172.21.15.91:45498) 2023-11-27T20:44:28.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.209+0000 7f0423fff640 1 -- 172.21.15.91:0/2340153719 learned_addr learned my addr 172.21.15.91:0/2340153719 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:28.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.209+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035651037 0 0) 0x7f04240c06c0 con 0x7f0424155490 2023-11-27T20:44:28.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.209+0000 7f0428ee5640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04240c1500 0x7f04240c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:28.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.209+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0410003520 con 0x7f0424155490 2023-11-27T20:44:28.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3994908596 0 0) 0x7f0410003520 con 0x7f0424155490 2023-11-27T20:44:28.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04240c1500 msgr2=0x7f04240c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:28.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04240c1500 0x7f04240c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 >> v1:172.21.15.183:6789/0 conn(0x7f04240a9b40 legacy=0x7f04240c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:28.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240c0910 con 0x7f0424155490 2023-11-27T20:44:28.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f04140019f0 con 0x7f0424155490 2023-11-27T20:44:28.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0428ee5640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04240c1500 0x7f04240c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:44:28.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 >> v1:172.21.15.91:6789/0 conn(0x7f0424155490 legacy=0x7f04240a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:28.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04100039a0 0x7f0410003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04240c1500 0x7f04100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0410004d00 0x7f0410005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041000ba90 con 0x7f04100039a0 2023-11-27T20:44:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041000bc00 con 0x7f0410004d00 2023-11-27T20:44:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041000bdc0 con 0x7f04240c1500 2023-11-27T20:44:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.210+0000 7f0423fff640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04100039a0 0x7f0410003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:28.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.211+0000 7f04237fe640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04240c1500 0x7f04100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:28.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.211+0000 7f0423fff640 1 -- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04240c1500 msgr2=0x7f04100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:28.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.211+0000 7f0423fff640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04240c1500 0x7f04100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.211+0000 7f0423fff640 1 -- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0410004d00 msgr2=0x7f0410005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:28.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.211+0000 7f0423fff640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0410004d00 0x7f0410005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.211+0000 7f0423fff640 1 -- 172.21.15.91:0/2340153719 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0410003520 con 0x7f04100039a0 2023-11-27T20:44:28.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.212+0000 7f0423fff640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04100039a0 0x7f0410003dc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f041400a410 tx=0x7f04100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5760c74fc81086 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:28.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.212+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04140072d0 con 0x7f04100039a0 2023-11-27T20:44:28.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.212+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414031070 con 0x7f04100039a0 2023-11-27T20:44:28.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.212+0000 7f0422ffd640 1 -- 172.21.15.91:0/2340153719 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414007670 con 0x7f04100039a0 2023-11-27T20:44:28.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.212+0000 7f042a948640 1 -- 172.21.15.91:0/2340153719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04100039a0 msgr2=0x7f0410003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:28.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.212+0000 7f042a948640 1 --2- 172.21.15.91:0/2340153719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04100039a0 0x7f0410003dc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f041400a410 tx=0x7f04100057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.213+0000 7f0428ee5640 1 -- 172.21.15.91:0/2340153719 reap_dead start 2023-11-27T20:44:28.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.213+0000 7f042a948640 1 -- 172.21.15.91:0/2340153719 shutdown_connections 2023-11-27T20:44:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.213+0000 7f042a948640 1 -- 172.21.15.91:0/2340153719 >> 172.21.15.91:0/2340153719 conn(0x7f042406a500 msgr2=0x7f042406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.213+0000 7f042a948640 1 -- 172.21.15.91:0/2340153719 shutdown_connections 2023-11-27T20:44:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.213+0000 7f042a948640 1 -- 172.21.15.91:0/2340153719 wait complete. 2023-11-27T20:44:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.215+0000 7f042a948640 1 Processor -- start 2023-11-27T20:44:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.215+0000 7f042a948640 1 -- start start 2023-11-27T20:44:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f042a948640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04100039a0 0x7f04241ea930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f042a948640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0424151980 0x7f04240a7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f042a948640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04241dba90 0x7f0424150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f042a948640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04241ea510 con 0x7f0424151980 2023-11-27T20:44:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f042a948640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04241516a0 con 0x7f04100039a0 2023-11-27T20:44:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f042a948640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04241e9e50 con 0x7f04241dba90 2023-11-27T20:44:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f04237fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0424151980 0x7f04240a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f04237fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0424151980 0x7f04240a7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48446/0 (socket says 172.21.15.91:48446) 2023-11-27T20:44:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f04237fe640 1 -- 172.21.15.91:0/1115063083 learned_addr learned my addr 172.21.15.91:0/1115063083 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f04237fe640 1 -- 172.21.15.91:0/1115063083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04241dba90 msgr2=0x7f0424150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f04237fe640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04241dba90 0x7f0424150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f04237fe640 1 -- 172.21.15.91:0/1115063083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04100039a0 msgr2=0x7f04241ea930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:28.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f04237fe640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04100039a0 0x7f04241ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.216+0000 7f04237fe640 1 -- 172.21.15.91:0/1115063083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04241ea130 con 0x7f0424151980 2023-11-27T20:44:28.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.217+0000 7f04237fe640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0424151980 0x7f04240a7070 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f040c00e4d0 tx=0x7f040c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:28.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.217+0000 7f0420ff9640 1 -- 172.21.15.91:0/1115063083 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0053a0 con 0x7f0424151980 2023-11-27T20:44:28.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.217+0000 7f0420ff9640 1 -- 172.21.15.91:0/1115063083 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c0035f0 con 0x7f0424151980 2023-11-27T20:44:28.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.217+0000 7f0420ff9640 1 -- 172.21.15.91:0/1115063083 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0039a0 con 0x7f0424151980 2023-11-27T20:44:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.217+0000 7f042a948640 1 -- 172.21.15.91:0/1115063083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0424151e00 con 0x7f0424151980 2023-11-27T20:44:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.217+0000 7f042a948640 1 -- 172.21.15.91:0/1115063083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04241df090 con 0x7f0424151980 2023-11-27T20:44:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.218+0000 7f042a948640 1 -- 172.21.15.91:0/1115063083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04241ea2c0 con 0x7f0424151980 2023-11-27T20:44:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.219+0000 7f0420ff9640 1 -- 172.21.15.91:0/1115063083 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f040c003b00 con 0x7f0424151980 2023-11-27T20:44:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.220+0000 7f0420ff9640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f040406b1f0 0x7f040406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.220+0000 7f0420ff9640 1 -- 172.21.15.91:0/1115063083 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f040c089b60 con 0x7f0424151980 2023-11-27T20:44:28.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.220+0000 7f0423fff640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f040406b1f0 0x7f040406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:28.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.221+0000 7f0423fff640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f040406b1f0 0x7f040406d6b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0414036000 tx=0x7f0414031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:28.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.225+0000 7f0420ff9640 1 -- 172.21.15.91:0/1115063083 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f040c0544f0 con 0x7f0424151980 2023-11-27T20:44:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.431+0000 7f042a948640 1 -- 172.21.15.91:0/1115063083 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0424068350 con 0x7f0424151980 2023-11-27T20:44:28.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.432+0000 7f0420ff9640 1 -- 172.21.15.91:0/1115063083 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f040c003db0 con 0x7f0424151980 2023-11-27T20:44:28.433 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:44:28.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.434+0000 7f042a948640 1 -- 172.21.15.91:0/1115063083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f040406b1f0 msgr2=0x7f040406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:28.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.434+0000 7f042a948640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f040406b1f0 0x7f040406d6b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0414036000 tx=0x7f0414031000 comp rx=0 tx=0).stop 2023-11-27T20:44:28.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.434+0000 7f042a948640 1 -- 172.21.15.91:0/1115063083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0424151980 msgr2=0x7f04240a7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:28.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.435+0000 7f042a948640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0424151980 0x7f04240a7070 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f040c00e4d0 tx=0x7f040c00e990 comp rx=0 tx=0).stop 2023-11-27T20:44:28.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.435+0000 7f042a948640 1 -- 172.21.15.91:0/1115063083 shutdown_connections 2023-11-27T20:44:28.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.435+0000 7f042a948640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04241dba90 0x7f0424150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.435+0000 7f042a948640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0424151980 0x7f04240a7070 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.435+0000 7f042a948640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f040406b1f0 0x7f040406d6b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.435+0000 7f042a948640 1 --2- 172.21.15.91:0/1115063083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04100039a0 0x7f04241ea930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.435+0000 7f042a948640 1 -- 172.21.15.91:0/1115063083 >> 172.21.15.91:0/1115063083 conn(0x7f042406a500 msgr2=0x7f0424071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:28.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.435+0000 7f042a948640 1 -- 172.21.15.91:0/1115063083 shutdown_connections 2023-11-27T20:44:28.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.435+0000 7f042a948640 1 -- 172.21.15.91:0/1115063083 wait complete. 2023-11-27T20:44:28.456 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-27T20:44:28.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:28.456 DEBUG:teuthology.orchestra.run.smithi091:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-27T20:44:28.560 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:44:28.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:28.560 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-27T20:44:28.608 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:44:28.609 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:28.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-27T20:44:28.652 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:44:28.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.911+0000 7f50ef59e640 1 Processor -- start 2023-11-27T20:44:28.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.911+0000 7f50ef59e640 1 -- start start 2023-11-27T20:44:28.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ef59e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f50f014e7c0 0x7f50f00c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ef59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f00c4c00 0x7f50f00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ef59e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f0158a60 con 0x7f50f00ca990 2023-11-27T20:44:28.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ef59e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f00c5b10 con 0x7f50f014e7c0 2023-11-27T20:44:28.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ef59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f0157ca0 con 0x7f50f00c4c00 2023-11-27T20:44:28.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ee59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f50f014e7c0 0x7f50f00c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:28.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ee59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f50f014e7c0 0x7f50f00c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48452/0 (socket says 172.21.15.91:48452) 2023-11-27T20:44:28.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ee59c640 1 -- 172.21.15.91:0/758995428 learned_addr learned my addr 172.21.15.91:0/758995428 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:28.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ee59c640 1 -- 172.21.15.91:0/758995428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f00c4c00 msgr2=0x7f50f00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:28.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ee59c640 1 --2- 172.21.15.91:0/758995428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f00c4c00 0x7f50f00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ee59c640 1 -- 172.21.15.91:0/758995428 >> v1:172.21.15.183:6789/0 conn(0x7f50f00ca990 legacy=0x7f50f0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:28.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.913+0000 7f50ee59c640 1 -- 172.21.15.91:0/758995428 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f0157f80 con 0x7f50f014e7c0 2023-11-27T20:44:28.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.915+0000 7f50ee59c640 1 --2- 172.21.15.91:0/758995428 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 0x7f50f00c46c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009870 tx=0x7f50e002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291ce1d929ec0132 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:28.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.915+0000 7f50edd9b640 1 -- 172.21.15.91:0/758995428 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e0031740 con 0x7f50f014e7c0 2023-11-27T20:44:28.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.915+0000 7f50edd9b640 1 -- 172.21.15.91:0/758995428 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e00318a0 con 0x7f50f014e7c0 2023-11-27T20:44:28.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.915+0000 7f50edd9b640 1 -- 172.21.15.91:0/758995428 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e0031c30 con 0x7f50f014e7c0 2023-11-27T20:44:28.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.915+0000 7f50ef59e640 1 -- 172.21.15.91:0/758995428 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 msgr2=0x7f50f00c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:28.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.915+0000 7f50ef59e640 1 --2- 172.21.15.91:0/758995428 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 0x7f50f00c46c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009870 tx=0x7f50e002b7e0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.916+0000 7f50ef59e640 1 -- 172.21.15.91:0/758995428 shutdown_connections 2023-11-27T20:44:28.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.916+0000 7f50ef59e640 1 --2- 172.21.15.91:0/758995428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f00c4c00 0x7f50f00ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.916+0000 7f50ef59e640 1 --2- 172.21.15.91:0/758995428 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 0x7f50f00c46c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.916+0000 7f50ef59e640 1 -- 172.21.15.91:0/758995428 >> 172.21.15.91:0/758995428 conn(0x7f50f00abf00 msgr2=0x7f50f00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:28.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.916+0000 7f50ef59e640 1 -- 172.21.15.91:0/758995428 shutdown_connections 2023-11-27T20:44:28.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.916+0000 7f50ef59e640 1 -- 172.21.15.91:0/758995428 wait complete. 2023-11-27T20:44:28.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.917+0000 7f50ef59e640 1 Processor -- start 2023-11-27T20:44:28.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.918+0000 7f50ef59e640 1 -- start start 2023-11-27T20:44:28.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.918+0000 7f50ef59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f00c4c00 0x7f50f00bff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.918+0000 7f50ef59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f00ca990 0x7f50f0154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.918+0000 7f50ef59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 0x7f50f0155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.918+0000 7f50ef59e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00c3d30 con 0x7f50f014e7c0 2023-11-27T20:44:28.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.918+0000 7f50ef59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00bea70 con 0x7f50f00c4c00 2023-11-27T20:44:28.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.918+0000 7f50ef59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00bed50 con 0x7f50f00ca990 2023-11-27T20:44:28.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.919+0000 7f50eed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 0x7f50f0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:28.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.919+0000 7f50eed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 0x7f50f0155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48466/0 (socket says 172.21.15.91:48466) 2023-11-27T20:44:28.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.919+0000 7f50eed9d640 1 -- 172.21.15.91:0/121020618 learned_addr learned my addr 172.21.15.91:0/121020618 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:28.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.919+0000 7f50eed9d640 1 -- 172.21.15.91:0/121020618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f00ca990 msgr2=0x7f50f0154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:28.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.919+0000 7f50eed9d640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f00ca990 0x7f50f0154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.919+0000 7f50eed9d640 1 -- 172.21.15.91:0/121020618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f00c4c00 msgr2=0x7f50f00bff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:28.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.919+0000 7f50eed9d640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f00c4c00 0x7f50f00bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:28.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.919+0000 7f50eed9d640 1 -- 172.21.15.91:0/121020618 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e00094d0 con 0x7f50f014e7c0 2023-11-27T20:44:28.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.920+0000 7f50eed9d640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 0x7f50f0155070 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f50e800c780 tx=0x7f50e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:28.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.920+0000 7f50e6ffd640 1 -- 172.21.15.91:0/121020618 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8003d80 con 0x7f50f014e7c0 2023-11-27T20:44:28.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.920+0000 7f50e6ffd640 1 -- 172.21.15.91:0/121020618 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e800ce90 con 0x7f50f014e7c0 2023-11-27T20:44:28.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.920+0000 7f50e6ffd640 1 -- 172.21.15.91:0/121020618 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e80052b0 con 0x7f50f014e7c0 2023-11-27T20:44:28.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.920+0000 7f50ef59e640 1 -- 172.21.15.91:0/121020618 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f00bf030 con 0x7f50f014e7c0 2023-11-27T20:44:28.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.920+0000 7f50ef59e640 1 -- 172.21.15.91:0/121020618 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f01eb100 con 0x7f50f014e7c0 2023-11-27T20:44:28.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.921+0000 7f50ef59e640 1 -- 172.21.15.91:0/121020618 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f004e840 con 0x7f50f014e7c0 2023-11-27T20:44:28.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.922+0000 7f50e6ffd640 1 -- 172.21.15.91:0/121020618 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f50e8005410 con 0x7f50f014e7c0 2023-11-27T20:44:28.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.923+0000 7f50e6ffd640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f50d006b1c0 0x7f50d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:28.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.924+0000 7f50e6ffd640 1 -- 172.21.15.91:0/121020618 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f50e8089370 con 0x7f50f014e7c0 2023-11-27T20:44:28.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.924+0000 7f50ee59c640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f50d006b1c0 0x7f50d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:28.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.925+0000 7f50ee59c640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f50d006b1c0 0x7f50d006d680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f50e0035000 tx=0x7f50e0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:28.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:28.928+0000 7f50e6ffd640 1 -- 172.21.15.91:0/121020618 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f50e8053be0 con 0x7f50f014e7c0 2023-11-27T20:44:29.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.154+0000 7f50ef59e640 1 -- 172.21.15.91:0/121020618 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f50f00c7c40 con 0x7f50f014e7c0 2023-11-27T20:44:29.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.155+0000 7f50e6ffd640 1 -- 172.21.15.91:0/121020618 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+149 (secure 0 0 0) 0x7f50e8017070 con 0x7f50f014e7c0 2023-11-27T20:44:29.156 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:44:29.156 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-27T20:44:29.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 -- 172.21.15.91:0/121020618 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f50d006b1c0 msgr2=0x7f50d006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:29.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f50d006b1c0 0x7f50d006d680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f50e0035000 tx=0x7f50e0030000 comp rx=0 tx=0).stop 2023-11-27T20:44:29.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 -- 172.21.15.91:0/121020618 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 msgr2=0x7f50f0155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:29.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 0x7f50f0155070 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f50e800c780 tx=0x7f50e800cc40 comp rx=0 tx=0).stop 2023-11-27T20:44:29.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 -- 172.21.15.91:0/121020618 shutdown_connections 2023-11-27T20:44:29.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50f014e7c0 0x7f50f0155070 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:29.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f00ca990 0x7f50f0154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:29.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f50d006b1c0 0x7f50d006d680 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:29.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 --2- 172.21.15.91:0/121020618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f00c4c00 0x7f50f00bff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:29.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 -- 172.21.15.91:0/121020618 >> 172.21.15.91:0/121020618 conn(0x7f50f00abf00 msgr2=0x7f50f014caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:29.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 -- 172.21.15.91:0/121020618 shutdown_connections 2023-11-27T20:44:29.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:29.157+0000 7f50ef59e640 1 -- 172.21.15.91:0/121020618 wait complete. 2023-11-27T20:44:29.177 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-27T20:44:29.177 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:44:29.177 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-27T20:44:29.177 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-27T20:44:29.177 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:44:29.177 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-27T20:44:29.177 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:44:29.178 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.OcWavdnfcl 2023-11-27T20:44:29.178 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-27T20:44:29.229 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.FtRiMKICcw 2023-11-27T20:44:29.229 DEBUG:teuthology.orchestra.run.smithi091:> sudo cp /tmp/tmp.OcWavdnfcl /tmp/tmp.FtRiMKICcw 2023-11-27T20:44:29.320 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.FtRiMKICcw 2023-11-27T20:44:29.482 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.FtRiMKICcw is 245B 2023-11-27T20:44:29.543 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.FtRiMKICcw 2023-11-27T20:44:29.593 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCo/2RlzjcFIRAA6CAAN8BdP+PWaUAriMDQ1Q== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-27T20:44:29.593 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:44:29.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:29.593 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-27T20:44:29.645 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:44:29.645 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-27T20:44:29.646 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 42152sec preferred_lft 42152sec 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:29.647 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::c0c6:34ff:feb5:e67/64 scope link 2023-11-27T20:44:29.648 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:29.648 INFO:teuthology.orchestra.run.smithi091.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:44:29.648 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:44:29.648 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::d8e3:6ff:fe8b:3b7f/64 scope link 2023-11-27T20:44:29.648 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:44:29.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:29.649 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:44:29.739 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-27T20:44:29.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:29.744 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-27T20:44:29.799 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-27T20:44:29.799 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:44:29.799 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:44:29.799 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:44:29.799 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:44:29.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:29.800 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:44:29.800 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:44:29.800 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:44:29.800 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:44:29.800 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:44:29.800 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:44:29.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:29.984 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T20:44:30.036 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T20:44:30.037 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:44:30.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:30.037 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-11-27T20:44:30.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:44:30.131 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T20:44:30.188 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:44:30.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:44:30.188 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:44:30.241 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:44:30.241 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/tmp/tmp.OcWavdnfcl of=/dev/stdout 2023-11-27T20:44:30.293 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:44:30.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:30.294 DEBUG:teuthology.orchestra.run.smithi091:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQCo/2RlzjcFIRAA6CAAN8BdP+PWaUAriMDQ1Q==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:44:30.435 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,secret=AQCo/2RlzjcFIRAA6CAAN8BdP+PWaUAriMDQ1Q==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:44:30.435 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-27T20:44:30.435 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:44:30.435 INFO:teuthology.orchestra.run.smithi091.stdout:keyring.get_secret failed 2023-11-27T20:44:30.456 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,secret=AQCo/2RlzjcFIRAA6CAAN8BdP+PWaUAriMDQ1Q==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:44:30.456 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-27T20:44:30.456 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:44:30.456 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:44:30.457 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:44:30.457 INFO:teuthology.orchestra.run.smithi091.stdout:keyring.get_secret failed 2023-11-27T20:44:30.488 INFO:teuthology.orchestra.run.smithi091.stderr:mount error 13 = Permission denied 2023-11-27T20:44:30.489 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,secret=AQCo/2RlzjcFIRAA6CAAN8BdP+PWaUAriMDQ1Q==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:44:30.489 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-27T20:44:30.489 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:44:30.490 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:44:30.490 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:44:30.490 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:44:30.490 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:44:30.490 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:44:30.495 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-27T20:44:30.496 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-11-27T20:44:30.496 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-27T20:44:30.496 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:44:30.604 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:44:30.727 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-27T20:44:30.727 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:44:30.728 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:30.785 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-27T20:44:30.786 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:44:30.786 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:30.844 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:44:30.845 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:44:30.895 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:31.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.116+0000 7fd086a87640 1 Processor -- start 2023-11-27T20:44:31.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.116+0000 7fd086a87640 1 -- start start 2023-11-27T20:44:31.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.117+0000 7fd086a87640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd080155490 0x7fd0800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.117+0000 7fd086a87640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0800c1500 0x7fd0800a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.117+0000 7fd086a87640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0800c06c0 con 0x7fd0800c4080 2023-11-27T20:44:31.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.117+0000 7fd086a87640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0800a5820 con 0x7fd080155490 2023-11-27T20:44:31.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.117+0000 7fd086a87640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800c1020 con 0x7fd0800c1500 2023-11-27T20:44:31.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.118+0000 7fd084823640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd080155490 0x7fd0800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:31.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.118+0000 7fd085024640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd0800c4080 0x7fd0800c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45514/0 (socket says 172.21.15.91:45514) 2023-11-27T20:44:31.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.118+0000 7fd085024640 1 -- 172.21.15.91:0/2882746403 learned_addr learned my addr 172.21.15.91:0/2882746403 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:31.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.118+0000 7fd084823640 1 -- 172.21.15.91:0/2882746403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0800c1500 msgr2=0x7fd0800a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:31.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.118+0000 7fd07ffff640 1 --2- 172.21.15.91:0/2882746403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0800c1500 0x7fd0800a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:31.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.118+0000 7fd07f7fe640 1 -- 172.21.15.91:0/2882746403 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776860850 0 0) 0x7fd0800c06c0 con 0x7fd0800c4080 2023-11-27T20:44:31.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.118+0000 7fd084823640 1 --2- 172.21.15.91:0/2882746403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0800c1500 0x7fd0800a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.118+0000 7fd084823640 1 -- 172.21.15.91:0/2882746403 >> v1:172.21.15.91:6789/0 conn(0x7fd0800c4080 legacy=0x7fd0800c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.118+0000 7fd084823640 1 -- 172.21.15.91:0/2882746403 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800c0910 con 0x7fd080155490 2023-11-27T20:44:31.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.118+0000 7fd07ffff640 1 --2- 172.21.15.91:0/2882746403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0800c1500 0x7fd0800a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:31.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.120+0000 7fd084823640 1 --2- 172.21.15.91:0/2882746403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd080155490 0x7fd0800a51b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd0740097a0 tx=0x7fd07402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb968cc323903d28 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:31.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.120+0000 7fd07f7fe640 1 -- 172.21.15.91:0/2882746403 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074031780 con 0x7fd080155490 2023-11-27T20:44:31.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.120+0000 7fd07f7fe640 1 -- 172.21.15.91:0/2882746403 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0740318e0 con 0x7fd080155490 2023-11-27T20:44:31.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.120+0000 7fd07f7fe640 1 -- 172.21.15.91:0/2882746403 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074031c70 con 0x7fd080155490 2023-11-27T20:44:31.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.120+0000 7fd086a87640 1 -- 172.21.15.91:0/2882746403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd080155490 msgr2=0x7fd0800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.120+0000 7fd086a87640 1 --2- 172.21.15.91:0/2882746403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd080155490 0x7fd0800a51b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd0740097a0 tx=0x7fd07402b820 comp rx=0 tx=0).stop 2023-11-27T20:44:31.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.121+0000 7fd086a87640 1 -- 172.21.15.91:0/2882746403 shutdown_connections 2023-11-27T20:44:31.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.121+0000 7fd086a87640 1 --2- 172.21.15.91:0/2882746403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0800c1500 0x7fd0800a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.121+0000 7fd086a87640 1 --2- 172.21.15.91:0/2882746403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd080155490 0x7fd0800a51b0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.121+0000 7fd086a87640 1 -- 172.21.15.91:0/2882746403 >> 172.21.15.91:0/2882746403 conn(0x7fd08006a500 msgr2=0x7fd08006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:31.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.121+0000 7fd086a87640 1 -- 172.21.15.91:0/2882746403 shutdown_connections 2023-11-27T20:44:31.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.121+0000 7fd086a87640 1 -- 172.21.15.91:0/2882746403 wait complete. 2023-11-27T20:44:31.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.122+0000 7fd086a87640 1 Processor -- start 2023-11-27T20:44:31.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.123+0000 7fd086a87640 1 -- start start 2023-11-27T20:44:31.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.123+0000 7fd086a87640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0800c1500 0x7fd08009ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.123+0000 7fd086a87640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0800c4080 0x7fd0801511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.123+0000 7fd086a87640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd080155490 0x7fd080151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.123+0000 7fd086a87640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08009b590 con 0x7fd0800c4080 2023-11-27T20:44:31.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.123+0000 7fd086a87640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd080151c40 con 0x7fd080155490 2023-11-27T20:44:31.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.123+0000 7fd086a87640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800bfcc0 con 0x7fd0800c1500 2023-11-27T20:44:31.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.124+0000 7fd07ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0800c4080 0x7fd0801511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:31.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.124+0000 7fd07ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0800c4080 0x7fd0801511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48484/0 (socket says 172.21.15.91:48484) 2023-11-27T20:44:31.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.124+0000 7fd07ffff640 1 -- 172.21.15.91:0/668529423 learned_addr learned my addr 172.21.15.91:0/668529423 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:31.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.124+0000 7fd07ffff640 1 -- 172.21.15.91:0/668529423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0800c1500 msgr2=0x7fd08009ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.124+0000 7fd07ffff640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0800c1500 0x7fd08009ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.124+0000 7fd07ffff640 1 -- 172.21.15.91:0/668529423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd080155490 msgr2=0x7fd080151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.124+0000 7fd07ffff640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd080155490 0x7fd080151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.124+0000 7fd07ffff640 1 -- 172.21.15.91:0/668529423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd074009400 con 0x7fd0800c4080 2023-11-27T20:44:31.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.125+0000 7fd07ffff640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0800c4080 0x7fd0801511c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00c7f0 tx=0x7fd06c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:31.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.125+0000 7fd07d7fa640 1 -- 172.21.15.91:0/668529423 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c007a30 con 0x7fd0800c4080 2023-11-27T20:44:31.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.125+0000 7fd07d7fa640 1 -- 172.21.15.91:0/668529423 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c007b90 con 0x7fd0800c4080 2023-11-27T20:44:31.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.125+0000 7fd07d7fa640 1 -- 172.21.15.91:0/668529423 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c00ce40 con 0x7fd0800c4080 2023-11-27T20:44:31.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.125+0000 7fd086a87640 1 -- 172.21.15.91:0/668529423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0800aa840 con 0x7fd0800c4080 2023-11-27T20:44:31.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.125+0000 7fd086a87640 1 -- 172.21.15.91:0/668529423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0800aaab0 con 0x7fd0800c4080 2023-11-27T20:44:31.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.126+0000 7fd086a87640 1 -- 172.21.15.91:0/668529423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd080068350 con 0x7fd0800c4080 2023-11-27T20:44:31.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.127+0000 7fd07d7fa640 1 -- 172.21.15.91:0/668529423 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd06c0113f0 con 0x7fd0800c4080 2023-11-27T20:44:31.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.128+0000 7fd07d7fa640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd06406b1c0 0x7fd06406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.129+0000 7fd07d7fa640 1 -- 172.21.15.91:0/668529423 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fd06c089f60 con 0x7fd0800c4080 2023-11-27T20:44:31.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.129+0000 7fd084823640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd06406b1c0 0x7fd06406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:31.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.129+0000 7fd084823640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd06406b1c0 0x7fd06406d680 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd074036000 tx=0x7fd074030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:31.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.133+0000 7fd07d7fa640 1 -- 172.21.15.91:0/668529423 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd06c0548f0 con 0x7fd0800c4080 2023-11-27T20:44:31.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.323+0000 7fd086a87640 1 -- 172.21.15.91:0/668529423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0800c3e60 con 0x7fd0800c4080 2023-11-27T20:44:31.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.328+0000 7fd07d7fa640 1 -- 172.21.15.91:0/668529423 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+20342 (secure 0 0 0) 0x7fd06c01f090 con 0x7fd0800c4080 2023-11-27T20:44:31.328 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:31.328 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":61,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:18.243029+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:31.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.330+0000 7fd086a87640 1 -- 172.21.15.91:0/668529423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd06406b1c0 msgr2=0x7fd06406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.330+0000 7fd086a87640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd06406b1c0 0x7fd06406d680 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd074036000 tx=0x7fd074030000 comp rx=0 tx=0).stop 2023-11-27T20:44:31.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.330+0000 7fd086a87640 1 -- 172.21.15.91:0/668529423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0800c4080 msgr2=0x7fd0801511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.330+0000 7fd086a87640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0800c4080 0x7fd0801511c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00c7f0 tx=0x7fd06c00cbf0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.330+0000 7fd086a87640 1 -- 172.21.15.91:0/668529423 shutdown_connections 2023-11-27T20:44:31.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.330+0000 7fd086a87640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd06406b1c0 0x7fd06406d680 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.330+0000 7fd086a87640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd080155490 0x7fd080151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.330+0000 7fd086a87640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0800c4080 0x7fd0801511c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.330+0000 7fd086a87640 1 --2- 172.21.15.91:0/668529423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0800c1500 0x7fd08009ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.330+0000 7fd086a87640 1 -- 172.21.15.91:0/668529423 >> 172.21.15.91:0/668529423 conn(0x7fd08006a500 msgr2=0x7fd080071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:31.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.331+0000 7fd086a87640 1 -- 172.21.15.91:0/668529423 shutdown_connections 2023-11-27T20:44:31.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.331+0000 7fd086a87640 1 -- 172.21.15.91:0/668529423 wait complete. 2023-11-27T20:44:31.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:43:50.043742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:43:51.176510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:44:06.059576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:44:06.989345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:44:31.352 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:44:31.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.570+0000 7f40f5e32640 1 Processor -- start 2023-11-27T20:44:31.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.571+0000 7f40f5e32640 1 -- start start 2023-11-27T20:44:31.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.572+0000 7f40f5e32640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f40f014faf0 0x7f40f006e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.572+0000 7f40f5e32640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40f00ab850 0x7f40f0152370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.572+0000 7f40f5e32640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f00aae20 con 0x7f40f01528b0 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.572+0000 7f40f5e32640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f00c2fe0 con 0x7f40f014faf0 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.572+0000 7f40f5e32640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00a99e0 con 0x7f40f00ab850 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.572+0000 7f40ef7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f40f014faf0 0x7f40f006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.572+0000 7f40ef7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f40f014faf0 0x7f40f006e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48486/0 (socket says 172.21.15.91:48486) 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.572+0000 7f40ef7fe640 1 -- 172.21.15.91:0/4132947524 learned_addr learned my addr 172.21.15.91:0/4132947524 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.573+0000 7f40ef7fe640 1 -- 172.21.15.91:0/4132947524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40f00ab850 msgr2=0x7f40f0152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.573+0000 7f40ef7fe640 1 --2- 172.21.15.91:0/4132947524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40f00ab850 0x7f40f0152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.573+0000 7f40ef7fe640 1 -- 172.21.15.91:0/4132947524 >> v1:172.21.15.183:6789/0 conn(0x7f40f01528b0 legacy=0x7f40f006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:31.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.573+0000 7f40ef7fe640 1 -- 172.21.15.91:0/4132947524 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f00c2780 con 0x7f40f014faf0 2023-11-27T20:44:31.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.574+0000 7f40ef7fe640 1 --2- 172.21.15.91:0/4132947524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 0x7f40f006e950 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f40e0009e50 tx=0x7f40e002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83956e0180a86e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:31.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.574+0000 7f40ee7fc640 1 -- 172.21.15.91:0/4132947524 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e002c9e0 con 0x7f40f014faf0 2023-11-27T20:44:31.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.574+0000 7f40ee7fc640 1 -- 172.21.15.91:0/4132947524 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e002cb40 con 0x7f40f014faf0 2023-11-27T20:44:31.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.574+0000 7f40ee7fc640 1 -- 172.21.15.91:0/4132947524 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00343f0 con 0x7f40f014faf0 2023-11-27T20:44:31.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.575+0000 7f40f5e32640 1 -- 172.21.15.91:0/4132947524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 msgr2=0x7f40f006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.575+0000 7f40f5e32640 1 --2- 172.21.15.91:0/4132947524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 0x7f40f006e950 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f40e0009e50 tx=0x7f40e002be40 comp rx=0 tx=0).stop 2023-11-27T20:44:31.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.575+0000 7f40f5e32640 1 -- 172.21.15.91:0/4132947524 shutdown_connections 2023-11-27T20:44:31.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.575+0000 7f40f5e32640 1 --2- 172.21.15.91:0/4132947524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40f00ab850 0x7f40f0152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.575+0000 7f40f5e32640 1 --2- 172.21.15.91:0/4132947524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 0x7f40f006e950 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.575+0000 7f40f5e32640 1 -- 172.21.15.91:0/4132947524 >> 172.21.15.91:0/4132947524 conn(0x7f40f00c3120 msgr2=0x7f40f00c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:31.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.575+0000 7f40f5e32640 1 -- 172.21.15.91:0/4132947524 shutdown_connections 2023-11-27T20:44:31.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.575+0000 7f40f5e32640 1 -- 172.21.15.91:0/4132947524 wait complete. 2023-11-27T20:44:31.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.577+0000 7f40f5e32640 1 Processor -- start 2023-11-27T20:44:31.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.577+0000 7f40f5e32640 1 -- start start 2023-11-27T20:44:31.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.578+0000 7f40f5e32640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40f00ab850 0x7f40f00c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.578+0000 7f40f5e32640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 0x7f40f013de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.578+0000 7f40f5e32640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40f01528b0 0x7f40f013e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.578+0000 7f40f5e32640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0150510 con 0x7f40f014faf0 2023-11-27T20:44:31.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.578+0000 7f40f5e32640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0151b60 con 0x7f40f00ab850 2023-11-27T20:44:31.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.578+0000 7f40f5e32640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f013e8e0 con 0x7f40f01528b0 2023-11-27T20:44:31.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.578+0000 7f40eeffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 0x7f40f013de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:31.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.578+0000 7f40eeffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 0x7f40f013de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48496/0 (socket says 172.21.15.91:48496) 2023-11-27T20:44:31.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.578+0000 7f40eeffd640 1 -- 172.21.15.91:0/853624046 learned_addr learned my addr 172.21.15.91:0/853624046 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40eeffd640 1 -- 172.21.15.91:0/853624046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40f01528b0 msgr2=0x7f40f013e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40ef7fe640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40f00ab850 0x7f40f00c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40effff640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40f01528b0 0x7f40f013e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40eeffd640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40f01528b0 0x7f40f013e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40eeffd640 1 -- 172.21.15.91:0/853624046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40f00ab850 msgr2=0x7f40f00c1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40eeffd640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40f00ab850 0x7f40f00c1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40eeffd640 1 -- 172.21.15.91:0/853624046 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e0009b30 con 0x7f40f014faf0 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40eeffd640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 0x7f40f013de60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f40d800b4d0 tx=0x7f40d800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40e7fff640 1 -- 172.21.15.91:0/853624046 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8010870 con 0x7f40f014faf0 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40e7fff640 1 -- 172.21.15.91:0/853624046 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d80109d0 con 0x7f40f014faf0 2023-11-27T20:44:31.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40e7fff640 1 -- 172.21.15.91:0/853624046 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8010d80 con 0x7f40f014faf0 2023-11-27T20:44:31.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.579+0000 7f40f5e32640 1 -- 172.21.15.91:0/853624046 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f0152ff0 con 0x7f40f014faf0 2023-11-27T20:44:31.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.580+0000 7f40f5e32640 1 -- 172.21.15.91:0/853624046 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f0151510 con 0x7f40f014faf0 2023-11-27T20:44:31.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.581+0000 7f40f5e32640 1 -- 172.21.15.91:0/853624046 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f006d3a0 con 0x7f40f014faf0 2023-11-27T20:44:31.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.582+0000 7f40e7fff640 1 -- 172.21.15.91:0/853624046 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f40d800f3c0 con 0x7f40f014faf0 2023-11-27T20:44:31.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.583+0000 7f40e7fff640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f40d006b1f0 0x7f40d006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:31.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.583+0000 7f40e7fff640 1 -- 172.21.15.91:0/853624046 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f40d8089e10 con 0x7f40f014faf0 2023-11-27T20:44:31.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.583+0000 7f40ef7fe640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f40d006b1f0 0x7f40d006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:31.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.584+0000 7f40ef7fe640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f40d006b1f0 0x7f40d006d6b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f40e0035000 tx=0x7f40e0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:31.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.587+0000 7f40e7fff640 1 -- 172.21.15.91:0/853624046 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f40d8054720 con 0x7f40f014faf0 2023-11-27T20:44:31.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.779+0000 7f40f5e32640 1 -- 172.21.15.91:0/853624046 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40f0068350 con 0x7f40f014faf0 2023-11-27T20:44:31.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.780+0000 7f40e7fff640 1 -- 172.21.15.91:0/853624046 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40d801e0a0 con 0x7f40f014faf0 2023-11-27T20:44:31.781 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:44:31.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.782+0000 7f40f5e32640 1 -- 172.21.15.91:0/853624046 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f40d006b1f0 msgr2=0x7f40d006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f40d006b1f0 0x7f40d006d6b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f40e0035000 tx=0x7f40e0030000 comp rx=0 tx=0).stop 2023-11-27T20:44:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 -- 172.21.15.91:0/853624046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 msgr2=0x7f40f013de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 0x7f40f013de60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f40d800b4d0 tx=0x7f40d800b990 comp rx=0 tx=0).stop 2023-11-27T20:44:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 -- 172.21.15.91:0/853624046 shutdown_connections 2023-11-27T20:44:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40f01528b0 0x7f40f013e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40f014faf0 0x7f40f013de60 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f40d006b1f0 0x7f40d006d6b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 --2- 172.21.15.91:0/853624046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40f00ab850 0x7f40f00c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 -- 172.21.15.91:0/853624046 >> 172.21.15.91:0/853624046 conn(0x7f40f00c3120 msgr2=0x7f40f0155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 -- 172.21.15.91:0/853624046 shutdown_connections 2023-11-27T20:44:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:31.783+0000 7f40f5e32640 1 -- 172.21.15.91:0/853624046 wait complete. 2023-11-27T20:44:31.802 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:44:32.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.020+0000 7f0ae57b6640 1 Processor -- start 2023-11-27T20:44:32.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.021+0000 7f0ae57b6640 1 -- start start 2023-11-27T20:44:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.022+0000 7f0ae57b6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0ae00c1020 0x7f0ae0155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.022+0000 7f0ae57b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ae006e990 0x7f0ae01581a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.022+0000 7f0ae57b6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae006d770 con 0x7f0ae0151af0 2023-11-27T20:44:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.022+0000 7f0ae57b6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae006dd30 con 0x7f0ae00c1020 2023-11-27T20:44:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.022+0000 7f0ae57b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae006da50 con 0x7f0ae006e990 2023-11-27T20:44:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.022+0000 7f0ade7fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0ae00c1020 0x7f0ae0155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.022+0000 7f0ade7fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0ae00c1020 0x7f0ae0155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48500/0 (socket says 172.21.15.91:48500) 2023-11-27T20:44:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.023+0000 7f0ade7fc640 1 -- 172.21.15.91:0/421559944 learned_addr learned my addr 172.21.15.91:0/421559944 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:32.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.023+0000 7f0adf7fe640 1 --2- 172.21.15.91:0/421559944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ae006e990 0x7f0ae01581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.023+0000 7f0ade7fc640 1 -- 172.21.15.91:0/421559944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ae006e990 msgr2=0x7f0ae01581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:32.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.023+0000 7f0ade7fc640 1 --2- 172.21.15.91:0/421559944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ae006e990 0x7f0ae01581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.023+0000 7f0ade7fc640 1 -- 172.21.15.91:0/421559944 >> v1:172.21.15.183:6789/0 conn(0x7f0ae0151af0 legacy=0x7f0ae006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:32.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.023+0000 7f0ade7fc640 1 -- 172.21.15.91:0/421559944 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae0157c80 con 0x7f0ae00c1020 2023-11-27T20:44:32.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.023+0000 7f0adf7fe640 1 --2- 172.21.15.91:0/421559944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ae006e990 0x7f0ae01581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:32.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.024+0000 7f0ade7fc640 1 --2- 172.21.15.91:0/421559944 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae00c1020 0x7f0ae0155090 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009870 tx=0x7f0ac802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f58c351bb9d3693 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:32.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.024+0000 7f0addffb640 1 -- 172.21.15.91:0/421559944 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac80317c0 con 0x7f0ae00c1020 2023-11-27T20:44:32.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.024+0000 7f0addffb640 1 -- 172.21.15.91:0/421559944 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8031920 con 0x7f0ae00c1020 2023-11-27T20:44:32.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.024+0000 7f0addffb640 1 -- 172.21.15.91:0/421559944 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8031cb0 con 0x7f0ae00c1020 2023-11-27T20:44:32.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.025+0000 7f0ae57b6640 1 -- 172.21.15.91:0/421559944 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae00c1020 msgr2=0x7f0ae0155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.025+0000 7f0ae57b6640 1 --2- 172.21.15.91:0/421559944 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae00c1020 0x7f0ae0155090 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009870 tx=0x7f0ac802b860 comp rx=0 tx=0).stop 2023-11-27T20:44:32.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.025+0000 7f0ae57b6640 1 -- 172.21.15.91:0/421559944 shutdown_connections 2023-11-27T20:44:32.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.025+0000 7f0ae57b6640 1 --2- 172.21.15.91:0/421559944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ae006e990 0x7f0ae01581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.025+0000 7f0ae57b6640 1 --2- 172.21.15.91:0/421559944 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae00c1020 0x7f0ae0155090 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.025+0000 7f0ae57b6640 1 -- 172.21.15.91:0/421559944 >> 172.21.15.91:0/421559944 conn(0x7f0ae00c3120 msgr2=0x7f0ae00c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:32.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.025+0000 7f0ae57b6640 1 -- 172.21.15.91:0/421559944 shutdown_connections 2023-11-27T20:44:32.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.025+0000 7f0ae57b6640 1 -- 172.21.15.91:0/421559944 wait complete. 2023-11-27T20:44:32.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.027+0000 7f0ae57b6640 1 Processor -- start 2023-11-27T20:44:32.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.027+0000 7f0ae57b6640 1 -- start start 2023-11-27T20:44:32.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.028+0000 7f0ae57b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ae006e990 0x7f0ae00ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.028+0000 7f0ae57b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ae00c1020 0x7f0ae0071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.028+0000 7f0ae57b6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae0151af0 0x7f0ae00c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.028+0000 7f0ae57b6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00a9c50 con 0x7f0ae0151af0 2023-11-27T20:44:32.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.028+0000 7f0ae57b6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00a9920 con 0x7f0ae006e990 2023-11-27T20:44:32.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.028+0000 7f0ae57b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae0072aa0 con 0x7f0ae00c1020 2023-11-27T20:44:32.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.028+0000 7f0adf7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae0151af0 0x7f0ae00c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.028+0000 7f0adf7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae0151af0 0x7f0ae00c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48508/0 (socket says 172.21.15.91:48508) 2023-11-27T20:44:32.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.028+0000 7f0adf7fe640 1 -- 172.21.15.91:0/1191928250 learned_addr learned my addr 172.21.15.91:0/1191928250 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:32.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0adf7fe640 1 -- 172.21.15.91:0/1191928250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ae00c1020 msgr2=0x7f0ae0071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0adeffd640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ae006e990 0x7f0ae00ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0adf7fe640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ae00c1020 0x7f0ae0071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0adf7fe640 1 -- 172.21.15.91:0/1191928250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ae006e990 msgr2=0x7f0ae00ab3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0adf7fe640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ae006e990 0x7f0ae00ab3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0adf7fe640 1 -- 172.21.15.91:0/1191928250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac80094d0 con 0x7f0ae0151af0 2023-11-27T20:44:32.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0adf7fe640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae0151af0 0x7f0ae00c5e70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800c7f0 tx=0x7f0ad800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:32.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0ad77fe640 1 -- 172.21.15.91:0/1191928250 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8007820 con 0x7f0ae0151af0 2023-11-27T20:44:32.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0ad77fe640 1 -- 172.21.15.91:0/1191928250 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad8007980 con 0x7f0ae0151af0 2023-11-27T20:44:32.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0ae57b6640 1 -- 172.21.15.91:0/1191928250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae01eded0 con 0x7f0ae0151af0 2023-11-27T20:44:32.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0ad77fe640 1 -- 172.21.15.91:0/1191928250 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8007d70 con 0x7f0ae0151af0 2023-11-27T20:44:32.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.029+0000 7f0ae57b6640 1 -- 172.21.15.91:0/1191928250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae00ab8e0 con 0x7f0ae0151af0 2023-11-27T20:44:32.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.031+0000 7f0ae57b6640 1 -- 172.21.15.91:0/1191928250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae0068350 con 0x7f0ae0151af0 2023-11-27T20:44:32.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.032+0000 7f0ad77fe640 1 -- 172.21.15.91:0/1191928250 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0ad80113f0 con 0x7f0ae0151af0 2023-11-27T20:44:32.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.033+0000 7f0ad77fe640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac006b1c0 0x7f0ac006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.033+0000 7f0ad77fe640 1 -- 172.21.15.91:0/1191928250 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f0ad808a230 con 0x7f0ae0151af0 2023-11-27T20:44:32.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.033+0000 7f0adeffd640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac006b1c0 0x7f0ac006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.034+0000 7f0adeffd640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac006b1c0 0x7f0ac006d680 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00ac550 tx=0x7f0ad00072f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:32.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.038+0000 7f0ad77fe640 1 -- 172.21.15.91:0/1191928250 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0ad8054b30 con 0x7f0ae0151af0 2023-11-27T20:44:32.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.225+0000 7f0ae57b6640 1 -- 172.21.15.91:0/1191928250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ae006a7c0 con 0x7f0ae0151af0 2023-11-27T20:44:32.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.226+0000 7f0ad77fe640 1 -- 172.21.15.91:0/1191928250 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ad8058150 con 0x7f0ae0151af0 2023-11-27T20:44:32.226 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:44:32.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.228+0000 7f0ae57b6640 1 -- 172.21.15.91:0/1191928250 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac006b1c0 msgr2=0x7f0ac006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.228+0000 7f0ae57b6640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac006b1c0 0x7f0ac006d680 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00ac550 tx=0x7f0ad00072f0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.228+0000 7f0ae57b6640 1 -- 172.21.15.91:0/1191928250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae0151af0 msgr2=0x7f0ae00c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.228+0000 7f0ae57b6640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae0151af0 0x7f0ae00c5e70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800c7f0 tx=0x7f0ad800ccb0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.229+0000 7f0ae57b6640 1 -- 172.21.15.91:0/1191928250 shutdown_connections 2023-11-27T20:44:32.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.229+0000 7f0ae57b6640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ae0151af0 0x7f0ae00c5e70 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.229+0000 7f0ae57b6640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ae00c1020 0x7f0ae0071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.229+0000 7f0ae57b6640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ac006b1c0 0x7f0ac006d680 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.229+0000 7f0ae57b6640 1 --2- 172.21.15.91:0/1191928250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ae006e990 0x7f0ae00ab3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.229+0000 7f0ae57b6640 1 -- 172.21.15.91:0/1191928250 >> 172.21.15.91:0/1191928250 conn(0x7f0ae00c3120 msgr2=0x7f0ae006b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:32.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.229+0000 7f0ae57b6640 1 -- 172.21.15.91:0/1191928250 shutdown_connections 2023-11-27T20:44:32.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.229+0000 7f0ae57b6640 1 -- 172.21.15.91:0/1191928250 wait complete. 2023-11-27T20:44:32.248 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:44:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.457+0000 7f4391d5a640 1 Processor -- start 2023-11-27T20:44:32.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.457+0000 7f4391d5a640 1 -- start start 2023-11-27T20:44:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.459+0000 7f4391d5a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f438c14fd30 0x7f438c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.459+0000 7f4391d5a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f438c06d0a0 0x7f438c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.459+0000 7f4391d5a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438c0a5260 0x7f438c0c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.459+0000 7f4391d5a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c0c64a0 con 0x7f438c06d0a0 2023-11-27T20:44:32.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.459+0000 7f4391d5a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c0c5c00 con 0x7f438c14fd30 2023-11-27T20:44:32.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.459+0000 7f4391d5a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0c5ee0 con 0x7f438c0a5260 2023-11-27T20:44:32.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.459+0000 7f4383fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f438c06d0a0 0x7f438c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.459+0000 7f4383fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f438c06d0a0 0x7f438c0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48522/0 (socket says 172.21.15.91:48522) 2023-11-27T20:44:32.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.459+0000 7f4383fff640 1 -- 172.21.15.91:0/1359357244 learned_addr learned my addr 172.21.15.91:0/1359357244 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:32.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.460+0000 7f438bfff640 1 --2- 172.21.15.91:0/1359357244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438c0a5260 0x7f438c0c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.460+0000 7f438b7fe640 1 --2- 172.21.15.91:0/1359357244 >> v2:172.21.15.183:3300/0 conn(0x7f438c14fd30 0x7f438c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.460+0000 7f4383fff640 1 -- 172.21.15.91:0/1359357244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438c0a5260 msgr2=0x7f438c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:32.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.460+0000 7f4383fff640 1 --2- 172.21.15.91:0/1359357244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438c0a5260 0x7f438c0c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.460+0000 7f4383fff640 1 -- 172.21.15.91:0/1359357244 >> v2:172.21.15.183:3300/0 conn(0x7f438c14fd30 msgr2=0x7f438c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:32.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.460+0000 7f4383fff640 1 --2- 172.21.15.91:0/1359357244 >> v2:172.21.15.183:3300/0 conn(0x7f438c14fd30 0x7f438c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.460+0000 7f4383fff640 1 -- 172.21.15.91:0/1359357244 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0c61c0 con 0x7f438c06d0a0 2023-11-27T20:44:32.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.461+0000 7f4383fff640 1 --2- 172.21.15.91:0/1359357244 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 0x7f438c0a4d20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f438c06b200 tx=0x7f437402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67439568eeff9d85 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:32.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.461+0000 7f438affd640 1 -- 172.21.15.91:0/1359357244 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374031870 con 0x7f438c06d0a0 2023-11-27T20:44:32.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.461+0000 7f438affd640 1 -- 172.21.15.91:0/1359357244 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43740319d0 con 0x7f438c06d0a0 2023-11-27T20:44:32.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.461+0000 7f438affd640 1 -- 172.21.15.91:0/1359357244 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374031d60 con 0x7f438c06d0a0 2023-11-27T20:44:32.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.462+0000 7f4391d5a640 1 -- 172.21.15.91:0/1359357244 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 msgr2=0x7f438c0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.462+0000 7f4391d5a640 1 --2- 172.21.15.91:0/1359357244 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 0x7f438c0a4d20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f438c06b200 tx=0x7f437402b910 comp rx=0 tx=0).stop 2023-11-27T20:44:32.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.462+0000 7f4391d5a640 1 -- 172.21.15.91:0/1359357244 shutdown_connections 2023-11-27T20:44:32.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.462+0000 7f4391d5a640 1 --2- 172.21.15.91:0/1359357244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438c0a5260 0x7f438c0c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.462+0000 7f4391d5a640 1 --2- 172.21.15.91:0/1359357244 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 0x7f438c0a4d20 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.462+0000 7f4391d5a640 1 --2- 172.21.15.91:0/1359357244 >> v2:172.21.15.183:3300/0 conn(0x7f438c14fd30 0x7f438c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.462+0000 7f4391d5a640 1 -- 172.21.15.91:0/1359357244 >> 172.21.15.91:0/1359357244 conn(0x7f438c06a500 msgr2=0x7f438c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:32.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.462+0000 7f4391d5a640 1 -- 172.21.15.91:0/1359357244 shutdown_connections 2023-11-27T20:44:32.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.462+0000 7f4391d5a640 1 -- 172.21.15.91:0/1359357244 wait complete. 2023-11-27T20:44:32.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.464+0000 7f4391d5a640 1 Processor -- start 2023-11-27T20:44:32.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.464+0000 7f4391d5a640 1 -- start start 2023-11-27T20:44:32.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.465+0000 7f4391d5a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 0x7f438c156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.465+0000 7f4391d5a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438c0a5260 0x7f438c1dce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.465+0000 7f4391d5a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f438c14fd30 0x7f438c0bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.465+0000 7f4391d5a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c1e89c0 con 0x7f438c06d0a0 2023-11-27T20:44:32.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.465+0000 7f4391d5a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c14ecb0 con 0x7f438c14fd30 2023-11-27T20:44:32.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.465+0000 7f4391d5a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c14ef00 con 0x7f438c0a5260 2023-11-27T20:44:32.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.465+0000 7f438b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 0x7f438c156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.465+0000 7f438b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 0x7f438c156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48524/0 (socket says 172.21.15.91:48524) 2023-11-27T20:44:32.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.465+0000 7f438b7fe640 1 -- 172.21.15.91:0/3907479118 learned_addr learned my addr 172.21.15.91:0/3907479118 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:32.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f438b7fe640 1 -- 172.21.15.91:0/3907479118 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438c0a5260 msgr2=0x7f438c1dce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f438b7fe640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438c0a5260 0x7f438c1dce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f438bfff640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f438c14fd30 0x7f438c0bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f438b7fe640 1 -- 172.21.15.91:0/3907479118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f438c14fd30 msgr2=0x7f438c0bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f438b7fe640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f438c14fd30 0x7f438c0bfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f438b7fe640 1 -- 172.21.15.91:0/3907479118 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43740094d0 con 0x7f438c06d0a0 2023-11-27T20:44:32.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f438b7fe640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 0x7f438c156240 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f437c00c7f0 tx=0x7f437c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:32.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f4388ff9640 1 -- 172.21.15.91:0/3907479118 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c004220 con 0x7f438c06d0a0 2023-11-27T20:44:32.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f4388ff9640 1 -- 172.21.15.91:0/3907479118 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c004380 con 0x7f438c06d0a0 2023-11-27T20:44:32.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f4391d5a640 1 -- 172.21.15.91:0/3907479118 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c1df580 con 0x7f438c06d0a0 2023-11-27T20:44:32.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f4388ff9640 1 -- 172.21.15.91:0/3907479118 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c007840 con 0x7f438c06d0a0 2023-11-27T20:44:32.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.466+0000 7f4391d5a640 1 -- 172.21.15.91:0/3907479118 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c156780 con 0x7f438c06d0a0 2023-11-27T20:44:32.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.468+0000 7f4391d5a640 1 -- 172.21.15.91:0/3907479118 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c068350 con 0x7f438c06d0a0 2023-11-27T20:44:32.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.468+0000 7f4388ff9640 1 -- 172.21.15.91:0/3907479118 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f437c007bb0 con 0x7f438c06d0a0 2023-11-27T20:44:32.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.469+0000 7f4388ff9640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f436c06b1c0 0x7f436c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.469+0000 7f4388ff9640 1 -- 172.21.15.91:0/3907479118 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f437c089cd0 con 0x7f438c06d0a0 2023-11-27T20:44:32.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.469+0000 7f4383fff640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f436c06b1c0 0x7f436c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.470+0000 7f4383fff640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f436c06b1c0 0x7f436c06d680 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4374036000 tx=0x7f4374030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:32.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.473+0000 7f4388ff9640 1 -- 172.21.15.91:0/3907479118 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f437c054660 con 0x7f438c06d0a0 2023-11-27T20:44:32.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.669+0000 7f4391d5a640 1 -- 172.21.15.91:0/3907479118 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f438c0c66d0 con 0x7f438c06d0a0 2023-11-27T20:44:32.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.670+0000 7f4388ff9640 1 -- 172.21.15.91:0/3907479118 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f437c01e020 con 0x7f438c06d0a0 2023-11-27T20:44:32.671 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:44:32.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 -- 172.21.15.91:0/3907479118 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f436c06b1c0 msgr2=0x7f436c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f436c06b1c0 0x7f436c06d680 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4374036000 tx=0x7f4374030000 comp rx=0 tx=0).stop 2023-11-27T20:44:32.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 -- 172.21.15.91:0/3907479118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 msgr2=0x7f438c156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 0x7f438c156240 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f437c00c7f0 tx=0x7f437c00ccb0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 -- 172.21.15.91:0/3907479118 shutdown_connections 2023-11-27T20:44:32.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f436c06b1c0 0x7f436c06d680 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f438c14fd30 0x7f438c0bfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438c0a5260 0x7f438c1dce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 --2- 172.21.15.91:0/3907479118 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f438c06d0a0 0x7f438c156240 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 -- 172.21.15.91:0/3907479118 >> 172.21.15.91:0/3907479118 conn(0x7f438c06a500 msgr2=0x7f438c0c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:32.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 -- 172.21.15.91:0/3907479118 shutdown_connections 2023-11-27T20:44:32.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.673+0000 7f4391d5a640 1 -- 172.21.15.91:0/3907479118 wait complete. 2023-11-27T20:44:32.692 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:44:32.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.908+0000 7f2722856640 1 Processor -- start 2023-11-27T20:44:32.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.909+0000 7f2722856640 1 -- start start 2023-11-27T20:44:32.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.910+0000 7f2722856640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f271c14fd30 0x7f271c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.910+0000 7f2722856640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f271c0c3ea0 0x7f271c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.910+0000 7f2722856640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271c0c64a0 con 0x7f271c06d0a0 2023-11-27T20:44:32.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.910+0000 7f2722856640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c0c5c00 con 0x7f271c0c3ea0 2023-11-27T20:44:32.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.910+0000 7f2722856640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c0c5ee0 con 0x7f271c14fd30 2023-11-27T20:44:32.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.910+0000 7f2720df3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f271c0c3ea0 0x7f271c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.910+0000 7f2713fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f271c06d0a0 0x7f271c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45526/0 (socket says 172.21.15.91:45526) 2023-11-27T20:44:32.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.910+0000 7f2720df3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f271c0c3ea0 0x7f271c0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48538/0 (socket says 172.21.15.91:48538) 2023-11-27T20:44:32.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.910+0000 7f2713fff640 1 -- 172.21.15.91:0/1723966093 learned_addr learned my addr 172.21.15.91:0/1723966093 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:32.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.911+0000 7f271bfff640 1 --2- 172.21.15.91:0/1723966093 >> v2:172.21.15.183:3300/0 conn(0x7f271c14fd30 0x7f271c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.911+0000 7f2720df3640 1 -- 172.21.15.91:0/1723966093 >> v2:172.21.15.183:3300/0 conn(0x7f271c14fd30 msgr2=0x7f271c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:32.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.911+0000 7f2720df3640 1 --2- 172.21.15.91:0/1723966093 >> v2:172.21.15.183:3300/0 conn(0x7f271c14fd30 0x7f271c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.911+0000 7f2720df3640 1 -- 172.21.15.91:0/1723966093 >> v1:172.21.15.91:6789/0 conn(0x7f271c06d0a0 legacy=0x7f271c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.911+0000 7f2720df3640 1 -- 172.21.15.91:0/1723966093 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0c61c0 con 0x7f271c0c3ea0 2023-11-27T20:44:32.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.911+0000 7f271bfff640 1 --2- 172.21.15.91:0/1723966093 >> v2:172.21.15.183:3300/0 conn(0x7f271c14fd30 0x7f271c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:44:32.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.912+0000 7f2720df3640 1 --2- 172.21.15.91:0/1723966093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c0c3ea0 0x7f271c0c4330 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f271c06b200 tx=0x7f271402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637c7ee476ed49d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:32.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.912+0000 7f271b7fe640 1 -- 172.21.15.91:0/1723966093 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271402cc70 con 0x7f271c0c3ea0 2023-11-27T20:44:32.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.912+0000 7f271b7fe640 1 -- 172.21.15.91:0/1723966093 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271402cdd0 con 0x7f271c0c3ea0 2023-11-27T20:44:32.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.912+0000 7f271b7fe640 1 -- 172.21.15.91:0/1723966093 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2714034660 con 0x7f271c0c3ea0 2023-11-27T20:44:32.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.913+0000 7f2722856640 1 -- 172.21.15.91:0/1723966093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c0c3ea0 msgr2=0x7f271c0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.913+0000 7f2722856640 1 --2- 172.21.15.91:0/1723966093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c0c3ea0 0x7f271c0c4330 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f271c06b200 tx=0x7f271402bec0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.913+0000 7f2722856640 1 -- 172.21.15.91:0/1723966093 shutdown_connections 2023-11-27T20:44:32.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.913+0000 7f2722856640 1 --2- 172.21.15.91:0/1723966093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c0c3ea0 0x7f271c0c4330 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.913+0000 7f2722856640 1 --2- 172.21.15.91:0/1723966093 >> v2:172.21.15.183:3300/0 conn(0x7f271c14fd30 0x7f271c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.913+0000 7f2722856640 1 -- 172.21.15.91:0/1723966093 >> 172.21.15.91:0/1723966093 conn(0x7f271c06a500 msgr2=0x7f271c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:32.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.913+0000 7f2722856640 1 -- 172.21.15.91:0/1723966093 shutdown_connections 2023-11-27T20:44:32.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.913+0000 7f2722856640 1 -- 172.21.15.91:0/1723966093 wait complete. 2023-11-27T20:44:32.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.915+0000 7f2722856640 1 Processor -- start 2023-11-27T20:44:32.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.915+0000 7f2722856640 1 -- start start 2023-11-27T20:44:32.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.916+0000 7f2722856640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271c06d0a0 0x7f271c1eb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.916+0000 7f2722856640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f271c0c3ea0 0x7f271c1ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.916+0000 7f2722856640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c14fd30 0x7f271c140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.916+0000 7f2722856640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c1ec3f0 con 0x7f271c14fd30 2023-11-27T20:44:32.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.916+0000 7f2722856640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c1dd9f0 con 0x7f271c0c3ea0 2023-11-27T20:44:32.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.916+0000 7f2722856640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0bb7d0 con 0x7f271c06d0a0 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.916+0000 7f2720df3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c14fd30 0x7f271c140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.916+0000 7f2720df3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c14fd30 0x7f271c140c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48554/0 (socket says 172.21.15.91:48554) 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.916+0000 7f2720df3640 1 -- 172.21.15.91:0/1906453641 learned_addr learned my addr 172.21.15.91:0/1906453641 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f2713fff640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f271c0c3ea0 0x7f271c1ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f271bfff640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271c06d0a0 0x7f271c1eb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f2720df3640 1 -- 172.21.15.91:0/1906453641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271c06d0a0 msgr2=0x7f271c1eb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f2720df3640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271c06d0a0 0x7f271c1eb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f2720df3640 1 -- 172.21.15.91:0/1906453641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f271c0c3ea0 msgr2=0x7f271c1ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f2720df3640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f271c0c3ea0 0x7f271c1ebeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f2720df3640 1 -- 172.21.15.91:0/1906453641 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714009a70 con 0x7f271c14fd30 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f271bfff640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271c06d0a0 0x7f271c1eb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:32.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f2720df3640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c14fd30 0x7f271c140c00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f271402c4d0 tx=0x7f2714004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:32.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f27197fa640 1 -- 172.21.15.91:0/1906453641 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271403e610 con 0x7f271c14fd30 2023-11-27T20:44:32.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f27197fa640 1 -- 172.21.15.91:0/1906453641 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271403e790 con 0x7f271c14fd30 2023-11-27T20:44:32.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f2722856640 1 -- 172.21.15.91:0/1906453641 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271c1dc6f0 con 0x7f271c14fd30 2023-11-27T20:44:32.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.917+0000 7f27197fa640 1 -- 172.21.15.91:0/1906453641 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271403eb40 con 0x7f271c14fd30 2023-11-27T20:44:32.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.918+0000 7f2722856640 1 -- 172.21.15.91:0/1906453641 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271c1dccb0 con 0x7f271c14fd30 2023-11-27T20:44:32.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.919+0000 7f2722856640 1 -- 172.21.15.91:0/1906453641 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271c068350 con 0x7f271c14fd30 2023-11-27T20:44:32.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.920+0000 7f27197fa640 1 -- 172.21.15.91:0/1906453641 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f271403b050 con 0x7f271c14fd30 2023-11-27T20:44:32.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.921+0000 7f27197fa640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f26fc06b1c0 0x7f26fc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:32.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.921+0000 7f27197fa640 1 -- 172.21.15.91:0/1906453641 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f27140ac6b0 con 0x7f271c14fd30 2023-11-27T20:44:32.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.921+0000 7f271bfff640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f26fc06b1c0 0x7f26fc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:32.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.922+0000 7f271bfff640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f26fc06b1c0 0x7f26fc06d680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f270c006fd0 tx=0x7f270c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:32.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:32.926+0000 7f27197fa640 1 -- 172.21.15.91:0/1906453641 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2714077040 con 0x7f271c14fd30 2023-11-27T20:44:33.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.114+0000 7f2722856640 1 -- 172.21.15.91:0/1906453641 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f271c06d540 con 0x7f271c14fd30 2023-11-27T20:44:33.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.115+0000 7f27197fa640 1 -- 172.21.15.91:0/1906453641 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v61) v1 ==== 105+0+11 (secure 0 0 0) 0x7f271407a660 con 0x7f271c14fd30 2023-11-27T20:44:33.116 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:44:33.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 -- 172.21.15.91:0/1906453641 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f26fc06b1c0 msgr2=0x7f26fc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f26fc06b1c0 0x7f26fc06d680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f270c006fd0 tx=0x7f270c008040 comp rx=0 tx=0).stop 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 -- 172.21.15.91:0/1906453641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c14fd30 msgr2=0x7f271c140c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c14fd30 0x7f271c140c00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f271402c4d0 tx=0x7f2714004a40 comp rx=0 tx=0).stop 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 -- 172.21.15.91:0/1906453641 shutdown_connections 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c14fd30 0x7f271c140c00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f26fc06b1c0 0x7f26fc06d680 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f271c0c3ea0 0x7f271c1ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 --2- 172.21.15.91:0/1906453641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271c06d0a0 0x7f271c1eb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 -- 172.21.15.91:0/1906453641 >> 172.21.15.91:0/1906453641 conn(0x7f271c06a500 msgr2=0x7f271c0706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 -- 172.21.15.91:0/1906453641 shutdown_connections 2023-11-27T20:44:33.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.118+0000 7f2722856640 1 -- 172.21.15.91:0/1906453641 wait complete. 2023-11-27T20:44:33.136 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:44:33.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.354+0000 7f4259cf3640 1 Processor -- start 2023-11-27T20:44:33.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.354+0000 7f4259cf3640 1 -- start start 2023-11-27T20:44:33.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.355+0000 7f4259cf3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f425413d0d0 0x7f425406e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.355+0000 7f4259cf3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f425413d6e0 0x7f425406e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.355+0000 7f4259cf3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f425413dc30 0x7f4254158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.355+0000 7f4259cf3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425406b350 con 0x7f425413d0d0 2023-11-27T20:44:33.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.355+0000 7f4259cf3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4254157cb0 con 0x7f425413d6e0 2023-11-27T20:44:33.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.355+0000 7f4259cf3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425406ef10 con 0x7f425413dc30 2023-11-27T20:44:33.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.356+0000 7f42537fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f425413d0d0 0x7f425406e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:33.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.356+0000 7f42537fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f425413d0d0 0x7f425406e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48556/0 (socket says 172.21.15.91:48556) 2023-11-27T20:44:33.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.356+0000 7f42537fe640 1 -- 172.21.15.91:0/2681002839 learned_addr learned my addr 172.21.15.91:0/2681002839 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:33.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.356+0000 7f424bfff640 1 --2- 172.21.15.91:0/2681002839 >> v2:172.21.15.183:3300/0 conn(0x7f425413d6e0 0x7f425406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:33.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.356+0000 7f42537fe640 1 -- 172.21.15.91:0/2681002839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f425413dc30 msgr2=0x7f4254158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:33.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.356+0000 7f42537fe640 1 --2- 172.21.15.91:0/2681002839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f425413dc30 0x7f4254158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.356+0000 7f42537fe640 1 -- 172.21.15.91:0/2681002839 >> v2:172.21.15.183:3300/0 conn(0x7f425413d6e0 msgr2=0x7f425406e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:33.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.356+0000 7f42537fe640 1 --2- 172.21.15.91:0/2681002839 >> v2:172.21.15.183:3300/0 conn(0x7f425413d6e0 0x7f425406e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.356+0000 7f42537fe640 1 -- 172.21.15.91:0/2681002839 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425406b0b0 con 0x7f425413d0d0 2023-11-27T20:44:33.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.357+0000 7f42537fe640 1 --2- 172.21.15.91:0/2681002839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 0x7f425406e200 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f42540ad1d0 tx=0x7f424402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab293ca193fb513 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:33.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4252ffd640 1 -- 172.21.15.91:0/2681002839 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244031860 con 0x7f425413d0d0 2023-11-27T20:44:33.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4252ffd640 1 -- 172.21.15.91:0/2681002839 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42440319c0 con 0x7f425413d0d0 2023-11-27T20:44:33.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4252ffd640 1 -- 172.21.15.91:0/2681002839 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244031d50 con 0x7f425413d0d0 2023-11-27T20:44:33.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4259cf3640 1 -- 172.21.15.91:0/2681002839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 msgr2=0x7f425406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4259cf3640 1 --2- 172.21.15.91:0/2681002839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 0x7f425406e200 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f42540ad1d0 tx=0x7f424402b900 comp rx=0 tx=0).stop 2023-11-27T20:44:33.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4259cf3640 1 -- 172.21.15.91:0/2681002839 shutdown_connections 2023-11-27T20:44:33.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4259cf3640 1 --2- 172.21.15.91:0/2681002839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f425413dc30 0x7f4254158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4259cf3640 1 --2- 172.21.15.91:0/2681002839 >> v2:172.21.15.183:3300/0 conn(0x7f425413d6e0 0x7f425406e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4259cf3640 1 --2- 172.21.15.91:0/2681002839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 0x7f425406e200 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4259cf3640 1 -- 172.21.15.91:0/2681002839 >> 172.21.15.91:0/2681002839 conn(0x7f42540c39e0 msgr2=0x7f42540c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:33.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4259cf3640 1 -- 172.21.15.91:0/2681002839 shutdown_connections 2023-11-27T20:44:33.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.358+0000 7f4259cf3640 1 -- 172.21.15.91:0/2681002839 wait complete. 2023-11-27T20:44:33.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.360+0000 7f4259cf3640 1 Processor -- start 2023-11-27T20:44:33.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.360+0000 7f4259cf3640 1 -- start start 2023-11-27T20:44:33.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.361+0000 7f4259cf3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 0x7f42540c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.361+0000 7f4259cf3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f425413d6e0 0x7f42541eb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.361+0000 7f4259cf3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f425413dc30 0x7f42541eb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.361+0000 7f4259cf3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4254139ab0 con 0x7f425413d0d0 2023-11-27T20:44:33.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.361+0000 7f4259cf3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4254151400 con 0x7f425413dc30 2023-11-27T20:44:33.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.361+0000 7f4259cf3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4254151650 con 0x7f425413d6e0 2023-11-27T20:44:33.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.361+0000 7f42537fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 0x7f42540c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:33.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.361+0000 7f42537fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 0x7f42540c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48572/0 (socket says 172.21.15.91:48572) 2023-11-27T20:44:33.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.361+0000 7f42537fe640 1 -- 172.21.15.91:0/981793339 learned_addr learned my addr 172.21.15.91:0/981793339 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:33.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f42537fe640 1 -- 172.21.15.91:0/981793339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f425413d6e0 msgr2=0x7f42541eb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f424bfff640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f425413d6e0 0x7f42541eb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f4253fff640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f425413dc30 0x7f42541eb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f42537fe640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f425413d6e0 0x7f42541eb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f42537fe640 1 -- 172.21.15.91:0/981793339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f425413dc30 msgr2=0x7f42541eb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f42537fe640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f425413dc30 0x7f42541eb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f42537fe640 1 -- 172.21.15.91:0/981793339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440094d0 con 0x7f425413d0d0 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f4253fff640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f425413dc30 0x7f42541eb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f42537fe640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 0x7f42540c5d70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f424402b940 tx=0x7f42440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f4250ff9640 1 -- 172.21.15.91:0/981793339 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244031850 con 0x7f425413d0d0 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f4250ff9640 1 -- 172.21.15.91:0/981793339 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42440443f0 con 0x7f425413d0d0 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.362+0000 7f4250ff9640 1 -- 172.21.15.91:0/981793339 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440447a0 con 0x7f425413d0d0 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.363+0000 7f4259cf3640 1 -- 172.21.15.91:0/981793339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4254155860 con 0x7f425413d0d0 2023-11-27T20:44:33.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.363+0000 7f4259cf3640 1 -- 172.21.15.91:0/981793339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4254155e20 con 0x7f425413d0d0 2023-11-27T20:44:33.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.364+0000 7f4259cf3640 1 -- 172.21.15.91:0/981793339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425404e840 con 0x7f425413d0d0 2023-11-27T20:44:33.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.365+0000 7f4250ff9640 1 -- 172.21.15.91:0/981793339 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4244044900 con 0x7f425413d0d0 2023-11-27T20:44:33.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.366+0000 7f4250ff9640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f423406b1c0 0x7f423406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.366+0000 7f4250ff9640 1 -- 172.21.15.91:0/981793339 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f42440ac480 con 0x7f425413d0d0 2023-11-27T20:44:33.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.366+0000 7f424bfff640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f423406b1c0 0x7f423406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:33.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.367+0000 7f424bfff640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f423406b1c0 0x7f423406d680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f42540c6c40 tx=0x7f423c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:33.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.370+0000 7f4250ff9640 1 -- 172.21.15.91:0/981793339 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4244076fd0 con 0x7f425413d0d0 2023-11-27T20:44:33.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.564+0000 7f4259cf3640 1 -- 172.21.15.91:0/981793339 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f4254068350 con 0x7f425413d0d0 2023-11-27T20:44:33.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.565+0000 7f4250ff9640 1 -- 172.21.15.91:0/981793339 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v61) v1 ==== 101+0+11 (secure 0 0 0) 0x7f424407a5f0 con 0x7f425413d0d0 2023-11-27T20:44:33.566 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:44:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 -- 172.21.15.91:0/981793339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f423406b1c0 msgr2=0x7f423406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f423406b1c0 0x7f423406d680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f42540c6c40 tx=0x7f423c008040 comp rx=0 tx=0).stop 2023-11-27T20:44:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 -- 172.21.15.91:0/981793339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 msgr2=0x7f42540c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 0x7f42540c5d70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f424402b940 tx=0x7f42440046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 -- 172.21.15.91:0/981793339 shutdown_connections 2023-11-27T20:44:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f423406b1c0 0x7f423406d680 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f425413dc30 0x7f42541eb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f425413d6e0 0x7f42541eb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 --2- 172.21.15.91:0/981793339 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f425413d0d0 0x7f42540c5d70 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 -- 172.21.15.91:0/981793339 >> 172.21.15.91:0/981793339 conn(0x7f42540c39e0 msgr2=0x7f425413a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:33.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 -- 172.21.15.91:0/981793339 shutdown_connections 2023-11-27T20:44:33.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.568+0000 7f4259cf3640 1 -- 172.21.15.91:0/981793339 wait complete. 2023-11-27T20:44:33.587 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:44:33.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.802+0000 7f0b03a3d640 1 Processor -- start 2023-11-27T20:44:33.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.802+0000 7f0b03a3d640 1 -- start start 2023-11-27T20:44:33.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.804+0000 7f0b03a3d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0afc14fd30 0x7f0afc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.804+0000 7f0b03a3d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0c64a0 con 0x7f0afc0c3ea0 2023-11-27T20:44:33.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.804+0000 7f0b03a3d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0c5c00 con 0x7f0afc06d0a0 2023-11-27T20:44:33.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.804+0000 7f0b03a3d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc0c5ee0 con 0x7f0afc14fd30 2023-11-27T20:44:33.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.804+0000 7f0b017d9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0afc14fd30 0x7f0afc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:33.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.804+0000 7f0b017d9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0afc14fd30 0x7f0afc152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48576/0 (socket says 172.21.15.91:48576) 2023-11-27T20:44:33.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.804+0000 7f0b017d9640 1 -- 172.21.15.91:0/638464740 learned_addr learned my addr 172.21.15.91:0/638464740 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:33.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.805+0000 7f0b017d9640 1 -- 172.21.15.91:0/638464740 >> v1:172.21.15.183:6789/0 conn(0x7f0afc06d0a0 legacy=0x7f0afc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:33.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.805+0000 7f0b017d9640 1 -- 172.21.15.91:0/638464740 >> v1:172.21.15.91:6789/0 conn(0x7f0afc0c3ea0 legacy=0x7f0afc0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.805+0000 7f0b017d9640 1 -- 172.21.15.91:0/638464740 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc0c61c0 con 0x7f0afc14fd30 2023-11-27T20:44:33.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.805+0000 7f0afbfff640 1 -- 172.21.15.91:0/638464740 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588901793 0 0) 0x7f0afc0c64a0 con 0x7f0afc0c3ea0 2023-11-27T20:44:33.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.806+0000 7f0b017d9640 1 --2- 172.21.15.91:0/638464740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 0x7f0afc152f20 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009e50 tx=0x7f0af002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b5c075b6081208 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:33.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.806+0000 7f0afbfff640 1 -- 172.21.15.91:0/638464740 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af002cb20 con 0x7f0afc14fd30 2023-11-27T20:44:33.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.806+0000 7f0afbfff640 1 -- 172.21.15.91:0/638464740 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af002cc80 con 0x7f0afc14fd30 2023-11-27T20:44:33.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.806+0000 7f0afbfff640 1 -- 172.21.15.91:0/638464740 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00343f0 con 0x7f0afc14fd30 2023-11-27T20:44:33.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.807+0000 7f0b03a3d640 1 -- 172.21.15.91:0/638464740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 msgr2=0x7f0afc152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.807+0000 7f0b03a3d640 1 --2- 172.21.15.91:0/638464740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 0x7f0afc152f20 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009e50 tx=0x7f0af002bf80 comp rx=0 tx=0).stop 2023-11-27T20:44:33.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.807+0000 7f0b03a3d640 1 -- 172.21.15.91:0/638464740 shutdown_connections 2023-11-27T20:44:33.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.807+0000 7f0b03a3d640 1 --2- 172.21.15.91:0/638464740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 0x7f0afc152f20 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.807+0000 7f0b03a3d640 1 -- 172.21.15.91:0/638464740 >> 172.21.15.91:0/638464740 conn(0x7f0afc06a500 msgr2=0x7f0afc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:33.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.807+0000 7f0b03a3d640 1 -- 172.21.15.91:0/638464740 shutdown_connections 2023-11-27T20:44:33.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.807+0000 7f0b03a3d640 1 -- 172.21.15.91:0/638464740 wait complete. 2023-11-27T20:44:33.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.809+0000 7f0b03a3d640 1 Processor -- start 2023-11-27T20:44:33.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.809+0000 7f0b03a3d640 1 -- start start 2023-11-27T20:44:33.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b03a3d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0afc06d0a0 0x7f0afc1ea350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b03a3d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0afc0c3ea0 0x7f0afc1e1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b03a3d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 0x7f0afc1ee080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b03a3d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc1eb3c0 con 0x7f0afc14fd30 2023-11-27T20:44:33.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b03a3d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc14bb80 con 0x7f0afc06d0a0 2023-11-27T20:44:33.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b03a3d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc1ed910 con 0x7f0afc0c3ea0 2023-11-27T20:44:33.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b01fda640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 0x7f0afc1ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:33.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b01fda640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 0x7f0afc1ee080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:48580/0 (socket says 172.21.15.91:48580) 2023-11-27T20:44:33.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b01fda640 1 -- 172.21.15.91:0/2815463065 learned_addr learned my addr 172.21.15.91:0/2815463065 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:33.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b01fda640 1 -- 172.21.15.91:0/2815463065 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0afc0c3ea0 msgr2=0x7f0afc1e1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.810+0000 7f0b01fda640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0afc0c3ea0 0x7f0afc1e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.811+0000 7f0b017d9640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0afc06d0a0 0x7f0afc1ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:33.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.811+0000 7f0b01fda640 1 -- 172.21.15.91:0/2815463065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0afc06d0a0 msgr2=0x7f0afc1ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:33.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.811+0000 7f0b01fda640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0afc06d0a0 0x7f0afc1ea350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:33.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.811+0000 7f0b01fda640 1 -- 172.21.15.91:0/2815463065 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af0009b30 con 0x7f0afc14fd30 2023-11-27T20:44:33.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.811+0000 7f0b01fda640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 0x7f0afc1ee080 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c430 tx=0x7f0af400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:33.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.811+0000 7f0af9ffb640 1 -- 172.21.15.91:0/2815463065 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40035f0 con 0x7f0afc14fd30 2023-11-27T20:44:33.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.811+0000 7f0af9ffb640 1 -- 172.21.15.91:0/2815463065 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af4003770 con 0x7f0afc14fd30 2023-11-27T20:44:33.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.811+0000 7f0af9ffb640 1 -- 172.21.15.91:0/2815463065 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4003b20 con 0x7f0afc14fd30 2023-11-27T20:44:33.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.811+0000 7f0b03a3d640 1 -- 172.21.15.91:0/2815463065 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc150500 con 0x7f0afc14fd30 2023-11-27T20:44:33.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.811+0000 7f0b03a3d640 1 -- 172.21.15.91:0/2815463065 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc1edb60 con 0x7f0afc14fd30 2023-11-27T20:44:33.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.812+0000 7f0b03a3d640 1 -- 172.21.15.91:0/2815463065 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc150a20 con 0x7f0afc14fd30 2023-11-27T20:44:33.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.813+0000 7f0af9ffb640 1 -- 172.21.15.91:0/2815463065 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0af4003c80 con 0x7f0afc14fd30 2023-11-27T20:44:33.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.814+0000 7f0af9ffb640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ae006b1c0 0x7f0ae006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:33.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.814+0000 7f0af9ffb640 1 -- 172.21.15.91:0/2815463065 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f0af4089380 con 0x7f0afc14fd30 2023-11-27T20:44:33.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.815+0000 7f0b017d9640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ae006b1c0 0x7f0ae006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:33.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.815+0000 7f0b017d9640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ae006b1c0 0x7f0ae006d680 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0af0035000 tx=0x7f0af0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:33.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:33.818+0000 7f0af9ffb640 1 -- 172.21.15.91:0/2815463065 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0af4053d90 con 0x7f0afc14fd30 2023-11-27T20:44:34.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.019+0000 7f0b03a3d640 1 -- 172.21.15.91:0/2815463065 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0afc1edd80 con 0x7f0afc14fd30 2023-11-27T20:44:34.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.020+0000 7f0af9ffb640 1 -- 172.21.15.91:0/2815463065 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0af40573b0 con 0x7f0afc14fd30 2023-11-27T20:44:34.021 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:44:34.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 -- 172.21.15.91:0/2815463065 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ae006b1c0 msgr2=0x7f0ae006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ae006b1c0 0x7f0ae006d680 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0af0035000 tx=0x7f0af0030000 comp rx=0 tx=0).stop 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 -- 172.21.15.91:0/2815463065 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 msgr2=0x7f0afc1ee080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 0x7f0afc1ee080 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c430 tx=0x7f0af400c8f0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 -- 172.21.15.91:0/2815463065 shutdown_connections 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc14fd30 0x7f0afc1ee080 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0afc0c3ea0 0x7f0afc1e1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0ae006b1c0 0x7f0ae006d680 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 --2- 172.21.15.91:0/2815463065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0afc06d0a0 0x7f0afc1ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 -- 172.21.15.91:0/2815463065 >> 172.21.15.91:0/2815463065 conn(0x7f0afc06a500 msgr2=0x7f0afc0c4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 -- 172.21.15.91:0/2815463065 shutdown_connections 2023-11-27T20:44:34.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.023+0000 7f0b03a3d640 1 -- 172.21.15.91:0/2815463065 wait complete. 2023-11-27T20:44:34.042 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-27T20:44:34.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:34.042 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-27T20:44:34.155 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:44:34.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:44:34.156 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-27T20:44:34.205 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:44:34.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.427+0000 7fa38b56f640 1 Processor -- start 2023-11-27T20:44:34.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.427+0000 7fa38b56f640 1 -- start start 2023-11-27T20:44:34.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.428+0000 7fa38b56f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa3840c45d0 0x7fa384155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.428+0000 7fa38b56f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa3840c3340 0x7fa384156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.428+0000 7fa38b56f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3840bfdc0 con 0x7fa3840c5ec0 2023-11-27T20:44:34.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.428+0000 7fa38b56f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38406e390 con 0x7fa3840c3340 2023-11-27T20:44:34.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.428+0000 7fa38b56f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38406ddd0 con 0x7fa3840c45d0 2023-11-27T20:44:34.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.429+0000 7fa389b0c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa3840c3340 0x7fa384156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.429+0000 7fa389b0c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa3840c3340 0x7fa384156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44094/0 (socket says 172.21.15.91:44094) 2023-11-27T20:44:34.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.429+0000 7fa389b0c640 1 -- 172.21.15.91:0/750461237 learned_addr learned my addr 172.21.15.91:0/750461237 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:34.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.429+0000 7fa388b0a640 1 --2- 172.21.15.91:0/750461237 >> v2:172.21.15.183:3300/0 conn(0x7fa3840c45d0 0x7fa384155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.429+0000 7fa389b0c640 1 -- 172.21.15.91:0/750461237 >> v2:172.21.15.183:3300/0 conn(0x7fa3840c45d0 msgr2=0x7fa384155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:34.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.429+0000 7fa389b0c640 1 --2- 172.21.15.91:0/750461237 >> v2:172.21.15.183:3300/0 conn(0x7fa3840c45d0 0x7fa384155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.429+0000 7fa389b0c640 1 -- 172.21.15.91:0/750461237 >> v1:172.21.15.183:6789/0 conn(0x7fa3840c5ec0 legacy=0x7fa3840c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:34.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.429+0000 7fa389b0c640 1 -- 172.21.15.91:0/750461237 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38406e0b0 con 0x7fa3840c3340 2023-11-27T20:44:34.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.430+0000 7fa389b0c640 1 --2- 172.21.15.91:0/750461237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 0x7fa384156370 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009e50 tx=0x7fa37c02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2952f02d630922e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:34.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa37bfff640 1 -- 172.21.15.91:0/750461237 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c02c960 con 0x7fa3840c3340 2023-11-27T20:44:34.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa37bfff640 1 -- 172.21.15.91:0/750461237 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c02cac0 con 0x7fa3840c3340 2023-11-27T20:44:34.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa37bfff640 1 -- 172.21.15.91:0/750461237 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c02ce50 con 0x7fa3840c3340 2023-11-27T20:44:34.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa38b56f640 1 -- 172.21.15.91:0/750461237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 msgr2=0x7fa384156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:34.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa38b56f640 1 --2- 172.21.15.91:0/750461237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 0x7fa384156370 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009e50 tx=0x7fa37c02bdc0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa38b56f640 1 -- 172.21.15.91:0/750461237 shutdown_connections 2023-11-27T20:44:34.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa38b56f640 1 --2- 172.21.15.91:0/750461237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 0x7fa384156370 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa38b56f640 1 --2- 172.21.15.91:0/750461237 >> v2:172.21.15.183:3300/0 conn(0x7fa3840c45d0 0x7fa384155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa38b56f640 1 -- 172.21.15.91:0/750461237 >> 172.21.15.91:0/750461237 conn(0x7fa38406a500 msgr2=0x7fa38406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:34.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa38b56f640 1 -- 172.21.15.91:0/750461237 shutdown_connections 2023-11-27T20:44:34.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.431+0000 7fa38b56f640 1 -- 172.21.15.91:0/750461237 wait complete. 2023-11-27T20:44:34.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.433+0000 7fa38b56f640 1 Processor -- start 2023-11-27T20:44:34.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.433+0000 7fa38b56f640 1 -- start start 2023-11-27T20:44:34.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.434+0000 7fa38b56f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 0x7fa3841504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.434+0000 7fa38b56f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3840c45d0 0x7fa384158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.434+0000 7fa38b56f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3840c5ec0 0x7fa3841558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.434+0000 7fa38b56f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841ea0d0 con 0x7fa3840c3340 2023-11-27T20:44:34.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.434+0000 7fa38b56f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841ea3b0 con 0x7fa3840c45d0 2023-11-27T20:44:34.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.434+0000 7fa38b56f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841ea690 con 0x7fa3840c5ec0 2023-11-27T20:44:34.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.434+0000 7fa38930b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 0x7fa3841504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.434+0000 7fa38930b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 0x7fa3841504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44104/0 (socket says 172.21.15.91:44104) 2023-11-27T20:44:34.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.434+0000 7fa38930b640 1 -- 172.21.15.91:0/429053670 learned_addr learned my addr 172.21.15.91:0/429053670 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:34.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa388b0a640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3840c45d0 0x7fa384158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa38930b640 1 -- 172.21.15.91:0/429053670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3840c5ec0 msgr2=0x7fa3841558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:34.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa38930b640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3840c5ec0 0x7fa3841558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa38930b640 1 -- 172.21.15.91:0/429053670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3840c45d0 msgr2=0x7fa384158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:34.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa38930b640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3840c45d0 0x7fa384158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa38930b640 1 -- 172.21.15.91:0/429053670 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c009b30 con 0x7fa3840c3340 2023-11-27T20:44:34.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa38930b640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 0x7fa3841504f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b3f0 tx=0x7fa38000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:34.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa379ffb640 1 -- 172.21.15.91:0/429053670 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380011830 con 0x7fa3840c3340 2023-11-27T20:44:34.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa379ffb640 1 -- 172.21.15.91:0/429053670 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa380011990 con 0x7fa3840c3340 2023-11-27T20:44:34.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa379ffb640 1 -- 172.21.15.91:0/429053670 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380011d40 con 0x7fa3840c3340 2023-11-27T20:44:34.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa38b56f640 1 -- 172.21.15.91:0/429053670 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3841ea970 con 0x7fa3840c3340 2023-11-27T20:44:34.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.435+0000 7fa38b56f640 1 -- 172.21.15.91:0/429053670 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa384150ed0 con 0x7fa3840c3340 2023-11-27T20:44:34.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.437+0000 7fa38b56f640 1 -- 172.21.15.91:0/429053670 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa384068350 con 0x7fa3840c3340 2023-11-27T20:44:34.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.437+0000 7fa379ffb640 1 -- 172.21.15.91:0/429053670 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa38001a400 con 0x7fa3840c3340 2023-11-27T20:44:34.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.438+0000 7fa379ffb640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa36806b1c0 0x7fa36806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.438+0000 7fa379ffb640 1 -- 172.21.15.91:0/429053670 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fa380089c60 con 0x7fa3840c3340 2023-11-27T20:44:34.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.439+0000 7fa388b0a640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa36806b1c0 0x7fa36806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.439+0000 7fa388b0a640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa36806b1c0 0x7fa36806d680 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa384150d40 tx=0x7fa374008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:34.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.443+0000 7fa379ffb640 1 -- 172.21.15.91:0/429053670 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa380054600 con 0x7fa3840c3340 2023-11-27T20:44:34.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.675+0000 7fa38b56f640 1 -- 172.21.15.91:0/429053670 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa384158c40 con 0x7fa3840c3340 2023-11-27T20:44:34.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.677+0000 7fa379ffb640 1 -- 172.21.15.91:0/429053670 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6132 (secure 0 0 0) 0x7fa380015090 con 0x7fa3840c3340 2023-11-27T20:44:34.677 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:34.678 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:43:52.149238+0000","modified":"2023-11-27T20:43:55.217623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/42700883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":42700883},{"type":"v1","addr":"172.21.15.91:6837","nonce":42700883}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:44:07.981170+0000","modified":"2023-11-27T20:44:11.024916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5790},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5790":{"gid":5790,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6836/1107018884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1107018884},{"type":"v1","addr":"172.21.15.91:6836","nonce":1107018884}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-27T20:44:34.678 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 35 2023-11-27T20:44:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 -- 172.21.15.91:0/429053670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa36806b1c0 msgr2=0x7fa36806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa36806b1c0 0x7fa36806d680 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa384150d40 tx=0x7fa374008040 comp rx=0 tx=0).stop 2023-11-27T20:44:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 -- 172.21.15.91:0/429053670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 msgr2=0x7fa3841504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 0x7fa3841504f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b3f0 tx=0x7fa38000b8b0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 -- 172.21.15.91:0/429053670 shutdown_connections 2023-11-27T20:44:34.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3840c5ec0 0x7fa3841558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa36806b1c0 0x7fa36806d680 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3840c45d0 0x7fa384158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 --2- 172.21.15.91:0/429053670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa3840c3340 0x7fa3841504f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 -- 172.21.15.91:0/429053670 >> 172.21.15.91:0/429053670 conn(0x7fa38406a500 msgr2=0x7fa3840c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 -- 172.21.15.91:0/429053670 shutdown_connections 2023-11-27T20:44:34.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.680+0000 7fa38b56f640 1 -- 172.21.15.91:0/429053670 wait complete. 2023-11-27T20:44:34.701 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:34.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.910+0000 7f051dd83640 1 Processor -- start 2023-11-27T20:44:34.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.910+0000 7f051dd83640 1 -- start start 2023-11-27T20:44:34.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.911+0000 7f051dd83640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f051814fd30 0x7f0518152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.911+0000 7f051dd83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f051806d0a0 0x7f05180a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.911+0000 7f051dd83640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f05180a5260 0x7f05180c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.911+0000 7f051dd83640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05180c64a0 con 0x7f05180a5260 2023-11-27T20:44:34.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.911+0000 7f051dd83640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05180c5c00 con 0x7f051814fd30 2023-11-27T20:44:34.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.911+0000 7f051dd83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05180c5ee0 con 0x7f051806d0a0 2023-11-27T20:44:34.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.911+0000 7f0517fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f05180a5260 0x7f05180c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.911+0000 7f0517fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f05180a5260 0x7f05180c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44116/0 (socket says 172.21.15.91:44116) 2023-11-27T20:44:34.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.911+0000 7f0517fff640 1 -- 172.21.15.91:0/3891328838 learned_addr learned my addr 172.21.15.91:0/3891328838 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:34.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.912+0000 7f05177fe640 1 --2- 172.21.15.91:0/3891328838 >> v2:172.21.15.183:3300/0 conn(0x7f051814fd30 0x7f0518152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.912+0000 7f050ffff640 1 --2- 172.21.15.91:0/3891328838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f051806d0a0 0x7f05180a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.912+0000 7f0517fff640 1 -- 172.21.15.91:0/3891328838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f051806d0a0 msgr2=0x7f05180a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:34.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.912+0000 7f0517fff640 1 --2- 172.21.15.91:0/3891328838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f051806d0a0 0x7f05180a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.912+0000 7f0517fff640 1 -- 172.21.15.91:0/3891328838 >> v2:172.21.15.183:3300/0 conn(0x7f051814fd30 msgr2=0x7f0518152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:34.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.912+0000 7f0517fff640 1 --2- 172.21.15.91:0/3891328838 >> v2:172.21.15.183:3300/0 conn(0x7f051814fd30 0x7f0518152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.912+0000 7f0517fff640 1 -- 172.21.15.91:0/3891328838 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05180c61c0 con 0x7f05180a5260 2023-11-27T20:44:34.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.912+0000 7f050ffff640 1 --2- 172.21.15.91:0/3891328838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f051806d0a0 0x7f05180a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:34.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.912+0000 7f05177fe640 1 --2- 172.21.15.91:0/3891328838 >> v2:172.21.15.183:3300/0 conn(0x7f051814fd30 0x7f0518152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:34.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.913+0000 7f0517fff640 1 --2- 172.21.15.91:0/3891328838 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05180a5260 0x7f05180c3ea0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f051806b200 tx=0x7f051002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3264b65c9a6ec33a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.913+0000 7f0516ffd640 1 -- 172.21.15.91:0/3891328838 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510031870 con 0x7f05180a5260 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.913+0000 7f0516ffd640 1 -- 172.21.15.91:0/3891328838 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05100319d0 con 0x7f05180a5260 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.913+0000 7f0516ffd640 1 -- 172.21.15.91:0/3891328838 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510031d60 con 0x7f05180a5260 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.914+0000 7f051dd83640 1 -- 172.21.15.91:0/3891328838 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05180a5260 msgr2=0x7f05180c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.914+0000 7f051dd83640 1 --2- 172.21.15.91:0/3891328838 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05180a5260 0x7f05180c3ea0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f051806b200 tx=0x7f051002b910 comp rx=0 tx=0).stop 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.914+0000 7f051dd83640 1 -- 172.21.15.91:0/3891328838 shutdown_connections 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.914+0000 7f051dd83640 1 --2- 172.21.15.91:0/3891328838 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05180a5260 0x7f05180c3ea0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.914+0000 7f051dd83640 1 --2- 172.21.15.91:0/3891328838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f051806d0a0 0x7f05180a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.914+0000 7f051dd83640 1 --2- 172.21.15.91:0/3891328838 >> v2:172.21.15.183:3300/0 conn(0x7f051814fd30 0x7f0518152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.914+0000 7f051dd83640 1 -- 172.21.15.91:0/3891328838 >> 172.21.15.91:0/3891328838 conn(0x7f051806a500 msgr2=0x7f051806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:34.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.914+0000 7f051dd83640 1 -- 172.21.15.91:0/3891328838 shutdown_connections 2023-11-27T20:44:34.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.914+0000 7f051dd83640 1 -- 172.21.15.91:0/3891328838 wait complete. 2023-11-27T20:44:34.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.916+0000 7f051dd83640 1 Processor -- start 2023-11-27T20:44:34.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.916+0000 7f051dd83640 1 -- start start 2023-11-27T20:44:34.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f051dd83640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f051806d0a0 0x7f051814db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f051dd83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05180a5260 0x7f051814e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f051dd83640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f051814fd30 0x7f051814aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f051dd83640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05180a69a0 con 0x7f051806d0a0 2023-11-27T20:44:34.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f051dd83640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051814e590 con 0x7f051814fd30 2023-11-27T20:44:34.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f051dd83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051814bba0 con 0x7f05180a5260 2023-11-27T20:44:34.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f05177fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f051806d0a0 0x7f051814db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f05177fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f051806d0a0 0x7f051814db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44124/0 (socket says 172.21.15.91:44124) 2023-11-27T20:44:34.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f05177fe640 1 -- 172.21.15.91:0/722736466 learned_addr learned my addr 172.21.15.91:0/722736466 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:34.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f05177fe640 1 -- 172.21.15.91:0/722736466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05180a5260 msgr2=0x7f051814e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:34.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f0517fff640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f051814fd30 0x7f051814aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f05177fe640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05180a5260 0x7f051814e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f05177fe640 1 -- 172.21.15.91:0/722736466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f051814fd30 msgr2=0x7f051814aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:34.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f05177fe640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f051814fd30 0x7f051814aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:34.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.917+0000 7f05177fe640 1 -- 172.21.15.91:0/722736466 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05100094d0 con 0x7f051806d0a0 2023-11-27T20:44:34.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.918+0000 7f05177fe640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f051806d0a0 0x7f051814db10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f050800ce30 tx=0x7f050800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:34.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.918+0000 7f0514ff9640 1 -- 172.21.15.91:0/722736466 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050800f890 con 0x7f051806d0a0 2023-11-27T20:44:34.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.918+0000 7f0514ff9640 1 -- 172.21.15.91:0/722736466 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050800f9f0 con 0x7f051806d0a0 2023-11-27T20:44:34.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.918+0000 7f051dd83640 1 -- 172.21.15.91:0/722736466 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051814eeb0 con 0x7f051806d0a0 2023-11-27T20:44:34.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.918+0000 7f0514ff9640 1 -- 172.21.15.91:0/722736466 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050800fd80 con 0x7f051806d0a0 2023-11-27T20:44:34.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.918+0000 7f051dd83640 1 -- 172.21.15.91:0/722736466 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051814bdf0 con 0x7f051806d0a0 2023-11-27T20:44:34.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.919+0000 7f051dd83640 1 -- 172.21.15.91:0/722736466 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0518068350 con 0x7f051806d0a0 2023-11-27T20:44:34.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.920+0000 7f0514ff9640 1 -- 172.21.15.91:0/722736466 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f050800b040 con 0x7f051806d0a0 2023-11-27T20:44:34.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.921+0000 7f0514ff9640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04f806b1c0 0x7f04f806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:34.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.921+0000 7f0514ff9640 1 -- 172.21.15.91:0/722736466 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f050808a7f0 con 0x7f051806d0a0 2023-11-27T20:44:34.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.922+0000 7f050ffff640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04f806b1c0 0x7f04f806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:34.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.922+0000 7f050ffff640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04f806b1c0 0x7f04f806d680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f05180a8b10 tx=0x7f0500008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:34.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:34.926+0000 7f0514ff9640 1 -- 172.21.15.91:0/722736466 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0508055230 con 0x7f051806d0a0 2023-11-27T20:44:35.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.117+0000 7f051dd83640 1 -- 172.21.15.91:0/722736466 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f051806e150 con 0x7f051806d0a0 2023-11-27T20:44:35.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.119+0000 7f0514ff9640 1 -- 172.21.15.91:0/722736466 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+20342 (secure 0 0 0) 0x7f0508058850 con 0x7f051806d0a0 2023-11-27T20:44:35.119 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:35.119 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":61,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:18.243029+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.121+0000 7f051dd83640 1 -- 172.21.15.91:0/722736466 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04f806b1c0 msgr2=0x7f04f806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.121+0000 7f051dd83640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04f806b1c0 0x7f04f806d680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f05180a8b10 tx=0x7f0500008040 comp rx=0 tx=0).stop 2023-11-27T20:44:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.121+0000 7f051dd83640 1 -- 172.21.15.91:0/722736466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f051806d0a0 msgr2=0x7f051814db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.121+0000 7f051dd83640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f051806d0a0 0x7f051814db10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f050800ce30 tx=0x7f050800a650 comp rx=0 tx=0).stop 2023-11-27T20:44:35.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.122+0000 7f051dd83640 1 -- 172.21.15.91:0/722736466 shutdown_connections 2023-11-27T20:44:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.122+0000 7f051dd83640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04f806b1c0 0x7f04f806d680 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.122+0000 7f051dd83640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f051814fd30 0x7f051814aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.122+0000 7f051dd83640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05180a5260 0x7f051814e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.122+0000 7f051dd83640 1 --2- 172.21.15.91:0/722736466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f051806d0a0 0x7f051814db10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.122+0000 7f051dd83640 1 -- 172.21.15.91:0/722736466 >> 172.21.15.91:0/722736466 conn(0x7f051806a500 msgr2=0x7f05180719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.122+0000 7f051dd83640 1 -- 172.21.15.91:0/722736466 shutdown_connections 2023-11-27T20:44:35.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.122+0000 7f051dd83640 1 -- 172.21.15.91:0/722736466 wait complete. 2023-11-27T20:44:35.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:43:50.043742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:43:51.176510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:44:06.059576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:44:06.989345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:44:35.142 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:44:35.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.355+0000 7f56bc610640 1 Processor -- start 2023-11-27T20:44:35.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.355+0000 7f56bc610640 1 -- start start 2023-11-27T20:44:35.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.356+0000 7f56bc610640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f56b406d0a0 0x7f56b4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.356+0000 7f56bc610640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56b40c3ea0 0x7f56b40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.356+0000 7f56bc610640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b40c64a0 con 0x7f56b414fd30 2023-11-27T20:44:35.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.356+0000 7f56bc610640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b40c5c00 con 0x7f56b406d0a0 2023-11-27T20:44:35.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.356+0000 7f56bc610640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b40c5ee0 con 0x7f56b40c3ea0 2023-11-27T20:44:35.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.356+0000 7f56ba3ac640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f56b414fd30 0x7f56b40a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54818/0 (socket says 172.21.15.91:54818) 2023-11-27T20:44:35.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.356+0000 7f56ba3ac640 1 -- 172.21.15.91:0/460700498 learned_addr learned my addr 172.21.15.91:0/460700498 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:35.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.356+0000 7f56b9bab640 1 --2- 172.21.15.91:0/460700498 >> v2:172.21.15.91:3300/0 conn(0x7f56b406d0a0 0x7f56b4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:35.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.357+0000 7f56babad640 1 --2- 172.21.15.91:0/460700498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56b40c3ea0 0x7f56b40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:35.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.357+0000 7f56b93aa640 1 -- 172.21.15.91:0/460700498 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923443259 0 0) 0x7f56b40c64a0 con 0x7f56b414fd30 2023-11-27T20:44:35.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.357+0000 7f56b93aa640 1 -- 172.21.15.91:0/460700498 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a0003520 con 0x7f56b414fd30 2023-11-27T20:44:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.357+0000 7f56b9bab640 1 -- 172.21.15.91:0/460700498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56b40c3ea0 msgr2=0x7f56b40c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.357+0000 7f56b9bab640 1 --2- 172.21.15.91:0/460700498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56b40c3ea0 0x7f56b40c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.357+0000 7f56b9bab640 1 -- 172.21.15.91:0/460700498 >> v1:172.21.15.91:6789/0 conn(0x7f56b414fd30 legacy=0x7f56b40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.357+0000 7f56b9bab640 1 -- 172.21.15.91:0/460700498 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b40c61c0 con 0x7f56b406d0a0 2023-11-27T20:44:35.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.358+0000 7f56b9bab640 1 --2- 172.21.15.91:0/460700498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b406d0a0 0x7f56b4152f20 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f56a40097a0 tx=0x7f56a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a996838f0ae0ae2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:35.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.358+0000 7f56b93aa640 1 -- 172.21.15.91:0/460700498 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4031830 con 0x7f56b406d0a0 2023-11-27T20:44:35.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.358+0000 7f56b93aa640 1 -- 172.21.15.91:0/460700498 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a4031990 con 0x7f56b406d0a0 2023-11-27T20:44:35.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.358+0000 7f56b93aa640 1 -- 172.21.15.91:0/460700498 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4031d00 con 0x7f56b406d0a0 2023-11-27T20:44:35.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.359+0000 7f56bc610640 1 -- 172.21.15.91:0/460700498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b406d0a0 msgr2=0x7f56b4152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.359+0000 7f56bc610640 1 --2- 172.21.15.91:0/460700498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b406d0a0 0x7f56b4152f20 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f56a40097a0 tx=0x7f56a402b8d0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.359+0000 7f56bc610640 1 -- 172.21.15.91:0/460700498 shutdown_connections 2023-11-27T20:44:35.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.359+0000 7f56bc610640 1 --2- 172.21.15.91:0/460700498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56b40c3ea0 0x7f56b40c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.359+0000 7f56bc610640 1 --2- 172.21.15.91:0/460700498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b406d0a0 0x7f56b4152f20 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.359+0000 7f56bc610640 1 -- 172.21.15.91:0/460700498 >> 172.21.15.91:0/460700498 conn(0x7f56b406a500 msgr2=0x7f56b406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:35.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.359+0000 7f56bc610640 1 -- 172.21.15.91:0/460700498 shutdown_connections 2023-11-27T20:44:35.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.359+0000 7f56bc610640 1 -- 172.21.15.91:0/460700498 wait complete. 2023-11-27T20:44:35.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.361+0000 7f56bc610640 1 Processor -- start 2023-11-27T20:44:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.361+0000 7f56bc610640 1 -- start start 2023-11-27T20:44:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.362+0000 7f56bc610640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b406d0a0 0x7f56b4155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.362+0000 7f56bc610640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b40c3ea0 0x7f56b414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.362+0000 7f56bc610640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56b414fd30 0x7f56b414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.362+0000 7f56bc610640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b41dc850 con 0x7f56b40c3ea0 2023-11-27T20:44:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.362+0000 7f56bc610640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b40a90f0 con 0x7f56b406d0a0 2023-11-27T20:44:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.362+0000 7f56bc610640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b41dc2b0 con 0x7f56b414fd30 2023-11-27T20:44:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.362+0000 7f56b9bab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b40c3ea0 0x7f56b414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.362+0000 7f56b9bab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b40c3ea0 0x7f56b414ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44134/0 (socket says 172.21.15.91:44134) 2023-11-27T20:44:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.362+0000 7f56b9bab640 1 -- 172.21.15.91:0/1536506548 learned_addr learned my addr 172.21.15.91:0/1536506548 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.363+0000 7f56ba3ac640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b406d0a0 0x7f56b4155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.363+0000 7f56babad640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56b414fd30 0x7f56b414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.363+0000 7f56b9bab640 1 -- 172.21.15.91:0/1536506548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56b414fd30 msgr2=0x7f56b414f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.363+0000 7f56b9bab640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56b414fd30 0x7f56b414f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.363+0000 7f56b9bab640 1 -- 172.21.15.91:0/1536506548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b406d0a0 msgr2=0x7f56b4155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.363+0000 7f56b9bab640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b406d0a0 0x7f56b4155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.363+0000 7f56b9bab640 1 -- 172.21.15.91:0/1536506548 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a4009400 con 0x7f56b40c3ea0 2023-11-27T20:44:35.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.363+0000 7f56b9bab640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b40c3ea0 0x7f56b414ee00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f56a402b910 tx=0x7f56a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:35.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.365+0000 7f56aaffd640 1 -- 172.21.15.91:0/1536506548 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a403a8f0 con 0x7f56b40c3ea0 2023-11-27T20:44:35.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.365+0000 7f56aaffd640 1 -- 172.21.15.91:0/1536506548 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a403aa70 con 0x7f56b40c3ea0 2023-11-27T20:44:35.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.365+0000 7f56aaffd640 1 -- 172.21.15.91:0/1536506548 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a403ae20 con 0x7f56b40c3ea0 2023-11-27T20:44:35.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.365+0000 7f56bc610640 1 -- 172.21.15.91:0/1536506548 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b40a8e70 con 0x7f56b40c3ea0 2023-11-27T20:44:35.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.365+0000 7f56bc610640 1 -- 172.21.15.91:0/1536506548 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b41ee740 con 0x7f56b40c3ea0 2023-11-27T20:44:35.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.366+0000 7f56bc610640 1 -- 172.21.15.91:0/1536506548 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b40a92a0 con 0x7f56b40c3ea0 2023-11-27T20:44:35.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.367+0000 7f56aaffd640 1 -- 172.21.15.91:0/1536506548 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f56a404d450 con 0x7f56b40c3ea0 2023-11-27T20:44:35.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.368+0000 7f56aaffd640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f569806b1f0 0x7f569806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.368+0000 7f56aaffd640 1 -- 172.21.15.91:0/1536506548 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f56a40abdb0 con 0x7f56b40c3ea0 2023-11-27T20:44:35.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.368+0000 7f56ba3ac640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f569806b1f0 0x7f569806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:35.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.369+0000 7f56ba3ac640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f569806b1f0 0x7f569806d6b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f56b0005880 tx=0x7f56b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:35.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.372+0000 7f56aaffd640 1 -- 172.21.15.91:0/1536506548 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f56b40a92a0 con 0x7f56b40c3ea0 2023-11-27T20:44:35.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.562+0000 7f56bc610640 1 -- 172.21.15.91:0/1536506548 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56b40a92a0 con 0x7f56b40c3ea0 2023-11-27T20:44:35.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.563+0000 7f56aaffd640 1 -- 172.21.15.91:0/1536506548 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56b40a92a0 con 0x7f56b40c3ea0 2023-11-27T20:44:35.563 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:44:35.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 -- 172.21.15.91:0/1536506548 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f569806b1f0 msgr2=0x7f569806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f569806b1f0 0x7f569806d6b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f56b0005880 tx=0x7f56b0009040 comp rx=0 tx=0).stop 2023-11-27T20:44:35.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 -- 172.21.15.91:0/1536506548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b40c3ea0 msgr2=0x7f56b414ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b40c3ea0 0x7f56b414ee00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f56a402b910 tx=0x7f56a40046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 -- 172.21.15.91:0/1536506548 shutdown_connections 2023-11-27T20:44:35.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56b414fd30 0x7f56b414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b40c3ea0 0x7f56b414ee00 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f569806b1f0 0x7f569806d6b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 --2- 172.21.15.91:0/1536506548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56b406d0a0 0x7f56b4155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 -- 172.21.15.91:0/1536506548 >> 172.21.15.91:0/1536506548 conn(0x7f56b406a500 msgr2=0x7f56b40c2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:35.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 -- 172.21.15.91:0/1536506548 shutdown_connections 2023-11-27T20:44:35.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.566+0000 7f56bc610640 1 -- 172.21.15.91:0/1536506548 wait complete. 2023-11-27T20:44:35.586 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:44:35.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.804+0000 7f6d1e905640 1 Processor -- start 2023-11-27T20:44:35.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.804+0000 7f6d1e905640 1 -- start start 2023-11-27T20:44:35.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.806+0000 7f6d1e905640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d180c1500 0x7f6d180c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.806+0000 7f6d1e905640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d180c06c0 con 0x7f6d180a9b40 2023-11-27T20:44:35.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.806+0000 7f6d1e905640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d180c1020 con 0x7f6d18155490 2023-11-27T20:44:35.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.806+0000 7f6d1e905640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d180a5820 con 0x7f6d180c1500 2023-11-27T20:44:35.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.806+0000 7f6d1cea2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d180c1500 0x7f6d180c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:35.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.806+0000 7f6d177fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f6d180a9b40 0x7f6d180c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54832/0 (socket says 172.21.15.91:54832) 2023-11-27T20:44:35.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.806+0000 7f6d177fe640 1 -- 172.21.15.91:0/558299686 learned_addr learned my addr 172.21.15.91:0/558299686 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:35.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.806+0000 7f6d1cea2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6d180c1500 0x7f6d180c2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44142/0 (socket says 172.21.15.91:44142) 2023-11-27T20:44:35.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.807+0000 7f6d1cea2640 1 -- 172.21.15.91:0/558299686 >> v1:172.21.15.183:6789/0 conn(0x7f6d18155490 legacy=0x7f6d180a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:35.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.807+0000 7f6d1cea2640 1 -- 172.21.15.91:0/558299686 >> v1:172.21.15.91:6789/0 conn(0x7f6d180a9b40 legacy=0x7f6d180c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.807+0000 7f6d1cea2640 1 -- 172.21.15.91:0/558299686 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180c0910 con 0x7f6d180c1500 2023-11-27T20:44:35.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.807+0000 7f6d16ffd640 1 -- 172.21.15.91:0/558299686 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566619057 0 0) 0x7f6d180c06c0 con 0x7f6d180a9b40 2023-11-27T20:44:35.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.808+0000 7f6d1cea2640 1 --2- 172.21.15.91:0/558299686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d180c1500 0x7f6d180c2be0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009d90 tx=0x7f6d1002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17866bb115f70df2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:35.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.808+0000 7f6d16ffd640 1 -- 172.21.15.91:0/558299686 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1002cc60 con 0x7f6d180c1500 2023-11-27T20:44:35.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.808+0000 7f6d16ffd640 1 -- 172.21.15.91:0/558299686 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1002cdc0 con 0x7f6d180c1500 2023-11-27T20:44:35.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.808+0000 7f6d16ffd640 1 -- 172.21.15.91:0/558299686 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10034660 con 0x7f6d180c1500 2023-11-27T20:44:35.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.809+0000 7f6d1e905640 1 -- 172.21.15.91:0/558299686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d180c1500 msgr2=0x7f6d180c2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.809+0000 7f6d1e905640 1 --2- 172.21.15.91:0/558299686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d180c1500 0x7f6d180c2be0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009d90 tx=0x7f6d1002beb0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.809+0000 7f6d1e905640 1 -- 172.21.15.91:0/558299686 shutdown_connections 2023-11-27T20:44:35.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.809+0000 7f6d1e905640 1 --2- 172.21.15.91:0/558299686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d180c1500 0x7f6d180c2be0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.809+0000 7f6d1e905640 1 -- 172.21.15.91:0/558299686 >> 172.21.15.91:0/558299686 conn(0x7f6d1806a500 msgr2=0x7f6d1806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:35.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.809+0000 7f6d1e905640 1 -- 172.21.15.91:0/558299686 shutdown_connections 2023-11-27T20:44:35.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.809+0000 7f6d1e905640 1 -- 172.21.15.91:0/558299686 wait complete. 2023-11-27T20:44:35.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.810+0000 7f6d1e905640 1 Processor -- start 2023-11-27T20:44:35.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.811+0000 7f6d1e905640 1 -- start start 2023-11-27T20:44:35.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.811+0000 7f6d1e905640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d180c1500 0x7f6d18148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.811+0000 7f6d1e905640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d18155490 0x7f6d1814c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.811+0000 7f6d1e905640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d1814af30 0x7f6d1814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.811+0000 7f6d1e905640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1814d0e0 con 0x7f6d1814af30 2023-11-27T20:44:35.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.811+0000 7f6d1e905640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1813ab70 con 0x7f6d180c1500 2023-11-27T20:44:35.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.811+0000 7f6d1e905640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1814ce00 con 0x7f6d18155490 2023-11-27T20:44:35.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.812+0000 7f6d1cea2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d1814af30 0x7f6d1814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:35.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.812+0000 7f6d1cea2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d1814af30 0x7f6d1814c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44146/0 (socket says 172.21.15.91:44146) 2023-11-27T20:44:35.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.812+0000 7f6d1cea2640 1 -- 172.21.15.91:0/689273498 learned_addr learned my addr 172.21.15.91:0/689273498 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:35.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.812+0000 7f6d1cea2640 1 -- 172.21.15.91:0/689273498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d18155490 msgr2=0x7f6d1814c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.812+0000 7f6d1cea2640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d18155490 0x7f6d1814c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.812+0000 7f6d1cea2640 1 -- 172.21.15.91:0/689273498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d180c1500 msgr2=0x7f6d18148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:35.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.812+0000 7f6d1cea2640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d180c1500 0x7f6d18148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:35.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.812+0000 7f6d1cea2640 1 -- 172.21.15.91:0/689273498 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d10009a70 con 0x7f6d1814af30 2023-11-27T20:44:35.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.812+0000 7f6d1cea2640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d1814af30 0x7f6d1814c740 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6d1002c4c0 tx=0x7f6d10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:35.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.813+0000 7f6d14ff9640 1 -- 172.21.15.91:0/689273498 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1003f420 con 0x7f6d1814af30 2023-11-27T20:44:35.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.813+0000 7f6d14ff9640 1 -- 172.21.15.91:0/689273498 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1003f580 con 0x7f6d1814af30 2023-11-27T20:44:35.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.813+0000 7f6d14ff9640 1 -- 172.21.15.91:0/689273498 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1003f910 con 0x7f6d1814af30 2023-11-27T20:44:35.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.813+0000 7f6d1e905640 1 -- 172.21.15.91:0/689273498 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1814ba00 con 0x7f6d1814af30 2023-11-27T20:44:35.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.813+0000 7f6d1e905640 1 -- 172.21.15.91:0/689273498 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d18148860 con 0x7f6d1814af30 2023-11-27T20:44:35.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.814+0000 7f6d1e905640 1 -- 172.21.15.91:0/689273498 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1814bf20 con 0x7f6d1814af30 2023-11-27T20:44:35.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.815+0000 7f6d14ff9640 1 -- 172.21.15.91:0/689273498 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6d1003fa70 con 0x7f6d1814af30 2023-11-27T20:44:35.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.816+0000 7f6d14ff9640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d0406b1c0 0x7f6d0406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:35.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.816+0000 7f6d14ff9640 1 -- 172.21.15.91:0/689273498 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f6d100ac9e0 con 0x7f6d1814af30 2023-11-27T20:44:35.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.816+0000 7f6d17fff640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d0406b1c0 0x7f6d0406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:35.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.817+0000 7f6d17fff640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d0406b1c0 0x7f6d0406d680 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6d08006fd0 tx=0x7f6d08006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:35.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:35.820+0000 7f6d14ff9640 1 -- 172.21.15.91:0/689273498 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6d1814bf20 con 0x7f6d1814af30 2023-11-27T20:44:36.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.008+0000 7f6d1e905640 1 -- 172.21.15.91:0/689273498 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d1814bf20 con 0x7f6d1814af30 2023-11-27T20:44:36.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.009+0000 7f6d14ff9640 1 -- 172.21.15.91:0/689273498 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d10043020 con 0x7f6d1814af30 2023-11-27T20:44:36.010 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:44:36.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 -- 172.21.15.91:0/689273498 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d0406b1c0 msgr2=0x7f6d0406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d0406b1c0 0x7f6d0406d680 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6d08006fd0 tx=0x7f6d08006bc0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 -- 172.21.15.91:0/689273498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d1814af30 msgr2=0x7f6d1814c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d1814af30 0x7f6d1814c740 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6d1002c4c0 tx=0x7f6d10004a40 comp rx=0 tx=0).stop 2023-11-27T20:44:36.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 -- 172.21.15.91:0/689273498 shutdown_connections 2023-11-27T20:44:36.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6d1814af30 0x7f6d1814c740 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d18155490 0x7f6d1814c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6d0406b1c0 0x7f6d0406d680 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 --2- 172.21.15.91:0/689273498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d180c1500 0x7f6d18148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 -- 172.21.15.91:0/689273498 >> 172.21.15.91:0/689273498 conn(0x7f6d1806a500 msgr2=0x7f6d18149180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:36.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 -- 172.21.15.91:0/689273498 shutdown_connections 2023-11-27T20:44:36.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.012+0000 7f6d1e905640 1 -- 172.21.15.91:0/689273498 wait complete. 2023-11-27T20:44:36.032 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:44:36.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.245+0000 7fa54b0a3640 1 Processor -- start 2023-11-27T20:44:36.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.245+0000 7fa54b0a3640 1 -- start start 2023-11-27T20:44:36.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.247+0000 7fa54b0a3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa5440c1100 0x7fa5441641c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.247+0000 7fa54b0a3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa544159800 con 0x7fa54406e000 2023-11-27T20:44:36.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.247+0000 7fa54b0a3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa544158a40 con 0x7fa544155f60 2023-11-27T20:44:36.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.247+0000 7fa54b0a3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54406c440 con 0x7fa5440c1100 2023-11-27T20:44:36.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.247+0000 7fa5498a0640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa54406e000 0x7fa5440c3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54844/0 (socket says 172.21.15.91:54844) 2023-11-27T20:44:36.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.247+0000 7fa5498a0640 1 -- 172.21.15.91:0/3516645421 learned_addr learned my addr 172.21.15.91:0/3516645421 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:36.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54a8a2640 1 --2- 172.21.15.91:0/3516645421 >> v2:172.21.15.183:3300/0 conn(0x7fa5440c1100 0x7fa5441641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656907921 0 0) 0x7fa544159800 con 0x7fa54406e000 2023-11-27T20:44:36.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa530003520 con 0x7fa54406e000 2023-11-27T20:44:36.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333992880 0 0) 0x7fa530003520 con 0x7fa54406e000 2023-11-27T20:44:36.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 >> v2:172.21.15.183:3300/0 conn(0x7fa5440c1100 msgr2=0x7fa5441641c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:36.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 --2- 172.21.15.91:0/3516645421 >> v2:172.21.15.183:3300/0 conn(0x7fa5440c1100 0x7fa5441641c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 >> v1:172.21.15.183:6789/0 conn(0x7fa544155f60 legacy=0x7fa5440c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa544158d20 con 0x7fa54406e000 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fa534001670 con 0x7fa54406e000 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 >> v1:172.21.15.91:6789/0 conn(0x7fa54406e000 legacy=0x7fa5440c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 --2- 172.21.15.91:0/3516645421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa530003970 0x7fa530003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 --2- 172.21.15.91:0/3516645421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300047c0 0x7fa530004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 --2- 172.21.15.91:0/3516645421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa530005180 0x7fa53000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54406c440 con 0x7fa5300047c0 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53000c020 con 0x7fa530003970 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.248+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53000c1e0 con 0x7fa530005180 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.249+0000 7fa5498a0640 1 --2- 172.21.15.91:0/3516645421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300047c0 0x7fa530004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.249+0000 7fa54a0a1640 1 --2- 172.21.15.91:0/3516645421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa530003970 0x7fa530003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.249+0000 7fa5498a0640 1 -- 172.21.15.91:0/3516645421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa530005180 msgr2=0x7fa53000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:36.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.249+0000 7fa5498a0640 1 --2- 172.21.15.91:0/3516645421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa530005180 0x7fa53000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.249+0000 7fa5498a0640 1 -- 172.21.15.91:0/3516645421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa530003970 msgr2=0x7fa530003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:36.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.249+0000 7fa5498a0640 1 --2- 172.21.15.91:0/3516645421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa530003970 0x7fa530003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.249+0000 7fa5498a0640 1 -- 172.21.15.91:0/3516645421 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa530003520 con 0x7fa5300047c0 2023-11-27T20:44:36.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.249+0000 7fa54a8a2640 1 -- 172.21.15.91:0/3516645421 reap_dead start 2023-11-27T20:44:36.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.250+0000 7fa5498a0640 1 --2- 172.21.15.91:0/3516645421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300047c0 0x7fa530004c40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa53400c240 tx=0x7fa5300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bba62f4e48b02d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:36.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.250+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534005ad0 con 0x7fa5300047c0 2023-11-27T20:44:36.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.250+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa534005c30 con 0x7fa5300047c0 2023-11-27T20:44:36.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.250+0000 7fa54909f640 1 -- 172.21.15.91:0/3516645421 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53402cab0 con 0x7fa5300047c0 2023-11-27T20:44:36.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.251+0000 7fa54b0a3640 1 -- 172.21.15.91:0/3516645421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300047c0 msgr2=0x7fa530004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.251+0000 7fa54b0a3640 1 --2- 172.21.15.91:0/3516645421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300047c0 0x7fa530004c40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa53400c240 tx=0x7fa5300057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.251+0000 7fa54b0a3640 1 -- 172.21.15.91:0/3516645421 shutdown_connections 2023-11-27T20:44:36.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.251+0000 7fa54b0a3640 1 --2- 172.21.15.91:0/3516645421 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300047c0 0x7fa530004c40 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.251+0000 7fa54b0a3640 1 -- 172.21.15.91:0/3516645421 >> 172.21.15.91:0/3516645421 conn(0x7fa5440a77f0 msgr2=0x7fa5440a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:36.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.251+0000 7fa54b0a3640 1 -- 172.21.15.91:0/3516645421 shutdown_connections 2023-11-27T20:44:36.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.251+0000 7fa54b0a3640 1 -- 172.21.15.91:0/3516645421 wait complete. 2023-11-27T20:44:36.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.253+0000 7fa54b0a3640 1 Processor -- start 2023-11-27T20:44:36.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.253+0000 7fa54b0a3640 1 -- start start 2023-11-27T20:44:36.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.254+0000 7fa54b0a3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5300047c0 0x7fa54415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.254+0000 7fa54b0a3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5440a95a0 0x7fa54415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.254+0000 7fa54b0a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5441f1cc0 0x7fa5441f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.254+0000 7fa54b0a3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440a29b0 con 0x7fa5440a95a0 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.254+0000 7fa54b0a3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440a23f0 con 0x7fa5300047c0 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.254+0000 7fa54b0a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440a26d0 con 0x7fa5441f1cc0 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.254+0000 7fa5498a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5440a95a0 0x7fa54415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.254+0000 7fa5498a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5440a95a0 0x7fa54415b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44170/0 (socket says 172.21.15.91:44170) 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.254+0000 7fa5498a0640 1 -- 172.21.15.91:0/147606699 learned_addr learned my addr 172.21.15.91:0/147606699 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa54a0a1640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5300047c0 0x7fa54415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa54a8a2640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5441f1cc0 0x7fa5441f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa5498a0640 1 -- 172.21.15.91:0/147606699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5441f1cc0 msgr2=0x7fa5441f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa5498a0640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5441f1cc0 0x7fa5441f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa5498a0640 1 -- 172.21.15.91:0/147606699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5300047c0 msgr2=0x7fa54415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa5498a0640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5300047c0 0x7fa54415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa5498a0640 1 -- 172.21.15.91:0/147606699 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54415ab80 con 0x7fa5440a95a0 2023-11-27T20:44:36.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa54a8a2640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5441f1cc0 0x7fa5441f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:36.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa5498a0640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5440a95a0 0x7fa54415b5e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa534001930 tx=0x7fa53402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:36.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa53affd640 1 -- 172.21.15.91:0/147606699 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53403c040 con 0x7fa5440a95a0 2023-11-27T20:44:36.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa53affd640 1 -- 172.21.15.91:0/147606699 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53402cd40 con 0x7fa5440a95a0 2023-11-27T20:44:36.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa53affd640 1 -- 172.21.15.91:0/147606699 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534007290 con 0x7fa5440a95a0 2023-11-27T20:44:36.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa54b0a3640 1 -- 172.21.15.91:0/147606699 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54415bf10 con 0x7fa5440a95a0 2023-11-27T20:44:36.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.255+0000 7fa54b0a3640 1 -- 172.21.15.91:0/147606699 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa544151f70 con 0x7fa5440a95a0 2023-11-27T20:44:36.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.256+0000 7fa54b0a3640 1 -- 172.21.15.91:0/147606699 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54415ad10 con 0x7fa5440a95a0 2023-11-27T20:44:36.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.257+0000 7fa53affd640 1 -- 172.21.15.91:0/147606699 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa534032070 con 0x7fa5440a95a0 2023-11-27T20:44:36.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.258+0000 7fa53affd640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52806b1c0 0x7fa52806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.258+0000 7fa53affd640 1 -- 172.21.15.91:0/147606699 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fa5340ab2d0 con 0x7fa5440a95a0 2023-11-27T20:44:36.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.259+0000 7fa54a0a1640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52806b1c0 0x7fa52806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.259+0000 7fa54a0a1640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52806b1c0 0x7fa52806d680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa5440ab710 tx=0x7fa540009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:36.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.263+0000 7fa53affd640 1 -- 172.21.15.91:0/147606699 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa534075c60 con 0x7fa5440a95a0 2023-11-27T20:44:36.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.454+0000 7fa54b0a3640 1 -- 172.21.15.91:0/147606699 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa54406c0a0 con 0x7fa5440a95a0 2023-11-27T20:44:36.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.455+0000 7fa53affd640 1 -- 172.21.15.91:0/147606699 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa534079280 con 0x7fa5440a95a0 2023-11-27T20:44:36.456 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:44:36.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.457+0000 7fa54b0a3640 1 -- 172.21.15.91:0/147606699 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52806b1c0 msgr2=0x7fa52806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52806b1c0 0x7fa52806d680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa5440ab710 tx=0x7fa540009040 comp rx=0 tx=0).stop 2023-11-27T20:44:36.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 -- 172.21.15.91:0/147606699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5440a95a0 msgr2=0x7fa54415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5440a95a0 0x7fa54415b5e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa534001930 tx=0x7fa53402e070 comp rx=0 tx=0).stop 2023-11-27T20:44:36.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 -- 172.21.15.91:0/147606699 shutdown_connections 2023-11-27T20:44:36.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5441f1cc0 0x7fa5441f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5440a95a0 0x7fa54415b5e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa52806b1c0 0x7fa52806d680 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 --2- 172.21.15.91:0/147606699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5300047c0 0x7fa54415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 -- 172.21.15.91:0/147606699 >> 172.21.15.91:0/147606699 conn(0x7fa5440a77f0 msgr2=0x7fa5440a6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:36.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 -- 172.21.15.91:0/147606699 shutdown_connections 2023-11-27T20:44:36.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.458+0000 7fa54b0a3640 1 -- 172.21.15.91:0/147606699 wait complete. 2023-11-27T20:44:36.477 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:44:36.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.691+0000 7f69af664640 1 Processor -- start 2023-11-27T20:44:36.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.691+0000 7f69af664640 1 -- start start 2023-11-27T20:44:36.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.692+0000 7f69af664640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a806d0a0 0x7f69a8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69af664640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f69a80c3ea0 0x7f69a80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69af664640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a80c64a0 con 0x7f69a814fd30 2023-11-27T20:44:36.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69af664640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a80c5c00 con 0x7f69a80c3ea0 2023-11-27T20:44:36.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69af664640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a80c5ee0 con 0x7f69a806d0a0 2023-11-27T20:44:36.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69adc01640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f69a80c3ea0 0x7f69a80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69adc01640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f69a80c3ea0 0x7f69a80c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44178/0 (socket says 172.21.15.91:44178) 2023-11-27T20:44:36.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69adc01640 1 -- 172.21.15.91:0/819842598 learned_addr learned my addr 172.21.15.91:0/819842598 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:36.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69acbff640 1 --2- 172.21.15.91:0/819842598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a806d0a0 0x7f69a8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69adc01640 1 -- 172.21.15.91:0/819842598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a806d0a0 msgr2=0x7f69a8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:36.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69adc01640 1 --2- 172.21.15.91:0/819842598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a806d0a0 0x7f69a8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.693+0000 7f69adc01640 1 -- 172.21.15.91:0/819842598 >> v1:172.21.15.183:6789/0 conn(0x7f69a814fd30 legacy=0x7f69a80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:36.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.694+0000 7f69adc01640 1 -- 172.21.15.91:0/819842598 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a80c61c0 con 0x7f69a80c3ea0 2023-11-27T20:44:36.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.694+0000 7f69acbff640 1 --2- 172.21.15.91:0/819842598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a806d0a0 0x7f69a8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:36.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.695+0000 7f69adc01640 1 --2- 172.21.15.91:0/819842598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a80c3ea0 0x7f69a80c4330 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009e50 tx=0x7f69a002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842de9d9b3f2387f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:36.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.695+0000 7f699bfff640 1 -- 172.21.15.91:0/819842598 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a002ca80 con 0x7f69a80c3ea0 2023-11-27T20:44:36.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.695+0000 7f699bfff640 1 -- 172.21.15.91:0/819842598 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a002cbe0 con 0x7f69a80c3ea0 2023-11-27T20:44:36.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.695+0000 7f699bfff640 1 -- 172.21.15.91:0/819842598 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a00343f0 con 0x7f69a80c3ea0 2023-11-27T20:44:36.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.696+0000 7f69af664640 1 -- 172.21.15.91:0/819842598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a80c3ea0 msgr2=0x7f69a80c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.696+0000 7f69af664640 1 --2- 172.21.15.91:0/819842598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a80c3ea0 0x7f69a80c4330 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009e50 tx=0x7f69a002bee0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.696+0000 7f69af664640 1 -- 172.21.15.91:0/819842598 shutdown_connections 2023-11-27T20:44:36.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.696+0000 7f69af664640 1 --2- 172.21.15.91:0/819842598 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a80c3ea0 0x7f69a80c4330 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.696+0000 7f69af664640 1 --2- 172.21.15.91:0/819842598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a806d0a0 0x7f69a8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.696+0000 7f69af664640 1 -- 172.21.15.91:0/819842598 >> 172.21.15.91:0/819842598 conn(0x7f69a806a500 msgr2=0x7f69a806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:36.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.696+0000 7f69af664640 1 -- 172.21.15.91:0/819842598 shutdown_connections 2023-11-27T20:44:36.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.696+0000 7f69af664640 1 -- 172.21.15.91:0/819842598 wait complete. 2023-11-27T20:44:36.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.698+0000 7f69af664640 1 Processor -- start 2023-11-27T20:44:36.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.698+0000 7f69af664640 1 -- start start 2023-11-27T20:44:36.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69af664640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69a806d0a0 0x7f69a80a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69af664640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a80c3ea0 0x7f69a80bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69af664640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a814fd30 0x7f69a8149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69af664640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a8150560 con 0x7f69a814fd30 2023-11-27T20:44:36.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69af664640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a81522f0 con 0x7f69a806d0a0 2023-11-27T20:44:36.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69af664640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a81516e0 con 0x7f69a80c3ea0 2023-11-27T20:44:36.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69adc01640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a814fd30 0x7f69a8149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69adc01640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a814fd30 0x7f69a8149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44194/0 (socket says 172.21.15.91:44194) 2023-11-27T20:44:36.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69adc01640 1 -- 172.21.15.91:0/1884140248 learned_addr learned my addr 172.21.15.91:0/1884140248 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:36.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69ad400640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69a806d0a0 0x7f69a80a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69adc01640 1 -- 172.21.15.91:0/1884140248 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a80c3ea0 msgr2=0x7f69a80bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69acbff640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a80c3ea0 0x7f69a80bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69adc01640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a80c3ea0 0x7f69a80bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69adc01640 1 -- 172.21.15.91:0/1884140248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69a806d0a0 msgr2=0x7f69a80a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69adc01640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69a806d0a0 0x7f69a80a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69adc01640 1 -- 172.21.15.91:0/1884140248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a0009b30 con 0x7f69a814fd30 2023-11-27T20:44:36.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.699+0000 7f69ad400640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69a806d0a0 0x7f69a80a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:36.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.700+0000 7f69adc01640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a814fd30 0x7f69a8149690 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f69a0036040 tx=0x7f69a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:36.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.700+0000 7f6999ffb640 1 -- 172.21.15.91:0/1884140248 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a003e450 con 0x7f69a814fd30 2023-11-27T20:44:36.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.700+0000 7f6999ffb640 1 -- 172.21.15.91:0/1884140248 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a003e5d0 con 0x7f69a814fd30 2023-11-27T20:44:36.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.700+0000 7f6999ffb640 1 -- 172.21.15.91:0/1884140248 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a003e980 con 0x7f69a814fd30 2023-11-27T20:44:36.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.700+0000 7f69af664640 1 -- 172.21.15.91:0/1884140248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a81519c0 con 0x7f69a814fd30 2023-11-27T20:44:36.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.700+0000 7f69af664640 1 -- 172.21.15.91:0/1884140248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a8151f80 con 0x7f69a814fd30 2023-11-27T20:44:36.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.701+0000 7f69af664640 1 -- 172.21.15.91:0/1884140248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a8068350 con 0x7f69a814fd30 2023-11-27T20:44:36.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.702+0000 7f6999ffb640 1 -- 172.21.15.91:0/1884140248 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f69a002cd50 con 0x7f69a814fd30 2023-11-27T20:44:36.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.703+0000 7f6999ffb640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f698c06b1f0 0x7f698c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:36.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.703+0000 7f6999ffb640 1 -- 172.21.15.91:0/1884140248 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f69a00ac6b0 con 0x7f69a814fd30 2023-11-27T20:44:36.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.703+0000 7f69ad400640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f698c06b1f0 0x7f698c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:36.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.704+0000 7f69ad400640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f698c06b1f0 0x7f698c06d6b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f69a4003eb0 tx=0x7f69a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:36.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.707+0000 7f6999ffb640 1 -- 172.21.15.91:0/1884140248 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f69a0077050 con 0x7f69a814fd30 2023-11-27T20:44:36.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.900+0000 7f69af664640 1 -- 172.21.15.91:0/1884140248 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69a81ed6b0 con 0x7f69a814fd30 2023-11-27T20:44:36.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.901+0000 7f6999ffb640 1 -- 172.21.15.91:0/1884140248 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v61) v1 ==== 105+0+11 (secure 0 0 0) 0x7f69a007a670 con 0x7f69a814fd30 2023-11-27T20:44:36.902 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:44:36.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 -- 172.21.15.91:0/1884140248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f698c06b1f0 msgr2=0x7f698c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f698c06b1f0 0x7f698c06d6b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f69a4003eb0 tx=0x7f69a4009040 comp rx=0 tx=0).stop 2023-11-27T20:44:36.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 -- 172.21.15.91:0/1884140248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a814fd30 msgr2=0x7f69a8149690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:36.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a814fd30 0x7f69a8149690 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f69a0036040 tx=0x7f69a0004a40 comp rx=0 tx=0).stop 2023-11-27T20:44:36.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 -- 172.21.15.91:0/1884140248 shutdown_connections 2023-11-27T20:44:36.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69a814fd30 0x7f69a8149690 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69a80c3ea0 0x7f69a80bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f698c06b1f0 0x7f698c06d6b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 --2- 172.21.15.91:0/1884140248 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69a806d0a0 0x7f69a80a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:36.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 -- 172.21.15.91:0/1884140248 >> 172.21.15.91:0/1884140248 conn(0x7f69a806a500 msgr2=0x7f69a81e0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:36.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 -- 172.21.15.91:0/1884140248 shutdown_connections 2023-11-27T20:44:36.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:36.904+0000 7f69af664640 1 -- 172.21.15.91:0/1884140248 wait complete. 2023-11-27T20:44:36.923 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:44:37.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.138+0000 7f5bb4875640 1 Processor -- start 2023-11-27T20:44:37.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.138+0000 7f5bb4875640 1 -- start start 2023-11-27T20:44:37.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.139+0000 7f5bb4875640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb0155490 0x7f5bb00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.140+0000 7f5bb4875640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb00c06c0 con 0x7f5bb00c1500 2023-11-27T20:44:37.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.140+0000 7f5bb4875640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb00c1020 con 0x7f5bb00a9b40 2023-11-27T20:44:37.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.140+0000 7f5bb4875640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb00a5820 con 0x7f5bb0155490 2023-11-27T20:44:37.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.140+0000 7f5badd9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f5bb00c1500 0x7f5bb00a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54850/0 (socket says 172.21.15.91:54850) 2023-11-27T20:44:37.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.140+0000 7f5badd9b640 1 -- 172.21.15.91:0/3943383614 learned_addr learned my addr 172.21.15.91:0/3943383614 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:37.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.140+0000 7f5bae59c640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb0155490 0x7f5bb00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.140+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493064441 0 0) 0x7f5bb00c06c0 con 0x7f5bb00c1500 2023-11-27T20:44:37.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.140+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b98003520 con 0x7f5bb00c1500 2023-11-27T20:44:37.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274670659 0 0) 0x7f5b98003520 con 0x7f5bb00c1500 2023-11-27T20:44:37.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb0155490 msgr2=0x7f5bb00a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:37.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb0155490 0x7f5bb00a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 >> v1:172.21.15.183:6789/0 conn(0x7f5bb00a9b40 legacy=0x7f5bb00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb00c0910 con 0x7f5bb00c1500 2023-11-27T20:44:37.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f5ba4001670 con 0x7f5bb00c1500 2023-11-27T20:44:37.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 >> v1:172.21.15.91:6789/0 conn(0x7f5bb00c1500 legacy=0x7f5bb00a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b980039a0 0x7f5b98003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb0155490 0x7f5b980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 0x7f5b98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9800ba30 con 0x7f5b98004d00 2023-11-27T20:44:37.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9800bb70 con 0x7f5b980039a0 2023-11-27T20:44:37.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9800bd30 con 0x7f5bb0155490 2023-11-27T20:44:37.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5baed9d640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 0x7f5b98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.141+0000 7f5bae59c640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b980039a0 0x7f5b98003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.142+0000 7f5badd9b640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb0155490 0x7f5b980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.142+0000 7f5baed9d640 1 -- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb0155490 msgr2=0x7f5b980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:37.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.142+0000 7f5baed9d640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb0155490 0x7f5b980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.142+0000 7f5baed9d640 1 -- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b980039a0 msgr2=0x7f5b98003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:37.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.142+0000 7f5baed9d640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b980039a0 0x7f5b98003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.142+0000 7f5baed9d640 1 -- 172.21.15.91:0/3943383614 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98003520 con 0x7f5b98004d00 2023-11-27T20:44:37.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.142+0000 7f5bae59c640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b980039a0 0x7f5b98003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:44:37.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.143+0000 7f5baed9d640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 0x7f5b98005180 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0067240 tx=0x7f5b980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a970c0812d1c6348 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:37.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.143+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8003b70 con 0x7f5b98004d00 2023-11-27T20:44:37.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.143+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba8003cd0 con 0x7f5b98004d00 2023-11-27T20:44:37.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.143+0000 7f5bad59a640 1 -- 172.21.15.91:0/3943383614 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8005310 con 0x7f5b98004d00 2023-11-27T20:44:37.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.144+0000 7f5bb4875640 1 -- 172.21.15.91:0/3943383614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 msgr2=0x7f5b98005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.144+0000 7f5bb4875640 1 --2- 172.21.15.91:0/3943383614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 0x7f5b98005180 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0067240 tx=0x7f5b980057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.144+0000 7f5baed9d640 1 -- 172.21.15.91:0/3943383614 reap_dead start 2023-11-27T20:44:37.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.144+0000 7f5bb4875640 1 -- 172.21.15.91:0/3943383614 shutdown_connections 2023-11-27T20:44:37.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.144+0000 7f5bb4875640 1 -- 172.21.15.91:0/3943383614 >> 172.21.15.91:0/3943383614 conn(0x7f5bb006a500 msgr2=0x7f5bb006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:37.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.144+0000 7f5bb4875640 1 -- 172.21.15.91:0/3943383614 shutdown_connections 2023-11-27T20:44:37.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.144+0000 7f5bb4875640 1 -- 172.21.15.91:0/3943383614 wait complete. 2023-11-27T20:44:37.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.146+0000 7f5bb4875640 1 Processor -- start 2023-11-27T20:44:37.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.146+0000 7f5bb4875640 1 -- start start 2023-11-27T20:44:37.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bb4875640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 0x7f5bb00c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bb4875640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb01eb310 0x7f5bb01eb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bb4875640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bb01ebcd0 0x7f5bb01dcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bb4875640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01edbe0 con 0x7f5b98004d00 2023-11-27T20:44:37.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bb4875640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01ee110 con 0x7f5bb01ebcd0 2023-11-27T20:44:37.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bb4875640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01ede30 con 0x7f5bb01eb310 2023-11-27T20:44:37.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bae59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 0x7f5bb00c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bae59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 0x7f5bb00c4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44212/0 (socket says 172.21.15.91:44212) 2023-11-27T20:44:37.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bae59c640 1 -- 172.21.15.91:0/2053266930 learned_addr learned my addr 172.21.15.91:0/2053266930 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:37.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bae59c640 1 -- 172.21.15.91:0/2053266930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb01eb310 msgr2=0x7f5bb01eb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bae59c640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb01eb310 0x7f5bb01eb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bae59c640 1 -- 172.21.15.91:0/2053266930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bb01ebcd0 msgr2=0x7f5bb01dcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bae59c640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bb01ebcd0 0x7f5bb01dcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.147+0000 7f5bae59c640 1 -- 172.21.15.91:0/2053266930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb01dec10 con 0x7f5b98004d00 2023-11-27T20:44:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.148+0000 7f5bae59c640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 0x7f5bb00c4db0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0011600 tx=0x7f5ba0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.148+0000 7f5b9effd640 1 -- 172.21.15.91:0/2053266930 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0015870 con 0x7f5b98004d00 2023-11-27T20:44:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.148+0000 7f5b9effd640 1 -- 172.21.15.91:0/2053266930 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba00159d0 con 0x7f5b98004d00 2023-11-27T20:44:37.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.148+0000 7f5bb4875640 1 -- 172.21.15.91:0/2053266930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb01deef0 con 0x7f5b98004d00 2023-11-27T20:44:37.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.148+0000 7f5b9effd640 1 -- 172.21.15.91:0/2053266930 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0015d60 con 0x7f5b98004d00 2023-11-27T20:44:37.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.148+0000 7f5bb4875640 1 -- 172.21.15.91:0/2053266930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb00c52f0 con 0x7f5b98004d00 2023-11-27T20:44:37.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.149+0000 7f5bb4875640 1 -- 172.21.15.91:0/2053266930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb0068350 con 0x7f5b98004d00 2023-11-27T20:44:37.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.150+0000 7f5b9effd640 1 -- 172.21.15.91:0/2053266930 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5ba000f490 con 0x7f5b98004d00 2023-11-27T20:44:37.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.151+0000 7f5b9effd640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b9006b1f0 0x7f5b9006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.151+0000 7f5b9effd640 1 -- 172.21.15.91:0/2053266930 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f5ba008a530 con 0x7f5b98004d00 2023-11-27T20:44:37.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.151+0000 7f5badd9b640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b9006b1f0 0x7f5b9006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.152+0000 7f5badd9b640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b9006b1f0 0x7f5b9006d6b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4001eb0 tx=0x7f5ba4001d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:37.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.156+0000 7f5b9effd640 1 -- 172.21.15.91:0/2053266930 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5ba0054f60 con 0x7f5b98004d00 2023-11-27T20:44:37.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.348+0000 7f5bb4875640 1 -- 172.21.15.91:0/2053266930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f5bb00c03a0 con 0x7f5b98004d00 2023-11-27T20:44:37.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.349+0000 7f5b9effd640 1 -- 172.21.15.91:0/2053266930 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v61) v1 ==== 101+0+11 (secure 0 0 0) 0x7f5ba0058580 con 0x7f5b98004d00 2023-11-27T20:44:37.350 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:44:37.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 -- 172.21.15.91:0/2053266930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b9006b1f0 msgr2=0x7f5b9006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b9006b1f0 0x7f5b9006d6b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4001eb0 tx=0x7f5ba4001d60 comp rx=0 tx=0).stop 2023-11-27T20:44:37.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 -- 172.21.15.91:0/2053266930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 msgr2=0x7f5bb00c4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 0x7f5bb00c4db0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0011600 tx=0x7f5ba0011ac0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 -- 172.21.15.91:0/2053266930 shutdown_connections 2023-11-27T20:44:37.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5b9006b1f0 0x7f5b9006d6b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bb01ebcd0 0x7f5bb01dcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bb01eb310 0x7f5bb01eb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 --2- 172.21.15.91:0/2053266930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b98004d00 0x7f5bb00c4db0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 -- 172.21.15.91:0/2053266930 >> 172.21.15.91:0/2053266930 conn(0x7f5bb006a500 msgr2=0x7f5bb0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:37.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 -- 172.21.15.91:0/2053266930 shutdown_connections 2023-11-27T20:44:37.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.352+0000 7f5bb4875640 1 -- 172.21.15.91:0/2053266930 wait complete. 2023-11-27T20:44:37.372 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:44:37.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.589+0000 7f843c7b0640 1 Processor -- start 2023-11-27T20:44:37.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.589+0000 7f843c7b0640 1 -- start start 2023-11-27T20:44:37.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.591+0000 7f843c7b0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f843414fd30 0x7f8434152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.591+0000 7f843c7b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f843406d0a0 0x7f84340a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.591+0000 7f843c7b0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84340c64a0 con 0x7f84340a5260 2023-11-27T20:44:37.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.591+0000 7f843c7b0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84340c5c00 con 0x7f843414fd30 2023-11-27T20:44:37.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.591+0000 7f843c7b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84340c5ee0 con 0x7f843406d0a0 2023-11-27T20:44:37.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.591+0000 7f843a54c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f843414fd30 0x7f8434152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.592+0000 7f8439d4b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f843406d0a0 0x7f84340a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.592+0000 7f843a54c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f843414fd30 0x7f8434152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:56080/0 (socket says 172.21.15.91:56080) 2023-11-27T20:44:37.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.592+0000 7f843a54c640 1 -- 172.21.15.91:0/2501473169 learned_addr learned my addr 172.21.15.91:0/2501473169 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.592+0000 7f843a54c640 1 -- 172.21.15.91:0/2501473169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f843406d0a0 msgr2=0x7f84340a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.592+0000 7f843a54c640 1 --2- 172.21.15.91:0/2501473169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f843406d0a0 0x7f84340a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.592+0000 7f843a54c640 1 -- 172.21.15.91:0/2501473169 >> v1:172.21.15.183:6789/0 conn(0x7f84340a5260 legacy=0x7f84340c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.592+0000 7f843a54c640 1 -- 172.21.15.91:0/2501473169 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84340c61c0 con 0x7f843414fd30 2023-11-27T20:44:37.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.594+0000 7f843a54c640 1 --2- 172.21.15.91:0/2501473169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f843414fd30 0x7f8434152f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8430009870 tx=0x7f843002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a6aa0cb931bf041 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:37.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.594+0000 7f843954a640 1 -- 172.21.15.91:0/2501473169 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430030840 con 0x7f843414fd30 2023-11-27T20:44:37.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.594+0000 7f843954a640 1 -- 172.21.15.91:0/2501473169 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300309a0 con 0x7f843414fd30 2023-11-27T20:44:37.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.594+0000 7f843954a640 1 -- 172.21.15.91:0/2501473169 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430030d30 con 0x7f843414fd30 2023-11-27T20:44:37.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.595+0000 7f843c7b0640 1 -- 172.21.15.91:0/2501473169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f843414fd30 msgr2=0x7f8434152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.595+0000 7f843c7b0640 1 --2- 172.21.15.91:0/2501473169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f843414fd30 0x7f8434152f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8430009870 tx=0x7f843002b980 comp rx=0 tx=0).stop 2023-11-27T20:44:37.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.595+0000 7f843c7b0640 1 -- 172.21.15.91:0/2501473169 shutdown_connections 2023-11-27T20:44:37.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.595+0000 7f843c7b0640 1 --2- 172.21.15.91:0/2501473169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f843406d0a0 0x7f84340a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.595+0000 7f843c7b0640 1 --2- 172.21.15.91:0/2501473169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f843414fd30 0x7f8434152f20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.595+0000 7f843c7b0640 1 -- 172.21.15.91:0/2501473169 >> 172.21.15.91:0/2501473169 conn(0x7f843406a500 msgr2=0x7f843406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:37.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.595+0000 7f843c7b0640 1 -- 172.21.15.91:0/2501473169 shutdown_connections 2023-11-27T20:44:37.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.595+0000 7f843c7b0640 1 -- 172.21.15.91:0/2501473169 wait complete. 2023-11-27T20:44:37.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.597+0000 7f843c7b0640 1 Processor -- start 2023-11-27T20:44:37.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.597+0000 7f843c7b0640 1 -- start start 2023-11-27T20:44:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.598+0000 7f843c7b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f843406d0a0 0x7f84341ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.598+0000 7f843c7b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84340a5260 0x7f843414ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.598+0000 7f843c7b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f843414fd30 0x7f843414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.598+0000 7f843c7b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84341eb340 con 0x7f84340a5260 2023-11-27T20:44:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.598+0000 7f843c7b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84341edf30 con 0x7f843414fd30 2023-11-27T20:44:37.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.598+0000 7f843c7b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84341eb5e0 con 0x7f843406d0a0 2023-11-27T20:44:37.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.598+0000 7f8439d4b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84340a5260 0x7f843414ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.598+0000 7f8439d4b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84340a5260 0x7f843414ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44226/0 (socket says 172.21.15.91:44226) 2023-11-27T20:44:37.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.598+0000 7f8439d4b640 1 -- 172.21.15.91:0/3296899682 learned_addr learned my addr 172.21.15.91:0/3296899682 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:37.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f843ad4d640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f843414fd30 0x7f843414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f8439d4b640 1 -- 172.21.15.91:0/3296899682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f843406d0a0 msgr2=0x7f84341ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f8439d4b640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f843406d0a0 0x7f84341ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f8439d4b640 1 -- 172.21.15.91:0/3296899682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f843414fd30 msgr2=0x7f843414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f8439d4b640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f843414fd30 0x7f843414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f8439d4b640 1 -- 172.21.15.91:0/3296899682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84300094d0 con 0x7f84340a5260 2023-11-27T20:44:37.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f843ad4d640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f843414fd30 0x7f843414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:37.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f8439d4b640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84340a5260 0x7f843414ac10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f842400e980 tx=0x7f842400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:37.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f842affd640 1 -- 172.21.15.91:0/3296899682 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424009670 con 0x7f84340a5260 2023-11-27T20:44:37.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f842affd640 1 -- 172.21.15.91:0/3296899682 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842400ca00 con 0x7f84340a5260 2023-11-27T20:44:37.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f842affd640 1 -- 172.21.15.91:0/3296899682 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842400cd90 con 0x7f84340a5260 2023-11-27T20:44:37.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.599+0000 7f843c7b0640 1 -- 172.21.15.91:0/3296899682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84341eb8c0 con 0x7f84340a5260 2023-11-27T20:44:37.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.600+0000 7f843c7b0640 1 -- 172.21.15.91:0/3296899682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843414b690 con 0x7f84340a5260 2023-11-27T20:44:37.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.601+0000 7f843c7b0640 1 -- 172.21.15.91:0/3296899682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8434068350 con 0x7f84340a5260 2023-11-27T20:44:37.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.601+0000 7f842affd640 1 -- 172.21.15.91:0/3296899682 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8424013470 con 0x7f84340a5260 2023-11-27T20:44:37.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.602+0000 7f842affd640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f841806b1f0 0x7f841806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:37.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.602+0000 7f842affd640 1 -- 172.21.15.91:0/3296899682 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f8424089fe0 con 0x7f84340a5260 2023-11-27T20:44:37.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.603+0000 7f843a54c640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f841806b1f0 0x7f841806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:37.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.603+0000 7f843a54c640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f841806b1f0 0x7f841806d6b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8430036000 tx=0x7f843003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:37.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.607+0000 7f842affd640 1 -- 172.21.15.91:0/3296899682 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8424054940 con 0x7f84340a5260 2023-11-27T20:44:37.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.837+0000 7f843c7b0640 1 -- 172.21.15.91:0/3296899682 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84340c66d0 con 0x7f84340a5260 2023-11-27T20:44:37.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.838+0000 7f842affd640 1 -- 172.21.15.91:0/3296899682 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6132 (secure 0 0 0) 0x7f8424057f60 con 0x7f84340a5260 2023-11-27T20:44:37.839 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:37.839 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:43:52.149238+0000","modified":"2023-11-27T20:43:55.217623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/42700883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":42700883},{"type":"v1","addr":"172.21.15.91:6837","nonce":42700883}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:44:07.981170+0000","modified":"2023-11-27T20:44:11.024916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5790},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5790":{"gid":5790,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6836/1107018884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1107018884},{"type":"v1","addr":"172.21.15.91:6836","nonce":1107018884}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-27T20:44:37.839 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 35 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 -- 172.21.15.91:0/3296899682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f841806b1f0 msgr2=0x7f841806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f841806b1f0 0x7f841806d6b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8430036000 tx=0x7f843003b040 comp rx=0 tx=0).stop 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 -- 172.21.15.91:0/3296899682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84340a5260 msgr2=0x7f843414ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84340a5260 0x7f843414ac10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f842400e980 tx=0x7f842400ee40 comp rx=0 tx=0).stop 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 -- 172.21.15.91:0/3296899682 shutdown_connections 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f841806b1f0 0x7f841806d6b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f843414fd30 0x7f843414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84340a5260 0x7f843414ac10 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 --2- 172.21.15.91:0/3296899682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f843406d0a0 0x7f84341ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 -- 172.21.15.91:0/3296899682 >> 172.21.15.91:0/3296899682 conn(0x7f843406a500 msgr2=0x7f84340a5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:37.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 -- 172.21.15.91:0/3296899682 shutdown_connections 2023-11-27T20:44:37.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:37.841+0000 7f843c7b0640 1 -- 172.21.15.91:0/3296899682 wait complete. 2023-11-27T20:44:37.861 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:38.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.067+0000 7f4712101640 1 Processor -- start 2023-11-27T20:44:38.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.067+0000 7f4712101640 1 -- start start 2023-11-27T20:44:38.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.068+0000 7f4712101640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f470c0c5ec0 0x7f470c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.068+0000 7f4712101640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f470c0721a0 0x7f470c0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.068+0000 7f4712101640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470c0bfdc0 con 0x7f470c0c45d0 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.068+0000 7f4712101640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c06e390 con 0x7f470c0c5ec0 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.068+0000 7f4712101640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c06ddd0 con 0x7f470c0721a0 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.069+0000 7f470b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f470c0c5ec0 0x7f470c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.069+0000 7f470b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f470c0c5ec0 0x7f470c0c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44238/0 (socket says 172.21.15.91:44238) 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.069+0000 7f470b7fe640 1 -- 172.21.15.91:0/268950471 learned_addr learned my addr 172.21.15.91:0/268950471 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.069+0000 7f470bfff640 1 --2- 172.21.15.91:0/268950471 >> v2:172.21.15.183:3300/0 conn(0x7f470c0721a0 0x7f470c0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.069+0000 7f470b7fe640 1 -- 172.21.15.91:0/268950471 >> v2:172.21.15.183:3300/0 conn(0x7f470c0721a0 msgr2=0x7f470c0c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.069+0000 7f470b7fe640 1 --2- 172.21.15.91:0/268950471 >> v2:172.21.15.183:3300/0 conn(0x7f470c0721a0 0x7f470c0c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.069+0000 7f470b7fe640 1 -- 172.21.15.91:0/268950471 >> v1:172.21.15.183:6789/0 conn(0x7f470c0c45d0 legacy=0x7f470c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:38.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.069+0000 7f470b7fe640 1 -- 172.21.15.91:0/268950471 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c06e0b0 con 0x7f470c0c5ec0 2023-11-27T20:44:38.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.069+0000 7f470bfff640 1 --2- 172.21.15.91:0/268950471 >> v2:172.21.15.183:3300/0 conn(0x7f470c0721a0 0x7f470c0c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:38.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.070+0000 7f470b7fe640 1 --2- 172.21.15.91:0/268950471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c5ec0 0x7f470c0c2c30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009870 tx=0x7f46fc02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fee7e5605ad9b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:38.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.071+0000 7f470a7fc640 1 -- 172.21.15.91:0/268950471 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc031740 con 0x7f470c0c5ec0 2023-11-27T20:44:38.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.071+0000 7f470a7fc640 1 -- 172.21.15.91:0/268950471 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc0318a0 con 0x7f470c0c5ec0 2023-11-27T20:44:38.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.071+0000 7f470a7fc640 1 -- 172.21.15.91:0/268950471 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc031c30 con 0x7f470c0c5ec0 2023-11-27T20:44:38.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.071+0000 7f4712101640 1 -- 172.21.15.91:0/268950471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c5ec0 msgr2=0x7f470c0c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.071+0000 7f4712101640 1 --2- 172.21.15.91:0/268950471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c5ec0 0x7f470c0c2c30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009870 tx=0x7f46fc02b7e0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.072+0000 7f4712101640 1 -- 172.21.15.91:0/268950471 shutdown_connections 2023-11-27T20:44:38.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.072+0000 7f4712101640 1 --2- 172.21.15.91:0/268950471 >> v2:172.21.15.183:3300/0 conn(0x7f470c0721a0 0x7f470c0c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.072+0000 7f4712101640 1 --2- 172.21.15.91:0/268950471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c5ec0 0x7f470c0c2c30 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.072+0000 7f4712101640 1 -- 172.21.15.91:0/268950471 >> 172.21.15.91:0/268950471 conn(0x7f470c06a500 msgr2=0x7f470c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:38.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.072+0000 7f4712101640 1 -- 172.21.15.91:0/268950471 shutdown_connections 2023-11-27T20:44:38.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.072+0000 7f4712101640 1 -- 172.21.15.91:0/268950471 wait complete. 2023-11-27T20:44:38.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.073+0000 7f4712101640 1 Processor -- start 2023-11-27T20:44:38.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.074+0000 7f4712101640 1 -- start start 2023-11-27T20:44:38.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.074+0000 7f4712101640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f470c0721a0 0x7f470c14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.074+0000 7f4712101640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c45d0 0x7f470c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.074+0000 7f4712101640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f470c0c5ec0 0x7f470c0a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.074+0000 7f4712101640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c0a7870 con 0x7f470c0c45d0 2023-11-27T20:44:38.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.074+0000 7f4712101640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c154dc0 con 0x7f470c0c5ec0 2023-11-27T20:44:38.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.074+0000 7f4712101640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1edfc0 con 0x7f470c0721a0 2023-11-27T20:44:38.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.075+0000 7f470affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c45d0 0x7f470c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.075+0000 7f470affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c45d0 0x7f470c0a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44248/0 (socket says 172.21.15.91:44248) 2023-11-27T20:44:38.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.075+0000 7f470affd640 1 -- 172.21.15.91:0/1682017213 learned_addr learned my addr 172.21.15.91:0/1682017213 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:38.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.075+0000 7f470affd640 1 -- 172.21.15.91:0/1682017213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f470c0721a0 msgr2=0x7f470c14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.075+0000 7f470affd640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f470c0721a0 0x7f470c14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.075+0000 7f470affd640 1 -- 172.21.15.91:0/1682017213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f470c0c5ec0 msgr2=0x7f470c0a7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.075+0000 7f470bfff640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f470c0c5ec0 0x7f470c0a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.075+0000 7f470affd640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f470c0c5ec0 0x7f470c0a7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.075+0000 7f470affd640 1 -- 172.21.15.91:0/1682017213 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc0094d0 con 0x7f470c0c45d0 2023-11-27T20:44:38.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.076+0000 7f470affd640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c45d0 0x7f470c0a5870 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f46f400c400 tx=0x7f46f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:38.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.076+0000 7f4703fff640 1 -- 172.21.15.91:0/1682017213 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f40035f0 con 0x7f470c0c45d0 2023-11-27T20:44:38.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.076+0000 7f4703fff640 1 -- 172.21.15.91:0/1682017213 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f4003750 con 0x7f470c0c45d0 2023-11-27T20:44:38.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.076+0000 7f4703fff640 1 -- 172.21.15.91:0/1682017213 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4003b00 con 0x7f470c0c45d0 2023-11-27T20:44:38.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.076+0000 7f4712101640 1 -- 172.21.15.91:0/1682017213 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c156900 con 0x7f470c0c45d0 2023-11-27T20:44:38.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.076+0000 7f4712101640 1 -- 172.21.15.91:0/1682017213 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c156ec0 con 0x7f470c0c45d0 2023-11-27T20:44:38.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.077+0000 7f4712101640 1 -- 172.21.15.91:0/1682017213 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470c0a7ae0 con 0x7f470c0c45d0 2023-11-27T20:44:38.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.078+0000 7f4703fff640 1 -- 172.21.15.91:0/1682017213 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f46f4003c60 con 0x7f470c0c45d0 2023-11-27T20:44:38.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.079+0000 7f4703fff640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f46f006b1c0 0x7f46f006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.079+0000 7f4703fff640 1 -- 172.21.15.91:0/1682017213 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f46f4088f60 con 0x7f470c0c45d0 2023-11-27T20:44:38.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.079+0000 7f470b7fe640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f46f006b1c0 0x7f46f006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.080+0000 7f470b7fe640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f46f006b1c0 0x7f46f006d680 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f46fc035000 tx=0x7f46fc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:38.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.083+0000 7f4703fff640 1 -- 172.21.15.91:0/1682017213 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f46f40539a0 con 0x7f470c0c45d0 2023-11-27T20:44:38.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.274+0000 7f4712101640 1 -- 172.21.15.91:0/1682017213 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f470c068350 con 0x7f470c0c45d0 2023-11-27T20:44:38.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.276+0000 7f4703fff640 1 -- 172.21.15.91:0/1682017213 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+20342 (secure 0 0 0) 0x7f46f4017090 con 0x7f470c0c45d0 2023-11-27T20:44:38.278 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:38.278 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":61,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:18.243029+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:38.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 -- 172.21.15.91:0/1682017213 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f46f006b1c0 msgr2=0x7f46f006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f46f006b1c0 0x7f46f006d680 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f46fc035000 tx=0x7f46fc030000 comp rx=0 tx=0).stop 2023-11-27T20:44:38.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 -- 172.21.15.91:0/1682017213 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c45d0 msgr2=0x7f470c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c45d0 0x7f470c0a5870 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f46f400c400 tx=0x7f46f400c8c0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 -- 172.21.15.91:0/1682017213 shutdown_connections 2023-11-27T20:44:38.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f46f006b1c0 0x7f46f006d680 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f470c0c5ec0 0x7f470c0a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f470c0c45d0 0x7f470c0a5870 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 --2- 172.21.15.91:0/1682017213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f470c0721a0 0x7f470c14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 -- 172.21.15.91:0/1682017213 >> 172.21.15.91:0/1682017213 conn(0x7f470c06a500 msgr2=0x7f470c0c2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:38.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 -- 172.21.15.91:0/1682017213 shutdown_connections 2023-11-27T20:44:38.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.279+0000 7f4712101640 1 -- 172.21.15.91:0/1682017213 wait complete. 2023-11-27T20:44:38.298 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-27T20:44:38.298 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:44:38.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.503+0000 7f59de7a9640 1 Processor -- start 2023-11-27T20:44:38.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.503+0000 7f59de7a9640 1 -- start start 2023-11-27T20:44:38.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.504+0000 7f59de7a9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f59d814fd30 0x7f59d8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.505+0000 7f59de7a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 0x7f59d80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.505+0000 7f59de7a9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d80c64a0 con 0x7f59d806d0a0 2023-11-27T20:44:38.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.505+0000 7f59de7a9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d80c5c00 con 0x7f59d814fd30 2023-11-27T20:44:38.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.505+0000 7f59de7a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80c5ee0 con 0x7f59d80c3ea0 2023-11-27T20:44:38.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.505+0000 7f59d7fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f59d814fd30 0x7f59d8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.505+0000 7f59dcd46640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 0x7f59d80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.506+0000 7f59d7fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f59d814fd30 0x7f59d8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:56114/0 (socket says 172.21.15.91:56114) 2023-11-27T20:44:38.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.506+0000 7f59d7fff640 1 -- 172.21.15.91:0/2994130784 learned_addr learned my addr 172.21.15.91:0/2994130784 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:38.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.506+0000 7f59dcd46640 1 -- 172.21.15.91:0/2994130784 >> v2:172.21.15.183:3300/0 conn(0x7f59d814fd30 msgr2=0x7f59d8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:38.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.506+0000 7f59dcd46640 1 --2- 172.21.15.91:0/2994130784 >> v2:172.21.15.183:3300/0 conn(0x7f59d814fd30 0x7f59d8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.506+0000 7f59dcd46640 1 -- 172.21.15.91:0/2994130784 >> v1:172.21.15.183:6789/0 conn(0x7f59d806d0a0 legacy=0x7f59d80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.506+0000 7f59dcd46640 1 -- 172.21.15.91:0/2994130784 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d80c61c0 con 0x7f59d80c3ea0 2023-11-27T20:44:38.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.506+0000 7f59d7fff640 1 --2- 172.21.15.91:0/2994130784 >> v2:172.21.15.183:3300/0 conn(0x7f59d814fd30 0x7f59d8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:44:38.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.508+0000 7f59dcd46640 1 --2- 172.21.15.91:0/2994130784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 0x7f59d80c4330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009d90 tx=0x7f59d002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66f83e374b99d2c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:38.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.508+0000 7f59d77fe640 1 -- 172.21.15.91:0/2994130784 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d002cc60 con 0x7f59d80c3ea0 2023-11-27T20:44:38.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.508+0000 7f59d77fe640 1 -- 172.21.15.91:0/2994130784 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d002cdc0 con 0x7f59d80c3ea0 2023-11-27T20:44:38.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.508+0000 7f59d77fe640 1 -- 172.21.15.91:0/2994130784 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0034660 con 0x7f59d80c3ea0 2023-11-27T20:44:38.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.509+0000 7f59de7a9640 1 -- 172.21.15.91:0/2994130784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 msgr2=0x7f59d80c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.509+0000 7f59de7a9640 1 --2- 172.21.15.91:0/2994130784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 0x7f59d80c4330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009d90 tx=0x7f59d002beb0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.509+0000 7f59de7a9640 1 -- 172.21.15.91:0/2994130784 shutdown_connections 2023-11-27T20:44:38.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.509+0000 7f59de7a9640 1 --2- 172.21.15.91:0/2994130784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 0x7f59d80c4330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.509+0000 7f59de7a9640 1 --2- 172.21.15.91:0/2994130784 >> v2:172.21.15.183:3300/0 conn(0x7f59d814fd30 0x7f59d8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.509+0000 7f59de7a9640 1 -- 172.21.15.91:0/2994130784 >> 172.21.15.91:0/2994130784 conn(0x7f59d806a500 msgr2=0x7f59d806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:38.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.509+0000 7f59de7a9640 1 -- 172.21.15.91:0/2994130784 shutdown_connections 2023-11-27T20:44:38.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.509+0000 7f59de7a9640 1 -- 172.21.15.91:0/2994130784 wait complete. 2023-11-27T20:44:38.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.511+0000 7f59de7a9640 1 Processor -- start 2023-11-27T20:44:38.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.511+0000 7f59de7a9640 1 -- start start 2023-11-27T20:44:38.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.512+0000 7f59de7a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59d806d0a0 0x7f59d81edae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.512+0000 7f59de7a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 0x7f59d8155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.512+0000 7f59de7a9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59d814fd30 0x7f59d81563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.512+0000 7f59de7a9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d81ee7d0 con 0x7f59d814fd30 2023-11-27T20:44:38.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.512+0000 7f59de7a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d81ee4f0 con 0x7f59d806d0a0 2023-11-27T20:44:38.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.512+0000 7f59de7a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d81512d0 con 0x7f59d80c3ea0 2023-11-27T20:44:38.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.512+0000 7f59dcd46640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59d814fd30 0x7f59d81563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59dcd46640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59d814fd30 0x7f59d81563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44252/0 (socket says 172.21.15.91:44252) 2023-11-27T20:44:38.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59dcd46640 1 -- 172.21.15.91:0/916393329 learned_addr learned my addr 172.21.15.91:0/916393329 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:38.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59d7fff640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59d806d0a0 0x7f59d81edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59cffff640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 0x7f59d8155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59dcd46640 1 -- 172.21.15.91:0/916393329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 msgr2=0x7f59d8155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59dcd46640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 0x7f59d8155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59dcd46640 1 -- 172.21.15.91:0/916393329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59d806d0a0 msgr2=0x7f59d81edae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59dcd46640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59d806d0a0 0x7f59d81edae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59dcd46640 1 -- 172.21.15.91:0/916393329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80094d0 con 0x7f59d814fd30 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59cffff640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 0x7f59d8155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.513+0000 7f59dcd46640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59d814fd30 0x7f59d81563d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009d90 tx=0x7f59d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.514+0000 7f59d57fa640 1 -- 172.21.15.91:0/916393329 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0040650 con 0x7f59d814fd30 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.514+0000 7f59d57fa640 1 -- 172.21.15.91:0/916393329 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d00407b0 con 0x7f59d814fd30 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.514+0000 7f59de7a9640 1 -- 172.21.15.91:0/916393329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d0009a70 con 0x7f59d814fd30 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.514+0000 7f59d57fa640 1 -- 172.21.15.91:0/916393329 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0040b60 con 0x7f59d814fd30 2023-11-27T20:44:38.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.514+0000 7f59de7a9640 1 -- 172.21.15.91:0/916393329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d8152350 con 0x7f59d814fd30 2023-11-27T20:44:38.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.515+0000 7f59de7a9640 1 -- 172.21.15.91:0/916393329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d80a9570 con 0x7f59d814fd30 2023-11-27T20:44:38.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.516+0000 7f59d57fa640 1 -- 172.21.15.91:0/916393329 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f59d0040cc0 con 0x7f59d814fd30 2023-11-27T20:44:38.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.517+0000 7f59d57fa640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59b806b1c0 0x7f59b806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.517+0000 7f59d57fa640 1 -- 172.21.15.91:0/916393329 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f59d00aca50 con 0x7f59d814fd30 2023-11-27T20:44:38.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.517+0000 7f59d7fff640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59b806b1c0 0x7f59b806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.518+0000 7f59d7fff640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59b806b1c0 0x7f59b806d680 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f59d814a0d0 tx=0x7f59c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:38.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.521+0000 7f59d57fa640 1 -- 172.21.15.91:0/916393329 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f59d80a9570 con 0x7f59d814fd30 2023-11-27T20:44:38.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.749+0000 7f59de7a9640 1 -- 172.21.15.91:0/916393329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59d8071ff0 con 0x7f59d814fd30 2023-11-27T20:44:38.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.751+0000 7f59d57fa640 1 -- 172.21.15.91:0/916393329 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6132 (secure 0 0 0) 0x7f59d8071ff0 con 0x7f59d814fd30 2023-11-27T20:44:38.751 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:38.751 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:43:52.149238+0000","modified":"2023-11-27T20:43:55.217623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/42700883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":42700883},{"type":"v1","addr":"172.21.15.91:6837","nonce":42700883}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:44:07.981170+0000","modified":"2023-11-27T20:44:11.024916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5790},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5790":{"gid":5790,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6836/1107018884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1107018884},{"type":"v1","addr":"172.21.15.91:6836","nonce":1107018884}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-27T20:44:38.751 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 35 2023-11-27T20:44:38.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.753+0000 7f59de7a9640 1 -- 172.21.15.91:0/916393329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59b806b1c0 msgr2=0x7f59b806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.753+0000 7f59de7a9640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59b806b1c0 0x7f59b806d680 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f59d814a0d0 tx=0x7f59c8008040 comp rx=0 tx=0).stop 2023-11-27T20:44:38.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.753+0000 7f59de7a9640 1 -- 172.21.15.91:0/916393329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59d814fd30 msgr2=0x7f59d81563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.753+0000 7f59de7a9640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59d814fd30 0x7f59d81563d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009d90 tx=0x7f59d0004a40 comp rx=0 tx=0).stop 2023-11-27T20:44:38.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.754+0000 7f59de7a9640 1 -- 172.21.15.91:0/916393329 shutdown_connections 2023-11-27T20:44:38.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.754+0000 7f59de7a9640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f59d814fd30 0x7f59d81563d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.754+0000 7f59de7a9640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59d80c3ea0 0x7f59d8155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.754+0000 7f59de7a9640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f59b806b1c0 0x7f59b806d680 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.754+0000 7f59de7a9640 1 --2- 172.21.15.91:0/916393329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59d806d0a0 0x7f59d81edae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.754+0000 7f59de7a9640 1 -- 172.21.15.91:0/916393329 >> 172.21.15.91:0/916393329 conn(0x7f59d806a500 msgr2=0x7f59d814ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:38.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.754+0000 7f59de7a9640 1 -- 172.21.15.91:0/916393329 shutdown_connections 2023-11-27T20:44:38.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.754+0000 7f59de7a9640 1 -- 172.21.15.91:0/916393329 wait complete. 2023-11-27T20:44:38.771 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:44:38.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.969+0000 7fa2910d3640 1 Processor -- start 2023-11-27T20:44:38.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.970+0000 7fa2910d3640 1 -- start start 2023-11-27T20:44:38.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.971+0000 7fa2910d3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa28c14fd30 0x7fa28c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.971+0000 7fa2910d3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa28c06d0a0 0x7fa28c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.971+0000 7fa2910d3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c0c64a0 con 0x7fa28c0a5260 2023-11-27T20:44:38.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.971+0000 7fa2910d3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28c0c5c00 con 0x7fa28c06d0a0 2023-11-27T20:44:38.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.971+0000 7fa2910d3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28c0c5ee0 con 0x7fa28c14fd30 2023-11-27T20:44:38.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.971+0000 7fa28a59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa28c06d0a0 0x7fa28c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.971+0000 7fa28b59e640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa28c0a5260 0x7fa28c0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54864/0 (socket says 172.21.15.91:54864) 2023-11-27T20:44:38.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.971+0000 7fa28a59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa28c06d0a0 0x7fa28c0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44258/0 (socket says 172.21.15.91:44258) 2023-11-27T20:44:38.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.971+0000 7fa28b59e640 1 -- 172.21.15.91:0/3620114630 learned_addr learned my addr 172.21.15.91:0/3620114630 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:38.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.972+0000 7fa28ad9d640 1 --2- 172.21.15.91:0/3620114630 >> v2:172.21.15.183:3300/0 conn(0x7fa28c14fd30 0x7fa28c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.972+0000 7fa28a59c640 1 -- 172.21.15.91:0/3620114630 >> v2:172.21.15.183:3300/0 conn(0x7fa28c14fd30 msgr2=0x7fa28c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:38.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.972+0000 7fa28a59c640 1 --2- 172.21.15.91:0/3620114630 >> v2:172.21.15.183:3300/0 conn(0x7fa28c14fd30 0x7fa28c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.972+0000 7fa28a59c640 1 -- 172.21.15.91:0/3620114630 >> v1:172.21.15.91:6789/0 conn(0x7fa28c0a5260 legacy=0x7fa28c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.972+0000 7fa28a59c640 1 -- 172.21.15.91:0/3620114630 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0c61c0 con 0x7fa28c06d0a0 2023-11-27T20:44:38.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.973+0000 7fa28a59c640 1 --2- 172.21.15.91:0/3620114630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c06d0a0 0x7fa28c0a4d20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa28c06b200 tx=0x7fa27402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613527d24cbfa4a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:38.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.973+0000 7fa289d9b640 1 -- 172.21.15.91:0/3620114630 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27402cc70 con 0x7fa28c06d0a0 2023-11-27T20:44:38.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.973+0000 7fa289d9b640 1 -- 172.21.15.91:0/3620114630 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27402cdd0 con 0x7fa28c06d0a0 2023-11-27T20:44:38.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.973+0000 7fa289d9b640 1 -- 172.21.15.91:0/3620114630 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa274034660 con 0x7fa28c06d0a0 2023-11-27T20:44:38.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.974+0000 7fa2910d3640 1 -- 172.21.15.91:0/3620114630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c06d0a0 msgr2=0x7fa28c0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.974+0000 7fa2910d3640 1 --2- 172.21.15.91:0/3620114630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c06d0a0 0x7fa28c0a4d20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa28c06b200 tx=0x7fa27402bec0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.974+0000 7fa2910d3640 1 -- 172.21.15.91:0/3620114630 shutdown_connections 2023-11-27T20:44:38.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.974+0000 7fa2910d3640 1 --2- 172.21.15.91:0/3620114630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c06d0a0 0x7fa28c0a4d20 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.974+0000 7fa2910d3640 1 --2- 172.21.15.91:0/3620114630 >> v2:172.21.15.183:3300/0 conn(0x7fa28c14fd30 0x7fa28c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.974+0000 7fa2910d3640 1 -- 172.21.15.91:0/3620114630 >> 172.21.15.91:0/3620114630 conn(0x7fa28c06a500 msgr2=0x7fa28c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:38.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.974+0000 7fa2910d3640 1 -- 172.21.15.91:0/3620114630 shutdown_connections 2023-11-27T20:44:38.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.974+0000 7fa2910d3640 1 -- 172.21.15.91:0/3620114630 wait complete. 2023-11-27T20:44:38.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.976+0000 7fa2910d3640 1 Processor -- start 2023-11-27T20:44:38.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.976+0000 7fa2910d3640 1 -- start start 2023-11-27T20:44:38.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa2910d3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa28c06d0a0 0x7fa28c0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa2910d3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa28c0a5260 0x7fa28c1ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa2910d3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c14fd30 0x7fa28c1eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa2910d3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c155e50 con 0x7fa28c14fd30 2023-11-27T20:44:38.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa2910d3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c155050 con 0x7fa28c0a5260 2023-11-27T20:44:38.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa2910d3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c156430 con 0x7fa28c06d0a0 2023-11-27T20:44:38.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa28b59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c14fd30 0x7fa28c1eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa28b59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c14fd30 0x7fa28c1eaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44266/0 (socket says 172.21.15.91:44266) 2023-11-27T20:44:38.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa28b59e640 1 -- 172.21.15.91:0/2924190293 learned_addr learned my addr 172.21.15.91:0/2924190293 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:38.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa28b59e640 1 -- 172.21.15.91:0/2924190293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa28c06d0a0 msgr2=0x7fa28c0bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa28b59e640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa28c06d0a0 0x7fa28c0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa28b59e640 1 -- 172.21.15.91:0/2924190293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa28c0a5260 msgr2=0x7fa28c1ea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:38.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa28b59e640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa28c0a5260 0x7fa28c1ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:38.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.977+0000 7fa28b59e640 1 -- 172.21.15.91:0/2924190293 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa274009a70 con 0x7fa28c14fd30 2023-11-27T20:44:38.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.978+0000 7fa28b59e640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c14fd30 0x7fa28c1eaa00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c420 tx=0x7fa28400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:38.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.978+0000 7fa2837fe640 1 -- 172.21.15.91:0/2924190293 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284005ce0 con 0x7fa28c14fd30 2023-11-27T20:44:38.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.978+0000 7fa2837fe640 1 -- 172.21.15.91:0/2924190293 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa284005e40 con 0x7fa28c14fd30 2023-11-27T20:44:38.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.978+0000 7fa2837fe640 1 -- 172.21.15.91:0/2924190293 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2840072d0 con 0x7fa28c14fd30 2023-11-27T20:44:38.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.978+0000 7fa2910d3640 1 -- 172.21.15.91:0/2924190293 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c156710 con 0x7fa28c14fd30 2023-11-27T20:44:38.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.978+0000 7fa2910d3640 1 -- 172.21.15.91:0/2924190293 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c0bf8a0 con 0x7fa28c14fd30 2023-11-27T20:44:38.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.979+0000 7fa2910d3640 1 -- 172.21.15.91:0/2924190293 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28c0c2890 con 0x7fa28c14fd30 2023-11-27T20:44:38.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.980+0000 7fa2837fe640 1 -- 172.21.15.91:0/2924190293 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa2840074f0 con 0x7fa28c14fd30 2023-11-27T20:44:38.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.981+0000 7fa2837fe640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa26c06b1c0 0x7fa26c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:38.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.981+0000 7fa2837fe640 1 -- 172.21.15.91:0/2924190293 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fa2840891b0 con 0x7fa28c14fd30 2023-11-27T20:44:38.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.981+0000 7fa28ad9d640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa26c06b1c0 0x7fa26c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:38.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.982+0000 7fa28ad9d640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa26c06b1c0 0x7fa26c06d680 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa27c006fd0 tx=0x7fa27c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:38.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:38.985+0000 7fa2837fe640 1 -- 172.21.15.91:0/2924190293 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa284053c90 con 0x7fa28c14fd30 2023-11-27T20:44:39.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.197+0000 7fa2910d3640 1 -- 172.21.15.91:0/2924190293 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa28c0a8c90 con 0x7fa28c14fd30 2023-11-27T20:44:39.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.198+0000 7fa2837fe640 1 -- 172.21.15.91:0/2924190293 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6132 (secure 0 0 0) 0x7fa2840572b0 con 0x7fa28c14fd30 2023-11-27T20:44:39.199 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:39.199 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:43:52.149238+0000","modified":"2023-11-27T20:43:55.217623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/42700883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":42700883},{"type":"v1","addr":"172.21.15.91:6837","nonce":42700883}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:44:07.981170+0000","modified":"2023-11-27T20:44:11.024916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5790},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5790":{"gid":5790,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6836/1107018884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1107018884},{"type":"v1","addr":"172.21.15.91:6836","nonce":1107018884}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-27T20:44:39.199 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 35 2023-11-27T20:44:39.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.200+0000 7fa2910d3640 1 -- 172.21.15.91:0/2924190293 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa26c06b1c0 msgr2=0x7fa26c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.200+0000 7fa2910d3640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa26c06b1c0 0x7fa26c06d680 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa27c006fd0 tx=0x7fa27c008040 comp rx=0 tx=0).stop 2023-11-27T20:44:39.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.201+0000 7fa2910d3640 1 -- 172.21.15.91:0/2924190293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c14fd30 msgr2=0x7fa28c1eaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.201+0000 7fa2910d3640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c14fd30 0x7fa28c1eaa00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c420 tx=0x7fa28400c8e0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.201+0000 7fa2910d3640 1 -- 172.21.15.91:0/2924190293 shutdown_connections 2023-11-27T20:44:39.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.201+0000 7fa2910d3640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa28c14fd30 0x7fa28c1eaa00 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.201+0000 7fa2910d3640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa26c06b1c0 0x7fa26c06d680 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.201+0000 7fa2910d3640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa28c0a5260 0x7fa28c1ea4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.201+0000 7fa2910d3640 1 --2- 172.21.15.91:0/2924190293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa28c06d0a0 0x7fa28c0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.201+0000 7fa2910d3640 1 -- 172.21.15.91:0/2924190293 >> 172.21.15.91:0/2924190293 conn(0x7fa28c06a500 msgr2=0x7fa28c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.201+0000 7fa2910d3640 1 -- 172.21.15.91:0/2924190293 shutdown_connections 2023-11-27T20:44:39.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.201+0000 7fa2910d3640 1 -- 172.21.15.91:0/2924190293 wait complete. 2023-11-27T20:44:39.219 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:39.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.419+0000 7fb9bc264640 1 Processor -- start 2023-11-27T20:44:39.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.419+0000 7fb9bc264640 1 -- start start 2023-11-27T20:44:39.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.420+0000 7fb9bc264640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b414fd30 0x7fb9b4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.420+0000 7fb9bc264640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb9b406d0a0 0x7fb9b40a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.421+0000 7fb9bc264640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b40c64a0 con 0x7fb9b40a5260 2023-11-27T20:44:39.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.421+0000 7fb9bc264640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b40c5c00 con 0x7fb9b406d0a0 2023-11-27T20:44:39.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.421+0000 7fb9bc264640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c5ee0 con 0x7fb9b414fd30 2023-11-27T20:44:39.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.421+0000 7fb9ba801640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb9b40a5260 0x7fb9b40c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54866/0 (socket says 172.21.15.91:54866) 2023-11-27T20:44:39.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.421+0000 7fb9ba801640 1 -- 172.21.15.91:0/657322789 learned_addr learned my addr 172.21.15.91:0/657322789 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:39.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.421+0000 7fb9ba000640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b414fd30 0x7fb9b4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:39.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.421+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649317193 0 0) 0x7fb9b40c64a0 con 0x7fb9b40a5260 2023-11-27T20:44:39.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.421+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a0003520 con 0x7fb9b40a5260 2023-11-27T20:44:39.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 602991656 0 0) 0x7fb9a0003520 con 0x7fb9b40a5260 2023-11-27T20:44:39.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b414fd30 msgr2=0x7fb9b4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:39.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b414fd30 0x7fb9b4152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 >> v2:172.21.15.183:3300/0 conn(0x7fb9b406d0a0 msgr2=0x7fb9b40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 --2- 172.21.15.91:0/657322789 >> v2:172.21.15.183:3300/0 conn(0x7fb9b406d0a0 0x7fb9b40a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b40c61c0 con 0x7fb9b40a5260 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fb9ac0019f0 con 0x7fb9b40a5260 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 >> v1:172.21.15.91:6789/0 conn(0x7fb9b40a5260 legacy=0x7fb9b40c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b414fd30 0x7fb9a0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9a0003fa0 0x7fb9a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0004d00 0x7fb9a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c5c00 con 0x7fb9a0003fa0 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c5ee0 con 0x7fb9a0004d00 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a000bb90 con 0x7fb9b414fd30 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b97ff640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9a0003fa0 0x7fb9a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9ba000640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b414fd30 0x7fb9a0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b97ff640 1 -- 172.21.15.91:0/657322789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b414fd30 msgr2=0x7fb9a0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:39.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b97ff640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b414fd30 0x7fb9a0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b97ff640 1 -- 172.21.15.91:0/657322789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0004d00 msgr2=0x7fb9a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:39.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.422+0000 7fb9b97ff640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0004d00 0x7fb9a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.423+0000 7fb9b97ff640 1 -- 172.21.15.91:0/657322789 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0003520 con 0x7fb9a0003fa0 2023-11-27T20:44:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.424+0000 7fb9b97ff640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9a0003fa0 0x7fb9a00047c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb9b406d4e0 tx=0x7fb9a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0bb8b8c6ebd5e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.424+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4032600 con 0x7fb9a0003fa0 2023-11-27T20:44:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.424+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a402e050 con 0x7fb9a0003fa0 2023-11-27T20:44:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.424+0000 7fb9b8ffe640 1 -- 172.21.15.91:0/657322789 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40329c0 con 0x7fb9a0003fa0 2023-11-27T20:44:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.424+0000 7fb9bc264640 1 -- 172.21.15.91:0/657322789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9a0003fa0 msgr2=0x7fb9a00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.424+0000 7fb9bc264640 1 --2- 172.21.15.91:0/657322789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9a0003fa0 0x7fb9a00047c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb9b406d4e0 tx=0x7fb9a00057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.424+0000 7fb9ba801640 1 -- 172.21.15.91:0/657322789 reap_dead start 2023-11-27T20:44:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.425+0000 7fb9bc264640 1 -- 172.21.15.91:0/657322789 shutdown_connections 2023-11-27T20:44:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.425+0000 7fb9bc264640 1 -- 172.21.15.91:0/657322789 >> 172.21.15.91:0/657322789 conn(0x7fb9b406a500 msgr2=0x7fb9b406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:39.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.425+0000 7fb9bc264640 1 -- 172.21.15.91:0/657322789 shutdown_connections 2023-11-27T20:44:39.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.425+0000 7fb9bc264640 1 -- 172.21.15.91:0/657322789 wait complete. 2023-11-27T20:44:39.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.426+0000 7fb9bc264640 1 Processor -- start 2023-11-27T20:44:39.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.426+0000 7fb9bc264640 1 -- start start 2023-11-27T20:44:39.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.427+0000 7fb9bc264640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0003fa0 0x7fb9b414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.427+0000 7fb9bc264640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b4070790 0x7fb9b414ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.427+0000 7fb9bc264640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9b41510e0 0x7fb9b4151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.427+0000 7fb9bc264640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4071030 con 0x7fb9b41510e0 2023-11-27T20:44:39.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.427+0000 7fb9bc264640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b414b1e0 con 0x7fb9a0003fa0 2023-11-27T20:44:39.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.427+0000 7fb9bc264640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b41eb590 con 0x7fb9b4070790 2023-11-27T20:44:39.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.428+0000 7fb9ba801640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9b41510e0 0x7fb9b4151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:39.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.428+0000 7fb9ba801640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9b41510e0 0x7fb9b4151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44272/0 (socket says 172.21.15.91:44272) 2023-11-27T20:44:39.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.428+0000 7fb9ba801640 1 -- 172.21.15.91:0/2555523443 learned_addr learned my addr 172.21.15.91:0/2555523443 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:39.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.428+0000 7fb9ba801640 1 -- 172.21.15.91:0/2555523443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b4070790 msgr2=0x7fb9b414ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.428+0000 7fb9ba801640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b4070790 0x7fb9b414ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.428+0000 7fb9ba801640 1 -- 172.21.15.91:0/2555523443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0003fa0 msgr2=0x7fb9b414a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.428+0000 7fb9ba801640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0003fa0 0x7fb9b414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.428+0000 7fb9ba801640 1 -- 172.21.15.91:0/2555523443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b4151aa0 con 0x7fb9b41510e0 2023-11-27T20:44:39.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.428+0000 7fb9ba801640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9b41510e0 0x7fb9b4151560 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac001560 tx=0x7fb9ac00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:39.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.429+0000 7fb9aa7fc640 1 -- 172.21.15.91:0/2555523443 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00a610 con 0x7fb9b41510e0 2023-11-27T20:44:39.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.429+0000 7fb9aa7fc640 1 -- 172.21.15.91:0/2555523443 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac00a770 con 0x7fb9b41510e0 2023-11-27T20:44:39.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.429+0000 7fb9aa7fc640 1 -- 172.21.15.91:0/2555523443 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00ab00 con 0x7fb9b41510e0 2023-11-27T20:44:39.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.429+0000 7fb9bc264640 1 -- 172.21.15.91:0/2555523443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b40722d0 con 0x7fb9b41510e0 2023-11-27T20:44:39.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.429+0000 7fb9bc264640 1 -- 172.21.15.91:0/2555523443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b414b480 con 0x7fb9b41510e0 2023-11-27T20:44:39.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.430+0000 7fb9bc264640 1 -- 172.21.15.91:0/2555523443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b4068350 con 0x7fb9b41510e0 2023-11-27T20:44:39.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.431+0000 7fb9aa7fc640 1 -- 172.21.15.91:0/2555523443 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb9ac00ac60 con 0x7fb9b41510e0 2023-11-27T20:44:39.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.432+0000 7fb9aa7fc640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb99806b1f0 0x7fb99806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.432+0000 7fb9aa7fc640 1 -- 172.21.15.91:0/2555523443 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fb9ac089b60 con 0x7fb9b41510e0 2023-11-27T20:44:39.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.432+0000 7fb9ba000640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb99806b1f0 0x7fb99806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:39.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.433+0000 7fb9ba000640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb99806b1f0 0x7fb99806d6b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0006fd0 tx=0x7fb9b000b2e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:39.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.437+0000 7fb9aa7fc640 1 -- 172.21.15.91:0/2555523443 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb9ac0544f0 con 0x7fb9b41510e0 2023-11-27T20:44:39.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.633+0000 7fb9bc264640 1 -- 172.21.15.91:0/2555523443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9b40c66d0 con 0x7fb9b41510e0 2023-11-27T20:44:39.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.636+0000 7fb9aa7fc640 1 -- 172.21.15.91:0/2555523443 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+20342 (secure 0 0 0) 0x7fb9ac057b10 con 0x7fb9b41510e0 2023-11-27T20:44:39.637 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:39.637 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":61,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:18.243029+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:43:50.043742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-27T20:43:51.176510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:39.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 -- 172.21.15.91:0/2555523443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb99806b1f0 msgr2=0x7fb99806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb99806b1f0 0x7fb99806d6b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0006fd0 tx=0x7fb9b000b2e0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 -- 172.21.15.91:0/2555523443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9b41510e0 msgr2=0x7fb9b4151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9b41510e0 0x7fb9b4151560 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac001560 tx=0x7fb9ac00ccd0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 -- 172.21.15.91:0/2555523443 shutdown_connections 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb9b41510e0 0x7fb9b4151560 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b4070790 0x7fb9b414ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb99806b1f0 0x7fb99806d6b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 --2- 172.21.15.91:0/2555523443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0003fa0 0x7fb9b414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 -- 172.21.15.91:0/2555523443 >> 172.21.15.91:0/2555523443 conn(0x7fb9b406a500 msgr2=0x7fb9b40bfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 -- 172.21.15.91:0/2555523443 shutdown_connections 2023-11-27T20:44:39.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.639+0000 7fb9bc264640 1 -- 172.21.15.91:0/2555523443 wait complete. 2023-11-27T20:44:39.659 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-27T20:44:39.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.872+0000 7f358f217640 1 Processor -- start 2023-11-27T20:44:39.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.873+0000 7f358f217640 1 -- start start 2023-11-27T20:44:39.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.874+0000 7f358f217640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f358814fd30 0x7f3588152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.874+0000 7f358f217640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35880c64a0 con 0x7f358806d0a0 2023-11-27T20:44:39.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.874+0000 7f358f217640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35880c5c00 con 0x7f35880c3ea0 2023-11-27T20:44:39.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.874+0000 7f358f217640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35880c5ee0 con 0x7f358814fd30 2023-11-27T20:44:39.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.874+0000 7f358cfb3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f358814fd30 0x7f3588152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:39.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.874+0000 7f358cfb3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f358814fd30 0x7f3588152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44278/0 (socket says 172.21.15.91:44278) 2023-11-27T20:44:39.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.874+0000 7f358cfb3640 1 -- 172.21.15.91:0/3147881064 learned_addr learned my addr 172.21.15.91:0/3147881064 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:39.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.875+0000 7f358cfb3640 1 -- 172.21.15.91:0/3147881064 >> v1:172.21.15.183:6789/0 conn(0x7f35880c3ea0 legacy=0x7f35880c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:39.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.875+0000 7f358cfb3640 1 -- 172.21.15.91:0/3147881064 >> v1:172.21.15.91:6789/0 conn(0x7f358806d0a0 legacy=0x7f35880a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.875+0000 7f358cfb3640 1 -- 172.21.15.91:0/3147881064 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35880c61c0 con 0x7f358814fd30 2023-11-27T20:44:39.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.876+0000 7f358cfb3640 1 --2- 172.21.15.91:0/3147881064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 0x7f3588152f20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3578009e50 tx=0x7f357802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb693314e1b4f27 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:39.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.876+0000 7f35877fe640 1 -- 172.21.15.91:0/3147881064 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357802cb10 con 0x7f358814fd30 2023-11-27T20:44:39.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.876+0000 7f35877fe640 1 -- 172.21.15.91:0/3147881064 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357802cc70 con 0x7f358814fd30 2023-11-27T20:44:39.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.876+0000 7f35877fe640 1 -- 172.21.15.91:0/3147881064 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35780343f0 con 0x7f358814fd30 2023-11-27T20:44:39.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.877+0000 7f358f217640 1 -- 172.21.15.91:0/3147881064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 msgr2=0x7f3588152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.877+0000 7f358f217640 1 --2- 172.21.15.91:0/3147881064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 0x7f3588152f20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3578009e50 tx=0x7f357802bf70 comp rx=0 tx=0).stop 2023-11-27T20:44:39.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.877+0000 7f358f217640 1 -- 172.21.15.91:0/3147881064 shutdown_connections 2023-11-27T20:44:39.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.877+0000 7f358f217640 1 --2- 172.21.15.91:0/3147881064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 0x7f3588152f20 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.877+0000 7f358f217640 1 -- 172.21.15.91:0/3147881064 >> 172.21.15.91:0/3147881064 conn(0x7f358806a500 msgr2=0x7f358806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:39.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.877+0000 7f358f217640 1 -- 172.21.15.91:0/3147881064 shutdown_connections 2023-11-27T20:44:39.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.877+0000 7f358f217640 1 -- 172.21.15.91:0/3147881064 wait complete. 2023-11-27T20:44:39.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.879+0000 7f358f217640 1 Processor -- start 2023-11-27T20:44:39.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.879+0000 7f358f217640 1 -- start start 2023-11-27T20:44:39.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358f217640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f358806d0a0 0x7f358814f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358f217640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35880c3ea0 0x7f35880713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358f217640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 0x7f35881e8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358f217640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35881e7e10 con 0x7f358814fd30 2023-11-27T20:44:39.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358f217640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35881e9280 con 0x7f35880c3ea0 2023-11-27T20:44:39.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358f217640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35880bb5b0 con 0x7f358806d0a0 2023-11-27T20:44:39.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358d7b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 0x7f35881e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:39.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358d7b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 0x7f35881e8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44286/0 (socket says 172.21.15.91:44286) 2023-11-27T20:44:39.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358d7b4640 1 -- 172.21.15.91:0/2804885859 learned_addr learned my addr 172.21.15.91:0/2804885859 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:39.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358d7b4640 1 -- 172.21.15.91:0/2804885859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f358806d0a0 msgr2=0x7f358814f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358d7b4640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f358806d0a0 0x7f358814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358d7b4640 1 -- 172.21.15.91:0/2804885859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35880c3ea0 msgr2=0x7f35880713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:39.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358d7b4640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35880c3ea0 0x7f35880713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:39.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.880+0000 7f358d7b4640 1 -- 172.21.15.91:0/2804885859 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3578009b30 con 0x7f358814fd30 2023-11-27T20:44:39.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.881+0000 7f358d7b4640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 0x7f35881e8220 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f358000c470 tx=0x7f358000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.881+0000 7f35857fa640 1 -- 172.21.15.91:0/2804885859 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580011790 con 0x7f358814fd30 2023-11-27T20:44:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.881+0000 7f35857fa640 1 -- 172.21.15.91:0/2804885859 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35800118f0 con 0x7f358814fd30 2023-11-27T20:44:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.881+0000 7f35857fa640 1 -- 172.21.15.91:0/2804885859 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580011ca0 con 0x7f358814fd30 2023-11-27T20:44:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.881+0000 7f358f217640 1 -- 172.21.15.91:0/2804885859 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35881dc320 con 0x7f358814fd30 2023-11-27T20:44:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.881+0000 7f358f217640 1 -- 172.21.15.91:0/2804885859 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35881ebd90 con 0x7f358814fd30 2023-11-27T20:44:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.882+0000 7f358f217640 1 -- 172.21.15.91:0/2804885859 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3588068350 con 0x7f358814fd30 2023-11-27T20:44:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.883+0000 7f35857fa640 1 -- 172.21.15.91:0/2804885859 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f358001c460 con 0x7f358814fd30 2023-11-27T20:44:39.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.884+0000 7f35857fa640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f356806b1c0 0x7f356806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:39.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.884+0000 7f35857fa640 1 -- 172.21.15.91:0/2804885859 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f3580089a60 con 0x7f358814fd30 2023-11-27T20:44:39.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.884+0000 7f358cfb3640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f356806b1c0 0x7f356806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:39.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.885+0000 7f358cfb3640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f356806b1c0 0x7f356806d680 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3578035000 tx=0x7f357802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:39.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:39.888+0000 7f35857fa640 1 -- 172.21.15.91:0/2804885859 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f35800543f0 con 0x7f358814fd30 2023-11-27T20:44:40.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.115+0000 7f358f217640 1 -- 172.21.15.91:0/2804885859 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f358806d540 con 0x7f358814fd30 2023-11-27T20:44:40.117 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-11-27T20:44:40.116+0000 7fb57696d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-27T20:44:40.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.120+0000 7f35857fa640 1 -- 172.21.15.91:0/2804885859 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3580057a10 con 0x7f358814fd30 2023-11-27T20:44:40.121 INFO:teuthology.orchestra.run.smithi091.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T20:44:40.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.123+0000 7f358f217640 1 -- 172.21.15.91:0/2804885859 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f356806b1c0 msgr2=0x7f356806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:40.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.123+0000 7f358f217640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f356806b1c0 0x7f356806d680 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3578035000 tx=0x7f357802e000 comp rx=0 tx=0).stop 2023-11-27T20:44:40.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.123+0000 7f358f217640 1 -- 172.21.15.91:0/2804885859 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 msgr2=0x7f35881e8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:40.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.123+0000 7f358f217640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 0x7f35881e8220 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f358000c470 tx=0x7f358000c930 comp rx=0 tx=0).stop 2023-11-27T20:44:40.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.123+0000 7f358f217640 1 -- 172.21.15.91:0/2804885859 shutdown_connections 2023-11-27T20:44:40.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.123+0000 7f358f217640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f358814fd30 0x7f35881e8220 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:40.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.123+0000 7f358f217640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f356806b1c0 0x7f356806d680 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:40.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.123+0000 7f358f217640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35880c3ea0 0x7f35880713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:40.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.123+0000 7f358f217640 1 --2- 172.21.15.91:0/2804885859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f358806d0a0 0x7f358814f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:40.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.123+0000 7f358f217640 1 -- 172.21.15.91:0/2804885859 >> 172.21.15.91:0/2804885859 conn(0x7f358806a500 msgr2=0x7f3588152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:40.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.124+0000 7f358f217640 1 -- 172.21.15.91:0/2804885859 shutdown_connections 2023-11-27T20:44:40.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.124+0000 7f358f217640 1 -- 172.21.15.91:0/2804885859 wait complete. 2023-11-27T20:44:40.135 INFO:tasks.ceph.mds.c.smithi091.stderr: -3197> 2023-11-27T20:43:56.647+0000 7f3dd458b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:44:40.151 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-27T20:44:40.193 INFO:tasks.ceph.mds.c.smithi091.stdout:starting mds.c at 2023-11-27T20:44:40.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.337+0000 7f0508f9e640 1 Processor -- start 2023-11-27T20:44:40.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.337+0000 7f0508f9e640 1 -- start start 2023-11-27T20:44:40.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.339+0000 7f0508f9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f050414fd30 0x7f0504152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:40.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.339+0000 7f0508f9e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f050406d0a0 0x7f05040a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:40.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.339+0000 7f0508f9e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05040c64a0 con 0x7f05040a5260 2023-11-27T20:44:40.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.339+0000 7f0508f9e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05040c5c00 con 0x7f050414fd30 2023-11-27T20:44:40.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.339+0000 7f0508f9e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05040c5ee0 con 0x7f050406d0a0 2023-11-27T20:44:40.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.339+0000 7f050259c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f050414fd30 0x7f0504152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:40.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.339+0000 7f050259c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f050414fd30 0x7f0504152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44306/0 (socket says 172.21.15.91:44306) 2023-11-27T20:44:40.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.339+0000 7f050259c640 1 -- 172.21.15.91:0/93390453 learned_addr learned my addr 172.21.15.91:0/93390453 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:40.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.340+0000 7f050259c640 1 -- 172.21.15.91:0/93390453 >> v2:172.21.15.183:3300/0 conn(0x7f050406d0a0 msgr2=0x7f05040a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:40.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.340+0000 7f050259c640 1 --2- 172.21.15.91:0/93390453 >> v2:172.21.15.183:3300/0 conn(0x7f050406d0a0 0x7f05040a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:40.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.340+0000 7f050259c640 1 -- 172.21.15.91:0/93390453 >> v1:172.21.15.183:6789/0 conn(0x7f05040a5260 legacy=0x7f05040c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:40.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.340+0000 7f050259c640 1 -- 172.21.15.91:0/93390453 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05040c61c0 con 0x7f050414fd30 2023-11-27T20:44:40.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.341+0000 7f050259c640 1 --2- 172.21.15.91:0/93390453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f050414fd30 0x7f0504152f20 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f050406b460 tx=0x7f04f402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5622d40d3895935b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:40.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.341+0000 7f050159a640 1 -- 172.21.15.91:0/93390453 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4031870 con 0x7f050414fd30 2023-11-27T20:44:40.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.341+0000 7f050159a640 1 -- 172.21.15.91:0/93390453 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f40319d0 con 0x7f050414fd30 2023-11-27T20:44:40.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.341+0000 7f050159a640 1 -- 172.21.15.91:0/93390453 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4031d60 con 0x7f050414fd30 2023-11-27T20:44:40.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.342+0000 7f0508f9e640 1 -- 172.21.15.91:0/93390453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f050414fd30 msgr2=0x7f0504152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:40.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.342+0000 7f0508f9e640 1 --2- 172.21.15.91:0/93390453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f050414fd30 0x7f0504152f20 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f050406b460 tx=0x7f04f402b910 comp rx=0 tx=0).stop 2023-11-27T20:44:40.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.342+0000 7f0508f9e640 1 -- 172.21.15.91:0/93390453 shutdown_connections 2023-11-27T20:44:40.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.342+0000 7f0508f9e640 1 --2- 172.21.15.91:0/93390453 >> v2:172.21.15.183:3300/0 conn(0x7f050406d0a0 0x7f05040a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:40.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.342+0000 7f0508f9e640 1 --2- 172.21.15.91:0/93390453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f050414fd30 0x7f0504152f20 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:40.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.342+0000 7f0508f9e640 1 -- 172.21.15.91:0/93390453 >> 172.21.15.91:0/93390453 conn(0x7f050406a500 msgr2=0x7f050406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:40.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.342+0000 7f0508f9e640 1 -- 172.21.15.91:0/93390453 shutdown_connections 2023-11-27T20:44:40.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.342+0000 7f0508f9e640 1 -- 172.21.15.91:0/93390453 wait complete. 2023-11-27T20:44:40.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.343+0000 7f0508f9e640 1 Processor -- start 2023-11-27T20:44:40.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.344+0000 7f0508f9e640 1 -- start start 2023-11-27T20:44:40.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.344+0000 7f0508f9e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f050406d0a0 0x7f050414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:40.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.344+0000 7f0508f9e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05040a5260 0x7f05041e8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:40.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.344+0000 7f0508f9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f050414fd30 0x7f05041e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:40.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.344+0000 7f0508f9e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0504154410 con 0x7f05040a5260 2023-11-27T20:44:40.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.344+0000 7f0508f9e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0504153de0 con 0x7f050406d0a0 2023-11-27T20:44:40.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.344+0000 7f0508f9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05041e8c80 con 0x7f050414fd30 2023-11-27T20:44:40.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.345+0000 7f0501d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05040a5260 0x7f05041e8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:40.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.345+0000 7f0501d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05040a5260 0x7f05041e8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44320/0 (socket says 172.21.15.91:44320) 2023-11-27T20:44:40.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.345+0000 7f0501d9b640 1 -- 172.21.15.91:0/3855534540 learned_addr learned my addr 172.21.15.91:0/3855534540 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:40.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.345+0000 7f0501d9b640 1 -- 172.21.15.91:0/3855534540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f050414fd30 msgr2=0x7f05041e85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:40.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.345+0000 7f0501d9b640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f050414fd30 0x7f05041e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:40.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.345+0000 7f0501d9b640 1 -- 172.21.15.91:0/3855534540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f050406d0a0 msgr2=0x7f050414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:40.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.345+0000 7f050259c640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f050406d0a0 0x7f050414eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:40.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.345+0000 7f0501d9b640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f050406d0a0 0x7f050414eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:40.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.345+0000 7f0501d9b640 1 -- 172.21.15.91:0/3855534540 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40094d0 con 0x7f05040a5260 2023-11-27T20:44:40.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.346+0000 7f0501d9b640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05040a5260 0x7f05041e8060 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b450 tx=0x7f04f800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:40.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.346+0000 7f04f2ffd640 1 -- 172.21.15.91:0/3855534540 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8011890 con 0x7f05040a5260 2023-11-27T20:44:40.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.346+0000 7f04f2ffd640 1 -- 172.21.15.91:0/3855534540 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f80119f0 con 0x7f05040a5260 2023-11-27T20:44:40.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.346+0000 7f0508f9e640 1 -- 172.21.15.91:0/3855534540 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0504154030 con 0x7f05040a5260 2023-11-27T20:44:40.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.346+0000 7f04f2ffd640 1 -- 172.21.15.91:0/3855534540 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8011da0 con 0x7f05040a5260 2023-11-27T20:44:40.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.346+0000 7f0508f9e640 1 -- 172.21.15.91:0/3855534540 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0504151f70 con 0x7f05040a5260 2023-11-27T20:44:40.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.347+0000 7f0508f9e640 1 -- 172.21.15.91:0/3855534540 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0504154550 con 0x7f05040a5260 2023-11-27T20:44:40.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.348+0000 7f04f2ffd640 1 -- 172.21.15.91:0/3855534540 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f04f801a400 con 0x7f05040a5260 2023-11-27T20:44:40.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.349+0000 7f04f2ffd640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04e406b1c0 0x7f04e406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:40.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.350+0000 7f04f2ffd640 1 -- 172.21.15.91:0/3855534540 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6709+0+0 (secure 0 0 0) 0x7f04f808a230 con 0x7f05040a5260 2023-11-27T20:44:40.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.350+0000 7f050259c640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04e406b1c0 0x7f04e406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:40.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.350+0000 7f050259c640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04e406b1c0 0x7f04e406d680 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f04f4036000 tx=0x7f04f403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:40.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.354+0000 7f04f2ffd640 1 -- 172.21.15.91:0/3855534540 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0504154550 con 0x7f05040a5260 2023-11-27T20:44:40.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:40.584+0000 7f0508f9e640 1 -- 172.21.15.91:0/3855534540 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0504154550 con 0x7f05040a5260 2023-11-27T20:44:41.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.123+0000 7f04f2ffd640 1 -- 172.21.15.91:0/3855534540 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0504154550 con 0x7f05040a5260 2023-11-27T20:44:41.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.128+0000 7f0508f9e640 1 -- 172.21.15.91:0/3855534540 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04e406b1c0 msgr2=0x7f04e406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:41.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.128+0000 7f0508f9e640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04e406b1c0 0x7f04e406d680 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f04f4036000 tx=0x7f04f403c040 comp rx=0 tx=0).stop 2023-11-27T20:44:41.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.128+0000 7f0508f9e640 1 -- 172.21.15.91:0/3855534540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05040a5260 msgr2=0x7f05041e8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:41.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.128+0000 7f0508f9e640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05040a5260 0x7f05041e8060 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b450 tx=0x7f04f800b910 comp rx=0 tx=0).stop 2023-11-27T20:44:41.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.128+0000 7f0508f9e640 1 -- 172.21.15.91:0/3855534540 shutdown_connections 2023-11-27T20:44:41.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.128+0000 7f0508f9e640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f050414fd30 0x7f05041e85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.128+0000 7f0508f9e640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05040a5260 0x7f05041e8060 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.128+0000 7f0508f9e640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f04e406b1c0 0x7f04e406d680 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.128+0000 7f0508f9e640 1 --2- 172.21.15.91:0/3855534540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f050406d0a0 0x7f050414eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.128+0000 7f0508f9e640 1 -- 172.21.15.91:0/3855534540 >> 172.21.15.91:0/3855534540 conn(0x7f050406a500 msgr2=0x7f05041dbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:41.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.129+0000 7f0508f9e640 1 -- 172.21.15.91:0/3855534540 shutdown_connections 2023-11-27T20:44:41.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.129+0000 7f0508f9e640 1 -- 172.21.15.91:0/3855534540 wait complete. 2023-11-27T20:44:41.150 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-27T20:44:41.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.408+0000 7f5d6b36e640 1 Processor -- start 2023-11-27T20:44:41.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.408+0000 7f5d6b36e640 1 -- start start 2023-11-27T20:44:41.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d6b36e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640a5360 0x7f5d640c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:41.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d6b36e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5d640c1140 0x7f5d640c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:41.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d6b36e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5d641554c0 0x7f5d640c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:41.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d6b36e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d64154790 con 0x7f5d641554c0 2023-11-27T20:44:41.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d6b36e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d640c30c0 con 0x7f5d640c1140 2023-11-27T20:44:41.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d6b36e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d641549e0 con 0x7f5d640a5360 2023-11-27T20:44:41.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d6ab6d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5d641554c0 0x7f5d640c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:41.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d6ab6d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5d641554c0 0x7f5d640c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44332/0 (socket says 172.21.15.91:44332) 2023-11-27T20:44:41.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d6ab6d640 1 -- 172.21.15.91:0/1920283930 learned_addr learned my addr 172.21.15.91:0/1920283930 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:41.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d69b6b640 1 --2- 172.21.15.91:0/1920283930 >> v2:172.21.15.183:3300/0 conn(0x7f5d640c1140 0x7f5d640c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:41.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.410+0000 7f5d6a36c640 1 --2- 172.21.15.91:0/1920283930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640a5360 0x7f5d640c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:41.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.411+0000 7f5d6ab6d640 1 -- 172.21.15.91:0/1920283930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640a5360 msgr2=0x7f5d640c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:41.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.411+0000 7f5d6ab6d640 1 --2- 172.21.15.91:0/1920283930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640a5360 0x7f5d640c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.411+0000 7f5d6ab6d640 1 -- 172.21.15.91:0/1920283930 >> v2:172.21.15.183:3300/0 conn(0x7f5d640c1140 msgr2=0x7f5d640c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:41.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.411+0000 7f5d6ab6d640 1 --2- 172.21.15.91:0/1920283930 >> v2:172.21.15.183:3300/0 conn(0x7f5d640c1140 0x7f5d640c16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.411+0000 7f5d6ab6d640 1 -- 172.21.15.91:0/1920283930 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64154cc0 con 0x7f5d641554c0 2023-11-27T20:44:41.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.412+0000 7f5d6ab6d640 1 --2- 172.21.15.91:0/1920283930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 0x7f5d640c3bc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0098a0 tx=0x7f5d5c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2110cb0d26c404a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:41.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.412+0000 7f5d6936a640 1 -- 172.21.15.91:0/1920283930 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c0317c0 con 0x7f5d641554c0 2023-11-27T20:44:41.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.412+0000 7f5d6936a640 1 -- 172.21.15.91:0/1920283930 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c031920 con 0x7f5d641554c0 2023-11-27T20:44:41.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.412+0000 7f5d6936a640 1 -- 172.21.15.91:0/1920283930 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c031cb0 con 0x7f5d641554c0 2023-11-27T20:44:41.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.413+0000 7f5d6b36e640 1 -- 172.21.15.91:0/1920283930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 msgr2=0x7f5d640c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:41.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.413+0000 7f5d6b36e640 1 --2- 172.21.15.91:0/1920283930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 0x7f5d640c3bc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0098a0 tx=0x7f5d5c02b860 comp rx=0 tx=0).stop 2023-11-27T20:44:41.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.413+0000 7f5d6b36e640 1 -- 172.21.15.91:0/1920283930 shutdown_connections 2023-11-27T20:44:41.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.413+0000 7f5d6b36e640 1 --2- 172.21.15.91:0/1920283930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 0x7f5d640c3bc0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.413+0000 7f5d6b36e640 1 --2- 172.21.15.91:0/1920283930 >> v2:172.21.15.183:3300/0 conn(0x7f5d640c1140 0x7f5d640c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.413+0000 7f5d6b36e640 1 --2- 172.21.15.91:0/1920283930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640a5360 0x7f5d640c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.413+0000 7f5d6b36e640 1 -- 172.21.15.91:0/1920283930 >> 172.21.15.91:0/1920283930 conn(0x7f5d640c5cc0 msgr2=0x7f5d640c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:41.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.413+0000 7f5d6b36e640 1 -- 172.21.15.91:0/1920283930 shutdown_connections 2023-11-27T20:44:41.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.413+0000 7f5d6b36e640 1 -- 172.21.15.91:0/1920283930 wait complete. 2023-11-27T20:44:41.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.415+0000 7f5d6b36e640 1 Processor -- start 2023-11-27T20:44:41.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.415+0000 7f5d6b36e640 1 -- start start 2023-11-27T20:44:41.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6b36e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640a5360 0x7f5d64147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:41.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6b36e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d640c1140 0x7f5d641485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:41.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6b36e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 0x7f5d641429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:41.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6b36e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6415d500 con 0x7f5d641554c0 2023-11-27T20:44:41.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6b36e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d64148110 con 0x7f5d640c1140 2023-11-27T20:44:41.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6b36e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640a6830 con 0x7f5d640a5360 2023-11-27T20:44:41.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6ab6d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 0x7f5d641429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:41.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6ab6d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 0x7f5d641429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44346/0 (socket says 172.21.15.91:44346) 2023-11-27T20:44:41.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6ab6d640 1 -- 172.21.15.91:0/118369560 learned_addr learned my addr 172.21.15.91:0/118369560 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:41.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6ab6d640 1 -- 172.21.15.91:0/118369560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640a5360 msgr2=0x7f5d64147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:41.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6ab6d640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640a5360 0x7f5d64147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6ab6d640 1 -- 172.21.15.91:0/118369560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d640c1140 msgr2=0x7f5d641485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:41.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6ab6d640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d640c1140 0x7f5d641485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:41.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.416+0000 7f5d6ab6d640 1 -- 172.21.15.91:0/118369560 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c0094d0 con 0x7f5d641554c0 2023-11-27T20:44:41.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.417+0000 7f5d6ab6d640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 0x7f5d641429f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c02b8a0 tx=0x7f5d5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:41.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.417+0000 7f5d5affd640 1 -- 172.21.15.91:0/118369560 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c032860 con 0x7f5d641554c0 2023-11-27T20:44:41.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.417+0000 7f5d5affd640 1 -- 172.21.15.91:0/118369560 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c0329e0 con 0x7f5d641554c0 2023-11-27T20:44:41.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.417+0000 7f5d5affd640 1 -- 172.21.15.91:0/118369560 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c032d90 con 0x7f5d641554c0 2023-11-27T20:44:41.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.417+0000 7f5d6b36e640 1 -- 172.21.15.91:0/118369560 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d640a6b10 con 0x7f5d641554c0 2023-11-27T20:44:41.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.417+0000 7f5d6b36e640 1 -- 172.21.15.91:0/118369560 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d640a70d0 con 0x7f5d641554c0 2023-11-27T20:44:41.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.418+0000 7f5d6b36e640 1 -- 172.21.15.91:0/118369560 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d64067fd0 con 0x7f5d641554c0 2023-11-27T20:44:41.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.419+0000 7f5d5affd640 1 -- 172.21.15.91:0/118369560 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5d5c04d3f0 con 0x7f5d641554c0 2023-11-27T20:44:41.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.420+0000 7f5d5affd640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4806b1f0 0x7f5d4806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:41.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.420+0000 7f5d5affd640 1 -- 172.21.15.91:0/118369560 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6709+0+0 (secure 0 0 0) 0x7f5d5c0abb40 con 0x7f5d641554c0 2023-11-27T20:44:41.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.420+0000 7f5d6a36c640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4806b1f0 0x7f5d4806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:41.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.421+0000 7f5d6a36c640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4806b1f0 0x7f5d4806d6b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5d600070b0 tx=0x7f5d60007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:41.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.425+0000 7f5d5affd640 1 -- 172.21.15.91:0/118369560 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5d5c076510 con 0x7f5d641554c0 2023-11-27T20:44:41.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:41.615+0000 7f5d6b36e640 1 -- 172.21.15.91:0/118369560 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d6415b810 con 0x7f5d641554c0 2023-11-27T20:44:42.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.401+0000 7f5d5affd640 1 -- 172.21.15.91:0/118369560 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5d6415b810 con 0x7f5d641554c0 2023-11-27T20:44:42.403 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' removed 2023-11-27T20:44:42.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 -- 172.21.15.91:0/118369560 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4806b1f0 msgr2=0x7f5d4806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:42.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4806b1f0 0x7f5d4806d6b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5d600070b0 tx=0x7f5d60007040 comp rx=0 tx=0).stop 2023-11-27T20:44:42.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 -- 172.21.15.91:0/118369560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 msgr2=0x7f5d641429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:42.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 0x7f5d641429f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c02b8a0 tx=0x7f5d5c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 -- 172.21.15.91:0/118369560 shutdown_connections 2023-11-27T20:44:42.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d641554c0 0x7f5d641429f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5d4806b1f0 0x7f5d4806d6b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d640c1140 0x7f5d641485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 --2- 172.21.15.91:0/118369560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640a5360 0x7f5d64147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 -- 172.21.15.91:0/118369560 >> 172.21.15.91:0/118369560 conn(0x7f5d640c5cc0 msgr2=0x7f5d6415af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:42.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 -- 172.21.15.91:0/118369560 shutdown_connections 2023-11-27T20:44:42.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.405+0000 7f5d6b36e640 1 -- 172.21.15.91:0/118369560 wait complete. 2023-11-27T20:44:42.436 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-27T20:44:42.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.624+0000 7f6dcf753640 1 Processor -- start 2023-11-27T20:44:42.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.624+0000 7f6dcf753640 1 -- start start 2023-11-27T20:44:42.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.625+0000 7f6dcf753640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6dc814fa80 0x7f6dc806d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:42.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.625+0000 7f6dcf753640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6dc8071f70 0x7f6dc80c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:42.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.625+0000 7f6dcf753640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc80c0980 con 0x7f6dc8072530 2023-11-27T20:44:42.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.625+0000 7f6dcf753640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc806d160 con 0x7f6dc8071f70 2023-11-27T20:44:42.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.625+0000 7f6dcf753640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc806c070 con 0x7f6dc814fa80 2023-11-27T20:44:42.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dcccee640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f6dc8072530 0x7f6dc80c5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:54890/0 (socket says 172.21.15.91:54890) 2023-11-27T20:44:42.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dcccee640 1 -- 172.21.15.91:0/377454590 learned_addr learned my addr 172.21.15.91:0/377454590 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:42.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dcd4ef640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6dc814fa80 0x7f6dc806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:42.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532965271 0 0) 0x7f6dc80c0980 con 0x7f6dc8072530 2023-11-27T20:44:42.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dcdcf0640 1 --2- 172.21.15.91:0/377454590 >> v2:172.21.15.183:3300/0 conn(0x7f6dc8071f70 0x7f6dc80c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:42.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db4003520 con 0x7f6dc8072530 2023-11-27T20:44:42.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3541816489 0 0) 0x7f6db4003520 con 0x7f6dc8072530 2023-11-27T20:44:42.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6dc814fa80 msgr2=0x7f6dc806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:42.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dbbfff640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6dc814fa80 0x7f6dc806d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 >> v2:172.21.15.183:3300/0 conn(0x7f6dc8071f70 msgr2=0x7f6dc80c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:42.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dbbfff640 1 --2- 172.21.15.91:0/377454590 >> v2:172.21.15.183:3300/0 conn(0x7f6dc8071f70 0x7f6dc80c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc806dc70 con 0x7f6dc8072530 2023-11-27T20:44:42.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f6dbc001670 con 0x7f6dc8072530 2023-11-27T20:44:42.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.626+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 >> v1:172.21.15.91:6789/0 conn(0x7f6dc8072530 legacy=0x7f6dc80c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:42.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dbbfff640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 0x7f6db4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:42.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dbbfff640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6db40047c0 0x7f6db4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dbbfff640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6db4005180 0x7f6db400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc806d160 con 0x7f6db4003970 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc806c070 con 0x7f6db4005180 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db400c050 con 0x7f6db40047c0 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dcd4ef640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6dc814fa80 0x7f6dc806d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dcd4ef640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 0x7f6db4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dcccee640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6db40047c0 0x7f6db4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dcdcf0640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6db4005180 0x7f6db400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dcd4ef640 1 -- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6db40047c0 msgr2=0x7f6db4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dcd4ef640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6db40047c0 0x7f6db4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dcd4ef640 1 -- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6db4005180 msgr2=0x7f6db400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dcd4ef640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6db4005180 0x7f6db400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.627+0000 7f6dcd4ef640 1 -- 172.21.15.91:0/377454590 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db4003520 con 0x7f6db4003970 2023-11-27T20:44:42.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.628+0000 7f6dcd4ef640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 0x7f6db4003d90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4006fd0 tx=0x7f6db40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcceb68f9b534c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:42.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.629+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4033600 con 0x7f6db4003970 2023-11-27T20:44:42.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.629+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc402f050 con 0x7f6db4003970 2023-11-27T20:44:42.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.629+0000 7f6dbbfff640 1 -- 172.21.15.91:0/377454590 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4033980 con 0x7f6db4003970 2023-11-27T20:44:42.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.629+0000 7f6dcf753640 1 -- 172.21.15.91:0/377454590 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 msgr2=0x7f6db4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:42.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.629+0000 7f6dcf753640 1 --2- 172.21.15.91:0/377454590 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 0x7f6db4003d90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4006fd0 tx=0x7f6db40057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.629+0000 7f6dcdcf0640 1 -- 172.21.15.91:0/377454590 reap_dead start 2023-11-27T20:44:42.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.629+0000 7f6dcf753640 1 -- 172.21.15.91:0/377454590 shutdown_connections 2023-11-27T20:44:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.629+0000 7f6dcf753640 1 -- 172.21.15.91:0/377454590 >> 172.21.15.91:0/377454590 conn(0x7f6dc80c5bc0 msgr2=0x7f6dc80c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.629+0000 7f6dcf753640 1 -- 172.21.15.91:0/377454590 shutdown_connections 2023-11-27T20:44:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.630+0000 7f6dcf753640 1 -- 172.21.15.91:0/377454590 wait complete. 2023-11-27T20:44:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.631+0000 7f6dcf753640 1 Processor -- start 2023-11-27T20:44:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.631+0000 7f6dcf753640 1 -- start start 2023-11-27T20:44:42.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.632+0000 7f6dcf753640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 0x7f6dc8147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.632+0000 7f6dcf753640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc814b390 0x7f6dc80a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.632+0000 7f6dcf753640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6dc80a9840 0x7f6dc80708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.632+0000 7f6dcf753640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc80a8c70 con 0x7f6db4003970 2023-11-27T20:44:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.632+0000 7f6dcf753640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8146db0 con 0x7f6dc814b390 2023-11-27T20:44:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.632+0000 7f6dcf753640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc814a8b0 con 0x7f6dc80a9840 2023-11-27T20:44:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.632+0000 7f6dcd4ef640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 0x7f6dc8147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.633+0000 7f6dcd4ef640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 0x7f6dc8147d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44374/0 (socket says 172.21.15.91:44374) 2023-11-27T20:44:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.633+0000 7f6dcd4ef640 1 -- 172.21.15.91:0/3219092615 learned_addr learned my addr 172.21.15.91:0/3219092615 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.633+0000 7f6dcd4ef640 1 -- 172.21.15.91:0/3219092615 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6dc80a9840 msgr2=0x7f6dc80708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.633+0000 7f6dcd4ef640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6dc80a9840 0x7f6dc80708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.633+0000 7f6dcccee640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc814b390 0x7f6dc80a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.633+0000 7f6dcd4ef640 1 -- 172.21.15.91:0/3219092615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc814b390 msgr2=0x7f6dc80a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.633+0000 7f6dcd4ef640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc814b390 0x7f6dc80a9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.633+0000 7f6dcd4ef640 1 -- 172.21.15.91:0/3219092615 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc814ab90 con 0x7f6db4003970 2023-11-27T20:44:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.633+0000 7f6dcd4ef640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 0x7f6dc8147d30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80c3580 tx=0x7f6dc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.634+0000 7f6db9ffb640 1 -- 172.21.15.91:0/3219092615 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40328f0 con 0x7f6db4003970 2023-11-27T20:44:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.634+0000 7f6db9ffb640 1 -- 172.21.15.91:0/3219092615 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc4032a50 con 0x7f6db4003970 2023-11-27T20:44:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.634+0000 7f6db9ffb640 1 -- 172.21.15.91:0/3219092615 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4032de0 con 0x7f6db4003970 2023-11-27T20:44:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.634+0000 7f6dcf753640 1 -- 172.21.15.91:0/3219092615 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc814ae70 con 0x7f6db4003970 2023-11-27T20:44:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.634+0000 7f6dcf753640 1 -- 172.21.15.91:0/3219092615 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc814ba20 con 0x7f6db4003970 2023-11-27T20:44:42.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.635+0000 7f6dcf753640 1 -- 172.21.15.91:0/3219092615 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc8067950 con 0x7f6db4003970 2023-11-27T20:44:42.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.636+0000 7f6db9ffb640 1 -- 172.21.15.91:0/3219092615 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6dc403d410 con 0x7f6db4003970 2023-11-27T20:44:42.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.637+0000 7f6db9ffb640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6dac06b1c0 0x7f6dac06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:42.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.637+0000 7f6db9ffb640 1 -- 172.21.15.91:0/3219092615 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6271+0+0 (secure 0 0 0) 0x7f6dc40abf10 con 0x7f6db4003970 2023-11-27T20:44:42.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.637+0000 7f6dcccee640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6dac06b1c0 0x7f6dac06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:42.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.638+0000 7f6dcccee640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6dac06b1c0 0x7f6dac06d680 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc001050 tx=0x7f6dbc0013b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:42.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.641+0000 7f6db9ffb640 1 -- 172.21.15.91:0/3219092615 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6dc4076a40 con 0x7f6db4003970 2023-11-27T20:44:42.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:42.832+0000 7f6dcf753640 1 -- 172.21.15.91:0/3219092615 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6dc8068350 con 0x7f6db4003970 2023-11-27T20:44:43.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.427+0000 7f6db9ffb640 1 -- 172.21.15.91:0/3219092615 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6dc400f040 con 0x7f6db4003970 2023-11-27T20:44:43.429 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' removed 2023-11-27T20:44:43.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 -- 172.21.15.91:0/3219092615 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6dac06b1c0 msgr2=0x7f6dac06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:43.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6dac06b1c0 0x7f6dac06d680 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc001050 tx=0x7f6dbc0013b0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 -- 172.21.15.91:0/3219092615 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 msgr2=0x7f6dc8147d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:43.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 0x7f6dc8147d30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80c3580 tx=0x7f6dc4004730 comp rx=0 tx=0).stop 2023-11-27T20:44:43.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 -- 172.21.15.91:0/3219092615 shutdown_connections 2023-11-27T20:44:43.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6dc80a9840 0x7f6dc80708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6dac06b1c0 0x7f6dac06d680 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6dc814b390 0x7f6dc80a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 --2- 172.21.15.91:0/3219092615 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6db4003970 0x7f6dc8147d30 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 -- 172.21.15.91:0/3219092615 >> 172.21.15.91:0/3219092615 conn(0x7f6dc80c5bc0 msgr2=0x7f6dc814d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:43.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 -- 172.21.15.91:0/3219092615 shutdown_connections 2023-11-27T20:44:43.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.431+0000 7f6dcf753640 1 -- 172.21.15.91:0/3219092615 wait complete. 2023-11-27T20:44:43.461 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:43.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.643+0000 7f9d8d6ec640 1 Processor -- start 2023-11-27T20:44:43.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.644+0000 7f9d8d6ec640 1 -- start start 2023-11-27T20:44:43.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.645+0000 7f9d8d6ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d8806f7d0 0x7f9d880a7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:43.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.645+0000 7f9d8d6ec640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9d880a70a0 0x7f9d8806fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:43.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.645+0000 7f9d8d6ec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9d88153240 0x7f9d880c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:43.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.645+0000 7f9d8d6ec640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8806e240 con 0x7f9d880a70a0 2023-11-27T20:44:43.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.645+0000 7f9d8d6ec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d88152550 con 0x7f9d88153240 2023-11-27T20:44:43.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.645+0000 7f9d8d6ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8814ffd0 con 0x7f9d8806f7d0 2023-11-27T20:44:43.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d867fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9d880a70a0 0x7f9d8806fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:43.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d867fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9d880a70a0 0x7f9d8806fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44388/0 (socket says 172.21.15.91:44388) 2023-11-27T20:44:43.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d867fc640 1 -- 172.21.15.91:0/1381240282 learned_addr learned my addr 172.21.15.91:0/1381240282 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:43.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d86ffd640 1 --2- 172.21.15.91:0/1381240282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d8806f7d0 0x7f9d880a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:43.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d877fe640 1 --2- 172.21.15.91:0/1381240282 >> v2:172.21.15.183:3300/0 conn(0x7f9d88153240 0x7f9d880c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:43.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d867fc640 1 -- 172.21.15.91:0/1381240282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d8806f7d0 msgr2=0x7f9d880a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:43.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d867fc640 1 --2- 172.21.15.91:0/1381240282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d8806f7d0 0x7f9d880a7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d867fc640 1 -- 172.21.15.91:0/1381240282 >> v2:172.21.15.183:3300/0 conn(0x7f9d88153240 msgr2=0x7f9d880c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:43.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d867fc640 1 --2- 172.21.15.91:0/1381240282 >> v2:172.21.15.183:3300/0 conn(0x7f9d88153240 0x7f9d880c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d867fc640 1 -- 172.21.15.91:0/1381240282 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8806df60 con 0x7f9d880a70a0 2023-11-27T20:44:43.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.646+0000 7f9d86ffd640 1 --2- 172.21.15.91:0/1381240282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d8806f7d0 0x7f9d880a7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:44:43.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.648+0000 7f9d867fc640 1 --2- 172.21.15.91:0/1381240282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d880a70a0 0x7f9d8806fbb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9d88071d90 tx=0x7f9d7002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544443134a0fbb2c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:43.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.648+0000 7f9d85ffb640 1 -- 172.21.15.91:0/1381240282 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700317d0 con 0x7f9d880a70a0 2023-11-27T20:44:43.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.648+0000 7f9d85ffb640 1 -- 172.21.15.91:0/1381240282 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d70031930 con 0x7f9d880a70a0 2023-11-27T20:44:43.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.648+0000 7f9d85ffb640 1 -- 172.21.15.91:0/1381240282 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70031cc0 con 0x7f9d880a70a0 2023-11-27T20:44:43.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.649+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1381240282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d880a70a0 msgr2=0x7f9d8806fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:43.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.649+0000 7f9d8d6ec640 1 --2- 172.21.15.91:0/1381240282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d880a70a0 0x7f9d8806fbb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9d88071d90 tx=0x7f9d7002b870 comp rx=0 tx=0).stop 2023-11-27T20:44:43.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.649+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1381240282 shutdown_connections 2023-11-27T20:44:43.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.649+0000 7f9d8d6ec640 1 --2- 172.21.15.91:0/1381240282 >> v2:172.21.15.183:3300/0 conn(0x7f9d88153240 0x7f9d880c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.649+0000 7f9d8d6ec640 1 --2- 172.21.15.91:0/1381240282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d880a70a0 0x7f9d8806fbb0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.649+0000 7f9d8d6ec640 1 --2- 172.21.15.91:0/1381240282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d8806f7d0 0x7f9d880a7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.649+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1381240282 >> 172.21.15.91:0/1381240282 conn(0x7f9d880c7e30 msgr2=0x7f9d880c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:43.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.649+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1381240282 shutdown_connections 2023-11-27T20:44:43.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.649+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1381240282 wait complete. 2023-11-27T20:44:43.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.650+0000 7f9d8d6ec640 1 Processor -- start 2023-11-27T20:44:43.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.651+0000 7f9d8d6ec640 1 -- start start 2023-11-27T20:44:43.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.651+0000 7f9d8d6ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d8806f7d0 0x7f9d88154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:43.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.651+0000 7f9d8d6ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d880a70a0 0x7f9d880c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d8d6ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d88153240 0x7f9d881ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d8d6ec640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8806ccf0 con 0x7f9d8806f7d0 2023-11-27T20:44:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d8d6ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8806d500 con 0x7f9d88153240 2023-11-27T20:44:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d8d6ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881544f0 con 0x7f9d880a70a0 2023-11-27T20:44:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d86ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d8806f7d0 0x7f9d88154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d86ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d8806f7d0 0x7f9d88154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44402/0 (socket says 172.21.15.91:44402) 2023-11-27T20:44:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d86ffd640 1 -- 172.21.15.91:0/1665881718 learned_addr learned my addr 172.21.15.91:0/1665881718 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d86ffd640 1 -- 172.21.15.91:0/1665881718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d880a70a0 msgr2=0x7f9d880c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d86ffd640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d880a70a0 0x7f9d880c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d86ffd640 1 -- 172.21.15.91:0/1665881718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d88153240 msgr2=0x7f9d881ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:43.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d86ffd640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d88153240 0x7f9d881ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.652+0000 7f9d86ffd640 1 -- 172.21.15.91:0/1665881718 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700094d0 con 0x7f9d8806f7d0 2023-11-27T20:44:43.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.653+0000 7f9d86ffd640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d8806f7d0 0x7f9d88154cb0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9d78007e10 tx=0x7f9d7800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:43.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.653+0000 7f9d7f7fe640 1 -- 172.21.15.91:0/1665881718 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78003b90 con 0x7f9d8806f7d0 2023-11-27T20:44:43.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.653+0000 7f9d7f7fe640 1 -- 172.21.15.91:0/1665881718 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800f040 con 0x7f9d8806f7d0 2023-11-27T20:44:43.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.653+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1665881718 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8806cf40 con 0x7f9d8806f7d0 2023-11-27T20:44:43.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.653+0000 7f9d7f7fe640 1 -- 172.21.15.91:0/1665881718 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800de80 con 0x7f9d8806f7d0 2023-11-27T20:44:43.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.653+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1665881718 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d88154790 con 0x7f9d8806f7d0 2023-11-27T20:44:43.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.654+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1665881718 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d88068350 con 0x7f9d8806f7d0 2023-11-27T20:44:43.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.655+0000 7f9d7f7fe640 1 -- 172.21.15.91:0/1665881718 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9d78004030 con 0x7f9d8806f7d0 2023-11-27T20:44:43.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.656+0000 7f9d7f7fe640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d6806b1c0 0x7f9d6806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:43.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.656+0000 7f9d7f7fe640 1 -- 172.21.15.91:0/1665881718 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f9d78089bd0 con 0x7f9d8806f7d0 2023-11-27T20:44:43.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.656+0000 7f9d867fc640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d6806b1c0 0x7f9d6806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:43.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.657+0000 7f9d867fc640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d6806b1c0 0x7f9d6806d680 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9d70036000 tx=0x7f9d70030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:43.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.660+0000 7f9d7f7fe640 1 -- 172.21.15.91:0/1665881718 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9d780549a0 con 0x7f9d8806f7d0 2023-11-27T20:44:43.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.851+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1665881718 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d880c73e0 con 0x7f9d8806f7d0 2023-11-27T20:44:43.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.854+0000 7f9d7f7fe640 1 -- 172.21.15.91:0/1665881718 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16759 (secure 0 0 0) 0x7f9d7801a090 con 0x7f9d8806f7d0 2023-11-27T20:44:43.856 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:43.856 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":64,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:43.415028+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.91:6837/42700883":"2023-11-28T20:44:40.116207+0000","172.21.15.91:6834/42700883":"2023-11-28T20:44:40.116207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1665881718 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d6806b1c0 msgr2=0x7f9d6806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d6806b1c0 0x7f9d6806d680 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9d70036000 tx=0x7f9d70030000 comp rx=0 tx=0).stop 2023-11-27T20:44:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1665881718 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d8806f7d0 msgr2=0x7f9d88154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d8806f7d0 0x7f9d88154cb0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9d78007e10 tx=0x7f9d7800d4a0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1665881718 shutdown_connections 2023-11-27T20:44:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d6806b1c0 0x7f9d6806d680 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d88153240 0x7f9d881ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d880a70a0 0x7f9d880c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 --2- 172.21.15.91:0/1665881718 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d8806f7d0 0x7f9d88154cb0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1665881718 >> 172.21.15.91:0/1665881718 conn(0x7f9d880c7e30 msgr2=0x7f9d880aacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1665881718 shutdown_connections 2023-11-27T20:44:43.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:43.857+0000 7f9d8d6ec640 1 -- 172.21.15.91:0/1665881718 wait complete. 2023-11-27T20:44:43.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:44:06.059576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:44:06.989345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:44:43.877 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:44:44.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.087+0000 7f7801b39640 1 Processor -- start 2023-11-27T20:44:44.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.087+0000 7f7801b39640 1 -- start start 2023-11-27T20:44:44.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.088+0000 7f7801b39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f77fc155490 0x7f77fc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.088+0000 7f7801b39640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f77fc0a9b40 0x7f77fc0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.088+0000 7f7801b39640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc0c06c0 con 0x7f77fc0c1500 2023-11-27T20:44:44.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.088+0000 7f7801b39640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77fc0a5820 con 0x7f77fc155490 2023-11-27T20:44:44.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.088+0000 7f7801b39640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77fc0c1020 con 0x7f77fc0a9b40 2023-11-27T20:44:44.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.088+0000 7f77fb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f77fc155490 0x7f77fc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.088+0000 7f77fb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f77fc155490 0x7f77fc0a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40614/0 (socket says 172.21.15.91:40614) 2023-11-27T20:44:44.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.088+0000 7f77fb7fe640 1 -- 172.21.15.91:0/15414926 learned_addr learned my addr 172.21.15.91:0/15414926 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:44.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.089+0000 7f77fbfff640 1 --2- 172.21.15.91:0/15414926 >> v2:172.21.15.183:3300/0 conn(0x7f77fc0a9b40 0x7f77fc0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.089+0000 7f77fb7fe640 1 -- 172.21.15.91:0/15414926 >> v2:172.21.15.183:3300/0 conn(0x7f77fc0a9b40 msgr2=0x7f77fc0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:44.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.089+0000 7f77fb7fe640 1 --2- 172.21.15.91:0/15414926 >> v2:172.21.15.183:3300/0 conn(0x7f77fc0a9b40 0x7f77fc0c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.089+0000 7f77fb7fe640 1 -- 172.21.15.91:0/15414926 >> v1:172.21.15.183:6789/0 conn(0x7f77fc0c1500 legacy=0x7f77fc0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:44.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.089+0000 7f77fb7fe640 1 -- 172.21.15.91:0/15414926 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0c0910 con 0x7f77fc155490 2023-11-27T20:44:44.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.089+0000 7f77fbfff640 1 --2- 172.21.15.91:0/15414926 >> v2:172.21.15.183:3300/0 conn(0x7f77fc0a9b40 0x7f77fc0c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:44.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.090+0000 7f77fb7fe640 1 --2- 172.21.15.91:0/15414926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 0x7f77fc0a51b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f77fc067220 tx=0x7f77ec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae6e8ac0fd20236 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:44.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.090+0000 7f77faffd640 1 -- 172.21.15.91:0/15414926 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec031870 con 0x7f77fc155490 2023-11-27T20:44:44.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.091+0000 7f77faffd640 1 -- 172.21.15.91:0/15414926 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec0319d0 con 0x7f77fc155490 2023-11-27T20:44:44.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.091+0000 7f77faffd640 1 -- 172.21.15.91:0/15414926 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec031d60 con 0x7f77fc155490 2023-11-27T20:44:44.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.091+0000 7f7801b39640 1 -- 172.21.15.91:0/15414926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 msgr2=0x7f77fc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.091+0000 7f7801b39640 1 --2- 172.21.15.91:0/15414926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 0x7f77fc0a51b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f77fc067220 tx=0x7f77ec02b910 comp rx=0 tx=0).stop 2023-11-27T20:44:44.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.091+0000 7f7801b39640 1 -- 172.21.15.91:0/15414926 shutdown_connections 2023-11-27T20:44:44.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.091+0000 7f7801b39640 1 --2- 172.21.15.91:0/15414926 >> v2:172.21.15.183:3300/0 conn(0x7f77fc0a9b40 0x7f77fc0c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.091+0000 7f7801b39640 1 --2- 172.21.15.91:0/15414926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 0x7f77fc0a51b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.091+0000 7f7801b39640 1 -- 172.21.15.91:0/15414926 >> 172.21.15.91:0/15414926 conn(0x7f77fc06a500 msgr2=0x7f77fc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:44.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.091+0000 7f7801b39640 1 -- 172.21.15.91:0/15414926 shutdown_connections 2023-11-27T20:44:44.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.091+0000 7f7801b39640 1 -- 172.21.15.91:0/15414926 wait complete. 2023-11-27T20:44:44.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.093+0000 7f7801b39640 1 Processor -- start 2023-11-27T20:44:44.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.093+0000 7f7801b39640 1 -- start start 2023-11-27T20:44:44.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.094+0000 7f7801b39640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77fc0c1500 0x7f77fc1df0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.094+0000 7f7801b39640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 0x7f77fc1ed030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.094+0000 7f7801b39640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77fc0a74c0 0x7f77fc1ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.094+0000 7f7801b39640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0bb9a0 con 0x7f77fc155490 2023-11-27T20:44:44.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.094+0000 7f7801b39640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc1edab0 con 0x7f77fc0c1500 2023-11-27T20:44:44.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.094+0000 7f7801b39640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc1ea990 con 0x7f77fc0a74c0 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.094+0000 7f77f3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 0x7f77fc1ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.094+0000 7f77f3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 0x7f77fc1ed030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40618/0 (socket says 172.21.15.91:40618) 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.094+0000 7f77f3fff640 1 -- 172.21.15.91:0/2800261581 learned_addr learned my addr 172.21.15.91:0/2800261581 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77fb7fe640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77fc0c1500 0x7f77fc1df0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77fbfff640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77fc0a74c0 0x7f77fc1ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77f3fff640 1 -- 172.21.15.91:0/2800261581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77fc0a74c0 msgr2=0x7f77fc1ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77f3fff640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77fc0a74c0 0x7f77fc1ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77f3fff640 1 -- 172.21.15.91:0/2800261581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77fc0c1500 msgr2=0x7f77fc1df0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77f3fff640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77fc0c1500 0x7f77fc1df0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77f3fff640 1 -- 172.21.15.91:0/2800261581 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec0094d0 con 0x7f77fc155490 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77fbfff640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77fc0a74c0 0x7f77fc1ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:44.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77f3fff640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 0x7f77fc1ed030 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f77e400c440 tx=0x7f77e400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:44.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77f8ff9640 1 -- 172.21.15.91:0/2800261581 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4005480 con 0x7f77fc155490 2023-11-27T20:44:44.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77f8ff9640 1 -- 172.21.15.91:0/2800261581 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e40035f0 con 0x7f77fc155490 2023-11-27T20:44:44.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f77f8ff9640 1 -- 172.21.15.91:0/2800261581 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40039c0 con 0x7f77fc155490 2023-11-27T20:44:44.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.095+0000 7f7801b39640 1 -- 172.21.15.91:0/2800261581 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc1e9bd0 con 0x7f77fc155490 2023-11-27T20:44:44.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.096+0000 7f7801b39640 1 -- 172.21.15.91:0/2800261581 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc1ea190 con 0x7f77fc155490 2023-11-27T20:44:44.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.097+0000 7f7801b39640 1 -- 172.21.15.91:0/2800261581 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77fc068350 con 0x7f77fc155490 2023-11-27T20:44:44.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.098+0000 7f77f8ff9640 1 -- 172.21.15.91:0/2800261581 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f77e4003b20 con 0x7f77fc155490 2023-11-27T20:44:44.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.099+0000 7f77f8ff9640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f77dc06b1c0 0x7f77dc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.099+0000 7f77f8ff9640 1 -- 172.21.15.91:0/2800261581 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f77e4088cd0 con 0x7f77fc155490 2023-11-27T20:44:44.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.099+0000 7f77fb7fe640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f77dc06b1c0 0x7f77dc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.100+0000 7f77fb7fe640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f77dc06b1c0 0x7f77dc06d680 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f77ec036000 tx=0x7f77ec03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:44.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.103+0000 7f77f8ff9640 1 -- 172.21.15.91:0/2800261581 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f77e4053950 con 0x7f77fc155490 2023-11-27T20:44:44.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.297+0000 7f7801b39640 1 -- 172.21.15.91:0/2800261581 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77fc0aa0d0 con 0x7f77fc155490 2023-11-27T20:44:44.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.299+0000 7f77f8ff9640 1 -- 172.21.15.91:0/2800261581 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77e4017020 con 0x7f77fc155490 2023-11-27T20:44:44.301 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:44:44.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.304+0000 7f7801b39640 1 -- 172.21.15.91:0/2800261581 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f77dc06b1c0 msgr2=0x7f77dc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.304+0000 7f7801b39640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f77dc06b1c0 0x7f77dc06d680 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f77ec036000 tx=0x7f77ec03c040 comp rx=0 tx=0).stop 2023-11-27T20:44:44.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.304+0000 7f7801b39640 1 -- 172.21.15.91:0/2800261581 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 msgr2=0x7f77fc1ed030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.304+0000 7f7801b39640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 0x7f77fc1ed030 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f77e400c440 tx=0x7f77e400c900 comp rx=0 tx=0).stop 2023-11-27T20:44:44.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.304+0000 7f7801b39640 1 -- 172.21.15.91:0/2800261581 shutdown_connections 2023-11-27T20:44:44.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.305+0000 7f7801b39640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77fc0a74c0 0x7f77fc1ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.305+0000 7f7801b39640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77fc155490 0x7f77fc1ed030 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.305+0000 7f7801b39640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f77dc06b1c0 0x7f77dc06d680 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.305+0000 7f7801b39640 1 --2- 172.21.15.91:0/2800261581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77fc0c1500 0x7f77fc1df0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.305+0000 7f7801b39640 1 -- 172.21.15.91:0/2800261581 >> 172.21.15.91:0/2800261581 conn(0x7f77fc06a500 msgr2=0x7f77fc0c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:44.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.305+0000 7f7801b39640 1 -- 172.21.15.91:0/2800261581 shutdown_connections 2023-11-27T20:44:44.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.305+0000 7f7801b39640 1 -- 172.21.15.91:0/2800261581 wait complete. 2023-11-27T20:44:44.325 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:44:44.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.529+0000 7fc5771be640 1 Processor -- start 2023-11-27T20:44:44.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.530+0000 7fc5771be640 1 -- start start 2023-11-27T20:44:44.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.531+0000 7fc5771be640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc570152f20 0x7fc5700c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.531+0000 7fc5771be640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700c64a0 con 0x7fc57006d0a0 2023-11-27T20:44:44.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.531+0000 7fc5771be640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700c5c00 con 0x7fc57014fd30 2023-11-27T20:44:44.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.531+0000 7fc5771be640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5700c5ee0 con 0x7fc570152f20 2023-11-27T20:44:44.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.531+0000 7fc57575b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc570152f20 0x7fc5700c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.531+0000 7fc57575b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc570152f20 0x7fc5700c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40628/0 (socket says 172.21.15.91:40628) 2023-11-27T20:44:44.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.531+0000 7fc57575b640 1 -- 172.21.15.91:0/2504937242 learned_addr learned my addr 172.21.15.91:0/2504937242 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:44.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.532+0000 7fc57575b640 1 -- 172.21.15.91:0/2504937242 >> v1:172.21.15.183:6789/0 conn(0x7fc57014fd30 legacy=0x7fc5700a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:44.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.532+0000 7fc57575b640 1 -- 172.21.15.91:0/2504937242 >> v1:172.21.15.91:6789/0 conn(0x7fc57006d0a0 legacy=0x7fc5700c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.532+0000 7fc57575b640 1 -- 172.21.15.91:0/2504937242 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700c61c0 con 0x7fc570152f20 2023-11-27T20:44:44.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.532+0000 7fc56f7fe640 1 -- 172.21.15.91:0/2504937242 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743595307 0 0) 0x7fc5700c64a0 con 0x7fc57006d0a0 2023-11-27T20:44:44.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.533+0000 7fc57575b640 1 --2- 172.21.15.91:0/2504937242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc570152f20 0x7fc5700c45b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc568009e50 tx=0x7fc56802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f070a4a5a4d4111b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:44.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.533+0000 7fc56f7fe640 1 -- 172.21.15.91:0/2504937242 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56802cb20 con 0x7fc570152f20 2023-11-27T20:44:44.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.533+0000 7fc56f7fe640 1 -- 172.21.15.91:0/2504937242 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56802cc80 con 0x7fc570152f20 2023-11-27T20:44:44.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.533+0000 7fc56f7fe640 1 -- 172.21.15.91:0/2504937242 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5680343f0 con 0x7fc570152f20 2023-11-27T20:44:44.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.534+0000 7fc5771be640 1 -- 172.21.15.91:0/2504937242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc570152f20 msgr2=0x7fc5700c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.534+0000 7fc5771be640 1 --2- 172.21.15.91:0/2504937242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc570152f20 0x7fc5700c45b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc568009e50 tx=0x7fc56802bf80 comp rx=0 tx=0).stop 2023-11-27T20:44:44.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.534+0000 7fc5771be640 1 -- 172.21.15.91:0/2504937242 shutdown_connections 2023-11-27T20:44:44.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.534+0000 7fc5771be640 1 --2- 172.21.15.91:0/2504937242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc570152f20 0x7fc5700c45b0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.534+0000 7fc5771be640 1 -- 172.21.15.91:0/2504937242 >> 172.21.15.91:0/2504937242 conn(0x7fc57006a500 msgr2=0x7fc57006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:44.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.534+0000 7fc5771be640 1 -- 172.21.15.91:0/2504937242 shutdown_connections 2023-11-27T20:44:44.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.534+0000 7fc5771be640 1 -- 172.21.15.91:0/2504937242 wait complete. 2023-11-27T20:44:44.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.536+0000 7fc5771be640 1 Processor -- start 2023-11-27T20:44:44.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.536+0000 7fc5771be640 1 -- start start 2023-11-27T20:44:44.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc5771be640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc57006d0a0 0x7fc5701555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc5771be640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc57014fd30 0x7fc5701ddc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc5771be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc570152f20 0x7fc5701de150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc5771be640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701dd0d0 con 0x7fc57006d0a0 2023-11-27T20:44:44.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc5771be640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701dcdf0 con 0x7fc57014fd30 2023-11-27T20:44:44.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc5771be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701de690 con 0x7fc570152f20 2023-11-27T20:44:44.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc574f5a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc57006d0a0 0x7fc5701555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc574f5a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc57006d0a0 0x7fc5701555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40630/0 (socket says 172.21.15.91:40630) 2023-11-27T20:44:44.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc574f5a640 1 -- 172.21.15.91:0/1091113628 learned_addr learned my addr 172.21.15.91:0/1091113628 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:44.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc574f5a640 1 -- 172.21.15.91:0/1091113628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc570152f20 msgr2=0x7fc5701de150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc574f5a640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc570152f20 0x7fc5701de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc574f5a640 1 -- 172.21.15.91:0/1091113628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc57014fd30 msgr2=0x7fc5701ddc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc574f5a640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc57014fd30 0x7fc5701ddc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.537+0000 7fc574f5a640 1 -- 172.21.15.91:0/1091113628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568009b30 con 0x7fc57006d0a0 2023-11-27T20:44:44.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.538+0000 7fc574f5a640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc57006d0a0 0x7fc5701555d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c430 tx=0x7fc56400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:44.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.538+0000 7fc56d7fa640 1 -- 172.21.15.91:0/1091113628 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564011790 con 0x7fc57006d0a0 2023-11-27T20:44:44.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.538+0000 7fc56d7fa640 1 -- 172.21.15.91:0/1091113628 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5640118f0 con 0x7fc57006d0a0 2023-11-27T20:44:44.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.538+0000 7fc56d7fa640 1 -- 172.21.15.91:0/1091113628 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564011ce0 con 0x7fc57006d0a0 2023-11-27T20:44:44.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.538+0000 7fc5771be640 1 -- 172.21.15.91:0/1091113628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5701dd560 con 0x7fc57006d0a0 2023-11-27T20:44:44.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.538+0000 7fc5771be640 1 -- 172.21.15.91:0/1091113628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5700bace0 con 0x7fc57006d0a0 2023-11-27T20:44:44.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.539+0000 7fc5771be640 1 -- 172.21.15.91:0/1091113628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc570068350 con 0x7fc57006d0a0 2023-11-27T20:44:44.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.540+0000 7fc56d7fa640 1 -- 172.21.15.91:0/1091113628 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc56401c460 con 0x7fc57006d0a0 2023-11-27T20:44:44.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.541+0000 7fc56d7fa640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc55406b1f0 0x7fc55406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.541+0000 7fc56d7fa640 1 -- 172.21.15.91:0/1091113628 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fc564089b20 con 0x7fc57006d0a0 2023-11-27T20:44:44.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.542+0000 7fc56ffff640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc55406b1f0 0x7fc55406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.542+0000 7fc56ffff640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc55406b1f0 0x7fc55406d6b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc57006e1d0 tx=0x7fc55c007910 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:44.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.546+0000 7fc56d7fa640 1 -- 172.21.15.91:0/1091113628 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc5640547a0 con 0x7fc57006d0a0 2023-11-27T20:44:44.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.740+0000 7fc5771be640 1 -- 172.21.15.91:0/1091113628 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5700c45f0 con 0x7fc57006d0a0 2023-11-27T20:44:44.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.740+0000 7fc56d7fa640 1 -- 172.21.15.91:0/1091113628 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v64) v1 ==== 105+0+11 (secure 0 0 0) 0x7fc564057dc0 con 0x7fc57006d0a0 2023-11-27T20:44:44.742 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:44:44.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 -- 172.21.15.91:0/1091113628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc55406b1f0 msgr2=0x7fc55406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc55406b1f0 0x7fc55406d6b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc57006e1d0 tx=0x7fc55c007910 comp rx=0 tx=0).stop 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 -- 172.21.15.91:0/1091113628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc57006d0a0 msgr2=0x7fc5701555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc57006d0a0 0x7fc5701555d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c430 tx=0x7fc56400c8f0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 -- 172.21.15.91:0/1091113628 shutdown_connections 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc570152f20 0x7fc5701de150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc55406b1f0 0x7fc55406d6b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc57014fd30 0x7fc5701ddc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 --2- 172.21.15.91:0/1091113628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc57006d0a0 0x7fc5701555d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 -- 172.21.15.91:0/1091113628 >> 172.21.15.91:0/1091113628 conn(0x7fc57006a500 msgr2=0x7fc5700c1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 -- 172.21.15.91:0/1091113628 shutdown_connections 2023-11-27T20:44:44.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.743+0000 7fc5771be640 1 -- 172.21.15.91:0/1091113628 wait complete. 2023-11-27T20:44:44.762 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:44:44.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.975+0000 7f6271773640 1 Processor -- start 2023-11-27T20:44:44.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.975+0000 7f6271773640 1 -- start start 2023-11-27T20:44:44.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.976+0000 7f6271773640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f626c06d0a0 0x7f626c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.977+0000 7f6271773640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f626c0c3ea0 0x7f626c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.977+0000 7f6271773640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626c0c64a0 con 0x7f626c14fd30 2023-11-27T20:44:44.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.977+0000 7f6271773640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626c0c5c00 con 0x7f626c0c3ea0 2023-11-27T20:44:44.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.977+0000 7f6271773640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c0c5ee0 con 0x7f626c06d0a0 2023-11-27T20:44:44.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.977+0000 7f626b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f626c0c3ea0 0x7f626c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.977+0000 7f626b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f626c0c3ea0 0x7f626c0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40634/0 (socket says 172.21.15.91:40634) 2023-11-27T20:44:44.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.977+0000 7f626b7fe640 1 -- 172.21.15.91:0/332088987 learned_addr learned my addr 172.21.15.91:0/332088987 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:44.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.977+0000 7f626a7fc640 1 --2- 172.21.15.91:0/332088987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f626c06d0a0 0x7f626c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.978+0000 7f626b7fe640 1 -- 172.21.15.91:0/332088987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f626c06d0a0 msgr2=0x7f626c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:44.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.978+0000 7f626b7fe640 1 --2- 172.21.15.91:0/332088987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f626c06d0a0 0x7f626c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.978+0000 7f626b7fe640 1 -- 172.21.15.91:0/332088987 >> v1:172.21.15.183:6789/0 conn(0x7f626c14fd30 legacy=0x7f626c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:44.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.978+0000 7f626b7fe640 1 -- 172.21.15.91:0/332088987 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c0c61c0 con 0x7f626c0c3ea0 2023-11-27T20:44:44.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.979+0000 7f626b7fe640 1 --2- 172.21.15.91:0/332088987 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c0c3ea0 0x7f626c0c4330 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6264009e50 tx=0x7f626402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87829eb982fd24aa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:44.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.979+0000 7f6269ffb640 1 -- 172.21.15.91:0/332088987 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626402cb00 con 0x7f626c0c3ea0 2023-11-27T20:44:44.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.979+0000 7f6269ffb640 1 -- 172.21.15.91:0/332088987 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626402cc60 con 0x7f626c0c3ea0 2023-11-27T20:44:44.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.979+0000 7f6269ffb640 1 -- 172.21.15.91:0/332088987 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640343f0 con 0x7f626c0c3ea0 2023-11-27T20:44:44.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.980+0000 7f6271773640 1 -- 172.21.15.91:0/332088987 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c0c3ea0 msgr2=0x7f626c0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.980+0000 7f6271773640 1 --2- 172.21.15.91:0/332088987 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c0c3ea0 0x7f626c0c4330 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6264009e50 tx=0x7f626402bf60 comp rx=0 tx=0).stop 2023-11-27T20:44:44.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.980+0000 7f6271773640 1 -- 172.21.15.91:0/332088987 shutdown_connections 2023-11-27T20:44:44.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.980+0000 7f6271773640 1 --2- 172.21.15.91:0/332088987 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c0c3ea0 0x7f626c0c4330 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.980+0000 7f6271773640 1 --2- 172.21.15.91:0/332088987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f626c06d0a0 0x7f626c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.980+0000 7f6271773640 1 -- 172.21.15.91:0/332088987 >> 172.21.15.91:0/332088987 conn(0x7f626c06a500 msgr2=0x7f626c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:44.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.980+0000 7f6271773640 1 -- 172.21.15.91:0/332088987 shutdown_connections 2023-11-27T20:44:44.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.980+0000 7f6271773640 1 -- 172.21.15.91:0/332088987 wait complete. 2023-11-27T20:44:44.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.982+0000 7f6271773640 1 Processor -- start 2023-11-27T20:44:44.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.982+0000 7f6271773640 1 -- start start 2023-11-27T20:44:44.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f6271773640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f626c06d0a0 0x7f626c1e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f6271773640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f626c0c3ea0 0x7f626c155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f6271773640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c14fd30 0x7f626c1dd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f6271773640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c1e94b0 con 0x7f626c14fd30 2023-11-27T20:44:44.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f6271773640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c1e84f0 con 0x7f626c06d0a0 2023-11-27T20:44:44.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f6271773640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c1df200 con 0x7f626c0c3ea0 2023-11-27T20:44:44.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f626b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c14fd30 0x7f626c1dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f626b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c14fd30 0x7f626c1dd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40640/0 (socket says 172.21.15.91:40640) 2023-11-27T20:44:44.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f626b7fe640 1 -- 172.21.15.91:0/995367220 learned_addr learned my addr 172.21.15.91:0/995367220 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:44.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f626a7fc640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f626c0c3ea0 0x7f626c155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f626affd640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f626c06d0a0 0x7f626c1e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f626b7fe640 1 -- 172.21.15.91:0/995367220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f626c0c3ea0 msgr2=0x7f626c155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f626b7fe640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f626c0c3ea0 0x7f626c155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f626b7fe640 1 -- 172.21.15.91:0/995367220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f626c06d0a0 msgr2=0x7f626c1e8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:44.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f626b7fe640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f626c06d0a0 0x7f626c1e8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:44.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.983+0000 7f626b7fe640 1 -- 172.21.15.91:0/995367220 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264009b30 con 0x7f626c14fd30 2023-11-27T20:44:44.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.984+0000 7f626b7fe640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c14fd30 0x7f626c1dd800 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f6264009e50 tx=0x7f6264004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:44.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.984+0000 7f62537fe640 1 -- 172.21.15.91:0/995367220 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6264009510 con 0x7f626c14fd30 2023-11-27T20:44:44.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.984+0000 7f62537fe640 1 -- 172.21.15.91:0/995367220 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626403e450 con 0x7f626c14fd30 2023-11-27T20:44:44.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.984+0000 7f62537fe640 1 -- 172.21.15.91:0/995367220 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626403e800 con 0x7f626c14fd30 2023-11-27T20:44:44.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.984+0000 7f6271773640 1 -- 172.21.15.91:0/995367220 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c1df4e0 con 0x7f626c14fd30 2023-11-27T20:44:44.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.984+0000 7f6271773640 1 -- 172.21.15.91:0/995367220 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c1e8770 con 0x7f626c14fd30 2023-11-27T20:44:44.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.985+0000 7f6271773640 1 -- 172.21.15.91:0/995367220 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c1df9a0 con 0x7f626c14fd30 2023-11-27T20:44:44.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.986+0000 7f62537fe640 1 -- 172.21.15.91:0/995367220 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f626403e960 con 0x7f626c14fd30 2023-11-27T20:44:44.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.987+0000 7f62537fe640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f625806b1c0 0x7f625806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:44.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.987+0000 7f62537fe640 1 -- 172.21.15.91:0/995367220 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f62640ac850 con 0x7f626c14fd30 2023-11-27T20:44:44.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.987+0000 7f626affd640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f625806b1c0 0x7f625806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:44.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.988+0000 7f626affd640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f625806b1c0 0x7f625806d680 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f625c000f60 tx=0x7f625c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:44.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:44.991+0000 7f62537fe640 1 -- 172.21.15.91:0/995367220 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f62640774e0 con 0x7f626c14fd30 2023-11-27T20:44:45.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.182+0000 7f6271773640 1 -- 172.21.15.91:0/995367220 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f626c152330 con 0x7f626c14fd30 2023-11-27T20:44:45.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.182+0000 7f62537fe640 1 -- 172.21.15.91:0/995367220 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v64) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6264043020 con 0x7f626c14fd30 2023-11-27T20:44:45.184 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:44:45.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 -- 172.21.15.91:0/995367220 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f625806b1c0 msgr2=0x7f625806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f625806b1c0 0x7f625806d680 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f625c000f60 tx=0x7f625c009040 comp rx=0 tx=0).stop 2023-11-27T20:44:45.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 -- 172.21.15.91:0/995367220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c14fd30 msgr2=0x7f626c1dd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c14fd30 0x7f626c1dd800 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f6264009e50 tx=0x7f6264004a40 comp rx=0 tx=0).stop 2023-11-27T20:44:45.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 -- 172.21.15.91:0/995367220 shutdown_connections 2023-11-27T20:44:45.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f626c14fd30 0x7f626c1dd800 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f626c0c3ea0 0x7f626c155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f625806b1c0 0x7f625806d680 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 --2- 172.21.15.91:0/995367220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f626c06d0a0 0x7f626c1e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 -- 172.21.15.91:0/995367220 >> 172.21.15.91:0/995367220 conn(0x7f626c06a500 msgr2=0x7f626c152c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:45.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 -- 172.21.15.91:0/995367220 shutdown_connections 2023-11-27T20:44:45.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.185+0000 7f6271773640 1 -- 172.21.15.91:0/995367220 wait complete. 2023-11-27T20:44:45.206 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:44:45.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.416+0000 7fa8f5cdc640 1 Processor -- start 2023-11-27T20:44:45.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.417+0000 7fa8f5cdc640 1 -- start start 2023-11-27T20:44:45.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.418+0000 7fa8f5cdc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa8f014e7c0 0x7fa8f00c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.418+0000 7fa8f5cdc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa8f00c4c00 0x7fa8f00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.418+0000 7fa8f5cdc640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f0158a60 con 0x7fa8f00ca990 2023-11-27T20:44:45.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.418+0000 7fa8f5cdc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f00c5b10 con 0x7fa8f014e7c0 2023-11-27T20:44:45.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.418+0000 7fa8f5cdc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f0157ca0 con 0x7fa8f00c4c00 2023-11-27T20:44:45.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.419+0000 7fa8f4cda640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa8f014e7c0 0x7fa8f00c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:45.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.419+0000 7fa8f4cda640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa8f014e7c0 0x7fa8f00c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40652/0 (socket says 172.21.15.91:40652) 2023-11-27T20:44:45.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.419+0000 7fa8f4cda640 1 -- 172.21.15.91:0/3353625195 learned_addr learned my addr 172.21.15.91:0/3353625195 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:45.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.419+0000 7fa8effff640 1 --2- 172.21.15.91:0/3353625195 >> v2:172.21.15.183:3300/0 conn(0x7fa8f00c4c00 0x7fa8f00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:45.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.419+0000 7fa8f4cda640 1 -- 172.21.15.91:0/3353625195 >> v2:172.21.15.183:3300/0 conn(0x7fa8f00c4c00 msgr2=0x7fa8f00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:45.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.419+0000 7fa8f4cda640 1 --2- 172.21.15.91:0/3353625195 >> v2:172.21.15.183:3300/0 conn(0x7fa8f00c4c00 0x7fa8f00ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.419+0000 7fa8f4cda640 1 -- 172.21.15.91:0/3353625195 >> v1:172.21.15.183:6789/0 conn(0x7fa8f00ca990 legacy=0x7fa8f0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:45.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.419+0000 7fa8f4cda640 1 -- 172.21.15.91:0/3353625195 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f0157f80 con 0x7fa8f014e7c0 2023-11-27T20:44:45.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.421+0000 7fa8f4cda640 1 --2- 172.21.15.91:0/3353625195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f014e7c0 0x7fa8f00c46c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00ac990 tx=0x7fa8e002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd0f212fe48118e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:45.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.421+0000 7fa8ef7fe640 1 -- 172.21.15.91:0/3353625195 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e002c960 con 0x7fa8f014e7c0 2023-11-27T20:44:45.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.421+0000 7fa8ef7fe640 1 -- 172.21.15.91:0/3353625195 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e002cac0 con 0x7fa8f014e7c0 2023-11-27T20:44:45.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.421+0000 7fa8ef7fe640 1 -- 172.21.15.91:0/3353625195 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e002ce50 con 0x7fa8f014e7c0 2023-11-27T20:44:45.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.421+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/3353625195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f014e7c0 msgr2=0x7fa8f00c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.421+0000 7fa8f5cdc640 1 --2- 172.21.15.91:0/3353625195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f014e7c0 0x7fa8f00c46c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00ac990 tx=0x7fa8e002bdc0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.422+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/3353625195 shutdown_connections 2023-11-27T20:44:45.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.422+0000 7fa8f5cdc640 1 --2- 172.21.15.91:0/3353625195 >> v2:172.21.15.183:3300/0 conn(0x7fa8f00c4c00 0x7fa8f00ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.422+0000 7fa8f5cdc640 1 --2- 172.21.15.91:0/3353625195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f014e7c0 0x7fa8f00c46c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.422+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/3353625195 >> 172.21.15.91:0/3353625195 conn(0x7fa8f00abf00 msgr2=0x7fa8f00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:45.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.422+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/3353625195 shutdown_connections 2023-11-27T20:44:45.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.422+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/3353625195 wait complete. 2023-11-27T20:44:45.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.423+0000 7fa8f5cdc640 1 Processor -- start 2023-11-27T20:44:45.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.423+0000 7fa8f5cdc640 1 -- start start 2023-11-27T20:44:45.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.424+0000 7fa8f5cdc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8f00c4c00 0x7fa8f0156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.424+0000 7fa8f5cdc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f00ca990 0x7fa8f0147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.424+0000 7fa8f5cdc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8f014e7c0 0x7fa8f0148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.424+0000 7fa8f5cdc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00c05b0 con 0x7fa8f00ca990 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.424+0000 7fa8f5cdc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00bf860 con 0x7fa8f014e7c0 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.424+0000 7fa8f5cdc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00c3150 con 0x7fa8f00c4c00 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.425+0000 7fa8effff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f00ca990 0x7fa8f0147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.425+0000 7fa8effff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f00ca990 0x7fa8f0147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40658/0 (socket says 172.21.15.91:40658) 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.425+0000 7fa8effff640 1 -- 172.21.15.91:0/1407195157 learned_addr learned my addr 172.21.15.91:0/1407195157 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.425+0000 7fa8effff640 1 -- 172.21.15.91:0/1407195157 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8f00c4c00 msgr2=0x7fa8f0156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.425+0000 7fa8effff640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8f00c4c00 0x7fa8f0156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.425+0000 7fa8effff640 1 -- 172.21.15.91:0/1407195157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8f014e7c0 msgr2=0x7fa8f0148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.425+0000 7fa8f54db640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8f014e7c0 0x7fa8f0148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:45.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.425+0000 7fa8effff640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8f014e7c0 0x7fa8f0148020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.425+0000 7fa8effff640 1 -- 172.21.15.91:0/1407195157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e0009b30 con 0x7fa8f00ca990 2023-11-27T20:44:45.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.425+0000 7fa8effff640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f00ca990 0x7fa8f0147ae0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800d5f0 tx=0x7fa8d800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:45.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.426+0000 7fa8ed7fa640 1 -- 172.21.15.91:0/1407195157 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80125f0 con 0x7fa8f00ca990 2023-11-27T20:44:45.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.426+0000 7fa8ed7fa640 1 -- 172.21.15.91:0/1407195157 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d8012750 con 0x7fa8f00ca990 2023-11-27T20:44:45.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.426+0000 7fa8ed7fa640 1 -- 172.21.15.91:0/1407195157 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8012b00 con 0x7fa8f00ca990 2023-11-27T20:44:45.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.426+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/1407195157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f00c3430 con 0x7fa8f00ca990 2023-11-27T20:44:45.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.426+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/1407195157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f00c39f0 con 0x7fa8f00ca990 2023-11-27T20:44:45.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.427+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/1407195157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f004e840 con 0x7fa8f00ca990 2023-11-27T20:44:45.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.428+0000 7fa8ed7fa640 1 -- 172.21.15.91:0/1407195157 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa8d8012c60 con 0x7fa8f00ca990 2023-11-27T20:44:45.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.429+0000 7fa8ed7fa640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa8d006b1f0 0x7fa8d006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.429+0000 7fa8ed7fa640 1 -- 172.21.15.91:0/1407195157 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fa8d8089f60 con 0x7fa8f00ca990 2023-11-27T20:44:45.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.429+0000 7fa8f4cda640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa8d006b1f0 0x7fa8d006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:45.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.430+0000 7fa8f4cda640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa8d006b1f0 0x7fa8d006d6b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0035000 tx=0x7fa8e002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:45.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.433+0000 7fa8ed7fa640 1 -- 172.21.15.91:0/1407195157 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa8d8054be0 con 0x7fa8f00ca990 2023-11-27T20:44:45.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.661+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/1407195157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8f00bdc30 con 0x7fa8f00ca990 2023-11-27T20:44:45.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.662+0000 7fa8ed7fa640 1 -- 172.21.15.91:0/1407195157 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fa8f00bdc30 con 0x7fa8f00ca990 2023-11-27T20:44:45.663 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:45.664 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6360,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/854034874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":854034874},{"type":"v1","addr":"172.21.15.91:6837","nonce":854034874}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:44:07.981170+0000","modified":"2023-11-27T20:44:11.024916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5790},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5790":{"gid":5790,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6836/1107018884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1107018884},{"type":"v1","addr":"172.21.15.91:6836","nonce":1107018884}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-27T20:44:45.664 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 37 2023-11-27T20:44:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.664+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/1407195157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa8d006b1f0 msgr2=0x7fa8d006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.664+0000 7fa8f5cdc640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa8d006b1f0 0x7fa8d006d6b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0035000 tx=0x7fa8e002e000 comp rx=0 tx=0).stop 2023-11-27T20:44:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.664+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/1407195157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f00ca990 msgr2=0x7fa8f0147ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.664+0000 7fa8f5cdc640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f00ca990 0x7fa8f0147ae0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800d5f0 tx=0x7fa8d800dab0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.664+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/1407195157 shutdown_connections 2023-11-27T20:44:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.664+0000 7fa8f5cdc640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa8d006b1f0 0x7fa8d006d6b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.664+0000 7fa8f5cdc640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8f014e7c0 0x7fa8f0148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.664+0000 7fa8f5cdc640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f00ca990 0x7fa8f0147ae0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.664+0000 7fa8f5cdc640 1 --2- 172.21.15.91:0/1407195157 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8f00c4c00 0x7fa8f0156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.664+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/1407195157 >> 172.21.15.91:0/1407195157 conn(0x7fa8f00abf00 msgr2=0x7fa8f014da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:45.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.665+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/1407195157 shutdown_connections 2023-11-27T20:44:45.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.665+0000 7fa8f5cdc640 1 -- 172.21.15.91:0/1407195157 wait complete. 2023-11-27T20:44:45.686 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:45.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.895+0000 7fad31248640 1 Processor -- start 2023-11-27T20:44:45.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.895+0000 7fad31248640 1 -- start start 2023-11-27T20:44:45.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.896+0000 7fad31248640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fad2c0c45d0 0x7fad2c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.897+0000 7fad31248640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c0bfdc0 con 0x7fad2c0c5ec0 2023-11-27T20:44:45.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.897+0000 7fad31248640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c156a80 con 0x7fad2c0c3340 2023-11-27T20:44:45.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.897+0000 7fad31248640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2c06e390 con 0x7fad2c0c45d0 2023-11-27T20:44:45.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.897+0000 7fad2ad9d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fad2c0c5ec0 0x7fad2c0c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36046/0 (socket says 172.21.15.91:36046) 2023-11-27T20:44:45.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.897+0000 7fad2ad9d640 1 -- 172.21.15.91:0/1712273233 learned_addr learned my addr 172.21.15.91:0/1712273233 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:45.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.897+0000 7fad2a59c640 1 --2- 172.21.15.91:0/1712273233 >> v2:172.21.15.183:3300/0 conn(0x7fad2c0c45d0 0x7fad2c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:45.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.897+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149836222 0 0) 0x7fad2c0bfdc0 con 0x7fad2c0c5ec0 2023-11-27T20:44:45.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.897+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad14003520 con 0x7fad2c0c5ec0 2023-11-27T20:44:45.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2267111602 0 0) 0x7fad14003520 con 0x7fad2c0c5ec0 2023-11-27T20:44:45.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 >> v2:172.21.15.183:3300/0 conn(0x7fad2c0c45d0 msgr2=0x7fad2c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:45.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 --2- 172.21.15.91:0/1712273233 >> v2:172.21.15.183:3300/0 conn(0x7fad2c0c45d0 0x7fad2c155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 >> v1:172.21.15.183:6789/0 conn(0x7fad2c0c3340 legacy=0x7fad2c156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c06ddd0 con 0x7fad2c0c5ec0 2023-11-27T20:44:45.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fad1c001670 con 0x7fad2c0c5ec0 2023-11-27T20:44:45.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 >> v1:172.21.15.91:6789/0 conn(0x7fad2c0c5ec0 legacy=0x7fad2c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 --2- 172.21.15.91:0/1712273233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad140039a0 0x7fad14003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 --2- 172.21.15.91:0/1712273233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad140047c0 0x7fad14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 --2- 172.21.15.91:0/1712273233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad140052a0 0x7fad1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c06e390 con 0x7fad140039a0 2023-11-27T20:44:45.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1400c1a0 con 0x7fad140052a0 2023-11-27T20:44:45.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1400c360 con 0x7fad140047c0 2023-11-27T20:44:45.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.898+0000 7fad2ad9d640 1 --2- 172.21.15.91:0/1712273233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad140039a0 0x7fad14003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:45.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.899+0000 7fad2ad9d640 1 -- 172.21.15.91:0/1712273233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad140047c0 msgr2=0x7fad14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:45.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.899+0000 7fad2ad9d640 1 --2- 172.21.15.91:0/1712273233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad140047c0 0x7fad14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.899+0000 7fad2ad9d640 1 -- 172.21.15.91:0/1712273233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad140052a0 msgr2=0x7fad1400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:45.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.899+0000 7fad2ad9d640 1 --2- 172.21.15.91:0/1712273233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad140052a0 0x7fad1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.899+0000 7fad2ad9d640 1 -- 172.21.15.91:0/1712273233 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14003520 con 0x7fad140039a0 2023-11-27T20:44:45.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.899+0000 7fad2b59e640 1 -- 172.21.15.91:0/1712273233 reap_dead start 2023-11-27T20:44:45.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.900+0000 7fad2ad9d640 1 --2- 172.21.15.91:0/1712273233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad140039a0 0x7fad14003dc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00c210 tx=0x7fad140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5d96dbd541879a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:45.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.900+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c005ad0 con 0x7fad140039a0 2023-11-27T20:44:45.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.900+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c005c30 con 0x7fad140039a0 2023-11-27T20:44:45.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.900+0000 7fad29d9b640 1 -- 172.21.15.91:0/1712273233 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c02cad0 con 0x7fad140039a0 2023-11-27T20:44:45.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.901+0000 7fad31248640 1 -- 172.21.15.91:0/1712273233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad140039a0 msgr2=0x7fad14003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.901+0000 7fad31248640 1 --2- 172.21.15.91:0/1712273233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad140039a0 0x7fad14003dc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00c210 tx=0x7fad140057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.901+0000 7fad31248640 1 -- 172.21.15.91:0/1712273233 shutdown_connections 2023-11-27T20:44:45.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.901+0000 7fad31248640 1 --2- 172.21.15.91:0/1712273233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad140039a0 0x7fad14003dc0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.901+0000 7fad31248640 1 -- 172.21.15.91:0/1712273233 >> 172.21.15.91:0/1712273233 conn(0x7fad2c06a500 msgr2=0x7fad2c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:45.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.901+0000 7fad31248640 1 -- 172.21.15.91:0/1712273233 shutdown_connections 2023-11-27T20:44:45.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.901+0000 7fad31248640 1 -- 172.21.15.91:0/1712273233 wait complete. 2023-11-27T20:44:45.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.903+0000 7fad31248640 1 Processor -- start 2023-11-27T20:44:45.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.903+0000 7fad31248640 1 -- start start 2023-11-27T20:44:45.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad31248640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad140039a0 0x7fad2c1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad31248640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad2c150b60 0x7fad2c14daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad31248640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c14e5d0 0x7fad2c14dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad31248640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c1e9bc0 con 0x7fad2c14e5d0 2023-11-27T20:44:45.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad31248640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c1eab70 con 0x7fad140039a0 2023-11-27T20:44:45.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad31248640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c1e9db0 con 0x7fad2c150b60 2023-11-27T20:44:45.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad2b59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c14e5d0 0x7fad2c14dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:45.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad2b59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c14e5d0 0x7fad2c14dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40674/0 (socket says 172.21.15.91:40674) 2023-11-27T20:44:45.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad2b59e640 1 -- 172.21.15.91:0/801578916 learned_addr learned my addr 172.21.15.91:0/801578916 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:45.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad2ad9d640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad140039a0 0x7fad2c1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:45.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad2b59e640 1 -- 172.21.15.91:0/801578916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad2c150b60 msgr2=0x7fad2c14daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad2b59e640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad2c150b60 0x7fad2c14daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad2b59e640 1 -- 172.21.15.91:0/801578916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad140039a0 msgr2=0x7fad2c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:45.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad2b59e640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad140039a0 0x7fad2c1583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:45.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.904+0000 7fad2b59e640 1 -- 172.21.15.91:0/801578916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c1ea090 con 0x7fad2c14e5d0 2023-11-27T20:44:45.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.905+0000 7fad2b59e640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c14e5d0 0x7fad2c14dfe0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fad2c06b200 tx=0x7fad2400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:45.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.905+0000 7fad137fe640 1 -- 172.21.15.91:0/801578916 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24005d40 con 0x7fad2c14e5d0 2023-11-27T20:44:45.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.905+0000 7fad137fe640 1 -- 172.21.15.91:0/801578916 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2400ced0 con 0x7fad2c14e5d0 2023-11-27T20:44:45.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.905+0000 7fad137fe640 1 -- 172.21.15.91:0/801578916 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24005ea0 con 0x7fad2c14e5d0 2023-11-27T20:44:45.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.905+0000 7fad31248640 1 -- 172.21.15.91:0/801578916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c1ea370 con 0x7fad2c14e5d0 2023-11-27T20:44:45.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.905+0000 7fad31248640 1 -- 172.21.15.91:0/801578916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c158900 con 0x7fad2c14e5d0 2023-11-27T20:44:45.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.906+0000 7fad31248640 1 -- 172.21.15.91:0/801578916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c1ea890 con 0x7fad2c14e5d0 2023-11-27T20:44:45.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.907+0000 7fad137fe640 1 -- 172.21.15.91:0/801578916 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fad2400a850 con 0x7fad2c14e5d0 2023-11-27T20:44:45.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.908+0000 7fad137fe640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fad1806b1f0 0x7fad1806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:45.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.909+0000 7fad137fe640 1 -- 172.21.15.91:0/801578916 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fad24088fa0 con 0x7fad2c14e5d0 2023-11-27T20:44:45.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.909+0000 7fad2ad9d640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fad1806b1f0 0x7fad1806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:45.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.909+0000 7fad2ad9d640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fad1806b1f0 0x7fad1806d6b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fad1c034000 tx=0x7fad1c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:45.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:45.913+0000 7fad137fe640 1 -- 172.21.15.91:0/801578916 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fad2c1ea890 con 0x7fad2c14e5d0 2023-11-27T20:44:46.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.104+0000 7fad31248640 1 -- 172.21.15.91:0/801578916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad2c1ea890 con 0x7fad2c14e5d0 2023-11-27T20:44:46.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.107+0000 7fad137fe640 1 -- 172.21.15.91:0/801578916 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16759 (secure 0 0 0) 0x7fad24017020 con 0x7fad2c14e5d0 2023-11-27T20:44:46.109 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:46.109 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":64,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:43.415028+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.91:6837/42700883":"2023-11-28T20:44:40.116207+0000","172.21.15.91:6834/42700883":"2023-11-28T20:44:40.116207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:46.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 -- 172.21.15.91:0/801578916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fad1806b1f0 msgr2=0x7fad1806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fad1806b1f0 0x7fad1806d6b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fad1c034000 tx=0x7fad1c009030 comp rx=0 tx=0).stop 2023-11-27T20:44:46.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 -- 172.21.15.91:0/801578916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c14e5d0 msgr2=0x7fad2c14dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c14e5d0 0x7fad2c14dfe0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fad2c06b200 tx=0x7fad2400cb90 comp rx=0 tx=0).stop 2023-11-27T20:44:46.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 -- 172.21.15.91:0/801578916 shutdown_connections 2023-11-27T20:44:46.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fad2c14e5d0 0x7fad2c14dfe0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad2c150b60 0x7fad2c14daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fad1806b1f0 0x7fad1806d6b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 --2- 172.21.15.91:0/801578916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad140039a0 0x7fad2c1583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 -- 172.21.15.91:0/801578916 >> 172.21.15.91:0/801578916 conn(0x7fad2c06a500 msgr2=0x7fad2c0c2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:46.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 -- 172.21.15.91:0/801578916 shutdown_connections 2023-11-27T20:44:46.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.110+0000 7fad31248640 1 -- 172.21.15.91:0/801578916 wait complete. 2023-11-27T20:44:46.129 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-27T20:44:46.129 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:44:46.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.339+0000 7fc1b424f640 1 Processor -- start 2023-11-27T20:44:46.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.339+0000 7fc1b424f640 1 -- start start 2023-11-27T20:44:46.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.341+0000 7fc1b424f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc1ac14fd30 0x7fc1ac152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.341+0000 7fc1b424f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 0x7fc1ac0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.341+0000 7fc1b424f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac0c64a0 con 0x7fc1ac0a5260 2023-11-27T20:44:46.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.341+0000 7fc1b424f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0c5c00 con 0x7fc1ac14fd30 2023-11-27T20:44:46.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.341+0000 7fc1b424f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0c5ee0 con 0x7fc1ac06d0a0 2023-11-27T20:44:46.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.342+0000 7fc1b1feb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc1ac14fd30 0x7fc1ac152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.342+0000 7fc1b17ea640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 0x7fc1ac0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.342+0000 7fc1b27ec640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fc1ac0a5260 0x7fc1ac0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:45558/0 (socket says 172.21.15.91:45558) 2023-11-27T20:44:46.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.342+0000 7fc1b27ec640 1 -- 172.21.15.91:0/3238393122 learned_addr learned my addr 172.21.15.91:0/3238393122 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:46.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.342+0000 7fc1b17ea640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 0x7fc1ac0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:50022/0 (socket says 172.21.15.91:50022) 2023-11-27T20:44:46.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.342+0000 7fc1b17ea640 1 -- 172.21.15.91:0/3238393122 >> v2:172.21.15.183:3300/0 conn(0x7fc1ac14fd30 msgr2=0x7fc1ac152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:46.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.342+0000 7fc1b17ea640 1 --2- 172.21.15.91:0/3238393122 >> v2:172.21.15.183:3300/0 conn(0x7fc1ac14fd30 0x7fc1ac152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.342+0000 7fc1b17ea640 1 -- 172.21.15.91:0/3238393122 >> v1:172.21.15.183:6789/0 conn(0x7fc1ac0a5260 legacy=0x7fc1ac0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.342+0000 7fc1b17ea640 1 -- 172.21.15.91:0/3238393122 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0c61c0 con 0x7fc1ac06d0a0 2023-11-27T20:44:46.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.342+0000 7fc1b1feb640 1 --2- 172.21.15.91:0/3238393122 >> v2:172.21.15.183:3300/0 conn(0x7fc1ac14fd30 0x7fc1ac152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:44:46.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.344+0000 7fc1b17ea640 1 --2- 172.21.15.91:0/3238393122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 0x7fc1ac0a4d20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0097a0 tx=0x7fc19c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9303386924f731d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:46.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.344+0000 7fc1b0fe9640 1 -- 172.21.15.91:0/3238393122 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c02d040 con 0x7fc1ac06d0a0 2023-11-27T20:44:46.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.344+0000 7fc1b0fe9640 1 -- 172.21.15.91:0/3238393122 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c031810 con 0x7fc1ac06d0a0 2023-11-27T20:44:46.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.344+0000 7fc1b0fe9640 1 -- 172.21.15.91:0/3238393122 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c031ba0 con 0x7fc1ac06d0a0 2023-11-27T20:44:46.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.345+0000 7fc1b424f640 1 -- 172.21.15.91:0/3238393122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 msgr2=0x7fc1ac0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.345+0000 7fc1b424f640 1 --2- 172.21.15.91:0/3238393122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 0x7fc1ac0a4d20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0097a0 tx=0x7fc19c02b8b0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.345+0000 7fc1b424f640 1 -- 172.21.15.91:0/3238393122 shutdown_connections 2023-11-27T20:44:46.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.345+0000 7fc1b424f640 1 --2- 172.21.15.91:0/3238393122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 0x7fc1ac0a4d20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.345+0000 7fc1b424f640 1 --2- 172.21.15.91:0/3238393122 >> v2:172.21.15.183:3300/0 conn(0x7fc1ac14fd30 0x7fc1ac152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.345+0000 7fc1b424f640 1 -- 172.21.15.91:0/3238393122 >> 172.21.15.91:0/3238393122 conn(0x7fc1ac06a500 msgr2=0x7fc1ac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:46.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.345+0000 7fc1b424f640 1 -- 172.21.15.91:0/3238393122 shutdown_connections 2023-11-27T20:44:46.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.345+0000 7fc1b424f640 1 -- 172.21.15.91:0/3238393122 wait complete. 2023-11-27T20:44:46.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.347+0000 7fc1b424f640 1 Processor -- start 2023-11-27T20:44:46.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.347+0000 7fc1b424f640 1 -- start start 2023-11-27T20:44:46.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.348+0000 7fc1b424f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 0x7fc1ac0a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.348+0000 7fc1b424f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ac0a5260 0x7fc1ac14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.348+0000 7fc1b424f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1ac14fd30 0x7fc1ac1ea430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.348+0000 7fc1b424f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac1dc130 con 0x7fc1ac14fd30 2023-11-27T20:44:46.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.348+0000 7fc1b424f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac1dbb70 con 0x7fc1ac0a5260 2023-11-27T20:44:46.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.348+0000 7fc1b424f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac1dbe50 con 0x7fc1ac06d0a0 2023-11-27T20:44:46.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.348+0000 7fc1b27ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1ac14fd30 0x7fc1ac1ea430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.348+0000 7fc1b27ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1ac14fd30 0x7fc1ac1ea430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40678/0 (socket says 172.21.15.91:40678) 2023-11-27T20:44:46.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.348+0000 7fc1b27ec640 1 -- 172.21.15.91:0/1738082240 learned_addr learned my addr 172.21.15.91:0/1738082240 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:46.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1b17ea640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ac0a5260 0x7fc1ac14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1b1feb640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 0x7fc1ac0a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1b27ec640 1 -- 172.21.15.91:0/1738082240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 msgr2=0x7fc1ac0a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1b27ec640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 0x7fc1ac0a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1b27ec640 1 -- 172.21.15.91:0/1738082240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ac0a5260 msgr2=0x7fc1ac14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1b27ec640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ac0a5260 0x7fc1ac14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1b27ec640 1 -- 172.21.15.91:0/1738082240 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a8009400 con 0x7fc1ac14fd30 2023-11-27T20:44:46.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1b27ec640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1ac14fd30 0x7fc1ac1ea430 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400cbc0 tx=0x7fc1a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:46.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1a27fc640 1 -- 172.21.15.91:0/1738082240 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400ad40 con 0x7fc1ac14fd30 2023-11-27T20:44:46.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1a27fc640 1 -- 172.21.15.91:0/1738082240 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a4012400 con 0x7fc1ac14fd30 2023-11-27T20:44:46.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1b424f640 1 -- 172.21.15.91:0/1738082240 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19c009400 con 0x7fc1ac14fd30 2023-11-27T20:44:46.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.349+0000 7fc1a27fc640 1 -- 172.21.15.91:0/1738082240 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400aea0 con 0x7fc1ac14fd30 2023-11-27T20:44:46.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.350+0000 7fc1b424f640 1 -- 172.21.15.91:0/1738082240 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac1522a0 con 0x7fc1ac14fd30 2023-11-27T20:44:46.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.350+0000 7fc1b424f640 1 -- 172.21.15.91:0/1738082240 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac068350 con 0x7fc1ac14fd30 2023-11-27T20:44:46.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.352+0000 7fc1a27fc640 1 -- 172.21.15.91:0/1738082240 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc1a4007070 con 0x7fc1ac14fd30 2023-11-27T20:44:46.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.353+0000 7fc1a27fc640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc19006b1c0 0x7fc19006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.353+0000 7fc1a27fc640 1 -- 172.21.15.91:0/1738082240 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fc1a4089930 con 0x7fc1ac14fd30 2023-11-27T20:44:46.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.353+0000 7fc1b1feb640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc19006b1c0 0x7fc19006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.354+0000 7fc1b1feb640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc19006b1c0 0x7fc19006d680 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009bc0 tx=0x7fc1a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:46.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.357+0000 7fc1a27fc640 1 -- 172.21.15.91:0/1738082240 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc1a4054660 con 0x7fc1ac14fd30 2023-11-27T20:44:46.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.582+0000 7fc1b424f640 1 -- 172.21.15.91:0/1738082240 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1ac14baf0 con 0x7fc1ac14fd30 2023-11-27T20:44:46.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.583+0000 7fc1a27fc640 1 -- 172.21.15.91:0/1738082240 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fc1a4017020 con 0x7fc1ac14fd30 2023-11-27T20:44:46.584 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:46.584 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6360,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/854034874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":854034874},{"type":"v1","addr":"172.21.15.91:6837","nonce":854034874}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:44:07.981170+0000","modified":"2023-11-27T20:44:11.024916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5790},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5790":{"gid":5790,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6836/1107018884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1107018884},{"type":"v1","addr":"172.21.15.91:6836","nonce":1107018884}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-27T20:44:46.585 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 37 2023-11-27T20:44:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.585+0000 7fc1b424f640 1 -- 172.21.15.91:0/1738082240 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc19006b1c0 msgr2=0x7fc19006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.585+0000 7fc1b424f640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc19006b1c0 0x7fc19006d680 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009bc0 tx=0x7fc1a8008040 comp rx=0 tx=0).stop 2023-11-27T20:44:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.585+0000 7fc1b424f640 1 -- 172.21.15.91:0/1738082240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1ac14fd30 msgr2=0x7fc1ac1ea430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.585+0000 7fc1b424f640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1ac14fd30 0x7fc1ac1ea430 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400cbc0 tx=0x7fc1a400a430 comp rx=0 tx=0).stop 2023-11-27T20:44:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.585+0000 7fc1b424f640 1 -- 172.21.15.91:0/1738082240 shutdown_connections 2023-11-27T20:44:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.585+0000 7fc1b424f640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1ac14fd30 0x7fc1ac1ea430 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.585+0000 7fc1b424f640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc19006b1c0 0x7fc19006d680 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.585+0000 7fc1b424f640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ac0a5260 0x7fc1ac14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.585+0000 7fc1b424f640 1 --2- 172.21.15.91:0/1738082240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1ac06d0a0 0x7fc1ac0a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.585+0000 7fc1b424f640 1 -- 172.21.15.91:0/1738082240 >> 172.21.15.91:0/1738082240 conn(0x7fc1ac06a500 msgr2=0x7fc1ac0bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:46.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.586+0000 7fc1b424f640 1 -- 172.21.15.91:0/1738082240 shutdown_connections 2023-11-27T20:44:46.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.586+0000 7fc1b424f640 1 -- 172.21.15.91:0/1738082240 wait complete. 2023-11-27T20:44:46.605 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:44:46.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.808+0000 7f62853a0640 1 Processor -- start 2023-11-27T20:44:46.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.808+0000 7f62853a0640 1 -- start start 2023-11-27T20:44:46.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.810+0000 7f62853a0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f628014c2e0 0x7f62800c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.810+0000 7f62853a0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f62800c0440 0x7f6280152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.810+0000 7f62853a0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6280072310 0x7f62800a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.810+0000 7f62853a0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6280071470 con 0x7f6280072310 2023-11-27T20:44:46.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.810+0000 7f62853a0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6280071e80 con 0x7f62800c0440 2023-11-27T20:44:46.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.810+0000 7f62853a0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628014c6c0 con 0x7f628014c2e0 2023-11-27T20:44:46.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.810+0000 7f6284b9f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6280072310 0x7f62800a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.810+0000 7f6284b9f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6280072310 0x7f62800a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40690/0 (socket says 172.21.15.91:40690) 2023-11-27T20:44:46.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.810+0000 7f6284b9f640 1 -- 172.21.15.91:0/508495424 learned_addr learned my addr 172.21.15.91:0/508495424 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:46.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.810+0000 7f6277fff640 1 --2- 172.21.15.91:0/508495424 >> v2:172.21.15.183:3300/0 conn(0x7f62800c0440 0x7f6280152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.811+0000 7f627ffff640 1 --2- 172.21.15.91:0/508495424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f628014c2e0 0x7f62800c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.811+0000 7f6284b9f640 1 -- 172.21.15.91:0/508495424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f628014c2e0 msgr2=0x7f62800c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:46.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.811+0000 7f6284b9f640 1 --2- 172.21.15.91:0/508495424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f628014c2e0 0x7f62800c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.811+0000 7f6284b9f640 1 -- 172.21.15.91:0/508495424 >> v2:172.21.15.183:3300/0 conn(0x7f62800c0440 msgr2=0x7f6280152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:46.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.811+0000 7f6284b9f640 1 --2- 172.21.15.91:0/508495424 >> v2:172.21.15.183:3300/0 conn(0x7f62800c0440 0x7f6280152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.811+0000 7f6284b9f640 1 -- 172.21.15.91:0/508495424 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6280153180 con 0x7f6280072310 2023-11-27T20:44:46.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.812+0000 7f6284b9f640 1 --2- 172.21.15.91:0/508495424 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6280072310 0x7f62800a4d20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f628006b500 tx=0x7f627802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a375c33582f182d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:46.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.812+0000 7f627f7fe640 1 -- 172.21.15.91:0/508495424 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627802c950 con 0x7f6280072310 2023-11-27T20:44:46.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.812+0000 7f627f7fe640 1 -- 172.21.15.91:0/508495424 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627802cab0 con 0x7f6280072310 2023-11-27T20:44:46.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.812+0000 7f627f7fe640 1 -- 172.21.15.91:0/508495424 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627802ce40 con 0x7f6280072310 2023-11-27T20:44:46.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.813+0000 7f62853a0640 1 -- 172.21.15.91:0/508495424 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6280072310 msgr2=0x7f62800a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.813+0000 7f62853a0640 1 --2- 172.21.15.91:0/508495424 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6280072310 0x7f62800a4d20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f628006b500 tx=0x7f627802bdb0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.813+0000 7f62853a0640 1 -- 172.21.15.91:0/508495424 shutdown_connections 2023-11-27T20:44:46.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.813+0000 7f62853a0640 1 --2- 172.21.15.91:0/508495424 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6280072310 0x7f62800a4d20 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.813+0000 7f62853a0640 1 --2- 172.21.15.91:0/508495424 >> v2:172.21.15.183:3300/0 conn(0x7f62800c0440 0x7f6280152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.813+0000 7f62853a0640 1 --2- 172.21.15.91:0/508495424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f628014c2e0 0x7f62800c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.813+0000 7f62853a0640 1 -- 172.21.15.91:0/508495424 >> 172.21.15.91:0/508495424 conn(0x7f62800a77f0 msgr2=0x7f62800a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:46.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.813+0000 7f62853a0640 1 -- 172.21.15.91:0/508495424 shutdown_connections 2023-11-27T20:44:46.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.813+0000 7f62853a0640 1 -- 172.21.15.91:0/508495424 wait complete. 2023-11-27T20:44:46.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.814+0000 7f62853a0640 1 Processor -- start 2023-11-27T20:44:46.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.815+0000 7f62853a0640 1 -- start start 2023-11-27T20:44:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.815+0000 7f62853a0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6280072310 0x7f62800aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.815+0000 7f62853a0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62800c0440 0x7f628014ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.815+0000 7f62853a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f628014c2e0 0x7f628014d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.815+0000 7f62853a0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628014b3f0 con 0x7f628014c2e0 2023-11-27T20:44:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.815+0000 7f62853a0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62800ab0d0 con 0x7f62800c0440 2023-11-27T20:44:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.815+0000 7f62853a0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62800ab300 con 0x7f6280072310 2023-11-27T20:44:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6284b9f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f628014c2e0 0x7f628014d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6284b9f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f628014c2e0 0x7f628014d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40706/0 (socket says 172.21.15.91:40706) 2023-11-27T20:44:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6284b9f640 1 -- 172.21.15.91:0/1854031832 learned_addr learned my addr 172.21.15.91:0/1854031832 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6277fff640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62800c0440 0x7f628014ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6284b9f640 1 -- 172.21.15.91:0/1854031832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6280072310 msgr2=0x7f62800aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6284b9f640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6280072310 0x7f62800aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6284b9f640 1 -- 172.21.15.91:0/1854031832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62800c0440 msgr2=0x7f628014ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6284b9f640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62800c0440 0x7f628014ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6284b9f640 1 -- 172.21.15.91:0/1854031832 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278009b30 con 0x7f628014c2e0 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6277fff640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62800c0440 0x7f628014ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.816+0000 7f6284b9f640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f628014c2e0 0x7f628014d1f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6278009f40 tx=0x7f6278004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.817+0000 7f627d7fa640 1 -- 172.21.15.91:0/1854031832 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627803e450 con 0x7f628014c2e0 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.817+0000 7f627d7fa640 1 -- 172.21.15.91:0/1854031832 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627803e5b0 con 0x7f628014c2e0 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.817+0000 7f627d7fa640 1 -- 172.21.15.91:0/1854031832 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627803e960 con 0x7f628014c2e0 2023-11-27T20:44:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.817+0000 7f62853a0640 1 -- 172.21.15.91:0/1854031832 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62800a90d0 con 0x7f628014c2e0 2023-11-27T20:44:46.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.817+0000 7f62853a0640 1 -- 172.21.15.91:0/1854031832 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62800a9690 con 0x7f628014c2e0 2023-11-27T20:44:46.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.818+0000 7f62853a0640 1 -- 172.21.15.91:0/1854031832 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628004e840 con 0x7f628014c2e0 2023-11-27T20:44:46.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.819+0000 7f627d7fa640 1 -- 172.21.15.91:0/1854031832 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f627803eac0 con 0x7f628014c2e0 2023-11-27T20:44:46.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.820+0000 7f627d7fa640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f626006b1c0 0x7f626006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:46.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.820+0000 7f627d7fa640 1 -- 172.21.15.91:0/1854031832 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f62780ac960 con 0x7f628014c2e0 2023-11-27T20:44:46.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.820+0000 7f627ffff640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f626006b1c0 0x7f626006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:46.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.821+0000 7f627ffff640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f626006b1c0 0x7f626006d680 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f627000a770 tx=0x7f6270008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:46.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:46.824+0000 7f627d7fa640 1 -- 172.21.15.91:0/1854031832 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f62780775f0 con 0x7f628014c2e0 2023-11-27T20:44:47.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.033+0000 7f62853a0640 1 -- 172.21.15.91:0/1854031832 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62800c5380 con 0x7f628014c2e0 2023-11-27T20:44:47.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.034+0000 7f627d7fa640 1 -- 172.21.15.91:0/1854031832 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f627807ac10 con 0x7f628014c2e0 2023-11-27T20:44:47.036 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:47.036 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6360,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/854034874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":854034874},{"type":"v1","addr":"172.21.15.91:6837","nonce":854034874}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:44:07.981170+0000","modified":"2023-11-27T20:44:11.024916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5790},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5790":{"gid":5790,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6836/1107018884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1107018884},{"type":"v1","addr":"172.21.15.91:6836","nonce":1107018884}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-27T20:44:47.036 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 37 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 -- 172.21.15.91:0/1854031832 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f626006b1c0 msgr2=0x7f626006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f626006b1c0 0x7f626006d680 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f627000a770 tx=0x7f6270008040 comp rx=0 tx=0).stop 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 -- 172.21.15.91:0/1854031832 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f628014c2e0 msgr2=0x7f628014d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f628014c2e0 0x7f628014d1f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6278009f40 tx=0x7f6278004a40 comp rx=0 tx=0).stop 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 -- 172.21.15.91:0/1854031832 shutdown_connections 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f628014c2e0 0x7f628014d1f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f626006b1c0 0x7f626006d680 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62800c0440 0x7f628014ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 --2- 172.21.15.91:0/1854031832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6280072310 0x7f62800aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 -- 172.21.15.91:0/1854031832 >> 172.21.15.91:0/1854031832 conn(0x7f62800a77f0 msgr2=0x7f62800c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 -- 172.21.15.91:0/1854031832 shutdown_connections 2023-11-27T20:44:47.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.037+0000 7f62853a0640 1 -- 172.21.15.91:0/1854031832 wait complete. 2023-11-27T20:44:47.057 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:47.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.261+0000 7fecc0725640 1 Processor -- start 2023-11-27T20:44:47.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.261+0000 7fecc0725640 1 -- start start 2023-11-27T20:44:47.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.262+0000 7fecc0725640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb8155fc0 0x7fecb8159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.263+0000 7fecc0725640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fecb80c2e60 0x7fecb8163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.263+0000 7fecc0725640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb806d580 con 0x7fecb80c1ca0 2023-11-27T20:44:47.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.263+0000 7fecc0725640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb806dd60 con 0x7fecb80c2e60 2023-11-27T20:44:47.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.263+0000 7fecc0725640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80c6580 con 0x7fecb8155fc0 2023-11-27T20:44:47.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.263+0000 7fecbecc2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fecb80c2e60 0x7fecb8163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.263+0000 7fecbecc2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fecb80c2e60 0x7fecb8163370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40722/0 (socket says 172.21.15.91:40722) 2023-11-27T20:44:47.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.263+0000 7fecbecc2640 1 -- 172.21.15.91:0/199907285 learned_addr learned my addr 172.21.15.91:0/199907285 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:47.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.263+0000 7fecbe4c1640 1 --2- 172.21.15.91:0/199907285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb8155fc0 0x7fecb8159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.264+0000 7fecbecc2640 1 -- 172.21.15.91:0/199907285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb8155fc0 msgr2=0x7fecb8159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:47.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.264+0000 7fecbecc2640 1 --2- 172.21.15.91:0/199907285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb8155fc0 0x7fecb8159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.264+0000 7fecbecc2640 1 -- 172.21.15.91:0/199907285 >> v1:172.21.15.183:6789/0 conn(0x7fecb80c1ca0 legacy=0x7fecb80c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:47.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.264+0000 7fecbecc2640 1 -- 172.21.15.91:0/199907285 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80726d0 con 0x7fecb80c2e60 2023-11-27T20:44:47.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.265+0000 7fecbecc2640 1 --2- 172.21.15.91:0/199907285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 0x7fecb8163370 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009e50 tx=0x7fecb002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47f49d9cf99b3f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:47.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.265+0000 7fecbd4bf640 1 -- 172.21.15.91:0/199907285 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb002c9e0 con 0x7fecb80c2e60 2023-11-27T20:44:47.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.265+0000 7fecbd4bf640 1 -- 172.21.15.91:0/199907285 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb002cb40 con 0x7fecb80c2e60 2023-11-27T20:44:47.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.265+0000 7fecbd4bf640 1 -- 172.21.15.91:0/199907285 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb00343f0 con 0x7fecb80c2e60 2023-11-27T20:44:47.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.266+0000 7fecc0725640 1 -- 172.21.15.91:0/199907285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 msgr2=0x7fecb8163370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.266+0000 7fecc0725640 1 --2- 172.21.15.91:0/199907285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 0x7fecb8163370 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009e50 tx=0x7fecb002be40 comp rx=0 tx=0).stop 2023-11-27T20:44:47.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.266+0000 7fecc0725640 1 -- 172.21.15.91:0/199907285 shutdown_connections 2023-11-27T20:44:47.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.266+0000 7fecc0725640 1 --2- 172.21.15.91:0/199907285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 0x7fecb8163370 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.266+0000 7fecc0725640 1 --2- 172.21.15.91:0/199907285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb8155fc0 0x7fecb8159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.266+0000 7fecc0725640 1 -- 172.21.15.91:0/199907285 >> 172.21.15.91:0/199907285 conn(0x7fecb806a500 msgr2=0x7fecb806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:47.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.266+0000 7fecc0725640 1 -- 172.21.15.91:0/199907285 shutdown_connections 2023-11-27T20:44:47.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.266+0000 7fecc0725640 1 -- 172.21.15.91:0/199907285 wait complete. 2023-11-27T20:44:47.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.268+0000 7fecc0725640 1 Processor -- start 2023-11-27T20:44:47.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.268+0000 7fecc0725640 1 -- start start 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecc0725640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb80c1ca0 0x7fecb80c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecc0725640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 0x7fecb81f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecc0725640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb8155fc0 0x7fecb81f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecc0725640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80a2df0 con 0x7fecb80c2e60 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecc0725640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80a6d40 con 0x7fecb80c1ca0 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecc0725640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80a6160 con 0x7fecb8155fc0 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecbdcc0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 0x7fecb81f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecbdcc0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 0x7fecb81f1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40732/0 (socket says 172.21.15.91:40732) 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecbdcc0640 1 -- 172.21.15.91:0/4204617081 learned_addr learned my addr 172.21.15.91:0/4204617081 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecbe4c1640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb80c1ca0 0x7fecb80c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecbdcc0640 1 -- 172.21.15.91:0/4204617081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb8155fc0 msgr2=0x7fecb81f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecbdcc0640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb8155fc0 0x7fecb81f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecbdcc0640 1 -- 172.21.15.91:0/4204617081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb80c1ca0 msgr2=0x7fecb80c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecbdcc0640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb80c1ca0 0x7fecb80c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.269+0000 7fecbdcc0640 1 -- 172.21.15.91:0/4204617081 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb0009b30 con 0x7fecb80c2e60 2023-11-27T20:44:47.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.270+0000 7fecbdcc0640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 0x7fecb81f1830 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7feca800c450 tx=0x7feca800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:47.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.270+0000 7fecaeffd640 1 -- 172.21.15.91:0/4204617081 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca80052d0 con 0x7fecb80c2e60 2023-11-27T20:44:47.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.270+0000 7fecaeffd640 1 -- 172.21.15.91:0/4204617081 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca8005430 con 0x7fecb80c2e60 2023-11-27T20:44:47.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.270+0000 7fecaeffd640 1 -- 172.21.15.91:0/4204617081 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8012870 con 0x7fecb80c2e60 2023-11-27T20:44:47.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.270+0000 7fecc0725640 1 -- 172.21.15.91:0/4204617081 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb80a27e0 con 0x7fecb80c2e60 2023-11-27T20:44:47.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.270+0000 7fecc0725640 1 -- 172.21.15.91:0/4204617081 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb80a6690 con 0x7fecb80c2e60 2023-11-27T20:44:47.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.271+0000 7fecc0725640 1 -- 172.21.15.91:0/4204617081 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb81f1550 con 0x7fecb80c2e60 2023-11-27T20:44:47.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.272+0000 7fecaeffd640 1 -- 172.21.15.91:0/4204617081 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7feca80129d0 con 0x7fecb80c2e60 2023-11-27T20:44:47.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.273+0000 7fecaeffd640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec9c06b1c0 0x7fec9c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.273+0000 7fecaeffd640 1 -- 172.21.15.91:0/4204617081 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7feca8089610 con 0x7fecb80c2e60 2023-11-27T20:44:47.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.274+0000 7fecbe4c1640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec9c06b1c0 0x7fec9c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.274+0000 7fecbe4c1640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec9c06b1c0 0x7fec9c06d680 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fecb4006fd0 tx=0x7fecb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:47.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.278+0000 7fecaeffd640 1 -- 172.21.15.91:0/4204617081 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fecb81f1550 con 0x7fecb80c2e60 2023-11-27T20:44:47.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.468+0000 7fecc0725640 1 -- 172.21.15.91:0/4204617081 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecb81f1550 con 0x7fecb80c2e60 2023-11-27T20:44:47.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.470+0000 7fecaeffd640 1 -- 172.21.15.91:0/4204617081 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16759 (secure 0 0 0) 0x7fecb81f1550 con 0x7fecb80c2e60 2023-11-27T20:44:47.472 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:47.472 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":64,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:43.415028+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:44:06.059576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:44:06.989345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.91:6837/42700883":"2023-11-28T20:44:40.116207+0000","172.21.15.91:6834/42700883":"2023-11-28T20:44:40.116207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.473+0000 7fecc0725640 1 -- 172.21.15.91:0/4204617081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec9c06b1c0 msgr2=0x7fec9c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.473+0000 7fecc0725640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec9c06b1c0 0x7fec9c06d680 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fecb4006fd0 tx=0x7fecb4008040 comp rx=0 tx=0).stop 2023-11-27T20:44:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.473+0000 7fecc0725640 1 -- 172.21.15.91:0/4204617081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 msgr2=0x7fecb81f1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.473+0000 7fecc0725640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 0x7fecb81f1830 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7feca800c450 tx=0x7feca800c910 comp rx=0 tx=0).stop 2023-11-27T20:44:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.474+0000 7fecc0725640 1 -- 172.21.15.91:0/4204617081 shutdown_connections 2023-11-27T20:44:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.474+0000 7fecc0725640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb8155fc0 0x7fecb81f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.474+0000 7fecc0725640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fecb80c2e60 0x7fecb81f1830 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.474+0000 7fecc0725640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec9c06b1c0 0x7fec9c06d680 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.474+0000 7fecc0725640 1 --2- 172.21.15.91:0/4204617081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb80c1ca0 0x7fecb80c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.474+0000 7fecc0725640 1 -- 172.21.15.91:0/4204617081 >> 172.21.15.91:0/4204617081 conn(0x7fecb806a500 msgr2=0x7fecb80c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:47.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.474+0000 7fecc0725640 1 -- 172.21.15.91:0/4204617081 shutdown_connections 2023-11-27T20:44:47.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.474+0000 7fecc0725640 1 -- 172.21.15.91:0/4204617081 wait complete. 2023-11-27T20:44:47.494 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-27T20:44:47.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.699+0000 7efc845c5640 1 Processor -- start 2023-11-27T20:44:47.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.699+0000 7efc845c5640 1 -- start start 2023-11-27T20:44:47.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.700+0000 7efc845c5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc7c06d0a0 0x7efc7c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.700+0000 7efc845c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c0c3ea0 0x7efc7c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.700+0000 7efc845c5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7c0c64a0 con 0x7efc7c14fd30 2023-11-27T20:44:47.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.700+0000 7efc845c5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c0c5c00 con 0x7efc7c06d0a0 2023-11-27T20:44:47.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.700+0000 7efc845c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0c5ee0 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.701+0000 7efc81b60640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc7c06d0a0 0x7efc7c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.701+0000 7efc82b62640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c0c3ea0 0x7efc7c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.701+0000 7efc82b62640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c0c3ea0 0x7efc7c0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:50098/0 (socket says 172.21.15.91:50098) 2023-11-27T20:44:47.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.701+0000 7efc82b62640 1 -- 172.21.15.91:0/1550392709 learned_addr learned my addr 172.21.15.91:0/1550392709 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:47.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.701+0000 7efc82361640 1 --1- 172.21.15.91:0/1550392709 >> v1:172.21.15.183:6789/0 conn(0x7efc7c14fd30 0x7efc7c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:45572/0 (socket says 172.21.15.91:45572) 2023-11-27T20:44:47.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.702+0000 7efc81b60640 1 -- 172.21.15.91:0/1550392709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c0c3ea0 msgr2=0x7efc7c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:47.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.702+0000 7efc81b60640 1 --2- 172.21.15.91:0/1550392709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c0c3ea0 0x7efc7c0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.702+0000 7efc81b60640 1 -- 172.21.15.91:0/1550392709 >> v1:172.21.15.183:6789/0 conn(0x7efc7c14fd30 legacy=0x7efc7c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.702+0000 7efc81b60640 1 -- 172.21.15.91:0/1550392709 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0c61c0 con 0x7efc7c06d0a0 2023-11-27T20:44:47.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.703+0000 7efc81b60640 1 --2- 172.21.15.91:0/1550392709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc7c06d0a0 0x7efc7c152f20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efc700097a0 tx=0x7efc7002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=559a040f0e9a37bd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:47.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc8135f640 1 -- 172.21.15.91:0/1550392709 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70031830 con 0x7efc7c06d0a0 2023-11-27T20:44:47.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc8135f640 1 -- 172.21.15.91:0/1550392709 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc70031990 con 0x7efc7c06d0a0 2023-11-27T20:44:47.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc8135f640 1 -- 172.21.15.91:0/1550392709 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70031d20 con 0x7efc7c06d0a0 2023-11-27T20:44:47.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc845c5640 1 -- 172.21.15.91:0/1550392709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc7c06d0a0 msgr2=0x7efc7c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc845c5640 1 --2- 172.21.15.91:0/1550392709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc7c06d0a0 0x7efc7c152f20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efc700097a0 tx=0x7efc7002b8d0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc845c5640 1 -- 172.21.15.91:0/1550392709 shutdown_connections 2023-11-27T20:44:47.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc845c5640 1 --2- 172.21.15.91:0/1550392709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c0c3ea0 0x7efc7c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc845c5640 1 --2- 172.21.15.91:0/1550392709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc7c06d0a0 0x7efc7c152f20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc845c5640 1 -- 172.21.15.91:0/1550392709 >> 172.21.15.91:0/1550392709 conn(0x7efc7c06a500 msgr2=0x7efc7c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:47.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc845c5640 1 -- 172.21.15.91:0/1550392709 shutdown_connections 2023-11-27T20:44:47.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.704+0000 7efc845c5640 1 -- 172.21.15.91:0/1550392709 wait complete. 2023-11-27T20:44:47.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.706+0000 7efc845c5640 1 Processor -- start 2023-11-27T20:44:47.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.706+0000 7efc845c5640 1 -- start start 2023-11-27T20:44:47.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.707+0000 7efc845c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c06d0a0 0x7efc7c1ddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.707+0000 7efc845c5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc7c0c3ea0 0x7efc7c1dc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.707+0000 7efc845c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc7c14fd30 0x7efc7c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.707+0000 7efc845c5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c1dd750 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.707+0000 7efc845c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c1dcc70 con 0x7efc7c14fd30 2023-11-27T20:44:47.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.707+0000 7efc845c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0aaa20 con 0x7efc7c06d0a0 2023-11-27T20:44:47.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.707+0000 7efc81b60640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc7c0c3ea0 0x7efc7c1dc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.707+0000 7efc81b60640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc7c0c3ea0 0x7efc7c1dc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40736/0 (socket says 172.21.15.91:40736) 2023-11-27T20:44:47.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.707+0000 7efc81b60640 1 -- 172.21.15.91:0/604078064 learned_addr learned my addr 172.21.15.91:0/604078064 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:47.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.708+0000 7efc82b62640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc7c14fd30 0x7efc7c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.708+0000 7efc82361640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c06d0a0 0x7efc7c1ddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.708+0000 7efc81b60640 1 -- 172.21.15.91:0/604078064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c06d0a0 msgr2=0x7efc7c1ddbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.708+0000 7efc81b60640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c06d0a0 0x7efc7c1ddbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.708+0000 7efc81b60640 1 -- 172.21.15.91:0/604078064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc7c14fd30 msgr2=0x7efc7c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.708+0000 7efc81b60640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc7c14fd30 0x7efc7c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.708+0000 7efc81b60640 1 -- 172.21.15.91:0/604078064 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc70009400 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.708+0000 7efc81b60640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc7c0c3ea0 0x7efc7c1dc730 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7efc7002bee0 tx=0x7efc700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:47.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.708+0000 7efc6effd640 1 -- 172.21.15.91:0/604078064 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7003a8f0 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.708+0000 7efc6effd640 1 -- 172.21.15.91:0/604078064 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7003aa70 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.709+0000 7efc845c5640 1 -- 172.21.15.91:0/604078064 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c1de730 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.709+0000 7efc6effd640 1 -- 172.21.15.91:0/604078064 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7003ae20 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.709+0000 7efc845c5640 1 -- 172.21.15.91:0/604078064 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c152080 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.710+0000 7efc845c5640 1 -- 172.21.15.91:0/604078064 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c1dd900 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.711+0000 7efc6effd640 1 -- 172.21.15.91:0/604078064 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efc7004d440 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.712+0000 7efc6effd640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc6006b1f0 0x7efc6006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:47.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.712+0000 7efc6effd640 1 -- 172.21.15.91:0/604078064 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5857+0+0 (secure 0 0 0) 0x7efc700abb30 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.712+0000 7efc82361640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc6006b1f0 0x7efc6006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:47.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.713+0000 7efc82361640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc6006b1f0 0x7efc6006d6b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efc78007fd0 tx=0x7efc78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:47.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.716+0000 7efc6effd640 1 -- 172.21.15.91:0/604078064 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efc7c1dd900 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.942+0000 7efc845c5640 1 -- 172.21.15.91:0/604078064 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7efc7c1dd900 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.944 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-11-27T20:44:47.943+0000 7fb57696d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-27T20:44:47.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.947+0000 7efc6effd640 1 -- 172.21.15.91:0/604078064 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 163+0+0 (secure 0 0 0) 0x7efc7c1dd900 con 0x7efc7c0c3ea0 2023-11-27T20:44:47.948 INFO:teuthology.orchestra.run.smithi091.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T20:44:47.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.949+0000 7efc845c5640 1 -- 172.21.15.91:0/604078064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc6006b1f0 msgr2=0x7efc6006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.949+0000 7efc845c5640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc6006b1f0 0x7efc6006d6b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efc78007fd0 tx=0x7efc78009040 comp rx=0 tx=0).stop 2023-11-27T20:44:47.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.949+0000 7efc845c5640 1 -- 172.21.15.91:0/604078064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc7c0c3ea0 msgr2=0x7efc7c1dc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:47.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.949+0000 7efc845c5640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc7c0c3ea0 0x7efc7c1dc730 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7efc7002bee0 tx=0x7efc700046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.950+0000 7efc845c5640 1 -- 172.21.15.91:0/604078064 shutdown_connections 2023-11-27T20:44:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.950+0000 7efc845c5640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efc6006b1f0 0x7efc6006d6b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.950+0000 7efc845c5640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc7c14fd30 0x7efc7c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.950+0000 7efc845c5640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc7c0c3ea0 0x7efc7c1dc730 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.950+0000 7efc845c5640 1 --2- 172.21.15.91:0/604078064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc7c06d0a0 0x7efc7c1ddbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.950+0000 7efc845c5640 1 -- 172.21.15.91:0/604078064 >> 172.21.15.91:0/604078064 conn(0x7efc7c06a500 msgr2=0x7efc7c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.950+0000 7efc845c5640 1 -- 172.21.15.91:0/604078064 shutdown_connections 2023-11-27T20:44:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:47.950+0000 7efc845c5640 1 -- 172.21.15.91:0/604078064 wait complete. 2023-11-27T20:44:47.962 INFO:tasks.ceph.mds.a.smithi091.stderr: -2304> 2023-11-27T20:44:11.644+0000 7fa03b48e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:44:47.973 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-27T20:44:48.024 INFO:tasks.ceph.mds.a.smithi091.stdout:starting mds.a at 2023-11-27T20:44:48.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.162+0000 7f5e4a5e5640 1 Processor -- start 2023-11-27T20:44:48.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.162+0000 7f5e4a5e5640 1 -- start start 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e4a5e5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5e44155490 0x7f5e440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e4a5e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5e440c1500 0x7f5e440a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e4a5e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e440c4080 0x7f5e440a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e4a5e5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e440a5820 con 0x7f5e44155490 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e4a5e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e440c06c0 con 0x7f5e440c1500 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e4a5e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440c1020 con 0x7f5e440c4080 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e43fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5e44155490 0x7f5e440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e43fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5e44155490 0x7f5e440a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40780/0 (socket says 172.21.15.91:40780) 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e43fff640 1 -- 172.21.15.91:0/1384583512 learned_addr learned my addr 172.21.15.91:0/1384583512 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e43fff640 1 -- 172.21.15.91:0/1384583512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e440c4080 msgr2=0x7f5e440a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e43fff640 1 --2- 172.21.15.91:0/1384583512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e440c4080 0x7f5e440a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e43fff640 1 -- 172.21.15.91:0/1384583512 >> v2:172.21.15.183:3300/0 conn(0x7f5e440c1500 msgr2=0x7f5e440a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:48.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e3bfff640 1 --2- 172.21.15.91:0/1384583512 >> v2:172.21.15.183:3300/0 conn(0x7f5e440c1500 0x7f5e440a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:48.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e43fff640 1 --2- 172.21.15.91:0/1384583512 >> v2:172.21.15.183:3300/0 conn(0x7f5e440c1500 0x7f5e440a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e43fff640 1 -- 172.21.15.91:0/1384583512 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440c0910 con 0x7f5e44155490 2023-11-27T20:44:48.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.164+0000 7f5e3bfff640 1 --2- 172.21.15.91:0/1384583512 >> v2:172.21.15.183:3300/0 conn(0x7f5e440c1500 0x7f5e440a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:48.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.165+0000 7f5e43fff640 1 --2- 172.21.15.91:0/1384583512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e44155490 0x7f5e440a51b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5e440a5160 tx=0x7f5e3402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fd4ea99c7bdbd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:48.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.166+0000 7f5e437fe640 1 -- 172.21.15.91:0/1384583512 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340317e0 con 0x7f5e44155490 2023-11-27T20:44:48.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.166+0000 7f5e437fe640 1 -- 172.21.15.91:0/1384583512 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e34031940 con 0x7f5e44155490 2023-11-27T20:44:48.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.166+0000 7f5e437fe640 1 -- 172.21.15.91:0/1384583512 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34031cd0 con 0x7f5e44155490 2023-11-27T20:44:48.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.166+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/1384583512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e44155490 msgr2=0x7f5e440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:48.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.166+0000 7f5e4a5e5640 1 --2- 172.21.15.91:0/1384583512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e44155490 0x7f5e440a51b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5e440a5160 tx=0x7f5e3402b880 comp rx=0 tx=0).stop 2023-11-27T20:44:48.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.166+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/1384583512 shutdown_connections 2023-11-27T20:44:48.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.166+0000 7f5e4a5e5640 1 --2- 172.21.15.91:0/1384583512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e440c4080 0x7f5e440a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.166+0000 7f5e4a5e5640 1 --2- 172.21.15.91:0/1384583512 >> v2:172.21.15.183:3300/0 conn(0x7f5e440c1500 0x7f5e440a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.167+0000 7f5e4a5e5640 1 --2- 172.21.15.91:0/1384583512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e44155490 0x7f5e440a51b0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.167+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/1384583512 >> 172.21.15.91:0/1384583512 conn(0x7f5e4406a500 msgr2=0x7f5e4406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:48.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.167+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/1384583512 shutdown_connections 2023-11-27T20:44:48.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.167+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/1384583512 wait complete. 2023-11-27T20:44:48.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.168+0000 7f5e4a5e5640 1 Processor -- start 2023-11-27T20:44:48.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.169+0000 7f5e4a5e5640 1 -- start start 2023-11-27T20:44:48.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e4a5e5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c1500 0x7f5e44151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:48.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e4a5e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e440c4080 0x7f5e44070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:48.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e4a5e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e44155490 0x7f5e44145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:48.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e4a5e5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e441edb30 con 0x7f5e440c1500 2023-11-27T20:44:48.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e4a5e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e441ede10 con 0x7f5e440c4080 2023-11-27T20:44:48.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e4a5e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e441ee0f0 con 0x7f5e44155490 2023-11-27T20:44:48.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e43fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c1500 0x7f5e44151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:48.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e43fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c1500 0x7f5e44151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40788/0 (socket says 172.21.15.91:40788) 2023-11-27T20:44:48.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e43fff640 1 -- 172.21.15.91:0/3057747611 learned_addr learned my addr 172.21.15.91:0/3057747611 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e43fff640 1 -- 172.21.15.91:0/3057747611 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e44155490 msgr2=0x7f5e44145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e43fff640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e44155490 0x7f5e44145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e43fff640 1 -- 172.21.15.91:0/3057747611 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e440c4080 msgr2=0x7f5e44070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.170+0000 7f5e43fff640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e440c4080 0x7f5e44070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.171+0000 7f5e43fff640 1 -- 172.21.15.91:0/3057747611 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e340094d0 con 0x7f5e440c1500 2023-11-27T20:44:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.171+0000 7f5e43fff640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c1500 0x7f5e44151970 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5e3402b8c0 tx=0x7f5e340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.171+0000 7f5e417fa640 1 -- 172.21.15.91:0/3057747611 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340329c0 con 0x7f5e440c1500 2023-11-27T20:44:48.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.171+0000 7f5e417fa640 1 -- 172.21.15.91:0/3057747611 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e34032b40 con 0x7f5e440c1500 2023-11-27T20:44:48.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.171+0000 7f5e417fa640 1 -- 172.21.15.91:0/3057747611 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340453f0 con 0x7f5e440c1500 2023-11-27T20:44:48.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.171+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/3057747611 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e441ee3d0 con 0x7f5e440c1500 2023-11-27T20:44:48.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.171+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/3057747611 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e44151eb0 con 0x7f5e440c1500 2023-11-27T20:44:48.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.172+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/3057747611 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e441ee8f0 con 0x7f5e440c1500 2023-11-27T20:44:48.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.173+0000 7f5e417fa640 1 -- 172.21.15.91:0/3057747611 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5e3404d3f0 con 0x7f5e440c1500 2023-11-27T20:44:48.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.174+0000 7f5e417fa640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e2406b1c0 0x7f5e2406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:48.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.175+0000 7f5e417fa640 1 -- 172.21.15.91:0/3057747611 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5943+0+0 (secure 0 0 0) 0x7f5e340ab9a0 con 0x7f5e440c1500 2023-11-27T20:44:48.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.175+0000 7f5e3bfff640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e2406b1c0 0x7f5e2406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:48.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.175+0000 7f5e3bfff640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e2406b1c0 0x7f5e2406d680 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5e4406aa10 tx=0x7f5e2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:48.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.179+0000 7f5e417fa640 1 -- 172.21.15.91:0/3057747611 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5e34076720 con 0x7f5e440c1500 2023-11-27T20:44:48.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.397+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/3057747611 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5e44068350 con 0x7f5e440c1500 2023-11-27T20:44:48.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.950+0000 7f5e417fa640 1 -- 172.21.15.91:0/3057747611 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5e34079d40 con 0x7f5e440c1500 2023-11-27T20:44:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.954+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/3057747611 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e2406b1c0 msgr2=0x7f5e2406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.954+0000 7f5e4a5e5640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e2406b1c0 0x7f5e2406d680 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5e4406aa10 tx=0x7f5e2c008040 comp rx=0 tx=0).stop 2023-11-27T20:44:48.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.954+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/3057747611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c1500 msgr2=0x7f5e44151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:48.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.954+0000 7f5e4a5e5640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c1500 0x7f5e44151970 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5e3402b8c0 tx=0x7f5e340046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.955+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/3057747611 shutdown_connections 2023-11-27T20:44:48.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.955+0000 7f5e4a5e5640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e44155490 0x7f5e44145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.955+0000 7f5e4a5e5640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5e2406b1c0 0x7f5e2406d680 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.955+0000 7f5e4a5e5640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e440c4080 0x7f5e44070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.955+0000 7f5e4a5e5640 1 --2- 172.21.15.91:0/3057747611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c1500 0x7f5e44151970 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.955+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/3057747611 >> 172.21.15.91:0/3057747611 conn(0x7f5e4406a500 msgr2=0x7f5e44152620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.955+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/3057747611 shutdown_connections 2023-11-27T20:44:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:48.955+0000 7f5e4a5e5640 1 -- 172.21.15.91:0/3057747611 wait complete. 2023-11-27T20:44:48.978 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-27T20:44:49.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.179+0000 7f4425802640 1 Processor -- start 2023-11-27T20:44:49.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.179+0000 7f4425802640 1 -- start start 2023-11-27T20:44:49.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.181+0000 7f4425802640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f44200a52d0 0x7f44200c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:49.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.181+0000 7f4425802640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44200a8de0 con 0x7f44200c4d40 2023-11-27T20:44:49.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.181+0000 7f4425802640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44200a9030 con 0x7f44200c31e0 2023-11-27T20:44:49.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.181+0000 7f4425802640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44200a9310 con 0x7f44200a52d0 2023-11-27T20:44:49.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.181+0000 7f441e7fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f44200c4d40 0x7f442006c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:36064/0 (socket says 172.21.15.91:36064) 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.181+0000 7f441e7fc640 1 -- 172.21.15.91:0/2127711914 learned_addr learned my addr 172.21.15.91:0/2127711914 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.181+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595269649 0 0) 0x7f44200a8de0 con 0x7f44200c4d40 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.181+0000 7f441effd640 1 --2- 172.21.15.91:0/2127711914 >> v2:172.21.15.183:3300/0 conn(0x7f44200a52d0 0x7f44200c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f440c003520 con 0x7f44200c4d40 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2521430097 0 0) 0x7f440c003520 con 0x7f44200c4d40 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 >> v2:172.21.15.183:3300/0 conn(0x7f44200a52d0 msgr2=0x7f44200c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 --2- 172.21.15.91:0/2127711914 >> v2:172.21.15.183:3300/0 conn(0x7f44200a52d0 0x7f44200c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 >> v1:172.21.15.183:6789/0 conn(0x7f44200c31e0 legacy=0x7f442006cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44200a95f0 con 0x7f44200c4d40 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f44080019f0 con 0x7f44200c4d40 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 >> v1:172.21.15.91:6789/0 conn(0x7f44200c4d40 legacy=0x7f442006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 --2- 172.21.15.91:0/2127711914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f440c003970 0x7f440c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 --2- 172.21.15.91:0/2127711914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f440c0047c0 0x7f440c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 --2- 172.21.15.91:0/2127711914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f440c0052a0 0x7f440c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44200a9310 con 0x7f440c003970 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c00c1f0 con 0x7f440c0047c0 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440c00c3b0 con 0x7f440c0052a0 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.182+0000 7f441effd640 1 --2- 172.21.15.91:0/2127711914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f440c003970 0x7f440c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.183+0000 7f441e7fc640 1 --2- 172.21.15.91:0/2127711914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f440c0047c0 0x7f440c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.183+0000 7f441effd640 1 -- 172.21.15.91:0/2127711914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f440c0052a0 msgr2=0x7f440c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.183+0000 7f441effd640 1 --2- 172.21.15.91:0/2127711914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f440c0052a0 0x7f440c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.183+0000 7f441effd640 1 -- 172.21.15.91:0/2127711914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f440c0047c0 msgr2=0x7f440c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.183+0000 7f441effd640 1 --2- 172.21.15.91:0/2127711914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f440c0047c0 0x7f440c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.183+0000 7f441effd640 1 -- 172.21.15.91:0/2127711914 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c003520 con 0x7f440c003970 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.183+0000 7f441f7fe640 1 -- 172.21.15.91:0/2127711914 reap_dead start 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.184+0000 7f441effd640 1 --2- 172.21.15.91:0/2127711914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f440c003970 0x7f440c003d70 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f441000ba00 tx=0x7f440c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aae374e5caa8bce server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.184+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410033680 con 0x7f440c003970 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.184+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44100337e0 con 0x7f440c003970 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.184+0000 7f441dffb640 1 -- 172.21.15.91:0/2127711914 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410033b70 con 0x7f440c003970 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.185+0000 7f4425802640 1 -- 172.21.15.91:0/2127711914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f440c003970 msgr2=0x7f440c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.185+0000 7f4425802640 1 --2- 172.21.15.91:0/2127711914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f440c003970 0x7f440c003d70 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f441000ba00 tx=0x7f440c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.185+0000 7f4425802640 1 -- 172.21.15.91:0/2127711914 shutdown_connections 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.185+0000 7f4425802640 1 --2- 172.21.15.91:0/2127711914 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f440c003970 0x7f440c003d70 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.185+0000 7f4425802640 1 -- 172.21.15.91:0/2127711914 >> 172.21.15.91:0/2127711914 conn(0x7f44200c5d30 msgr2=0x7f44200c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.185+0000 7f4425802640 1 -- 172.21.15.91:0/2127711914 shutdown_connections 2023-11-27T20:44:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.185+0000 7f4425802640 1 -- 172.21.15.91:0/2127711914 wait complete. 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.187+0000 7f4425802640 1 Processor -- start 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.187+0000 7f4425802640 1 -- start start 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f4425802640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f440c003970 0x7f4420147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f4425802640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44201476b0 0x7f44201ea350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f4425802640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44201ea890 0x7f4420145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f4425802640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44201ead20 con 0x7f44201ea890 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f4425802640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4420140060 con 0x7f44201476b0 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f4425802640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44201e9e70 con 0x7f440c003970 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f441f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44201ea890 0x7f4420145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f441f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44201ea890 0x7f4420145070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40804/0 (socket says 172.21.15.91:40804) 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f441f7fe640 1 -- 172.21.15.91:0/1680510959 learned_addr learned my addr 172.21.15.91:0/1680510959 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f441effd640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f440c003970 0x7f4420147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:49.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f441f7fe640 1 -- 172.21.15.91:0/1680510959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f440c003970 msgr2=0x7f4420147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f441f7fe640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f440c003970 0x7f4420147170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f441f7fe640 1 -- 172.21.15.91:0/1680510959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44201476b0 msgr2=0x7f44201ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f441e7fc640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44201476b0 0x7f44201ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f441f7fe640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44201476b0 0x7f44201ea350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.188+0000 7f441f7fe640 1 -- 172.21.15.91:0/1680510959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420142a80 con 0x7f44201ea890 2023-11-27T20:44:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.189+0000 7f441f7fe640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44201ea890 0x7f4420145070 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f44200c10a0 tx=0x7f441800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.189+0000 7f4417fff640 1 -- 172.21.15.91:0/1680510959 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44180074e0 con 0x7f44201ea890 2023-11-27T20:44:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.189+0000 7f4417fff640 1 -- 172.21.15.91:0/1680510959 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44180044a0 con 0x7f44201ea890 2023-11-27T20:44:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.189+0000 7f4417fff640 1 -- 172.21.15.91:0/1680510959 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418005a00 con 0x7f44201ea890 2023-11-27T20:44:49.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.189+0000 7f4425802640 1 -- 172.21.15.91:0/1680510959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44201427a0 con 0x7f44201ea890 2023-11-27T20:44:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.189+0000 7f4425802640 1 -- 172.21.15.91:0/1680510959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4420144d90 con 0x7f44201ea890 2023-11-27T20:44:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.190+0000 7f4425802640 1 -- 172.21.15.91:0/1680510959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44201ea030 con 0x7f44201ea890 2023-11-27T20:44:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.191+0000 7f4417fff640 1 -- 172.21.15.91:0/1680510959 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4418005b60 con 0x7f44201ea890 2023-11-27T20:44:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.192+0000 7f4417fff640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f440006b1c0 0x7f440006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.192+0000 7f4417fff640 1 -- 172.21.15.91:0/1680510959 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5943+0+0 (secure 0 0 0) 0x7f4418088c90 con 0x7f44201ea890 2023-11-27T20:44:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.193+0000 7f441effd640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f440006b1c0 0x7f440006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.193+0000 7f441effd640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f440006b1c0 0x7f440006d680 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f440c0057a0 tx=0x7f4410030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.197+0000 7f4417fff640 1 -- 172.21.15.91:0/1680510959 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f44180538c0 con 0x7f44201ea890 2023-11-27T20:44:49.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.386+0000 7f4425802640 1 -- 172.21.15.91:0/1680510959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4420068350 con 0x7f44201ea890 2023-11-27T20:44:49.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.960+0000 7f4417fff640 1 -- 172.21.15.91:0/1680510959 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v66) v1 ==== 184+0+0 (secure 0 0 0) 0x7f44180170e0 con 0x7f44201ea890 2023-11-27T20:44:49.962 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_metadata' removed 2023-11-27T20:44:49.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.965+0000 7f4425802640 1 -- 172.21.15.91:0/1680510959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f440006b1c0 msgr2=0x7f440006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:49.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.965+0000 7f4425802640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f440006b1c0 0x7f440006d680 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f440c0057a0 tx=0x7f4410030000 comp rx=0 tx=0).stop 2023-11-27T20:44:49.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.965+0000 7f4425802640 1 -- 172.21.15.91:0/1680510959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44201ea890 msgr2=0x7f4420145070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:49.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.965+0000 7f4425802640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44201ea890 0x7f4420145070 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f44200c10a0 tx=0x7f441800c820 comp rx=0 tx=0).stop 2023-11-27T20:44:49.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.966+0000 7f4425802640 1 -- 172.21.15.91:0/1680510959 shutdown_connections 2023-11-27T20:44:49.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.966+0000 7f4425802640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44201ea890 0x7f4420145070 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.966+0000 7f4425802640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f440006b1c0 0x7f440006d680 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.966+0000 7f4425802640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44201476b0 0x7f44201ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.966+0000 7f4425802640 1 --2- 172.21.15.91:0/1680510959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f440c003970 0x7f4420147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:49.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.966+0000 7f4425802640 1 -- 172.21.15.91:0/1680510959 >> 172.21.15.91:0/1680510959 conn(0x7f44200c5d30 msgr2=0x7f44200bf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:49.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.966+0000 7f4425802640 1 -- 172.21.15.91:0/1680510959 shutdown_connections 2023-11-27T20:44:49.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:49.966+0000 7f4425802640 1 -- 172.21.15.91:0/1680510959 wait complete. 2023-11-27T20:44:49.993 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-27T20:44:50.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.193+0000 7feab359e640 1 Processor -- start 2023-11-27T20:44:50.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.194+0000 7feab359e640 1 -- start start 2023-11-27T20:44:50.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.195+0000 7feab359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feab4072630 0x7feab406cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:50.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.195+0000 7feab359e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feab40bef80 0x7feab4154e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:50.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.195+0000 7feab359e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feab40c4530 0x7feab40a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:50.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.195+0000 7feab359e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab40c40a0 con 0x7feab40c4530 2023-11-27T20:44:50.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.195+0000 7feab359e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab41553a0 con 0x7feab40bef80 2023-11-27T20:44:50.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.195+0000 7feab359e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab40bf500 con 0x7feab4072630 2023-11-27T20:44:50.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab2d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feab40c4530 0x7feab40a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:50.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab2d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feab40c4530 0x7feab40a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40814/0 (socket says 172.21.15.91:40814) 2023-11-27T20:44:50.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab2d9d640 1 -- 172.21.15.91:0/158019987 learned_addr learned my addr 172.21.15.91:0/158019987 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:50.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab259c640 1 --2- 172.21.15.91:0/158019987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feab4072630 0x7feab406cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:50.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab2d9d640 1 -- 172.21.15.91:0/158019987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feab4072630 msgr2=0x7feab406cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:50.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab2d9d640 1 --2- 172.21.15.91:0/158019987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feab4072630 0x7feab406cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:50.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab1d9b640 1 --2- 172.21.15.91:0/158019987 >> v2:172.21.15.183:3300/0 conn(0x7feab40bef80 0x7feab4154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:50.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab2d9d640 1 -- 172.21.15.91:0/158019987 >> v2:172.21.15.183:3300/0 conn(0x7feab40bef80 msgr2=0x7feab4154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:50.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab2d9d640 1 --2- 172.21.15.91:0/158019987 >> v2:172.21.15.183:3300/0 conn(0x7feab40bef80 0x7feab4154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:50.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab2d9d640 1 -- 172.21.15.91:0/158019987 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab40bf7e0 con 0x7feab40c4530 2023-11-27T20:44:50.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.196+0000 7feab1d9b640 1 --2- 172.21.15.91:0/158019987 >> v2:172.21.15.183:3300/0 conn(0x7feab40bef80 0x7feab4154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:50.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.197+0000 7feab2d9d640 1 --2- 172.21.15.91:0/158019987 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 0x7feab40a4d20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7feab40a88c0 tx=0x7feaac02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44221743a3c3907f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:50.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.198+0000 7feab159a640 1 -- 172.21.15.91:0/158019987 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac0317d0 con 0x7feab40c4530 2023-11-27T20:44:50.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.198+0000 7feab159a640 1 -- 172.21.15.91:0/158019987 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac031930 con 0x7feab40c4530 2023-11-27T20:44:50.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.198+0000 7feab159a640 1 -- 172.21.15.91:0/158019987 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac031cc0 con 0x7feab40c4530 2023-11-27T20:44:50.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.198+0000 7feab359e640 1 -- 172.21.15.91:0/158019987 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 msgr2=0x7feab40a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:50.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.198+0000 7feab359e640 1 --2- 172.21.15.91:0/158019987 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 0x7feab40a4d20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7feab40a88c0 tx=0x7feaac02b870 comp rx=0 tx=0).stop 2023-11-27T20:44:50.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.199+0000 7feab359e640 1 -- 172.21.15.91:0/158019987 shutdown_connections 2023-11-27T20:44:50.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.199+0000 7feab359e640 1 --2- 172.21.15.91:0/158019987 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 0x7feab40a4d20 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:50.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.199+0000 7feab359e640 1 --2- 172.21.15.91:0/158019987 >> v2:172.21.15.183:3300/0 conn(0x7feab40bef80 0x7feab4154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:50.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.199+0000 7feab359e640 1 --2- 172.21.15.91:0/158019987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feab4072630 0x7feab406cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:50.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.199+0000 7feab359e640 1 -- 172.21.15.91:0/158019987 >> 172.21.15.91:0/158019987 conn(0x7feab40c2650 msgr2=0x7feab40c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:50.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.199+0000 7feab359e640 1 -- 172.21.15.91:0/158019987 shutdown_connections 2023-11-27T20:44:50.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.199+0000 7feab359e640 1 -- 172.21.15.91:0/158019987 wait complete. 2023-11-27T20:44:50.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.200+0000 7feab359e640 1 Processor -- start 2023-11-27T20:44:50.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.200+0000 7feab359e640 1 -- start start 2023-11-27T20:44:50.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.201+0000 7feab359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feab4072630 0x7feab40a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:50.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.201+0000 7feab359e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feab40bef80 0x7feab40ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:50.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.201+0000 7feab359e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 0x7feab4149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:50.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.201+0000 7feab359e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab40aa400 con 0x7feab40c4530 2023-11-27T20:44:50.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.201+0000 7feab359e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab40aa6e0 con 0x7feab40bef80 2023-11-27T20:44:50.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.201+0000 7feab359e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab40aa9c0 con 0x7feab4072630 2023-11-27T20:44:50.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab2d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 0x7feab4149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:50.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab2d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 0x7feab4149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40818/0 (socket says 172.21.15.91:40818) 2023-11-27T20:44:50.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab2d9d640 1 -- 172.21.15.91:0/3606010136 learned_addr learned my addr 172.21.15.91:0/3606010136 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:50.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab1d9b640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feab40bef80 0x7feab40ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab259c640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feab4072630 0x7feab40a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab2d9d640 1 -- 172.21.15.91:0/3606010136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feab4072630 msgr2=0x7feab40a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab2d9d640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feab4072630 0x7feab40a89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab2d9d640 1 -- 172.21.15.91:0/3606010136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feab40bef80 msgr2=0x7feab40ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab2d9d640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feab40bef80 0x7feab40ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab2d9d640 1 -- 172.21.15.91:0/3606010136 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0094d0 con 0x7feab40c4530 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab1d9b640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feab40bef80 0x7feab40ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.202+0000 7feab2d9d640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 0x7feab4149ee0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7feaac0090b0 tx=0x7feaac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.203+0000 7feaaaffd640 1 -- 172.21.15.91:0/3606010136 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac032870 con 0x7feab40c4530 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.203+0000 7feaaaffd640 1 -- 172.21.15.91:0/3606010136 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac0329d0 con 0x7feab40c4530 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.203+0000 7feab359e640 1 -- 172.21.15.91:0/3606010136 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab40aaca0 con 0x7feab40c4530 2023-11-27T20:44:50.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.203+0000 7feaaaffd640 1 -- 172.21.15.91:0/3606010136 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac032d80 con 0x7feab40c4530 2023-11-27T20:44:50.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.203+0000 7feab359e640 1 -- 172.21.15.91:0/3606010136 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab4157f90 con 0x7feab40c4530 2023-11-27T20:44:50.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.204+0000 7feab359e640 1 -- 172.21.15.91:0/3606010136 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab40aaeb0 con 0x7feab40c4530 2023-11-27T20:44:50.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.205+0000 7feaaaffd640 1 -- 172.21.15.91:0/3606010136 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7feaac030070 con 0x7feab40c4530 2023-11-27T20:44:50.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.206+0000 7feaaaffd640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea9406b1c0 0x7fea9406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:50.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.206+0000 7feaaaffd640 1 -- 172.21.15.91:0/3606010136 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5503+0+0 (secure 0 0 0) 0x7feaac0ab470 con 0x7feab40c4530 2023-11-27T20:44:50.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.206+0000 7feab259c640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea9406b1c0 0x7fea9406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:50.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.207+0000 7feab259c640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea9406b1c0 0x7fea9406d680 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009f30 tx=0x7feaa400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:50.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.210+0000 7feaaaffd640 1 -- 172.21.15.91:0/3606010136 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7feaac0763b0 con 0x7feab40c4530 2023-11-27T20:44:50.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:50.400+0000 7feab359e640 1 -- 172.21.15.91:0/3606010136 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feab40aa540 con 0x7feab40c4530 2023-11-27T20:44:51.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.229+0000 7feaaaffd640 1 -- 172.21.15.91:0/3606010136 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v67) v1 ==== 172+0+0 (secure 0 0 0) 0x7feab40aa540 con 0x7feab40c4530 2023-11-27T20:44:51.231 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_data' removed 2023-11-27T20:44:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.234+0000 7feab359e640 1 -- 172.21.15.91:0/3606010136 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea9406b1c0 msgr2=0x7fea9406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.234+0000 7feab359e640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea9406b1c0 0x7fea9406d680 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009f30 tx=0x7feaa400b040 comp rx=0 tx=0).stop 2023-11-27T20:44:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.234+0000 7feab359e640 1 -- 172.21.15.91:0/3606010136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 msgr2=0x7feab4149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.234+0000 7feab359e640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 0x7feab4149ee0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7feaac0090b0 tx=0x7feaac0046c0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.235+0000 7feab359e640 1 -- 172.21.15.91:0/3606010136 shutdown_connections 2023-11-27T20:44:51.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.235+0000 7feab359e640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feab40c4530 0x7feab4149ee0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.235+0000 7feab359e640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea9406b1c0 0x7fea9406d680 secure :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009f30 tx=0x7feaa400b040 comp rx=0 tx=0).stop 2023-11-27T20:44:51.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.235+0000 7feab359e640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feab40bef80 0x7feab40ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.235+0000 7feab359e640 1 --2- 172.21.15.91:0/3606010136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feab4072630 0x7feab40a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.235+0000 7feab359e640 1 -- 172.21.15.91:0/3606010136 >> 172.21.15.91:0/3606010136 conn(0x7feab40c2650 msgr2=0x7feab40a64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:51.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.236+0000 7feab359e640 1 -- 172.21.15.91:0/3606010136 shutdown_connections 2023-11-27T20:44:51.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.236+0000 7feab359e640 1 -- 172.21.15.91:0/3606010136 wait complete. 2023-11-27T20:44:51.262 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-27T20:44:51.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.456+0000 7fdc88c6e640 1 Processor -- start 2023-11-27T20:44:51.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.456+0000 7fdc88c6e640 1 -- start start 2023-11-27T20:44:51.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.457+0000 7fdc88c6e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdc840c4f20 0x7fdc840c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:51.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.457+0000 7fdc88c6e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdc84152250 0x7fdc841526a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:51.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.457+0000 7fdc88c6e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc840c5380 con 0x7fdc8414f910 2023-11-27T20:44:51.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.457+0000 7fdc88c6e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8406c4f0 con 0x7fdc84152250 2023-11-27T20:44:51.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.457+0000 7fdc88c6e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8414fcf0 con 0x7fdc840c4f20 2023-11-27T20:44:51.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.458+0000 7fdc83fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdc84152250 0x7fdc841526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:51.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.458+0000 7fdc83fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdc84152250 0x7fdc841526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40830/0 (socket says 172.21.15.91:40830) 2023-11-27T20:44:51.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.458+0000 7fdc83fff640 1 -- 172.21.15.91:0/4274367248 learned_addr learned my addr 172.21.15.91:0/4274367248 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:51.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.458+0000 7fdc82ffd640 1 --2- 172.21.15.91:0/4274367248 >> v2:172.21.15.183:3300/0 conn(0x7fdc840c4f20 0x7fdc840c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:51.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.458+0000 7fdc83fff640 1 -- 172.21.15.91:0/4274367248 >> v2:172.21.15.183:3300/0 conn(0x7fdc840c4f20 msgr2=0x7fdc840c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:51.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.458+0000 7fdc83fff640 1 --2- 172.21.15.91:0/4274367248 >> v2:172.21.15.183:3300/0 conn(0x7fdc840c4f20 0x7fdc840c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.458+0000 7fdc83fff640 1 -- 172.21.15.91:0/4274367248 >> v1:172.21.15.183:6789/0 conn(0x7fdc8414f910 legacy=0x7fdc840a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:51.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.458+0000 7fdc83fff640 1 -- 172.21.15.91:0/4274367248 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840c49a0 con 0x7fdc84152250 2023-11-27T20:44:51.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.459+0000 7fdc83fff640 1 --2- 172.21.15.91:0/4274367248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc84152250 0x7fdc841526a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fdc840a8990 tx=0x7fdc7c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4617d9b478873b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:51.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.459+0000 7fdc827fc640 1 -- 172.21.15.91:0/4274367248 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c02c9f0 con 0x7fdc84152250 2023-11-27T20:44:51.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.460+0000 7fdc827fc640 1 -- 172.21.15.91:0/4274367248 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c02cb50 con 0x7fdc84152250 2023-11-27T20:44:51.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.460+0000 7fdc827fc640 1 -- 172.21.15.91:0/4274367248 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c0343f0 con 0x7fdc84152250 2023-11-27T20:44:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.460+0000 7fdc88c6e640 1 -- 172.21.15.91:0/4274367248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc84152250 msgr2=0x7fdc841526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.460+0000 7fdc88c6e640 1 --2- 172.21.15.91:0/4274367248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc84152250 0x7fdc841526a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fdc840a8990 tx=0x7fdc7c02be50 comp rx=0 tx=0).stop 2023-11-27T20:44:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.460+0000 7fdc88c6e640 1 -- 172.21.15.91:0/4274367248 shutdown_connections 2023-11-27T20:44:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.460+0000 7fdc88c6e640 1 --2- 172.21.15.91:0/4274367248 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc84152250 0x7fdc841526a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.460+0000 7fdc88c6e640 1 --2- 172.21.15.91:0/4274367248 >> v2:172.21.15.183:3300/0 conn(0x7fdc840c4f20 0x7fdc840c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.460+0000 7fdc88c6e640 1 -- 172.21.15.91:0/4274367248 >> 172.21.15.91:0/4274367248 conn(0x7fdc840c5b50 msgr2=0x7fdc840c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.460+0000 7fdc88c6e640 1 -- 172.21.15.91:0/4274367248 shutdown_connections 2023-11-27T20:44:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.460+0000 7fdc88c6e640 1 -- 172.21.15.91:0/4274367248 wait complete. 2023-11-27T20:44:51.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.462+0000 7fdc88c6e640 1 Processor -- start 2023-11-27T20:44:51.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.462+0000 7fdc88c6e640 1 -- start start 2023-11-27T20:44:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.463+0000 7fdc88c6e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc840c4f20 0x7fdc84153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.463+0000 7fdc88c6e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc8414f910 0x7fdc840c1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.463+0000 7fdc88c6e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc84152250 0x7fdc841edb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.463+0000 7fdc88c6e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc841ed700 con 0x7fdc840c4f20 2023-11-27T20:44:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.463+0000 7fdc88c6e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc841ed400 con 0x7fdc84152250 2023-11-27T20:44:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.463+0000 7fdc88c6e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840a9a00 con 0x7fdc8414f910 2023-11-27T20:44:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.463+0000 7fdc837fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc840c4f20 0x7fdc84153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.463+0000 7fdc837fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc840c4f20 0x7fdc84153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40836/0 (socket says 172.21.15.91:40836) 2023-11-27T20:44:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.463+0000 7fdc837fe640 1 -- 172.21.15.91:0/3253979623 learned_addr learned my addr 172.21.15.91:0/3253979623 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:51.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc83fff640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc84152250 0x7fdc841edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:51.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc82ffd640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc8414f910 0x7fdc840c1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc837fe640 1 -- 172.21.15.91:0/3253979623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc8414f910 msgr2=0x7fdc840c1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc837fe640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc8414f910 0x7fdc840c1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc837fe640 1 -- 172.21.15.91:0/3253979623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc84152250 msgr2=0x7fdc841edb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc837fe640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc84152250 0x7fdc841edb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc837fe640 1 -- 172.21.15.91:0/3253979623 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c009b30 con 0x7fdc840c4f20 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc83fff640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc84152250 0x7fdc841edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc82ffd640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc8414f910 0x7fdc840c1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc837fe640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc840c4f20 0x7fdc84153270 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400c440 tx=0x7fdc7400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.464+0000 7fdc6bfff640 1 -- 172.21.15.91:0/3253979623 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74005480 con 0x7fdc840c4f20 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.465+0000 7fdc6bfff640 1 -- 172.21.15.91:0/3253979623 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc740035f0 con 0x7fdc840c4f20 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.465+0000 7fdc6bfff640 1 -- 172.21.15.91:0/3253979623 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc740039c0 con 0x7fdc840c4f20 2023-11-27T20:44:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.465+0000 7fdc88c6e640 1 -- 172.21.15.91:0/3253979623 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc840c2190 con 0x7fdc840c4f20 2023-11-27T20:44:51.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.465+0000 7fdc88c6e640 1 -- 172.21.15.91:0/3253979623 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc840c1a60 con 0x7fdc840c4f20 2023-11-27T20:44:51.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.466+0000 7fdc88c6e640 1 -- 172.21.15.91:0/3253979623 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8404e840 con 0x7fdc840c4f20 2023-11-27T20:44:51.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.467+0000 7fdc6bfff640 1 -- 172.21.15.91:0/3253979623 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdc74003b20 con 0x7fdc840c4f20 2023-11-27T20:44:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.468+0000 7fdc6bfff640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc7006b1c0 0x7fdc7006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.468+0000 7fdc6bfff640 1 -- 172.21.15.91:0/3253979623 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdc74088a30 con 0x7fdc840c4f20 2023-11-27T20:44:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.468+0000 7fdc82ffd640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc7006b1c0 0x7fdc7006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:51.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.469+0000 7fdc82ffd640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc7006b1c0 0x7fdc7006d680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdc84149630 tx=0x7fdc78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:51.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.472+0000 7fdc6bfff640 1 -- 172.21.15.91:0/3253979623 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdc74053950 con 0x7fdc840c4f20 2023-11-27T20:44:51.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.662+0000 7fdc88c6e640 1 -- 172.21.15.91:0/3253979623 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdc841ed540 con 0x7fdc840c4f20 2023-11-27T20:44:51.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.668+0000 7fdc6bfff640 1 -- 172.21.15.91:0/3253979623 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdc841ed540 con 0x7fdc840c4f20 2023-11-27T20:44:51.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.670+0000 7fdc88c6e640 1 -- 172.21.15.91:0/3253979623 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc7006b1c0 msgr2=0x7fdc7006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:51.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.670+0000 7fdc88c6e640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc7006b1c0 0x7fdc7006d680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdc84149630 tx=0x7fdc78008040 comp rx=0 tx=0).stop 2023-11-27T20:44:51.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.670+0000 7fdc88c6e640 1 -- 172.21.15.91:0/3253979623 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc840c4f20 msgr2=0x7fdc84153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:51.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.670+0000 7fdc88c6e640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc840c4f20 0x7fdc84153270 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400c440 tx=0x7fdc7400c900 comp rx=0 tx=0).stop 2023-11-27T20:44:51.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.671+0000 7fdc88c6e640 1 -- 172.21.15.91:0/3253979623 shutdown_connections 2023-11-27T20:44:51.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.671+0000 7fdc88c6e640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc7006b1c0 0x7fdc7006d680 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.671+0000 7fdc88c6e640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc84152250 0x7fdc841edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.671+0000 7fdc88c6e640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc8414f910 0x7fdc840c1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.671+0000 7fdc88c6e640 1 --2- 172.21.15.91:0/3253979623 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc840c4f20 0x7fdc84153270 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:51.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.671+0000 7fdc88c6e640 1 -- 172.21.15.91:0/3253979623 >> 172.21.15.91:0/3253979623 conn(0x7fdc840c5b50 msgr2=0x7fdc840bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:51.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.671+0000 7fdc88c6e640 1 -- 172.21.15.91:0/3253979623 shutdown_connections 2023-11-27T20:44:51.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.671+0000 7fdc88c6e640 1 -- 172.21.15.91:0/3253979623 wait complete. 2023-11-27T20:44:51.690 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-11-27T20:44:51.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.899+0000 7fb1eda4f640 1 Processor -- start 2023-11-27T20:44:57.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.900+0000 7fb1eda4f640 1 -- start start 2023-11-27T20:44:57.532 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:57.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.901+0000 7fb1eda4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e8151cc0 0x7fb1e8155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.901+0000 7fb1eda4f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb1e80c4940 0x7fb1e80c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.901+0000 7fb1eda4f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e81556d0 con 0x7fb1e80c7ec0 2023-11-27T20:44:57.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.901+0000 7fb1eda4f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e8154740 con 0x7fb1e80c4940 2023-11-27T20:44:57.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.901+0000 7fb1eda4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e806c760 con 0x7fb1e8151cc0 2023-11-27T20:44:57.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.902+0000 7fb1e77fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb1e80c4940 0x7fb1e80c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:57.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.902+0000 7fb1e77fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb1e80c4940 0x7fb1e80c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40846/0 (socket says 172.21.15.91:40846) 2023-11-27T20:44:57.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.902+0000 7fb1e77fe640 1 -- 172.21.15.91:0/4188762323 learned_addr learned my addr 172.21.15.91:0/4188762323 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:57.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.902+0000 7fb1e6ffd640 1 --2- 172.21.15.91:0/4188762323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e8151cc0 0x7fb1e8155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:57.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.902+0000 7fb1e77fe640 1 -- 172.21.15.91:0/4188762323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e8151cc0 msgr2=0x7fb1e8155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:57.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.902+0000 7fb1e77fe640 1 --2- 172.21.15.91:0/4188762323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e8151cc0 0x7fb1e8155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.902+0000 7fb1e77fe640 1 -- 172.21.15.91:0/4188762323 >> v1:172.21.15.183:6789/0 conn(0x7fb1e80c7ec0 legacy=0x7fb1e8157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:57.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.902+0000 7fb1e77fe640 1 -- 172.21.15.91:0/4188762323 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80c8470 con 0x7fb1e80c4940 2023-11-27T20:44:57.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.903+0000 7fb1e77fe640 1 --2- 172.21.15.91:0/4188762323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 0x7fb1e80c4d50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009870 tx=0x7fb1e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f0a7dbdd772649 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:57.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.903+0000 7fb1e5ffb640 1 -- 172.21.15.91:0/4188762323 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0031640 con 0x7fb1e80c4940 2023-11-27T20:44:57.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.904+0000 7fb1e5ffb640 1 -- 172.21.15.91:0/4188762323 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e00317a0 con 0x7fb1e80c4940 2023-11-27T20:44:57.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.904+0000 7fb1e5ffb640 1 -- 172.21.15.91:0/4188762323 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0031b30 con 0x7fb1e80c4940 2023-11-27T20:44:57.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.904+0000 7fb1eda4f640 1 -- 172.21.15.91:0/4188762323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 msgr2=0x7fb1e80c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:57.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.904+0000 7fb1eda4f640 1 --2- 172.21.15.91:0/4188762323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 0x7fb1e80c4d50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009870 tx=0x7fb1e002b8f0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.904+0000 7fb1eda4f640 1 -- 172.21.15.91:0/4188762323 shutdown_connections 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.904+0000 7fb1eda4f640 1 --2- 172.21.15.91:0/4188762323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 0x7fb1e80c4d50 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.904+0000 7fb1eda4f640 1 --2- 172.21.15.91:0/4188762323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e8151cc0 0x7fb1e8155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.904+0000 7fb1eda4f640 1 -- 172.21.15.91:0/4188762323 >> 172.21.15.91:0/4188762323 conn(0x7fb1e8071e10 msgr2=0x7fb1e8072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.904+0000 7fb1eda4f640 1 -- 172.21.15.91:0/4188762323 shutdown_connections 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.904+0000 7fb1eda4f640 1 -- 172.21.15.91:0/4188762323 wait complete. 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.906+0000 7fb1eda4f640 1 Processor -- start 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.906+0000 7fb1eda4f640 1 -- start start 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.907+0000 7fb1eda4f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 0x7fb1e814ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1eda4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e80c7ec0 0x7fb1e81e7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1eda4f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1e8151cc0 0x7fb1e81ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1eda4f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80aeea0 con 0x7fb1e80c4940 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1eda4f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8149eb0 con 0x7fb1e8151cc0 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1eda4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e814a6c0 con 0x7fb1e80c7ec0 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1e6ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 0x7fb1e814ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1e6ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 0x7fb1e814ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:40854/0 (socket says 172.21.15.91:40854) 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1e6ffd640 1 -- 172.21.15.91:0/863320368 learned_addr learned my addr 172.21.15.91:0/863320368 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1e6ffd640 1 -- 172.21.15.91:0/863320368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e80c7ec0 msgr2=0x7fb1e81e7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1e6ffd640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e80c7ec0 0x7fb1e81e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1e6ffd640 1 -- 172.21.15.91:0/863320368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1e8151cc0 msgr2=0x7fb1e81ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1e6ffd640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1e8151cc0 0x7fb1e81ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.908+0000 7fb1e6ffd640 1 -- 172.21.15.91:0/863320368 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e00094d0 con 0x7fb1e80c4940 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.909+0000 7fb1e6ffd640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 0x7fb1e814ded0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800cd00 tx=0x7fb1d800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.909+0000 7fb1dffff640 1 -- 172.21.15.91:0/863320368 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8003990 con 0x7fb1e80c4940 2023-11-27T20:44:57.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.909+0000 7fb1dffff640 1 -- 172.21.15.91:0/863320368 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d8003af0 con 0x7fb1e80c4940 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.909+0000 7fb1dffff640 1 -- 172.21.15.91:0/863320368 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8003e80 con 0x7fb1e80c4940 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.909+0000 7fb1eda4f640 1 -- 172.21.15.91:0/863320368 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e81eaa70 con 0x7fb1e80c4940 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.909+0000 7fb1eda4f640 1 -- 172.21.15.91:0/863320368 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e814a3e0 con 0x7fb1e80c4940 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.910+0000 7fb1eda4f640 1 -- 172.21.15.91:0/863320368 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e8068350 con 0x7fb1e80c4940 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.911+0000 7fb1dffff640 1 -- 172.21.15.91:0/863320368 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb1d8004020 con 0x7fb1e80c4940 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.912+0000 7fb1dffff640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb1c806b1f0 0x7fb1c806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.913+0000 7fb1dffff640 1 -- 172.21.15.91:0/863320368 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb1d8089ad0 con 0x7fb1e80c4940 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.913+0000 7fb1e67fc640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb1c806b1f0 0x7fb1c806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.913+0000 7fb1e67fc640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb1c806b1f0 0x7fb1c806d6b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80c43e0 tx=0x7fb1d00079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:51.917+0000 7fb1dffff640 1 -- 172.21.15.91:0/863320368 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb1d8054b30 con 0x7fb1e80c4940 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.179+0000 7fb1eda4f640 1 -- 172.21.15.91:0/863320368 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fb1e814c300 con 0x7fb1e80c4940 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.232+0000 7fb1dffff640 1 -- 172.21.15.91:0/863320368 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v208) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb1d801d020 con 0x7fb1e80c4940 2023-11-27T20:44:57.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.234+0000 7fb1eda4f640 1 -- 172.21.15.91:0/863320368 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb1c806b1f0 msgr2=0x7fb1c806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:57.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.234+0000 7fb1eda4f640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb1c806b1f0 0x7fb1c806d6b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80c43e0 tx=0x7fb1d00079b0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.234+0000 7fb1eda4f640 1 -- 172.21.15.91:0/863320368 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 msgr2=0x7fb1e814ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:57.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.234+0000 7fb1eda4f640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 0x7fb1e814ded0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800cd00 tx=0x7fb1d800a5c0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.235+0000 7fb1eda4f640 1 -- 172.21.15.91:0/863320368 shutdown_connections 2023-11-27T20:44:57.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.235+0000 7fb1eda4f640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb1c806b1f0 0x7fb1c806d6b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.235+0000 7fb1eda4f640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1e8151cc0 0x7fb1e81ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.235+0000 7fb1eda4f640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e80c7ec0 0x7fb1e81e7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.235+0000 7fb1eda4f640 1 --2- 172.21.15.91:0/863320368 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1e80c4940 0x7fb1e814ded0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.235+0000 7fb1eda4f640 1 -- 172.21.15.91:0/863320368 >> 172.21.15.91:0/863320368 conn(0x7fb1e8071e10 msgr2=0x7fb1e814cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:57.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.235+0000 7fb1eda4f640 1 -- 172.21.15.91:0/863320368 shutdown_connections 2023-11-27T20:44:57.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:52.235+0000 7fb1eda4f640 1 -- 172.21.15.91:0/863320368 wait complete. 2023-11-27T20:44:57.589 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-11-27T20:44:57.589 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-27T20:44:57.590 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:44:57.598 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:57.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.793+0000 7f2221683640 1 Processor -- start 2023-11-27T20:44:57.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.793+0000 7f2221683640 1 -- start start 2023-11-27T20:44:57.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.795+0000 7f2221683640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f221c152f20 0x7f221c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.795+0000 7f2221683640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c0c64a0 con 0x7f221c14fd30 2023-11-27T20:44:57.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.795+0000 7f2221683640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c0c5c00 con 0x7f221c06d0a0 2023-11-27T20:44:57.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.795+0000 7f2221683640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c0c5ee0 con 0x7f221c152f20 2023-11-27T20:44:57.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.795+0000 7f221b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f221c152f20 0x7f221c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:57.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.795+0000 7f221b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f221c152f20 0x7f221c0c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47090/0 (socket says 172.21.15.91:47090) 2023-11-27T20:44:57.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.795+0000 7f221b7fe640 1 -- 172.21.15.91:0/1112292328 learned_addr learned my addr 172.21.15.91:0/1112292328 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:57.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.795+0000 7f221affd640 1 --1- 172.21.15.91:0/1112292328 >> v1:172.21.15.91:6789/0 conn(0x7f221c14fd30 0x7f221c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59162/0 (socket says 172.21.15.91:59162) 2023-11-27T20:44:57.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.795+0000 7f221b7fe640 1 -- 172.21.15.91:0/1112292328 >> v1:172.21.15.183:6789/0 conn(0x7f221c06d0a0 legacy=0x7f221c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:57.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.796+0000 7f2219ffb640 1 -- 172.21.15.91:0/1112292328 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795826884 0 0) 0x7f221c0c64a0 con 0x7f221c14fd30 2023-11-27T20:44:57.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.796+0000 7f221b7fe640 1 -- 172.21.15.91:0/1112292328 >> v1:172.21.15.91:6789/0 conn(0x7f221c14fd30 legacy=0x7f221c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:57.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.796+0000 7f221b7fe640 1 -- 172.21.15.91:0/1112292328 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0c61c0 con 0x7f221c152f20 2023-11-27T20:44:57.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.797+0000 7f221b7fe640 1 --2- 172.21.15.91:0/1112292328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c152f20 0x7f221c0c45b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2214009e50 tx=0x7f221402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63448d05c5fc4228 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:57.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.797+0000 7f2219ffb640 1 -- 172.21.15.91:0/1112292328 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221402cb20 con 0x7f221c152f20 2023-11-27T20:44:57.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.797+0000 7f2219ffb640 1 -- 172.21.15.91:0/1112292328 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221402cc80 con 0x7f221c152f20 2023-11-27T20:44:57.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.797+0000 7f2219ffb640 1 -- 172.21.15.91:0/1112292328 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140343f0 con 0x7f221c152f20 2023-11-27T20:44:57.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.798+0000 7f2221683640 1 -- 172.21.15.91:0/1112292328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c152f20 msgr2=0x7f221c0c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:57.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.798+0000 7f2221683640 1 --2- 172.21.15.91:0/1112292328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c152f20 0x7f221c0c45b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2214009e50 tx=0x7f221402bf80 comp rx=0 tx=0).stop 2023-11-27T20:44:57.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.798+0000 7f2221683640 1 -- 172.21.15.91:0/1112292328 shutdown_connections 2023-11-27T20:44:57.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.798+0000 7f2221683640 1 --2- 172.21.15.91:0/1112292328 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c152f20 0x7f221c0c45b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.798+0000 7f2221683640 1 -- 172.21.15.91:0/1112292328 >> 172.21.15.91:0/1112292328 conn(0x7f221c06a500 msgr2=0x7f221c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:57.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.798+0000 7f2221683640 1 -- 172.21.15.91:0/1112292328 shutdown_connections 2023-11-27T20:44:57.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.798+0000 7f2221683640 1 -- 172.21.15.91:0/1112292328 wait complete. 2023-11-27T20:44:57.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.799+0000 7f2221683640 1 Processor -- start 2023-11-27T20:44:57.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.799+0000 7f2221683640 1 -- start start 2023-11-27T20:44:57.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.800+0000 7f2221683640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f221c06d0a0 0x7f221c1ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.800+0000 7f2221683640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c14fd30 0x7f221c0a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.800+0000 7f2221683640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f221c152f20 0x7f221c1ea080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.800+0000 7f2221683640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1dea30 con 0x7f221c14fd30 2023-11-27T20:44:57.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.800+0000 7f2221683640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1edc20 con 0x7f221c06d0a0 2023-11-27T20:44:57.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.800+0000 7f2221683640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1ed5f0 con 0x7f221c152f20 2023-11-27T20:44:57.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.801+0000 7f221a7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c14fd30 0x7f221c0a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:57.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.801+0000 7f221a7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c14fd30 0x7f221c0a7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47098/0 (socket says 172.21.15.91:47098) 2023-11-27T20:44:57.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.801+0000 7f221a7fc640 1 -- 172.21.15.91:0/2781053756 learned_addr learned my addr 172.21.15.91:0/2781053756 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:57.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.801+0000 7f221affd640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f221c06d0a0 0x7f221c1ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:57.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.801+0000 7f221a7fc640 1 -- 172.21.15.91:0/2781053756 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f221c152f20 msgr2=0x7f221c1ea080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:57.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.801+0000 7f221a7fc640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f221c152f20 0x7f221c1ea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.801+0000 7f221a7fc640 1 -- 172.21.15.91:0/2781053756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f221c06d0a0 msgr2=0x7f221c1ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:57.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.801+0000 7f221a7fc640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f221c06d0a0 0x7f221c1ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:57.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.801+0000 7f221a7fc640 1 -- 172.21.15.91:0/2781053756 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2214009b30 con 0x7f221c14fd30 2023-11-27T20:44:57.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.801+0000 7f221a7fc640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c14fd30 0x7f221c0a7250 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f221000c380 tx=0x7f221000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:57.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.802+0000 7f22037fe640 1 -- 172.21.15.91:0/2781053756 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210011790 con 0x7f221c14fd30 2023-11-27T20:44:57.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.802+0000 7f22037fe640 1 -- 172.21.15.91:0/2781053756 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22100118f0 con 0x7f221c14fd30 2023-11-27T20:44:57.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.802+0000 7f22037fe640 1 -- 172.21.15.91:0/2781053756 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210011ca0 con 0x7f221c14fd30 2023-11-27T20:44:57.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.802+0000 7f2221683640 1 -- 172.21.15.91:0/2781053756 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c0aa910 con 0x7f221c14fd30 2023-11-27T20:44:57.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.802+0000 7f2221683640 1 -- 172.21.15.91:0/2781053756 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c1ed840 con 0x7f221c14fd30 2023-11-27T20:44:57.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.803+0000 7f2221683640 1 -- 172.21.15.91:0/2781053756 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c1edd60 con 0x7f221c14fd30 2023-11-27T20:44:57.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.804+0000 7f22037fe640 1 -- 172.21.15.91:0/2781053756 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f221001c460 con 0x7f221c14fd30 2023-11-27T20:44:57.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.805+0000 7f22037fe640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f220806b1c0 0x7f220806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:57.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.805+0000 7f22037fe640 1 -- 172.21.15.91:0/2781053756 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2210089680 con 0x7f221c14fd30 2023-11-27T20:44:57.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.805+0000 7f221affd640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f220806b1c0 0x7f220806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:57.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.806+0000 7f221affd640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f220806b1c0 0x7f220806d680 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f220c000f60 tx=0x7f220c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:57.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:57.810+0000 7f22037fe640 1 -- 172.21.15.91:0/2781053756 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f221c1edd60 con 0x7f221c14fd30 2023-11-27T20:44:58.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.002+0000 7f2221683640 1 -- 172.21.15.91:0/2781053756 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f221c1edd60 con 0x7f221c14fd30 2023-11-27T20:44:58.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.004+0000 7f22037fe640 1 -- 172.21.15.91:0/2781053756 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+13078 (secure 0 0 0) 0x7f221c1edd60 con 0x7f221c14fd30 2023-11-27T20:44:58.006 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:44:58.006 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":67,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:44:51.226149+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.91:6836/1107018884":"2023-11-28T20:44:47.944627+0000","172.21.15.91:6835/1107018884":"2023-11-28T20:44:47.944627+0000","172.21.15.91:6837/42700883":"2023-11-28T20:44:40.116207+0000","172.21.15.91:6834/42700883":"2023-11-28T20:44:40.116207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:44:58.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 -- 172.21.15.91:0/2781053756 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f220806b1c0 msgr2=0x7f220806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f220806b1c0 0x7f220806d680 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f220c000f60 tx=0x7f220c009040 comp rx=0 tx=0).stop 2023-11-27T20:44:58.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 -- 172.21.15.91:0/2781053756 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c14fd30 msgr2=0x7f221c0a7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c14fd30 0x7f221c0a7250 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f221000c380 tx=0x7f221000c840 comp rx=0 tx=0).stop 2023-11-27T20:44:58.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 -- 172.21.15.91:0/2781053756 shutdown_connections 2023-11-27T20:44:58.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f221c152f20 0x7f221c1ea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f221c14fd30 0x7f221c0a7250 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f220806b1c0 0x7f220806d680 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 --2- 172.21.15.91:0/2781053756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f221c06d0a0 0x7f221c1ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 -- 172.21.15.91:0/2781053756 >> 172.21.15.91:0/2781053756 conn(0x7f221c06a500 msgr2=0x7f221c1deb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:58.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 -- 172.21.15.91:0/2781053756 shutdown_connections 2023-11-27T20:44:58.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.007+0000 7f2221683640 1 -- 172.21.15.91:0/2781053756 wait complete. 2023-11-27T20:44:58.027 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:44:58.027 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:44:58.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.243+0000 7fb0324a2640 1 Processor -- start 2023-11-27T20:44:58.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.243+0000 7fb0324a2640 1 -- start start 2023-11-27T20:44:58.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.245+0000 7fb0324a2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb02c0c1ca0 0x7fb02c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.245+0000 7fb0324a2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c071e30 0x7fb02c0c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.245+0000 7fb0324a2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c06d580 con 0x7fb02c155fc0 2023-11-27T20:44:58.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.245+0000 7fb0324a2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c06dd60 con 0x7fb02c0c1ca0 2023-11-27T20:44:58.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.245+0000 7fb0324a2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0c6580 con 0x7fb02c071e30 2023-11-27T20:44:58.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.245+0000 7fb02bfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb02c155fc0 0x7fb02c159470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59174/0 (socket says 172.21.15.91:59174) 2023-11-27T20:44:58.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.245+0000 7fb02bfff640 1 -- 172.21.15.91:0/2310885930 learned_addr learned my addr 172.21.15.91:0/2310885930 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:58.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.245+0000 7fb02b7fe640 1 --2- 172.21.15.91:0/2310885930 >> v2:172.21.15.183:3300/0 conn(0x7fb02c0c1ca0 0x7fb02c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.245+0000 7fb030a3f640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c071e30 0x7fb02c0c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274275767 0 0) 0x7fb02c06d580 con 0x7fb02c155fc0 2023-11-27T20:44:58.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb014003520 con 0x7fb02c155fc0 2023-11-27T20:44:58.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 219870414 0 0) 0x7fb014003520 con 0x7fb02c155fc0 2023-11-27T20:44:58.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c071e30 msgr2=0x7fb02c0c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:58.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c071e30 0x7fb02c0c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 >> v2:172.21.15.183:3300/0 conn(0x7fb02c0c1ca0 msgr2=0x7fb02c0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:58.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 --2- 172.21.15.91:0/2310885930 >> v2:172.21.15.183:3300/0 conn(0x7fb02c0c1ca0 0x7fb02c0c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0726d0 con 0x7fb02c155fc0 2023-11-27T20:44:58.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fb01c001670 con 0x7fb02c155fc0 2023-11-27T20:44:58.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 >> v1:172.21.15.91:6789/0 conn(0x7fb02c155fc0 legacy=0x7fb02c159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 0x7fb014003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0140047c0 0x7fb014004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c071e30 0x7fb014005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c06dd60 con 0x7fb0140039a0 2023-11-27T20:44:58.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01400ba30 con 0x7fb0140047c0 2023-11-27T20:44:58.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.246+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01400bba0 con 0x7fb02c071e30 2023-11-27T20:44:58.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.247+0000 7fb02bfff640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 0x7fb014003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.247+0000 7fb030a3f640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c071e30 0x7fb014005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.247+0000 7fb02b7fe640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0140047c0 0x7fb014004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.247+0000 7fb02bfff640 1 -- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c071e30 msgr2=0x7fb014005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:58.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.247+0000 7fb02bfff640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c071e30 0x7fb014005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.247+0000 7fb02bfff640 1 -- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0140047c0 msgr2=0x7fb014004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:58.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.247+0000 7fb02bfff640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0140047c0 0x7fb014004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.247+0000 7fb02bfff640 1 -- 172.21.15.91:0/2310885930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014003520 con 0x7fb0140039a0 2023-11-27T20:44:58.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.247+0000 7fb02b7fe640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0140047c0 0x7fb014004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:58.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.249+0000 7fb02bfff640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 0x7fb014003dc0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb01c001eb0 tx=0x7fb0140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a762ee8402a9370b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:58.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.249+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c005ad0 con 0x7fb0140039a0 2023-11-27T20:44:58.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.249+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c005c30 con 0x7fb0140039a0 2023-11-27T20:44:58.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.249+0000 7fb02affd640 1 -- 172.21.15.91:0/2310885930 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c02c850 con 0x7fb0140039a0 2023-11-27T20:44:58.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.249+0000 7fb0324a2640 1 -- 172.21.15.91:0/2310885930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 msgr2=0x7fb014003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.249+0000 7fb0324a2640 1 --2- 172.21.15.91:0/2310885930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 0x7fb014003dc0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb01c001eb0 tx=0x7fb0140057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.249+0000 7fb030a3f640 1 -- 172.21.15.91:0/2310885930 reap_dead start 2023-11-27T20:44:58.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.249+0000 7fb0324a2640 1 -- 172.21.15.91:0/2310885930 shutdown_connections 2023-11-27T20:44:58.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.249+0000 7fb0324a2640 1 -- 172.21.15.91:0/2310885930 >> 172.21.15.91:0/2310885930 conn(0x7fb02c06a500 msgr2=0x7fb02c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:58.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.250+0000 7fb0324a2640 1 -- 172.21.15.91:0/2310885930 shutdown_connections 2023-11-27T20:44:58.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.250+0000 7fb0324a2640 1 -- 172.21.15.91:0/2310885930 wait complete. 2023-11-27T20:44:58.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.251+0000 7fb0324a2640 1 Processor -- start 2023-11-27T20:44:58.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.251+0000 7fb0324a2640 1 -- start start 2023-11-27T20:44:58.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.252+0000 7fb0324a2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 0x7fb02c0c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.252+0000 7fb0324a2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c0a79c0 0x7fb02c1ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.252+0000 7fb0324a2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb02c0a8380 0x7fb02c1eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.252+0000 7fb0324a2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0c5910 con 0x7fb0140039a0 2023-11-27T20:44:58.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.252+0000 7fb0324a2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c15bc90 con 0x7fb02c0a8380 2023-11-27T20:44:58.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.252+0000 7fb0324a2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0aa7b0 con 0x7fb02c0a79c0 2023-11-27T20:44:58.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.253+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 0x7fb02c0c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.253+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 0x7fb02c0c4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47120/0 (socket says 172.21.15.91:47120) 2023-11-27T20:44:58.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.253+0000 7fb02bfff640 1 -- 172.21.15.91:0/820253848 learned_addr learned my addr 172.21.15.91:0/820253848 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:58.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.253+0000 7fb02bfff640 1 -- 172.21.15.91:0/820253848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c0a79c0 msgr2=0x7fb02c1ee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.253+0000 7fb02bfff640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c0a79c0 0x7fb02c1ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.253+0000 7fb02bfff640 1 -- 172.21.15.91:0/820253848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb02c0a8380 msgr2=0x7fb02c1eedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.253+0000 7fb02bfff640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb02c0a8380 0x7fb02c1eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.253+0000 7fb02bfff640 1 -- 172.21.15.91:0/820253848 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c15bf30 con 0x7fb0140039a0 2023-11-27T20:44:58.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.253+0000 7fb02bfff640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 0x7fb02c0c4b70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb01c02c3f0 tx=0x7fb02c0722c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:58.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.254+0000 7fb028ff9640 1 -- 172.21.15.91:0/820253848 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c039070 con 0x7fb0140039a0 2023-11-27T20:44:58.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.254+0000 7fb028ff9640 1 -- 172.21.15.91:0/820253848 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c02cc60 con 0x7fb0140039a0 2023-11-27T20:44:58.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.254+0000 7fb028ff9640 1 -- 172.21.15.91:0/820253848 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c03c040 con 0x7fb0140039a0 2023-11-27T20:44:58.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.254+0000 7fb0324a2640 1 -- 172.21.15.91:0/820253848 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c15c210 con 0x7fb0140039a0 2023-11-27T20:44:58.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.254+0000 7fb0324a2640 1 -- 172.21.15.91:0/820253848 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c0aaa90 con 0x7fb0140039a0 2023-11-27T20:44:58.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.255+0000 7fb0324a2640 1 -- 172.21.15.91:0/820253848 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c068350 con 0x7fb0140039a0 2023-11-27T20:44:58.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.256+0000 7fb028ff9640 1 -- 172.21.15.91:0/820253848 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb01c032070 con 0x7fb0140039a0 2023-11-27T20:44:58.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.257+0000 7fb028ff9640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb01806b1c0 0x7fb01806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.257+0000 7fb028ff9640 1 -- 172.21.15.91:0/820253848 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb01c0aa960 con 0x7fb0140039a0 2023-11-27T20:44:58.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.257+0000 7fb02b7fe640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb01806b1c0 0x7fb01806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.258+0000 7fb02b7fe640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb01806b1c0 0x7fb01806d680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0a56c0 tx=0x7fb020008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:58.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.261+0000 7fb028ff9640 1 -- 172.21.15.91:0/820253848 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb01c075920 con 0x7fb0140039a0 2023-11-27T20:44:58.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.449+0000 7fb0324a2640 1 -- 172.21.15.91:0/820253848 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb02c158170 con 0x7fb0140039a0 2023-11-27T20:44:58.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.450+0000 7fb028ff9640 1 -- 172.21.15.91:0/820253848 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb01c078f40 con 0x7fb0140039a0 2023-11-27T20:44:58.452 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:44:58.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 -- 172.21.15.91:0/820253848 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb01806b1c0 msgr2=0x7fb01806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb01806b1c0 0x7fb01806d680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0a56c0 tx=0x7fb020008040 comp rx=0 tx=0).stop 2023-11-27T20:44:58.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 -- 172.21.15.91:0/820253848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 msgr2=0x7fb02c0c4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 0x7fb02c0c4b70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb01c02c3f0 tx=0x7fb02c0722c0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 -- 172.21.15.91:0/820253848 shutdown_connections 2023-11-27T20:44:58.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb01806b1c0 0x7fb01806d680 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb02c0a8380 0x7fb02c1eedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c0a79c0 0x7fb02c1ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 --2- 172.21.15.91:0/820253848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0140039a0 0x7fb02c0c4b70 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 -- 172.21.15.91:0/820253848 >> 172.21.15.91:0/820253848 conn(0x7fb02c06a500 msgr2=0x7fb02c153ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:58.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.453+0000 7fb0324a2640 1 -- 172.21.15.91:0/820253848 shutdown_connections 2023-11-27T20:44:58.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.454+0000 7fb0324a2640 1 -- 172.21.15.91:0/820253848 wait complete. 2023-11-27T20:44:58.475 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-11-27T20:44:58.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.682+0000 7faf63333640 1 Processor -- start 2023-11-27T20:44:58.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.683+0000 7faf63333640 1 -- start start 2023-11-27T20:44:58.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.684+0000 7faf63333640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c45d0 0x7faf5c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.684+0000 7faf63333640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faf5c0c3340 0x7faf5c156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.684+0000 7faf63333640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c0bfdc0 con 0x7faf5c0c5ec0 2023-11-27T20:44:58.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.684+0000 7faf63333640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c06e390 con 0x7faf5c0c3340 2023-11-27T20:44:58.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.684+0000 7faf63333640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c06ddd0 con 0x7faf5c0c45d0 2023-11-27T20:44:58.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.684+0000 7faf610cf640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7faf5c0c5ec0 0x7faf5c0c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59184/0 (socket says 172.21.15.91:59184) 2023-11-27T20:44:58.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.684+0000 7faf610cf640 1 -- 172.21.15.91:0/778852587 learned_addr learned my addr 172.21.15.91:0/778852587 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:58.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.684+0000 7faf618d0640 1 --2- 172.21.15.91:0/778852587 >> v2:172.21.15.91:3300/0 conn(0x7faf5c0c3340 0x7faf5c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.685+0000 7faf608ce640 1 --2- 172.21.15.91:0/778852587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c45d0 0x7faf5c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.685+0000 7faf53fff640 1 -- 172.21.15.91:0/778852587 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536083004 0 0) 0x7faf5c0bfdc0 con 0x7faf5c0c5ec0 2023-11-27T20:44:58.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.685+0000 7faf53fff640 1 -- 172.21.15.91:0/778852587 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf48003520 con 0x7faf5c0c5ec0 2023-11-27T20:44:58.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.685+0000 7faf618d0640 1 -- 172.21.15.91:0/778852587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c45d0 msgr2=0x7faf5c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:58.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.685+0000 7faf618d0640 1 --2- 172.21.15.91:0/778852587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c45d0 0x7faf5c155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.685+0000 7faf618d0640 1 -- 172.21.15.91:0/778852587 >> v1:172.21.15.91:6789/0 conn(0x7faf5c0c5ec0 legacy=0x7faf5c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.685+0000 7faf618d0640 1 -- 172.21.15.91:0/778852587 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c06e0b0 con 0x7faf5c0c3340 2023-11-27T20:44:58.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.686+0000 7faf618d0640 1 --2- 172.21.15.91:0/778852587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 0x7faf5c156370 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7faf54009d90 tx=0x7faf5402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ba24e9c6b47fc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:58.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.686+0000 7faf53fff640 1 -- 172.21.15.91:0/778852587 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5402cb30 con 0x7faf5c0c3340 2023-11-27T20:44:58.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.686+0000 7faf53fff640 1 -- 172.21.15.91:0/778852587 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5402cc90 con 0x7faf5c0c3340 2023-11-27T20:44:58.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.687+0000 7faf53fff640 1 -- 172.21.15.91:0/778852587 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54034440 con 0x7faf5c0c3340 2023-11-27T20:44:58.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.687+0000 7faf63333640 1 -- 172.21.15.91:0/778852587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 msgr2=0x7faf5c156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.687+0000 7faf63333640 1 --2- 172.21.15.91:0/778852587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 0x7faf5c156370 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7faf54009d90 tx=0x7faf5402bd80 comp rx=0 tx=0).stop 2023-11-27T20:44:58.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.687+0000 7faf63333640 1 -- 172.21.15.91:0/778852587 shutdown_connections 2023-11-27T20:44:58.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.687+0000 7faf63333640 1 --2- 172.21.15.91:0/778852587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 0x7faf5c156370 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.687+0000 7faf63333640 1 --2- 172.21.15.91:0/778852587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c45d0 0x7faf5c155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.687+0000 7faf63333640 1 -- 172.21.15.91:0/778852587 >> 172.21.15.91:0/778852587 conn(0x7faf5c06a500 msgr2=0x7faf5c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:58.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.687+0000 7faf63333640 1 -- 172.21.15.91:0/778852587 shutdown_connections 2023-11-27T20:44:58.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.687+0000 7faf63333640 1 -- 172.21.15.91:0/778852587 wait complete. 2023-11-27T20:44:58.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.689+0000 7faf63333640 1 Processor -- start 2023-11-27T20:44:58.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.689+0000 7faf63333640 1 -- start start 2023-11-27T20:44:58.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.690+0000 7faf63333640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 0x7faf5c0a8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.690+0000 7faf63333640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c45d0 0x7faf5c0c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.690+0000 7faf63333640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c5ec0 0x7faf5c1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.690+0000 7faf63333640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c157c10 con 0x7faf5c0c3340 2023-11-27T20:44:58.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.690+0000 7faf63333640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0a87b0 con 0x7faf5c0c45d0 2023-11-27T20:44:58.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.690+0000 7faf63333640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c1ecdd0 con 0x7faf5c0c5ec0 2023-11-27T20:44:58.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.690+0000 7faf610cf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 0x7faf5c0a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.690+0000 7faf610cf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 0x7faf5c0a8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47146/0 (socket says 172.21.15.91:47146) 2023-11-27T20:44:58.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.690+0000 7faf610cf640 1 -- 172.21.15.91:0/3424257053 learned_addr learned my addr 172.21.15.91:0/3424257053 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf608ce640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c45d0 0x7faf5c0c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf610cf640 1 -- 172.21.15.91:0/3424257053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c5ec0 msgr2=0x7faf5c1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf618d0640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c5ec0 0x7faf5c1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf610cf640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c5ec0 0x7faf5c1500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf610cf640 1 -- 172.21.15.91:0/3424257053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c45d0 msgr2=0x7faf5c0c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf610cf640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c45d0 0x7faf5c0c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf610cf640 1 -- 172.21.15.91:0/3424257053 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54009a70 con 0x7faf5c0c3340 2023-11-27T20:44:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf608ce640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c45d0 0x7faf5c0c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:44:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf610cf640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 0x7faf5c0a8270 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c390 tx=0x7faf5800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:58.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf51ffb640 1 -- 172.21.15.91:0/3424257053 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58005ce0 con 0x7faf5c0c3340 2023-11-27T20:44:58.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf51ffb640 1 -- 172.21.15.91:0/3424257053 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58005e40 con 0x7faf5c0c3340 2023-11-27T20:44:58.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf51ffb640 1 -- 172.21.15.91:0/3424257053 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf580072f0 con 0x7faf5c0c3340 2023-11-27T20:44:58.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf63333640 1 -- 172.21.15.91:0/3424257053 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c1ed950 con 0x7faf5c0c3340 2023-11-27T20:44:58.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.691+0000 7faf63333640 1 -- 172.21.15.91:0/3424257053 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c1588f0 con 0x7faf5c0c3340 2023-11-27T20:44:58.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.692+0000 7faf63333640 1 -- 172.21.15.91:0/3424257053 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c068350 con 0x7faf5c0c3340 2023-11-27T20:44:58.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.694+0000 7faf51ffb640 1 -- 172.21.15.91:0/3424257053 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faf58007450 con 0x7faf5c0c3340 2023-11-27T20:44:58.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.694+0000 7faf51ffb640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf4006b1c0 0x7faf4006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:58.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.695+0000 7faf51ffb640 1 -- 172.21.15.91:0/3424257053 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7faf58088cd0 con 0x7faf5c0c3340 2023-11-27T20:44:58.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.695+0000 7faf608ce640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf4006b1c0 0x7faf4006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:58.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.695+0000 7faf608ce640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf4006b1c0 0x7faf4006d680 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0a3e30 tx=0x7faf4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:58.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.699+0000 7faf51ffb640 1 -- 172.21.15.91:0/3424257053 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faf58053d30 con 0x7faf5c0c3340 2023-11-27T20:44:58.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:58.958+0000 7faf63333640 1 -- 172.21.15.91:0/3424257053 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7faf5c0bfa00 con 0x7faf5c0c3340 2023-11-27T20:44:59.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.557+0000 7faf51ffb640 1 -- 172.21.15.91:0/3424257053 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v214) v1 ==== 162+0+0 (secure 0 0 0) 0x7faf58017020 con 0x7faf5c0c3340 2023-11-27T20:44:59.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.560+0000 7faf63333640 1 -- 172.21.15.91:0/3424257053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf4006b1c0 msgr2=0x7faf4006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:59.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.560+0000 7faf63333640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf4006b1c0 0x7faf4006d680 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0a3e30 tx=0x7faf4c008040 comp rx=0 tx=0).stop 2023-11-27T20:44:59.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.560+0000 7faf63333640 1 -- 172.21.15.91:0/3424257053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 msgr2=0x7faf5c0a8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:59.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.560+0000 7faf63333640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 0x7faf5c0a8270 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c390 tx=0x7faf5800c850 comp rx=0 tx=0).stop 2023-11-27T20:44:59.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.560+0000 7faf63333640 1 -- 172.21.15.91:0/3424257053 shutdown_connections 2023-11-27T20:44:59.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.560+0000 7faf63333640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c5ec0 0x7faf5c1500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.560+0000 7faf63333640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf4006b1c0 0x7faf4006d680 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.560+0000 7faf63333640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c45d0 0x7faf5c0c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.560+0000 7faf63333640 1 --2- 172.21.15.91:0/3424257053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c3340 0x7faf5c0a8270 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.560+0000 7faf63333640 1 -- 172.21.15.91:0/3424257053 >> 172.21.15.91:0/3424257053 conn(0x7faf5c06a500 msgr2=0x7faf5c0c1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:59.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.561+0000 7faf63333640 1 -- 172.21.15.91:0/3424257053 shutdown_connections 2023-11-27T20:44:59.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.561+0000 7faf63333640 1 -- 172.21.15.91:0/3424257053 wait complete. 2023-11-27T20:44:59.581 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-27T20:44:59.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.793+0000 7f1b6671d640 1 Processor -- start 2023-11-27T20:44:59.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.793+0000 7f1b6671d640 1 -- start start 2023-11-27T20:44:59.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.794+0000 7f1b6671d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1b600c3340 0x7f1b60156540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:59.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.795+0000 7f1b6671d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b600bfdc0 con 0x7f1b600c45d0 2023-11-27T20:44:59.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.795+0000 7f1b6671d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b60156a80 con 0x7f1b600c5ec0 2023-11-27T20:44:59.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.795+0000 7f1b6671d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6006e390 con 0x7f1b600c3340 2023-11-27T20:44:59.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.795+0000 7f1b57fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f1b600c45d0 0x7f1b60155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59196/0 (socket says 172.21.15.91:59196) 2023-11-27T20:44:59.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.795+0000 7f1b57fff640 1 -- 172.21.15.91:0/3544244403 learned_addr learned my addr 172.21.15.91:0/3544244403 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:44:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.795+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713363889 0 0) 0x7f1b600bfdc0 con 0x7f1b600c45d0 2023-11-27T20:44:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.795+0000 7f1b64cba640 1 --2- 172.21.15.91:0/3544244403 >> v2:172.21.15.183:3300/0 conn(0x7f1b600c3340 0x7f1b60156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:59.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.795+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b4c003520 con 0x7f1b600c45d0 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3722814388 0 0) 0x7f1b4c003520 con 0x7f1b600c45d0 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 >> v2:172.21.15.183:3300/0 conn(0x7f1b600c3340 msgr2=0x7f1b60156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 --2- 172.21.15.91:0/3544244403 >> v2:172.21.15.183:3300/0 conn(0x7f1b600c3340 0x7f1b60156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 >> v1:172.21.15.183:6789/0 conn(0x7f1b600c5ec0 legacy=0x7f1b600c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6006ddd0 con 0x7f1b600c45d0 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f1b48001670 con 0x7f1b600c45d0 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 >> v1:172.21.15.91:6789/0 conn(0x7f1b600c45d0 legacy=0x7f1b60155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b4c003970 0x7f1b4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b4c0047c0 0x7f1b4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b4c0052a0 0x7f1b4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6006e390 con 0x7f1b4c003970 2023-11-27T20:44:59.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c00c170 con 0x7f1b4c0052a0 2023-11-27T20:44:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c00c330 con 0x7f1b4c0047c0 2023-11-27T20:44:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.796+0000 7f1b5ffff640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b4c003970 0x7f1b4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.797+0000 7f1b57fff640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b4c0047c0 0x7f1b4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.797+0000 7f1b64cba640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b4c0052a0 0x7f1b4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.797+0000 7f1b5ffff640 1 -- 172.21.15.91:0/3544244403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b4c0047c0 msgr2=0x7f1b4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.797+0000 7f1b5ffff640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b4c0047c0 0x7f1b4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.797+0000 7f1b5ffff640 1 -- 172.21.15.91:0/3544244403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b4c0052a0 msgr2=0x7f1b4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:44:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.797+0000 7f1b5ffff640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b4c0052a0 0x7f1b4c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.797+0000 7f1b5ffff640 1 -- 172.21.15.91:0/3544244403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c003520 con 0x7f1b4c003970 2023-11-27T20:44:59.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.797+0000 7f1b64cba640 1 -- 172.21.15.91:0/3544244403 reap_dead start 2023-11-27T20:44:59.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.798+0000 7f1b5ffff640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b4c003970 0x7f1b4c003d90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1b50001720 tx=0x7f1b4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b3681df62429fa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:59.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.798+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b500052d0 con 0x7f1b4c003970 2023-11-27T20:44:59.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.798+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5002e050 con 0x7f1b4c003970 2023-11-27T20:44:59.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.798+0000 7f1b5f7fe640 1 -- 172.21.15.91:0/3544244403 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50003830 con 0x7f1b4c003970 2023-11-27T20:44:59.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.799+0000 7f1b6671d640 1 -- 172.21.15.91:0/3544244403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b4c003970 msgr2=0x7f1b4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:59.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.799+0000 7f1b6671d640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b4c003970 0x7f1b4c003d90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1b50001720 tx=0x7f1b4c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.799+0000 7f1b6671d640 1 -- 172.21.15.91:0/3544244403 shutdown_connections 2023-11-27T20:44:59.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.799+0000 7f1b6671d640 1 --2- 172.21.15.91:0/3544244403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b4c003970 0x7f1b4c003d90 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.799+0000 7f1b6671d640 1 -- 172.21.15.91:0/3544244403 >> 172.21.15.91:0/3544244403 conn(0x7f1b6006a500 msgr2=0x7f1b6006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:44:59.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.799+0000 7f1b6671d640 1 -- 172.21.15.91:0/3544244403 shutdown_connections 2023-11-27T20:44:59.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.799+0000 7f1b6671d640 1 -- 172.21.15.91:0/3544244403 wait complete. 2023-11-27T20:44:59.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.801+0000 7f1b6671d640 1 Processor -- start 2023-11-27T20:44:59.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.801+0000 7f1b6671d640 1 -- start start 2023-11-27T20:44:59.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b6671d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b4c003970 0x7f1b600a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:59.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b6671d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b601ea9a0 0x7f1b6014d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:59.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b6671d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b601edcd0 0x7f1b60157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:59.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b6671d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600ab350 con 0x7f1b601edcd0 2023-11-27T20:44:59.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b6671d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b601ed560 con 0x7f1b601ea9a0 2023-11-27T20:44:59.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b6671d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6014dac0 con 0x7f1b4c003970 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b64cba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b601edcd0 0x7f1b60157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b64cba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b601edcd0 0x7f1b60157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47178/0 (socket says 172.21.15.91:47178) 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b64cba640 1 -- 172.21.15.91:0/2242696419 learned_addr learned my addr 172.21.15.91:0/2242696419 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b5ffff640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b4c003970 0x7f1b600a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b64cba640 1 -- 172.21.15.91:0/2242696419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b4c003970 msgr2=0x7f1b600a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b64cba640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b4c003970 0x7f1b600a9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b64cba640 1 -- 172.21.15.91:0/2242696419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b601ea9a0 msgr2=0x7f1b6014d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b64cba640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b601ea9a0 0x7f1b6014d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.802+0000 7f1b64cba640 1 -- 172.21.15.91:0/2242696419 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b601eae00 con 0x7f1b601edcd0 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.803+0000 7f1b64cba640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b601edcd0 0x7f1b60157cf0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1b600c5800 tx=0x7f1b580115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.803+0000 7f1b5d7fa640 1 -- 172.21.15.91:0/2242696419 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5800e070 con 0x7f1b601edcd0 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.803+0000 7f1b5d7fa640 1 -- 172.21.15.91:0/2242696419 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58011e40 con 0x7f1b601edcd0 2023-11-27T20:44:59.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.803+0000 7f1b5d7fa640 1 -- 172.21.15.91:0/2242696419 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58003990 con 0x7f1b601edcd0 2023-11-27T20:44:59.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.803+0000 7f1b6671d640 1 -- 172.21.15.91:0/2242696419 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b600a6e40 con 0x7f1b601edcd0 2023-11-27T20:44:59.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.803+0000 7f1b6671d640 1 -- 172.21.15.91:0/2242696419 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b600a7400 con 0x7f1b601edcd0 2023-11-27T20:44:59.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.804+0000 7f1b6671d640 1 -- 172.21.15.91:0/2242696419 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b600bf2a0 con 0x7f1b601edcd0 2023-11-27T20:44:59.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.805+0000 7f1b5d7fa640 1 -- 172.21.15.91:0/2242696419 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1b58003af0 con 0x7f1b601edcd0 2023-11-27T20:44:59.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.806+0000 7f1b5d7fa640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1b4006b1f0 0x7f1b4006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:44:59.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.806+0000 7f1b5d7fa640 1 -- 172.21.15.91:0/2242696419 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1b58089da0 con 0x7f1b601edcd0 2023-11-27T20:44:59.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.806+0000 7f1b5ffff640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1b4006b1f0 0x7f1b4006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:44:59.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.807+0000 7f1b5ffff640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1b4006b1f0 0x7f1b4006d6b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1b50033000 tx=0x7f1b50009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:44:59.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:44:59.811+0000 7f1b5d7fa640 1 -- 172.21.15.91:0/2242696419 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1b58054d60 con 0x7f1b601edcd0 2023-11-27T20:45:00.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.001+0000 7f1b6671d640 1 -- 172.21.15.91:0/2242696419 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1b60068350 con 0x7f1b601edcd0 2023-11-27T20:45:00.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.006+0000 7f1b5d7fa640 1 -- 172.21.15.91:0/2242696419 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1b58058380 con 0x7f1b601edcd0 2023-11-27T20:45:00.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 -- 172.21.15.91:0/2242696419 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1b4006b1f0 msgr2=0x7f1b4006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:00.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1b4006b1f0 0x7f1b4006d6b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1b50033000 tx=0x7f1b50009030 comp rx=0 tx=0).stop 2023-11-27T20:45:00.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 -- 172.21.15.91:0/2242696419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b601edcd0 msgr2=0x7f1b60157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:00.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b601edcd0 0x7f1b60157cf0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1b600c5800 tx=0x7f1b580115a0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 -- 172.21.15.91:0/2242696419 shutdown_connections 2023-11-27T20:45:00.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b601edcd0 0x7f1b60157cf0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1b4006b1f0 0x7f1b4006d6b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b601ea9a0 0x7f1b6014d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 --2- 172.21.15.91:0/2242696419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b4c003970 0x7f1b600a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 -- 172.21.15.91:0/2242696419 >> 172.21.15.91:0/2242696419 conn(0x7f1b6006a500 msgr2=0x7f1b60155f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:00.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 -- 172.21.15.91:0/2242696419 shutdown_connections 2023-11-27T20:45:00.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.009+0000 7f1b6671d640 1 -- 172.21.15.91:0/2242696419 wait complete. 2023-11-27T20:45:00.030 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-27T20:45:00.030 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:45:00.131 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:45:00.259 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-27T20:45:00.259 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:00.259 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:00.317 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-27T20:45:00.318 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:00.318 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:00.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-27T20:45:00.378 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-27T20:45:00.378 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:45:00.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.593+0000 7fde4bcee640 1 Processor -- start 2023-11-27T20:45:00.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.593+0000 7fde4bcee640 1 -- start start 2023-11-27T20:45:00.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.594+0000 7fde4bcee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c45d0 0x7fde44155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:00.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.594+0000 7fde4bcee640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fde440c3340 0x7fde44156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:00.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.594+0000 7fde4bcee640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde440bfdc0 con 0x7fde440c5ec0 2023-11-27T20:45:00.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.594+0000 7fde4bcee640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4406e390 con 0x7fde440c3340 2023-11-27T20:45:00.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.594+0000 7fde4bcee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4406ddd0 con 0x7fde440c45d0 2023-11-27T20:45:00.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.595+0000 7fde4a28b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fde440c3340 0x7fde44156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:00.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.595+0000 7fde4a28b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fde440c3340 0x7fde44156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47180/0 (socket says 172.21.15.91:47180) 2023-11-27T20:45:00.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.595+0000 7fde4a28b640 1 -- 172.21.15.91:0/2761077742 learned_addr learned my addr 172.21.15.91:0/2761077742 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:00.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.595+0000 7fde49289640 1 --2- 172.21.15.91:0/2761077742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c45d0 0x7fde44155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:00.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.596+0000 7fde4a28b640 1 -- 172.21.15.91:0/2761077742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c45d0 msgr2=0x7fde44155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:00.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.596+0000 7fde4a28b640 1 --2- 172.21.15.91:0/2761077742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c45d0 0x7fde44155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.596+0000 7fde4a28b640 1 -- 172.21.15.91:0/2761077742 >> v1:172.21.15.183:6789/0 conn(0x7fde440c5ec0 legacy=0x7fde440c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:00.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.596+0000 7fde4a28b640 1 -- 172.21.15.91:0/2761077742 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4406e0b0 con 0x7fde440c3340 2023-11-27T20:45:00.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.597+0000 7fde4a28b640 1 --2- 172.21.15.91:0/2761077742 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c3340 0x7fde44156370 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009e50 tx=0x7fde3c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd60e038d0c1d184 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:00.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.597+0000 7fde48a88640 1 -- 172.21.15.91:0/2761077742 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c02c9e0 con 0x7fde440c3340 2023-11-27T20:45:00.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.597+0000 7fde48a88640 1 -- 172.21.15.91:0/2761077742 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c02cb40 con 0x7fde440c3340 2023-11-27T20:45:00.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.597+0000 7fde48a88640 1 -- 172.21.15.91:0/2761077742 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0343f0 con 0x7fde440c3340 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.598+0000 7fde4bcee640 1 -- 172.21.15.91:0/2761077742 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c3340 msgr2=0x7fde44156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.598+0000 7fde4bcee640 1 --2- 172.21.15.91:0/2761077742 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c3340 0x7fde44156370 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009e50 tx=0x7fde3c02be40 comp rx=0 tx=0).stop 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.598+0000 7fde4bcee640 1 -- 172.21.15.91:0/2761077742 shutdown_connections 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.598+0000 7fde4bcee640 1 --2- 172.21.15.91:0/2761077742 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c3340 0x7fde44156370 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.598+0000 7fde4bcee640 1 --2- 172.21.15.91:0/2761077742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c45d0 0x7fde44155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.598+0000 7fde4bcee640 1 -- 172.21.15.91:0/2761077742 >> 172.21.15.91:0/2761077742 conn(0x7fde4406a500 msgr2=0x7fde4406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.598+0000 7fde4bcee640 1 -- 172.21.15.91:0/2761077742 shutdown_connections 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.598+0000 7fde4bcee640 1 -- 172.21.15.91:0/2761077742 wait complete. 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.600+0000 7fde4bcee640 1 Processor -- start 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.600+0000 7fde4bcee640 1 -- start start 2023-11-27T20:45:00.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.601+0000 7fde4bcee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c3340 0x7fde441ed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.601+0000 7fde4bcee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde440c45d0 0x7fde440a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.601+0000 7fde4bcee640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c5ec0 0x7fde440a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.601+0000 7fde4bcee640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde441ee220 con 0x7fde440c5ec0 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.601+0000 7fde4bcee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4414b650 con 0x7fde440c45d0 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.601+0000 7fde4bcee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4414b930 con 0x7fde440c3340 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.601+0000 7fde4a28b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c5ec0 0x7fde440a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.601+0000 7fde4a28b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c5ec0 0x7fde440a7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47182/0 (socket says 172.21.15.91:47182) 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.601+0000 7fde4a28b640 1 -- 172.21.15.91:0/726352377 learned_addr learned my addr 172.21.15.91:0/726352377 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.601+0000 7fde49a8a640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c3340 0x7fde441ed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde49289640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde440c45d0 0x7fde440a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde4a28b640 1 -- 172.21.15.91:0/726352377 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c3340 msgr2=0x7fde441ed7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:00.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde4a28b640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c3340 0x7fde441ed7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde4a28b640 1 -- 172.21.15.91:0/726352377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde440c45d0 msgr2=0x7fde440a77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde4a28b640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde440c45d0 0x7fde440a77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde4a28b640 1 -- 172.21.15.91:0/726352377 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c009b30 con 0x7fde440c5ec0 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde49a8a640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c3340 0x7fde441ed7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde4a28b640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c5ec0 0x7fde440a7cf0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009e50 tx=0x7fde3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde3a7fc640 1 -- 172.21.15.91:0/726352377 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03e450 con 0x7fde440c5ec0 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde3a7fc640 1 -- 172.21.15.91:0/726352377 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c03e5b0 con 0x7fde440c5ec0 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde3a7fc640 1 -- 172.21.15.91:0/726352377 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03e960 con 0x7fde440c5ec0 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.602+0000 7fde4bcee640 1 -- 172.21.15.91:0/726352377 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4414bc10 con 0x7fde440c5ec0 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.603+0000 7fde4bcee640 1 -- 172.21.15.91:0/726352377 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde440a8670 con 0x7fde440c5ec0 2023-11-27T20:45:00.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.604+0000 7fde4bcee640 1 -- 172.21.15.91:0/726352377 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde44068350 con 0x7fde440c5ec0 2023-11-27T20:45:00.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.605+0000 7fde3a7fc640 1 -- 172.21.15.91:0/726352377 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fde3c03eac0 con 0x7fde440c5ec0 2023-11-27T20:45:00.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.605+0000 7fde3a7fc640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde2806b1c0 0x7fde2806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:00.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.606+0000 7fde3a7fc640 1 -- 172.21.15.91:0/726352377 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fde3c0ac620 con 0x7fde440c5ec0 2023-11-27T20:45:00.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.606+0000 7fde49a8a640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde2806b1c0 0x7fde2806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:00.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.607+0000 7fde49a8a640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde2806b1c0 0x7fde2806d680 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fde40000f60 tx=0x7fde40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:00.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.610+0000 7fde3a7fc640 1 -- 172.21.15.91:0/726352377 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fde3c0775e0 con 0x7fde440c5ec0 2023-11-27T20:45:00.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.839+0000 7fde4bcee640 1 -- 172.21.15.91:0/726352377 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde440bfa00 con 0x7fde440c5ec0 2023-11-27T20:45:00.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.841+0000 7fde3a7fc640 1 -- 172.21.15.91:0/726352377 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fde3c043e90 con 0x7fde440c5ec0 2023-11-27T20:45:00.842 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:00.842 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3271555404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3271555404},{"type":"v1","addr":"172.21.15.183:6833","nonce":3271555404}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":4709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3725410642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":3725410642},{"type":"v1","addr":"172.21.15.183:6835","nonce":3725410642}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6360,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/854034874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":854034874},{"type":"v1","addr":"172.21.15.91:6837","nonce":854034874}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37},{"gid":6444,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/967355914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":967355914},{"type":"v1","addr":"172.21.15.91:6836","nonce":967355914}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[]} 2023-11-27T20:45:00.843 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 39 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 -- 172.21.15.91:0/726352377 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde2806b1c0 msgr2=0x7fde2806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde2806b1c0 0x7fde2806d680 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fde40000f60 tx=0x7fde40009040 comp rx=0 tx=0).stop 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 -- 172.21.15.91:0/726352377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c5ec0 msgr2=0x7fde440a7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c5ec0 0x7fde440a7cf0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009e50 tx=0x7fde3c004a40 comp rx=0 tx=0).stop 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 -- 172.21.15.91:0/726352377 shutdown_connections 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde440c5ec0 0x7fde440a7cf0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fde2806b1c0 0x7fde2806d680 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde440c45d0 0x7fde440a77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 --2- 172.21.15.91:0/726352377 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde440c3340 0x7fde441ed7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 -- 172.21.15.91:0/726352377 >> 172.21.15.91:0/726352377 conn(0x7fde4406a500 msgr2=0x7fde44070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 -- 172.21.15.91:0/726352377 shutdown_connections 2023-11-27T20:45:00.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:00.843+0000 7fde4bcee640 1 -- 172.21.15.91:0/726352377 wait complete. 2023-11-27T20:45:00.864 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T20:45:00.864 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-27T20:45:00.864 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-27T20:45:00.865 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:45:00.865 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T20:45:00.865 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-27T20:45:00.865 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-27T20:45:00.865 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:45:00.865 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T20:45:00.866 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-27T20:45:00.866 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-27T20:45:00.866 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:45:00.866 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-27T20:45:00.866 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-27T20:45:00.866 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-27T20:45:00.866 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:45:00.886 INFO:tasks.ceph.mds.d:Stopped 2023-11-27T20:45:00.887 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-27T20:45:00.887 INFO:tasks.ceph.mds.c:Stopped 2023-11-27T20:45:00.888 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-27T20:45:00.888 INFO:tasks.ceph.mds.a:Stopped 2023-11-27T20:45:00.889 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-27T20:45:00.890 INFO:tasks.ceph.mds.b:Stopped 2023-11-27T20:45:00.890 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-27T20:45:00.937 INFO:tasks.ceph.mds.c:Started 2023-11-27T20:45:00.937 DEBUG:teuthology.parallel:result is None 2023-11-27T20:45:00.939 INFO:tasks.ceph.mds.d:Started 2023-11-27T20:45:00.939 DEBUG:teuthology.parallel:result is None 2023-11-27T20:45:00.944 INFO:tasks.ceph.mds.a:Started 2023-11-27T20:45:00.944 DEBUG:teuthology.parallel:result is None 2023-11-27T20:45:00.946 INFO:tasks.ceph.mds.b:Started 2023-11-27T20:45:00.946 DEBUG:teuthology.parallel:result is None 2023-11-27T20:45:00.947 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-27T20:45:01.093 INFO:tasks.ceph.mds.c.smithi091.stdout:starting mds.c at 2023-11-27T20:45:01.093 INFO:tasks.ceph.mds.a.smithi091.stdout:starting mds.a at 2023-11-27T20:45:01.104 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-11-27T20:45:01.104 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-11-27T20:45:01.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.132+0000 7f2cb3ec2640 1 Processor -- start 2023-11-27T20:45:01.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.133+0000 7f2cb3ec2640 1 -- start start 2023-11-27T20:45:01.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.134+0000 7f2cb3ec2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac155fc0 0x7f2cac159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.134+0000 7f2cb3ec2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac06d580 con 0x7f2cac0c2e60 2023-11-27T20:45:01.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.134+0000 7f2cb3ec2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac0726d0 con 0x7f2cac0c1ca0 2023-11-27T20:45:01.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.134+0000 7f2cb3ec2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac06dd60 con 0x7f2cac155fc0 2023-11-27T20:45:01.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.134+0000 7f2cb245f640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2cac0c2e60 0x7f2cac163370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59212/0 (socket says 172.21.15.91:59212) 2023-11-27T20:45:01.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.134+0000 7f2cb245f640 1 -- 172.21.15.91:0/1233510730 learned_addr learned my addr 172.21.15.91:0/1233510730 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:01.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.134+0000 7f2cb1c5e640 1 --2- 172.21.15.91:0/1233510730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac155fc0 0x7f2cac159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.135+0000 7f2cb0c5c640 1 -- 172.21.15.91:0/1233510730 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126346116 0 0) 0x7f2cac06d580 con 0x7f2cac0c2e60 2023-11-27T20:45:01.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.135+0000 7f2cb0c5c640 1 -- 172.21.15.91:0/1233510730 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c98003520 con 0x7f2cac0c2e60 2023-11-27T20:45:01.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.135+0000 7f2cb0c5c640 1 -- 172.21.15.91:0/1233510730 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701369754 0 0) 0x7f2cac0726d0 con 0x7f2cac0c1ca0 2023-11-27T20:45:01.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.135+0000 7f2cb1c5e640 1 -- 172.21.15.91:0/1233510730 >> v1:172.21.15.183:6789/0 conn(0x7f2cac0c1ca0 legacy=0x7f2cac0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.135+0000 7f2cb1c5e640 1 -- 172.21.15.91:0/1233510730 >> v1:172.21.15.91:6789/0 conn(0x7f2cac0c2e60 legacy=0x7f2cac163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.135+0000 7f2cb1c5e640 1 -- 172.21.15.91:0/1233510730 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac1599b0 con 0x7f2cac155fc0 2023-11-27T20:45:01.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.136+0000 7f2cb1c5e640 1 --2- 172.21.15.91:0/1233510730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac155fc0 0x7f2cac159470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80097d0 tx=0x7f2ca802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd0c432a8bed8c9a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:01.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.136+0000 7f2cb0c5c640 1 -- 172.21.15.91:0/1233510730 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8031780 con 0x7f2cac155fc0 2023-11-27T20:45:01.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.136+0000 7f2cb0c5c640 1 -- 172.21.15.91:0/1233510730 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca80318e0 con 0x7f2cac155fc0 2023-11-27T20:45:01.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.136+0000 7f2cb0c5c640 1 -- 172.21.15.91:0/1233510730 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8031c70 con 0x7f2cac155fc0 2023-11-27T20:45:01.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.137+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/1233510730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac155fc0 msgr2=0x7f2cac159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.137+0000 7f2cb3ec2640 1 --2- 172.21.15.91:0/1233510730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac155fc0 0x7f2cac159470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80097d0 tx=0x7f2ca802b820 comp rx=0 tx=0).stop 2023-11-27T20:45:01.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.137+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/1233510730 shutdown_connections 2023-11-27T20:45:01.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.137+0000 7f2cb3ec2640 1 --2- 172.21.15.91:0/1233510730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac155fc0 0x7f2cac159470 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.137+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/1233510730 >> 172.21.15.91:0/1233510730 conn(0x7f2cac06a500 msgr2=0x7f2cac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:01.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.137+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/1233510730 shutdown_connections 2023-11-27T20:45:01.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.137+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/1233510730 wait complete. 2023-11-27T20:45:01.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.138+0000 7f2cb3ec2640 1 Processor -- start 2023-11-27T20:45:01.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.138+0000 7f2cb3ec2640 1 -- start start 2023-11-27T20:45:01.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.139+0000 7f2cb3ec2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac0c1ca0 0x7f2cac0bace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.139+0000 7f2cb3ec2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cac0c2e60 0x7f2cac157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.139+0000 7f2cb3ec2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac155fc0 0x7f2cac0a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.139+0000 7f2cb3ec2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac1f2190 con 0x7f2cac155fc0 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.139+0000 7f2cb3ec2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac1f1ca0 con 0x7f2cac0c2e60 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.139+0000 7f2cb3ec2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0bbf10 con 0x7f2cac0c1ca0 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb245f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac155fc0 0x7f2cac0a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb245f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac155fc0 0x7f2cac0a4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47228/0 (socket says 172.21.15.91:47228) 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb245f640 1 -- 172.21.15.91:0/3902139539 learned_addr learned my addr 172.21.15.91:0/3902139539 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb1c5e640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac0c1ca0 0x7f2cac0bace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb145d640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cac0c2e60 0x7f2cac157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb245f640 1 -- 172.21.15.91:0/3902139539 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac0c1ca0 msgr2=0x7f2cac0bace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb245f640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac0c1ca0 0x7f2cac0bace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb245f640 1 -- 172.21.15.91:0/3902139539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cac0c2e60 msgr2=0x7f2cac157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb245f640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cac0c2e60 0x7f2cac157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb245f640 1 -- 172.21.15.91:0/3902139539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8009400 con 0x7f2cac155fc0 2023-11-27T20:45:01.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.140+0000 7f2cb245f640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac155fc0 0x7f2cac0a4190 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400cb70 tx=0x7f2ca400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:01.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.141+0000 7f2ca27fc640 1 -- 172.21.15.91:0/3902139539 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400ad40 con 0x7f2cac155fc0 2023-11-27T20:45:01.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.141+0000 7f2ca27fc640 1 -- 172.21.15.91:0/3902139539 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca4012400 con 0x7f2cac155fc0 2023-11-27T20:45:01.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.141+0000 7f2ca27fc640 1 -- 172.21.15.91:0/3902139539 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400aea0 con 0x7f2cac155fc0 2023-11-27T20:45:01.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.141+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/3902139539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac0a2de0 con 0x7f2cac155fc0 2023-11-27T20:45:01.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.141+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/3902139539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac0a3c90 con 0x7f2cac155fc0 2023-11-27T20:45:01.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.142+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/3902139539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac068350 con 0x7f2cac155fc0 2023-11-27T20:45:01.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.143+0000 7f2ca27fc640 1 -- 172.21.15.91:0/3902139539 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2ca4007070 con 0x7f2cac155fc0 2023-11-27T20:45:01.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.144+0000 7f2ca27fc640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2c9006b1c0 0x7f2c9006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.144+0000 7f2ca27fc640 1 -- 172.21.15.91:0/3902139539 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2ca40897c0 con 0x7f2cac155fc0 2023-11-27T20:45:01.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.144+0000 7f2cb1c5e640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2c9006b1c0 0x7f2c9006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.145+0000 7f2cb1c5e640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2c9006b1c0 0x7f2c9006d680 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8036000 tx=0x7f2ca803e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:01.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.148+0000 7f2ca27fc640 1 -- 172.21.15.91:0/3902139539 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2ca40547b0 con 0x7f2cac155fc0 2023-11-27T20:45:01.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.349+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/3902139539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2cac0674d0 con 0x7f2cac155fc0 2023-11-27T20:45:01.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.581+0000 7f2ca27fc640 1 -- 172.21.15.91:0/3902139539 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2ca4017020 con 0x7f2cac155fc0 2023-11-27T20:45:01.583 INFO:teuthology.orchestra.run.smithi091.stderr: removed all blocklist entries 2023-11-27T20:45:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.585+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/3902139539 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2c9006b1c0 msgr2=0x7f2c9006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.585+0000 7f2cb3ec2640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2c9006b1c0 0x7f2c9006d680 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8036000 tx=0x7f2ca803e040 comp rx=0 tx=0).stop 2023-11-27T20:45:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.585+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/3902139539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac155fc0 msgr2=0x7f2cac0a4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.585+0000 7f2cb3ec2640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac155fc0 0x7f2cac0a4190 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400cb70 tx=0x7f2ca400a430 comp rx=0 tx=0).stop 2023-11-27T20:45:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.585+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/3902139539 shutdown_connections 2023-11-27T20:45:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.585+0000 7f2cb3ec2640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac155fc0 0x7f2cac0a4190 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.585+0000 7f2cb3ec2640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2c9006b1c0 0x7f2c9006d680 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.585+0000 7f2cb3ec2640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cac0c2e60 0x7f2cac157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.585+0000 7f2cb3ec2640 1 --2- 172.21.15.91:0/3902139539 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cac0c1ca0 0x7f2cac0bace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.585+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/3902139539 >> 172.21.15.91:0/3902139539 conn(0x7f2cac06a500 msgr2=0x7f2cac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:01.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.586+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/3902139539 shutdown_connections 2023-11-27T20:45:01.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.586+0000 7f2cb3ec2640 1 -- 172.21.15.91:0/3902139539 wait complete. 2023-11-27T20:45:01.610 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-27T20:45:01.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.810+0000 7f891c31d640 1 Processor -- start 2023-11-27T20:45:01.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.811+0000 7f891c31d640 1 -- start start 2023-11-27T20:45:01.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.812+0000 7f891c31d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f891414fd30 0x7f8914152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.812+0000 7f891c31d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89140c3ea0 0x7f89140c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.812+0000 7f891c31d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89140c64a0 con 0x7f891406d0a0 2023-11-27T20:45:01.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.812+0000 7f891c31d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89140c5c00 con 0x7f891414fd30 2023-11-27T20:45:01.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.812+0000 7f891c31d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89140c5ee0 con 0x7f89140c3ea0 2023-11-27T20:45:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.812+0000 7f891a0b9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f891414fd30 0x7f8914152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.812+0000 7f891a0b9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f891414fd30 0x7f8914152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47240/0 (socket says 172.21.15.91:47240) 2023-11-27T20:45:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.812+0000 7f891a0b9640 1 -- 172.21.15.91:0/3375374105 learned_addr learned my addr 172.21.15.91:0/3375374105 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.813+0000 7f891a8ba640 1 --2- 172.21.15.91:0/3375374105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89140c3ea0 0x7f89140c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.813+0000 7f891a0b9640 1 -- 172.21.15.91:0/3375374105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89140c3ea0 msgr2=0x7f89140c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.813+0000 7f891a0b9640 1 --2- 172.21.15.91:0/3375374105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89140c3ea0 0x7f89140c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.813+0000 7f891a0b9640 1 -- 172.21.15.91:0/3375374105 >> v1:172.21.15.91:6789/0 conn(0x7f891406d0a0 legacy=0x7f89140a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.813+0000 7f891a0b9640 1 -- 172.21.15.91:0/3375374105 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89140c61c0 con 0x7f891414fd30 2023-11-27T20:45:01.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.814+0000 7f891a0b9640 1 --2- 172.21.15.91:0/3375374105 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f891414fd30 0x7f8914152f20 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8910009870 tx=0x7f891002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21bd5ecba86e165 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.814+0000 7f89190b7640 1 -- 172.21.15.91:0/3375374105 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910030840 con 0x7f891414fd30 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.814+0000 7f89190b7640 1 -- 172.21.15.91:0/3375374105 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89100309a0 con 0x7f891414fd30 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.814+0000 7f89190b7640 1 -- 172.21.15.91:0/3375374105 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910030d30 con 0x7f891414fd30 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.815+0000 7f891c31d640 1 -- 172.21.15.91:0/3375374105 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f891414fd30 msgr2=0x7f8914152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.815+0000 7f891c31d640 1 --2- 172.21.15.91:0/3375374105 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f891414fd30 0x7f8914152f20 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8910009870 tx=0x7f891002b980 comp rx=0 tx=0).stop 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.815+0000 7f891c31d640 1 -- 172.21.15.91:0/3375374105 shutdown_connections 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.815+0000 7f891c31d640 1 --2- 172.21.15.91:0/3375374105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89140c3ea0 0x7f89140c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.815+0000 7f891c31d640 1 --2- 172.21.15.91:0/3375374105 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f891414fd30 0x7f8914152f20 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.815+0000 7f891c31d640 1 -- 172.21.15.91:0/3375374105 >> 172.21.15.91:0/3375374105 conn(0x7f891406a500 msgr2=0x7f891406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.815+0000 7f891c31d640 1 -- 172.21.15.91:0/3375374105 shutdown_connections 2023-11-27T20:45:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.815+0000 7f891c31d640 1 -- 172.21.15.91:0/3375374105 wait complete. 2023-11-27T20:45:01.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.817+0000 7f891c31d640 1 Processor -- start 2023-11-27T20:45:01.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.817+0000 7f891c31d640 1 -- start start 2023-11-27T20:45:01.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.818+0000 7f891c31d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f891406d0a0 0x7f89140a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.818+0000 7f891c31d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89140c3ea0 0x7f891414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.818+0000 7f891c31d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f891414fd30 0x7f89141ea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.818+0000 7f891c31d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891414cc20 con 0x7f89140c3ea0 2023-11-27T20:45:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.818+0000 7f891c31d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89141ea400 con 0x7f891406d0a0 2023-11-27T20:45:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.818+0000 7f891c31d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89140aa980 con 0x7f891414fd30 2023-11-27T20:45:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.818+0000 7f89198b8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89140c3ea0 0x7f891414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.818+0000 7f89198b8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89140c3ea0 0x7f891414e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47248/0 (socket says 172.21.15.91:47248) 2023-11-27T20:45:01.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.818+0000 7f89198b8640 1 -- 172.21.15.91:0/3920528550 learned_addr learned my addr 172.21.15.91:0/3920528550 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:01.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f891a8ba640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f891414fd30 0x7f89141ea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f89198b8640 1 -- 172.21.15.91:0/3920528550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f891414fd30 msgr2=0x7f89141ea9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f891a0b9640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f891406d0a0 0x7f89140a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f89198b8640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f891414fd30 0x7f89141ea9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f89198b8640 1 -- 172.21.15.91:0/3920528550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f891406d0a0 msgr2=0x7f89140a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f89198b8640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f891406d0a0 0x7f89140a4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f89198b8640 1 -- 172.21.15.91:0/3920528550 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89100094d0 con 0x7f89140c3ea0 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f891a0b9640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f891406d0a0 0x7f89140a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f89198b8640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89140c3ea0 0x7f891414e940 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f890400c3c0 tx=0x7f890400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f890affd640 1 -- 172.21.15.91:0/3920528550 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89040052d0 con 0x7f89140c3ea0 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f890affd640 1 -- 172.21.15.91:0/3920528550 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8904005450 con 0x7f89140c3ea0 2023-11-27T20:45:01.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f891c31d640 1 -- 172.21.15.91:0/3920528550 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89140aac60 con 0x7f89140c3ea0 2023-11-27T20:45:01.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f890affd640 1 -- 172.21.15.91:0/3920528550 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8904003830 con 0x7f89140c3ea0 2023-11-27T20:45:01.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.819+0000 7f891c31d640 1 -- 172.21.15.91:0/3920528550 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891414ee80 con 0x7f89140c3ea0 2023-11-27T20:45:01.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.820+0000 7f891c31d640 1 -- 172.21.15.91:0/3920528550 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89141eda00 con 0x7f89140c3ea0 2023-11-27T20:45:01.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.822+0000 7f890affd640 1 -- 172.21.15.91:0/3920528550 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8904003990 con 0x7f89140c3ea0 2023-11-27T20:45:01.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.823+0000 7f890affd640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88f806b1c0 0x7f88f806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.823+0000 7f890affd640 1 -- 172.21.15.91:0/3920528550 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8904088bb0 con 0x7f89140c3ea0 2023-11-27T20:45:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.823+0000 7f891a0b9640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88f806b1c0 0x7f88f806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.824+0000 7f891a0b9640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88f806b1c0 0x7f88f806d680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8910036000 tx=0x7f891003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:01.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:01.827+0000 7f890affd640 1 -- 172.21.15.91:0/3920528550 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f89141eda00 con 0x7f89140c3ea0 2023-11-27T20:45:02.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.083+0000 7f891c31d640 1 -- 172.21.15.91:0/3920528550 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f89141eda00 con 0x7f89140c3ea0 2023-11-27T20:45:02.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.084+0000 7f890affd640 1 -- 172.21.15.91:0/3920528550 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5081 (secure 0 0 0) 0x7f89141eda00 con 0x7f89140c3ea0 2023-11-27T20:45:02.086 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:02.086 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:45:02.086 INFO:teuthology.orchestra.run.smithi091.stdout: "auth_dump": [ 2023-11-27T20:45:02.086 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.086 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.a", 2023-11-27T20:45:02.086 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRlRwaqHRAAqer3j2kHk7wuowivepQUgw==", 2023-11-27T20:45:02.086 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.b", 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRlx9BVAxAA+wJ5xix5GpiENKnZfH/iFw==", 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:45:02.087 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.c", 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRlv407LhAAE6ECkLA1z27fwufNKJNIYA==", 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:45:02.088 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mds.d", 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRl+kFcExAAkuOMQ90ecoxXDkPxO6FDvw==", 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.089 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.0", 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC9/mRlONFOLhAAYUIBkatNBD7/J4D9sfAiaw==", 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.1", 2023-11-27T20:45:02.090 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDB/mRlvE+RDBAACA+NQHmb0QQxYZgXZpslEQ==", 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.2", 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDE/mRleeqGFhAAHwW2F6fQnCdomrsUsdm+8w==", 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:45:02.091 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.3", 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDH/mRlYT1/IBAATkOmqpRab148FbKtb+MifA==", 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.092 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.4", 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDO/mRlebvbIBAARnJZSuaKdb1vs1PoMQNDOw==", 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.093 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.5", 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDR/mRl6MgQOxAAw94eeILe8F/405enQHSaiA==", 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.6", 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDV/mRl5Jd9GhAAv9BxPC9a0D6l3ZBcP0ceUg==", 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.094 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "osd.7", 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQDY/mRlllnNJRAAXnAoHjIq7CKkL8c6MC3byg==", 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow profile osd", 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile osd", 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.095 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.0", 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRlKBgjIhAArHSIgmH/SwVIdiUlROMOfA==", 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow r", 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.1", 2023-11-27T20:45:02.096 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC5/mRlsqHoLBAAzs5TAvGaf/SnzmZfDewgAg==", 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow", 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow r", 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow rw pool=cephfs2_data" 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.admin", 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC3/mRlMswjDhAAq6QNwbsRncp78C5FXSuMZg==", 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow *", 2023-11-27T20:45:02.097 INFO:teuthology.orchestra.run.smithi091.stdout: "mgr": "allow *", 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow *", 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "client.testuser", 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQCo/2RlzjcFIRAA6CAAN8BdP+PWaUAriMDQ1Q==", 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow rw fsname=cephfs", 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-11-27T20:45:02.098 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mgr.x", 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRl8E2qERAA2C9blyASELJzyHJZ3BdIUw==", 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow *", 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile mgr", 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:02.099 INFO:teuthology.orchestra.run.smithi091.stdout: "entity": "mgr.y", 2023-11-27T20:45:02.100 INFO:teuthology.orchestra.run.smithi091.stdout: "key": "AQC4/mRld4txBRAAvOUjPT9j+tXIe6B82dWA0w==", 2023-11-27T20:45:02.100 INFO:teuthology.orchestra.run.smithi091.stdout: "caps": { 2023-11-27T20:45:02.100 INFO:teuthology.orchestra.run.smithi091.stdout: "mds": "allow *", 2023-11-27T20:45:02.100 INFO:teuthology.orchestra.run.smithi091.stdout: "mon": "allow profile mgr", 2023-11-27T20:45:02.100 INFO:teuthology.orchestra.run.smithi091.stdout: "osd": "allow *" 2023-11-27T20:45:02.100 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.100 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:02.100 INFO:teuthology.orchestra.run.smithi091.stdout: ] 2023-11-27T20:45:02.100 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:45:02.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 -- 172.21.15.91:0/3920528550 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88f806b1c0 msgr2=0x7f88f806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88f806b1c0 0x7f88f806d680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8910036000 tx=0x7f891003b040 comp rx=0 tx=0).stop 2023-11-27T20:45:02.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 -- 172.21.15.91:0/3920528550 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89140c3ea0 msgr2=0x7f891414e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89140c3ea0 0x7f891414e940 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f890400c3c0 tx=0x7f890400c880 comp rx=0 tx=0).stop 2023-11-27T20:45:02.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 -- 172.21.15.91:0/3920528550 shutdown_connections 2023-11-27T20:45:02.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f891414fd30 0x7f89141ea9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89140c3ea0 0x7f891414e940 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f88f806b1c0 0x7f88f806d680 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 --2- 172.21.15.91:0/3920528550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f891406d0a0 0x7f89140a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 -- 172.21.15.91:0/3920528550 >> 172.21.15.91:0/3920528550 conn(0x7f891406a500 msgr2=0x7f89140c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:02.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 -- 172.21.15.91:0/3920528550 shutdown_connections 2023-11-27T20:45:02.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.087+0000 7f891c31d640 1 -- 172.21.15.91:0/3920528550 wait complete. 2023-11-27T20:45:02.106 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-11-27T20:45:02.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.308+0000 7faca569b640 1 Processor -- start 2023-11-27T20:45:02.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.308+0000 7faca569b640 1 -- start start 2023-11-27T20:45:02.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.310+0000 7faca569b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faca00c11c0 0x7faca00c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.310+0000 7faca569b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faca0158760 0x7faca0151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.310+0000 7faca569b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca006ce10 con 0x7faca006c3c0 2023-11-27T20:45:02.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.310+0000 7faca569b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca0155800 con 0x7faca00c11c0 2023-11-27T20:45:02.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.310+0000 7faca569b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca00c1e80 con 0x7faca0158760 2023-11-27T20:45:02.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.310+0000 7fac9effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faca00c11c0 0x7faca00c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.310+0000 7fac9effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faca00c11c0 0x7faca00c23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47258/0 (socket says 172.21.15.91:47258) 2023-11-27T20:45:02.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.310+0000 7fac9effd640 1 -- 172.21.15.91:0/1562178696 learned_addr learned my addr 172.21.15.91:0/1562178696 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:02.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.311+0000 7fac9effd640 1 -- 172.21.15.91:0/1562178696 >> v2:172.21.15.183:3300/0 conn(0x7faca0158760 msgr2=0x7faca0151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:02.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.311+0000 7fac9f7fe640 1 --2- 172.21.15.91:0/1562178696 >> v2:172.21.15.183:3300/0 conn(0x7faca0158760 0x7faca0151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.311+0000 7fac9effd640 1 --2- 172.21.15.91:0/1562178696 >> v2:172.21.15.183:3300/0 conn(0x7faca0158760 0x7faca0151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.311+0000 7fac9effd640 1 -- 172.21.15.91:0/1562178696 >> v1:172.21.15.183:6789/0 conn(0x7faca006c3c0 legacy=0x7faca01550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:02.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.311+0000 7fac9effd640 1 -- 172.21.15.91:0/1562178696 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca006c850 con 0x7faca00c11c0 2023-11-27T20:45:02.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.311+0000 7fac9f7fe640 1 --2- 172.21.15.91:0/1562178696 >> v2:172.21.15.183:3300/0 conn(0x7faca0158760 0x7faca0151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:02.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.312+0000 7fac9effd640 1 --2- 172.21.15.91:0/1562178696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca00c11c0 0x7faca00c23e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fac90009e50 tx=0x7fac9002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77116587d1fdb3b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:02.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.313+0000 7fac9e7fc640 1 -- 172.21.15.91:0/1562178696 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9002c960 con 0x7faca00c11c0 2023-11-27T20:45:02.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.313+0000 7fac9e7fc640 1 -- 172.21.15.91:0/1562178696 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9002cac0 con 0x7faca00c11c0 2023-11-27T20:45:02.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.313+0000 7fac9e7fc640 1 -- 172.21.15.91:0/1562178696 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9002ce50 con 0x7faca00c11c0 2023-11-27T20:45:02.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.313+0000 7faca569b640 1 -- 172.21.15.91:0/1562178696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca00c11c0 msgr2=0x7faca00c23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.313+0000 7faca569b640 1 --2- 172.21.15.91:0/1562178696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca00c11c0 0x7faca00c23e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fac90009e50 tx=0x7fac9002bdc0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.313+0000 7faca569b640 1 -- 172.21.15.91:0/1562178696 shutdown_connections 2023-11-27T20:45:02.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.313+0000 7faca569b640 1 --2- 172.21.15.91:0/1562178696 >> v2:172.21.15.183:3300/0 conn(0x7faca0158760 0x7faca0151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.313+0000 7faca569b640 1 --2- 172.21.15.91:0/1562178696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca00c11c0 0x7faca00c23e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.313+0000 7faca569b640 1 -- 172.21.15.91:0/1562178696 >> 172.21.15.91:0/1562178696 conn(0x7faca006a500 msgr2=0x7faca006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:02.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.314+0000 7faca569b640 1 -- 172.21.15.91:0/1562178696 shutdown_connections 2023-11-27T20:45:02.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.314+0000 7faca569b640 1 -- 172.21.15.91:0/1562178696 wait complete. 2023-11-27T20:45:02.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.315+0000 7faca569b640 1 Processor -- start 2023-11-27T20:45:02.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.315+0000 7faca569b640 1 -- start start 2023-11-27T20:45:02.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.316+0000 7faca569b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faca00c11c0 0x7faca0157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.316+0000 7faca569b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca0158760 0x7faca01ea860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.316+0000 7faca569b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faca00c3e20 0x7faca0145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.316+0000 7faca569b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca0072090 con 0x7faca0158760 2023-11-27T20:45:02.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.316+0000 7faca569b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca01ea0f0 con 0x7faca00c3e20 2023-11-27T20:45:02.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.316+0000 7faca569b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca01ee110 con 0x7faca00c11c0 2023-11-27T20:45:02.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.316+0000 7fac967fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca0158760 0x7faca01ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.316+0000 7fac967fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca0158760 0x7faca01ea860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47274/0 (socket says 172.21.15.91:47274) 2023-11-27T20:45:02.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.316+0000 7fac967fc640 1 -- 172.21.15.91:0/3335346553 learned_addr learned my addr 172.21.15.91:0/3335346553 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:02.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7fac9effd640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faca00c11c0 0x7faca0157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7fac967fc640 1 -- 172.21.15.91:0/3335346553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faca00c11c0 msgr2=0x7faca0157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7fac967fc640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faca00c11c0 0x7faca0157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7fac967fc640 1 -- 172.21.15.91:0/3335346553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faca00c3e20 msgr2=0x7faca0145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7fac967fc640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faca00c3e20 0x7faca0145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7fac967fc640 1 -- 172.21.15.91:0/3335346553 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90009b30 con 0x7faca0158760 2023-11-27T20:45:02.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7fac967fc640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca0158760 0x7faca01ea860 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fac8800b3e0 tx=0x7fac8800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:02.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7fac97fff640 1 -- 172.21.15.91:0/3335346553 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88011830 con 0x7faca0158760 2023-11-27T20:45:02.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7fac97fff640 1 -- 172.21.15.91:0/3335346553 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac88011990 con 0x7faca0158760 2023-11-27T20:45:02.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7fac97fff640 1 -- 172.21.15.91:0/3335346553 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88011d40 con 0x7faca0158760 2023-11-27T20:45:02.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.317+0000 7faca569b640 1 -- 172.21.15.91:0/3335346553 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca01ee3f0 con 0x7faca0158760 2023-11-27T20:45:02.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.318+0000 7faca569b640 1 -- 172.21.15.91:0/3335346553 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca01577b0 con 0x7faca0158760 2023-11-27T20:45:02.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.319+0000 7faca569b640 1 -- 172.21.15.91:0/3335346553 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca00c1b60 con 0x7faca0158760 2023-11-27T20:45:02.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.320+0000 7fac97fff640 1 -- 172.21.15.91:0/3335346553 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fac8801a400 con 0x7faca0158760 2023-11-27T20:45:02.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.320+0000 7fac97fff640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fac8006b1f0 0x7fac8006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.321+0000 7fac97fff640 1 -- 172.21.15.91:0/3335346553 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac880897d0 con 0x7faca0158760 2023-11-27T20:45:02.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.321+0000 7fac9effd640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fac8006b1f0 0x7fac8006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.321+0000 7fac9effd640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fac8006b1f0 0x7fac8006d6b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fac90035000 tx=0x7fac90030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:02.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.325+0000 7fac97fff640 1 -- 172.21.15.91:0/3335346553 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fac88054840 con 0x7faca0158760 2023-11-27T20:45:02.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.563+0000 7faca569b640 1 -- 172.21.15.91:0/3335346553 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7faca01ea580 con 0x7faca0158760 2023-11-27T20:45:02.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.567+0000 7fac97fff640 1 -- 172.21.15.91:0/3335346553 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v22) v1 ==== 85+0+0 (secure 0 0 0) 0x7faca01ea580 con 0x7faca0158760 2023-11-27T20:45:02.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 -- 172.21.15.91:0/3335346553 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fac8006b1f0 msgr2=0x7fac8006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fac8006b1f0 0x7fac8006d6b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fac90035000 tx=0x7fac90030000 comp rx=0 tx=0).stop 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 -- 172.21.15.91:0/3335346553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca0158760 msgr2=0x7faca01ea860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca0158760 0x7faca01ea860 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fac8800b3e0 tx=0x7fac8800b8a0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 -- 172.21.15.91:0/3335346553 shutdown_connections 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fac8006b1f0 0x7fac8006d6b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faca00c3e20 0x7faca0145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faca0158760 0x7faca01ea860 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 --2- 172.21.15.91:0/3335346553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faca00c11c0 0x7faca0157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 -- 172.21.15.91:0/3335346553 >> 172.21.15.91:0/3335346553 conn(0x7faca006a500 msgr2=0x7faca00a9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 -- 172.21.15.91:0/3335346553 shutdown_connections 2023-11-27T20:45:02.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.570+0000 7faca569b640 1 -- 172.21.15.91:0/3335346553 wait complete. 2023-11-27T20:45:02.591 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:02.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.777+0000 7f2fc3c64640 1 Processor -- start 2023-11-27T20:45:02.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.777+0000 7f2fc3c64640 1 -- start start 2023-11-27T20:45:02.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.778+0000 7f2fc3c64640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2fbc0c1500 0x7f2fbc0c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.778+0000 7f2fc3c64640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0c06c0 con 0x7f2fbc155490 2023-11-27T20:45:02.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.778+0000 7f2fc3c64640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0c1020 con 0x7f2fbc0a9b40 2023-11-27T20:45:02.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.778+0000 7f2fc3c64640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0a5820 con 0x7f2fbc0c1500 2023-11-27T20:45:02.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc1a00640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2fbc155490 0x7f2fbc0a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59226/0 (socket says 172.21.15.91:59226) 2023-11-27T20:45:02.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc1a00640 1 -- 172.21.15.91:0/2189538834 learned_addr learned my addr 172.21.15.91:0/2189538834 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:02.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876717424 0 0) 0x7f2fbc0c06c0 con 0x7f2fbc155490 2023-11-27T20:45:02.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa8003520 con 0x7f2fbc155490 2023-11-27T20:45:02.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc2201640 1 --2- 172.21.15.91:0/2189538834 >> v2:172.21.15.183:3300/0 conn(0x7f2fbc0c1500 0x7f2fbc0c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 391182203 0 0) 0x7f2fa8003520 con 0x7f2fbc155490 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 >> v2:172.21.15.183:3300/0 conn(0x7f2fbc0c1500 msgr2=0x7f2fbc0c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc09fe640 1 --2- 172.21.15.91:0/2189538834 >> v2:172.21.15.183:3300/0 conn(0x7f2fbc0c1500 0x7f2fbc0c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 >> v1:172.21.15.183:6789/0 conn(0x7f2fbc0a9b40 legacy=0x7f2fbc0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0c0910 con 0x7f2fbc155490 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f2fb8001670 con 0x7f2fbc155490 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.779+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 >> v1:172.21.15.91:6789/0 conn(0x7f2fbc155490 legacy=0x7f2fbc0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc09fe640 1 --2- 172.21.15.91:0/2189538834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fa8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc09fe640 1 --2- 172.21.15.91:0/2189538834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fa80047c0 0x7f2fa8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc09fe640 1 --2- 172.21.15.91:0/2189538834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fa80052a0 0x7f2fa800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa800c170 con 0x7f2fa8003970 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa800c2e0 con 0x7f2fa80047c0 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa800c4a0 con 0x7f2fa80052a0 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc2201640 1 --2- 172.21.15.91:0/2189538834 >> v2:172.21.15.183:3300/0 conn(0x7f2fbc0c1500 0x7f2fbc0c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc1a00640 1 --2- 172.21.15.91:0/2189538834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fa8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc11ff640 1 --2- 172.21.15.91:0/2189538834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fa80047c0 0x7f2fa8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc1a00640 1 -- 172.21.15.91:0/2189538834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fa80052a0 msgr2=0x7f2fa800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc1a00640 1 --2- 172.21.15.91:0/2189538834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fa80052a0 0x7f2fa800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc1a00640 1 -- 172.21.15.91:0/2189538834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fa80047c0 msgr2=0x7f2fa8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc1a00640 1 --2- 172.21.15.91:0/2189538834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fa80047c0 0x7f2fa8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc1a00640 1 -- 172.21.15.91:0/2189538834 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8003520 con 0x7f2fa8003970 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.780+0000 7f2fc2201640 1 -- 172.21.15.91:0/2189538834 reap_dead start 2023-11-27T20:45:02.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.781+0000 7f2fc1a00640 1 --2- 172.21.15.91:0/2189538834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fa8003d70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c210 tx=0x7f2fa80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd15c06609fb375 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:02.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.782+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8005ad0 con 0x7f2fa8003970 2023-11-27T20:45:02.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.782+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb8005c30 con 0x7f2fa8003970 2023-11-27T20:45:02.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.782+0000 7f2fc09fe640 1 -- 172.21.15.91:0/2189538834 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb802c870 con 0x7f2fa8003970 2023-11-27T20:45:02.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.782+0000 7f2fc3c64640 1 -- 172.21.15.91:0/2189538834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 msgr2=0x7f2fa8003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.782+0000 7f2fc3c64640 1 --2- 172.21.15.91:0/2189538834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fa8003d70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c210 tx=0x7f2fa80057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.782+0000 7f2fc3c64640 1 -- 172.21.15.91:0/2189538834 shutdown_connections 2023-11-27T20:45:02.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.782+0000 7f2fc3c64640 1 --2- 172.21.15.91:0/2189538834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fa8003d70 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.782+0000 7f2fc3c64640 1 -- 172.21.15.91:0/2189538834 >> 172.21.15.91:0/2189538834 conn(0x7f2fbc06a500 msgr2=0x7f2fbc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:02.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.782+0000 7f2fc3c64640 1 -- 172.21.15.91:0/2189538834 shutdown_connections 2023-11-27T20:45:02.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.782+0000 7f2fc3c64640 1 -- 172.21.15.91:0/2189538834 wait complete. 2023-11-27T20:45:02.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.784+0000 7f2fc3c64640 1 Processor -- start 2023-11-27T20:45:02.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.784+0000 7f2fc3c64640 1 -- start start 2023-11-27T20:45:02.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.785+0000 7f2fc3c64640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fbc14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.785+0000 7f2fc3c64640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fbc14b820 0x7f2fbc149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.785+0000 7f2fc3c64640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fbc1dc080 0x7f2fbc1e7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.785+0000 7f2fc3c64640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc14b4d0 con 0x7f2fa8003970 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.785+0000 7f2fc3c64640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc14bfe0 con 0x7f2fbc1dc080 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.785+0000 7f2fc3c64640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc148da0 con 0x7f2fbc14b820 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.785+0000 7f2fc1a00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fbc14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.785+0000 7f2fc1a00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fbc14cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47294/0 (socket says 172.21.15.91:47294) 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.785+0000 7f2fc1a00640 1 -- 172.21.15.91:0/1217739522 learned_addr learned my addr 172.21.15.91:0/1217739522 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fc11ff640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fbc14b820 0x7f2fbc149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fc2201640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fbc1dc080 0x7f2fbc1e7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fc1a00640 1 -- 172.21.15.91:0/1217739522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fbc14b820 msgr2=0x7f2fbc149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fc1a00640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fbc14b820 0x7f2fbc149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fc1a00640 1 -- 172.21.15.91:0/1217739522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fbc1dc080 msgr2=0x7f2fbc1e7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fc1a00640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fbc1dc080 0x7f2fbc1e7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fc1a00640 1 -- 172.21.15.91:0/1217739522 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc14bd00 con 0x7f2fa8003970 2023-11-27T20:45:02.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fc1a00640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fbc14cbd0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2fb802c410 tx=0x7f2fb802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:02.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fae7fc640 1 -- 172.21.15.91:0/1217739522 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb803c040 con 0x7f2fa8003970 2023-11-27T20:45:02.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fae7fc640 1 -- 172.21.15.91:0/1217739522 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb802cd40 con 0x7f2fa8003970 2023-11-27T20:45:02.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fc3c64640 1 -- 172.21.15.91:0/1217739522 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc149040 con 0x7f2fa8003970 2023-11-27T20:45:02.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fae7fc640 1 -- 172.21.15.91:0/1217739522 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8007290 con 0x7f2fa8003970 2023-11-27T20:45:02.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.786+0000 7f2fc3c64640 1 -- 172.21.15.91:0/1217739522 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc1dcc40 con 0x7f2fa8003970 2023-11-27T20:45:02.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.787+0000 7f2fc3c64640 1 -- 172.21.15.91:0/1217739522 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc068350 con 0x7f2fa8003970 2023-11-27T20:45:02.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.788+0000 7f2fae7fc640 1 -- 172.21.15.91:0/1217739522 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2fb8032070 con 0x7f2fa8003970 2023-11-27T20:45:02.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.789+0000 7f2fae7fc640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fa006b1f0 0x7f2fa006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:02.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.789+0000 7f2fae7fc640 1 -- 172.21.15.91:0/1217739522 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2fb80aa7b0 con 0x7f2fa8003970 2023-11-27T20:45:02.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.789+0000 7f2fc11ff640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fa006b1f0 0x7f2fa006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:02.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.790+0000 7f2fc11ff640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fa006b1f0 0x7f2fa006d6b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0007fd0 tx=0x7f2fb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:02.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.793+0000 7f2fae7fc640 1 -- 172.21.15.91:0/1217739522 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2fb80759f0 con 0x7f2fa8003970 2023-11-27T20:45:02.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.983+0000 7f2fc3c64640 1 -- 172.21.15.91:0/1217739522 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fbc0702b0 con 0x7f2fa8003970 2023-11-27T20:45:02.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.985+0000 7f2fae7fc640 1 -- 172.21.15.91:0/1217739522 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+12823 (secure 0 0 0) 0x7f2fb8045090 con 0x7f2fa8003970 2023-11-27T20:45:02.987 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:02.987 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":71,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:01.598407+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:02.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 -- 172.21.15.91:0/1217739522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fa006b1f0 msgr2=0x7f2fa006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fa006b1f0 0x7f2fa006d6b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0007fd0 tx=0x7f2fb0009040 comp rx=0 tx=0).stop 2023-11-27T20:45:02.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 -- 172.21.15.91:0/1217739522 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 msgr2=0x7f2fbc14cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:02.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fbc14cbd0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2fb802c410 tx=0x7f2fb802e070 comp rx=0 tx=0).stop 2023-11-27T20:45:02.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 -- 172.21.15.91:0/1217739522 shutdown_connections 2023-11-27T20:45:02.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f2fa006b1f0 0x7f2fa006d6b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fbc1dc080 0x7f2fbc1e7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fbc14b820 0x7f2fbc149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 --2- 172.21.15.91:0/1217739522 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fa8003970 0x7f2fbc14cbd0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:02.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 -- 172.21.15.91:0/1217739522 >> 172.21.15.91:0/1217739522 conn(0x7f2fbc06a500 msgr2=0x7f2fbc0a8440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:02.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 -- 172.21.15.91:0/1217739522 shutdown_connections 2023-11-27T20:45:02.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:02.988+0000 7f2fc3c64640 1 -- 172.21.15.91:0/1217739522 wait complete. 2023-11-27T20:45:03.009 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:45:03.009 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:45:03.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.218+0000 7f1092aca640 1 Processor -- start 2023-11-27T20:45:03.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.218+0000 7f1092aca640 1 -- start start 2023-11-27T20:45:03.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.219+0000 7f1092aca640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f108c14c2e0 0x7f108c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.219+0000 7f1092aca640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f108c0c0440 0x7f108c152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.219+0000 7f1092aca640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f108c072310 0x7f108c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.219+0000 7f1092aca640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c071470 con 0x7f108c072310 2023-11-27T20:45:03.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.219+0000 7f1092aca640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c071e80 con 0x7f108c14c2e0 2023-11-27T20:45:03.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.219+0000 7f1092aca640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c14c6c0 con 0x7f108c0c0440 2023-11-27T20:45:03.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f10922c9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f108c072310 0x7f108c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:03.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f10922c9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f108c072310 0x7f108c0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47304/0 (socket says 172.21.15.91:47304) 2023-11-27T20:45:03.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f10922c9640 1 -- 172.21.15.91:0/3859917136 learned_addr learned my addr 172.21.15.91:0/3859917136 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:03.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f1091ac8640 1 --2- 172.21.15.91:0/3859917136 >> v2:172.21.15.183:3300/0 conn(0x7f108c14c2e0 0x7f108c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:03.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f10912c7640 1 --2- 172.21.15.91:0/3859917136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f108c0c0440 0x7f108c152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:03.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f10922c9640 1 -- 172.21.15.91:0/3859917136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f108c0c0440 msgr2=0x7f108c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:03.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f10922c9640 1 --2- 172.21.15.91:0/3859917136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f108c0c0440 0x7f108c152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f10922c9640 1 -- 172.21.15.91:0/3859917136 >> v2:172.21.15.183:3300/0 conn(0x7f108c14c2e0 msgr2=0x7f108c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:03.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f10922c9640 1 --2- 172.21.15.91:0/3859917136 >> v2:172.21.15.183:3300/0 conn(0x7f108c14c2e0 0x7f108c0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f10922c9640 1 -- 172.21.15.91:0/3859917136 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c153180 con 0x7f108c072310 2023-11-27T20:45:03.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.220+0000 7f1091ac8640 1 --2- 172.21.15.91:0/3859917136 >> v2:172.21.15.183:3300/0 conn(0x7f108c14c2e0 0x7f108c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:45:03.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.221+0000 7f10922c9640 1 --2- 172.21.15.91:0/3859917136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 0x7f108c0a4d20 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f108c067940 tx=0x7f108402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c7df4f730e9040 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:03.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1090ac6640 1 -- 172.21.15.91:0/3859917136 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108402c950 con 0x7f108c072310 2023-11-27T20:45:03.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1090ac6640 1 -- 172.21.15.91:0/3859917136 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108402cab0 con 0x7f108c072310 2023-11-27T20:45:03.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1090ac6640 1 -- 172.21.15.91:0/3859917136 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108402ce40 con 0x7f108c072310 2023-11-27T20:45:03.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1092aca640 1 -- 172.21.15.91:0/3859917136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 msgr2=0x7f108c0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:03.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1092aca640 1 --2- 172.21.15.91:0/3859917136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 0x7f108c0a4d20 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f108c067940 tx=0x7f108402bdb0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1092aca640 1 -- 172.21.15.91:0/3859917136 shutdown_connections 2023-11-27T20:45:03.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1092aca640 1 --2- 172.21.15.91:0/3859917136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 0x7f108c0a4d20 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1092aca640 1 --2- 172.21.15.91:0/3859917136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f108c0c0440 0x7f108c152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1092aca640 1 --2- 172.21.15.91:0/3859917136 >> v2:172.21.15.183:3300/0 conn(0x7f108c14c2e0 0x7f108c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1092aca640 1 -- 172.21.15.91:0/3859917136 >> 172.21.15.91:0/3859917136 conn(0x7f108c0a77f0 msgr2=0x7f108c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:03.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1092aca640 1 -- 172.21.15.91:0/3859917136 shutdown_connections 2023-11-27T20:45:03.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.222+0000 7f1092aca640 1 -- 172.21.15.91:0/3859917136 wait complete. 2023-11-27T20:45:03.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.224+0000 7f1092aca640 1 Processor -- start 2023-11-27T20:45:03.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.224+0000 7f1092aca640 1 -- start start 2023-11-27T20:45:03.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.225+0000 7f1092aca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 0x7f108c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.225+0000 7f1092aca640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f108c0c0440 0x7f108c1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.225+0000 7f1092aca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f108c14c2e0 0x7f108c152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.225+0000 7f1092aca640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c14d660 con 0x7f108c072310 2023-11-27T20:45:03.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.225+0000 7f1092aca640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c14ce50 con 0x7f108c14c2e0 2023-11-27T20:45:03.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.225+0000 7f1092aca640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c152470 con 0x7f108c0c0440 2023-11-27T20:45:03.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.225+0000 7f1091ac8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 0x7f108c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:03.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.225+0000 7f1091ac8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 0x7f108c14fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47312/0 (socket says 172.21.15.91:47312) 2023-11-27T20:45:03.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.225+0000 7f1091ac8640 1 -- 172.21.15.91:0/2418380175 learned_addr learned my addr 172.21.15.91:0/2418380175 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:03.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f1091ac8640 1 -- 172.21.15.91:0/2418380175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f108c0c0440 msgr2=0x7f108c1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f1091ac8640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f108c0c0440 0x7f108c1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f1091ac8640 1 -- 172.21.15.91:0/2418380175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f108c14c2e0 msgr2=0x7f108c152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f10922c9640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f108c14c2e0 0x7f108c152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f1091ac8640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f108c14c2e0 0x7f108c152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f1091ac8640 1 -- 172.21.15.91:0/2418380175 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084009b30 con 0x7f108c072310 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f10922c9640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f108c14c2e0 0x7f108c152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f1091ac8640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 0x7f108c14fce0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f108000d7d0 tx=0x7f108000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f108a7fc640 1 -- 172.21.15.91:0/2418380175 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080004030 con 0x7f108c072310 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f108a7fc640 1 -- 172.21.15.91:0/2418380175 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1080004190 con 0x7f108c072310 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.226+0000 7f1092aca640 1 -- 172.21.15.91:0/2418380175 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c1510a0 con 0x7f108c072310 2023-11-27T20:45:03.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.227+0000 7f108a7fc640 1 -- 172.21.15.91:0/2418380175 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080004520 con 0x7f108c072310 2023-11-27T20:45:03.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.227+0000 7f1092aca640 1 -- 172.21.15.91:0/2418380175 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c154b20 con 0x7f108c072310 2023-11-27T20:45:03.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.228+0000 7f1092aca640 1 -- 172.21.15.91:0/2418380175 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c04e840 con 0x7f108c072310 2023-11-27T20:45:03.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.228+0000 7f108a7fc640 1 -- 172.21.15.91:0/2418380175 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f108000b660 con 0x7f108c072310 2023-11-27T20:45:03.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.229+0000 7f108a7fc640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f107006b1c0 0x7f107006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.229+0000 7f108a7fc640 1 -- 172.21.15.91:0/2418380175 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1080089760 con 0x7f108c072310 2023-11-27T20:45:03.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.230+0000 7f10912c7640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f107006b1c0 0x7f107006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:03.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.230+0000 7f10912c7640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f107006b1c0 0x7f107006d680 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f108c0a6ce0 tx=0x7f1078008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:03.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.234+0000 7f108a7fc640 1 -- 172.21.15.91:0/2418380175 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1080054870 con 0x7f108c072310 2023-11-27T20:45:03.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.424+0000 7f1092aca640 1 -- 172.21.15.91:0/2418380175 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f108c0c5380 con 0x7f108c072310 2023-11-27T20:45:03.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.425+0000 7f108a7fc640 1 -- 172.21.15.91:0/2418380175 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1080057e90 con 0x7f108c072310 2023-11-27T20:45:03.427 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:45:03.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.427+0000 7f1092aca640 1 -- 172.21.15.91:0/2418380175 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f107006b1c0 msgr2=0x7f107006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.427+0000 7f1092aca640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f107006b1c0 0x7f107006d680 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f108c0a6ce0 tx=0x7f1078008040 comp rx=0 tx=0).stop 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.427+0000 7f1092aca640 1 -- 172.21.15.91:0/2418380175 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 msgr2=0x7f108c14fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.428+0000 7f1092aca640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 0x7f108c14fce0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f108000d7d0 tx=0x7f108000dc90 comp rx=0 tx=0).stop 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.428+0000 7f1092aca640 1 -- 172.21.15.91:0/2418380175 shutdown_connections 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.428+0000 7f1092aca640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f107006b1c0 0x7f107006d680 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.428+0000 7f1092aca640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f108c14c2e0 0x7f108c152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.428+0000 7f1092aca640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f108c0c0440 0x7f108c1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.428+0000 7f1092aca640 1 --2- 172.21.15.91:0/2418380175 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f108c072310 0x7f108c14fce0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.428+0000 7f1092aca640 1 -- 172.21.15.91:0/2418380175 >> 172.21.15.91:0/2418380175 conn(0x7f108c0a77f0 msgr2=0x7f108c14a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.428+0000 7f1092aca640 1 -- 172.21.15.91:0/2418380175 shutdown_connections 2023-11-27T20:45:03.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.428+0000 7f1092aca640 1 -- 172.21.15.91:0/2418380175 wait complete. 2023-11-27T20:45:03.448 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T20:45:03.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.655+0000 7f49c759e640 1 Processor -- start 2023-11-27T20:45:03.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.656+0000 7f49c759e640 1 -- start start 2023-11-27T20:45:03.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.657+0000 7f49c759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49c814c2e0 0x7f49c80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.657+0000 7f49c759e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f49c80c0440 0x7f49c8152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.657+0000 7f49c759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f49c8072310 0x7f49c80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.657+0000 7f49c759e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c8071470 con 0x7f49c8072310 2023-11-27T20:45:03.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.657+0000 7f49c759e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c8071e80 con 0x7f49c80c0440 2023-11-27T20:45:03.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.657+0000 7f49c759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c814c6c0 con 0x7f49c814c2e0 2023-11-27T20:45:03.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.657+0000 7f49c6d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f49c8072310 0x7f49c80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:03.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.657+0000 7f49c6d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f49c8072310 0x7f49c80a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47324/0 (socket says 172.21.15.91:47324) 2023-11-27T20:45:03.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.657+0000 7f49c6d9d640 1 -- 172.21.15.91:0/1771698395 learned_addr learned my addr 172.21.15.91:0/1771698395 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.657+0000 7f49c659c640 1 --2- 172.21.15.91:0/1771698395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49c814c2e0 0x7f49c80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.658+0000 7f49c6d9d640 1 -- 172.21.15.91:0/1771698395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49c814c2e0 msgr2=0x7f49c80c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.658+0000 7f49c6d9d640 1 --2- 172.21.15.91:0/1771698395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49c814c2e0 0x7f49c80c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.658+0000 7f49c6d9d640 1 -- 172.21.15.91:0/1771698395 >> v2:172.21.15.183:3300/0 conn(0x7f49c80c0440 msgr2=0x7f49c8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.658+0000 7f49c6d9d640 1 --2- 172.21.15.91:0/1771698395 >> v2:172.21.15.183:3300/0 conn(0x7f49c80c0440 0x7f49c8152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.658+0000 7f49c6d9d640 1 -- 172.21.15.91:0/1771698395 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c8153180 con 0x7f49c8072310 2023-11-27T20:45:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.659+0000 7f49c6d9d640 1 --2- 172.21.15.91:0/1771698395 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c8072310 0x7f49c80a4d20 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f49c806b500 tx=0x7f49c002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997f5c930b32647c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:03.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.659+0000 7f49c5d9b640 1 -- 172.21.15.91:0/1771698395 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c002c960 con 0x7f49c8072310 2023-11-27T20:45:03.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.659+0000 7f49c5d9b640 1 -- 172.21.15.91:0/1771698395 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c002cac0 con 0x7f49c8072310 2023-11-27T20:45:03.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.659+0000 7f49c5d9b640 1 -- 172.21.15.91:0/1771698395 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c002ce50 con 0x7f49c8072310 2023-11-27T20:45:03.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.660+0000 7f49c759e640 1 -- 172.21.15.91:0/1771698395 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c8072310 msgr2=0x7f49c80a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:03.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.660+0000 7f49c759e640 1 --2- 172.21.15.91:0/1771698395 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c8072310 0x7f49c80a4d20 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f49c806b500 tx=0x7f49c002bdc0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.660+0000 7f49c759e640 1 -- 172.21.15.91:0/1771698395 shutdown_connections 2023-11-27T20:45:03.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.660+0000 7f49c759e640 1 --2- 172.21.15.91:0/1771698395 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c8072310 0x7f49c80a4d20 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.660+0000 7f49c759e640 1 --2- 172.21.15.91:0/1771698395 >> v2:172.21.15.183:3300/0 conn(0x7f49c80c0440 0x7f49c8152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.660+0000 7f49c759e640 1 --2- 172.21.15.91:0/1771698395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49c814c2e0 0x7f49c80c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.660+0000 7f49c759e640 1 -- 172.21.15.91:0/1771698395 >> 172.21.15.91:0/1771698395 conn(0x7f49c80a77f0 msgr2=0x7f49c80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:03.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.660+0000 7f49c759e640 1 -- 172.21.15.91:0/1771698395 shutdown_connections 2023-11-27T20:45:03.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.660+0000 7f49c759e640 1 -- 172.21.15.91:0/1771698395 wait complete. 2023-11-27T20:45:03.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.661+0000 7f49c759e640 1 Processor -- start 2023-11-27T20:45:03.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.662+0000 7f49c759e640 1 -- start start 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.662+0000 7f49c759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49c8072310 0x7f49c80aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.662+0000 7f49c759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c80c0440 0x7f49c8144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.662+0000 7f49c759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49c814c2e0 0x7f49c81452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.662+0000 7f49c759e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c81eaff0 con 0x7f49c80c0440 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.662+0000 7f49c759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c81eb2b0 con 0x7f49c814c2e0 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.663+0000 7f49c759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c81eb590 con 0x7f49c8072310 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.663+0000 7f49bdd9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c80c0440 0x7f49c8144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.663+0000 7f49bdd9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c80c0440 0x7f49c8144d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:47340/0 (socket says 172.21.15.91:47340) 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.663+0000 7f49bdd9b640 1 -- 172.21.15.91:0/3068788573 learned_addr learned my addr 172.21.15.91:0/3068788573 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.663+0000 7f49bdd9b640 1 -- 172.21.15.91:0/3068788573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49c8072310 msgr2=0x7f49c80aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.663+0000 7f49bdd9b640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49c8072310 0x7f49c80aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.663+0000 7f49bdd9b640 1 -- 172.21.15.91:0/3068788573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49c814c2e0 msgr2=0x7f49c81452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:03.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.663+0000 7f49bdd9b640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49c814c2e0 0x7f49c81452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.663+0000 7f49bdd9b640 1 -- 172.21.15.91:0/3068788573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c0009b30 con 0x7f49c80c0440 2023-11-27T20:45:03.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.663+0000 7f49bdd9b640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c80c0440 0x7f49c8144d80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f49b000b4a0 tx=0x7f49b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:03.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.664+0000 7f49bf7fe640 1 -- 172.21.15.91:0/3068788573 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0010610 con 0x7f49c80c0440 2023-11-27T20:45:03.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.664+0000 7f49bf7fe640 1 -- 172.21.15.91:0/3068788573 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b0010770 con 0x7f49c80c0440 2023-11-27T20:45:03.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.664+0000 7f49bf7fe640 1 -- 172.21.15.91:0/3068788573 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0010b00 con 0x7f49c80c0440 2023-11-27T20:45:03.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.664+0000 7f49c759e640 1 -- 172.21.15.91:0/3068788573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c81eb870 con 0x7f49c80c0440 2023-11-27T20:45:03.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.664+0000 7f49c759e640 1 -- 172.21.15.91:0/3068788573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c8155560 con 0x7f49c80c0440 2023-11-27T20:45:03.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.665+0000 7f49c759e640 1 -- 172.21.15.91:0/3068788573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c81ebd90 con 0x7f49c80c0440 2023-11-27T20:45:03.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.666+0000 7f49bf7fe640 1 -- 172.21.15.91:0/3068788573 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f49b0010c60 con 0x7f49c80c0440 2023-11-27T20:45:03.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.667+0000 7f49bf7fe640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f49a806b1f0 0x7f49a806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:03.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.667+0000 7f49bf7fe640 1 -- 172.21.15.91:0/3068788573 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f49b00892f0 con 0x7f49c80c0440 2023-11-27T20:45:03.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.667+0000 7f49c659c640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f49a806b1f0 0x7f49a806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:03.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.668+0000 7f49c659c640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f49a806b1f0 0x7f49a806d6b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f49b800a810 tx=0x7f49b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:03.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.671+0000 7f49bf7fe640 1 -- 172.21.15.91:0/3068788573 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f49c81ebd90 con 0x7f49c80c0440 2023-11-27T20:45:03.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.864+0000 7f49c759e640 1 -- 172.21.15.91:0/3068788573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f49c81ebd90 con 0x7f49c80c0440 2023-11-27T20:45:03.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.865+0000 7f49bf7fe640 1 -- 172.21.15.91:0/3068788573 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) v1 ==== 84+0+65 (secure 0 0 0) 0x7f49c81ebd90 con 0x7f49c80c0440 2023-11-27T20:45:03.866 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:03.866 INFO:teuthology.orchestra.run.smithi091.stdout:[ 2023-11-27T20:45:03.866 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:03.866 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 1, 2023-11-27T20:45:03.866 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": ".mgr" 2023-11-27T20:45:03.866 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:03.867 INFO:teuthology.orchestra.run.smithi091.stdout:] 2023-11-27T20:45:03.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 -- 172.21.15.91:0/3068788573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f49a806b1f0 msgr2=0x7f49a806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:03.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f49a806b1f0 0x7f49a806d6b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f49b800a810 tx=0x7f49b8008040 comp rx=0 tx=0).stop 2023-11-27T20:45:03.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 -- 172.21.15.91:0/3068788573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c80c0440 msgr2=0x7f49c8144d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:03.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c80c0440 0x7f49c8144d80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f49b000b4a0 tx=0x7f49b000b960 comp rx=0 tx=0).stop 2023-11-27T20:45:03.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 -- 172.21.15.91:0/3068788573 shutdown_connections 2023-11-27T20:45:03.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f49a806b1f0 0x7f49a806d6b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49c814c2e0 0x7f49c81452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c80c0440 0x7f49c8144d80 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 --2- 172.21.15.91:0/3068788573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49c8072310 0x7f49c80aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:03.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 -- 172.21.15.91:0/3068788573 >> 172.21.15.91:0/3068788573 conn(0x7f49c80a77f0 msgr2=0x7f49c80c24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:03.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 -- 172.21.15.91:0/3068788573 shutdown_connections 2023-11-27T20:45:03.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:03.867+0000 7f49c759e640 1 -- 172.21.15.91:0/3068788573 wait complete. 2023-11-27T20:45:03.887 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T20:45:03.888 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T20:45:04.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.099+0000 7fab9d843640 1 Processor -- start 2023-11-27T20:45:04.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.099+0000 7fab9d843640 1 -- start start 2023-11-27T20:45:04.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.100+0000 7fab9d843640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab980c4180 0x7fab98071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.100+0000 7fab9d843640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980a9560 con 0x7fab980aa940 2023-11-27T20:45:04.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.100+0000 7fab9d843640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980a9820 con 0x7fab980c4660 2023-11-27T20:45:04.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.100+0000 7fab9d843640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab980c3120 con 0x7fab980c4180 2023-11-27T20:45:04.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.101+0000 7fab96ffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fab980aa940 0x7fab980a9cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:48854/0 (socket says 172.21.15.91:48854) 2023-11-27T20:45:04.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.101+0000 7fab96ffd640 1 -- 172.21.15.91:0/927297754 learned_addr learned my addr 172.21.15.91:0/927297754 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.101+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007409478 0 0) 0x7fab980a9560 con 0x7fab980aa940 2023-11-27T20:45:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.101+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab80003520 con 0x7fab980aa940 2023-11-27T20:45:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.101+0000 7fab977fe640 1 --2- 172.21.15.91:0/927297754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab980c4180 0x7fab98071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126630329 0 0) 0x7fab80003520 con 0x7fab980aa940 2023-11-27T20:45:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab980c4180 msgr2=0x7fab98071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 --2- 172.21.15.91:0/927297754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab980c4180 0x7fab98071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 >> v1:172.21.15.183:6789/0 conn(0x7fab980c4660 legacy=0x7fab9815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980c4b50 con 0x7fab980aa940 2023-11-27T20:45:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fab88001670 con 0x7fab980aa940 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 >> v1:172.21.15.91:6789/0 conn(0x7fab980aa940 legacy=0x7fab980a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 --2- 172.21.15.91:0/927297754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 0x7fab80003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 --2- 172.21.15.91:0/927297754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab980c4180 0x7fab800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 --2- 172.21.15.91:0/927297754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab80004d00 0x7fab80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980c3120 con 0x7fab800039a0 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8000bc00 con 0x7fab80004d00 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8000bdc0 con 0x7fab980c4180 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab96ffd640 1 --2- 172.21.15.91:0/927297754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 0x7fab80003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab96ffd640 1 -- 172.21.15.91:0/927297754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab980c4180 msgr2=0x7fab800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab96ffd640 1 --2- 172.21.15.91:0/927297754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab980c4180 0x7fab800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab96ffd640 1 -- 172.21.15.91:0/927297754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab80004d00 msgr2=0x7fab80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab96ffd640 1 --2- 172.21.15.91:0/927297754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab80004d00 0x7fab80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.102+0000 7fab96ffd640 1 -- 172.21.15.91:0/927297754 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80003520 con 0x7fab800039a0 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.103+0000 7fab96ffd640 1 --2- 172.21.15.91:0/927297754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 0x7fab80003dc0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c0e0 tx=0x7fab800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871a74449726ff6d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.104+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88005ad0 con 0x7fab800039a0 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.104+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab88005c30 con 0x7fab800039a0 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.104+0000 7fab95ffb640 1 -- 172.21.15.91:0/927297754 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8802c810 con 0x7fab800039a0 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.104+0000 7fab9d843640 1 -- 172.21.15.91:0/927297754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 msgr2=0x7fab80003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.104+0000 7fab9d843640 1 --2- 172.21.15.91:0/927297754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 0x7fab80003dc0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c0e0 tx=0x7fab800057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.104+0000 7fab977fe640 1 -- 172.21.15.91:0/927297754 reap_dead start 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.104+0000 7fab9d843640 1 -- 172.21.15.91:0/927297754 shutdown_connections 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.104+0000 7fab9d843640 1 -- 172.21.15.91:0/927297754 >> 172.21.15.91:0/927297754 conn(0x7fab980c5bc0 msgr2=0x7fab980c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.104+0000 7fab9d843640 1 -- 172.21.15.91:0/927297754 shutdown_connections 2023-11-27T20:45:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.104+0000 7fab9d843640 1 -- 172.21.15.91:0/927297754 wait complete. 2023-11-27T20:45:04.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.106+0000 7fab9d843640 1 Processor -- start 2023-11-27T20:45:04.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.106+0000 7fab9d843640 1 -- start start 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.107+0000 7fab9d843640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 0x7fab981cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.107+0000 7fab9d843640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab981cd3a0 0x7fab981ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.107+0000 7fab9d843640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab981ea5e0 0x7fab980a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.107+0000 7fab9d843640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab981cd820 con 0x7fab800039a0 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.107+0000 7fab9d843640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980a8620 con 0x7fab981ea5e0 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.107+0000 7fab9d843640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab981d6b20 con 0x7fab981cd3a0 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.108+0000 7fab96ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 0x7fab981cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.108+0000 7fab96ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 0x7fab981cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51966/0 (socket says 172.21.15.91:51966) 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.108+0000 7fab96ffd640 1 -- 172.21.15.91:0/1295847801 learned_addr learned my addr 172.21.15.91:0/1295847801 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.108+0000 7fab967fc640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab981cd3a0 0x7fab981ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:04.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.108+0000 7fab96ffd640 1 -- 172.21.15.91:0/1295847801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab981cd3a0 msgr2=0x7fab981ea0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.108+0000 7fab96ffd640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab981cd3a0 0x7fab981ea0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.108+0000 7fab96ffd640 1 -- 172.21.15.91:0/1295847801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab981ea5e0 msgr2=0x7fab980a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.108+0000 7fab96ffd640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab981ea5e0 0x7fab980a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.108+0000 7fab96ffd640 1 -- 172.21.15.91:0/1295847801 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab981d6dc0 con 0x7fab800039a0 2023-11-27T20:45:04.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.108+0000 7fab96ffd640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 0x7fab981cce60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c0e0 tx=0x7fab88001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:04.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.109+0000 7fab7ffff640 1 -- 172.21.15.91:0/1295847801 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8803c040 con 0x7fab800039a0 2023-11-27T20:45:04.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.109+0000 7fab7ffff640 1 -- 172.21.15.91:0/1295847801 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8802dcb0 con 0x7fab800039a0 2023-11-27T20:45:04.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.109+0000 7fab7ffff640 1 -- 172.21.15.91:0/1295847801 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88007270 con 0x7fab800039a0 2023-11-27T20:45:04.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.109+0000 7fab9d843640 1 -- 172.21.15.91:0/1295847801 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab981d70a0 con 0x7fab800039a0 2023-11-27T20:45:04.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.109+0000 7fab9d843640 1 -- 172.21.15.91:0/1295847801 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab980a7030 con 0x7fab800039a0 2023-11-27T20:45:04.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.110+0000 7fab9d843640 1 -- 172.21.15.91:0/1295847801 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab98067950 con 0x7fab800039a0 2023-11-27T20:45:04.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.111+0000 7fab7ffff640 1 -- 172.21.15.91:0/1295847801 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fab88032070 con 0x7fab800039a0 2023-11-27T20:45:04.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.112+0000 7fab7ffff640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fab8406b1f0 0x7fab8406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.112+0000 7fab7ffff640 1 -- 172.21.15.91:0/1295847801 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab880ab190 con 0x7fab800039a0 2023-11-27T20:45:04.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.112+0000 7fab967fc640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fab8406b1f0 0x7fab8406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:04.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.113+0000 7fab967fc640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fab8406b1f0 0x7fab8406d6b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fab981d5e30 tx=0x7fab8c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:04.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.116+0000 7fab7ffff640 1 -- 172.21.15.91:0/1295847801 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fab88076200 con 0x7fab800039a0 2023-11-27T20:45:04.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.307+0000 7fab9d843640 1 -- 172.21.15.91:0/1295847801 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fab980a71c0 con 0x7fab800039a0 2023-11-27T20:45:04.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.598+0000 7fab7ffff640 1 -- 172.21.15.91:0/1295847801 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) v1 ==== 138+0+0 (secure 0 0 0) 0x7fab88079820 con 0x7fab800039a0 2023-11-27T20:45:04.600 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' created 2023-11-27T20:45:04.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.602+0000 7fab9d843640 1 -- 172.21.15.91:0/1295847801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fab8406b1f0 msgr2=0x7fab8406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.602+0000 7fab9d843640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fab8406b1f0 0x7fab8406d6b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fab981d5e30 tx=0x7fab8c009040 comp rx=0 tx=0).stop 2023-11-27T20:45:04.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.602+0000 7fab9d843640 1 -- 172.21.15.91:0/1295847801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 msgr2=0x7fab981cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.602+0000 7fab9d843640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 0x7fab981cce60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c0e0 tx=0x7fab88001930 comp rx=0 tx=0).stop 2023-11-27T20:45:04.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.602+0000 7fab9d843640 1 -- 172.21.15.91:0/1295847801 shutdown_connections 2023-11-27T20:45:04.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.602+0000 7fab9d843640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fab8406b1f0 0x7fab8406d6b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.602+0000 7fab9d843640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab981ea5e0 0x7fab980a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.602+0000 7fab9d843640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab981cd3a0 0x7fab981ea0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.602+0000 7fab9d843640 1 --2- 172.21.15.91:0/1295847801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fab800039a0 0x7fab981cce60 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.602+0000 7fab9d843640 1 -- 172.21.15.91:0/1295847801 >> 172.21.15.91:0/1295847801 conn(0x7fab980c5bc0 msgr2=0x7fab980c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:04.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.603+0000 7fab9d843640 1 -- 172.21.15.91:0/1295847801 shutdown_connections 2023-11-27T20:45:04.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.603+0000 7fab9d843640 1 -- 172.21.15.91:0/1295847801 wait complete. 2023-11-27T20:45:04.631 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T20:45:04.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.829+0000 7fe3816da640 1 Processor -- start 2023-11-27T20:45:04.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.830+0000 7fe3816da640 1 -- start start 2023-11-27T20:45:04.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.831+0000 7fe3816da640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe37c14c2e0 0x7fe37c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.831+0000 7fe3816da640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe37c0c0440 0x7fe37c152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.831+0000 7fe3816da640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c071e80 con 0x7fe37c072310 2023-11-27T20:45:04.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.831+0000 7fe3816da640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c071470 con 0x7fe37c14c2e0 2023-11-27T20:45:04.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.831+0000 7fe3816da640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c14c6c0 con 0x7fe37c0c0440 2023-11-27T20:45:04.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.832+0000 7fe37bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe37c14c2e0 0x7fe37c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:04.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.832+0000 7fe37bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe37c14c2e0 0x7fe37c0c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51974/0 (socket says 172.21.15.91:51974) 2023-11-27T20:45:04.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.832+0000 7fe37bfff640 1 -- 172.21.15.91:0/94523474 learned_addr learned my addr 172.21.15.91:0/94523474 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:04.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.832+0000 7fe373fff640 1 --2- 172.21.15.91:0/94523474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe37c0c0440 0x7fe37c152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:04.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.832+0000 7fe37bfff640 1 -- 172.21.15.91:0/94523474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe37c0c0440 msgr2=0x7fe37c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:04.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.832+0000 7fe37bfff640 1 --2- 172.21.15.91:0/94523474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe37c0c0440 0x7fe37c152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.832+0000 7fe37bfff640 1 -- 172.21.15.91:0/94523474 >> v1:172.21.15.183:6789/0 conn(0x7fe37c072310 legacy=0x7fe37c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.832+0000 7fe37bfff640 1 -- 172.21.15.91:0/94523474 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c153180 con 0x7fe37c14c2e0 2023-11-27T20:45:04.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.834+0000 7fe37bfff640 1 --2- 172.21.15.91:0/94523474 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c14c2e0 0x7fe37c0c0c80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009870 tx=0x7fe36c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c732379fc6fe0f6b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:04.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.834+0000 7fe37b7fe640 1 -- 172.21.15.91:0/94523474 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0317c0 con 0x7fe37c14c2e0 2023-11-27T20:45:04.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.835+0000 7fe37b7fe640 1 -- 172.21.15.91:0/94523474 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c031920 con 0x7fe37c14c2e0 2023-11-27T20:45:04.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.835+0000 7fe37b7fe640 1 -- 172.21.15.91:0/94523474 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c031cb0 con 0x7fe37c14c2e0 2023-11-27T20:45:04.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.835+0000 7fe3816da640 1 -- 172.21.15.91:0/94523474 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c14c2e0 msgr2=0x7fe37c0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.835+0000 7fe3816da640 1 --2- 172.21.15.91:0/94523474 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c14c2e0 0x7fe37c0c0c80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009870 tx=0x7fe36c02b860 comp rx=0 tx=0).stop 2023-11-27T20:45:04.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.835+0000 7fe3816da640 1 -- 172.21.15.91:0/94523474 shutdown_connections 2023-11-27T20:45:04.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.835+0000 7fe3816da640 1 --2- 172.21.15.91:0/94523474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe37c0c0440 0x7fe37c152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.835+0000 7fe3816da640 1 --2- 172.21.15.91:0/94523474 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c14c2e0 0x7fe37c0c0c80 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.835+0000 7fe3816da640 1 -- 172.21.15.91:0/94523474 >> 172.21.15.91:0/94523474 conn(0x7fe37c0a77f0 msgr2=0x7fe37c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:04.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.835+0000 7fe3816da640 1 -- 172.21.15.91:0/94523474 shutdown_connections 2023-11-27T20:45:04.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.835+0000 7fe3816da640 1 -- 172.21.15.91:0/94523474 wait complete. 2023-11-27T20:45:04.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.837+0000 7fe3816da640 1 Processor -- start 2023-11-27T20:45:04.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.837+0000 7fe3816da640 1 -- start start 2023-11-27T20:45:04.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.838+0000 7fe3816da640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe37c072310 0x7fe37c152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.838+0000 7fe3816da640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c0c0440 0x7fe37c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.838+0000 7fe3816da640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe37c14c2e0 0x7fe37c154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.838+0000 7fe3816da640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c153860 con 0x7fe37c0c0440 2023-11-27T20:45:04.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.838+0000 7fe3816da640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c153b40 con 0x7fe37c072310 2023-11-27T20:45:04.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.838+0000 7fe3816da640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c152d90 con 0x7fe37c14c2e0 2023-11-27T20:45:04.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.838+0000 7fe373fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c0c0440 0x7fe37c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:04.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.838+0000 7fe373fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c0c0440 0x7fe37c153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51990/0 (socket says 172.21.15.91:51990) 2023-11-27T20:45:04.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.838+0000 7fe373fff640 1 -- 172.21.15.91:0/534159156 learned_addr learned my addr 172.21.15.91:0/534159156 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:04.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.839+0000 7fe373fff640 1 -- 172.21.15.91:0/534159156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe37c14c2e0 msgr2=0x7fe37c154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.839+0000 7fe373fff640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe37c14c2e0 0x7fe37c154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.839+0000 7fe373fff640 1 -- 172.21.15.91:0/534159156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe37c072310 msgr2=0x7fe37c152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:04.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.839+0000 7fe373fff640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe37c072310 0x7fe37c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:04.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.839+0000 7fe373fff640 1 -- 172.21.15.91:0/534159156 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c0094d0 con 0x7fe37c0c0440 2023-11-27T20:45:04.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.839+0000 7fe373fff640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c0c0440 0x7fe37c153fd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fe36400d830 tx=0x7fe36400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:04.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.839+0000 7fe3797fa640 1 -- 172.21.15.91:0/534159156 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400b6c0 con 0x7fe37c0c0440 2023-11-27T20:45:04.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.839+0000 7fe3797fa640 1 -- 172.21.15.91:0/534159156 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36400b820 con 0x7fe37c0c0440 2023-11-27T20:45:04.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.839+0000 7fe3816da640 1 -- 172.21.15.91:0/534159156 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37c150d70 con 0x7fe37c0c0440 2023-11-27T20:45:04.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.839+0000 7fe3797fa640 1 -- 172.21.15.91:0/534159156 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400bbb0 con 0x7fe37c0c0440 2023-11-27T20:45:04.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.840+0000 7fe3816da640 1 -- 172.21.15.91:0/534159156 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37c1512e0 con 0x7fe37c0c0440 2023-11-27T20:45:04.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.840+0000 7fe3816da640 1 -- 172.21.15.91:0/534159156 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37c04e840 con 0x7fe37c0c0440 2023-11-27T20:45:04.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.842+0000 7fe3797fa640 1 -- 172.21.15.91:0/534159156 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe36401e460 con 0x7fe37c0c0440 2023-11-27T20:45:04.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.843+0000 7fe3797fa640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe36006b1c0 0x7fe36006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:04.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.844+0000 7fe3797fa640 1 -- 172.21.15.91:0/534159156 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe36408ab00 con 0x7fe37c0c0440 2023-11-27T20:45:04.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.844+0000 7fe37bfff640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe36006b1c0 0x7fe36006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:04.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.844+0000 7fe37bfff640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe36006b1c0 0x7fe36006d680 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe36c036000 tx=0x7fe36c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:04.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:04.847+0000 7fe3797fa640 1 -- 172.21.15.91:0/534159156 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe3640559f0 con 0x7fe37c0c0440 2023-11-27T20:45:05.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.038+0000 7fe3816da640 1 -- 172.21.15.91:0/534159156 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe37c153c80 con 0x7fe37c0c0440 2023-11-27T20:45:05.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.604+0000 7fe3797fa640 1 -- 172.21.15.91:0/534159156 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe364059010 con 0x7fe37c0c0440 2023-11-27T20:45:05.606 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' created 2023-11-27T20:45:05.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.607+0000 7fe3816da640 1 -- 172.21.15.91:0/534159156 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe36006b1c0 msgr2=0x7fe36006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:05.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.607+0000 7fe3816da640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe36006b1c0 0x7fe36006d680 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe36c036000 tx=0x7fe36c030000 comp rx=0 tx=0).stop 2023-11-27T20:45:05.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.608+0000 7fe3816da640 1 -- 172.21.15.91:0/534159156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c0c0440 msgr2=0x7fe37c153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:05.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.608+0000 7fe3816da640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c0c0440 0x7fe37c153fd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fe36400d830 tx=0x7fe36400dcf0 comp rx=0 tx=0).stop 2023-11-27T20:45:05.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.608+0000 7fe3816da640 1 -- 172.21.15.91:0/534159156 shutdown_connections 2023-11-27T20:45:05.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.608+0000 7fe3816da640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe37c14c2e0 0x7fe37c154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:05.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.608+0000 7fe3816da640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe37c0c0440 0x7fe37c153fd0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:05.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.608+0000 7fe3816da640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe36006b1c0 0x7fe36006d680 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:05.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.608+0000 7fe3816da640 1 --2- 172.21.15.91:0/534159156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe37c072310 0x7fe37c152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:05.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.608+0000 7fe3816da640 1 -- 172.21.15.91:0/534159156 >> 172.21.15.91:0/534159156 conn(0x7fe37c0a77f0 msgr2=0x7fe37c0c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:05.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.608+0000 7fe3816da640 1 -- 172.21.15.91:0/534159156 shutdown_connections 2023-11-27T20:45:05.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.608+0000 7fe3816da640 1 -- 172.21.15.91:0/534159156 wait complete. 2023-11-27T20:45:05.643 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T20:45:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.827+0000 7fb68da8c640 1 Processor -- start 2023-11-27T20:45:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.827+0000 7fb68da8c640 1 -- start start 2023-11-27T20:45:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.829+0000 7fb68da8c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb68806cd20 0x7fb68815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.829+0000 7fb68da8c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6880a8380 con 0x7fb68814e7f0 2023-11-27T20:45:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.829+0000 7fb68da8c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6881510b0 con 0x7fb6880c52e0 2023-11-27T20:45:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.829+0000 7fb68da8c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68806bf60 con 0x7fb68806cd20 2023-11-27T20:45:05.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.829+0000 7fb68ca8a640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb68814e7f0 0x7fb6880c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:48862/0 (socket says 172.21.15.91:48862) 2023-11-27T20:45:05.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.829+0000 7fb68ca8a640 1 -- 172.21.15.91:0/222521934 learned_addr learned my addr 172.21.15.91:0/222521934 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:05.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.829+0000 7fb68d28b640 1 --2- 172.21.15.91:0/222521934 >> v2:172.21.15.91:3300/0 conn(0x7fb68806cd20 0x7fb68815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:05.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.830+0000 7fb68d28b640 1 -- 172.21.15.91:0/222521934 >> v1:172.21.15.183:6789/0 conn(0x7fb6880c52e0 legacy=0x7fb68806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:05.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.830+0000 7fb68d28b640 1 -- 172.21.15.91:0/222521934 >> v1:172.21.15.91:6789/0 conn(0x7fb68814e7f0 legacy=0x7fb6880c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:05.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.830+0000 7fb68d28b640 1 -- 172.21.15.91:0/222521934 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68806c240 con 0x7fb68806cd20 2023-11-27T20:45:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.831+0000 7fb68d28b640 1 --2- 172.21.15.91:0/222521934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 0x7fb68815ca40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb680009d90 tx=0x7fb68002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92560a98548f22 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.831+0000 7fb6877fe640 1 -- 172.21.15.91:0/222521934 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68002cbd0 con 0x7fb68806cd20 2023-11-27T20:45:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.831+0000 7fb6877fe640 1 -- 172.21.15.91:0/222521934 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68002cd30 con 0x7fb68806cd20 2023-11-27T20:45:05.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.831+0000 7fb6877fe640 1 -- 172.21.15.91:0/222521934 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68002cea0 con 0x7fb68806cd20 2023-11-27T20:45:05.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.832+0000 7fb68da8c640 1 -- 172.21.15.91:0/222521934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 msgr2=0x7fb68815ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:05.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.832+0000 7fb68da8c640 1 --2- 172.21.15.91:0/222521934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 0x7fb68815ca40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb680009d90 tx=0x7fb68002be20 comp rx=0 tx=0).stop 2023-11-27T20:45:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.832+0000 7fb68da8c640 1 -- 172.21.15.91:0/222521934 shutdown_connections 2023-11-27T20:45:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.832+0000 7fb68da8c640 1 --2- 172.21.15.91:0/222521934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 0x7fb68815ca40 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.832+0000 7fb68da8c640 1 -- 172.21.15.91:0/222521934 >> 172.21.15.91:0/222521934 conn(0x7fb6880a77f0 msgr2=0x7fb6880a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.832+0000 7fb68da8c640 1 -- 172.21.15.91:0/222521934 shutdown_connections 2023-11-27T20:45:05.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.832+0000 7fb68da8c640 1 -- 172.21.15.91:0/222521934 wait complete. 2023-11-27T20:45:05.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.834+0000 7fb68da8c640 1 Processor -- start 2023-11-27T20:45:05.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.834+0000 7fb68da8c640 1 -- start start 2023-11-27T20:45:05.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.835+0000 7fb68da8c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 0x7fb6880a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:05.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.835+0000 7fb68da8c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6880c52e0 0x7fb68814c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:05.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.835+0000 7fb68da8c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb68814e7f0 0x7fb68814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:05.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.835+0000 7fb68da8c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb688148ec0 con 0x7fb68806cd20 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.835+0000 7fb68da8c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68814c150 con 0x7fb68814e7f0 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.835+0000 7fb68da8c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68814d610 con 0x7fb6880c52e0 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.835+0000 7fb68ca8a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 0x7fb6880a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.835+0000 7fb68ca8a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 0x7fb6880a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:51998/0 (socket says 172.21.15.91:51998) 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.835+0000 7fb68ca8a640 1 -- 172.21.15.91:0/1812883422 learned_addr learned my addr 172.21.15.91:0/1812883422 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb68d28b640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb68814e7f0 0x7fb68814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb687fff640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6880c52e0 0x7fb68814c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb68ca8a640 1 -- 172.21.15.91:0/1812883422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6880c52e0 msgr2=0x7fb68814c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb68ca8a640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6880c52e0 0x7fb68814c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb68ca8a640 1 -- 172.21.15.91:0/1812883422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb68814e7f0 msgr2=0x7fb68814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:05.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb68ca8a640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb68814e7f0 0x7fb68814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:05.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb68ca8a640 1 -- 172.21.15.91:0/1812883422 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb680009a70 con 0x7fb68806cd20 2023-11-27T20:45:05.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb687fff640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6880c52e0 0x7fb68814c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:05.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb68ca8a640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 0x7fb6880a6920 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00c480 tx=0x7fb67c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:05.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb6857fa640 1 -- 172.21.15.91:0/1812883422 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c005ce0 con 0x7fb68806cd20 2023-11-27T20:45:05.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb6857fa640 1 -- 172.21.15.91:0/1812883422 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c005e40 con 0x7fb68806cd20 2023-11-27T20:45:05.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.836+0000 7fb6857fa640 1 -- 172.21.15.91:0/1812883422 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0072f0 con 0x7fb68806cd20 2023-11-27T20:45:05.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.837+0000 7fb68da8c640 1 -- 172.21.15.91:0/1812883422 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68814d8f0 con 0x7fb68806cd20 2023-11-27T20:45:05.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.837+0000 7fb68da8c640 1 -- 172.21.15.91:0/1812883422 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68814deb0 con 0x7fb68806cd20 2023-11-27T20:45:05.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.838+0000 7fb68da8c640 1 -- 172.21.15.91:0/1812883422 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68804e840 con 0x7fb68806cd20 2023-11-27T20:45:05.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.839+0000 7fb6857fa640 1 -- 172.21.15.91:0/1812883422 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb67c007510 con 0x7fb68806cd20 2023-11-27T20:45:05.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.840+0000 7fb6857fa640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb66c06b1c0 0x7fb66c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:05.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.840+0000 7fb6857fa640 1 -- 172.21.15.91:0/1812883422 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb67c088e20 con 0x7fb68806cd20 2023-11-27T20:45:05.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.840+0000 7fb687fff640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb66c06b1c0 0x7fb66c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:05.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.841+0000 7fb687fff640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb66c06b1c0 0x7fb66c06d680 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb6880c1010 tx=0x7fb674009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:05.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:05.845+0000 7fb6857fa640 1 -- 172.21.15.91:0/1812883422 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb67c053cf0 con 0x7fb68806cd20 2023-11-27T20:45:06.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.070+0000 7fb68da8c640 1 -- 172.21.15.91:0/1812883422 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb6880704d0 con 0x7fb68806cd20 2023-11-27T20:45:06.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.641+0000 7fb6857fa640 1 -- 172.21.15.91:0/1812883422 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb67c017020 con 0x7fb68806cd20 2023-11-27T20:45:06.643 INFO:teuthology.orchestra.run.smithi091.stderr:new fs with metadata pool 12 and data pool 13 2023-11-27T20:45:06.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.644+0000 7fb68da8c640 1 -- 172.21.15.91:0/1812883422 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb66c06b1c0 msgr2=0x7fb66c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:06.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.644+0000 7fb68da8c640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb66c06b1c0 0x7fb66c06d680 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb6880c1010 tx=0x7fb674009040 comp rx=0 tx=0).stop 2023-11-27T20:45:06.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.644+0000 7fb68da8c640 1 -- 172.21.15.91:0/1812883422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 msgr2=0x7fb6880a6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:06.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.644+0000 7fb68da8c640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 0x7fb6880a6920 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00c480 tx=0x7fb67c00c940 comp rx=0 tx=0).stop 2023-11-27T20:45:06.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.644+0000 7fb68da8c640 1 -- 172.21.15.91:0/1812883422 shutdown_connections 2023-11-27T20:45:06.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.645+0000 7fb68da8c640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb66c06b1c0 0x7fb66c06d680 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:06.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.645+0000 7fb68da8c640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb68814e7f0 0x7fb68814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:06.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.645+0000 7fb68da8c640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6880c52e0 0x7fb68814c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:06.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.645+0000 7fb68da8c640 1 --2- 172.21.15.91:0/1812883422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb68806cd20 0x7fb6880a6920 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:06.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.645+0000 7fb68da8c640 1 -- 172.21.15.91:0/1812883422 >> 172.21.15.91:0/1812883422 conn(0x7fb6880a77f0 msgr2=0x7fb6880c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:06.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.645+0000 7fb68da8c640 1 -- 172.21.15.91:0/1812883422 shutdown_connections 2023-11-27T20:45:06.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.645+0000 7fb68da8c640 1 -- 172.21.15.91:0/1812883422 wait complete. 2023-11-27T20:45:06.673 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:06.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.862+0000 7fc47989a640 1 Processor -- start 2023-11-27T20:45:06.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.862+0000 7fc47989a640 1 -- start start 2023-11-27T20:45:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.864+0000 7fc47989a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc47414e7f0 0x7fc4740c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:06.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.864+0000 7fc47989a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc47406cd20 0x7fc47415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.864+0000 7fc47989a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4740a8380 con 0x7fc4740c52e0 2023-11-27T20:45:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.864+0000 7fc47989a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4741510b0 con 0x7fc47414e7f0 2023-11-27T20:45:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.864+0000 7fc47989a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47406bf60 con 0x7fc47406cd20 2023-11-27T20:45:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.864+0000 7fc478898640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc47414e7f0 0x7fc4740c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.864+0000 7fc478898640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc47414e7f0 0x7fc4740c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52012/0 (socket says 172.21.15.91:52012) 2023-11-27T20:45:06.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.864+0000 7fc478898640 1 -- 172.21.15.91:0/903873259 learned_addr learned my addr 172.21.15.91:0/903873259 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.864+0000 7fc479099640 1 --2- 172.21.15.91:0/903873259 >> v2:172.21.15.183:3300/0 conn(0x7fc47406cd20 0x7fc47415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.865+0000 7fc478898640 1 -- 172.21.15.91:0/903873259 >> v2:172.21.15.183:3300/0 conn(0x7fc47406cd20 msgr2=0x7fc47415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.865+0000 7fc478898640 1 --2- 172.21.15.91:0/903873259 >> v2:172.21.15.183:3300/0 conn(0x7fc47406cd20 0x7fc47415ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.865+0000 7fc478898640 1 -- 172.21.15.91:0/903873259 >> v1:172.21.15.91:6789/0 conn(0x7fc4740c52e0 legacy=0x7fc47406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:06.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.865+0000 7fc478898640 1 -- 172.21.15.91:0/903873259 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47406c240 con 0x7fc47414e7f0 2023-11-27T20:45:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.866+0000 7fc478898640 1 --2- 172.21.15.91:0/903873259 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 0x7fc4740c0440 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc4740c1f50 tx=0x7fc46802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7617a6a73d1fa44c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.866+0000 7fc4737fe640 1 -- 172.21.15.91:0/903873259 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468031870 con 0x7fc47414e7f0 2023-11-27T20:45:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.866+0000 7fc4737fe640 1 -- 172.21.15.91:0/903873259 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4680319d0 con 0x7fc47414e7f0 2023-11-27T20:45:06.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.866+0000 7fc4737fe640 1 -- 172.21.15.91:0/903873259 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468031d60 con 0x7fc47414e7f0 2023-11-27T20:45:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.867+0000 7fc47989a640 1 -- 172.21.15.91:0/903873259 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 msgr2=0x7fc4740c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.867+0000 7fc47989a640 1 --2- 172.21.15.91:0/903873259 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 0x7fc4740c0440 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc4740c1f50 tx=0x7fc46802b910 comp rx=0 tx=0).stop 2023-11-27T20:45:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.867+0000 7fc47989a640 1 -- 172.21.15.91:0/903873259 shutdown_connections 2023-11-27T20:45:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.867+0000 7fc47989a640 1 --2- 172.21.15.91:0/903873259 >> v2:172.21.15.183:3300/0 conn(0x7fc47406cd20 0x7fc47415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.867+0000 7fc47989a640 1 --2- 172.21.15.91:0/903873259 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 0x7fc4740c0440 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.867+0000 7fc47989a640 1 -- 172.21.15.91:0/903873259 >> 172.21.15.91:0/903873259 conn(0x7fc4740a77f0 msgr2=0x7fc4740a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.867+0000 7fc47989a640 1 -- 172.21.15.91:0/903873259 shutdown_connections 2023-11-27T20:45:06.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.867+0000 7fc47989a640 1 -- 172.21.15.91:0/903873259 wait complete. 2023-11-27T20:45:06.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.869+0000 7fc47989a640 1 Processor -- start 2023-11-27T20:45:06.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.869+0000 7fc47989a640 1 -- start start 2023-11-27T20:45:06.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.870+0000 7fc47989a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc47406cd20 0x7fc4741505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:06.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.870+0000 7fc47989a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4740c52e0 0x7fc4741e47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:06.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.870+0000 7fc47989a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 0x7fc4741e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:06.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.870+0000 7fc47989a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741ebad0 con 0x7fc47414e7f0 2023-11-27T20:45:06.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.870+0000 7fc47989a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741e5230 con 0x7fc47406cd20 2023-11-27T20:45:06.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.870+0000 7fc47989a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740ab3e0 con 0x7fc4740c52e0 2023-11-27T20:45:06.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.870+0000 7fc479099640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 0x7fc4741e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:06.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.870+0000 7fc479099640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 0x7fc4741e4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52014/0 (socket says 172.21.15.91:52014) 2023-11-27T20:45:06.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.870+0000 7fc479099640 1 -- 172.21.15.91:0/718471580 learned_addr learned my addr 172.21.15.91:0/718471580 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:06.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc479099640 1 -- 172.21.15.91:0/718471580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4740c52e0 msgr2=0x7fc4741e47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:06.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc479099640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4740c52e0 0x7fc4741e47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:06.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc479099640 1 -- 172.21.15.91:0/718471580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc47406cd20 msgr2=0x7fc4741505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:06.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc479099640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc47406cd20 0x7fc4741505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:06.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc479099640 1 -- 172.21.15.91:0/718471580 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680094d0 con 0x7fc47414e7f0 2023-11-27T20:45:06.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc479099640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 0x7fc4741e4cf0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc46c007e40 tx=0x7fc46c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:06.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc4717fa640 1 -- 172.21.15.91:0/718471580 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c014620 con 0x7fc47414e7f0 2023-11-27T20:45:06.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc4717fa640 1 -- 172.21.15.91:0/718471580 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c00ee90 con 0x7fc47414e7f0 2023-11-27T20:45:06.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc4717fa640 1 -- 172.21.15.91:0/718471580 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0149e0 con 0x7fc47414e7f0 2023-11-27T20:45:06.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc47989a640 1 -- 172.21.15.91:0/718471580 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4741eaec0 con 0x7fc47414e7f0 2023-11-27T20:45:06.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.871+0000 7fc47989a640 1 -- 172.21.15.91:0/718471580 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4741eb480 con 0x7fc47414e7f0 2023-11-27T20:45:06.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.872+0000 7fc47989a640 1 -- 172.21.15.91:0/718471580 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47404e840 con 0x7fc47414e7f0 2023-11-27T20:45:06.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.873+0000 7fc4717fa640 1 -- 172.21.15.91:0/718471580 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc46c014b40 con 0x7fc47414e7f0 2023-11-27T20:45:06.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.874+0000 7fc4717fa640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc45806b1c0 0x7fc45806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:06.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.875+0000 7fc4717fa640 1 -- 172.21.15.91:0/718471580 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc46c08a460 con 0x7fc47414e7f0 2023-11-27T20:45:06.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.875+0000 7fc478898640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc45806b1c0 0x7fc45806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:06.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.875+0000 7fc478898640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc45806b1c0 0x7fc45806d680 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc468036000 tx=0x7fc468030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:06.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:06.879+0000 7fc4717fa640 1 -- 172.21.15.91:0/718471580 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc46c055190 con 0x7fc47414e7f0 2023-11-27T20:45:07.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.072+0000 7fc47989a640 1 -- 172.21.15.91:0/718471580 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4741ebc10 con 0x7fc47414e7f0 2023-11-27T20:45:07.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.074+0000 7fc4717fa640 1 -- 172.21.15.91:0/718471580 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16538 (secure 0 0 0) 0x7fc46c0587b0 con 0x7fc47414e7f0 2023-11-27T20:45:07.075 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:07.076 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":74,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:06.072200+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:07.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 -- 172.21.15.91:0/718471580 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc45806b1c0 msgr2=0x7fc45806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc45806b1c0 0x7fc45806d680 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc468036000 tx=0x7fc468030000 comp rx=0 tx=0).stop 2023-11-27T20:45:07.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 -- 172.21.15.91:0/718471580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 msgr2=0x7fc4741e4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 0x7fc4741e4cf0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc46c007e40 tx=0x7fc46c00e4b0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 -- 172.21.15.91:0/718471580 shutdown_connections 2023-11-27T20:45:07.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc47414e7f0 0x7fc4741e4cf0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4740c52e0 0x7fc4741e47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc45806b1c0 0x7fc45806d680 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 --2- 172.21.15.91:0/718471580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc47406cd20 0x7fc4741505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 -- 172.21.15.91:0/718471580 >> 172.21.15.91:0/718471580 conn(0x7fc4740a77f0 msgr2=0x7fc47406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:07.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 -- 172.21.15.91:0/718471580 shutdown_connections 2023-11-27T20:45:07.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.077+0000 7fc47989a640 1 -- 172.21.15.91:0/718471580 wait complete. 2023-11-27T20:45:07.097 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:07.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.304+0000 7f2567036640 1 Processor -- start 2023-11-27T20:45:07.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.305+0000 7f2567036640 1 -- start start 2023-11-27T20:45:07.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.306+0000 7f2567036640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f256014fd30 0x7f2560152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.306+0000 7f2567036640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f25600c3ea0 0x7f25600c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.306+0000 7f2567036640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25600c64a0 con 0x7f256006d0a0 2023-11-27T20:45:07.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.306+0000 7f2567036640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25600c5c00 con 0x7f256014fd30 2023-11-27T20:45:07.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.306+0000 7f2567036640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25600c5ee0 con 0x7f25600c3ea0 2023-11-27T20:45:07.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.306+0000 7f2564dd2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f256014fd30 0x7f2560152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:07.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.306+0000 7f2564dd2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f256014fd30 0x7f2560152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52016/0 (socket says 172.21.15.91:52016) 2023-11-27T20:45:07.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.306+0000 7f2564dd2640 1 -- 172.21.15.91:0/1601385084 learned_addr learned my addr 172.21.15.91:0/1601385084 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:07.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.307+0000 7f25655d3640 1 --2- 172.21.15.91:0/1601385084 >> v2:172.21.15.183:3300/0 conn(0x7f25600c3ea0 0x7f25600c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:07.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.307+0000 7f2564dd2640 1 -- 172.21.15.91:0/1601385084 >> v2:172.21.15.183:3300/0 conn(0x7f25600c3ea0 msgr2=0x7f25600c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:07.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.307+0000 7f2564dd2640 1 --2- 172.21.15.91:0/1601385084 >> v2:172.21.15.183:3300/0 conn(0x7f25600c3ea0 0x7f25600c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.307+0000 7f2564dd2640 1 -- 172.21.15.91:0/1601385084 >> v1:172.21.15.91:6789/0 conn(0x7f256006d0a0 legacy=0x7f25600a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.307+0000 7f2564dd2640 1 -- 172.21.15.91:0/1601385084 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600c61c0 con 0x7f256014fd30 2023-11-27T20:45:07.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.308+0000 7f2564dd2640 1 --2- 172.21.15.91:0/1601385084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f256014fd30 0x7f2560152f20 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f256006e430 tx=0x7f255002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77db496cdbf7c3b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:07.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.308+0000 7f255f7fe640 1 -- 172.21.15.91:0/1601385084 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255002cb10 con 0x7f256014fd30 2023-11-27T20:45:07.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.308+0000 7f255f7fe640 1 -- 172.21.15.91:0/1601385084 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255002cc70 con 0x7f256014fd30 2023-11-27T20:45:07.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.308+0000 7f255f7fe640 1 -- 172.21.15.91:0/1601385084 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500343f0 con 0x7f256014fd30 2023-11-27T20:45:07.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.309+0000 7f2567036640 1 -- 172.21.15.91:0/1601385084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f256014fd30 msgr2=0x7f2560152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.309+0000 7f2567036640 1 --2- 172.21.15.91:0/1601385084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f256014fd30 0x7f2560152f20 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f256006e430 tx=0x7f255002bf70 comp rx=0 tx=0).stop 2023-11-27T20:45:07.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.309+0000 7f2567036640 1 -- 172.21.15.91:0/1601385084 shutdown_connections 2023-11-27T20:45:07.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.309+0000 7f2567036640 1 --2- 172.21.15.91:0/1601385084 >> v2:172.21.15.183:3300/0 conn(0x7f25600c3ea0 0x7f25600c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.309+0000 7f2567036640 1 --2- 172.21.15.91:0/1601385084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f256014fd30 0x7f2560152f20 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.309+0000 7f2567036640 1 -- 172.21.15.91:0/1601385084 >> 172.21.15.91:0/1601385084 conn(0x7f256006a500 msgr2=0x7f256006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:07.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.309+0000 7f2567036640 1 -- 172.21.15.91:0/1601385084 shutdown_connections 2023-11-27T20:45:07.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.309+0000 7f2567036640 1 -- 172.21.15.91:0/1601385084 wait complete. 2023-11-27T20:45:07.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.311+0000 7f2567036640 1 Processor -- start 2023-11-27T20:45:07.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.311+0000 7f2567036640 1 -- start start 2023-11-27T20:45:07.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.312+0000 7f2567036640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f256006d0a0 0x7f25600c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.312+0000 7f2567036640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25600c3ea0 0x7f256014ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.312+0000 7f2567036640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f256014fd30 0x7f256014f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.312+0000 7f2567036640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600bdf30 con 0x7f25600c3ea0 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.312+0000 7f2567036640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600be210 con 0x7f256014fd30 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.312+0000 7f2567036640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600be4f0 con 0x7f256006d0a0 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.312+0000 7f255ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25600c3ea0 0x7f256014ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.312+0000 7f255ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25600c3ea0 0x7f256014ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52026/0 (socket says 172.21.15.91:52026) 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.312+0000 7f255ffff640 1 -- 172.21.15.91:0/2190563284 learned_addr learned my addr 172.21.15.91:0/2190563284 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.312+0000 7f2564dd2640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f256006d0a0 0x7f25600c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f255ffff640 1 -- 172.21.15.91:0/2190563284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f256006d0a0 msgr2=0x7f25600c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f255ffff640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f256006d0a0 0x7f25600c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f255ffff640 1 -- 172.21.15.91:0/2190563284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f256014fd30 msgr2=0x7f256014f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f255ffff640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f256014fd30 0x7f256014f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f255ffff640 1 -- 172.21.15.91:0/2190563284 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2550009b30 con 0x7f25600c3ea0 2023-11-27T20:45:07.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f2564dd2640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f256006d0a0 0x7f25600c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:07.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f255ffff640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25600c3ea0 0x7f256014ef50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f254800c3c0 tx=0x7f254800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:07.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f255d7fa640 1 -- 172.21.15.91:0/2190563284 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480052d0 con 0x7f25600c3ea0 2023-11-27T20:45:07.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f255d7fa640 1 -- 172.21.15.91:0/2190563284 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548005450 con 0x7f25600c3ea0 2023-11-27T20:45:07.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f2567036640 1 -- 172.21.15.91:0/2190563284 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25600c2740 con 0x7f25600c3ea0 2023-11-27T20:45:07.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f255d7fa640 1 -- 172.21.15.91:0/2190563284 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548003830 con 0x7f25600c3ea0 2023-11-27T20:45:07.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.313+0000 7f2567036640 1 -- 172.21.15.91:0/2190563284 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25601ebd70 con 0x7f25600c3ea0 2023-11-27T20:45:07.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.315+0000 7f2567036640 1 -- 172.21.15.91:0/2190563284 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2560068350 con 0x7f25600c3ea0 2023-11-27T20:45:07.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.316+0000 7f255d7fa640 1 -- 172.21.15.91:0/2190563284 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2548003990 con 0x7f25600c3ea0 2023-11-27T20:45:07.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.316+0000 7f255d7fa640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f254006b1c0 0x7f254006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.317+0000 7f255d7fa640 1 -- 172.21.15.91:0/2190563284 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2548088e60 con 0x7f25600c3ea0 2023-11-27T20:45:07.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.317+0000 7f2564dd2640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f254006b1c0 0x7f254006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:07.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.318+0000 7f2564dd2640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f254006b1c0 0x7f254006d680 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2550035000 tx=0x7f2550030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:07.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.321+0000 7f255d7fa640 1 -- 172.21.15.91:0/2190563284 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2548053c20 con 0x7f25600c3ea0 2023-11-27T20:45:07.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.513+0000 7f2567036640 1 -- 172.21.15.91:0/2190563284 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25600c66d0 con 0x7f25600c3ea0 2023-11-27T20:45:07.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.516+0000 7f255d7fa640 1 -- 172.21.15.91:0/2190563284 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16525 (secure 0 0 0) 0x7f2548017090 con 0x7f25600c3ea0 2023-11-27T20:45:07.518 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:07.518 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":75,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:07.238139+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:07.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.519+0000 7f2567036640 1 -- 172.21.15.91:0/2190563284 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f254006b1c0 msgr2=0x7f254006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.519+0000 7f2567036640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f254006b1c0 0x7f254006d680 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2550035000 tx=0x7f2550030000 comp rx=0 tx=0).stop 2023-11-27T20:45:07.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.519+0000 7f2567036640 1 -- 172.21.15.91:0/2190563284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25600c3ea0 msgr2=0x7f256014ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.519+0000 7f2567036640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25600c3ea0 0x7f256014ef50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f254800c3c0 tx=0x7f254800c880 comp rx=0 tx=0).stop 2023-11-27T20:45:07.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.519+0000 7f2567036640 1 -- 172.21.15.91:0/2190563284 shutdown_connections 2023-11-27T20:45:07.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.519+0000 7f2567036640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f254006b1c0 0x7f254006d680 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.519+0000 7f2567036640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f256014fd30 0x7f256014f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.519+0000 7f2567036640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25600c3ea0 0x7f256014ef50 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.519+0000 7f2567036640 1 --2- 172.21.15.91:0/2190563284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f256006d0a0 0x7f25600c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.519+0000 7f2567036640 1 -- 172.21.15.91:0/2190563284 >> 172.21.15.91:0/2190563284 conn(0x7f256006a500 msgr2=0x7f256006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:07.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.520+0000 7f2567036640 1 -- 172.21.15.91:0/2190563284 shutdown_connections 2023-11-27T20:45:07.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.520+0000 7f2567036640 1 -- 172.21.15.91:0/2190563284 wait complete. 2023-11-27T20:45:07.541 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T20:45:07.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.758+0000 7f3ef637c640 1 Processor -- start 2023-11-27T20:45:07.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.758+0000 7f3ef637c640 1 -- start start 2023-11-27T20:45:07.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.759+0000 7f3ef637c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3ef00a9b40 0x7f3ef00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.759+0000 7f3ef637c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef00c1500 0x7f3ef00c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.759+0000 7f3ef637c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef00c06c0 con 0x7f3ef0155490 2023-11-27T20:45:07.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.759+0000 7f3ef637c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef00a5820 con 0x7f3ef00a9b40 2023-11-27T20:45:07.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.759+0000 7f3ef637c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00c1020 con 0x7f3ef00c1500 2023-11-27T20:45:07.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.759+0000 7f3ee7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3ef00a9b40 0x7f3ef00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:07.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.760+0000 7f3ee7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3ef00a9b40 0x7f3ef00a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52028/0 (socket says 172.21.15.91:52028) 2023-11-27T20:45:07.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.760+0000 7f3ee7fff640 1 -- 172.21.15.91:0/2888610201 learned_addr learned my addr 172.21.15.91:0/2888610201 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:07.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.760+0000 7f3ee7fff640 1 -- 172.21.15.91:0/2888610201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef00c1500 msgr2=0x7f3ef00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:07.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.760+0000 7f3ee7fff640 1 --2- 172.21.15.91:0/2888610201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef00c1500 0x7f3ef00c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.760+0000 7f3ee7fff640 1 -- 172.21.15.91:0/2888610201 >> v1:172.21.15.91:6789/0 conn(0x7f3ef0155490 legacy=0x7f3ef00a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.760+0000 7f3ee7fff640 1 -- 172.21.15.91:0/2888610201 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef00c0910 con 0x7f3ef00a9b40 2023-11-27T20:45:07.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.761+0000 7f3ee7fff640 1 --2- 172.21.15.91:0/2888610201 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00a9b40 0x7f3ef00a51b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009870 tx=0x7f3ed802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dedb8ad0c39f412 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:07.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.761+0000 7f3eef7fe640 1 -- 172.21.15.91:0/2888610201 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8030860 con 0x7f3ef00a9b40 2023-11-27T20:45:07.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.762+0000 7f3eef7fe640 1 -- 172.21.15.91:0/2888610201 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed80309c0 con 0x7f3ef00a9b40 2023-11-27T20:45:07.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.762+0000 7f3eef7fe640 1 -- 172.21.15.91:0/2888610201 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8030d50 con 0x7f3ef00a9b40 2023-11-27T20:45:07.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.762+0000 7f3ef637c640 1 -- 172.21.15.91:0/2888610201 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00a9b40 msgr2=0x7f3ef00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.762+0000 7f3ef637c640 1 --2- 172.21.15.91:0/2888610201 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00a9b40 0x7f3ef00a51b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009870 tx=0x7f3ed802b9a0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.762+0000 7f3ef637c640 1 -- 172.21.15.91:0/2888610201 shutdown_connections 2023-11-27T20:45:07.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.762+0000 7f3ef637c640 1 --2- 172.21.15.91:0/2888610201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef00c1500 0x7f3ef00c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.762+0000 7f3ef637c640 1 --2- 172.21.15.91:0/2888610201 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00a9b40 0x7f3ef00a51b0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.762+0000 7f3ef637c640 1 -- 172.21.15.91:0/2888610201 >> 172.21.15.91:0/2888610201 conn(0x7f3ef006a500 msgr2=0x7f3ef006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:07.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.762+0000 7f3ef637c640 1 -- 172.21.15.91:0/2888610201 shutdown_connections 2023-11-27T20:45:07.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.762+0000 7f3ef637c640 1 -- 172.21.15.91:0/2888610201 wait complete. 2023-11-27T20:45:07.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.764+0000 7f3ef637c640 1 Processor -- start 2023-11-27T20:45:07.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.764+0000 7f3ef637c640 1 -- start start 2023-11-27T20:45:07.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.765+0000 7f3ef637c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00c1500 0x7f3ef014b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.765+0000 7f3ef637c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef0155490 0x7f3ef0147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.765+0000 7f3ef637c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef0148690 0x7f3ef0147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.765+0000 7f3ef637c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef01e8d20 con 0x7f3ef00c1500 2023-11-27T20:45:07.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.765+0000 7f3ef637c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef014c380 con 0x7f3ef0148690 2023-11-27T20:45:07.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.765+0000 7f3ef637c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef0149940 con 0x7f3ef0155490 2023-11-27T20:45:07.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.765+0000 7f3eeffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00c1500 0x7f3ef014b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:07.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.765+0000 7f3eeffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00c1500 0x7f3ef014b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52030/0 (socket says 172.21.15.91:52030) 2023-11-27T20:45:07.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.765+0000 7f3eeffff640 1 -- 172.21.15.91:0/1464253959 learned_addr learned my addr 172.21.15.91:0/1464253959 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:07.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3ee7fff640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef0155490 0x7f3ef0147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:07.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3ef4919640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef0148690 0x7f3ef0147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:07.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3eeffff640 1 -- 172.21.15.91:0/1464253959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef0155490 msgr2=0x7f3ef0147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3eeffff640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef0155490 0x7f3ef0147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3eeffff640 1 -- 172.21.15.91:0/1464253959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef0148690 msgr2=0x7f3ef0147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:07.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3eeffff640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef0148690 0x7f3ef0147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:07.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3eeffff640 1 -- 172.21.15.91:0/1464253959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80094d0 con 0x7f3ef00c1500 2023-11-27T20:45:07.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3eeffff640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00c1500 0x7f3ef014b890 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c400 tx=0x7f3ee000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:07.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3eed7fa640 1 -- 172.21.15.91:0/1464253959 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee00052d0 con 0x7f3ef00c1500 2023-11-27T20:45:07.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3eed7fa640 1 -- 172.21.15.91:0/1464253959 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0005430 con 0x7f3ef00c1500 2023-11-27T20:45:07.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3eed7fa640 1 -- 172.21.15.91:0/1464253959 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0003830 con 0x7f3ef00c1500 2023-11-27T20:45:07.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.766+0000 7f3ef637c640 1 -- 172.21.15.91:0/1464253959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef01484c0 con 0x7f3ef00c1500 2023-11-27T20:45:07.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.767+0000 7f3ef637c640 1 -- 172.21.15.91:0/1464253959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef01492f0 con 0x7f3ef00c1500 2023-11-27T20:45:07.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.768+0000 7f3ef637c640 1 -- 172.21.15.91:0/1464253959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef0149150 con 0x7f3ef00c1500 2023-11-27T20:45:07.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.769+0000 7f3eed7fa640 1 -- 172.21.15.91:0/1464253959 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3ee0003990 con 0x7f3ef00c1500 2023-11-27T20:45:07.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.769+0000 7f3eed7fa640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3ed006b1c0 0x7f3ed006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:07.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.769+0000 7f3eed7fa640 1 -- 172.21.15.91:0/1464253959 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ee0088f90 con 0x7f3ef00c1500 2023-11-27T20:45:07.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.770+0000 7f3ee7fff640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3ed006b1c0 0x7f3ed006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:07.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.771+0000 7f3ee7fff640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3ed006b1c0 0x7f3ed006d680 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8036000 tx=0x7f3ed8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:07.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.774+0000 7f3eed7fa640 1 -- 172.21.15.91:0/1464253959 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3ef0149150 con 0x7f3ef00c1500 2023-11-27T20:45:07.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:07.995+0000 7f3ef637c640 1 -- 172.21.15.91:0/1464253959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3ef0149150 con 0x7f3ef00c1500 2023-11-27T20:45:08.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.669+0000 7f3eed7fa640 1 -- 172.21.15.91:0/1464253959 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3ef0149150 con 0x7f3ef00c1500 2023-11-27T20:45:08.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.672+0000 7f3ef637c640 1 -- 172.21.15.91:0/1464253959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3ed006b1c0 msgr2=0x7f3ed006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:08.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.672+0000 7f3ef637c640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3ed006b1c0 0x7f3ed006d680 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8036000 tx=0x7f3ed8008030 comp rx=0 tx=0).stop 2023-11-27T20:45:08.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.672+0000 7f3ef637c640 1 -- 172.21.15.91:0/1464253959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00c1500 msgr2=0x7f3ef014b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:08.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.672+0000 7f3ef637c640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00c1500 0x7f3ef014b890 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c400 tx=0x7f3ee000c8c0 comp rx=0 tx=0).stop 2023-11-27T20:45:08.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.672+0000 7f3ef637c640 1 -- 172.21.15.91:0/1464253959 shutdown_connections 2023-11-27T20:45:08.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.672+0000 7f3ef637c640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3ed006b1c0 0x7f3ed006d680 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:08.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.672+0000 7f3ef637c640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef0148690 0x7f3ef0147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:08.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.672+0000 7f3ef637c640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef0155490 0x7f3ef0147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:08.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.672+0000 7f3ef637c640 1 --2- 172.21.15.91:0/1464253959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ef00c1500 0x7f3ef014b890 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:08.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.672+0000 7f3ef637c640 1 -- 172.21.15.91:0/1464253959 >> 172.21.15.91:0/1464253959 conn(0x7f3ef006a500 msgr2=0x7f3ef00c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:08.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.673+0000 7f3ef637c640 1 -- 172.21.15.91:0/1464253959 shutdown_connections 2023-11-27T20:45:08.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.673+0000 7f3ef637c640 1 -- 172.21.15.91:0/1464253959 wait complete. 2023-11-27T20:45:08.694 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T20:45:08.694 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T20:45:08.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.890+0000 7efee5e9a640 1 Processor -- start 2023-11-27T20:45:08.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.890+0000 7efee5e9a640 1 -- start start 2023-11-27T20:45:08.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.891+0000 7efee5e9a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efee00ca450 0x7efee00ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:08.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.891+0000 7efee5e9a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee0158a60 con 0x7efee0154580 2023-11-27T20:45:08.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.891+0000 7efee5e9a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00c4dd0 con 0x7efee014e7c0 2023-11-27T20:45:08.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.891+0000 7efee5e9a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee00c5b10 con 0x7efee00ca450 2023-11-27T20:45:08.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.891+0000 7efedffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efee00ca450 0x7efee00ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:08.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.891+0000 7efedffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efee00ca450 0x7efee00ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52042/0 (socket says 172.21.15.91:52042) 2023-11-27T20:45:08.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.891+0000 7efedffff640 1 -- 172.21.15.91:0/3049679275 learned_addr learned my addr 172.21.15.91:0/3049679275 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:08.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.892+0000 7efedffff640 1 -- 172.21.15.91:0/3049679275 >> v1:172.21.15.183:6789/0 conn(0x7efee014e7c0 legacy=0x7efee00c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:08.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.892+0000 7efedffff640 1 -- 172.21.15.91:0/3049679275 >> v1:172.21.15.91:6789/0 conn(0x7efee0154580 legacy=0x7efee01549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:08.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.892+0000 7efedffff640 1 -- 172.21.15.91:0/3049679275 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee0157ca0 con 0x7efee00ca450 2023-11-27T20:45:08.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.892+0000 7efedf7fe640 1 -- 172.21.15.91:0/3049679275 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239836147 0 0) 0x7efee0158a60 con 0x7efee0154580 2023-11-27T20:45:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.893+0000 7efedffff640 1 --2- 172.21.15.91:0/3049679275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee00ca450 0x7efee00ca8d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7efecc009870 tx=0x7efecc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d61027e425df1c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.893+0000 7efedf7fe640 1 -- 172.21.15.91:0/3049679275 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc0317e0 con 0x7efee00ca450 2023-11-27T20:45:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.893+0000 7efedf7fe640 1 -- 172.21.15.91:0/3049679275 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc031940 con 0x7efee00ca450 2023-11-27T20:45:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.893+0000 7efedf7fe640 1 -- 172.21.15.91:0/3049679275 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc031cd0 con 0x7efee00ca450 2023-11-27T20:45:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.893+0000 7efee5e9a640 1 -- 172.21.15.91:0/3049679275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee00ca450 msgr2=0x7efee00ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.893+0000 7efee5e9a640 1 --2- 172.21.15.91:0/3049679275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee00ca450 0x7efee00ca8d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7efecc009870 tx=0x7efecc02b880 comp rx=0 tx=0).stop 2023-11-27T20:45:08.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.894+0000 7efee5e9a640 1 -- 172.21.15.91:0/3049679275 shutdown_connections 2023-11-27T20:45:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.894+0000 7efee5e9a640 1 --2- 172.21.15.91:0/3049679275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee00ca450 0x7efee00ca8d0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.894+0000 7efee5e9a640 1 -- 172.21.15.91:0/3049679275 >> 172.21.15.91:0/3049679275 conn(0x7efee00abf00 msgr2=0x7efee00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.894+0000 7efee5e9a640 1 -- 172.21.15.91:0/3049679275 shutdown_connections 2023-11-27T20:45:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.894+0000 7efee5e9a640 1 -- 172.21.15.91:0/3049679275 wait complete. 2023-11-27T20:45:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.895+0000 7efee5e9a640 1 Processor -- start 2023-11-27T20:45:08.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.895+0000 7efee5e9a640 1 -- start start 2023-11-27T20:45:08.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.896+0000 7efee5e9a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efee00ca450 0x7efee0155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:08.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.896+0000 7efee5e9a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee014e7c0 0x7efee01ed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:08.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.896+0000 7efee5e9a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efee0154580 0x7efee01536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:08.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.896+0000 7efee5e9a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee01ed380 con 0x7efee014e7c0 2023-11-27T20:45:08.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.896+0000 7efee5e9a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee01577e0 con 0x7efee0154580 2023-11-27T20:45:08.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.896+0000 7efee5e9a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee0157220 con 0x7efee00ca450 2023-11-27T20:45:08.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.896+0000 7efedffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee014e7c0 0x7efee01ed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:08.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.896+0000 7efedffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee014e7c0 0x7efee01ed7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52054/0 (socket says 172.21.15.91:52054) 2023-11-27T20:45:08.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.896+0000 7efedffff640 1 -- 172.21.15.91:0/333867258 learned_addr learned my addr 172.21.15.91:0/333867258 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:08.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efedffff640 1 -- 172.21.15.91:0/333867258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efee00ca450 msgr2=0x7efee0155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efedffff640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efee00ca450 0x7efee0155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efedffff640 1 -- 172.21.15.91:0/333867258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efee0154580 msgr2=0x7efee01536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efee5699640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efee0154580 0x7efee01536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efedffff640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efee0154580 0x7efee01536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efedffff640 1 -- 172.21.15.91:0/333867258 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0094d0 con 0x7efee014e7c0 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efedffff640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee014e7c0 0x7efee01ed7a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7efecc034040 tx=0x7efecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efedd7fa640 1 -- 172.21.15.91:0/333867258 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc004220 con 0x7efee014e7c0 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efedd7fa640 1 -- 172.21.15.91:0/333867258 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc004380 con 0x7efee014e7c0 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efee5e9a640 1 -- 172.21.15.91:0/333867258 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee0157500 con 0x7efee014e7c0 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.897+0000 7efedd7fa640 1 -- 172.21.15.91:0/333867258 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc003850 con 0x7efee014e7c0 2023-11-27T20:45:08.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.898+0000 7efee5e9a640 1 -- 172.21.15.91:0/333867258 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee01560a0 con 0x7efee014e7c0 2023-11-27T20:45:08.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.899+0000 7efee5e9a640 1 -- 172.21.15.91:0/333867258 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee01ed5f0 con 0x7efee014e7c0 2023-11-27T20:45:08.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.900+0000 7efedd7fa640 1 -- 172.21.15.91:0/333867258 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efecc043070 con 0x7efee014e7c0 2023-11-27T20:45:08.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.900+0000 7efedd7fa640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efec406b1f0 0x7efec406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:08.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.901+0000 7efedd7fa640 1 -- 172.21.15.91:0/333867258 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efecc0ab8c0 con 0x7efee014e7c0 2023-11-27T20:45:08.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.901+0000 7efee4e98640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efec406b1f0 0x7efec406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:08.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.901+0000 7efee4e98640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efec406b1f0 0x7efec406d6b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efed4006fd0 tx=0x7efed4006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:08.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:08.906+0000 7efedd7fa640 1 -- 172.21.15.91:0/333867258 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efecc076560 con 0x7efee014e7c0 2023-11-27T20:45:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.131+0000 7efee5e9a640 1 -- 172.21.15.91:0/333867258 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efee01ed5f0 con 0x7efee014e7c0 2023-11-27T20:45:09.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.680+0000 7efedd7fa640 1 -- 172.21.15.91:0/333867258 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7efecc0ab070 con 0x7efee014e7c0 2023-11-27T20:45:09.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 -- 172.21.15.91:0/333867258 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efec406b1f0 msgr2=0x7efec406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:09.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efec406b1f0 0x7efec406d6b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efed4006fd0 tx=0x7efed4006bc0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 -- 172.21.15.91:0/333867258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee014e7c0 msgr2=0x7efee01ed7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:09.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee014e7c0 0x7efee01ed7a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7efecc034040 tx=0x7efecc0046c0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 -- 172.21.15.91:0/333867258 shutdown_connections 2023-11-27T20:45:09.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efec406b1f0 0x7efec406d6b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efee0154580 0x7efee01536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee014e7c0 0x7efee01ed7a0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 --2- 172.21.15.91:0/333867258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efee00ca450 0x7efee0155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 -- 172.21.15.91:0/333867258 >> 172.21.15.91:0/333867258 conn(0x7efee00abf00 msgr2=0x7efee0149e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:09.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 -- 172.21.15.91:0/333867258 shutdown_connections 2023-11-27T20:45:09.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.684+0000 7efee5e9a640 1 -- 172.21.15.91:0/333867258 wait complete. 2023-11-27T20:45:09.704 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T20:45:09.704 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:45:09.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.910+0000 7f00b9327640 1 Processor -- start 2023-11-27T20:45:09.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.910+0000 7f00b9327640 1 -- start start 2023-11-27T20:45:09.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.911+0000 7f00b9327640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f00b406cd20 0x7f00b415ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:09.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.911+0000 7f00b9327640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b40a8380 con 0x7f00b40c52e0 2023-11-27T20:45:09.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.911+0000 7f00b9327640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b41510b0 con 0x7f00b414e7f0 2023-11-27T20:45:09.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.911+0000 7f00b9327640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b406bf60 con 0x7f00b406cd20 2023-11-27T20:45:09.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00abfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f00b40c52e0 0x7f00b406d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:48906/0 (socket says 172.21.15.91:48906) 2023-11-27T20:45:09.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00abfff640 1 -- 172.21.15.91:0/3464786888 learned_addr learned my addr 172.21.15.91:0/3464786888 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644996887 0 0) 0x7f00b40a8380 con 0x7f00b40c52e0 2023-11-27T20:45:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00a0003520 con 0x7f00b40c52e0 2023-11-27T20:45:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2855187075 0 0) 0x7f00a0003520 con 0x7f00b40c52e0 2023-11-27T20:45:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 >> v2:172.21.15.183:3300/0 conn(0x7f00b406cd20 msgr2=0x7f00b415ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b8b26640 1 --2- 172.21.15.91:0/3464786888 >> v2:172.21.15.183:3300/0 conn(0x7f00b406cd20 0x7f00b415ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b37fe640 1 --2- 172.21.15.91:0/3464786888 >> v2:172.21.15.183:3300/0 conn(0x7f00b406cd20 0x7f00b415ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 >> v1:172.21.15.183:6789/0 conn(0x7f00b414e7f0 legacy=0x7f00b40c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b406c240 con 0x7f00b40c52e0 2023-11-27T20:45:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f009c001670 con 0x7f00b40c52e0 2023-11-27T20:45:09.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b8b26640 1 --2- 172.21.15.91:0/3464786888 >> v2:172.21.15.183:3300/0 conn(0x7f00b406cd20 0x7f00b415ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 >> v1:172.21.15.91:6789/0 conn(0x7f00b40c52e0 legacy=0x7f00b406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.912+0000 7f00b37fe640 1 --2- 172.21.15.91:0/3464786888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00a0003970 0x7f00a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b37fe640 1 --2- 172.21.15.91:0/3464786888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a00047c0 0x7f00a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b37fe640 1 --2- 172.21.15.91:0/3464786888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00a0005380 0x7f00a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b406bf60 con 0x7f00a0003970 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a000c240 con 0x7f00a00047c0 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a000c400 con 0x7f00a0005380 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b3fff640 1 --2- 172.21.15.91:0/3464786888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00a0003970 0x7f00a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b3fff640 1 -- 172.21.15.91:0/3464786888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00a0005380 msgr2=0x7f00a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b3fff640 1 --2- 172.21.15.91:0/3464786888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00a0005380 0x7f00a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b3fff640 1 -- 172.21.15.91:0/3464786888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a00047c0 msgr2=0x7f00a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:09.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b3fff640 1 --2- 172.21.15.91:0/3464786888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a00047c0 0x7f00a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b3fff640 1 -- 172.21.15.91:0/3464786888 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0003520 con 0x7f00a0003970 2023-11-27T20:45:09.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.913+0000 7f00b8b26640 1 -- 172.21.15.91:0/3464786888 reap_dead start 2023-11-27T20:45:09.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.914+0000 7f00b3fff640 1 --2- 172.21.15.91:0/3464786888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00a0003970 0x7f00a0003d90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f00a4001750 tx=0x7f00a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a263b546f6986f49 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:09.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.914+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a40052d0 con 0x7f00a0003970 2023-11-27T20:45:09.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.914+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a402e050 con 0x7f00a0003970 2023-11-27T20:45:09.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.914+0000 7f00b37fe640 1 -- 172.21.15.91:0/3464786888 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4003830 con 0x7f00a0003970 2023-11-27T20:45:09.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.915+0000 7f00b9327640 1 -- 172.21.15.91:0/3464786888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00a0003970 msgr2=0x7f00a0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:09.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.915+0000 7f00b9327640 1 --2- 172.21.15.91:0/3464786888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00a0003970 0x7f00a0003d90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f00a4001750 tx=0x7f00a00057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.915+0000 7f00b9327640 1 -- 172.21.15.91:0/3464786888 shutdown_connections 2023-11-27T20:45:09.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.915+0000 7f00b9327640 1 --2- 172.21.15.91:0/3464786888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00a0003970 0x7f00a0003d90 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.915+0000 7f00b9327640 1 -- 172.21.15.91:0/3464786888 >> 172.21.15.91:0/3464786888 conn(0x7f00b40a77f0 msgr2=0x7f00b40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:09.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.915+0000 7f00b9327640 1 -- 172.21.15.91:0/3464786888 shutdown_connections 2023-11-27T20:45:09.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.915+0000 7f00b9327640 1 -- 172.21.15.91:0/3464786888 wait complete. 2023-11-27T20:45:09.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.917+0000 7f00b9327640 1 Processor -- start 2023-11-27T20:45:09.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.917+0000 7f00b9327640 1 -- start start 2023-11-27T20:45:09.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b9327640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a0003970 0x7f00b4147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:09.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b9327640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00b414c010 0x7f00b41e0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:09.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b9327640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00b41e9fc0 0x7f00b41ea440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:09.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b9327640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b4149850 con 0x7f00b41e9fc0 2023-11-27T20:45:09.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b9327640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b41484c0 con 0x7f00a0003970 2023-11-27T20:45:09.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b9327640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b414ae60 con 0x7f00b414c010 2023-11-27T20:45:09.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b8b26640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00b41e9fc0 0x7f00b41ea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:09.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b8b26640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00b41e9fc0 0x7f00b41ea440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52074/0 (socket says 172.21.15.91:52074) 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b8b26640 1 -- 172.21.15.91:0/3243315933 learned_addr learned my addr 172.21.15.91:0/3243315933 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b8b26640 1 -- 172.21.15.91:0/3243315933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00b414c010 msgr2=0x7f00b41e0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b8b26640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00b414c010 0x7f00b41e0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b8b26640 1 -- 172.21.15.91:0/3243315933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a0003970 msgr2=0x7f00b4147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b8b26640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a0003970 0x7f00b4147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.918+0000 7f00b8b26640 1 -- 172.21.15.91:0/3243315933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4150e80 con 0x7f00b41e9fc0 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.919+0000 7f00b8b26640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00b41e9fc0 0x7f00b41ea440 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f00b40703c0 tx=0x7f00ac00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.919+0000 7f00b17fa640 1 -- 172.21.15.91:0/3243315933 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac015440 con 0x7f00b41e9fc0 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.919+0000 7f00b17fa640 1 -- 172.21.15.91:0/3243315933 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac0155a0 con 0x7f00b41e9fc0 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.919+0000 7f00b17fa640 1 -- 172.21.15.91:0/3243315933 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac015910 con 0x7f00b41e9fc0 2023-11-27T20:45:09.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.919+0000 7f00b9327640 1 -- 172.21.15.91:0/3243315933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b4150ba0 con 0x7f00b41e9fc0 2023-11-27T20:45:09.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.919+0000 7f00b9327640 1 -- 172.21.15.91:0/3243315933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b41e11a0 con 0x7f00b41e9fc0 2023-11-27T20:45:09.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.920+0000 7f00b9327640 1 -- 172.21.15.91:0/3243315933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b414a930 con 0x7f00b41e9fc0 2023-11-27T20:45:09.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.921+0000 7f00b17fa640 1 -- 172.21.15.91:0/3243315933 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f00ac00d430 con 0x7f00b41e9fc0 2023-11-27T20:45:09.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.922+0000 7f00b17fa640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f009406b1f0 0x7f009406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:09.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.922+0000 7f00b17fa640 1 -- 172.21.15.91:0/3243315933 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00ac089e50 con 0x7f00b41e9fc0 2023-11-27T20:45:09.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.922+0000 7f00b3fff640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f009406b1f0 0x7f009406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:09.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.923+0000 7f00b3fff640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f009406b1f0 0x7f009406d6b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f00a4033000 tx=0x7f00a402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:09.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:09.926+0000 7f00b17fa640 1 -- 172.21.15.91:0/3243315933 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f00ac054c20 con 0x7f00b41e9fc0 2023-11-27T20:45:10.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.135+0000 7f00b9327640 1 -- 172.21.15.91:0/3243315933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00b414b010 con 0x7f00b41e9fc0 2023-11-27T20:45:10.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.136+0000 7f00b17fa640 1 -- 172.21.15.91:0/3243315933 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f00b414b010 con 0x7f00b41e9fc0 2023-11-27T20:45:10.137 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:10.137 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1761528163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1761528163},{"type":"v1","addr":"172.21.15.91:6837","nonce":1761528163}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:06.072742+0000","modified":"2023-11-27T20:45:09.133844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/2103536114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":2103536114},{"type":"v1","addr":"172.21.15.183:6835","nonce":2103536114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-27T20:45:10.137 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 46 2023-11-27T20:45:10.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 -- 172.21.15.91:0/3243315933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f009406b1f0 msgr2=0x7f009406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f009406b1f0 0x7f009406d6b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f00a4033000 tx=0x7f00a402f000 comp rx=0 tx=0).stop 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 -- 172.21.15.91:0/3243315933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00b41e9fc0 msgr2=0x7f00b41ea440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00b41e9fc0 0x7f00b41ea440 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f00b40703c0 tx=0x7f00ac00a710 comp rx=0 tx=0).stop 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 -- 172.21.15.91:0/3243315933 shutdown_connections 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00b41e9fc0 0x7f00b41ea440 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00b414c010 0x7f00b41e0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f009406b1f0 0x7f009406d6b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 --2- 172.21.15.91:0/3243315933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a0003970 0x7f00b4147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 -- 172.21.15.91:0/3243315933 >> 172.21.15.91:0/3243315933 conn(0x7f00b40a77f0 msgr2=0x7f00b40c09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 -- 172.21.15.91:0/3243315933 shutdown_connections 2023-11-27T20:45:10.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.139+0000 7f00b9327640 1 -- 172.21.15.91:0/3243315933 wait complete. 2023-11-27T20:45:10.159 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:10.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.357+0000 7f8cf6e48640 1 Processor -- start 2023-11-27T20:45:10.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.357+0000 7f8cf6e48640 1 -- start start 2023-11-27T20:45:10.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.358+0000 7f8cf6e48640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8cf014fd30 0x7f8cf0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.358+0000 7f8cf6e48640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf00c64a0 con 0x7f8cf006d0a0 2023-11-27T20:45:10.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.358+0000 7f8cf6e48640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf00c5c00 con 0x7f8cf00c3ea0 2023-11-27T20:45:10.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.358+0000 7f8cf6e48640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00c5ee0 con 0x7f8cf014fd30 2023-11-27T20:45:10.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.359+0000 7f8ceffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8cf006d0a0 0x7f8cf00a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:48922/0 (socket says 172.21.15.91:48922) 2023-11-27T20:45:10.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.359+0000 7f8ceffff640 1 -- 172.21.15.91:0/1681331382 learned_addr learned my addr 172.21.15.91:0/1681331382 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:10.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.359+0000 7f8cf4be4640 1 --2- 172.21.15.91:0/1681331382 >> v2:172.21.15.183:3300/0 conn(0x7f8cf014fd30 0x7f8cf0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.359+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486272627 0 0) 0x7f8cf00c64a0 con 0x7f8cf006d0a0 2023-11-27T20:45:10.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.359+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce0003520 con 0x7f8cf006d0a0 2023-11-27T20:45:10.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2899823536 0 0) 0x7f8ce0003520 con 0x7f8cf006d0a0 2023-11-27T20:45:10.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 >> v2:172.21.15.183:3300/0 conn(0x7f8cf014fd30 msgr2=0x7f8cf0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:10.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 --2- 172.21.15.91:0/1681331382 >> v2:172.21.15.183:3300/0 conn(0x7f8cf014fd30 0x7f8cf0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 >> v1:172.21.15.183:6789/0 conn(0x7f8cf00c3ea0 legacy=0x7f8cf00c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00c61c0 con 0x7f8cf006d0a0 2023-11-27T20:45:10.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f8cdc001670 con 0x7f8cf006d0a0 2023-11-27T20:45:10.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 >> v1:172.21.15.91:6789/0 conn(0x7f8cf006d0a0 legacy=0x7f8cf00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ce0003970 0x7f8ce0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ce00047c0 0x7f8ce0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce0005180 0x7f8ce000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00c5ee0 con 0x7f8ce0003970 2023-11-27T20:45:10.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce000c020 con 0x7f8ce0005180 2023-11-27T20:45:10.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce000c1e0 con 0x7f8ce00047c0 2023-11-27T20:45:10.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cf4be4640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ce0003970 0x7f8ce0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8cf53e5640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce0005180 0x7f8ce000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.360+0000 7f8ceffff640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ce00047c0 0x7f8ce0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.361+0000 7f8cf4be4640 1 -- 172.21.15.91:0/1681331382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ce00047c0 msgr2=0x7f8ce0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:10.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.361+0000 7f8cf4be4640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ce00047c0 0x7f8ce0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.361+0000 7f8cf4be4640 1 -- 172.21.15.91:0/1681331382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce0005180 msgr2=0x7f8ce000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:10.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.361+0000 7f8cf4be4640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce0005180 0x7f8ce000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.361+0000 7f8cf4be4640 1 -- 172.21.15.91:0/1681331382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0003520 con 0x7f8ce0003970 2023-11-27T20:45:10.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.361+0000 7f8cf53e5640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce0005180 0x7f8ce000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:10.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.361+0000 7f8cf53e5640 1 -- 172.21.15.91:0/1681331382 reap_dead start 2023-11-27T20:45:10.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.362+0000 7f8cf4be4640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ce0003970 0x7f8ce0003d90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009ac0 tx=0x7f8ce00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70b05c0ed242553 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:10.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.362+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce402c6b0 con 0x7f8ce0003970 2023-11-27T20:45:10.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.362+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce402c810 con 0x7f8ce0003970 2023-11-27T20:45:10.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.362+0000 7f8cef7fe640 1 -- 172.21.15.91:0/1681331382 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce402cba0 con 0x7f8ce0003970 2023-11-27T20:45:10.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.363+0000 7f8cf6e48640 1 -- 172.21.15.91:0/1681331382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ce0003970 msgr2=0x7f8ce0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.363+0000 7f8cf6e48640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ce0003970 0x7f8ce0003d90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009ac0 tx=0x7f8ce00057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.363+0000 7f8cf6e48640 1 -- 172.21.15.91:0/1681331382 shutdown_connections 2023-11-27T20:45:10.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.363+0000 7f8cf6e48640 1 --2- 172.21.15.91:0/1681331382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ce0003970 0x7f8ce0003d90 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.363+0000 7f8cf6e48640 1 -- 172.21.15.91:0/1681331382 >> 172.21.15.91:0/1681331382 conn(0x7f8cf006a500 msgr2=0x7f8cf006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:10.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.363+0000 7f8cf6e48640 1 -- 172.21.15.91:0/1681331382 shutdown_connections 2023-11-27T20:45:10.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.363+0000 7f8cf6e48640 1 -- 172.21.15.91:0/1681331382 wait complete. 2023-11-27T20:45:10.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.365+0000 7f8cf6e48640 1 Processor -- start 2023-11-27T20:45:10.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.365+0000 7f8cf6e48640 1 -- start start 2023-11-27T20:45:10.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8cf6e48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ce0003970 0x7f8cf01dd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8cf6e48640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cf0150e00 0x7f8cf0151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8cf6e48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cf01517c0 0x7f8cf01ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8cf6e48640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf01dc2b0 con 0x7f8cf0150e00 2023-11-27T20:45:10.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8cf6e48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf01dbe20 con 0x7f8cf01517c0 2023-11-27T20:45:10.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8cf6e48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00aa560 con 0x7f8ce0003970 2023-11-27T20:45:10.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8ceffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cf0150e00 0x7f8cf0151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8ceffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cf0150e00 0x7f8cf0151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52088/0 (socket says 172.21.15.91:52088) 2023-11-27T20:45:10.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8ceffff640 1 -- 172.21.15.91:0/218012212 learned_addr learned my addr 172.21.15.91:0/218012212 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:10.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8cf4be4640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ce0003970 0x7f8cf01dd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8cf53e5640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cf01517c0 0x7f8cf01ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8ceffff640 1 -- 172.21.15.91:0/218012212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ce0003970 msgr2=0x7f8cf01dd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8ceffff640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ce0003970 0x7f8cf01dd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8ceffff640 1 -- 172.21.15.91:0/218012212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cf01517c0 msgr2=0x7f8cf01ed640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8ceffff640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cf01517c0 0x7f8cf01ed640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8ceffff640 1 -- 172.21.15.91:0/218012212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf01ddf60 con 0x7f8cf0150e00 2023-11-27T20:45:10.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.366+0000 7f8cf53e5640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cf01517c0 0x7f8cf01ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:10.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.367+0000 7f8ceffff640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cf0150e00 0x7f8cf0151280 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00d810 tx=0x7f8cdc00dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:10.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.367+0000 7f8ced7fa640 1 -- 172.21.15.91:0/218012212 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0074e0 con 0x7f8cf0150e00 2023-11-27T20:45:10.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.367+0000 7f8ced7fa640 1 -- 172.21.15.91:0/218012212 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc007640 con 0x7f8cf0150e00 2023-11-27T20:45:10.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.367+0000 7f8cf6e48640 1 -- 172.21.15.91:0/218012212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf006fe40 con 0x7f8cf0150e00 2023-11-27T20:45:10.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.367+0000 7f8ced7fa640 1 -- 172.21.15.91:0/218012212 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc004a20 con 0x7f8cf0150e00 2023-11-27T20:45:10.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.367+0000 7f8cf6e48640 1 -- 172.21.15.91:0/218012212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf01de240 con 0x7f8cf0150e00 2023-11-27T20:45:10.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.368+0000 7f8cf6e48640 1 -- 172.21.15.91:0/218012212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf0070360 con 0x7f8cf0150e00 2023-11-27T20:45:10.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.369+0000 7f8ced7fa640 1 -- 172.21.15.91:0/218012212 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8cdc004b80 con 0x7f8cf0150e00 2023-11-27T20:45:10.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.370+0000 7f8ced7fa640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8cd406b1f0 0x7f8cd406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.370+0000 7f8ced7fa640 1 -- 172.21.15.91:0/218012212 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cdc0896f0 con 0x7f8cf0150e00 2023-11-27T20:45:10.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.370+0000 7f8cf4be4640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8cd406b1f0 0x7f8cd406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.371+0000 7f8cf4be4640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8cd406b1f0 0x7f8cd406d6b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4036000 tx=0x7f8ce4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:10.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.374+0000 7f8ced7fa640 1 -- 172.21.15.91:0/218012212 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8cf0070360 con 0x7f8cf0150e00 2023-11-27T20:45:10.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.565+0000 7f8cf6e48640 1 -- 172.21.15.91:0/218012212 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cf0070080 con 0x7f8cf0150e00 2023-11-27T20:45:10.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.568+0000 7f8ced7fa640 1 -- 172.21.15.91:0/218012212 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16525 (secure 0 0 0) 0x7f8cf0070080 con 0x7f8cf0150e00 2023-11-27T20:45:10.569 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:10.569 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":75,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:07.238139+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:10.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.570+0000 7f8cf6e48640 1 -- 172.21.15.91:0/218012212 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8cd406b1f0 msgr2=0x7f8cd406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.570+0000 7f8cf6e48640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8cd406b1f0 0x7f8cd406d6b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4036000 tx=0x7f8ce4030000 comp rx=0 tx=0).stop 2023-11-27T20:45:10.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.570+0000 7f8cf6e48640 1 -- 172.21.15.91:0/218012212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cf0150e00 msgr2=0x7f8cf0151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.570+0000 7f8cf6e48640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cf0150e00 0x7f8cf0151280 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00d810 tx=0x7f8cdc00dcd0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.571+0000 7f8cf6e48640 1 -- 172.21.15.91:0/218012212 shutdown_connections 2023-11-27T20:45:10.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.571+0000 7f8cf6e48640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8cd406b1f0 0x7f8cd406d6b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.571+0000 7f8cf6e48640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cf01517c0 0x7f8cf01ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.571+0000 7f8cf6e48640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8cf0150e00 0x7f8cf0151280 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.571+0000 7f8cf6e48640 1 --2- 172.21.15.91:0/218012212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ce0003970 0x7f8cf01dd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.571+0000 7f8cf6e48640 1 -- 172.21.15.91:0/218012212 >> 172.21.15.91:0/218012212 conn(0x7f8cf006a500 msgr2=0x7f8cf00c19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:10.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.571+0000 7f8cf6e48640 1 -- 172.21.15.91:0/218012212 shutdown_connections 2023-11-27T20:45:10.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.571+0000 7f8cf6e48640 1 -- 172.21.15.91:0/218012212 wait complete. 2023-11-27T20:45:10.591 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T20:45:10.591 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:45:10.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.796+0000 7f0f4b200640 1 Processor -- start 2023-11-27T20:45:10.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.796+0000 7f0f4b200640 1 -- start start 2023-11-27T20:45:10.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.797+0000 7f0f4b200640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0f44155490 0x7f0f440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.797+0000 7f0f4b200640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 0x7f0f440a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.797+0000 7f0f4b200640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f440c06c0 con 0x7f0f440c4080 2023-11-27T20:45:10.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.797+0000 7f0f4b200640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f440a5820 con 0x7f0f44155490 2023-11-27T20:45:10.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.797+0000 7f0f4b200640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f440c1020 con 0x7f0f440c1500 2023-11-27T20:45:10.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.798+0000 7f0f43fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 0x7f0f440a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.798+0000 7f0f43fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 0x7f0f440a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:42070/0 (socket says 172.21.15.91:42070) 2023-11-27T20:45:10.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.798+0000 7f0f43fff640 1 -- 172.21.15.91:0/146769730 learned_addr learned my addr 172.21.15.91:0/146769730 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:10.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.798+0000 7f0f48f9c640 1 --2- 172.21.15.91:0/146769730 >> v2:172.21.15.183:3300/0 conn(0x7f0f44155490 0x7f0f440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.799+0000 7f0f43fff640 1 -- 172.21.15.91:0/146769730 >> v2:172.21.15.183:3300/0 conn(0x7f0f44155490 msgr2=0x7f0f440a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:10.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.799+0000 7f0f43fff640 1 --2- 172.21.15.91:0/146769730 >> v2:172.21.15.183:3300/0 conn(0x7f0f44155490 0x7f0f440a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.799+0000 7f0f43fff640 1 -- 172.21.15.91:0/146769730 >> v1:172.21.15.183:6789/0 conn(0x7f0f440c4080 legacy=0x7f0f440c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.799+0000 7f0f43fff640 1 -- 172.21.15.91:0/146769730 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f440c0910 con 0x7f0f440c1500 2023-11-27T20:45:10.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.799+0000 7f0f48f9c640 1 --2- 172.21.15.91:0/146769730 >> v2:172.21.15.183:3300/0 conn(0x7f0f44155490 0x7f0f440a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:45:10.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.800+0000 7f0f43fff640 1 --2- 172.21.15.91:0/146769730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 0x7f0f440a9430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009870 tx=0x7f0f3402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66947f4c2412616f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:10.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.801+0000 7f0f437fe640 1 -- 172.21.15.91:0/146769730 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34031640 con 0x7f0f440c1500 2023-11-27T20:45:10.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.801+0000 7f0f437fe640 1 -- 172.21.15.91:0/146769730 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f340317a0 con 0x7f0f440c1500 2023-11-27T20:45:10.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.801+0000 7f0f437fe640 1 -- 172.21.15.91:0/146769730 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34031b30 con 0x7f0f440c1500 2023-11-27T20:45:10.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.802+0000 7f0f4b200640 1 -- 172.21.15.91:0/146769730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 msgr2=0x7f0f440a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.802+0000 7f0f4b200640 1 --2- 172.21.15.91:0/146769730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 0x7f0f440a9430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009870 tx=0x7f0f3402b8f0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.802+0000 7f0f4b200640 1 -- 172.21.15.91:0/146769730 shutdown_connections 2023-11-27T20:45:10.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.802+0000 7f0f4b200640 1 --2- 172.21.15.91:0/146769730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 0x7f0f440a9430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.802+0000 7f0f4b200640 1 --2- 172.21.15.91:0/146769730 >> v2:172.21.15.183:3300/0 conn(0x7f0f44155490 0x7f0f440a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.802+0000 7f0f4b200640 1 -- 172.21.15.91:0/146769730 >> 172.21.15.91:0/146769730 conn(0x7f0f4406a500 msgr2=0x7f0f4406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:10.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.802+0000 7f0f4b200640 1 -- 172.21.15.91:0/146769730 shutdown_connections 2023-11-27T20:45:10.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.802+0000 7f0f4b200640 1 -- 172.21.15.91:0/146769730 wait complete. 2023-11-27T20:45:10.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.803+0000 7f0f4b200640 1 Processor -- start 2023-11-27T20:45:10.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.804+0000 7f0f4b200640 1 -- start start 2023-11-27T20:45:10.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.804+0000 7f0f4b200640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 0x7f0f441e5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.804+0000 7f0f4b200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f440c4080 0x7f0f440a6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.804+0000 7f0f4b200640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f44155490 0x7f0f441eb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4b200640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f440a51b0 con 0x7f0f44155490 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4b200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f441ebed0 con 0x7f0f440c4080 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4b200640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f440a6420 con 0x7f0f440c1500 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4979d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f44155490 0x7f0f441eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4979d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f44155490 0x7f0f441eb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52090/0 (socket says 172.21.15.91:52090) 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4979d640 1 -- 172.21.15.91:0/2424699418 learned_addr learned my addr 172.21.15.91:0/2424699418 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f48f9c640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 0x7f0f441e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f43fff640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f440c4080 0x7f0f440a6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4979d640 1 -- 172.21.15.91:0/2424699418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 msgr2=0x7f0f441e5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4979d640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 0x7f0f441e5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4979d640 1 -- 172.21.15.91:0/2424699418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f440c4080 msgr2=0x7f0f440a6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:10.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4979d640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f440c4080 0x7f0f440a6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:10.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.805+0000 7f0f4979d640 1 -- 172.21.15.91:0/2424699418 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340094d0 con 0x7f0f44155490 2023-11-27T20:45:10.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.806+0000 7f0f4979d640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f44155490 0x7f0f441eb600 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00c7a0 tx=0x7f0f3c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:10.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.806+0000 7f0f417fa640 1 -- 172.21.15.91:0/2424699418 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c003b70 con 0x7f0f44155490 2023-11-27T20:45:10.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.806+0000 7f0f417fa640 1 -- 172.21.15.91:0/2424699418 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3c003cf0 con 0x7f0f44155490 2023-11-27T20:45:10.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.806+0000 7f0f417fa640 1 -- 172.21.15.91:0/2424699418 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c003ea0 con 0x7f0f44155490 2023-11-27T20:45:10.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.806+0000 7f0f4b200640 1 -- 172.21.15.91:0/2424699418 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f440a6700 con 0x7f0f44155490 2023-11-27T20:45:10.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.806+0000 7f0f4b200640 1 -- 172.21.15.91:0/2424699418 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f440a7160 con 0x7f0f44155490 2023-11-27T20:45:10.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.807+0000 7f0f4b200640 1 -- 172.21.15.91:0/2424699418 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f440a68f0 con 0x7f0f44155490 2023-11-27T20:45:10.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.808+0000 7f0f417fa640 1 -- 172.21.15.91:0/2424699418 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0f3c00aa90 con 0x7f0f44155490 2023-11-27T20:45:10.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.809+0000 7f0f417fa640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0f3006b1c0 0x7f0f3006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:10.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.809+0000 7f0f417fa640 1 -- 172.21.15.91:0/2424699418 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f3c089890 con 0x7f0f44155490 2023-11-27T20:45:10.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.809+0000 7f0f48f9c640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0f3006b1c0 0x7f0f3006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:10.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.810+0000 7f0f48f9c640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0f3006b1c0 0x7f0f3006d680 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0f38006fd0 tx=0x7f0f38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:10.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.813+0000 7f0f417fa640 1 -- 172.21.15.91:0/2424699418 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0f3c0545b0 con 0x7f0f44155490 2023-11-27T20:45:10.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:10.999+0000 7f0f4b200640 1 -- 172.21.15.91:0/2424699418 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f441ec040 con 0x7f0f3006b1c0 2023-11-27T20:45:11.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.020+0000 7f0f417fa640 1 -- 172.21.15.91:0/2424699418 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286677 (secure 0 0 0) 0x7f0f441ec040 con 0x7f0f3006b1c0 2023-11-27T20:45:11.025 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:11.026 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:45:11.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 -- 172.21.15.91:0/2424699418 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0f3006b1c0 msgr2=0x7f0f3006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0f3006b1c0 0x7f0f3006d680 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0f38006fd0 tx=0x7f0f38008040 comp rx=0 tx=0).stop 2023-11-27T20:45:11.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 -- 172.21.15.91:0/2424699418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f44155490 msgr2=0x7f0f441eb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f44155490 0x7f0f441eb600 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00c7a0 tx=0x7f0f3c00cc60 comp rx=0 tx=0).stop 2023-11-27T20:45:11.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 -- 172.21.15.91:0/2424699418 shutdown_connections 2023-11-27T20:45:11.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f44155490 0x7f0f441eb600 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0f3006b1c0 0x7f0f3006d680 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f440c4080 0x7f0f440a6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 --2- 172.21.15.91:0/2424699418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f440c1500 0x7f0f441e5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 -- 172.21.15.91:0/2424699418 >> 172.21.15.91:0/2424699418 conn(0x7f0f4406a500 msgr2=0x7f0f4406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:11.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 -- 172.21.15.91:0/2424699418 shutdown_connections 2023-11-27T20:45:11.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.026+0000 7f0f4b200640 1 -- 172.21.15.91:0/2424699418 wait complete. 2023-11-27T20:45:11.046 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2023-11-27T20:45:09.443965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253672,"kb_used_data":8376,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721048,"statfs":{"total":773094113280,"available":772834353152,"internally_reserved":0,"allocated":8577024,"data_stored":4443940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.842471"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250664+0000","last_change":"2023-11-27T20:45:06.275855+0000","last_active":"2023-11-27T20:45:07.250664+0000","last_peered":"2023-11-27T20:45:07.250664+0000","last_clean":"2023-11-27T20:45:07.250664+0000","last_became_active":"2023-11-27T20:45:06.272756+0000","last_became_peered":"2023-11-27T20:45:06.272756+0000","last_unstale":"2023-11-27T20:45:07.250664+0000","last_undegraded":"2023-11-27T20:45:07.250664+0000","last_fullsized":"2023-11-27T20:45:07.250664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:14.466572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.275462+0000","last_change":"2023-11-27T20:45:06.271328+0000","last_active":"2023-11-27T20:45:06.275462+0000","last_peered":"2023-11-27T20:45:06.275462+0000","last_clean":"2023-11-27T20:45:06.275462+0000","last_became_active":"2023-11-27T20:45:06.271029+0000","last_became_peered":"2023-11-27T20:45:06.271029+0000","last_unstale":"2023-11-27T20:45:06.275462+0000","last_undegraded":"2023-11-27T20:45:06.275462+0000","last_fullsized":"2023-11-27T20:45:06.275462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:50:09.959822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248337+0000","last_change":"2023-11-27T20:45:06.283797+0000","last_active":"2023-11-27T20:45:07.248337+0000","last_peered":"2023-11-27T20:45:07.248337+0000","last_clean":"2023-11-27T20:45:07.248337+0000","last_became_active":"2023-11-27T20:45:06.281615+0000","last_became_peered":"2023-11-27T20:45:06.281615+0000","last_unstale":"2023-11-27T20:45:07.248337+0000","last_undegraded":"2023-11-27T20:45:07.248337+0000","last_fullsized":"2023-11-27T20:45:07.248337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:26.013200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.281015+0000","last_change":"2023-11-27T20:45:06.274435+0000","last_active":"2023-11-27T20:45:06.281015+0000","last_peered":"2023-11-27T20:45:06.281015+0000","last_clean":"2023-11-27T20:45:06.281015+0000","last_became_active":"2023-11-27T20:45:06.274050+0000","last_became_peered":"2023-11-27T20:45:06.274050+0000","last_unstale":"2023-11-27T20:45:06.281015+0000","last_undegraded":"2023-11-27T20:45:06.281015+0000","last_fullsized":"2023-11-27T20:45:06.281015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:50:16.355137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277266+0000","last_change":"2023-11-27T20:45:06.270397+0000","last_active":"2023-11-27T20:45:06.277266+0000","last_peered":"2023-11-27T20:45:06.277266+0000","last_clean":"2023-11-27T20:45:06.277266+0000","last_became_active":"2023-11-27T20:45:06.270159+0000","last_became_peered":"2023-11-27T20:45:06.270159+0000","last_unstale":"2023-11-27T20:45:06.277266+0000","last_undegraded":"2023-11-27T20:45:06.277266+0000","last_fullsized":"2023-11-27T20:45:06.277266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:43:44.488291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382137+0000","last_change":"2023-11-27T20:45:06.276571+0000","last_active":"2023-11-27T20:45:07.382137+0000","last_peered":"2023-11-27T20:45:07.382137+0000","last_clean":"2023-11-27T20:45:07.382137+0000","last_became_active":"2023-11-27T20:45:06.276265+0000","last_became_peered":"2023-11-27T20:45:06.276265+0000","last_unstale":"2023-11-27T20:45:07.382137+0000","last_undegraded":"2023-11-27T20:45:07.382137+0000","last_fullsized":"2023-11-27T20:45:07.382137+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:28.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277333+0000","last_change":"2023-11-27T20:45:06.271839+0000","last_active":"2023-11-27T20:45:06.277333+0000","last_peered":"2023-11-27T20:45:06.277333+0000","last_clean":"2023-11-27T20:45:06.277333+0000","last_became_active":"2023-11-27T20:45:06.271230+0000","last_became_peered":"2023-11-27T20:45:06.271230+0000","last_unstale":"2023-11-27T20:45:06.277333+0000","last_undegraded":"2023-11-27T20:45:06.277333+0000","last_fullsized":"2023-11-27T20:45:06.277333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:10:16.369642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382047+0000","last_change":"2023-11-27T20:45:06.271557+0000","last_active":"2023-11-27T20:45:07.382047+0000","last_peered":"2023-11-27T20:45:07.382047+0000","last_clean":"2023-11-27T20:45:07.382047+0000","last_became_active":"2023-11-27T20:45:06.271014+0000","last_became_peered":"2023-11-27T20:45:06.271014+0000","last_unstale":"2023-11-27T20:45:07.382047+0000","last_undegraded":"2023-11-27T20:45:07.382047+0000","last_fullsized":"2023-11-27T20:45:07.382047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:35.973730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382526+0000","last_change":"2023-11-27T20:45:06.279235+0000","last_active":"2023-11-27T20:45:07.382526+0000","last_peered":"2023-11-27T20:45:07.382526+0000","last_clean":"2023-11-27T20:45:07.382526+0000","last_became_active":"2023-11-27T20:45:06.278923+0000","last_became_peered":"2023-11-27T20:45:06.278923+0000","last_unstale":"2023-11-27T20:45:07.382526+0000","last_undegraded":"2023-11-27T20:45:07.382526+0000","last_fullsized":"2023-11-27T20:45:07.382526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.251040+0000","last_change":"2023-11-27T20:45:06.280157+0000","last_active":"2023-11-27T20:45:07.251040+0000","last_peered":"2023-11-27T20:45:07.251040+0000","last_clean":"2023-11-27T20:45:07.251040+0000","last_became_active":"2023-11-27T20:45:06.275941+0000","last_became_peered":"2023-11-27T20:45:06.275941+0000","last_unstale":"2023-11-27T20:45:07.251040+0000","last_undegraded":"2023-11-27T20:45:07.251040+0000","last_fullsized":"2023-11-27T20:45:07.251040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:55.254080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.275683+0000","last_change":"2023-11-27T20:45:06.268839+0000","last_active":"2023-11-27T20:45:06.275683+0000","last_peered":"2023-11-27T20:45:06.275683+0000","last_clean":"2023-11-27T20:45:06.275683+0000","last_became_active":"2023-11-27T20:45:06.268579+0000","last_became_peered":"2023-11-27T20:45:06.268579+0000","last_unstale":"2023-11-27T20:45:06.275683+0000","last_undegraded":"2023-11-27T20:45:06.275683+0000","last_fullsized":"2023-11-27T20:45:06.275683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:26.869703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.249899+0000","last_change":"2023-11-27T20:45:06.270837+0000","last_active":"2023-11-27T20:45:07.249899+0000","last_peered":"2023-11-27T20:45:07.249899+0000","last_clean":"2023-11-27T20:45:07.249899+0000","last_became_active":"2023-11-27T20:45:06.270495+0000","last_became_peered":"2023-11-27T20:45:06.270495+0000","last_unstale":"2023-11-27T20:45:07.249899+0000","last_undegraded":"2023-11-27T20:45:07.249899+0000","last_fullsized":"2023-11-27T20:45:07.249899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:11.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248414+0000","last_change":"2023-11-27T20:45:06.273803+0000","last_active":"2023-11-27T20:45:07.248414+0000","last_peered":"2023-11-27T20:45:07.248414+0000","last_clean":"2023-11-27T20:45:07.248414+0000","last_became_active":"2023-11-27T20:45:06.273439+0000","last_became_peered":"2023-11-27T20:45:06.273439+0000","last_unstale":"2023-11-27T20:45:07.248414+0000","last_undegraded":"2023-11-27T20:45:07.248414+0000","last_fullsized":"2023-11-27T20:45:07.248414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:20.750426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.281155+0000","last_change":"2023-11-27T20:45:06.276128+0000","last_active":"2023-11-27T20:45:06.281155+0000","last_peered":"2023-11-27T20:45:06.281155+0000","last_clean":"2023-11-27T20:45:06.281155+0000","last_became_active":"2023-11-27T20:45:06.274808+0000","last_became_peered":"2023-11-27T20:45:06.274808+0000","last_unstale":"2023-11-27T20:45:06.281155+0000","last_undegraded":"2023-11-27T20:45:06.281155+0000","last_fullsized":"2023-11-27T20:45:06.281155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:50.101297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.247926+0000","last_change":"2023-11-27T20:45:06.269154+0000","last_active":"2023-11-27T20:45:07.247926+0000","last_peered":"2023-11-27T20:45:07.247926+0000","last_clean":"2023-11-27T20:45:07.247926+0000","last_became_active":"2023-11-27T20:45:06.268153+0000","last_became_peered":"2023-11-27T20:45:06.268153+0000","last_unstale":"2023-11-27T20:45:07.247926+0000","last_undegraded":"2023-11-27T20:45:07.247926+0000","last_fullsized":"2023-11-27T20:45:07.247926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.286029+0000","last_change":"2023-11-27T20:45:06.280743+0000","last_active":"2023-11-27T20:45:06.286029+0000","last_peered":"2023-11-27T20:45:06.286029+0000","last_clean":"2023-11-27T20:45:06.286029+0000","last_became_active":"2023-11-27T20:45:06.280225+0000","last_became_peered":"2023-11-27T20:45:06.280225+0000","last_unstale":"2023-11-27T20:45:06.286029+0000","last_undegraded":"2023-11-27T20:45:06.286029+0000","last_fullsized":"2023-11-27T20:45:06.286029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:13:33.854711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.281003+0000","last_change":"2023-11-27T20:45:06.276232+0000","last_active":"2023-11-27T20:45:06.281003+0000","last_peered":"2023-11-27T20:45:06.281003+0000","last_clean":"2023-11-27T20:45:06.281003+0000","last_became_active":"2023-11-27T20:45:06.274283+0000","last_became_peered":"2023-11-27T20:45:06.274283+0000","last_unstale":"2023-11-27T20:45:06.281003+0000","last_undegraded":"2023-11-27T20:45:06.281003+0000","last_fullsized":"2023-11-27T20:45:06.281003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:40:26.978102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.284667+0000","last_change":"2023-11-27T20:45:06.282186+0000","last_active":"2023-11-27T20:45:06.284667+0000","last_peered":"2023-11-27T20:45:06.284667+0000","last_clean":"2023-11-27T20:45:06.284667+0000","last_became_active":"2023-11-27T20:45:06.281910+0000","last_became_peered":"2023-11-27T20:45:06.281910+0000","last_unstale":"2023-11-27T20:45:06.284667+0000","last_undegraded":"2023-11-27T20:45:06.284667+0000","last_fullsized":"2023-11-27T20:45:06.284667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:34:33.271480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.283161+0000","last_change":"2023-11-27T20:45:06.279696+0000","last_active":"2023-11-27T20:45:06.283161+0000","last_peered":"2023-11-27T20:45:06.283161+0000","last_clean":"2023-11-27T20:45:06.283161+0000","last_became_active":"2023-11-27T20:45:06.279208+0000","last_became_peered":"2023-11-27T20:45:06.279208+0000","last_unstale":"2023-11-27T20:45:06.283161+0000","last_undegraded":"2023-11-27T20:45:06.283161+0000","last_fullsized":"2023-11-27T20:45:06.283161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.283789+0000","last_change":"2023-11-27T20:45:06.277398+0000","last_active":"2023-11-27T20:45:06.283789+0000","last_peered":"2023-11-27T20:45:06.283789+0000","last_clean":"2023-11-27T20:45:06.283789+0000","last_became_active":"2023-11-27T20:45:06.277088+0000","last_became_peered":"2023-11-27T20:45:06.277088+0000","last_unstale":"2023-11-27T20:45:06.283789+0000","last_undegraded":"2023-11-27T20:45:06.283789+0000","last_fullsized":"2023-11-27T20:45:06.283789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:52.945038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.283762+0000","last_change":"2023-11-27T20:45:06.277480+0000","last_active":"2023-11-27T20:45:06.283762+0000","last_peered":"2023-11-27T20:45:06.283762+0000","last_clean":"2023-11-27T20:45:06.283762+0000","last_became_active":"2023-11-27T20:45:06.277134+0000","last_became_peered":"2023-11-27T20:45:06.277134+0000","last_unstale":"2023-11-27T20:45:06.283762+0000","last_undegraded":"2023-11-27T20:45:06.283762+0000","last_fullsized":"2023-11-27T20:45:06.283762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:11:09.293758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.282185+0000","last_change":"2023-11-27T20:45:06.277173+0000","last_active":"2023-11-27T20:45:06.282185+0000","last_peered":"2023-11-27T20:45:06.282185+0000","last_clean":"2023-11-27T20:45:06.282185+0000","last_became_active":"2023-11-27T20:45:06.276898+0000","last_became_peered":"2023-11-27T20:45:06.276898+0000","last_unstale":"2023-11-27T20:45:06.282185+0000","last_undegraded":"2023-11-27T20:45:06.282185+0000","last_fullsized":"2023-11-27T20:45:06.282185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:03.641350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250438+0000","last_change":"2023-11-27T20:45:06.279341+0000","last_active":"2023-11-27T20:45:07.250438+0000","last_peered":"2023-11-27T20:45:07.250438+0000","last_clean":"2023-11-27T20:45:07.250438+0000","last_became_active":"2023-11-27T20:45:06.278293+0000","last_became_peered":"2023-11-27T20:45:06.278293+0000","last_unstale":"2023-11-27T20:45:07.250438+0000","last_undegraded":"2023-11-27T20:45:07.250438+0000","last_fullsized":"2023-11-27T20:45:07.250438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:00.849008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.284066+0000","last_change":"2023-11-27T20:45:06.280079+0000","last_active":"2023-11-27T20:45:06.284066+0000","last_peered":"2023-11-27T20:45:06.284066+0000","last_clean":"2023-11-27T20:45:06.284066+0000","last_became_active":"2023-11-27T20:45:06.279228+0000","last_became_peered":"2023-11-27T20:45:06.279228+0000","last_unstale":"2023-11-27T20:45:06.284066+0000","last_undegraded":"2023-11-27T20:45:06.284066+0000","last_fullsized":"2023-11-27T20:45:06.284066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:09:59.378663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.271347+0000","last_change":"2023-11-27T20:45:06.263651+0000","last_active":"2023-11-27T20:45:06.271347+0000","last_peered":"2023-11-27T20:45:06.271347+0000","last_clean":"2023-11-27T20:45:06.271347+0000","last_became_active":"2023-11-27T20:45:06.263101+0000","last_became_peered":"2023-11-27T20:45:06.263101+0000","last_unstale":"2023-11-27T20:45:06.271347+0000","last_undegraded":"2023-11-27T20:45:06.271347+0000","last_fullsized":"2023-11-27T20:45:06.271347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:10:17.216692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248384+0000","last_change":"2023-11-27T20:45:06.276593+0000","last_active":"2023-11-27T20:45:07.248384+0000","last_peered":"2023-11-27T20:45:07.248384+0000","last_clean":"2023-11-27T20:45:07.248384+0000","last_became_active":"2023-11-27T20:45:06.276315+0000","last_became_peered":"2023-11-27T20:45:06.276315+0000","last_unstale":"2023-11-27T20:45:07.248384+0000","last_undegraded":"2023-11-27T20:45:07.248384+0000","last_fullsized":"2023-11-27T20:45:07.248384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:02.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.274815+0000","last_change":"2023-11-27T20:45:06.265948+0000","last_active":"2023-11-27T20:45:06.274815+0000","last_peered":"2023-11-27T20:45:06.274815+0000","last_clean":"2023-11-27T20:45:06.274815+0000","last_became_active":"2023-11-27T20:45:06.265615+0000","last_became_peered":"2023-11-27T20:45:06.265615+0000","last_unstale":"2023-11-27T20:45:06.274815+0000","last_undegraded":"2023-11-27T20:45:06.274815+0000","last_fullsized":"2023-11-27T20:45:06.274815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:59.006869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250108+0000","last_change":"2023-11-27T20:45:06.270218+0000","last_active":"2023-11-27T20:45:07.250108+0000","last_peered":"2023-11-27T20:45:07.250108+0000","last_clean":"2023-11-27T20:45:07.250108+0000","last_became_active":"2023-11-27T20:45:06.269297+0000","last_became_peered":"2023-11-27T20:45:06.269297+0000","last_unstale":"2023-11-27T20:45:07.250108+0000","last_undegraded":"2023-11-27T20:45:07.250108+0000","last_fullsized":"2023-11-27T20:45:07.250108+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.270952+0000","last_change":"2023-11-27T20:45:06.264325+0000","last_active":"2023-11-27T20:45:06.270952+0000","last_peered":"2023-11-27T20:45:06.270952+0000","last_clean":"2023-11-27T20:45:06.270952+0000","last_became_active":"2023-11-27T20:45:06.260926+0000","last_became_peered":"2023-11-27T20:45:06.260926+0000","last_unstale":"2023-11-27T20:45:06.270952+0000","last_undegraded":"2023-11-27T20:45:06.270952+0000","last_fullsized":"2023-11-27T20:45:06.270952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:58.157313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.283696+0000","last_change":"2023-11-27T20:45:06.278905+0000","last_active":"2023-11-27T20:45:06.283696+0000","last_peered":"2023-11-27T20:45:06.283696+0000","last_clean":"2023-11-27T20:45:06.283696+0000","last_became_active":"2023-11-27T20:45:06.276359+0000","last_became_peered":"2023-11-27T20:45:06.276359+0000","last_unstale":"2023-11-27T20:45:06.283696+0000","last_undegraded":"2023-11-27T20:45:06.283696+0000","last_fullsized":"2023-11-27T20:45:06.283696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:34:35.362869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.284197+0000","last_change":"2023-11-27T20:45:06.278065+0000","last_active":"2023-11-27T20:45:06.284197+0000","last_peered":"2023-11-27T20:45:06.284197+0000","last_clean":"2023-11-27T20:45:06.284197+0000","last_became_active":"2023-11-27T20:45:06.277780+0000","last_became_peered":"2023-11-27T20:45:06.277780+0000","last_unstale":"2023-11-27T20:45:06.284197+0000","last_undegraded":"2023-11-27T20:45:06.284197+0000","last_fullsized":"2023-11-27T20:45:06.284197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:13:43.427726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.249097+0000","last_change":"2023-11-27T20:45:06.257819+0000","last_active":"2023-11-27T20:45:07.249097+0000","last_peered":"2023-11-27T20:45:07.249097+0000","last_clean":"2023-11-27T20:45:07.249097+0000","last_became_active":"2023-11-27T20:45:06.257086+0000","last_became_peered":"2023-11-27T20:45:06.257086+0000","last_unstale":"2023-11-27T20:45:07.249097+0000","last_undegraded":"2023-11-27T20:45:07.249097+0000","last_fullsized":"2023-11-27T20:45:07.249097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:24.286070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.286119+0000","last_change":"2023-11-27T20:45:06.282558+0000","last_active":"2023-11-27T20:45:06.286119+0000","last_peered":"2023-11-27T20:45:06.286119+0000","last_clean":"2023-11-27T20:45:06.286119+0000","last_became_active":"2023-11-27T20:45:06.282227+0000","last_became_peered":"2023-11-27T20:45:06.282227+0000","last_unstale":"2023-11-27T20:45:06.286119+0000","last_undegraded":"2023-11-27T20:45:06.286119+0000","last_fullsized":"2023-11-27T20:45:06.286119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:44:31.727468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"74'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.251111+0000","last_change":"2023-11-27T20:45:05.632935+0000","last_active":"2023-11-27T20:45:07.251111+0000","last_peered":"2023-11-27T20:45:07.251111+0000","last_clean":"2023-11-27T20:45:07.251111+0000","last_became_active":"2023-11-27T20:45:05.632654+0000","last_became_peered":"2023-11-27T20:45:05.632654+0000","last_unstale":"2023-11-27T20:45:07.251111+0000","last_undegraded":"2023-11-27T20:45:07.251111+0000","last_fullsized":"2023-11-27T20:45:07.251111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:56.837141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250976+0000","last_change":"2023-11-27T20:45:06.280819+0000","last_active":"2023-11-27T20:45:07.250976+0000","last_peered":"2023-11-27T20:45:07.250976+0000","last_clean":"2023-11-27T20:45:07.250976+0000","last_became_active":"2023-11-27T20:45:06.280545+0000","last_became_peered":"2023-11-27T20:45:06.280545+0000","last_unstale":"2023-11-27T20:45:07.250976+0000","last_undegraded":"2023-11-27T20:45:07.250976+0000","last_fullsized":"2023-11-27T20:45:07.250976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:01.046541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"74'1","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.668192+0000","last_change":"2023-11-27T20:45:05.644560+0000","last_active":"2023-11-27T20:45:06.668192+0000","last_peered":"2023-11-27T20:45:06.668192+0000","last_clean":"2023-11-27T20:45:06.668192+0000","last_became_active":"2023-11-27T20:45:05.644264+0000","last_became_peered":"2023-11-27T20:45:05.644264+0000","last_unstale":"2023-11-27T20:45:06.668192+0000","last_undegraded":"2023-11-27T20:45:06.668192+0000","last_fullsized":"2023-11-27T20:45:06.668192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:02.361558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250246+0000","last_change":"2023-11-27T20:45:06.257973+0000","last_active":"2023-11-27T20:45:07.250246+0000","last_peered":"2023-11-27T20:45:07.250246+0000","last_clean":"2023-11-27T20:45:07.250246+0000","last_became_active":"2023-11-27T20:45:06.257676+0000","last_became_peered":"2023-11-27T20:45:06.257676+0000","last_unstale":"2023-11-27T20:45:07.250246+0000","last_undegraded":"2023-11-27T20:45:07.250246+0000","last_fullsized":"2023-11-27T20:45:07.250246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.664673+0000","last_change":"2023-11-27T20:45:05.636666+0000","last_active":"2023-11-27T20:45:06.664673+0000","last_peered":"2023-11-27T20:45:06.664673+0000","last_clean":"2023-11-27T20:45:06.664673+0000","last_became_active":"2023-11-27T20:45:05.636401+0000","last_became_peered":"2023-11-27T20:45:05.636401+0000","last_unstale":"2023-11-27T20:45:06.664673+0000","last_undegraded":"2023-11-27T20:45:06.664673+0000","last_fullsized":"2023-11-27T20:45:06.664673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:34.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248651+0000","last_change":"2023-11-27T20:45:06.280675+0000","last_active":"2023-11-27T20:45:07.248651+0000","last_peered":"2023-11-27T20:45:07.248651+0000","last_clean":"2023-11-27T20:45:07.248651+0000","last_became_active":"2023-11-27T20:45:06.280169+0000","last_became_peered":"2023-11-27T20:45:06.280169+0000","last_unstale":"2023-11-27T20:45:07.248651+0000","last_undegraded":"2023-11-27T20:45:07.248651+0000","last_fullsized":"2023-11-27T20:45:07.248651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.665768+0000","last_change":"2023-11-27T20:45:05.637617+0000","last_active":"2023-11-27T20:45:06.665768+0000","last_peered":"2023-11-27T20:45:06.665768+0000","last_clean":"2023-11-27T20:45:06.665768+0000","last_became_active":"2023-11-27T20:45:05.636099+0000","last_became_peered":"2023-11-27T20:45:05.636099+0000","last_unstale":"2023-11-27T20:45:06.665768+0000","last_undegraded":"2023-11-27T20:45:06.665768+0000","last_fullsized":"2023-11-27T20:45:06.665768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:00.040780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.280206+0000","last_change":"2023-11-27T20:45:06.271072+0000","last_active":"2023-11-27T20:45:06.280206+0000","last_peered":"2023-11-27T20:45:06.280206+0000","last_clean":"2023-11-27T20:45:06.280206+0000","last_became_active":"2023-11-27T20:45:06.270093+0000","last_became_peered":"2023-11-27T20:45:06.270093+0000","last_unstale":"2023-11-27T20:45:06.280206+0000","last_undegraded":"2023-11-27T20:45:06.280206+0000","last_fullsized":"2023-11-27T20:45:06.280206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:06:41.276549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"74'1","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.662885+0000","last_change":"2023-11-27T20:45:05.641565+0000","last_active":"2023-11-27T20:45:06.662885+0000","last_peered":"2023-11-27T20:45:06.662885+0000","last_clean":"2023-11-27T20:45:06.662885+0000","last_became_active":"2023-11-27T20:45:05.635532+0000","last_became_peered":"2023-11-27T20:45:05.635532+0000","last_unstale":"2023-11-27T20:45:06.662885+0000","last_undegraded":"2023-11-27T20:45:06.662885+0000","last_fullsized":"2023-11-27T20:45:06.662885+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:01:09.043274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277254+0000","last_change":"2023-11-27T20:45:06.269149+0000","last_active":"2023-11-27T20:45:06.277254+0000","last_peered":"2023-11-27T20:45:06.277254+0000","last_clean":"2023-11-27T20:45:06.277254+0000","last_became_active":"2023-11-27T20:45:06.268793+0000","last_became_peered":"2023-11-27T20:45:06.268793+0000","last_unstale":"2023-11-27T20:45:06.277254+0000","last_undegraded":"2023-11-27T20:45:06.277254+0000","last_fullsized":"2023-11-27T20:45:06.277254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:13.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"74'1","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.668365+0000","last_change":"2023-11-27T20:45:05.642294+0000","last_active":"2023-11-27T20:45:06.668365+0000","last_peered":"2023-11-27T20:45:06.668365+0000","last_clean":"2023-11-27T20:45:06.668365+0000","last_became_active":"2023-11-27T20:45:05.641621+0000","last_became_peered":"2023-11-27T20:45:05.641621+0000","last_unstale":"2023-11-27T20:45:06.668365+0000","last_undegraded":"2023-11-27T20:45:06.668365+0000","last_fullsized":"2023-11-27T20:45:06.668365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:05.586683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.247695+0000","last_change":"2023-11-27T20:45:06.283545+0000","last_active":"2023-11-27T20:45:07.247695+0000","last_peered":"2023-11-27T20:45:07.247695+0000","last_clean":"2023-11-27T20:45:07.247695+0000","last_became_active":"2023-11-27T20:45:06.281547+0000","last_became_peered":"2023-11-27T20:45:06.281547+0000","last_unstale":"2023-11-27T20:45:07.247695+0000","last_undegraded":"2023-11-27T20:45:07.247695+0000","last_fullsized":"2023-11-27T20:45:07.247695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:22:23.387234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.273266+0000","last_change":"2023-11-27T20:45:05.640954+0000","last_active":"2023-11-27T20:45:06.273266+0000","last_peered":"2023-11-27T20:45:06.273266+0000","last_clean":"2023-11-27T20:45:06.273266+0000","last_became_active":"2023-11-27T20:45:05.640670+0000","last_became_peered":"2023-11-27T20:45:05.640670+0000","last_unstale":"2023-11-27T20:45:06.273266+0000","last_undegraded":"2023-11-27T20:45:06.273266+0000","last_fullsized":"2023-11-27T20:45:06.273266+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:13.460812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248071+0000","last_change":"2023-11-27T20:45:06.267459+0000","last_active":"2023-11-27T20:45:07.248071+0000","last_peered":"2023-11-27T20:45:07.248071+0000","last_clean":"2023-11-27T20:45:07.248071+0000","last_became_active":"2023-11-27T20:45:06.267115+0000","last_became_peered":"2023-11-27T20:45:06.267115+0000","last_unstale":"2023-11-27T20:45:07.248071+0000","last_undegraded":"2023-11-27T20:45:07.248071+0000","last_fullsized":"2023-11-27T20:45:07.248071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:16:23.654821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.243404+0000","last_change":"2023-11-27T20:45:05.641922+0000","last_active":"2023-11-27T20:45:06.243404+0000","last_peered":"2023-11-27T20:45:06.243404+0000","last_clean":"2023-11-27T20:45:06.243404+0000","last_became_active":"2023-11-27T20:45:05.641612+0000","last_became_peered":"2023-11-27T20:45:05.641612+0000","last_unstale":"2023-11-27T20:45:06.243404+0000","last_undegraded":"2023-11-27T20:45:06.243404+0000","last_fullsized":"2023-11-27T20:45:06.243404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:57:05.757599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248848+0000","last_change":"2023-11-27T20:45:06.273369+0000","last_active":"2023-11-27T20:45:07.248848+0000","last_peered":"2023-11-27T20:45:07.248848+0000","last_clean":"2023-11-27T20:45:07.248848+0000","last_became_active":"2023-11-27T20:45:06.271740+0000","last_became_peered":"2023-11-27T20:45:06.271740+0000","last_unstale":"2023-11-27T20:45:07.248848+0000","last_undegraded":"2023-11-27T20:45:07.248848+0000","last_fullsized":"2023-11-27T20:45:07.248848+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:12.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.251131+0000","last_change":"2023-11-27T20:45:05.631301+0000","last_active":"2023-11-27T20:45:07.251131+0000","last_peered":"2023-11-27T20:45:07.251131+0000","last_clean":"2023-11-27T20:45:07.251131+0000","last_became_active":"2023-11-27T20:45:05.630652+0000","last_became_peered":"2023-11-27T20:45:05.630652+0000","last_unstale":"2023-11-27T20:45:07.251131+0000","last_undegraded":"2023-11-27T20:45:07.251131+0000","last_fullsized":"2023-11-27T20:45:07.251131+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:58.001108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382519+0000","last_change":"2023-11-27T20:45:06.273782+0000","last_active":"2023-11-27T20:45:07.382519+0000","last_peered":"2023-11-27T20:45:07.382519+0000","last_clean":"2023-11-27T20:45:07.382519+0000","last_became_active":"2023-11-27T20:45:06.273475+0000","last_became_peered":"2023-11-27T20:45:06.273475+0000","last_unstale":"2023-11-27T20:45:07.382519+0000","last_undegraded":"2023-11-27T20:45:07.382519+0000","last_fullsized":"2023-11-27T20:45:07.382519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250680+0000","last_change":"2023-11-27T20:45:05.646362+0000","last_active":"2023-11-27T20:45:07.250680+0000","last_peered":"2023-11-27T20:45:07.250680+0000","last_clean":"2023-11-27T20:45:07.250680+0000","last_became_active":"2023-11-27T20:45:05.645919+0000","last_became_peered":"2023-11-27T20:45:05.645919+0000","last_unstale":"2023-11-27T20:45:07.250680+0000","last_undegraded":"2023-11-27T20:45:07.250680+0000","last_fullsized":"2023-11-27T20:45:07.250680+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:01:09.043274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.287762+0000","last_change":"2023-11-27T20:45:06.283036+0000","last_active":"2023-11-27T20:45:06.287762+0000","last_peered":"2023-11-27T20:45:06.287762+0000","last_clean":"2023-11-27T20:45:06.287762+0000","last_became_active":"2023-11-27T20:45:06.281987+0000","last_became_peered":"2023-11-27T20:45:06.281987+0000","last_unstale":"2023-11-27T20:45:06.287762+0000","last_undegraded":"2023-11-27T20:45:06.287762+0000","last_fullsized":"2023-11-27T20:45:06.287762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"74'3","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.249955+0000","last_change":"2023-11-27T20:45:05.634876+0000","last_active":"2023-11-27T20:45:07.249955+0000","last_peered":"2023-11-27T20:45:07.249955+0000","last_clean":"2023-11-27T20:45:07.249955+0000","last_became_active":"2023-11-27T20:45:05.634310+0000","last_became_peered":"2023-11-27T20:45:05.634310+0000","last_unstale":"2023-11-27T20:45:07.249955+0000","last_undegraded":"2023-11-27T20:45:07.249955+0000","last_fullsized":"2023-11-27T20:45:07.249955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:44:30.721707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.286089+0000","last_change":"2023-11-27T20:45:06.282223+0000","last_active":"2023-11-27T20:45:06.286089+0000","last_peered":"2023-11-27T20:45:06.286089+0000","last_clean":"2023-11-27T20:45:06.286089+0000","last_became_active":"2023-11-27T20:45:06.281055+0000","last_became_peered":"2023-11-27T20:45:06.281055+0000","last_unstale":"2023-11-27T20:45:06.286089+0000","last_undegraded":"2023-11-27T20:45:06.286089+0000","last_fullsized":"2023-11-27T20:45:06.286089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:00.389778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"74'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382697+0000","last_change":"2023-11-27T20:45:05.636622+0000","last_active":"2023-11-27T20:45:07.382697+0000","last_peered":"2023-11-27T20:45:07.382697+0000","last_clean":"2023-11-27T20:45:07.382697+0000","last_became_active":"2023-11-27T20:45:05.633202+0000","last_became_peered":"2023-11-27T20:45:05.633202+0000","last_unstale":"2023-11-27T20:45:07.382697+0000","last_undegraded":"2023-11-27T20:45:07.382697+0000","last_fullsized":"2023-11-27T20:45:07.382697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:02.361558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.278846+0000","last_change":"2023-11-27T20:45:06.276770+0000","last_active":"2023-11-27T20:45:06.278846+0000","last_peered":"2023-11-27T20:45:06.278846+0000","last_clean":"2023-11-27T20:45:06.278846+0000","last_became_active":"2023-11-27T20:45:06.276404+0000","last_became_peered":"2023-11-27T20:45:06.276404+0000","last_unstale":"2023-11-27T20:45:06.278846+0000","last_undegraded":"2023-11-27T20:45:06.278846+0000","last_fullsized":"2023-11-27T20:45:06.278846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:00.849008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.666651+0000","last_change":"2023-11-27T20:45:05.634047+0000","last_active":"2023-11-27T20:45:06.666651+0000","last_peered":"2023-11-27T20:45:06.666651+0000","last_clean":"2023-11-27T20:45:06.666651+0000","last_became_active":"2023-11-27T20:45:05.633852+0000","last_became_peered":"2023-11-27T20:45:05.633852+0000","last_unstale":"2023-11-27T20:45:06.666651+0000","last_undegraded":"2023-11-27T20:45:06.666651+0000","last_fullsized":"2023-11-27T20:45:06.666651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:10:34.426540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248766+0000","last_change":"2023-11-27T20:45:06.277808+0000","last_active":"2023-11-27T20:45:07.248766+0000","last_peered":"2023-11-27T20:45:07.248766+0000","last_clean":"2023-11-27T20:45:07.248766+0000","last_became_active":"2023-11-27T20:45:06.277521+0000","last_became_peered":"2023-11-27T20:45:06.277521+0000","last_unstale":"2023-11-27T20:45:07.248766+0000","last_undegraded":"2023-11-27T20:45:07.248766+0000","last_fullsized":"2023-11-27T20:45:07.248766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:16:23.654821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.247958+0000","last_change":"2023-11-27T20:45:05.632402+0000","last_active":"2023-11-27T20:45:07.247958+0000","last_peered":"2023-11-27T20:45:07.247958+0000","last_clean":"2023-11-27T20:45:07.247958+0000","last_became_active":"2023-11-27T20:45:05.632030+0000","last_became_peered":"2023-11-27T20:45:05.632030+0000","last_unstale":"2023-11-27T20:45:07.247958+0000","last_undegraded":"2023-11-27T20:45:07.247958+0000","last_fullsized":"2023-11-27T20:45:07.247958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:01.270371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277260+0000","last_change":"2023-11-27T20:45:06.272412+0000","last_active":"2023-11-27T20:45:06.277260+0000","last_peered":"2023-11-27T20:45:06.277260+0000","last_clean":"2023-11-27T20:45:06.277260+0000","last_became_active":"2023-11-27T20:45:06.272103+0000","last_became_peered":"2023-11-27T20:45:06.272103+0000","last_unstale":"2023-11-27T20:45:06.277260+0000","last_undegraded":"2023-11-27T20:45:06.277260+0000","last_fullsized":"2023-11-27T20:45:06.277260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:09:40.464389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382489+0000","last_change":"2023-11-27T20:45:05.644812+0000","last_active":"2023-11-27T20:45:07.382489+0000","last_peered":"2023-11-27T20:45:07.382489+0000","last_clean":"2023-11-27T20:45:07.382489+0000","last_became_active":"2023-11-27T20:45:05.644097+0000","last_became_peered":"2023-11-27T20:45:05.644097+0000","last_unstale":"2023-11-27T20:45:07.382489+0000","last_undegraded":"2023-11-27T20:45:07.382489+0000","last_fullsized":"2023-11-27T20:45:07.382489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:58.144583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.270323+0000","last_change":"2023-11-27T20:45:06.263986+0000","last_active":"2023-11-27T20:45:06.270323+0000","last_peered":"2023-11-27T20:45:06.270323+0000","last_clean":"2023-11-27T20:45:06.270323+0000","last_became_active":"2023-11-27T20:45:06.263465+0000","last_became_peered":"2023-11-27T20:45:06.263465+0000","last_unstale":"2023-11-27T20:45:06.270323+0000","last_undegraded":"2023-11-27T20:45:06.270323+0000","last_fullsized":"2023-11-27T20:45:06.270323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:00:16.194858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"74'8","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.668409+0000","last_change":"2023-11-27T20:45:05.641159+0000","last_active":"2023-11-27T20:45:06.668409+0000","last_peered":"2023-11-27T20:45:06.668409+0000","last_clean":"2023-11-27T20:45:06.668409+0000","last_became_active":"2023-11-27T20:45:05.640821+0000","last_became_peered":"2023-11-27T20:45:05.640821+0000","last_unstale":"2023-11-27T20:45:06.668409+0000","last_undegraded":"2023-11-27T20:45:06.668409+0000","last_fullsized":"2023-11-27T20:45:06.668409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:06.355870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248783+0000","last_change":"2023-11-27T20:45:06.275736+0000","last_active":"2023-11-27T20:45:07.248783+0000","last_peered":"2023-11-27T20:45:07.248783+0000","last_clean":"2023-11-27T20:45:07.248783+0000","last_became_active":"2023-11-27T20:45:06.275432+0000","last_became_peered":"2023-11-27T20:45:06.275432+0000","last_unstale":"2023-11-27T20:45:07.248783+0000","last_undegraded":"2023-11-27T20:45:07.248783+0000","last_fullsized":"2023-11-27T20:45:07.248783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:12.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.251255+0000","last_change":"2023-11-27T20:45:05.633605+0000","last_active":"2023-11-27T20:45:07.251255+0000","last_peered":"2023-11-27T20:45:07.251255+0000","last_clean":"2023-11-27T20:45:07.251255+0000","last_became_active":"2023-11-27T20:45:05.633283+0000","last_became_peered":"2023-11-27T20:45:05.633283+0000","last_unstale":"2023-11-27T20:45:07.251255+0000","last_undegraded":"2023-11-27T20:45:07.251255+0000","last_fullsized":"2023-11-27T20:45:07.251255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:05.586683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.251013+0000","last_change":"2023-11-27T20:45:06.279727+0000","last_active":"2023-11-27T20:45:07.251013+0000","last_peered":"2023-11-27T20:45:07.251013+0000","last_clean":"2023-11-27T20:45:07.251013+0000","last_became_active":"2023-11-27T20:45:06.270223+0000","last_became_peered":"2023-11-27T20:45:06.270223+0000","last_unstale":"2023-11-27T20:45:07.251013+0000","last_undegraded":"2023-11-27T20:45:07.251013+0000","last_fullsized":"2023-11-27T20:45:07.251013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:59:57.174632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.663499+0000","last_change":"2023-11-27T20:45:05.642228+0000","last_active":"2023-11-27T20:45:06.663499+0000","last_peered":"2023-11-27T20:45:06.663499+0000","last_clean":"2023-11-27T20:45:06.663499+0000","last_became_active":"2023-11-27T20:45:05.641885+0000","last_became_peered":"2023-11-27T20:45:05.641885+0000","last_unstale":"2023-11-27T20:45:06.663499+0000","last_undegraded":"2023-11-27T20:45:06.663499+0000","last_fullsized":"2023-11-27T20:45:06.663499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:56.752121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277625+0000","last_change":"2023-11-27T20:45:06.274675+0000","last_active":"2023-11-27T20:45:06.277625+0000","last_peered":"2023-11-27T20:45:06.277625+0000","last_clean":"2023-11-27T20:45:06.277625+0000","last_became_active":"2023-11-27T20:45:06.271749+0000","last_became_peered":"2023-11-27T20:45:06.271749+0000","last_unstale":"2023-11-27T20:45:06.277625+0000","last_undegraded":"2023-11-27T20:45:06.277625+0000","last_fullsized":"2023-11-27T20:45:06.277625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:57.842902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.273749+0000","last_change":"2023-11-27T20:45:05.642419+0000","last_active":"2023-11-27T20:45:06.273749+0000","last_peered":"2023-11-27T20:45:06.273749+0000","last_clean":"2023-11-27T20:45:06.273749+0000","last_became_active":"2023-11-27T20:45:05.642092+0000","last_became_peered":"2023-11-27T20:45:05.642092+0000","last_unstale":"2023-11-27T20:45:06.273749+0000","last_undegraded":"2023-11-27T20:45:06.273749+0000","last_fullsized":"2023-11-27T20:45:06.273749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:54.248320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.281136+0000","last_change":"2023-11-27T20:45:06.274852+0000","last_active":"2023-11-27T20:45:06.281136+0000","last_peered":"2023-11-27T20:45:06.281136+0000","last_clean":"2023-11-27T20:45:06.281136+0000","last_became_active":"2023-11-27T20:45:06.274316+0000","last_became_peered":"2023-11-27T20:45:06.274316+0000","last_unstale":"2023-11-27T20:45:06.281136+0000","last_undegraded":"2023-11-27T20:45:06.281136+0000","last_fullsized":"2023-11-27T20:45:06.281136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:51:09.692880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248438+0000","last_change":"2023-11-27T20:45:05.628335+0000","last_active":"2023-11-27T20:45:07.248438+0000","last_peered":"2023-11-27T20:45:07.248438+0000","last_clean":"2023-11-27T20:45:07.248438+0000","last_became_active":"2023-11-27T20:45:05.627980+0000","last_became_peered":"2023-11-27T20:45:05.627980+0000","last_unstale":"2023-11-27T20:45:07.248438+0000","last_undegraded":"2023-11-27T20:45:07.248438+0000","last_fullsized":"2023-11-27T20:45:07.248438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:19.744666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382377+0000","last_change":"2023-11-27T20:45:06.265399+0000","last_active":"2023-11-27T20:45:07.382377+0000","last_peered":"2023-11-27T20:45:07.382377+0000","last_clean":"2023-11-27T20:45:07.382377+0000","last_became_active":"2023-11-27T20:45:06.265015+0000","last_became_peered":"2023-11-27T20:45:06.265015+0000","last_unstale":"2023-11-27T20:45:07.382377+0000","last_undegraded":"2023-11-27T20:45:07.382377+0000","last_fullsized":"2023-11-27T20:45:07.382377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.260747+0000","last_change":"2023-11-27T20:45:05.639115+0000","last_active":"2023-11-27T20:45:06.260747+0000","last_peered":"2023-11-27T20:45:06.260747+0000","last_clean":"2023-11-27T20:45:06.260747+0000","last_became_active":"2023-11-27T20:45:05.638219+0000","last_became_peered":"2023-11-27T20:45:05.638219+0000","last_unstale":"2023-11-27T20:45:06.260747+0000","last_undegraded":"2023-11-27T20:45:06.260747+0000","last_fullsized":"2023-11-27T20:45:06.260747+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:38.005329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277351+0000","last_change":"2023-11-27T20:45:06.270416+0000","last_active":"2023-11-27T20:45:06.277351+0000","last_peered":"2023-11-27T20:45:06.277351+0000","last_clean":"2023-11-27T20:45:06.277351+0000","last_became_active":"2023-11-27T20:45:06.270028+0000","last_became_peered":"2023-11-27T20:45:06.270028+0000","last_unstale":"2023-11-27T20:45:06.277351+0000","last_undegraded":"2023-11-27T20:45:06.277351+0000","last_fullsized":"2023-11-27T20:45:06.277351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:07:35.512664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.257437+0000","last_change":"2023-11-27T20:45:05.637206+0000","last_active":"2023-11-27T20:45:06.257437+0000","last_peered":"2023-11-27T20:45:06.257437+0000","last_clean":"2023-11-27T20:45:06.257437+0000","last_became_active":"2023-11-27T20:45:05.636487+0000","last_became_peered":"2023-11-27T20:45:05.636487+0000","last_unstale":"2023-11-27T20:45:06.257437+0000","last_undegraded":"2023-11-27T20:45:06.257437+0000","last_fullsized":"2023-11-27T20:45:06.257437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:47.083443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382139+0000","last_change":"2023-11-27T20:45:06.279113+0000","last_active":"2023-11-27T20:45:07.382139+0000","last_peered":"2023-11-27T20:45:07.382139+0000","last_clean":"2023-11-27T20:45:07.382139+0000","last_became_active":"2023-11-27T20:45:06.278833+0000","last_became_peered":"2023-11-27T20:45:06.278833+0000","last_unstale":"2023-11-27T20:45:07.382139+0000","last_undegraded":"2023-11-27T20:45:07.382139+0000","last_fullsized":"2023-11-27T20:45:07.382139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:24.286070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.247763+0000","last_change":"2023-11-27T20:45:05.635630+0000","last_active":"2023-11-27T20:45:07.247763+0000","last_peered":"2023-11-27T20:45:07.247763+0000","last_clean":"2023-11-27T20:45:07.247763+0000","last_became_active":"2023-11-27T20:45:05.635217+0000","last_became_peered":"2023-11-27T20:45:05.635217+0000","last_unstale":"2023-11-27T20:45:07.247763+0000","last_undegraded":"2023-11-27T20:45:07.247763+0000","last_fullsized":"2023-11-27T20:45:07.247763+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:25.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.265028+0000","last_change":"2023-11-27T20:45:06.263237+0000","last_active":"2023-11-27T20:45:06.265028+0000","last_peered":"2023-11-27T20:45:06.265028+0000","last_clean":"2023-11-27T20:45:06.265028+0000","last_became_active":"2023-11-27T20:45:06.262918+0000","last_became_peered":"2023-11-27T20:45:06.262918+0000","last_unstale":"2023-11-27T20:45:06.265028+0000","last_undegraded":"2023-11-27T20:45:06.265028+0000","last_fullsized":"2023-11-27T20:45:06.265028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:38:27.633981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.663813+0000","last_change":"2023-11-27T20:45:05.631892+0000","last_active":"2023-11-27T20:45:06.663813+0000","last_peered":"2023-11-27T20:45:06.663813+0000","last_clean":"2023-11-27T20:45:06.663813+0000","last_became_active":"2023-11-27T20:45:05.631305+0000","last_became_peered":"2023-11-27T20:45:05.631305+0000","last_unstale":"2023-11-27T20:45:06.663813+0000","last_undegraded":"2023-11-27T20:45:06.663813+0000","last_fullsized":"2023-11-27T20:45:06.663813+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:30:06.654414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248966+0000","last_change":"2023-11-27T20:45:06.282615+0000","last_active":"2023-11-27T20:45:07.248966+0000","last_peered":"2023-11-27T20:45:07.248966+0000","last_clean":"2023-11-27T20:45:07.248966+0000","last_became_active":"2023-11-27T20:45:06.282331+0000","last_became_peered":"2023-11-27T20:45:06.282331+0000","last_unstale":"2023-11-27T20:45:07.248966+0000","last_undegraded":"2023-11-27T20:45:07.248966+0000","last_fullsized":"2023-11-27T20:45:07.248966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:00:14.175844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.245061+0000","last_change":"2023-11-27T20:45:05.631778+0000","last_active":"2023-11-27T20:45:06.245061+0000","last_peered":"2023-11-27T20:45:06.245061+0000","last_clean":"2023-11-27T20:45:06.245061+0000","last_became_active":"2023-11-27T20:45:05.631172+0000","last_became_peered":"2023-11-27T20:45:05.631172+0000","last_unstale":"2023-11-27T20:45:06.245061+0000","last_undegraded":"2023-11-27T20:45:06.245061+0000","last_fullsized":"2023-11-27T20:45:06.245061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:18.830687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250468+0000","last_change":"2023-11-27T20:45:06.274427+0000","last_active":"2023-11-27T20:45:07.250468+0000","last_peered":"2023-11-27T20:45:07.250468+0000","last_clean":"2023-11-27T20:45:07.250468+0000","last_became_active":"2023-11-27T20:45:06.274140+0000","last_became_peered":"2023-11-27T20:45:06.274140+0000","last_unstale":"2023-11-27T20:45:07.250468+0000","last_undegraded":"2023-11-27T20:45:07.250468+0000","last_fullsized":"2023-11-27T20:45:07.250468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:07.361631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250646+0000","last_change":"2023-11-27T20:45:05.637612+0000","last_active":"2023-11-27T20:45:07.250646+0000","last_peered":"2023-11-27T20:45:07.250646+0000","last_clean":"2023-11-27T20:45:07.250646+0000","last_became_active":"2023-11-27T20:45:05.637230+0000","last_became_peered":"2023-11-27T20:45:05.637230+0000","last_unstale":"2023-11-27T20:45:07.250646+0000","last_undegraded":"2023-11-27T20:45:07.250646+0000","last_fullsized":"2023-11-27T20:45:07.250646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:59.384018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.285973+0000","last_change":"2023-11-27T20:45:06.279317+0000","last_active":"2023-11-27T20:45:06.285973+0000","last_peered":"2023-11-27T20:45:06.285973+0000","last_clean":"2023-11-27T20:45:06.285973+0000","last_became_active":"2023-11-27T20:45:06.279052+0000","last_became_peered":"2023-11-27T20:45:06.279052+0000","last_unstale":"2023-11-27T20:45:06.285973+0000","last_undegraded":"2023-11-27T20:45:06.285973+0000","last_fullsized":"2023-11-27T20:45:06.285973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:59.150344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250489+0000","last_change":"2023-11-27T20:45:05.634977+0000","last_active":"2023-11-27T20:45:07.250489+0000","last_peered":"2023-11-27T20:45:07.250489+0000","last_clean":"2023-11-27T20:45:07.250489+0000","last_became_active":"2023-11-27T20:45:05.631916+0000","last_became_peered":"2023-11-27T20:45:05.631916+0000","last_unstale":"2023-11-27T20:45:07.250489+0000","last_undegraded":"2023-11-27T20:45:07.250489+0000","last_fullsized":"2023-11-27T20:45:07.250489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:27.977492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382366+0000","last_change":"2023-11-27T20:45:06.266010+0000","last_active":"2023-11-27T20:45:07.382366+0000","last_peered":"2023-11-27T20:45:07.382366+0000","last_clean":"2023-11-27T20:45:07.382366+0000","last_became_active":"2023-11-27T20:45:06.265669+0000","last_became_peered":"2023-11-27T20:45:06.265669+0000","last_unstale":"2023-11-27T20:45:07.382366+0000","last_undegraded":"2023-11-27T20:45:07.382366+0000","last_fullsized":"2023-11-27T20:45:07.382366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:11.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.273742+0000","last_change":"2023-11-27T20:45:05.637071+0000","last_active":"2023-11-27T20:45:06.273742+0000","last_peered":"2023-11-27T20:45:06.273742+0000","last_clean":"2023-11-27T20:45:06.273742+0000","last_became_active":"2023-11-27T20:45:05.636864+0000","last_became_peered":"2023-11-27T20:45:05.636864+0000","last_unstale":"2023-11-27T20:45:06.273742+0000","last_undegraded":"2023-11-27T20:45:06.273742+0000","last_fullsized":"2023-11-27T20:45:06.273742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:59:56.168871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277869+0000","last_change":"2023-11-27T20:45:06.270493+0000","last_active":"2023-11-27T20:45:06.277869+0000","last_peered":"2023-11-27T20:45:06.277869+0000","last_clean":"2023-11-27T20:45:06.277869+0000","last_became_active":"2023-11-27T20:45:06.270214+0000","last_became_peered":"2023-11-27T20:45:06.270214+0000","last_unstale":"2023-11-27T20:45:06.277869+0000","last_undegraded":"2023-11-27T20:45:06.277869+0000","last_fullsized":"2023-11-27T20:45:06.277869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.256059+0000","last_change":"2023-11-27T20:45:05.642971+0000","last_active":"2023-11-27T20:45:06.256059+0000","last_peered":"2023-11-27T20:45:06.256059+0000","last_clean":"2023-11-27T20:45:06.256059+0000","last_became_active":"2023-11-27T20:45:05.642000+0000","last_became_peered":"2023-11-27T20:45:05.642000+0000","last_unstale":"2023-11-27T20:45:06.256059+0000","last_undegraded":"2023-11-27T20:45:06.256059+0000","last_fullsized":"2023-11-27T20:45:06.256059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:35:57.425975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.247899+0000","last_change":"2023-11-27T20:45:06.274514+0000","last_active":"2023-11-27T20:45:07.247899+0000","last_peered":"2023-11-27T20:45:07.247899+0000","last_clean":"2023-11-27T20:45:07.247899+0000","last_became_active":"2023-11-27T20:45:06.273513+0000","last_became_peered":"2023-11-27T20:45:06.273513+0000","last_unstale":"2023-11-27T20:45:07.247899+0000","last_undegraded":"2023-11-27T20:45:07.247899+0000","last_fullsized":"2023-11-27T20:45:07.247899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:13.008822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250422+0000","last_change":"2023-11-27T20:45:05.630546+0000","last_active":"2023-11-27T20:45:07.250422+0000","last_peered":"2023-11-27T20:45:07.250422+0000","last_clean":"2023-11-27T20:45:07.250422+0000","last_became_active":"2023-11-27T20:45:05.629859+0000","last_became_peered":"2023-11-27T20:45:05.629859+0000","last_unstale":"2023-11-27T20:45:07.250422+0000","last_undegraded":"2023-11-27T20:45:07.250422+0000","last_fullsized":"2023-11-27T20:45:07.250422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:34.967969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250168+0000","last_change":"2023-11-27T20:45:06.277953+0000","last_active":"2023-11-27T20:45:07.250168+0000","last_peered":"2023-11-27T20:45:07.250168+0000","last_clean":"2023-11-27T20:45:07.250168+0000","last_became_active":"2023-11-27T20:45:06.275250+0000","last_became_peered":"2023-11-27T20:45:06.275250+0000","last_unstale":"2023-11-27T20:45:07.250168+0000","last_undegraded":"2023-11-27T20:45:07.250168+0000","last_fullsized":"2023-11-27T20:45:07.250168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.258784+0000","last_change":"2023-11-27T20:45:05.640372+0000","last_active":"2023-11-27T20:45:06.258784+0000","last_peered":"2023-11-27T20:45:06.258784+0000","last_clean":"2023-11-27T20:45:06.258784+0000","last_became_active":"2023-11-27T20:45:05.640048+0000","last_became_peered":"2023-11-27T20:45:05.640048+0000","last_unstale":"2023-11-27T20:45:06.258784+0000","last_undegraded":"2023-11-27T20:45:06.258784+0000","last_fullsized":"2023-11-27T20:45:06.258784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:34.967969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.271395+0000","last_change":"2023-11-27T20:45:06.266017+0000","last_active":"2023-11-27T20:45:06.271395+0000","last_peered":"2023-11-27T20:45:06.271395+0000","last_clean":"2023-11-27T20:45:06.271395+0000","last_became_active":"2023-11-27T20:45:06.265439+0000","last_became_peered":"2023-11-27T20:45:06.265439+0000","last_unstale":"2023-11-27T20:45:06.271395+0000","last_undegraded":"2023-11-27T20:45:06.271395+0000","last_fullsized":"2023-11-27T20:45:06.271395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:38.205825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248569+0000","last_change":"2023-11-27T20:45:05.643524+0000","last_active":"2023-11-27T20:45:07.248569+0000","last_peered":"2023-11-27T20:45:07.248569+0000","last_clean":"2023-11-27T20:45:07.248569+0000","last_became_active":"2023-11-27T20:45:05.642570+0000","last_became_peered":"2023-11-27T20:45:05.642570+0000","last_unstale":"2023-11-27T20:45:07.248569+0000","last_undegraded":"2023-11-27T20:45:07.248569+0000","last_fullsized":"2023-11-27T20:45:07.248569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:00.040780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":215,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.261447+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:45:06.261447+0000","last_peered":"2023-11-27T20:45:06.261447+0000","last_clean":"2023-11-27T20:45:06.261447+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:45:06.261447+0000","last_undegraded":"2023-11-27T20:45:06.261447+0000","last_fullsized":"2023-11-27T20:45:06.261447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1519616,"data_stored":1000886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.127,"15min":1.153},"min":{"1min":0.63800000000000001,"5min":0.627,"15min":0.627},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.288},{"interface":"front","average":{"1min":1.129,"5min":1.206,"15min":1.2290000000000001},"min":{"1min":0.74199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6950000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.3400000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1890000000000001,"15min":1.224},"min":{"1min":0.71299999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.391,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.395},{"interface":"front","average":{"1min":1.099,"5min":1.1859999999999999,"15min":1.216},"min":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.585,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.637}]},{"osd":2,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.2330000000000001,"15min":1.2909999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4970000000000001,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.224},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2390000000000001,"15min":1.256},"min":{"1min":0.78300000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.722,"5min":1.909,"15min":1.909},"last":1.1439999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3340000000000001,"15min":1.3879999999999999},"min":{"1min":0.83199999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6000000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.579},{"interface":"front","average":{"1min":1.375,"5min":1.4430000000000001,"15min":1.4870000000000001},"min":{"1min":0.89800000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.95,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.5089999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.371,"15min":1.4099999999999999},"min":{"1min":1.0720000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.871,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.538},{"interface":"front","average":{"1min":1.373,"5min":1.4910000000000001,"15min":1.587},"min":{"1min":0.76500000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.897,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.4199999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.466,"15min":1.502},"min":{"1min":0.91000000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.462},{"interface":"front","average":{"1min":1.444,"5min":1.5329999999999999,"15min":1.583},"min":{"1min":1.0449999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7549999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.4790000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.627,"15min":1.667},"min":{"1min":1.208,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.849,"5min":2.508,"15min":2.508},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.6120000000000001,"15min":1.6799999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.849,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.6919999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":411142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2250000000000001,"15min":1.2709999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.6799999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.278},{"interface":"front","average":{"1min":1.145,"5min":1.266,"15min":1.3180000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.7430000000000001,"5min":2.581,"15min":2.581},"last":1.613}]},{"osd":1,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.2110000000000001,"15min":1.2629999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5309999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.165},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.129,"15min":1.159},"min":{"1min":0.66100000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.484,"5min":2.823,"15min":2.823},"last":0.96799999999999997}]},{"osd":2,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.0549999999999999,"15min":1.0740000000000001},"min":{"1min":0.69199999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4570000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3280000000000001,"15min":1.3899999999999999},"min":{"1min":0.753,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.651,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.82499999999999996}]},{"osd":3,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.304,"15min":1.3720000000000001},"min":{"1min":0.879,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.649,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.77},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.306,"15min":1.3440000000000001},"min":{"1min":0.83499999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.526,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.335}]},{"osd":4,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.532,"15min":1.607},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0019999999999998,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.367},{"interface":"front","average":{"1min":1.375,"5min":1.5609999999999999,"15min":1.6419999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.9450000000000001,"5min":3.536,"15min":3.536},"last":1.863}]},{"osd":5,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.3620000000000001,"15min":1.3979999999999999},"min":{"1min":0.74399999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7210000000000001,"5min":2.355,"15min":2.355},"last":1.397},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.589,"15min":1.6599999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.097,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.448}]},{"osd":7,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.581,"15min":1.669},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0230000000000001,"5min":3.645,"15min":3.645},"last":1.9550000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.534,"15min":1.577},"min":{"1min":0.93000000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.0590000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.2290000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":937984,"data_stored":412082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.103,"15min":1.151},"min":{"1min":0.71899999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.456,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.323},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1379999999999999,"15min":1.1779999999999999},"min":{"1min":0.73999999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.486,"5min":2.04,"15min":2.04},"last":1.4370000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1479999999999999,"15min":1.194},"min":{"1min":0.68500000000000005,"5min":0.379,"15min":0.379},"max":{"1min":1.4730000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.01},{"interface":"front","average":{"1min":1.117,"5min":1.153,"15min":1.165},"min":{"1min":0.68600000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3340000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.94699999999999995}]},{"osd":2,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.246,"15min":1.286},"min":{"1min":0.58999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.554,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1799999999999999,"15min":1.2090000000000001},"min":{"1min":0.75700000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.556,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.1970000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.341,"15min":1.391},"min":{"1min":0.70999999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6839999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.361,"15min":1.4470000000000001},"min":{"1min":0.70799999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4179999999999999,"5min":4.016,"15min":4.016},"last":1.3700000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.3029999999999999,"15min":1.3740000000000001},"min":{"1min":0.63200000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5149999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.056},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5329999999999999,"15min":1.617},"min":{"1min":0.80500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0289999999999999,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.1499999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.534,"15min":1.643},"min":{"1min":0.628,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.615,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.756},{"interface":"front","average":{"1min":1.383,"5min":1.5229999999999999,"15min":1.595},"min":{"1min":0.79000000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.637,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.5189999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.581,"15min":1.663},"min":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8520000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.706},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.6220000000000001,"15min":1.7310000000000001},"min":{"1min":0.81100000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.8200000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.571}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":404148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0109999999999999,"15min":1.006},"min":{"1min":0.63200000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4870000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.198,"5min":1.1080000000000001,"15min":1.0900000000000001},"min":{"1min":0.79900000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6180000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0609999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.0980000000000001,"15min":1.0289999999999999},"min":{"1min":0.85099999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.2},{"interface":"front","average":{"1min":1.361,"5min":1.25,"15min":1.2290000000000001},"min":{"1min":0.79900000000000004,"5min":0.628,"15min":0.628},"max":{"1min":3.9430000000000001,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.1519999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2210000000000001,"15min":1.2130000000000001},"min":{"1min":0.73199999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.296,"15min":1.296},"min":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.391}]},{"osd":3,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1459999999999999,"15min":1.1679999999999999},"min":{"1min":0.75900000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.321,"5min":1.778,"15min":1.778},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.3540000000000001,"15min":1.341},"min":{"1min":0.88600000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.623,"5min":2.097,"15min":2.097},"last":1.4890000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.222,"15min":1.2689999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7270000000000001,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.3899999999999999,"15min":1.419},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.601,"5min":1.992,"15min":1.992},"last":1.2669999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.351,"15min":1.367},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.841,"5min":2.157,"15min":2.157},"last":1.347},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5609999999999999,"15min":1.5940000000000001},"min":{"1min":0.73399999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.837,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.5409999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.492,"15min":1.4950000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.921,"5min":2.202,"15min":2.202},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.647,"15min":1.657},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.9350000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.601}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":412060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.93400000000000005,"15min":1.016},"min":{"1min":0.49199999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92700000000000005,"5min":3.641,"15min":3.641},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94599999999999995,"15min":1.0049999999999999},"min":{"1min":0.45800000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.5389999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.0660000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.91400000000000003,"15min":0.93999999999999995},"min":{"1min":0.46899999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.296,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":1.29},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0640000000000001,"15min":1.1100000000000001},"min":{"1min":0.61699999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.464,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.23}]},{"osd":2,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.075,"15min":1.1100000000000001},"min":{"1min":0.52300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6020000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.8100000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.087,"15min":1.125},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3939999999999999,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.4259999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3009999999999999,"15min":1.337},"min":{"1min":0.89700000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8939999999999999,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.482},{"interface":"front","average":{"1min":1.198,"5min":1.327,"15min":1.389},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6679999999999999,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.679}]},{"osd":5,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.371,"15min":1.4219999999999999},"min":{"1min":0.86299999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.5840000000000001,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.603},{"interface":"front","average":{"1min":1.331,"5min":1.419,"15min":1.4710000000000001},"min":{"1min":0.90700000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.954,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.6399999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.478,"15min":1.53},"min":{"1min":0.96299999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.9830000000000001,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.323},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4590000000000001,"15min":1.5109999999999999},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.9039999999999999,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.361}]},{"osd":7,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.496,"15min":1.55},"min":{"1min":0.93700000000000006,"5min":0.871,"15min":0.871},"max":{"1min":2.0310000000000001,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4490000000000001,"15min":1.488},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6919999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.7350000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":913408,"data_stored":404730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.80600000000000005},"min":{"1min":0.56399999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89000000000000001,"15min":0.92600000000000005},"min":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4750000000000001,"5min":1.972,"15min":1.972},"last":0.49099999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94999999999999996,"15min":1.004},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.252,"5min":1.522,"15min":1.522},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.98699999999999999},"min":{"1min":0.54100000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.3580000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.55700000000000005}]},{"osd":3,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.49399999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.45100000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.073,"15min":1.101},"min":{"1min":0.59099999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.175,"15min":1.2070000000000001},"min":{"1min":0.77500000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.522,"5min":1.669,"15min":1.669},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.349,"15min":1.383},"min":{"1min":0.97299999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8160000000000001,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.284,"15min":1.3200000000000001},"min":{"1min":0.92800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6160000000000001,"5min":2.48,"15min":2.48},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.381,"5min":1.4239999999999999,"15min":1.484},"min":{"1min":1.093,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.869,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3560000000000001,"15min":1.3779999999999999},"min":{"1min":0.89800000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7649999999999999,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4650000000000001,"15min":1.5289999999999999},"min":{"1min":1.111,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.752,"5min":3.302,"15min":3.302},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.431,"15min":1.486},"min":{"1min":0.84599999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.893,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.355,"5min":1.403,"15min":1.4710000000000001},"min":{"1min":1.0289999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7649999999999999,"5min":2.73,"15min":2.73},"last":1.077}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":921600,"data_stored":404342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.308,"15min":0.308},"max":{"1min":1.048,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88,"15min":0.876},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3320000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.90200000000000002}]},{"osd":2,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.55700000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4590000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.036,"15min":1.0449999999999999},"min":{"1min":0.51600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.444,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.0229999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.044,"15min":1.032},"min":{"1min":0.57899999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5469999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.123},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.079,"15min":1.085},"min":{"1min":0.66800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8500000000000001,"5min":2.044,"15min":2.044},"last":1.0840000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2,"15min":1.196},"min":{"1min":0.81299999999999994,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.365,"5min":1.367,"15min":1.355},"min":{"1min":0.79400000000000004,"5min":0.752,"15min":0.752},"max":{"1min":2.1589999999999998,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.1739999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.276,"15min":1.242},"min":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.004,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.306},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.2749999999999999,"15min":1.2410000000000001},"min":{"1min":0.85599999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1989999999999998,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.0600000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.359,"15min":1.325},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.1070000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.21},{"interface":"front","average":{"1min":1.377,"5min":1.347,"15min":1.3580000000000001},"min":{"1min":0.83399999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.0699999999999998,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.4279999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.45,"15min":1.47},"min":{"1min":1.042,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.9019999999999999,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.355},{"interface":"front","average":{"1min":1.47,"5min":1.573,"15min":1.5800000000000001},"min":{"1min":1.0169999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.1789999999999998,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.474}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":994550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.405,"5min":1.901,"15min":1.901},"last":1.093},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.877,"15min":0.84999999999999998},"min":{"1min":0.52300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.012}]},{"osd":2,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.87,"15min":0.84099999999999997},"min":{"1min":0.54500000000000004,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3129999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":0.96199999999999997,"15min":0.95599999999999996},"min":{"1min":0.55500000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.198}]},{"osd":3,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.91700000000000004,"15min":0.89800000000000002},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.4590000000000001,"5min":1.875,"15min":1.875},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.073,"15min":1.0569999999999999},"min":{"1min":0.52000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.847,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.2430000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2549999999999999,"15min":1.2490000000000001},"min":{"1min":0.75900000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.958,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.518},{"interface":"front","average":{"1min":1.248,"5min":1.2090000000000001,"15min":1.196},"min":{"1min":0.82899999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.056,"5min":2.391,"15min":2.391},"last":1.294}]},{"osd":5,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3480000000000001,"15min":1.3540000000000001},"min":{"1min":0.747,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.992,"5min":3.028,"15min":3.028},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3220000000000001,"15min":1.3129999999999999},"min":{"1min":0.79000000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6970000000000001,"5min":2.718,"15min":2.718},"last":1.4239999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3,"15min":1.3100000000000001},"min":{"1min":0.83499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.633,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4099999999999999,"15min":1.4199999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.462}]},{"osd":7,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.90600000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.708,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.625},{"interface":"front","average":{"1min":1.329,"5min":1.349,"15min":1.357},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.776,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.2310000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:45:11.051 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:45:11.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.298+0000 7f023f064640 1 Processor -- start 2023-11-27T20:45:11.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.298+0000 7f023f064640 1 -- start start 2023-11-27T20:45:11.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.299+0000 7f023f064640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0238155490 0x7f02380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f023f064640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f02380c1500 0x7f02380a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f023f064640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02380c4080 0x7f02380a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f023f064640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02380a5820 con 0x7f0238155490 2023-11-27T20:45:11.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f023f064640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02380c06c0 con 0x7f02380c1500 2023-11-27T20:45:11.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f023f064640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c1020 con 0x7f02380c4080 2023-11-27T20:45:11.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f023ce00640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0238155490 0x7f02380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:11.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f023ce00640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0238155490 0x7f02380a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52100/0 (socket says 172.21.15.91:52100) 2023-11-27T20:45:11.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f023ce00640 1 -- 172.21.15.91:0/1402710572 learned_addr learned my addr 172.21.15.91:0/1402710572 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f023ce00640 1 -- 172.21.15.91:0/1402710572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02380c4080 msgr2=0x7f02380a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f0237fff640 1 --2- 172.21.15.91:0/1402710572 >> v2:172.21.15.183:3300/0 conn(0x7f02380c1500 0x7f02380a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.300+0000 7f023d601640 1 --2- 172.21.15.91:0/1402710572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02380c4080 0x7f02380a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.301+0000 7f023ce00640 1 --2- 172.21.15.91:0/1402710572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02380c4080 0x7f02380a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.301+0000 7f023ce00640 1 -- 172.21.15.91:0/1402710572 >> v2:172.21.15.183:3300/0 conn(0x7f02380c1500 msgr2=0x7f02380a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.301+0000 7f023ce00640 1 --2- 172.21.15.91:0/1402710572 >> v2:172.21.15.183:3300/0 conn(0x7f02380c1500 0x7f02380a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.301+0000 7f023ce00640 1 -- 172.21.15.91:0/1402710572 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02380c0910 con 0x7f0238155490 2023-11-27T20:45:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.301+0000 7f0237fff640 1 --2- 172.21.15.91:0/1402710572 >> v2:172.21.15.183:3300/0 conn(0x7f02380c1500 0x7f02380a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.301+0000 7f023d601640 1 --2- 172.21.15.91:0/1402710572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02380c4080 0x7f02380a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.302+0000 7f023ce00640 1 --2- 172.21.15.91:0/1402710572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0238155490 0x7f02380a51b0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f02380a5160 tx=0x7f022c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc84695e4035a5f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:11.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.302+0000 7f02377fe640 1 -- 172.21.15.91:0/1402710572 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c0317c0 con 0x7f0238155490 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.302+0000 7f02377fe640 1 -- 172.21.15.91:0/1402710572 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c031920 con 0x7f0238155490 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.302+0000 7f02377fe640 1 -- 172.21.15.91:0/1402710572 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c031cb0 con 0x7f0238155490 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.303+0000 7f023f064640 1 -- 172.21.15.91:0/1402710572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0238155490 msgr2=0x7f02380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.303+0000 7f023f064640 1 --2- 172.21.15.91:0/1402710572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0238155490 0x7f02380a51b0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f02380a5160 tx=0x7f022c02b860 comp rx=0 tx=0).stop 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.303+0000 7f023f064640 1 -- 172.21.15.91:0/1402710572 shutdown_connections 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.303+0000 7f023f064640 1 --2- 172.21.15.91:0/1402710572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02380c4080 0x7f02380a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.303+0000 7f023f064640 1 --2- 172.21.15.91:0/1402710572 >> v2:172.21.15.183:3300/0 conn(0x7f02380c1500 0x7f02380a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.303+0000 7f023f064640 1 --2- 172.21.15.91:0/1402710572 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0238155490 0x7f02380a51b0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.303+0000 7f023f064640 1 -- 172.21.15.91:0/1402710572 >> 172.21.15.91:0/1402710572 conn(0x7f023806a500 msgr2=0x7f023806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.303+0000 7f023f064640 1 -- 172.21.15.91:0/1402710572 shutdown_connections 2023-11-27T20:45:11.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.303+0000 7f023f064640 1 -- 172.21.15.91:0/1402710572 wait complete. 2023-11-27T20:45:11.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.304+0000 7f023f064640 1 Processor -- start 2023-11-27T20:45:11.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.305+0000 7f023f064640 1 -- start start 2023-11-27T20:45:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.305+0000 7f023f064640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02380c1500 0x7f023814b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023f064640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02380c4080 0x7f023814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023f064640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0238155490 0x7f023814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023f064640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380711c0 con 0x7f02380c1500 2023-11-27T20:45:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023f064640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0238070440 con 0x7f02380c4080 2023-11-27T20:45:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023f064640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023806fda0 con 0x7f0238155490 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023ce00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02380c1500 0x7f023814b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023ce00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02380c1500 0x7f023814b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52108/0 (socket says 172.21.15.91:52108) 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023ce00640 1 -- 172.21.15.91:0/887344755 learned_addr learned my addr 172.21.15.91:0/887344755 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023ce00640 1 -- 172.21.15.91:0/887344755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0238155490 msgr2=0x7f023814fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023ce00640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0238155490 0x7f023814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023ce00640 1 -- 172.21.15.91:0/887344755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02380c4080 msgr2=0x7f023814a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023ce00640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02380c4080 0x7f023814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.306+0000 7f023ce00640 1 -- 172.21.15.91:0/887344755 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c0094d0 con 0x7f02380c1500 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.307+0000 7f023ce00640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02380c1500 0x7f023814b5c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f022c000c00 tx=0x7f022c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.307+0000 7f02357fa640 1 -- 172.21.15.91:0/887344755 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c032920 con 0x7f02380c1500 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.307+0000 7f02357fa640 1 -- 172.21.15.91:0/887344755 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c032ac0 con 0x7f02380c1500 2023-11-27T20:45:11.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.307+0000 7f02357fa640 1 -- 172.21.15.91:0/887344755 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c032e70 con 0x7f02380c1500 2023-11-27T20:45:11.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.307+0000 7f023f064640 1 -- 172.21.15.91:0/887344755 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0238070930 con 0x7f02380c1500 2023-11-27T20:45:11.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.307+0000 7f023f064640 1 -- 172.21.15.91:0/887344755 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0238070060 con 0x7f02380c1500 2023-11-27T20:45:11.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.308+0000 7f023f064640 1 -- 172.21.15.91:0/887344755 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023814a070 con 0x7f02380c1500 2023-11-27T20:45:11.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.309+0000 7f02357fa640 1 -- 172.21.15.91:0/887344755 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f022c04e450 con 0x7f02380c1500 2023-11-27T20:45:11.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.310+0000 7f02357fa640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f021c06b1c0 0x7f021c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.311+0000 7f02357fa640 1 -- 172.21.15.91:0/887344755 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f022c0abc50 con 0x7f02380c1500 2023-11-27T20:45:11.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.311+0000 7f0237fff640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f021c06b1c0 0x7f021c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:11.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.311+0000 7f0237fff640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f021c06b1c0 0x7f021c06d680 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f02380c0340 tx=0x7f0224008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:11.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.315+0000 7f02357fa640 1 -- 172.21.15.91:0/887344755 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f022c076970 con 0x7f02380c1500 2023-11-27T20:45:11.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.501+0000 7f023f064640 1 -- 172.21.15.91:0/887344755 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0238155870 con 0x7f021c06b1c0 2023-11-27T20:45:11.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.513+0000 7f02357fa640 1 -- 172.21.15.91:0/887344755 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286677 (secure 0 0 0) 0x7f022400a4a0 con 0x7f021c06b1c0 2023-11-27T20:45:11.517 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:11.519 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:45:11.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 -- 172.21.15.91:0/887344755 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f021c06b1c0 msgr2=0x7f021c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f021c06b1c0 0x7f021c06d680 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f02380c0340 tx=0x7f0224008040 comp rx=0 tx=0).stop 2023-11-27T20:45:11.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 -- 172.21.15.91:0/887344755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02380c1500 msgr2=0x7f023814b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02380c1500 0x7f023814b5c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f022c000c00 tx=0x7f022c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 -- 172.21.15.91:0/887344755 shutdown_connections 2023-11-27T20:45:11.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0238155490 0x7f023814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f021c06b1c0 0x7f021c06d680 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02380c4080 0x7f023814a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 --2- 172.21.15.91:0/887344755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02380c1500 0x7f023814b5c0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 -- 172.21.15.91:0/887344755 >> 172.21.15.91:0/887344755 conn(0x7f023806a500 msgr2=0x7f02380a9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:11.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 -- 172.21.15.91:0/887344755 shutdown_connections 2023-11-27T20:45:11.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.520+0000 7f023f064640 1 -- 172.21.15.91:0/887344755 wait complete. 2023-11-27T20:45:11.540 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2023-11-27T20:45:11.444853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253672,"kb_used_data":8376,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721048,"statfs":{"total":773094113280,"available":772834353152,"internally_reserved":0,"allocated":8577024,"data_stored":4443940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002087"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250664+0000","last_change":"2023-11-27T20:45:06.275855+0000","last_active":"2023-11-27T20:45:07.250664+0000","last_peered":"2023-11-27T20:45:07.250664+0000","last_clean":"2023-11-27T20:45:07.250664+0000","last_became_active":"2023-11-27T20:45:06.272756+0000","last_became_peered":"2023-11-27T20:45:06.272756+0000","last_unstale":"2023-11-27T20:45:07.250664+0000","last_undegraded":"2023-11-27T20:45:07.250664+0000","last_fullsized":"2023-11-27T20:45:07.250664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:14.466572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.275462+0000","last_change":"2023-11-27T20:45:06.271328+0000","last_active":"2023-11-27T20:45:06.275462+0000","last_peered":"2023-11-27T20:45:06.275462+0000","last_clean":"2023-11-27T20:45:06.275462+0000","last_became_active":"2023-11-27T20:45:06.271029+0000","last_became_peered":"2023-11-27T20:45:06.271029+0000","last_unstale":"2023-11-27T20:45:06.275462+0000","last_undegraded":"2023-11-27T20:45:06.275462+0000","last_fullsized":"2023-11-27T20:45:06.275462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:50:09.959822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248337+0000","last_change":"2023-11-27T20:45:06.283797+0000","last_active":"2023-11-27T20:45:07.248337+0000","last_peered":"2023-11-27T20:45:07.248337+0000","last_clean":"2023-11-27T20:45:07.248337+0000","last_became_active":"2023-11-27T20:45:06.281615+0000","last_became_peered":"2023-11-27T20:45:06.281615+0000","last_unstale":"2023-11-27T20:45:07.248337+0000","last_undegraded":"2023-11-27T20:45:07.248337+0000","last_fullsized":"2023-11-27T20:45:07.248337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:26.013200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.281015+0000","last_change":"2023-11-27T20:45:06.274435+0000","last_active":"2023-11-27T20:45:06.281015+0000","last_peered":"2023-11-27T20:45:06.281015+0000","last_clean":"2023-11-27T20:45:06.281015+0000","last_became_active":"2023-11-27T20:45:06.274050+0000","last_became_peered":"2023-11-27T20:45:06.274050+0000","last_unstale":"2023-11-27T20:45:06.281015+0000","last_undegraded":"2023-11-27T20:45:06.281015+0000","last_fullsized":"2023-11-27T20:45:06.281015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:50:16.355137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277266+0000","last_change":"2023-11-27T20:45:06.270397+0000","last_active":"2023-11-27T20:45:06.277266+0000","last_peered":"2023-11-27T20:45:06.277266+0000","last_clean":"2023-11-27T20:45:06.277266+0000","last_became_active":"2023-11-27T20:45:06.270159+0000","last_became_peered":"2023-11-27T20:45:06.270159+0000","last_unstale":"2023-11-27T20:45:06.277266+0000","last_undegraded":"2023-11-27T20:45:06.277266+0000","last_fullsized":"2023-11-27T20:45:06.277266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:43:44.488291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382137+0000","last_change":"2023-11-27T20:45:06.276571+0000","last_active":"2023-11-27T20:45:07.382137+0000","last_peered":"2023-11-27T20:45:07.382137+0000","last_clean":"2023-11-27T20:45:07.382137+0000","last_became_active":"2023-11-27T20:45:06.276265+0000","last_became_peered":"2023-11-27T20:45:06.276265+0000","last_unstale":"2023-11-27T20:45:07.382137+0000","last_undegraded":"2023-11-27T20:45:07.382137+0000","last_fullsized":"2023-11-27T20:45:07.382137+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:28.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277333+0000","last_change":"2023-11-27T20:45:06.271839+0000","last_active":"2023-11-27T20:45:06.277333+0000","last_peered":"2023-11-27T20:45:06.277333+0000","last_clean":"2023-11-27T20:45:06.277333+0000","last_became_active":"2023-11-27T20:45:06.271230+0000","last_became_peered":"2023-11-27T20:45:06.271230+0000","last_unstale":"2023-11-27T20:45:06.277333+0000","last_undegraded":"2023-11-27T20:45:06.277333+0000","last_fullsized":"2023-11-27T20:45:06.277333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:10:16.369642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382047+0000","last_change":"2023-11-27T20:45:06.271557+0000","last_active":"2023-11-27T20:45:07.382047+0000","last_peered":"2023-11-27T20:45:07.382047+0000","last_clean":"2023-11-27T20:45:07.382047+0000","last_became_active":"2023-11-27T20:45:06.271014+0000","last_became_peered":"2023-11-27T20:45:06.271014+0000","last_unstale":"2023-11-27T20:45:07.382047+0000","last_undegraded":"2023-11-27T20:45:07.382047+0000","last_fullsized":"2023-11-27T20:45:07.382047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:35.973730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382526+0000","last_change":"2023-11-27T20:45:06.279235+0000","last_active":"2023-11-27T20:45:07.382526+0000","last_peered":"2023-11-27T20:45:07.382526+0000","last_clean":"2023-11-27T20:45:07.382526+0000","last_became_active":"2023-11-27T20:45:06.278923+0000","last_became_peered":"2023-11-27T20:45:06.278923+0000","last_unstale":"2023-11-27T20:45:07.382526+0000","last_undegraded":"2023-11-27T20:45:07.382526+0000","last_fullsized":"2023-11-27T20:45:07.382526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.251040+0000","last_change":"2023-11-27T20:45:06.280157+0000","last_active":"2023-11-27T20:45:07.251040+0000","last_peered":"2023-11-27T20:45:07.251040+0000","last_clean":"2023-11-27T20:45:07.251040+0000","last_became_active":"2023-11-27T20:45:06.275941+0000","last_became_peered":"2023-11-27T20:45:06.275941+0000","last_unstale":"2023-11-27T20:45:07.251040+0000","last_undegraded":"2023-11-27T20:45:07.251040+0000","last_fullsized":"2023-11-27T20:45:07.251040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:55.254080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.275683+0000","last_change":"2023-11-27T20:45:06.268839+0000","last_active":"2023-11-27T20:45:06.275683+0000","last_peered":"2023-11-27T20:45:06.275683+0000","last_clean":"2023-11-27T20:45:06.275683+0000","last_became_active":"2023-11-27T20:45:06.268579+0000","last_became_peered":"2023-11-27T20:45:06.268579+0000","last_unstale":"2023-11-27T20:45:06.275683+0000","last_undegraded":"2023-11-27T20:45:06.275683+0000","last_fullsized":"2023-11-27T20:45:06.275683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:26.869703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.249899+0000","last_change":"2023-11-27T20:45:06.270837+0000","last_active":"2023-11-27T20:45:07.249899+0000","last_peered":"2023-11-27T20:45:07.249899+0000","last_clean":"2023-11-27T20:45:07.249899+0000","last_became_active":"2023-11-27T20:45:06.270495+0000","last_became_peered":"2023-11-27T20:45:06.270495+0000","last_unstale":"2023-11-27T20:45:07.249899+0000","last_undegraded":"2023-11-27T20:45:07.249899+0000","last_fullsized":"2023-11-27T20:45:07.249899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:11.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248414+0000","last_change":"2023-11-27T20:45:06.273803+0000","last_active":"2023-11-27T20:45:07.248414+0000","last_peered":"2023-11-27T20:45:07.248414+0000","last_clean":"2023-11-27T20:45:07.248414+0000","last_became_active":"2023-11-27T20:45:06.273439+0000","last_became_peered":"2023-11-27T20:45:06.273439+0000","last_unstale":"2023-11-27T20:45:07.248414+0000","last_undegraded":"2023-11-27T20:45:07.248414+0000","last_fullsized":"2023-11-27T20:45:07.248414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:20.750426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.281155+0000","last_change":"2023-11-27T20:45:06.276128+0000","last_active":"2023-11-27T20:45:06.281155+0000","last_peered":"2023-11-27T20:45:06.281155+0000","last_clean":"2023-11-27T20:45:06.281155+0000","last_became_active":"2023-11-27T20:45:06.274808+0000","last_became_peered":"2023-11-27T20:45:06.274808+0000","last_unstale":"2023-11-27T20:45:06.281155+0000","last_undegraded":"2023-11-27T20:45:06.281155+0000","last_fullsized":"2023-11-27T20:45:06.281155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:37:50.101297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.247926+0000","last_change":"2023-11-27T20:45:06.269154+0000","last_active":"2023-11-27T20:45:07.247926+0000","last_peered":"2023-11-27T20:45:07.247926+0000","last_clean":"2023-11-27T20:45:07.247926+0000","last_became_active":"2023-11-27T20:45:06.268153+0000","last_became_peered":"2023-11-27T20:45:06.268153+0000","last_unstale":"2023-11-27T20:45:07.247926+0000","last_undegraded":"2023-11-27T20:45:07.247926+0000","last_fullsized":"2023-11-27T20:45:07.247926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.286029+0000","last_change":"2023-11-27T20:45:06.280743+0000","last_active":"2023-11-27T20:45:06.286029+0000","last_peered":"2023-11-27T20:45:06.286029+0000","last_clean":"2023-11-27T20:45:06.286029+0000","last_became_active":"2023-11-27T20:45:06.280225+0000","last_became_peered":"2023-11-27T20:45:06.280225+0000","last_unstale":"2023-11-27T20:45:06.286029+0000","last_undegraded":"2023-11-27T20:45:06.286029+0000","last_fullsized":"2023-11-27T20:45:06.286029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:13:33.854711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.281003+0000","last_change":"2023-11-27T20:45:06.276232+0000","last_active":"2023-11-27T20:45:06.281003+0000","last_peered":"2023-11-27T20:45:06.281003+0000","last_clean":"2023-11-27T20:45:06.281003+0000","last_became_active":"2023-11-27T20:45:06.274283+0000","last_became_peered":"2023-11-27T20:45:06.274283+0000","last_unstale":"2023-11-27T20:45:06.281003+0000","last_undegraded":"2023-11-27T20:45:06.281003+0000","last_fullsized":"2023-11-27T20:45:06.281003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:40:26.978102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.284667+0000","last_change":"2023-11-27T20:45:06.282186+0000","last_active":"2023-11-27T20:45:06.284667+0000","last_peered":"2023-11-27T20:45:06.284667+0000","last_clean":"2023-11-27T20:45:06.284667+0000","last_became_active":"2023-11-27T20:45:06.281910+0000","last_became_peered":"2023-11-27T20:45:06.281910+0000","last_unstale":"2023-11-27T20:45:06.284667+0000","last_undegraded":"2023-11-27T20:45:06.284667+0000","last_fullsized":"2023-11-27T20:45:06.284667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:34:33.271480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.283161+0000","last_change":"2023-11-27T20:45:06.279696+0000","last_active":"2023-11-27T20:45:06.283161+0000","last_peered":"2023-11-27T20:45:06.283161+0000","last_clean":"2023-11-27T20:45:06.283161+0000","last_became_active":"2023-11-27T20:45:06.279208+0000","last_became_peered":"2023-11-27T20:45:06.279208+0000","last_unstale":"2023-11-27T20:45:06.283161+0000","last_undegraded":"2023-11-27T20:45:06.283161+0000","last_fullsized":"2023-11-27T20:45:06.283161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.283789+0000","last_change":"2023-11-27T20:45:06.277398+0000","last_active":"2023-11-27T20:45:06.283789+0000","last_peered":"2023-11-27T20:45:06.283789+0000","last_clean":"2023-11-27T20:45:06.283789+0000","last_became_active":"2023-11-27T20:45:06.277088+0000","last_became_peered":"2023-11-27T20:45:06.277088+0000","last_unstale":"2023-11-27T20:45:06.283789+0000","last_undegraded":"2023-11-27T20:45:06.283789+0000","last_fullsized":"2023-11-27T20:45:06.283789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:52.945038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.283762+0000","last_change":"2023-11-27T20:45:06.277480+0000","last_active":"2023-11-27T20:45:06.283762+0000","last_peered":"2023-11-27T20:45:06.283762+0000","last_clean":"2023-11-27T20:45:06.283762+0000","last_became_active":"2023-11-27T20:45:06.277134+0000","last_became_peered":"2023-11-27T20:45:06.277134+0000","last_unstale":"2023-11-27T20:45:06.283762+0000","last_undegraded":"2023-11-27T20:45:06.283762+0000","last_fullsized":"2023-11-27T20:45:06.283762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:11:09.293758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.282185+0000","last_change":"2023-11-27T20:45:06.277173+0000","last_active":"2023-11-27T20:45:06.282185+0000","last_peered":"2023-11-27T20:45:06.282185+0000","last_clean":"2023-11-27T20:45:06.282185+0000","last_became_active":"2023-11-27T20:45:06.276898+0000","last_became_peered":"2023-11-27T20:45:06.276898+0000","last_unstale":"2023-11-27T20:45:06.282185+0000","last_undegraded":"2023-11-27T20:45:06.282185+0000","last_fullsized":"2023-11-27T20:45:06.282185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:03.641350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250438+0000","last_change":"2023-11-27T20:45:06.279341+0000","last_active":"2023-11-27T20:45:07.250438+0000","last_peered":"2023-11-27T20:45:07.250438+0000","last_clean":"2023-11-27T20:45:07.250438+0000","last_became_active":"2023-11-27T20:45:06.278293+0000","last_became_peered":"2023-11-27T20:45:06.278293+0000","last_unstale":"2023-11-27T20:45:07.250438+0000","last_undegraded":"2023-11-27T20:45:07.250438+0000","last_fullsized":"2023-11-27T20:45:07.250438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:00.849008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.284066+0000","last_change":"2023-11-27T20:45:06.280079+0000","last_active":"2023-11-27T20:45:06.284066+0000","last_peered":"2023-11-27T20:45:06.284066+0000","last_clean":"2023-11-27T20:45:06.284066+0000","last_became_active":"2023-11-27T20:45:06.279228+0000","last_became_peered":"2023-11-27T20:45:06.279228+0000","last_unstale":"2023-11-27T20:45:06.284066+0000","last_undegraded":"2023-11-27T20:45:06.284066+0000","last_fullsized":"2023-11-27T20:45:06.284066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:09:59.378663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.271347+0000","last_change":"2023-11-27T20:45:06.263651+0000","last_active":"2023-11-27T20:45:06.271347+0000","last_peered":"2023-11-27T20:45:06.271347+0000","last_clean":"2023-11-27T20:45:06.271347+0000","last_became_active":"2023-11-27T20:45:06.263101+0000","last_became_peered":"2023-11-27T20:45:06.263101+0000","last_unstale":"2023-11-27T20:45:06.271347+0000","last_undegraded":"2023-11-27T20:45:06.271347+0000","last_fullsized":"2023-11-27T20:45:06.271347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:10:17.216692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248384+0000","last_change":"2023-11-27T20:45:06.276593+0000","last_active":"2023-11-27T20:45:07.248384+0000","last_peered":"2023-11-27T20:45:07.248384+0000","last_clean":"2023-11-27T20:45:07.248384+0000","last_became_active":"2023-11-27T20:45:06.276315+0000","last_became_peered":"2023-11-27T20:45:06.276315+0000","last_unstale":"2023-11-27T20:45:07.248384+0000","last_undegraded":"2023-11-27T20:45:07.248384+0000","last_fullsized":"2023-11-27T20:45:07.248384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:02.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.274815+0000","last_change":"2023-11-27T20:45:06.265948+0000","last_active":"2023-11-27T20:45:06.274815+0000","last_peered":"2023-11-27T20:45:06.274815+0000","last_clean":"2023-11-27T20:45:06.274815+0000","last_became_active":"2023-11-27T20:45:06.265615+0000","last_became_peered":"2023-11-27T20:45:06.265615+0000","last_unstale":"2023-11-27T20:45:06.274815+0000","last_undegraded":"2023-11-27T20:45:06.274815+0000","last_fullsized":"2023-11-27T20:45:06.274815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:59.006869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250108+0000","last_change":"2023-11-27T20:45:06.270218+0000","last_active":"2023-11-27T20:45:07.250108+0000","last_peered":"2023-11-27T20:45:07.250108+0000","last_clean":"2023-11-27T20:45:07.250108+0000","last_became_active":"2023-11-27T20:45:06.269297+0000","last_became_peered":"2023-11-27T20:45:06.269297+0000","last_unstale":"2023-11-27T20:45:07.250108+0000","last_undegraded":"2023-11-27T20:45:07.250108+0000","last_fullsized":"2023-11-27T20:45:07.250108+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.270952+0000","last_change":"2023-11-27T20:45:06.264325+0000","last_active":"2023-11-27T20:45:06.270952+0000","last_peered":"2023-11-27T20:45:06.270952+0000","last_clean":"2023-11-27T20:45:06.270952+0000","last_became_active":"2023-11-27T20:45:06.260926+0000","last_became_peered":"2023-11-27T20:45:06.260926+0000","last_unstale":"2023-11-27T20:45:06.270952+0000","last_undegraded":"2023-11-27T20:45:06.270952+0000","last_fullsized":"2023-11-27T20:45:06.270952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:56:58.157313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.283696+0000","last_change":"2023-11-27T20:45:06.278905+0000","last_active":"2023-11-27T20:45:06.283696+0000","last_peered":"2023-11-27T20:45:06.283696+0000","last_clean":"2023-11-27T20:45:06.283696+0000","last_became_active":"2023-11-27T20:45:06.276359+0000","last_became_peered":"2023-11-27T20:45:06.276359+0000","last_unstale":"2023-11-27T20:45:06.283696+0000","last_undegraded":"2023-11-27T20:45:06.283696+0000","last_fullsized":"2023-11-27T20:45:06.283696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:34:35.362869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.284197+0000","last_change":"2023-11-27T20:45:06.278065+0000","last_active":"2023-11-27T20:45:06.284197+0000","last_peered":"2023-11-27T20:45:06.284197+0000","last_clean":"2023-11-27T20:45:06.284197+0000","last_became_active":"2023-11-27T20:45:06.277780+0000","last_became_peered":"2023-11-27T20:45:06.277780+0000","last_unstale":"2023-11-27T20:45:06.284197+0000","last_undegraded":"2023-11-27T20:45:06.284197+0000","last_fullsized":"2023-11-27T20:45:06.284197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:13:43.427726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.249097+0000","last_change":"2023-11-27T20:45:06.257819+0000","last_active":"2023-11-27T20:45:07.249097+0000","last_peered":"2023-11-27T20:45:07.249097+0000","last_clean":"2023-11-27T20:45:07.249097+0000","last_became_active":"2023-11-27T20:45:06.257086+0000","last_became_peered":"2023-11-27T20:45:06.257086+0000","last_unstale":"2023-11-27T20:45:07.249097+0000","last_undegraded":"2023-11-27T20:45:07.249097+0000","last_fullsized":"2023-11-27T20:45:07.249097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:24.286070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.286119+0000","last_change":"2023-11-27T20:45:06.282558+0000","last_active":"2023-11-27T20:45:06.286119+0000","last_peered":"2023-11-27T20:45:06.286119+0000","last_clean":"2023-11-27T20:45:06.286119+0000","last_became_active":"2023-11-27T20:45:06.282227+0000","last_became_peered":"2023-11-27T20:45:06.282227+0000","last_unstale":"2023-11-27T20:45:06.286119+0000","last_undegraded":"2023-11-27T20:45:06.286119+0000","last_fullsized":"2023-11-27T20:45:06.286119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:44:31.727468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"74'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.251111+0000","last_change":"2023-11-27T20:45:05.632935+0000","last_active":"2023-11-27T20:45:07.251111+0000","last_peered":"2023-11-27T20:45:07.251111+0000","last_clean":"2023-11-27T20:45:07.251111+0000","last_became_active":"2023-11-27T20:45:05.632654+0000","last_became_peered":"2023-11-27T20:45:05.632654+0000","last_unstale":"2023-11-27T20:45:07.251111+0000","last_undegraded":"2023-11-27T20:45:07.251111+0000","last_fullsized":"2023-11-27T20:45:07.251111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:56.837141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250976+0000","last_change":"2023-11-27T20:45:06.280819+0000","last_active":"2023-11-27T20:45:07.250976+0000","last_peered":"2023-11-27T20:45:07.250976+0000","last_clean":"2023-11-27T20:45:07.250976+0000","last_became_active":"2023-11-27T20:45:06.280545+0000","last_became_peered":"2023-11-27T20:45:06.280545+0000","last_unstale":"2023-11-27T20:45:07.250976+0000","last_undegraded":"2023-11-27T20:45:07.250976+0000","last_fullsized":"2023-11-27T20:45:07.250976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:01.046541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"74'1","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.668192+0000","last_change":"2023-11-27T20:45:05.644560+0000","last_active":"2023-11-27T20:45:06.668192+0000","last_peered":"2023-11-27T20:45:06.668192+0000","last_clean":"2023-11-27T20:45:06.668192+0000","last_became_active":"2023-11-27T20:45:05.644264+0000","last_became_peered":"2023-11-27T20:45:05.644264+0000","last_unstale":"2023-11-27T20:45:06.668192+0000","last_undegraded":"2023-11-27T20:45:06.668192+0000","last_fullsized":"2023-11-27T20:45:06.668192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:02.361558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250246+0000","last_change":"2023-11-27T20:45:06.257973+0000","last_active":"2023-11-27T20:45:07.250246+0000","last_peered":"2023-11-27T20:45:07.250246+0000","last_clean":"2023-11-27T20:45:07.250246+0000","last_became_active":"2023-11-27T20:45:06.257676+0000","last_became_peered":"2023-11-27T20:45:06.257676+0000","last_unstale":"2023-11-27T20:45:07.250246+0000","last_undegraded":"2023-11-27T20:45:07.250246+0000","last_fullsized":"2023-11-27T20:45:07.250246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.664673+0000","last_change":"2023-11-27T20:45:05.636666+0000","last_active":"2023-11-27T20:45:06.664673+0000","last_peered":"2023-11-27T20:45:06.664673+0000","last_clean":"2023-11-27T20:45:06.664673+0000","last_became_active":"2023-11-27T20:45:05.636401+0000","last_became_peered":"2023-11-27T20:45:05.636401+0000","last_unstale":"2023-11-27T20:45:06.664673+0000","last_undegraded":"2023-11-27T20:45:06.664673+0000","last_fullsized":"2023-11-27T20:45:06.664673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:34.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248651+0000","last_change":"2023-11-27T20:45:06.280675+0000","last_active":"2023-11-27T20:45:07.248651+0000","last_peered":"2023-11-27T20:45:07.248651+0000","last_clean":"2023-11-27T20:45:07.248651+0000","last_became_active":"2023-11-27T20:45:06.280169+0000","last_became_peered":"2023-11-27T20:45:06.280169+0000","last_unstale":"2023-11-27T20:45:07.248651+0000","last_undegraded":"2023-11-27T20:45:07.248651+0000","last_fullsized":"2023-11-27T20:45:07.248651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.665768+0000","last_change":"2023-11-27T20:45:05.637617+0000","last_active":"2023-11-27T20:45:06.665768+0000","last_peered":"2023-11-27T20:45:06.665768+0000","last_clean":"2023-11-27T20:45:06.665768+0000","last_became_active":"2023-11-27T20:45:05.636099+0000","last_became_peered":"2023-11-27T20:45:05.636099+0000","last_unstale":"2023-11-27T20:45:06.665768+0000","last_undegraded":"2023-11-27T20:45:06.665768+0000","last_fullsized":"2023-11-27T20:45:06.665768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:00.040780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.280206+0000","last_change":"2023-11-27T20:45:06.271072+0000","last_active":"2023-11-27T20:45:06.280206+0000","last_peered":"2023-11-27T20:45:06.280206+0000","last_clean":"2023-11-27T20:45:06.280206+0000","last_became_active":"2023-11-27T20:45:06.270093+0000","last_became_peered":"2023-11-27T20:45:06.270093+0000","last_unstale":"2023-11-27T20:45:06.280206+0000","last_undegraded":"2023-11-27T20:45:06.280206+0000","last_fullsized":"2023-11-27T20:45:06.280206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:06:41.276549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"74'1","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.662885+0000","last_change":"2023-11-27T20:45:05.641565+0000","last_active":"2023-11-27T20:45:06.662885+0000","last_peered":"2023-11-27T20:45:06.662885+0000","last_clean":"2023-11-27T20:45:06.662885+0000","last_became_active":"2023-11-27T20:45:05.635532+0000","last_became_peered":"2023-11-27T20:45:05.635532+0000","last_unstale":"2023-11-27T20:45:06.662885+0000","last_undegraded":"2023-11-27T20:45:06.662885+0000","last_fullsized":"2023-11-27T20:45:06.662885+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:01:09.043274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277254+0000","last_change":"2023-11-27T20:45:06.269149+0000","last_active":"2023-11-27T20:45:06.277254+0000","last_peered":"2023-11-27T20:45:06.277254+0000","last_clean":"2023-11-27T20:45:06.277254+0000","last_became_active":"2023-11-27T20:45:06.268793+0000","last_became_peered":"2023-11-27T20:45:06.268793+0000","last_unstale":"2023-11-27T20:45:06.277254+0000","last_undegraded":"2023-11-27T20:45:06.277254+0000","last_fullsized":"2023-11-27T20:45:06.277254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:13.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"74'1","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.668365+0000","last_change":"2023-11-27T20:45:05.642294+0000","last_active":"2023-11-27T20:45:06.668365+0000","last_peered":"2023-11-27T20:45:06.668365+0000","last_clean":"2023-11-27T20:45:06.668365+0000","last_became_active":"2023-11-27T20:45:05.641621+0000","last_became_peered":"2023-11-27T20:45:05.641621+0000","last_unstale":"2023-11-27T20:45:06.668365+0000","last_undegraded":"2023-11-27T20:45:06.668365+0000","last_fullsized":"2023-11-27T20:45:06.668365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:05.586683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.247695+0000","last_change":"2023-11-27T20:45:06.283545+0000","last_active":"2023-11-27T20:45:07.247695+0000","last_peered":"2023-11-27T20:45:07.247695+0000","last_clean":"2023-11-27T20:45:07.247695+0000","last_became_active":"2023-11-27T20:45:06.281547+0000","last_became_peered":"2023-11-27T20:45:06.281547+0000","last_unstale":"2023-11-27T20:45:07.247695+0000","last_undegraded":"2023-11-27T20:45:07.247695+0000","last_fullsized":"2023-11-27T20:45:07.247695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:22:23.387234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.273266+0000","last_change":"2023-11-27T20:45:05.640954+0000","last_active":"2023-11-27T20:45:06.273266+0000","last_peered":"2023-11-27T20:45:06.273266+0000","last_clean":"2023-11-27T20:45:06.273266+0000","last_became_active":"2023-11-27T20:45:05.640670+0000","last_became_peered":"2023-11-27T20:45:05.640670+0000","last_unstale":"2023-11-27T20:45:06.273266+0000","last_undegraded":"2023-11-27T20:45:06.273266+0000","last_fullsized":"2023-11-27T20:45:06.273266+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:13.460812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248071+0000","last_change":"2023-11-27T20:45:06.267459+0000","last_active":"2023-11-27T20:45:07.248071+0000","last_peered":"2023-11-27T20:45:07.248071+0000","last_clean":"2023-11-27T20:45:07.248071+0000","last_became_active":"2023-11-27T20:45:06.267115+0000","last_became_peered":"2023-11-27T20:45:06.267115+0000","last_unstale":"2023-11-27T20:45:07.248071+0000","last_undegraded":"2023-11-27T20:45:07.248071+0000","last_fullsized":"2023-11-27T20:45:07.248071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:16:23.654821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.243404+0000","last_change":"2023-11-27T20:45:05.641922+0000","last_active":"2023-11-27T20:45:06.243404+0000","last_peered":"2023-11-27T20:45:06.243404+0000","last_clean":"2023-11-27T20:45:06.243404+0000","last_became_active":"2023-11-27T20:45:05.641612+0000","last_became_peered":"2023-11-27T20:45:05.641612+0000","last_unstale":"2023-11-27T20:45:06.243404+0000","last_undegraded":"2023-11-27T20:45:06.243404+0000","last_fullsized":"2023-11-27T20:45:06.243404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:57:05.757599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248848+0000","last_change":"2023-11-27T20:45:06.273369+0000","last_active":"2023-11-27T20:45:07.248848+0000","last_peered":"2023-11-27T20:45:07.248848+0000","last_clean":"2023-11-27T20:45:07.248848+0000","last_became_active":"2023-11-27T20:45:06.271740+0000","last_became_peered":"2023-11-27T20:45:06.271740+0000","last_unstale":"2023-11-27T20:45:07.248848+0000","last_undegraded":"2023-11-27T20:45:07.248848+0000","last_fullsized":"2023-11-27T20:45:07.248848+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:12.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.251131+0000","last_change":"2023-11-27T20:45:05.631301+0000","last_active":"2023-11-27T20:45:07.251131+0000","last_peered":"2023-11-27T20:45:07.251131+0000","last_clean":"2023-11-27T20:45:07.251131+0000","last_became_active":"2023-11-27T20:45:05.630652+0000","last_became_peered":"2023-11-27T20:45:05.630652+0000","last_unstale":"2023-11-27T20:45:07.251131+0000","last_undegraded":"2023-11-27T20:45:07.251131+0000","last_fullsized":"2023-11-27T20:45:07.251131+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:58.001108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382519+0000","last_change":"2023-11-27T20:45:06.273782+0000","last_active":"2023-11-27T20:45:07.382519+0000","last_peered":"2023-11-27T20:45:07.382519+0000","last_clean":"2023-11-27T20:45:07.382519+0000","last_became_active":"2023-11-27T20:45:06.273475+0000","last_became_peered":"2023-11-27T20:45:06.273475+0000","last_unstale":"2023-11-27T20:45:07.382519+0000","last_undegraded":"2023-11-27T20:45:07.382519+0000","last_fullsized":"2023-11-27T20:45:07.382519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250680+0000","last_change":"2023-11-27T20:45:05.646362+0000","last_active":"2023-11-27T20:45:07.250680+0000","last_peered":"2023-11-27T20:45:07.250680+0000","last_clean":"2023-11-27T20:45:07.250680+0000","last_became_active":"2023-11-27T20:45:05.645919+0000","last_became_peered":"2023-11-27T20:45:05.645919+0000","last_unstale":"2023-11-27T20:45:07.250680+0000","last_undegraded":"2023-11-27T20:45:07.250680+0000","last_fullsized":"2023-11-27T20:45:07.250680+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:01:09.043274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.287762+0000","last_change":"2023-11-27T20:45:06.283036+0000","last_active":"2023-11-27T20:45:06.287762+0000","last_peered":"2023-11-27T20:45:06.287762+0000","last_clean":"2023-11-27T20:45:06.287762+0000","last_became_active":"2023-11-27T20:45:06.281987+0000","last_became_peered":"2023-11-27T20:45:06.281987+0000","last_unstale":"2023-11-27T20:45:06.287762+0000","last_undegraded":"2023-11-27T20:45:06.287762+0000","last_fullsized":"2023-11-27T20:45:06.287762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"74'3","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.249955+0000","last_change":"2023-11-27T20:45:05.634876+0000","last_active":"2023-11-27T20:45:07.249955+0000","last_peered":"2023-11-27T20:45:07.249955+0000","last_clean":"2023-11-27T20:45:07.249955+0000","last_became_active":"2023-11-27T20:45:05.634310+0000","last_became_peered":"2023-11-27T20:45:05.634310+0000","last_unstale":"2023-11-27T20:45:07.249955+0000","last_undegraded":"2023-11-27T20:45:07.249955+0000","last_fullsized":"2023-11-27T20:45:07.249955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:44:30.721707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.286089+0000","last_change":"2023-11-27T20:45:06.282223+0000","last_active":"2023-11-27T20:45:06.286089+0000","last_peered":"2023-11-27T20:45:06.286089+0000","last_clean":"2023-11-27T20:45:06.286089+0000","last_became_active":"2023-11-27T20:45:06.281055+0000","last_became_peered":"2023-11-27T20:45:06.281055+0000","last_unstale":"2023-11-27T20:45:06.286089+0000","last_undegraded":"2023-11-27T20:45:06.286089+0000","last_fullsized":"2023-11-27T20:45:06.286089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:00.389778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"74'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382697+0000","last_change":"2023-11-27T20:45:05.636622+0000","last_active":"2023-11-27T20:45:07.382697+0000","last_peered":"2023-11-27T20:45:07.382697+0000","last_clean":"2023-11-27T20:45:07.382697+0000","last_became_active":"2023-11-27T20:45:05.633202+0000","last_became_peered":"2023-11-27T20:45:05.633202+0000","last_unstale":"2023-11-27T20:45:07.382697+0000","last_undegraded":"2023-11-27T20:45:07.382697+0000","last_fullsized":"2023-11-27T20:45:07.382697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:02.361558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.278846+0000","last_change":"2023-11-27T20:45:06.276770+0000","last_active":"2023-11-27T20:45:06.278846+0000","last_peered":"2023-11-27T20:45:06.278846+0000","last_clean":"2023-11-27T20:45:06.278846+0000","last_became_active":"2023-11-27T20:45:06.276404+0000","last_became_peered":"2023-11-27T20:45:06.276404+0000","last_unstale":"2023-11-27T20:45:06.278846+0000","last_undegraded":"2023-11-27T20:45:06.278846+0000","last_fullsized":"2023-11-27T20:45:06.278846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:00.849008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.666651+0000","last_change":"2023-11-27T20:45:05.634047+0000","last_active":"2023-11-27T20:45:06.666651+0000","last_peered":"2023-11-27T20:45:06.666651+0000","last_clean":"2023-11-27T20:45:06.666651+0000","last_became_active":"2023-11-27T20:45:05.633852+0000","last_became_peered":"2023-11-27T20:45:05.633852+0000","last_unstale":"2023-11-27T20:45:06.666651+0000","last_undegraded":"2023-11-27T20:45:06.666651+0000","last_fullsized":"2023-11-27T20:45:06.666651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:10:34.426540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248766+0000","last_change":"2023-11-27T20:45:06.277808+0000","last_active":"2023-11-27T20:45:07.248766+0000","last_peered":"2023-11-27T20:45:07.248766+0000","last_clean":"2023-11-27T20:45:07.248766+0000","last_became_active":"2023-11-27T20:45:06.277521+0000","last_became_peered":"2023-11-27T20:45:06.277521+0000","last_unstale":"2023-11-27T20:45:07.248766+0000","last_undegraded":"2023-11-27T20:45:07.248766+0000","last_fullsized":"2023-11-27T20:45:07.248766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:16:23.654821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.247958+0000","last_change":"2023-11-27T20:45:05.632402+0000","last_active":"2023-11-27T20:45:07.247958+0000","last_peered":"2023-11-27T20:45:07.247958+0000","last_clean":"2023-11-27T20:45:07.247958+0000","last_became_active":"2023-11-27T20:45:05.632030+0000","last_became_peered":"2023-11-27T20:45:05.632030+0000","last_unstale":"2023-11-27T20:45:07.247958+0000","last_undegraded":"2023-11-27T20:45:07.247958+0000","last_fullsized":"2023-11-27T20:45:07.247958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:01.270371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277260+0000","last_change":"2023-11-27T20:45:06.272412+0000","last_active":"2023-11-27T20:45:06.277260+0000","last_peered":"2023-11-27T20:45:06.277260+0000","last_clean":"2023-11-27T20:45:06.277260+0000","last_became_active":"2023-11-27T20:45:06.272103+0000","last_became_peered":"2023-11-27T20:45:06.272103+0000","last_unstale":"2023-11-27T20:45:06.277260+0000","last_undegraded":"2023-11-27T20:45:06.277260+0000","last_fullsized":"2023-11-27T20:45:06.277260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:09:40.464389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382489+0000","last_change":"2023-11-27T20:45:05.644812+0000","last_active":"2023-11-27T20:45:07.382489+0000","last_peered":"2023-11-27T20:45:07.382489+0000","last_clean":"2023-11-27T20:45:07.382489+0000","last_became_active":"2023-11-27T20:45:05.644097+0000","last_became_peered":"2023-11-27T20:45:05.644097+0000","last_unstale":"2023-11-27T20:45:07.382489+0000","last_undegraded":"2023-11-27T20:45:07.382489+0000","last_fullsized":"2023-11-27T20:45:07.382489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:58.144583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.270323+0000","last_change":"2023-11-27T20:45:06.263986+0000","last_active":"2023-11-27T20:45:06.270323+0000","last_peered":"2023-11-27T20:45:06.270323+0000","last_clean":"2023-11-27T20:45:06.270323+0000","last_became_active":"2023-11-27T20:45:06.263465+0000","last_became_peered":"2023-11-27T20:45:06.263465+0000","last_unstale":"2023-11-27T20:45:06.270323+0000","last_undegraded":"2023-11-27T20:45:06.270323+0000","last_fullsized":"2023-11-27T20:45:06.270323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:00:16.194858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"74'8","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.668409+0000","last_change":"2023-11-27T20:45:05.641159+0000","last_active":"2023-11-27T20:45:06.668409+0000","last_peered":"2023-11-27T20:45:06.668409+0000","last_clean":"2023-11-27T20:45:06.668409+0000","last_became_active":"2023-11-27T20:45:05.640821+0000","last_became_peered":"2023-11-27T20:45:05.640821+0000","last_unstale":"2023-11-27T20:45:06.668409+0000","last_undegraded":"2023-11-27T20:45:06.668409+0000","last_fullsized":"2023-11-27T20:45:06.668409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:06.355870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248783+0000","last_change":"2023-11-27T20:45:06.275736+0000","last_active":"2023-11-27T20:45:07.248783+0000","last_peered":"2023-11-27T20:45:07.248783+0000","last_clean":"2023-11-27T20:45:07.248783+0000","last_became_active":"2023-11-27T20:45:06.275432+0000","last_became_peered":"2023-11-27T20:45:06.275432+0000","last_unstale":"2023-11-27T20:45:07.248783+0000","last_undegraded":"2023-11-27T20:45:07.248783+0000","last_fullsized":"2023-11-27T20:45:07.248783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:12.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.251255+0000","last_change":"2023-11-27T20:45:05.633605+0000","last_active":"2023-11-27T20:45:07.251255+0000","last_peered":"2023-11-27T20:45:07.251255+0000","last_clean":"2023-11-27T20:45:07.251255+0000","last_became_active":"2023-11-27T20:45:05.633283+0000","last_became_peered":"2023-11-27T20:45:05.633283+0000","last_unstale":"2023-11-27T20:45:07.251255+0000","last_undegraded":"2023-11-27T20:45:07.251255+0000","last_fullsized":"2023-11-27T20:45:07.251255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:05.586683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.251013+0000","last_change":"2023-11-27T20:45:06.279727+0000","last_active":"2023-11-27T20:45:07.251013+0000","last_peered":"2023-11-27T20:45:07.251013+0000","last_clean":"2023-11-27T20:45:07.251013+0000","last_became_active":"2023-11-27T20:45:06.270223+0000","last_became_peered":"2023-11-27T20:45:06.270223+0000","last_unstale":"2023-11-27T20:45:07.251013+0000","last_undegraded":"2023-11-27T20:45:07.251013+0000","last_fullsized":"2023-11-27T20:45:07.251013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:59:57.174632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.663499+0000","last_change":"2023-11-27T20:45:05.642228+0000","last_active":"2023-11-27T20:45:06.663499+0000","last_peered":"2023-11-27T20:45:06.663499+0000","last_clean":"2023-11-27T20:45:06.663499+0000","last_became_active":"2023-11-27T20:45:05.641885+0000","last_became_peered":"2023-11-27T20:45:05.641885+0000","last_unstale":"2023-11-27T20:45:06.663499+0000","last_undegraded":"2023-11-27T20:45:06.663499+0000","last_fullsized":"2023-11-27T20:45:06.663499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:56.752121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277625+0000","last_change":"2023-11-27T20:45:06.274675+0000","last_active":"2023-11-27T20:45:06.277625+0000","last_peered":"2023-11-27T20:45:06.277625+0000","last_clean":"2023-11-27T20:45:06.277625+0000","last_became_active":"2023-11-27T20:45:06.271749+0000","last_became_peered":"2023-11-27T20:45:06.271749+0000","last_unstale":"2023-11-27T20:45:06.277625+0000","last_undegraded":"2023-11-27T20:45:06.277625+0000","last_fullsized":"2023-11-27T20:45:06.277625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:57.842902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.273749+0000","last_change":"2023-11-27T20:45:05.642419+0000","last_active":"2023-11-27T20:45:06.273749+0000","last_peered":"2023-11-27T20:45:06.273749+0000","last_clean":"2023-11-27T20:45:06.273749+0000","last_became_active":"2023-11-27T20:45:05.642092+0000","last_became_peered":"2023-11-27T20:45:05.642092+0000","last_unstale":"2023-11-27T20:45:06.273749+0000","last_undegraded":"2023-11-27T20:45:06.273749+0000","last_fullsized":"2023-11-27T20:45:06.273749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:54.248320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.281136+0000","last_change":"2023-11-27T20:45:06.274852+0000","last_active":"2023-11-27T20:45:06.281136+0000","last_peered":"2023-11-27T20:45:06.281136+0000","last_clean":"2023-11-27T20:45:06.281136+0000","last_became_active":"2023-11-27T20:45:06.274316+0000","last_became_peered":"2023-11-27T20:45:06.274316+0000","last_unstale":"2023-11-27T20:45:06.281136+0000","last_undegraded":"2023-11-27T20:45:06.281136+0000","last_fullsized":"2023-11-27T20:45:06.281136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:51:09.692880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248438+0000","last_change":"2023-11-27T20:45:05.628335+0000","last_active":"2023-11-27T20:45:07.248438+0000","last_peered":"2023-11-27T20:45:07.248438+0000","last_clean":"2023-11-27T20:45:07.248438+0000","last_became_active":"2023-11-27T20:45:05.627980+0000","last_became_peered":"2023-11-27T20:45:05.627980+0000","last_unstale":"2023-11-27T20:45:07.248438+0000","last_undegraded":"2023-11-27T20:45:07.248438+0000","last_fullsized":"2023-11-27T20:45:07.248438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:19.744666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382377+0000","last_change":"2023-11-27T20:45:06.265399+0000","last_active":"2023-11-27T20:45:07.382377+0000","last_peered":"2023-11-27T20:45:07.382377+0000","last_clean":"2023-11-27T20:45:07.382377+0000","last_became_active":"2023-11-27T20:45:06.265015+0000","last_became_peered":"2023-11-27T20:45:06.265015+0000","last_unstale":"2023-11-27T20:45:07.382377+0000","last_undegraded":"2023-11-27T20:45:07.382377+0000","last_fullsized":"2023-11-27T20:45:07.382377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.260747+0000","last_change":"2023-11-27T20:45:05.639115+0000","last_active":"2023-11-27T20:45:06.260747+0000","last_peered":"2023-11-27T20:45:06.260747+0000","last_clean":"2023-11-27T20:45:06.260747+0000","last_became_active":"2023-11-27T20:45:05.638219+0000","last_became_peered":"2023-11-27T20:45:05.638219+0000","last_unstale":"2023-11-27T20:45:06.260747+0000","last_undegraded":"2023-11-27T20:45:06.260747+0000","last_fullsized":"2023-11-27T20:45:06.260747+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:38.005329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277351+0000","last_change":"2023-11-27T20:45:06.270416+0000","last_active":"2023-11-27T20:45:06.277351+0000","last_peered":"2023-11-27T20:45:06.277351+0000","last_clean":"2023-11-27T20:45:06.277351+0000","last_became_active":"2023-11-27T20:45:06.270028+0000","last_became_peered":"2023-11-27T20:45:06.270028+0000","last_unstale":"2023-11-27T20:45:06.277351+0000","last_undegraded":"2023-11-27T20:45:06.277351+0000","last_fullsized":"2023-11-27T20:45:06.277351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:07:35.512664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.257437+0000","last_change":"2023-11-27T20:45:05.637206+0000","last_active":"2023-11-27T20:45:06.257437+0000","last_peered":"2023-11-27T20:45:06.257437+0000","last_clean":"2023-11-27T20:45:06.257437+0000","last_became_active":"2023-11-27T20:45:05.636487+0000","last_became_peered":"2023-11-27T20:45:05.636487+0000","last_unstale":"2023-11-27T20:45:06.257437+0000","last_undegraded":"2023-11-27T20:45:06.257437+0000","last_fullsized":"2023-11-27T20:45:06.257437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:47.083443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382139+0000","last_change":"2023-11-27T20:45:06.279113+0000","last_active":"2023-11-27T20:45:07.382139+0000","last_peered":"2023-11-27T20:45:07.382139+0000","last_clean":"2023-11-27T20:45:07.382139+0000","last_became_active":"2023-11-27T20:45:06.278833+0000","last_became_peered":"2023-11-27T20:45:06.278833+0000","last_unstale":"2023-11-27T20:45:07.382139+0000","last_undegraded":"2023-11-27T20:45:07.382139+0000","last_fullsized":"2023-11-27T20:45:07.382139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:24.286070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.247763+0000","last_change":"2023-11-27T20:45:05.635630+0000","last_active":"2023-11-27T20:45:07.247763+0000","last_peered":"2023-11-27T20:45:07.247763+0000","last_clean":"2023-11-27T20:45:07.247763+0000","last_became_active":"2023-11-27T20:45:05.635217+0000","last_became_peered":"2023-11-27T20:45:05.635217+0000","last_unstale":"2023-11-27T20:45:07.247763+0000","last_undegraded":"2023-11-27T20:45:07.247763+0000","last_fullsized":"2023-11-27T20:45:07.247763+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:25.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.265028+0000","last_change":"2023-11-27T20:45:06.263237+0000","last_active":"2023-11-27T20:45:06.265028+0000","last_peered":"2023-11-27T20:45:06.265028+0000","last_clean":"2023-11-27T20:45:06.265028+0000","last_became_active":"2023-11-27T20:45:06.262918+0000","last_became_peered":"2023-11-27T20:45:06.262918+0000","last_unstale":"2023-11-27T20:45:06.265028+0000","last_undegraded":"2023-11-27T20:45:06.265028+0000","last_fullsized":"2023-11-27T20:45:06.265028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:38:27.633981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.663813+0000","last_change":"2023-11-27T20:45:05.631892+0000","last_active":"2023-11-27T20:45:06.663813+0000","last_peered":"2023-11-27T20:45:06.663813+0000","last_clean":"2023-11-27T20:45:06.663813+0000","last_became_active":"2023-11-27T20:45:05.631305+0000","last_became_peered":"2023-11-27T20:45:05.631305+0000","last_unstale":"2023-11-27T20:45:06.663813+0000","last_undegraded":"2023-11-27T20:45:06.663813+0000","last_fullsized":"2023-11-27T20:45:06.663813+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:30:06.654414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248966+0000","last_change":"2023-11-27T20:45:06.282615+0000","last_active":"2023-11-27T20:45:07.248966+0000","last_peered":"2023-11-27T20:45:07.248966+0000","last_clean":"2023-11-27T20:45:07.248966+0000","last_became_active":"2023-11-27T20:45:06.282331+0000","last_became_peered":"2023-11-27T20:45:06.282331+0000","last_unstale":"2023-11-27T20:45:07.248966+0000","last_undegraded":"2023-11-27T20:45:07.248966+0000","last_fullsized":"2023-11-27T20:45:07.248966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:00:14.175844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.245061+0000","last_change":"2023-11-27T20:45:05.631778+0000","last_active":"2023-11-27T20:45:06.245061+0000","last_peered":"2023-11-27T20:45:06.245061+0000","last_clean":"2023-11-27T20:45:06.245061+0000","last_became_active":"2023-11-27T20:45:05.631172+0000","last_became_peered":"2023-11-27T20:45:05.631172+0000","last_unstale":"2023-11-27T20:45:06.245061+0000","last_undegraded":"2023-11-27T20:45:06.245061+0000","last_fullsized":"2023-11-27T20:45:06.245061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:18.830687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250468+0000","last_change":"2023-11-27T20:45:06.274427+0000","last_active":"2023-11-27T20:45:07.250468+0000","last_peered":"2023-11-27T20:45:07.250468+0000","last_clean":"2023-11-27T20:45:07.250468+0000","last_became_active":"2023-11-27T20:45:06.274140+0000","last_became_peered":"2023-11-27T20:45:06.274140+0000","last_unstale":"2023-11-27T20:45:07.250468+0000","last_undegraded":"2023-11-27T20:45:07.250468+0000","last_fullsized":"2023-11-27T20:45:07.250468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:07.361631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250646+0000","last_change":"2023-11-27T20:45:05.637612+0000","last_active":"2023-11-27T20:45:07.250646+0000","last_peered":"2023-11-27T20:45:07.250646+0000","last_clean":"2023-11-27T20:45:07.250646+0000","last_became_active":"2023-11-27T20:45:05.637230+0000","last_became_peered":"2023-11-27T20:45:05.637230+0000","last_unstale":"2023-11-27T20:45:07.250646+0000","last_undegraded":"2023-11-27T20:45:07.250646+0000","last_fullsized":"2023-11-27T20:45:07.250646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:59.384018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.285973+0000","last_change":"2023-11-27T20:45:06.279317+0000","last_active":"2023-11-27T20:45:06.285973+0000","last_peered":"2023-11-27T20:45:06.285973+0000","last_clean":"2023-11-27T20:45:06.285973+0000","last_became_active":"2023-11-27T20:45:06.279052+0000","last_became_peered":"2023-11-27T20:45:06.279052+0000","last_unstale":"2023-11-27T20:45:06.285973+0000","last_undegraded":"2023-11-27T20:45:06.285973+0000","last_fullsized":"2023-11-27T20:45:06.285973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:59.150344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250489+0000","last_change":"2023-11-27T20:45:05.634977+0000","last_active":"2023-11-27T20:45:07.250489+0000","last_peered":"2023-11-27T20:45:07.250489+0000","last_clean":"2023-11-27T20:45:07.250489+0000","last_became_active":"2023-11-27T20:45:05.631916+0000","last_became_peered":"2023-11-27T20:45:05.631916+0000","last_unstale":"2023-11-27T20:45:07.250489+0000","last_undegraded":"2023-11-27T20:45:07.250489+0000","last_fullsized":"2023-11-27T20:45:07.250489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:27.977492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.382366+0000","last_change":"2023-11-27T20:45:06.266010+0000","last_active":"2023-11-27T20:45:07.382366+0000","last_peered":"2023-11-27T20:45:07.382366+0000","last_clean":"2023-11-27T20:45:07.382366+0000","last_became_active":"2023-11-27T20:45:06.265669+0000","last_became_peered":"2023-11-27T20:45:06.265669+0000","last_unstale":"2023-11-27T20:45:07.382366+0000","last_undegraded":"2023-11-27T20:45:07.382366+0000","last_fullsized":"2023-11-27T20:45:07.382366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:11.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.273742+0000","last_change":"2023-11-27T20:45:05.637071+0000","last_active":"2023-11-27T20:45:06.273742+0000","last_peered":"2023-11-27T20:45:06.273742+0000","last_clean":"2023-11-27T20:45:06.273742+0000","last_became_active":"2023-11-27T20:45:05.636864+0000","last_became_peered":"2023-11-27T20:45:05.636864+0000","last_unstale":"2023-11-27T20:45:06.273742+0000","last_undegraded":"2023-11-27T20:45:06.273742+0000","last_fullsized":"2023-11-27T20:45:06.273742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:59:56.168871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.277869+0000","last_change":"2023-11-27T20:45:06.270493+0000","last_active":"2023-11-27T20:45:06.277869+0000","last_peered":"2023-11-27T20:45:06.277869+0000","last_clean":"2023-11-27T20:45:06.277869+0000","last_became_active":"2023-11-27T20:45:06.270214+0000","last_became_peered":"2023-11-27T20:45:06.270214+0000","last_unstale":"2023-11-27T20:45:06.277869+0000","last_undegraded":"2023-11-27T20:45:06.277869+0000","last_fullsized":"2023-11-27T20:45:06.277869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.256059+0000","last_change":"2023-11-27T20:45:05.642971+0000","last_active":"2023-11-27T20:45:06.256059+0000","last_peered":"2023-11-27T20:45:06.256059+0000","last_clean":"2023-11-27T20:45:06.256059+0000","last_became_active":"2023-11-27T20:45:05.642000+0000","last_became_peered":"2023-11-27T20:45:05.642000+0000","last_unstale":"2023-11-27T20:45:06.256059+0000","last_undegraded":"2023-11-27T20:45:06.256059+0000","last_fullsized":"2023-11-27T20:45:06.256059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:35:57.425975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.247899+0000","last_change":"2023-11-27T20:45:06.274514+0000","last_active":"2023-11-27T20:45:07.247899+0000","last_peered":"2023-11-27T20:45:07.247899+0000","last_clean":"2023-11-27T20:45:07.247899+0000","last_became_active":"2023-11-27T20:45:06.273513+0000","last_became_peered":"2023-11-27T20:45:06.273513+0000","last_unstale":"2023-11-27T20:45:07.247899+0000","last_undegraded":"2023-11-27T20:45:07.247899+0000","last_fullsized":"2023-11-27T20:45:07.247899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:13.008822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250422+0000","last_change":"2023-11-27T20:45:05.630546+0000","last_active":"2023-11-27T20:45:07.250422+0000","last_peered":"2023-11-27T20:45:07.250422+0000","last_clean":"2023-11-27T20:45:07.250422+0000","last_became_active":"2023-11-27T20:45:05.629859+0000","last_became_peered":"2023-11-27T20:45:05.629859+0000","last_unstale":"2023-11-27T20:45:07.250422+0000","last_undegraded":"2023-11-27T20:45:07.250422+0000","last_fullsized":"2023-11-27T20:45:07.250422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:34.967969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.250168+0000","last_change":"2023-11-27T20:45:06.277953+0000","last_active":"2023-11-27T20:45:07.250168+0000","last_peered":"2023-11-27T20:45:07.250168+0000","last_clean":"2023-11-27T20:45:07.250168+0000","last_became_active":"2023-11-27T20:45:06.275250+0000","last_became_peered":"2023-11-27T20:45:06.275250+0000","last_unstale":"2023-11-27T20:45:07.250168+0000","last_undegraded":"2023-11-27T20:45:07.250168+0000","last_fullsized":"2023-11-27T20:45:07.250168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.258784+0000","last_change":"2023-11-27T20:45:05.640372+0000","last_active":"2023-11-27T20:45:06.258784+0000","last_peered":"2023-11-27T20:45:06.258784+0000","last_clean":"2023-11-27T20:45:06.258784+0000","last_became_active":"2023-11-27T20:45:05.640048+0000","last_became_peered":"2023-11-27T20:45:05.640048+0000","last_unstale":"2023-11-27T20:45:06.258784+0000","last_undegraded":"2023-11-27T20:45:06.258784+0000","last_fullsized":"2023-11-27T20:45:06.258784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:34.967969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.271395+0000","last_change":"2023-11-27T20:45:06.266017+0000","last_active":"2023-11-27T20:45:06.271395+0000","last_peered":"2023-11-27T20:45:06.271395+0000","last_clean":"2023-11-27T20:45:06.271395+0000","last_became_active":"2023-11-27T20:45:06.265439+0000","last_became_peered":"2023-11-27T20:45:06.265439+0000","last_unstale":"2023-11-27T20:45:06.271395+0000","last_undegraded":"2023-11-27T20:45:06.271395+0000","last_fullsized":"2023-11-27T20:45:06.271395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:38.205825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-27T20:45:07.248569+0000","last_change":"2023-11-27T20:45:05.643524+0000","last_active":"2023-11-27T20:45:07.248569+0000","last_peered":"2023-11-27T20:45:07.248569+0000","last_clean":"2023-11-27T20:45:07.248569+0000","last_became_active":"2023-11-27T20:45:05.642570+0000","last_became_peered":"2023-11-27T20:45:05.642570+0000","last_unstale":"2023-11-27T20:45:07.248569+0000","last_undegraded":"2023-11-27T20:45:07.248569+0000","last_fullsized":"2023-11-27T20:45:07.248569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:00.040780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":215,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-27T20:45:06.261447+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:45:06.261447+0000","last_peered":"2023-11-27T20:45:06.261447+0000","last_clean":"2023-11-27T20:45:06.261447+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:45:06.261447+0000","last_undegraded":"2023-11-27T20:45:06.261447+0000","last_fullsized":"2023-11-27T20:45:06.261447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1519616,"data_stored":1000886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.127,"15min":1.153},"min":{"1min":0.63800000000000001,"5min":0.627,"15min":0.627},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.288},{"interface":"front","average":{"1min":1.129,"5min":1.206,"15min":1.2290000000000001},"min":{"1min":0.74199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6950000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.3400000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1890000000000001,"15min":1.224},"min":{"1min":0.71299999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.391,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.395},{"interface":"front","average":{"1min":1.099,"5min":1.1859999999999999,"15min":1.216},"min":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.585,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.637}]},{"osd":2,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.2330000000000001,"15min":1.2909999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4970000000000001,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.224},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2390000000000001,"15min":1.256},"min":{"1min":0.78300000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.722,"5min":1.909,"15min":1.909},"last":1.1439999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3340000000000001,"15min":1.3879999999999999},"min":{"1min":0.83199999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6000000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.579},{"interface":"front","average":{"1min":1.375,"5min":1.4430000000000001,"15min":1.4870000000000001},"min":{"1min":0.89800000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.95,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.5089999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.371,"15min":1.4099999999999999},"min":{"1min":1.0720000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.871,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.538},{"interface":"front","average":{"1min":1.373,"5min":1.4910000000000001,"15min":1.587},"min":{"1min":0.76500000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.897,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.4199999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.466,"15min":1.502},"min":{"1min":0.91000000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.462},{"interface":"front","average":{"1min":1.444,"5min":1.5329999999999999,"15min":1.583},"min":{"1min":1.0449999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7549999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.4790000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.627,"15min":1.667},"min":{"1min":1.208,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.849,"5min":2.508,"15min":2.508},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.6120000000000001,"15min":1.6799999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.849,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.6919999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":411142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2250000000000001,"15min":1.2709999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.6799999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.278},{"interface":"front","average":{"1min":1.145,"5min":1.266,"15min":1.3180000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.7430000000000001,"5min":2.581,"15min":2.581},"last":1.613}]},{"osd":1,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.2110000000000001,"15min":1.2629999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5309999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.165},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.129,"15min":1.159},"min":{"1min":0.66100000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.484,"5min":2.823,"15min":2.823},"last":0.96799999999999997}]},{"osd":2,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.0549999999999999,"15min":1.0740000000000001},"min":{"1min":0.69199999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4570000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3280000000000001,"15min":1.3899999999999999},"min":{"1min":0.753,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.651,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.82499999999999996}]},{"osd":3,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.304,"15min":1.3720000000000001},"min":{"1min":0.879,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.649,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.77},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.306,"15min":1.3440000000000001},"min":{"1min":0.83499999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.526,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.335}]},{"osd":4,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.532,"15min":1.607},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0019999999999998,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.367},{"interface":"front","average":{"1min":1.375,"5min":1.5609999999999999,"15min":1.6419999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.9450000000000001,"5min":3.536,"15min":3.536},"last":1.863}]},{"osd":5,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.3620000000000001,"15min":1.3979999999999999},"min":{"1min":0.74399999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7210000000000001,"5min":2.355,"15min":2.355},"last":1.397},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.589,"15min":1.6599999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.097,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.448}]},{"osd":7,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.581,"15min":1.669},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0230000000000001,"5min":3.645,"15min":3.645},"last":1.9550000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.534,"15min":1.577},"min":{"1min":0.93000000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.0590000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.2290000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":937984,"data_stored":412082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.103,"15min":1.151},"min":{"1min":0.71899999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.456,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.323},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1379999999999999,"15min":1.1779999999999999},"min":{"1min":0.73999999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.486,"5min":2.04,"15min":2.04},"last":1.4370000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1479999999999999,"15min":1.194},"min":{"1min":0.68500000000000005,"5min":0.379,"15min":0.379},"max":{"1min":1.4730000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.01},{"interface":"front","average":{"1min":1.117,"5min":1.153,"15min":1.165},"min":{"1min":0.68600000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3340000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.94699999999999995}]},{"osd":2,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.246,"15min":1.286},"min":{"1min":0.58999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.554,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1799999999999999,"15min":1.2090000000000001},"min":{"1min":0.75700000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.556,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.1970000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.341,"15min":1.391},"min":{"1min":0.70999999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6839999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.361,"15min":1.4470000000000001},"min":{"1min":0.70799999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4179999999999999,"5min":4.016,"15min":4.016},"last":1.3700000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.3029999999999999,"15min":1.3740000000000001},"min":{"1min":0.63200000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5149999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.056},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5329999999999999,"15min":1.617},"min":{"1min":0.80500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0289999999999999,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.1499999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.534,"15min":1.643},"min":{"1min":0.628,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.615,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.756},{"interface":"front","average":{"1min":1.383,"5min":1.5229999999999999,"15min":1.595},"min":{"1min":0.79000000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.637,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.5189999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.581,"15min":1.663},"min":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8520000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.706},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.6220000000000001,"15min":1.7310000000000001},"min":{"1min":0.81100000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.8200000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.571}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":404148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0109999999999999,"15min":1.006},"min":{"1min":0.63200000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4870000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.198,"5min":1.1080000000000001,"15min":1.0900000000000001},"min":{"1min":0.79900000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6180000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0609999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.0980000000000001,"15min":1.0289999999999999},"min":{"1min":0.85099999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.2},{"interface":"front","average":{"1min":1.361,"5min":1.25,"15min":1.2290000000000001},"min":{"1min":0.79900000000000004,"5min":0.628,"15min":0.628},"max":{"1min":3.9430000000000001,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.1519999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2210000000000001,"15min":1.2130000000000001},"min":{"1min":0.73199999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.296,"15min":1.296},"min":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.391}]},{"osd":3,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1459999999999999,"15min":1.1679999999999999},"min":{"1min":0.75900000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.321,"5min":1.778,"15min":1.778},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.3540000000000001,"15min":1.341},"min":{"1min":0.88600000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.623,"5min":2.097,"15min":2.097},"last":1.4890000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.222,"15min":1.2689999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7270000000000001,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.3899999999999999,"15min":1.419},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.601,"5min":1.992,"15min":1.992},"last":1.2669999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.351,"15min":1.367},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.841,"5min":2.157,"15min":2.157},"last":1.347},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5609999999999999,"15min":1.5940000000000001},"min":{"1min":0.73399999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.837,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.5409999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.492,"15min":1.4950000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.921,"5min":2.202,"15min":2.202},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.647,"15min":1.657},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.9350000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.601}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":412060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.93400000000000005,"15min":1.016},"min":{"1min":0.49199999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92700000000000005,"5min":3.641,"15min":3.641},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94599999999999995,"15min":1.0049999999999999},"min":{"1min":0.45800000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.5389999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.0660000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.91400000000000003,"15min":0.93999999999999995},"min":{"1min":0.46899999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.296,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":1.29},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0640000000000001,"15min":1.1100000000000001},"min":{"1min":0.61699999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.464,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.23}]},{"osd":2,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.075,"15min":1.1100000000000001},"min":{"1min":0.52300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6020000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.8100000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.087,"15min":1.125},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3939999999999999,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.4259999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3009999999999999,"15min":1.337},"min":{"1min":0.89700000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8939999999999999,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.482},{"interface":"front","average":{"1min":1.198,"5min":1.327,"15min":1.389},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6679999999999999,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.679}]},{"osd":5,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.371,"15min":1.4219999999999999},"min":{"1min":0.86299999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.5840000000000001,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.603},{"interface":"front","average":{"1min":1.331,"5min":1.419,"15min":1.4710000000000001},"min":{"1min":0.90700000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.954,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.6399999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.478,"15min":1.53},"min":{"1min":0.96299999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.9830000000000001,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.323},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4590000000000001,"15min":1.5109999999999999},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.9039999999999999,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.361}]},{"osd":7,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.496,"15min":1.55},"min":{"1min":0.93700000000000006,"5min":0.871,"15min":0.871},"max":{"1min":2.0310000000000001,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4490000000000001,"15min":1.488},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6919999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.7350000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":913408,"data_stored":404730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.80600000000000005},"min":{"1min":0.56399999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89000000000000001,"15min":0.92600000000000005},"min":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4750000000000001,"5min":1.972,"15min":1.972},"last":0.49099999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94999999999999996,"15min":1.004},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.252,"5min":1.522,"15min":1.522},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.98699999999999999},"min":{"1min":0.54100000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.3580000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.55700000000000005}]},{"osd":3,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.49399999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.45100000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.073,"15min":1.101},"min":{"1min":0.59099999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.175,"15min":1.2070000000000001},"min":{"1min":0.77500000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.522,"5min":1.669,"15min":1.669},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.349,"15min":1.383},"min":{"1min":0.97299999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8160000000000001,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.284,"15min":1.3200000000000001},"min":{"1min":0.92800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6160000000000001,"5min":2.48,"15min":2.48},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.381,"5min":1.4239999999999999,"15min":1.484},"min":{"1min":1.093,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.869,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3560000000000001,"15min":1.3779999999999999},"min":{"1min":0.89800000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7649999999999999,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4650000000000001,"15min":1.5289999999999999},"min":{"1min":1.111,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.752,"5min":3.302,"15min":3.302},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.431,"15min":1.486},"min":{"1min":0.84599999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.893,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.355,"5min":1.403,"15min":1.4710000000000001},"min":{"1min":1.0289999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7649999999999999,"5min":2.73,"15min":2.73},"last":1.077}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":921600,"data_stored":404342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.308,"15min":0.308},"max":{"1min":1.048,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88,"15min":0.876},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3320000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.90200000000000002}]},{"osd":2,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.55700000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4590000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.036,"15min":1.0449999999999999},"min":{"1min":0.51600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.444,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.0229999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.044,"15min":1.032},"min":{"1min":0.57899999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5469999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.123},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.079,"15min":1.085},"min":{"1min":0.66800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8500000000000001,"5min":2.044,"15min":2.044},"last":1.0840000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2,"15min":1.196},"min":{"1min":0.81299999999999994,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.365,"5min":1.367,"15min":1.355},"min":{"1min":0.79400000000000004,"5min":0.752,"15min":0.752},"max":{"1min":2.1589999999999998,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.1739999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.276,"15min":1.242},"min":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.004,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.306},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.2749999999999999,"15min":1.2410000000000001},"min":{"1min":0.85599999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1989999999999998,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.0600000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.359,"15min":1.325},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.1070000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.21},{"interface":"front","average":{"1min":1.377,"5min":1.347,"15min":1.3580000000000001},"min":{"1min":0.83399999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.0699999999999998,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.4279999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.45,"15min":1.47},"min":{"1min":1.042,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.9019999999999999,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.355},{"interface":"front","average":{"1min":1.47,"5min":1.573,"15min":1.5800000000000001},"min":{"1min":1.0169999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.1789999999999998,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.474}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":994550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.405,"5min":1.901,"15min":1.901},"last":1.093},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.877,"15min":0.84999999999999998},"min":{"1min":0.52300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.012}]},{"osd":2,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.87,"15min":0.84099999999999997},"min":{"1min":0.54500000000000004,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3129999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":0.96199999999999997,"15min":0.95599999999999996},"min":{"1min":0.55500000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.198}]},{"osd":3,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.91700000000000004,"15min":0.89800000000000002},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.4590000000000001,"5min":1.875,"15min":1.875},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.073,"15min":1.0569999999999999},"min":{"1min":0.52000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.847,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.2430000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2549999999999999,"15min":1.2490000000000001},"min":{"1min":0.75900000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.958,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.518},{"interface":"front","average":{"1min":1.248,"5min":1.2090000000000001,"15min":1.196},"min":{"1min":0.82899999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.056,"5min":2.391,"15min":2.391},"last":1.294}]},{"osd":5,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3480000000000001,"15min":1.3540000000000001},"min":{"1min":0.747,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.992,"5min":3.028,"15min":3.028},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3220000000000001,"15min":1.3129999999999999},"min":{"1min":0.79000000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6970000000000001,"5min":2.718,"15min":2.718},"last":1.4239999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3,"15min":1.3100000000000001},"min":{"1min":0.83499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.633,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4099999999999999,"15min":1.4199999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.462}]},{"osd":7,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.90600000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.708,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.625},{"interface":"front","average":{"1min":1.329,"5min":1.349,"15min":1.357},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.776,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.2310000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:45:11.546 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T20:45:11.546 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-27T20:45:11.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.810+0000 7f72bf1a5640 1 Processor -- start 2023-11-27T20:45:11.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.810+0000 7f72bf1a5640 1 -- start start 2023-11-27T20:45:11.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.811+0000 7f72bf1a5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f72b80c3bc0 0x7f72b80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.811+0000 7f72bf1a5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b80c6370 con 0x7f72b80724f0 2023-11-27T20:45:11.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.811+0000 7f72bf1a5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b80a5780 con 0x7f72b80c2750 2023-11-27T20:45:11.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.811+0000 7f72bf1a5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b80aadc0 con 0x7f72b80c3bc0 2023-11-27T20:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.812+0000 7f72bcf41640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f72b80c3bc0 0x7f72b80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.812+0000 7f72bcf41640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f72b80c3bc0 0x7f72b80a5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52114/0 (socket says 172.21.15.91:52114) 2023-11-27T20:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.812+0000 7f72bcf41640 1 -- 172.21.15.91:0/176193378 learned_addr learned my addr 172.21.15.91:0/176193378 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.813+0000 7f72bcf41640 1 -- 172.21.15.91:0/176193378 >> v1:172.21.15.183:6789/0 conn(0x7f72b80c2750 legacy=0x7f72b8154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.813+0000 7f72bcf41640 1 -- 172.21.15.91:0/176193378 >> v1:172.21.15.91:6789/0 conn(0x7f72b80724f0 legacy=0x7f72b80c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.813+0000 7f72bcf41640 1 -- 172.21.15.91:0/176193378 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b80c4170 con 0x7f72b80c3bc0 2023-11-27T20:45:11.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.814+0000 7f72bcf41640 1 --2- 172.21.15.91:0/176193378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c3bc0 0x7f72b80a5240 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009870 tx=0x7f72ac02dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bd0058dfd2be66 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:11.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.814+0000 7f72b77fe640 1 -- 172.21.15.91:0/176193378 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac02e950 con 0x7f72b80c3bc0 2023-11-27T20:45:11.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.814+0000 7f72b77fe640 1 -- 172.21.15.91:0/176193378 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac02eab0 con 0x7f72b80c3bc0 2023-11-27T20:45:11.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.814+0000 7f72b77fe640 1 -- 172.21.15.91:0/176193378 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac02ee40 con 0x7f72b80c3bc0 2023-11-27T20:45:11.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.815+0000 7f72bf1a5640 1 -- 172.21.15.91:0/176193378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c3bc0 msgr2=0x7f72b80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.815+0000 7f72bf1a5640 1 --2- 172.21.15.91:0/176193378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c3bc0 0x7f72b80a5240 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009870 tx=0x7f72ac02dba0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.815+0000 7f72bf1a5640 1 -- 172.21.15.91:0/176193378 shutdown_connections 2023-11-27T20:45:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.815+0000 7f72bf1a5640 1 --2- 172.21.15.91:0/176193378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c3bc0 0x7f72b80a5240 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.815+0000 7f72bf1a5640 1 -- 172.21.15.91:0/176193378 >> 172.21.15.91:0/176193378 conn(0x7f72b806a500 msgr2=0x7f72b806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.815+0000 7f72bf1a5640 1 -- 172.21.15.91:0/176193378 shutdown_connections 2023-11-27T20:45:11.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.815+0000 7f72bf1a5640 1 -- 172.21.15.91:0/176193378 wait complete. 2023-11-27T20:45:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.817+0000 7f72bf1a5640 1 Processor -- start 2023-11-27T20:45:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.817+0000 7f72bf1a5640 1 -- start start 2023-11-27T20:45:11.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.818+0000 7f72bf1a5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72b80724f0 0x7f72b8153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.818+0000 7f72bf1a5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c2750 0x7f72b8150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.818+0000 7f72bf1a5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72b80c3bc0 0x7f72b81507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.818+0000 7f72bf1a5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8150df0 con 0x7f72b80c2750 2023-11-27T20:45:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.818+0000 7f72bf1a5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8071ed0 con 0x7f72b80724f0 2023-11-27T20:45:11.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.818+0000 7f72bf1a5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8151040 con 0x7f72b80c3bc0 2023-11-27T20:45:11.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.818+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c2750 0x7f72b8150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:11.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.818+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c2750 0x7f72b8150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52124/0 (socket says 172.21.15.91:52124) 2023-11-27T20:45:11.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.818+0000 7f72b7fff640 1 -- 172.21.15.91:0/3524258254 learned_addr learned my addr 172.21.15.91:0/3524258254 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:11.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72bd742640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72b80c3bc0 0x7f72b81507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:11.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72bcf41640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72b80724f0 0x7f72b8153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:11.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72b7fff640 1 -- 172.21.15.91:0/3524258254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72b80c3bc0 msgr2=0x7f72b81507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72b7fff640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72b80c3bc0 0x7f72b81507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72b7fff640 1 -- 172.21.15.91:0/3524258254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72b80724f0 msgr2=0x7f72b8153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:11.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72b7fff640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72b80724f0 0x7f72b8153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:11.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72b7fff640 1 -- 172.21.15.91:0/3524258254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac0094d0 con 0x7f72b80c2750 2023-11-27T20:45:11.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72b7fff640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c2750 0x7f72b8150260 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f72a400c400 tx=0x7f72a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:11.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72b57fa640 1 -- 172.21.15.91:0/3524258254 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a40052d0 con 0x7f72b80c2750 2023-11-27T20:45:11.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72b57fa640 1 -- 172.21.15.91:0/3524258254 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a4005430 con 0x7f72b80c2750 2023-11-27T20:45:11.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72b57fa640 1 -- 172.21.15.91:0/3524258254 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4003830 con 0x7f72b80c2750 2023-11-27T20:45:11.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.819+0000 7f72bf1a5640 1 -- 172.21.15.91:0/3524258254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b81e62d0 con 0x7f72b80c2750 2023-11-27T20:45:11.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.820+0000 7f72bf1a5640 1 -- 172.21.15.91:0/3524258254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b8153560 con 0x7f72b80c2750 2023-11-27T20:45:11.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.821+0000 7f72bf1a5640 1 -- 172.21.15.91:0/3524258254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b81e67f0 con 0x7f72b80c2750 2023-11-27T20:45:11.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.822+0000 7f72b57fa640 1 -- 172.21.15.91:0/3524258254 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f72a4003990 con 0x7f72b80c2750 2023-11-27T20:45:11.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.822+0000 7f72b57fa640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f729c06b1f0 0x7f729c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:11.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.823+0000 7f72b57fa640 1 -- 172.21.15.91:0/3524258254 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72a4088f40 con 0x7f72b80c2750 2023-11-27T20:45:11.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.823+0000 7f72bcf41640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f729c06b1f0 0x7f729c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:11.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.823+0000 7f72bcf41640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f729c06b1f0 0x7f729c06d6b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f72ac038000 tx=0x7f72ac032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:11.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:11.827+0000 7f72b57fa640 1 -- 172.21.15.91:0/3524258254 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f72a4053c60 con 0x7f72b80c2750 2023-11-27T20:45:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.084+0000 7f72bf1a5640 1 -- 172.21.15.91:0/3524258254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f72b8071cc0 con 0x7f72b80c2750 2023-11-27T20:45:12.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.089+0000 7f72b57fa640 1 -- 172.21.15.91:0/3524258254 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+147 (secure 0 0 0) 0x7f72a40170b0 con 0x7f72b80c2750 2023-11-27T20:45:12.090 INFO:teuthology.orchestra.run.smithi091.stdout:[client.0] 2023-11-27T20:45:12.090 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5/mRlKBgjIhAArHSIgmH/SwVIdiUlROMOfA== 2023-11-27T20:45:12.091 INFO:teuthology.orchestra.run.smithi091.stdout: caps mds = "allow" 2023-11-27T20:45:12.091 INFO:teuthology.orchestra.run.smithi091.stdout: caps mon = "allow r" 2023-11-27T20:45:12.091 INFO:teuthology.orchestra.run.smithi091.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-27T20:45:12.093 INFO:teuthology.orchestra.run.smithi091.stderr:updated caps for client.0 2023-11-27T20:45:12.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.091+0000 7f72bf1a5640 1 -- 172.21.15.91:0/3524258254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f729c06b1f0 msgr2=0x7f729c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:12.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.091+0000 7f72bf1a5640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f729c06b1f0 0x7f729c06d6b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f72ac038000 tx=0x7f72ac032000 comp rx=0 tx=0).stop 2023-11-27T20:45:12.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.091+0000 7f72bf1a5640 1 -- 172.21.15.91:0/3524258254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c2750 msgr2=0x7f72b8150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:12.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.091+0000 7f72bf1a5640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c2750 0x7f72b8150260 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f72a400c400 tx=0x7f72a400c8c0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.092+0000 7f72bf1a5640 1 -- 172.21.15.91:0/3524258254 shutdown_connections 2023-11-27T20:45:12.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.092+0000 7f72bf1a5640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72b80c3bc0 0x7f72b81507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.092+0000 7f72bf1a5640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72b80c2750 0x7f72b8150260 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.092+0000 7f72bf1a5640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f729c06b1f0 0x7f729c06d6b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.092+0000 7f72bf1a5640 1 --2- 172.21.15.91:0/3524258254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72b80724f0 0x7f72b8153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.092+0000 7f72bf1a5640 1 -- 172.21.15.91:0/3524258254 >> 172.21.15.91:0/3524258254 conn(0x7f72b806a500 msgr2=0x7f72b80a8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:12.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.092+0000 7f72bf1a5640 1 -- 172.21.15.91:0/3524258254 shutdown_connections 2023-11-27T20:45:12.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.092+0000 7f72bf1a5640 1 -- 172.21.15.91:0/3524258254 wait complete. 2023-11-27T20:45:12.110 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:45:12.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.318+0000 7f204ffff640 1 Processor -- start 2023-11-27T20:45:12.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.318+0000 7f204ffff640 1 -- start start 2023-11-27T20:45:12.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.320+0000 7f204ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f205014e7f0 0x7f20500c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:12.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.320+0000 7f204ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f205006cd20 0x7f205015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:12.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.320+0000 7f204ffff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20500a8380 con 0x7f20500c52e0 2023-11-27T20:45:12.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.320+0000 7f204ffff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20501510b0 con 0x7f205006cd20 2023-11-27T20:45:12.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.320+0000 7f204ffff640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f205006bf60 con 0x7f205014e7f0 2023-11-27T20:45:12.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.320+0000 7f204f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f205006cd20 0x7f205015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:12.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.321+0000 7f204f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f205006cd20 0x7f205015ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52134/0 (socket says 172.21.15.91:52134) 2023-11-27T20:45:12.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.321+0000 7f204f7fe640 1 -- 172.21.15.91:0/2192748466 learned_addr learned my addr 172.21.15.91:0/2192748466 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:12.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.321+0000 7f204effd640 1 --2- 172.21.15.91:0/2192748466 >> v2:172.21.15.183:3300/0 conn(0x7f205014e7f0 0x7f20500c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:12.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.321+0000 7f204f7fe640 1 -- 172.21.15.91:0/2192748466 >> v2:172.21.15.183:3300/0 conn(0x7f205014e7f0 msgr2=0x7f20500c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:12.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.321+0000 7f204f7fe640 1 --2- 172.21.15.91:0/2192748466 >> v2:172.21.15.183:3300/0 conn(0x7f205014e7f0 0x7f20500c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.321+0000 7f204f7fe640 1 -- 172.21.15.91:0/2192748466 >> v1:172.21.15.183:6789/0 conn(0x7f20500c52e0 legacy=0x7f205006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:12.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.321+0000 7f204f7fe640 1 -- 172.21.15.91:0/2192748466 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205006c240 con 0x7f205006cd20 2023-11-27T20:45:12.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.322+0000 7f204f7fe640 1 --2- 172.21.15.91:0/2192748466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205006cd20 0x7f205015ba30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2050067910 tx=0x7f204802e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ccee5901382d8e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:12.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.323+0000 7f204e7fc640 1 -- 172.21.15.91:0/2192748466 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204802ea00 con 0x7f205006cd20 2023-11-27T20:45:12.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.323+0000 7f204e7fc640 1 -- 172.21.15.91:0/2192748466 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204802eb60 con 0x7f205006cd20 2023-11-27T20:45:12.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.323+0000 7f204e7fc640 1 -- 172.21.15.91:0/2192748466 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048009600 con 0x7f205006cd20 2023-11-27T20:45:12.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.323+0000 7f204ffff640 1 -- 172.21.15.91:0/2192748466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205006cd20 msgr2=0x7f205015ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:12.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.323+0000 7f204ffff640 1 --2- 172.21.15.91:0/2192748466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205006cd20 0x7f205015ba30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2050067910 tx=0x7f204802e060 comp rx=0 tx=0).stop 2023-11-27T20:45:12.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.323+0000 7f204ffff640 1 -- 172.21.15.91:0/2192748466 shutdown_connections 2023-11-27T20:45:12.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.323+0000 7f204ffff640 1 --2- 172.21.15.91:0/2192748466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205006cd20 0x7f205015ba30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.323+0000 7f204ffff640 1 --2- 172.21.15.91:0/2192748466 >> v2:172.21.15.183:3300/0 conn(0x7f205014e7f0 0x7f20500c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.323+0000 7f204ffff640 1 -- 172.21.15.91:0/2192748466 >> 172.21.15.91:0/2192748466 conn(0x7f20500a77f0 msgr2=0x7f20500a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:12.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.324+0000 7f204ffff640 1 -- 172.21.15.91:0/2192748466 shutdown_connections 2023-11-27T20:45:12.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.324+0000 7f204ffff640 1 -- 172.21.15.91:0/2192748466 wait complete. 2023-11-27T20:45:12.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.325+0000 7f204ffff640 1 Processor -- start 2023-11-27T20:45:12.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.325+0000 7f204ffff640 1 -- start start 2023-11-27T20:45:12.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.326+0000 7f204ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f205006cd20 0x7f2050154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:12.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.326+0000 7f204ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20500c52e0 0x7f20500bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:12.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.326+0000 7f204ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205014e7f0 0x7f20501e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:12.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.326+0000 7f204ffff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205014b530 con 0x7f205014e7f0 2023-11-27T20:45:12.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.326+0000 7f204ffff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20501dcf90 con 0x7f205006cd20 2023-11-27T20:45:12.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.326+0000 7f204ffff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20501dd510 con 0x7f20500c52e0 2023-11-27T20:45:12.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.326+0000 7f204f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205014e7f0 0x7f20501e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.326+0000 7f204f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205014e7f0 0x7f20501e9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52140/0 (socket says 172.21.15.91:52140) 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f204f7fe640 1 -- 172.21.15.91:0/3363217849 learned_addr learned my addr 172.21.15.91:0/3363217849 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f204effd640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f205006cd20 0x7f2050154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f204f7fe640 1 -- 172.21.15.91:0/3363217849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20500c52e0 msgr2=0x7f20500bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f204f7fe640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20500c52e0 0x7f20500bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f204f7fe640 1 -- 172.21.15.91:0/3363217849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f205006cd20 msgr2=0x7f2050154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f204f7fe640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f205006cd20 0x7f2050154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f204f7fe640 1 -- 172.21.15.91:0/3363217849 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204800bd40 con 0x7f205014e7f0 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f204effd640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f205006cd20 0x7f2050154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f204f7fe640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205014e7f0 0x7f20501e9a10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2048038040 tx=0x7f2048004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:12.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f2047fff640 1 -- 172.21.15.91:0/3363217849 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204802ea00 con 0x7f205014e7f0 2023-11-27T20:45:12.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.327+0000 7f2047fff640 1 -- 172.21.15.91:0/3363217849 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048036820 con 0x7f205014e7f0 2023-11-27T20:45:12.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.328+0000 7f2047fff640 1 -- 172.21.15.91:0/3363217849 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048036bd0 con 0x7f205014e7f0 2023-11-27T20:45:12.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.328+0000 7f204ffff640 1 -- 172.21.15.91:0/3363217849 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20501dd230 con 0x7f205014e7f0 2023-11-27T20:45:12.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.328+0000 7f204ffff640 1 -- 172.21.15.91:0/3363217849 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20500bf620 con 0x7f205014e7f0 2023-11-27T20:45:12.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.329+0000 7f204ffff640 1 -- 172.21.15.91:0/3363217849 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205014b6e0 con 0x7f205014e7f0 2023-11-27T20:45:12.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.330+0000 7f2047fff640 1 -- 172.21.15.91:0/3363217849 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2048036d30 con 0x7f205014e7f0 2023-11-27T20:45:12.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.330+0000 7f2047fff640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f203006b1f0 0x7f203006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:12.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.331+0000 7f2047fff640 1 -- 172.21.15.91:0/3363217849 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20480ac760 con 0x7f205014e7f0 2023-11-27T20:45:12.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.331+0000 7f204effd640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f203006b1f0 0x7f203006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:12.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.331+0000 7f204effd640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f203006b1f0 0x7f203006d6b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2040006fd0 tx=0x7f2040008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:12.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.335+0000 7f2047fff640 1 -- 172.21.15.91:0/3363217849 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f205014b6e0 con 0x7f205014e7f0 2023-11-27T20:45:12.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.545+0000 7f204ffff640 1 -- 172.21.15.91:0/3363217849 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f205014b6e0 con 0x7f205014e7f0 2023-11-27T20:45:12.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.546+0000 7f2047fff640 1 -- 172.21.15.91:0/3363217849 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f205014b6e0 con 0x7f205014e7f0 2023-11-27T20:45:12.546 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:12.547 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1761528163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1761528163},{"type":"v1","addr":"172.21.15.91:6837","nonce":1761528163}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:06.072742+0000","modified":"2023-11-27T20:45:09.133844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/2103536114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":2103536114},{"type":"v1","addr":"172.21.15.183:6835","nonce":2103536114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-27T20:45:12.547 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 46 2023-11-27T20:45:12.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 -- 172.21.15.91:0/3363217849 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f203006b1f0 msgr2=0x7f203006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:12.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f203006b1f0 0x7f203006d6b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2040006fd0 tx=0x7f2040008040 comp rx=0 tx=0).stop 2023-11-27T20:45:12.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 -- 172.21.15.91:0/3363217849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205014e7f0 msgr2=0x7f20501e9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:12.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205014e7f0 0x7f20501e9a10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2048038040 tx=0x7f2048004a40 comp rx=0 tx=0).stop 2023-11-27T20:45:12.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 -- 172.21.15.91:0/3363217849 shutdown_connections 2023-11-27T20:45:12.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f205014e7f0 0x7f20501e9a10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20500c52e0 0x7f20500bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f203006b1f0 0x7f203006d6b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 --2- 172.21.15.91:0/3363217849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f205006cd20 0x7f2050154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:12.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 -- 172.21.15.91:0/3363217849 >> 172.21.15.91:0/3363217849 conn(0x7f20500a77f0 msgr2=0x7f20500c43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:12.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 -- 172.21.15.91:0/3363217849 shutdown_connections 2023-11-27T20:45:12.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:12.549+0000 7f204ffff640 1 -- 172.21.15.91:0/3363217849 wait complete. 2023-11-27T20:45:12.599 INFO:tasks.ceph.mds.d.smithi183.stderr:2023-11-27T20:45:12.597+0000 7fa8cfed0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:45:12.970 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T20:45:06.072742+0000', 'modified': '2023-11-27T20:45:09.133844+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6528}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6528': {'gid': 6528, 'name': 'd', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6835/2103536114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6833', 'nonce': 2103536114}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 2103536114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T20:45:12.970 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T20:45:12.971 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-27T20:45:13.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.194+0000 7f51b4426640 1 Processor -- start 2023-11-27T20:45:13.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.194+0000 7f51b4426640 1 -- start start 2023-11-27T20:45:13.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.195+0000 7f51b4426640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac06d0a0 0x7f51ac152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.195+0000 7f51b4426640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f51ac0c3ea0 0x7f51ac0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.195+0000 7f51b4426640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0c64a0 con 0x7f51ac14fd30 2023-11-27T20:45:13.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.195+0000 7f51b4426640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac0c5c00 con 0x7f51ac0c3ea0 2023-11-27T20:45:13.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.195+0000 7f51b4426640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0c5ee0 con 0x7f51ac06d0a0 2023-11-27T20:45:13.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.196+0000 7f51b19c1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac06d0a0 0x7f51ac152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.196+0000 7f51b19c1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac06d0a0 0x7f51ac152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:42136/0 (socket says 172.21.15.91:42136) 2023-11-27T20:45:13.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.196+0000 7f51b19c1640 1 -- 172.21.15.91:0/2891024357 learned_addr learned my addr 172.21.15.91:0/2891024357 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:13.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.196+0000 7f51b29c3640 1 --2- 172.21.15.91:0/2891024357 >> v2:172.21.15.183:3300/0 conn(0x7f51ac0c3ea0 0x7f51ac0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.197+0000 7f51b19c1640 1 -- 172.21.15.91:0/2891024357 >> v2:172.21.15.183:3300/0 conn(0x7f51ac0c3ea0 msgr2=0x7f51ac0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.197+0000 7f51b19c1640 1 --2- 172.21.15.91:0/2891024357 >> v2:172.21.15.183:3300/0 conn(0x7f51ac0c3ea0 0x7f51ac0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.197+0000 7f51b19c1640 1 -- 172.21.15.91:0/2891024357 >> v1:172.21.15.183:6789/0 conn(0x7f51ac14fd30 legacy=0x7f51ac0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.197+0000 7f51b19c1640 1 -- 172.21.15.91:0/2891024357 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0c61c0 con 0x7f51ac06d0a0 2023-11-27T20:45:13.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.198+0000 7f51b19c1640 1 --2- 172.21.15.91:0/2891024357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac06d0a0 0x7f51ac152f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f519c009870 tx=0x7f519c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=615e7f19005c3459 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:13.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.199+0000 7f51b11c0640 1 -- 172.21.15.91:0/2891024357 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c030840 con 0x7f51ac06d0a0 2023-11-27T20:45:13.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.199+0000 7f51b11c0640 1 -- 172.21.15.91:0/2891024357 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c0309a0 con 0x7f51ac06d0a0 2023-11-27T20:45:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.199+0000 7f51b11c0640 1 -- 172.21.15.91:0/2891024357 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c030d30 con 0x7f51ac06d0a0 2023-11-27T20:45:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.200+0000 7f51b4426640 1 -- 172.21.15.91:0/2891024357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac06d0a0 msgr2=0x7f51ac152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.200+0000 7f51b4426640 1 --2- 172.21.15.91:0/2891024357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac06d0a0 0x7f51ac152f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f519c009870 tx=0x7f519c02b980 comp rx=0 tx=0).stop 2023-11-27T20:45:13.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.200+0000 7f51b4426640 1 -- 172.21.15.91:0/2891024357 shutdown_connections 2023-11-27T20:45:13.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.200+0000 7f51b4426640 1 --2- 172.21.15.91:0/2891024357 >> v2:172.21.15.183:3300/0 conn(0x7f51ac0c3ea0 0x7f51ac0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.200+0000 7f51b4426640 1 --2- 172.21.15.91:0/2891024357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac06d0a0 0x7f51ac152f20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.200+0000 7f51b4426640 1 -- 172.21.15.91:0/2891024357 >> 172.21.15.91:0/2891024357 conn(0x7f51ac06a500 msgr2=0x7f51ac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:13.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.200+0000 7f51b4426640 1 -- 172.21.15.91:0/2891024357 shutdown_connections 2023-11-27T20:45:13.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.200+0000 7f51b4426640 1 -- 172.21.15.91:0/2891024357 wait complete. 2023-11-27T20:45:13.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.202+0000 7f51b4426640 1 Processor -- start 2023-11-27T20:45:13.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.202+0000 7f51b4426640 1 -- start start 2023-11-27T20:45:13.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.203+0000 7f51b4426640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51ac06d0a0 0x7f51ac154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.203+0000 7f51b4426640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51ac0c3ea0 0x7f51ac14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.203+0000 7f51b4426640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac14fd30 0x7f51ac0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.203+0000 7f51b4426640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac156540 con 0x7f51ac06d0a0 2023-11-27T20:45:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.203+0000 7f51b4426640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac1ea9b0 con 0x7f51ac0c3ea0 2023-11-27T20:45:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.203+0000 7f51b4426640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0c00a0 con 0x7f51ac14fd30 2023-11-27T20:45:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.203+0000 7f51b21c2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51ac06d0a0 0x7f51ac154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.204+0000 7f51b21c2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51ac06d0a0 0x7f51ac154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52152/0 (socket says 172.21.15.91:52152) 2023-11-27T20:45:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.204+0000 7f51b21c2640 1 -- 172.21.15.91:0/957578147 learned_addr learned my addr 172.21.15.91:0/957578147 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.204+0000 7f51b19c1640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51ac0c3ea0 0x7f51ac14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.204+0000 7f51b29c3640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac14fd30 0x7f51ac0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.204+0000 7f51b21c2640 1 -- 172.21.15.91:0/957578147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac14fd30 msgr2=0x7f51ac0bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.204+0000 7f51b21c2640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac14fd30 0x7f51ac0bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.204+0000 7f51b21c2640 1 -- 172.21.15.91:0/957578147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51ac0c3ea0 msgr2=0x7f51ac14f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.204+0000 7f51b21c2640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51ac0c3ea0 0x7f51ac14f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.204+0000 7f51b21c2640 1 -- 172.21.15.91:0/957578147 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c0094d0 con 0x7f51ac06d0a0 2023-11-27T20:45:13.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.204+0000 7f51b21c2640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51ac06d0a0 0x7f51ac154dd0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f51a800c400 tx=0x7f51a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:13.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.205+0000 7f51a2ffd640 1 -- 172.21.15.91:0/957578147 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80052d0 con 0x7f51ac06d0a0 2023-11-27T20:45:13.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.205+0000 7f51a2ffd640 1 -- 172.21.15.91:0/957578147 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8005450 con 0x7f51ac06d0a0 2023-11-27T20:45:13.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.205+0000 7f51a2ffd640 1 -- 172.21.15.91:0/957578147 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8007260 con 0x7f51ac06d0a0 2023-11-27T20:45:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.205+0000 7f51b4426640 1 -- 172.21.15.91:0/957578147 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac14ef50 con 0x7f51ac06d0a0 2023-11-27T20:45:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.205+0000 7f51b4426640 1 -- 172.21.15.91:0/957578147 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac1eac00 con 0x7f51ac06d0a0 2023-11-27T20:45:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.207+0000 7f51a2ffd640 1 -- 172.21.15.91:0/957578147 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f51a80073c0 con 0x7f51ac06d0a0 2023-11-27T20:45:13.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.208+0000 7f51a2ffd640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f519006b1c0 0x7f519006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.208+0000 7f51a2ffd640 1 -- 172.21.15.91:0/957578147 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51a8088d90 con 0x7f51ac06d0a0 2023-11-27T20:45:13.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.208+0000 7f51b19c1640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f519006b1c0 0x7f519006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.209+0000 7f51b6fbb740 1 Processor -- start 2023-11-27T20:45:13.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.209+0000 7f51b19c1640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f519006b1c0 0x7f519006d680 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f519c036000 tx=0x7f519c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:13.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.209+0000 7f51b6fbb740 1 -- start start 2023-11-27T20:45:13.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.210+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.210+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8ac886b0 0x55ed8acc4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.210+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8acc5170 0x55ed8ac81ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.210+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8abe5880 con 0x55ed8acc1960 2023-11-27T20:45:13.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.210+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8abf4ae0 con 0x55ed8ac886b0 2023-11-27T20:45:13.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.210+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed8abf21d0 con 0x55ed8acc5170 2023-11-27T20:45:13.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.210+0000 7f51b21c2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.210+0000 7f51b21c2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52158/0 (socket says 172.21.15.91:52158) 2023-11-27T20:45:13.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.210+0000 7f51b21c2640 1 -- 172.21.15.91:0/4227664343 learned_addr learned my addr 172.21.15.91:0/4227664343 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:13.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.210+0000 7f51b19c1640 1 --2- 172.21.15.91:0/4227664343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8ac886b0 0x55ed8acc4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.211+0000 7f51b21c2640 1 -- 172.21.15.91:0/4227664343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8acc5170 msgr2=0x55ed8ac81ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.211+0000 7f51b21c2640 1 --2- 172.21.15.91:0/4227664343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8acc5170 0x55ed8ac81ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.211+0000 7f51b21c2640 1 -- 172.21.15.91:0/4227664343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8ac886b0 msgr2=0x55ed8acc4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.211+0000 7f51b21c2640 1 --2- 172.21.15.91:0/4227664343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8ac886b0 0x55ed8acc4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.211+0000 7f51b21c2640 1 -- 172.21.15.91:0/4227664343 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed8abb5860 con 0x55ed8acc1960 2023-11-27T20:45:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.211+0000 7f51b21c2640 1 --2- 172.21.15.91:0/4227664343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc1d40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f51a800cfd0 tx=0x7f51a8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e83968d881b6c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.211+0000 7f518ffff640 1 -- 172.21.15.91:0/4227664343 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a805b960 con 0x55ed8acc1960 2023-11-27T20:45:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.211+0000 7f518ffff640 1 -- 172.21.15.91:0/4227664343 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a805fb10 con 0x55ed8acc1960 2023-11-27T20:45:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.211+0000 7f518ffff640 1 -- 172.21.15.91:0/4227664343 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8053f20 con 0x55ed8acc1960 2023-11-27T20:45:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.212+0000 7f51b6fbb740 1 -- 172.21.15.91:0/4227664343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 msgr2=0x55ed8acc1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.212+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/4227664343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc1d40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f51a800cfd0 tx=0x7f51a8011000 comp rx=0 tx=0).stop 2023-11-27T20:45:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.212+0000 7f51b6fbb740 1 -- 172.21.15.91:0/4227664343 shutdown_connections 2023-11-27T20:45:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.212+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/4227664343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8acc5170 0x55ed8ac81ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.212+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/4227664343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8ac886b0 0x55ed8acc4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.212+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/4227664343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc1d40 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.212+0000 7f51b6fbb740 1 -- 172.21.15.91:0/4227664343 >> 172.21.15.91:0/4227664343 conn(0x55ed8ac48c70 msgr2=0x55ed8aca8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:13.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.212+0000 7f51b6fbb740 1 -- 172.21.15.91:0/4227664343 shutdown_connections 2023-11-27T20:45:13.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.212+0000 7f51b6fbb740 1 -- 172.21.15.91:0/4227664343 wait complete. 2023-11-27T20:45:13.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.213+0000 7f51b6fbb740 1 -- start start 2023-11-27T20:45:13.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.213+0000 7f51b6fbb740 1 Processor -- start 2023-11-27T20:45:13.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8ac886b0 0x55ed8aca82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acc5170 0x55ed8aca52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8abedac0 con 0x55ed8acc1960 2023-11-27T20:45:13.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8ab8a2f0 con 0x55ed8acc5170 2023-11-27T20:45:13.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed8aba7c70 con 0x55ed8ac886b0 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b6fbb740 10 client.0 _ll_register_callbacks cb 0x55ed8abac3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b19c1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b19c1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52160/0 (socket says 172.21.15.91:52160) 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b19c1640 1 -- 172.21.15.91:0/3679305050 learned_addr learned my addr 172.21.15.91:0/3679305050 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b21c2640 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8ac886b0 0x55ed8aca82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b19c1640 1 -- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8ac886b0 msgr2=0x55ed8aca82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b19c1640 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8ac886b0 0x55ed8aca82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b19c1640 1 -- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acc5170 msgr2=0x55ed8aca52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b19c1640 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acc5170 0x55ed8aca52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.214+0000 7f51b19c1640 1 -- 172.21.15.91:0/3679305050 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac1eac00 con 0x55ed8acc1960 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.215+0000 7f51b19c1640 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc84a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f519c006da0 tx=0x7f519c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c079b227e96e478 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.215+0000 7f518d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.215+0000 7f518d7fa640 1 -- 172.21.15.91:0/3679305050 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c049050 con 0x55ed8acc1960 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.215+0000 7f518d7fa640 1 -- 172.21.15.91:0/3679305050 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f519c03e040 con 0x55ed8acc1960 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.215+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3679305050 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed8abe6aa0 con 0x55ed8acc1960 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.215+0000 7f518d7fa640 1 -- 172.21.15.91:0/3679305050 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f519c039920 con 0x55ed8acc1960 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.215+0000 7f51b6fbb740 10 client.6669 fetch_fsmap learned FSMap version 46 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.215+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3679305050 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55ed8abec140 con 0x55ed8acc1960 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.216+0000 7f518d7fa640 1 -- 172.21.15.91:0/3679305050 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed8abe6aa0 con 0x55ed8acc1960 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.216+0000 7f518d7fa640 1 -- 172.21.15.91:0/3679305050 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f519c042050 con 0x55ed8acc1960 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.216+0000 7f51b6fbb740 10 client.6669 fetch_fsmap finished waiting for FSMap version 46 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.216+0000 7f51b6fbb740 10 client.6669 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T20:45:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.216+0000 7f51b6fbb740 20 client.6669 populate_metadata read hostname 'smithi091' 2023-11-27T20:45:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.216+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:6833/2103536114,v1:172.21.15.183:6835/2103536114] conn(0x55ed8acbf5a0 0x55ed8acbf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.216+0000 7f51b6fbb740 4 client.6669 mds_command: new command op to 6528 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T20:45:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.216+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3679305050 --> [v2:172.21.15.183:6833/2103536114,v1:172.21.15.183:6835/2103536114] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed8abe67c0 con 0x55ed8acbf5a0 2023-11-27T20:45:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.216+0000 7f51b21c2640 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:6833/2103536114,v1:172.21.15.183:6835/2103536114] conn(0x55ed8acbf5a0 0x55ed8acbf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.217+0000 7f51b21c2640 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:6833/2103536114,v1:172.21.15.183:6835/2103536114] conn(0x55ed8acbf5a0 0x55ed8acbf980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deb36fe7b22585fd server_cookie=10272ed3b84a15db in_seq=0 out_seq=0 2023-11-27T20:45:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.217+0000 7f518d7fa640 10 client.6669 ms_handle_connect on v2:172.21.15.183:6833/2103536114 2023-11-27T20:45:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.219+0000 7f518d7fa640 1 -- 172.21.15.91:0/3679305050 <== mds.0 v2:172.21.15.183:6833/2103536114 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ed8abe67c0 con 0x55ed8acbf5a0 2023-11-27T20:45:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.219+0000 7f518d7fa640 10 client.6669 handle_command_reply: tid=0 2023-11-27T20:45:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 client.6669 shutdown 2023-11-27T20:45:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3679305050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 msgr2=0x55ed8acc84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc84a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f519c006da0 tx=0x7f519c02e000 comp rx=0 tx=0).stop 2023-11-27T20:45:13.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3679305050 shutdown_connections 2023-11-27T20:45:13.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:6833/2103536114,v1:172.21.15.183:6835/2103536114] conn(0x55ed8acbf5a0 0x55ed8acbf980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acc5170 0x55ed8aca52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc1960 0x55ed8acc84a0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3679305050 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8ac886b0 0x55ed8aca82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f518d7fa640 0 client.6669 ms_handle_reset on v2:172.21.15.183:6833/2103536114 2023-11-27T20:45:13.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3679305050 >> 172.21.15.91:0/3679305050 conn(0x55ed8ac48c70 msgr2=0x55ed8acc6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:13.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3679305050 shutdown_connections 2023-11-27T20:45:13.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3679305050 wait complete. 2023-11-27T20:45:13.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.220+0000 7f51b6fbb740 20 client.6669 trim_cache size 0 max 16384 2023-11-27T20:45:13.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.237+0000 7f51b6fbb740 1 Processor -- start 2023-11-27T20:45:13.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.237+0000 7f51b6fbb740 1 -- start start 2023-11-27T20:45:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.238+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8ac886b0 0x55ed8acc45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.238+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8acc5170 0x55ed8ace6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.238+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acba200 0x55ed8acd5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.238+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8acd6530 con 0x55ed8ac886b0 2023-11-27T20:45:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.238+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8a950f20 con 0x55ed8acba200 2023-11-27T20:45:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.238+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed8abf62f0 con 0x55ed8acc5170 2023-11-27T20:45:13.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.238+0000 7f51b21c2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8ac886b0 0x55ed8acc45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.238+0000 7f51b21c2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8ac886b0 0x55ed8acc45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52162/0 (socket says 172.21.15.91:52162) 2023-11-27T20:45:13.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.238+0000 7f51b21c2640 1 -- 172.21.15.91:0/2583443484 learned_addr learned my addr 172.21.15.91:0/2583443484 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:13.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.239+0000 7f51b21c2640 1 -- 172.21.15.91:0/2583443484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8acc5170 msgr2=0x55ed8ace6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.239+0000 7f51b21c2640 1 --2- 172.21.15.91:0/2583443484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8acc5170 0x55ed8ace6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.239+0000 7f51b21c2640 1 -- 172.21.15.91:0/2583443484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acba200 msgr2=0x55ed8acd5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.239+0000 7f51b21c2640 1 --2- 172.21.15.91:0/2583443484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acba200 0x55ed8acd5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.239+0000 7f51b21c2640 1 -- 172.21.15.91:0/2583443484 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed8ab89b80 con 0x55ed8ac886b0 2023-11-27T20:45:13.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.239+0000 7f51b21c2640 1 --2- 172.21.15.91:0/2583443484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8ac886b0 0x55ed8acc45e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f51a80577a0 tx=0x7f51a805a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d070acd7ec32c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:13.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.239+0000 7f51a0dff640 1 -- 172.21.15.91:0/2583443484 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a805b960 con 0x55ed8ac886b0 2023-11-27T20:45:13.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.239+0000 7f51a0dff640 1 -- 172.21.15.91:0/2583443484 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8055bb0 con 0x55ed8ac886b0 2023-11-27T20:45:13.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.239+0000 7f51a0dff640 1 -- 172.21.15.91:0/2583443484 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8053f20 con 0x55ed8ac886b0 2023-11-27T20:45:13.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.240+0000 7f51b6fbb740 1 -- 172.21.15.91:0/2583443484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8ac886b0 msgr2=0x55ed8acc45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.240+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/2583443484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8ac886b0 0x55ed8acc45e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f51a80577a0 tx=0x7f51a805a000 comp rx=0 tx=0).stop 2023-11-27T20:45:13.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.240+0000 7f51b6fbb740 1 -- 172.21.15.91:0/2583443484 shutdown_connections 2023-11-27T20:45:13.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.240+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/2583443484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acba200 0x55ed8acd5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.240+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/2583443484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8acc5170 0x55ed8ace6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.240+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/2583443484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8ac886b0 0x55ed8acc45e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.240+0000 7f51b6fbb740 1 -- 172.21.15.91:0/2583443484 >> 172.21.15.91:0/2583443484 conn(0x55ed8ac48c70 msgr2=0x55ed8aca50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:13.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.240+0000 7f51b6fbb740 1 -- 172.21.15.91:0/2583443484 shutdown_connections 2023-11-27T20:45:13.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.240+0000 7f51b6fbb740 1 -- 172.21.15.91:0/2583443484 wait complete. 2023-11-27T20:45:13.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.240+0000 7f51b6fbb740 1 -- start start 2023-11-27T20:45:13.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.241+0000 7f51b6fbb740 1 Processor -- start 2023-11-27T20:45:13.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.241+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8ac886b0 0x55ed8acc0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.241+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acba200 0x55ed8acc6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.241+0000 7f51b6fbb740 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc5170 0x55ed8ad2aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.241+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8acc7c60 con 0x55ed8acc5170 2023-11-27T20:45:13.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.241+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8ac87b30 con 0x55ed8acba200 2023-11-27T20:45:13.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.241+0000 7f51b6fbb740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed8acc6ab0 con 0x55ed8ac886b0 2023-11-27T20:45:13.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f51b6fbb740 10 client.0 _ll_register_callbacks cb 0x7f51a40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T20:45:13.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f51b29c3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc5170 0x55ed8ad2aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f51b29c3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc5170 0x55ed8ad2aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52174/0 (socket says 172.21.15.91:52174) 2023-11-27T20:45:13.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f51b29c3640 1 -- 172.21.15.91:0/3889612404 learned_addr learned my addr 172.21.15.91:0/3889612404 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:13.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f51b29c3640 1 -- 172.21.15.91:0/3889612404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8ac886b0 msgr2=0x55ed8acc0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f51b29c3640 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8ac886b0 0x55ed8acc0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f51b29c3640 1 -- 172.21.15.91:0/3889612404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acba200 msgr2=0x55ed8acc6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f51b29c3640 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acba200 0x55ed8acc6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f51b29c3640 1 -- 172.21.15.91:0/3889612404 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed8abb5860 con 0x55ed8acc5170 2023-11-27T20:45:13.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f51b29c3640 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc5170 0x55ed8ad2aab0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009fd0 tx=0x7f51a4007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709cd9d150cee6d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:13.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.242+0000 7f518d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-11-27T20:45:13.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f518d7fa640 1 -- 172.21.15.91:0/3889612404 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400e050 con 0x55ed8acc5170 2023-11-27T20:45:13.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f518d7fa640 1 -- 172.21.15.91:0/3889612404 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51a4010bf0 con 0x55ed8acc5170 2023-11-27T20:45:13.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3889612404 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51a805fb10 con 0x55ed8acc5170 2023-11-27T20:45:13.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f518d7fa640 1 -- 172.21.15.91:0/3889612404 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51a4010db0 con 0x55ed8acc5170 2023-11-27T20:45:13.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f51b6fbb740 10 client.6675 fetch_fsmap learned FSMap version 46 2023-11-27T20:45:13.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3889612404 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55ed8abaf170 con 0x55ed8acc5170 2023-11-27T20:45:13.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f518d7fa640 1 -- 172.21.15.91:0/3889612404 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a805fb10 con 0x55ed8acc5170 2023-11-27T20:45:13.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f518d7fa640 1 -- 172.21.15.91:0/3889612404 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f51a4015440 con 0x55ed8acc5170 2023-11-27T20:45:13.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f51b6fbb740 10 client.6675 fetch_fsmap finished waiting for FSMap version 46 2023-11-27T20:45:13.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f51b6fbb740 10 client.6675 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T20:45:13.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f51b6fbb740 20 client.6675 populate_metadata read hostname 'smithi091' 2023-11-27T20:45:13.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.183:6833/2103536114,v1:172.21.15.183:6835/2103536114] conn(0x55ed8ad2d7a0 0x55ed8ad2db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f51b6fbb740 4 client.6675 mds_command: new command op to 6528 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T20:45:13.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.243+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3889612404 --> [v2:172.21.15.183:6833/2103536114,v1:172.21.15.183:6835/2103536114] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ed8a8ee6c0 con 0x55ed8ad2d7a0 2023-11-27T20:45:13.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.244+0000 7f51b21c2640 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.183:6833/2103536114,v1:172.21.15.183:6835/2103536114] conn(0x55ed8ad2d7a0 0x55ed8ad2db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.245+0000 7f51b21c2640 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.183:6833/2103536114,v1:172.21.15.183:6835/2103536114] conn(0x55ed8ad2d7a0 0x55ed8ad2db80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dc178193a633b0d server_cookie=c58e6aaa7bc36feb in_seq=0 out_seq=0 2023-11-27T20:45:13.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.245+0000 7f518d7fa640 10 client.6675 ms_handle_connect on v2:172.21.15.183:6833/2103536114 2023-11-27T20:45:13.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.245+0000 7f518d7fa640 1 -- 172.21.15.91:0/3889612404 <== mds.0 v2:172.21.15.183:6833/2103536114 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55ed8a8ee6c0 con 0x55ed8ad2d7a0 2023-11-27T20:45:13.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.245+0000 7f518d7fa640 10 client.6675 handle_command_reply: tid=0 2023-11-27T20:45:13.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.245+0000 7f51b6fbb740 1 client.6675 shutdown 2023-11-27T20:45:13.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3889612404 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc5170 msgr2=0x55ed8ad2aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc5170 0x55ed8ad2aab0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009fd0 tx=0x7f51a4007e40 comp rx=0 tx=0).stop 2023-11-27T20:45:13.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3889612404 shutdown_connections 2023-11-27T20:45:13.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.183:6833/2103536114,v1:172.21.15.183:6835/2103536114] conn(0x55ed8ad2d7a0 0x55ed8ad2db80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55ed8acc5170 0x55ed8ad2aab0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ed8acba200 0x55ed8acc6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 1 --2- 172.21.15.91:0/3889612404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55ed8ac886b0 0x55ed8acc0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f518d7fa640 0 client.6675 ms_handle_reset on v2:172.21.15.183:6833/2103536114 2023-11-27T20:45:13.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3889612404 >> 172.21.15.91:0/3889612404 conn(0x55ed8ac48c70 msgr2=0x55ed8acc8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:13.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3889612404 shutdown_connections 2023-11-27T20:45:13.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 1 -- 172.21.15.91:0/3889612404 wait complete. 2023-11-27T20:45:13.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b6fbb740 20 client.6675 trim_cache size 0 max 16384 2023-11-27T20:45:13.252 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:45:13.252 INFO:teuthology.orchestra.run.smithi091.stdout: "cluster_fsid": "76812701-65a9-4deb-87af-ef00110d1601", 2023-11-27T20:45:13.252 INFO:teuthology.orchestra.run.smithi091.stdout: "whoami": 0, 2023-11-27T20:45:13.253 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 6528, 2023-11-27T20:45:13.253 INFO:teuthology.orchestra.run.smithi091.stdout: "want_state": "up:active", 2023-11-27T20:45:13.253 INFO:teuthology.orchestra.run.smithi091.stdout: "state": "up:active", 2023-11-27T20:45:13.253 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs", 2023-11-27T20:45:13.253 INFO:teuthology.orchestra.run.smithi091.stdout: "rank_uptime": 6.6015158830000003, 2023-11-27T20:45:13.253 INFO:teuthology.orchestra.run.smithi091.stdout: "mdsmap_epoch": 46, 2023-11-27T20:45:13.253 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch": 75, 2023-11-27T20:45:13.253 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch_barrier": 75, 2023-11-27T20:45:13.253 INFO:teuthology.orchestra.run.smithi091.stdout: "uptime": 12.137726788 2023-11-27T20:45:13.253 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:45:13.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.246+0000 7f51b4426640 1 -- 172.21.15.91:0/957578147 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f519006b1c0 msgr2=0x7f519006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f519006b1c0 0x7f519006d680 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f519c036000 tx=0x7f519c03b040 comp rx=0 tx=0).stop 2023-11-27T20:45:13.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 -- 172.21.15.91:0/957578147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51ac06d0a0 msgr2=0x7f51ac154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51ac06d0a0 0x7f51ac154dd0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f51a800c400 tx=0x7f51a800c8c0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 -- 172.21.15.91:0/957578147 shutdown_connections 2023-11-27T20:45:13.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51ac14fd30 0x7f51ac0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f519006b1c0 0x7f519006d680 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51ac0c3ea0 0x7f51ac14f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 --2- 172.21.15.91:0/957578147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51ac06d0a0 0x7f51ac154dd0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 -- 172.21.15.91:0/957578147 >> 172.21.15.91:0/957578147 conn(0x7f51ac06a500 msgr2=0x7f51ac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:13.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 -- 172.21.15.91:0/957578147 shutdown_connections 2023-11-27T20:45:13.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.247+0000 7f51b4426640 1 -- 172.21.15.91:0/957578147 wait complete. 2023-11-27T20:45:13.263 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:45:13.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.456+0000 7efe6ffff640 1 Processor -- start 2023-11-27T20:45:13.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.456+0000 7efe6ffff640 1 -- start start 2023-11-27T20:45:13.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.457+0000 7efe6ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efe700c52e0 0x7efe7006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.457+0000 7efe6ffff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe700a8380 con 0x7efe7014e7f0 2023-11-27T20:45:13.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.457+0000 7efe6ffff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe701510b0 con 0x7efe7006cd20 2023-11-27T20:45:13.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.457+0000 7efe6ffff640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7006bf60 con 0x7efe700c52e0 2023-11-27T20:45:13.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6effd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7efe7014e7f0 0x7efe700c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:48950/0 (socket says 172.21.15.91:48950) 2023-11-27T20:45:13.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6effd640 1 -- 172.21.15.91:0/3270838772 learned_addr learned my addr 172.21.15.91:0/3270838772 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:13.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671330923 0 0) 0x7efe700a8380 con 0x7efe7014e7f0 2023-11-27T20:45:13.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe5c005730 con 0x7efe7014e7f0 2023-11-27T20:45:13.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe667fc640 1 --2- 172.21.15.91:0/3270838772 >> v2:172.21.15.183:3300/0 conn(0x7efe700c52e0 0x7efe7006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2629470060 0 0) 0x7efe5c005730 con 0x7efe7014e7f0 2023-11-27T20:45:13.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 >> v2:172.21.15.183:3300/0 conn(0x7efe700c52e0 msgr2=0x7efe7006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6e7fc640 1 --2- 172.21.15.91:0/3270838772 >> v2:172.21.15.183:3300/0 conn(0x7efe700c52e0 0x7efe7006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 >> v1:172.21.15.183:6789/0 conn(0x7efe7006cd20 legacy=0x7efe7015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7006c240 con 0x7efe7014e7f0 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7efe60001670 con 0x7efe7014e7f0 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.458+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 >> v1:172.21.15.91:6789/0 conn(0x7efe7014e7f0 legacy=0x7efe700c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe6e7fc640 1 --2- 172.21.15.91:0/3270838772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe5c005b80 0x7efe5c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe6e7fc640 1 --2- 172.21.15.91:0/3270838772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe5c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe6e7fc640 1 --2- 172.21.15.91:0/3270838772 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe5c0074b0 0x7efe5c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7006bf60 con 0x7efe5c0069d0 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c00e380 con 0x7efe5c005b80 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c00e540 con 0x7efe5c0074b0 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe667fc640 1 --2- 172.21.15.91:0/3270838772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe5c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe667fc640 1 -- 172.21.15.91:0/3270838772 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe5c0074b0 msgr2=0x7efe5c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe667fc640 1 --2- 172.21.15.91:0/3270838772 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe5c0074b0 0x7efe5c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe667fc640 1 -- 172.21.15.91:0/3270838772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe5c005b80 msgr2=0x7efe5c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:13.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe667fc640 1 --2- 172.21.15.91:0/3270838772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe5c005b80 0x7efe5c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe667fc640 1 -- 172.21.15.91:0/3270838772 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c005730 con 0x7efe5c0069d0 2023-11-27T20:45:13.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.459+0000 7efe6f7fe640 1 -- 172.21.15.91:0/3270838772 reap_dead start 2023-11-27T20:45:13.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.460+0000 7efe667fc640 1 --2- 172.21.15.91:0/3270838772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe5c006e50 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7efe5800ba00 tx=0x7efe5c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562f494f9c303e7b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:13.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.461+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58032620 con 0x7efe5c0069d0 2023-11-27T20:45:13.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.461+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58032780 con 0x7efe5c0069d0 2023-11-27T20:45:13.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.461+0000 7efe6e7fc640 1 -- 172.21.15.91:0/3270838772 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58032b10 con 0x7efe5c0069d0 2023-11-27T20:45:13.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.461+0000 7efe6ffff640 1 -- 172.21.15.91:0/3270838772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 msgr2=0x7efe5c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.461+0000 7efe6ffff640 1 --2- 172.21.15.91:0/3270838772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe5c006e50 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7efe5800ba00 tx=0x7efe5c007a00 comp rx=0 tx=0).stop 2023-11-27T20:45:13.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.461+0000 7efe6ffff640 1 -- 172.21.15.91:0/3270838772 shutdown_connections 2023-11-27T20:45:13.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.461+0000 7efe6ffff640 1 --2- 172.21.15.91:0/3270838772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe5c006e50 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.461+0000 7efe6ffff640 1 -- 172.21.15.91:0/3270838772 >> 172.21.15.91:0/3270838772 conn(0x7efe700a77f0 msgr2=0x7efe700a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:13.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.461+0000 7efe6ffff640 1 -- 172.21.15.91:0/3270838772 shutdown_connections 2023-11-27T20:45:13.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.461+0000 7efe6ffff640 1 -- 172.21.15.91:0/3270838772 wait complete. 2023-11-27T20:45:13.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.463+0000 7efe6ffff640 1 Processor -- start 2023-11-27T20:45:13.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.463+0000 7efe6ffff640 1 -- start start 2023-11-27T20:45:13.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.464+0000 7efe6ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe700c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.464+0000 7efe6ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe700abb20 0x7efe70145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.464+0000 7efe6ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe701ed6d0 0x7efe70146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.464+0000 7efe6ffff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe701eaef0 con 0x7efe5c0069d0 2023-11-27T20:45:13.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.464+0000 7efe6ffff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe70146550 con 0x7efe700abb20 2023-11-27T20:45:13.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.464+0000 7efe6ffff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe701ea270 con 0x7efe701ed6d0 2023-11-27T20:45:13.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe6effd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe700c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe6effd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe700c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:52196/0 (socket says 172.21.15.91:52196) 2023-11-27T20:45:13.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe6effd640 1 -- 172.21.15.91:0/1928979032 learned_addr learned my addr 172.21.15.91:0/1928979032 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:13.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe667fc640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe700abb20 0x7efe70145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe6effd640 1 -- 172.21.15.91:0/1928979032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe701ed6d0 msgr2=0x7efe70146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe6f7fe640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe701ed6d0 0x7efe70146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe6effd640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe701ed6d0 0x7efe70146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe6effd640 1 -- 172.21.15.91:0/1928979032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe700abb20 msgr2=0x7efe70145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe6effd640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe700abb20 0x7efe70145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe6effd640 1 -- 172.21.15.91:0/1928979032 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe701ea550 con 0x7efe5c0069d0 2023-11-27T20:45:13.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe667fc640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe700abb20 0x7efe70145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:13.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.465+0000 7efe6effd640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe700c48c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c700 tx=0x7efe6000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:13.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.466+0000 7efe67fff640 1 -- 172.21.15.91:0/1928979032 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe600074e0 con 0x7efe5c0069d0 2023-11-27T20:45:13.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.466+0000 7efe67fff640 1 -- 172.21.15.91:0/1928979032 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe60007660 con 0x7efe5c0069d0 2023-11-27T20:45:13.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.466+0000 7efe6ffff640 1 -- 172.21.15.91:0/1928979032 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe701ea830 con 0x7efe5c0069d0 2023-11-27T20:45:13.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.466+0000 7efe67fff640 1 -- 172.21.15.91:0/1928979032 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60004a20 con 0x7efe5c0069d0 2023-11-27T20:45:13.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.466+0000 7efe6ffff640 1 -- 172.21.15.91:0/1928979032 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe700c4e00 con 0x7efe5c0069d0 2023-11-27T20:45:13.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.467+0000 7efe6ffff640 1 -- 172.21.15.91:0/1928979032 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7004e840 con 0x7efe5c0069d0 2023-11-27T20:45:13.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.468+0000 7efe67fff640 1 -- 172.21.15.91:0/1928979032 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efe60004b80 con 0x7efe5c0069d0 2023-11-27T20:45:13.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.469+0000 7efe67fff640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe5006b1f0 0x7efe5006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:13.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.469+0000 7efe67fff640 1 -- 172.21.15.91:0/1928979032 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe60089170 con 0x7efe5c0069d0 2023-11-27T20:45:13.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.469+0000 7efe667fc640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe5006b1f0 0x7efe5006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:13.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.470+0000 7efe667fc640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe5006b1f0 0x7efe5006d6b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efe5c006950 tx=0x7efe5803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:13.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.473+0000 7efe67fff640 1 -- 172.21.15.91:0/1928979032 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efe60057920 con 0x7efe5c0069d0 2023-11-27T20:45:13.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.704+0000 7efe6ffff640 1 -- 172.21.15.91:0/1928979032 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efe7006fe40 con 0x7efe5c0069d0 2023-11-27T20:45:13.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.706+0000 7efe67fff640 1 -- 172.21.15.91:0/1928979032 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7efe60001bd0 con 0x7efe5c0069d0 2023-11-27T20:45:13.707 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:45:13.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 -- 172.21.15.91:0/1928979032 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe5006b1f0 msgr2=0x7efe5006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe5006b1f0 0x7efe5006d6b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efe5c006950 tx=0x7efe5803d040 comp rx=0 tx=0).stop 2023-11-27T20:45:13.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 -- 172.21.15.91:0/1928979032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 msgr2=0x7efe700c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:13.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe700c48c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c700 tx=0x7efe6000cbc0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 -- 172.21.15.91:0/1928979032 shutdown_connections 2023-11-27T20:45:13.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe701ed6d0 0x7efe70146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe5006b1f0 0x7efe5006d6b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe700abb20 0x7efe70145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 --2- 172.21.15.91:0/1928979032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe5c0069d0 0x7efe700c48c0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:13.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 -- 172.21.15.91:0/1928979032 >> 172.21.15.91:0/1928979032 conn(0x7efe700a77f0 msgr2=0x7efe7006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:13.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.709+0000 7efe6ffff640 1 -- 172.21.15.91:0/1928979032 shutdown_connections 2023-11-27T20:45:13.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:13.710+0000 7efe6ffff640 1 -- 172.21.15.91:0/1928979032 wait complete. 2023-11-27T20:45:13.730 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T20:45:13.730 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:45:13.730 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-27T20:45:13.730 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T20:45:13.730 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:13.730 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T20:45:13.730 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:45:13.730 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:45:13.731 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:45:13.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:13.731 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-27T20:45:13.777 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:45:13.777 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-27T20:45:13.778 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 42108sec preferred_lft 42108sec 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:45:13.779 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:13.780 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::c0c6:34ff:feb5:e67/64 scope link 2023-11-27T20:45:13.780 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:13.780 INFO:teuthology.orchestra.run.smithi091.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:45:13.780 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:45:13.780 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::d8e3:6ff:fe8b:3b7f/64 scope link 2023-11-27T20:45:13.780 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:13.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:13.781 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:45:13.909 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-27T20:45:13.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:13.914 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-27T20:45:13.972 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-27T20:45:13.972 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:45:13.972 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:45:13.972 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:45:13.972 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:45:13.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:13.973 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:45:13.973 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:45:13.973 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:45:13.973 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:45:13.973 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:45:13.973 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:45:14.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:14.161 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T20:45:14.211 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T20:45:14.212 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:45:14.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:14.213 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-11-27T20:45:14.313 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:45:14.313 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:14.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:45:14.363 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:14.415 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:45:14.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:14.416 DEBUG:teuthology.orchestra.run.smithi091:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:45:14.550 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:45:14.551 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:45:14.551 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:45:14.572 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:45:14.572 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:45:14.572 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:45:14.572 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:45:14.572 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:45:14.602 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T20:45:14.603 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T20:45:14.603 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:45:14.603 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:45:14.603 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:45:14.603 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:45:14.603 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:45:14.603 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:45:14.604 INFO:teuthology.orchestra.run.smithi091.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-27T20:45:14.605 INFO:teuthology.orchestra.run.smithi091.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:45:14.605 INFO:teuthology.orchestra.run.smithi091.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:45:14.605 INFO:teuthology.orchestra.run.smithi091.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:45:14.605 INFO:teuthology.orchestra.run.smithi091.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:45:14.608 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:45:14.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:14.609 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:14.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:14.692 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:45:14.771 INFO:teuthology.orchestra.run.smithi091.stdout:client4922 2023-11-27T20:45:14.771 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:14.771 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:14.827 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:45:15.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.032+0000 7fa123739640 1 Processor -- start 2023-11-27T20:45:15.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.032+0000 7fa123739640 1 -- start start 2023-11-27T20:45:15.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.034+0000 7fa123739640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa11c0c3340 0x7fa11c156540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:15.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.034+0000 7fa123739640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c0bfdc0 con 0x7fa11c0c5ec0 2023-11-27T20:45:15.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.034+0000 7fa123739640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c156a80 con 0x7fa11c0c45d0 2023-11-27T20:45:15.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.034+0000 7fa123739640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11c06e390 con 0x7fa11c0c3340 2023-11-27T20:45:15.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.034+0000 7fa1214d5640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa11c0c5ec0 0x7fa11c0c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55886/0 (socket says 172.21.15.91:55886) 2023-11-27T20:45:15.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.034+0000 7fa1214d5640 1 -- 172.21.15.91:0/1263806100 learned_addr learned my addr 172.21.15.91:0/1263806100 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:15.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa121cd6640 1 --2- 172.21.15.91:0/1263806100 >> v2:172.21.15.183:3300/0 conn(0x7fa11c0c3340 0x7fa11c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323095504 0 0) 0x7fa11c0bfdc0 con 0x7fa11c0c5ec0 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa108003520 con 0x7fa11c0c5ec0 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2221452376 0 0) 0x7fa108003520 con 0x7fa11c0c5ec0 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 >> v2:172.21.15.183:3300/0 conn(0x7fa11c0c3340 msgr2=0x7fa11c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 --2- 172.21.15.91:0/1263806100 >> v2:172.21.15.183:3300/0 conn(0x7fa11c0c3340 0x7fa11c156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 >> v1:172.21.15.183:6789/0 conn(0x7fa11c0c45d0 legacy=0x7fa11c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c06ddd0 con 0x7fa11c0c5ec0 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fa118001670 con 0x7fa11c0c5ec0 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 >> v1:172.21.15.91:6789/0 conn(0x7fa11c0c5ec0 legacy=0x7fa11c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa108003970 0x7fa108003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:15.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1080047c0 0x7fa108004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa108005380 0x7fa10800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c06e390 con 0x7fa1080047c0 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10800c210 con 0x7fa108005380 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.035+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10800c3d0 con 0x7fa108003970 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.036+0000 7fa120cd4640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1080047c0 0x7fa108004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.036+0000 7fa1214d5640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa108003970 0x7fa108003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.036+0000 7fa121cd6640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa108005380 0x7fa10800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.036+0000 7fa120cd4640 1 -- 172.21.15.91:0/1263806100 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa108003970 msgr2=0x7fa108003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.036+0000 7fa120cd4640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa108003970 0x7fa108003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.036+0000 7fa120cd4640 1 -- 172.21.15.91:0/1263806100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa108005380 msgr2=0x7fa10800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.036+0000 7fa120cd4640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa108005380 0x7fa10800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.036+0000 7fa121cd6640 1 -- 172.21.15.91:0/1263806100 reap_dead start 2023-11-27T20:45:15.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.036+0000 7fa120cd4640 1 -- 172.21.15.91:0/1263806100 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa108003520 con 0x7fa1080047c0 2023-11-27T20:45:15.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.037+0000 7fa120cd4640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1080047c0 0x7fa108004c40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa10c001720 tx=0x7fa1080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6812e034be315fac server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:15.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.038+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0052d0 con 0x7fa1080047c0 2023-11-27T20:45:15.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.038+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c02e050 con 0x7fa1080047c0 2023-11-27T20:45:15.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.038+0000 7fa113fff640 1 -- 172.21.15.91:0/1263806100 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c003830 con 0x7fa1080047c0 2023-11-27T20:45:15.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.038+0000 7fa123739640 1 -- 172.21.15.91:0/1263806100 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1080047c0 msgr2=0x7fa108004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:15.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.038+0000 7fa123739640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1080047c0 0x7fa108004c40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa10c001720 tx=0x7fa1080057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.038+0000 7fa123739640 1 -- 172.21.15.91:0/1263806100 shutdown_connections 2023-11-27T20:45:15.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.038+0000 7fa123739640 1 --2- 172.21.15.91:0/1263806100 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1080047c0 0x7fa108004c40 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.038+0000 7fa123739640 1 -- 172.21.15.91:0/1263806100 >> 172.21.15.91:0/1263806100 conn(0x7fa11c06a500 msgr2=0x7fa11c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:15.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.038+0000 7fa123739640 1 -- 172.21.15.91:0/1263806100 shutdown_connections 2023-11-27T20:45:15.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.038+0000 7fa123739640 1 -- 172.21.15.91:0/1263806100 wait complete. 2023-11-27T20:45:15.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.040+0000 7fa123739640 1 Processor -- start 2023-11-27T20:45:15.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.040+0000 7fa123739640 1 -- start start 2023-11-27T20:45:15.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.041+0000 7fa123739640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1080047c0 0x7fa11c0a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:15.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.041+0000 7fa123739640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11c14e1a0 0x7fa11c14ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:15.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.041+0000 7fa123739640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa11c14e6f0 0x7fa11c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:15.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.041+0000 7fa123739640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c0ab2b0 con 0x7fa11c14e6f0 2023-11-27T20:45:15.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.041+0000 7fa123739640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c0a6e70 con 0x7fa11c14e1a0 2023-11-27T20:45:15.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.041+0000 7fa123739640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c0aaa10 con 0x7fa1080047c0 2023-11-27T20:45:15.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.041+0000 7fa121cd6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa11c14e6f0 0x7fa11c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:15.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.041+0000 7fa121cd6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa11c14e6f0 0x7fa11c071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54892/0 (socket says 172.21.15.91:54892) 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.041+0000 7fa121cd6640 1 -- 172.21.15.91:0/1346349975 learned_addr learned my addr 172.21.15.91:0/1346349975 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa1214d5640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1080047c0 0x7fa11c0a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa120cd4640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11c14e1a0 0x7fa11c14ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa121cd6640 1 -- 172.21.15.91:0/1346349975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1080047c0 msgr2=0x7fa11c0a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa121cd6640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1080047c0 0x7fa11c0a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa121cd6640 1 -- 172.21.15.91:0/1346349975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11c14e1a0 msgr2=0x7fa11c14ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa121cd6640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11c14e1a0 0x7fa11c14ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa121cd6640 1 -- 172.21.15.91:0/1346349975 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c0aacf0 con 0x7fa11c14e6f0 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa120cd4640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11c14e1a0 0x7fa11c14ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa121cd6640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa11c14e6f0 0x7fa11c071190 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa11c06b200 tx=0x7fa114009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa111ffb640 1 -- 172.21.15.91:0/1346349975 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114007db0 con 0x7fa11c14e6f0 2023-11-27T20:45:15.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa111ffb640 1 -- 172.21.15.91:0/1346349975 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11400f050 con 0x7fa11c14e6f0 2023-11-27T20:45:15.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa123739640 1 -- 172.21.15.91:0/1346349975 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11c0aafd0 con 0x7fa11c14e6f0 2023-11-27T20:45:15.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa111ffb640 1 -- 172.21.15.91:0/1346349975 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114014650 con 0x7fa11c14e6f0 2023-11-27T20:45:15.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.042+0000 7fa123739640 1 -- 172.21.15.91:0/1346349975 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11c150500 con 0x7fa11c14e6f0 2023-11-27T20:45:15.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.044+0000 7fa123739640 1 -- 172.21.15.91:0/1346349975 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11c0a6650 con 0x7fa11c14e6f0 2023-11-27T20:45:15.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.044+0000 7fa111ffb640 1 -- 172.21.15.91:0/1346349975 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa1140147b0 con 0x7fa11c14e6f0 2023-11-27T20:45:15.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.046+0000 7fa111ffb640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa10006b1f0 0x7fa10006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:15.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.046+0000 7fa111ffb640 1 -- 172.21.15.91:0/1346349975 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa11408a130 con 0x7fa11c14e6f0 2023-11-27T20:45:15.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.046+0000 7fa1214d5640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa10006b1f0 0x7fa10006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:15.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.047+0000 7fa1214d5640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa10006b1f0 0x7fa10006d6b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa118001c90 tx=0x7fa118009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:15.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.050+0000 7fa111ffb640 1 -- 172.21.15.91:0/1346349975 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa11c0a6650 con 0x7fa11c14e6f0 2023-11-27T20:45:15.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.277+0000 7fa123739640 1 -- 172.21.15.91:0/1346349975 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa11c0a6650 con 0x7fa11c14e6f0 2023-11-27T20:45:15.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.277+0000 7fa111ffb640 1 -- 172.21.15.91:0/1346349975 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa11c0a6650 con 0x7fa11c14e6f0 2023-11-27T20:45:15.278 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:45:15.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.279+0000 7fa123739640 1 -- 172.21.15.91:0/1346349975 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa10006b1f0 msgr2=0x7fa10006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:15.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.279+0000 7fa123739640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa10006b1f0 0x7fa10006d6b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa118001c90 tx=0x7fa118009040 comp rx=0 tx=0).stop 2023-11-27T20:45:15.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.280+0000 7fa123739640 1 -- 172.21.15.91:0/1346349975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa11c14e6f0 msgr2=0x7fa11c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:15.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.280+0000 7fa123739640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa11c14e6f0 0x7fa11c071190 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa11c06b200 tx=0x7fa114009da0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.280+0000 7fa123739640 1 -- 172.21.15.91:0/1346349975 shutdown_connections 2023-11-27T20:45:15.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.280+0000 7fa123739640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa11c14e6f0 0x7fa11c071190 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.280+0000 7fa123739640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa10006b1f0 0x7fa10006d6b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.280+0000 7fa123739640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11c14e1a0 0x7fa11c14ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.280+0000 7fa123739640 1 --2- 172.21.15.91:0/1346349975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1080047c0 0x7fa11c0a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:15.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.280+0000 7fa123739640 1 -- 172.21.15.91:0/1346349975 >> 172.21.15.91:0/1346349975 conn(0x7fa11c06a500 msgr2=0x7fa11c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:15.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.280+0000 7fa123739640 1 -- 172.21.15.91:0/1346349975 shutdown_connections 2023-11-27T20:45:15.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:15.280+0000 7fa123739640 1 -- 172.21.15.91:0/1346349975 wait complete. 2023-11-27T20:45:15.298 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T20:45:15.298 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:45:15.298 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-27T20:45:15.298 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-27T20:45:15.299 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:15.299 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T20:45:15.299 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:45:15.299 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:45:15.299 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:45:15.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:15.299 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-27T20:45:15.359 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:45:15.359 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:15.360 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:15.361 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:45:15.361 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:15.361 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:45:15.361 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42143sec preferred_lft 42143sec 2023-11-27T20:45:15.361 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-27T20:45:15.361 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:15.361 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:45:15.361 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:15.361 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:45:15.361 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:15.362 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8479:57ff:fe06:e35b/64 scope link 2023-11-27T20:45:15.362 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:15.362 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:45:15.362 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T20:45:15.362 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::40e4:26ff:fe7f:e25/64 scope link 2023-11-27T20:45:15.362 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:15.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:15.363 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:45:15.453 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-27T20:45:15.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:15.457 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-27T20:45:15.510 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-27T20:45:15.510 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:45:15.510 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:45:15.510 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:45:15.510 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:45:15.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:15.511 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:45:15.511 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:45:15.511 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:45:15.511 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:45:15.511 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:45:15.511 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:45:15.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:15.694 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-27T20:45:15.745 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-27T20:45:15.745 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:45:15.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:15.745 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-11-27T20:45:15.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:45:15.838 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:15.893 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:45:15.893 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:45:15.893 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:15.947 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:45:15.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:15.947 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:45:16.085 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:45:16.085 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:45:16.085 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:45:16.106 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:45:16.106 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:45:16.107 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:45:16.107 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:45:16.107 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:45:16.133 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-27T20:45:16.134 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-27T20:45:16.135 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:45:16.136 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:45:16.137 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:45:16.137 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:45:16.137 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:45:16.137 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:45:16.138 INFO:teuthology.orchestra.run.smithi183.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-27T20:45:16.138 INFO:teuthology.orchestra.run.smithi183.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:45:16.139 INFO:teuthology.orchestra.run.smithi183.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:45:16.139 INFO:teuthology.orchestra.run.smithi183.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:45:16.139 INFO:teuthology.orchestra.run.smithi183.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:45:16.139 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:45:16.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:16.139 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:16.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:16.216 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:45:16.266 INFO:teuthology.orchestra.run.smithi183.stdout:client6690 2023-11-27T20:45:16.266 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:16.266 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:16.312 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-27T20:45:16.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.535+0000 7f198a9ce640 1 Processor -- start 2023-11-27T20:45:16.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.535+0000 7f198a9ce640 1 -- start start 2023-11-27T20:45:16.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.536+0000 7f198a9ce640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19840a9b40 0x7f19840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:16.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.537+0000 7f198a9ce640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840c06c0 con 0x7f19840c1500 2023-11-27T20:45:16.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.537+0000 7f198a9ce640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840c1020 con 0x7f1984155490 2023-11-27T20:45:16.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.537+0000 7f198a9ce640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19840a5820 con 0x7f19840a9b40 2023-11-27T20:45:16.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.537+0000 7f19837fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19840a9b40 0x7f19840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:16.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.537+0000 7f1988f6b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f19840c1500 0x7f19840c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55898/0 (socket says 172.21.15.91:55898) 2023-11-27T20:45:16.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.537+0000 7f19837fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19840a9b40 0x7f19840a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54898/0 (socket says 172.21.15.91:54898) 2023-11-27T20:45:16.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.537+0000 7f1988f6b640 1 -- 172.21.15.91:0/3065265367 learned_addr learned my addr 172.21.15.91:0/3065265367 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:16.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.537+0000 7f19837fe640 1 -- 172.21.15.91:0/3065265367 >> v1:172.21.15.183:6789/0 conn(0x7f1984155490 legacy=0x7f19840a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:16.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.537+0000 7f19837fe640 1 -- 172.21.15.91:0/3065265367 >> v1:172.21.15.91:6789/0 conn(0x7f19840c1500 legacy=0x7f19840c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:16.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.537+0000 7f19837fe640 1 -- 172.21.15.91:0/3065265367 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840c0910 con 0x7f19840a9b40 2023-11-27T20:45:16.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.538+0000 7f19837fe640 1 --2- 172.21.15.91:0/3065265367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19840a9b40 0x7f19840a51b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f19780097a0 tx=0x7f197802dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd83674fa610fd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:16.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.539+0000 7f1982ffd640 1 -- 172.21.15.91:0/3065265367 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197802f8a0 con 0x7f19840a9b40 2023-11-27T20:45:16.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.539+0000 7f1982ffd640 1 -- 172.21.15.91:0/3065265367 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197802fa00 con 0x7f19840a9b40 2023-11-27T20:45:16.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.539+0000 7f1982ffd640 1 -- 172.21.15.91:0/3065265367 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197802fd90 con 0x7f19840a9b40 2023-11-27T20:45:16.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.539+0000 7f198a9ce640 1 -- 172.21.15.91:0/3065265367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19840a9b40 msgr2=0x7f19840a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:16.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.539+0000 7f198a9ce640 1 --2- 172.21.15.91:0/3065265367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19840a9b40 0x7f19840a51b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f19780097a0 tx=0x7f197802dae0 comp rx=0 tx=0).stop 2023-11-27T20:45:16.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.539+0000 7f198a9ce640 1 -- 172.21.15.91:0/3065265367 shutdown_connections 2023-11-27T20:45:16.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.539+0000 7f198a9ce640 1 --2- 172.21.15.91:0/3065265367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19840a9b40 0x7f19840a51b0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:16.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.539+0000 7f198a9ce640 1 -- 172.21.15.91:0/3065265367 >> 172.21.15.91:0/3065265367 conn(0x7f198406a500 msgr2=0x7f198406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:16.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.540+0000 7f198a9ce640 1 -- 172.21.15.91:0/3065265367 shutdown_connections 2023-11-27T20:45:16.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.540+0000 7f198a9ce640 1 -- 172.21.15.91:0/3065265367 wait complete. 2023-11-27T20:45:16.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.541+0000 7f198a9ce640 1 Processor -- start 2023-11-27T20:45:16.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.541+0000 7f198a9ce640 1 -- start start 2023-11-27T20:45:16.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.542+0000 7f198a9ce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19840c1500 0x7f198414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:16.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.542+0000 7f198a9ce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1984155490 0x7f1984149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:16.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.542+0000 7f198a9ce640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198414a780 0x7f19841499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:16.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.542+0000 7f198a9ce640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1984149ee0 con 0x7f198414a780 2023-11-27T20:45:16.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.542+0000 7f198a9ce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198414b950 con 0x7f19840c1500 2023-11-27T20:45:16.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.542+0000 7f198a9ce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198414b0e0 con 0x7f1984155490 2023-11-27T20:45:16.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.542+0000 7f1988f6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198414a780 0x7f19841499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:16.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f1988f6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198414a780 0x7f19841499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54900/0 (socket says 172.21.15.91:54900) 2023-11-27T20:45:16.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f1988f6b640 1 -- 172.21.15.91:0/1480171464 learned_addr learned my addr 172.21.15.91:0/1480171464 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f1983fff640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19840c1500 0x7f198414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f19837fe640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1984155490 0x7f1984149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f1988f6b640 1 -- 172.21.15.91:0/1480171464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1984155490 msgr2=0x7f1984149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f1988f6b640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1984155490 0x7f1984149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f1988f6b640 1 -- 172.21.15.91:0/1480171464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19840c1500 msgr2=0x7f198414cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f1988f6b640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19840c1500 0x7f198414cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f1988f6b640 1 -- 172.21.15.91:0/1480171464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1978009400 con 0x7f198414a780 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f19837fe640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1984155490 0x7f1984149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f1988f6b640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198414a780 0x7f19841499a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f197c00cbc0 tx=0x7f197c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.543+0000 7f1980ff9640 1 -- 172.21.15.91:0/1480171464 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00ad40 con 0x7f198414a780 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.544+0000 7f1980ff9640 1 -- 172.21.15.91:0/1480171464 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c012400 con 0x7f198414a780 2023-11-27T20:45:16.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.544+0000 7f198a9ce640 1 -- 172.21.15.91:0/1480171464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198414b570 con 0x7f198414a780 2023-11-27T20:45:16.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.544+0000 7f1980ff9640 1 -- 172.21.15.91:0/1480171464 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00aea0 con 0x7f198414a780 2023-11-27T20:45:16.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.544+0000 7f198a9ce640 1 -- 172.21.15.91:0/1480171464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19840a5340 con 0x7f198414a780 2023-11-27T20:45:16.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.545+0000 7f198a9ce640 1 -- 172.21.15.91:0/1480171464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198414b250 con 0x7f198414a780 2023-11-27T20:45:16.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.546+0000 7f1980ff9640 1 -- 172.21.15.91:0/1480171464 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f197c007070 con 0x7f198414a780 2023-11-27T20:45:16.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.547+0000 7f1980ff9640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197006b1c0 0x7f197006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:16.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.547+0000 7f1980ff9640 1 -- 172.21.15.91:0/1480171464 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f197c0897f0 con 0x7f198414a780 2023-11-27T20:45:16.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.547+0000 7f1983fff640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197006b1c0 0x7f197006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:16.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.548+0000 7f1983fff640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197006b1c0 0x7f197006d680 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1974006fd0 tx=0x7f1974008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:16.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.551+0000 7f1980ff9640 1 -- 172.21.15.91:0/1480171464 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f197c054660 con 0x7f198414a780 2023-11-27T20:45:16.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.808+0000 7f198a9ce640 1 -- 172.21.15.91:0/1480171464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f1984072140 con 0x7f198414a780 2023-11-27T20:45:16.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.809+0000 7f1980ff9640 1 -- 172.21.15.91:0/1480171464 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v23) v1 ==== 84+0+0 (secure 0 0 0) 0x7f197c017020 con 0x7f198414a780 2023-11-27T20:45:16.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 -- 172.21.15.91:0/1480171464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197006b1c0 msgr2=0x7f197006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:16.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197006b1c0 0x7f197006d680 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1974006fd0 tx=0x7f1974008040 comp rx=0 tx=0).stop 2023-11-27T20:45:16.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 -- 172.21.15.91:0/1480171464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198414a780 msgr2=0x7f19841499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:16.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198414a780 0x7f19841499a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f197c00cbc0 tx=0x7f197c00a430 comp rx=0 tx=0).stop 2023-11-27T20:45:16.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 -- 172.21.15.91:0/1480171464 shutdown_connections 2023-11-27T20:45:16.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198414a780 0x7f19841499a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:16.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1984155490 0x7f1984149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:16.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197006b1c0 0x7f197006d680 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:16.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 --2- 172.21.15.91:0/1480171464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19840c1500 0x7f198414cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:16.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 -- 172.21.15.91:0/1480171464 >> 172.21.15.91:0/1480171464 conn(0x7f198406a500 msgr2=0x7f19840a9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:16.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 -- 172.21.15.91:0/1480171464 shutdown_connections 2023-11-27T20:45:16.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:16.812+0000 7f198a9ce640 1 -- 172.21.15.91:0/1480171464 wait complete. 2023-11-27T20:45:16.831 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:17.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.028+0000 7fe5f759e640 1 Processor -- start 2023-11-27T20:45:17.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.028+0000 7fe5f759e640 1 -- start start 2023-11-27T20:45:17.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.029+0000 7fe5f759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 0x7fe5f80c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.029+0000 7fe5f759e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe5f806cd20 0x7fe5f815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.029+0000 7fe5f759e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f80a8380 con 0x7fe5f80c52e0 2023-11-27T20:45:17.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.029+0000 7fe5f759e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f81510b0 con 0x7fe5f806cd20 2023-11-27T20:45:17.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.029+0000 7fe5f759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f806bf60 con 0x7fe5f814e7f0 2023-11-27T20:45:17.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.030+0000 7fe5f659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 0x7fe5f80c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.030+0000 7fe5f659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 0x7fe5f80c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:51808/0 (socket says 172.21.15.91:51808) 2023-11-27T20:45:17.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.030+0000 7fe5f659c640 1 -- 172.21.15.91:0/81506707 learned_addr learned my addr 172.21.15.91:0/81506707 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:17.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.030+0000 7fe5f6d9d640 1 --2- 172.21.15.91:0/81506707 >> v2:172.21.15.183:3300/0 conn(0x7fe5f806cd20 0x7fe5f815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.031+0000 7fe5f659c640 1 -- 172.21.15.91:0/81506707 >> v2:172.21.15.183:3300/0 conn(0x7fe5f806cd20 msgr2=0x7fe5f815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:17.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.031+0000 7fe5f659c640 1 --2- 172.21.15.91:0/81506707 >> v2:172.21.15.183:3300/0 conn(0x7fe5f806cd20 0x7fe5f815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.031+0000 7fe5f659c640 1 -- 172.21.15.91:0/81506707 >> v1:172.21.15.183:6789/0 conn(0x7fe5f80c52e0 legacy=0x7fe5f806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.031+0000 7fe5f659c640 1 -- 172.21.15.91:0/81506707 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f806c240 con 0x7fe5f814e7f0 2023-11-27T20:45:17.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.032+0000 7fe5f659c640 1 --2- 172.21.15.91:0/81506707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 0x7fe5f80c0440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009870 tx=0x7fe5e802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=735a3ace042e281d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:17.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f5d9b640 1 -- 172.21.15.91:0/81506707 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8031640 con 0x7fe5f814e7f0 2023-11-27T20:45:17.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f5d9b640 1 -- 172.21.15.91:0/81506707 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e80317a0 con 0x7fe5f814e7f0 2023-11-27T20:45:17.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f5d9b640 1 -- 172.21.15.91:0/81506707 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8031b30 con 0x7fe5f814e7f0 2023-11-27T20:45:17.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f759e640 1 -- 172.21.15.91:0/81506707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 msgr2=0x7fe5f80c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f759e640 1 --2- 172.21.15.91:0/81506707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 0x7fe5f80c0440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009870 tx=0x7fe5e802b8f0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f759e640 1 -- 172.21.15.91:0/81506707 shutdown_connections 2023-11-27T20:45:17.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f759e640 1 --2- 172.21.15.91:0/81506707 >> v2:172.21.15.183:3300/0 conn(0x7fe5f806cd20 0x7fe5f815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f759e640 1 --2- 172.21.15.91:0/81506707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 0x7fe5f80c0440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f759e640 1 -- 172.21.15.91:0/81506707 >> 172.21.15.91:0/81506707 conn(0x7fe5f80a77f0 msgr2=0x7fe5f80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:17.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f759e640 1 -- 172.21.15.91:0/81506707 shutdown_connections 2023-11-27T20:45:17.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.033+0000 7fe5f759e640 1 -- 172.21.15.91:0/81506707 wait complete. 2023-11-27T20:45:17.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.035+0000 7fe5f759e640 1 Processor -- start 2023-11-27T20:45:17.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.035+0000 7fe5f759e640 1 -- start start 2023-11-27T20:45:17.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.036+0000 7fe5f759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5f806cd20 0x7fe5f81ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.036+0000 7fe5f759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f80c52e0 0x7fe5f8149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.036+0000 7fe5f759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 0x7fe5f814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.036+0000 7fe5f759e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f814f250 con 0x7fe5f806cd20 2023-11-27T20:45:17.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.036+0000 7fe5f759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f814ef20 con 0x7fe5f80c52e0 2023-11-27T20:45:17.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.036+0000 7fe5f759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8152480 con 0x7fe5f814e7f0 2023-11-27T20:45:17.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.036+0000 7fe5f659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5f806cd20 0x7fe5f81ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.036+0000 7fe5f659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5f806cd20 0x7fe5f81ecf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54906/0 (socket says 172.21.15.91:54906) 2023-11-27T20:45:17.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.036+0000 7fe5f659c640 1 -- 172.21.15.91:0/695887737 learned_addr learned my addr 172.21.15.91:0/695887737 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:17.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5edd9b640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f80c52e0 0x7fe5f8149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5f6d9d640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 0x7fe5f814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5f659c640 1 -- 172.21.15.91:0/695887737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 msgr2=0x7fe5f814f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5f659c640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 0x7fe5f814f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5f659c640 1 -- 172.21.15.91:0/695887737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f80c52e0 msgr2=0x7fe5f8149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5f659c640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f80c52e0 0x7fe5f8149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5f659c640 1 -- 172.21.15.91:0/695887737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e80094d0 con 0x7fe5f806cd20 2023-11-27T20:45:17.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5edd9b640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f80c52e0 0x7fe5f8149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:17.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5f659c640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5f806cd20 0x7fe5f81ecf40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe5e802b930 tx=0x7fe5e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:17.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5ef7fe640 1 -- 172.21.15.91:0/695887737 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e803a930 con 0x7fe5f806cd20 2023-11-27T20:45:17.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5ef7fe640 1 -- 172.21.15.91:0/695887737 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e803aab0 con 0x7fe5f806cd20 2023-11-27T20:45:17.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5ef7fe640 1 -- 172.21.15.91:0/695887737 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e803ae60 con 0x7fe5f806cd20 2023-11-27T20:45:17.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5f759e640 1 -- 172.21.15.91:0/695887737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f8152760 con 0x7fe5f806cd20 2023-11-27T20:45:17.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.037+0000 7fe5f759e640 1 -- 172.21.15.91:0/695887737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f81ed480 con 0x7fe5f806cd20 2023-11-27T20:45:17.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.038+0000 7fe5f759e640 1 -- 172.21.15.91:0/695887737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f814f090 con 0x7fe5f806cd20 2023-11-27T20:45:17.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.039+0000 7fe5ef7fe640 1 -- 172.21.15.91:0/695887737 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe5e802f050 con 0x7fe5f806cd20 2023-11-27T20:45:17.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.040+0000 7fe5ef7fe640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe5d806b1f0 0x7fe5d806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.040+0000 7fe5ef7fe640 1 -- 172.21.15.91:0/695887737 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5e80ab870 con 0x7fe5f806cd20 2023-11-27T20:45:17.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.040+0000 7fe5edd9b640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe5d806b1f0 0x7fe5d806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.041+0000 7fe5edd9b640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe5d806b1f0 0x7fe5d806d6b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8151080 tx=0x7fe5e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:17.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.044+0000 7fe5ef7fe640 1 -- 172.21.15.91:0/695887737 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe5f814f090 con 0x7fe5f806cd20 2023-11-27T20:45:17.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.221+0000 7fe5f759e640 1 -- 172.21.15.91:0/695887737 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5f814f090 con 0x7fe5f806cd20 2023-11-27T20:45:17.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.224+0000 7fe5ef7fe640 1 -- 172.21.15.91:0/695887737 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16525 (secure 0 0 0) 0x7fe5f814f090 con 0x7fe5f806cd20 2023-11-27T20:45:17.225 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:17.225 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":75,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:07.238139+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:17.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.226+0000 7fe5f759e640 1 -- 172.21.15.91:0/695887737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe5d806b1f0 msgr2=0x7fe5d806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.226+0000 7fe5f759e640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe5d806b1f0 0x7fe5d806d6b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8151080 tx=0x7fe5e0009040 comp rx=0 tx=0).stop 2023-11-27T20:45:17.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.226+0000 7fe5f759e640 1 -- 172.21.15.91:0/695887737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5f806cd20 msgr2=0x7fe5f81ecf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.226+0000 7fe5f759e640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5f806cd20 0x7fe5f81ecf40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe5e802b930 tx=0x7fe5e80046c0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.227+0000 7fe5f759e640 1 -- 172.21.15.91:0/695887737 shutdown_connections 2023-11-27T20:45:17.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.227+0000 7fe5f759e640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814e7f0 0x7fe5f814f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.227+0000 7fe5f759e640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe5d806b1f0 0x7fe5d806d6b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.227+0000 7fe5f759e640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f80c52e0 0x7fe5f8149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.227+0000 7fe5f759e640 1 --2- 172.21.15.91:0/695887737 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5f806cd20 0x7fe5f81ecf40 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.227+0000 7fe5f759e640 1 -- 172.21.15.91:0/695887737 >> 172.21.15.91:0/695887737 conn(0x7fe5f80a77f0 msgr2=0x7fe5f80c17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:17.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.227+0000 7fe5f759e640 1 -- 172.21.15.91:0/695887737 shutdown_connections 2023-11-27T20:45:17.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.227+0000 7fe5f759e640 1 -- 172.21.15.91:0/695887737 wait complete. 2023-11-27T20:45:17.246 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:45:04.361620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:45:05.090674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:45:17.246 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:45:17.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.447+0000 7f3f59e6e640 1 Processor -- start 2023-11-27T20:45:17.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.447+0000 7f3f59e6e640 1 -- start start 2023-11-27T20:45:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.448+0000 7f3f59e6e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3f54155490 0x7f3f540a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.449+0000 7f3f59e6e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540c06c0 con 0x7f3f540a9b40 2023-11-27T20:45:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.449+0000 7f3f59e6e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540c1020 con 0x7f3f540c1500 2023-11-27T20:45:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.449+0000 7f3f59e6e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f540a5820 con 0x7f3f54155490 2023-11-27T20:45:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.449+0000 7f3f53fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f3f540a9b40 0x7f3f540c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55902/0 (socket says 172.21.15.91:55902) 2023-11-27T20:45:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.449+0000 7f3f53fff640 1 -- 172.21.15.91:0/2855267125 learned_addr learned my addr 172.21.15.91:0/2855267125 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.449+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789694821 0 0) 0x7f3f540c06c0 con 0x7f3f540a9b40 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.449+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f40005730 con 0x7f3f540a9b40 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f537fe640 1 --2- 172.21.15.91:0/2855267125 >> v2:172.21.15.183:3300/0 conn(0x7f3f54155490 0x7f3f540a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3474201115 0 0) 0x7f3f40005730 con 0x7f3f540a9b40 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 >> v2:172.21.15.183:3300/0 conn(0x7f3f54155490 msgr2=0x7f3f540a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 --2- 172.21.15.91:0/2855267125 >> v2:172.21.15.183:3300/0 conn(0x7f3f54155490 0x7f3f540a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 >> v1:172.21.15.183:6789/0 conn(0x7f3f540c1500 legacy=0x7f3f540a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f540c0910 con 0x7f3f540a9b40 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f3f4c0019f0 con 0x7f3f540a9b40 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 >> v1:172.21.15.91:6789/0 conn(0x7f3f540a9b40 legacy=0x7f3f540c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f40005b80 0x7f3f40005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f40006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f40007390 0x7f3f4000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4000e2b0 con 0x7f3f400069d0 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4000e420 con 0x7f3f40007390 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4000e5e0 con 0x7f3f40005b80 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.450+0000 7f3f4bfff640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f40006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.451+0000 7f3f537fe640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f40005b80 0x7f3f40005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.451+0000 7f3f4bfff640 1 -- 172.21.15.91:0/2855267125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f40005b80 msgr2=0x7f3f40005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.451+0000 7f3f4bfff640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f40005b80 0x7f3f40005fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.451+0000 7f3f4bfff640 1 -- 172.21.15.91:0/2855267125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f40007390 msgr2=0x7f3f4000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.451+0000 7f3f53fff640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f40007390 0x7f3f4000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.451+0000 7f3f4bfff640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f40007390 0x7f3f4000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.451+0000 7f3f4bfff640 1 -- 172.21.15.91:0/2855267125 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f40005730 con 0x7f3f400069d0 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.451+0000 7f3f53fff640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f40007390 0x7f3f4000db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.451+0000 7f3f53fff640 1 -- 172.21.15.91:0/2855267125 reap_dead start 2023-11-27T20:45:17.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.452+0000 7f3f4bfff640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f40006e50 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c001750 tx=0x7f3f40007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5269870fd29f95c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.452+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0052d0 con 0x7f3f400069d0 2023-11-27T20:45:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.452+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c02e050 con 0x7f3f400069d0 2023-11-27T20:45:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.452+0000 7f3f52ffd640 1 -- 172.21.15.91:0/2855267125 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c003830 con 0x7f3f400069d0 2023-11-27T20:45:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.453+0000 7f3f59e6e640 1 -- 172.21.15.91:0/2855267125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 msgr2=0x7f3f40006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.453+0000 7f3f59e6e640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f40006e50 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c001750 tx=0x7f3f40007a00 comp rx=0 tx=0).stop 2023-11-27T20:45:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.453+0000 7f3f59e6e640 1 -- 172.21.15.91:0/2855267125 shutdown_connections 2023-11-27T20:45:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.453+0000 7f3f59e6e640 1 --2- 172.21.15.91:0/2855267125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f40006e50 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.453+0000 7f3f59e6e640 1 -- 172.21.15.91:0/2855267125 >> 172.21.15.91:0/2855267125 conn(0x7f3f5406a500 msgr2=0x7f3f5406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.453+0000 7f3f59e6e640 1 -- 172.21.15.91:0/2855267125 shutdown_connections 2023-11-27T20:45:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.453+0000 7f3f59e6e640 1 -- 172.21.15.91:0/2855267125 wait complete. 2023-11-27T20:45:17.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.455+0000 7f3f59e6e640 1 Processor -- start 2023-11-27T20:45:17.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.455+0000 7f3f59e6e640 1 -- start start 2023-11-27T20:45:17.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f59e6e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f5409cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f59e6e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f541ea710 0x7f3f540bf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f59e6e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f54148f10 0x7f3f54149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f59e6e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f541498d0 con 0x7f3f400069d0 2023-11-27T20:45:17.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f59e6e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5409d1e0 con 0x7f3f541ea710 2023-11-27T20:45:17.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f59e6e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5409c590 con 0x7f3f54148f10 2023-11-27T20:45:17.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f537fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f5409cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f537fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f5409cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54930/0 (socket says 172.21.15.91:54930) 2023-11-27T20:45:17.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f537fe640 1 -- 172.21.15.91:0/576660115 learned_addr learned my addr 172.21.15.91:0/576660115 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:17.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f537fe640 1 -- 172.21.15.91:0/576660115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f54148f10 msgr2=0x7f3f54149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f537fe640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f54148f10 0x7f3f54149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f537fe640 1 -- 172.21.15.91:0/576660115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f541ea710 msgr2=0x7f3f540bf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f537fe640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f541ea710 0x7f3f540bf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.456+0000 7f3f537fe640 1 -- 172.21.15.91:0/576660115 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5409bcf0 con 0x7f3f400069d0 2023-11-27T20:45:17.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.457+0000 7f3f537fe640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f5409cca0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400e7e0 tx=0x7f3f4400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:17.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.457+0000 7f3f50ff9640 1 -- 172.21.15.91:0/576660115 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400c6d0 con 0x7f3f400069d0 2023-11-27T20:45:17.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.457+0000 7f3f50ff9640 1 -- 172.21.15.91:0/576660115 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400c830 con 0x7f3f400069d0 2023-11-27T20:45:17.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.457+0000 7f3f59e6e640 1 -- 172.21.15.91:0/576660115 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5409bfd0 con 0x7f3f400069d0 2023-11-27T20:45:17.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.457+0000 7f3f50ff9640 1 -- 172.21.15.91:0/576660115 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400cba0 con 0x7f3f400069d0 2023-11-27T20:45:17.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.457+0000 7f3f59e6e640 1 -- 172.21.15.91:0/576660115 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f541ed320 con 0x7f3f400069d0 2023-11-27T20:45:17.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.458+0000 7f3f59e6e640 1 -- 172.21.15.91:0/576660115 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f541ed4e0 con 0x7f3f400069d0 2023-11-27T20:45:17.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.459+0000 7f3f50ff9640 1 -- 172.21.15.91:0/576660115 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3f4400cd00 con 0x7f3f400069d0 2023-11-27T20:45:17.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.460+0000 7f3f50ff9640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3f3406b1f0 0x7f3f3406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.460+0000 7f3f50ff9640 1 -- 172.21.15.91:0/576660115 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f44089830 con 0x7f3f400069d0 2023-11-27T20:45:17.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.460+0000 7f3f4bfff640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3f3406b1f0 0x7f3f3406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.461+0000 7f3f4bfff640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3f3406b1f0 0x7f3f3406d6b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c033000 tx=0x7f3f3c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:17.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.464+0000 7f3f50ff9640 1 -- 172.21.15.91:0/576660115 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3f44054550 con 0x7f3f400069d0 2023-11-27T20:45:17.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.654+0000 7f3f59e6e640 1 -- 172.21.15.91:0/576660115 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f54068350 con 0x7f3f400069d0 2023-11-27T20:45:17.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.655+0000 7f3f50ff9640 1 -- 172.21.15.91:0/576660115 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f44057b70 con 0x7f3f400069d0 2023-11-27T20:45:17.655 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:45:17.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.657+0000 7f3f59e6e640 1 -- 172.21.15.91:0/576660115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3f3406b1f0 msgr2=0x7f3f3406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.657+0000 7f3f59e6e640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3f3406b1f0 0x7f3f3406d6b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c033000 tx=0x7f3f3c02f000 comp rx=0 tx=0).stop 2023-11-27T20:45:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.657+0000 7f3f59e6e640 1 -- 172.21.15.91:0/576660115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 msgr2=0x7f3f5409cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.657+0000 7f3f59e6e640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f5409cca0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400e7e0 tx=0x7f3f4400eca0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.658+0000 7f3f59e6e640 1 -- 172.21.15.91:0/576660115 shutdown_connections 2023-11-27T20:45:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.658+0000 7f3f59e6e640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f54148f10 0x7f3f54149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.658+0000 7f3f59e6e640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3f3406b1f0 0x7f3f3406d6b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.658+0000 7f3f59e6e640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f541ea710 0x7f3f540bf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.658+0000 7f3f59e6e640 1 --2- 172.21.15.91:0/576660115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3f400069d0 0x7f3f5409cca0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.658+0000 7f3f59e6e640 1 -- 172.21.15.91:0/576660115 >> 172.21.15.91:0/576660115 conn(0x7f3f5406a500 msgr2=0x7f3f54071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.658+0000 7f3f59e6e640 1 -- 172.21.15.91:0/576660115 shutdown_connections 2023-11-27T20:45:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.658+0000 7f3f59e6e640 1 -- 172.21.15.91:0/576660115 wait complete. 2023-11-27T20:45:17.678 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:45:17.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.895+0000 7f8e4bfff640 1 Processor -- start 2023-11-27T20:45:17.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.895+0000 7f8e4bfff640 1 -- start start 2023-11-27T20:45:17.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.896+0000 7f8e4bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8e4c14e7f0 0x7f8e4c0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.896+0000 7f8e4bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0a8380 con 0x7f8e4c06cd20 2023-11-27T20:45:17.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.896+0000 7f8e4bfff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c1510b0 con 0x7f8e4c0c52e0 2023-11-27T20:45:17.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.896+0000 7f8e4bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c06bf60 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.897+0000 7f8e4b7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8e4c06cd20 0x7f8e4c15ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55914/0 (socket says 172.21.15.91:55914) 2023-11-27T20:45:17.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.897+0000 7f8e4b7fe640 1 -- 172.21.15.91:0/1442645249 learned_addr learned my addr 172.21.15.91:0/1442645249 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.897+0000 7f8e4affd640 1 --2- 172.21.15.91:0/1442645249 >> v2:172.21.15.91:3300/0 conn(0x7f8e4c14e7f0 0x7f8e4c0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.897+0000 7f8e4a7fc640 1 -- 172.21.15.91:0/1442645249 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934238799 0 0) 0x7f8e4c0a8380 con 0x7f8e4c06cd20 2023-11-27T20:45:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.897+0000 7f8e4a7fc640 1 -- 172.21.15.91:0/1442645249 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e38003520 con 0x7f8e4c06cd20 2023-11-27T20:45:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.897+0000 7f8e4affd640 1 -- 172.21.15.91:0/1442645249 >> v1:172.21.15.183:6789/0 conn(0x7f8e4c0c52e0 legacy=0x7f8e4c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.897+0000 7f8e4affd640 1 -- 172.21.15.91:0/1442645249 >> v1:172.21.15.91:6789/0 conn(0x7f8e4c06cd20 legacy=0x7f8e4c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.897+0000 7f8e4affd640 1 -- 172.21.15.91:0/1442645249 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c06c240 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.898+0000 7f8e4affd640 1 --2- 172.21.15.91:0/1442645249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 0x7f8e4c0c0440 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0097a0 tx=0x7f8e3c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec332988753bc18 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.899+0000 7f8e4a7fc640 1 -- 172.21.15.91:0/1442645249 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c031830 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.899+0000 7f8e4a7fc640 1 -- 172.21.15.91:0/1442645249 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c031990 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.899+0000 7f8e4a7fc640 1 -- 172.21.15.91:0/1442645249 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c031d20 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.899+0000 7f8e4bfff640 1 -- 172.21.15.91:0/1442645249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 msgr2=0x7f8e4c0c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.899+0000 7f8e4bfff640 1 --2- 172.21.15.91:0/1442645249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 0x7f8e4c0c0440 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0097a0 tx=0x7f8e3c02b8d0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.899+0000 7f8e4bfff640 1 -- 172.21.15.91:0/1442645249 shutdown_connections 2023-11-27T20:45:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.899+0000 7f8e4bfff640 1 --2- 172.21.15.91:0/1442645249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 0x7f8e4c0c0440 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.899+0000 7f8e4bfff640 1 -- 172.21.15.91:0/1442645249 >> 172.21.15.91:0/1442645249 conn(0x7f8e4c0a77f0 msgr2=0x7f8e4c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.899+0000 7f8e4bfff640 1 -- 172.21.15.91:0/1442645249 shutdown_connections 2023-11-27T20:45:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.899+0000 7f8e4bfff640 1 -- 172.21.15.91:0/1442645249 wait complete. 2023-11-27T20:45:17.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.901+0000 7f8e4bfff640 1 Processor -- start 2023-11-27T20:45:17.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.901+0000 7f8e4bfff640 1 -- start start 2023-11-27T20:45:17.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.902+0000 7f8e4bfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e4c06cd20 0x7f8e4c1ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.902+0000 7f8e4bfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e4c0c52e0 0x7f8e4c1edd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.902+0000 7f8e4bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 0x7f8e4c149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.902+0000 7f8e4bfff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c15d4a0 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.902+0000 7f8e4bfff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c15dca0 con 0x7f8e4c0c52e0 2023-11-27T20:45:17.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.902+0000 7f8e4bfff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c15d150 con 0x7f8e4c06cd20 2023-11-27T20:45:17.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.902+0000 7f8e4b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 0x7f8e4c149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.902+0000 7f8e4b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 0x7f8e4c149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54948/0 (socket says 172.21.15.91:54948) 2023-11-27T20:45:17.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.902+0000 7f8e4b7fe640 1 -- 172.21.15.91:0/3591813068 learned_addr learned my addr 172.21.15.91:0/3591813068 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:17.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e43fff640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e4c0c52e0 0x7f8e4c1edd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e4affd640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e4c06cd20 0x7f8e4c1ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e4b7fe640 1 -- 172.21.15.91:0/3591813068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e4c06cd20 msgr2=0x7f8e4c1ed7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e4b7fe640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e4c06cd20 0x7f8e4c1ed7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e4b7fe640 1 -- 172.21.15.91:0/3591813068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e4c0c52e0 msgr2=0x7f8e4c1edd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:17.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e4b7fe640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e4c0c52e0 0x7f8e4c1edd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:17.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e4b7fe640 1 -- 172.21.15.91:0/3591813068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c009400 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e4b7fe640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 0x7f8e4c149530 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400cb00 tx=0x7f8e4400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:17.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e437fe640 1 -- 172.21.15.91:0/3591813068 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400aca0 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e437fe640 1 -- 172.21.15.91:0/3591813068 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4400ae00 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e4bfff640 1 -- 172.21.15.91:0/3591813068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c15d9e0 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.903+0000 7f8e437fe640 1 -- 172.21.15.91:0/3591813068 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44012620 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.904+0000 7f8e4bfff640 1 -- 172.21.15.91:0/3591813068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c066a00 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.905+0000 7f8e4bfff640 1 -- 172.21.15.91:0/3591813068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c15d5e0 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.906+0000 7f8e437fe640 1 -- 172.21.15.91:0/3591813068 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8e44007070 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.906+0000 7f8e437fe640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e2c06b1c0 0x7f8e2c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:17.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.907+0000 7f8e437fe640 1 -- 172.21.15.91:0/3591813068 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e44089930 con 0x7f8e4c14e7f0 2023-11-27T20:45:17.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.907+0000 7f8e4affd640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e2c06b1c0 0x7f8e2c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:17.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.907+0000 7f8e4affd640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e2c06b1c0 0x7f8e2c06d680 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c036000 tx=0x7f8e3c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:17.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:17.911+0000 7f8e437fe640 1 -- 172.21.15.91:0/3591813068 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8e4c15d5e0 con 0x7f8e4c14e7f0 2023-11-27T20:45:18.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.098+0000 7f8e4bfff640 1 -- 172.21.15.91:0/3591813068 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e4c15d5e0 con 0x7f8e4c14e7f0 2023-11-27T20:45:18.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.099+0000 7f8e437fe640 1 -- 172.21.15.91:0/3591813068 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e4c15d5e0 con 0x7f8e4c14e7f0 2023-11-27T20:45:18.099 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:18.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.101+0000 7f8e4bfff640 1 -- 172.21.15.91:0/3591813068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e2c06b1c0 msgr2=0x7f8e2c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.101+0000 7f8e4bfff640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e2c06b1c0 0x7f8e2c06d680 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c036000 tx=0x7f8e3c008030 comp rx=0 tx=0).stop 2023-11-27T20:45:18.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.101+0000 7f8e4bfff640 1 -- 172.21.15.91:0/3591813068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 msgr2=0x7f8e4c149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.101+0000 7f8e4bfff640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 0x7f8e4c149530 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400cb00 tx=0x7f8e4400a060 comp rx=0 tx=0).stop 2023-11-27T20:45:18.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.101+0000 7f8e4bfff640 1 -- 172.21.15.91:0/3591813068 shutdown_connections 2023-11-27T20:45:18.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.101+0000 7f8e4bfff640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e4c14e7f0 0x7f8e4c149530 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.101+0000 7f8e4bfff640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e2c06b1c0 0x7f8e2c06d680 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.101+0000 7f8e4bfff640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e4c0c52e0 0x7f8e4c1edd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.101+0000 7f8e4bfff640 1 --2- 172.21.15.91:0/3591813068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e4c06cd20 0x7f8e4c1ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.101+0000 7f8e4bfff640 1 -- 172.21.15.91:0/3591813068 >> 172.21.15.91:0/3591813068 conn(0x7f8e4c0a77f0 msgr2=0x7f8e4c0c0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:18.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.102+0000 7f8e4bfff640 1 -- 172.21.15.91:0/3591813068 shutdown_connections 2023-11-27T20:45:18.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.102+0000 7f8e4bfff640 1 -- 172.21.15.91:0/3591813068 wait complete. 2023-11-27T20:45:18.118 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:45:18.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.333+0000 7f3706cbb640 1 Processor -- start 2023-11-27T20:45:18.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.333+0000 7f3706cbb640 1 -- start start 2023-11-27T20:45:18.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.334+0000 7f3706cbb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700155490 0x7f37000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.334+0000 7f3706cbb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f37000a9b40 0x7f37000c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.334+0000 7f3706cbb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37000c06c0 con 0x7f37000c1500 2023-11-27T20:45:18.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.334+0000 7f3706cbb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37000a5820 con 0x7f37000a9b40 2023-11-27T20:45:18.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.334+0000 7f3706cbb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37000c1020 con 0x7f3700155490 2023-11-27T20:45:18.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.334+0000 7f36fffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f37000c1500 0x7f37000a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55930/0 (socket says 172.21.15.91:55930) 2023-11-27T20:45:18.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.334+0000 7f36fffff640 1 -- 172.21.15.91:0/4100470483 learned_addr learned my addr 172.21.15.91:0/4100470483 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:18.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f3705258640 1 --2- 172.21.15.91:0/4100470483 >> v2:172.21.15.183:3300/0 conn(0x7f37000a9b40 0x7f37000c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f3704a57640 1 --2- 172.21.15.91:0/4100470483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700155490 0x7f37000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126082202 0 0) 0x7f37000c06c0 con 0x7f37000c1500 2023-11-27T20:45:18.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f0003520 con 0x7f37000c1500 2023-11-27T20:45:18.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 758656709 0 0) 0x7f36f0003520 con 0x7f37000c1500 2023-11-27T20:45:18.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700155490 msgr2=0x7f37000a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:18.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 --2- 172.21.15.91:0/4100470483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700155490 0x7f37000a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 >> v2:172.21.15.183:3300/0 conn(0x7f37000a9b40 msgr2=0x7f37000c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:18.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 --2- 172.21.15.91:0/4100470483 >> v2:172.21.15.183:3300/0 conn(0x7f37000a9b40 0x7f37000c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37000c0910 con 0x7f37000c1500 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f36ec001670 con 0x7f37000c1500 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 >> v1:172.21.15.91:6789/0 conn(0x7f37000c1500 legacy=0x7f37000a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 --2- 172.21.15.91:0/4100470483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f0003970 0x7f36f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 --2- 172.21.15.91:0/4100470483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700155490 0x7f36f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.335+0000 7f36ff7fe640 1 --2- 172.21.15.91:0/4100470483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36f0004d00 0x7f36f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.336+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37000c1020 con 0x7f36f0004d00 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.336+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f000b980 con 0x7f36f0003970 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.336+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f000bac0 con 0x7f3700155490 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.336+0000 7f3705258640 1 --2- 172.21.15.91:0/4100470483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36f0004d00 0x7f36f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.336+0000 7f3705258640 1 -- 172.21.15.91:0/4100470483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700155490 msgr2=0x7f36f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.336+0000 7f3705258640 1 --2- 172.21.15.91:0/4100470483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700155490 0x7f36f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.336+0000 7f3705258640 1 -- 172.21.15.91:0/4100470483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f0003970 msgr2=0x7f36f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:18.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.336+0000 7f3705258640 1 --2- 172.21.15.91:0/4100470483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f0003970 0x7f36f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.336+0000 7f3705258640 1 -- 172.21.15.91:0/4100470483 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0003520 con 0x7f36f0004d00 2023-11-27T20:45:18.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.337+0000 7f3705258640 1 --2- 172.21.15.91:0/4100470483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36f0004d00 0x7f36f0005180 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f3700072ad0 tx=0x7f36f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68930cd77a40c54 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:18.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.338+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f802cbd0 con 0x7f36f0004d00 2023-11-27T20:45:18.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.338+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f800f040 con 0x7f36f0004d00 2023-11-27T20:45:18.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.338+0000 7f36ff7fe640 1 -- 172.21.15.91:0/4100470483 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8034440 con 0x7f36f0004d00 2023-11-27T20:45:18.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.338+0000 7f3706cbb640 1 -- 172.21.15.91:0/4100470483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36f0004d00 msgr2=0x7f36f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.338+0000 7f3706cbb640 1 --2- 172.21.15.91:0/4100470483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36f0004d00 0x7f36f0005180 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f3700072ad0 tx=0x7f36f00057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.338+0000 7f3705258640 1 -- 172.21.15.91:0/4100470483 reap_dead start 2023-11-27T20:45:18.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.338+0000 7f3706cbb640 1 -- 172.21.15.91:0/4100470483 shutdown_connections 2023-11-27T20:45:18.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.338+0000 7f3706cbb640 1 -- 172.21.15.91:0/4100470483 >> 172.21.15.91:0/4100470483 conn(0x7f370006a500 msgr2=0x7f370006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:18.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.338+0000 7f3706cbb640 1 -- 172.21.15.91:0/4100470483 shutdown_connections 2023-11-27T20:45:18.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.338+0000 7f3706cbb640 1 -- 172.21.15.91:0/4100470483 wait complete. 2023-11-27T20:45:18.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.340+0000 7f3706cbb640 1 Processor -- start 2023-11-27T20:45:18.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.340+0000 7f3706cbb640 1 -- start start 2023-11-27T20:45:18.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.341+0000 7f3706cbb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f0004d00 0x7f37000a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.341+0000 7f3706cbb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f370006d090 0x7f370014fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.341+0000 7f3706cbb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700150000 0x7f37000beec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.341+0000 7f3706cbb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370009cdd0 con 0x7f370006d090 2023-11-27T20:45:18.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.341+0000 7f3706cbb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700150480 con 0x7f36f0004d00 2023-11-27T20:45:18.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.341+0000 7f3706cbb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370009c460 con 0x7f3700150000 2023-11-27T20:45:18.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.341+0000 7f36fffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f370006d090 0x7f370014fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.341+0000 7f36fffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f370006d090 0x7f370014fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54974/0 (socket says 172.21.15.91:54974) 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.341+0000 7f36fffff640 1 -- 172.21.15.91:0/2510840601 learned_addr learned my addr 172.21.15.91:0/2510840601 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f3705258640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700150000 0x7f37000beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f36fffff640 1 -- 172.21.15.91:0/2510840601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700150000 msgr2=0x7f37000beec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f3704a57640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f0004d00 0x7f37000a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f36fffff640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700150000 0x7f37000beec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f36fffff640 1 -- 172.21.15.91:0/2510840601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f0004d00 msgr2=0x7f37000a6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f36fffff640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f0004d00 0x7f37000a6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f36fffff640 1 -- 172.21.15.91:0/2510840601 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3700099a60 con 0x7f370006d090 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f36fffff640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f370006d090 0x7f370014fac0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00c870 tx=0x7f36ec00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f36fd7fa640 1 -- 172.21.15.91:0/2510840601 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0074e0 con 0x7f370006d090 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f36fd7fa640 1 -- 172.21.15.91:0/2510840601 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec007640 con 0x7f370006d090 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f3706cbb640 1 -- 172.21.15.91:0/2510840601 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370006ad50 con 0x7f370006d090 2023-11-27T20:45:18.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f36fd7fa640 1 -- 172.21.15.91:0/2510840601 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec004a20 con 0x7f370006d090 2023-11-27T20:45:18.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.342+0000 7f3706cbb640 1 -- 172.21.15.91:0/2510840601 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37001e84b0 con 0x7f370006d090 2023-11-27T20:45:18.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.343+0000 7f3706cbb640 1 -- 172.21.15.91:0/2510840601 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3700068350 con 0x7f370006d090 2023-11-27T20:45:18.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.344+0000 7f36fd7fa640 1 -- 172.21.15.91:0/2510840601 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f36ec004b80 con 0x7f370006d090 2023-11-27T20:45:18.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.346+0000 7f36fd7fa640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36e406b1f0 0x7f36e406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.346+0000 7f36fd7fa640 1 -- 172.21.15.91:0/2510840601 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f36ec088de0 con 0x7f370006d090 2023-11-27T20:45:18.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.346+0000 7f3704a57640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36e406b1f0 0x7f36e406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.346+0000 7f3704a57640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36e406b1f0 0x7f36e406d6b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f36f4004770 tx=0x7f36f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:18.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.350+0000 7f36fd7fa640 1 -- 172.21.15.91:0/2510840601 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f36ec0575f0 con 0x7f370006d090 2023-11-27T20:45:18.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.525+0000 7f3706cbb640 1 -- 172.21.15.91:0/2510840601 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37000a71c0 con 0x7f370006d090 2023-11-27T20:45:18.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.526+0000 7f36fd7fa640 1 -- 172.21.15.91:0/2510840601 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36ec018020 con 0x7f370006d090 2023-11-27T20:45:18.527 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:18.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.528+0000 7f3706cbb640 1 -- 172.21.15.91:0/2510840601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36e406b1f0 msgr2=0x7f36e406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.528+0000 7f3706cbb640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36e406b1f0 0x7f36e406d6b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f36f4004770 tx=0x7f36f4008040 comp rx=0 tx=0).stop 2023-11-27T20:45:18.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.528+0000 7f3706cbb640 1 -- 172.21.15.91:0/2510840601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f370006d090 msgr2=0x7f370014fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.528+0000 7f3706cbb640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f370006d090 0x7f370014fac0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00c870 tx=0x7f36ec00cd30 comp rx=0 tx=0).stop 2023-11-27T20:45:18.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.529+0000 7f3706cbb640 1 -- 172.21.15.91:0/2510840601 shutdown_connections 2023-11-27T20:45:18.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.529+0000 7f3706cbb640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700150000 0x7f37000beec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.529+0000 7f3706cbb640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f370006d090 0x7f370014fac0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.529+0000 7f3706cbb640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36e406b1f0 0x7f36e406d6b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.529+0000 7f3706cbb640 1 --2- 172.21.15.91:0/2510840601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f0004d00 0x7f37000a6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.529+0000 7f3706cbb640 1 -- 172.21.15.91:0/2510840601 >> 172.21.15.91:0/2510840601 conn(0x7f370006a500 msgr2=0x7f37000aac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:18.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.529+0000 7f3706cbb640 1 -- 172.21.15.91:0/2510840601 shutdown_connections 2023-11-27T20:45:18.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.529+0000 7f3706cbb640 1 -- 172.21.15.91:0/2510840601 wait complete. 2023-11-27T20:45:18.547 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T20:45:18.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.752+0000 7fd0ea3d4640 1 Processor -- start 2023-11-27T20:45:18.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.752+0000 7fd0ea3d4640 1 -- start start 2023-11-27T20:45:18.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.753+0000 7fd0ea3d4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0e414c2e0 0x7fd0e40c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.753+0000 7fd0ea3d4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0e40c0440 0x7fd0e4152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.753+0000 7fd0ea3d4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e4071e80 con 0x7fd0e4072310 2023-11-27T20:45:18.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.753+0000 7fd0ea3d4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e4071470 con 0x7fd0e40c0440 2023-11-27T20:45:18.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.753+0000 7fd0ea3d4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e414c6c0 con 0x7fd0e414c2e0 2023-11-27T20:45:18.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.754+0000 7fd0e8bd1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0e40c0440 0x7fd0e4152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.754+0000 7fd0e8bd1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd0e40c0440 0x7fd0e4152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54976/0 (socket says 172.21.15.91:54976) 2023-11-27T20:45:18.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.754+0000 7fd0e8bd1640 1 -- 172.21.15.91:0/1161751794 learned_addr learned my addr 172.21.15.91:0/1161751794 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:18.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.754+0000 7fd0e93d2640 1 --2- 172.21.15.91:0/1161751794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0e414c2e0 0x7fd0e40c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.754+0000 7fd0e8bd1640 1 -- 172.21.15.91:0/1161751794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0e414c2e0 msgr2=0x7fd0e40c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:18.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.754+0000 7fd0e8bd1640 1 --2- 172.21.15.91:0/1161751794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0e414c2e0 0x7fd0e40c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.754+0000 7fd0e8bd1640 1 -- 172.21.15.91:0/1161751794 >> v1:172.21.15.183:6789/0 conn(0x7fd0e4072310 legacy=0x7fd0e40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:18.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.754+0000 7fd0e8bd1640 1 -- 172.21.15.91:0/1161751794 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e4153180 con 0x7fd0e40c0440 2023-11-27T20:45:18.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.755+0000 7fd0e8bd1640 1 --2- 172.21.15.91:0/1161751794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e40c0440 0x7fd0e4152c40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009870 tx=0x7fd0d402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e5d6a7dd4a67d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.755+0000 7fd0dbfff640 1 -- 172.21.15.91:0/1161751794 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4031740 con 0x7fd0e40c0440 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.756+0000 7fd0dbfff640 1 -- 172.21.15.91:0/1161751794 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d40318a0 con 0x7fd0e40c0440 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.756+0000 7fd0dbfff640 1 -- 172.21.15.91:0/1161751794 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4031c30 con 0x7fd0e40c0440 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.756+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/1161751794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e40c0440 msgr2=0x7fd0e4152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.756+0000 7fd0ea3d4640 1 --2- 172.21.15.91:0/1161751794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e40c0440 0x7fd0e4152c40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009870 tx=0x7fd0d402b7e0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.756+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/1161751794 shutdown_connections 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.756+0000 7fd0ea3d4640 1 --2- 172.21.15.91:0/1161751794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e40c0440 0x7fd0e4152c40 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.756+0000 7fd0ea3d4640 1 --2- 172.21.15.91:0/1161751794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0e414c2e0 0x7fd0e40c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.756+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/1161751794 >> 172.21.15.91:0/1161751794 conn(0x7fd0e40a77f0 msgr2=0x7fd0e40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.756+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/1161751794 shutdown_connections 2023-11-27T20:45:18.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.756+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/1161751794 wait complete. 2023-11-27T20:45:18.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.758+0000 7fd0ea3d4640 1 Processor -- start 2023-11-27T20:45:18.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.758+0000 7fd0ea3d4640 1 -- start start 2023-11-27T20:45:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.759+0000 7fd0ea3d4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e4072310 0x7fd0e41544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.759+0000 7fd0ea3d4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0e40c0440 0x7fd0e40bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.759+0000 7fd0ea3d4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0e414c2e0 0x7fd0e41e9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.759+0000 7fd0ea3d4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4156700 con 0x7fd0e4072310 2023-11-27T20:45:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.759+0000 7fd0ea3d4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e41549f0 con 0x7fd0e40c0440 2023-11-27T20:45:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.759+0000 7fd0ea3d4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4155e80 con 0x7fd0e414c2e0 2023-11-27T20:45:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.759+0000 7fd0e93d2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e4072310 0x7fd0e41544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.759+0000 7fd0e93d2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e4072310 0x7fd0e41544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:54988/0 (socket says 172.21.15.91:54988) 2023-11-27T20:45:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.759+0000 7fd0e93d2640 1 -- 172.21.15.91:0/3546371871 learned_addr learned my addr 172.21.15.91:0/3546371871 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:18.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0e9bd3640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0e414c2e0 0x7fd0e41e9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0e8bd1640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0e40c0440 0x7fd0e40bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0e93d2640 1 -- 172.21.15.91:0/3546371871 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0e414c2e0 msgr2=0x7fd0e41e9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0e93d2640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0e414c2e0 0x7fd0e41e9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0e93d2640 1 -- 172.21.15.91:0/3546371871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0e40c0440 msgr2=0x7fd0e40bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0e93d2640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0e40c0440 0x7fd0e40bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0e93d2640 1 -- 172.21.15.91:0/3546371871 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d40094d0 con 0x7fd0e4072310 2023-11-27T20:45:18.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0e8bd1640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0e40c0440 0x7fd0e40bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:18.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0e93d2640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e4072310 0x7fd0e41544b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000d5f0 tx=0x7fd0e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:18.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0d9ffb640 1 -- 172.21.15.91:0/3546371871 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00125f0 con 0x7fd0e4072310 2023-11-27T20:45:18.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0d9ffb640 1 -- 172.21.15.91:0/3546371871 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e0012750 con 0x7fd0e4072310 2023-11-27T20:45:18.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0d9ffb640 1 -- 172.21.15.91:0/3546371871 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0012b00 con 0x7fd0e4072310 2023-11-27T20:45:18.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/3546371871 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e40ab470 con 0x7fd0e4072310 2023-11-27T20:45:18.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.760+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/3546371871 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e4156420 con 0x7fd0e4072310 2023-11-27T20:45:18.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.762+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/3546371871 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e404e840 con 0x7fd0e4072310 2023-11-27T20:45:18.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.762+0000 7fd0d9ffb640 1 -- 172.21.15.91:0/3546371871 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd0e0012c60 con 0x7fd0e4072310 2023-11-27T20:45:18.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.764+0000 7fd0d9ffb640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0c806b1c0 0x7fd0c806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:18.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.764+0000 7fd0d9ffb640 1 -- 172.21.15.91:0/3546371871 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd0e0089f20 con 0x7fd0e4072310 2023-11-27T20:45:18.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.764+0000 7fd0e8bd1640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0c806b1c0 0x7fd0c806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:18.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.765+0000 7fd0e8bd1640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0c806b1c0 0x7fd0c806d680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4035000 tx=0x7fd0d4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.768+0000 7fd0d9ffb640 1 -- 172.21.15.91:0/3546371871 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd0e0054bf0 con 0x7fd0e4072310 2023-11-27T20:45:18.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.959+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/3546371871 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd0e40a4ff0 con 0x7fd0e4072310 2023-11-27T20:45:18.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.960+0000 7fd0d9ffb640 1 -- 172.21.15.91:0/3546371871 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+209 (secure 0 0 0) 0x7fd0e0058210 con 0x7fd0e4072310 2023-11-27T20:45:18.961 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:18.961 INFO:teuthology.orchestra.run.smithi091.stdout:[ 2023-11-27T20:45:18.961 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:18.961 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 1, 2023-11-27T20:45:18.961 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": ".mgr" 2023-11-27T20:45:18.961 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:18.961 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:18.961 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 12, 2023-11-27T20:45:18.961 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": "cephfs_metadata" 2023-11-27T20:45:18.961 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-27T20:45:18.962 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-11-27T20:45:18.962 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 13, 2023-11-27T20:45:18.962 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": "cephfs_data" 2023-11-27T20:45:18.962 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-27T20:45:18.962 INFO:teuthology.orchestra.run.smithi091.stdout:] 2023-11-27T20:45:18.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/3546371871 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0c806b1c0 msgr2=0x7fd0c806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0c806b1c0 0x7fd0c806d680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4035000 tx=0x7fd0d4008030 comp rx=0 tx=0).stop 2023-11-27T20:45:18.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/3546371871 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e4072310 msgr2=0x7fd0e41544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:18.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e4072310 0x7fd0e41544b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000d5f0 tx=0x7fd0e000dab0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/3546371871 shutdown_connections 2023-11-27T20:45:18.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0e414c2e0 0x7fd0e41e9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd0c806b1c0 0x7fd0c806d680 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0e40c0440 0x7fd0e40bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 --2- 172.21.15.91:0/3546371871 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0e4072310 0x7fd0e41544b0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:18.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/3546371871 >> 172.21.15.91:0/3546371871 conn(0x7fd0e40a77f0 msgr2=0x7fd0e40c24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:18.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/3546371871 shutdown_connections 2023-11-27T20:45:18.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:18.963+0000 7fd0ea3d4640 1 -- 172.21.15.91:0/3546371871 wait complete. 2023-11-27T20:45:18.982 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-27T20:45:18.982 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-27T20:45:19.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.196+0000 7f4273dde640 1 Processor -- start 2023-11-27T20:45:19.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.197+0000 7f4273dde640 1 -- start start 2023-11-27T20:45:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.198+0000 7f4273dde640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f426c0aa940 0x7f426c071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:19.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.198+0000 7f4273dde640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426c0a9560 con 0x7f426c0c4180 2023-11-27T20:45:19.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.198+0000 7f4273dde640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426c0a9820 con 0x7f426c0c4660 2023-11-27T20:45:19.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.198+0000 7f4273dde640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426c0c3120 con 0x7f426c0aa940 2023-11-27T20:45:19.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.198+0000 7f427237b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f426c0c4180 0x7f426c15ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55932/0 (socket says 172.21.15.91:55932) 2023-11-27T20:45:19.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.198+0000 7f427237b640 1 -- 172.21.15.91:0/717194721 learned_addr learned my addr 172.21.15.91:0/717194721 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:19.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.198+0000 7f4271b7a640 1 --2- 172.21.15.91:0/717194721 >> v2:172.21.15.91:3300/0 conn(0x7f426c0aa940 0x7f426c071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.199+0000 7f4270b78640 1 -- 172.21.15.91:0/717194721 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326178751 0 0) 0x7f426c0a9560 con 0x7f426c0c4180 2023-11-27T20:45:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.199+0000 7f4270b78640 1 -- 172.21.15.91:0/717194721 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4258003520 con 0x7f426c0c4180 2023-11-27T20:45:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.199+0000 7f4271b7a640 1 -- 172.21.15.91:0/717194721 >> v1:172.21.15.183:6789/0 conn(0x7f426c0c4660 legacy=0x7f426c0a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.199+0000 7f4271b7a640 1 -- 172.21.15.91:0/717194721 >> v1:172.21.15.91:6789/0 conn(0x7f426c0c4180 legacy=0x7f426c15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.199+0000 7f4271b7a640 1 -- 172.21.15.91:0/717194721 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0c4b50 con 0x7f426c0aa940 2023-11-27T20:45:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.200+0000 7f4271b7a640 1 --2- 172.21.15.91:0/717194721 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0aa940 0x7f426c071e90 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f42680097a0 tx=0x7f426802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f877cb4b1fc7661 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:19.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.201+0000 7f4270b78640 1 -- 172.21.15.91:0/717194721 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268031830 con 0x7f426c0aa940 2023-11-27T20:45:19.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.201+0000 7f4270b78640 1 -- 172.21.15.91:0/717194721 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4268031990 con 0x7f426c0aa940 2023-11-27T20:45:19.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.201+0000 7f4270b78640 1 -- 172.21.15.91:0/717194721 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268031d20 con 0x7f426c0aa940 2023-11-27T20:45:19.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.201+0000 7f4273dde640 1 -- 172.21.15.91:0/717194721 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0aa940 msgr2=0x7f426c071e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:19.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.201+0000 7f4273dde640 1 --2- 172.21.15.91:0/717194721 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0aa940 0x7f426c071e90 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f42680097a0 tx=0x7f426802b8d0 comp rx=0 tx=0).stop 2023-11-27T20:45:19.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.202+0000 7f4273dde640 1 -- 172.21.15.91:0/717194721 shutdown_connections 2023-11-27T20:45:19.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.202+0000 7f4273dde640 1 --2- 172.21.15.91:0/717194721 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0aa940 0x7f426c071e90 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:19.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.202+0000 7f4273dde640 1 -- 172.21.15.91:0/717194721 >> 172.21.15.91:0/717194721 conn(0x7f426c0c5bc0 msgr2=0x7f426c0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:19.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.202+0000 7f4273dde640 1 -- 172.21.15.91:0/717194721 shutdown_connections 2023-11-27T20:45:19.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.202+0000 7f4273dde640 1 -- 172.21.15.91:0/717194721 wait complete. 2023-11-27T20:45:19.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.204+0000 7f4273dde640 1 Processor -- start 2023-11-27T20:45:19.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.204+0000 7f4273dde640 1 -- start start 2023-11-27T20:45:19.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4273dde640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426c0aa940 0x7f426c1d69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:19.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4273dde640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0c4180 0x7f426c1ddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:19.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4273dde640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426c0c4660 0x7f426c0a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:19.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4273dde640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c1dfcc0 con 0x7f426c0c4180 2023-11-27T20:45:19.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4273dde640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c1e00c0 con 0x7f426c0c4660 2023-11-27T20:45:19.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4273dde640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c1ee1b0 con 0x7f426c0aa940 2023-11-27T20:45:19.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4271379640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0c4180 0x7f426c1ddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:19.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4271379640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0c4180 0x7f426c1ddbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55012/0 (socket says 172.21.15.91:55012) 2023-11-27T20:45:19.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4271379640 1 -- 172.21.15.91:0/575069029 learned_addr learned my addr 172.21.15.91:0/575069029 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4271b7a640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426c0aa940 0x7f426c1d69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f427237b640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426c0c4660 0x7f426c0a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4271379640 1 -- 172.21.15.91:0/575069029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426c0aa940 msgr2=0x7f426c1d69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4271379640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426c0aa940 0x7f426c1d69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4271379640 1 -- 172.21.15.91:0/575069029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426c0c4660 msgr2=0x7f426c0a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4271379640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426c0c4660 0x7f426c0a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4271379640 1 -- 172.21.15.91:0/575069029 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4268009400 con 0x7f426c0c4180 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f427237b640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426c0c4660 0x7f426c0a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.205+0000 7f4271b7a640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426c0aa940 0x7f426c1d69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.206+0000 7f4271379640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0c4180 0x7f426c1ddbe0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f426000c400 tx=0x7f426000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.206+0000 7f425e7fc640 1 -- 172.21.15.91:0/575069029 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600052d0 con 0x7f426c0c4180 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.206+0000 7f425e7fc640 1 -- 172.21.15.91:0/575069029 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4260005430 con 0x7f426c0c4180 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.206+0000 7f425e7fc640 1 -- 172.21.15.91:0/575069029 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260003830 con 0x7f426c0c4180 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.206+0000 7f4273dde640 1 -- 172.21.15.91:0/575069029 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426c1ee490 con 0x7f426c0c4180 2023-11-27T20:45:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.206+0000 7f4273dde640 1 -- 172.21.15.91:0/575069029 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c1d6f30 con 0x7f426c0c4180 2023-11-27T20:45:19.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.207+0000 7f4273dde640 1 -- 172.21.15.91:0/575069029 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426c068350 con 0x7f426c0c4180 2023-11-27T20:45:19.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.208+0000 7f425e7fc640 1 -- 172.21.15.91:0/575069029 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4260003990 con 0x7f426c0c4180 2023-11-27T20:45:19.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.210+0000 7f425e7fc640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f425006b1c0 0x7f425006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:19.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.210+0000 7f425e7fc640 1 -- 172.21.15.91:0/575069029 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4260089020 con 0x7f426c0c4180 2023-11-27T20:45:19.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.210+0000 7f4271b7a640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f425006b1c0 0x7f425006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:19.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.211+0000 7f4271b7a640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f425006b1c0 0x7f425006d680 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4268036000 tx=0x7f426803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:19.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.214+0000 7f425e7fc640 1 -- 172.21.15.91:0/575069029 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4260053d80 con 0x7f426c0c4180 2023-11-27T20:45:19.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:19.412+0000 7f4273dde640 1 -- 172.21.15.91:0/575069029 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f426c0c3ef0 con 0x7f426c0c4180 2023-11-27T20:45:20.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.287+0000 7f425e7fc640 1 -- 172.21.15.91:0/575069029 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v78) v1 ==== 140+0+0 (secure 0 0 0) 0x7f42600573a0 con 0x7f426c0c4180 2023-11-27T20:45:20.289 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_metadata' created 2023-11-27T20:45:20.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.291+0000 7f4273dde640 1 -- 172.21.15.91:0/575069029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f425006b1c0 msgr2=0x7f425006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:20.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.291+0000 7f4273dde640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f425006b1c0 0x7f425006d680 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4268036000 tx=0x7f426803c040 comp rx=0 tx=0).stop 2023-11-27T20:45:20.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.291+0000 7f4273dde640 1 -- 172.21.15.91:0/575069029 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0c4180 msgr2=0x7f426c1ddbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:20.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.291+0000 7f4273dde640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0c4180 0x7f426c1ddbe0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f426000c400 tx=0x7f426000c8c0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.291+0000 7f4273dde640 1 -- 172.21.15.91:0/575069029 shutdown_connections 2023-11-27T20:45:20.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.291+0000 7f4273dde640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f425006b1c0 0x7f425006d680 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.291+0000 7f4273dde640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426c0c4660 0x7f426c0a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.291+0000 7f4273dde640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f426c0c4180 0x7f426c1ddbe0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.291+0000 7f4273dde640 1 --2- 172.21.15.91:0/575069029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426c0aa940 0x7f426c1d69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.291+0000 7f4273dde640 1 -- 172.21.15.91:0/575069029 >> 172.21.15.91:0/575069029 conn(0x7f426c0c5bc0 msgr2=0x7f426c0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.292+0000 7f4273dde640 1 -- 172.21.15.91:0/575069029 shutdown_connections 2023-11-27T20:45:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.292+0000 7f4273dde640 1 -- 172.21.15.91:0/575069029 wait complete. 2023-11-27T20:45:20.324 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T20:45:20.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.529+0000 7f327e0b4640 1 Processor -- start 2023-11-27T20:45:20.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.529+0000 7f327e0b4640 1 -- start start 2023-11-27T20:45:20.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.530+0000 7f327e0b4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3278155fc0 0x7f3278159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:20.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.530+0000 7f327e0b4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32780c2e60 0x7f3278163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:20.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.530+0000 7f327e0b4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327806d580 con 0x7f32780c1ca0 2023-11-27T20:45:20.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.530+0000 7f327e0b4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327806dd60 con 0x7f32780c2e60 2023-11-27T20:45:20.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.530+0000 7f327e0b4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32780c6580 con 0x7f3278155fc0 2023-11-27T20:45:20.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.531+0000 7f3277fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32780c2e60 0x7f3278163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:20.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.531+0000 7f3277fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32780c2e60 0x7f3278163370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55020/0 (socket says 172.21.15.91:55020) 2023-11-27T20:45:20.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.531+0000 7f3277fff640 1 -- 172.21.15.91:0/4281288625 learned_addr learned my addr 172.21.15.91:0/4281288625 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:20.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.531+0000 7f32777fe640 1 --2- 172.21.15.91:0/4281288625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3278155fc0 0x7f3278159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:20.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.531+0000 7f3277fff640 1 -- 172.21.15.91:0/4281288625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3278155fc0 msgr2=0x7f3278159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:20.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.531+0000 7f3277fff640 1 --2- 172.21.15.91:0/4281288625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3278155fc0 0x7f3278159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.531+0000 7f3277fff640 1 -- 172.21.15.91:0/4281288625 >> v1:172.21.15.183:6789/0 conn(0x7f32780c1ca0 legacy=0x7f32780c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:20.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.531+0000 7f3277fff640 1 -- 172.21.15.91:0/4281288625 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32780726d0 con 0x7f32780c2e60 2023-11-27T20:45:20.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.532+0000 7f3277fff640 1 --2- 172.21.15.91:0/4281288625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c2e60 0x7f3278163370 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3270009e50 tx=0x7f327002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f375c768a519e992 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:20.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.533+0000 7f3276ffd640 1 -- 172.21.15.91:0/4281288625 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327002c950 con 0x7f32780c2e60 2023-11-27T20:45:20.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.533+0000 7f3276ffd640 1 -- 172.21.15.91:0/4281288625 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327002cab0 con 0x7f32780c2e60 2023-11-27T20:45:20.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.533+0000 7f3276ffd640 1 -- 172.21.15.91:0/4281288625 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327002ce40 con 0x7f32780c2e60 2023-11-27T20:45:20.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.533+0000 7f327e0b4640 1 -- 172.21.15.91:0/4281288625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c2e60 msgr2=0x7f3278163370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:20.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.533+0000 7f327e0b4640 1 --2- 172.21.15.91:0/4281288625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c2e60 0x7f3278163370 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3270009e50 tx=0x7f327002bdb0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.534+0000 7f327e0b4640 1 -- 172.21.15.91:0/4281288625 shutdown_connections 2023-11-27T20:45:20.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.534+0000 7f327e0b4640 1 --2- 172.21.15.91:0/4281288625 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c2e60 0x7f3278163370 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.534+0000 7f327e0b4640 1 --2- 172.21.15.91:0/4281288625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3278155fc0 0x7f3278159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.534+0000 7f327e0b4640 1 -- 172.21.15.91:0/4281288625 >> 172.21.15.91:0/4281288625 conn(0x7f327806a500 msgr2=0x7f327806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:20.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.534+0000 7f327e0b4640 1 -- 172.21.15.91:0/4281288625 shutdown_connections 2023-11-27T20:45:20.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.534+0000 7f327e0b4640 1 -- 172.21.15.91:0/4281288625 wait complete. 2023-11-27T20:45:20.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.536+0000 7f327e0b4640 1 Processor -- start 2023-11-27T20:45:20.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.536+0000 7f327e0b4640 1 -- start start 2023-11-27T20:45:20.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.537+0000 7f327e0b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c1ca0 0x7f32780a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:20.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.537+0000 7f327e0b4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32780c2e60 0x7f32780a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:20.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.537+0000 7f327e0b4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3278155fc0 0x7f32780a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:20.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.537+0000 7f327e0b4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780a5970 con 0x7f32780c1ca0 2023-11-27T20:45:20.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.537+0000 7f327e0b4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780aad00 con 0x7f32780c2e60 2023-11-27T20:45:20.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.537+0000 7f327e0b4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32780aafa0 con 0x7f3278155fc0 2023-11-27T20:45:20.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.537+0000 7f32777fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c1ca0 0x7f32780a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:20.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.537+0000 7f32777fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c1ca0 0x7f32780a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55026/0 (socket says 172.21.15.91:55026) 2023-11-27T20:45:20.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.538+0000 7f32777fe640 1 -- 172.21.15.91:0/3990482491 learned_addr learned my addr 172.21.15.91:0/3990482491 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:20.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.538+0000 7f32777fe640 1 -- 172.21.15.91:0/3990482491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3278155fc0 msgr2=0x7f32780a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:20.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.538+0000 7f32777fe640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3278155fc0 0x7f32780a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.538+0000 7f32777fe640 1 -- 172.21.15.91:0/3990482491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32780c2e60 msgr2=0x7f32780a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:20.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.538+0000 7f32777fe640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32780c2e60 0x7f32780a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:20.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.538+0000 7f32777fe640 1 -- 172.21.15.91:0/3990482491 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009b30 con 0x7f32780c1ca0 2023-11-27T20:45:20.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.538+0000 7f32777fe640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c1ca0 0x7f32780a4a40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f326800d5f0 tx=0x7f326800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:20.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.538+0000 7f3274ff9640 1 -- 172.21.15.91:0/3990482491 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32680125f0 con 0x7f32780c1ca0 2023-11-27T20:45:20.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.538+0000 7f3274ff9640 1 -- 172.21.15.91:0/3990482491 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3268012750 con 0x7f32780c1ca0 2023-11-27T20:45:20.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.539+0000 7f3274ff9640 1 -- 172.21.15.91:0/3990482491 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268012b00 con 0x7f32780c1ca0 2023-11-27T20:45:20.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.539+0000 7f327e0b4640 1 -- 172.21.15.91:0/3990482491 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32780a5b80 con 0x7f32780c1ca0 2023-11-27T20:45:20.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.539+0000 7f327e0b4640 1 -- 172.21.15.91:0/3990482491 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32780aa360 con 0x7f32780c1ca0 2023-11-27T20:45:20.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.540+0000 7f327e0b4640 1 -- 172.21.15.91:0/3990482491 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3278068350 con 0x7f32780c1ca0 2023-11-27T20:45:20.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.541+0000 7f3274ff9640 1 -- 172.21.15.91:0/3990482491 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3268012c60 con 0x7f32780c1ca0 2023-11-27T20:45:20.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.543+0000 7f3274ff9640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f325806b1f0 0x7f325806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:20.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.543+0000 7f3274ff9640 1 -- 172.21.15.91:0/3990482491 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6138+0+0 (secure 0 0 0) 0x7f326808a070 con 0x7f32780c1ca0 2023-11-27T20:45:20.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.543+0000 7f326effd640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f325806b1f0 0x7f325806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:20.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.544+0000 7f326effd640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f325806b1f0 0x7f325806d6b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3278151730 tx=0x7f32600079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:20.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.549+0000 7f3274ff9640 1 -- 172.21.15.91:0/3990482491 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f32680bce90 con 0x7f32780c1ca0 2023-11-27T20:45:20.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:20.741+0000 7f327e0b4640 1 -- 172.21.15.91:0/3990482491 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3278159990 con 0x7f32780c1ca0 2023-11-27T20:45:21.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.305+0000 7f3274ff9640 1 -- 172.21.15.91:0/3990482491 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v79) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3278159990 con 0x7f32780c1ca0 2023-11-27T20:45:21.307 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_data' created 2023-11-27T20:45:21.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 -- 172.21.15.91:0/3990482491 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f325806b1f0 msgr2=0x7f325806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:21.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f325806b1f0 0x7f325806d6b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3278151730 tx=0x7f32600079b0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 -- 172.21.15.91:0/3990482491 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c1ca0 msgr2=0x7f32780a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:21.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c1ca0 0x7f32780a4a40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f326800d5f0 tx=0x7f326800dab0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 -- 172.21.15.91:0/3990482491 shutdown_connections 2023-11-27T20:45:21.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3278155fc0 0x7f32780a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f325806b1f0 0x7f325806d6b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32780c2e60 0x7f32780a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 --2- 172.21.15.91:0/3990482491 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32780c1ca0 0x7f32780a4a40 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 -- 172.21.15.91:0/3990482491 >> 172.21.15.91:0/3990482491 conn(0x7f327806a500 msgr2=0x7f3278154150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:21.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 -- 172.21.15.91:0/3990482491 shutdown_connections 2023-11-27T20:45:21.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.309+0000 7f327e0b4640 1 -- 172.21.15.91:0/3990482491 wait complete. 2023-11-27T20:45:21.347 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-27T20:45:21.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.530+0000 7f9e2bfff640 1 Processor -- start 2023-11-27T20:45:21.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.530+0000 7f9e2bfff640 1 -- start start 2023-11-27T20:45:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.531+0000 7f9e2bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9e2c14e7f0 0x7f9e2c0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.531+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 0x7f9e2c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.531+0000 7f9e2bfff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2c0a8380 con 0x7f9e2c06cd20 2023-11-27T20:45:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.531+0000 7f9e2bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c1510b0 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.531+0000 7f9e2bfff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c06bf60 con 0x7f9e2c0c52e0 2023-11-27T20:45:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.532+0000 7f9e2affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9e2c14e7f0 0x7f9e2c0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.532+0000 7f9e2affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9e2c14e7f0 0x7f9e2c0c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55028/0 (socket says 172.21.15.91:55028) 2023-11-27T20:45:21.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.532+0000 7f9e2affd640 1 -- 172.21.15.91:0/3057465543 learned_addr learned my addr 172.21.15.91:0/3057465543 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.532+0000 7f9e2a7fc640 1 --2- 172.21.15.91:0/3057465543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 0x7f9e2c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.532+0000 7f9e2affd640 1 -- 172.21.15.91:0/3057465543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 msgr2=0x7f9e2c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:21.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.532+0000 7f9e2affd640 1 --2- 172.21.15.91:0/3057465543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 0x7f9e2c06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.532+0000 7f9e2affd640 1 -- 172.21.15.91:0/3057465543 >> v1:172.21.15.183:6789/0 conn(0x7f9e2c06cd20 legacy=0x7f9e2c1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:21.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.532+0000 7f9e2affd640 1 -- 172.21.15.91:0/3057465543 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c06c240 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.532+0000 7f9e2a7fc640 1 --2- 172.21.15.91:0/3057465543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 0x7f9e2c06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:21.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.534+0000 7f9e2affd640 1 --2- 172.21.15.91:0/3057465543 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 0x7f9e2c0c0440 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009870 tx=0x7f9e1c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdafe3f276805f12 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:21.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.534+0000 7f9e29ffb640 1 -- 172.21.15.91:0/3057465543 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0317c0 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.534+0000 7f9e29ffb640 1 -- 172.21.15.91:0/3057465543 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c031920 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.534+0000 7f9e29ffb640 1 -- 172.21.15.91:0/3057465543 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c031cb0 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.534+0000 7f9e2bfff640 1 -- 172.21.15.91:0/3057465543 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 msgr2=0x7f9e2c0c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.534+0000 7f9e2bfff640 1 --2- 172.21.15.91:0/3057465543 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 0x7f9e2c0c0440 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009870 tx=0x7f9e1c02b860 comp rx=0 tx=0).stop 2023-11-27T20:45:21.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.535+0000 7f9e2bfff640 1 -- 172.21.15.91:0/3057465543 shutdown_connections 2023-11-27T20:45:21.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.535+0000 7f9e2bfff640 1 --2- 172.21.15.91:0/3057465543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 0x7f9e2c06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.535+0000 7f9e2bfff640 1 --2- 172.21.15.91:0/3057465543 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 0x7f9e2c0c0440 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.535+0000 7f9e2bfff640 1 -- 172.21.15.91:0/3057465543 >> 172.21.15.91:0/3057465543 conn(0x7f9e2c0a77f0 msgr2=0x7f9e2c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:21.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.535+0000 7f9e2bfff640 1 -- 172.21.15.91:0/3057465543 shutdown_connections 2023-11-27T20:45:21.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.535+0000 7f9e2bfff640 1 -- 172.21.15.91:0/3057465543 wait complete. 2023-11-27T20:45:21.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.536+0000 7f9e2bfff640 1 Processor -- start 2023-11-27T20:45:21.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.536+0000 7f9e2bfff640 1 -- start start 2023-11-27T20:45:21.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.537+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e2c06cd20 0x7f9e2c14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:21.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.537+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 0x7f9e2c14a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:21.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.537+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 0x7f9e2c1eba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:21.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.537+0000 7f9e2bfff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c155600 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.537+0000 7f9e2bfff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c14c760 con 0x7f9e2c06cd20 2023-11-27T20:45:21.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.537+0000 7f9e2bfff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c0728f0 con 0x7f9e2c0c52e0 2023-11-27T20:45:21.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 0x7f9e2c1eba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:21.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 0x7f9e2c1eba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55030/0 (socket says 172.21.15.91:55030) 2023-11-27T20:45:21.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2b7fe640 1 -- 172.21.15.91:0/4119553486 learned_addr learned my addr 172.21.15.91:0/4119553486 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:21.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2affd640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e2c06cd20 0x7f9e2c14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:21.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2b7fe640 1 -- 172.21.15.91:0/4119553486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 msgr2=0x7f9e2c14a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:21.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2a7fc640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 0x7f9e2c14a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:21.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2b7fe640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 0x7f9e2c14a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2b7fe640 1 -- 172.21.15.91:0/4119553486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e2c06cd20 msgr2=0x7f9e2c14c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:21.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2b7fe640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e2c06cd20 0x7f9e2c14c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2b7fe640 1 -- 172.21.15.91:0/4119553486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c0094d0 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.538+0000 7f9e2b7fe640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 0x7f9e2c1eba60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400c6d0 tx=0x7f9e2400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.539+0000 7f9e137fe640 1 -- 172.21.15.91:0/4119553486 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400a840 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.539+0000 7f9e137fe640 1 -- 172.21.15.91:0/4119553486 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2400a9a0 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.539+0000 7f9e137fe640 1 -- 172.21.15.91:0/4119553486 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400ad90 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.539+0000 7f9e2bfff640 1 -- 172.21.15.91:0/4119553486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c1eb2a0 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.539+0000 7f9e2bfff640 1 -- 172.21.15.91:0/4119553486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2c072610 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.540+0000 7f9e2bfff640 1 -- 172.21.15.91:0/4119553486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2c0c0930 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.541+0000 7f9e137fe640 1 -- 172.21.15.91:0/4119553486 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9e24012630 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.542+0000 7f9e137fe640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9e1806b1f0 0x7f9e1806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.542+0000 7f9e137fe640 1 -- 172.21.15.91:0/4119553486 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f9e2408a3a0 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.543+0000 7f9e2affd640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9e1806b1f0 0x7f9e1806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:21.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.543+0000 7f9e2affd640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9e1806b1f0 0x7f9e1806d6b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c036000 tx=0x7f9e1c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:21.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.547+0000 7f9e137fe640 1 -- 172.21.15.91:0/4119553486 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9e24054e40 con 0x7f9e2c14e7f0 2023-11-27T20:45:21.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:21.785+0000 7f9e2bfff640 1 -- 172.21.15.91:0/4119553486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f9e2c04e840 con 0x7f9e2c14e7f0 2023-11-27T20:45:22.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.335+0000 7f9e137fe640 1 -- 172.21.15.91:0/4119553486 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v47) v1 ==== 177+0+0 (secure 0 0 0) 0x7f9e240160c0 con 0x7f9e2c14e7f0 2023-11-27T20:45:22.337 INFO:teuthology.orchestra.run.smithi091.stderr:new fs with metadata pool 14 and data pool 15 2023-11-27T20:45:22.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.340+0000 7f9e2bfff640 1 -- 172.21.15.91:0/4119553486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9e1806b1f0 msgr2=0x7f9e1806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:22.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.340+0000 7f9e2bfff640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9e1806b1f0 0x7f9e1806d6b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c036000 tx=0x7f9e1c03d040 comp rx=0 tx=0).stop 2023-11-27T20:45:22.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.340+0000 7f9e2bfff640 1 -- 172.21.15.91:0/4119553486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 msgr2=0x7f9e2c1eba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:22.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.340+0000 7f9e2bfff640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 0x7f9e2c1eba60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400c6d0 tx=0x7f9e2400cb90 comp rx=0 tx=0).stop 2023-11-27T20:45:22.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.341+0000 7f9e2bfff640 1 -- 172.21.15.91:0/4119553486 shutdown_connections 2023-11-27T20:45:22.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.341+0000 7f9e2bfff640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e2c14e7f0 0x7f9e2c1eba60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.341+0000 7f9e2bfff640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e2c0c52e0 0x7f9e2c14a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.341+0000 7f9e2bfff640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9e1806b1f0 0x7f9e1806d6b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.341+0000 7f9e2bfff640 1 --2- 172.21.15.91:0/4119553486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e2c06cd20 0x7f9e2c14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.341+0000 7f9e2bfff640 1 -- 172.21.15.91:0/4119553486 >> 172.21.15.91:0/4119553486 conn(0x7f9e2c0a77f0 msgr2=0x7f9e2c14b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:22.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.342+0000 7f9e2bfff640 1 -- 172.21.15.91:0/4119553486 shutdown_connections 2023-11-27T20:45:22.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.342+0000 7f9e2bfff640 1 -- 172.21.15.91:0/4119553486 wait complete. 2023-11-27T20:45:22.380 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:22.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.559+0000 7f5225483640 1 Processor -- start 2023-11-27T20:45:22.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.559+0000 7f5225483640 1 -- start start 2023-11-27T20:45:22.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f5225483640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f52200c5ec0 0x7f52200c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:22.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f5225483640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52200c45d0 0x7f52200c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:22.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f5225483640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52200bfdc0 con 0x7f52200721a0 2023-11-27T20:45:22.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f5225483640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522006e390 con 0x7f52200c5ec0 2023-11-27T20:45:22.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f5225483640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522006ddd0 con 0x7f52200c45d0 2023-11-27T20:45:22.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f521effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f52200c5ec0 0x7f52200c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:22.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f521f7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f52200721a0 0x7f5220155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55946/0 (socket says 172.21.15.91:55946) 2023-11-27T20:45:22.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f521f7fe640 1 -- 172.21.15.91:0/2855246962 learned_addr learned my addr 172.21.15.91:0/2855246962 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:22.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f521e7fc640 1 --2- 172.21.15.91:0/2855246962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52200c45d0 0x7f52200c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:22.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f521effd640 1 -- 172.21.15.91:0/2855246962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52200c45d0 msgr2=0x7f52200c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:22.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f521effd640 1 --2- 172.21.15.91:0/2855246962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52200c45d0 0x7f52200c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f521effd640 1 -- 172.21.15.91:0/2855246962 >> v1:172.21.15.91:6789/0 conn(0x7f52200721a0 legacy=0x7f5220155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:22.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.561+0000 7f521effd640 1 -- 172.21.15.91:0/2855246962 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522006e0b0 con 0x7f52200c5ec0 2023-11-27T20:45:22.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.563+0000 7f521effd640 1 --2- 172.21.15.91:0/2855246962 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 0x7f52200c2c30 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f52100097a0 tx=0x7f521002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c10449ccff3190 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:22.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.563+0000 7f521dffb640 1 -- 172.21.15.91:0/2855246962 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52100316f0 con 0x7f52200c5ec0 2023-11-27T20:45:22.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.563+0000 7f521dffb640 1 -- 172.21.15.91:0/2855246962 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5210031850 con 0x7f52200c5ec0 2023-11-27T20:45:22.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.563+0000 7f521dffb640 1 -- 172.21.15.91:0/2855246962 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210031be0 con 0x7f52200c5ec0 2023-11-27T20:45:22.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.563+0000 7f5225483640 1 -- 172.21.15.91:0/2855246962 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 msgr2=0x7f52200c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:22.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.563+0000 7f5225483640 1 --2- 172.21.15.91:0/2855246962 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 0x7f52200c2c30 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f52100097a0 tx=0x7f521002b790 comp rx=0 tx=0).stop 2023-11-27T20:45:22.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.564+0000 7f5225483640 1 -- 172.21.15.91:0/2855246962 shutdown_connections 2023-11-27T20:45:22.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.564+0000 7f5225483640 1 --2- 172.21.15.91:0/2855246962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52200c45d0 0x7f52200c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.564+0000 7f5225483640 1 --2- 172.21.15.91:0/2855246962 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 0x7f52200c2c30 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.564+0000 7f5225483640 1 -- 172.21.15.91:0/2855246962 >> 172.21.15.91:0/2855246962 conn(0x7f522006a500 msgr2=0x7f522006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:22.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.564+0000 7f5225483640 1 -- 172.21.15.91:0/2855246962 shutdown_connections 2023-11-27T20:45:22.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.564+0000 7f5225483640 1 -- 172.21.15.91:0/2855246962 wait complete. 2023-11-27T20:45:22.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.565+0000 7f5225483640 1 Processor -- start 2023-11-27T20:45:22.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.565+0000 7f5225483640 1 -- start start 2023-11-27T20:45:22.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.566+0000 7f5225483640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52200721a0 0x7f52201ea810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:22.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.566+0000 7f5225483640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52200c45d0 0x7f52200a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:22.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.566+0000 7f5225483640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 0x7f5220157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:22.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.566+0000 7f5225483640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52201584e0 con 0x7f52200c5ec0 2023-11-27T20:45:22.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.566+0000 7f5225483640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220157290 con 0x7f52200721a0 2023-11-27T20:45:22.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.566+0000 7f5225483640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52201566a0 con 0x7f52200c45d0 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.567+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 0x7f5220157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.567+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 0x7f5220157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55058/0 (socket says 172.21.15.91:55058) 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.567+0000 7f521f7fe640 1 -- 172.21.15.91:0/2961729012 learned_addr learned my addr 172.21.15.91:0/2961729012 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.567+0000 7f521effd640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52200721a0 0x7f52201ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.567+0000 7f521f7fe640 1 -- 172.21.15.91:0/2961729012 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52200c45d0 msgr2=0x7f52200a5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.567+0000 7f521f7fe640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52200c45d0 0x7f52200a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.567+0000 7f521f7fe640 1 -- 172.21.15.91:0/2961729012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52200721a0 msgr2=0x7f52201ea810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.567+0000 7f521f7fe640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52200721a0 0x7f52201ea810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.567+0000 7f521f7fe640 1 -- 172.21.15.91:0/2961729012 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5210009400 con 0x7f52200c5ec0 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.567+0000 7f521f7fe640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 0x7f5220157720 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f521800cbc0 tx=0x7f521800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.568+0000 7f52077fe640 1 -- 172.21.15.91:0/2961729012 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800ad40 con 0x7f52200c5ec0 2023-11-27T20:45:22.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.568+0000 7f52077fe640 1 -- 172.21.15.91:0/2961729012 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5218012400 con 0x7f52200c5ec0 2023-11-27T20:45:22.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.568+0000 7f5225483640 1 -- 172.21.15.91:0/2961729012 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5220156960 con 0x7f52200c5ec0 2023-11-27T20:45:22.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.568+0000 7f52077fe640 1 -- 172.21.15.91:0/2961729012 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800aea0 con 0x7f52200c5ec0 2023-11-27T20:45:22.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.568+0000 7f5225483640 1 -- 172.21.15.91:0/2961729012 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5220156f20 con 0x7f52200c5ec0 2023-11-27T20:45:22.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.569+0000 7f5225483640 1 -- 172.21.15.91:0/2961729012 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5220157440 con 0x7f52200c5ec0 2023-11-27T20:45:22.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.570+0000 7f52077fe640 1 -- 172.21.15.91:0/2961729012 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5218007070 con 0x7f52200c5ec0 2023-11-27T20:45:22.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.571+0000 7f52077fe640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f520c06b1f0 0x7f520c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:22.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.572+0000 7f52077fe640 1 -- 172.21.15.91:0/2961729012 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f5218089be0 con 0x7f52200c5ec0 2023-11-27T20:45:22.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.572+0000 7f521effd640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f520c06b1f0 0x7f520c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:22.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.572+0000 7f521effd640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f520c06b1f0 0x7f520c06d6b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5210036000 tx=0x7f5210008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:22.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.577+0000 7f52077fe640 1 -- 172.21.15.91:0/2961729012 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5220157440 con 0x7f52200c5ec0 2023-11-27T20:45:22.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.770+0000 7f5225483640 1 -- 172.21.15.91:0/2961729012 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5220157400 con 0x7f52200c5ec0 2023-11-27T20:45:22.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.774+0000 7f52077fe640 1 -- 172.21.15.91:0/2961729012 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+20289 (secure 0 0 0) 0x7f5218017020 con 0x7f52200c5ec0 2023-11-27T20:45:22.776 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:22.776 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":80,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:21.787145+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:22.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 -- 172.21.15.91:0/2961729012 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f520c06b1f0 msgr2=0x7f520c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:22.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f520c06b1f0 0x7f520c06d6b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5210036000 tx=0x7f5210008030 comp rx=0 tx=0).stop 2023-11-27T20:45:22.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 -- 172.21.15.91:0/2961729012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 msgr2=0x7f5220157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:22.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 0x7f5220157720 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f521800cbc0 tx=0x7f521800a430 comp rx=0 tx=0).stop 2023-11-27T20:45:22.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 -- 172.21.15.91:0/2961729012 shutdown_connections 2023-11-27T20:45:22.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52200c5ec0 0x7f5220157720 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52200c45d0 0x7f52200a5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f520c06b1f0 0x7f520c06d6b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 --2- 172.21.15.91:0/2961729012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52200721a0 0x7f52201ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:22.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 -- 172.21.15.91:0/2961729012 >> 172.21.15.91:0/2961729012 conn(0x7f522006a500 msgr2=0x7f52200c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:22.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 -- 172.21.15.91:0/2961729012 shutdown_connections 2023-11-27T20:45:22.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:22.777+0000 7f5225483640 1 -- 172.21.15.91:0/2961729012 wait complete. 2023-11-27T20:45:22.798 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:23.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.013+0000 7f4da759e640 1 Processor -- start 2023-11-27T20:45:23.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.013+0000 7f4da759e640 1 -- start start 2023-11-27T20:45:23.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.014+0000 7f4da759e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4da014c2e0 0x7f4da00c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.014+0000 7f4da759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4da0072310 0x7f4da00a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.014+0000 7f4da759e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da0071e80 con 0x7f4da00c0440 2023-11-27T20:45:23.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.014+0000 7f4da759e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da0071470 con 0x7f4da0072310 2023-11-27T20:45:23.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.014+0000 7f4da759e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da014c6c0 con 0x7f4da014c2e0 2023-11-27T20:45:23.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.015+0000 7f4da5d9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f4da00c0440 0x7f4da0152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55948/0 (socket says 172.21.15.91:55948) 2023-11-27T20:45:23.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.015+0000 7f4da5d9b640 1 -- 172.21.15.91:0/1090867417 learned_addr learned my addr 172.21.15.91:0/1090867417 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:23.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.015+0000 7f4da6d9d640 1 --2- 172.21.15.91:0/1090867417 >> v2:172.21.15.91:3300/0 conn(0x7f4da0072310 0x7f4da00a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.015+0000 7f4da659c640 1 --2- 172.21.15.91:0/1090867417 >> v2:172.21.15.183:3300/0 conn(0x7f4da014c2e0 0x7f4da00c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.015+0000 7f4da559a640 1 -- 172.21.15.91:0/1090867417 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120347494 0 0) 0x7f4da0071e80 con 0x7f4da00c0440 2023-11-27T20:45:23.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.015+0000 7f4da559a640 1 -- 172.21.15.91:0/1090867417 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d8c003520 con 0x7f4da00c0440 2023-11-27T20:45:23.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.015+0000 7f4da6d9d640 1 -- 172.21.15.91:0/1090867417 >> v2:172.21.15.183:3300/0 conn(0x7f4da014c2e0 msgr2=0x7f4da00c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:23.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.015+0000 7f4da6d9d640 1 --2- 172.21.15.91:0/1090867417 >> v2:172.21.15.183:3300/0 conn(0x7f4da014c2e0 0x7f4da00c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.015+0000 7f4da6d9d640 1 -- 172.21.15.91:0/1090867417 >> v1:172.21.15.91:6789/0 conn(0x7f4da00c0440 legacy=0x7f4da0152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:23.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.015+0000 7f4da6d9d640 1 -- 172.21.15.91:0/1090867417 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da006fdc0 con 0x7f4da0072310 2023-11-27T20:45:23.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.016+0000 7f4da6d9d640 1 --2- 172.21.15.91:0/1090867417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da0072310 0x7f4da00a4d20 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f4da0067940 tx=0x7f4d9c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d46b50b052e256 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:23.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da559a640 1 -- 172.21.15.91:0/1090867417 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c02cb60 con 0x7f4da0072310 2023-11-27T20:45:23.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da559a640 1 -- 172.21.15.91:0/1090867417 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c02ccc0 con 0x7f4da0072310 2023-11-27T20:45:23.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da559a640 1 -- 172.21.15.91:0/1090867417 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c034660 con 0x7f4da0072310 2023-11-27T20:45:23.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da759e640 1 -- 172.21.15.91:0/1090867417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da0072310 msgr2=0x7f4da00a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:23.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da759e640 1 --2- 172.21.15.91:0/1090867417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da0072310 0x7f4da00a4d20 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f4da0067940 tx=0x7f4d9c02bdb0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da759e640 1 -- 172.21.15.91:0/1090867417 shutdown_connections 2023-11-27T20:45:23.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da759e640 1 --2- 172.21.15.91:0/1090867417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da0072310 0x7f4da00a4d20 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da759e640 1 --2- 172.21.15.91:0/1090867417 >> v2:172.21.15.183:3300/0 conn(0x7f4da014c2e0 0x7f4da00c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da759e640 1 -- 172.21.15.91:0/1090867417 >> 172.21.15.91:0/1090867417 conn(0x7f4da00a77f0 msgr2=0x7f4da00a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:23.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da759e640 1 -- 172.21.15.91:0/1090867417 shutdown_connections 2023-11-27T20:45:23.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.017+0000 7f4da759e640 1 -- 172.21.15.91:0/1090867417 wait complete. 2023-11-27T20:45:23.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.019+0000 7f4da759e640 1 Processor -- start 2023-11-27T20:45:23.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.019+0000 7f4da759e640 1 -- start start 2023-11-27T20:45:23.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.020+0000 7f4da759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4da0072310 0x7f4da01e8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.020+0000 7f4da759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da00c0440 0x7f4da00bf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.020+0000 7f4da759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4da014c2e0 0x7f4da01e49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.020+0000 7f4da759e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da01e87c0 con 0x7f4da00c0440 2023-11-27T20:45:23.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.020+0000 7f4da759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00be090 con 0x7f4da0072310 2023-11-27T20:45:23.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.020+0000 7f4da759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00bb2b0 con 0x7f4da014c2e0 2023-11-27T20:45:23.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.020+0000 7f4da5d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da00c0440 0x7f4da00bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4da5d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da00c0440 0x7f4da00bf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55068/0 (socket says 172.21.15.91:55068) 2023-11-27T20:45:23.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4da5d9b640 1 -- 172.21.15.91:0/1107831329 learned_addr learned my addr 172.21.15.91:0/1107831329 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:23.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4da6d9d640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4da014c2e0 0x7f4da01e49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4da5d9b640 1 -- 172.21.15.91:0/1107831329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4da014c2e0 msgr2=0x7f4da01e49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:23.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4da5d9b640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4da014c2e0 0x7f4da01e49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4da659c640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4da0072310 0x7f4da01e8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4da5d9b640 1 -- 172.21.15.91:0/1107831329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4da0072310 msgr2=0x7f4da01e8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:23.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4da5d9b640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4da0072310 0x7f4da01e8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4da5d9b640 1 -- 172.21.15.91:0/1107831329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c009a70 con 0x7f4da00c0440 2023-11-27T20:45:23.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4da5d9b640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da00c0440 0x7f4da00bf760 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800c500 tx=0x7f4d9800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:23.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.021+0000 7f4d92ffd640 1 -- 172.21.15.91:0/1107831329 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98005ce0 con 0x7f4da00c0440 2023-11-27T20:45:23.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.022+0000 7f4d92ffd640 1 -- 172.21.15.91:0/1107831329 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d98005e40 con 0x7f4da00c0440 2023-11-27T20:45:23.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.022+0000 7f4d92ffd640 1 -- 172.21.15.91:0/1107831329 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98007330 con 0x7f4da00c0440 2023-11-27T20:45:23.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.022+0000 7f4da759e640 1 -- 172.21.15.91:0/1107831329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da00bb590 con 0x7f4da00c0440 2023-11-27T20:45:23.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.022+0000 7f4da759e640 1 -- 172.21.15.91:0/1107831329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da00a9cf0 con 0x7f4da00c0440 2023-11-27T20:45:23.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.023+0000 7f4da759e640 1 -- 172.21.15.91:0/1107831329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da004e840 con 0x7f4da00c0440 2023-11-27T20:45:23.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.024+0000 7f4d92ffd640 1 -- 172.21.15.91:0/1107831329 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4d98007490 con 0x7f4da00c0440 2023-11-27T20:45:23.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.025+0000 7f4d92ffd640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1f0 0x7f4d8406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.025+0000 7f4d92ffd640 1 -- 172.21.15.91:0/1107831329 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f4d98089450 con 0x7f4da00c0440 2023-11-27T20:45:23.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.025+0000 7f4da659c640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1f0 0x7f4d8406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.026+0000 7f4da659c640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1f0 0x7f4d8406d6b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4d94006fd0 tx=0x7f4d94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:23.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.029+0000 7f4d92ffd640 1 -- 172.21.15.91:0/1107831329 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4d98053ea0 con 0x7f4da00c0440 2023-11-27T20:45:23.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.221+0000 7f4da759e640 1 -- 172.21.15.91:0/1107831329 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4da00c5380 con 0x7f4da00c0440 2023-11-27T20:45:23.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.225+0000 7f4d92ffd640 1 -- 172.21.15.91:0/1107831329 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+20289 (secure 0 0 0) 0x7f4d980574c0 con 0x7f4da00c0440 2023-11-27T20:45:23.227 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:23.227 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":80,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:21.787145+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:23.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 -- 172.21.15.91:0/1107831329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1f0 msgr2=0x7f4d8406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:23.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1f0 0x7f4d8406d6b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4d94006fd0 tx=0x7f4d94008040 comp rx=0 tx=0).stop 2023-11-27T20:45:23.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 -- 172.21.15.91:0/1107831329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da00c0440 msgr2=0x7f4da00bf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:23.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da00c0440 0x7f4da00bf760 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800c500 tx=0x7f4d9800c9c0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 -- 172.21.15.91:0/1107831329 shutdown_connections 2023-11-27T20:45:23.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4da014c2e0 0x7f4da01e49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4da00c0440 0x7f4da00bf760 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4d8406b1f0 0x7f4d8406d6b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 --2- 172.21.15.91:0/1107831329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4da0072310 0x7f4da01e8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 -- 172.21.15.91:0/1107831329 >> 172.21.15.91:0/1107831329 conn(0x7f4da00a77f0 msgr2=0x7f4da00a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:23.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 -- 172.21.15.91:0/1107831329 shutdown_connections 2023-11-27T20:45:23.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.228+0000 7f4da759e640 1 -- 172.21.15.91:0/1107831329 wait complete. 2023-11-27T20:45:23.249 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-27T20:45:23.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.465+0000 7f78d95b6640 1 Processor -- start 2023-11-27T20:45:23.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.466+0000 7f78d95b6640 1 -- start start 2023-11-27T20:45:23.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.467+0000 7f78d95b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78d4151af0 0x7f78d4155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.467+0000 7f78d95b6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f78d40c1020 0x7f78d406e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.467+0000 7f78d95b6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d406eed0 con 0x7f78d406b510 2023-11-27T20:45:23.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.467+0000 7f78d95b6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d406dd30 con 0x7f78d40c1020 2023-11-27T20:45:23.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.467+0000 7f78d95b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d406d770 con 0x7f78d4151af0 2023-11-27T20:45:23.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.467+0000 7f78d37fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f78d406b510 0x7f78d41581a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55958/0 (socket says 172.21.15.91:55958) 2023-11-27T20:45:23.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d37fe640 1 -- 172.21.15.91:0/1975827490 learned_addr learned my addr 172.21.15.91:0/1975827490 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:23.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d2ffd640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78d4151af0 0x7f78d4155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942788023 0 0) 0x7f78d406eed0 con 0x7f78d406b510 2023-11-27T20:45:23.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78bc003520 con 0x7f78d406b510 2023-11-27T20:45:23.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d27fc640 1 --2- 172.21.15.91:0/1975827490 >> v2:172.21.15.183:3300/0 conn(0x7f78d40c1020 0x7f78d406e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564735985 0 0) 0x7f78bc003520 con 0x7f78d406b510 2023-11-27T20:45:23.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78d4151af0 msgr2=0x7f78d4155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:23.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78d4151af0 0x7f78d4155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 >> v2:172.21.15.183:3300/0 conn(0x7f78d40c1020 msgr2=0x7f78d406e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 --2- 172.21.15.91:0/1975827490 >> v2:172.21.15.183:3300/0 conn(0x7f78d40c1020 0x7f78d406e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d406da50 con 0x7f78d406b510 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f78cc0019f0 con 0x7f78d406b510 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 >> v1:172.21.15.91:6789/0 conn(0x7f78d406b510 legacy=0x7f78d41581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78bc003970 0x7f78bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78bc0047c0 0x7f78bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78bc005180 0x7f78bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.468+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d406dd30 con 0x7f78bc005180 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.469+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d406d770 con 0x7f78bc0047c0 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.469+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc00c050 con 0x7f78bc003970 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.469+0000 7f78d27fc640 1 --2- 172.21.15.91:0/1975827490 >> v2:172.21.15.183:3300/0 conn(0x7f78d40c1020 0x7f78d406e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.469+0000 7f78d2ffd640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78d4151af0 0x7f78d4155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:45:23.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.469+0000 7f78d37fe640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78bc005180 0x7f78bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.469+0000 7f78d37fe640 1 -- 172.21.15.91:0/1975827490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78bc003970 msgr2=0x7f78bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:23.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.469+0000 7f78d37fe640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78bc003970 0x7f78bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.469+0000 7f78d37fe640 1 -- 172.21.15.91:0/1975827490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78bc0047c0 msgr2=0x7f78bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:23.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.469+0000 7f78d37fe640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78bc0047c0 0x7f78bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.469+0000 7f78d37fe640 1 -- 172.21.15.91:0/1975827490 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc003520 con 0x7f78bc005180 2023-11-27T20:45:23.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.470+0000 7f78d37fe640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78bc005180 0x7f78bc00b980 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00a860 tx=0x7f78bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646ac11fa7b3b4b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:23.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.470+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc034630 con 0x7f78bc005180 2023-11-27T20:45:23.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.470+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc02f070 con 0x7f78bc005180 2023-11-27T20:45:23.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.470+0000 7f78d1ffb640 1 -- 172.21.15.91:0/1975827490 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc034a30 con 0x7f78bc005180 2023-11-27T20:45:23.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.471+0000 7f78d95b6640 1 -- 172.21.15.91:0/1975827490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78bc005180 msgr2=0x7f78bc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:23.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.471+0000 7f78d95b6640 1 --2- 172.21.15.91:0/1975827490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78bc005180 0x7f78bc00b980 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00a860 tx=0x7f78bc0057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.471+0000 7f78d37fe640 1 -- 172.21.15.91:0/1975827490 reap_dead start 2023-11-27T20:45:23.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.471+0000 7f78d95b6640 1 -- 172.21.15.91:0/1975827490 shutdown_connections 2023-11-27T20:45:23.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.471+0000 7f78d95b6640 1 -- 172.21.15.91:0/1975827490 >> 172.21.15.91:0/1975827490 conn(0x7f78d40c3120 msgr2=0x7f78d40c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:23.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.471+0000 7f78d95b6640 1 -- 172.21.15.91:0/1975827490 shutdown_connections 2023-11-27T20:45:23.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.471+0000 7f78d95b6640 1 -- 172.21.15.91:0/1975827490 wait complete. 2023-11-27T20:45:23.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.473+0000 7f78d95b6640 1 Processor -- start 2023-11-27T20:45:23.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.473+0000 7f78d95b6640 1 -- start start 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d95b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78bc005180 0x7f78d4071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d95b6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78d414bd90 0x7f78d4143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d95b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78d4146c70 0x7f78d41444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d95b6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d40a9980 con 0x7f78d414bd90 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d95b6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d40a9450 con 0x7f78bc005180 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d95b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d40a96a0 con 0x7f78d4146c70 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d27fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78d414bd90 0x7f78d4143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d27fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78d414bd90 0x7f78d4143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55090/0 (socket says 172.21.15.91:55090) 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d27fc640 1 -- 172.21.15.91:0/4019220204 learned_addr learned my addr 172.21.15.91:0/4019220204 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d27fc640 1 -- 172.21.15.91:0/4019220204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78d4146c70 msgr2=0x7f78d41444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:23.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d27fc640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78d4146c70 0x7f78d41444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d27fc640 1 -- 172.21.15.91:0/4019220204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78bc005180 msgr2=0x7f78d4071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:23.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.474+0000 7f78d27fc640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78bc005180 0x7f78d4071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:23.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.475+0000 7f78d27fc640 1 -- 172.21.15.91:0/4019220204 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d41edcc0 con 0x7f78d414bd90 2023-11-27T20:45:23.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.475+0000 7f78d27fc640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78d414bd90 0x7f78d4143f60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f78c800e810 tx=0x7f78c800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:23.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.475+0000 7f78bb7fe640 1 -- 172.21.15.91:0/4019220204 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8004030 con 0x7f78d414bd90 2023-11-27T20:45:23.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.475+0000 7f78bb7fe640 1 -- 172.21.15.91:0/4019220204 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c8004190 con 0x7f78d414bd90 2023-11-27T20:45:23.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.475+0000 7f78bb7fe640 1 -- 172.21.15.91:0/4019220204 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8004520 con 0x7f78d414bd90 2023-11-27T20:45:23.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.475+0000 7f78d95b6640 1 -- 172.21.15.91:0/4019220204 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d41edfa0 con 0x7f78d414bd90 2023-11-27T20:45:23.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.475+0000 7f78d95b6640 1 -- 172.21.15.91:0/4019220204 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d41449e0 con 0x7f78d414bd90 2023-11-27T20:45:23.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.476+0000 7f78d95b6640 1 -- 172.21.15.91:0/4019220204 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d4066ac0 con 0x7f78d414bd90 2023-11-27T20:45:23.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.477+0000 7f78bb7fe640 1 -- 172.21.15.91:0/4019220204 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f78c800c650 con 0x7f78d414bd90 2023-11-27T20:45:23.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.478+0000 7f78bb7fe640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c006b1c0 0x7f78c006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:23.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.478+0000 7f78bb7fe640 1 -- 172.21.15.91:0/4019220204 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f78c80898d0 con 0x7f78d414bd90 2023-11-27T20:45:23.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.478+0000 7f78d2ffd640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c006b1c0 0x7f78c006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:23.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.479+0000 7f78d2ffd640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c006b1c0 0x7f78c006d680 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f78c4006fd0 tx=0x7f78c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:23.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.482+0000 7f78bb7fe640 1 -- 172.21.15.91:0/4019220204 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f78c8054300 con 0x7f78d414bd90 2023-11-27T20:45:23.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:23.711+0000 7f78d95b6640 1 -- 172.21.15.91:0/4019220204 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f78d41edb20 con 0x7f78d414bd90 2023-11-27T20:45:24.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.368+0000 7f78bb7fe640 1 -- 172.21.15.91:0/4019220204 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 119+0+0 (secure 0 0 0) 0x7f78d41edb20 con 0x7f78d414bd90 2023-11-27T20:45:24.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 -- 172.21.15.91:0/4019220204 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c006b1c0 msgr2=0x7f78c006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:24.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c006b1c0 0x7f78c006d680 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f78c4006fd0 tx=0x7f78c4008040 comp rx=0 tx=0).stop 2023-11-27T20:45:24.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 -- 172.21.15.91:0/4019220204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78d414bd90 msgr2=0x7f78d4143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:24.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78d414bd90 0x7f78d4143f60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f78c800e810 tx=0x7f78c800ecd0 comp rx=0 tx=0).stop 2023-11-27T20:45:24.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 -- 172.21.15.91:0/4019220204 shutdown_connections 2023-11-27T20:45:24.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78d4146c70 0x7f78d41444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:24.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78d414bd90 0x7f78d4143f60 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:24.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f78c006b1c0 0x7f78c006d680 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:24.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 --2- 172.21.15.91:0/4019220204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78bc005180 0x7f78d4071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:24.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 -- 172.21.15.91:0/4019220204 >> 172.21.15.91:0/4019220204 conn(0x7f78d40c3120 msgr2=0x7f78d4150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:24.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 -- 172.21.15.91:0/4019220204 shutdown_connections 2023-11-27T20:45:24.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.372+0000 7f78d95b6640 1 -- 172.21.15.91:0/4019220204 wait complete. 2023-11-27T20:45:24.394 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T20:45:24.394 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-27T20:45:24.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.609+0000 7ff8a1d7c640 1 Processor -- start 2023-11-27T20:45:24.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.609+0000 7ff8a1d7c640 1 -- start start 2023-11-27T20:45:24.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff8a1d7c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff89c151fd0 0x7ff89c06e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:24.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff8a1d7c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff89c0c3400 0x7ff89c06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:24.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff8a1d7c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c071fd0 con 0x7ff89c06aa40 2023-11-27T20:45:24.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff8a1d7c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c06ee50 con 0x7ff89c151fd0 2023-11-27T20:45:24.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff8a1d7c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c072220 con 0x7ff89c0c3400 2023-11-27T20:45:24.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff89b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff89c151fd0 0x7ff89c06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:24.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff89b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff89c151fd0 0x7ff89c06e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37018/0 (socket says 172.21.15.91:37018) 2023-11-27T20:45:24.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff89b7fe640 1 -- 172.21.15.91:0/1409898720 learned_addr learned my addr 172.21.15.91:0/1409898720 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:24.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff89b7fe640 1 -- 172.21.15.91:0/1409898720 >> v2:172.21.15.183:3300/0 conn(0x7ff89c0c3400 msgr2=0x7ff89c06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:24.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff89b7fe640 1 --2- 172.21.15.91:0/1409898720 >> v2:172.21.15.183:3300/0 conn(0x7ff89c0c3400 0x7ff89c06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:24.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff89b7fe640 1 -- 172.21.15.91:0/1409898720 >> v1:172.21.15.183:6789/0 conn(0x7ff89c06aa40 legacy=0x7ff89c157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:24.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.611+0000 7ff89b7fe640 1 -- 172.21.15.91:0/1409898720 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c06e0d0 con 0x7ff89c151fd0 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.612+0000 7ff89b7fe640 1 --2- 172.21.15.91:0/1409898720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 0x7ff89c06e910 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ff89c06ddb0 tx=0x7ff88c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f322b2c689870c69 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff89affd640 1 -- 172.21.15.91:0/1409898720 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c02c9f0 con 0x7ff89c151fd0 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff89affd640 1 -- 172.21.15.91:0/1409898720 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c02cb50 con 0x7ff89c151fd0 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff89affd640 1 -- 172.21.15.91:0/1409898720 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0343f0 con 0x7ff89c151fd0 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/1409898720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 msgr2=0x7ff89c06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff8a1d7c640 1 --2- 172.21.15.91:0/1409898720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 0x7ff89c06e910 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ff89c06ddb0 tx=0x7ff88c02be50 comp rx=0 tx=0).stop 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/1409898720 shutdown_connections 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff8a1d7c640 1 --2- 172.21.15.91:0/1409898720 >> v2:172.21.15.183:3300/0 conn(0x7ff89c0c3400 0x7ff89c06a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff8a1d7c640 1 --2- 172.21.15.91:0/1409898720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 0x7ff89c06e910 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/1409898720 >> 172.21.15.91:0/1409898720 conn(0x7ff89c0c6ee0 msgr2=0x7ff89c0c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:24.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/1409898720 shutdown_connections 2023-11-27T20:45:24.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.613+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/1409898720 wait complete. 2023-11-27T20:45:24.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.615+0000 7ff8a1d7c640 1 Processor -- start 2023-11-27T20:45:24.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.615+0000 7ff8a1d7c640 1 -- start start 2023-11-27T20:45:24.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff8a1d7c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff89c06aa40 0x7ff89c1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:24.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff8a1d7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff89c0c3400 0x7ff89c1ea830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:24.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff8a1d7c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 0x7ff89c1ead70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:24.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff8a1d7c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c152e40 con 0x7ff89c151fd0 2023-11-27T20:45:24.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff8a1d7c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c152640 con 0x7ff89c06aa40 2023-11-27T20:45:24.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff8a1d7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c1ea3a0 con 0x7ff89c0c3400 2023-11-27T20:45:24.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff89bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 0x7ff89c1ead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:24.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff89bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 0x7ff89c1ead70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37020/0 (socket says 172.21.15.91:37020) 2023-11-27T20:45:24.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff89bfff640 1 -- 172.21.15.91:0/2264162900 learned_addr learned my addr 172.21.15.91:0/2264162900 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:24.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff89bfff640 1 -- 172.21.15.91:0/2264162900 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff89c0c3400 msgr2=0x7ff89c1ea830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:24.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff89bfff640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff89c0c3400 0x7ff89c1ea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:24.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff89bfff640 1 -- 172.21.15.91:0/2264162900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff89c06aa40 msgr2=0x7ff89c1464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:24.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff89bfff640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff89c06aa40 0x7ff89c1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:24.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.616+0000 7ff89bfff640 1 -- 172.21.15.91:0/2264162900 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c009b30 con 0x7ff89c151fd0 2023-11-27T20:45:24.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.617+0000 7ff89bfff640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 0x7ff89c1ead70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff89400c390 tx=0x7ff89400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:24.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.617+0000 7ff898ff9640 1 -- 172.21.15.91:0/2264162900 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8940035f0 con 0x7ff89c151fd0 2023-11-27T20:45:24.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.617+0000 7ff898ff9640 1 -- 172.21.15.91:0/2264162900 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff894003750 con 0x7ff89c151fd0 2023-11-27T20:45:24.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.617+0000 7ff898ff9640 1 -- 172.21.15.91:0/2264162900 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894003b00 con 0x7ff89c151fd0 2023-11-27T20:45:24.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.617+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/2264162900 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c152890 con 0x7ff89c151fd0 2023-11-27T20:45:24.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.617+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/2264162900 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c0c68a0 con 0x7ff89c151fd0 2023-11-27T20:45:24.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.618+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/2264162900 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89c068350 con 0x7ff89c151fd0 2023-11-27T20:45:24.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.619+0000 7ff898ff9640 1 -- 172.21.15.91:0/2264162900 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff894003c60 con 0x7ff89c151fd0 2023-11-27T20:45:24.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.621+0000 7ff898ff9640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff87c06b1c0 0x7ff87c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:24.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.621+0000 7ff898ff9640 1 -- 172.21.15.91:0/2264162900 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7ff894088fa0 con 0x7ff89c151fd0 2023-11-27T20:45:24.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.621+0000 7ff89b7fe640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff87c06b1c0 0x7ff87c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:24.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.621+0000 7ff89b7fe640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff87c06b1c0 0x7ff87c06d680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff88c035000 tx=0x7ff88c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:24.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.625+0000 7ff898ff9640 1 -- 172.21.15.91:0/2264162900 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff8940bbe90 con 0x7ff89c151fd0 2023-11-27T20:45:24.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:24.855+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/2264162900 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff89c0c7c60 con 0x7ff89c151fd0 2023-11-27T20:45:25.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.371+0000 7ff898ff9640 1 -- 172.21.15.91:0/2264162900 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff8940170c0 con 0x7ff89c151fd0 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.375+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/2264162900 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff87c06b1c0 msgr2=0x7ff87c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.375+0000 7ff8a1d7c640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff87c06b1c0 0x7ff87c06d680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff88c035000 tx=0x7ff88c02e000 comp rx=0 tx=0).stop 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.375+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/2264162900 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 msgr2=0x7ff89c1ead70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.375+0000 7ff8a1d7c640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 0x7ff89c1ead70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff89400c390 tx=0x7ff89400c850 comp rx=0 tx=0).stop 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.375+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/2264162900 shutdown_connections 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.375+0000 7ff8a1d7c640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff89c151fd0 0x7ff89c1ead70 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.375+0000 7ff8a1d7c640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff89c0c3400 0x7ff89c1ea830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.375+0000 7ff8a1d7c640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff87c06b1c0 0x7ff87c06d680 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.375+0000 7ff8a1d7c640 1 --2- 172.21.15.91:0/2264162900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff89c06aa40 0x7ff89c1464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.375+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/2264162900 >> 172.21.15.91:0/2264162900 conn(0x7ff89c0c6ee0 msgr2=0x7ff89c1479c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.376+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/2264162900 shutdown_connections 2023-11-27T20:45:25.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.376+0000 7ff8a1d7c640 1 -- 172.21.15.91:0/2264162900 wait complete. 2023-11-27T20:45:25.398 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-27T20:45:25.398 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:45:25.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.614+0000 7f1fae1be640 1 Processor -- start 2023-11-27T20:45:25.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.615+0000 7f1fae1be640 1 -- start start 2023-11-27T20:45:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.616+0000 7f1fae1be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fa8155490 0x7f1fa80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.616+0000 7f1fae1be640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1fa80c1500 0x7f1fa80a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.616+0000 7f1fae1be640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1fa80c4080 0x7f1fa80a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.616+0000 7f1fae1be640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa80a5820 con 0x7f1fa80c4080 2023-11-27T20:45:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.616+0000 7f1fae1be640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa80c06c0 con 0x7f1fa80c1500 2023-11-27T20:45:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.616+0000 7f1fae1be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80c1020 con 0x7f1fa8155490 2023-11-27T20:45:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.616+0000 7f1fa7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1fa80c4080 0x7f1fa80a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.616+0000 7f1fa7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1fa80c4080 0x7f1fa80a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37030/0 (socket says 172.21.15.91:37030) 2023-11-27T20:45:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.616+0000 7f1fa7fff640 1 -- 172.21.15.91:0/1910646256 learned_addr learned my addr 172.21.15.91:0/1910646256 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.617+0000 7f1fa77fe640 1 --2- 172.21.15.91:0/1910646256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fa8155490 0x7f1fa80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.617+0000 7f1fa7fff640 1 -- 172.21.15.91:0/1910646256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fa8155490 msgr2=0x7f1fa80a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.617+0000 7f1fa7fff640 1 --2- 172.21.15.91:0/1910646256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fa8155490 0x7f1fa80a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.617+0000 7f1fa7fff640 1 -- 172.21.15.91:0/1910646256 >> v2:172.21.15.183:3300/0 conn(0x7f1fa80c1500 msgr2=0x7f1fa80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.617+0000 7f1f9ffff640 1 --2- 172.21.15.91:0/1910646256 >> v2:172.21.15.183:3300/0 conn(0x7f1fa80c1500 0x7f1fa80a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:25.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.617+0000 7f1fa7fff640 1 --2- 172.21.15.91:0/1910646256 >> v2:172.21.15.183:3300/0 conn(0x7f1fa80c1500 0x7f1fa80a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.617+0000 7f1fa7fff640 1 -- 172.21.15.91:0/1910646256 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80c0910 con 0x7f1fa80c4080 2023-11-27T20:45:25.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.618+0000 7f1fa7fff640 1 --2- 172.21.15.91:0/1910646256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c4080 0x7f1fa80a9970 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f1fa806b280 tx=0x7f1fa002e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1702e6d422f58e89 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:25.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.618+0000 7f1fa6ffd640 1 -- 172.21.15.91:0/1910646256 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa002ea00 con 0x7f1fa80c4080 2023-11-27T20:45:25.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.618+0000 7f1fa6ffd640 1 -- 172.21.15.91:0/1910646256 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa002eb60 con 0x7f1fa80c4080 2023-11-27T20:45:25.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.618+0000 7f1fa6ffd640 1 -- 172.21.15.91:0/1910646256 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0009600 con 0x7f1fa80c4080 2023-11-27T20:45:25.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.619+0000 7f1fae1be640 1 -- 172.21.15.91:0/1910646256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c4080 msgr2=0x7f1fa80a9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:25.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.619+0000 7f1fae1be640 1 --2- 172.21.15.91:0/1910646256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c4080 0x7f1fa80a9970 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f1fa806b280 tx=0x7f1fa002e060 comp rx=0 tx=0).stop 2023-11-27T20:45:25.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.619+0000 7f1fae1be640 1 -- 172.21.15.91:0/1910646256 shutdown_connections 2023-11-27T20:45:25.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.619+0000 7f1fae1be640 1 --2- 172.21.15.91:0/1910646256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c4080 0x7f1fa80a9970 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.619+0000 7f1fae1be640 1 --2- 172.21.15.91:0/1910646256 >> v2:172.21.15.183:3300/0 conn(0x7f1fa80c1500 0x7f1fa80a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.619+0000 7f1fae1be640 1 --2- 172.21.15.91:0/1910646256 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fa8155490 0x7f1fa80a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.619+0000 7f1fae1be640 1 -- 172.21.15.91:0/1910646256 >> 172.21.15.91:0/1910646256 conn(0x7f1fa806a500 msgr2=0x7f1fa806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.619+0000 7f1fae1be640 1 -- 172.21.15.91:0/1910646256 shutdown_connections 2023-11-27T20:45:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.619+0000 7f1fae1be640 1 -- 172.21.15.91:0/1910646256 wait complete. 2023-11-27T20:45:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.621+0000 7f1fae1be640 1 Processor -- start 2023-11-27T20:45:25.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.621+0000 7f1fae1be640 1 -- start start 2023-11-27T20:45:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.622+0000 7f1fae1be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fa80c1500 0x7f1fa809a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.622+0000 7f1fae1be640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fa80c4080 0x7f1fa80710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.622+0000 7f1fae1be640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa8155490 0x7f1fa81e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.622+0000 7f1fae1be640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8070cc0 con 0x7f1fa8155490 2023-11-27T20:45:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.622+0000 7f1fae1be640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81e78c0 con 0x7f1fa80c4080 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.622+0000 7f1fae1be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81eab50 con 0x7f1fa80c1500 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.622+0000 7f1fa7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa8155490 0x7f1fa81e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.622+0000 7f1fa7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa8155490 0x7f1fa81e9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37036/0 (socket says 172.21.15.91:37036) 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.622+0000 7f1fa7fff640 1 -- 172.21.15.91:0/682199801 learned_addr learned my addr 172.21.15.91:0/682199801 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fa7fff640 1 -- 172.21.15.91:0/682199801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fa80c1500 msgr2=0x7f1fa809a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.622+0000 7f1fa77fe640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fa80c1500 0x7f1fa809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fa7fff640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fa80c1500 0x7f1fa809a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fa7fff640 1 -- 172.21.15.91:0/682199801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fa80c4080 msgr2=0x7f1fa80710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1f9ffff640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fa80c4080 0x7f1fa80710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fa7fff640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fa80c4080 0x7f1fa80710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fa7fff640 1 -- 172.21.15.91:0/682199801 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa000bd40 con 0x7f1fa8155490 2023-11-27T20:45:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fa7fff640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa8155490 0x7f1fa81e9e80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0038040 tx=0x7f1fa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:25.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fa4ff9640 1 -- 172.21.15.91:0/682199801 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0036800 con 0x7f1fa8155490 2023-11-27T20:45:25.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fa4ff9640 1 -- 172.21.15.91:0/682199801 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa0036960 con 0x7f1fa8155490 2023-11-27T20:45:25.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fae1be640 1 -- 172.21.15.91:0/682199801 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa809ae20 con 0x7f1fa8155490 2023-11-27T20:45:25.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fa4ff9640 1 -- 172.21.15.91:0/682199801 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0036d10 con 0x7f1fa8155490 2023-11-27T20:45:25.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.623+0000 7f1fae1be640 1 -- 172.21.15.91:0/682199801 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa81ea870 con 0x7f1fa8155490 2023-11-27T20:45:25.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.624+0000 7f1fae1be640 1 -- 172.21.15.91:0/682199801 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa8070e00 con 0x7f1fa8155490 2023-11-27T20:45:25.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.625+0000 7f1fa4ff9640 1 -- 172.21.15.91:0/682199801 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1fa004a460 con 0x7f1fa8155490 2023-11-27T20:45:25.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.626+0000 7f1fa4ff9640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1f8806b1c0 0x7f1f8806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:25.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.626+0000 7f1fa4ff9640 1 -- 172.21.15.91:0/682199801 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f1fa00ad2f0 con 0x7f1fa8155490 2023-11-27T20:45:25.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.627+0000 7f1fa77fe640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1f8806b1c0 0x7f1f8806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:25.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.627+0000 7f1fa77fe640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1f8806b1c0 0x7f1f8806d680 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800b7c0 tx=0x7f1f98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:25.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.631+0000 7f1fa4ff9640 1 -- 172.21.15.91:0/682199801 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1fa8070e00 con 0x7f1fa8155490 2023-11-27T20:45:25.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.860+0000 7f1fae1be640 1 -- 172.21.15.91:0/682199801 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fa8070e00 con 0x7f1fa8155490 2023-11-27T20:45:25.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.861+0000 7f1fa4ff9640 1 -- 172.21.15.91:0/682199801 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6140 (secure 0 0 0) 0x7f1fa8070e00 con 0x7f1fa8155490 2023-11-27T20:45:25.862 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:25.863 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:06.072742+0000","modified":"2023-11-27T20:45:09.133844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/2103536114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":2103536114},{"type":"v1","addr":"172.21.15.183:6835","nonce":2103536114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:21.787805+0000","modified":"2023-11-27T20:45:24.857169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/1761528163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1761528163},{"type":"v1","addr":"172.21.15.91:6837","nonce":1761528163}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-27T20:45:25.863 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 51 2023-11-27T20:45:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.863+0000 7f1fae1be640 1 -- 172.21.15.91:0/682199801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1f8806b1c0 msgr2=0x7f1f8806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.863+0000 7f1fae1be640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1f8806b1c0 0x7f1f8806d680 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800b7c0 tx=0x7f1f98008040 comp rx=0 tx=0).stop 2023-11-27T20:45:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.863+0000 7f1fae1be640 1 -- 172.21.15.91:0/682199801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa8155490 msgr2=0x7f1fa81e9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.863+0000 7f1fae1be640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa8155490 0x7f1fa81e9e80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0038040 tx=0x7f1fa0004a40 comp rx=0 tx=0).stop 2023-11-27T20:45:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.863+0000 7f1fae1be640 1 -- 172.21.15.91:0/682199801 shutdown_connections 2023-11-27T20:45:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.863+0000 7f1fae1be640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa8155490 0x7f1fa81e9e80 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.863+0000 7f1fae1be640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f1f8806b1c0 0x7f1f8806d680 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.863+0000 7f1fae1be640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fa80c4080 0x7f1fa80710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.863+0000 7f1fae1be640 1 --2- 172.21.15.91:0/682199801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fa80c1500 0x7f1fa809a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:25.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.863+0000 7f1fae1be640 1 -- 172.21.15.91:0/682199801 >> 172.21.15.91:0/682199801 conn(0x7f1fa806a500 msgr2=0x7f1fa80aa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:25.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.864+0000 7f1fae1be640 1 -- 172.21.15.91:0/682199801 shutdown_connections 2023-11-27T20:45:25.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:25.864+0000 7f1fae1be640 1 -- 172.21.15.91:0/682199801 wait complete. 2023-11-27T20:45:25.885 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:26.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.096+0000 7f7cc8fe5640 1 Processor -- start 2023-11-27T20:45:26.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.096+0000 7f7cc8fe5640 1 -- start start 2023-11-27T20:45:26.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.097+0000 7f7cc8fe5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 0x7f7cc4156260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.097+0000 7f7cc8fe5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7cc40c0a50 0x7f7cc414f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.097+0000 7f7cc8fe5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc40c05c0 con 0x7f7cc4155e80 2023-11-27T20:45:26.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.098+0000 7f7cc8fe5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc40c11b0 con 0x7f7cc40c0a50 2023-11-27T20:45:26.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.098+0000 7f7cc8fe5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc406de60 con 0x7f7cc40a50e0 2023-11-27T20:45:26.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.098+0000 7f7cb9d9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 0x7f7cc4156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:26.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.098+0000 7f7cb9d9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 0x7f7cc4156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:48602/0 (socket says 172.21.15.91:48602) 2023-11-27T20:45:26.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.098+0000 7f7cb9d9b640 1 -- 172.21.15.91:0/1326416950 learned_addr learned my addr 172.21.15.91:0/1326416950 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:26.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.098+0000 7f7cc2d9d640 1 --2- 172.21.15.91:0/1326416950 >> v2:172.21.15.183:3300/0 conn(0x7f7cc40c0a50 0x7f7cc414f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:26.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.099+0000 7f7cb9d9b640 1 -- 172.21.15.91:0/1326416950 >> v2:172.21.15.183:3300/0 conn(0x7f7cc40c0a50 msgr2=0x7f7cc414f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:26.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.099+0000 7f7cb9d9b640 1 --2- 172.21.15.91:0/1326416950 >> v2:172.21.15.183:3300/0 conn(0x7f7cc40c0a50 0x7f7cc414f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.099+0000 7f7cb9d9b640 1 -- 172.21.15.91:0/1326416950 >> v1:172.21.15.183:6789/0 conn(0x7f7cc4155e80 legacy=0x7f7cc40c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.099+0000 7f7cb9d9b640 1 -- 172.21.15.91:0/1326416950 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4156b50 con 0x7f7cc40a50e0 2023-11-27T20:45:26.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.100+0000 7f7cb9d9b640 1 --2- 172.21.15.91:0/1326416950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 0x7f7cc4156260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009e50 tx=0x7f7cac02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37bd1cee627924ea server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:26.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.101+0000 7f7cc1d9b640 1 -- 172.21.15.91:0/1326416950 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac02c9e0 con 0x7f7cc40a50e0 2023-11-27T20:45:26.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.101+0000 7f7cc1d9b640 1 -- 172.21.15.91:0/1326416950 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac02cb40 con 0x7f7cc40a50e0 2023-11-27T20:45:26.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.101+0000 7f7cc1d9b640 1 -- 172.21.15.91:0/1326416950 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0343f0 con 0x7f7cc40a50e0 2023-11-27T20:45:26.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.102+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/1326416950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 msgr2=0x7f7cc4156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.102+0000 7f7cc8fe5640 1 --2- 172.21.15.91:0/1326416950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 0x7f7cc4156260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009e50 tx=0x7f7cac02be40 comp rx=0 tx=0).stop 2023-11-27T20:45:26.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.102+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/1326416950 shutdown_connections 2023-11-27T20:45:26.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.102+0000 7f7cc8fe5640 1 --2- 172.21.15.91:0/1326416950 >> v2:172.21.15.183:3300/0 conn(0x7f7cc40c0a50 0x7f7cc414f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.102+0000 7f7cc8fe5640 1 --2- 172.21.15.91:0/1326416950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 0x7f7cc4156260 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.102+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/1326416950 >> 172.21.15.91:0/1326416950 conn(0x7f7cc40a7970 msgr2=0x7f7cc40a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:26.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.102+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/1326416950 shutdown_connections 2023-11-27T20:45:26.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.102+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/1326416950 wait complete. 2023-11-27T20:45:26.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.104+0000 7f7cc8fe5640 1 Processor -- start 2023-11-27T20:45:26.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.104+0000 7f7cc8fe5640 1 -- start start 2023-11-27T20:45:26.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.105+0000 7f7cc8fe5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 0x7f7cc4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.105+0000 7f7cc8fe5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7cc40c0a50 0x7f7cc40bf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.105+0000 7f7cc8fe5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cc4155e80 0x7f7cc40bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.105+0000 7f7cc8fe5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc41ea370 con 0x7f7cc40c0a50 2023-11-27T20:45:26.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.105+0000 7f7cc8fe5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc41ea610 con 0x7f7cc4155e80 2023-11-27T20:45:26.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.105+0000 7f7cc8fe5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc41ea8f0 con 0x7f7cc40a50e0 2023-11-27T20:45:26.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.105+0000 7f7cb9d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7cc40c0a50 0x7f7cc40bf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:26.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.105+0000 7f7cb9d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7cc40c0a50 0x7f7cc40bf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37040/0 (socket says 172.21.15.91:37040) 2023-11-27T20:45:26.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.105+0000 7f7cb9d9b640 1 -- 172.21.15.91:0/2248059099 learned_addr learned my addr 172.21.15.91:0/2248059099 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:26.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.105+0000 7f7cc259c640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 0x7f7cc4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cc2d9d640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cc4155e80 0x7f7cc40bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cb9d9b640 1 -- 172.21.15.91:0/2248059099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 msgr2=0x7f7cc4071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cb9d9b640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 0x7f7cc4071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cb9d9b640 1 -- 172.21.15.91:0/2248059099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cc4155e80 msgr2=0x7f7cc40bdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cb9d9b640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cc4155e80 0x7f7cc40bdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cb9d9b640 1 -- 172.21.15.91:0/2248059099 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac009b30 con 0x7f7cc40c0a50 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cb9d9b640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7cc40c0a50 0x7f7cc40bf840 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f7cac000f80 tx=0x7f7cac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cbb7fe640 1 -- 172.21.15.91:0/2248059099 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac009510 con 0x7f7cc40c0a50 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cbb7fe640 1 -- 172.21.15.91:0/2248059099 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac03e450 con 0x7f7cc40c0a50 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/2248059099 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc41eabd0 con 0x7f7cc40c0a50 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cbb7fe640 1 -- 172.21.15.91:0/2248059099 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac03e800 con 0x7f7cc40c0a50 2023-11-27T20:45:26.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.106+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/2248059099 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc4071960 con 0x7f7cc40c0a50 2023-11-27T20:45:26.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.108+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/2248059099 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc41eb0f0 con 0x7f7cc40c0a50 2023-11-27T20:45:26.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.109+0000 7f7cbb7fe640 1 -- 172.21.15.91:0/2248059099 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7cac03e960 con 0x7f7cc40c0a50 2023-11-27T20:45:26.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.109+0000 7f7cbb7fe640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ca406b1c0 0x7f7ca406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.109+0000 7f7cbb7fe640 1 -- 172.21.15.91:0/2248059099 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f7cac0acb90 con 0x7f7cc40c0a50 2023-11-27T20:45:26.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.110+0000 7f7cc259c640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ca406b1c0 0x7f7ca406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:26.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.110+0000 7f7cc259c640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ca406b1c0 0x7f7ca406d680 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4000f60 tx=0x7f7cb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:26.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.114+0000 7f7cbb7fe640 1 -- 172.21.15.91:0/2248059099 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7cac0774a0 con 0x7f7cc40c0a50 2023-11-27T20:45:26.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.306+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/2248059099 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cc4153ef0 con 0x7f7cc40c0a50 2023-11-27T20:45:26.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.310+0000 7f7cbb7fe640 1 -- 172.21.15.91:0/2248059099 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f7cac07aac0 con 0x7f7cc40c0a50 2023-11-27T20:45:26.312 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:26.312 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":81,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:23.334850+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:26.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.312+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/2248059099 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ca406b1c0 msgr2=0x7f7ca406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.312+0000 7f7cc8fe5640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ca406b1c0 0x7f7ca406d680 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4000f60 tx=0x7f7cb4009040 comp rx=0 tx=0).stop 2023-11-27T20:45:26.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.312+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/2248059099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7cc40c0a50 msgr2=0x7f7cc40bf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.312+0000 7f7cc8fe5640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7cc40c0a50 0x7f7cc40bf840 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f7cac000f80 tx=0x7f7cac004a40 comp rx=0 tx=0).stop 2023-11-27T20:45:26.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.313+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/2248059099 shutdown_connections 2023-11-27T20:45:26.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.313+0000 7f7cc8fe5640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7ca406b1c0 0x7f7ca406d680 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.313+0000 7f7cc8fe5640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cc4155e80 0x7f7cc40bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.313+0000 7f7cc8fe5640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7cc40c0a50 0x7f7cc40bf840 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.313+0000 7f7cc8fe5640 1 --2- 172.21.15.91:0/2248059099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cc40a50e0 0x7f7cc4071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.313+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/2248059099 >> 172.21.15.91:0/2248059099 conn(0x7f7cc40a7970 msgr2=0x7f7cc406d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:26.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.313+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/2248059099 shutdown_connections 2023-11-27T20:45:26.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.313+0000 7f7cc8fe5640 1 -- 172.21.15.91:0/2248059099 wait complete. 2023-11-27T20:45:26.333 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T20:45:26.334 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:45:26.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.544+0000 7f89dc35a640 1 Processor -- start 2023-11-27T20:45:26.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.544+0000 7f89dc35a640 1 -- start start 2023-11-27T20:45:26.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.546+0000 7f89dc35a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f89d414fd30 0x7f89d4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.546+0000 7f89dc35a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f89d40c3ea0 0x7f89d40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.546+0000 7f89dc35a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d40c64a0 con 0x7f89d406d0a0 2023-11-27T20:45:26.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.546+0000 7f89dc35a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d40c5c00 con 0x7f89d40c3ea0 2023-11-27T20:45:26.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.546+0000 7f89dc35a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d40c5ee0 con 0x7f89d414fd30 2023-11-27T20:45:26.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.546+0000 7f89da8f7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f89d40c3ea0 0x7f89d40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:26.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.546+0000 7f89da8f7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f89d40c3ea0 0x7f89d40c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37054/0 (socket says 172.21.15.91:37054) 2023-11-27T20:45:26.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.546+0000 7f89da8f7640 1 -- 172.21.15.91:0/2370194141 learned_addr learned my addr 172.21.15.91:0/2370194141 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:26.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.547+0000 7f89da8f7640 1 -- 172.21.15.91:0/2370194141 >> v2:172.21.15.183:3300/0 conn(0x7f89d414fd30 msgr2=0x7f89d4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:26.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.547+0000 7f89da8f7640 1 --2- 172.21.15.91:0/2370194141 >> v2:172.21.15.183:3300/0 conn(0x7f89d414fd30 0x7f89d4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.547+0000 7f89da8f7640 1 -- 172.21.15.91:0/2370194141 >> v1:172.21.15.183:6789/0 conn(0x7f89d406d0a0 legacy=0x7f89d40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:26.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.547+0000 7f89da8f7640 1 -- 172.21.15.91:0/2370194141 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d40c61c0 con 0x7f89d40c3ea0 2023-11-27T20:45:26.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.548+0000 7f89da8f7640 1 --2- 172.21.15.91:0/2370194141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 0x7f89d40c4330 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f89d406b200 tx=0x7f89cc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b869be846b11aa27 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:26.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.548+0000 7f89d90f4640 1 -- 172.21.15.91:0/2370194141 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc02ca80 con 0x7f89d40c3ea0 2023-11-27T20:45:26.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.548+0000 7f89d90f4640 1 -- 172.21.15.91:0/2370194141 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc02cbe0 con 0x7f89d40c3ea0 2023-11-27T20:45:26.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.548+0000 7f89d90f4640 1 -- 172.21.15.91:0/2370194141 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0343f0 con 0x7f89d40c3ea0 2023-11-27T20:45:26.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.549+0000 7f89dc35a640 1 -- 172.21.15.91:0/2370194141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 msgr2=0x7f89d40c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.549+0000 7f89dc35a640 1 --2- 172.21.15.91:0/2370194141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 0x7f89d40c4330 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f89d406b200 tx=0x7f89cc02bee0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.549+0000 7f89dc35a640 1 -- 172.21.15.91:0/2370194141 shutdown_connections 2023-11-27T20:45:26.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.549+0000 7f89dc35a640 1 --2- 172.21.15.91:0/2370194141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 0x7f89d40c4330 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.549+0000 7f89dc35a640 1 --2- 172.21.15.91:0/2370194141 >> v2:172.21.15.183:3300/0 conn(0x7f89d414fd30 0x7f89d4152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.549+0000 7f89dc35a640 1 -- 172.21.15.91:0/2370194141 >> 172.21.15.91:0/2370194141 conn(0x7f89d406a500 msgr2=0x7f89d406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:26.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.549+0000 7f89dc35a640 1 -- 172.21.15.91:0/2370194141 shutdown_connections 2023-11-27T20:45:26.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.549+0000 7f89dc35a640 1 -- 172.21.15.91:0/2370194141 wait complete. 2023-11-27T20:45:26.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.551+0000 7f89dc35a640 1 Processor -- start 2023-11-27T20:45:26.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.551+0000 7f89dc35a640 1 -- start start 2023-11-27T20:45:26.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89dc35a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89d406d0a0 0x7f89d4150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89dc35a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 0x7f89d414d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89dc35a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89d414fd30 0x7f89d414ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89dc35a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d414dec0 con 0x7f89d40c3ea0 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89dc35a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d414bde0 con 0x7f89d406d0a0 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89dc35a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d414b820 con 0x7f89d414fd30 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89d98f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 0x7f89d414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89d98f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 0x7f89d414d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37064/0 (socket says 172.21.15.91:37064) 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89d98f5640 1 -- 172.21.15.91:0/1214498684 learned_addr learned my addr 172.21.15.91:0/1214498684 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89da0f6640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89d406d0a0 0x7f89d4150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89d98f5640 1 -- 172.21.15.91:0/1214498684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89d414fd30 msgr2=0x7f89d414ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89d98f5640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89d414fd30 0x7f89d414ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89d98f5640 1 -- 172.21.15.91:0/1214498684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89d406d0a0 msgr2=0x7f89d4150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89d98f5640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89d406d0a0 0x7f89d4150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89d98f5640 1 -- 172.21.15.91:0/1214498684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc009b30 con 0x7f89d40c3ea0 2023-11-27T20:45:26.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.552+0000 7f89da0f6640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89d406d0a0 0x7f89d4150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:26.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.553+0000 7f89d98f5640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 0x7f89d414d980 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f89c400b3c0 tx=0x7f89c400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:26.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.553+0000 7f89caffd640 1 -- 172.21.15.91:0/1214498684 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4011830 con 0x7f89d40c3ea0 2023-11-27T20:45:26.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.553+0000 7f89caffd640 1 -- 172.21.15.91:0/1214498684 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c4011990 con 0x7f89d40c3ea0 2023-11-27T20:45:26.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.553+0000 7f89caffd640 1 -- 172.21.15.91:0/1214498684 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4011d80 con 0x7f89d40c3ea0 2023-11-27T20:45:26.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.553+0000 7f89dc35a640 1 -- 172.21.15.91:0/1214498684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d414bb00 con 0x7f89d40c3ea0 2023-11-27T20:45:26.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.553+0000 7f89dc35a640 1 -- 172.21.15.91:0/1214498684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d41ea6a0 con 0x7f89d40c3ea0 2023-11-27T20:45:26.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.554+0000 7f89dc35a640 1 -- 172.21.15.91:0/1214498684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d41ea220 con 0x7f89d40c3ea0 2023-11-27T20:45:26.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.555+0000 7f89caffd640 1 -- 172.21.15.91:0/1214498684 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f89c401b460 con 0x7f89d40c3ea0 2023-11-27T20:45:26.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.556+0000 7f89caffd640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f89b806b1c0 0x7f89b806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:26.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.556+0000 7f89caffd640 1 -- 172.21.15.91:0/1214498684 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f89c4089950 con 0x7f89d40c3ea0 2023-11-27T20:45:26.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.556+0000 7f89da0f6640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f89b806b1c0 0x7f89b806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:26.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.557+0000 7f89da0f6640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f89b806b1c0 0x7f89b806d680 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f89d0006fd0 tx=0x7f89d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:26.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.561+0000 7f89caffd640 1 -- 172.21.15.91:0/1214498684 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f89d41ea220 con 0x7f89d40c3ea0 2023-11-27T20:45:26.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.749+0000 7f89dc35a640 1 -- 172.21.15.91:0/1214498684 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89d4072980 con 0x7f89b806b1c0 2023-11-27T20:45:26.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.767+0000 7f89caffd640 1 -- 172.21.15.91:0/1214498684 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525441 (secure 0 0 0) 0x7f89d000ae20 con 0x7f89b806b1c0 2023-11-27T20:45:26.775 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:26.781 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:45:26.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.774+0000 7f89dc35a640 1 -- 172.21.15.91:0/1214498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f89b806b1c0 msgr2=0x7f89b806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.774+0000 7f89dc35a640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f89b806b1c0 0x7f89b806d680 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f89d0006fd0 tx=0x7f89d0008040 comp rx=0 tx=0).stop 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.774+0000 7f89dc35a640 1 -- 172.21.15.91:0/1214498684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 msgr2=0x7f89d414d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.774+0000 7f89dc35a640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 0x7f89d414d980 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f89c400b3c0 tx=0x7f89c400b880 comp rx=0 tx=0).stop 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.774+0000 7f89dc35a640 1 -- 172.21.15.91:0/1214498684 shutdown_connections 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.774+0000 7f89dc35a640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89d414fd30 0x7f89d414ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.774+0000 7f89dc35a640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89d40c3ea0 0x7f89d414d980 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.774+0000 7f89dc35a640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f89b806b1c0 0x7f89b806d680 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.774+0000 7f89dc35a640 1 --2- 172.21.15.91:0/1214498684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89d406d0a0 0x7f89d4150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.774+0000 7f89dc35a640 1 -- 172.21.15.91:0/1214498684 >> 172.21.15.91:0/1214498684 conn(0x7f89d406a500 msgr2=0x7f89d41e0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.775+0000 7f89dc35a640 1 -- 172.21.15.91:0/1214498684 shutdown_connections 2023-11-27T20:45:26.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:26.775+0000 7f89dc35a640 1 -- 172.21.15.91:0/1214498684 wait complete. 2023-11-27T20:45:26.795 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2023-11-27T20:45:25.451513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":273,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254280,"kb_used_data":8968,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720440,"statfs":{"total":773094113280,"available":772833730560,"internally_reserved":0,"allocated":9183232,"data_stored":4745878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.161463"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.354157+0000","last_change":"2023-11-27T20:45:22.346374+0000","last_active":"2023-11-27T20:45:23.354157+0000","last_peered":"2023-11-27T20:45:23.354157+0000","last_clean":"2023-11-27T20:45:23.354157+0000","last_became_active":"2023-11-27T20:45:22.344818+0000","last_became_peered":"2023-11-27T20:45:22.344818+0000","last_unstale":"2023-11-27T20:45:23.354157+0000","last_undegraded":"2023-11-27T20:45:23.354157+0000","last_fullsized":"2023-11-27T20:45:23.354157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:16.736962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332820+0000","last_change":"2023-11-27T20:45:06.275855+0000","last_active":"2023-11-27T20:45:21.332820+0000","last_peered":"2023-11-27T20:45:21.332820+0000","last_clean":"2023-11-27T20:45:21.332820+0000","last_became_active":"2023-11-27T20:45:06.272756+0000","last_became_peered":"2023-11-27T20:45:06.272756+0000","last_unstale":"2023-11-27T20:45:21.332820+0000","last_undegraded":"2023-11-27T20:45:21.332820+0000","last_fullsized":"2023-11-27T20:45:21.332820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:14.466572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.355264+0000","last_change":"2023-11-27T20:45:22.349068+0000","last_active":"2023-11-27T20:45:22.355264+0000","last_peered":"2023-11-27T20:45:22.355264+0000","last_clean":"2023-11-27T20:45:22.355264+0000","last_became_active":"2023-11-27T20:45:22.348795+0000","last_became_peered":"2023-11-27T20:45:22.348795+0000","last_unstale":"2023-11-27T20:45:22.355264+0000","last_undegraded":"2023-11-27T20:45:22.355264+0000","last_fullsized":"2023-11-27T20:45:22.355264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:18:21.773413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332115+0000","last_change":"2023-11-27T20:45:19.289901+0000","last_active":"2023-11-27T20:45:21.332115+0000","last_peered":"2023-11-27T20:45:21.332115+0000","last_clean":"2023-11-27T20:45:21.332115+0000","last_became_active":"2023-11-27T20:45:19.289361+0000","last_became_peered":"2023-11-27T20:45:19.289361+0000","last_unstale":"2023-11-27T20:45:21.332115+0000","last_undegraded":"2023-11-27T20:45:21.332115+0000","last_fullsized":"2023-11-27T20:45:21.332115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:11.277550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.354622+0000","last_change":"2023-11-27T20:45:22.347805+0000","last_active":"2023-11-27T20:45:23.354622+0000","last_peered":"2023-11-27T20:45:23.354622+0000","last_clean":"2023-11-27T20:45:23.354622+0000","last_became_active":"2023-11-27T20:45:22.347483+0000","last_became_peered":"2023-11-27T20:45:22.347483+0000","last_unstale":"2023-11-27T20:45:23.354622+0000","last_undegraded":"2023-11-27T20:45:23.354622+0000","last_fullsized":"2023-11-27T20:45:23.354622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:12.865053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.339182+0000","last_change":"2023-11-27T20:45:06.283797+0000","last_active":"2023-11-27T20:45:21.339182+0000","last_peered":"2023-11-27T20:45:21.339182+0000","last_clean":"2023-11-27T20:45:21.339182+0000","last_became_active":"2023-11-27T20:45:06.281615+0000","last_became_peered":"2023-11-27T20:45:06.281615+0000","last_unstale":"2023-11-27T20:45:21.339182+0000","last_undegraded":"2023-11-27T20:45:21.339182+0000","last_fullsized":"2023-11-27T20:45:21.339182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:26.013200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357905+0000","last_change":"2023-11-27T20:45:22.353252+0000","last_active":"2023-11-27T20:45:23.357905+0000","last_peered":"2023-11-27T20:45:23.357905+0000","last_clean":"2023-11-27T20:45:23.357905+0000","last_became_active":"2023-11-27T20:45:22.350165+0000","last_became_peered":"2023-11-27T20:45:22.350165+0000","last_unstale":"2023-11-27T20:45:23.357905+0000","last_undegraded":"2023-11-27T20:45:23.357905+0000","last_fullsized":"2023-11-27T20:45:23.357905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:11.378122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.334155+0000","last_change":"2023-11-27T20:45:06.274435+0000","last_active":"2023-11-27T20:45:22.334155+0000","last_peered":"2023-11-27T20:45:22.334155+0000","last_clean":"2023-11-27T20:45:22.334155+0000","last_became_active":"2023-11-27T20:45:06.274050+0000","last_became_peered":"2023-11-27T20:45:06.274050+0000","last_unstale":"2023-11-27T20:45:22.334155+0000","last_undegraded":"2023-11-27T20:45:22.334155+0000","last_fullsized":"2023-11-27T20:45:22.334155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:10:35.432301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.356575+0000","last_change":"2023-11-27T20:45:22.352883+0000","last_active":"2023-11-27T20:45:22.356575+0000","last_peered":"2023-11-27T20:45:22.356575+0000","last_clean":"2023-11-27T20:45:22.356575+0000","last_became_active":"2023-11-27T20:45:22.352106+0000","last_became_peered":"2023-11-27T20:45:22.352106+0000","last_unstale":"2023-11-27T20:45:22.356575+0000","last_undegraded":"2023-11-27T20:45:22.356575+0000","last_fullsized":"2023-11-27T20:45:22.356575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:39:56.285530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.331998+0000","last_change":"2023-11-27T20:45:06.270397+0000","last_active":"2023-11-27T20:45:22.331998+0000","last_peered":"2023-11-27T20:45:22.331998+0000","last_clean":"2023-11-27T20:45:22.331998+0000","last_became_active":"2023-11-27T20:45:06.270159+0000","last_became_peered":"2023-11-27T20:45:06.270159+0000","last_unstale":"2023-11-27T20:45:22.331998+0000","last_undegraded":"2023-11-27T20:45:22.331998+0000","last_fullsized":"2023-11-27T20:45:22.331998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:28.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356253+0000","last_change":"2023-11-27T20:45:22.353059+0000","last_active":"2023-11-27T20:45:23.356253+0000","last_peered":"2023-11-27T20:45:23.356253+0000","last_clean":"2023-11-27T20:45:23.356253+0000","last_became_active":"2023-11-27T20:45:22.351367+0000","last_became_peered":"2023-11-27T20:45:22.351367+0000","last_unstale":"2023-11-27T20:45:23.356253+0000","last_undegraded":"2023-11-27T20:45:23.356253+0000","last_fullsized":"2023-11-27T20:45:23.356253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:12.006218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332136+0000","last_change":"2023-11-27T20:45:06.276571+0000","last_active":"2023-11-27T20:45:21.332136+0000","last_peered":"2023-11-27T20:45:21.332136+0000","last_clean":"2023-11-27T20:45:21.332136+0000","last_became_active":"2023-11-27T20:45:06.276265+0000","last_became_peered":"2023-11-27T20:45:06.276265+0000","last_unstale":"2023-11-27T20:45:21.332136+0000","last_undegraded":"2023-11-27T20:45:21.332136+0000","last_fullsized":"2023-11-27T20:45:21.332136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:28.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.350735+0000","last_change":"2023-11-27T20:45:22.346941+0000","last_active":"2023-11-27T20:45:22.350735+0000","last_peered":"2023-11-27T20:45:22.350735+0000","last_clean":"2023-11-27T20:45:22.350735+0000","last_became_active":"2023-11-27T20:45:22.346467+0000","last_became_peered":"2023-11-27T20:45:22.346467+0000","last_unstale":"2023-11-27T20:45:22.350735+0000","last_undegraded":"2023-11-27T20:45:22.350735+0000","last_fullsized":"2023-11-27T20:45:22.350735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:37:19.859739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.331117+0000","last_change":"2023-11-27T20:45:06.271839+0000","last_active":"2023-11-27T20:45:22.331117+0000","last_peered":"2023-11-27T20:45:22.331117+0000","last_clean":"2023-11-27T20:45:22.331117+0000","last_became_active":"2023-11-27T20:45:06.271230+0000","last_became_peered":"2023-11-27T20:45:06.271230+0000","last_unstale":"2023-11-27T20:45:22.331117+0000","last_undegraded":"2023-11-27T20:45:22.331117+0000","last_fullsized":"2023-11-27T20:45:22.331117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:57:06.763360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358203+0000","last_change":"2023-11-27T20:45:22.353188+0000","last_active":"2023-11-27T20:45:22.358203+0000","last_peered":"2023-11-27T20:45:22.358203+0000","last_clean":"2023-11-27T20:45:22.358203+0000","last_became_active":"2023-11-27T20:45:22.351124+0000","last_became_peered":"2023-11-27T20:45:22.351124+0000","last_unstale":"2023-11-27T20:45:22.358203+0000","last_undegraded":"2023-11-27T20:45:22.358203+0000","last_fullsized":"2023-11-27T20:45:22.358203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:18:21.773413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330591+0000","last_change":"2023-11-27T20:45:06.271557+0000","last_active":"2023-11-27T20:45:21.330591+0000","last_peered":"2023-11-27T20:45:21.330591+0000","last_clean":"2023-11-27T20:45:21.330591+0000","last_became_active":"2023-11-27T20:45:06.271014+0000","last_became_peered":"2023-11-27T20:45:06.271014+0000","last_unstale":"2023-11-27T20:45:21.330591+0000","last_undegraded":"2023-11-27T20:45:21.330591+0000","last_fullsized":"2023-11-27T20:45:21.330591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:35.973730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358887+0000","last_change":"2023-11-27T20:45:22.354763+0000","last_active":"2023-11-27T20:45:22.358887+0000","last_peered":"2023-11-27T20:45:22.358887+0000","last_clean":"2023-11-27T20:45:22.358887+0000","last_became_active":"2023-11-27T20:45:22.354412+0000","last_became_peered":"2023-11-27T20:45:22.354412+0000","last_unstale":"2023-11-27T20:45:22.358887+0000","last_undegraded":"2023-11-27T20:45:22.358887+0000","last_fullsized":"2023-11-27T20:45:22.358887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:41:32.100480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333132+0000","last_change":"2023-11-27T20:45:06.279235+0000","last_active":"2023-11-27T20:45:21.333132+0000","last_peered":"2023-11-27T20:45:21.333132+0000","last_clean":"2023-11-27T20:45:21.333132+0000","last_became_active":"2023-11-27T20:45:06.278923+0000","last_became_peered":"2023-11-27T20:45:06.278923+0000","last_unstale":"2023-11-27T20:45:21.333132+0000","last_undegraded":"2023-11-27T20:45:21.333132+0000","last_fullsized":"2023-11-27T20:45:21.333132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357505+0000","last_change":"2023-11-27T20:45:22.337126+0000","last_active":"2023-11-27T20:45:23.357505+0000","last_peered":"2023-11-27T20:45:23.357505+0000","last_clean":"2023-11-27T20:45:23.357505+0000","last_became_active":"2023-11-27T20:45:22.336548+0000","last_became_peered":"2023-11-27T20:45:22.336548+0000","last_unstale":"2023-11-27T20:45:23.357505+0000","last_undegraded":"2023-11-27T20:45:23.357505+0000","last_fullsized":"2023-11-27T20:45:23.357505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:18:21.773413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332532+0000","last_change":"2023-11-27T20:45:06.280157+0000","last_active":"2023-11-27T20:45:21.332532+0000","last_peered":"2023-11-27T20:45:21.332532+0000","last_clean":"2023-11-27T20:45:21.332532+0000","last_became_active":"2023-11-27T20:45:06.275941+0000","last_became_peered":"2023-11-27T20:45:06.275941+0000","last_unstale":"2023-11-27T20:45:21.332532+0000","last_undegraded":"2023-11-27T20:45:21.332532+0000","last_fullsized":"2023-11-27T20:45:21.332532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:55.254080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.359100+0000","last_change":"2023-11-27T20:45:22.350026+0000","last_active":"2023-11-27T20:45:23.359100+0000","last_peered":"2023-11-27T20:45:23.359100+0000","last_clean":"2023-11-27T20:45:23.359100+0000","last_became_active":"2023-11-27T20:45:22.349705+0000","last_became_peered":"2023-11-27T20:45:22.349705+0000","last_unstale":"2023-11-27T20:45:23.359100+0000","last_undegraded":"2023-11-27T20:45:23.359100+0000","last_fullsized":"2023-11-27T20:45:23.359100+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:17.023008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.319484+0000","last_change":"2023-11-27T20:45:06.268839+0000","last_active":"2023-11-27T20:45:22.319484+0000","last_peered":"2023-11-27T20:45:22.319484+0000","last_clean":"2023-11-27T20:45:22.319484+0000","last_became_active":"2023-11-27T20:45:06.268579+0000","last_became_peered":"2023-11-27T20:45:06.268579+0000","last_unstale":"2023-11-27T20:45:22.319484+0000","last_undegraded":"2023-11-27T20:45:22.319484+0000","last_fullsized":"2023-11-27T20:45:22.319484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:46.386901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.348892+0000","last_change":"2023-11-27T20:45:22.339096+0000","last_active":"2023-11-27T20:45:22.348892+0000","last_peered":"2023-11-27T20:45:22.348892+0000","last_clean":"2023-11-27T20:45:22.348892+0000","last_became_active":"2023-11-27T20:45:22.338380+0000","last_became_peered":"2023-11-27T20:45:22.338380+0000","last_unstale":"2023-11-27T20:45:22.348892+0000","last_undegraded":"2023-11-27T20:45:22.348892+0000","last_fullsized":"2023-11-27T20:45:22.348892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:34.135648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331316+0000","last_change":"2023-11-27T20:45:06.270837+0000","last_active":"2023-11-27T20:45:21.331316+0000","last_peered":"2023-11-27T20:45:21.331316+0000","last_clean":"2023-11-27T20:45:21.331316+0000","last_became_active":"2023-11-27T20:45:06.270495+0000","last_became_peered":"2023-11-27T20:45:06.270495+0000","last_unstale":"2023-11-27T20:45:21.331316+0000","last_undegraded":"2023-11-27T20:45:21.331316+0000","last_fullsized":"2023-11-27T20:45:21.331316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:11.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.356748+0000","last_change":"2023-11-27T20:45:22.349837+0000","last_active":"2023-11-27T20:45:22.356748+0000","last_peered":"2023-11-27T20:45:22.356748+0000","last_clean":"2023-11-27T20:45:22.356748+0000","last_became_active":"2023-11-27T20:45:22.346904+0000","last_became_peered":"2023-11-27T20:45:22.346904+0000","last_unstale":"2023-11-27T20:45:22.356748+0000","last_undegraded":"2023-11-27T20:45:22.356748+0000","last_fullsized":"2023-11-27T20:45:22.356748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:41:32.100480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.336969+0000","last_change":"2023-11-27T20:45:06.273803+0000","last_active":"2023-11-27T20:45:21.336969+0000","last_peered":"2023-11-27T20:45:21.336969+0000","last_clean":"2023-11-27T20:45:21.336969+0000","last_became_active":"2023-11-27T20:45:06.273439+0000","last_became_peered":"2023-11-27T20:45:06.273439+0000","last_unstale":"2023-11-27T20:45:21.336969+0000","last_undegraded":"2023-11-27T20:45:21.336969+0000","last_fullsized":"2023-11-27T20:45:21.336969+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:20.750426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.362272+0000","last_change":"2023-11-27T20:45:22.357322+0000","last_active":"2023-11-27T20:45:22.362272+0000","last_peered":"2023-11-27T20:45:22.362272+0000","last_clean":"2023-11-27T20:45:22.362272+0000","last_became_active":"2023-11-27T20:45:22.357026+0000","last_became_peered":"2023-11-27T20:45:22.357026+0000","last_unstale":"2023-11-27T20:45:22.362272+0000","last_undegraded":"2023-11-27T20:45:22.362272+0000","last_fullsized":"2023-11-27T20:45:22.362272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:37:50.104291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337836+0000","last_change":"2023-11-27T20:45:06.276128+0000","last_active":"2023-11-27T20:45:22.337836+0000","last_peered":"2023-11-27T20:45:22.337836+0000","last_clean":"2023-11-27T20:45:22.337836+0000","last_became_active":"2023-11-27T20:45:06.274808+0000","last_became_peered":"2023-11-27T20:45:06.274808+0000","last_unstale":"2023-11-27T20:45:22.337836+0000","last_undegraded":"2023-11-27T20:45:22.337836+0000","last_fullsized":"2023-11-27T20:45:22.337836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:50:09.959822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364085+0000","last_change":"2023-11-27T20:45:22.354631+0000","last_active":"2023-11-27T20:45:22.364085+0000","last_peered":"2023-11-27T20:45:22.364085+0000","last_clean":"2023-11-27T20:45:22.364085+0000","last_became_active":"2023-11-27T20:45:22.353006+0000","last_became_peered":"2023-11-27T20:45:22.353006+0000","last_unstale":"2023-11-27T20:45:22.364085+0000","last_undegraded":"2023-11-27T20:45:22.364085+0000","last_fullsized":"2023-11-27T20:45:22.364085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:39:56.285530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.323992+0000","last_change":"2023-11-27T20:45:06.269154+0000","last_active":"2023-11-27T20:45:21.323992+0000","last_peered":"2023-11-27T20:45:21.323992+0000","last_clean":"2023-11-27T20:45:21.323992+0000","last_became_active":"2023-11-27T20:45:06.268153+0000","last_became_peered":"2023-11-27T20:45:06.268153+0000","last_unstale":"2023-11-27T20:45:21.323992+0000","last_undegraded":"2023-11-27T20:45:21.323992+0000","last_fullsized":"2023-11-27T20:45:21.323992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.450953+0000","last_change":"2023-11-27T20:45:22.357635+0000","last_active":"2023-11-27T20:45:23.450953+0000","last_peered":"2023-11-27T20:45:23.450953+0000","last_clean":"2023-11-27T20:45:23.450953+0000","last_became_active":"2023-11-27T20:45:22.353642+0000","last_became_peered":"2023-11-27T20:45:22.353642+0000","last_unstale":"2023-11-27T20:45:23.450953+0000","last_undegraded":"2023-11-27T20:45:23.450953+0000","last_fullsized":"2023-11-27T20:45:23.450953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:19.057740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.325348+0000","last_change":"2023-11-27T20:45:06.280743+0000","last_active":"2023-11-27T20:45:22.325348+0000","last_peered":"2023-11-27T20:45:22.325348+0000","last_clean":"2023-11-27T20:45:22.325348+0000","last_became_active":"2023-11-27T20:45:06.280225+0000","last_became_peered":"2023-11-27T20:45:06.280225+0000","last_unstale":"2023-11-27T20:45:22.325348+0000","last_undegraded":"2023-11-27T20:45:22.325348+0000","last_fullsized":"2023-11-27T20:45:22.325348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:24.286070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.452137+0000","last_change":"2023-11-27T20:45:22.348519+0000","last_active":"2023-11-27T20:45:23.452137+0000","last_peered":"2023-11-27T20:45:23.452137+0000","last_clean":"2023-11-27T20:45:23.452137+0000","last_became_active":"2023-11-27T20:45:22.348232+0000","last_became_peered":"2023-11-27T20:45:22.348232+0000","last_unstale":"2023-11-27T20:45:23.452137+0000","last_undegraded":"2023-11-27T20:45:23.452137+0000","last_fullsized":"2023-11-27T20:45:23.452137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:55.269119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.330783+0000","last_change":"2023-11-27T20:45:06.276232+0000","last_active":"2023-11-27T20:45:22.330783+0000","last_peered":"2023-11-27T20:45:22.330783+0000","last_clean":"2023-11-27T20:45:22.330783+0000","last_became_active":"2023-11-27T20:45:06.274283+0000","last_became_peered":"2023-11-27T20:45:06.274283+0000","last_unstale":"2023-11-27T20:45:22.330783+0000","last_undegraded":"2023-11-27T20:45:22.330783+0000","last_fullsized":"2023-11-27T20:45:22.330783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:59:57.174632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357651+0000","last_change":"2023-11-27T20:45:22.340990+0000","last_active":"2023-11-27T20:45:23.357651+0000","last_peered":"2023-11-27T20:45:23.357651+0000","last_clean":"2023-11-27T20:45:23.357651+0000","last_became_active":"2023-11-27T20:45:22.340672+0000","last_became_peered":"2023-11-27T20:45:22.340672+0000","last_unstale":"2023-11-27T20:45:23.357651+0000","last_undegraded":"2023-11-27T20:45:23.357651+0000","last_fullsized":"2023-11-27T20:45:23.357651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:10.851731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.340288+0000","last_change":"2023-11-27T20:45:06.282186+0000","last_active":"2023-11-27T20:45:22.340288+0000","last_peered":"2023-11-27T20:45:22.340288+0000","last_clean":"2023-11-27T20:45:22.340288+0000","last_became_active":"2023-11-27T20:45:06.281910+0000","last_became_peered":"2023-11-27T20:45:06.281910+0000","last_unstale":"2023-11-27T20:45:22.340288+0000","last_undegraded":"2023-11-27T20:45:22.340288+0000","last_fullsized":"2023-11-27T20:45:22.340288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:38.205825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.358077+0000","last_change":"2023-11-27T20:45:22.357704+0000","last_active":"2023-11-27T20:45:23.358077+0000","last_peered":"2023-11-27T20:45:23.358077+0000","last_clean":"2023-11-27T20:45:23.358077+0000","last_became_active":"2023-11-27T20:45:22.357334+0000","last_became_peered":"2023-11-27T20:45:22.357334+0000","last_unstale":"2023-11-27T20:45:23.358077+0000","last_undegraded":"2023-11-27T20:45:23.358077+0000","last_fullsized":"2023-11-27T20:45:23.358077+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:20.476267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337505+0000","last_change":"2023-11-27T20:45:06.279696+0000","last_active":"2023-11-27T20:45:22.337505+0000","last_peered":"2023-11-27T20:45:22.337505+0000","last_clean":"2023-11-27T20:45:22.337505+0000","last_became_active":"2023-11-27T20:45:06.279208+0000","last_became_peered":"2023-11-27T20:45:06.279208+0000","last_unstale":"2023-11-27T20:45:22.337505+0000","last_undegraded":"2023-11-27T20:45:22.337505+0000","last_fullsized":"2023-11-27T20:45:22.337505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:22:23.387234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364424+0000","last_change":"2023-11-27T20:45:22.360553+0000","last_active":"2023-11-27T20:45:22.364424+0000","last_peered":"2023-11-27T20:45:22.364424+0000","last_clean":"2023-11-27T20:45:22.364424+0000","last_became_active":"2023-11-27T20:45:22.360122+0000","last_became_peered":"2023-11-27T20:45:22.360122+0000","last_unstale":"2023-11-27T20:45:22.364424+0000","last_undegraded":"2023-11-27T20:45:22.364424+0000","last_fullsized":"2023-11-27T20:45:22.364424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:10.851731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.334311+0000","last_change":"2023-11-27T20:45:06.277398+0000","last_active":"2023-11-27T20:45:22.334311+0000","last_peered":"2023-11-27T20:45:22.334311+0000","last_clean":"2023-11-27T20:45:22.334311+0000","last_became_active":"2023-11-27T20:45:06.277088+0000","last_became_peered":"2023-11-27T20:45:06.277088+0000","last_unstale":"2023-11-27T20:45:22.334311+0000","last_undegraded":"2023-11-27T20:45:22.334311+0000","last_fullsized":"2023-11-27T20:45:22.334311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:19.836448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356391+0000","last_change":"2023-11-27T20:45:22.347218+0000","last_active":"2023-11-27T20:45:23.356391+0000","last_peered":"2023-11-27T20:45:23.356391+0000","last_clean":"2023-11-27T20:45:23.356391+0000","last_became_active":"2023-11-27T20:45:22.345439+0000","last_became_peered":"2023-11-27T20:45:22.345439+0000","last_unstale":"2023-11-27T20:45:23.356391+0000","last_undegraded":"2023-11-27T20:45:23.356391+0000","last_fullsized":"2023-11-27T20:45:23.356391+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:07.786331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338591+0000","last_change":"2023-11-27T20:45:06.277480+0000","last_active":"2023-11-27T20:45:22.338591+0000","last_peered":"2023-11-27T20:45:22.338591+0000","last_clean":"2023-11-27T20:45:22.338591+0000","last_became_active":"2023-11-27T20:45:06.277134+0000","last_became_peered":"2023-11-27T20:45:06.277134+0000","last_unstale":"2023-11-27T20:45:22.338591+0000","last_undegraded":"2023-11-27T20:45:22.338591+0000","last_fullsized":"2023-11-27T20:45:22.338591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:10:17.216692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358445+0000","last_change":"2023-11-27T20:45:22.355973+0000","last_active":"2023-11-27T20:45:22.358445+0000","last_peered":"2023-11-27T20:45:22.358445+0000","last_clean":"2023-11-27T20:45:22.358445+0000","last_became_active":"2023-11-27T20:45:22.355428+0000","last_became_peered":"2023-11-27T20:45:22.355428+0000","last_unstale":"2023-11-27T20:45:22.358445+0000","last_undegraded":"2023-11-27T20:45:22.358445+0000","last_fullsized":"2023-11-27T20:45:22.358445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:45:04.189207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.317955+0000","last_change":"2023-11-27T20:45:06.277173+0000","last_active":"2023-11-27T20:45:22.317955+0000","last_peered":"2023-11-27T20:45:22.317955+0000","last_clean":"2023-11-27T20:45:22.317955+0000","last_became_active":"2023-11-27T20:45:06.276898+0000","last_became_peered":"2023-11-27T20:45:06.276898+0000","last_unstale":"2023-11-27T20:45:22.317955+0000","last_undegraded":"2023-11-27T20:45:22.317955+0000","last_fullsized":"2023-11-27T20:45:22.317955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:58:55.412394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451496+0000","last_change":"2023-11-27T20:45:22.355694+0000","last_active":"2023-11-27T20:45:23.451496+0000","last_peered":"2023-11-27T20:45:23.451496+0000","last_clean":"2023-11-27T20:45:23.451496+0000","last_became_active":"2023-11-27T20:45:22.351085+0000","last_became_peered":"2023-11-27T20:45:22.351085+0000","last_unstale":"2023-11-27T20:45:23.451496+0000","last_undegraded":"2023-11-27T20:45:23.451496+0000","last_fullsized":"2023-11-27T20:45:23.451496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:44.673674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330167+0000","last_change":"2023-11-27T20:45:06.279341+0000","last_active":"2023-11-27T20:45:21.330167+0000","last_peered":"2023-11-27T20:45:21.330167+0000","last_clean":"2023-11-27T20:45:21.330167+0000","last_became_active":"2023-11-27T20:45:06.278293+0000","last_became_peered":"2023-11-27T20:45:06.278293+0000","last_unstale":"2023-11-27T20:45:21.330167+0000","last_undegraded":"2023-11-27T20:45:21.330167+0000","last_fullsized":"2023-11-27T20:45:21.330167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:00.849008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356548+0000","last_change":"2023-11-27T20:45:22.352267+0000","last_active":"2023-11-27T20:45:23.356548+0000","last_peered":"2023-11-27T20:45:23.356548+0000","last_clean":"2023-11-27T20:45:23.356548+0000","last_became_active":"2023-11-27T20:45:22.350619+0000","last_became_peered":"2023-11-27T20:45:22.350619+0000","last_unstale":"2023-11-27T20:45:23.356548+0000","last_undegraded":"2023-11-27T20:45:23.356548+0000","last_fullsized":"2023-11-27T20:45:23.356548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:25:15.988150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.340639+0000","last_change":"2023-11-27T20:45:06.280079+0000","last_active":"2023-11-27T20:45:22.340639+0000","last_peered":"2023-11-27T20:45:22.340639+0000","last_clean":"2023-11-27T20:45:22.340639+0000","last_became_active":"2023-11-27T20:45:06.279228+0000","last_became_peered":"2023-11-27T20:45:06.279228+0000","last_unstale":"2023-11-27T20:45:22.340639+0000","last_undegraded":"2023-11-27T20:45:22.340639+0000","last_fullsized":"2023-11-27T20:45:22.340639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:09:40.464389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364345+0000","last_change":"2023-11-27T20:45:22.360934+0000","last_active":"2023-11-27T20:45:22.364345+0000","last_peered":"2023-11-27T20:45:22.364345+0000","last_clean":"2023-11-27T20:45:22.364345+0000","last_became_active":"2023-11-27T20:45:22.360204+0000","last_became_peered":"2023-11-27T20:45:22.360204+0000","last_unstale":"2023-11-27T20:45:22.364345+0000","last_undegraded":"2023-11-27T20:45:22.364345+0000","last_fullsized":"2023-11-27T20:45:22.364345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:48:12.470137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.321044+0000","last_change":"2023-11-27T20:45:06.263651+0000","last_active":"2023-11-27T20:45:22.321044+0000","last_peered":"2023-11-27T20:45:22.321044+0000","last_clean":"2023-11-27T20:45:22.321044+0000","last_became_active":"2023-11-27T20:45:06.263101+0000","last_became_peered":"2023-11-27T20:45:06.263101+0000","last_unstale":"2023-11-27T20:45:22.321044+0000","last_undegraded":"2023-11-27T20:45:22.321044+0000","last_fullsized":"2023-11-27T20:45:22.321044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:38:33.732526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.353829+0000","last_change":"2023-11-27T20:45:22.350156+0000","last_active":"2023-11-27T20:45:22.353829+0000","last_peered":"2023-11-27T20:45:22.353829+0000","last_clean":"2023-11-27T20:45:22.353829+0000","last_became_active":"2023-11-27T20:45:22.342948+0000","last_became_peered":"2023-11-27T20:45:22.342948+0000","last_unstale":"2023-11-27T20:45:22.353829+0000","last_undegraded":"2023-11-27T20:45:22.353829+0000","last_fullsized":"2023-11-27T20:45:22.353829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:00:24.410247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.340925+0000","last_change":"2023-11-27T20:45:06.276593+0000","last_active":"2023-11-27T20:45:21.340925+0000","last_peered":"2023-11-27T20:45:21.340925+0000","last_clean":"2023-11-27T20:45:21.340925+0000","last_became_active":"2023-11-27T20:45:06.276315+0000","last_became_peered":"2023-11-27T20:45:06.276315+0000","last_unstale":"2023-11-27T20:45:21.340925+0000","last_undegraded":"2023-11-27T20:45:21.340925+0000","last_fullsized":"2023-11-27T20:45:21.340925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:02.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.353982+0000","last_change":"2023-11-27T20:45:22.350466+0000","last_active":"2023-11-27T20:45:22.353982+0000","last_peered":"2023-11-27T20:45:22.353982+0000","last_clean":"2023-11-27T20:45:22.353982+0000","last_became_active":"2023-11-27T20:45:22.348676+0000","last_became_peered":"2023-11-27T20:45:22.348676+0000","last_unstale":"2023-11-27T20:45:22.353982+0000","last_undegraded":"2023-11-27T20:45:22.353982+0000","last_fullsized":"2023-11-27T20:45:22.353982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:36:22.091833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.327518+0000","last_change":"2023-11-27T20:45:06.265948+0000","last_active":"2023-11-27T20:45:22.327518+0000","last_peered":"2023-11-27T20:45:22.327518+0000","last_clean":"2023-11-27T20:45:22.327518+0000","last_became_active":"2023-11-27T20:45:06.265615+0000","last_became_peered":"2023-11-27T20:45:06.265615+0000","last_unstale":"2023-11-27T20:45:22.327518+0000","last_undegraded":"2023-11-27T20:45:22.327518+0000","last_fullsized":"2023-11-27T20:45:22.327518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.358227+0000","last_change":"2023-11-27T20:45:22.352391+0000","last_active":"2023-11-27T20:45:23.358227+0000","last_peered":"2023-11-27T20:45:23.358227+0000","last_clean":"2023-11-27T20:45:23.358227+0000","last_became_active":"2023-11-27T20:45:22.351730+0000","last_became_peered":"2023-11-27T20:45:22.351730+0000","last_unstale":"2023-11-27T20:45:23.358227+0000","last_undegraded":"2023-11-27T20:45:23.358227+0000","last_fullsized":"2023-11-27T20:45:23.358227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:41:31.794086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331422+0000","last_change":"2023-11-27T20:45:06.270218+0000","last_active":"2023-11-27T20:45:21.331422+0000","last_peered":"2023-11-27T20:45:21.331422+0000","last_clean":"2023-11-27T20:45:21.331422+0000","last_became_active":"2023-11-27T20:45:06.269297+0000","last_became_peered":"2023-11-27T20:45:06.269297+0000","last_unstale":"2023-11-27T20:45:21.331422+0000","last_undegraded":"2023-11-27T20:45:21.331422+0000","last_fullsized":"2023-11-27T20:45:21.331422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.356769+0000","last_change":"2023-11-27T20:45:22.350146+0000","last_active":"2023-11-27T20:45:22.356769+0000","last_peered":"2023-11-27T20:45:22.356769+0000","last_clean":"2023-11-27T20:45:22.356769+0000","last_became_active":"2023-11-27T20:45:22.349774+0000","last_became_peered":"2023-11-27T20:45:22.349774+0000","last_unstale":"2023-11-27T20:45:22.356769+0000","last_undegraded":"2023-11-27T20:45:22.356769+0000","last_fullsized":"2023-11-27T20:45:22.356769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:47.794087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.318214+0000","last_change":"2023-11-27T20:45:06.264325+0000","last_active":"2023-11-27T20:45:22.318214+0000","last_peered":"2023-11-27T20:45:22.318214+0000","last_clean":"2023-11-27T20:45:22.318214+0000","last_became_active":"2023-11-27T20:45:06.260926+0000","last_became_peered":"2023-11-27T20:45:06.260926+0000","last_unstale":"2023-11-27T20:45:22.318214+0000","last_undegraded":"2023-11-27T20:45:22.318214+0000","last_fullsized":"2023-11-27T20:45:22.318214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:06.182643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353232+0000","last_change":"2023-11-27T20:45:22.342522+0000","last_active":"2023-11-27T20:45:23.353232+0000","last_peered":"2023-11-27T20:45:23.353232+0000","last_clean":"2023-11-27T20:45:23.353232+0000","last_became_active":"2023-11-27T20:45:22.342067+0000","last_became_peered":"2023-11-27T20:45:22.342067+0000","last_unstale":"2023-11-27T20:45:23.353232+0000","last_undegraded":"2023-11-27T20:45:23.353232+0000","last_fullsized":"2023-11-27T20:45:23.353232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:57.104764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.318185+0000","last_change":"2023-11-27T20:45:06.278905+0000","last_active":"2023-11-27T20:45:22.318185+0000","last_peered":"2023-11-27T20:45:22.318185+0000","last_clean":"2023-11-27T20:45:22.318185+0000","last_became_active":"2023-11-27T20:45:06.276359+0000","last_became_peered":"2023-11-27T20:45:06.276359+0000","last_unstale":"2023-11-27T20:45:22.318185+0000","last_undegraded":"2023-11-27T20:45:22.318185+0000","last_fullsized":"2023-11-27T20:45:22.318185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:13:33.854711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357088+0000","last_change":"2023-11-27T20:45:22.349924+0000","last_active":"2023-11-27T20:45:23.357088+0000","last_peered":"2023-11-27T20:45:23.357088+0000","last_clean":"2023-11-27T20:45:23.357088+0000","last_became_active":"2023-11-27T20:45:22.349642+0000","last_became_peered":"2023-11-27T20:45:22.349642+0000","last_unstale":"2023-11-27T20:45:23.357088+0000","last_undegraded":"2023-11-27T20:45:23.357088+0000","last_fullsized":"2023-11-27T20:45:23.357088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:57:12.808217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.325696+0000","last_change":"2023-11-27T20:45:06.278065+0000","last_active":"2023-11-27T20:45:22.325696+0000","last_peered":"2023-11-27T20:45:22.325696+0000","last_clean":"2023-11-27T20:45:22.325696+0000","last_became_active":"2023-11-27T20:45:06.277780+0000","last_became_peered":"2023-11-27T20:45:06.277780+0000","last_unstale":"2023-11-27T20:45:22.325696+0000","last_undegraded":"2023-11-27T20:45:22.325696+0000","last_fullsized":"2023-11-27T20:45:22.325696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:11.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451700+0000","last_change":"2023-11-27T20:45:22.344095+0000","last_active":"2023-11-27T20:45:23.451700+0000","last_peered":"2023-11-27T20:45:23.451700+0000","last_clean":"2023-11-27T20:45:23.451700+0000","last_became_active":"2023-11-27T20:45:22.343828+0000","last_became_peered":"2023-11-27T20:45:22.343828+0000","last_unstale":"2023-11-27T20:45:23.451700+0000","last_undegraded":"2023-11-27T20:45:23.451700+0000","last_fullsized":"2023-11-27T20:45:23.451700+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:39.976491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330682+0000","last_change":"2023-11-27T20:45:06.257819+0000","last_active":"2023-11-27T20:45:21.330682+0000","last_peered":"2023-11-27T20:45:21.330682+0000","last_clean":"2023-11-27T20:45:21.330682+0000","last_became_active":"2023-11-27T20:45:06.257086+0000","last_became_peered":"2023-11-27T20:45:06.257086+0000","last_unstale":"2023-11-27T20:45:21.330682+0000","last_undegraded":"2023-11-27T20:45:21.330682+0000","last_fullsized":"2023-11-27T20:45:21.330682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:24.286070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353742+0000","last_change":"2023-11-27T20:45:22.342376+0000","last_active":"2023-11-27T20:45:23.353742+0000","last_peered":"2023-11-27T20:45:23.353742+0000","last_clean":"2023-11-27T20:45:23.353742+0000","last_became_active":"2023-11-27T20:45:22.341887+0000","last_became_peered":"2023-11-27T20:45:22.341887+0000","last_unstale":"2023-11-27T20:45:23.353742+0000","last_undegraded":"2023-11-27T20:45:23.353742+0000","last_fullsized":"2023-11-27T20:45:23.353742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:23.052052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357971+0000","last_change":"2023-11-27T20:45:21.345110+0000","last_active":"2023-11-27T20:45:23.357971+0000","last_peered":"2023-11-27T20:45:23.357971+0000","last_clean":"2023-11-27T20:45:23.357971+0000","last_became_active":"2023-11-27T20:45:21.344796+0000","last_became_peered":"2023-11-27T20:45:21.344796+0000","last_unstale":"2023-11-27T20:45:23.357971+0000","last_undegraded":"2023-11-27T20:45:23.357971+0000","last_fullsized":"2023-11-27T20:45:23.357971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:59:48.447747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.326090+0000","last_change":"2023-11-27T20:45:06.282558+0000","last_active":"2023-11-27T20:45:22.326090+0000","last_peered":"2023-11-27T20:45:22.326090+0000","last_clean":"2023-11-27T20:45:22.326090+0000","last_became_active":"2023-11-27T20:45:06.282227+0000","last_became_peered":"2023-11-27T20:45:06.282227+0000","last_unstale":"2023-11-27T20:45:22.326090+0000","last_undegraded":"2023-11-27T20:45:22.326090+0000","last_fullsized":"2023-11-27T20:45:22.326090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"74'4","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333098+0000","last_change":"2023-11-27T20:45:05.632935+0000","last_active":"2023-11-27T20:45:21.333098+0000","last_peered":"2023-11-27T20:45:21.333098+0000","last_clean":"2023-11-27T20:45:21.333098+0000","last_became_active":"2023-11-27T20:45:05.632654+0000","last_became_peered":"2023-11-27T20:45:05.632654+0000","last_unstale":"2023-11-27T20:45:21.333098+0000","last_undegraded":"2023-11-27T20:45:21.333098+0000","last_fullsized":"2023-11-27T20:45:21.333098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:56.837141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357952+0000","last_change":"2023-11-27T20:45:22.348879+0000","last_active":"2023-11-27T20:45:23.357952+0000","last_peered":"2023-11-27T20:45:23.357952+0000","last_clean":"2023-11-27T20:45:23.357952+0000","last_became_active":"2023-11-27T20:45:22.348489+0000","last_became_peered":"2023-11-27T20:45:22.348489+0000","last_unstale":"2023-11-27T20:45:23.357952+0000","last_undegraded":"2023-11-27T20:45:23.357952+0000","last_fullsized":"2023-11-27T20:45:23.357952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:41:32.100480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357225+0000","last_change":"2023-11-27T20:45:21.342255+0000","last_active":"2023-11-27T20:45:23.357225+0000","last_peered":"2023-11-27T20:45:23.357225+0000","last_clean":"2023-11-27T20:45:23.357225+0000","last_became_active":"2023-11-27T20:45:21.339919+0000","last_became_peered":"2023-11-27T20:45:21.339919+0000","last_unstale":"2023-11-27T20:45:23.357225+0000","last_undegraded":"2023-11-27T20:45:23.357225+0000","last_fullsized":"2023-11-27T20:45:23.357225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:44.073973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332909+0000","last_change":"2023-11-27T20:45:06.280819+0000","last_active":"2023-11-27T20:45:21.332909+0000","last_peered":"2023-11-27T20:45:21.332909+0000","last_clean":"2023-11-27T20:45:21.332909+0000","last_became_active":"2023-11-27T20:45:06.280545+0000","last_became_peered":"2023-11-27T20:45:06.280545+0000","last_unstale":"2023-11-27T20:45:21.332909+0000","last_undegraded":"2023-11-27T20:45:21.332909+0000","last_fullsized":"2023-11-27T20:45:21.332909+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:01.046541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"74'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.327117+0000","last_change":"2023-11-27T20:45:05.644560+0000","last_active":"2023-11-27T20:45:22.327117+0000","last_peered":"2023-11-27T20:45:22.327117+0000","last_clean":"2023-11-27T20:45:22.327117+0000","last_became_active":"2023-11-27T20:45:05.644264+0000","last_became_peered":"2023-11-27T20:45:05.644264+0000","last_unstale":"2023-11-27T20:45:22.327117+0000","last_undegraded":"2023-11-27T20:45:22.327117+0000","last_fullsized":"2023-11-27T20:45:22.327117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:02.361558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.453411+0000","last_change":"2023-11-27T20:45:22.354977+0000","last_active":"2023-11-27T20:45:23.453411+0000","last_peered":"2023-11-27T20:45:23.453411+0000","last_clean":"2023-11-27T20:45:23.453411+0000","last_became_active":"2023-11-27T20:45:22.350957+0000","last_became_peered":"2023-11-27T20:45:22.350957+0000","last_unstale":"2023-11-27T20:45:23.453411+0000","last_undegraded":"2023-11-27T20:45:23.453411+0000","last_fullsized":"2023-11-27T20:45:23.453411+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:57.104764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"80'4","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357586+0000","last_change":"2023-11-27T20:45:21.339017+0000","last_active":"2023-11-27T20:45:23.357586+0000","last_peered":"2023-11-27T20:45:23.357586+0000","last_clean":"2023-11-27T20:45:23.357586+0000","last_became_active":"2023-11-27T20:45:21.338757+0000","last_became_peered":"2023-11-27T20:45:21.338757+0000","last_unstale":"2023-11-27T20:45:23.357586+0000","last_undegraded":"2023-11-27T20:45:23.357586+0000","last_fullsized":"2023-11-27T20:45:23.357586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:16:58.196965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331531+0000","last_change":"2023-11-27T20:45:06.257973+0000","last_active":"2023-11-27T20:45:21.331531+0000","last_peered":"2023-11-27T20:45:21.331531+0000","last_clean":"2023-11-27T20:45:21.331531+0000","last_became_active":"2023-11-27T20:45:06.257676+0000","last_became_peered":"2023-11-27T20:45:06.257676+0000","last_unstale":"2023-11-27T20:45:21.331531+0000","last_undegraded":"2023-11-27T20:45:21.331531+0000","last_fullsized":"2023-11-27T20:45:21.331531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"74'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337593+0000","last_change":"2023-11-27T20:45:05.636666+0000","last_active":"2023-11-27T20:45:22.337593+0000","last_peered":"2023-11-27T20:45:22.337593+0000","last_clean":"2023-11-27T20:45:22.337593+0000","last_became_active":"2023-11-27T20:45:05.636401+0000","last_became_peered":"2023-11-27T20:45:05.636401+0000","last_unstale":"2023-11-27T20:45:22.337593+0000","last_undegraded":"2023-11-27T20:45:22.337593+0000","last_fullsized":"2023-11-27T20:45:22.337593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:34.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364139+0000","last_change":"2023-11-27T20:45:22.355853+0000","last_active":"2023-11-27T20:45:22.364139+0000","last_peered":"2023-11-27T20:45:22.364139+0000","last_clean":"2023-11-27T20:45:22.364139+0000","last_became_active":"2023-11-27T20:45:22.355501+0000","last_became_peered":"2023-11-27T20:45:22.355501+0000","last_unstale":"2023-11-27T20:45:22.364139+0000","last_undegraded":"2023-11-27T20:45:22.364139+0000","last_fullsized":"2023-11-27T20:45:22.364139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:17.023008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.371281+0000","last_change":"2023-11-27T20:45:21.348526+0000","last_active":"2023-11-27T20:45:22.371281+0000","last_peered":"2023-11-27T20:45:22.371281+0000","last_clean":"2023-11-27T20:45:22.371281+0000","last_became_active":"2023-11-27T20:45:21.348200+0000","last_became_peered":"2023-11-27T20:45:21.348200+0000","last_unstale":"2023-11-27T20:45:22.371281+0000","last_undegraded":"2023-11-27T20:45:22.371281+0000","last_fullsized":"2023-11-27T20:45:22.371281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:09.838796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.339278+0000","last_change":"2023-11-27T20:45:06.280675+0000","last_active":"2023-11-27T20:45:21.339278+0000","last_peered":"2023-11-27T20:45:21.339278+0000","last_clean":"2023-11-27T20:45:21.339278+0000","last_became_active":"2023-11-27T20:45:06.280169+0000","last_became_peered":"2023-11-27T20:45:06.280169+0000","last_unstale":"2023-11-27T20:45:21.339278+0000","last_undegraded":"2023-11-27T20:45:21.339278+0000","last_fullsized":"2023-11-27T20:45:21.339278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"74'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338550+0000","last_change":"2023-11-27T20:45:05.637617+0000","last_active":"2023-11-27T20:45:22.338550+0000","last_peered":"2023-11-27T20:45:22.338550+0000","last_clean":"2023-11-27T20:45:22.338550+0000","last_became_active":"2023-11-27T20:45:05.636099+0000","last_became_peered":"2023-11-27T20:45:05.636099+0000","last_unstale":"2023-11-27T20:45:22.338550+0000","last_undegraded":"2023-11-27T20:45:22.338550+0000","last_fullsized":"2023-11-27T20:45:22.338550+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:00.040780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.346817+0000","last_change":"2023-11-27T20:45:22.336541+0000","last_active":"2023-11-27T20:45:22.346817+0000","last_peered":"2023-11-27T20:45:22.346817+0000","last_clean":"2023-11-27T20:45:22.346817+0000","last_became_active":"2023-11-27T20:45:22.336095+0000","last_became_peered":"2023-11-27T20:45:22.336095+0000","last_unstale":"2023-11-27T20:45:22.346817+0000","last_undegraded":"2023-11-27T20:45:22.346817+0000","last_fullsized":"2023-11-27T20:45:22.346817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:50.234056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.332459+0000","last_change":"2023-11-27T20:45:21.341685+0000","last_active":"2023-11-27T20:45:22.332459+0000","last_peered":"2023-11-27T20:45:22.332459+0000","last_clean":"2023-11-27T20:45:22.332459+0000","last_became_active":"2023-11-27T20:45:21.340271+0000","last_became_peered":"2023-11-27T20:45:21.340271+0000","last_unstale":"2023-11-27T20:45:22.332459+0000","last_undegraded":"2023-11-27T20:45:22.332459+0000","last_fullsized":"2023-11-27T20:45:22.332459+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:37:49.091355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.318419+0000","last_change":"2023-11-27T20:45:06.271072+0000","last_active":"2023-11-27T20:45:22.318419+0000","last_peered":"2023-11-27T20:45:22.318419+0000","last_clean":"2023-11-27T20:45:22.318419+0000","last_became_active":"2023-11-27T20:45:06.270093+0000","last_became_peered":"2023-11-27T20:45:06.270093+0000","last_unstale":"2023-11-27T20:45:22.318419+0000","last_undegraded":"2023-11-27T20:45:22.318419+0000","last_fullsized":"2023-11-27T20:45:22.318419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:13:43.427726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"74'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.332298+0000","last_change":"2023-11-27T20:45:05.641565+0000","last_active":"2023-11-27T20:45:22.332298+0000","last_peered":"2023-11-27T20:45:22.332298+0000","last_clean":"2023-11-27T20:45:22.332298+0000","last_became_active":"2023-11-27T20:45:05.635532+0000","last_became_peered":"2023-11-27T20:45:05.635532+0000","last_unstale":"2023-11-27T20:45:22.332298+0000","last_undegraded":"2023-11-27T20:45:22.332298+0000","last_fullsized":"2023-11-27T20:45:22.332298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:01:09.043274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356858+0000","last_change":"2023-11-27T20:45:22.341814+0000","last_active":"2023-11-27T20:45:23.356858+0000","last_peered":"2023-11-27T20:45:23.356858+0000","last_clean":"2023-11-27T20:45:23.356858+0000","last_became_active":"2023-11-27T20:45:22.341523+0000","last_became_peered":"2023-11-27T20:45:22.341523+0000","last_unstale":"2023-11-27T20:45:23.356858+0000","last_undegraded":"2023-11-27T20:45:23.356858+0000","last_fullsized":"2023-11-27T20:45:23.356858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:37:50.104291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353094+0000","last_change":"2023-11-27T20:45:21.330006+0000","last_active":"2023-11-27T20:45:23.353094+0000","last_peered":"2023-11-27T20:45:23.353094+0000","last_clean":"2023-11-27T20:45:23.353094+0000","last_became_active":"2023-11-27T20:45:21.329190+0000","last_became_peered":"2023-11-27T20:45:21.329190+0000","last_unstale":"2023-11-27T20:45:23.353094+0000","last_undegraded":"2023-11-27T20:45:23.353094+0000","last_fullsized":"2023-11-27T20:45:23.353094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:21.269930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.332059+0000","last_change":"2023-11-27T20:45:06.269149+0000","last_active":"2023-11-27T20:45:22.332059+0000","last_peered":"2023-11-27T20:45:22.332059+0000","last_clean":"2023-11-27T20:45:22.332059+0000","last_became_active":"2023-11-27T20:45:06.268793+0000","last_became_peered":"2023-11-27T20:45:06.268793+0000","last_unstale":"2023-11-27T20:45:22.332059+0000","last_undegraded":"2023-11-27T20:45:22.332059+0000","last_fullsized":"2023-11-27T20:45:22.332059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"74'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.326878+0000","last_change":"2023-11-27T20:45:05.642294+0000","last_active":"2023-11-27T20:45:22.326878+0000","last_peered":"2023-11-27T20:45:22.326878+0000","last_clean":"2023-11-27T20:45:22.326878+0000","last_became_active":"2023-11-27T20:45:05.641621+0000","last_became_peered":"2023-11-27T20:45:05.641621+0000","last_unstale":"2023-11-27T20:45:22.326878+0000","last_undegraded":"2023-11-27T20:45:22.326878+0000","last_fullsized":"2023-11-27T20:45:22.326878+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:05.586683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.359067+0000","last_change":"2023-11-27T20:45:22.354371+0000","last_active":"2023-11-27T20:45:22.359067+0000","last_peered":"2023-11-27T20:45:22.359067+0000","last_clean":"2023-11-27T20:45:22.359067+0000","last_became_active":"2023-11-27T20:45:22.353961+0000","last_became_peered":"2023-11-27T20:45:22.353961+0000","last_unstale":"2023-11-27T20:45:22.359067+0000","last_undegraded":"2023-11-27T20:45:22.359067+0000","last_fullsized":"2023-11-27T20:45:22.359067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:13.448303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353534+0000","last_change":"2023-11-27T20:45:21.339994+0000","last_active":"2023-11-27T20:45:23.353534+0000","last_peered":"2023-11-27T20:45:23.353534+0000","last_clean":"2023-11-27T20:45:23.353534+0000","last_became_active":"2023-11-27T20:45:21.339295+0000","last_became_peered":"2023-11-27T20:45:21.339295+0000","last_unstale":"2023-11-27T20:45:23.353534+0000","last_undegraded":"2023-11-27T20:45:23.353534+0000","last_fullsized":"2023-11-27T20:45:23.353534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:21:13.827830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.336425+0000","last_change":"2023-11-27T20:45:06.283545+0000","last_active":"2023-11-27T20:45:21.336425+0000","last_peered":"2023-11-27T20:45:21.336425+0000","last_clean":"2023-11-27T20:45:21.336425+0000","last_became_active":"2023-11-27T20:45:06.281547+0000","last_became_peered":"2023-11-27T20:45:06.281547+0000","last_unstale":"2023-11-27T20:45:21.336425+0000","last_undegraded":"2023-11-27T20:45:21.336425+0000","last_fullsized":"2023-11-27T20:45:21.336425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:22:23.387234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.336421+0000","last_change":"2023-11-27T20:45:05.640954+0000","last_active":"2023-11-27T20:45:22.336421+0000","last_peered":"2023-11-27T20:45:22.336421+0000","last_clean":"2023-11-27T20:45:22.336421+0000","last_became_active":"2023-11-27T20:45:05.640670+0000","last_became_peered":"2023-11-27T20:45:05.640670+0000","last_unstale":"2023-11-27T20:45:22.336421+0000","last_undegraded":"2023-11-27T20:45:22.336421+0000","last_fullsized":"2023-11-27T20:45:22.336421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:13.460812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.363472+0000","last_change":"2023-11-27T20:45:22.359115+0000","last_active":"2023-11-27T20:45:22.363472+0000","last_peered":"2023-11-27T20:45:22.363472+0000","last_clean":"2023-11-27T20:45:22.363472+0000","last_became_active":"2023-11-27T20:45:22.358834+0000","last_became_peered":"2023-11-27T20:45:22.358834+0000","last_unstale":"2023-11-27T20:45:22.363472+0000","last_undegraded":"2023-11-27T20:45:22.363472+0000","last_fullsized":"2023-11-27T20:45:22.363472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:47.794087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356595+0000","last_change":"2023-11-27T20:45:21.337250+0000","last_active":"2023-11-27T20:45:23.356595+0000","last_peered":"2023-11-27T20:45:23.356595+0000","last_clean":"2023-11-27T20:45:23.356595+0000","last_became_active":"2023-11-27T20:45:21.336947+0000","last_became_peered":"2023-11-27T20:45:21.336947+0000","last_unstale":"2023-11-27T20:45:23.356595+0000","last_undegraded":"2023-11-27T20:45:23.356595+0000","last_fullsized":"2023-11-27T20:45:23.356595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:01:15.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.324096+0000","last_change":"2023-11-27T20:45:06.267459+0000","last_active":"2023-11-27T20:45:21.324096+0000","last_peered":"2023-11-27T20:45:21.324096+0000","last_clean":"2023-11-27T20:45:21.324096+0000","last_became_active":"2023-11-27T20:45:06.267115+0000","last_became_peered":"2023-11-27T20:45:06.267115+0000","last_unstale":"2023-11-27T20:45:21.324096+0000","last_undegraded":"2023-11-27T20:45:21.324096+0000","last_fullsized":"2023-11-27T20:45:21.324096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:16:23.654821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.317415+0000","last_change":"2023-11-27T20:45:05.641922+0000","last_active":"2023-11-27T20:45:22.317415+0000","last_peered":"2023-11-27T20:45:22.317415+0000","last_clean":"2023-11-27T20:45:22.317415+0000","last_became_active":"2023-11-27T20:45:05.641612+0000","last_became_peered":"2023-11-27T20:45:05.641612+0000","last_unstale":"2023-11-27T20:45:22.317415+0000","last_undegraded":"2023-11-27T20:45:22.317415+0000","last_fullsized":"2023-11-27T20:45:22.317415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:57:05.757599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.350264+0000","last_change":"2023-11-27T20:45:22.343208+0000","last_active":"2023-11-27T20:45:22.350264+0000","last_peered":"2023-11-27T20:45:22.350264+0000","last_clean":"2023-11-27T20:45:22.350264+0000","last_became_active":"2023-11-27T20:45:22.342542+0000","last_became_peered":"2023-11-27T20:45:22.342542+0000","last_unstale":"2023-11-27T20:45:22.350264+0000","last_undegraded":"2023-11-27T20:45:22.350264+0000","last_fullsized":"2023-11-27T20:45:22.350264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:30.859296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"80'3","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.371157+0000","last_change":"2023-11-27T20:45:21.348133+0000","last_active":"2023-11-27T20:45:22.371157+0000","last_peered":"2023-11-27T20:45:22.371157+0000","last_clean":"2023-11-27T20:45:22.371157+0000","last_became_active":"2023-11-27T20:45:21.347651+0000","last_became_peered":"2023-11-27T20:45:21.347651+0000","last_unstale":"2023-11-27T20:45:22.371157+0000","last_undegraded":"2023-11-27T20:45:22.371157+0000","last_fullsized":"2023-11-27T20:45:22.371157+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:17:39.954725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332336+0000","last_change":"2023-11-27T20:45:06.273369+0000","last_active":"2023-11-27T20:45:21.332336+0000","last_peered":"2023-11-27T20:45:21.332336+0000","last_clean":"2023-11-27T20:45:21.332336+0000","last_became_active":"2023-11-27T20:45:06.271740+0000","last_became_peered":"2023-11-27T20:45:06.271740+0000","last_unstale":"2023-11-27T20:45:21.332336+0000","last_undegraded":"2023-11-27T20:45:21.332336+0000","last_fullsized":"2023-11-27T20:45:21.332336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:12.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333210+0000","last_change":"2023-11-27T20:45:05.631301+0000","last_active":"2023-11-27T20:45:21.333210+0000","last_peered":"2023-11-27T20:45:21.333210+0000","last_clean":"2023-11-27T20:45:21.333210+0000","last_became_active":"2023-11-27T20:45:05.630652+0000","last_became_peered":"2023-11-27T20:45:05.630652+0000","last_unstale":"2023-11-27T20:45:21.333210+0000","last_undegraded":"2023-11-27T20:45:21.333210+0000","last_fullsized":"2023-11-27T20:45:21.333210+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:58.001108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364364+0000","last_change":"2023-11-27T20:45:22.361676+0000","last_active":"2023-11-27T20:45:22.364364+0000","last_peered":"2023-11-27T20:45:22.364364+0000","last_clean":"2023-11-27T20:45:22.364364+0000","last_became_active":"2023-11-27T20:45:22.361352+0000","last_became_peered":"2023-11-27T20:45:22.361352+0000","last_unstale":"2023-11-27T20:45:22.364364+0000","last_undegraded":"2023-11-27T20:45:22.364364+0000","last_fullsized":"2023-11-27T20:45:22.364364+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:17.023008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"80'6","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357773+0000","last_change":"2023-11-27T20:45:21.335431+0000","last_active":"2023-11-27T20:45:23.357773+0000","last_peered":"2023-11-27T20:45:23.357773+0000","last_clean":"2023-11-27T20:45:23.357773+0000","last_became_active":"2023-11-27T20:45:21.335024+0000","last_became_peered":"2023-11-27T20:45:21.335024+0000","last_unstale":"2023-11-27T20:45:23.357773+0000","last_undegraded":"2023-11-27T20:45:23.357773+0000","last_fullsized":"2023-11-27T20:45:23.357773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:29.846361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333246+0000","last_change":"2023-11-27T20:45:06.273782+0000","last_active":"2023-11-27T20:45:21.333246+0000","last_peered":"2023-11-27T20:45:21.333246+0000","last_clean":"2023-11-27T20:45:21.333246+0000","last_became_active":"2023-11-27T20:45:06.273475+0000","last_became_peered":"2023-11-27T20:45:06.273475+0000","last_unstale":"2023-11-27T20:45:21.333246+0000","last_undegraded":"2023-11-27T20:45:21.333246+0000","last_fullsized":"2023-11-27T20:45:21.333246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332620+0000","last_change":"2023-11-27T20:45:05.646362+0000","last_active":"2023-11-27T20:45:21.332620+0000","last_peered":"2023-11-27T20:45:21.332620+0000","last_clean":"2023-11-27T20:45:21.332620+0000","last_became_active":"2023-11-27T20:45:05.645919+0000","last_became_peered":"2023-11-27T20:45:05.645919+0000","last_unstale":"2023-11-27T20:45:21.332620+0000","last_undegraded":"2023-11-27T20:45:21.332620+0000","last_fullsized":"2023-11-27T20:45:21.332620+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:01:09.043274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357594+0000","last_change":"2023-11-27T20:45:22.353452+0000","last_active":"2023-11-27T20:45:23.357594+0000","last_peered":"2023-11-27T20:45:23.357594+0000","last_clean":"2023-11-27T20:45:23.357594+0000","last_became_active":"2023-11-27T20:45:22.352105+0000","last_became_peered":"2023-11-27T20:45:22.352105+0000","last_unstale":"2023-11-27T20:45:23.357594+0000","last_undegraded":"2023-11-27T20:45:23.357594+0000","last_fullsized":"2023-11-27T20:45:23.357594+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:17.355833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.355021+0000","last_change":"2023-11-27T20:45:21.334475+0000","last_active":"2023-11-27T20:45:23.355021+0000","last_peered":"2023-11-27T20:45:23.355021+0000","last_clean":"2023-11-27T20:45:23.355021+0000","last_became_active":"2023-11-27T20:45:21.334136+0000","last_became_peered":"2023-11-27T20:45:21.334136+0000","last_unstale":"2023-11-27T20:45:23.355021+0000","last_undegraded":"2023-11-27T20:45:23.355021+0000","last_fullsized":"2023-11-27T20:45:23.355021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:41.024339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338458+0000","last_change":"2023-11-27T20:45:06.283036+0000","last_active":"2023-11-27T20:45:22.338458+0000","last_peered":"2023-11-27T20:45:22.338458+0000","last_clean":"2023-11-27T20:45:22.338458+0000","last_became_active":"2023-11-27T20:45:06.281987+0000","last_became_peered":"2023-11-27T20:45:06.281987+0000","last_unstale":"2023-11-27T20:45:22.338458+0000","last_undegraded":"2023-11-27T20:45:22.338458+0000","last_fullsized":"2023-11-27T20:45:22.338458+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:13.008822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"74'3","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331894+0000","last_change":"2023-11-27T20:45:05.634876+0000","last_active":"2023-11-27T20:45:21.331894+0000","last_peered":"2023-11-27T20:45:21.331894+0000","last_clean":"2023-11-27T20:45:21.331894+0000","last_became_active":"2023-11-27T20:45:05.634310+0000","last_became_peered":"2023-11-27T20:45:05.634310+0000","last_unstale":"2023-11-27T20:45:21.331894+0000","last_undegraded":"2023-11-27T20:45:21.331894+0000","last_fullsized":"2023-11-27T20:45:21.331894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:44:30.721707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.359195+0000","last_change":"2023-11-27T20:45:22.350667+0000","last_active":"2023-11-27T20:45:23.359195+0000","last_peered":"2023-11-27T20:45:23.359195+0000","last_clean":"2023-11-27T20:45:23.359195+0000","last_became_active":"2023-11-27T20:45:22.350401+0000","last_became_peered":"2023-11-27T20:45:22.350401+0000","last_unstale":"2023-11-27T20:45:23.359195+0000","last_undegraded":"2023-11-27T20:45:23.359195+0000","last_fullsized":"2023-11-27T20:45:23.359195+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:30:12.613989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.341921+0000","last_change":"2023-11-27T20:45:21.338433+0000","last_active":"2023-11-27T20:45:22.341921+0000","last_peered":"2023-11-27T20:45:22.341921+0000","last_clean":"2023-11-27T20:45:22.341921+0000","last_became_active":"2023-11-27T20:45:21.338122+0000","last_became_peered":"2023-11-27T20:45:21.338122+0000","last_unstale":"2023-11-27T20:45:22.341921+0000","last_undegraded":"2023-11-27T20:45:22.341921+0000","last_fullsized":"2023-11-27T20:45:22.341921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:17:39.954725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.330219+0000","last_change":"2023-11-27T20:45:06.282223+0000","last_active":"2023-11-27T20:45:22.330219+0000","last_peered":"2023-11-27T20:45:22.330219+0000","last_clean":"2023-11-27T20:45:22.330219+0000","last_became_active":"2023-11-27T20:45:06.281055+0000","last_became_peered":"2023-11-27T20:45:06.281055+0000","last_unstale":"2023-11-27T20:45:22.330219+0000","last_undegraded":"2023-11-27T20:45:22.330219+0000","last_fullsized":"2023-11-27T20:45:22.330219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:00.849008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"75'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333330+0000","last_change":"2023-11-27T20:45:05.636622+0000","last_active":"2023-11-27T20:45:21.333330+0000","last_peered":"2023-11-27T20:45:21.333330+0000","last_clean":"2023-11-27T20:45:21.333330+0000","last_became_active":"2023-11-27T20:45:05.633202+0000","last_became_peered":"2023-11-27T20:45:05.633202+0000","last_unstale":"2023-11-27T20:45:21.333330+0000","last_undegraded":"2023-11-27T20:45:21.333330+0000","last_fullsized":"2023-11-27T20:45:21.333330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:02.361558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356657+0000","last_change":"2023-11-27T20:45:22.340246+0000","last_active":"2023-11-27T20:45:23.356657+0000","last_peered":"2023-11-27T20:45:23.356657+0000","last_clean":"2023-11-27T20:45:23.356657+0000","last_became_active":"2023-11-27T20:45:22.339915+0000","last_became_peered":"2023-11-27T20:45:22.339915+0000","last_unstale":"2023-11-27T20:45:23.356657+0000","last_undegraded":"2023-11-27T20:45:23.356657+0000","last_fullsized":"2023-11-27T20:45:23.356657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:47.794087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356657+0000","last_change":"2023-11-27T20:45:21.337690+0000","last_active":"2023-11-27T20:45:23.356657+0000","last_peered":"2023-11-27T20:45:23.356657+0000","last_clean":"2023-11-27T20:45:23.356657+0000","last_became_active":"2023-11-27T20:45:21.336774+0000","last_became_peered":"2023-11-27T20:45:21.336774+0000","last_unstale":"2023-11-27T20:45:23.356657+0000","last_undegraded":"2023-11-27T20:45:23.356657+0000","last_fullsized":"2023-11-27T20:45:23.356657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:36:21.078898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337972+0000","last_change":"2023-11-27T20:45:06.276770+0000","last_active":"2023-11-27T20:45:22.337972+0000","last_peered":"2023-11-27T20:45:22.337972+0000","last_clean":"2023-11-27T20:45:22.337972+0000","last_became_active":"2023-11-27T20:45:06.276404+0000","last_became_peered":"2023-11-27T20:45:06.276404+0000","last_unstale":"2023-11-27T20:45:22.337972+0000","last_undegraded":"2023-11-27T20:45:22.337972+0000","last_fullsized":"2023-11-27T20:45:22.337972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:26.013200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"74'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.319645+0000","last_change":"2023-11-27T20:45:05.634047+0000","last_active":"2023-11-27T20:45:22.319645+0000","last_peered":"2023-11-27T20:45:22.319645+0000","last_clean":"2023-11-27T20:45:22.319645+0000","last_became_active":"2023-11-27T20:45:05.633852+0000","last_became_peered":"2023-11-27T20:45:05.633852+0000","last_unstale":"2023-11-27T20:45:22.319645+0000","last_undegraded":"2023-11-27T20:45:22.319645+0000","last_fullsized":"2023-11-27T20:45:22.319645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:10:34.426540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451099+0000","last_change":"2023-11-27T20:45:22.352257+0000","last_active":"2023-11-27T20:45:23.451099+0000","last_peered":"2023-11-27T20:45:23.451099+0000","last_clean":"2023-11-27T20:45:23.451099+0000","last_became_active":"2023-11-27T20:45:22.351966+0000","last_became_peered":"2023-11-27T20:45:22.351966+0000","last_unstale":"2023-11-27T20:45:23.451099+0000","last_undegraded":"2023-11-27T20:45:23.451099+0000","last_fullsized":"2023-11-27T20:45:23.451099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:01:25.739456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"80'8","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353226+0000","last_change":"2023-11-27T20:45:21.337936+0000","last_active":"2023-11-27T20:45:23.353226+0000","last_peered":"2023-11-27T20:45:23.353226+0000","last_clean":"2023-11-27T20:45:23.353226+0000","last_became_active":"2023-11-27T20:45:21.337619+0000","last_became_peered":"2023-11-27T20:45:21.337619+0000","last_unstale":"2023-11-27T20:45:23.353226+0000","last_undegraded":"2023-11-27T20:45:23.353226+0000","last_fullsized":"2023-11-27T20:45:23.353226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:18.044804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.337160+0000","last_change":"2023-11-27T20:45:06.277808+0000","last_active":"2023-11-27T20:45:21.337160+0000","last_peered":"2023-11-27T20:45:21.337160+0000","last_clean":"2023-11-27T20:45:21.337160+0000","last_became_active":"2023-11-27T20:45:06.277521+0000","last_became_peered":"2023-11-27T20:45:06.277521+0000","last_unstale":"2023-11-27T20:45:21.337160+0000","last_undegraded":"2023-11-27T20:45:21.337160+0000","last_fullsized":"2023-11-27T20:45:21.337160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:16:23.654821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332610+0000","last_change":"2023-11-27T20:45:05.632402+0000","last_active":"2023-11-27T20:45:21.332610+0000","last_peered":"2023-11-27T20:45:21.332610+0000","last_clean":"2023-11-27T20:45:21.332610+0000","last_became_active":"2023-11-27T20:45:05.632030+0000","last_became_peered":"2023-11-27T20:45:05.632030+0000","last_unstale":"2023-11-27T20:45:21.332610+0000","last_undegraded":"2023-11-27T20:45:21.332610+0000","last_fullsized":"2023-11-27T20:45:21.332610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:01.270371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364157+0000","last_change":"2023-11-27T20:45:22.355892+0000","last_active":"2023-11-27T20:45:22.364157+0000","last_peered":"2023-11-27T20:45:22.364157+0000","last_clean":"2023-11-27T20:45:22.364157+0000","last_became_active":"2023-11-27T20:45:22.354975+0000","last_became_peered":"2023-11-27T20:45:22.354975+0000","last_unstale":"2023-11-27T20:45:22.364157+0000","last_undegraded":"2023-11-27T20:45:22.364157+0000","last_fullsized":"2023-11-27T20:45:22.364157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:37:50.104291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451643+0000","last_change":"2023-11-27T20:45:21.340395+0000","last_active":"2023-11-27T20:45:23.451643+0000","last_peered":"2023-11-27T20:45:23.451643+0000","last_clean":"2023-11-27T20:45:23.451643+0000","last_became_active":"2023-11-27T20:45:21.340110+0000","last_became_peered":"2023-11-27T20:45:21.340110+0000","last_unstale":"2023-11-27T20:45:23.451643+0000","last_undegraded":"2023-11-27T20:45:23.451643+0000","last_fullsized":"2023-11-27T20:45:23.451643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:40:41.655588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.317173+0000","last_change":"2023-11-27T20:45:06.272412+0000","last_active":"2023-11-27T20:45:22.317173+0000","last_peered":"2023-11-27T20:45:22.317173+0000","last_clean":"2023-11-27T20:45:22.317173+0000","last_became_active":"2023-11-27T20:45:06.272103+0000","last_became_peered":"2023-11-27T20:45:06.272103+0000","last_unstale":"2023-11-27T20:45:22.317173+0000","last_undegraded":"2023-11-27T20:45:22.317173+0000","last_fullsized":"2023-11-27T20:45:22.317173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:38.651622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330379+0000","last_change":"2023-11-27T20:45:05.644812+0000","last_active":"2023-11-27T20:45:21.330379+0000","last_peered":"2023-11-27T20:45:21.330379+0000","last_clean":"2023-11-27T20:45:21.330379+0000","last_became_active":"2023-11-27T20:45:05.644097+0000","last_became_peered":"2023-11-27T20:45:05.644097+0000","last_unstale":"2023-11-27T20:45:21.330379+0000","last_undegraded":"2023-11-27T20:45:21.330379+0000","last_fullsized":"2023-11-27T20:45:21.330379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:58.144583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353927+0000","last_change":"2023-11-27T20:45:22.356086+0000","last_active":"2023-11-27T20:45:23.353927+0000","last_peered":"2023-11-27T20:45:23.353927+0000","last_clean":"2023-11-27T20:45:23.353927+0000","last_became_active":"2023-11-27T20:45:22.349758+0000","last_became_peered":"2023-11-27T20:45:22.349758+0000","last_unstale":"2023-11-27T20:45:23.353927+0000","last_undegraded":"2023-11-27T20:45:23.353927+0000","last_fullsized":"2023-11-27T20:45:23.353927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:30.156994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451129+0000","last_change":"2023-11-27T20:45:21.335516+0000","last_active":"2023-11-27T20:45:23.451129+0000","last_peered":"2023-11-27T20:45:23.451129+0000","last_clean":"2023-11-27T20:45:23.451129+0000","last_became_active":"2023-11-27T20:45:21.335179+0000","last_became_peered":"2023-11-27T20:45:21.335179+0000","last_unstale":"2023-11-27T20:45:23.451129+0000","last_undegraded":"2023-11-27T20:45:23.451129+0000","last_fullsized":"2023-11-27T20:45:23.451129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:28.018483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.315860+0000","last_change":"2023-11-27T20:45:06.263986+0000","last_active":"2023-11-27T20:45:22.315860+0000","last_peered":"2023-11-27T20:45:22.315860+0000","last_clean":"2023-11-27T20:45:22.315860+0000","last_became_active":"2023-11-27T20:45:06.263465+0000","last_became_peered":"2023-11-27T20:45:06.263465+0000","last_unstale":"2023-11-27T20:45:22.315860+0000","last_undegraded":"2023-11-27T20:45:22.315860+0000","last_fullsized":"2023-11-27T20:45:22.315860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:54:46.614170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"74'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.339194+0000","last_change":"2023-11-27T20:45:05.641159+0000","last_active":"2023-11-27T20:45:22.339194+0000","last_peered":"2023-11-27T20:45:22.339194+0000","last_clean":"2023-11-27T20:45:22.339194+0000","last_became_active":"2023-11-27T20:45:05.640821+0000","last_became_peered":"2023-11-27T20:45:05.640821+0000","last_unstale":"2023-11-27T20:45:22.339194+0000","last_undegraded":"2023-11-27T20:45:22.339194+0000","last_fullsized":"2023-11-27T20:45:22.339194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:06.355870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358965+0000","last_change":"2023-11-27T20:45:22.353477+0000","last_active":"2023-11-27T20:45:22.358965+0000","last_peered":"2023-11-27T20:45:22.358965+0000","last_clean":"2023-11-27T20:45:22.358965+0000","last_became_active":"2023-11-27T20:45:22.352485+0000","last_became_peered":"2023-11-27T20:45:22.352485+0000","last_unstale":"2023-11-27T20:45:22.358965+0000","last_undegraded":"2023-11-27T20:45:22.358965+0000","last_fullsized":"2023-11-27T20:45:22.358965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:22:39.077655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.371672+0000","last_change":"2023-11-27T20:45:21.343347+0000","last_active":"2023-11-27T20:45:22.371672+0000","last_peered":"2023-11-27T20:45:22.371672+0000","last_clean":"2023-11-27T20:45:22.371672+0000","last_became_active":"2023-11-27T20:45:21.342932+0000","last_became_peered":"2023-11-27T20:45:21.342932+0000","last_unstale":"2023-11-27T20:45:22.371672+0000","last_undegraded":"2023-11-27T20:45:22.371672+0000","last_fullsized":"2023-11-27T20:45:22.371672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:18:20.760478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.341152+0000","last_change":"2023-11-27T20:45:06.275736+0000","last_active":"2023-11-27T20:45:21.341152+0000","last_peered":"2023-11-27T20:45:21.341152+0000","last_clean":"2023-11-27T20:45:21.341152+0000","last_became_active":"2023-11-27T20:45:06.275432+0000","last_became_peered":"2023-11-27T20:45:06.275432+0000","last_unstale":"2023-11-27T20:45:21.341152+0000","last_undegraded":"2023-11-27T20:45:21.341152+0000","last_fullsized":"2023-11-27T20:45:21.341152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:12.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"74'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333364+0000","last_change":"2023-11-27T20:45:05.633605+0000","last_active":"2023-11-27T20:45:21.333364+0000","last_peered":"2023-11-27T20:45:21.333364+0000","last_clean":"2023-11-27T20:45:21.333364+0000","last_became_active":"2023-11-27T20:45:05.633283+0000","last_became_peered":"2023-11-27T20:45:05.633283+0000","last_unstale":"2023-11-27T20:45:21.333364+0000","last_undegraded":"2023-11-27T20:45:21.333364+0000","last_fullsized":"2023-11-27T20:45:21.333364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:05.586683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358868+0000","last_change":"2023-11-27T20:45:22.354702+0000","last_active":"2023-11-27T20:45:22.358868+0000","last_peered":"2023-11-27T20:45:22.358868+0000","last_clean":"2023-11-27T20:45:22.358868+0000","last_became_active":"2023-11-27T20:45:22.354354+0000","last_became_peered":"2023-11-27T20:45:22.354354+0000","last_unstale":"2023-11-27T20:45:22.358868+0000","last_undegraded":"2023-11-27T20:45:22.358868+0000","last_fullsized":"2023-11-27T20:45:22.358868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:30:12.613989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357348+0000","last_change":"2023-11-27T20:45:21.339620+0000","last_active":"2023-11-27T20:45:23.357348+0000","last_peered":"2023-11-27T20:45:23.357348+0000","last_clean":"2023-11-27T20:45:23.357348+0000","last_became_active":"2023-11-27T20:45:21.339296+0000","last_became_peered":"2023-11-27T20:45:21.339296+0000","last_unstale":"2023-11-27T20:45:23.357348+0000","last_undegraded":"2023-11-27T20:45:23.357348+0000","last_fullsized":"2023-11-27T20:45:23.357348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:03.598760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333011+0000","last_change":"2023-11-27T20:45:06.279727+0000","last_active":"2023-11-27T20:45:21.333011+0000","last_peered":"2023-11-27T20:45:21.333011+0000","last_clean":"2023-11-27T20:45:21.333011+0000","last_became_active":"2023-11-27T20:45:06.270223+0000","last_became_peered":"2023-11-27T20:45:06.270223+0000","last_unstale":"2023-11-27T20:45:21.333011+0000","last_undegraded":"2023-11-27T20:45:21.333011+0000","last_fullsized":"2023-11-27T20:45:21.333011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:59:57.174632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"74'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.336997+0000","last_change":"2023-11-27T20:45:05.642228+0000","last_active":"2023-11-27T20:45:22.336997+0000","last_peered":"2023-11-27T20:45:22.336997+0000","last_clean":"2023-11-27T20:45:22.336997+0000","last_became_active":"2023-11-27T20:45:05.641885+0000","last_became_peered":"2023-11-27T20:45:05.641885+0000","last_unstale":"2023-11-27T20:45:22.336997+0000","last_undegraded":"2023-11-27T20:45:22.336997+0000","last_fullsized":"2023-11-27T20:45:22.336997+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:56.752121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358501+0000","last_change":"2023-11-27T20:45:22.353735+0000","last_active":"2023-11-27T20:45:22.358501+0000","last_peered":"2023-11-27T20:45:22.358501+0000","last_clean":"2023-11-27T20:45:22.358501+0000","last_became_active":"2023-11-27T20:45:22.353343+0000","last_became_peered":"2023-11-27T20:45:22.353343+0000","last_unstale":"2023-11-27T20:45:22.358501+0000","last_undegraded":"2023-11-27T20:45:22.358501+0000","last_fullsized":"2023-11-27T20:45:22.358501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:31:31.417613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.358691+0000","last_change":"2023-11-27T20:45:21.345276+0000","last_active":"2023-11-27T20:45:23.358691+0000","last_peered":"2023-11-27T20:45:23.358691+0000","last_clean":"2023-11-27T20:45:23.358691+0000","last_became_active":"2023-11-27T20:45:21.344800+0000","last_became_peered":"2023-11-27T20:45:21.344800+0000","last_unstale":"2023-11-27T20:45:23.358691+0000","last_undegraded":"2023-11-27T20:45:23.358691+0000","last_fullsized":"2023-11-27T20:45:23.358691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:25.955036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.331699+0000","last_change":"2023-11-27T20:45:06.274675+0000","last_active":"2023-11-27T20:45:22.331699+0000","last_peered":"2023-11-27T20:45:22.331699+0000","last_clean":"2023-11-27T20:45:22.331699+0000","last_became_active":"2023-11-27T20:45:06.271749+0000","last_became_peered":"2023-11-27T20:45:06.271749+0000","last_unstale":"2023-11-27T20:45:22.331699+0000","last_undegraded":"2023-11-27T20:45:22.331699+0000","last_fullsized":"2023-11-27T20:45:22.331699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:07.361631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338635+0000","last_change":"2023-11-27T20:45:05.642419+0000","last_active":"2023-11-27T20:45:22.338635+0000","last_peered":"2023-11-27T20:45:22.338635+0000","last_clean":"2023-11-27T20:45:22.338635+0000","last_became_active":"2023-11-27T20:45:05.642092+0000","last_became_peered":"2023-11-27T20:45:05.642092+0000","last_unstale":"2023-11-27T20:45:22.338635+0000","last_undegraded":"2023-11-27T20:45:22.338635+0000","last_fullsized":"2023-11-27T20:45:22.338635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:54.248320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.450689+0000","last_change":"2023-11-27T20:45:22.355066+0000","last_active":"2023-11-27T20:45:23.450689+0000","last_peered":"2023-11-27T20:45:23.450689+0000","last_clean":"2023-11-27T20:45:23.450689+0000","last_became_active":"2023-11-27T20:45:22.354672+0000","last_became_peered":"2023-11-27T20:45:22.354672+0000","last_unstale":"2023-11-27T20:45:23.450689+0000","last_undegraded":"2023-11-27T20:45:23.450689+0000","last_fullsized":"2023-11-27T20:45:23.450689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:22.282865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.341376+0000","last_change":"2023-11-27T20:45:21.337529+0000","last_active":"2023-11-27T20:45:22.341376+0000","last_peered":"2023-11-27T20:45:22.341376+0000","last_clean":"2023-11-27T20:45:22.341376+0000","last_became_active":"2023-11-27T20:45:21.337122+0000","last_became_peered":"2023-11-27T20:45:21.337122+0000","last_unstale":"2023-11-27T20:45:22.341376+0000","last_undegraded":"2023-11-27T20:45:22.341376+0000","last_fullsized":"2023-11-27T20:45:22.341376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:27.686308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337926+0000","last_change":"2023-11-27T20:45:19.356541+0000","last_active":"2023-11-27T20:45:22.337926+0000","last_peered":"2023-11-27T20:45:22.337926+0000","last_clean":"2023-11-27T20:45:22.337926+0000","last_became_active":"2023-11-27T20:45:19.356100+0000","last_became_peered":"2023-11-27T20:45:19.356100+0000","last_unstale":"2023-11-27T20:45:22.337926+0000","last_undegraded":"2023-11-27T20:45:22.337926+0000","last_fullsized":"2023-11-27T20:45:22.337926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:30:07.660175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"74'2","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331262+0000","last_change":"2023-11-27T20:45:05.628335+0000","last_active":"2023-11-27T20:45:21.331262+0000","last_peered":"2023-11-27T20:45:21.331262+0000","last_clean":"2023-11-27T20:45:21.331262+0000","last_became_active":"2023-11-27T20:45:05.627980+0000","last_became_peered":"2023-11-27T20:45:05.627980+0000","last_unstale":"2023-11-27T20:45:21.331262+0000","last_undegraded":"2023-11-27T20:45:21.331262+0000","last_fullsized":"2023-11-27T20:45:21.331262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:19.744666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.341223+0000","last_change":"2023-11-27T20:45:22.333992+0000","last_active":"2023-11-27T20:45:22.341223+0000","last_peered":"2023-11-27T20:45:22.341223+0000","last_clean":"2023-11-27T20:45:22.341223+0000","last_became_active":"2023-11-27T20:45:22.333557+0000","last_became_peered":"2023-11-27T20:45:22.333557+0000","last_unstale":"2023-11-27T20:45:22.341223+0000","last_undegraded":"2023-11-27T20:45:22.341223+0000","last_fullsized":"2023-11-27T20:45:22.341223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:00:29.866265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356358+0000","last_change":"2023-11-27T20:45:21.333924+0000","last_active":"2023-11-27T20:45:23.356358+0000","last_peered":"2023-11-27T20:45:23.356358+0000","last_clean":"2023-11-27T20:45:23.356358+0000","last_became_active":"2023-11-27T20:45:21.333652+0000","last_became_peered":"2023-11-27T20:45:21.333652+0000","last_unstale":"2023-11-27T20:45:23.356358+0000","last_undegraded":"2023-11-27T20:45:23.356358+0000","last_fullsized":"2023-11-27T20:45:23.356358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:45:03.176272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331285+0000","last_change":"2023-11-27T20:45:06.265399+0000","last_active":"2023-11-27T20:45:21.331285+0000","last_peered":"2023-11-27T20:45:21.331285+0000","last_clean":"2023-11-27T20:45:21.331285+0000","last_became_active":"2023-11-27T20:45:06.265015+0000","last_became_peered":"2023-11-27T20:45:06.265015+0000","last_unstale":"2023-11-27T20:45:21.331285+0000","last_undegraded":"2023-11-27T20:45:21.331285+0000","last_fullsized":"2023-11-27T20:45:21.331285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338034+0000","last_change":"2023-11-27T20:45:05.639115+0000","last_active":"2023-11-27T20:45:22.338034+0000","last_peered":"2023-11-27T20:45:22.338034+0000","last_clean":"2023-11-27T20:45:22.338034+0000","last_became_active":"2023-11-27T20:45:05.638219+0000","last_became_peered":"2023-11-27T20:45:05.638219+0000","last_unstale":"2023-11-27T20:45:22.338034+0000","last_undegraded":"2023-11-27T20:45:22.338034+0000","last_fullsized":"2023-11-27T20:45:22.338034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:38.005329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451112+0000","last_change":"2023-11-27T20:45:22.358166+0000","last_active":"2023-11-27T20:45:23.451112+0000","last_peered":"2023-11-27T20:45:23.451112+0000","last_clean":"2023-11-27T20:45:23.451112+0000","last_became_active":"2023-11-27T20:45:22.357901+0000","last_became_peered":"2023-11-27T20:45:22.357901+0000","last_unstale":"2023-11-27T20:45:23.451112+0000","last_undegraded":"2023-11-27T20:45:23.451112+0000","last_fullsized":"2023-11-27T20:45:23.451112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:51.664151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357223+0000","last_change":"2023-11-27T20:45:21.345762+0000","last_active":"2023-11-27T20:45:23.357223+0000","last_peered":"2023-11-27T20:45:23.357223+0000","last_clean":"2023-11-27T20:45:23.357223+0000","last_became_active":"2023-11-27T20:45:21.345068+0000","last_became_peered":"2023-11-27T20:45:21.345068+0000","last_unstale":"2023-11-27T20:45:23.357223+0000","last_undegraded":"2023-11-27T20:45:23.357223+0000","last_fullsized":"2023-11-27T20:45:23.357223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:38:55.334782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.340725+0000","last_change":"2023-11-27T20:45:06.270416+0000","last_active":"2023-11-27T20:45:22.340725+0000","last_peered":"2023-11-27T20:45:22.340725+0000","last_clean":"2023-11-27T20:45:22.340725+0000","last_became_active":"2023-11-27T20:45:06.270028+0000","last_became_peered":"2023-11-27T20:45:06.270028+0000","last_unstale":"2023-11-27T20:45:22.340725+0000","last_undegraded":"2023-11-27T20:45:22.340725+0000","last_fullsized":"2023-11-27T20:45:22.340725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:03.641350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.331945+0000","last_change":"2023-11-27T20:45:05.637206+0000","last_active":"2023-11-27T20:45:22.331945+0000","last_peered":"2023-11-27T20:45:22.331945+0000","last_clean":"2023-11-27T20:45:22.331945+0000","last_became_active":"2023-11-27T20:45:05.636487+0000","last_became_peered":"2023-11-27T20:45:05.636487+0000","last_unstale":"2023-11-27T20:45:22.331945+0000","last_undegraded":"2023-11-27T20:45:22.331945+0000","last_fullsized":"2023-11-27T20:45:22.331945+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:47.083443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451830+0000","last_change":"2023-11-27T20:45:22.353719+0000","last_active":"2023-11-27T20:45:23.451830+0000","last_peered":"2023-11-27T20:45:23.451830+0000","last_clean":"2023-11-27T20:45:23.451830+0000","last_became_active":"2023-11-27T20:45:22.353412+0000","last_became_peered":"2023-11-27T20:45:22.353412+0000","last_unstale":"2023-11-27T20:45:23.451830+0000","last_undegraded":"2023-11-27T20:45:23.451830+0000","last_fullsized":"2023-11-27T20:45:23.451830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:27.341287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.342758+0000","last_change":"2023-11-27T20:45:21.335464+0000","last_active":"2023-11-27T20:45:22.342758+0000","last_peered":"2023-11-27T20:45:22.342758+0000","last_clean":"2023-11-27T20:45:22.342758+0000","last_became_active":"2023-11-27T20:45:21.333731+0000","last_became_peered":"2023-11-27T20:45:21.333731+0000","last_unstale":"2023-11-27T20:45:22.342758+0000","last_undegraded":"2023-11-27T20:45:22.342758+0000","last_fullsized":"2023-11-27T20:45:22.342758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:40.690686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330646+0000","last_change":"2023-11-27T20:45:06.279113+0000","last_active":"2023-11-27T20:45:21.330646+0000","last_peered":"2023-11-27T20:45:21.330646+0000","last_clean":"2023-11-27T20:45:21.330646+0000","last_became_active":"2023-11-27T20:45:06.278833+0000","last_became_peered":"2023-11-27T20:45:06.278833+0000","last_unstale":"2023-11-27T20:45:21.330646+0000","last_undegraded":"2023-11-27T20:45:21.330646+0000","last_fullsized":"2023-11-27T20:45:21.330646+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:24.286070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.321548+0000","last_change":"2023-11-27T20:45:05.635630+0000","last_active":"2023-11-27T20:45:21.321548+0000","last_peered":"2023-11-27T20:45:21.321548+0000","last_clean":"2023-11-27T20:45:21.321548+0000","last_became_active":"2023-11-27T20:45:05.635217+0000","last_became_peered":"2023-11-27T20:45:05.635217+0000","last_unstale":"2023-11-27T20:45:21.321548+0000","last_undegraded":"2023-11-27T20:45:21.321548+0000","last_fullsized":"2023-11-27T20:45:21.321548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:25.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353717+0000","last_change":"2023-11-27T20:45:22.359242+0000","last_active":"2023-11-27T20:45:23.353717+0000","last_peered":"2023-11-27T20:45:23.353717+0000","last_clean":"2023-11-27T20:45:23.353717+0000","last_became_active":"2023-11-27T20:45:22.358803+0000","last_became_peered":"2023-11-27T20:45:22.358803+0000","last_unstale":"2023-11-27T20:45:23.353717+0000","last_undegraded":"2023-11-27T20:45:23.353717+0000","last_fullsized":"2023-11-27T20:45:23.353717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:16.539429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357485+0000","last_change":"2023-11-27T20:45:21.340458+0000","last_active":"2023-11-27T20:45:23.357485+0000","last_peered":"2023-11-27T20:45:23.357485+0000","last_clean":"2023-11-27T20:45:23.357485+0000","last_became_active":"2023-11-27T20:45:21.340182+0000","last_became_peered":"2023-11-27T20:45:21.340182+0000","last_unstale":"2023-11-27T20:45:23.357485+0000","last_undegraded":"2023-11-27T20:45:23.357485+0000","last_fullsized":"2023-11-27T20:45:23.357485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:38:47.397254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.326302+0000","last_change":"2023-11-27T20:45:06.263237+0000","last_active":"2023-11-27T20:45:22.326302+0000","last_peered":"2023-11-27T20:45:22.326302+0000","last_clean":"2023-11-27T20:45:22.326302+0000","last_became_active":"2023-11-27T20:45:06.262918+0000","last_became_peered":"2023-11-27T20:45:06.262918+0000","last_unstale":"2023-11-27T20:45:22.326302+0000","last_undegraded":"2023-11-27T20:45:22.326302+0000","last_fullsized":"2023-11-27T20:45:22.326302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:14.466572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"74'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.321355+0000","last_change":"2023-11-27T20:45:05.631892+0000","last_active":"2023-11-27T20:45:22.321355+0000","last_peered":"2023-11-27T20:45:22.321355+0000","last_clean":"2023-11-27T20:45:22.321355+0000","last_became_active":"2023-11-27T20:45:05.631305+0000","last_became_peered":"2023-11-27T20:45:05.631305+0000","last_unstale":"2023-11-27T20:45:22.321355+0000","last_undegraded":"2023-11-27T20:45:22.321355+0000","last_fullsized":"2023-11-27T20:45:22.321355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:30:06.654414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.347107+0000","last_change":"2023-11-27T20:45:22.343979+0000","last_active":"2023-11-27T20:45:22.347107+0000","last_peered":"2023-11-27T20:45:22.347107+0000","last_clean":"2023-11-27T20:45:22.347107+0000","last_became_active":"2023-11-27T20:45:22.343651+0000","last_became_peered":"2023-11-27T20:45:22.343651+0000","last_unstale":"2023-11-27T20:45:22.347107+0000","last_undegraded":"2023-11-27T20:45:22.347107+0000","last_fullsized":"2023-11-27T20:45:22.347107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:50.234056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.332794+0000","last_change":"2023-11-27T20:45:21.340280+0000","last_active":"2023-11-27T20:45:22.332794+0000","last_peered":"2023-11-27T20:45:22.332794+0000","last_clean":"2023-11-27T20:45:22.332794+0000","last_became_active":"2023-11-27T20:45:21.339948+0000","last_became_peered":"2023-11-27T20:45:21.339948+0000","last_unstale":"2023-11-27T20:45:22.332794+0000","last_undegraded":"2023-11-27T20:45:22.332794+0000","last_fullsized":"2023-11-27T20:45:22.332794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:39:55.272595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.341814+0000","last_change":"2023-11-27T20:45:06.282615+0000","last_active":"2023-11-27T20:45:21.341814+0000","last_peered":"2023-11-27T20:45:21.341814+0000","last_clean":"2023-11-27T20:45:21.341814+0000","last_became_active":"2023-11-27T20:45:06.282331+0000","last_became_peered":"2023-11-27T20:45:06.282331+0000","last_unstale":"2023-11-27T20:45:21.341814+0000","last_undegraded":"2023-11-27T20:45:21.341814+0000","last_fullsized":"2023-11-27T20:45:21.341814+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:00:14.175844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"75'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.320899+0000","last_change":"2023-11-27T20:45:05.631778+0000","last_active":"2023-11-27T20:45:22.320899+0000","last_peered":"2023-11-27T20:45:22.320899+0000","last_clean":"2023-11-27T20:45:22.320899+0000","last_became_active":"2023-11-27T20:45:05.631172+0000","last_became_peered":"2023-11-27T20:45:05.631172+0000","last_unstale":"2023-11-27T20:45:22.320899+0000","last_undegraded":"2023-11-27T20:45:22.320899+0000","last_fullsized":"2023-11-27T20:45:22.320899+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:18.830687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357719+0000","last_change":"2023-11-27T20:45:22.350700+0000","last_active":"2023-11-27T20:45:23.357719+0000","last_peered":"2023-11-27T20:45:23.357719+0000","last_clean":"2023-11-27T20:45:23.357719+0000","last_became_active":"2023-11-27T20:45:22.350423+0000","last_became_peered":"2023-11-27T20:45:22.350423+0000","last_unstale":"2023-11-27T20:45:23.357719+0000","last_undegraded":"2023-11-27T20:45:23.357719+0000","last_fullsized":"2023-11-27T20:45:23.357719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:21.666307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.370763+0000","last_change":"2023-11-27T20:45:21.340876+0000","last_active":"2023-11-27T20:45:22.370763+0000","last_peered":"2023-11-27T20:45:22.370763+0000","last_clean":"2023-11-27T20:45:22.370763+0000","last_became_active":"2023-11-27T20:45:21.340532+0000","last_became_peered":"2023-11-27T20:45:21.340532+0000","last_unstale":"2023-11-27T20:45:22.370763+0000","last_undegraded":"2023-11-27T20:45:22.370763+0000","last_fullsized":"2023-11-27T20:45:22.370763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:16.953618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331628+0000","last_change":"2023-11-27T20:45:06.274427+0000","last_active":"2023-11-27T20:45:21.331628+0000","last_peered":"2023-11-27T20:45:21.331628+0000","last_clean":"2023-11-27T20:45:21.331628+0000","last_became_active":"2023-11-27T20:45:06.274140+0000","last_became_peered":"2023-11-27T20:45:06.274140+0000","last_unstale":"2023-11-27T20:45:21.331628+0000","last_undegraded":"2023-11-27T20:45:21.331628+0000","last_fullsized":"2023-11-27T20:45:21.331628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:07.361631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332150+0000","last_change":"2023-11-27T20:45:05.637612+0000","last_active":"2023-11-27T20:45:21.332150+0000","last_peered":"2023-11-27T20:45:21.332150+0000","last_clean":"2023-11-27T20:45:21.332150+0000","last_became_active":"2023-11-27T20:45:05.637230+0000","last_became_peered":"2023-11-27T20:45:05.637230+0000","last_unstale":"2023-11-27T20:45:21.332150+0000","last_undegraded":"2023-11-27T20:45:21.332150+0000","last_fullsized":"2023-11-27T20:45:21.332150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:59.384018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.354646+0000","last_change":"2023-11-27T20:45:22.358818+0000","last_active":"2023-11-27T20:45:23.354646+0000","last_peered":"2023-11-27T20:45:23.354646+0000","last_clean":"2023-11-27T20:45:23.354646+0000","last_became_active":"2023-11-27T20:45:22.358533+0000","last_became_peered":"2023-11-27T20:45:22.358533+0000","last_unstale":"2023-11-27T20:45:23.354646+0000","last_undegraded":"2023-11-27T20:45:23.354646+0000","last_fullsized":"2023-11-27T20:45:23.354646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:29:10.944501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357798+0000","last_change":"2023-11-27T20:45:21.346215+0000","last_active":"2023-11-27T20:45:23.357798+0000","last_peered":"2023-11-27T20:45:23.357798+0000","last_clean":"2023-11-27T20:45:23.357798+0000","last_became_active":"2023-11-27T20:45:21.345835+0000","last_became_peered":"2023-11-27T20:45:21.345835+0000","last_unstale":"2023-11-27T20:45:23.357798+0000","last_undegraded":"2023-11-27T20:45:23.357798+0000","last_fullsized":"2023-11-27T20:45:23.357798+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:41.038318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.331920+0000","last_change":"2023-11-27T20:45:06.279317+0000","last_active":"2023-11-27T20:45:22.331920+0000","last_peered":"2023-11-27T20:45:22.331920+0000","last_clean":"2023-11-27T20:45:22.331920+0000","last_became_active":"2023-11-27T20:45:06.279052+0000","last_became_peered":"2023-11-27T20:45:06.279052+0000","last_unstale":"2023-11-27T20:45:22.331920+0000","last_undegraded":"2023-11-27T20:45:22.331920+0000","last_fullsized":"2023-11-27T20:45:22.331920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:01.046541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331726+0000","last_change":"2023-11-27T20:45:05.634977+0000","last_active":"2023-11-27T20:45:21.331726+0000","last_peered":"2023-11-27T20:45:21.331726+0000","last_clean":"2023-11-27T20:45:21.331726+0000","last_became_active":"2023-11-27T20:45:05.631916+0000","last_became_peered":"2023-11-27T20:45:05.631916+0000","last_unstale":"2023-11-27T20:45:21.331726+0000","last_undegraded":"2023-11-27T20:45:21.331726+0000","last_fullsized":"2023-11-27T20:45:21.331726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:27.977492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.450781+0000","last_change":"2023-11-27T20:45:22.358303+0000","last_active":"2023-11-27T20:45:23.450781+0000","last_peered":"2023-11-27T20:45:23.450781+0000","last_clean":"2023-11-27T20:45:23.450781+0000","last_became_active":"2023-11-27T20:45:22.355270+0000","last_became_peered":"2023-11-27T20:45:22.355270+0000","last_unstale":"2023-11-27T20:45:23.450781+0000","last_undegraded":"2023-11-27T20:45:23.450781+0000","last_fullsized":"2023-11-27T20:45:23.450781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:14.122157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.339474+0000","last_change":"2023-11-27T20:45:21.334962+0000","last_active":"2023-11-27T20:45:22.339474+0000","last_peered":"2023-11-27T20:45:22.339474+0000","last_clean":"2023-11-27T20:45:22.339474+0000","last_became_active":"2023-11-27T20:45:21.334626+0000","last_became_peered":"2023-11-27T20:45:21.334626+0000","last_unstale":"2023-11-27T20:45:22.339474+0000","last_undegraded":"2023-11-27T20:45:22.339474+0000","last_fullsized":"2023-11-27T20:45:22.339474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:30:11.601054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332232+0000","last_change":"2023-11-27T20:45:06.266010+0000","last_active":"2023-11-27T20:45:21.332232+0000","last_peered":"2023-11-27T20:45:21.332232+0000","last_clean":"2023-11-27T20:45:21.332232+0000","last_became_active":"2023-11-27T20:45:06.265669+0000","last_became_peered":"2023-11-27T20:45:06.265669+0000","last_unstale":"2023-11-27T20:45:21.332232+0000","last_undegraded":"2023-11-27T20:45:21.332232+0000","last_fullsized":"2023-11-27T20:45:21.332232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:11.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337255+0000","last_change":"2023-11-27T20:45:05.637071+0000","last_active":"2023-11-27T20:45:22.337255+0000","last_peered":"2023-11-27T20:45:22.337255+0000","last_clean":"2023-11-27T20:45:22.337255+0000","last_became_active":"2023-11-27T20:45:05.636864+0000","last_became_peered":"2023-11-27T20:45:05.636864+0000","last_unstale":"2023-11-27T20:45:22.337255+0000","last_undegraded":"2023-11-27T20:45:22.337255+0000","last_fullsized":"2023-11-27T20:45:22.337255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:59:56.168871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.349075+0000","last_change":"2023-11-27T20:45:22.345388+0000","last_active":"2023-11-27T20:45:22.349075+0000","last_peered":"2023-11-27T20:45:22.349075+0000","last_clean":"2023-11-27T20:45:22.349075+0000","last_became_active":"2023-11-27T20:45:22.345120+0000","last_became_peered":"2023-11-27T20:45:22.345120+0000","last_unstale":"2023-11-27T20:45:22.349075+0000","last_undegraded":"2023-11-27T20:45:22.349075+0000","last_fullsized":"2023-11-27T20:45:22.349075+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:26.967971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.450745+0000","last_change":"2023-11-27T20:45:21.340498+0000","last_active":"2023-11-27T20:45:23.450745+0000","last_peered":"2023-11-27T20:45:23.450745+0000","last_clean":"2023-11-27T20:45:23.450745+0000","last_became_active":"2023-11-27T20:45:21.340170+0000","last_became_peered":"2023-11-27T20:45:21.340170+0000","last_unstale":"2023-11-27T20:45:23.450745+0000","last_undegraded":"2023-11-27T20:45:23.450745+0000","last_fullsized":"2023-11-27T20:45:23.450745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:15.067264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338128+0000","last_change":"2023-11-27T20:45:06.270493+0000","last_active":"2023-11-27T20:45:22.338128+0000","last_peered":"2023-11-27T20:45:22.338128+0000","last_clean":"2023-11-27T20:45:22.338128+0000","last_became_active":"2023-11-27T20:45:06.270214+0000","last_became_peered":"2023-11-27T20:45:06.270214+0000","last_unstale":"2023-11-27T20:45:22.338128+0000","last_undegraded":"2023-11-27T20:45:22.338128+0000","last_fullsized":"2023-11-27T20:45:22.338128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:02.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.327108+0000","last_change":"2023-11-27T20:45:05.642971+0000","last_active":"2023-11-27T20:45:22.327108+0000","last_peered":"2023-11-27T20:45:22.327108+0000","last_clean":"2023-11-27T20:45:22.327108+0000","last_became_active":"2023-11-27T20:45:05.642000+0000","last_became_peered":"2023-11-27T20:45:05.642000+0000","last_unstale":"2023-11-27T20:45:22.327108+0000","last_undegraded":"2023-11-27T20:45:22.327108+0000","last_fullsized":"2023-11-27T20:45:22.327108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:35:57.425975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451051+0000","last_change":"2023-11-27T20:45:22.353398+0000","last_active":"2023-11-27T20:45:23.451051+0000","last_peered":"2023-11-27T20:45:23.451051+0000","last_clean":"2023-11-27T20:45:23.451051+0000","last_became_active":"2023-11-27T20:45:22.353142+0000","last_became_peered":"2023-11-27T20:45:22.353142+0000","last_unstale":"2023-11-27T20:45:23.451051+0000","last_undegraded":"2023-11-27T20:45:23.451051+0000","last_fullsized":"2023-11-27T20:45:23.451051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:21:14.840765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356900+0000","last_change":"2023-11-27T20:45:21.338091+0000","last_active":"2023-11-27T20:45:23.356900+0000","last_peered":"2023-11-27T20:45:23.356900+0000","last_clean":"2023-11-27T20:45:23.356900+0000","last_became_active":"2023-11-27T20:45:21.337820+0000","last_became_peered":"2023-11-27T20:45:21.337820+0000","last_unstale":"2023-11-27T20:45:23.356900+0000","last_undegraded":"2023-11-27T20:45:23.356900+0000","last_fullsized":"2023-11-27T20:45:23.356900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:01:29.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.336520+0000","last_change":"2023-11-27T20:45:06.274514+0000","last_active":"2023-11-27T20:45:21.336520+0000","last_peered":"2023-11-27T20:45:21.336520+0000","last_clean":"2023-11-27T20:45:21.336520+0000","last_became_active":"2023-11-27T20:45:06.273513+0000","last_became_peered":"2023-11-27T20:45:06.273513+0000","last_unstale":"2023-11-27T20:45:21.336520+0000","last_undegraded":"2023-11-27T20:45:21.336520+0000","last_fullsized":"2023-11-27T20:45:21.336520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:13.008822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330377+0000","last_change":"2023-11-27T20:45:05.630546+0000","last_active":"2023-11-27T20:45:21.330377+0000","last_peered":"2023-11-27T20:45:21.330377+0000","last_clean":"2023-11-27T20:45:21.330377+0000","last_became_active":"2023-11-27T20:45:05.629859+0000","last_became_peered":"2023-11-27T20:45:05.629859+0000","last_unstale":"2023-11-27T20:45:21.330377+0000","last_undegraded":"2023-11-27T20:45:21.330377+0000","last_fullsized":"2023-11-27T20:45:21.330377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:34.967969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357389+0000","last_change":"2023-11-27T20:45:22.350853+0000","last_active":"2023-11-27T20:45:23.357389+0000","last_peered":"2023-11-27T20:45:23.357389+0000","last_clean":"2023-11-27T20:45:23.357389+0000","last_became_active":"2023-11-27T20:45:22.348848+0000","last_became_peered":"2023-11-27T20:45:22.348848+0000","last_unstale":"2023-11-27T20:45:23.357389+0000","last_undegraded":"2023-11-27T20:45:23.357389+0000","last_fullsized":"2023-11-27T20:45:23.357389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:39:56.285530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.330883+0000","last_change":"2023-11-27T20:45:21.341408+0000","last_active":"2023-11-27T20:45:22.330883+0000","last_peered":"2023-11-27T20:45:22.330883+0000","last_clean":"2023-11-27T20:45:22.330883+0000","last_became_active":"2023-11-27T20:45:21.340941+0000","last_became_peered":"2023-11-27T20:45:21.340941+0000","last_unstale":"2023-11-27T20:45:22.330883+0000","last_undegraded":"2023-11-27T20:45:22.330883+0000","last_fullsized":"2023-11-27T20:45:22.330883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:46.781152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330271+0000","last_change":"2023-11-27T20:45:06.277953+0000","last_active":"2023-11-27T20:45:21.330271+0000","last_peered":"2023-11-27T20:45:21.330271+0000","last_clean":"2023-11-27T20:45:21.330271+0000","last_became_active":"2023-11-27T20:45:06.275250+0000","last_became_peered":"2023-11-27T20:45:06.275250+0000","last_unstale":"2023-11-27T20:45:21.330271+0000","last_undegraded":"2023-11-27T20:45:21.330271+0000","last_fullsized":"2023-11-27T20:45:21.330271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.325697+0000","last_change":"2023-11-27T20:45:05.640372+0000","last_active":"2023-11-27T20:45:22.325697+0000","last_peered":"2023-11-27T20:45:22.325697+0000","last_clean":"2023-11-27T20:45:22.325697+0000","last_became_active":"2023-11-27T20:45:05.640048+0000","last_became_peered":"2023-11-27T20:45:05.640048+0000","last_unstale":"2023-11-27T20:45:22.325697+0000","last_undegraded":"2023-11-27T20:45:22.325697+0000","last_fullsized":"2023-11-27T20:45:22.325697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:34.967969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.452961+0000","last_change":"2023-11-27T20:45:22.356960+0000","last_active":"2023-11-27T20:45:23.452961+0000","last_peered":"2023-11-27T20:45:23.452961+0000","last_clean":"2023-11-27T20:45:23.452961+0000","last_became_active":"2023-11-27T20:45:22.356702+0000","last_became_peered":"2023-11-27T20:45:22.356702+0000","last_unstale":"2023-11-27T20:45:23.452961+0000","last_undegraded":"2023-11-27T20:45:23.452961+0000","last_fullsized":"2023-11-27T20:45:23.452961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:42.037274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.370425+0000","last_change":"2023-11-27T20:45:21.345073+0000","last_active":"2023-11-27T20:45:22.370425+0000","last_peered":"2023-11-27T20:45:22.370425+0000","last_clean":"2023-11-27T20:45:22.370425+0000","last_became_active":"2023-11-27T20:45:21.344674+0000","last_became_peered":"2023-11-27T20:45:21.344674+0000","last_unstale":"2023-11-27T20:45:22.370425+0000","last_undegraded":"2023-11-27T20:45:22.370425+0000","last_fullsized":"2023-11-27T20:45:22.370425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:01:29.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.320074+0000","last_change":"2023-11-27T20:45:06.266017+0000","last_active":"2023-11-27T20:45:22.320074+0000","last_peered":"2023-11-27T20:45:22.320074+0000","last_clean":"2023-11-27T20:45:22.320074+0000","last_became_active":"2023-11-27T20:45:06.265439+0000","last_became_peered":"2023-11-27T20:45:06.265439+0000","last_unstale":"2023-11-27T20:45:22.320074+0000","last_undegraded":"2023-11-27T20:45:22.320074+0000","last_fullsized":"2023-11-27T20:45:22.320074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:05.796906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"74'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.339977+0000","last_change":"2023-11-27T20:45:05.643524+0000","last_active":"2023-11-27T20:45:21.339977+0000","last_peered":"2023-11-27T20:45:21.339977+0000","last_clean":"2023-11-27T20:45:21.339977+0000","last_became_active":"2023-11-27T20:45:05.642570+0000","last_became_peered":"2023-11-27T20:45:05.642570+0000","last_unstale":"2023-11-27T20:45:21.339977+0000","last_undegraded":"2023-11-27T20:45:21.339977+0000","last_fullsized":"2023-11-27T20:45:21.339977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:00.040780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.336736+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:45:21.336736+0000","last_peered":"2023-11-27T20:45:21.336736+0000","last_clean":"2023-11-27T20:45:21.336736+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:45:21.336736+0000","last_undegraded":"2023-11-27T20:45:21.336736+0000","last_fullsized":"2023-11-27T20:45:21.336736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1589248,"data_stored":1034614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.127,"15min":1.153},"min":{"1min":0.63800000000000001,"5min":0.627,"15min":0.627},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.206,"15min":1.2290000000000001},"min":{"1min":0.74199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6950000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.268}]},{"osd":1,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1890000000000001,"15min":1.224},"min":{"1min":0.71299999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.391,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.099,"5min":1.1859999999999999,"15min":1.216},"min":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.585,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.0069999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.2330000000000001,"15min":1.2909999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4970000000000001,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2390000000000001,"15min":1.256},"min":{"1min":0.78300000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.722,"5min":1.909,"15min":1.909},"last":0.68500000000000005}]},{"osd":3,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3340000000000001,"15min":1.3879999999999999},"min":{"1min":0.83199999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6000000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.296},{"interface":"front","average":{"1min":1.375,"5min":1.4430000000000001,"15min":1.4870000000000001},"min":{"1min":0.89800000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.95,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.94799999999999995}]},{"osd":4,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.371,"15min":1.4099999999999999},"min":{"1min":1.0720000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.871,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.4910000000000001,"15min":1.587},"min":{"1min":0.76500000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.897,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.464}]},{"osd":5,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.466,"15min":1.502},"min":{"1min":0.91000000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.5329999999999999,"15min":1.583},"min":{"1min":1.0449999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7549999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.177}]},{"osd":6,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.627,"15min":1.667},"min":{"1min":1.208,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.849,"5min":2.508,"15min":2.508},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.6120000000000001,"15min":1.6799999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.849,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.4079999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":445410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2250000000000001,"15min":1.2709999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.6799999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.145,"5min":1.266,"15min":1.3180000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.7430000000000001,"5min":2.581,"15min":2.581},"last":1.2709999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.2110000000000001,"15min":1.2629999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5309999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.129,"15min":1.159},"min":{"1min":0.66100000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.484,"5min":2.823,"15min":2.823},"last":1.373}]},{"osd":2,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.0549999999999999,"15min":1.0740000000000001},"min":{"1min":0.69199999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4570000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3280000000000001,"15min":1.3899999999999999},"min":{"1min":0.753,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.651,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.69499999999999995}]},{"osd":3,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.304,"15min":1.3720000000000001},"min":{"1min":0.879,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.649,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.306,"15min":1.3440000000000001},"min":{"1min":0.83499999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.526,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.018}]},{"osd":4,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.532,"15min":1.607},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0019999999999998,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.079},{"interface":"front","average":{"1min":1.375,"5min":1.5609999999999999,"15min":1.6419999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.9450000000000001,"5min":3.536,"15min":3.536},"last":1.4359999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.3620000000000001,"15min":1.3979999999999999},"min":{"1min":0.74399999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7210000000000001,"5min":2.355,"15min":2.355},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.589,"15min":1.6599999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.097,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.1719999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.581,"15min":1.669},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0230000000000001,"5min":3.645,"15min":3.645},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.534,"15min":1.577},"min":{"1min":0.93000000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.0590000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.605}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":447263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.103,"15min":1.151},"min":{"1min":0.71899999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.456,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1379999999999999,"15min":1.1779999999999999},"min":{"1min":0.73999999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.486,"5min":2.04,"15min":2.04},"last":1.083}]},{"osd":1,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1479999999999999,"15min":1.194},"min":{"1min":0.68500000000000005,"5min":0.379,"15min":0.379},"max":{"1min":1.4730000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.153,"15min":1.165},"min":{"1min":0.68600000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3340000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.2370000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.246,"15min":1.286},"min":{"1min":0.58999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.554,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.204},{"interface":"front","average":{"1min":1.149,"5min":1.1799999999999999,"15min":1.2090000000000001},"min":{"1min":0.75700000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.556,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.538}]},{"osd":3,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.341,"15min":1.391},"min":{"1min":0.70999999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6839999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.484},{"interface":"front","average":{"1min":1.119,"5min":1.361,"15min":1.4470000000000001},"min":{"1min":0.70799999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4179999999999999,"5min":4.016,"15min":4.016},"last":1.377}]},{"osd":4,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.3029999999999999,"15min":1.3740000000000001},"min":{"1min":0.63200000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5149999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5329999999999999,"15min":1.617},"min":{"1min":0.80500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0289999999999999,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.3009999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.534,"15min":1.643},"min":{"1min":0.628,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.615,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.5229999999999999,"15min":1.595},"min":{"1min":0.79000000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.637,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.0149999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.581,"15min":1.663},"min":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8520000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.429},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.6220000000000001,"15min":1.7310000000000001},"min":{"1min":0.81100000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.8200000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.8640000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":445800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0109999999999999,"15min":1.006},"min":{"1min":0.63200000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4870000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.1080000000000001,"15min":1.0900000000000001},"min":{"1min":0.79900000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6180000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.0980000000000001,"15min":1.0289999999999999},"min":{"1min":0.85099999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.369},{"interface":"front","average":{"1min":1.361,"5min":1.25,"15min":1.2290000000000001},"min":{"1min":0.79900000000000004,"5min":0.628,"15min":0.628},"max":{"1min":3.9430000000000001,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.0169999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2210000000000001,"15min":1.2130000000000001},"min":{"1min":0.73199999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.486},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.296,"15min":1.296},"min":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.117}]},{"osd":3,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1459999999999999,"15min":1.1679999999999999},"min":{"1min":0.75900000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.321,"5min":1.778,"15min":1.778},"last":1.081},{"interface":"front","average":{"1min":1.304,"5min":1.3540000000000001,"15min":1.341},"min":{"1min":0.88600000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.623,"5min":2.097,"15min":2.097},"last":1.3220000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.222,"15min":1.2689999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7270000000000001,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.3899999999999999,"15min":1.419},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.601,"5min":1.992,"15min":1.992},"last":1.2210000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.351,"15min":1.367},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.841,"5min":2.157,"15min":2.157},"last":1.276},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5609999999999999,"15min":1.5940000000000001},"min":{"1min":0.73399999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.837,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.4099999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.492,"15min":1.4950000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.921,"5min":2.202,"15min":2.202},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.647,"15min":1.657},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.9350000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.5069999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":448805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.93400000000000005,"15min":1.016},"min":{"1min":0.49199999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92700000000000005,"5min":3.641,"15min":3.641},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94599999999999995,"15min":1.0049999999999999},"min":{"1min":0.45800000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.5389999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.70999999999999996}]},{"osd":1,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.91400000000000003,"15min":0.93999999999999995},"min":{"1min":0.46899999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.296,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0640000000000001,"15min":1.1100000000000001},"min":{"1min":0.61699999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.464,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.65900000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.075,"15min":1.1100000000000001},"min":{"1min":0.52300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6020000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.012},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.087,"15min":1.125},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3939999999999999,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.075}]},{"osd":4,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3009999999999999,"15min":1.337},"min":{"1min":0.89700000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8939999999999999,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.327,"15min":1.389},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6679999999999999,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.546}]},{"osd":5,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.371,"15min":1.4219999999999999},"min":{"1min":0.86299999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.5840000000000001,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.419,"15min":1.4710000000000001},"min":{"1min":0.90700000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.954,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.93600000000000005}]},{"osd":6,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.478,"15min":1.53},"min":{"1min":0.96299999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.9830000000000001,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4590000000000001,"15min":1.5109999999999999},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.9039999999999999,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.5009999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.496,"15min":1.55},"min":{"1min":0.93700000000000006,"5min":0.871,"15min":0.871},"max":{"1min":2.0310000000000001,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4490000000000001,"15min":1.488},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6919999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.6539999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":444680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.80600000000000005},"min":{"1min":0.56399999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89000000000000001,"15min":0.92600000000000005},"min":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4750000000000001,"5min":1.972,"15min":1.972},"last":1.585}]},{"osd":1,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94999999999999996,"15min":1.004},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.252,"5min":1.522,"15min":1.522},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.98699999999999999},"min":{"1min":0.54100000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.3580000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4650000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.49399999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.111,"5min":1.073,"15min":1.101},"min":{"1min":0.59099999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.143}]},{"osd":4,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.175,"15min":1.2070000000000001},"min":{"1min":0.77500000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.522,"5min":1.669,"15min":1.669},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.349,"15min":1.383},"min":{"1min":0.97299999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8160000000000001,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.206}]},{"osd":5,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.284,"15min":1.3200000000000001},"min":{"1min":0.92800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6160000000000001,"5min":2.48,"15min":2.48},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.381,"5min":1.4239999999999999,"15min":1.484},"min":{"1min":1.093,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.869,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.2609999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3560000000000001,"15min":1.3779999999999999},"min":{"1min":0.89800000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7649999999999999,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4650000000000001,"15min":1.5289999999999999},"min":{"1min":1.111,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.752,"5min":3.302,"15min":3.302},"last":1.3169999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.431,"15min":1.486},"min":{"1min":0.84599999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.893,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.403,"15min":1.4710000000000001},"min":{"1min":1.0289999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7649999999999999,"5min":2.73,"15min":2.73},"last":1.345}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":995328,"data_stored":444258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.308,"15min":0.308},"max":{"1min":1.048,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88,"15min":0.876},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3320000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.53200000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.55700000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4590000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.497},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.036,"15min":1.0449999999999999},"min":{"1min":0.51600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.444,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.748}]},{"osd":3,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.044,"15min":1.032},"min":{"1min":0.57899999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5469999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.079,"15min":1.085},"min":{"1min":0.66800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8500000000000001,"5min":2.044,"15min":2.044},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2,"15min":1.196},"min":{"1min":0.81299999999999994,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.365,"5min":1.367,"15min":1.355},"min":{"1min":0.79400000000000004,"5min":0.752,"15min":0.752},"max":{"1min":2.1589999999999998,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.1830000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.276,"15min":1.242},"min":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.004,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.2749999999999999,"15min":1.2410000000000001},"min":{"1min":0.85599999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1989999999999998,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.83999999999999997}]},{"osd":6,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.359,"15min":1.325},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.1070000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.377,"5min":1.347,"15min":1.3580000000000001},"min":{"1min":0.83399999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.0699999999999998,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.45,"15min":1.47},"min":{"1min":1.042,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.9019999999999999,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.127},{"interface":"front","average":{"1min":1.47,"5min":1.573,"15min":1.5800000000000001},"min":{"1min":1.0169999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.1789999999999998,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.79900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1585152,"data_stored":1035048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.405,"5min":1.901,"15min":1.901},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.877,"15min":0.84999999999999998},"min":{"1min":0.52300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.004}]},{"osd":2,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.87,"15min":0.84099999999999997},"min":{"1min":0.54500000000000004,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3129999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.752},{"interface":"front","average":{"1min":1.0660000000000001,"5min":0.96199999999999997,"15min":0.95599999999999996},"min":{"1min":0.55500000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.2410000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.91700000000000004,"15min":0.89800000000000002},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.4590000000000001,"5min":1.875,"15min":1.875},"last":1.077},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.073,"15min":1.0569999999999999},"min":{"1min":0.52000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.847,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.59699999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2549999999999999,"15min":1.2490000000000001},"min":{"1min":0.75900000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.958,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.2090000000000001,"15min":1.196},"min":{"1min":0.82899999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.056,"5min":2.391,"15min":2.391},"last":1.323}]},{"osd":5,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3480000000000001,"15min":1.3540000000000001},"min":{"1min":0.747,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.992,"5min":3.028,"15min":3.028},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3220000000000001,"15min":1.3129999999999999},"min":{"1min":0.79000000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6970000000000001,"5min":2.718,"15min":2.718},"last":1.3540000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3,"15min":1.3100000000000001},"min":{"1min":0.83499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.633,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4099999999999999,"15min":1.4199999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.284}]},{"osd":7,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.90600000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.708,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.349,"15min":1.357},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.776,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3819999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:45:26.845 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:45:27.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.062+0000 7ff2e0287640 1 Processor -- start 2023-11-27T20:45:27.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.062+0000 7ff2e0287640 1 -- start start 2023-11-27T20:45:27.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.063+0000 7ff2e0287640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2d80c1500 0x7ff2d80c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.063+0000 7ff2e0287640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d80c06c0 con 0x7ff2d8155490 2023-11-27T20:45:27.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.063+0000 7ff2e0287640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d80c1020 con 0x7ff2d80a9b40 2023-11-27T20:45:27.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.063+0000 7ff2e0287640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80a5820 con 0x7ff2d80c1500 2023-11-27T20:45:27.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.064+0000 7ff2de023640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff2d8155490 0x7ff2d80a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53306/0 (socket says 172.21.15.91:53306) 2023-11-27T20:45:27.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.064+0000 7ff2de023640 1 -- 172.21.15.91:0/469326101 learned_addr learned my addr 172.21.15.91:0/469326101 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:27.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.064+0000 7ff2de824640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2d80c1500 0x7ff2d80c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.064+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808717153 0 0) 0x7ff2d80c06c0 con 0x7ff2d8155490 2023-11-27T20:45:27.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.064+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c4003520 con 0x7ff2d8155490 2023-11-27T20:45:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.064+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1997771730 0 0) 0x7ff2c4003520 con 0x7ff2d8155490 2023-11-27T20:45:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.064+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2d80c1500 msgr2=0x7ff2d80c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.064+0000 7ff2dd021640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2d80c1500 0x7ff2d80c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.064+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 >> v1:172.21.15.183:6789/0 conn(0x7ff2d80a9b40 legacy=0x7ff2d80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.064+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80c0910 con 0x7ff2d8155490 2023-11-27T20:45:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7ff2d4001670 con 0x7ff2d8155490 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 >> v1:172.21.15.91:6789/0 conn(0x7ff2d8155490 legacy=0x7ff2d80a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2dd021640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2d80c1500 0x7ff2c40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2dd021640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c4003f20 0x7ff2c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2dd021640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c4004d00 0x7ff2c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c400ba30 con 0x7ff2c4004d00 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c400bba0 con 0x7ff2c4003f20 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c400df70 con 0x7ff2d80c1500 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2de824640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c4004d00 0x7ff2c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2de023640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2d80c1500 0x7ff2c40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2dd822640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c4003f20 0x7ff2c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2de824640 1 -- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2d80c1500 msgr2=0x7ff2c40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:27.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2de824640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2d80c1500 0x7ff2c40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2de824640 1 -- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c4003f20 msgr2=0x7ff2c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2de824640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c4003f20 0x7ff2c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2de824640 1 -- 172.21.15.91:0/469326101 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4003520 con 0x7ff2c4004d00 2023-11-27T20:45:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.065+0000 7ff2dd822640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c4003f20 0x7ff2c40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.066+0000 7ff2de824640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c4004d00 0x7ff2c4005180 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80ab440 tx=0x7ff2c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a2abdb0afa79f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.067+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d002cb90 con 0x7ff2c4004d00 2023-11-27T20:45:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.067+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d000f040 con 0x7ff2c4004d00 2023-11-27T20:45:27.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.067+0000 7ff2dd021640 1 -- 172.21.15.91:0/469326101 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0034440 con 0x7ff2c4004d00 2023-11-27T20:45:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.067+0000 7ff2e0287640 1 -- 172.21.15.91:0/469326101 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c4004d00 msgr2=0x7ff2c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.067+0000 7ff2e0287640 1 --2- 172.21.15.91:0/469326101 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2c4004d00 0x7ff2c4005180 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80ab440 tx=0x7ff2c40057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.067+0000 7ff2de824640 1 -- 172.21.15.91:0/469326101 reap_dead start 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.067+0000 7ff2e0287640 1 -- 172.21.15.91:0/469326101 shutdown_connections 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.067+0000 7ff2e0287640 1 -- 172.21.15.91:0/469326101 >> 172.21.15.91:0/469326101 conn(0x7ff2d806a500 msgr2=0x7ff2d806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.068+0000 7ff2e0287640 1 -- 172.21.15.91:0/469326101 shutdown_connections 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.068+0000 7ff2e0287640 1 -- 172.21.15.91:0/469326101 wait complete. 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.069+0000 7ff2e0287640 1 Processor -- start 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.069+0000 7ff2e0287640 1 -- start start 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.070+0000 7ff2e0287640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2c4004d00 0x7ff2d81edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.070+0000 7ff2e0287640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2d80a5990 0x7ff2d80bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.070+0000 7ff2e0287640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2d8070640 0x7ff2d814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.070+0000 7ff2e0287640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d81ee210 con 0x7ff2d8070640 2023-11-27T20:45:27.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.070+0000 7ff2e0287640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80bfd50 con 0x7ff2d80a5990 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.070+0000 7ff2e0287640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8071e90 con 0x7ff2c4004d00 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2de824640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2d8070640 0x7ff2d814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2de824640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2d8070640 0x7ff2d814cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37072/0 (socket says 172.21.15.91:37072) 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2de824640 1 -- 172.21.15.91:0/916038949 learned_addr learned my addr 172.21.15.91:0/916038949 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2dd822640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2d80a5990 0x7ff2d80bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2de023640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2c4004d00 0x7ff2d81edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2de824640 1 -- 172.21.15.91:0/916038949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2c4004d00 msgr2=0x7ff2d81edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2de824640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2c4004d00 0x7ff2d81edcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2de824640 1 -- 172.21.15.91:0/916038949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2d80a5990 msgr2=0x7ff2d80bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2de824640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2d80a5990 0x7ff2d80bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2de824640 1 -- 172.21.15.91:0/916038949 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80718d0 con 0x7ff2d8070640 2023-11-27T20:45:27.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.071+0000 7ff2de824640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2d8070640 0x7ff2d814cf30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0002230 tx=0x7ff2d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:27.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.072+0000 7ff2ceffd640 1 -- 172.21.15.91:0/916038949 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0034cd0 con 0x7ff2d8070640 2023-11-27T20:45:27.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.072+0000 7ff2ceffd640 1 -- 172.21.15.91:0/916038949 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d0034e30 con 0x7ff2d8070640 2023-11-27T20:45:27.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.072+0000 7ff2ceffd640 1 -- 172.21.15.91:0/916038949 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d003e680 con 0x7ff2d8070640 2023-11-27T20:45:27.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.072+0000 7ff2e0287640 1 -- 172.21.15.91:0/916038949 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d8071bb0 con 0x7ff2d8070640 2023-11-27T20:45:27.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.072+0000 7ff2e0287640 1 -- 172.21.15.91:0/916038949 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d8070120 con 0x7ff2d8070640 2023-11-27T20:45:27.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.073+0000 7ff2e0287640 1 -- 172.21.15.91:0/916038949 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d8154ff0 con 0x7ff2d8070640 2023-11-27T20:45:27.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.074+0000 7ff2ceffd640 1 -- 172.21.15.91:0/916038949 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff2d003e7e0 con 0x7ff2d8070640 2023-11-27T20:45:27.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.075+0000 7ff2ceffd640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff2bc06b1f0 0x7ff2bc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.075+0000 7ff2ceffd640 1 -- 172.21.15.91:0/916038949 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7ff2d00abff0 con 0x7ff2d8070640 2023-11-27T20:45:27.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.075+0000 7ff2de023640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff2bc06b1f0 0x7ff2bc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.076+0000 7ff2de023640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff2bc06b1f0 0x7ff2bc06d6b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4001200 tx=0x7ff2d4001110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:27.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.079+0000 7ff2ceffd640 1 -- 172.21.15.91:0/916038949 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff2d00dee90 con 0x7ff2d8070640 2023-11-27T20:45:27.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.264+0000 7ff2e0287640 1 -- 172.21.15.91:0/916038949 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2d8155870 con 0x7ff2bc06b1f0 2023-11-27T20:45:27.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.279+0000 7ff2ceffd640 1 -- 172.21.15.91:0/916038949 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525441 (secure 0 0 0) 0x7ff2d40015d0 con 0x7ff2bc06b1f0 2023-11-27T20:45:27.289 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:27.293 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:45:27.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.289+0000 7ff2e0287640 1 -- 172.21.15.91:0/916038949 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff2bc06b1f0 msgr2=0x7ff2bc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.289+0000 7ff2e0287640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff2bc06b1f0 0x7ff2bc06d6b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4001200 tx=0x7ff2d4001110 comp rx=0 tx=0).stop 2023-11-27T20:45:27.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.289+0000 7ff2e0287640 1 -- 172.21.15.91:0/916038949 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2d8070640 msgr2=0x7ff2d814cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.289+0000 7ff2e0287640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2d8070640 0x7ff2d814cf30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0002230 tx=0x7ff2d0009750 comp rx=0 tx=0).stop 2023-11-27T20:45:27.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.289+0000 7ff2e0287640 1 -- 172.21.15.91:0/916038949 shutdown_connections 2023-11-27T20:45:27.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.289+0000 7ff2e0287640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2d8070640 0x7ff2d814cf30 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.289+0000 7ff2e0287640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff2bc06b1f0 0x7ff2bc06d6b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.289+0000 7ff2e0287640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2d80a5990 0x7ff2d80bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.289+0000 7ff2e0287640 1 --2- 172.21.15.91:0/916038949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2c4004d00 0x7ff2d81edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.289+0000 7ff2e0287640 1 -- 172.21.15.91:0/916038949 >> 172.21.15.91:0/916038949 conn(0x7ff2d806a500 msgr2=0x7ff2d81524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:27.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.290+0000 7ff2e0287640 1 -- 172.21.15.91:0/916038949 shutdown_connections 2023-11-27T20:45:27.296 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.290+0000 7ff2e0287640 1 -- 172.21.15.91:0/916038949 wait complete. 2023-11-27T20:45:27.311 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2023-11-27T20:45:25.451513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":273,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254280,"kb_used_data":8968,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720440,"statfs":{"total":773094113280,"available":772833730560,"internally_reserved":0,"allocated":9183232,"data_stored":4745878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.161463"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.354157+0000","last_change":"2023-11-27T20:45:22.346374+0000","last_active":"2023-11-27T20:45:23.354157+0000","last_peered":"2023-11-27T20:45:23.354157+0000","last_clean":"2023-11-27T20:45:23.354157+0000","last_became_active":"2023-11-27T20:45:22.344818+0000","last_became_peered":"2023-11-27T20:45:22.344818+0000","last_unstale":"2023-11-27T20:45:23.354157+0000","last_undegraded":"2023-11-27T20:45:23.354157+0000","last_fullsized":"2023-11-27T20:45:23.354157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:16.736962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332820+0000","last_change":"2023-11-27T20:45:06.275855+0000","last_active":"2023-11-27T20:45:21.332820+0000","last_peered":"2023-11-27T20:45:21.332820+0000","last_clean":"2023-11-27T20:45:21.332820+0000","last_became_active":"2023-11-27T20:45:06.272756+0000","last_became_peered":"2023-11-27T20:45:06.272756+0000","last_unstale":"2023-11-27T20:45:21.332820+0000","last_undegraded":"2023-11-27T20:45:21.332820+0000","last_fullsized":"2023-11-27T20:45:21.332820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:14.466572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.355264+0000","last_change":"2023-11-27T20:45:22.349068+0000","last_active":"2023-11-27T20:45:22.355264+0000","last_peered":"2023-11-27T20:45:22.355264+0000","last_clean":"2023-11-27T20:45:22.355264+0000","last_became_active":"2023-11-27T20:45:22.348795+0000","last_became_peered":"2023-11-27T20:45:22.348795+0000","last_unstale":"2023-11-27T20:45:22.355264+0000","last_undegraded":"2023-11-27T20:45:22.355264+0000","last_fullsized":"2023-11-27T20:45:22.355264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:18:21.773413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332115+0000","last_change":"2023-11-27T20:45:19.289901+0000","last_active":"2023-11-27T20:45:21.332115+0000","last_peered":"2023-11-27T20:45:21.332115+0000","last_clean":"2023-11-27T20:45:21.332115+0000","last_became_active":"2023-11-27T20:45:19.289361+0000","last_became_peered":"2023-11-27T20:45:19.289361+0000","last_unstale":"2023-11-27T20:45:21.332115+0000","last_undegraded":"2023-11-27T20:45:21.332115+0000","last_fullsized":"2023-11-27T20:45:21.332115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:11.277550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.354622+0000","last_change":"2023-11-27T20:45:22.347805+0000","last_active":"2023-11-27T20:45:23.354622+0000","last_peered":"2023-11-27T20:45:23.354622+0000","last_clean":"2023-11-27T20:45:23.354622+0000","last_became_active":"2023-11-27T20:45:22.347483+0000","last_became_peered":"2023-11-27T20:45:22.347483+0000","last_unstale":"2023-11-27T20:45:23.354622+0000","last_undegraded":"2023-11-27T20:45:23.354622+0000","last_fullsized":"2023-11-27T20:45:23.354622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:00:12.865053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.339182+0000","last_change":"2023-11-27T20:45:06.283797+0000","last_active":"2023-11-27T20:45:21.339182+0000","last_peered":"2023-11-27T20:45:21.339182+0000","last_clean":"2023-11-27T20:45:21.339182+0000","last_became_active":"2023-11-27T20:45:06.281615+0000","last_became_peered":"2023-11-27T20:45:06.281615+0000","last_unstale":"2023-11-27T20:45:21.339182+0000","last_undegraded":"2023-11-27T20:45:21.339182+0000","last_fullsized":"2023-11-27T20:45:21.339182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:26.013200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357905+0000","last_change":"2023-11-27T20:45:22.353252+0000","last_active":"2023-11-27T20:45:23.357905+0000","last_peered":"2023-11-27T20:45:23.357905+0000","last_clean":"2023-11-27T20:45:23.357905+0000","last_became_active":"2023-11-27T20:45:22.350165+0000","last_became_peered":"2023-11-27T20:45:22.350165+0000","last_unstale":"2023-11-27T20:45:23.357905+0000","last_undegraded":"2023-11-27T20:45:23.357905+0000","last_fullsized":"2023-11-27T20:45:23.357905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:49:11.378122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.334155+0000","last_change":"2023-11-27T20:45:06.274435+0000","last_active":"2023-11-27T20:45:22.334155+0000","last_peered":"2023-11-27T20:45:22.334155+0000","last_clean":"2023-11-27T20:45:22.334155+0000","last_became_active":"2023-11-27T20:45:06.274050+0000","last_became_peered":"2023-11-27T20:45:06.274050+0000","last_unstale":"2023-11-27T20:45:22.334155+0000","last_undegraded":"2023-11-27T20:45:22.334155+0000","last_fullsized":"2023-11-27T20:45:22.334155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:10:35.432301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.356575+0000","last_change":"2023-11-27T20:45:22.352883+0000","last_active":"2023-11-27T20:45:22.356575+0000","last_peered":"2023-11-27T20:45:22.356575+0000","last_clean":"2023-11-27T20:45:22.356575+0000","last_became_active":"2023-11-27T20:45:22.352106+0000","last_became_peered":"2023-11-27T20:45:22.352106+0000","last_unstale":"2023-11-27T20:45:22.356575+0000","last_undegraded":"2023-11-27T20:45:22.356575+0000","last_fullsized":"2023-11-27T20:45:22.356575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:39:56.285530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.331998+0000","last_change":"2023-11-27T20:45:06.270397+0000","last_active":"2023-11-27T20:45:22.331998+0000","last_peered":"2023-11-27T20:45:22.331998+0000","last_clean":"2023-11-27T20:45:22.331998+0000","last_became_active":"2023-11-27T20:45:06.270159+0000","last_became_peered":"2023-11-27T20:45:06.270159+0000","last_unstale":"2023-11-27T20:45:22.331998+0000","last_undegraded":"2023-11-27T20:45:22.331998+0000","last_fullsized":"2023-11-27T20:45:22.331998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:28.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356253+0000","last_change":"2023-11-27T20:45:22.353059+0000","last_active":"2023-11-27T20:45:23.356253+0000","last_peered":"2023-11-27T20:45:23.356253+0000","last_clean":"2023-11-27T20:45:23.356253+0000","last_became_active":"2023-11-27T20:45:22.351367+0000","last_became_peered":"2023-11-27T20:45:22.351367+0000","last_unstale":"2023-11-27T20:45:23.356253+0000","last_undegraded":"2023-11-27T20:45:23.356253+0000","last_fullsized":"2023-11-27T20:45:23.356253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:12.006218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332136+0000","last_change":"2023-11-27T20:45:06.276571+0000","last_active":"2023-11-27T20:45:21.332136+0000","last_peered":"2023-11-27T20:45:21.332136+0000","last_clean":"2023-11-27T20:45:21.332136+0000","last_became_active":"2023-11-27T20:45:06.276265+0000","last_became_peered":"2023-11-27T20:45:06.276265+0000","last_unstale":"2023-11-27T20:45:21.332136+0000","last_undegraded":"2023-11-27T20:45:21.332136+0000","last_fullsized":"2023-11-27T20:45:21.332136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:28.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.350735+0000","last_change":"2023-11-27T20:45:22.346941+0000","last_active":"2023-11-27T20:45:22.350735+0000","last_peered":"2023-11-27T20:45:22.350735+0000","last_clean":"2023-11-27T20:45:22.350735+0000","last_became_active":"2023-11-27T20:45:22.346467+0000","last_became_peered":"2023-11-27T20:45:22.346467+0000","last_unstale":"2023-11-27T20:45:22.350735+0000","last_undegraded":"2023-11-27T20:45:22.350735+0000","last_fullsized":"2023-11-27T20:45:22.350735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:37:19.859739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.331117+0000","last_change":"2023-11-27T20:45:06.271839+0000","last_active":"2023-11-27T20:45:22.331117+0000","last_peered":"2023-11-27T20:45:22.331117+0000","last_clean":"2023-11-27T20:45:22.331117+0000","last_became_active":"2023-11-27T20:45:06.271230+0000","last_became_peered":"2023-11-27T20:45:06.271230+0000","last_unstale":"2023-11-27T20:45:22.331117+0000","last_undegraded":"2023-11-27T20:45:22.331117+0000","last_fullsized":"2023-11-27T20:45:22.331117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:57:06.763360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358203+0000","last_change":"2023-11-27T20:45:22.353188+0000","last_active":"2023-11-27T20:45:22.358203+0000","last_peered":"2023-11-27T20:45:22.358203+0000","last_clean":"2023-11-27T20:45:22.358203+0000","last_became_active":"2023-11-27T20:45:22.351124+0000","last_became_peered":"2023-11-27T20:45:22.351124+0000","last_unstale":"2023-11-27T20:45:22.358203+0000","last_undegraded":"2023-11-27T20:45:22.358203+0000","last_fullsized":"2023-11-27T20:45:22.358203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:18:21.773413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330591+0000","last_change":"2023-11-27T20:45:06.271557+0000","last_active":"2023-11-27T20:45:21.330591+0000","last_peered":"2023-11-27T20:45:21.330591+0000","last_clean":"2023-11-27T20:45:21.330591+0000","last_became_active":"2023-11-27T20:45:06.271014+0000","last_became_peered":"2023-11-27T20:45:06.271014+0000","last_unstale":"2023-11-27T20:45:21.330591+0000","last_undegraded":"2023-11-27T20:45:21.330591+0000","last_fullsized":"2023-11-27T20:45:21.330591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:35.973730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358887+0000","last_change":"2023-11-27T20:45:22.354763+0000","last_active":"2023-11-27T20:45:22.358887+0000","last_peered":"2023-11-27T20:45:22.358887+0000","last_clean":"2023-11-27T20:45:22.358887+0000","last_became_active":"2023-11-27T20:45:22.354412+0000","last_became_peered":"2023-11-27T20:45:22.354412+0000","last_unstale":"2023-11-27T20:45:22.358887+0000","last_undegraded":"2023-11-27T20:45:22.358887+0000","last_fullsized":"2023-11-27T20:45:22.358887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:41:32.100480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333132+0000","last_change":"2023-11-27T20:45:06.279235+0000","last_active":"2023-11-27T20:45:21.333132+0000","last_peered":"2023-11-27T20:45:21.333132+0000","last_clean":"2023-11-27T20:45:21.333132+0000","last_became_active":"2023-11-27T20:45:06.278923+0000","last_became_peered":"2023-11-27T20:45:06.278923+0000","last_unstale":"2023-11-27T20:45:21.333132+0000","last_undegraded":"2023-11-27T20:45:21.333132+0000","last_fullsized":"2023-11-27T20:45:21.333132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357505+0000","last_change":"2023-11-27T20:45:22.337126+0000","last_active":"2023-11-27T20:45:23.357505+0000","last_peered":"2023-11-27T20:45:23.357505+0000","last_clean":"2023-11-27T20:45:23.357505+0000","last_became_active":"2023-11-27T20:45:22.336548+0000","last_became_peered":"2023-11-27T20:45:22.336548+0000","last_unstale":"2023-11-27T20:45:23.357505+0000","last_undegraded":"2023-11-27T20:45:23.357505+0000","last_fullsized":"2023-11-27T20:45:23.357505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:18:21.773413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332532+0000","last_change":"2023-11-27T20:45:06.280157+0000","last_active":"2023-11-27T20:45:21.332532+0000","last_peered":"2023-11-27T20:45:21.332532+0000","last_clean":"2023-11-27T20:45:21.332532+0000","last_became_active":"2023-11-27T20:45:06.275941+0000","last_became_peered":"2023-11-27T20:45:06.275941+0000","last_unstale":"2023-11-27T20:45:21.332532+0000","last_undegraded":"2023-11-27T20:45:21.332532+0000","last_fullsized":"2023-11-27T20:45:21.332532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:55.254080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.359100+0000","last_change":"2023-11-27T20:45:22.350026+0000","last_active":"2023-11-27T20:45:23.359100+0000","last_peered":"2023-11-27T20:45:23.359100+0000","last_clean":"2023-11-27T20:45:23.359100+0000","last_became_active":"2023-11-27T20:45:22.349705+0000","last_became_peered":"2023-11-27T20:45:22.349705+0000","last_unstale":"2023-11-27T20:45:23.359100+0000","last_undegraded":"2023-11-27T20:45:23.359100+0000","last_fullsized":"2023-11-27T20:45:23.359100+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:17.023008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.319484+0000","last_change":"2023-11-27T20:45:06.268839+0000","last_active":"2023-11-27T20:45:22.319484+0000","last_peered":"2023-11-27T20:45:22.319484+0000","last_clean":"2023-11-27T20:45:22.319484+0000","last_became_active":"2023-11-27T20:45:06.268579+0000","last_became_peered":"2023-11-27T20:45:06.268579+0000","last_unstale":"2023-11-27T20:45:22.319484+0000","last_undegraded":"2023-11-27T20:45:22.319484+0000","last_fullsized":"2023-11-27T20:45:22.319484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:52:46.386901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.348892+0000","last_change":"2023-11-27T20:45:22.339096+0000","last_active":"2023-11-27T20:45:22.348892+0000","last_peered":"2023-11-27T20:45:22.348892+0000","last_clean":"2023-11-27T20:45:22.348892+0000","last_became_active":"2023-11-27T20:45:22.338380+0000","last_became_peered":"2023-11-27T20:45:22.338380+0000","last_unstale":"2023-11-27T20:45:22.348892+0000","last_undegraded":"2023-11-27T20:45:22.348892+0000","last_fullsized":"2023-11-27T20:45:22.348892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:24:34.135648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331316+0000","last_change":"2023-11-27T20:45:06.270837+0000","last_active":"2023-11-27T20:45:21.331316+0000","last_peered":"2023-11-27T20:45:21.331316+0000","last_clean":"2023-11-27T20:45:21.331316+0000","last_became_active":"2023-11-27T20:45:06.270495+0000","last_became_peered":"2023-11-27T20:45:06.270495+0000","last_unstale":"2023-11-27T20:45:21.331316+0000","last_undegraded":"2023-11-27T20:45:21.331316+0000","last_fullsized":"2023-11-27T20:45:21.331316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:11.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.356748+0000","last_change":"2023-11-27T20:45:22.349837+0000","last_active":"2023-11-27T20:45:22.356748+0000","last_peered":"2023-11-27T20:45:22.356748+0000","last_clean":"2023-11-27T20:45:22.356748+0000","last_became_active":"2023-11-27T20:45:22.346904+0000","last_became_peered":"2023-11-27T20:45:22.346904+0000","last_unstale":"2023-11-27T20:45:22.356748+0000","last_undegraded":"2023-11-27T20:45:22.356748+0000","last_fullsized":"2023-11-27T20:45:22.356748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:41:32.100480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.336969+0000","last_change":"2023-11-27T20:45:06.273803+0000","last_active":"2023-11-27T20:45:21.336969+0000","last_peered":"2023-11-27T20:45:21.336969+0000","last_clean":"2023-11-27T20:45:21.336969+0000","last_became_active":"2023-11-27T20:45:06.273439+0000","last_became_peered":"2023-11-27T20:45:06.273439+0000","last_unstale":"2023-11-27T20:45:21.336969+0000","last_undegraded":"2023-11-27T20:45:21.336969+0000","last_fullsized":"2023-11-27T20:45:21.336969+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:20.750426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.362272+0000","last_change":"2023-11-27T20:45:22.357322+0000","last_active":"2023-11-27T20:45:22.362272+0000","last_peered":"2023-11-27T20:45:22.362272+0000","last_clean":"2023-11-27T20:45:22.362272+0000","last_became_active":"2023-11-27T20:45:22.357026+0000","last_became_peered":"2023-11-27T20:45:22.357026+0000","last_unstale":"2023-11-27T20:45:22.362272+0000","last_undegraded":"2023-11-27T20:45:22.362272+0000","last_fullsized":"2023-11-27T20:45:22.362272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:37:50.104291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337836+0000","last_change":"2023-11-27T20:45:06.276128+0000","last_active":"2023-11-27T20:45:22.337836+0000","last_peered":"2023-11-27T20:45:22.337836+0000","last_clean":"2023-11-27T20:45:22.337836+0000","last_became_active":"2023-11-27T20:45:06.274808+0000","last_became_peered":"2023-11-27T20:45:06.274808+0000","last_unstale":"2023-11-27T20:45:22.337836+0000","last_undegraded":"2023-11-27T20:45:22.337836+0000","last_fullsized":"2023-11-27T20:45:22.337836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:50:09.959822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364085+0000","last_change":"2023-11-27T20:45:22.354631+0000","last_active":"2023-11-27T20:45:22.364085+0000","last_peered":"2023-11-27T20:45:22.364085+0000","last_clean":"2023-11-27T20:45:22.364085+0000","last_became_active":"2023-11-27T20:45:22.353006+0000","last_became_peered":"2023-11-27T20:45:22.353006+0000","last_unstale":"2023-11-27T20:45:22.364085+0000","last_undegraded":"2023-11-27T20:45:22.364085+0000","last_fullsized":"2023-11-27T20:45:22.364085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:39:56.285530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.323992+0000","last_change":"2023-11-27T20:45:06.269154+0000","last_active":"2023-11-27T20:45:21.323992+0000","last_peered":"2023-11-27T20:45:21.323992+0000","last_clean":"2023-11-27T20:45:21.323992+0000","last_became_active":"2023-11-27T20:45:06.268153+0000","last_became_peered":"2023-11-27T20:45:06.268153+0000","last_unstale":"2023-11-27T20:45:21.323992+0000","last_undegraded":"2023-11-27T20:45:21.323992+0000","last_fullsized":"2023-11-27T20:45:21.323992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.450953+0000","last_change":"2023-11-27T20:45:22.357635+0000","last_active":"2023-11-27T20:45:23.450953+0000","last_peered":"2023-11-27T20:45:23.450953+0000","last_clean":"2023-11-27T20:45:23.450953+0000","last_became_active":"2023-11-27T20:45:22.353642+0000","last_became_peered":"2023-11-27T20:45:22.353642+0000","last_unstale":"2023-11-27T20:45:23.450953+0000","last_undegraded":"2023-11-27T20:45:23.450953+0000","last_fullsized":"2023-11-27T20:45:23.450953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:19.057740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.325348+0000","last_change":"2023-11-27T20:45:06.280743+0000","last_active":"2023-11-27T20:45:22.325348+0000","last_peered":"2023-11-27T20:45:22.325348+0000","last_clean":"2023-11-27T20:45:22.325348+0000","last_became_active":"2023-11-27T20:45:06.280225+0000","last_became_peered":"2023-11-27T20:45:06.280225+0000","last_unstale":"2023-11-27T20:45:22.325348+0000","last_undegraded":"2023-11-27T20:45:22.325348+0000","last_fullsized":"2023-11-27T20:45:22.325348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:24.286070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.452137+0000","last_change":"2023-11-27T20:45:22.348519+0000","last_active":"2023-11-27T20:45:23.452137+0000","last_peered":"2023-11-27T20:45:23.452137+0000","last_clean":"2023-11-27T20:45:23.452137+0000","last_became_active":"2023-11-27T20:45:22.348232+0000","last_became_peered":"2023-11-27T20:45:22.348232+0000","last_unstale":"2023-11-27T20:45:23.452137+0000","last_undegraded":"2023-11-27T20:45:23.452137+0000","last_fullsized":"2023-11-27T20:45:23.452137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:55.269119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.330783+0000","last_change":"2023-11-27T20:45:06.276232+0000","last_active":"2023-11-27T20:45:22.330783+0000","last_peered":"2023-11-27T20:45:22.330783+0000","last_clean":"2023-11-27T20:45:22.330783+0000","last_became_active":"2023-11-27T20:45:06.274283+0000","last_became_peered":"2023-11-27T20:45:06.274283+0000","last_unstale":"2023-11-27T20:45:22.330783+0000","last_undegraded":"2023-11-27T20:45:22.330783+0000","last_fullsized":"2023-11-27T20:45:22.330783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:59:57.174632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357651+0000","last_change":"2023-11-27T20:45:22.340990+0000","last_active":"2023-11-27T20:45:23.357651+0000","last_peered":"2023-11-27T20:45:23.357651+0000","last_clean":"2023-11-27T20:45:23.357651+0000","last_became_active":"2023-11-27T20:45:22.340672+0000","last_became_peered":"2023-11-27T20:45:22.340672+0000","last_unstale":"2023-11-27T20:45:23.357651+0000","last_undegraded":"2023-11-27T20:45:23.357651+0000","last_fullsized":"2023-11-27T20:45:23.357651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:10.851731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.340288+0000","last_change":"2023-11-27T20:45:06.282186+0000","last_active":"2023-11-27T20:45:22.340288+0000","last_peered":"2023-11-27T20:45:22.340288+0000","last_clean":"2023-11-27T20:45:22.340288+0000","last_became_active":"2023-11-27T20:45:06.281910+0000","last_became_peered":"2023-11-27T20:45:06.281910+0000","last_unstale":"2023-11-27T20:45:22.340288+0000","last_undegraded":"2023-11-27T20:45:22.340288+0000","last_fullsized":"2023-11-27T20:45:22.340288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:38.205825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.358077+0000","last_change":"2023-11-27T20:45:22.357704+0000","last_active":"2023-11-27T20:45:23.358077+0000","last_peered":"2023-11-27T20:45:23.358077+0000","last_clean":"2023-11-27T20:45:23.358077+0000","last_became_active":"2023-11-27T20:45:22.357334+0000","last_became_peered":"2023-11-27T20:45:22.357334+0000","last_unstale":"2023-11-27T20:45:23.358077+0000","last_undegraded":"2023-11-27T20:45:23.358077+0000","last_fullsized":"2023-11-27T20:45:23.358077+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:26:20.476267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337505+0000","last_change":"2023-11-27T20:45:06.279696+0000","last_active":"2023-11-27T20:45:22.337505+0000","last_peered":"2023-11-27T20:45:22.337505+0000","last_clean":"2023-11-27T20:45:22.337505+0000","last_became_active":"2023-11-27T20:45:06.279208+0000","last_became_peered":"2023-11-27T20:45:06.279208+0000","last_unstale":"2023-11-27T20:45:22.337505+0000","last_undegraded":"2023-11-27T20:45:22.337505+0000","last_fullsized":"2023-11-27T20:45:22.337505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:22:23.387234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364424+0000","last_change":"2023-11-27T20:45:22.360553+0000","last_active":"2023-11-27T20:45:22.364424+0000","last_peered":"2023-11-27T20:45:22.364424+0000","last_clean":"2023-11-27T20:45:22.364424+0000","last_became_active":"2023-11-27T20:45:22.360122+0000","last_became_peered":"2023-11-27T20:45:22.360122+0000","last_unstale":"2023-11-27T20:45:22.364424+0000","last_undegraded":"2023-11-27T20:45:22.364424+0000","last_fullsized":"2023-11-27T20:45:22.364424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:10.851731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.334311+0000","last_change":"2023-11-27T20:45:06.277398+0000","last_active":"2023-11-27T20:45:22.334311+0000","last_peered":"2023-11-27T20:45:22.334311+0000","last_clean":"2023-11-27T20:45:22.334311+0000","last_became_active":"2023-11-27T20:45:06.277088+0000","last_became_peered":"2023-11-27T20:45:06.277088+0000","last_unstale":"2023-11-27T20:45:22.334311+0000","last_undegraded":"2023-11-27T20:45:22.334311+0000","last_fullsized":"2023-11-27T20:45:22.334311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:19.836448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356391+0000","last_change":"2023-11-27T20:45:22.347218+0000","last_active":"2023-11-27T20:45:23.356391+0000","last_peered":"2023-11-27T20:45:23.356391+0000","last_clean":"2023-11-27T20:45:23.356391+0000","last_became_active":"2023-11-27T20:45:22.345439+0000","last_became_peered":"2023-11-27T20:45:22.345439+0000","last_unstale":"2023-11-27T20:45:23.356391+0000","last_undegraded":"2023-11-27T20:45:23.356391+0000","last_fullsized":"2023-11-27T20:45:23.356391+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:32:07.786331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338591+0000","last_change":"2023-11-27T20:45:06.277480+0000","last_active":"2023-11-27T20:45:22.338591+0000","last_peered":"2023-11-27T20:45:22.338591+0000","last_clean":"2023-11-27T20:45:22.338591+0000","last_became_active":"2023-11-27T20:45:06.277134+0000","last_became_peered":"2023-11-27T20:45:06.277134+0000","last_unstale":"2023-11-27T20:45:22.338591+0000","last_undegraded":"2023-11-27T20:45:22.338591+0000","last_fullsized":"2023-11-27T20:45:22.338591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:10:17.216692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358445+0000","last_change":"2023-11-27T20:45:22.355973+0000","last_active":"2023-11-27T20:45:22.358445+0000","last_peered":"2023-11-27T20:45:22.358445+0000","last_clean":"2023-11-27T20:45:22.358445+0000","last_became_active":"2023-11-27T20:45:22.355428+0000","last_became_peered":"2023-11-27T20:45:22.355428+0000","last_unstale":"2023-11-27T20:45:22.358445+0000","last_undegraded":"2023-11-27T20:45:22.358445+0000","last_fullsized":"2023-11-27T20:45:22.358445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:45:04.189207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.317955+0000","last_change":"2023-11-27T20:45:06.277173+0000","last_active":"2023-11-27T20:45:22.317955+0000","last_peered":"2023-11-27T20:45:22.317955+0000","last_clean":"2023-11-27T20:45:22.317955+0000","last_became_active":"2023-11-27T20:45:06.276898+0000","last_became_peered":"2023-11-27T20:45:06.276898+0000","last_unstale":"2023-11-27T20:45:22.317955+0000","last_undegraded":"2023-11-27T20:45:22.317955+0000","last_fullsized":"2023-11-27T20:45:22.317955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:58:55.412394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451496+0000","last_change":"2023-11-27T20:45:22.355694+0000","last_active":"2023-11-27T20:45:23.451496+0000","last_peered":"2023-11-27T20:45:23.451496+0000","last_clean":"2023-11-27T20:45:23.451496+0000","last_became_active":"2023-11-27T20:45:22.351085+0000","last_became_peered":"2023-11-27T20:45:22.351085+0000","last_unstale":"2023-11-27T20:45:23.451496+0000","last_undegraded":"2023-11-27T20:45:23.451496+0000","last_fullsized":"2023-11-27T20:45:23.451496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:44.673674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330167+0000","last_change":"2023-11-27T20:45:06.279341+0000","last_active":"2023-11-27T20:45:21.330167+0000","last_peered":"2023-11-27T20:45:21.330167+0000","last_clean":"2023-11-27T20:45:21.330167+0000","last_became_active":"2023-11-27T20:45:06.278293+0000","last_became_peered":"2023-11-27T20:45:06.278293+0000","last_unstale":"2023-11-27T20:45:21.330167+0000","last_undegraded":"2023-11-27T20:45:21.330167+0000","last_fullsized":"2023-11-27T20:45:21.330167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:00.849008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356548+0000","last_change":"2023-11-27T20:45:22.352267+0000","last_active":"2023-11-27T20:45:23.356548+0000","last_peered":"2023-11-27T20:45:23.356548+0000","last_clean":"2023-11-27T20:45:23.356548+0000","last_became_active":"2023-11-27T20:45:22.350619+0000","last_became_peered":"2023-11-27T20:45:22.350619+0000","last_unstale":"2023-11-27T20:45:23.356548+0000","last_undegraded":"2023-11-27T20:45:23.356548+0000","last_fullsized":"2023-11-27T20:45:23.356548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:25:15.988150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.340639+0000","last_change":"2023-11-27T20:45:06.280079+0000","last_active":"2023-11-27T20:45:22.340639+0000","last_peered":"2023-11-27T20:45:22.340639+0000","last_clean":"2023-11-27T20:45:22.340639+0000","last_became_active":"2023-11-27T20:45:06.279228+0000","last_became_peered":"2023-11-27T20:45:06.279228+0000","last_unstale":"2023-11-27T20:45:22.340639+0000","last_undegraded":"2023-11-27T20:45:22.340639+0000","last_fullsized":"2023-11-27T20:45:22.340639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:09:40.464389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364345+0000","last_change":"2023-11-27T20:45:22.360934+0000","last_active":"2023-11-27T20:45:22.364345+0000","last_peered":"2023-11-27T20:45:22.364345+0000","last_clean":"2023-11-27T20:45:22.364345+0000","last_became_active":"2023-11-27T20:45:22.360204+0000","last_became_peered":"2023-11-27T20:45:22.360204+0000","last_unstale":"2023-11-27T20:45:22.364345+0000","last_undegraded":"2023-11-27T20:45:22.364345+0000","last_fullsized":"2023-11-27T20:45:22.364345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:48:12.470137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.321044+0000","last_change":"2023-11-27T20:45:06.263651+0000","last_active":"2023-11-27T20:45:22.321044+0000","last_peered":"2023-11-27T20:45:22.321044+0000","last_clean":"2023-11-27T20:45:22.321044+0000","last_became_active":"2023-11-27T20:45:06.263101+0000","last_became_peered":"2023-11-27T20:45:06.263101+0000","last_unstale":"2023-11-27T20:45:22.321044+0000","last_undegraded":"2023-11-27T20:45:22.321044+0000","last_fullsized":"2023-11-27T20:45:22.321044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:38:33.732526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.353829+0000","last_change":"2023-11-27T20:45:22.350156+0000","last_active":"2023-11-27T20:45:22.353829+0000","last_peered":"2023-11-27T20:45:22.353829+0000","last_clean":"2023-11-27T20:45:22.353829+0000","last_became_active":"2023-11-27T20:45:22.342948+0000","last_became_peered":"2023-11-27T20:45:22.342948+0000","last_unstale":"2023-11-27T20:45:22.353829+0000","last_undegraded":"2023-11-27T20:45:22.353829+0000","last_fullsized":"2023-11-27T20:45:22.353829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:00:24.410247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.340925+0000","last_change":"2023-11-27T20:45:06.276593+0000","last_active":"2023-11-27T20:45:21.340925+0000","last_peered":"2023-11-27T20:45:21.340925+0000","last_clean":"2023-11-27T20:45:21.340925+0000","last_became_active":"2023-11-27T20:45:06.276315+0000","last_became_peered":"2023-11-27T20:45:06.276315+0000","last_unstale":"2023-11-27T20:45:21.340925+0000","last_undegraded":"2023-11-27T20:45:21.340925+0000","last_fullsized":"2023-11-27T20:45:21.340925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:02.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.353982+0000","last_change":"2023-11-27T20:45:22.350466+0000","last_active":"2023-11-27T20:45:22.353982+0000","last_peered":"2023-11-27T20:45:22.353982+0000","last_clean":"2023-11-27T20:45:22.353982+0000","last_became_active":"2023-11-27T20:45:22.348676+0000","last_became_peered":"2023-11-27T20:45:22.348676+0000","last_unstale":"2023-11-27T20:45:22.353982+0000","last_undegraded":"2023-11-27T20:45:22.353982+0000","last_fullsized":"2023-11-27T20:45:22.353982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:36:22.091833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.327518+0000","last_change":"2023-11-27T20:45:06.265948+0000","last_active":"2023-11-27T20:45:22.327518+0000","last_peered":"2023-11-27T20:45:22.327518+0000","last_clean":"2023-11-27T20:45:22.327518+0000","last_became_active":"2023-11-27T20:45:06.265615+0000","last_became_peered":"2023-11-27T20:45:06.265615+0000","last_unstale":"2023-11-27T20:45:22.327518+0000","last_undegraded":"2023-11-27T20:45:22.327518+0000","last_fullsized":"2023-11-27T20:45:22.327518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.358227+0000","last_change":"2023-11-27T20:45:22.352391+0000","last_active":"2023-11-27T20:45:23.358227+0000","last_peered":"2023-11-27T20:45:23.358227+0000","last_clean":"2023-11-27T20:45:23.358227+0000","last_became_active":"2023-11-27T20:45:22.351730+0000","last_became_peered":"2023-11-27T20:45:22.351730+0000","last_unstale":"2023-11-27T20:45:23.358227+0000","last_undegraded":"2023-11-27T20:45:23.358227+0000","last_fullsized":"2023-11-27T20:45:23.358227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:41:31.794086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331422+0000","last_change":"2023-11-27T20:45:06.270218+0000","last_active":"2023-11-27T20:45:21.331422+0000","last_peered":"2023-11-27T20:45:21.331422+0000","last_clean":"2023-11-27T20:45:21.331422+0000","last_became_active":"2023-11-27T20:45:06.269297+0000","last_became_peered":"2023-11-27T20:45:06.269297+0000","last_unstale":"2023-11-27T20:45:21.331422+0000","last_undegraded":"2023-11-27T20:45:21.331422+0000","last_fullsized":"2023-11-27T20:45:21.331422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.356769+0000","last_change":"2023-11-27T20:45:22.350146+0000","last_active":"2023-11-27T20:45:22.356769+0000","last_peered":"2023-11-27T20:45:22.356769+0000","last_clean":"2023-11-27T20:45:22.356769+0000","last_became_active":"2023-11-27T20:45:22.349774+0000","last_became_peered":"2023-11-27T20:45:22.349774+0000","last_unstale":"2023-11-27T20:45:22.356769+0000","last_undegraded":"2023-11-27T20:45:22.356769+0000","last_fullsized":"2023-11-27T20:45:22.356769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:47.794087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.318214+0000","last_change":"2023-11-27T20:45:06.264325+0000","last_active":"2023-11-27T20:45:22.318214+0000","last_peered":"2023-11-27T20:45:22.318214+0000","last_clean":"2023-11-27T20:45:22.318214+0000","last_became_active":"2023-11-27T20:45:06.260926+0000","last_became_peered":"2023-11-27T20:45:06.260926+0000","last_unstale":"2023-11-27T20:45:22.318214+0000","last_undegraded":"2023-11-27T20:45:22.318214+0000","last_fullsized":"2023-11-27T20:45:22.318214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:06.182643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353232+0000","last_change":"2023-11-27T20:45:22.342522+0000","last_active":"2023-11-27T20:45:23.353232+0000","last_peered":"2023-11-27T20:45:23.353232+0000","last_clean":"2023-11-27T20:45:23.353232+0000","last_became_active":"2023-11-27T20:45:22.342067+0000","last_became_peered":"2023-11-27T20:45:22.342067+0000","last_unstale":"2023-11-27T20:45:23.353232+0000","last_undegraded":"2023-11-27T20:45:23.353232+0000","last_fullsized":"2023-11-27T20:45:23.353232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:57.104764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.318185+0000","last_change":"2023-11-27T20:45:06.278905+0000","last_active":"2023-11-27T20:45:22.318185+0000","last_peered":"2023-11-27T20:45:22.318185+0000","last_clean":"2023-11-27T20:45:22.318185+0000","last_became_active":"2023-11-27T20:45:06.276359+0000","last_became_peered":"2023-11-27T20:45:06.276359+0000","last_unstale":"2023-11-27T20:45:22.318185+0000","last_undegraded":"2023-11-27T20:45:22.318185+0000","last_fullsized":"2023-11-27T20:45:22.318185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:13:33.854711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357088+0000","last_change":"2023-11-27T20:45:22.349924+0000","last_active":"2023-11-27T20:45:23.357088+0000","last_peered":"2023-11-27T20:45:23.357088+0000","last_clean":"2023-11-27T20:45:23.357088+0000","last_became_active":"2023-11-27T20:45:22.349642+0000","last_became_peered":"2023-11-27T20:45:22.349642+0000","last_unstale":"2023-11-27T20:45:23.357088+0000","last_undegraded":"2023-11-27T20:45:23.357088+0000","last_fullsized":"2023-11-27T20:45:23.357088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:57:12.808217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.325696+0000","last_change":"2023-11-27T20:45:06.278065+0000","last_active":"2023-11-27T20:45:22.325696+0000","last_peered":"2023-11-27T20:45:22.325696+0000","last_clean":"2023-11-27T20:45:22.325696+0000","last_became_active":"2023-11-27T20:45:06.277780+0000","last_became_peered":"2023-11-27T20:45:06.277780+0000","last_unstale":"2023-11-27T20:45:22.325696+0000","last_undegraded":"2023-11-27T20:45:22.325696+0000","last_fullsized":"2023-11-27T20:45:22.325696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:11.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451700+0000","last_change":"2023-11-27T20:45:22.344095+0000","last_active":"2023-11-27T20:45:23.451700+0000","last_peered":"2023-11-27T20:45:23.451700+0000","last_clean":"2023-11-27T20:45:23.451700+0000","last_became_active":"2023-11-27T20:45:22.343828+0000","last_became_peered":"2023-11-27T20:45:22.343828+0000","last_unstale":"2023-11-27T20:45:23.451700+0000","last_undegraded":"2023-11-27T20:45:23.451700+0000","last_fullsized":"2023-11-27T20:45:23.451700+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:39.976491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330682+0000","last_change":"2023-11-27T20:45:06.257819+0000","last_active":"2023-11-27T20:45:21.330682+0000","last_peered":"2023-11-27T20:45:21.330682+0000","last_clean":"2023-11-27T20:45:21.330682+0000","last_became_active":"2023-11-27T20:45:06.257086+0000","last_became_peered":"2023-11-27T20:45:06.257086+0000","last_unstale":"2023-11-27T20:45:21.330682+0000","last_undegraded":"2023-11-27T20:45:21.330682+0000","last_fullsized":"2023-11-27T20:45:21.330682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:24.286070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353742+0000","last_change":"2023-11-27T20:45:22.342376+0000","last_active":"2023-11-27T20:45:23.353742+0000","last_peered":"2023-11-27T20:45:23.353742+0000","last_clean":"2023-11-27T20:45:23.353742+0000","last_became_active":"2023-11-27T20:45:22.341887+0000","last_became_peered":"2023-11-27T20:45:22.341887+0000","last_unstale":"2023-11-27T20:45:23.353742+0000","last_undegraded":"2023-11-27T20:45:23.353742+0000","last_fullsized":"2023-11-27T20:45:23.353742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:23.052052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357971+0000","last_change":"2023-11-27T20:45:21.345110+0000","last_active":"2023-11-27T20:45:23.357971+0000","last_peered":"2023-11-27T20:45:23.357971+0000","last_clean":"2023-11-27T20:45:23.357971+0000","last_became_active":"2023-11-27T20:45:21.344796+0000","last_became_peered":"2023-11-27T20:45:21.344796+0000","last_unstale":"2023-11-27T20:45:23.357971+0000","last_undegraded":"2023-11-27T20:45:23.357971+0000","last_fullsized":"2023-11-27T20:45:23.357971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:59:48.447747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.326090+0000","last_change":"2023-11-27T20:45:06.282558+0000","last_active":"2023-11-27T20:45:22.326090+0000","last_peered":"2023-11-27T20:45:22.326090+0000","last_clean":"2023-11-27T20:45:22.326090+0000","last_became_active":"2023-11-27T20:45:06.282227+0000","last_became_peered":"2023-11-27T20:45:06.282227+0000","last_unstale":"2023-11-27T20:45:22.326090+0000","last_undegraded":"2023-11-27T20:45:22.326090+0000","last_fullsized":"2023-11-27T20:45:22.326090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"74'4","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333098+0000","last_change":"2023-11-27T20:45:05.632935+0000","last_active":"2023-11-27T20:45:21.333098+0000","last_peered":"2023-11-27T20:45:21.333098+0000","last_clean":"2023-11-27T20:45:21.333098+0000","last_became_active":"2023-11-27T20:45:05.632654+0000","last_became_peered":"2023-11-27T20:45:05.632654+0000","last_unstale":"2023-11-27T20:45:21.333098+0000","last_undegraded":"2023-11-27T20:45:21.333098+0000","last_fullsized":"2023-11-27T20:45:21.333098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:56.837141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357952+0000","last_change":"2023-11-27T20:45:22.348879+0000","last_active":"2023-11-27T20:45:23.357952+0000","last_peered":"2023-11-27T20:45:23.357952+0000","last_clean":"2023-11-27T20:45:23.357952+0000","last_became_active":"2023-11-27T20:45:22.348489+0000","last_became_peered":"2023-11-27T20:45:22.348489+0000","last_unstale":"2023-11-27T20:45:23.357952+0000","last_undegraded":"2023-11-27T20:45:23.357952+0000","last_fullsized":"2023-11-27T20:45:23.357952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:41:32.100480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357225+0000","last_change":"2023-11-27T20:45:21.342255+0000","last_active":"2023-11-27T20:45:23.357225+0000","last_peered":"2023-11-27T20:45:23.357225+0000","last_clean":"2023-11-27T20:45:23.357225+0000","last_became_active":"2023-11-27T20:45:21.339919+0000","last_became_peered":"2023-11-27T20:45:21.339919+0000","last_unstale":"2023-11-27T20:45:23.357225+0000","last_undegraded":"2023-11-27T20:45:23.357225+0000","last_fullsized":"2023-11-27T20:45:23.357225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:44.073973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332909+0000","last_change":"2023-11-27T20:45:06.280819+0000","last_active":"2023-11-27T20:45:21.332909+0000","last_peered":"2023-11-27T20:45:21.332909+0000","last_clean":"2023-11-27T20:45:21.332909+0000","last_became_active":"2023-11-27T20:45:06.280545+0000","last_became_peered":"2023-11-27T20:45:06.280545+0000","last_unstale":"2023-11-27T20:45:21.332909+0000","last_undegraded":"2023-11-27T20:45:21.332909+0000","last_fullsized":"2023-11-27T20:45:21.332909+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:01.046541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"74'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.327117+0000","last_change":"2023-11-27T20:45:05.644560+0000","last_active":"2023-11-27T20:45:22.327117+0000","last_peered":"2023-11-27T20:45:22.327117+0000","last_clean":"2023-11-27T20:45:22.327117+0000","last_became_active":"2023-11-27T20:45:05.644264+0000","last_became_peered":"2023-11-27T20:45:05.644264+0000","last_unstale":"2023-11-27T20:45:22.327117+0000","last_undegraded":"2023-11-27T20:45:22.327117+0000","last_fullsized":"2023-11-27T20:45:22.327117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:02.361558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.453411+0000","last_change":"2023-11-27T20:45:22.354977+0000","last_active":"2023-11-27T20:45:23.453411+0000","last_peered":"2023-11-27T20:45:23.453411+0000","last_clean":"2023-11-27T20:45:23.453411+0000","last_became_active":"2023-11-27T20:45:22.350957+0000","last_became_peered":"2023-11-27T20:45:22.350957+0000","last_unstale":"2023-11-27T20:45:23.453411+0000","last_undegraded":"2023-11-27T20:45:23.453411+0000","last_fullsized":"2023-11-27T20:45:23.453411+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:57.104764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"80'4","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357586+0000","last_change":"2023-11-27T20:45:21.339017+0000","last_active":"2023-11-27T20:45:23.357586+0000","last_peered":"2023-11-27T20:45:23.357586+0000","last_clean":"2023-11-27T20:45:23.357586+0000","last_became_active":"2023-11-27T20:45:21.338757+0000","last_became_peered":"2023-11-27T20:45:21.338757+0000","last_unstale":"2023-11-27T20:45:23.357586+0000","last_undegraded":"2023-11-27T20:45:23.357586+0000","last_fullsized":"2023-11-27T20:45:23.357586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:16:58.196965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331531+0000","last_change":"2023-11-27T20:45:06.257973+0000","last_active":"2023-11-27T20:45:21.331531+0000","last_peered":"2023-11-27T20:45:21.331531+0000","last_clean":"2023-11-27T20:45:21.331531+0000","last_became_active":"2023-11-27T20:45:06.257676+0000","last_became_peered":"2023-11-27T20:45:06.257676+0000","last_unstale":"2023-11-27T20:45:21.331531+0000","last_undegraded":"2023-11-27T20:45:21.331531+0000","last_fullsized":"2023-11-27T20:45:21.331531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:46:41.414343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"74'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337593+0000","last_change":"2023-11-27T20:45:05.636666+0000","last_active":"2023-11-27T20:45:22.337593+0000","last_peered":"2023-11-27T20:45:22.337593+0000","last_clean":"2023-11-27T20:45:22.337593+0000","last_became_active":"2023-11-27T20:45:05.636401+0000","last_became_peered":"2023-11-27T20:45:05.636401+0000","last_unstale":"2023-11-27T20:45:22.337593+0000","last_undegraded":"2023-11-27T20:45:22.337593+0000","last_fullsized":"2023-11-27T20:45:22.337593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:34.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364139+0000","last_change":"2023-11-27T20:45:22.355853+0000","last_active":"2023-11-27T20:45:22.364139+0000","last_peered":"2023-11-27T20:45:22.364139+0000","last_clean":"2023-11-27T20:45:22.364139+0000","last_became_active":"2023-11-27T20:45:22.355501+0000","last_became_peered":"2023-11-27T20:45:22.355501+0000","last_unstale":"2023-11-27T20:45:22.364139+0000","last_undegraded":"2023-11-27T20:45:22.364139+0000","last_fullsized":"2023-11-27T20:45:22.364139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:17.023008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.371281+0000","last_change":"2023-11-27T20:45:21.348526+0000","last_active":"2023-11-27T20:45:22.371281+0000","last_peered":"2023-11-27T20:45:22.371281+0000","last_clean":"2023-11-27T20:45:22.371281+0000","last_became_active":"2023-11-27T20:45:21.348200+0000","last_became_peered":"2023-11-27T20:45:21.348200+0000","last_unstale":"2023-11-27T20:45:22.371281+0000","last_undegraded":"2023-11-27T20:45:22.371281+0000","last_fullsized":"2023-11-27T20:45:22.371281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:29:09.838796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.339278+0000","last_change":"2023-11-27T20:45:06.280675+0000","last_active":"2023-11-27T20:45:21.339278+0000","last_peered":"2023-11-27T20:45:21.339278+0000","last_clean":"2023-11-27T20:45:21.339278+0000","last_became_active":"2023-11-27T20:45:06.280169+0000","last_became_peered":"2023-11-27T20:45:06.280169+0000","last_unstale":"2023-11-27T20:45:21.339278+0000","last_undegraded":"2023-11-27T20:45:21.339278+0000","last_fullsized":"2023-11-27T20:45:21.339278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"74'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338550+0000","last_change":"2023-11-27T20:45:05.637617+0000","last_active":"2023-11-27T20:45:22.338550+0000","last_peered":"2023-11-27T20:45:22.338550+0000","last_clean":"2023-11-27T20:45:22.338550+0000","last_became_active":"2023-11-27T20:45:05.636099+0000","last_became_peered":"2023-11-27T20:45:05.636099+0000","last_unstale":"2023-11-27T20:45:22.338550+0000","last_undegraded":"2023-11-27T20:45:22.338550+0000","last_fullsized":"2023-11-27T20:45:22.338550+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:00.040780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.346817+0000","last_change":"2023-11-27T20:45:22.336541+0000","last_active":"2023-11-27T20:45:22.346817+0000","last_peered":"2023-11-27T20:45:22.346817+0000","last_clean":"2023-11-27T20:45:22.346817+0000","last_became_active":"2023-11-27T20:45:22.336095+0000","last_became_peered":"2023-11-27T20:45:22.336095+0000","last_unstale":"2023-11-27T20:45:22.346817+0000","last_undegraded":"2023-11-27T20:45:22.346817+0000","last_fullsized":"2023-11-27T20:45:22.346817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:50.234056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.332459+0000","last_change":"2023-11-27T20:45:21.341685+0000","last_active":"2023-11-27T20:45:22.332459+0000","last_peered":"2023-11-27T20:45:22.332459+0000","last_clean":"2023-11-27T20:45:22.332459+0000","last_became_active":"2023-11-27T20:45:21.340271+0000","last_became_peered":"2023-11-27T20:45:21.340271+0000","last_unstale":"2023-11-27T20:45:22.332459+0000","last_undegraded":"2023-11-27T20:45:22.332459+0000","last_fullsized":"2023-11-27T20:45:22.332459+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:37:49.091355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.318419+0000","last_change":"2023-11-27T20:45:06.271072+0000","last_active":"2023-11-27T20:45:22.318419+0000","last_peered":"2023-11-27T20:45:22.318419+0000","last_clean":"2023-11-27T20:45:22.318419+0000","last_became_active":"2023-11-27T20:45:06.270093+0000","last_became_peered":"2023-11-27T20:45:06.270093+0000","last_unstale":"2023-11-27T20:45:22.318419+0000","last_undegraded":"2023-11-27T20:45:22.318419+0000","last_fullsized":"2023-11-27T20:45:22.318419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:13:43.427726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"74'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.332298+0000","last_change":"2023-11-27T20:45:05.641565+0000","last_active":"2023-11-27T20:45:22.332298+0000","last_peered":"2023-11-27T20:45:22.332298+0000","last_clean":"2023-11-27T20:45:22.332298+0000","last_became_active":"2023-11-27T20:45:05.635532+0000","last_became_peered":"2023-11-27T20:45:05.635532+0000","last_unstale":"2023-11-27T20:45:22.332298+0000","last_undegraded":"2023-11-27T20:45:22.332298+0000","last_fullsized":"2023-11-27T20:45:22.332298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:01:09.043274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356858+0000","last_change":"2023-11-27T20:45:22.341814+0000","last_active":"2023-11-27T20:45:23.356858+0000","last_peered":"2023-11-27T20:45:23.356858+0000","last_clean":"2023-11-27T20:45:23.356858+0000","last_became_active":"2023-11-27T20:45:22.341523+0000","last_became_peered":"2023-11-27T20:45:22.341523+0000","last_unstale":"2023-11-27T20:45:23.356858+0000","last_undegraded":"2023-11-27T20:45:23.356858+0000","last_fullsized":"2023-11-27T20:45:23.356858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:37:50.104291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353094+0000","last_change":"2023-11-27T20:45:21.330006+0000","last_active":"2023-11-27T20:45:23.353094+0000","last_peered":"2023-11-27T20:45:23.353094+0000","last_clean":"2023-11-27T20:45:23.353094+0000","last_became_active":"2023-11-27T20:45:21.329190+0000","last_became_peered":"2023-11-27T20:45:21.329190+0000","last_unstale":"2023-11-27T20:45:23.353094+0000","last_undegraded":"2023-11-27T20:45:23.353094+0000","last_fullsized":"2023-11-27T20:45:23.353094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:21.269930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.332059+0000","last_change":"2023-11-27T20:45:06.269149+0000","last_active":"2023-11-27T20:45:22.332059+0000","last_peered":"2023-11-27T20:45:22.332059+0000","last_clean":"2023-11-27T20:45:22.332059+0000","last_became_active":"2023-11-27T20:45:06.268793+0000","last_became_peered":"2023-11-27T20:45:06.268793+0000","last_unstale":"2023-11-27T20:45:22.332059+0000","last_undegraded":"2023-11-27T20:45:22.332059+0000","last_fullsized":"2023-11-27T20:45:22.332059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"74'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.326878+0000","last_change":"2023-11-27T20:45:05.642294+0000","last_active":"2023-11-27T20:45:22.326878+0000","last_peered":"2023-11-27T20:45:22.326878+0000","last_clean":"2023-11-27T20:45:22.326878+0000","last_became_active":"2023-11-27T20:45:05.641621+0000","last_became_peered":"2023-11-27T20:45:05.641621+0000","last_unstale":"2023-11-27T20:45:22.326878+0000","last_undegraded":"2023-11-27T20:45:22.326878+0000","last_fullsized":"2023-11-27T20:45:22.326878+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:05.586683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.359067+0000","last_change":"2023-11-27T20:45:22.354371+0000","last_active":"2023-11-27T20:45:22.359067+0000","last_peered":"2023-11-27T20:45:22.359067+0000","last_clean":"2023-11-27T20:45:22.359067+0000","last_became_active":"2023-11-27T20:45:22.353961+0000","last_became_peered":"2023-11-27T20:45:22.353961+0000","last_unstale":"2023-11-27T20:45:22.359067+0000","last_undegraded":"2023-11-27T20:45:22.359067+0000","last_fullsized":"2023-11-27T20:45:22.359067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:39:13.448303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353534+0000","last_change":"2023-11-27T20:45:21.339994+0000","last_active":"2023-11-27T20:45:23.353534+0000","last_peered":"2023-11-27T20:45:23.353534+0000","last_clean":"2023-11-27T20:45:23.353534+0000","last_became_active":"2023-11-27T20:45:21.339295+0000","last_became_peered":"2023-11-27T20:45:21.339295+0000","last_unstale":"2023-11-27T20:45:23.353534+0000","last_undegraded":"2023-11-27T20:45:23.353534+0000","last_fullsized":"2023-11-27T20:45:23.353534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:21:13.827830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.336425+0000","last_change":"2023-11-27T20:45:06.283545+0000","last_active":"2023-11-27T20:45:21.336425+0000","last_peered":"2023-11-27T20:45:21.336425+0000","last_clean":"2023-11-27T20:45:21.336425+0000","last_became_active":"2023-11-27T20:45:06.281547+0000","last_became_peered":"2023-11-27T20:45:06.281547+0000","last_unstale":"2023-11-27T20:45:21.336425+0000","last_undegraded":"2023-11-27T20:45:21.336425+0000","last_fullsized":"2023-11-27T20:45:21.336425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:22:23.387234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.336421+0000","last_change":"2023-11-27T20:45:05.640954+0000","last_active":"2023-11-27T20:45:22.336421+0000","last_peered":"2023-11-27T20:45:22.336421+0000","last_clean":"2023-11-27T20:45:22.336421+0000","last_became_active":"2023-11-27T20:45:05.640670+0000","last_became_peered":"2023-11-27T20:45:05.640670+0000","last_unstale":"2023-11-27T20:45:22.336421+0000","last_undegraded":"2023-11-27T20:45:22.336421+0000","last_fullsized":"2023-11-27T20:45:22.336421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:13.460812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.363472+0000","last_change":"2023-11-27T20:45:22.359115+0000","last_active":"2023-11-27T20:45:22.363472+0000","last_peered":"2023-11-27T20:45:22.363472+0000","last_clean":"2023-11-27T20:45:22.363472+0000","last_became_active":"2023-11-27T20:45:22.358834+0000","last_became_peered":"2023-11-27T20:45:22.358834+0000","last_unstale":"2023-11-27T20:45:22.363472+0000","last_undegraded":"2023-11-27T20:45:22.363472+0000","last_fullsized":"2023-11-27T20:45:22.363472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:47.794087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356595+0000","last_change":"2023-11-27T20:45:21.337250+0000","last_active":"2023-11-27T20:45:23.356595+0000","last_peered":"2023-11-27T20:45:23.356595+0000","last_clean":"2023-11-27T20:45:23.356595+0000","last_became_active":"2023-11-27T20:45:21.336947+0000","last_became_peered":"2023-11-27T20:45:21.336947+0000","last_unstale":"2023-11-27T20:45:23.356595+0000","last_undegraded":"2023-11-27T20:45:23.356595+0000","last_fullsized":"2023-11-27T20:45:23.356595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:01:15.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.324096+0000","last_change":"2023-11-27T20:45:06.267459+0000","last_active":"2023-11-27T20:45:21.324096+0000","last_peered":"2023-11-27T20:45:21.324096+0000","last_clean":"2023-11-27T20:45:21.324096+0000","last_became_active":"2023-11-27T20:45:06.267115+0000","last_became_peered":"2023-11-27T20:45:06.267115+0000","last_unstale":"2023-11-27T20:45:21.324096+0000","last_undegraded":"2023-11-27T20:45:21.324096+0000","last_fullsized":"2023-11-27T20:45:21.324096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:16:23.654821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.317415+0000","last_change":"2023-11-27T20:45:05.641922+0000","last_active":"2023-11-27T20:45:22.317415+0000","last_peered":"2023-11-27T20:45:22.317415+0000","last_clean":"2023-11-27T20:45:22.317415+0000","last_became_active":"2023-11-27T20:45:05.641612+0000","last_became_peered":"2023-11-27T20:45:05.641612+0000","last_unstale":"2023-11-27T20:45:22.317415+0000","last_undegraded":"2023-11-27T20:45:22.317415+0000","last_fullsized":"2023-11-27T20:45:22.317415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:57:05.757599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.350264+0000","last_change":"2023-11-27T20:45:22.343208+0000","last_active":"2023-11-27T20:45:22.350264+0000","last_peered":"2023-11-27T20:45:22.350264+0000","last_clean":"2023-11-27T20:45:22.350264+0000","last_became_active":"2023-11-27T20:45:22.342542+0000","last_became_peered":"2023-11-27T20:45:22.342542+0000","last_unstale":"2023-11-27T20:45:22.350264+0000","last_undegraded":"2023-11-27T20:45:22.350264+0000","last_fullsized":"2023-11-27T20:45:22.350264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:30.859296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"80'3","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.371157+0000","last_change":"2023-11-27T20:45:21.348133+0000","last_active":"2023-11-27T20:45:22.371157+0000","last_peered":"2023-11-27T20:45:22.371157+0000","last_clean":"2023-11-27T20:45:22.371157+0000","last_became_active":"2023-11-27T20:45:21.347651+0000","last_became_peered":"2023-11-27T20:45:21.347651+0000","last_unstale":"2023-11-27T20:45:22.371157+0000","last_undegraded":"2023-11-27T20:45:22.371157+0000","last_fullsized":"2023-11-27T20:45:22.371157+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:17:39.954725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332336+0000","last_change":"2023-11-27T20:45:06.273369+0000","last_active":"2023-11-27T20:45:21.332336+0000","last_peered":"2023-11-27T20:45:21.332336+0000","last_clean":"2023-11-27T20:45:21.332336+0000","last_became_active":"2023-11-27T20:45:06.271740+0000","last_became_peered":"2023-11-27T20:45:06.271740+0000","last_unstale":"2023-11-27T20:45:21.332336+0000","last_undegraded":"2023-11-27T20:45:21.332336+0000","last_fullsized":"2023-11-27T20:45:21.332336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:12.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333210+0000","last_change":"2023-11-27T20:45:05.631301+0000","last_active":"2023-11-27T20:45:21.333210+0000","last_peered":"2023-11-27T20:45:21.333210+0000","last_clean":"2023-11-27T20:45:21.333210+0000","last_became_active":"2023-11-27T20:45:05.630652+0000","last_became_peered":"2023-11-27T20:45:05.630652+0000","last_unstale":"2023-11-27T20:45:21.333210+0000","last_undegraded":"2023-11-27T20:45:21.333210+0000","last_fullsized":"2023-11-27T20:45:21.333210+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:40:58.001108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364364+0000","last_change":"2023-11-27T20:45:22.361676+0000","last_active":"2023-11-27T20:45:22.364364+0000","last_peered":"2023-11-27T20:45:22.364364+0000","last_clean":"2023-11-27T20:45:22.364364+0000","last_became_active":"2023-11-27T20:45:22.361352+0000","last_became_peered":"2023-11-27T20:45:22.361352+0000","last_unstale":"2023-11-27T20:45:22.364364+0000","last_undegraded":"2023-11-27T20:45:22.364364+0000","last_fullsized":"2023-11-27T20:45:22.364364+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:59:17.023008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"80'6","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357773+0000","last_change":"2023-11-27T20:45:21.335431+0000","last_active":"2023-11-27T20:45:23.357773+0000","last_peered":"2023-11-27T20:45:23.357773+0000","last_clean":"2023-11-27T20:45:23.357773+0000","last_became_active":"2023-11-27T20:45:21.335024+0000","last_became_peered":"2023-11-27T20:45:21.335024+0000","last_unstale":"2023-11-27T20:45:23.357773+0000","last_undegraded":"2023-11-27T20:45:23.357773+0000","last_fullsized":"2023-11-27T20:45:23.357773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:24:29.846361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333246+0000","last_change":"2023-11-27T20:45:06.273782+0000","last_active":"2023-11-27T20:45:21.333246+0000","last_peered":"2023-11-27T20:45:21.333246+0000","last_clean":"2023-11-27T20:45:21.333246+0000","last_became_active":"2023-11-27T20:45:06.273475+0000","last_became_peered":"2023-11-27T20:45:06.273475+0000","last_unstale":"2023-11-27T20:45:21.333246+0000","last_undegraded":"2023-11-27T20:45:21.333246+0000","last_fullsized":"2023-11-27T20:45:21.333246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332620+0000","last_change":"2023-11-27T20:45:05.646362+0000","last_active":"2023-11-27T20:45:21.332620+0000","last_peered":"2023-11-27T20:45:21.332620+0000","last_clean":"2023-11-27T20:45:21.332620+0000","last_became_active":"2023-11-27T20:45:05.645919+0000","last_became_peered":"2023-11-27T20:45:05.645919+0000","last_unstale":"2023-11-27T20:45:21.332620+0000","last_undegraded":"2023-11-27T20:45:21.332620+0000","last_fullsized":"2023-11-27T20:45:21.332620+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:01:09.043274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357594+0000","last_change":"2023-11-27T20:45:22.353452+0000","last_active":"2023-11-27T20:45:23.357594+0000","last_peered":"2023-11-27T20:45:23.357594+0000","last_clean":"2023-11-27T20:45:23.357594+0000","last_became_active":"2023-11-27T20:45:22.352105+0000","last_became_peered":"2023-11-27T20:45:22.352105+0000","last_unstale":"2023-11-27T20:45:23.357594+0000","last_undegraded":"2023-11-27T20:45:23.357594+0000","last_fullsized":"2023-11-27T20:45:23.357594+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:11:17.355833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.355021+0000","last_change":"2023-11-27T20:45:21.334475+0000","last_active":"2023-11-27T20:45:23.355021+0000","last_peered":"2023-11-27T20:45:23.355021+0000","last_clean":"2023-11-27T20:45:23.355021+0000","last_became_active":"2023-11-27T20:45:21.334136+0000","last_became_peered":"2023-11-27T20:45:21.334136+0000","last_unstale":"2023-11-27T20:45:23.355021+0000","last_undegraded":"2023-11-27T20:45:23.355021+0000","last_fullsized":"2023-11-27T20:45:23.355021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:41.024339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338458+0000","last_change":"2023-11-27T20:45:06.283036+0000","last_active":"2023-11-27T20:45:22.338458+0000","last_peered":"2023-11-27T20:45:22.338458+0000","last_clean":"2023-11-27T20:45:22.338458+0000","last_became_active":"2023-11-27T20:45:06.281987+0000","last_became_peered":"2023-11-27T20:45:06.281987+0000","last_unstale":"2023-11-27T20:45:22.338458+0000","last_undegraded":"2023-11-27T20:45:22.338458+0000","last_fullsized":"2023-11-27T20:45:22.338458+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:13.008822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"74'3","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331894+0000","last_change":"2023-11-27T20:45:05.634876+0000","last_active":"2023-11-27T20:45:21.331894+0000","last_peered":"2023-11-27T20:45:21.331894+0000","last_clean":"2023-11-27T20:45:21.331894+0000","last_became_active":"2023-11-27T20:45:05.634310+0000","last_became_peered":"2023-11-27T20:45:05.634310+0000","last_unstale":"2023-11-27T20:45:21.331894+0000","last_undegraded":"2023-11-27T20:45:21.331894+0000","last_fullsized":"2023-11-27T20:45:21.331894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:44:30.721707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.359195+0000","last_change":"2023-11-27T20:45:22.350667+0000","last_active":"2023-11-27T20:45:23.359195+0000","last_peered":"2023-11-27T20:45:23.359195+0000","last_clean":"2023-11-27T20:45:23.359195+0000","last_became_active":"2023-11-27T20:45:22.350401+0000","last_became_peered":"2023-11-27T20:45:22.350401+0000","last_unstale":"2023-11-27T20:45:23.359195+0000","last_undegraded":"2023-11-27T20:45:23.359195+0000","last_fullsized":"2023-11-27T20:45:23.359195+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:30:12.613989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.341921+0000","last_change":"2023-11-27T20:45:21.338433+0000","last_active":"2023-11-27T20:45:22.341921+0000","last_peered":"2023-11-27T20:45:22.341921+0000","last_clean":"2023-11-27T20:45:22.341921+0000","last_became_active":"2023-11-27T20:45:21.338122+0000","last_became_peered":"2023-11-27T20:45:21.338122+0000","last_unstale":"2023-11-27T20:45:22.341921+0000","last_undegraded":"2023-11-27T20:45:22.341921+0000","last_fullsized":"2023-11-27T20:45:22.341921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:17:39.954725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.330219+0000","last_change":"2023-11-27T20:45:06.282223+0000","last_active":"2023-11-27T20:45:22.330219+0000","last_peered":"2023-11-27T20:45:22.330219+0000","last_clean":"2023-11-27T20:45:22.330219+0000","last_became_active":"2023-11-27T20:45:06.281055+0000","last_became_peered":"2023-11-27T20:45:06.281055+0000","last_unstale":"2023-11-27T20:45:22.330219+0000","last_undegraded":"2023-11-27T20:45:22.330219+0000","last_fullsized":"2023-11-27T20:45:22.330219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:00.849008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"75'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333330+0000","last_change":"2023-11-27T20:45:05.636622+0000","last_active":"2023-11-27T20:45:21.333330+0000","last_peered":"2023-11-27T20:45:21.333330+0000","last_clean":"2023-11-27T20:45:21.333330+0000","last_became_active":"2023-11-27T20:45:05.633202+0000","last_became_peered":"2023-11-27T20:45:05.633202+0000","last_unstale":"2023-11-27T20:45:21.333330+0000","last_undegraded":"2023-11-27T20:45:21.333330+0000","last_fullsized":"2023-11-27T20:45:21.333330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:02.361558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356657+0000","last_change":"2023-11-27T20:45:22.340246+0000","last_active":"2023-11-27T20:45:23.356657+0000","last_peered":"2023-11-27T20:45:23.356657+0000","last_clean":"2023-11-27T20:45:23.356657+0000","last_became_active":"2023-11-27T20:45:22.339915+0000","last_became_peered":"2023-11-27T20:45:22.339915+0000","last_unstale":"2023-11-27T20:45:23.356657+0000","last_undegraded":"2023-11-27T20:45:23.356657+0000","last_fullsized":"2023-11-27T20:45:23.356657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:47.794087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356657+0000","last_change":"2023-11-27T20:45:21.337690+0000","last_active":"2023-11-27T20:45:23.356657+0000","last_peered":"2023-11-27T20:45:23.356657+0000","last_clean":"2023-11-27T20:45:23.356657+0000","last_became_active":"2023-11-27T20:45:21.336774+0000","last_became_peered":"2023-11-27T20:45:21.336774+0000","last_unstale":"2023-11-27T20:45:23.356657+0000","last_undegraded":"2023-11-27T20:45:23.356657+0000","last_fullsized":"2023-11-27T20:45:23.356657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:36:21.078898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337972+0000","last_change":"2023-11-27T20:45:06.276770+0000","last_active":"2023-11-27T20:45:22.337972+0000","last_peered":"2023-11-27T20:45:22.337972+0000","last_clean":"2023-11-27T20:45:22.337972+0000","last_became_active":"2023-11-27T20:45:06.276404+0000","last_became_peered":"2023-11-27T20:45:06.276404+0000","last_unstale":"2023-11-27T20:45:22.337972+0000","last_undegraded":"2023-11-27T20:45:22.337972+0000","last_fullsized":"2023-11-27T20:45:22.337972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:26.013200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"74'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.319645+0000","last_change":"2023-11-27T20:45:05.634047+0000","last_active":"2023-11-27T20:45:22.319645+0000","last_peered":"2023-11-27T20:45:22.319645+0000","last_clean":"2023-11-27T20:45:22.319645+0000","last_became_active":"2023-11-27T20:45:05.633852+0000","last_became_peered":"2023-11-27T20:45:05.633852+0000","last_unstale":"2023-11-27T20:45:22.319645+0000","last_undegraded":"2023-11-27T20:45:22.319645+0000","last_fullsized":"2023-11-27T20:45:22.319645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:10:34.426540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451099+0000","last_change":"2023-11-27T20:45:22.352257+0000","last_active":"2023-11-27T20:45:23.451099+0000","last_peered":"2023-11-27T20:45:23.451099+0000","last_clean":"2023-11-27T20:45:23.451099+0000","last_became_active":"2023-11-27T20:45:22.351966+0000","last_became_peered":"2023-11-27T20:45:22.351966+0000","last_unstale":"2023-11-27T20:45:23.451099+0000","last_undegraded":"2023-11-27T20:45:23.451099+0000","last_fullsized":"2023-11-27T20:45:23.451099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:01:25.739456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"80'8","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353226+0000","last_change":"2023-11-27T20:45:21.337936+0000","last_active":"2023-11-27T20:45:23.353226+0000","last_peered":"2023-11-27T20:45:23.353226+0000","last_clean":"2023-11-27T20:45:23.353226+0000","last_became_active":"2023-11-27T20:45:21.337619+0000","last_became_peered":"2023-11-27T20:45:21.337619+0000","last_unstale":"2023-11-27T20:45:23.353226+0000","last_undegraded":"2023-11-27T20:45:23.353226+0000","last_fullsized":"2023-11-27T20:45:23.353226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:18.044804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.337160+0000","last_change":"2023-11-27T20:45:06.277808+0000","last_active":"2023-11-27T20:45:21.337160+0000","last_peered":"2023-11-27T20:45:21.337160+0000","last_clean":"2023-11-27T20:45:21.337160+0000","last_became_active":"2023-11-27T20:45:06.277521+0000","last_became_peered":"2023-11-27T20:45:06.277521+0000","last_unstale":"2023-11-27T20:45:21.337160+0000","last_undegraded":"2023-11-27T20:45:21.337160+0000","last_fullsized":"2023-11-27T20:45:21.337160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:16:23.654821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332610+0000","last_change":"2023-11-27T20:45:05.632402+0000","last_active":"2023-11-27T20:45:21.332610+0000","last_peered":"2023-11-27T20:45:21.332610+0000","last_clean":"2023-11-27T20:45:21.332610+0000","last_became_active":"2023-11-27T20:45:05.632030+0000","last_became_peered":"2023-11-27T20:45:05.632030+0000","last_unstale":"2023-11-27T20:45:21.332610+0000","last_undegraded":"2023-11-27T20:45:21.332610+0000","last_fullsized":"2023-11-27T20:45:21.332610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:01.270371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.364157+0000","last_change":"2023-11-27T20:45:22.355892+0000","last_active":"2023-11-27T20:45:22.364157+0000","last_peered":"2023-11-27T20:45:22.364157+0000","last_clean":"2023-11-27T20:45:22.364157+0000","last_became_active":"2023-11-27T20:45:22.354975+0000","last_became_peered":"2023-11-27T20:45:22.354975+0000","last_unstale":"2023-11-27T20:45:22.364157+0000","last_undegraded":"2023-11-27T20:45:22.364157+0000","last_fullsized":"2023-11-27T20:45:22.364157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:37:50.104291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451643+0000","last_change":"2023-11-27T20:45:21.340395+0000","last_active":"2023-11-27T20:45:23.451643+0000","last_peered":"2023-11-27T20:45:23.451643+0000","last_clean":"2023-11-27T20:45:23.451643+0000","last_became_active":"2023-11-27T20:45:21.340110+0000","last_became_peered":"2023-11-27T20:45:21.340110+0000","last_unstale":"2023-11-27T20:45:23.451643+0000","last_undegraded":"2023-11-27T20:45:23.451643+0000","last_fullsized":"2023-11-27T20:45:23.451643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:40:41.655588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.317173+0000","last_change":"2023-11-27T20:45:06.272412+0000","last_active":"2023-11-27T20:45:22.317173+0000","last_peered":"2023-11-27T20:45:22.317173+0000","last_clean":"2023-11-27T20:45:22.317173+0000","last_became_active":"2023-11-27T20:45:06.272103+0000","last_became_peered":"2023-11-27T20:45:06.272103+0000","last_unstale":"2023-11-27T20:45:22.317173+0000","last_undegraded":"2023-11-27T20:45:22.317173+0000","last_fullsized":"2023-11-27T20:45:22.317173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:19:38.651622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330379+0000","last_change":"2023-11-27T20:45:05.644812+0000","last_active":"2023-11-27T20:45:21.330379+0000","last_peered":"2023-11-27T20:45:21.330379+0000","last_clean":"2023-11-27T20:45:21.330379+0000","last_became_active":"2023-11-27T20:45:05.644097+0000","last_became_peered":"2023-11-27T20:45:05.644097+0000","last_unstale":"2023-11-27T20:45:21.330379+0000","last_undegraded":"2023-11-27T20:45:21.330379+0000","last_fullsized":"2023-11-27T20:45:21.330379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:58.144583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353927+0000","last_change":"2023-11-27T20:45:22.356086+0000","last_active":"2023-11-27T20:45:23.353927+0000","last_peered":"2023-11-27T20:45:23.353927+0000","last_clean":"2023-11-27T20:45:23.353927+0000","last_became_active":"2023-11-27T20:45:22.349758+0000","last_became_peered":"2023-11-27T20:45:22.349758+0000","last_unstale":"2023-11-27T20:45:23.353927+0000","last_undegraded":"2023-11-27T20:45:23.353927+0000","last_fullsized":"2023-11-27T20:45:23.353927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:30.156994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451129+0000","last_change":"2023-11-27T20:45:21.335516+0000","last_active":"2023-11-27T20:45:23.451129+0000","last_peered":"2023-11-27T20:45:23.451129+0000","last_clean":"2023-11-27T20:45:23.451129+0000","last_became_active":"2023-11-27T20:45:21.335179+0000","last_became_peered":"2023-11-27T20:45:21.335179+0000","last_unstale":"2023-11-27T20:45:23.451129+0000","last_undegraded":"2023-11-27T20:45:23.451129+0000","last_fullsized":"2023-11-27T20:45:23.451129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:28.018483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.315860+0000","last_change":"2023-11-27T20:45:06.263986+0000","last_active":"2023-11-27T20:45:22.315860+0000","last_peered":"2023-11-27T20:45:22.315860+0000","last_clean":"2023-11-27T20:45:22.315860+0000","last_became_active":"2023-11-27T20:45:06.263465+0000","last_became_peered":"2023-11-27T20:45:06.263465+0000","last_unstale":"2023-11-27T20:45:22.315860+0000","last_undegraded":"2023-11-27T20:45:22.315860+0000","last_fullsized":"2023-11-27T20:45:22.315860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:54:46.614170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"74'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.339194+0000","last_change":"2023-11-27T20:45:05.641159+0000","last_active":"2023-11-27T20:45:22.339194+0000","last_peered":"2023-11-27T20:45:22.339194+0000","last_clean":"2023-11-27T20:45:22.339194+0000","last_became_active":"2023-11-27T20:45:05.640821+0000","last_became_peered":"2023-11-27T20:45:05.640821+0000","last_unstale":"2023-11-27T20:45:22.339194+0000","last_undegraded":"2023-11-27T20:45:22.339194+0000","last_fullsized":"2023-11-27T20:45:22.339194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:06.355870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358965+0000","last_change":"2023-11-27T20:45:22.353477+0000","last_active":"2023-11-27T20:45:22.358965+0000","last_peered":"2023-11-27T20:45:22.358965+0000","last_clean":"2023-11-27T20:45:22.358965+0000","last_became_active":"2023-11-27T20:45:22.352485+0000","last_became_peered":"2023-11-27T20:45:22.352485+0000","last_unstale":"2023-11-27T20:45:22.358965+0000","last_undegraded":"2023-11-27T20:45:22.358965+0000","last_fullsized":"2023-11-27T20:45:22.358965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:22:39.077655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.371672+0000","last_change":"2023-11-27T20:45:21.343347+0000","last_active":"2023-11-27T20:45:22.371672+0000","last_peered":"2023-11-27T20:45:22.371672+0000","last_clean":"2023-11-27T20:45:22.371672+0000","last_became_active":"2023-11-27T20:45:21.342932+0000","last_became_peered":"2023-11-27T20:45:21.342932+0000","last_unstale":"2023-11-27T20:45:22.371672+0000","last_undegraded":"2023-11-27T20:45:22.371672+0000","last_fullsized":"2023-11-27T20:45:22.371672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:18:20.760478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.341152+0000","last_change":"2023-11-27T20:45:06.275736+0000","last_active":"2023-11-27T20:45:21.341152+0000","last_peered":"2023-11-27T20:45:21.341152+0000","last_clean":"2023-11-27T20:45:21.341152+0000","last_became_active":"2023-11-27T20:45:06.275432+0000","last_became_peered":"2023-11-27T20:45:06.275432+0000","last_unstale":"2023-11-27T20:45:21.341152+0000","last_undegraded":"2023-11-27T20:45:21.341152+0000","last_fullsized":"2023-11-27T20:45:21.341152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:40:12.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"74'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333364+0000","last_change":"2023-11-27T20:45:05.633605+0000","last_active":"2023-11-27T20:45:21.333364+0000","last_peered":"2023-11-27T20:45:21.333364+0000","last_clean":"2023-11-27T20:45:21.333364+0000","last_became_active":"2023-11-27T20:45:05.633283+0000","last_became_peered":"2023-11-27T20:45:05.633283+0000","last_unstale":"2023-11-27T20:45:21.333364+0000","last_undegraded":"2023-11-27T20:45:21.333364+0000","last_fullsized":"2023-11-27T20:45:21.333364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:05.586683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358868+0000","last_change":"2023-11-27T20:45:22.354702+0000","last_active":"2023-11-27T20:45:22.358868+0000","last_peered":"2023-11-27T20:45:22.358868+0000","last_clean":"2023-11-27T20:45:22.358868+0000","last_became_active":"2023-11-27T20:45:22.354354+0000","last_became_peered":"2023-11-27T20:45:22.354354+0000","last_unstale":"2023-11-27T20:45:22.358868+0000","last_undegraded":"2023-11-27T20:45:22.358868+0000","last_fullsized":"2023-11-27T20:45:22.358868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:30:12.613989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357348+0000","last_change":"2023-11-27T20:45:21.339620+0000","last_active":"2023-11-27T20:45:23.357348+0000","last_peered":"2023-11-27T20:45:23.357348+0000","last_clean":"2023-11-27T20:45:23.357348+0000","last_became_active":"2023-11-27T20:45:21.339296+0000","last_became_peered":"2023-11-27T20:45:21.339296+0000","last_unstale":"2023-11-27T20:45:23.357348+0000","last_undegraded":"2023-11-27T20:45:23.357348+0000","last_fullsized":"2023-11-27T20:45:23.357348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:03.598760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.333011+0000","last_change":"2023-11-27T20:45:06.279727+0000","last_active":"2023-11-27T20:45:21.333011+0000","last_peered":"2023-11-27T20:45:21.333011+0000","last_clean":"2023-11-27T20:45:21.333011+0000","last_became_active":"2023-11-27T20:45:06.270223+0000","last_became_peered":"2023-11-27T20:45:06.270223+0000","last_unstale":"2023-11-27T20:45:21.333011+0000","last_undegraded":"2023-11-27T20:45:21.333011+0000","last_fullsized":"2023-11-27T20:45:21.333011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:59:57.174632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"74'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.336997+0000","last_change":"2023-11-27T20:45:05.642228+0000","last_active":"2023-11-27T20:45:22.336997+0000","last_peered":"2023-11-27T20:45:22.336997+0000","last_clean":"2023-11-27T20:45:22.336997+0000","last_became_active":"2023-11-27T20:45:05.641885+0000","last_became_peered":"2023-11-27T20:45:05.641885+0000","last_unstale":"2023-11-27T20:45:22.336997+0000","last_undegraded":"2023-11-27T20:45:22.336997+0000","last_fullsized":"2023-11-27T20:45:22.336997+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:38:56.752121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.358501+0000","last_change":"2023-11-27T20:45:22.353735+0000","last_active":"2023-11-27T20:45:22.358501+0000","last_peered":"2023-11-27T20:45:22.358501+0000","last_clean":"2023-11-27T20:45:22.358501+0000","last_became_active":"2023-11-27T20:45:22.353343+0000","last_became_peered":"2023-11-27T20:45:22.353343+0000","last_unstale":"2023-11-27T20:45:22.358501+0000","last_undegraded":"2023-11-27T20:45:22.358501+0000","last_fullsized":"2023-11-27T20:45:22.358501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:31:31.417613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.358691+0000","last_change":"2023-11-27T20:45:21.345276+0000","last_active":"2023-11-27T20:45:23.358691+0000","last_peered":"2023-11-27T20:45:23.358691+0000","last_clean":"2023-11-27T20:45:23.358691+0000","last_became_active":"2023-11-27T20:45:21.344800+0000","last_became_peered":"2023-11-27T20:45:21.344800+0000","last_unstale":"2023-11-27T20:45:23.358691+0000","last_undegraded":"2023-11-27T20:45:23.358691+0000","last_fullsized":"2023-11-27T20:45:23.358691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:25.955036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.331699+0000","last_change":"2023-11-27T20:45:06.274675+0000","last_active":"2023-11-27T20:45:22.331699+0000","last_peered":"2023-11-27T20:45:22.331699+0000","last_clean":"2023-11-27T20:45:22.331699+0000","last_became_active":"2023-11-27T20:45:06.271749+0000","last_became_peered":"2023-11-27T20:45:06.271749+0000","last_unstale":"2023-11-27T20:45:22.331699+0000","last_undegraded":"2023-11-27T20:45:22.331699+0000","last_fullsized":"2023-11-27T20:45:22.331699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:07.361631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338635+0000","last_change":"2023-11-27T20:45:05.642419+0000","last_active":"2023-11-27T20:45:22.338635+0000","last_peered":"2023-11-27T20:45:22.338635+0000","last_clean":"2023-11-27T20:45:22.338635+0000","last_became_active":"2023-11-27T20:45:05.642092+0000","last_became_peered":"2023-11-27T20:45:05.642092+0000","last_unstale":"2023-11-27T20:45:22.338635+0000","last_undegraded":"2023-11-27T20:45:22.338635+0000","last_fullsized":"2023-11-27T20:45:22.338635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:28:54.248320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.450689+0000","last_change":"2023-11-27T20:45:22.355066+0000","last_active":"2023-11-27T20:45:23.450689+0000","last_peered":"2023-11-27T20:45:23.450689+0000","last_clean":"2023-11-27T20:45:23.450689+0000","last_became_active":"2023-11-27T20:45:22.354672+0000","last_became_peered":"2023-11-27T20:45:22.354672+0000","last_unstale":"2023-11-27T20:45:23.450689+0000","last_undegraded":"2023-11-27T20:45:23.450689+0000","last_fullsized":"2023-11-27T20:45:23.450689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:09:22.282865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.341376+0000","last_change":"2023-11-27T20:45:21.337529+0000","last_active":"2023-11-27T20:45:22.341376+0000","last_peered":"2023-11-27T20:45:22.341376+0000","last_clean":"2023-11-27T20:45:22.341376+0000","last_became_active":"2023-11-27T20:45:21.337122+0000","last_became_peered":"2023-11-27T20:45:21.337122+0000","last_unstale":"2023-11-27T20:45:22.341376+0000","last_undegraded":"2023-11-27T20:45:22.341376+0000","last_fullsized":"2023-11-27T20:45:22.341376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:27.686308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337926+0000","last_change":"2023-11-27T20:45:19.356541+0000","last_active":"2023-11-27T20:45:22.337926+0000","last_peered":"2023-11-27T20:45:22.337926+0000","last_clean":"2023-11-27T20:45:22.337926+0000","last_became_active":"2023-11-27T20:45:19.356100+0000","last_became_peered":"2023-11-27T20:45:19.356100+0000","last_unstale":"2023-11-27T20:45:22.337926+0000","last_undegraded":"2023-11-27T20:45:22.337926+0000","last_fullsized":"2023-11-27T20:45:22.337926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:30:07.660175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"74'2","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331262+0000","last_change":"2023-11-27T20:45:05.628335+0000","last_active":"2023-11-27T20:45:21.331262+0000","last_peered":"2023-11-27T20:45:21.331262+0000","last_clean":"2023-11-27T20:45:21.331262+0000","last_became_active":"2023-11-27T20:45:05.627980+0000","last_became_peered":"2023-11-27T20:45:05.627980+0000","last_unstale":"2023-11-27T20:45:21.331262+0000","last_undegraded":"2023-11-27T20:45:21.331262+0000","last_fullsized":"2023-11-27T20:45:21.331262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:19.744666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.341223+0000","last_change":"2023-11-27T20:45:22.333992+0000","last_active":"2023-11-27T20:45:22.341223+0000","last_peered":"2023-11-27T20:45:22.341223+0000","last_clean":"2023-11-27T20:45:22.341223+0000","last_became_active":"2023-11-27T20:45:22.333557+0000","last_became_peered":"2023-11-27T20:45:22.333557+0000","last_unstale":"2023-11-27T20:45:22.341223+0000","last_undegraded":"2023-11-27T20:45:22.341223+0000","last_fullsized":"2023-11-27T20:45:22.341223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:00:29.866265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356358+0000","last_change":"2023-11-27T20:45:21.333924+0000","last_active":"2023-11-27T20:45:23.356358+0000","last_peered":"2023-11-27T20:45:23.356358+0000","last_clean":"2023-11-27T20:45:23.356358+0000","last_became_active":"2023-11-27T20:45:21.333652+0000","last_became_peered":"2023-11-27T20:45:21.333652+0000","last_unstale":"2023-11-27T20:45:23.356358+0000","last_undegraded":"2023-11-27T20:45:23.356358+0000","last_fullsized":"2023-11-27T20:45:23.356358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:45:03.176272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331285+0000","last_change":"2023-11-27T20:45:06.265399+0000","last_active":"2023-11-27T20:45:21.331285+0000","last_peered":"2023-11-27T20:45:21.331285+0000","last_clean":"2023-11-27T20:45:21.331285+0000","last_became_active":"2023-11-27T20:45:06.265015+0000","last_became_peered":"2023-11-27T20:45:06.265015+0000","last_unstale":"2023-11-27T20:45:21.331285+0000","last_undegraded":"2023-11-27T20:45:21.331285+0000","last_fullsized":"2023-11-27T20:45:21.331285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:01:39.578698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338034+0000","last_change":"2023-11-27T20:45:05.639115+0000","last_active":"2023-11-27T20:45:22.338034+0000","last_peered":"2023-11-27T20:45:22.338034+0000","last_clean":"2023-11-27T20:45:22.338034+0000","last_became_active":"2023-11-27T20:45:05.638219+0000","last_became_peered":"2023-11-27T20:45:05.638219+0000","last_unstale":"2023-11-27T20:45:22.338034+0000","last_undegraded":"2023-11-27T20:45:22.338034+0000","last_fullsized":"2023-11-27T20:45:22.338034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:38.005329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451112+0000","last_change":"2023-11-27T20:45:22.358166+0000","last_active":"2023-11-27T20:45:23.451112+0000","last_peered":"2023-11-27T20:45:23.451112+0000","last_clean":"2023-11-27T20:45:23.451112+0000","last_became_active":"2023-11-27T20:45:22.357901+0000","last_became_peered":"2023-11-27T20:45:22.357901+0000","last_unstale":"2023-11-27T20:45:23.451112+0000","last_undegraded":"2023-11-27T20:45:23.451112+0000","last_fullsized":"2023-11-27T20:45:23.451112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:51.664151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357223+0000","last_change":"2023-11-27T20:45:21.345762+0000","last_active":"2023-11-27T20:45:23.357223+0000","last_peered":"2023-11-27T20:45:23.357223+0000","last_clean":"2023-11-27T20:45:23.357223+0000","last_became_active":"2023-11-27T20:45:21.345068+0000","last_became_peered":"2023-11-27T20:45:21.345068+0000","last_unstale":"2023-11-27T20:45:23.357223+0000","last_undegraded":"2023-11-27T20:45:23.357223+0000","last_fullsized":"2023-11-27T20:45:23.357223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:38:55.334782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.340725+0000","last_change":"2023-11-27T20:45:06.270416+0000","last_active":"2023-11-27T20:45:22.340725+0000","last_peered":"2023-11-27T20:45:22.340725+0000","last_clean":"2023-11-27T20:45:22.340725+0000","last_became_active":"2023-11-27T20:45:06.270028+0000","last_became_peered":"2023-11-27T20:45:06.270028+0000","last_unstale":"2023-11-27T20:45:22.340725+0000","last_undegraded":"2023-11-27T20:45:22.340725+0000","last_fullsized":"2023-11-27T20:45:22.340725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:28:03.641350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.331945+0000","last_change":"2023-11-27T20:45:05.637206+0000","last_active":"2023-11-27T20:45:22.331945+0000","last_peered":"2023-11-27T20:45:22.331945+0000","last_clean":"2023-11-27T20:45:22.331945+0000","last_became_active":"2023-11-27T20:45:05.636487+0000","last_became_peered":"2023-11-27T20:45:05.636487+0000","last_unstale":"2023-11-27T20:45:22.331945+0000","last_undegraded":"2023-11-27T20:45:22.331945+0000","last_fullsized":"2023-11-27T20:45:22.331945+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:41:47.083443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451830+0000","last_change":"2023-11-27T20:45:22.353719+0000","last_active":"2023-11-27T20:45:23.451830+0000","last_peered":"2023-11-27T20:45:23.451830+0000","last_clean":"2023-11-27T20:45:23.451830+0000","last_became_active":"2023-11-27T20:45:22.353412+0000","last_became_peered":"2023-11-27T20:45:22.353412+0000","last_unstale":"2023-11-27T20:45:23.451830+0000","last_undegraded":"2023-11-27T20:45:23.451830+0000","last_fullsized":"2023-11-27T20:45:23.451830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:27.341287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.342758+0000","last_change":"2023-11-27T20:45:21.335464+0000","last_active":"2023-11-27T20:45:22.342758+0000","last_peered":"2023-11-27T20:45:22.342758+0000","last_clean":"2023-11-27T20:45:22.342758+0000","last_became_active":"2023-11-27T20:45:21.333731+0000","last_became_peered":"2023-11-27T20:45:21.333731+0000","last_unstale":"2023-11-27T20:45:22.342758+0000","last_undegraded":"2023-11-27T20:45:22.342758+0000","last_fullsized":"2023-11-27T20:45:22.342758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:40.690686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330646+0000","last_change":"2023-11-27T20:45:06.279113+0000","last_active":"2023-11-27T20:45:21.330646+0000","last_peered":"2023-11-27T20:45:21.330646+0000","last_clean":"2023-11-27T20:45:21.330646+0000","last_became_active":"2023-11-27T20:45:06.278833+0000","last_became_peered":"2023-11-27T20:45:06.278833+0000","last_unstale":"2023-11-27T20:45:21.330646+0000","last_undegraded":"2023-11-27T20:45:21.330646+0000","last_fullsized":"2023-11-27T20:45:21.330646+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:24.286070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.321548+0000","last_change":"2023-11-27T20:45:05.635630+0000","last_active":"2023-11-27T20:45:21.321548+0000","last_peered":"2023-11-27T20:45:21.321548+0000","last_clean":"2023-11-27T20:45:21.321548+0000","last_became_active":"2023-11-27T20:45:05.635217+0000","last_became_peered":"2023-11-27T20:45:05.635217+0000","last_unstale":"2023-11-27T20:45:21.321548+0000","last_undegraded":"2023-11-27T20:45:21.321548+0000","last_fullsized":"2023-11-27T20:45:21.321548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:07:25.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.353717+0000","last_change":"2023-11-27T20:45:22.359242+0000","last_active":"2023-11-27T20:45:23.353717+0000","last_peered":"2023-11-27T20:45:23.353717+0000","last_clean":"2023-11-27T20:45:23.353717+0000","last_became_active":"2023-11-27T20:45:22.358803+0000","last_became_peered":"2023-11-27T20:45:22.358803+0000","last_unstale":"2023-11-27T20:45:23.353717+0000","last_undegraded":"2023-11-27T20:45:23.353717+0000","last_fullsized":"2023-11-27T20:45:23.353717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:16.539429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357485+0000","last_change":"2023-11-27T20:45:21.340458+0000","last_active":"2023-11-27T20:45:23.357485+0000","last_peered":"2023-11-27T20:45:23.357485+0000","last_clean":"2023-11-27T20:45:23.357485+0000","last_became_active":"2023-11-27T20:45:21.340182+0000","last_became_peered":"2023-11-27T20:45:21.340182+0000","last_unstale":"2023-11-27T20:45:23.357485+0000","last_undegraded":"2023-11-27T20:45:23.357485+0000","last_fullsized":"2023-11-27T20:45:23.357485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:38:47.397254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.326302+0000","last_change":"2023-11-27T20:45:06.263237+0000","last_active":"2023-11-27T20:45:22.326302+0000","last_peered":"2023-11-27T20:45:22.326302+0000","last_clean":"2023-11-27T20:45:22.326302+0000","last_became_active":"2023-11-27T20:45:06.262918+0000","last_became_peered":"2023-11-27T20:45:06.262918+0000","last_unstale":"2023-11-27T20:45:22.326302+0000","last_undegraded":"2023-11-27T20:45:22.326302+0000","last_fullsized":"2023-11-27T20:45:22.326302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:21:14.466572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"74'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.321355+0000","last_change":"2023-11-27T20:45:05.631892+0000","last_active":"2023-11-27T20:45:22.321355+0000","last_peered":"2023-11-27T20:45:22.321355+0000","last_clean":"2023-11-27T20:45:22.321355+0000","last_became_active":"2023-11-27T20:45:05.631305+0000","last_became_peered":"2023-11-27T20:45:05.631305+0000","last_unstale":"2023-11-27T20:45:22.321355+0000","last_undegraded":"2023-11-27T20:45:22.321355+0000","last_fullsized":"2023-11-27T20:45:22.321355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:30:06.654414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.347107+0000","last_change":"2023-11-27T20:45:22.343979+0000","last_active":"2023-11-27T20:45:22.347107+0000","last_peered":"2023-11-27T20:45:22.347107+0000","last_clean":"2023-11-27T20:45:22.347107+0000","last_became_active":"2023-11-27T20:45:22.343651+0000","last_became_peered":"2023-11-27T20:45:22.343651+0000","last_unstale":"2023-11-27T20:45:22.347107+0000","last_undegraded":"2023-11-27T20:45:22.347107+0000","last_fullsized":"2023-11-27T20:45:22.347107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:27:50.234056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.332794+0000","last_change":"2023-11-27T20:45:21.340280+0000","last_active":"2023-11-27T20:45:22.332794+0000","last_peered":"2023-11-27T20:45:22.332794+0000","last_clean":"2023-11-27T20:45:22.332794+0000","last_became_active":"2023-11-27T20:45:21.339948+0000","last_became_peered":"2023-11-27T20:45:21.339948+0000","last_unstale":"2023-11-27T20:45:22.332794+0000","last_undegraded":"2023-11-27T20:45:22.332794+0000","last_fullsized":"2023-11-27T20:45:22.332794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:39:55.272595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.341814+0000","last_change":"2023-11-27T20:45:06.282615+0000","last_active":"2023-11-27T20:45:21.341814+0000","last_peered":"2023-11-27T20:45:21.341814+0000","last_clean":"2023-11-27T20:45:21.341814+0000","last_became_active":"2023-11-27T20:45:06.282331+0000","last_became_peered":"2023-11-27T20:45:06.282331+0000","last_unstale":"2023-11-27T20:45:21.341814+0000","last_undegraded":"2023-11-27T20:45:21.341814+0000","last_fullsized":"2023-11-27T20:45:21.341814+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:00:14.175844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"75'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.320899+0000","last_change":"2023-11-27T20:45:05.631778+0000","last_active":"2023-11-27T20:45:22.320899+0000","last_peered":"2023-11-27T20:45:22.320899+0000","last_clean":"2023-11-27T20:45:22.320899+0000","last_became_active":"2023-11-27T20:45:05.631172+0000","last_became_peered":"2023-11-27T20:45:05.631172+0000","last_unstale":"2023-11-27T20:45:22.320899+0000","last_undegraded":"2023-11-27T20:45:22.320899+0000","last_fullsized":"2023-11-27T20:45:22.320899+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:18.830687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357719+0000","last_change":"2023-11-27T20:45:22.350700+0000","last_active":"2023-11-27T20:45:23.357719+0000","last_peered":"2023-11-27T20:45:23.357719+0000","last_clean":"2023-11-27T20:45:23.357719+0000","last_became_active":"2023-11-27T20:45:22.350423+0000","last_became_peered":"2023-11-27T20:45:22.350423+0000","last_unstale":"2023-11-27T20:45:23.357719+0000","last_undegraded":"2023-11-27T20:45:23.357719+0000","last_fullsized":"2023-11-27T20:45:23.357719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:55:21.666307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.370763+0000","last_change":"2023-11-27T20:45:21.340876+0000","last_active":"2023-11-27T20:45:22.370763+0000","last_peered":"2023-11-27T20:45:22.370763+0000","last_clean":"2023-11-27T20:45:22.370763+0000","last_became_active":"2023-11-27T20:45:21.340532+0000","last_became_peered":"2023-11-27T20:45:21.340532+0000","last_unstale":"2023-11-27T20:45:22.370763+0000","last_undegraded":"2023-11-27T20:45:22.370763+0000","last_fullsized":"2023-11-27T20:45:22.370763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:16.953618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331628+0000","last_change":"2023-11-27T20:45:06.274427+0000","last_active":"2023-11-27T20:45:21.331628+0000","last_peered":"2023-11-27T20:45:21.331628+0000","last_clean":"2023-11-27T20:45:21.331628+0000","last_became_active":"2023-11-27T20:45:06.274140+0000","last_became_peered":"2023-11-27T20:45:06.274140+0000","last_unstale":"2023-11-27T20:45:21.331628+0000","last_undegraded":"2023-11-27T20:45:21.331628+0000","last_fullsized":"2023-11-27T20:45:21.331628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:46:07.361631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332150+0000","last_change":"2023-11-27T20:45:05.637612+0000","last_active":"2023-11-27T20:45:21.332150+0000","last_peered":"2023-11-27T20:45:21.332150+0000","last_clean":"2023-11-27T20:45:21.332150+0000","last_became_active":"2023-11-27T20:45:05.637230+0000","last_became_peered":"2023-11-27T20:45:05.637230+0000","last_unstale":"2023-11-27T20:45:21.332150+0000","last_undegraded":"2023-11-27T20:45:21.332150+0000","last_fullsized":"2023-11-27T20:45:21.332150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:52:59.384018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.354646+0000","last_change":"2023-11-27T20:45:22.358818+0000","last_active":"2023-11-27T20:45:23.354646+0000","last_peered":"2023-11-27T20:45:23.354646+0000","last_clean":"2023-11-27T20:45:23.354646+0000","last_became_active":"2023-11-27T20:45:22.358533+0000","last_became_peered":"2023-11-27T20:45:22.358533+0000","last_unstale":"2023-11-27T20:45:23.354646+0000","last_undegraded":"2023-11-27T20:45:23.354646+0000","last_fullsized":"2023-11-27T20:45:23.354646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:29:10.944501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357798+0000","last_change":"2023-11-27T20:45:21.346215+0000","last_active":"2023-11-27T20:45:23.357798+0000","last_peered":"2023-11-27T20:45:23.357798+0000","last_clean":"2023-11-27T20:45:23.357798+0000","last_became_active":"2023-11-27T20:45:21.345835+0000","last_became_peered":"2023-11-27T20:45:21.345835+0000","last_unstale":"2023-11-27T20:45:23.357798+0000","last_undegraded":"2023-11-27T20:45:23.357798+0000","last_fullsized":"2023-11-27T20:45:23.357798+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:41.038318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.331920+0000","last_change":"2023-11-27T20:45:06.279317+0000","last_active":"2023-11-27T20:45:22.331920+0000","last_peered":"2023-11-27T20:45:22.331920+0000","last_clean":"2023-11-27T20:45:22.331920+0000","last_became_active":"2023-11-27T20:45:06.279052+0000","last_became_peered":"2023-11-27T20:45:06.279052+0000","last_unstale":"2023-11-27T20:45:22.331920+0000","last_undegraded":"2023-11-27T20:45:22.331920+0000","last_fullsized":"2023-11-27T20:45:22.331920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:01.046541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.331726+0000","last_change":"2023-11-27T20:45:05.634977+0000","last_active":"2023-11-27T20:45:21.331726+0000","last_peered":"2023-11-27T20:45:21.331726+0000","last_clean":"2023-11-27T20:45:21.331726+0000","last_became_active":"2023-11-27T20:45:05.631916+0000","last_became_peered":"2023-11-27T20:45:05.631916+0000","last_unstale":"2023-11-27T20:45:21.331726+0000","last_undegraded":"2023-11-27T20:45:21.331726+0000","last_fullsized":"2023-11-27T20:45:21.331726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:46:27.977492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.450781+0000","last_change":"2023-11-27T20:45:22.358303+0000","last_active":"2023-11-27T20:45:23.450781+0000","last_peered":"2023-11-27T20:45:23.450781+0000","last_clean":"2023-11-27T20:45:23.450781+0000","last_became_active":"2023-11-27T20:45:22.355270+0000","last_became_peered":"2023-11-27T20:45:22.355270+0000","last_unstale":"2023-11-27T20:45:23.450781+0000","last_undegraded":"2023-11-27T20:45:23.450781+0000","last_fullsized":"2023-11-27T20:45:23.450781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:14.122157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.339474+0000","last_change":"2023-11-27T20:45:21.334962+0000","last_active":"2023-11-27T20:45:22.339474+0000","last_peered":"2023-11-27T20:45:22.339474+0000","last_clean":"2023-11-27T20:45:22.339474+0000","last_became_active":"2023-11-27T20:45:21.334626+0000","last_became_peered":"2023-11-27T20:45:21.334626+0000","last_unstale":"2023-11-27T20:45:22.339474+0000","last_undegraded":"2023-11-27T20:45:22.339474+0000","last_fullsized":"2023-11-27T20:45:22.339474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:30:11.601054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.332232+0000","last_change":"2023-11-27T20:45:06.266010+0000","last_active":"2023-11-27T20:45:21.332232+0000","last_peered":"2023-11-27T20:45:21.332232+0000","last_clean":"2023-11-27T20:45:21.332232+0000","last_became_active":"2023-11-27T20:45:06.265669+0000","last_became_peered":"2023-11-27T20:45:06.265669+0000","last_unstale":"2023-11-27T20:45:21.332232+0000","last_undegraded":"2023-11-27T20:45:21.332232+0000","last_fullsized":"2023-11-27T20:45:21.332232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:11.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.337255+0000","last_change":"2023-11-27T20:45:05.637071+0000","last_active":"2023-11-27T20:45:22.337255+0000","last_peered":"2023-11-27T20:45:22.337255+0000","last_clean":"2023-11-27T20:45:22.337255+0000","last_became_active":"2023-11-27T20:45:05.636864+0000","last_became_peered":"2023-11-27T20:45:05.636864+0000","last_unstale":"2023-11-27T20:45:22.337255+0000","last_undegraded":"2023-11-27T20:45:22.337255+0000","last_fullsized":"2023-11-27T20:45:22.337255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:59:56.168871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.349075+0000","last_change":"2023-11-27T20:45:22.345388+0000","last_active":"2023-11-27T20:45:22.349075+0000","last_peered":"2023-11-27T20:45:22.349075+0000","last_clean":"2023-11-27T20:45:22.349075+0000","last_became_active":"2023-11-27T20:45:22.345120+0000","last_became_peered":"2023-11-27T20:45:22.345120+0000","last_unstale":"2023-11-27T20:45:22.349075+0000","last_undegraded":"2023-11-27T20:45:22.349075+0000","last_fullsized":"2023-11-27T20:45:22.349075+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:15:26.967971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.450745+0000","last_change":"2023-11-27T20:45:21.340498+0000","last_active":"2023-11-27T20:45:23.450745+0000","last_peered":"2023-11-27T20:45:23.450745+0000","last_clean":"2023-11-27T20:45:23.450745+0000","last_became_active":"2023-11-27T20:45:21.340170+0000","last_became_peered":"2023-11-27T20:45:21.340170+0000","last_unstale":"2023-11-27T20:45:23.450745+0000","last_undegraded":"2023-11-27T20:45:23.450745+0000","last_fullsized":"2023-11-27T20:45:23.450745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:53:15.067264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.338128+0000","last_change":"2023-11-27T20:45:06.270493+0000","last_active":"2023-11-27T20:45:22.338128+0000","last_peered":"2023-11-27T20:45:22.338128+0000","last_clean":"2023-11-27T20:45:22.338128+0000","last_became_active":"2023-11-27T20:45:06.270214+0000","last_became_peered":"2023-11-27T20:45:06.270214+0000","last_unstale":"2023-11-27T20:45:22.338128+0000","last_undegraded":"2023-11-27T20:45:22.338128+0000","last_fullsized":"2023-11-27T20:45:22.338128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:21:02.276132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.327108+0000","last_change":"2023-11-27T20:45:05.642971+0000","last_active":"2023-11-27T20:45:22.327108+0000","last_peered":"2023-11-27T20:45:22.327108+0000","last_clean":"2023-11-27T20:45:22.327108+0000","last_became_active":"2023-11-27T20:45:05.642000+0000","last_became_peered":"2023-11-27T20:45:05.642000+0000","last_unstale":"2023-11-27T20:45:22.327108+0000","last_undegraded":"2023-11-27T20:45:22.327108+0000","last_fullsized":"2023-11-27T20:45:22.327108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:35:57.425975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.451051+0000","last_change":"2023-11-27T20:45:22.353398+0000","last_active":"2023-11-27T20:45:23.451051+0000","last_peered":"2023-11-27T20:45:23.451051+0000","last_clean":"2023-11-27T20:45:23.451051+0000","last_became_active":"2023-11-27T20:45:22.353142+0000","last_became_peered":"2023-11-27T20:45:22.353142+0000","last_unstale":"2023-11-27T20:45:23.451051+0000","last_undegraded":"2023-11-27T20:45:23.451051+0000","last_fullsized":"2023-11-27T20:45:23.451051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:21:14.840765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.356900+0000","last_change":"2023-11-27T20:45:21.338091+0000","last_active":"2023-11-27T20:45:23.356900+0000","last_peered":"2023-11-27T20:45:23.356900+0000","last_clean":"2023-11-27T20:45:23.356900+0000","last_became_active":"2023-11-27T20:45:21.337820+0000","last_became_peered":"2023-11-27T20:45:21.337820+0000","last_unstale":"2023-11-27T20:45:23.356900+0000","last_undegraded":"2023-11-27T20:45:23.356900+0000","last_fullsized":"2023-11-27T20:45:23.356900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:01:29.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.336520+0000","last_change":"2023-11-27T20:45:06.274514+0000","last_active":"2023-11-27T20:45:21.336520+0000","last_peered":"2023-11-27T20:45:21.336520+0000","last_clean":"2023-11-27T20:45:21.336520+0000","last_became_active":"2023-11-27T20:45:06.273513+0000","last_became_peered":"2023-11-27T20:45:06.273513+0000","last_unstale":"2023-11-27T20:45:21.336520+0000","last_undegraded":"2023-11-27T20:45:21.336520+0000","last_fullsized":"2023-11-27T20:45:21.336520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:13.008822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330377+0000","last_change":"2023-11-27T20:45:05.630546+0000","last_active":"2023-11-27T20:45:21.330377+0000","last_peered":"2023-11-27T20:45:21.330377+0000","last_clean":"2023-11-27T20:45:21.330377+0000","last_became_active":"2023-11-27T20:45:05.629859+0000","last_became_peered":"2023-11-27T20:45:05.629859+0000","last_unstale":"2023-11-27T20:45:21.330377+0000","last_undegraded":"2023-11-27T20:45:21.330377+0000","last_fullsized":"2023-11-27T20:45:21.330377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:34.967969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.357389+0000","last_change":"2023-11-27T20:45:22.350853+0000","last_active":"2023-11-27T20:45:23.357389+0000","last_peered":"2023-11-27T20:45:23.357389+0000","last_clean":"2023-11-27T20:45:23.357389+0000","last_became_active":"2023-11-27T20:45:22.348848+0000","last_became_peered":"2023-11-27T20:45:22.348848+0000","last_unstale":"2023-11-27T20:45:23.357389+0000","last_undegraded":"2023-11-27T20:45:23.357389+0000","last_fullsized":"2023-11-27T20:45:23.357389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:39:56.285530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.330883+0000","last_change":"2023-11-27T20:45:21.341408+0000","last_active":"2023-11-27T20:45:22.330883+0000","last_peered":"2023-11-27T20:45:22.330883+0000","last_clean":"2023-11-27T20:45:22.330883+0000","last_became_active":"2023-11-27T20:45:21.340941+0000","last_became_peered":"2023-11-27T20:45:21.340941+0000","last_unstale":"2023-11-27T20:45:22.330883+0000","last_undegraded":"2023-11-27T20:45:22.330883+0000","last_fullsized":"2023-11-27T20:45:22.330883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:01:46.781152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.330271+0000","last_change":"2023-11-27T20:45:06.277953+0000","last_active":"2023-11-27T20:45:21.330271+0000","last_peered":"2023-11-27T20:45:21.330271+0000","last_clean":"2023-11-27T20:45:21.330271+0000","last_became_active":"2023-11-27T20:45:06.275250+0000","last_became_peered":"2023-11-27T20:45:06.275250+0000","last_unstale":"2023-11-27T20:45:21.330271+0000","last_undegraded":"2023-11-27T20:45:21.330271+0000","last_fullsized":"2023-11-27T20:45:21.330271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:26.346853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.325697+0000","last_change":"2023-11-27T20:45:05.640372+0000","last_active":"2023-11-27T20:45:22.325697+0000","last_peered":"2023-11-27T20:45:22.325697+0000","last_clean":"2023-11-27T20:45:22.325697+0000","last_became_active":"2023-11-27T20:45:05.640048+0000","last_became_peered":"2023-11-27T20:45:05.640048+0000","last_unstale":"2023-11-27T20:45:22.325697+0000","last_undegraded":"2023-11-27T20:45:22.325697+0000","last_fullsized":"2023-11-27T20:45:22.325697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:35:34.967969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-27T20:45:23.452961+0000","last_change":"2023-11-27T20:45:22.356960+0000","last_active":"2023-11-27T20:45:23.452961+0000","last_peered":"2023-11-27T20:45:23.452961+0000","last_clean":"2023-11-27T20:45:23.452961+0000","last_became_active":"2023-11-27T20:45:22.356702+0000","last_became_peered":"2023-11-27T20:45:22.356702+0000","last_unstale":"2023-11-27T20:45:23.452961+0000","last_undegraded":"2023-11-27T20:45:23.452961+0000","last_fullsized":"2023-11-27T20:45:23.452961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:21.289814+0000","last_clean_scrub_stamp":"2023-11-27T20:45:21.289814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:36:42.037274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.370425+0000","last_change":"2023-11-27T20:45:21.345073+0000","last_active":"2023-11-27T20:45:22.370425+0000","last_peered":"2023-11-27T20:45:22.370425+0000","last_clean":"2023-11-27T20:45:22.370425+0000","last_became_active":"2023-11-27T20:45:21.344674+0000","last_became_peered":"2023-11-27T20:45:21.344674+0000","last_unstale":"2023-11-27T20:45:22.370425+0000","last_undegraded":"2023-11-27T20:45:22.370425+0000","last_fullsized":"2023-11-27T20:45:22.370425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:20.276879+0000","last_clean_scrub_stamp":"2023-11-27T20:45:20.276879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:01:29.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-27T20:45:22.320074+0000","last_change":"2023-11-27T20:45:06.266017+0000","last_active":"2023-11-27T20:45:22.320074+0000","last_peered":"2023-11-27T20:45:22.320074+0000","last_clean":"2023-11-27T20:45:22.320074+0000","last_became_active":"2023-11-27T20:45:06.265439+0000","last_became_peered":"2023-11-27T20:45:06.265439+0000","last_unstale":"2023-11-27T20:45:22.320074+0000","last_undegraded":"2023-11-27T20:45:22.320074+0000","last_fullsized":"2023-11-27T20:45:22.320074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:05.599393+0000","last_clean_scrub_stamp":"2023-11-27T20:45:05.599393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:05.796906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"74'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.339977+0000","last_change":"2023-11-27T20:45:05.643524+0000","last_active":"2023-11-27T20:45:21.339977+0000","last_peered":"2023-11-27T20:45:21.339977+0000","last_clean":"2023-11-27T20:45:21.339977+0000","last_became_active":"2023-11-27T20:45:05.642570+0000","last_became_peered":"2023-11-27T20:45:05.642570+0000","last_unstale":"2023-11-27T20:45:21.339977+0000","last_undegraded":"2023-11-27T20:45:21.339977+0000","last_fullsized":"2023-11-27T20:45:21.339977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:45:04.593632+0000","last_clean_scrub_stamp":"2023-11-27T20:45:04.593632+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:34:00.040780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-27T20:45:21.336736+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:45:21.336736+0000","last_peered":"2023-11-27T20:45:21.336736+0000","last_clean":"2023-11-27T20:45:21.336736+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:45:21.336736+0000","last_undegraded":"2023-11-27T20:45:21.336736+0000","last_fullsized":"2023-11-27T20:45:21.336736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1589248,"data_stored":1034614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.127,"15min":1.153},"min":{"1min":0.63800000000000001,"5min":0.627,"15min":0.627},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.206,"15min":1.2290000000000001},"min":{"1min":0.74199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6950000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.268}]},{"osd":1,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1890000000000001,"15min":1.224},"min":{"1min":0.71299999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.391,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.099,"5min":1.1859999999999999,"15min":1.216},"min":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.585,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.0069999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.2330000000000001,"15min":1.2909999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4970000000000001,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2390000000000001,"15min":1.256},"min":{"1min":0.78300000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.722,"5min":1.909,"15min":1.909},"last":0.68500000000000005}]},{"osd":3,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3340000000000001,"15min":1.3879999999999999},"min":{"1min":0.83199999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6000000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.296},{"interface":"front","average":{"1min":1.375,"5min":1.4430000000000001,"15min":1.4870000000000001},"min":{"1min":0.89800000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.95,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.94799999999999995}]},{"osd":4,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.371,"15min":1.4099999999999999},"min":{"1min":1.0720000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.871,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.4910000000000001,"15min":1.587},"min":{"1min":0.76500000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.897,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.464}]},{"osd":5,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.466,"15min":1.502},"min":{"1min":0.91000000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.5329999999999999,"15min":1.583},"min":{"1min":1.0449999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7549999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.177}]},{"osd":6,"last update":"Mon Nov 27 20:44:32 2023","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.627,"15min":1.667},"min":{"1min":1.208,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.849,"5min":2.508,"15min":2.508},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.6120000000000001,"15min":1.6799999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.849,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":1.4079999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":445410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2250000000000001,"15min":1.2709999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.6799999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.145,"5min":1.266,"15min":1.3180000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.7430000000000001,"5min":2.581,"15min":2.581},"last":1.2709999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.2110000000000001,"15min":1.2629999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5309999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.129,"15min":1.159},"min":{"1min":0.66100000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.484,"5min":2.823,"15min":2.823},"last":1.373}]},{"osd":2,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.0549999999999999,"15min":1.0740000000000001},"min":{"1min":0.69199999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4570000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3280000000000001,"15min":1.3899999999999999},"min":{"1min":0.753,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.651,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.69499999999999995}]},{"osd":3,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.304,"15min":1.3720000000000001},"min":{"1min":0.879,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.649,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.306,"15min":1.3440000000000001},"min":{"1min":0.83499999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.526,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.018}]},{"osd":4,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.532,"15min":1.607},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0019999999999998,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.079},{"interface":"front","average":{"1min":1.375,"5min":1.5609999999999999,"15min":1.6419999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.9450000000000001,"5min":3.536,"15min":3.536},"last":1.4359999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.3620000000000001,"15min":1.3979999999999999},"min":{"1min":0.74399999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7210000000000001,"5min":2.355,"15min":2.355},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.589,"15min":1.6599999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.097,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.1719999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.581,"15min":1.669},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0230000000000001,"5min":3.645,"15min":3.645},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.534,"15min":1.577},"min":{"1min":0.93000000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.0590000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.605}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":447263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.103,"15min":1.151},"min":{"1min":0.71899999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.456,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1379999999999999,"15min":1.1779999999999999},"min":{"1min":0.73999999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.486,"5min":2.04,"15min":2.04},"last":1.083}]},{"osd":1,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1479999999999999,"15min":1.194},"min":{"1min":0.68500000000000005,"5min":0.379,"15min":0.379},"max":{"1min":1.4730000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.153,"15min":1.165},"min":{"1min":0.68600000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3340000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.2370000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.246,"15min":1.286},"min":{"1min":0.58999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.554,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.204},{"interface":"front","average":{"1min":1.149,"5min":1.1799999999999999,"15min":1.2090000000000001},"min":{"1min":0.75700000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.556,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.538}]},{"osd":3,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.341,"15min":1.391},"min":{"1min":0.70999999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6839999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.484},{"interface":"front","average":{"1min":1.119,"5min":1.361,"15min":1.4470000000000001},"min":{"1min":0.70799999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.4179999999999999,"5min":4.016,"15min":4.016},"last":1.377}]},{"osd":4,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.3029999999999999,"15min":1.3740000000000001},"min":{"1min":0.63200000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5149999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5329999999999999,"15min":1.617},"min":{"1min":0.80500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0289999999999999,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.3009999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.534,"15min":1.643},"min":{"1min":0.628,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.615,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.5229999999999999,"15min":1.595},"min":{"1min":0.79000000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.637,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.0149999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.581,"15min":1.663},"min":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8520000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.429},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.6220000000000001,"15min":1.7310000000000001},"min":{"1min":0.81100000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.8200000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.8640000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":445800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0109999999999999,"15min":1.006},"min":{"1min":0.63200000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4870000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.1080000000000001,"15min":1.0900000000000001},"min":{"1min":0.79900000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6180000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.0980000000000001,"15min":1.0289999999999999},"min":{"1min":0.85099999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.369},{"interface":"front","average":{"1min":1.361,"5min":1.25,"15min":1.2290000000000001},"min":{"1min":0.79900000000000004,"5min":0.628,"15min":0.628},"max":{"1min":3.9430000000000001,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.0169999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2210000000000001,"15min":1.2130000000000001},"min":{"1min":0.73199999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.486},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.296,"15min":1.296},"min":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.117}]},{"osd":3,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1459999999999999,"15min":1.1679999999999999},"min":{"1min":0.75900000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.321,"5min":1.778,"15min":1.778},"last":1.081},{"interface":"front","average":{"1min":1.304,"5min":1.3540000000000001,"15min":1.341},"min":{"1min":0.88600000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.623,"5min":2.097,"15min":2.097},"last":1.3220000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.222,"15min":1.2689999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7270000000000001,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.3899999999999999,"15min":1.419},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.601,"5min":1.992,"15min":1.992},"last":1.2210000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.351,"15min":1.367},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.841,"5min":2.157,"15min":2.157},"last":1.276},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5609999999999999,"15min":1.5940000000000001},"min":{"1min":0.73399999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.837,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.4099999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.492,"15min":1.4950000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.921,"5min":2.202,"15min":2.202},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.647,"15min":1.657},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.9350000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.5069999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":448805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.93400000000000005,"15min":1.016},"min":{"1min":0.49199999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92700000000000005,"5min":3.641,"15min":3.641},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94599999999999995,"15min":1.0049999999999999},"min":{"1min":0.45800000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.5389999999999999,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.70999999999999996}]},{"osd":1,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.91400000000000003,"15min":0.93999999999999995},"min":{"1min":0.46899999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.296,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0640000000000001,"15min":1.1100000000000001},"min":{"1min":0.61699999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.464,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.65900000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.075,"15min":1.1100000000000001},"min":{"1min":0.52300000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6020000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.012},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.087,"15min":1.125},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3939999999999999,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.075}]},{"osd":4,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3009999999999999,"15min":1.337},"min":{"1min":0.89700000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8939999999999999,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.327,"15min":1.389},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6679999999999999,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.546}]},{"osd":5,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.371,"15min":1.4219999999999999},"min":{"1min":0.86299999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.5840000000000001,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.419,"15min":1.4710000000000001},"min":{"1min":0.90700000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.954,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.93600000000000005}]},{"osd":6,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.478,"15min":1.53},"min":{"1min":0.96299999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.9830000000000001,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4590000000000001,"15min":1.5109999999999999},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.9039999999999999,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.5009999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.496,"15min":1.55},"min":{"1min":0.93700000000000006,"5min":0.871,"15min":0.871},"max":{"1min":2.0310000000000001,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4490000000000001,"15min":1.488},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6919999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.6539999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":444680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.80600000000000005},"min":{"1min":0.56399999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89000000000000001,"15min":0.92600000000000005},"min":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4750000000000001,"5min":1.972,"15min":1.972},"last":1.585}]},{"osd":1,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94999999999999996,"15min":1.004},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.252,"5min":1.522,"15min":1.522},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.98699999999999999},"min":{"1min":0.54100000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.3580000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4650000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.49399999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.111,"5min":1.073,"15min":1.101},"min":{"1min":0.59099999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.143}]},{"osd":4,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.175,"15min":1.2070000000000001},"min":{"1min":0.77500000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.522,"5min":1.669,"15min":1.669},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.349,"15min":1.383},"min":{"1min":0.97299999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8160000000000001,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.206}]},{"osd":5,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.284,"15min":1.3200000000000001},"min":{"1min":0.92800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6160000000000001,"5min":2.48,"15min":2.48},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.381,"5min":1.4239999999999999,"15min":1.484},"min":{"1min":1.093,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.869,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.2609999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3560000000000001,"15min":1.3779999999999999},"min":{"1min":0.89800000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7649999999999999,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4650000000000001,"15min":1.5289999999999999},"min":{"1min":1.111,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.752,"5min":3.302,"15min":3.302},"last":1.3169999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:44:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.431,"15min":1.486},"min":{"1min":0.84599999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.893,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.403,"15min":1.4710000000000001},"min":{"1min":1.0289999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7649999999999999,"5min":2.73,"15min":2.73},"last":1.345}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":995328,"data_stored":444258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.308,"15min":0.308},"max":{"1min":1.048,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88,"15min":0.876},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3320000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.53200000000000003}]},{"osd":2,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.55700000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4590000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.497},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.036,"15min":1.0449999999999999},"min":{"1min":0.51600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.444,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.748}]},{"osd":3,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.044,"15min":1.032},"min":{"1min":0.57899999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5469999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.079,"15min":1.085},"min":{"1min":0.66800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8500000000000001,"5min":2.044,"15min":2.044},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2,"15min":1.196},"min":{"1min":0.81299999999999994,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.365,"5min":1.367,"15min":1.355},"min":{"1min":0.79400000000000004,"5min":0.752,"15min":0.752},"max":{"1min":2.1589999999999998,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.1830000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.276,"15min":1.242},"min":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.004,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.2749999999999999,"15min":1.2410000000000001},"min":{"1min":0.85599999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1989999999999998,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.83999999999999997}]},{"osd":6,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.359,"15min":1.325},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.1070000000000002,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.377,"5min":1.347,"15min":1.3580000000000001},"min":{"1min":0.83399999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.0699999999999998,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:44:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.45,"15min":1.47},"min":{"1min":1.042,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.9019999999999999,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.127},{"interface":"front","average":{"1min":1.47,"5min":1.573,"15min":1.5800000000000001},"min":{"1min":1.0169999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.1789999999999998,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.79900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1585152,"data_stored":1035048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.405,"5min":1.901,"15min":1.901},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.877,"15min":0.84999999999999998},"min":{"1min":0.52300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.004}]},{"osd":2,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.87,"15min":0.84099999999999997},"min":{"1min":0.54500000000000004,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3129999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.752},{"interface":"front","average":{"1min":1.0660000000000001,"5min":0.96199999999999997,"15min":0.95599999999999996},"min":{"1min":0.55500000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.2410000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.91700000000000004,"15min":0.89800000000000002},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.4590000000000001,"5min":1.875,"15min":1.875},"last":1.077},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.073,"15min":1.0569999999999999},"min":{"1min":0.52000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.847,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.59699999999999998}]},{"osd":4,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2549999999999999,"15min":1.2490000000000001},"min":{"1min":0.75900000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.958,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.2090000000000001,"15min":1.196},"min":{"1min":0.82899999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.056,"5min":2.391,"15min":2.391},"last":1.323}]},{"osd":5,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3480000000000001,"15min":1.3540000000000001},"min":{"1min":0.747,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.992,"5min":3.028,"15min":3.028},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3220000000000001,"15min":1.3129999999999999},"min":{"1min":0.79000000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6970000000000001,"5min":2.718,"15min":2.718},"last":1.3540000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3,"15min":1.3100000000000001},"min":{"1min":0.83499999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.633,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.4099999999999999,"15min":1.4199999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.284}]},{"osd":7,"last update":"Mon Nov 27 20:44:27 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.90600000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.708,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.349,"15min":1.357},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.776,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3819999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:45:27.322 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T20:45:27.323 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-27T20:45:27.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.579+0000 7f259b856640 1 Processor -- start 2023-11-27T20:45:27.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.579+0000 7f259b856640 1 -- start start 2023-11-27T20:45:27.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.581+0000 7f259b856640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2594153240 0x7f25940a7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.581+0000 7f259b856640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259414ffd0 con 0x7f259406f7d0 2023-11-27T20:45:27.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.581+0000 7f259b856640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259406df60 con 0x7f25940a70a0 2023-11-27T20:45:27.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.581+0000 7f259b856640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259406e240 con 0x7f2594153240 2023-11-27T20:45:27.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.581+0000 7f25995f2640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f259406f7d0 0x7f25940c5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53318/0 (socket says 172.21.15.91:53318) 2023-11-27T20:45:27.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.581+0000 7f25995f2640 1 -- 172.21.15.91:0/2474182049 learned_addr learned my addr 172.21.15.91:0/2474182049 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:27.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.581+0000 7f2599df3640 1 --2- 172.21.15.91:0/2474182049 >> v2:172.21.15.91:3300/0 conn(0x7f2594153240 0x7f25940a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.582+0000 7f258bfff640 1 -- 172.21.15.91:0/2474182049 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256338228 0 0) 0x7f259414ffd0 con 0x7f259406f7d0 2023-11-27T20:45:27.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.582+0000 7f258bfff640 1 -- 172.21.15.91:0/2474182049 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2580003520 con 0x7f259406f7d0 2023-11-27T20:45:27.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.582+0000 7f2599df3640 1 -- 172.21.15.91:0/2474182049 >> v1:172.21.15.183:6789/0 conn(0x7f25940a70a0 legacy=0x7f259415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.582+0000 7f2599df3640 1 -- 172.21.15.91:0/2474182049 >> v1:172.21.15.91:6789/0 conn(0x7f259406f7d0 legacy=0x7f25940c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.582+0000 7f2599df3640 1 -- 172.21.15.91:0/2474182049 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2594152760 con 0x7f2594153240 2023-11-27T20:45:27.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.583+0000 7f2599df3640 1 --2- 172.21.15.91:0/2474182049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2594153240 0x7f25940a7560 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f258c0097a0 tx=0x7f258c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91f61b612163248 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:27.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.583+0000 7f258bfff640 1 -- 172.21.15.91:0/2474182049 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c031830 con 0x7f2594153240 2023-11-27T20:45:27.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.583+0000 7f258bfff640 1 -- 172.21.15.91:0/2474182049 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c031990 con 0x7f2594153240 2023-11-27T20:45:27.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.583+0000 7f258bfff640 1 -- 172.21.15.91:0/2474182049 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c031d20 con 0x7f2594153240 2023-11-27T20:45:27.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.584+0000 7f259b856640 1 -- 172.21.15.91:0/2474182049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2594153240 msgr2=0x7f25940a7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.584+0000 7f259b856640 1 --2- 172.21.15.91:0/2474182049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2594153240 0x7f25940a7560 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f258c0097a0 tx=0x7f258c02b8d0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.584+0000 7f259b856640 1 -- 172.21.15.91:0/2474182049 shutdown_connections 2023-11-27T20:45:27.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.584+0000 7f259b856640 1 --2- 172.21.15.91:0/2474182049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2594153240 0x7f25940a7560 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.584+0000 7f259b856640 1 -- 172.21.15.91:0/2474182049 >> 172.21.15.91:0/2474182049 conn(0x7f25940c7e30 msgr2=0x7f25940c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:27.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.584+0000 7f259b856640 1 -- 172.21.15.91:0/2474182049 shutdown_connections 2023-11-27T20:45:27.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.584+0000 7f259b856640 1 -- 172.21.15.91:0/2474182049 wait complete. 2023-11-27T20:45:27.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.586+0000 7f259b856640 1 Processor -- start 2023-11-27T20:45:27.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.586+0000 7f259b856640 1 -- start start 2023-11-27T20:45:27.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.587+0000 7f259b856640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f259406f7d0 0x7f25940bed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.587+0000 7f259b856640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25940a70a0 0x7f25940c1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.587+0000 7f259b856640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2594153240 0x7f2594155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.587+0000 7f259b856640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25941eb590 con 0x7f25940a70a0 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.587+0000 7f259b856640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25941eb2b0 con 0x7f2594153240 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.587+0000 7f259b856640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25940bcef0 con 0x7f259406f7d0 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.587+0000 7f2598df1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25940a70a0 0x7f25940c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.588+0000 7f2598df1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25940a70a0 0x7f25940c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37088/0 (socket says 172.21.15.91:37088) 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.588+0000 7f2598df1640 1 -- 172.21.15.91:0/3705135107 learned_addr learned my addr 172.21.15.91:0/3705135107 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.588+0000 7f25995f2640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f259406f7d0 0x7f25940bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.588+0000 7f2599df3640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2594153240 0x7f2594155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.588+0000 7f2598df1640 1 -- 172.21.15.91:0/3705135107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f259406f7d0 msgr2=0x7f25940bed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.588+0000 7f2598df1640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f259406f7d0 0x7f25940bed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.588+0000 7f2598df1640 1 -- 172.21.15.91:0/3705135107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2594153240 msgr2=0x7f2594155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.588+0000 7f2598df1640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2594153240 0x7f2594155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.588+0000 7f2598df1640 1 -- 172.21.15.91:0/3705135107 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c009400 con 0x7f25940a70a0 2023-11-27T20:45:27.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.588+0000 7f2598df1640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25940a70a0 0x7f25940c1910 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f258400c3c0 tx=0x7f258400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:27.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.589+0000 7f2589ffb640 1 -- 172.21.15.91:0/3705135107 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25840052d0 con 0x7f25940a70a0 2023-11-27T20:45:27.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.589+0000 7f2589ffb640 1 -- 172.21.15.91:0/3705135107 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2584005450 con 0x7f25940a70a0 2023-11-27T20:45:27.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.589+0000 7f2589ffb640 1 -- 172.21.15.91:0/3705135107 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584003830 con 0x7f25940a70a0 2023-11-27T20:45:27.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.589+0000 7f259b856640 1 -- 172.21.15.91:0/3705135107 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25940bd1d0 con 0x7f25940a70a0 2023-11-27T20:45:27.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.589+0000 7f259b856640 1 -- 172.21.15.91:0/3705135107 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25940bd790 con 0x7f25940a70a0 2023-11-27T20:45:27.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.590+0000 7f259b856640 1 -- 172.21.15.91:0/3705135107 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25940c5a20 con 0x7f25940a70a0 2023-11-27T20:45:27.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.591+0000 7f2589ffb640 1 -- 172.21.15.91:0/3705135107 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2584003990 con 0x7f25940a70a0 2023-11-27T20:45:27.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.592+0000 7f2589ffb640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f257806b1c0 0x7f257806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:27.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.592+0000 7f2589ffb640 1 -- 172.21.15.91:0/3705135107 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f2584089290 con 0x7f25940a70a0 2023-11-27T20:45:27.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.593+0000 7f25995f2640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f257806b1c0 0x7f257806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:27.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.593+0000 7f25995f2640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f257806b1c0 0x7f257806d680 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2590005c00 tx=0x7f2590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:27.595 INFO:tasks.ceph.mds.a.smithi091.stderr:2023-11-27T20:45:27.594+0000 7f184422a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:45:27.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.597+0000 7f2589ffb640 1 -- 172.21.15.91:0/3705135107 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2584053c20 con 0x7f25940a70a0 2023-11-27T20:45:27.738 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:45:27.747 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:45:27.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.856+0000 7f259b856640 1 -- 172.21.15.91:0/3705135107 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f2594068350 con 0x7f25940a70a0 2023-11-27T20:45:27.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.860+0000 7f2589ffb640 1 -- 172.21.15.91:0/3705135107 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v24) v1 ==== 185+0+142 (secure 0 0 0) 0x7f2584057240 con 0x7f25940a70a0 2023-11-27T20:45:27.865 INFO:teuthology.orchestra.run.smithi091.stdout:[client.1] 2023-11-27T20:45:27.865 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5/mRlsqHoLBAAzs5TAvGaf/SnzmZfDewgAg== 2023-11-27T20:45:27.865 INFO:teuthology.orchestra.run.smithi091.stdout: caps mds = "allow" 2023-11-27T20:45:27.866 INFO:teuthology.orchestra.run.smithi091.stdout: caps mon = "allow r" 2023-11-27T20:45:27.866 INFO:teuthology.orchestra.run.smithi091.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-27T20:45:27.867 INFO:teuthology.orchestra.run.smithi091.stderr:updated caps for client.1 2023-11-27T20:45:27.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 -- 172.21.15.91:0/3705135107 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f257806b1c0 msgr2=0x7f257806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f257806b1c0 0x7f257806d680 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2590005c00 tx=0x7f2590009040 comp rx=0 tx=0).stop 2023-11-27T20:45:27.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 -- 172.21.15.91:0/3705135107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25940a70a0 msgr2=0x7f25940c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:27.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25940a70a0 0x7f25940c1910 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f258400c3c0 tx=0x7f258400c880 comp rx=0 tx=0).stop 2023-11-27T20:45:27.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 -- 172.21.15.91:0/3705135107 shutdown_connections 2023-11-27T20:45:27.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f257806b1c0 0x7f257806d680 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2594153240 0x7f2594155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f25940a70a0 0x7f25940c1910 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 --2- 172.21.15.91:0/3705135107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f259406f7d0 0x7f25940bed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:27.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 -- 172.21.15.91:0/3705135107 >> 172.21.15.91:0/3705135107 conn(0x7f25940c7e30 msgr2=0x7f2594151e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:27.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 -- 172.21.15.91:0/3705135107 shutdown_connections 2023-11-27T20:45:27.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:27.863+0000 7f259b856640 1 -- 172.21.15.91:0/3705135107 wait complete. 2023-11-27T20:45:27.882 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:27.882 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:27.942 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:27.942 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:27.998 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:28.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.215+0000 7f31626bb640 1 Processor -- start 2023-11-27T20:45:28.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.215+0000 7f31626bb640 1 -- start start 2023-11-27T20:45:28.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.216+0000 7f31626bb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f315c0c0c80 0x7f315c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.216+0000 7f31626bb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c071e80 con 0x7f315c0c0440 2023-11-27T20:45:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.216+0000 7f31626bb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c072a20 con 0x7f315c14c2e0 2023-11-27T20:45:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.216+0000 7f31626bb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c071470 con 0x7f315c0c0c80 2023-11-27T20:45:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.217+0000 7f3160eb8640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f315c0c0440 0x7f315c072310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53324/0 (socket says 172.21.15.91:53324) 2023-11-27T20:45:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.217+0000 7f3160eb8640 1 -- 172.21.15.91:0/689805947 learned_addr learned my addr 172.21.15.91:0/689805947 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.217+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923255114 0 0) 0x7f315c071e80 con 0x7f315c0c0440 2023-11-27T20:45:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.217+0000 7f3161eba640 1 --2- 172.21.15.91:0/689805947 >> v2:172.21.15.183:3300/0 conn(0x7f315c0c0c80 0x7f315c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:28.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.217+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3148003520 con 0x7f315c0c0440 2023-11-27T20:45:28.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 431913380 0 0) 0x7f3148003520 con 0x7f315c0c0440 2023-11-27T20:45:28.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 >> v2:172.21.15.183:3300/0 conn(0x7f315c0c0c80 msgr2=0x7f315c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:28.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 --2- 172.21.15.91:0/689805947 >> v2:172.21.15.183:3300/0 conn(0x7f315c0c0c80 0x7f315c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 >> v1:172.21.15.183:6789/0 conn(0x7f315c14c2e0 legacy=0x7f315c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c14c6c0 con 0x7f315c0c0440 2023-11-27T20:45:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f314c001670 con 0x7f315c0c0440 2023-11-27T20:45:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3161eba640 1 --2- 172.21.15.91:0/689805947 >> v2:172.21.15.183:3300/0 conn(0x7f315c0c0c80 0x7f315c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:45:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 >> v1:172.21.15.91:6789/0 conn(0x7f315c0c0440 legacy=0x7f315c072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 --2- 172.21.15.91:0/689805947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3148003970 0x7f3148003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 --2- 172.21.15.91:0/689805947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31480047c0 0x7f3148004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 --2- 172.21.15.91:0/689805947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f314800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314800c1e0 con 0x7f3148005380 2023-11-27T20:45:28.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314800c350 con 0x7f3148003970 2023-11-27T20:45:28.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314800c510 con 0x7f31480047c0 2023-11-27T20:45:28.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3161eba640 1 --2- 172.21.15.91:0/689805947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f314800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:28.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f31616b9640 1 --2- 172.21.15.91:0/689805947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3148003970 0x7f3148003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:28.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3161eba640 1 -- 172.21.15.91:0/689805947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31480047c0 msgr2=0x7f3148004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:28.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3161eba640 1 --2- 172.21.15.91:0/689805947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31480047c0 0x7f3148004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3161eba640 1 -- 172.21.15.91:0/689805947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3148003970 msgr2=0x7f3148003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:28.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3161eba640 1 --2- 172.21.15.91:0/689805947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3148003970 0x7f3148003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.218+0000 7f3161eba640 1 -- 172.21.15.91:0/689805947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3148003520 con 0x7f3148005380 2023-11-27T20:45:28.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.219+0000 7f3161eba640 1 -- 172.21.15.91:0/689805947 reap_dead start 2023-11-27T20:45:28.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.220+0000 7f3161eba640 1 --2- 172.21.15.91:0/689805947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f314800b980 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f31540073e0 tx=0x7f31480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdcb78abfb9efe2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:28.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.220+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315402cdc0 con 0x7f3148005380 2023-11-27T20:45:28.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.220+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3154034440 con 0x7f3148005380 2023-11-27T20:45:28.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.220+0000 7f3153fff640 1 -- 172.21.15.91:0/689805947 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31540347f0 con 0x7f3148005380 2023-11-27T20:45:28.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.220+0000 7f31626bb640 1 -- 172.21.15.91:0/689805947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 msgr2=0x7f314800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.220+0000 7f31626bb640 1 --2- 172.21.15.91:0/689805947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f314800b980 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f31540073e0 tx=0x7f31480057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.220+0000 7f31626bb640 1 -- 172.21.15.91:0/689805947 shutdown_connections 2023-11-27T20:45:28.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.220+0000 7f31626bb640 1 --2- 172.21.15.91:0/689805947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f314800b980 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.220+0000 7f31626bb640 1 -- 172.21.15.91:0/689805947 >> 172.21.15.91:0/689805947 conn(0x7f315c0a77f0 msgr2=0x7f315c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:28.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.221+0000 7f31626bb640 1 -- 172.21.15.91:0/689805947 shutdown_connections 2023-11-27T20:45:28.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.221+0000 7f31626bb640 1 -- 172.21.15.91:0/689805947 wait complete. 2023-11-27T20:45:28.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.222+0000 7f31626bb640 1 Processor -- start 2023-11-27T20:45:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.222+0000 7f31626bb640 1 -- start start 2023-11-27T20:45:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.223+0000 7f31626bb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f315c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.223+0000 7f31626bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f315c1e9cd0 0x7f315c0ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.223+0000 7f31626bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f315c0a9890 0x7f315c14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.223+0000 7f31626bb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c155c00 con 0x7f3148005380 2023-11-27T20:45:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.223+0000 7f31626bb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c14fdf0 con 0x7f315c0a9890 2023-11-27T20:45:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.223+0000 7f31626bb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0a87f0 con 0x7f315c1e9cd0 2023-11-27T20:45:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.224+0000 7f31616b9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f315c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:28.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.224+0000 7f31616b9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f315c153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37102/0 (socket says 172.21.15.91:37102) 2023-11-27T20:45:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.224+0000 7f31616b9640 1 -- 172.21.15.91:0/2746485124 learned_addr learned my addr 172.21.15.91:0/2746485124 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.224+0000 7f31616b9640 1 -- 172.21.15.91:0/2746485124 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f315c1e9cd0 msgr2=0x7f315c0ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.224+0000 7f31616b9640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f315c1e9cd0 0x7f315c0ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.224+0000 7f3161eba640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f315c0a9890 0x7f315c14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.224+0000 7f31616b9640 1 -- 172.21.15.91:0/2746485124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f315c0a9890 msgr2=0x7f315c14f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.224+0000 7f31616b9640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f315c0a9890 0x7f315c14f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.224+0000 7f31616b9640 1 -- 172.21.15.91:0/2746485124 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0a8ad0 con 0x7f3148005380 2023-11-27T20:45:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.224+0000 7f31616b9640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f315c153bc0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f315800e4b0 tx=0x7f315800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.225+0000 7f3151ffb640 1 -- 172.21.15.91:0/2746485124 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31580052e0 con 0x7f3148005380 2023-11-27T20:45:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.225+0000 7f3151ffb640 1 -- 172.21.15.91:0/2746485124 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3158005440 con 0x7f3148005380 2023-11-27T20:45:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.225+0000 7f3151ffb640 1 -- 172.21.15.91:0/2746485124 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158003830 con 0x7f3148005380 2023-11-27T20:45:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.225+0000 7f31626bb640 1 -- 172.21.15.91:0/2746485124 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c0a8db0 con 0x7f3148005380 2023-11-27T20:45:28.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.225+0000 7f31626bb640 1 -- 172.21.15.91:0/2746485124 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c0a9370 con 0x7f3148005380 2023-11-27T20:45:28.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.226+0000 7f31626bb640 1 -- 172.21.15.91:0/2746485124 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c0a9500 con 0x7f3148005380 2023-11-27T20:45:28.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.227+0000 7f3151ffb640 1 -- 172.21.15.91:0/2746485124 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3158003990 con 0x7f3148005380 2023-11-27T20:45:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.228+0000 7f3151ffb640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f314006b1f0 0x7f314006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.228+0000 7f3151ffb640 1 -- 172.21.15.91:0/2746485124 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f3158089a10 con 0x7f3148005380 2023-11-27T20:45:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.228+0000 7f3160eb8640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f314006b1f0 0x7f314006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:28.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.229+0000 7f3160eb8640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f314006b1f0 0x7f314006d6b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f314c000f60 tx=0x7f314c0014e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:28.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.233+0000 7f3151ffb640 1 -- 172.21.15.91:0/2746485124 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3158054440 con 0x7f3148005380 2023-11-27T20:45:28.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.423+0000 7f31626bb640 1 -- 172.21.15.91:0/2746485124 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f315c067d50 con 0x7f3148005380 2023-11-27T20:45:28.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.427+0000 7f3151ffb640 1 -- 172.21.15.91:0/2746485124 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f3158057a60 con 0x7f3148005380 2023-11-27T20:45:28.429 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:28.429 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":81,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:23.334850+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.429+0000 7f31626bb640 1 -- 172.21.15.91:0/2746485124 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f314006b1f0 msgr2=0x7f314006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.429+0000 7f31626bb640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f314006b1f0 0x7f314006d6b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f314c000f60 tx=0x7f314c0014e0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.430+0000 7f31626bb640 1 -- 172.21.15.91:0/2746485124 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 msgr2=0x7f315c153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.430+0000 7f31626bb640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f315c153bc0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f315800e4b0 tx=0x7f315800e970 comp rx=0 tx=0).stop 2023-11-27T20:45:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.430+0000 7f31626bb640 1 -- 172.21.15.91:0/2746485124 shutdown_connections 2023-11-27T20:45:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.430+0000 7f31626bb640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f314006b1f0 0x7f314006d6b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.430+0000 7f31626bb640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f315c0a9890 0x7f315c14f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.430+0000 7f31626bb640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f315c1e9cd0 0x7f315c0ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.430+0000 7f31626bb640 1 --2- 172.21.15.91:0/2746485124 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3148005380 0x7f315c153bc0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.430+0000 7f31626bb640 1 -- 172.21.15.91:0/2746485124 >> 172.21.15.91:0/2746485124 conn(0x7f315c0a77f0 msgr2=0x7f315c0bee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:28.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.430+0000 7f31626bb640 1 -- 172.21.15.91:0/2746485124 shutdown_connections 2023-11-27T20:45:28.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.430+0000 7f31626bb640 1 -- 172.21.15.91:0/2746485124 wait complete. 2023-11-27T20:45:28.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:45:04.361620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:45:05.090674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:45:19.465319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:45:20.794821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:45:28.452 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:45:28.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.658+0000 7f08c3236640 1 Processor -- start 2023-11-27T20:45:28.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.658+0000 7f08c3236640 1 -- start start 2023-11-27T20:45:28.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.659+0000 7f08c3236640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08bc14e810 0x7f08bc1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.659+0000 7f08c3236640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f08bc06b7d0 0x7f08bc06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.659+0000 7f08c3236640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0bd8d0 con 0x7f08bc0c7e90 2023-11-27T20:45:28.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.659+0000 7f08c3236640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0c6e60 con 0x7f08bc14e810 2023-11-27T20:45:28.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.659+0000 7f08c3236640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc155600 con 0x7f08bc06b7d0 2023-11-27T20:45:28.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.659+0000 7f08c0fd2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08bc14e810 0x7f08bc1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:28.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.660+0000 7f08c0fd2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08bc14e810 0x7f08bc1550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37110/0 (socket says 172.21.15.91:37110) 2023-11-27T20:45:28.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.660+0000 7f08c0fd2640 1 -- 172.21.15.91:0/856016449 learned_addr learned my addr 172.21.15.91:0/856016449 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:28.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.660+0000 7f08c0fd2640 1 -- 172.21.15.91:0/856016449 >> v2:172.21.15.183:3300/0 conn(0x7f08bc06b7d0 msgr2=0x7f08bc06bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:28.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.660+0000 7f08c0fd2640 1 --2- 172.21.15.91:0/856016449 >> v2:172.21.15.183:3300/0 conn(0x7f08bc06b7d0 0x7f08bc06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.660+0000 7f08c0fd2640 1 -- 172.21.15.91:0/856016449 >> v1:172.21.15.183:6789/0 conn(0x7f08bc0c7e90 legacy=0x7f08bc0c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:28.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.660+0000 7f08c0fd2640 1 -- 172.21.15.91:0/856016449 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0c70d0 con 0x7f08bc14e810 2023-11-27T20:45:28.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.661+0000 7f08c0fd2640 1 --2- 172.21.15.91:0/856016449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc14e810 0x7f08bc1550c0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f08bc158cd0 tx=0x7f08a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a95b6a6abea67b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:28.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.661+0000 7f08bb7fe640 1 -- 172.21.15.91:0/856016449 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40317e0 con 0x7f08bc14e810 2023-11-27T20:45:28.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.661+0000 7f08bb7fe640 1 -- 172.21.15.91:0/856016449 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4031940 con 0x7f08bc14e810 2023-11-27T20:45:28.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.661+0000 7f08bb7fe640 1 -- 172.21.15.91:0/856016449 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4031cd0 con 0x7f08bc14e810 2023-11-27T20:45:28.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.662+0000 7f08c3236640 1 -- 172.21.15.91:0/856016449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc14e810 msgr2=0x7f08bc1550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.662+0000 7f08c3236640 1 --2- 172.21.15.91:0/856016449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc14e810 0x7f08bc1550c0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f08bc158cd0 tx=0x7f08a402b880 comp rx=0 tx=0).stop 2023-11-27T20:45:28.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.662+0000 7f08c3236640 1 -- 172.21.15.91:0/856016449 shutdown_connections 2023-11-27T20:45:28.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.662+0000 7f08c3236640 1 --2- 172.21.15.91:0/856016449 >> v2:172.21.15.183:3300/0 conn(0x7f08bc06b7d0 0x7f08bc06bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.662+0000 7f08c3236640 1 --2- 172.21.15.91:0/856016449 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc14e810 0x7f08bc1550c0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.662+0000 7f08c3236640 1 -- 172.21.15.91:0/856016449 >> 172.21.15.91:0/856016449 conn(0x7f08bc0ca170 msgr2=0x7f08bc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:28.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.662+0000 7f08c3236640 1 -- 172.21.15.91:0/856016449 shutdown_connections 2023-11-27T20:45:28.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.662+0000 7f08c3236640 1 -- 172.21.15.91:0/856016449 wait complete. 2023-11-27T20:45:28.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.664+0000 7f08c3236640 1 Processor -- start 2023-11-27T20:45:28.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.664+0000 7f08c3236640 1 -- start start 2023-11-27T20:45:28.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.665+0000 7f08c3236640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08bc06b7d0 0x7f08bc155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.665+0000 7f08c3236640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc0c7e90 0x7f08bc0c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.665+0000 7f08c3236640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08bc14e810 0x7f08bc0c0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.665+0000 7f08c3236640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc14b5b0 con 0x7f08bc0c7e90 2023-11-27T20:45:28.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.665+0000 7f08c3236640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0c0e70 con 0x7f08bc06b7d0 2023-11-27T20:45:28.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.665+0000 7f08c3236640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0bdaf0 con 0x7f08bc14e810 2023-11-27T20:45:28.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.665+0000 7f08bbfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc0c7e90 0x7f08bc0c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:28.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.665+0000 7f08bbfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc0c7e90 0x7f08bc0c03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37124/0 (socket says 172.21.15.91:37124) 2023-11-27T20:45:28.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.665+0000 7f08bbfff640 1 -- 172.21.15.91:0/2041065808 learned_addr learned my addr 172.21.15.91:0/2041065808 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:28.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08c0fd2640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08bc06b7d0 0x7f08bc155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:28.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08bbfff640 1 -- 172.21.15.91:0/2041065808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08bc14e810 msgr2=0x7f08bc0c0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08bbfff640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08bc14e810 0x7f08bc0c0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08bbfff640 1 -- 172.21.15.91:0/2041065808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08bc06b7d0 msgr2=0x7f08bc155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08bbfff640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08bc06b7d0 0x7f08bc155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08bbfff640 1 -- 172.21.15.91:0/2041065808 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40094d0 con 0x7f08bc0c7e90 2023-11-27T20:45:28.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08c0fd2640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08bc06b7d0 0x7f08bc155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:28.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08bbfff640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc0c7e90 0x7f08bc0c03f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00c820 tx=0x7f08ac00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:28.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08b97fa640 1 -- 172.21.15.91:0/2041065808 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac003d80 con 0x7f08bc0c7e90 2023-11-27T20:45:28.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08b97fa640 1 -- 172.21.15.91:0/2041065808 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac005070 con 0x7f08bc0c7e90 2023-11-27T20:45:28.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08b97fa640 1 -- 172.21.15.91:0/2041065808 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac005420 con 0x7f08bc0c7e90 2023-11-27T20:45:28.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08c3236640 1 -- 172.21.15.91:0/2041065808 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc14fce0 con 0x7f08bc0c7e90 2023-11-27T20:45:28.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.666+0000 7f08c3236640 1 -- 172.21.15.91:0/2041065808 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc14ff80 con 0x7f08bc0c7e90 2023-11-27T20:45:28.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.668+0000 7f08c3236640 1 -- 172.21.15.91:0/2041065808 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc1501a0 con 0x7f08bc0c7e90 2023-11-27T20:45:28.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.668+0000 7f08b97fa640 1 -- 172.21.15.91:0/2041065808 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f08ac005580 con 0x7f08bc0c7e90 2023-11-27T20:45:28.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.669+0000 7f08b97fa640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f089c06b1c0 0x7f089c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:28.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.669+0000 7f08b97fa640 1 -- 172.21.15.91:0/2041065808 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f08ac089330 con 0x7f08bc0c7e90 2023-11-27T20:45:28.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.670+0000 7f08c0fd2640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f089c06b1c0 0x7f089c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:28.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.670+0000 7f08c0fd2640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f089c06b1c0 0x7f089c06d680 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f08a4036000 tx=0x7f08a403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:28.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.674+0000 7f08b97fa640 1 -- 172.21.15.91:0/2041065808 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f08ac053cc0 con 0x7f08bc0c7e90 2023-11-27T20:45:28.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.866+0000 7f08c3236640 1 -- 172.21.15.91:0/2041065808 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08bc068350 con 0x7f08bc0c7e90 2023-11-27T20:45:28.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.867+0000 7f08b97fa640 1 -- 172.21.15.91:0/2041065808 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08ac0572e0 con 0x7f08bc0c7e90 2023-11-27T20:45:28.869 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:45:28.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.870+0000 7f08c3236640 1 -- 172.21.15.91:0/2041065808 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f089c06b1c0 msgr2=0x7f089c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.870+0000 7f08c3236640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f089c06b1c0 0x7f089c06d680 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f08a4036000 tx=0x7f08a403d040 comp rx=0 tx=0).stop 2023-11-27T20:45:28.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.870+0000 7f08c3236640 1 -- 172.21.15.91:0/2041065808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc0c7e90 msgr2=0x7f08bc0c03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:28.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.870+0000 7f08c3236640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc0c7e90 0x7f08bc0c03f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00c820 tx=0x7f08ac00cce0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.870+0000 7f08c3236640 1 -- 172.21.15.91:0/2041065808 shutdown_connections 2023-11-27T20:45:28.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.870+0000 7f08c3236640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08bc14e810 0x7f08bc0c0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.870+0000 7f08c3236640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08bc0c7e90 0x7f08bc0c03f0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.870+0000 7f08c3236640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f089c06b1c0 0x7f089c06d680 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.870+0000 7f08c3236640 1 --2- 172.21.15.91:0/2041065808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08bc06b7d0 0x7f08bc155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:28.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.870+0000 7f08c3236640 1 -- 172.21.15.91:0/2041065808 >> 172.21.15.91:0/2041065808 conn(0x7f08bc0ca170 msgr2=0x7f08bc151fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:28.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.871+0000 7f08c3236640 1 -- 172.21.15.91:0/2041065808 shutdown_connections 2023-11-27T20:45:28.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:28.871+0000 7f08c3236640 1 -- 172.21.15.91:0/2041065808 wait complete. 2023-11-27T20:45:28.894 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:45:29.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.099+0000 7f7f1088c640 1 Processor -- start 2023-11-27T20:45:29.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.100+0000 7f7f1088c640 1 -- start start 2023-11-27T20:45:29.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.101+0000 7f7f1088c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7f0c0a4d20 0x7f7f0c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.102 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.101+0000 7f7f1088c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0c1450 0x7f7f0c15ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.101+0000 7f7f1088c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c157ad0 con 0x7f7f0c154430 2023-11-27T20:45:29.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.101+0000 7f7f1088c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c154fd0 con 0x7f7f0c0a4d20 2023-11-27T20:45:29.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.101+0000 7f7f1088c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c158890 con 0x7f7f0c0c1450 2023-11-27T20:45:29.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.102+0000 7f7f0bfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0c1450 0x7f7f0c15ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.102+0000 7f7f03fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f7f0c154430 0x7f7f0c1548c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:58524/0 (socket says 172.21.15.91:58524) 2023-11-27T20:45:29.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.102+0000 7f7f03fff640 1 -- 172.21.15.91:0/1806629089 learned_addr learned my addr 172.21.15.91:0/1806629089 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:29.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.102+0000 7f7f0b7fe640 1 --2- 172.21.15.91:0/1806629089 >> v2:172.21.15.183:3300/0 conn(0x7f7f0c0a4d20 0x7f7f0c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.103+0000 7f7f0bfff640 1 -- 172.21.15.91:0/1806629089 >> v2:172.21.15.183:3300/0 conn(0x7f7f0c0a4d20 msgr2=0x7f7f0c0a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:29.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.103+0000 7f7f0bfff640 1 --2- 172.21.15.91:0/1806629089 >> v2:172.21.15.183:3300/0 conn(0x7f7f0c0a4d20 0x7f7f0c0a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.103+0000 7f7f0bfff640 1 -- 172.21.15.91:0/1806629089 >> v1:172.21.15.183:6789/0 conn(0x7f7f0c154430 legacy=0x7f7f0c1548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.103+0000 7f7f0bfff640 1 -- 172.21.15.91:0/1806629089 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c157db0 con 0x7f7f0c0c1450 2023-11-27T20:45:29.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.104+0000 7f7f0bfff640 1 --2- 172.21.15.91:0/1806629089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0c1450 0x7f7f0c15ecd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009d90 tx=0x7f7f0402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35d0f4a87b99acb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:29.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.104+0000 7f7f0affd640 1 -- 172.21.15.91:0/1806629089 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0402cbd0 con 0x7f7f0c0c1450 2023-11-27T20:45:29.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.104+0000 7f7f0affd640 1 -- 172.21.15.91:0/1806629089 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0402cd30 con 0x7f7f0c0c1450 2023-11-27T20:45:29.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.104+0000 7f7f0affd640 1 -- 172.21.15.91:0/1806629089 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0402cea0 con 0x7f7f0c0c1450 2023-11-27T20:45:29.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.105+0000 7f7f1088c640 1 -- 172.21.15.91:0/1806629089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0c1450 msgr2=0x7f7f0c15ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.105+0000 7f7f1088c640 1 --2- 172.21.15.91:0/1806629089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0c1450 0x7f7f0c15ecd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009d90 tx=0x7f7f0402be20 comp rx=0 tx=0).stop 2023-11-27T20:45:29.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.105+0000 7f7f1088c640 1 -- 172.21.15.91:0/1806629089 shutdown_connections 2023-11-27T20:45:29.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.105+0000 7f7f1088c640 1 --2- 172.21.15.91:0/1806629089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0c1450 0x7f7f0c15ecd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.105+0000 7f7f1088c640 1 --2- 172.21.15.91:0/1806629089 >> v2:172.21.15.183:3300/0 conn(0x7f7f0c0a4d20 0x7f7f0c0a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.105+0000 7f7f1088c640 1 -- 172.21.15.91:0/1806629089 >> 172.21.15.91:0/1806629089 conn(0x7f7f0c0a77f0 msgr2=0x7f7f0c0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:29.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.105+0000 7f7f1088c640 1 -- 172.21.15.91:0/1806629089 shutdown_connections 2023-11-27T20:45:29.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.105+0000 7f7f1088c640 1 -- 172.21.15.91:0/1806629089 wait complete. 2023-11-27T20:45:29.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.107+0000 7f7f1088c640 1 Processor -- start 2023-11-27T20:45:29.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.107+0000 7f7f1088c640 1 -- start start 2023-11-27T20:45:29.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f1088c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0a4d20 0x7f7f0c0c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f1088c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f0c0c1450 0x7f7f0c14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f1088c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f0c154430 0x7f7f0c14e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f1088c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0a75b0 con 0x7f7f0c0c1450 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f1088c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0a6ff0 con 0x7f7f0c154430 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f1088c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0a72d0 con 0x7f7f0c0a4d20 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f03fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f0c0c1450 0x7f7f0c14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f03fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f0c0c1450 0x7f7f0c14e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37136/0 (socket says 172.21.15.91:37136) 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f03fff640 1 -- 172.21.15.91:0/2796646157 learned_addr learned my addr 172.21.15.91:0/2796646157 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f0b7fe640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0a4d20 0x7f7f0c0c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f03fff640 1 -- 172.21.15.91:0/2796646157 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0a4d20 msgr2=0x7f7f0c0c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f03fff640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0a4d20 0x7f7f0c0c27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f0bfff640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f0c154430 0x7f7f0c14e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f03fff640 1 -- 172.21.15.91:0/2796646157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f0c154430 msgr2=0x7f7f0c14e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.108+0000 7f7f03fff640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f0c154430 0x7f7f0c14e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.109+0000 7f7f03fff640 1 -- 172.21.15.91:0/2796646157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f04009a70 con 0x7f7f0c0c1450 2023-11-27T20:45:29.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.109+0000 7f7f03fff640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f0c0c1450 0x7f7f0c14e0c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400c480 tx=0x7f7ef400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:29.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.109+0000 7f7f08ff9640 1 -- 172.21.15.91:0/2796646157 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4005ce0 con 0x7f7f0c0c1450 2023-11-27T20:45:29.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.109+0000 7f7f08ff9640 1 -- 172.21.15.91:0/2796646157 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4005e40 con 0x7f7f0c0c1450 2023-11-27T20:45:29.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.109+0000 7f7f1088c640 1 -- 172.21.15.91:0/2796646157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c14f120 con 0x7f7f0c0c1450 2023-11-27T20:45:29.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.109+0000 7f7f08ff9640 1 -- 172.21.15.91:0/2796646157 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40072d0 con 0x7f7f0c0c1450 2023-11-27T20:45:29.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.109+0000 7f7f1088c640 1 -- 172.21.15.91:0/2796646157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c0c2cf0 con 0x7f7f0c0c1450 2023-11-27T20:45:29.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.110+0000 7f7f1088c640 1 -- 172.21.15.91:0/2796646157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c14ef80 con 0x7f7f0c0c1450 2023-11-27T20:45:29.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.111+0000 7f7f08ff9640 1 -- 172.21.15.91:0/2796646157 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7ef40074f0 con 0x7f7f0c0c1450 2023-11-27T20:45:29.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.112+0000 7f7f08ff9640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7eec06b1c0 0x7f7eec06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.112+0000 7f7f08ff9640 1 -- 172.21.15.91:0/2796646157 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f7ef4089350 con 0x7f7f0c0c1450 2023-11-27T20:45:29.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.112+0000 7f7f0b7fe640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7eec06b1c0 0x7f7eec06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.113+0000 7f7f0b7fe640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7eec06b1c0 0x7f7eec06d680 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c071d90 tx=0x7f7efc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:29.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.116+0000 7f7f08ff9640 1 -- 172.21.15.91:0/2796646157 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7f0c14ef80 con 0x7f7f0c0c1450 2023-11-27T20:45:29.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.305+0000 7f7f1088c640 1 -- 172.21.15.91:0/2796646157 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f0c14ef80 con 0x7f7f0c0c1450 2023-11-27T20:45:29.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.306+0000 7f7f08ff9640 1 -- 172.21.15.91:0/2796646157 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f0c14ef80 con 0x7f7f0c0c1450 2023-11-27T20:45:29.308 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 -- 172.21.15.91:0/2796646157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7eec06b1c0 msgr2=0x7f7eec06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7eec06b1c0 0x7f7eec06d680 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c071d90 tx=0x7f7efc008040 comp rx=0 tx=0).stop 2023-11-27T20:45:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 -- 172.21.15.91:0/2796646157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f0c0c1450 msgr2=0x7f7f0c14e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f0c0c1450 0x7f7f0c14e0c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400c480 tx=0x7f7ef400c940 comp rx=0 tx=0).stop 2023-11-27T20:45:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 -- 172.21.15.91:0/2796646157 shutdown_connections 2023-11-27T20:45:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7eec06b1c0 0x7f7eec06d680 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f0c154430 0x7f7f0c14e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7f0c0c1450 0x7f7f0c14e0c0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 --2- 172.21.15.91:0/2796646157 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f0c0a4d20 0x7f7f0c0c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 -- 172.21.15.91:0/2796646157 >> 172.21.15.91:0/2796646157 conn(0x7f7f0c0a77f0 msgr2=0x7f7f0c06d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:29.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 -- 172.21.15.91:0/2796646157 shutdown_connections 2023-11-27T20:45:29.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.309+0000 7f7f1088c640 1 -- 172.21.15.91:0/2796646157 wait complete. 2023-11-27T20:45:29.327 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:45:29.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.528+0000 7f268ce6b640 1 Processor -- start 2023-11-27T20:45:29.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.528+0000 7f268ce6b640 1 -- start start 2023-11-27T20:45:29.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.530+0000 7f268ce6b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2688152f20 0x7f26880c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.530+0000 7f268ce6b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26880c64a0 con 0x7f268806d0a0 2023-11-27T20:45:29.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.530+0000 7f268ce6b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26880c5c00 con 0x7f268814fd30 2023-11-27T20:45:29.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.530+0000 7f268ce6b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26880c5ee0 con 0x7f2688152f20 2023-11-27T20:45:29.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.530+0000 7f2686d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2688152f20 0x7f26880c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.530+0000 7f267dd9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f268806d0a0 0x7f26880c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53334/0 (socket says 172.21.15.91:53334) 2023-11-27T20:45:29.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.530+0000 7f267dd9b640 1 -- 172.21.15.91:0/3707713262 learned_addr learned my addr 172.21.15.91:0/3707713262 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:29.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.530+0000 7f2686d9d640 1 -- 172.21.15.91:0/3707713262 >> v1:172.21.15.183:6789/0 conn(0x7f268814fd30 legacy=0x7f26880a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:29.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.530+0000 7f2686d9d640 1 -- 172.21.15.91:0/3707713262 >> v1:172.21.15.91:6789/0 conn(0x7f268806d0a0 legacy=0x7f26880c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.531+0000 7f2686d9d640 1 -- 172.21.15.91:0/3707713262 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26880c61c0 con 0x7f2688152f20 2023-11-27T20:45:29.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.530+0000 7f2685d9b640 1 -- 172.21.15.91:0/3707713262 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212842182 0 0) 0x7f26880c64a0 con 0x7f268806d0a0 2023-11-27T20:45:29.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.532+0000 7f2686d9d640 1 --2- 172.21.15.91:0/3707713262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2688152f20 0x7f26880c45b0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f26800097a0 tx=0x7f268002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1eac57070f08c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:29.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.532+0000 7f2685d9b640 1 -- 172.21.15.91:0/3707713262 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2680031830 con 0x7f2688152f20 2023-11-27T20:45:29.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.532+0000 7f2685d9b640 1 -- 172.21.15.91:0/3707713262 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2680031990 con 0x7f2688152f20 2023-11-27T20:45:29.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.532+0000 7f2685d9b640 1 -- 172.21.15.91:0/3707713262 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2680031d20 con 0x7f2688152f20 2023-11-27T20:45:29.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.532+0000 7f268ce6b640 1 -- 172.21.15.91:0/3707713262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2688152f20 msgr2=0x7f26880c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.532+0000 7f268ce6b640 1 --2- 172.21.15.91:0/3707713262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2688152f20 0x7f26880c45b0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f26800097a0 tx=0x7f268002b8d0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.532+0000 7f268ce6b640 1 -- 172.21.15.91:0/3707713262 shutdown_connections 2023-11-27T20:45:29.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.532+0000 7f268ce6b640 1 --2- 172.21.15.91:0/3707713262 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2688152f20 0x7f26880c45b0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.532+0000 7f268ce6b640 1 -- 172.21.15.91:0/3707713262 >> 172.21.15.91:0/3707713262 conn(0x7f268806a500 msgr2=0x7f268806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:29.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.533+0000 7f268ce6b640 1 -- 172.21.15.91:0/3707713262 shutdown_connections 2023-11-27T20:45:29.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.533+0000 7f268ce6b640 1 -- 172.21.15.91:0/3707713262 wait complete. 2023-11-27T20:45:29.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.534+0000 7f268ce6b640 1 Processor -- start 2023-11-27T20:45:29.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.534+0000 7f268ce6b640 1 -- start start 2023-11-27T20:45:29.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.535+0000 7f268ce6b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f268806d0a0 0x7f2688155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.535+0000 7f268ce6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f268814fd30 0x7f26881f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.535+0000 7f268ce6b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2688152f20 0x7f26881f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.535+0000 7f268ce6b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26881f2670 con 0x7f268814fd30 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.535+0000 7f268ce6b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26880aa000 con 0x7f2688152f20 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.535+0000 7f268ce6b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26880aa2e0 con 0x7f268806d0a0 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.536+0000 7f267dd9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f268814fd30 0x7f26881f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.536+0000 7f267dd9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f268814fd30 0x7f26881f1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37142/0 (socket says 172.21.15.91:37142) 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.536+0000 7f267dd9b640 1 -- 172.21.15.91:0/3974181541 learned_addr learned my addr 172.21.15.91:0/3974181541 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.536+0000 7f267dd9b640 1 -- 172.21.15.91:0/3974181541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f268806d0a0 msgr2=0x7f2688155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.536+0000 7f268659c640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f268806d0a0 0x7f2688155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.536+0000 7f267dd9b640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f268806d0a0 0x7f2688155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.536+0000 7f267dd9b640 1 -- 172.21.15.91:0/3974181541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2688152f20 msgr2=0x7f26881f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.536+0000 7f267dd9b640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2688152f20 0x7f26881f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.536+0000 7f267dd9b640 1 -- 172.21.15.91:0/3974181541 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680009400 con 0x7f268814fd30 2023-11-27T20:45:29.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.536+0000 7f267dd9b640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f268814fd30 0x7f26881f1b10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f267000c4b0 tx=0x7f267000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:29.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.537+0000 7f267f7fe640 1 -- 172.21.15.91:0/3974181541 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26700074e0 con 0x7f268814fd30 2023-11-27T20:45:29.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.537+0000 7f267f7fe640 1 -- 172.21.15.91:0/3974181541 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2670007660 con 0x7f268814fd30 2023-11-27T20:45:29.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.537+0000 7f267f7fe640 1 -- 172.21.15.91:0/3974181541 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670004a20 con 0x7f268814fd30 2023-11-27T20:45:29.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.537+0000 7f268ce6b640 1 -- 172.21.15.91:0/3974181541 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26880aa5c0 con 0x7f268814fd30 2023-11-27T20:45:29.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.537+0000 7f268ce6b640 1 -- 172.21.15.91:0/3974181541 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26880a2270 con 0x7f268814fd30 2023-11-27T20:45:29.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.538+0000 7f268ce6b640 1 -- 172.21.15.91:0/3974181541 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2688155990 con 0x7f268814fd30 2023-11-27T20:45:29.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.539+0000 7f267f7fe640 1 -- 172.21.15.91:0/3974181541 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2670004b80 con 0x7f268814fd30 2023-11-27T20:45:29.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.540+0000 7f267f7fe640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f266806b1c0 0x7f266806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.540+0000 7f267f7fe640 1 -- 172.21.15.91:0/3974181541 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f2670088f90 con 0x7f268814fd30 2023-11-27T20:45:29.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.540+0000 7f268659c640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f266806b1c0 0x7f266806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.541+0000 7f268659c640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f266806b1c0 0x7f266806d680 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2678007fd0 tx=0x7f2678009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:29.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.544+0000 7f267f7fe640 1 -- 172.21.15.91:0/3974181541 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2688155990 con 0x7f268814fd30 2023-11-27T20:45:29.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.743+0000 7f268ce6b640 1 -- 172.21.15.91:0/3974181541 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2688155990 con 0x7f268814fd30 2023-11-27T20:45:29.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.744+0000 7f267f7fe640 1 -- 172.21.15.91:0/3974181541 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2688155990 con 0x7f268814fd30 2023-11-27T20:45:29.745 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:29.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.746+0000 7f268ce6b640 1 -- 172.21.15.91:0/3974181541 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f266806b1c0 msgr2=0x7f266806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.746+0000 7f268ce6b640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f266806b1c0 0x7f266806d680 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2678007fd0 tx=0x7f2678009040 comp rx=0 tx=0).stop 2023-11-27T20:45:29.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.746+0000 7f268ce6b640 1 -- 172.21.15.91:0/3974181541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f268814fd30 msgr2=0x7f26881f1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.746+0000 7f268ce6b640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f268814fd30 0x7f26881f1b10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f267000c4b0 tx=0x7f267000c970 comp rx=0 tx=0).stop 2023-11-27T20:45:29.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.747+0000 7f268ce6b640 1 -- 172.21.15.91:0/3974181541 shutdown_connections 2023-11-27T20:45:29.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.747+0000 7f268ce6b640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f266806b1c0 0x7f266806d680 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.747+0000 7f268ce6b640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2688152f20 0x7f26881f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.747+0000 7f268ce6b640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f268814fd30 0x7f26881f1b10 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.747+0000 7f268ce6b640 1 --2- 172.21.15.91:0/3974181541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f268806d0a0 0x7f2688155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.747+0000 7f268ce6b640 1 -- 172.21.15.91:0/3974181541 >> 172.21.15.91:0/3974181541 conn(0x7f268806a500 msgr2=0x7f26880c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:29.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.747+0000 7f268ce6b640 1 -- 172.21.15.91:0/3974181541 shutdown_connections 2023-11-27T20:45:29.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.747+0000 7f268ce6b640 1 -- 172.21.15.91:0/3974181541 wait complete. 2023-11-27T20:45:29.767 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:45:29.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.978+0000 7f3431848640 1 Processor -- start 2023-11-27T20:45:29.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.978+0000 7f3431848640 1 -- start start 2023-11-27T20:45:29.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.979+0000 7f3431848640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f342c14fd30 0x7f342c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.979+0000 7f3431848640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f342c06d0a0 0x7f342c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.979+0000 7f3431848640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c0c64a0 con 0x7f342c0a5260 2023-11-27T20:45:29.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.979+0000 7f3431848640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342c0c5c00 con 0x7f342c14fd30 2023-11-27T20:45:29.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.979+0000 7f3431848640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342c0c5ee0 con 0x7f342c06d0a0 2023-11-27T20:45:29.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.980+0000 7f342affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f342c14fd30 0x7f342c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.980+0000 7f342affd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f342c14fd30 0x7f342c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37148/0 (socket says 172.21.15.91:37148) 2023-11-27T20:45:29.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.980+0000 7f342affd640 1 -- 172.21.15.91:0/735064993 learned_addr learned my addr 172.21.15.91:0/735064993 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:29.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.980+0000 7f342affd640 1 -- 172.21.15.91:0/735064993 >> v2:172.21.15.183:3300/0 conn(0x7f342c06d0a0 msgr2=0x7f342c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:29.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.980+0000 7f342affd640 1 --2- 172.21.15.91:0/735064993 >> v2:172.21.15.183:3300/0 conn(0x7f342c06d0a0 0x7f342c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.980+0000 7f342affd640 1 -- 172.21.15.91:0/735064993 >> v1:172.21.15.183:6789/0 conn(0x7f342c0a5260 legacy=0x7f342c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:29.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.980+0000 7f342affd640 1 -- 172.21.15.91:0/735064993 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c0c61c0 con 0x7f342c14fd30 2023-11-27T20:45:29.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.981+0000 7f342affd640 1 --2- 172.21.15.91:0/735064993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c14fd30 0x7f342c152f20 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f342c06b460 tx=0x7f341c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34225807a4fa0171 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:29.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3429ffb640 1 -- 172.21.15.91:0/735064993 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c031870 con 0x7f342c14fd30 2023-11-27T20:45:29.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3429ffb640 1 -- 172.21.15.91:0/735064993 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c0319d0 con 0x7f342c14fd30 2023-11-27T20:45:29.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3429ffb640 1 -- 172.21.15.91:0/735064993 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c031d60 con 0x7f342c14fd30 2023-11-27T20:45:29.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3431848640 1 -- 172.21.15.91:0/735064993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c14fd30 msgr2=0x7f342c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3431848640 1 --2- 172.21.15.91:0/735064993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c14fd30 0x7f342c152f20 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f342c06b460 tx=0x7f341c02b910 comp rx=0 tx=0).stop 2023-11-27T20:45:29.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3431848640 1 -- 172.21.15.91:0/735064993 shutdown_connections 2023-11-27T20:45:29.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3431848640 1 --2- 172.21.15.91:0/735064993 >> v2:172.21.15.183:3300/0 conn(0x7f342c06d0a0 0x7f342c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3431848640 1 --2- 172.21.15.91:0/735064993 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c14fd30 0x7f342c152f20 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3431848640 1 -- 172.21.15.91:0/735064993 >> 172.21.15.91:0/735064993 conn(0x7f342c06a500 msgr2=0x7f342c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:29.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3431848640 1 -- 172.21.15.91:0/735064993 shutdown_connections 2023-11-27T20:45:29.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.982+0000 7f3431848640 1 -- 172.21.15.91:0/735064993 wait complete. 2023-11-27T20:45:29.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.984+0000 7f3431848640 1 Processor -- start 2023-11-27T20:45:29.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.984+0000 7f3431848640 1 -- start start 2023-11-27T20:45:29.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.985+0000 7f3431848640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f342c06d0a0 0x7f342c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.985+0000 7f3431848640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c0a5260 0x7f342c151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.985+0000 7f3431848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342c14fd30 0x7f342c1ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.985+0000 7f3431848640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c1ed760 con 0x7f342c0a5260 2023-11-27T20:45:29.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.985+0000 7f3431848640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c1ee000 con 0x7f342c06d0a0 2023-11-27T20:45:29.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.985+0000 7f3431848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c1de8a0 con 0x7f342c14fd30 2023-11-27T20:45:29.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.985+0000 7f342a7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c0a5260 0x7f342c151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.986+0000 7f342a7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c0a5260 0x7f342c151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37160/0 (socket says 172.21.15.91:37160) 2023-11-27T20:45:29.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.986+0000 7f342a7fc640 1 -- 172.21.15.91:0/1247296278 learned_addr learned my addr 172.21.15.91:0/1247296278 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:29.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.986+0000 7f342affd640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f342c06d0a0 0x7f342c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.986+0000 7f342b7fe640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342c14fd30 0x7f342c1ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.986+0000 7f342a7fc640 1 -- 172.21.15.91:0/1247296278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342c14fd30 msgr2=0x7f342c1ea1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.986+0000 7f342a7fc640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342c14fd30 0x7f342c1ea1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.986+0000 7f342a7fc640 1 -- 172.21.15.91:0/1247296278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f342c06d0a0 msgr2=0x7f342c14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:29.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.986+0000 7f342a7fc640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f342c06d0a0 0x7f342c14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:29.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.986+0000 7f342a7fc640 1 -- 172.21.15.91:0/1247296278 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0094d0 con 0x7f342c0a5260 2023-11-27T20:45:29.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.986+0000 7f342a7fc640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c0a5260 0x7f342c151c80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f342000b480 tx=0x7f342000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:29.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.987+0000 7f3413fff640 1 -- 172.21.15.91:0/1247296278 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420010870 con 0x7f342c0a5260 2023-11-27T20:45:29.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.987+0000 7f3413fff640 1 -- 172.21.15.91:0/1247296278 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34200109d0 con 0x7f342c0a5260 2023-11-27T20:45:29.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.987+0000 7f3413fff640 1 -- 172.21.15.91:0/1247296278 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420010d80 con 0x7f342c0a5260 2023-11-27T20:45:29.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.987+0000 7f3431848640 1 -- 172.21.15.91:0/1247296278 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c1dc6f0 con 0x7f342c0a5260 2023-11-27T20:45:29.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.987+0000 7f3431848640 1 -- 172.21.15.91:0/1247296278 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342c1edc90 con 0x7f342c0a5260 2023-11-27T20:45:29.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.988+0000 7f3431848640 1 -- 172.21.15.91:0/1247296278 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342c068350 con 0x7f342c0a5260 2023-11-27T20:45:29.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.989+0000 7f3413fff640 1 -- 172.21.15.91:0/1247296278 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f342000f3c0 con 0x7f342c0a5260 2023-11-27T20:45:29.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.990+0000 7f3413fff640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f341806b1c0 0x7f341806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:29.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.990+0000 7f3413fff640 1 -- 172.21.15.91:0/1247296278 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f3420089e20 con 0x7f342c0a5260 2023-11-27T20:45:29.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.990+0000 7f342affd640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f341806b1c0 0x7f341806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:29.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.991+0000 7f342affd640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f341806b1c0 0x7f341806d680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f341c036000 tx=0x7f341c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:29.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:29.994+0000 7f3413fff640 1 -- 172.21.15.91:0/1247296278 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f34200547b0 con 0x7f342c0a5260 2023-11-27T20:45:30.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.186+0000 7f3431848640 1 -- 172.21.15.91:0/1247296278 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f342c1ee140 con 0x7f342c0a5260 2023-11-27T20:45:30.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.187+0000 7f3413fff640 1 -- 172.21.15.91:0/1247296278 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v81) v1 ==== 105+0+11 (secure 0 0 0) 0x7f342001e020 con 0x7f342c0a5260 2023-11-27T20:45:30.188 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:30.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 -- 172.21.15.91:0/1247296278 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f341806b1c0 msgr2=0x7f341806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f341806b1c0 0x7f341806d680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f341c036000 tx=0x7f341c03c040 comp rx=0 tx=0).stop 2023-11-27T20:45:30.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 -- 172.21.15.91:0/1247296278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c0a5260 msgr2=0x7f342c151c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c0a5260 0x7f342c151c80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f342000b480 tx=0x7f342000b940 comp rx=0 tx=0).stop 2023-11-27T20:45:30.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 -- 172.21.15.91:0/1247296278 shutdown_connections 2023-11-27T20:45:30.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342c14fd30 0x7f342c1ea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342c0a5260 0x7f342c151c80 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f341806b1c0 0x7f341806d680 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 --2- 172.21.15.91:0/1247296278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f342c06d0a0 0x7f342c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 -- 172.21.15.91:0/1247296278 >> 172.21.15.91:0/1247296278 conn(0x7f342c06a500 msgr2=0x7f342c0c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:30.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 -- 172.21.15.91:0/1247296278 shutdown_connections 2023-11-27T20:45:30.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.189+0000 7f3431848640 1 -- 172.21.15.91:0/1247296278 wait complete. 2023-11-27T20:45:30.209 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:45:30.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.424+0000 7fa434675640 1 Processor -- start 2023-11-27T20:45:30.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.424+0000 7fa434675640 1 -- start start 2023-11-27T20:45:30.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.425+0000 7fa434675640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa42c152f20 0x7fa42c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.425+0000 7fa434675640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0c64a0 con 0x7fa42c14fd30 2023-11-27T20:45:30.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.425+0000 7fa434675640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0c5c00 con 0x7fa42c06d0a0 2023-11-27T20:45:30.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.425+0000 7fa434675640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0c5ee0 con 0x7fa42c152f20 2023-11-27T20:45:30.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.426+0000 7fa432c12640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa42c152f20 0x7fa42c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:30.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.426+0000 7fa432411640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fa42c14fd30 0x7fa42c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53338/0 (socket says 172.21.15.91:53338) 2023-11-27T20:45:30.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.426+0000 7fa432411640 1 -- 172.21.15.91:0/1485167536 learned_addr learned my addr 172.21.15.91:0/1485167536 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:30.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.426+0000 7fa432c12640 1 -- 172.21.15.91:0/1485167536 >> v1:172.21.15.183:6789/0 conn(0x7fa42c06d0a0 legacy=0x7fa42c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:30.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.426+0000 7fa432c12640 1 -- 172.21.15.91:0/1485167536 >> v1:172.21.15.91:6789/0 conn(0x7fa42c14fd30 legacy=0x7fa42c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.426+0000 7fa432c12640 1 -- 172.21.15.91:0/1485167536 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0c61c0 con 0x7fa42c152f20 2023-11-27T20:45:30.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.427+0000 7fa432c12640 1 --2- 172.21.15.91:0/1485167536 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 0x7fa42c0c45b0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fa4240097a0 tx=0x7fa42402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d679e46d5f237ca4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:30.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.428+0000 7fa43140f640 1 -- 172.21.15.91:0/1485167536 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424031830 con 0x7fa42c152f20 2023-11-27T20:45:30.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.428+0000 7fa43140f640 1 -- 172.21.15.91:0/1485167536 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424031990 con 0x7fa42c152f20 2023-11-27T20:45:30.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.428+0000 7fa43140f640 1 -- 172.21.15.91:0/1485167536 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424031d20 con 0x7fa42c152f20 2023-11-27T20:45:30.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.428+0000 7fa434675640 1 -- 172.21.15.91:0/1485167536 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 msgr2=0x7fa42c0c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.428+0000 7fa434675640 1 --2- 172.21.15.91:0/1485167536 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 0x7fa42c0c45b0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fa4240097a0 tx=0x7fa42402b8d0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.428+0000 7fa434675640 1 -- 172.21.15.91:0/1485167536 shutdown_connections 2023-11-27T20:45:30.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.428+0000 7fa434675640 1 --2- 172.21.15.91:0/1485167536 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 0x7fa42c0c45b0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.428+0000 7fa434675640 1 -- 172.21.15.91:0/1485167536 >> 172.21.15.91:0/1485167536 conn(0x7fa42c06a500 msgr2=0x7fa42c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:30.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.429+0000 7fa434675640 1 -- 172.21.15.91:0/1485167536 shutdown_connections 2023-11-27T20:45:30.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.429+0000 7fa434675640 1 -- 172.21.15.91:0/1485167536 wait complete. 2023-11-27T20:45:30.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.430+0000 7fa434675640 1 Processor -- start 2023-11-27T20:45:30.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.430+0000 7fa434675640 1 -- start start 2023-11-27T20:45:30.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.431+0000 7fa434675640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa42c06d0a0 0x7fa42c1dc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.431+0000 7fa434675640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42c14fd30 0x7fa42c1e8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.431+0000 7fa434675640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 0x7fa42c0c2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.431+0000 7fa434675640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c1e8f40 con 0x7fa42c152f20 2023-11-27T20:45:30.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.431+0000 7fa434675640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c1eb4f0 con 0x7fa42c14fd30 2023-11-27T20:45:30.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.431+0000 7fa434675640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c1ebd90 con 0x7fa42c06d0a0 2023-11-27T20:45:30.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.431+0000 7fa432c12640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 0x7fa42c0c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:30.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.431+0000 7fa432c12640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 0x7fa42c0c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37174/0 (socket says 172.21.15.91:37174) 2023-11-27T20:45:30.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.431+0000 7fa432c12640 1 -- 172.21.15.91:0/2713659895 learned_addr learned my addr 172.21.15.91:0/2713659895 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:30.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa432411640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa42c06d0a0 0x7fa42c1dc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:30.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa431c10640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42c14fd30 0x7fa42c1e8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:30.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa432c12640 1 -- 172.21.15.91:0/2713659895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa42c06d0a0 msgr2=0x7fa42c1dc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa432c12640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa42c06d0a0 0x7fa42c1dc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa432c12640 1 -- 172.21.15.91:0/2713659895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42c14fd30 msgr2=0x7fa42c1e8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa432c12640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42c14fd30 0x7fa42c1e8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa432c12640 1 -- 172.21.15.91:0/2713659895 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424009400 con 0x7fa42c152f20 2023-11-27T20:45:30.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa432411640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa42c06d0a0 0x7fa42c1dc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:30.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa431c10640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42c14fd30 0x7fa42c1e8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:30.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa432c12640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 0x7fa42c0c2390 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fa4240097a0 tx=0x7fa4240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:30.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.432+0000 7fa42affd640 1 -- 172.21.15.91:0/2713659895 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42403a9e0 con 0x7fa42c152f20 2023-11-27T20:45:30.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.433+0000 7fa42affd640 1 -- 172.21.15.91:0/2713659895 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42403ab40 con 0x7fa42c152f20 2023-11-27T20:45:30.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.433+0000 7fa42affd640 1 -- 172.21.15.91:0/2713659895 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4240443f0 con 0x7fa42c152f20 2023-11-27T20:45:30.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.433+0000 7fa434675640 1 -- 172.21.15.91:0/2713659895 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c1dcd20 con 0x7fa42c152f20 2023-11-27T20:45:30.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.433+0000 7fa434675640 1 -- 172.21.15.91:0/2713659895 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c1eba20 con 0x7fa42c152f20 2023-11-27T20:45:30.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.434+0000 7fa434675640 1 -- 172.21.15.91:0/2713659895 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c1ebbe0 con 0x7fa42c152f20 2023-11-27T20:45:30.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.435+0000 7fa42affd640 1 -- 172.21.15.91:0/2713659895 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa42404d450 con 0x7fa42c152f20 2023-11-27T20:45:30.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.436+0000 7fa42affd640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa41006b1c0 0x7fa41006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.436+0000 7fa42affd640 1 -- 172.21.15.91:0/2713659895 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fa4240abe90 con 0x7fa42c152f20 2023-11-27T20:45:30.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.436+0000 7fa432411640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa41006b1c0 0x7fa41006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:30.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.436+0000 7fa432411640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa41006b1c0 0x7fa41006d680 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa420005c00 tx=0x7fa420009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:30.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.440+0000 7fa42affd640 1 -- 172.21.15.91:0/2713659895 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa4240768a0 con 0x7fa42c152f20 2023-11-27T20:45:30.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.633+0000 7fa434675640 1 -- 172.21.15.91:0/2713659895 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa42c1ebf00 con 0x7fa42c152f20 2023-11-27T20:45:30.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.634+0000 7fa42affd640 1 -- 172.21.15.91:0/2713659895 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v81) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa424035020 con 0x7fa42c152f20 2023-11-27T20:45:30.636 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 -- 172.21.15.91:0/2713659895 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa41006b1c0 msgr2=0x7fa41006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa41006b1c0 0x7fa41006d680 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa420005c00 tx=0x7fa420009040 comp rx=0 tx=0).stop 2023-11-27T20:45:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 -- 172.21.15.91:0/2713659895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 msgr2=0x7fa42c0c2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 0x7fa42c0c2390 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fa4240097a0 tx=0x7fa4240046c0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 -- 172.21.15.91:0/2713659895 shutdown_connections 2023-11-27T20:45:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42c152f20 0x7fa42c0c2390 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa41006b1c0 0x7fa41006d680 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa42c14fd30 0x7fa42c1e8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 --2- 172.21.15.91:0/2713659895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa42c06d0a0 0x7fa42c1dc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 -- 172.21.15.91:0/2713659895 >> 172.21.15.91:0/2713659895 conn(0x7fa42c06a500 msgr2=0x7fa42c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:30.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 -- 172.21.15.91:0/2713659895 shutdown_connections 2023-11-27T20:45:30.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.637+0000 7fa434675640 1 -- 172.21.15.91:0/2713659895 wait complete. 2023-11-27T20:45:30.658 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:45:30.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.858+0000 7fec613ec640 1 Processor -- start 2023-11-27T20:45:30.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.858+0000 7fec613ec640 1 -- start start 2023-11-27T20:45:30.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.860+0000 7fec613ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec5c06d0a0 0x7fec5c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.860+0000 7fec613ec640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fec5c0c3ea0 0x7fec5c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.860+0000 7fec613ec640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0c64a0 con 0x7fec5c14fd30 2023-11-27T20:45:30.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.860+0000 7fec613ec640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0c5c00 con 0x7fec5c0c3ea0 2023-11-27T20:45:30.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.860+0000 7fec613ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c5ee0 con 0x7fec5c06d0a0 2023-11-27T20:45:30.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.860+0000 7fec5b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fec5c0c3ea0 0x7fec5c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:30.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.860+0000 7fec5b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fec5c0c3ea0 0x7fec5c0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37182/0 (socket says 172.21.15.91:37182) 2023-11-27T20:45:30.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.860+0000 7fec5b7fe640 1 -- 172.21.15.91:0/2803386885 learned_addr learned my addr 172.21.15.91:0/2803386885 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:30.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.861+0000 7fec527fc640 1 --2- 172.21.15.91:0/2803386885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec5c06d0a0 0x7fec5c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:30.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.861+0000 7fec5b7fe640 1 -- 172.21.15.91:0/2803386885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec5c06d0a0 msgr2=0x7fec5c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:30.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.861+0000 7fec5b7fe640 1 --2- 172.21.15.91:0/2803386885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec5c06d0a0 0x7fec5c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.861+0000 7fec5b7fe640 1 -- 172.21.15.91:0/2803386885 >> v1:172.21.15.183:6789/0 conn(0x7fec5c14fd30 legacy=0x7fec5c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.861+0000 7fec5b7fe640 1 -- 172.21.15.91:0/2803386885 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0c61c0 con 0x7fec5c0c3ea0 2023-11-27T20:45:30.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.862+0000 7fec5b7fe640 1 --2- 172.21.15.91:0/2803386885 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c0c3ea0 0x7fec5c0c4330 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fec54009e50 tx=0x7fec5402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c07e0d542927a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:30.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.862+0000 7fec5a7fc640 1 -- 172.21.15.91:0/2803386885 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5402cb00 con 0x7fec5c0c3ea0 2023-11-27T20:45:30.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.862+0000 7fec5a7fc640 1 -- 172.21.15.91:0/2803386885 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5402cc60 con 0x7fec5c0c3ea0 2023-11-27T20:45:30.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.862+0000 7fec5a7fc640 1 -- 172.21.15.91:0/2803386885 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec540343f0 con 0x7fec5c0c3ea0 2023-11-27T20:45:30.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.863+0000 7fec613ec640 1 -- 172.21.15.91:0/2803386885 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c0c3ea0 msgr2=0x7fec5c0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.863+0000 7fec613ec640 1 --2- 172.21.15.91:0/2803386885 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c0c3ea0 0x7fec5c0c4330 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fec54009e50 tx=0x7fec5402bf60 comp rx=0 tx=0).stop 2023-11-27T20:45:30.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.863+0000 7fec613ec640 1 -- 172.21.15.91:0/2803386885 shutdown_connections 2023-11-27T20:45:30.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.863+0000 7fec613ec640 1 --2- 172.21.15.91:0/2803386885 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c0c3ea0 0x7fec5c0c4330 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.863+0000 7fec613ec640 1 --2- 172.21.15.91:0/2803386885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec5c06d0a0 0x7fec5c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.863+0000 7fec613ec640 1 -- 172.21.15.91:0/2803386885 >> 172.21.15.91:0/2803386885 conn(0x7fec5c06a500 msgr2=0x7fec5c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:30.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.863+0000 7fec613ec640 1 -- 172.21.15.91:0/2803386885 shutdown_connections 2023-11-27T20:45:30.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.863+0000 7fec613ec640 1 -- 172.21.15.91:0/2803386885 wait complete. 2023-11-27T20:45:30.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.865+0000 7fec613ec640 1 Processor -- start 2023-11-27T20:45:30.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.865+0000 7fec613ec640 1 -- start start 2023-11-27T20:45:30.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.866+0000 7fec613ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec5c06d0a0 0x7fec5c0bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.866+0000 7fec613ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec5c0c3ea0 0x7fec5c0a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.866+0000 7fec613ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c14fd30 0x7fec5c148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.866+0000 7fec613ec640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c149a00 con 0x7fec5c14fd30 2023-11-27T20:45:30.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.866+0000 7fec613ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c1ed6c0 con 0x7fec5c06d0a0 2023-11-27T20:45:30.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.866+0000 7fec613ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c1ed9a0 con 0x7fec5c0c3ea0 2023-11-27T20:45:30.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.866+0000 7fec5b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c14fd30 0x7fec5c148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:30.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.866+0000 7fec5b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c14fd30 0x7fec5c148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37194/0 (socket says 172.21.15.91:37194) 2023-11-27T20:45:30.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.866+0000 7fec5b7fe640 1 -- 172.21.15.91:0/4268956079 learned_addr learned my addr 172.21.15.91:0/4268956079 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:30.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.867+0000 7fec5affd640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec5c06d0a0 0x7fec5c0bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:30.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.867+0000 7fec5b7fe640 1 -- 172.21.15.91:0/4268956079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec5c0c3ea0 msgr2=0x7fec5c0a9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.867+0000 7fec5b7fe640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec5c0c3ea0 0x7fec5c0a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.867+0000 7fec5b7fe640 1 -- 172.21.15.91:0/4268956079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec5c06d0a0 msgr2=0x7fec5c0bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:30.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.867+0000 7fec5b7fe640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec5c06d0a0 0x7fec5c0bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:30.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.867+0000 7fec5b7fe640 1 -- 172.21.15.91:0/4268956079 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec54009b30 con 0x7fec5c14fd30 2023-11-27T20:45:30.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.867+0000 7fec5affd640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec5c06d0a0 0x7fec5c0bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:30.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.867+0000 7fec5b7fe640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c14fd30 0x7fec5c148c80 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fec54009e50 tx=0x7fec54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:30.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.867+0000 7fec53fff640 1 -- 172.21.15.91:0/4268956079 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54009510 con 0x7fec5c14fd30 2023-11-27T20:45:30.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.868+0000 7fec53fff640 1 -- 172.21.15.91:0/4268956079 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5403e450 con 0x7fec5c14fd30 2023-11-27T20:45:30.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.868+0000 7fec613ec640 1 -- 172.21.15.91:0/4268956079 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c1edc80 con 0x7fec5c14fd30 2023-11-27T20:45:30.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.868+0000 7fec53fff640 1 -- 172.21.15.91:0/4268956079 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5403e800 con 0x7fec5c14fd30 2023-11-27T20:45:30.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.868+0000 7fec613ec640 1 -- 172.21.15.91:0/4268956079 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c0a4ed0 con 0x7fec5c14fd30 2023-11-27T20:45:30.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.869+0000 7fec613ec640 1 -- 172.21.15.91:0/4268956079 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c1edec0 con 0x7fec5c14fd30 2023-11-27T20:45:30.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.870+0000 7fec53fff640 1 -- 172.21.15.91:0/4268956079 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fec5403e960 con 0x7fec5c14fd30 2023-11-27T20:45:30.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.871+0000 7fec53fff640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec3c06b1c0 0x7fec3c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:30.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.871+0000 7fec53fff640 1 -- 172.21.15.91:0/4268956079 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fec540acaa0 con 0x7fec5c14fd30 2023-11-27T20:45:30.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.871+0000 7fec5affd640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec3c06b1c0 0x7fec3c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:30.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.872+0000 7fec5affd640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec3c06b1c0 0x7fec3c06d680 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0aae50 tx=0x7fec4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:30.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:30.875+0000 7fec53fff640 1 -- 172.21.15.91:0/4268956079 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fec5c1edec0 con 0x7fec5c14fd30 2023-11-27T20:45:31.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.080+0000 7fec613ec640 1 -- 172.21.15.91:0/4268956079 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fec5c1ede70 con 0x7fec5c14fd30 2023-11-27T20:45:31.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.081+0000 7fec53fff640 1 -- 172.21.15.91:0/4268956079 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) v1 ==== 80+0+0 (secure 0 0 0) 0x7fec540774d0 con 0x7fec5c14fd30 2023-11-27T20:45:31.082 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:45:31.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.083+0000 7fec613ec640 1 -- 172.21.15.91:0/4268956079 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec3c06b1c0 msgr2=0x7fec3c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:31.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.083+0000 7fec613ec640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec3c06b1c0 0x7fec3c06d680 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0aae50 tx=0x7fec4c009040 comp rx=0 tx=0).stop 2023-11-27T20:45:31.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.083+0000 7fec613ec640 1 -- 172.21.15.91:0/4268956079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c14fd30 msgr2=0x7fec5c148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:31.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.083+0000 7fec613ec640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c14fd30 0x7fec5c148c80 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fec54009e50 tx=0x7fec54004a40 comp rx=0 tx=0).stop 2023-11-27T20:45:31.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.084+0000 7fec613ec640 1 -- 172.21.15.91:0/4268956079 shutdown_connections 2023-11-27T20:45:31.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.084+0000 7fec613ec640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec5c14fd30 0x7fec5c148c80 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.084+0000 7fec613ec640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec5c0c3ea0 0x7fec5c0a9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.084+0000 7fec613ec640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fec3c06b1c0 0x7fec3c06d680 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.084+0000 7fec613ec640 1 --2- 172.21.15.91:0/4268956079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec5c06d0a0 0x7fec5c0bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.084+0000 7fec613ec640 1 -- 172.21.15.91:0/4268956079 >> 172.21.15.91:0/4268956079 conn(0x7fec5c06a500 msgr2=0x7fec5c1e0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:31.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.084+0000 7fec613ec640 1 -- 172.21.15.91:0/4268956079 shutdown_connections 2023-11-27T20:45:31.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.084+0000 7fec613ec640 1 -- 172.21.15.91:0/4268956079 wait complete. 2023-11-27T20:45:31.104 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-27T20:45:31.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:31.104 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:31.223 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:45:31.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:31.223 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-27T20:45:31.273 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:31.273 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:31.321 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-27T20:45:31.322 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:45:31.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.542+0000 7f11df8d0640 1 Processor -- start 2023-11-27T20:45:31.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.542+0000 7f11df8d0640 1 -- start start 2023-11-27T20:45:31.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11df8d0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f11d80c5ec0 0x7f11d80c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:31.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11df8d0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f11d80c45d0 0x7f11d80c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:31.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11df8d0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d80bfdc0 con 0x7f11d80721a0 2023-11-27T20:45:31.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11df8d0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d806e390 con 0x7f11d80c5ec0 2023-11-27T20:45:31.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11df8d0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d806ddd0 con 0x7f11d80c45d0 2023-11-27T20:45:31.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11dd66c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f11d80c5ec0 0x7f11d80c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:31.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11dd66c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f11d80c5ec0 0x7f11d80c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37202/0 (socket says 172.21.15.91:37202) 2023-11-27T20:45:31.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11dd66c640 1 -- 172.21.15.91:0/252031282 learned_addr learned my addr 172.21.15.91:0/252031282 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:31.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11dd66c640 1 -- 172.21.15.91:0/252031282 >> v2:172.21.15.183:3300/0 conn(0x7f11d80c45d0 msgr2=0x7f11d80c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:31.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11dd66c640 1 --2- 172.21.15.91:0/252031282 >> v2:172.21.15.183:3300/0 conn(0x7f11d80c45d0 0x7f11d80c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11dd66c640 1 -- 172.21.15.91:0/252031282 >> v1:172.21.15.183:6789/0 conn(0x7f11d80721a0 legacy=0x7f11d8155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:31.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.544+0000 7f11dd66c640 1 -- 172.21.15.91:0/252031282 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d806e0b0 con 0x7f11d80c5ec0 2023-11-27T20:45:31.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.545+0000 7f11dd66c640 1 --2- 172.21.15.91:0/252031282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c5ec0 0x7f11d80c2c30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f11d806b430 tx=0x7f11d402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be046d313147af3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:31.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.546+0000 7f11cffff640 1 -- 172.21.15.91:0/252031282 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4031750 con 0x7f11d80c5ec0 2023-11-27T20:45:31.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.546+0000 7f11cffff640 1 -- 172.21.15.91:0/252031282 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d40318b0 con 0x7f11d80c5ec0 2023-11-27T20:45:31.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.546+0000 7f11cffff640 1 -- 172.21.15.91:0/252031282 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4031c40 con 0x7f11d80c5ec0 2023-11-27T20:45:31.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.546+0000 7f11df8d0640 1 -- 172.21.15.91:0/252031282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c5ec0 msgr2=0x7f11d80c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:31.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.546+0000 7f11df8d0640 1 --2- 172.21.15.91:0/252031282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c5ec0 0x7f11d80c2c30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f11d806b430 tx=0x7f11d402b7f0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.546+0000 7f11df8d0640 1 -- 172.21.15.91:0/252031282 shutdown_connections 2023-11-27T20:45:31.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.546+0000 7f11df8d0640 1 --2- 172.21.15.91:0/252031282 >> v2:172.21.15.183:3300/0 conn(0x7f11d80c45d0 0x7f11d80c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.546+0000 7f11df8d0640 1 --2- 172.21.15.91:0/252031282 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c5ec0 0x7f11d80c2c30 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.546+0000 7f11df8d0640 1 -- 172.21.15.91:0/252031282 >> 172.21.15.91:0/252031282 conn(0x7f11d806a500 msgr2=0x7f11d806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:31.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.547+0000 7f11df8d0640 1 -- 172.21.15.91:0/252031282 shutdown_connections 2023-11-27T20:45:31.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.547+0000 7f11df8d0640 1 -- 172.21.15.91:0/252031282 wait complete. 2023-11-27T20:45:31.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.548+0000 7f11df8d0640 1 Processor -- start 2023-11-27T20:45:31.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.549+0000 7f11df8d0640 1 -- start start 2023-11-27T20:45:31.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11df8d0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11d80721a0 0x7f11d81ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:31.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11df8d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c45d0 0x7f11d8158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:31.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11df8d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11d80c5ec0 0x7f11d81505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:31.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11df8d0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d81ea480 con 0x7f11d80c45d0 2023-11-27T20:45:31.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11df8d0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8158dd0 con 0x7f11d80721a0 2023-11-27T20:45:31.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11df8d0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8151010 con 0x7f11d80c5ec0 2023-11-27T20:45:31.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dce6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c45d0 0x7f11d8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:31.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dce6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c45d0 0x7f11d8158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37208/0 (socket says 172.21.15.91:37208) 2023-11-27T20:45:31.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dce6b640 1 -- 172.21.15.91:0/2755719652 learned_addr learned my addr 172.21.15.91:0/2755719652 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:31.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dd66c640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11d80721a0 0x7f11d81ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:31.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dde6d640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11d80c5ec0 0x7f11d81505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:31.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dce6b640 1 -- 172.21.15.91:0/2755719652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11d80c5ec0 msgr2=0x7f11d81505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:31.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dce6b640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11d80c5ec0 0x7f11d81505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dce6b640 1 -- 172.21.15.91:0/2755719652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11d80721a0 msgr2=0x7f11d81ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:31.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dce6b640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11d80721a0 0x7f11d81ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dce6b640 1 -- 172.21.15.91:0/2755719652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d40094d0 con 0x7f11d80c45d0 2023-11-27T20:45:31.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.550+0000 7f11dd66c640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11d80721a0 0x7f11d81ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:31.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.551+0000 7f11dce6b640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c45d0 0x7f11d8158890 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f11c800b480 tx=0x7f11c800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:31.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.551+0000 7f11cdffb640 1 -- 172.21.15.91:0/2755719652 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8010870 con 0x7f11d80c45d0 2023-11-27T20:45:31.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.551+0000 7f11cdffb640 1 -- 172.21.15.91:0/2755719652 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c80109d0 con 0x7f11d80c45d0 2023-11-27T20:45:31.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.551+0000 7f11df8d0640 1 -- 172.21.15.91:0/2755719652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d81562b0 con 0x7f11d80c45d0 2023-11-27T20:45:31.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.551+0000 7f11cdffb640 1 -- 172.21.15.91:0/2755719652 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8010d80 con 0x7f11d80c45d0 2023-11-27T20:45:31.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.551+0000 7f11df8d0640 1 -- 172.21.15.91:0/2755719652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d81ea110 con 0x7f11d80c45d0 2023-11-27T20:45:31.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.552+0000 7f11df8d0640 1 -- 172.21.15.91:0/2755719652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d81ea630 con 0x7f11d80c45d0 2023-11-27T20:45:31.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.553+0000 7f11cdffb640 1 -- 172.21.15.91:0/2755719652 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f11c800f3c0 con 0x7f11d80c45d0 2023-11-27T20:45:31.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.555+0000 7f11cdffb640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f11bc06b1c0 0x7f11bc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:31.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.555+0000 7f11cdffb640 1 -- 172.21.15.91:0/2755719652 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f11c8089d60 con 0x7f11d80c45d0 2023-11-27T20:45:31.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.555+0000 7f11dd66c640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f11bc06b1c0 0x7f11bc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:31.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.556+0000 7f11dd66c640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f11bc06b1c0 0x7f11bc06d680 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f11d4035000 tx=0x7f11d4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:31.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.559+0000 7f11cdffb640 1 -- 172.21.15.91:0/2755719652 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f11d81ea630 con 0x7f11d80c45d0 2023-11-27T20:45:31.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.793+0000 7f11df8d0640 1 -- 172.21.15.91:0/2755719652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f11d81ea630 con 0x7f11d80c45d0 2023-11-27T20:45:31.795 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.794+0000 7f11cdffb640 1 -- 172.21.15.91:0/2755719652 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7f11c801e0b0 con 0x7f11d80c45d0 2023-11-27T20:45:31.795 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:45:31.795 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-27T20:45:31.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.796+0000 7f11df8d0640 1 -- 172.21.15.91:0/2755719652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f11bc06b1c0 msgr2=0x7f11bc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:31.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.796+0000 7f11df8d0640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f11bc06b1c0 0x7f11bc06d680 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f11d4035000 tx=0x7f11d4008030 comp rx=0 tx=0).stop 2023-11-27T20:45:31.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.796+0000 7f11df8d0640 1 -- 172.21.15.91:0/2755719652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c45d0 msgr2=0x7f11d8158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:31.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.796+0000 7f11df8d0640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c45d0 0x7f11d8158890 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f11c800b480 tx=0x7f11c800b940 comp rx=0 tx=0).stop 2023-11-27T20:45:31.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.796+0000 7f11df8d0640 1 -- 172.21.15.91:0/2755719652 shutdown_connections 2023-11-27T20:45:31.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.796+0000 7f11df8d0640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11d80c5ec0 0x7f11d81505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.797+0000 7f11df8d0640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11d80c45d0 0x7f11d8158890 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.797+0000 7f11df8d0640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f11bc06b1c0 0x7f11bc06d680 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.797+0000 7f11df8d0640 1 --2- 172.21.15.91:0/2755719652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11d80721a0 0x7f11d81ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:31.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.797+0000 7f11df8d0640 1 -- 172.21.15.91:0/2755719652 >> 172.21.15.91:0/2755719652 conn(0x7f11d806a500 msgr2=0x7f11d80c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:31.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.797+0000 7f11df8d0640 1 -- 172.21.15.91:0/2755719652 shutdown_connections 2023-11-27T20:45:31.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:31.797+0000 7f11df8d0640 1 -- 172.21.15.91:0/2755719652 wait complete. 2023-11-27T20:45:31.816 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-27T20:45:31.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:45:31.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-27T20:45:31.816 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-27T20:45:31.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:31.816 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-27T20:45:31.816 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:45:31.816 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T20:45:31.817 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:45:31.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:31.817 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-27T20:45:31.878 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:45:31.878 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:45:31.878 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:45:31.878 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:31.878 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:31.879 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42127sec preferred_lft 42127sec 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8479:57ff:fe06:e35b/64 scope link 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T20:45:31.880 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::40e4:26ff:fe7f:e25/64 scope link 2023-11-27T20:45:31.881 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:31.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:31.882 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:45:31.978 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-27T20:45:31.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:31.982 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-27T20:45:32.034 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-27T20:45:32.034 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:45:32.034 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:45:32.034 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:45:32.034 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:45:32.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:32.035 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:45:32.035 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:45:32.035 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:45:32.035 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:45:32.035 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:45:32.035 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:45:32.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:32.217 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-27T20:45:32.268 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-27T20:45:32.268 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:45:32.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:32.269 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-11-27T20:45:32.362 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:45:32.363 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:32.419 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:45:32.420 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:45:32.420 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:32.470 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:45:32.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:32.471 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:45:32.623 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:45:32.623 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-27T20:45:32.623 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:45:32.644 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:45:32.644 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-27T20:45:32.645 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:45:32.645 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:45:32.645 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:45:32.672 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-11-27T20:45:32.672 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-11-27T20:45:32.672 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:45:32.672 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:45:32.672 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:45:32.672 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:45:32.673 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:45:32.673 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:45:32.675 INFO:teuthology.orchestra.run.smithi183.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-27T20:45:32.675 INFO:teuthology.orchestra.run.smithi183.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:45:32.675 INFO:teuthology.orchestra.run.smithi183.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:45:32.675 INFO:teuthology.orchestra.run.smithi183.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:45:32.675 INFO:teuthology.orchestra.run.smithi183.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:45:32.680 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:45:32.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:32.680 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:32.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:32.759 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:45:32.839 INFO:teuthology.orchestra.run.smithi183.stdout:client4967 2023-11-27T20:45:32.839 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:32.839 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:32.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:32.900 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-11-27T20:45:32.972 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:32.972 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-11-27T20:45:33.038 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:33.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:33.038 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-11-27T20:45:33.121 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:33.121 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-11-27T20:45:33.188 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:33.188 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-11-27T20:45:33.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.404+0000 7f80f3761640 1 Processor -- start 2023-11-27T20:45:33.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.404+0000 7f80f3761640 1 -- start start 2023-11-27T20:45:33.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.405+0000 7f80f3761640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80ec155490 0x7f80ec0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.405+0000 7f80f3761640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c1500 0x7f80ec0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.405+0000 7f80f3761640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f80ec0c4080 0x7f80ec0a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.405+0000 7f80f3761640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec0a5820 con 0x7f80ec155490 2023-11-27T20:45:33.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.405+0000 7f80f3761640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec0c06c0 con 0x7f80ec0c4080 2023-11-27T20:45:33.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.405+0000 7f80f3761640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0c1020 con 0x7f80ec0c1500 2023-11-27T20:45:33.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f14fd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80ec155490 0x7f80ec0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f14fd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80ec155490 0x7f80ec0a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37212/0 (socket says 172.21.15.91:37212) 2023-11-27T20:45:33.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f14fd640 1 -- 172.21.15.91:0/1980061194 learned_addr learned my addr 172.21.15.91:0/1980061194 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:33.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f1cfe640 1 --2- 172.21.15.91:0/1980061194 >> v2:172.21.15.183:3300/0 conn(0x7f80ec0c4080 0x7f80ec0a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f0cfc640 1 --2- 172.21.15.91:0/1980061194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c1500 0x7f80ec0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f14fd640 1 -- 172.21.15.91:0/1980061194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c1500 msgr2=0x7f80ec0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:33.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f14fd640 1 --2- 172.21.15.91:0/1980061194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c1500 0x7f80ec0a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f14fd640 1 -- 172.21.15.91:0/1980061194 >> v2:172.21.15.183:3300/0 conn(0x7f80ec0c4080 msgr2=0x7f80ec0a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:33.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f14fd640 1 --2- 172.21.15.91:0/1980061194 >> v2:172.21.15.183:3300/0 conn(0x7f80ec0c4080 0x7f80ec0a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f14fd640 1 -- 172.21.15.91:0/1980061194 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0c0910 con 0x7f80ec155490 2023-11-27T20:45:33.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.406+0000 7f80f1cfe640 1 --2- 172.21.15.91:0/1980061194 >> v2:172.21.15.183:3300/0 conn(0x7f80ec0c4080 0x7f80ec0a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:33.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.408+0000 7f80f14fd640 1 --2- 172.21.15.91:0/1980061194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 0x7f80ec0a51b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0c3e00 tx=0x7f80e802e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862cbb1d2cb0428e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:33.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.408+0000 7f80e3fff640 1 -- 172.21.15.91:0/1980061194 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e802edf0 con 0x7f80ec155490 2023-11-27T20:45:33.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.408+0000 7f80e3fff640 1 -- 172.21.15.91:0/1980061194 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e8036440 con 0x7f80ec155490 2023-11-27T20:45:33.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.408+0000 7f80e3fff640 1 -- 172.21.15.91:0/1980061194 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80367d0 con 0x7f80ec155490 2023-11-27T20:45:33.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.408+0000 7f80f3761640 1 -- 172.21.15.91:0/1980061194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 msgr2=0x7f80ec0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:33.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.408+0000 7f80f3761640 1 --2- 172.21.15.91:0/1980061194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 0x7f80ec0a51b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0c3e00 tx=0x7f80e802e040 comp rx=0 tx=0).stop 2023-11-27T20:45:33.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.409+0000 7f80f3761640 1 -- 172.21.15.91:0/1980061194 shutdown_connections 2023-11-27T20:45:33.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.409+0000 7f80f3761640 1 --2- 172.21.15.91:0/1980061194 >> v2:172.21.15.183:3300/0 conn(0x7f80ec0c4080 0x7f80ec0a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.409+0000 7f80f3761640 1 --2- 172.21.15.91:0/1980061194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c1500 0x7f80ec0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.409+0000 7f80f3761640 1 --2- 172.21.15.91:0/1980061194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 0x7f80ec0a51b0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.409+0000 7f80f3761640 1 -- 172.21.15.91:0/1980061194 >> 172.21.15.91:0/1980061194 conn(0x7f80ec06a500 msgr2=0x7f80ec06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:33.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.409+0000 7f80f3761640 1 -- 172.21.15.91:0/1980061194 shutdown_connections 2023-11-27T20:45:33.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.409+0000 7f80f3761640 1 -- 172.21.15.91:0/1980061194 wait complete. 2023-11-27T20:45:33.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.410+0000 7f80f3761640 1 Processor -- start 2023-11-27T20:45:33.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.411+0000 7f80f3761640 1 -- start start 2023-11-27T20:45:33.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.411+0000 7f80f3761640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80ec0c1500 0x7f80ec070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.411+0000 7f80f3761640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c4080 0x7f80ec14bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f3761640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 0x7f80ec14c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f3761640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0a9b80 con 0x7f80ec155490 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f3761640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec071f70 con 0x7f80ec0c1500 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f3761640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec072250 con 0x7f80ec0c4080 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f1cfe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 0x7f80ec14c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f1cfe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 0x7f80ec14c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:37216/0 (socket says 172.21.15.91:37216) 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f1cfe640 1 -- 172.21.15.91:0/1366056335 learned_addr learned my addr 172.21.15.91:0/1366056335 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f1cfe640 1 -- 172.21.15.91:0/1366056335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c4080 msgr2=0x7f80ec14bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f0cfc640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c4080 0x7f80ec14bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f14fd640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80ec0c1500 0x7f80ec070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f1cfe640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c4080 0x7f80ec14bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f1cfe640 1 -- 172.21.15.91:0/1366056335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80ec0c1500 msgr2=0x7f80ec070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:33.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f1cfe640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80ec0c1500 0x7f80ec070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f1cfe640 1 -- 172.21.15.91:0/1366056335 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e800b770 con 0x7f80ec155490 2023-11-27T20:45:33.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.412+0000 7f80f0cfc640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c4080 0x7f80ec14bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:33.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.413+0000 7f80f1cfe640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 0x7f80ec14c480 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f80e400cef0 tx=0x7f80e400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:33.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.413+0000 7f80e1ffb640 1 -- 172.21.15.91:0/1366056335 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400d840 con 0x7f80ec155490 2023-11-27T20:45:33.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.413+0000 7f80e1ffb640 1 -- 172.21.15.91:0/1366056335 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e400d9c0 con 0x7f80ec155490 2023-11-27T20:45:33.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.413+0000 7f80f3761640 1 -- 172.21.15.91:0/1366056335 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec14e200 con 0x7f80ec155490 2023-11-27T20:45:33.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.413+0000 7f80e1ffb640 1 -- 172.21.15.91:0/1366056335 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400dd70 con 0x7f80ec155490 2023-11-27T20:45:33.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.413+0000 7f80f3761640 1 -- 172.21.15.91:0/1366056335 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec1ee0b0 con 0x7f80ec155490 2023-11-27T20:45:33.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.414+0000 7f80f3761640 1 -- 172.21.15.91:0/1366056335 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec14e720 con 0x7f80ec155490 2023-11-27T20:45:33.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.415+0000 7f80e1ffb640 1 -- 172.21.15.91:0/1366056335 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f80e401d360 con 0x7f80ec155490 2023-11-27T20:45:33.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.417+0000 7f80e1ffb640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 0x7f80d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.417+0000 7f80e1ffb640 1 -- 172.21.15.91:0/1366056335 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f80e408a900 con 0x7f80ec155490 2023-11-27T20:45:33.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.417+0000 7f80f14fd640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 0x7f80d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.417+0000 7f80f14fd640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 0x7f80d006d680 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f80e8038000 tx=0x7f80e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:33.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.421+0000 7f80e1ffb640 1 -- 172.21.15.91:0/1366056335 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f80ec14e720 con 0x7f80ec155490 2023-11-27T20:45:33.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.669+0000 7f80f3761640 1 -- 172.21.15.91:0/1366056335 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7f80ec14e720 con 0x7f80ec155490 2023-11-27T20:45:33.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.674+0000 7f80e1ffb640 1 -- 172.21.15.91:0/1366056335 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v25) v1 ==== 272+0+0 (secure 0 0 0) 0x7f80ec14e720 con 0x7f80ec155490 2023-11-27T20:45:33.675 INFO:teuthology.orchestra.run.smithi091.stderr:added key for client.testuser 2023-11-27T20:45:33.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 -- 172.21.15.91:0/1366056335 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 msgr2=0x7f80d006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:33.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 0x7f80d006d680 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f80e8038000 tx=0x7f80e8008040 comp rx=0 tx=0).stop 2023-11-27T20:45:33.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 -- 172.21.15.91:0/1366056335 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 msgr2=0x7f80ec14c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:33.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 0x7f80ec14c480 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f80e400cef0 tx=0x7f80e400a710 comp rx=0 tx=0).stop 2023-11-27T20:45:33.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 -- 172.21.15.91:0/1366056335 shutdown_connections 2023-11-27T20:45:33.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80ec155490 0x7f80ec14c480 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80ec0c4080 0x7f80ec14bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80d006b1c0 0x7f80d006d680 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 --2- 172.21.15.91:0/1366056335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80ec0c1500 0x7f80ec070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 -- 172.21.15.91:0/1366056335 >> 172.21.15.91:0/1366056335 conn(0x7f80ec06a500 msgr2=0x7f80ec0c5440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:33.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 -- 172.21.15.91:0/1366056335 shutdown_connections 2023-11-27T20:45:33.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.676+0000 7f80f3761640 1 -- 172.21.15.91:0/1366056335 wait complete. 2023-11-27T20:45:33.694 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-11-27T20:45:33.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.886+0000 7ff8d066e640 1 Processor -- start 2023-11-27T20:45:33.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.887+0000 7ff8d066e640 1 -- start start 2023-11-27T20:45:33.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.888+0000 7ff8d066e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8c814fd30 0x7ff8c8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.888+0000 7ff8d066e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff8c806d0a0 0x7ff8c80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.888+0000 7ff8d066e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8c80a5260 0x7ff8c80c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.888+0000 7ff8d066e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c80c64a0 con 0x7ff8c814fd30 2023-11-27T20:45:33.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.888+0000 7ff8d066e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c80c5c00 con 0x7ff8c806d0a0 2023-11-27T20:45:33.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.888+0000 7ff8d066e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80c5ee0 con 0x7ff8c80a5260 2023-11-27T20:45:33.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.888+0000 7ff8ce40a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8c814fd30 0x7ff8c8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.888+0000 7ff8ce40a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8c814fd30 0x7ff8c8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38622/0 (socket says 172.21.15.91:38622) 2023-11-27T20:45:33.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.888+0000 7ff8ce40a640 1 -- 172.21.15.91:0/1143002355 learned_addr learned my addr 172.21.15.91:0/1143002355 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:33.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.889+0000 7ff8ce40a640 1 -- 172.21.15.91:0/1143002355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8c80a5260 msgr2=0x7ff8c80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:33.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.889+0000 7ff8ce40a640 1 --2- 172.21.15.91:0/1143002355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8c80a5260 0x7ff8c80c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.889+0000 7ff8ce40a640 1 -- 172.21.15.91:0/1143002355 >> v2:172.21.15.183:3300/0 conn(0x7ff8c806d0a0 msgr2=0x7ff8c80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:33.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.889+0000 7ff8ce40a640 1 --2- 172.21.15.91:0/1143002355 >> v2:172.21.15.183:3300/0 conn(0x7ff8c806d0a0 0x7ff8c80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.889+0000 7ff8ce40a640 1 -- 172.21.15.91:0/1143002355 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80c61c0 con 0x7ff8c814fd30 2023-11-27T20:45:33.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.890+0000 7ff8ce40a640 1 --2- 172.21.15.91:0/1143002355 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c814fd30 0x7ff8c8152f20 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ff8c806b460 tx=0x7ff8bc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a04334e2b796320 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:33.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.890+0000 7ff8cd408640 1 -- 172.21.15.91:0/1143002355 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc02ca80 con 0x7ff8c814fd30 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.890+0000 7ff8cd408640 1 -- 172.21.15.91:0/1143002355 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc02cbe0 con 0x7ff8c814fd30 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.890+0000 7ff8cd408640 1 -- 172.21.15.91:0/1143002355 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0343f0 con 0x7ff8c814fd30 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.890+0000 7ff8d066e640 1 -- 172.21.15.91:0/1143002355 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c814fd30 msgr2=0x7ff8c8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.890+0000 7ff8d066e640 1 --2- 172.21.15.91:0/1143002355 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c814fd30 0x7ff8c8152f20 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ff8c806b460 tx=0x7ff8bc02bee0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.891+0000 7ff8d066e640 1 -- 172.21.15.91:0/1143002355 shutdown_connections 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.891+0000 7ff8d066e640 1 --2- 172.21.15.91:0/1143002355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8c80a5260 0x7ff8c80c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.891+0000 7ff8d066e640 1 --2- 172.21.15.91:0/1143002355 >> v2:172.21.15.183:3300/0 conn(0x7ff8c806d0a0 0x7ff8c80a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.891+0000 7ff8d066e640 1 --2- 172.21.15.91:0/1143002355 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c814fd30 0x7ff8c8152f20 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.891+0000 7ff8d066e640 1 -- 172.21.15.91:0/1143002355 >> 172.21.15.91:0/1143002355 conn(0x7ff8c806a500 msgr2=0x7ff8c806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.891+0000 7ff8d066e640 1 -- 172.21.15.91:0/1143002355 shutdown_connections 2023-11-27T20:45:33.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.891+0000 7ff8d066e640 1 -- 172.21.15.91:0/1143002355 wait complete. 2023-11-27T20:45:33.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.892+0000 7ff8d066e640 1 Processor -- start 2023-11-27T20:45:33.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.892+0000 7ff8d066e640 1 -- start start 2023-11-27T20:45:33.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.893+0000 7ff8d066e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8c806d0a0 0x7ff8c8149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.893+0000 7ff8d066e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c80a5260 0x7ff8c81ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.893+0000 7ff8d066e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8c814fd30 0x7ff8c80710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.893+0000 7ff8d066e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c81509c0 con 0x7ff8c80a5260 2023-11-27T20:45:33.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.893+0000 7ff8d066e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c81499b0 con 0x7ff8c806d0a0 2023-11-27T20:45:33.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.893+0000 7ff8d066e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80aac60 con 0x7ff8c814fd30 2023-11-27T20:45:33.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.893+0000 7ff8cdc09640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c80a5260 0x7ff8c81ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8cdc09640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c80a5260 0x7ff8c81ed660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38630/0 (socket says 172.21.15.91:38630) 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8cdc09640 1 -- 172.21.15.91:0/2210060457 learned_addr learned my addr 172.21.15.91:0/2210060457 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8cdc09640 1 -- 172.21.15.91:0/2210060457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8c814fd30 msgr2=0x7ff8c80710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8ce40a640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8c806d0a0 0x7ff8c8149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8cec0b640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8c814fd30 0x7ff8c80710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8cdc09640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8c814fd30 0x7ff8c80710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8cdc09640 1 -- 172.21.15.91:0/2210060457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8c806d0a0 msgr2=0x7ff8c8149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8cdc09640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8c806d0a0 0x7ff8c8149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8cdc09640 1 -- 172.21.15.91:0/2210060457 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc009b30 con 0x7ff8c80a5260 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8cec0b640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8c814fd30 0x7ff8c80710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8ce40a640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8c806d0a0 0x7ff8c8149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:33.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.894+0000 7ff8cdc09640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c80a5260 0x7ff8c81ed660 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400b450 tx=0x7ff8b400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:33.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.895+0000 7ff8c6ffd640 1 -- 172.21.15.91:0/2210060457 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4011890 con 0x7ff8c80a5260 2023-11-27T20:45:33.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.895+0000 7ff8c6ffd640 1 -- 172.21.15.91:0/2210060457 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b40119f0 con 0x7ff8c80a5260 2023-11-27T20:45:33.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.895+0000 7ff8c6ffd640 1 -- 172.21.15.91:0/2210060457 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4011da0 con 0x7ff8c80a5260 2023-11-27T20:45:33.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.895+0000 7ff8d066e640 1 -- 172.21.15.91:0/2210060457 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c81491d0 con 0x7ff8c80a5260 2023-11-27T20:45:33.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.895+0000 7ff8d066e640 1 -- 172.21.15.91:0/2210060457 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c81edf30 con 0x7ff8c80a5260 2023-11-27T20:45:33.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.896+0000 7ff8d066e640 1 -- 172.21.15.91:0/2210060457 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c8068350 con 0x7ff8c80a5260 2023-11-27T20:45:33.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.897+0000 7ff8c6ffd640 1 -- 172.21.15.91:0/2210060457 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff8b401a400 con 0x7ff8c80a5260 2023-11-27T20:45:33.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.898+0000 7ff8c6ffd640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff8ac06b1f0 0x7ff8ac06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:33.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.898+0000 7ff8c6ffd640 1 -- 172.21.15.91:0/2210060457 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7ff8b408a1a0 con 0x7ff8c80a5260 2023-11-27T20:45:33.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.898+0000 7ff8ce40a640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff8ac06b1f0 0x7ff8ac06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:33.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.899+0000 7ff8ce40a640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff8ac06b1f0 0x7ff8ac06d6b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc035000 tx=0x7ff8bc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:33.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:33.902+0000 7ff8c6ffd640 1 -- 172.21.15.91:0/2210060457 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff8b4054b30 con 0x7ff8c80a5260 2023-11-27T20:45:34.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.164+0000 7ff8d066e640 1 -- 172.21.15.91:0/2210060457 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7ff8c806d540 con 0x7ff8c80a5260 2023-11-27T20:45:34.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.164+0000 7ff8c6ffd640 1 -- 172.21.15.91:0/2210060457 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v25) v1 ==== 85+0+226 (secure 0 0 0) 0x7ff8b4015100 con 0x7ff8c80a5260 2023-11-27T20:45:34.166 INFO:teuthology.orchestra.run.smithi091.stdout:[client.testuser] 2023-11-27T20:45:34.166 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ== 2023-11-27T20:45:34.166 INFO:teuthology.orchestra.run.smithi091.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-11-27T20:45:34.166 INFO:teuthology.orchestra.run.smithi091.stdout: caps mon = "allow r" 2023-11-27T20:45:34.166 INFO:teuthology.orchestra.run.smithi091.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-27T20:45:34.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 -- 172.21.15.91:0/2210060457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff8ac06b1f0 msgr2=0x7ff8ac06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff8ac06b1f0 0x7ff8ac06d6b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc035000 tx=0x7ff8bc030000 comp rx=0 tx=0).stop 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 -- 172.21.15.91:0/2210060457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c80a5260 msgr2=0x7ff8c81ed660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c80a5260 0x7ff8c81ed660 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400b450 tx=0x7ff8b400b910 comp rx=0 tx=0).stop 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 -- 172.21.15.91:0/2210060457 shutdown_connections 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8c814fd30 0x7ff8c80710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8c80a5260 0x7ff8c81ed660 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff8ac06b1f0 0x7ff8ac06d6b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 --2- 172.21.15.91:0/2210060457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8c806d0a0 0x7ff8c8149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 -- 172.21.15.91:0/2210060457 >> 172.21.15.91:0/2210060457 conn(0x7ff8c806a500 msgr2=0x7ff8c80a71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 -- 172.21.15.91:0/2210060457 shutdown_connections 2023-11-27T20:45:34.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.167+0000 7ff8d066e640 1 -- 172.21.15.91:0/2210060457 wait complete. 2023-11-27T20:45:34.187 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-27T20:45:34.188 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-27T20:45:34.235 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.WHWyUDgsLl 2023-11-27T20:45:34.235 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:34.235 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/tmp/tmp.WHWyUDgsLl 2023-11-27T20:45:34.332 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:34.332 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:34.428 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:34.429 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:34.476 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:34.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.732+0000 7f53b3cf3640 1 Processor -- start 2023-11-27T20:45:34.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.733+0000 7f53b3cf3640 1 -- start start 2023-11-27T20:45:34.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.734+0000 7f53b3cf3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 0x7f53ac152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:34.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.734+0000 7f53b3cf3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53ac0c3ea0 0x7f53ac0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:34.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.734+0000 7f53b3cf3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac0c64a0 con 0x7f53ac14fd30 2023-11-27T20:45:34.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.734+0000 7f53b3cf3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ac0c5c00 con 0x7f53ac0c3ea0 2023-11-27T20:45:34.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.734+0000 7f53b3cf3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0c5ee0 con 0x7f53ac06d0a0 2023-11-27T20:45:34.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.734+0000 7f53b2290640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53ac0c3ea0 0x7f53ac0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:34.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.734+0000 7f53b2290640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53ac0c3ea0 0x7f53ac0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38632/0 (socket says 172.21.15.91:38632) 2023-11-27T20:45:34.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.734+0000 7f53b2290640 1 -- 172.21.15.91:0/2306406650 learned_addr learned my addr 172.21.15.91:0/2306406650 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:34.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.735+0000 7f53b128e640 1 --2- 172.21.15.91:0/2306406650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 0x7f53ac152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:34.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.735+0000 7f53b2290640 1 -- 172.21.15.91:0/2306406650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 msgr2=0x7f53ac152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:34.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.735+0000 7f53b2290640 1 --2- 172.21.15.91:0/2306406650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 0x7f53ac152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.735+0000 7f53b2290640 1 -- 172.21.15.91:0/2306406650 >> v1:172.21.15.183:6789/0 conn(0x7f53ac14fd30 legacy=0x7f53ac0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:34.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.735+0000 7f53b2290640 1 -- 172.21.15.91:0/2306406650 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac0c61c0 con 0x7f53ac0c3ea0 2023-11-27T20:45:34.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.735+0000 7f53b128e640 1 --2- 172.21.15.91:0/2306406650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 0x7f53ac152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:34.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.736+0000 7f53b2290640 1 --2- 172.21.15.91:0/2306406650 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac0c3ea0 0x7f53ac0c4330 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009e50 tx=0x7f53a402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881914992ccc965f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.736+0000 7f53b0a8d640 1 -- 172.21.15.91:0/2306406650 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a402ca80 con 0x7f53ac0c3ea0 2023-11-27T20:45:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.736+0000 7f53b0a8d640 1 -- 172.21.15.91:0/2306406650 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a402cbe0 con 0x7f53ac0c3ea0 2023-11-27T20:45:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.736+0000 7f53b0a8d640 1 -- 172.21.15.91:0/2306406650 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40343f0 con 0x7f53ac0c3ea0 2023-11-27T20:45:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.737+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2306406650 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac0c3ea0 msgr2=0x7f53ac0c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.737+0000 7f53b3cf3640 1 --2- 172.21.15.91:0/2306406650 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac0c3ea0 0x7f53ac0c4330 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009e50 tx=0x7f53a402bee0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.737+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2306406650 shutdown_connections 2023-11-27T20:45:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.737+0000 7f53b3cf3640 1 --2- 172.21.15.91:0/2306406650 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac0c3ea0 0x7f53ac0c4330 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.737+0000 7f53b3cf3640 1 --2- 172.21.15.91:0/2306406650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 0x7f53ac152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.737+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2306406650 >> 172.21.15.91:0/2306406650 conn(0x7f53ac06a500 msgr2=0x7f53ac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:34.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.737+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2306406650 shutdown_connections 2023-11-27T20:45:34.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.737+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2306406650 wait complete. 2023-11-27T20:45:34.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.739+0000 7f53b3cf3640 1 Processor -- start 2023-11-27T20:45:34.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.739+0000 7f53b3cf3640 1 -- start start 2023-11-27T20:45:34.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.740+0000 7f53b3cf3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 0x7f53ac1ea220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:34.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.740+0000 7f53b3cf3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53ac0c3ea0 0x7f53ac0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:34.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.740+0000 7f53b3cf3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac14fd30 0x7f53ac0aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:34.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.740+0000 7f53b3cf3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac1ea760 con 0x7f53ac14fd30 2023-11-27T20:45:34.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.740+0000 7f53b3cf3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0a9fa0 con 0x7f53ac0c3ea0 2023-11-27T20:45:34.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.740+0000 7f53b3cf3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0a9ca0 con 0x7f53ac06d0a0 2023-11-27T20:45:34.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.740+0000 7f53b2290640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac14fd30 0x7f53ac0aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:34.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.740+0000 7f53b2290640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac14fd30 0x7f53ac0aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38634/0 (socket says 172.21.15.91:38634) 2023-11-27T20:45:34.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.740+0000 7f53b2290640 1 -- 172.21.15.91:0/2952374675 learned_addr learned my addr 172.21.15.91:0/2952374675 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:34.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53b1a8f640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 0x7f53ac1ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53b128e640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53ac0c3ea0 0x7f53ac0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53b2290640 1 -- 172.21.15.91:0/2952374675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 msgr2=0x7f53ac1ea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53b2290640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 0x7f53ac1ea220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53b2290640 1 -- 172.21.15.91:0/2952374675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53ac0c3ea0 msgr2=0x7f53ac0bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53b2290640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53ac0c3ea0 0x7f53ac0bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53b2290640 1 -- 172.21.15.91:0/2952374675 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4009b30 con 0x7f53ac14fd30 2023-11-27T20:45:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53b1a8f640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 0x7f53ac1ea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53b2290640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac14fd30 0x7f53ac0aa430 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009e50 tx=0x7f53a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53a27fc640 1 -- 172.21.15.91:0/2952374675 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a403e450 con 0x7f53ac14fd30 2023-11-27T20:45:34.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53a27fc640 1 -- 172.21.15.91:0/2952374675 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a403e5d0 con 0x7f53ac14fd30 2023-11-27T20:45:34.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53a27fc640 1 -- 172.21.15.91:0/2952374675 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a403e980 con 0x7f53ac14fd30 2023-11-27T20:45:34.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.741+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2952374675 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac0a9180 con 0x7f53ac14fd30 2023-11-27T20:45:34.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.742+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2952374675 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac0bf8a0 con 0x7f53ac14fd30 2023-11-27T20:45:34.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.743+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2952374675 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac0aa150 con 0x7f53ac14fd30 2023-11-27T20:45:34.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.744+0000 7f53a27fc640 1 -- 172.21.15.91:0/2952374675 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f53a402cd50 con 0x7f53ac14fd30 2023-11-27T20:45:34.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.744+0000 7f53a27fc640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f539006b1c0 0x7f539006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:34.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.745+0000 7f53a27fc640 1 -- 172.21.15.91:0/2952374675 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f53a40ac8e0 con 0x7f53ac14fd30 2023-11-27T20:45:34.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.745+0000 7f53b1a8f640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f539006b1c0 0x7f539006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:34.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.745+0000 7f53b1a8f640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f539006b1c0 0x7f539006d680 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f53a8003eb0 tx=0x7f53a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:34.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.749+0000 7f53a27fc640 1 -- 172.21.15.91:0/2952374675 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f53ac0aa150 con 0x7f53ac14fd30 2023-11-27T20:45:34.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.938+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2952374675 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53ac0aa150 con 0x7f53ac14fd30 2023-11-27T20:45:34.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.940+0000 7f53a27fc640 1 -- 172.21.15.91:0/2952374675 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f53ac0aa150 con 0x7f53ac14fd30 2023-11-27T20:45:34.942 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:34.942 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":81,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:23.334850+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:34.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2952374675 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f539006b1c0 msgr2=0x7f539006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f539006b1c0 0x7f539006d680 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f53a8003eb0 tx=0x7f53a8009040 comp rx=0 tx=0).stop 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2952374675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac14fd30 msgr2=0x7f53ac0aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac14fd30 0x7f53ac0aa430 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009e50 tx=0x7f53a4004a40 comp rx=0 tx=0).stop 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2952374675 shutdown_connections 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53ac14fd30 0x7f53ac0aa430 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f539006b1c0 0x7f539006d680 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53ac0c3ea0 0x7f53ac0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 --2- 172.21.15.91:0/2952374675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53ac06d0a0 0x7f53ac1ea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2952374675 >> 172.21.15.91:0/2952374675 conn(0x7f53ac06a500 msgr2=0x7f53ac152120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2952374675 shutdown_connections 2023-11-27T20:45:34.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:34.943+0000 7f53b3cf3640 1 -- 172.21.15.91:0/2952374675 wait complete. 2023-11-27T20:45:34.964 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:45:04.361620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:45:05.090674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:45:19.465319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:45:20.794821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:45:34.965 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:45:35.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.179+0000 7f231ed54640 1 Processor -- start 2023-11-27T20:45:35.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.180+0000 7f231ed54640 1 -- start start 2023-11-27T20:45:35.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.181+0000 7f231ed54640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f231806fec0 0x7f23180c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.181+0000 7f231ed54640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2318156310 con 0x7f23180ac750 2023-11-27T20:45:35.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.181+0000 7f231ed54640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23181565f0 con 0x7f2318155e70 2023-11-27T20:45:35.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.181+0000 7f231ed54640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180c74e0 con 0x7f231806fec0 2023-11-27T20:45:35.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.181+0000 7f231dd52640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f23180ac750 0x7f2318155760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:57844/0 (socket says 172.21.15.91:57844) 2023-11-27T20:45:35.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.181+0000 7f231dd52640 1 -- 172.21.15.91:0/1306408317 learned_addr learned my addr 172.21.15.91:0/1306408317 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:35.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231e553640 1 --2- 172.21.15.91:0/1306408317 >> v2:172.21.15.183:3300/0 conn(0x7f231806fec0 0x7f23180c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076770240 0 0) 0x7f2318156310 con 0x7f23180ac750 2023-11-27T20:45:35.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2304003520 con 0x7f23180ac750 2023-11-27T20:45:35.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2037029310 0 0) 0x7f2304003520 con 0x7f23180ac750 2023-11-27T20:45:35.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 >> v2:172.21.15.183:3300/0 conn(0x7f231806fec0 msgr2=0x7f23180c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:35.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 --2- 172.21.15.91:0/1306408317 >> v2:172.21.15.183:3300/0 conn(0x7f231806fec0 0x7f23180c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 >> v1:172.21.15.183:6789/0 conn(0x7f2318155e70 legacy=0x7f23180c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180acbd0 con 0x7f23180ac750 2023-11-27T20:45:35.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f2314001670 con 0x7f23180ac750 2023-11-27T20:45:35.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 >> v1:172.21.15.91:6789/0 conn(0x7f23180ac750 legacy=0x7f2318155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2304003970 0x7f2304003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040047c0 0x7f2304004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23040052a0 0x7f230400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180c74e0 con 0x7f23040052a0 2023-11-27T20:45:35.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230400c170 con 0x7f23040047c0 2023-11-27T20:45:35.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.182+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230400c330 con 0x7f2304003970 2023-11-27T20:45:35.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.183+0000 7f231e553640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23040052a0 0x7f230400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.183+0000 7f231dd52640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2304003970 0x7f2304003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.183+0000 7f231d551640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040047c0 0x7f2304004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.183+0000 7f231e553640 1 -- 172.21.15.91:0/1306408317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2304003970 msgr2=0x7f2304003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:35.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.183+0000 7f231e553640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2304003970 0x7f2304003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.183+0000 7f231e553640 1 -- 172.21.15.91:0/1306408317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040047c0 msgr2=0x7f2304004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:35.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.183+0000 7f231e553640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040047c0 0x7f2304004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.183+0000 7f231e553640 1 -- 172.21.15.91:0/1306408317 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304003520 con 0x7f23040052a0 2023-11-27T20:45:35.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.183+0000 7f231d551640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040047c0 0x7f2304004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:35.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.184+0000 7f231e553640 1 -- 172.21.15.91:0/1306408317 reap_dead start 2023-11-27T20:45:35.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.185+0000 7f231e553640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23040052a0 0x7f230400b980 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2310009f90 tx=0x7f23040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95eef2779d27a261 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:35.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.185+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231002cc20 con 0x7f23040052a0 2023-11-27T20:45:35.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.185+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000f040 con 0x7f23040052a0 2023-11-27T20:45:35.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.185+0000 7f231cd50640 1 -- 172.21.15.91:0/1306408317 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310003990 con 0x7f23040052a0 2023-11-27T20:45:35.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.185+0000 7f231ed54640 1 -- 172.21.15.91:0/1306408317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23040052a0 msgr2=0x7f230400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.185+0000 7f231ed54640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23040052a0 0x7f230400b980 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2310009f90 tx=0x7f23040057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.186+0000 7f231ed54640 1 -- 172.21.15.91:0/1306408317 shutdown_connections 2023-11-27T20:45:35.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.186+0000 7f231ed54640 1 --2- 172.21.15.91:0/1306408317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23040052a0 0x7f230400b980 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.186+0000 7f231ed54640 1 -- 172.21.15.91:0/1306408317 >> 172.21.15.91:0/1306408317 conn(0x7f23180c7b00 msgr2=0x7f23180c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:35.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.186+0000 7f231ed54640 1 -- 172.21.15.91:0/1306408317 shutdown_connections 2023-11-27T20:45:35.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.186+0000 7f231ed54640 1 -- 172.21.15.91:0/1306408317 wait complete. 2023-11-27T20:45:35.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.187+0000 7f231ed54640 1 Processor -- start 2023-11-27T20:45:35.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.187+0000 7f231ed54640 1 -- start start 2023-11-27T20:45:35.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.188+0000 7f231ed54640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040052a0 0x7f23180c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.188+0000 7f231ed54640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f231806c7b0 0x7f2318151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.188+0000 7f231ed54640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2318151d90 0x7f23181ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.188+0000 7f231ed54640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180acfb0 con 0x7f2318151d90 2023-11-27T20:45:35.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.188+0000 7f231ed54640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231814ac90 con 0x7f23040052a0 2023-11-27T20:45:35.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.188+0000 7f231ed54640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23181e9be0 con 0x7f231806c7b0 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231e553640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2318151d90 0x7f23181ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231e553640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2318151d90 0x7f23181ed1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38662/0 (socket says 172.21.15.91:38662) 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231e553640 1 -- 172.21.15.91:0/39170403 learned_addr learned my addr 172.21.15.91:0/39170403 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231d551640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f231806c7b0 0x7f2318151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231dd52640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040052a0 0x7f23180c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231e553640 1 -- 172.21.15.91:0/39170403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f231806c7b0 msgr2=0x7f2318151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231e553640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f231806c7b0 0x7f2318151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231e553640 1 -- 172.21.15.91:0/39170403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040052a0 msgr2=0x7f23180c11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231e553640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040052a0 0x7f23180c11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231e553640 1 -- 172.21.15.91:0/39170403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23181eab90 con 0x7f2318151d90 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231dd52640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040052a0 0x7f23180c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:35.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.189+0000 7f231e553640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2318151d90 0x7f23181ed1d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f231002c690 tx=0x7f2310009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.190+0000 7f230e7fc640 1 -- 172.21.15.91:0/39170403 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231002cea0 con 0x7f2318151d90 2023-11-27T20:45:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.190+0000 7f230e7fc640 1 -- 172.21.15.91:0/39170403 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2310004230 con 0x7f2318151d90 2023-11-27T20:45:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.190+0000 7f230e7fc640 1 -- 172.21.15.91:0/39170403 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100045e0 con 0x7f2318151d90 2023-11-27T20:45:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.190+0000 7f231ed54640 1 -- 172.21.15.91:0/39170403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23180c2a80 con 0x7f2318151d90 2023-11-27T20:45:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.190+0000 7f231ed54640 1 -- 172.21.15.91:0/39170403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23181ea0b0 con 0x7f2318151d90 2023-11-27T20:45:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.191+0000 7f231ed54640 1 -- 172.21.15.91:0/39170403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231804e840 con 0x7f2318151d90 2023-11-27T20:45:35.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.192+0000 7f230e7fc640 1 -- 172.21.15.91:0/39170403 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2310004740 con 0x7f2318151d90 2023-11-27T20:45:35.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.193+0000 7f230e7fc640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22fc06b1c0 0x7f22fc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.193+0000 7f230e7fc640 1 -- 172.21.15.91:0/39170403 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f23100ac260 con 0x7f2318151d90 2023-11-27T20:45:35.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.193+0000 7f231dd52640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22fc06b1c0 0x7f22fc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.194+0000 7f231dd52640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22fc06b1c0 0x7f22fc06d680 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2314001200 tx=0x7f2314000f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:35.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.197+0000 7f230e7fc640 1 -- 172.21.15.91:0/39170403 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2310076db0 con 0x7f2318151d90 2023-11-27T20:45:35.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.387+0000 7f231ed54640 1 -- 172.21.15.91:0/39170403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23180a6c30 con 0x7f2318151d90 2023-11-27T20:45:35.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.387+0000 7f230e7fc640 1 -- 172.21.15.91:0/39170403 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f231007a3d0 con 0x7f2318151d90 2023-11-27T20:45:35.389 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:45:35.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 -- 172.21.15.91:0/39170403 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22fc06b1c0 msgr2=0x7f22fc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22fc06b1c0 0x7f22fc06d680 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2314001200 tx=0x7f2314000f50 comp rx=0 tx=0).stop 2023-11-27T20:45:35.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 -- 172.21.15.91:0/39170403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2318151d90 msgr2=0x7f23181ed1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2318151d90 0x7f23181ed1d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f231002c690 tx=0x7f2310009750 comp rx=0 tx=0).stop 2023-11-27T20:45:35.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 -- 172.21.15.91:0/39170403 shutdown_connections 2023-11-27T20:45:35.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2318151d90 0x7f23181ed1d0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f231806c7b0 0x7f2318151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22fc06b1c0 0x7f22fc06d680 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 --2- 172.21.15.91:0/39170403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23040052a0 0x7f23180c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 -- 172.21.15.91:0/39170403 >> 172.21.15.91:0/39170403 conn(0x7f23180c7b00 msgr2=0x7f23180c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:35.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.390+0000 7f231ed54640 1 -- 172.21.15.91:0/39170403 shutdown_connections 2023-11-27T20:45:35.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.391+0000 7f231ed54640 1 -- 172.21.15.91:0/39170403 wait complete. 2023-11-27T20:45:35.411 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:45:35.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.620+0000 7f66b110f640 1 Processor -- start 2023-11-27T20:45:35.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.621+0000 7f66b110f640 1 -- start start 2023-11-27T20:45:35.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.622+0000 7f66b110f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f66ac0c45d0 0x7f66ac155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.622+0000 7f66b110f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f66ac0c3340 0x7f66ac156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.622+0000 7f66b110f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ac0bfdc0 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.622+0000 7f66b110f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ac06e390 con 0x7f66ac0c3340 2023-11-27T20:45:35.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.622+0000 7f66b110f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ac06ddd0 con 0x7f66ac0c45d0 2023-11-27T20:45:35.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.622+0000 7f66aad9d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f66ac0c5ec0 0x7f66ac0c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:57848/0 (socket says 172.21.15.91:57848) 2023-11-27T20:45:35.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.622+0000 7f66aad9d640 1 -- 172.21.15.91:0/1799679174 learned_addr learned my addr 172.21.15.91:0/1799679174 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:35.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.623+0000 7f66ab59e640 1 --2- 172.21.15.91:0/1799679174 >> v2:172.21.15.91:3300/0 conn(0x7f66ac0c3340 0x7f66ac156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.623+0000 7f66a3fff640 1 --2- 172.21.15.91:0/1799679174 >> v2:172.21.15.183:3300/0 conn(0x7f66ac0c45d0 0x7f66ac155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.623+0000 7f66aa59c640 1 -- 172.21.15.91:0/1799679174 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005561145 0 0) 0x7f66ac0bfdc0 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.623+0000 7f66aa59c640 1 -- 172.21.15.91:0/1799679174 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6698003520 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.623+0000 7f66ab59e640 1 -- 172.21.15.91:0/1799679174 >> v2:172.21.15.183:3300/0 conn(0x7f66ac0c45d0 msgr2=0x7f66ac155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:35.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.623+0000 7f66ab59e640 1 --2- 172.21.15.91:0/1799679174 >> v2:172.21.15.183:3300/0 conn(0x7f66ac0c45d0 0x7f66ac155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.623+0000 7f66ab59e640 1 -- 172.21.15.91:0/1799679174 >> v1:172.21.15.91:6789/0 conn(0x7f66ac0c5ec0 legacy=0x7f66ac0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.623+0000 7f66ab59e640 1 -- 172.21.15.91:0/1799679174 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac06e0b0 con 0x7f66ac0c3340 2023-11-27T20:45:35.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.624+0000 7f66ab59e640 1 --2- 172.21.15.91:0/1799679174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c3340 0x7f66ac156370 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009d90 tx=0x7f66a402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28335c97673af6d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:35.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.624+0000 7f66aa59c640 1 -- 172.21.15.91:0/1799679174 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a402cb40 con 0x7f66ac0c3340 2023-11-27T20:45:35.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.625+0000 7f66aa59c640 1 -- 172.21.15.91:0/1799679174 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a402cca0 con 0x7f66ac0c3340 2023-11-27T20:45:35.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.625+0000 7f66aa59c640 1 -- 172.21.15.91:0/1799679174 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4034660 con 0x7f66ac0c3340 2023-11-27T20:45:35.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.625+0000 7f66b110f640 1 -- 172.21.15.91:0/1799679174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c3340 msgr2=0x7f66ac156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.625+0000 7f66b110f640 1 --2- 172.21.15.91:0/1799679174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c3340 0x7f66ac156370 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009d90 tx=0x7f66a402bd90 comp rx=0 tx=0).stop 2023-11-27T20:45:35.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.625+0000 7f66b110f640 1 -- 172.21.15.91:0/1799679174 shutdown_connections 2023-11-27T20:45:35.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.625+0000 7f66b110f640 1 --2- 172.21.15.91:0/1799679174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c3340 0x7f66ac156370 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.625+0000 7f66b110f640 1 --2- 172.21.15.91:0/1799679174 >> v2:172.21.15.183:3300/0 conn(0x7f66ac0c45d0 0x7f66ac155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.625+0000 7f66b110f640 1 -- 172.21.15.91:0/1799679174 >> 172.21.15.91:0/1799679174 conn(0x7f66ac06a500 msgr2=0x7f66ac06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:35.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.625+0000 7f66b110f640 1 -- 172.21.15.91:0/1799679174 shutdown_connections 2023-11-27T20:45:35.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.625+0000 7f66b110f640 1 -- 172.21.15.91:0/1799679174 wait complete. 2023-11-27T20:45:35.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.627+0000 7f66b110f640 1 Processor -- start 2023-11-27T20:45:35.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.627+0000 7f66b110f640 1 -- start start 2023-11-27T20:45:35.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.628+0000 7f66b110f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66ac0c3340 0x7f66ac14e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.628+0000 7f66b110f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66ac0c45d0 0x7f66ac1ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.628+0000 7f66b110f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c5ec0 0x7f66ac0aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.628+0000 7f66b110f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac1586c0 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.628+0000 7f66b110f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac0a81f0 con 0x7f66ac0c45d0 2023-11-27T20:45:35.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.628+0000 7f66b110f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac0a8440 con 0x7f66ac0c3340 2023-11-27T20:45:35.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.628+0000 7f66ab59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c5ec0 0x7f66ac0aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.628+0000 7f66ab59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c5ec0 0x7f66ac0aa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38680/0 (socket says 172.21.15.91:38680) 2023-11-27T20:45:35.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.628+0000 7f66ab59e640 1 -- 172.21.15.91:0/3879005558 learned_addr learned my addr 172.21.15.91:0/3879005558 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66a3fff640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66ac0c45d0 0x7f66ac1ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66ab59e640 1 -- 172.21.15.91:0/3879005558 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66ac0c3340 msgr2=0x7f66ac14e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66ab59e640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66ac0c3340 0x7f66ac14e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66ab59e640 1 -- 172.21.15.91:0/3879005558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66ac0c45d0 msgr2=0x7f66ac1ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66ab59e640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66ac0c45d0 0x7f66ac1ed8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66ab59e640 1 -- 172.21.15.91:0/3879005558 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4009a70 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66ab59e640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c5ec0 0x7f66ac0aa7f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009d90 tx=0x7f66a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66a37fe640 1 -- 172.21.15.91:0/3879005558 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4040650 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66a37fe640 1 -- 172.21.15.91:0/3879005558 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a40407b0 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66a37fe640 1 -- 172.21.15.91:0/3879005558 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4040b60 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.629+0000 7f66b110f640 1 -- 172.21.15.91:0/3879005558 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ac0a8720 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.630+0000 7f66b110f640 1 -- 172.21.15.91:0/3879005558 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ac1581a0 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.631+0000 7f66b110f640 1 -- 172.21.15.91:0/3879005558 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ac1583c0 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.632+0000 7f66a37fe640 1 -- 172.21.15.91:0/3879005558 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f66a4040cc0 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.632+0000 7f66a37fe640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f668c06b1f0 0x7f668c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:35.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.633+0000 7f66a37fe640 1 -- 172.21.15.91:0/3879005558 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f66a40ac8e0 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.633+0000 7f66aad9d640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f668c06b1f0 0x7f668c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:35.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.633+0000 7f66aad9d640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f668c06b1f0 0x7f668c06d6b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f669c001570 tx=0x7f669c007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:35.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.637+0000 7f66a37fe640 1 -- 172.21.15.91:0/3879005558 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f66a4077390 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.825+0000 7f66b110f640 1 -- 172.21.15.91:0/3879005558 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66ac068350 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.826+0000 7f66a37fe640 1 -- 172.21.15.91:0/3879005558 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66a407a9b0 con 0x7f66ac0c5ec0 2023-11-27T20:45:35.828 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:35.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.828+0000 7f66b110f640 1 -- 172.21.15.91:0/3879005558 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f668c06b1f0 msgr2=0x7f668c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.828+0000 7f66b110f640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f668c06b1f0 0x7f668c06d6b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f669c001570 tx=0x7f669c007930 comp rx=0 tx=0).stop 2023-11-27T20:45:35.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.828+0000 7f66b110f640 1 -- 172.21.15.91:0/3879005558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c5ec0 msgr2=0x7f66ac0aa7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:35.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.828+0000 7f66b110f640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c5ec0 0x7f66ac0aa7f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009d90 tx=0x7f66a4004a40 comp rx=0 tx=0).stop 2023-11-27T20:45:35.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.829+0000 7f66b110f640 1 -- 172.21.15.91:0/3879005558 shutdown_connections 2023-11-27T20:45:35.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.829+0000 7f66b110f640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66ac0c5ec0 0x7f66ac0aa7f0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.829+0000 7f66b110f640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f668c06b1f0 0x7f668c06d6b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.829+0000 7f66b110f640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66ac0c45d0 0x7f66ac1ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.829+0000 7f66b110f640 1 --2- 172.21.15.91:0/3879005558 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66ac0c3340 0x7f66ac14e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:35.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.829+0000 7f66b110f640 1 -- 172.21.15.91:0/3879005558 >> 172.21.15.91:0/3879005558 conn(0x7f66ac06a500 msgr2=0x7f66ac0c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:35.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.829+0000 7f66b110f640 1 -- 172.21.15.91:0/3879005558 shutdown_connections 2023-11-27T20:45:35.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:35.829+0000 7f66b110f640 1 -- 172.21.15.91:0/3879005558 wait complete. 2023-11-27T20:45:35.851 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:45:36.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.062+0000 7fdff68ee640 1 Processor -- start 2023-11-27T20:45:36.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.063+0000 7fdff68ee640 1 -- start start 2023-11-27T20:45:36.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.064+0000 7fdff68ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdff014fd30 0x7fdff0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.064+0000 7fdff68ee640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdff006d0a0 0x7fdff00a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.064+0000 7fdff68ee640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff00c64a0 con 0x7fdff00a5260 2023-11-27T20:45:36.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.064+0000 7fdff68ee640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00c5c00 con 0x7fdff006d0a0 2023-11-27T20:45:36.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.064+0000 7fdff68ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00c5ee0 con 0x7fdff014fd30 2023-11-27T20:45:36.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.064+0000 7fdfef7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdff006d0a0 0x7fdff00a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.064+0000 7fdfef7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdff006d0a0 0x7fdff00a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38688/0 (socket says 172.21.15.91:38688) 2023-11-27T20:45:36.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.064+0000 7fdfef7fe640 1 -- 172.21.15.91:0/130804923 learned_addr learned my addr 172.21.15.91:0/130804923 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:36.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.065+0000 7fdfeffff640 1 --2- 172.21.15.91:0/130804923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdff014fd30 0x7fdff0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.065+0000 7fdfef7fe640 1 -- 172.21.15.91:0/130804923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdff014fd30 msgr2=0x7fdff0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:36.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.065+0000 7fdfef7fe640 1 --2- 172.21.15.91:0/130804923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdff014fd30 0x7fdff0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.065+0000 7fdfef7fe640 1 -- 172.21.15.91:0/130804923 >> v1:172.21.15.91:6789/0 conn(0x7fdff00a5260 legacy=0x7fdff00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.065+0000 7fdfef7fe640 1 -- 172.21.15.91:0/130804923 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00c61c0 con 0x7fdff006d0a0 2023-11-27T20:45:36.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.066+0000 7fdfef7fe640 1 --2- 172.21.15.91:0/130804923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff006d0a0 0x7fdff00a4d20 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009870 tx=0x7fdfd802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5977b8a42018ef6c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:36.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.066+0000 7fdfeeffd640 1 -- 172.21.15.91:0/130804923 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8030840 con 0x7fdff006d0a0 2023-11-27T20:45:36.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.066+0000 7fdfeeffd640 1 -- 172.21.15.91:0/130804923 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd80309a0 con 0x7fdff006d0a0 2023-11-27T20:45:36.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.066+0000 7fdfeeffd640 1 -- 172.21.15.91:0/130804923 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8030d30 con 0x7fdff006d0a0 2023-11-27T20:45:36.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.067+0000 7fdff68ee640 1 -- 172.21.15.91:0/130804923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff006d0a0 msgr2=0x7fdff00a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.067+0000 7fdff68ee640 1 --2- 172.21.15.91:0/130804923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff006d0a0 0x7fdff00a4d20 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009870 tx=0x7fdfd802b980 comp rx=0 tx=0).stop 2023-11-27T20:45:36.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.067+0000 7fdff68ee640 1 -- 172.21.15.91:0/130804923 shutdown_connections 2023-11-27T20:45:36.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.067+0000 7fdff68ee640 1 --2- 172.21.15.91:0/130804923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff006d0a0 0x7fdff00a4d20 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.067+0000 7fdff68ee640 1 --2- 172.21.15.91:0/130804923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdff014fd30 0x7fdff0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.067+0000 7fdff68ee640 1 -- 172.21.15.91:0/130804923 >> 172.21.15.91:0/130804923 conn(0x7fdff006a500 msgr2=0x7fdff006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:36.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.067+0000 7fdff68ee640 1 -- 172.21.15.91:0/130804923 shutdown_connections 2023-11-27T20:45:36.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.067+0000 7fdff68ee640 1 -- 172.21.15.91:0/130804923 wait complete. 2023-11-27T20:45:36.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.069+0000 7fdff68ee640 1 Processor -- start 2023-11-27T20:45:36.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.069+0000 7fdff68ee640 1 -- start start 2023-11-27T20:45:36.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.070+0000 7fdff68ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff006d0a0 0x7fdff00bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.070+0000 7fdff68ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdff00a5260 0x7fdff01ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.070+0000 7fdff68ee640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff014fd30 0x7fdff01ede20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.070+0000 7fdff68ee640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00aa650 con 0x7fdff014fd30 2023-11-27T20:45:36.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.070+0000 7fdff68ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01dca90 con 0x7fdff006d0a0 2023-11-27T20:45:36.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.070+0000 7fdff68ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01dc4d0 con 0x7fdff00a5260 2023-11-27T20:45:36.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.070+0000 7fdff4e8b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff014fd30 0x7fdff01ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.070+0000 7fdff4e8b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff014fd30 0x7fdff01ede20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38700/0 (socket says 172.21.15.91:38700) 2023-11-27T20:45:36.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.070+0000 7fdff4e8b640 1 -- 172.21.15.91:0/354855193 learned_addr learned my addr 172.21.15.91:0/354855193 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:36.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdff4e8b640 1 -- 172.21.15.91:0/354855193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdff00a5260 msgr2=0x7fdff01ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdff4e8b640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdff00a5260 0x7fdff01ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdfeffff640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff006d0a0 0x7fdff00bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdff4e8b640 1 -- 172.21.15.91:0/354855193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff006d0a0 msgr2=0x7fdff00bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdff4e8b640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff006d0a0 0x7fdff00bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdff4e8b640 1 -- 172.21.15.91:0/354855193 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80094d0 con 0x7fdff014fd30 2023-11-27T20:45:36.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdff4e8b640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff014fd30 0x7fdff01ede20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c400 tx=0x7fdfe800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:36.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdfecff9640 1 -- 172.21.15.91:0/354855193 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe80052d0 con 0x7fdff014fd30 2023-11-27T20:45:36.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdfecff9640 1 -- 172.21.15.91:0/354855193 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe8005430 con 0x7fdff014fd30 2023-11-27T20:45:36.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdfecff9640 1 -- 172.21.15.91:0/354855193 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8003810 con 0x7fdff014fd30 2023-11-27T20:45:36.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdff68ee640 1 -- 172.21.15.91:0/354855193 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff01dc7b0 con 0x7fdff014fd30 2023-11-27T20:45:36.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.071+0000 7fdff68ee640 1 -- 172.21.15.91:0/354855193 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff01dbad0 con 0x7fdff014fd30 2023-11-27T20:45:36.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.072+0000 7fdff68ee640 1 -- 172.21.15.91:0/354855193 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff00aa800 con 0x7fdff014fd30 2023-11-27T20:45:36.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.073+0000 7fdfecff9640 1 -- 172.21.15.91:0/354855193 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdfe8003970 con 0x7fdff014fd30 2023-11-27T20:45:36.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.074+0000 7fdfecff9640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdfd006b1c0 0x7fdfd006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.074+0000 7fdfecff9640 1 -- 172.21.15.91:0/354855193 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fdfe80892d0 con 0x7fdff014fd30 2023-11-27T20:45:36.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.074+0000 7fdfeffff640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdfd006b1c0 0x7fdfd006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.075+0000 7fdfeffff640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdfd006b1c0 0x7fdfd006d680 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009e90 tx=0x7fdfe000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:36.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.079+0000 7fdfecff9640 1 -- 172.21.15.91:0/354855193 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdff00aa800 con 0x7fdff014fd30 2023-11-27T20:45:36.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.270+0000 7fdff68ee640 1 -- 172.21.15.91:0/354855193 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdff00aa800 con 0x7fdff014fd30 2023-11-27T20:45:36.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.271+0000 7fdfecff9640 1 -- 172.21.15.91:0/354855193 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdff00aa800 con 0x7fdff014fd30 2023-11-27T20:45:36.273 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:36.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 -- 172.21.15.91:0/354855193 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdfd006b1c0 msgr2=0x7fdfd006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdfd006b1c0 0x7fdfd006d680 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009e90 tx=0x7fdfe000b040 comp rx=0 tx=0).stop 2023-11-27T20:45:36.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 -- 172.21.15.91:0/354855193 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff014fd30 msgr2=0x7fdff01ede20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff014fd30 0x7fdff01ede20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c400 tx=0x7fdfe800c8c0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 -- 172.21.15.91:0/354855193 shutdown_connections 2023-11-27T20:45:36.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdff014fd30 0x7fdff01ede20 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdff00a5260 0x7fdff01ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdfd006b1c0 0x7fdfd006d680 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 --2- 172.21.15.91:0/354855193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdff006d0a0 0x7fdff00bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 -- 172.21.15.91:0/354855193 >> 172.21.15.91:0/354855193 conn(0x7fdff006a500 msgr2=0x7fdff006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:36.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 -- 172.21.15.91:0/354855193 shutdown_connections 2023-11-27T20:45:36.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.274+0000 7fdff68ee640 1 -- 172.21.15.91:0/354855193 wait complete. 2023-11-27T20:45:36.293 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:45:36.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.508+0000 7f141d5f1640 1 Processor -- start 2023-11-27T20:45:36.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.508+0000 7f141d5f1640 1 -- start start 2023-11-27T20:45:36.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.510+0000 7f141d5f1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f14180c1500 0x7f14180c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.510+0000 7f141d5f1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14180c06c0 con 0x7f1418155490 2023-11-27T20:45:36.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.510+0000 7f141d5f1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14180c1020 con 0x7f14180a9b40 2023-11-27T20:45:36.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.510+0000 7f141d5f1640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14180a5820 con 0x7f14180c1500 2023-11-27T20:45:36.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.510+0000 7f1416ffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f1418155490 0x7f14180a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:57870/0 (socket says 172.21.15.91:57870) 2023-11-27T20:45:36.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.510+0000 7f1416ffd640 1 -- 172.21.15.91:0/535091151 learned_addr learned my addr 172.21.15.91:0/535091151 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:36.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.510+0000 7f14177fe640 1 --2- 172.21.15.91:0/535091151 >> v2:172.21.15.91:3300/0 conn(0x7f14180c1500 0x7f14180c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.510+0000 7f14177fe640 1 -- 172.21.15.91:0/535091151 >> v1:172.21.15.183:6789/0 conn(0x7f14180a9b40 legacy=0x7f14180c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:36.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.510+0000 7f14177fe640 1 -- 172.21.15.91:0/535091151 >> v1:172.21.15.91:6789/0 conn(0x7f1418155490 legacy=0x7f14180a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.510+0000 7f14177fe640 1 -- 172.21.15.91:0/535091151 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14180c0910 con 0x7f14180c1500 2023-11-27T20:45:36.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.512+0000 7f14177fe640 1 --2- 172.21.15.91:0/535091151 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14180c1500 0x7f14180c2be0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1410009d90 tx=0x7f141002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18bb7bcb16c4b7a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:36.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.512+0000 7f1415ffb640 1 -- 172.21.15.91:0/535091151 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141002cc60 con 0x7f14180c1500 2023-11-27T20:45:36.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.512+0000 7f1415ffb640 1 -- 172.21.15.91:0/535091151 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141002cdc0 con 0x7f14180c1500 2023-11-27T20:45:36.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.512+0000 7f1415ffb640 1 -- 172.21.15.91:0/535091151 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410034660 con 0x7f14180c1500 2023-11-27T20:45:36.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.512+0000 7f141d5f1640 1 -- 172.21.15.91:0/535091151 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14180c1500 msgr2=0x7f14180c2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.512+0000 7f141d5f1640 1 --2- 172.21.15.91:0/535091151 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14180c1500 0x7f14180c2be0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1410009d90 tx=0x7f141002beb0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.513+0000 7f141d5f1640 1 -- 172.21.15.91:0/535091151 shutdown_connections 2023-11-27T20:45:36.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.513+0000 7f141d5f1640 1 --2- 172.21.15.91:0/535091151 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14180c1500 0x7f14180c2be0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.513+0000 7f141d5f1640 1 -- 172.21.15.91:0/535091151 >> 172.21.15.91:0/535091151 conn(0x7f141806a500 msgr2=0x7f141806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:36.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.513+0000 7f141d5f1640 1 -- 172.21.15.91:0/535091151 shutdown_connections 2023-11-27T20:45:36.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.513+0000 7f141d5f1640 1 -- 172.21.15.91:0/535091151 wait complete. 2023-11-27T20:45:36.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.514+0000 7f141d5f1640 1 Processor -- start 2023-11-27T20:45:36.518 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.515+0000 7f141d5f1640 1 -- start start 2023-11-27T20:45:36.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.515+0000 7f141d5f1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c1500 0x7f141814f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.515+0000 7f141d5f1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1418155490 0x7f14181dee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.515+0000 7f141d5f1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1418071b70 0x7f141806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f141d5f1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14180a4f40 con 0x7f1418155490 2023-11-27T20:45:36.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f141d5f1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418071690 con 0x7f14180c1500 2023-11-27T20:45:36.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f141d5f1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14181eaba0 con 0x7f1418071b70 2023-11-27T20:45:36.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f14167fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1418155490 0x7f14181dee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f14167fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1418155490 0x7f14181dee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38704/0 (socket says 172.21.15.91:38704) 2023-11-27T20:45:36.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f14167fc640 1 -- 172.21.15.91:0/46029688 learned_addr learned my addr 172.21.15.91:0/46029688 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:36.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f14167fc640 1 -- 172.21.15.91:0/46029688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1418071b70 msgr2=0x7f141806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f14177fe640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1418071b70 0x7f141806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f1416ffd640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c1500 0x7f141814f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f14167fc640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1418071b70 0x7f141806fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f14167fc640 1 -- 172.21.15.91:0/46029688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c1500 msgr2=0x7f141814f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f14167fc640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c1500 0x7f141814f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f14167fc640 1 -- 172.21.15.91:0/46029688 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1410009a70 con 0x7f1418155490 2023-11-27T20:45:36.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.516+0000 7f1416ffd640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c1500 0x7f141814f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:36.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.517+0000 7f14167fc640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1418155490 0x7f14181dee50 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f140c00c430 tx=0x7f140c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:36.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.517+0000 7f13ff7fe640 1 -- 172.21.15.91:0/46029688 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c011790 con 0x7f1418155490 2023-11-27T20:45:36.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.517+0000 7f13ff7fe640 1 -- 172.21.15.91:0/46029688 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c0118f0 con 0x7f1418155490 2023-11-27T20:45:36.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.517+0000 7f13ff7fe640 1 -- 172.21.15.91:0/46029688 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c011ce0 con 0x7f1418155490 2023-11-27T20:45:36.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.517+0000 7f141d5f1640 1 -- 172.21.15.91:0/46029688 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14180a5190 con 0x7f1418155490 2023-11-27T20:45:36.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.517+0000 7f141d5f1640 1 -- 172.21.15.91:0/46029688 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14181ea830 con 0x7f1418155490 2023-11-27T20:45:36.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.518+0000 7f141d5f1640 1 -- 172.21.15.91:0/46029688 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1418071850 con 0x7f1418155490 2023-11-27T20:45:36.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.519+0000 7f13ff7fe640 1 -- 172.21.15.91:0/46029688 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f140c01c460 con 0x7f1418155490 2023-11-27T20:45:36.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.520+0000 7f13ff7fe640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f140406b1c0 0x7f140406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.520+0000 7f13ff7fe640 1 -- 172.21.15.91:0/46029688 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f140c089d10 con 0x7f1418155490 2023-11-27T20:45:36.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.520+0000 7f1416ffd640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f140406b1c0 0x7f140406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.521+0000 7f1416ffd640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f140406b1c0 0x7f140406d680 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1408007fd0 tx=0x7f1408009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:36.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.524+0000 7f13ff7fe640 1 -- 172.21.15.91:0/46029688 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f140c08f020 con 0x7f1418155490 2023-11-27T20:45:36.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.714+0000 7f141d5f1640 1 -- 172.21.15.91:0/46029688 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1418068350 con 0x7f1418155490 2023-11-27T20:45:36.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.714+0000 7f13ff7fe640 1 -- 172.21.15.91:0/46029688 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v81) v1 ==== 105+0+11 (secure 0 0 0) 0x7f140c0546a0 con 0x7f1418155490 2023-11-27T20:45:36.716 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:36.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 -- 172.21.15.91:0/46029688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f140406b1c0 msgr2=0x7f140406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f140406b1c0 0x7f140406d680 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1408007fd0 tx=0x7f1408009040 comp rx=0 tx=0).stop 2023-11-27T20:45:36.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 -- 172.21.15.91:0/46029688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1418155490 msgr2=0x7f14181dee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1418155490 0x7f14181dee50 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f140c00c430 tx=0x7f140c00c8f0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 -- 172.21.15.91:0/46029688 shutdown_connections 2023-11-27T20:45:36.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1418071b70 0x7f141806fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1418155490 0x7f14181dee50 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f140406b1c0 0x7f140406d680 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 --2- 172.21.15.91:0/46029688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14180c1500 0x7f141814f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 -- 172.21.15.91:0/46029688 >> 172.21.15.91:0/46029688 conn(0x7f141806a500 msgr2=0x7f14180c4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:36.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.717+0000 7f141d5f1640 1 -- 172.21.15.91:0/46029688 shutdown_connections 2023-11-27T20:45:36.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.718+0000 7f141d5f1640 1 -- 172.21.15.91:0/46029688 wait complete. 2023-11-27T20:45:36.737 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:45:36.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.948+0000 7faddd3f5640 1 Processor -- start 2023-11-27T20:45:36.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.948+0000 7faddd3f5640 1 -- start start 2023-11-27T20:45:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.949+0000 7faddd3f5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fadd814fd30 0x7fadd8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.950+0000 7faddd3f5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fadd806d0a0 0x7fadd80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.950+0000 7faddd3f5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80c64a0 con 0x7fadd80a5260 2023-11-27T20:45:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.950+0000 7faddd3f5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd80c5c00 con 0x7fadd814fd30 2023-11-27T20:45:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.950+0000 7faddd3f5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd80c5ee0 con 0x7fadd806d0a0 2023-11-27T20:45:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.950+0000 7fadd6ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fadd814fd30 0x7fadd8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.950+0000 7fadd6ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fadd814fd30 0x7fadd8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38716/0 (socket says 172.21.15.91:38716) 2023-11-27T20:45:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.950+0000 7fadd6ffd640 1 -- 172.21.15.91:0/633267940 learned_addr learned my addr 172.21.15.91:0/633267940 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:36.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.950+0000 7fadd77fe640 1 --1- 172.21.15.91:0/633267940 >> v1:172.21.15.91:6789/0 conn(0x7fadd80a5260 0x7fadd80c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:57874/0 (socket says 172.21.15.91:57874) 2023-11-27T20:45:36.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.950+0000 7fadd67fc640 1 --2- 172.21.15.91:0/633267940 >> v2:172.21.15.183:3300/0 conn(0x7fadd806d0a0 0x7fadd80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.951+0000 7fadd6ffd640 1 -- 172.21.15.91:0/633267940 >> v2:172.21.15.183:3300/0 conn(0x7fadd806d0a0 msgr2=0x7fadd80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:36.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.951+0000 7fadd6ffd640 1 --2- 172.21.15.91:0/633267940 >> v2:172.21.15.183:3300/0 conn(0x7fadd806d0a0 0x7fadd80a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.951+0000 7fadd6ffd640 1 -- 172.21.15.91:0/633267940 >> v1:172.21.15.91:6789/0 conn(0x7fadd80a5260 legacy=0x7fadd80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.951+0000 7fadd6ffd640 1 -- 172.21.15.91:0/633267940 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80c61c0 con 0x7fadd814fd30 2023-11-27T20:45:36.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.952+0000 7fadd6ffd640 1 --2- 172.21.15.91:0/633267940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd814fd30 0x7fadd8152f20 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fadd806b460 tx=0x7fadc802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f29a5b051d39823 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.952+0000 7fadd5ffb640 1 -- 172.21.15.91:0/633267940 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc802cb20 con 0x7fadd814fd30 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.952+0000 7fadd5ffb640 1 -- 172.21.15.91:0/633267940 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc802cc80 con 0x7fadd814fd30 2023-11-27T20:45:36.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.952+0000 7fadd5ffb640 1 -- 172.21.15.91:0/633267940 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc80343f0 con 0x7fadd814fd30 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.953+0000 7faddd3f5640 1 -- 172.21.15.91:0/633267940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd814fd30 msgr2=0x7fadd8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.953+0000 7faddd3f5640 1 --2- 172.21.15.91:0/633267940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd814fd30 0x7fadd8152f20 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fadd806b460 tx=0x7fadc802bf80 comp rx=0 tx=0).stop 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.953+0000 7faddd3f5640 1 -- 172.21.15.91:0/633267940 shutdown_connections 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.953+0000 7faddd3f5640 1 --2- 172.21.15.91:0/633267940 >> v2:172.21.15.183:3300/0 conn(0x7fadd806d0a0 0x7fadd80a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.953+0000 7faddd3f5640 1 --2- 172.21.15.91:0/633267940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd814fd30 0x7fadd8152f20 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.953+0000 7faddd3f5640 1 -- 172.21.15.91:0/633267940 >> 172.21.15.91:0/633267940 conn(0x7fadd806a500 msgr2=0x7fadd806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.953+0000 7faddd3f5640 1 -- 172.21.15.91:0/633267940 shutdown_connections 2023-11-27T20:45:36.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.953+0000 7faddd3f5640 1 -- 172.21.15.91:0/633267940 wait complete. 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.955+0000 7faddd3f5640 1 Processor -- start 2023-11-27T20:45:36.956 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.955+0000 7faddd3f5640 1 -- start start 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.956+0000 7faddd3f5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadd806d0a0 0x7fadd81eac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.956+0000 7faddd3f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd80a5260 0x7fadd80a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.956+0000 7faddd3f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadd814fd30 0x7fadd8155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.956+0000 7faddd3f5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd81ea7a0 con 0x7fadd80a5260 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.956+0000 7faddd3f5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd81568a0 con 0x7fadd806d0a0 2023-11-27T20:45:36.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.956+0000 7faddd3f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80aab50 con 0x7fadd814fd30 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.956+0000 7fadd67fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd80a5260 0x7fadd80a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.956+0000 7fadd67fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd80a5260 0x7fadd80a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38728/0 (socket says 172.21.15.91:38728) 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.956+0000 7fadd67fc640 1 -- 172.21.15.91:0/704963749 learned_addr learned my addr 172.21.15.91:0/704963749 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.957+0000 7fadd6ffd640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadd806d0a0 0x7fadd81eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.957+0000 7fadd77fe640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadd814fd30 0x7fadd8155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.957+0000 7fadd67fc640 1 -- 172.21.15.91:0/704963749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadd814fd30 msgr2=0x7fadd8155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.957+0000 7fadd67fc640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadd814fd30 0x7fadd8155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.957+0000 7fadd67fc640 1 -- 172.21.15.91:0/704963749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadd806d0a0 msgr2=0x7fadd81eac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.957+0000 7fadd67fc640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadd806d0a0 0x7fadd81eac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.957+0000 7fadd67fc640 1 -- 172.21.15.91:0/704963749 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8009b30 con 0x7fadd80a5260 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.957+0000 7fadd77fe640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadd814fd30 0x7fadd8155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.957+0000 7fadd67fc640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd80a5260 0x7fadd80a8e70 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fadc000d7d0 tx=0x7fadc000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.957+0000 7fadcf7fe640 1 -- 172.21.15.91:0/704963749 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000b6c0 con 0x7fadd80a5260 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.958+0000 7fadcf7fe640 1 -- 172.21.15.91:0/704963749 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc000b820 con 0x7fadd80a5260 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.958+0000 7fadcf7fe640 1 -- 172.21.15.91:0/704963749 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000bbb0 con 0x7fadd80a5260 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.958+0000 7faddd3f5640 1 -- 172.21.15.91:0/704963749 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd81ea150 con 0x7fadd80a5260 2023-11-27T20:45:36.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.958+0000 7faddd3f5640 1 -- 172.21.15.91:0/704963749 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd80aae30 con 0x7fadd80a5260 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.959+0000 7faddd3f5640 1 -- 172.21.15.91:0/704963749 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd8068350 con 0x7fadd80a5260 2023-11-27T20:45:36.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.960+0000 7fadcf7fe640 1 -- 172.21.15.91:0/704963749 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fadc000bd10 con 0x7fadd80a5260 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.961+0000 7fadcf7fe640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadb806b1f0 0x7fadb806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.961+0000 7fadcf7fe640 1 -- 172.21.15.91:0/704963749 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fadc008a3c0 con 0x7fadd80a5260 2023-11-27T20:45:36.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.961+0000 7fadd6ffd640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadb806b1f0 0x7fadb806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:36.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.962+0000 7fadd6ffd640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadb806b1f0 0x7fadb806d6b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fadc8035000 tx=0x7fadc8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:36.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:36.965+0000 7fadcf7fe640 1 -- 172.21.15.91:0/704963749 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fadc0054d50 con 0x7fadd80a5260 2023-11-27T20:45:37.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.155+0000 7faddd3f5640 1 -- 172.21.15.91:0/704963749 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fadd80a7590 con 0x7fadd80a5260 2023-11-27T20:45:37.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.156+0000 7fadcf7fe640 1 -- 172.21.15.91:0/704963749 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v81) v1 ==== 101+0+11 (secure 0 0 0) 0x7fadc0058370 con 0x7fadd80a5260 2023-11-27T20:45:37.158 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:37.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 -- 172.21.15.91:0/704963749 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadb806b1f0 msgr2=0x7fadb806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadb806b1f0 0x7fadb806d6b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fadc8035000 tx=0x7fadc8030000 comp rx=0 tx=0).stop 2023-11-27T20:45:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 -- 172.21.15.91:0/704963749 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd80a5260 msgr2=0x7fadd80a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd80a5260 0x7fadd80a8e70 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fadc000d7d0 tx=0x7fadc000dc90 comp rx=0 tx=0).stop 2023-11-27T20:45:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 -- 172.21.15.91:0/704963749 shutdown_connections 2023-11-27T20:45:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadd814fd30 0x7fadd8155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fadd80a5260 0x7fadd80a8e70 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fadb806b1f0 0x7fadb806d6b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 --2- 172.21.15.91:0/704963749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadd806d0a0 0x7fadd81eac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 -- 172.21.15.91:0/704963749 >> 172.21.15.91:0/704963749 conn(0x7fadd806a500 msgr2=0x7fadd8070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:37.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 -- 172.21.15.91:0/704963749 shutdown_connections 2023-11-27T20:45:37.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.159+0000 7faddd3f5640 1 -- 172.21.15.91:0/704963749 wait complete. 2023-11-27T20:45:37.180 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:45:37.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.387+0000 7f07b9ca6640 1 Processor -- start 2023-11-27T20:45:37.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.387+0000 7f07b9ca6640 1 -- start start 2023-11-27T20:45:37.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.388+0000 7f07b9ca6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f07b4155490 0x7f07b40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:37.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.388+0000 7f07b9ca6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f07b40a9b40 0x7f07b40c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:37.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.388+0000 7f07b9ca6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b40c06c0 con 0x7f07b40c1500 2023-11-27T20:45:37.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.388+0000 7f07b9ca6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b40a5820 con 0x7f07b40a9b40 2023-11-27T20:45:37.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.388+0000 7f07b9ca6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b40c1020 con 0x7f07b4155490 2023-11-27T20:45:37.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.389+0000 7f07b3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f07b40a9b40 0x7f07b40c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:37.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.389+0000 7f07b3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f07b40a9b40 0x7f07b40c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38730/0 (socket says 172.21.15.91:38730) 2023-11-27T20:45:37.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.389+0000 7f07b3fff640 1 -- 172.21.15.91:0/256339659 learned_addr learned my addr 172.21.15.91:0/256339659 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:37.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.389+0000 7f07b3fff640 1 -- 172.21.15.91:0/256339659 >> v2:172.21.15.183:3300/0 conn(0x7f07b4155490 msgr2=0x7f07b40a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:37.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.389+0000 7f07b3fff640 1 --2- 172.21.15.91:0/256339659 >> v2:172.21.15.183:3300/0 conn(0x7f07b4155490 0x7f07b40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.389+0000 7f07b3fff640 1 -- 172.21.15.91:0/256339659 >> v1:172.21.15.183:6789/0 conn(0x7f07b40c1500 legacy=0x7f07b40a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:37.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.389+0000 7f07b3fff640 1 -- 172.21.15.91:0/256339659 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40c0910 con 0x7f07b40a9b40 2023-11-27T20:45:37.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.390+0000 7f07b3fff640 1 --2- 172.21.15.91:0/256339659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b40a9b40 0x7f07b40c24d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f07b406dff0 tx=0x7f07ac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479aa509d528e14a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:37.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.391+0000 7f07b2ffd640 1 -- 172.21.15.91:0/256339659 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac02ca80 con 0x7f07b40a9b40 2023-11-27T20:45:37.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.391+0000 7f07b2ffd640 1 -- 172.21.15.91:0/256339659 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac02cbe0 con 0x7f07b40a9b40 2023-11-27T20:45:37.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.391+0000 7f07b2ffd640 1 -- 172.21.15.91:0/256339659 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac0343f0 con 0x7f07b40a9b40 2023-11-27T20:45:37.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.391+0000 7f07b9ca6640 1 -- 172.21.15.91:0/256339659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b40a9b40 msgr2=0x7f07b40c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:37.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.391+0000 7f07b9ca6640 1 --2- 172.21.15.91:0/256339659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b40a9b40 0x7f07b40c24d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f07b406dff0 tx=0x7f07ac02bee0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.392+0000 7f07b9ca6640 1 -- 172.21.15.91:0/256339659 shutdown_connections 2023-11-27T20:45:37.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.392+0000 7f07b9ca6640 1 --2- 172.21.15.91:0/256339659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b40a9b40 0x7f07b40c24d0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.392+0000 7f07b9ca6640 1 --2- 172.21.15.91:0/256339659 >> v2:172.21.15.183:3300/0 conn(0x7f07b4155490 0x7f07b40a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.392+0000 7f07b9ca6640 1 -- 172.21.15.91:0/256339659 >> 172.21.15.91:0/256339659 conn(0x7f07b406a500 msgr2=0x7f07b406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:37.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.392+0000 7f07b9ca6640 1 -- 172.21.15.91:0/256339659 shutdown_connections 2023-11-27T20:45:37.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.392+0000 7f07b9ca6640 1 -- 172.21.15.91:0/256339659 wait complete. 2023-11-27T20:45:37.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.393+0000 7f07b9ca6640 1 Processor -- start 2023-11-27T20:45:37.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.393+0000 7f07b9ca6640 1 -- start start 2023-11-27T20:45:37.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.394+0000 7f07b9ca6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b40c1500 0x7f07b41e9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:37.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.394+0000 7f07b9ca6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b4155490 0x7f07b41df0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:37.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.394+0000 7f07b9ca6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07b406fda0 0x7f07b40bae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:37.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.394+0000 7f07b9ca6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40c0170 con 0x7f07b4155490 2023-11-27T20:45:37.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.394+0000 7f07b9ca6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b41ea080 con 0x7f07b406fda0 2023-11-27T20:45:37.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.394+0000 7f07b9ca6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40c0390 con 0x7f07b40c1500 2023-11-27T20:45:37.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07abfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b4155490 0x7f07b41df0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:37.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07abfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b4155490 0x7f07b41df0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38738/0 (socket says 172.21.15.91:38738) 2023-11-27T20:45:37.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07abfff640 1 -- 172.21.15.91:0/2511916713 learned_addr learned my addr 172.21.15.91:0/2511916713 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:37.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07b37fe640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b40c1500 0x7f07b41e9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:37.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07abfff640 1 -- 172.21.15.91:0/2511916713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b40c1500 msgr2=0x7f07b41e9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:37.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07abfff640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b40c1500 0x7f07b41e9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07b3fff640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07b406fda0 0x7f07b40bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:37.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07abfff640 1 -- 172.21.15.91:0/2511916713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07b406fda0 msgr2=0x7f07b40bae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:37.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07abfff640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07b406fda0 0x7f07b40bae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07abfff640 1 -- 172.21.15.91:0/2511916713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac009b30 con 0x7f07b4155490 2023-11-27T20:45:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.395+0000 7f07abfff640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b4155490 0x7f07b41df0c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c410 tx=0x7f079c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.396+0000 7f07b0ff9640 1 -- 172.21.15.91:0/2511916713 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c0035f0 con 0x7f07b4155490 2023-11-27T20:45:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.396+0000 7f07b0ff9640 1 -- 172.21.15.91:0/2511916713 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c003750 con 0x7f07b4155490 2023-11-27T20:45:37.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.396+0000 7f07b0ff9640 1 -- 172.21.15.91:0/2511916713 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c003b00 con 0x7f07b4155490 2023-11-27T20:45:37.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.396+0000 7f07b9ca6640 1 -- 172.21.15.91:0/2511916713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b4151ce0 con 0x7f07b4155490 2023-11-27T20:45:37.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.396+0000 7f07b9ca6640 1 -- 172.21.15.91:0/2511916713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b41edbf0 con 0x7f07b4155490 2023-11-27T20:45:37.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.397+0000 7f07b9ca6640 1 -- 172.21.15.91:0/2511916713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b4068350 con 0x7f07b4155490 2023-11-27T20:45:37.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.398+0000 7f07b0ff9640 1 -- 172.21.15.91:0/2511916713 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f079c003c60 con 0x7f07b4155490 2023-11-27T20:45:37.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.399+0000 7f07b0ff9640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f079406b1f0 0x7f079406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:37.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.399+0000 7f07b0ff9640 1 -- 172.21.15.91:0/2511916713 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f079c088ea0 con 0x7f07b4155490 2023-11-27T20:45:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.399+0000 7f07b37fe640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f079406b1f0 0x7f079406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.400+0000 7f07b37fe640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f079406b1f0 0x7f079406d6b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b810 tx=0x7f07a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:37.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.403+0000 7f07b0ff9640 1 -- 172.21.15.91:0/2511916713 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f079c0538d0 con 0x7f07b4155490 2023-11-27T20:45:37.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.607+0000 7f07b9ca6640 1 -- 172.21.15.91:0/2511916713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f07b406aa00 con 0x7f07b4155490 2023-11-27T20:45:37.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.608+0000 7f07b0ff9640 1 -- 172.21.15.91:0/2511916713 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) v1 ==== 80+0+0 (secure 0 0 0) 0x7f079c056ef0 con 0x7f07b4155490 2023-11-27T20:45:37.609 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:45:37.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 -- 172.21.15.91:0/2511916713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f079406b1f0 msgr2=0x7f079406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:37.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f079406b1f0 0x7f079406d6b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b810 tx=0x7f07a4008040 comp rx=0 tx=0).stop 2023-11-27T20:45:37.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 -- 172.21.15.91:0/2511916713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b4155490 msgr2=0x7f07b41df0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b4155490 0x7f07b41df0c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c410 tx=0x7f079c00c8d0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 -- 172.21.15.91:0/2511916713 shutdown_connections 2023-11-27T20:45:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f079406b1f0 0x7f079406d6b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07b406fda0 0x7f07b40bae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07b4155490 0x7f07b41df0c0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 --2- 172.21.15.91:0/2511916713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b40c1500 0x7f07b41e9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 -- 172.21.15.91:0/2511916713 >> 172.21.15.91:0/2511916713 conn(0x7f07b406a500 msgr2=0x7f07b406ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 -- 172.21.15.91:0/2511916713 shutdown_connections 2023-11-27T20:45:37.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:37.611+0000 7f07b9ca6640 1 -- 172.21.15.91:0/2511916713 wait complete. 2023-11-27T20:45:37.629 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-27T20:45:37.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:37.630 DEBUG:teuthology.orchestra.run.smithi091:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:37.768 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:45:37.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:37.768 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-27T20:45:37.818 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:37.818 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:37.899 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-27T20:45:37.900 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:45:38.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.148+0000 7ff25cbe5640 1 Processor -- start 2023-11-27T20:45:38.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.149+0000 7ff25cbe5640 1 -- start start 2023-11-27T20:45:38.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.150+0000 7ff25cbe5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff2580a9b40 0x7ff2580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:38.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.150+0000 7ff25cbe5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff2580c1500 0x7ff2580c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:38.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.150+0000 7ff25cbe5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2580c06c0 con 0x7ff258155490 2023-11-27T20:45:38.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.150+0000 7ff25cbe5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2580a5820 con 0x7ff2580c1500 2023-11-27T20:45:38.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.150+0000 7ff25cbe5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2580c1020 con 0x7ff2580a9b40 2023-11-27T20:45:38.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.151+0000 7ff256d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff2580c1500 0x7ff2580c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:38.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.151+0000 7ff256d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff2580c1500 0x7ff2580c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38750/0 (socket says 172.21.15.91:38750) 2023-11-27T20:45:38.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.151+0000 7ff256d9d640 1 -- 172.21.15.91:0/2847381681 learned_addr learned my addr 172.21.15.91:0/2847381681 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:38.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.151+0000 7ff24ffff640 1 --2- 172.21.15.91:0/2847381681 >> v2:172.21.15.183:3300/0 conn(0x7ff2580a9b40 0x7ff2580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:38.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.151+0000 7ff256d9d640 1 -- 172.21.15.91:0/2847381681 >> v2:172.21.15.183:3300/0 conn(0x7ff2580a9b40 msgr2=0x7ff2580a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:38.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.151+0000 7ff256d9d640 1 --2- 172.21.15.91:0/2847381681 >> v2:172.21.15.183:3300/0 conn(0x7ff2580a9b40 0x7ff2580a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:38.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.151+0000 7ff256d9d640 1 -- 172.21.15.91:0/2847381681 >> v1:172.21.15.91:6789/0 conn(0x7ff258155490 legacy=0x7ff2580a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:38.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.151+0000 7ff256d9d640 1 -- 172.21.15.91:0/2847381681 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2580c0910 con 0x7ff2580c1500 2023-11-27T20:45:38.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.151+0000 7ff24ffff640 1 --2- 172.21.15.91:0/2847381681 >> v2:172.21.15.183:3300/0 conn(0x7ff2580a9b40 0x7ff2580a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:38.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.152+0000 7ff256d9d640 1 --2- 172.21.15.91:0/2847381681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 0x7ff2580c24d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff2580a5160 tx=0x7ff25002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb58279ac3ea50b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:38.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff255d9b640 1 -- 172.21.15.91:0/2847381681 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25002cb20 con 0x7ff2580c1500 2023-11-27T20:45:38.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff255d9b640 1 -- 172.21.15.91:0/2847381681 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25002cc80 con 0x7ff2580c1500 2023-11-27T20:45:38.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff255d9b640 1 -- 172.21.15.91:0/2847381681 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2500343f0 con 0x7ff2580c1500 2023-11-27T20:45:38.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2847381681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 msgr2=0x7ff2580c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:38.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff25cbe5640 1 --2- 172.21.15.91:0/2847381681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 0x7ff2580c24d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff2580a5160 tx=0x7ff25002bf80 comp rx=0 tx=0).stop 2023-11-27T20:45:38.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2847381681 shutdown_connections 2023-11-27T20:45:38.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff25cbe5640 1 --2- 172.21.15.91:0/2847381681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 0x7ff2580c24d0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:38.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff25cbe5640 1 --2- 172.21.15.91:0/2847381681 >> v2:172.21.15.183:3300/0 conn(0x7ff2580a9b40 0x7ff2580a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:38.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2847381681 >> 172.21.15.91:0/2847381681 conn(0x7ff25806a500 msgr2=0x7ff25806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:38.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2847381681 shutdown_connections 2023-11-27T20:45:38.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.153+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2847381681 wait complete. 2023-11-27T20:45:38.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.155+0000 7ff25cbe5640 1 Processor -- start 2023-11-27T20:45:38.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.155+0000 7ff25cbe5640 1 -- start start 2023-11-27T20:45:38.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.156+0000 7ff25cbe5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 0x7ff25814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:38.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.156+0000 7ff25cbe5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff258155490 0x7ff2581ea810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:38.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.156+0000 7ff25cbe5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2581eb5c0 0x7ff2581ead50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:38.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.156+0000 7ff25cbe5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581ee0d0 con 0x7ff2580c1500 2023-11-27T20:45:38.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.156+0000 7ff25cbe5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581ee600 con 0x7ff2581eb5c0 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.156+0000 7ff25cbe5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581ea380 con 0x7ff258155490 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.156+0000 7ff25659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 0x7ff25814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.156+0000 7ff25659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 0x7ff25814a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38762/0 (socket says 172.21.15.91:38762) 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.156+0000 7ff25659c640 1 -- 172.21.15.91:0/2994784415 learned_addr learned my addr 172.21.15.91:0/2994784415 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff25659c640 1 -- 172.21.15.91:0/2994784415 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff258155490 msgr2=0x7ff2581ea810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff25659c640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff258155490 0x7ff2581ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff25659c640 1 -- 172.21.15.91:0/2994784415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2581eb5c0 msgr2=0x7ff2581ead50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff256d9d640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2581eb5c0 0x7ff2581ead50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff25659c640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2581eb5c0 0x7ff2581ead50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff25659c640 1 -- 172.21.15.91:0/2994784415 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff250009b30 con 0x7ff2580c1500 2023-11-27T20:45:38.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff25659c640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 0x7ff25814a240 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff24800c400 tx=0x7ff24800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:38.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff24effd640 1 -- 172.21.15.91:0/2994784415 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2480052d0 con 0x7ff2580c1500 2023-11-27T20:45:38.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff24effd640 1 -- 172.21.15.91:0/2994784415 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff248005430 con 0x7ff2580c1500 2023-11-27T20:45:38.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff24effd640 1 -- 172.21.15.91:0/2994784415 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248003830 con 0x7ff2580c1500 2023-11-27T20:45:38.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2994784415 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2581ed480 con 0x7ff2580c1500 2023-11-27T20:45:38.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.157+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2994784415 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2580713d0 con 0x7ff2580c1500 2023-11-27T20:45:38.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.159+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2994784415 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2580c38b0 con 0x7ff2580c1500 2023-11-27T20:45:38.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.160+0000 7ff24effd640 1 -- 172.21.15.91:0/2994784415 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff248003990 con 0x7ff2580c1500 2023-11-27T20:45:38.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.160+0000 7ff24effd640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff23806b1c0 0x7ff23806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:38.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.161+0000 7ff24effd640 1 -- 172.21.15.91:0/2994784415 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7ff248089370 con 0x7ff2580c1500 2023-11-27T20:45:38.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.161+0000 7ff24ffff640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff23806b1c0 0x7ff23806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:38.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.161+0000 7ff24ffff640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff23806b1c0 0x7ff23806d680 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff240006fd0 tx=0x7ff240008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:38.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.165+0000 7ff24effd640 1 -- 172.21.15.91:0/2994784415 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff248053d00 con 0x7ff2580c1500 2023-11-27T20:45:38.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.402+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2994784415 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff258068350 con 0x7ff2580c1500 2023-11-27T20:45:38.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.403+0000 7ff24effd640 1 -- 172.21.15.91:0/2994784415 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7ff248057320 con 0x7ff2580c1500 2023-11-27T20:45:38.404 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:45:38.405 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-27T20:45:38.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.405+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2994784415 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff23806b1c0 msgr2=0x7ff23806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:38.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.405+0000 7ff25cbe5640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff23806b1c0 0x7ff23806d680 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff240006fd0 tx=0x7ff240008040 comp rx=0 tx=0).stop 2023-11-27T20:45:38.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.405+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2994784415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 msgr2=0x7ff25814a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.405+0000 7ff25cbe5640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 0x7ff25814a240 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff24800c400 tx=0x7ff24800c8c0 comp rx=0 tx=0).stop 2023-11-27T20:45:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.406+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2994784415 shutdown_connections 2023-11-27T20:45:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.406+0000 7ff25cbe5640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff23806b1c0 0x7ff23806d680 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.406+0000 7ff25cbe5640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2581eb5c0 0x7ff2581ead50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.406+0000 7ff25cbe5640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff258155490 0x7ff2581ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.406+0000 7ff25cbe5640 1 --2- 172.21.15.91:0/2994784415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2580c1500 0x7ff25814a240 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.406+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2994784415 >> 172.21.15.91:0/2994784415 conn(0x7ff25806a500 msgr2=0x7ff25814b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.406+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2994784415 shutdown_connections 2023-11-27T20:45:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:38.406+0000 7ff25cbe5640 1 -- 172.21.15.91:0/2994784415 wait complete. 2023-11-27T20:45:38.424 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T20:45:38.424 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:45:38.424 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-27T20:45:38.425 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-27T20:45:38.425 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:38.425 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T20:45:38.425 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:45:38.425 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.WHWyUDgsLl 2023-11-27T20:45:38.425 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-27T20:45:38.472 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.yD3VAWozeY 2023-11-27T20:45:38.473 DEBUG:teuthology.orchestra.run.smithi091:> sudo cp /tmp/tmp.WHWyUDgsLl /tmp/tmp.yD3VAWozeY 2023-11-27T20:45:38.554 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.yD3VAWozeY 2023-11-27T20:45:38.710 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.yD3VAWozeY is 226B 2023-11-27T20:45:38.772 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.yD3VAWozeY 2023-11-27T20:45:38.827 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-27T20:45:38.827 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:45:38.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:38.828 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-27T20:45:38.881 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:45:38.881 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:45:38.881 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:45:38.881 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:38.881 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-27T20:45:38.881 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:38.881 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:38.881 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 42083sec preferred_lft 42083sec 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-27T20:45:38.882 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:38.883 INFO:teuthology.orchestra.run.smithi091.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:45:38.883 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:38.883 INFO:teuthology.orchestra.run.smithi091.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:45:38.883 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:38.883 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::c0c6:34ff:feb5:e67/64 scope link 2023-11-27T20:45:38.883 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:38.883 INFO:teuthology.orchestra.run.smithi091.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:45:38.883 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether da:e3:06:8b:3b:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:45:38.883 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::d8e3:6ff:fe8b:3b7f/64 scope link 2023-11-27T20:45:38.883 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:38.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:38.884 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:45:38.973 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-27T20:45:38.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:38.978 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-27T20:45:39.034 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-27T20:45:39.035 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:45:39.035 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:45:39.035 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:45:39.035 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:45:39.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:39.035 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-27T20:45:39.035 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-27T20:45:39.036 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:45:39.036 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:45:39.036 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:45:39.036 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-27T20:45:39.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:39.224 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T20:45:39.275 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T20:45:39.276 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:45:39.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:39.276 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-11-27T20:45:39.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:45:39.367 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:39.421 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T20:45:39.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:45:39.421 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:39.471 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:39.471 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/tmp/tmp.WHWyUDgsLl of=/dev/stdout 2023-11-27T20:45:39.520 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:45:39.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:39.520 DEBUG:teuthology.orchestra.run.smithi091:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2023-11-27T20:45:39.663 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,secret=AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2023-11-27T20:45:39.663 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs". 2023-11-27T20:45:39.663 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:45:39.664 INFO:teuthology.orchestra.run.smithi091.stdout:keyring.get_secret failed 2023-11-27T20:45:39.686 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,secret=AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2023-11-27T20:45:39.686 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs". 2023-11-27T20:45:39.686 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:45:39.686 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:45:39.687 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:45:39.687 INFO:teuthology.orchestra.run.smithi091.stdout:keyring.get_secret failed 2023-11-27T20:45:39.713 INFO:teuthology.orchestra.run.smithi091.stdout:parsing options: rw,norequire_active_mds,secret=AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2023-11-27T20:45:39.714 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs". 2023-11-27T20:45:39.714 INFO:teuthology.orchestra.run.smithi091.stdout:invalid new device string format 2023-11-27T20:45:39.714 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:45:39.714 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:45:39.714 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:45:39.714 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:45:39.714 INFO:teuthology.orchestra.run.smithi091.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs,key=testuser,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:45:39.716 INFO:teuthology.orchestra.run.smithi091.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-27T20:45:39.716 INFO:teuthology.orchestra.run.smithi091.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:45:39.716 INFO:teuthology.orchestra.run.smithi091.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:45:39.716 INFO:teuthology.orchestra.run.smithi091.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:45:39.716 INFO:teuthology.orchestra.run.smithi091.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:45:39.721 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:45:39.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:39.721 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:39.805 INFO:teuthology.orchestra.run.smithi091.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-11-27T20:45:39.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:45:39.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:39.809 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:45:39.868 INFO:teuthology.orchestra.run.smithi091.stdout:client5437 2023-11-27T20:45:39.868 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:39.868 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:39.919 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-11-27T20:45:39.982 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.VklaMpXsm0 2023-11-27T20:45:39.982 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:39.982 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/tmp/tmp.VklaMpXsm0 2023-11-27T20:45:40.037 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:40.037 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:40.136 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:40.136 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:40.191 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:40.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.414+0000 7f86f1bed640 1 Processor -- start 2023-11-27T20:45:40.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.414+0000 7f86f1bed640 1 -- start start 2023-11-27T20:45:40.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.415+0000 7f86f1bed640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f86ec14e7f0 0x7f86ec0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.415+0000 7f86f1bed640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86ec06cd20 0x7f86ec15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.415+0000 7f86f1bed640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ec0a8380 con 0x7f86ec0c52e0 2023-11-27T20:45:40.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.415+0000 7f86f1bed640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec1510b0 con 0x7f86ec14e7f0 2023-11-27T20:45:40.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.415+0000 7f86f1bed640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec06bf60 con 0x7f86ec06cd20 2023-11-27T20:45:40.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.415+0000 7f86f0beb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f86ec14e7f0 0x7f86ec0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.416+0000 7f86f0beb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f86ec14e7f0 0x7f86ec0c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38770/0 (socket says 172.21.15.91:38770) 2023-11-27T20:45:40.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.416+0000 7f86f0beb640 1 -- 172.21.15.91:0/1652317945 learned_addr learned my addr 172.21.15.91:0/1652317945 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:40.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.416+0000 7f86f0beb640 1 -- 172.21.15.91:0/1652317945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86ec06cd20 msgr2=0x7f86ec15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:40.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.416+0000 7f86f0beb640 1 --2- 172.21.15.91:0/1652317945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86ec06cd20 0x7f86ec15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.416+0000 7f86f0beb640 1 -- 172.21.15.91:0/1652317945 >> v1:172.21.15.91:6789/0 conn(0x7f86ec0c52e0 legacy=0x7f86ec06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:40.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.416+0000 7f86f0beb640 1 -- 172.21.15.91:0/1652317945 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec06c240 con 0x7f86ec14e7f0 2023-11-27T20:45:40.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.417+0000 7f86f0beb640 1 --2- 172.21.15.91:0/1652317945 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 0x7f86ec0c0440 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009870 tx=0x7f86e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e109601358e33775 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:40.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.417+0000 7f86eb7fe640 1 -- 172.21.15.91:0/1652317945 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0031870 con 0x7f86ec14e7f0 2023-11-27T20:45:40.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.417+0000 7f86eb7fe640 1 -- 172.21.15.91:0/1652317945 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e00319d0 con 0x7f86ec14e7f0 2023-11-27T20:45:40.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.417+0000 7f86eb7fe640 1 -- 172.21.15.91:0/1652317945 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0031d60 con 0x7f86ec14e7f0 2023-11-27T20:45:40.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.418+0000 7f86f1bed640 1 -- 172.21.15.91:0/1652317945 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 msgr2=0x7f86ec0c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:40.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.418+0000 7f86f1bed640 1 --2- 172.21.15.91:0/1652317945 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 0x7f86ec0c0440 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009870 tx=0x7f86e002b910 comp rx=0 tx=0).stop 2023-11-27T20:45:40.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.418+0000 7f86f1bed640 1 -- 172.21.15.91:0/1652317945 shutdown_connections 2023-11-27T20:45:40.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.418+0000 7f86f1bed640 1 --2- 172.21.15.91:0/1652317945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86ec06cd20 0x7f86ec15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.418+0000 7f86f1bed640 1 --2- 172.21.15.91:0/1652317945 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 0x7f86ec0c0440 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.418+0000 7f86f1bed640 1 -- 172.21.15.91:0/1652317945 >> 172.21.15.91:0/1652317945 conn(0x7f86ec0a77f0 msgr2=0x7f86ec0a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:40.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.418+0000 7f86f1bed640 1 -- 172.21.15.91:0/1652317945 shutdown_connections 2023-11-27T20:45:40.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.418+0000 7f86f1bed640 1 -- 172.21.15.91:0/1652317945 wait complete. 2023-11-27T20:45:40.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.420+0000 7f86f1bed640 1 Processor -- start 2023-11-27T20:45:40.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.420+0000 7f86f1bed640 1 -- start start 2023-11-27T20:45:40.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.421+0000 7f86f1bed640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86ec06cd20 0x7f86ec150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.421+0000 7f86f1bed640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86ec0c52e0 0x7f86ec1de960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.421+0000 7f86f1bed640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 0x7f86ec1eba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.421+0000 7f86f1bed640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec1dc570 con 0x7f86ec14e7f0 2023-11-27T20:45:40.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.421+0000 7f86f1bed640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec1eb370 con 0x7f86ec06cd20 2023-11-27T20:45:40.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.421+0000 7f86f1bed640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec1dc040 con 0x7f86ec0c52e0 2023-11-27T20:45:40.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.421+0000 7f86f13ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 0x7f86ec1eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.421+0000 7f86f13ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 0x7f86ec1eba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38786/0 (socket says 172.21.15.91:38786) 2023-11-27T20:45:40.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.421+0000 7f86f13ec640 1 -- 172.21.15.91:0/3579271693 learned_addr learned my addr 172.21.15.91:0/3579271693 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:40.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86ebfff640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86ec0c52e0 0x7f86ec1de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86f0beb640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86ec06cd20 0x7f86ec150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86f13ec640 1 -- 172.21.15.91:0/3579271693 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86ec0c52e0 msgr2=0x7f86ec1de960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:40.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86f13ec640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86ec0c52e0 0x7f86ec1de960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86f13ec640 1 -- 172.21.15.91:0/3579271693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86ec06cd20 msgr2=0x7f86ec150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:40.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86f13ec640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86ec06cd20 0x7f86ec150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86f13ec640 1 -- 172.21.15.91:0/3579271693 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00094d0 con 0x7f86ec14e7f0 2023-11-27T20:45:40.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86f0beb640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86ec06cd20 0x7f86ec150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:40.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86f13ec640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 0x7f86ec1eba80 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f86e400b9e0 tx=0x7f86e400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:40.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86e97fa640 1 -- 172.21.15.91:0/3579271693 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e400cb20 con 0x7f86ec14e7f0 2023-11-27T20:45:40.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86e97fa640 1 -- 172.21.15.91:0/3579271693 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e400cc80 con 0x7f86ec14e7f0 2023-11-27T20:45:40.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86f1bed640 1 -- 172.21.15.91:0/3579271693 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec1eb5f0 con 0x7f86ec14e7f0 2023-11-27T20:45:40.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.422+0000 7f86e97fa640 1 -- 172.21.15.91:0/3579271693 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4014440 con 0x7f86ec14e7f0 2023-11-27T20:45:40.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.423+0000 7f86f1bed640 1 -- 172.21.15.91:0/3579271693 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec1e8180 con 0x7f86ec14e7f0 2023-11-27T20:45:40.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.424+0000 7f86f1bed640 1 -- 172.21.15.91:0/3579271693 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec1eb780 con 0x7f86ec14e7f0 2023-11-27T20:45:40.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.425+0000 7f86e97fa640 1 -- 172.21.15.91:0/3579271693 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f86e401d3b0 con 0x7f86ec14e7f0 2023-11-27T20:45:40.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.426+0000 7f86e97fa640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86d006b1c0 0x7f86d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.426+0000 7f86e97fa640 1 -- 172.21.15.91:0/3579271693 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f86e4089c30 con 0x7f86ec14e7f0 2023-11-27T20:45:40.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.426+0000 7f86f0beb640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86d006b1c0 0x7f86d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.427+0000 7f86f0beb640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86d006b1c0 0x7f86d006d680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f86e0036000 tx=0x7f86e003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:40.436 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.430+0000 7f86e97fa640 1 -- 172.21.15.91:0/3579271693 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f86e4054660 con 0x7f86ec14e7f0 2023-11-27T20:45:40.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.624+0000 7f86f1bed640 1 -- 172.21.15.91:0/3579271693 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86ec04e840 con 0x7f86ec14e7f0 2023-11-27T20:45:40.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.627+0000 7f86e97fa640 1 -- 172.21.15.91:0/3579271693 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f86e4019020 con 0x7f86ec14e7f0 2023-11-27T20:45:40.629 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:40.629 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":81,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:23.334850+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:40.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 -- 172.21.15.91:0/3579271693 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86d006b1c0 msgr2=0x7f86d006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:40.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86d006b1c0 0x7f86d006d680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f86e0036000 tx=0x7f86e003c040 comp rx=0 tx=0).stop 2023-11-27T20:45:40.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 -- 172.21.15.91:0/3579271693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 msgr2=0x7f86ec1eba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:40.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 0x7f86ec1eba80 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f86e400b9e0 tx=0x7f86e400bea0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 -- 172.21.15.91:0/3579271693 shutdown_connections 2023-11-27T20:45:40.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86ec14e7f0 0x7f86ec1eba80 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86ec0c52e0 0x7f86ec1de960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86d006b1c0 0x7f86d006d680 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 --2- 172.21.15.91:0/3579271693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86ec06cd20 0x7f86ec150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 -- 172.21.15.91:0/3579271693 >> 172.21.15.91:0/3579271693 conn(0x7f86ec0a77f0 msgr2=0x7f86ec0a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:40.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 -- 172.21.15.91:0/3579271693 shutdown_connections 2023-11-27T20:45:40.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.630+0000 7f86f1bed640 1 -- 172.21.15.91:0/3579271693 wait complete. 2023-11-27T20:45:40.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:45:04.361620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:45:05.090674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:45:19.465319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:45:20.794821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:45:40.652 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:45:40.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.862+0000 7f3424dd0640 1 Processor -- start 2023-11-27T20:45:40.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.862+0000 7f3424dd0640 1 -- start start 2023-11-27T20:45:40.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.864+0000 7f3424dd0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342014fd30 0x7f3420152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.864+0000 7f3424dd0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f342006d0a0 0x7f34200a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.864+0000 7f3424dd0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f34200a5260 0x7f34200c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.864+0000 7f3424dd0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34200c64a0 con 0x7f34200a5260 2023-11-27T20:45:40.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.864+0000 7f3424dd0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34200c5c00 con 0x7f342006d0a0 2023-11-27T20:45:40.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.864+0000 7f3424dd0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34200c5ee0 con 0x7f342014fd30 2023-11-27T20:45:40.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.864+0000 7f341ed9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f34200a5260 0x7f34200c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.864+0000 7f341ed9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f34200a5260 0x7f34200c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38788/0 (socket says 172.21.15.91:38788) 2023-11-27T20:45:40.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.864+0000 7f341ed9d640 1 -- 172.21.15.91:0/1174681166 learned_addr learned my addr 172.21.15.91:0/1174681166 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:40.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.865+0000 7f341e59c640 1 --2- 172.21.15.91:0/1174681166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342014fd30 0x7f3420152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.865+0000 7f3417fff640 1 --2- 172.21.15.91:0/1174681166 >> v2:172.21.15.183:3300/0 conn(0x7f342006d0a0 0x7f34200a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.865+0000 7f341ed9d640 1 -- 172.21.15.91:0/1174681166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342014fd30 msgr2=0x7f3420152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:40.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.865+0000 7f341ed9d640 1 --2- 172.21.15.91:0/1174681166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342014fd30 0x7f3420152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.865+0000 7f341ed9d640 1 -- 172.21.15.91:0/1174681166 >> v2:172.21.15.183:3300/0 conn(0x7f342006d0a0 msgr2=0x7f34200a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:40.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.865+0000 7f341ed9d640 1 --2- 172.21.15.91:0/1174681166 >> v2:172.21.15.183:3300/0 conn(0x7f342006d0a0 0x7f34200a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.865+0000 7f341ed9d640 1 -- 172.21.15.91:0/1174681166 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34200c61c0 con 0x7f34200a5260 2023-11-27T20:45:40.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.866+0000 7f341ed9d640 1 --2- 172.21.15.91:0/1174681166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f34200a5260 0x7f34200c3ea0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f342006b280 tx=0x7f341802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7cce6205b02b26 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:40.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.866+0000 7f341dd9b640 1 -- 172.21.15.91:0/1174681166 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341802ca80 con 0x7f34200a5260 2023-11-27T20:45:40.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.866+0000 7f341dd9b640 1 -- 172.21.15.91:0/1174681166 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341802cbe0 con 0x7f34200a5260 2023-11-27T20:45:40.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.866+0000 7f341dd9b640 1 -- 172.21.15.91:0/1174681166 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34180343f0 con 0x7f34200a5260 2023-11-27T20:45:40.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.867+0000 7f3424dd0640 1 -- 172.21.15.91:0/1174681166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f34200a5260 msgr2=0x7f34200c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:40.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.867+0000 7f3424dd0640 1 --2- 172.21.15.91:0/1174681166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f34200a5260 0x7f34200c3ea0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f342006b280 tx=0x7f341802bee0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.867+0000 7f3424dd0640 1 -- 172.21.15.91:0/1174681166 shutdown_connections 2023-11-27T20:45:40.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.867+0000 7f3424dd0640 1 --2- 172.21.15.91:0/1174681166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f34200a5260 0x7f34200c3ea0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.867+0000 7f3424dd0640 1 --2- 172.21.15.91:0/1174681166 >> v2:172.21.15.183:3300/0 conn(0x7f342006d0a0 0x7f34200a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.867+0000 7f3424dd0640 1 --2- 172.21.15.91:0/1174681166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342014fd30 0x7f3420152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.867+0000 7f3424dd0640 1 -- 172.21.15.91:0/1174681166 >> 172.21.15.91:0/1174681166 conn(0x7f342006a500 msgr2=0x7f342006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:40.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.867+0000 7f3424dd0640 1 -- 172.21.15.91:0/1174681166 shutdown_connections 2023-11-27T20:45:40.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.867+0000 7f3424dd0640 1 -- 172.21.15.91:0/1174681166 wait complete. 2023-11-27T20:45:40.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.869+0000 7f3424dd0640 1 Processor -- start 2023-11-27T20:45:40.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.869+0000 7f3424dd0640 1 -- start start 2023-11-27T20:45:40.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.870+0000 7f3424dd0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342006d0a0 0x7f3420071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.870+0000 7f3424dd0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34200a5260 0x7f34201eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.870+0000 7f3424dd0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342014fd30 0x7f34201dbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.870+0000 7f3424dd0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34201ea890 con 0x7f342014fd30 2023-11-27T20:45:40.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.870+0000 7f3424dd0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34201eecf0 con 0x7f34200a5260 2023-11-27T20:45:40.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.870+0000 7f3424dd0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34201562a0 con 0x7f342006d0a0 2023-11-27T20:45:40.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.870+0000 7f341ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342014fd30 0x7f34201dbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.870+0000 7f341ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342014fd30 0x7f34201dbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38790/0 (socket says 172.21.15.91:38790) 2023-11-27T20:45:40.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.870+0000 7f341ed9d640 1 -- 172.21.15.91:0/239271369 learned_addr learned my addr 172.21.15.91:0/239271369 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:40.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f341e59c640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342006d0a0 0x7f3420071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f3417fff640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34200a5260 0x7f34201eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f341ed9d640 1 -- 172.21.15.91:0/239271369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342006d0a0 msgr2=0x7f3420071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f341ed9d640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342006d0a0 0x7f3420071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f341ed9d640 1 -- 172.21.15.91:0/239271369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34200a5260 msgr2=0x7f34201eafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f341ed9d640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34200a5260 0x7f34201eafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f341ed9d640 1 -- 172.21.15.91:0/239271369 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3418009b30 con 0x7f342014fd30 2023-11-27T20:45:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f3417fff640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34200a5260 0x7f34201eafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f341ed9d640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342014fd30 0x7f34201dbad0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3418036040 tx=0x7f3418004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:40.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f3416ffd640 1 -- 172.21.15.91:0/239271369 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341803e450 con 0x7f342014fd30 2023-11-27T20:45:40.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f3416ffd640 1 -- 172.21.15.91:0/239271369 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341803e5b0 con 0x7f342014fd30 2023-11-27T20:45:40.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f3416ffd640 1 -- 172.21.15.91:0/239271369 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341803e960 con 0x7f342014fd30 2023-11-27T20:45:40.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f3424dd0640 1 -- 172.21.15.91:0/239271369 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3420156580 con 0x7f342014fd30 2023-11-27T20:45:40.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.871+0000 7f3424dd0640 1 -- 172.21.15.91:0/239271369 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34200715a0 con 0x7f342014fd30 2023-11-27T20:45:40.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.872+0000 7f3424dd0640 1 -- 172.21.15.91:0/239271369 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34201567c0 con 0x7f342014fd30 2023-11-27T20:45:40.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.874+0000 7f3416ffd640 1 -- 172.21.15.91:0/239271369 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f341802cd50 con 0x7f342014fd30 2023-11-27T20:45:40.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.874+0000 7f3416ffd640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f340006b1c0 0x7f340006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:40.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.874+0000 7f3416ffd640 1 -- 172.21.15.91:0/239271369 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f34180ac8a0 con 0x7f342014fd30 2023-11-27T20:45:40.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.875+0000 7f341e59c640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f340006b1c0 0x7f340006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:40.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.875+0000 7f341e59c640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f340006b1c0 0x7f340006d680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3410006fd0 tx=0x7f3410008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:40.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:40.879+0000 7f3416ffd640 1 -- 172.21.15.91:0/239271369 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f34201567c0 con 0x7f342014fd30 2023-11-27T20:45:41.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.069+0000 7f3424dd0640 1 -- 172.21.15.91:0/239271369 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34201567c0 con 0x7f342014fd30 2023-11-27T20:45:41.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.070+0000 7f3416ffd640 1 -- 172.21.15.91:0/239271369 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34201567c0 con 0x7f342014fd30 2023-11-27T20:45:41.071 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:45:41.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 -- 172.21.15.91:0/239271369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f340006b1c0 msgr2=0x7f340006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f340006b1c0 0x7f340006d680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3410006fd0 tx=0x7f3410008040 comp rx=0 tx=0).stop 2023-11-27T20:45:41.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 -- 172.21.15.91:0/239271369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342014fd30 msgr2=0x7f34201dbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342014fd30 0x7f34201dbad0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3418036040 tx=0x7f3418004a40 comp rx=0 tx=0).stop 2023-11-27T20:45:41.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 -- 172.21.15.91:0/239271369 shutdown_connections 2023-11-27T20:45:41.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f342014fd30 0x7f34201dbad0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f340006b1c0 0x7f340006d680 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34200a5260 0x7f34201eafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 --2- 172.21.15.91:0/239271369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f342006d0a0 0x7f3420071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 -- 172.21.15.91:0/239271369 >> 172.21.15.91:0/239271369 conn(0x7f342006a500 msgr2=0x7f34200c1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:41.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 -- 172.21.15.91:0/239271369 shutdown_connections 2023-11-27T20:45:41.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.073+0000 7f3424dd0640 1 -- 172.21.15.91:0/239271369 wait complete. 2023-11-27T20:45:41.093 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:45:41.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.308+0000 7f9a8d42b640 1 Processor -- start 2023-11-27T20:45:41.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.308+0000 7f9a8d42b640 1 -- start start 2023-11-27T20:45:41.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.309+0000 7f9a8d42b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a88151cc0 0x7f9a88155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.309+0000 7f9a8d42b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a881556d0 con 0x7f9a880c4940 2023-11-27T20:45:41.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.309+0000 7f9a8d42b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a88154740 con 0x7f9a880c7ec0 2023-11-27T20:45:41.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.309+0000 7f9a8d42b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8806c760 con 0x7f9a88151cc0 2023-11-27T20:45:41.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a877fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f9a880c4940 0x7f9a8815f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:57912/0 (socket says 172.21.15.91:57912) 2023-11-27T20:45:41.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a877fe640 1 -- 172.21.15.91:0/2340623652 learned_addr learned my addr 172.21.15.91:0/2340623652 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:41.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591813555 0 0) 0x7f9a80001110 con 0x7f9a880c4940 2023-11-27T20:45:41.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a74003520 con 0x7f9a880c4940 2023-11-27T20:45:41.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a86ffd640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a88151cc0 0x7f9a88155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948359783 0 0) 0x7f9a74003520 con 0x7f9a880c4940 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a88151cc0 msgr2=0x7f9a88155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a85ffb640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a88151cc0 0x7f9a88155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 >> v1:172.21.15.183:6789/0 conn(0x7f9a880c7ec0 legacy=0x7f9a88157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a880c8470 con 0x7f9a880c4940 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f9a80001800 con 0x7f9a880c4940 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a86ffd640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a88151cc0 0x7f9a88155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.310+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 >> v1:172.21.15.91:6789/0 conn(0x7f9a880c4940 legacy=0x7f9a8815f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a85ffb640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a88151cc0 0x7f9a740039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a85ffb640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a74004070 0x7f9a740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a85ffb640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a74004d50 0x7f9a740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8806c760 con 0x7f9a74004070 2023-11-27T20:45:41.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7400bbc0 con 0x7f9a74004d50 2023-11-27T20:45:41.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7400bd80 con 0x7f9a88151cc0 2023-11-27T20:45:41.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a867fc640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a74004070 0x7f9a740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a86ffd640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a88151cc0 0x7f9a740039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a867fc640 1 -- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a88151cc0 msgr2=0x7f9a740039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:41.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a867fc640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a88151cc0 0x7f9a740039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a867fc640 1 -- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a74004d50 msgr2=0x7f9a740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:41.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a867fc640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a74004d50 0x7f9a740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.311+0000 7f9a867fc640 1 -- 172.21.15.91:0/2340623652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74003520 con 0x7f9a74004070 2023-11-27T20:45:41.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.312+0000 7f9a867fc640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a74004070 0x7f9a740047c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f9a880c8320 tx=0x7f9a740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b8f8f09aded327 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:41.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.313+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70032600 con 0x7f9a74004070 2023-11-27T20:45:41.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.313+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7002e050 con 0x7f9a74004070 2023-11-27T20:45:41.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.313+0000 7f9a85ffb640 1 -- 172.21.15.91:0/2340623652 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a700329e0 con 0x7f9a74004070 2023-11-27T20:45:41.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.313+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2340623652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a74004070 msgr2=0x7f9a740047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.313+0000 7f9a8d42b640 1 --2- 172.21.15.91:0/2340623652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a74004070 0x7f9a740047c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f9a880c8320 tx=0x7f9a740057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.313+0000 7f9a877fe640 1 -- 172.21.15.91:0/2340623652 reap_dead start 2023-11-27T20:45:41.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.313+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2340623652 shutdown_connections 2023-11-27T20:45:41.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.313+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2340623652 >> 172.21.15.91:0/2340623652 conn(0x7f9a88071e10 msgr2=0x7f9a88072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:41.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.313+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2340623652 shutdown_connections 2023-11-27T20:45:41.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.313+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2340623652 wait complete. 2023-11-27T20:45:41.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.315+0000 7f9a8d42b640 1 Processor -- start 2023-11-27T20:45:41.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.315+0000 7f9a8d42b640 1 -- start start 2023-11-27T20:45:41.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.316+0000 7f9a8d42b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a74004070 0x7f9a88147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.316+0000 7f9a8d42b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a88148b30 0x7f9a881536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.316+0000 7f9a8d42b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a88153c20 0x7f9a881ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.316+0000 7f9a8d42b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a880c3ff0 con 0x7f9a88153c20 2023-11-27T20:45:41.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.316+0000 7f9a8d42b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8814c930 con 0x7f9a88148b30 2023-11-27T20:45:41.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.316+0000 7f9a8d42b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88148600 con 0x7f9a74004070 2023-11-27T20:45:41.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a877fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a88153c20 0x7f9a881ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a877fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a88153c20 0x7f9a881ed9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38810/0 (socket says 172.21.15.91:38810) 2023-11-27T20:45:41.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a877fe640 1 -- 172.21.15.91:0/2519306267 learned_addr learned my addr 172.21.15.91:0/2519306267 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:41.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a867fc640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a88148b30 0x7f9a881536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a86ffd640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a74004070 0x7f9a88147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a877fe640 1 -- 172.21.15.91:0/2519306267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a74004070 msgr2=0x7f9a88147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a877fe640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a74004070 0x7f9a88147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a877fe640 1 -- 172.21.15.91:0/2519306267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a88148b30 msgr2=0x7f9a881536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a877fe640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a88148b30 0x7f9a881536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a877fe640 1 -- 172.21.15.91:0/2519306267 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a881488c0 con 0x7f9a88153c20 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.317+0000 7f9a877fe640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a88153c20 0x7f9a881ed9a0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f9a88072b80 tx=0x7f9a8000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.318+0000 7f9a7f7fe640 1 -- 172.21.15.91:0/2519306267 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800072d0 con 0x7f9a88153c20 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.318+0000 7f9a7f7fe640 1 -- 172.21.15.91:0/2519306267 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8000ced0 con 0x7f9a88153c20 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.318+0000 7f9a7f7fe640 1 -- 172.21.15.91:0/2519306267 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80007670 con 0x7f9a88153c20 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.318+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2519306267 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a880c3650 con 0x7f9a88153c20 2023-11-27T20:45:41.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.318+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2519306267 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a880c3c10 con 0x7f9a88153c20 2023-11-27T20:45:41.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.319+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2519306267 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a880c3dd0 con 0x7f9a88153c20 2023-11-27T20:45:41.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.320+0000 7f9a7f7fe640 1 -- 172.21.15.91:0/2519306267 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9a800047e0 con 0x7f9a88153c20 2023-11-27T20:45:41.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.321+0000 7f9a7f7fe640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a6806b1c0 0x7f9a6806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.321+0000 7f9a7f7fe640 1 -- 172.21.15.91:0/2519306267 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f9a800896a0 con 0x7f9a88153c20 2023-11-27T20:45:41.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.321+0000 7f9a86ffd640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a6806b1c0 0x7f9a6806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.322+0000 7f9a86ffd640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a6806b1c0 0x7f9a6806d680 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9a780085b0 tx=0x7f9a78008540 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:41.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.325+0000 7f9a7f7fe640 1 -- 172.21.15.91:0/2519306267 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9a800540d0 con 0x7f9a88153c20 2023-11-27T20:45:41.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.515+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2519306267 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9a881556d0 con 0x7f9a88153c20 2023-11-27T20:45:41.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.516+0000 7f9a7f7fe640 1 -- 172.21.15.91:0/2519306267 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9a881556d0 con 0x7f9a88153c20 2023-11-27T20:45:41.518 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:41.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2519306267 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a6806b1c0 msgr2=0x7f9a6806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a6806b1c0 0x7f9a6806d680 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9a780085b0 tx=0x7f9a78008540 comp rx=0 tx=0).stop 2023-11-27T20:45:41.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2519306267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a88153c20 msgr2=0x7f9a881ed9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a88153c20 0x7f9a881ed9a0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f9a88072b80 tx=0x7f9a8000cb90 comp rx=0 tx=0).stop 2023-11-27T20:45:41.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2519306267 shutdown_connections 2023-11-27T20:45:41.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a88153c20 0x7f9a881ed9a0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9a6806b1c0 0x7f9a6806d680 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a88148b30 0x7f9a881536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 --2- 172.21.15.91:0/2519306267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a74004070 0x7f9a88147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2519306267 >> 172.21.15.91:0/2519306267 conn(0x7f9a88071e10 msgr2=0x7f9a880c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:41.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2519306267 shutdown_connections 2023-11-27T20:45:41.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.519+0000 7f9a8d42b640 1 -- 172.21.15.91:0/2519306267 wait complete. 2023-11-27T20:45:41.538 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:45:41.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.743+0000 7f0e19461640 1 Processor -- start 2023-11-27T20:45:41.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.744+0000 7f0e19461640 1 -- start start 2023-11-27T20:45:41.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.745+0000 7f0e19461640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0e1414fd30 0x7f0e14152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.745+0000 7f0e19461640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0e1406d0a0 0x7f0e140a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.745+0000 7f0e19461640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e140c64a0 con 0x7f0e140a5260 2023-11-27T20:45:41.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.745+0000 7f0e19461640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e140c5c00 con 0x7f0e1406d0a0 2023-11-27T20:45:41.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.745+0000 7f0e19461640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e140c5ee0 con 0x7f0e1414fd30 2023-11-27T20:45:41.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.745+0000 7f0e127fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0e1406d0a0 0x7f0e140a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.745+0000 7f0e127fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0e1406d0a0 0x7f0e140a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38824/0 (socket says 172.21.15.91:38824) 2023-11-27T20:45:41.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.745+0000 7f0e127fc640 1 -- 172.21.15.91:0/3875898553 learned_addr learned my addr 172.21.15.91:0/3875898553 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:41.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.746+0000 7f0e12ffd640 1 --2- 172.21.15.91:0/3875898553 >> v2:172.21.15.183:3300/0 conn(0x7f0e1414fd30 0x7f0e14152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.746+0000 7f0e127fc640 1 -- 172.21.15.91:0/3875898553 >> v2:172.21.15.183:3300/0 conn(0x7f0e1414fd30 msgr2=0x7f0e14152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:41.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.746+0000 7f0e127fc640 1 --2- 172.21.15.91:0/3875898553 >> v2:172.21.15.183:3300/0 conn(0x7f0e1414fd30 0x7f0e14152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.746+0000 7f0e127fc640 1 -- 172.21.15.91:0/3875898553 >> v1:172.21.15.91:6789/0 conn(0x7f0e140a5260 legacy=0x7f0e140c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.746+0000 7f0e127fc640 1 -- 172.21.15.91:0/3875898553 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e140c61c0 con 0x7f0e1406d0a0 2023-11-27T20:45:41.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.747+0000 7f0e127fc640 1 --2- 172.21.15.91:0/3875898553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 0x7f0e140a4d20 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0e1406b200 tx=0x7f0dfc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bca66b49b10ad7b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:41.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.747+0000 7f0e11ffb640 1 -- 172.21.15.91:0/3875898553 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc030860 con 0x7f0e1406d0a0 2023-11-27T20:45:41.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.747+0000 7f0e11ffb640 1 -- 172.21.15.91:0/3875898553 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0309c0 con 0x7f0e1406d0a0 2023-11-27T20:45:41.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.747+0000 7f0e11ffb640 1 -- 172.21.15.91:0/3875898553 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc030d50 con 0x7f0e1406d0a0 2023-11-27T20:45:41.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.748+0000 7f0e19461640 1 -- 172.21.15.91:0/3875898553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 msgr2=0x7f0e140a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.748+0000 7f0e19461640 1 --2- 172.21.15.91:0/3875898553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 0x7f0e140a4d20 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0e1406b200 tx=0x7f0dfc02b9a0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.748+0000 7f0e19461640 1 -- 172.21.15.91:0/3875898553 shutdown_connections 2023-11-27T20:45:41.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.748+0000 7f0e19461640 1 --2- 172.21.15.91:0/3875898553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 0x7f0e140a4d20 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.748+0000 7f0e19461640 1 --2- 172.21.15.91:0/3875898553 >> v2:172.21.15.183:3300/0 conn(0x7f0e1414fd30 0x7f0e14152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.748+0000 7f0e19461640 1 -- 172.21.15.91:0/3875898553 >> 172.21.15.91:0/3875898553 conn(0x7f0e1406a500 msgr2=0x7f0e1406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:41.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.748+0000 7f0e19461640 1 -- 172.21.15.91:0/3875898553 shutdown_connections 2023-11-27T20:45:41.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.748+0000 7f0e19461640 1 -- 172.21.15.91:0/3875898553 wait complete. 2023-11-27T20:45:41.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.750+0000 7f0e19461640 1 Processor -- start 2023-11-27T20:45:41.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.750+0000 7f0e19461640 1 -- start start 2023-11-27T20:45:41.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.751+0000 7f0e19461640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 0x7f0e141eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.751+0000 7f0e19461640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140a5260 0x7f0e14071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.751+0000 7f0e19461640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1414fd30 0x7f0e14153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.751+0000 7f0e19461640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141dc430 con 0x7f0e1406d0a0 2023-11-27T20:45:41.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.751+0000 7f0e19461640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141eaf90 con 0x7f0e1414fd30 2023-11-27T20:45:41.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.751+0000 7f0e19461640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140723c0 con 0x7f0e140a5260 2023-11-27T20:45:41.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.751+0000 7f0e12ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 0x7f0e141eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.751+0000 7f0e12ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 0x7f0e141eaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38828/0 (socket says 172.21.15.91:38828) 2023-11-27T20:45:41.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.751+0000 7f0e12ffd640 1 -- 172.21.15.91:0/1386395721 learned_addr learned my addr 172.21.15.91:0/1386395721 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:41.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e127fc640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140a5260 0x7f0e14071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e137fe640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1414fd30 0x7f0e14153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e12ffd640 1 -- 172.21.15.91:0/1386395721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140a5260 msgr2=0x7f0e14071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e12ffd640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140a5260 0x7f0e14071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e12ffd640 1 -- 172.21.15.91:0/1386395721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1414fd30 msgr2=0x7f0e14153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e12ffd640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1414fd30 0x7f0e14153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e12ffd640 1 -- 172.21.15.91:0/1386395721 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc0094d0 con 0x7f0e1406d0a0 2023-11-27T20:45:41.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e127fc640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140a5260 0x7f0e14071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:41.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e137fe640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1414fd30 0x7f0e14153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:41.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e12ffd640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 0x7f0e141eaa50 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f0e04007e40 tx=0x7f0e0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:41.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e0b7fe640 1 -- 172.21.15.91:0/1386395721 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04014620 con 0x7f0e1406d0a0 2023-11-27T20:45:41.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e0b7fe640 1 -- 172.21.15.91:0/1386395721 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0400ee90 con 0x7f0e1406d0a0 2023-11-27T20:45:41.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e0b7fe640 1 -- 172.21.15.91:0/1386395721 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040149c0 con 0x7f0e1406d0a0 2023-11-27T20:45:41.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.752+0000 7f0e19461640 1 -- 172.21.15.91:0/1386395721 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e140c2a40 con 0x7f0e1406d0a0 2023-11-27T20:45:41.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.753+0000 7f0e19461640 1 -- 172.21.15.91:0/1386395721 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e14071e00 con 0x7f0e1406d0a0 2023-11-27T20:45:41.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.754+0000 7f0e19461640 1 -- 172.21.15.91:0/1386395721 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e141dbad0 con 0x7f0e1406d0a0 2023-11-27T20:45:41.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.754+0000 7f0e0b7fe640 1 -- 172.21.15.91:0/1386395721 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0e04014b20 con 0x7f0e1406d0a0 2023-11-27T20:45:41.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.755+0000 7f0e0b7fe640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0df406b1c0 0x7f0df406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:41.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.755+0000 7f0e0b7fe640 1 -- 172.21.15.91:0/1386395721 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f0e0408a780 con 0x7f0e1406d0a0 2023-11-27T20:45:41.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.756+0000 7f0e127fc640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0df406b1c0 0x7f0df406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:41.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.757+0000 7f0e127fc640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0df406b1c0 0x7f0df406d680 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc036000 tx=0x7f0dfc03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:41.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.760+0000 7f0e0b7fe640 1 -- 172.21.15.91:0/1386395721 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0e141dbad0 con 0x7f0e1406d0a0 2023-11-27T20:45:41.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.953+0000 7f0e19461640 1 -- 172.21.15.91:0/1386395721 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e141dbad0 con 0x7f0e1406d0a0 2023-11-27T20:45:41.955 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.954+0000 7f0e0b7fe640 1 -- 172.21.15.91:0/1386395721 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e141dbad0 con 0x7f0e1406d0a0 2023-11-27T20:45:41.955 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:41.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.956+0000 7f0e19461640 1 -- 172.21.15.91:0/1386395721 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0df406b1c0 msgr2=0x7f0df406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.956+0000 7f0e19461640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0df406b1c0 0x7f0df406d680 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc036000 tx=0x7f0dfc03b040 comp rx=0 tx=0).stop 2023-11-27T20:45:41.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.956+0000 7f0e19461640 1 -- 172.21.15.91:0/1386395721 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 msgr2=0x7f0e141eaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:41.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.956+0000 7f0e19461640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 0x7f0e141eaa50 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f0e04007e40 tx=0x7f0e0400e4b0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.957+0000 7f0e19461640 1 -- 172.21.15.91:0/1386395721 shutdown_connections 2023-11-27T20:45:41.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.957+0000 7f0e19461640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0df406b1c0 0x7f0df406d680 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.957+0000 7f0e19461640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1414fd30 0x7f0e14153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.957+0000 7f0e19461640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140a5260 0x7f0e14071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.957+0000 7f0e19461640 1 --2- 172.21.15.91:0/1386395721 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e1406d0a0 0x7f0e141eaa50 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:41.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.957+0000 7f0e19461640 1 -- 172.21.15.91:0/1386395721 >> 172.21.15.91:0/1386395721 conn(0x7f0e1406a500 msgr2=0x7f0e140bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:41.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.957+0000 7f0e19461640 1 -- 172.21.15.91:0/1386395721 shutdown_connections 2023-11-27T20:45:41.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:41.957+0000 7f0e19461640 1 -- 172.21.15.91:0/1386395721 wait complete. 2023-11-27T20:45:41.976 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:45:42.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.178+0000 7f80bffff640 1 Processor -- start 2023-11-27T20:45:42.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.178+0000 7f80bffff640 1 -- start start 2023-11-27T20:45:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.179+0000 7f80bffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80c0151c80 0x7f80c00c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.179+0000 7f80bffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f80c00c49f0 0x7f80c0157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.179+0000 7f80bffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80c00c5440 0x7f80c01582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.179+0000 7f80bffff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c0152060 con 0x7f80c00c5440 2023-11-27T20:45:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.179+0000 7f80bffff640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c00c1f60 con 0x7f80c00c49f0 2023-11-27T20:45:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80bffff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00c1590 con 0x7f80c0151c80 2023-11-27T20:45:42.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80bf7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80c00c5440 0x7f80c01582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80bf7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80c00c5440 0x7f80c01582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38834/0 (socket says 172.21.15.91:38834) 2023-11-27T20:45:42.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80bf7fe640 1 -- 172.21.15.91:0/916337265 learned_addr learned my addr 172.21.15.91:0/916337265 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:42.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80beffd640 1 --2- 172.21.15.91:0/916337265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80c0151c80 0x7f80c00c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80bf7fe640 1 -- 172.21.15.91:0/916337265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80c0151c80 msgr2=0x7f80c00c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:42.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80be7fc640 1 --2- 172.21.15.91:0/916337265 >> v2:172.21.15.183:3300/0 conn(0x7f80c00c49f0 0x7f80c0157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80bf7fe640 1 --2- 172.21.15.91:0/916337265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80c0151c80 0x7f80c00c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80bf7fe640 1 -- 172.21.15.91:0/916337265 >> v2:172.21.15.183:3300/0 conn(0x7f80c00c49f0 msgr2=0x7f80c0157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:42.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80bf7fe640 1 --2- 172.21.15.91:0/916337265 >> v2:172.21.15.183:3300/0 conn(0x7f80c00c49f0 0x7f80c0157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80bf7fe640 1 -- 172.21.15.91:0/916337265 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00c65b0 con 0x7f80c00c5440 2023-11-27T20:45:42.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.180+0000 7f80beffd640 1 --2- 172.21.15.91:0/916337265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80c0151c80 0x7f80c00c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:42.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.181+0000 7f80bf7fe640 1 --2- 172.21.15.91:0/916337265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c00c5440 0x7f80c01582c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f80c00a9890 tx=0x7f80b802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bdee81b1f68d27 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:42.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.182+0000 7f80bdffb640 1 -- 172.21.15.91:0/916337265 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80317d0 con 0x7f80c00c5440 2023-11-27T20:45:42.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.182+0000 7f80bdffb640 1 -- 172.21.15.91:0/916337265 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8031930 con 0x7f80c00c5440 2023-11-27T20:45:42.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.182+0000 7f80bdffb640 1 -- 172.21.15.91:0/916337265 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8031cc0 con 0x7f80c00c5440 2023-11-27T20:45:42.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.182+0000 7f80bffff640 1 -- 172.21.15.91:0/916337265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c00c5440 msgr2=0x7f80c01582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.182+0000 7f80bffff640 1 --2- 172.21.15.91:0/916337265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c00c5440 0x7f80c01582c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f80c00a9890 tx=0x7f80b802b870 comp rx=0 tx=0).stop 2023-11-27T20:45:42.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.183+0000 7f80bffff640 1 -- 172.21.15.91:0/916337265 shutdown_connections 2023-11-27T20:45:42.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.183+0000 7f80bffff640 1 --2- 172.21.15.91:0/916337265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c00c5440 0x7f80c01582c0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.183+0000 7f80bffff640 1 --2- 172.21.15.91:0/916337265 >> v2:172.21.15.183:3300/0 conn(0x7f80c00c49f0 0x7f80c0157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.183+0000 7f80bffff640 1 --2- 172.21.15.91:0/916337265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80c0151c80 0x7f80c00c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.183+0000 7f80bffff640 1 -- 172.21.15.91:0/916337265 >> 172.21.15.91:0/916337265 conn(0x7f80c00a88a0 msgr2=0x7f80c00a8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:42.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.183+0000 7f80bffff640 1 -- 172.21.15.91:0/916337265 shutdown_connections 2023-11-27T20:45:42.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.183+0000 7f80bffff640 1 -- 172.21.15.91:0/916337265 wait complete. 2023-11-27T20:45:42.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.184+0000 7f80bffff640 1 Processor -- start 2023-11-27T20:45:42.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.184+0000 7f80bffff640 1 -- start start 2023-11-27T20:45:42.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.185+0000 7f80bffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80c00c49f0 0x7f80c0146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.185+0000 7f80bffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80c00c5440 0x7f80c00bce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.185+0000 7f80bffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0151c80 0x7f80c01ec530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.185+0000 7f80bffff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0157440 con 0x7f80c0151c80 2023-11-27T20:45:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.185+0000 7f80bffff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0156350 con 0x7f80c00c49f0 2023-11-27T20:45:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.185+0000 7f80bffff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0156630 con 0x7f80c00c5440 2023-11-27T20:45:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.186+0000 7f80bf7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0151c80 0x7f80c01ec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.186+0000 7f80bf7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0151c80 0x7f80c01ec530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38846/0 (socket says 172.21.15.91:38846) 2023-11-27T20:45:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.186+0000 7f80bf7fe640 1 -- 172.21.15.91:0/3300191358 learned_addr learned my addr 172.21.15.91:0/3300191358 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.186+0000 7f80beffd640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80c00c49f0 0x7f80c0146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.186+0000 7f80bf7fe640 1 -- 172.21.15.91:0/3300191358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80c00c5440 msgr2=0x7f80c00bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.186+0000 7f80bf7fe640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80c00c5440 0x7f80c00bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.186+0000 7f80bf7fe640 1 -- 172.21.15.91:0/3300191358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80c00c49f0 msgr2=0x7f80c0146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.186+0000 7f80bf7fe640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80c00c49f0 0x7f80c0146c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.186+0000 7f80bf7fe640 1 -- 172.21.15.91:0/3300191358 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80094d0 con 0x7f80c0151c80 2023-11-27T20:45:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.186+0000 7f80bf7fe640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0151c80 0x7f80c01ec530 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f80b80090b0 tx=0x7f80b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.187+0000 7f80b77fe640 1 -- 172.21.15.91:0/3300191358 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80328f0 con 0x7f80c0151c80 2023-11-27T20:45:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.187+0000 7f80b77fe640 1 -- 172.21.15.91:0/3300191358 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8032a50 con 0x7f80c0151c80 2023-11-27T20:45:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.187+0000 7f80b77fe640 1 -- 172.21.15.91:0/3300191358 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8032e00 con 0x7f80c0151c80 2023-11-27T20:45:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.187+0000 7f80bffff640 1 -- 172.21.15.91:0/3300191358 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c0156910 con 0x7f80c0151c80 2023-11-27T20:45:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.187+0000 7f80bffff640 1 -- 172.21.15.91:0/3300191358 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c01570d0 con 0x7f80c0151c80 2023-11-27T20:45:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.188+0000 7f80bffff640 1 -- 172.21.15.91:0/3300191358 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c0157260 con 0x7f80c0151c80 2023-11-27T20:45:42.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.189+0000 7f80b77fe640 1 -- 172.21.15.91:0/3300191358 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f80b8030070 con 0x7f80c0151c80 2023-11-27T20:45:42.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.190+0000 7f80b77fe640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80a006b1f0 0x7f80a006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.190+0000 7f80b77fe640 1 -- 172.21.15.91:0/3300191358 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f80b80ab9d0 con 0x7f80c0151c80 2023-11-27T20:45:42.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.190+0000 7f80beffd640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80a006b1f0 0x7f80a006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.191+0000 7f80beffd640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80a006b1f0 0x7f80a006d6b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f80b0008ee0 tx=0x7f80b0008430 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:42.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.194+0000 7f80b77fe640 1 -- 172.21.15.91:0/3300191358 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f80b8076360 con 0x7f80c0151c80 2023-11-27T20:45:42.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.384+0000 7f80bffff640 1 -- 172.21.15.91:0/3300191358 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80c0157580 con 0x7f80c0151c80 2023-11-27T20:45:42.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.385+0000 7f80b77fe640 1 -- 172.21.15.91:0/3300191358 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v81) v1 ==== 105+0+11 (secure 0 0 0) 0x7f80c0157580 con 0x7f80c0151c80 2023-11-27T20:45:42.387 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:42.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 -- 172.21.15.91:0/3300191358 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80a006b1f0 msgr2=0x7f80a006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80a006b1f0 0x7f80a006d6b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f80b0008ee0 tx=0x7f80b0008430 comp rx=0 tx=0).stop 2023-11-27T20:45:42.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 -- 172.21.15.91:0/3300191358 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0151c80 msgr2=0x7f80c01ec530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0151c80 0x7f80c01ec530 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f80b80090b0 tx=0x7f80b80046c0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 -- 172.21.15.91:0/3300191358 shutdown_connections 2023-11-27T20:45:42.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0151c80 0x7f80c01ec530 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80c00c5440 0x7f80c00bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f80a006b1f0 0x7f80a006d6b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 --2- 172.21.15.91:0/3300191358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80c00c49f0 0x7f80c0146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 -- 172.21.15.91:0/3300191358 >> 172.21.15.91:0/3300191358 conn(0x7f80c00a88a0 msgr2=0x7f80c00a8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:42.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 -- 172.21.15.91:0/3300191358 shutdown_connections 2023-11-27T20:45:42.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.388+0000 7f80bffff640 1 -- 172.21.15.91:0/3300191358 wait complete. 2023-11-27T20:45:42.409 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:45:42.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.620+0000 7f076fec2640 1 Processor -- start 2023-11-27T20:45:42.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.620+0000 7f076fec2640 1 -- start start 2023-11-27T20:45:42.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.621+0000 7f076fec2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076814fd30 0x7f0768152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.621+0000 7f076fec2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f076806d0a0 0x7f07680a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.621+0000 7f076fec2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07680c64a0 con 0x7f07680a5260 2023-11-27T20:45:42.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.621+0000 7f076fec2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07680c5c00 con 0x7f076806d0a0 2023-11-27T20:45:42.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.622+0000 7f076fec2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07680c5ee0 con 0x7f076814fd30 2023-11-27T20:45:42.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.622+0000 7f076d45d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f076806d0a0 0x7f07680a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.622+0000 7f076dc5e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076814fd30 0x7f0768152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.622+0000 7f076d45d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f076806d0a0 0x7f07680a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:52740/0 (socket says 172.21.15.91:52740) 2023-11-27T20:45:42.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.622+0000 7f076d45d640 1 -- 172.21.15.91:0/1348768569 learned_addr learned my addr 172.21.15.91:0/1348768569 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:42.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.623+0000 7f076d45d640 1 -- 172.21.15.91:0/1348768569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076814fd30 msgr2=0x7f0768152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:42.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.623+0000 7f076d45d640 1 --2- 172.21.15.91:0/1348768569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076814fd30 0x7f0768152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.623+0000 7f076d45d640 1 -- 172.21.15.91:0/1348768569 >> v1:172.21.15.183:6789/0 conn(0x7f07680a5260 legacy=0x7f07680c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.623+0000 7f076d45d640 1 -- 172.21.15.91:0/1348768569 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680c61c0 con 0x7f076806d0a0 2023-11-27T20:45:42.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.625+0000 7f076d45d640 1 --2- 172.21.15.91:0/1348768569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f076806d0a0 0x7f07680a4d20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0758009870 tx=0x7f075802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ee2ca6d7b26faac server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:42.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.625+0000 7f076cc5c640 1 -- 172.21.15.91:0/1348768569 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758030840 con 0x7f076806d0a0 2023-11-27T20:45:42.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.625+0000 7f076cc5c640 1 -- 172.21.15.91:0/1348768569 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07580309a0 con 0x7f076806d0a0 2023-11-27T20:45:42.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.625+0000 7f076cc5c640 1 -- 172.21.15.91:0/1348768569 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758030d30 con 0x7f076806d0a0 2023-11-27T20:45:42.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.626+0000 7f076fec2640 1 -- 172.21.15.91:0/1348768569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f076806d0a0 msgr2=0x7f07680a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.626+0000 7f076fec2640 1 --2- 172.21.15.91:0/1348768569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f076806d0a0 0x7f07680a4d20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0758009870 tx=0x7f075802b980 comp rx=0 tx=0).stop 2023-11-27T20:45:42.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.626+0000 7f076fec2640 1 -- 172.21.15.91:0/1348768569 shutdown_connections 2023-11-27T20:45:42.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.626+0000 7f076fec2640 1 --2- 172.21.15.91:0/1348768569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f076806d0a0 0x7f07680a4d20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.626+0000 7f076fec2640 1 --2- 172.21.15.91:0/1348768569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076814fd30 0x7f0768152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.626+0000 7f076fec2640 1 -- 172.21.15.91:0/1348768569 >> 172.21.15.91:0/1348768569 conn(0x7f076806a500 msgr2=0x7f076806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:42.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.626+0000 7f076fec2640 1 -- 172.21.15.91:0/1348768569 shutdown_connections 2023-11-27T20:45:42.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.626+0000 7f076fec2640 1 -- 172.21.15.91:0/1348768569 wait complete. 2023-11-27T20:45:42.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.628+0000 7f076fec2640 1 Processor -- start 2023-11-27T20:45:42.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.628+0000 7f076fec2640 1 -- start start 2023-11-27T20:45:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.629+0000 7f076fec2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f076806d0a0 0x7f07680bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.629+0000 7f076fec2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07680a5260 0x7f07681ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.629+0000 7f076fec2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076814fd30 0x7f07681ede20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.629+0000 7f076fec2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07680aa650 con 0x7f076806d0a0 2023-11-27T20:45:42.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.629+0000 7f076fec2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681dca90 con 0x7f07680a5260 2023-11-27T20:45:42.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.629+0000 7f076fec2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07681dc4d0 con 0x7f076814fd30 2023-11-27T20:45:42.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.629+0000 7f076dc5e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f076806d0a0 0x7f07680bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.629+0000 7f076dc5e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f076806d0a0 0x7f07680bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38860/0 (socket says 172.21.15.91:38860) 2023-11-27T20:45:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.629+0000 7f076dc5e640 1 -- 172.21.15.91:0/3462059269 learned_addr learned my addr 172.21.15.91:0/3462059269 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.629+0000 7f076d45d640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07680a5260 0x7f07681ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f076e45f640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076814fd30 0x7f07681ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f076dc5e640 1 -- 172.21.15.91:0/3462059269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076814fd30 msgr2=0x7f07681ede20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f076dc5e640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076814fd30 0x7f07681ede20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f076dc5e640 1 -- 172.21.15.91:0/3462059269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07680a5260 msgr2=0x7f07681ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f076dc5e640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07680a5260 0x7f07681ed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f076dc5e640 1 -- 172.21.15.91:0/3462059269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580094d0 con 0x7f076806d0a0 2023-11-27T20:45:42.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f076dc5e640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f076806d0a0 0x7f07680bf360 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f076400e8a0 tx=0x7f076400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f075e7fc640 1 -- 172.21.15.91:0/3462059269 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640094f0 con 0x7f076806d0a0 2023-11-27T20:45:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f075e7fc640 1 -- 172.21.15.91:0/3462059269 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076400c940 con 0x7f076806d0a0 2023-11-27T20:45:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f075e7fc640 1 -- 172.21.15.91:0/3462059269 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400ccf0 con 0x7f076806d0a0 2023-11-27T20:45:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f076fec2640 1 -- 172.21.15.91:0/3462059269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07681dc7b0 con 0x7f076806d0a0 2023-11-27T20:45:42.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.630+0000 7f076fec2640 1 -- 172.21.15.91:0/3462059269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07681dbad0 con 0x7f076806d0a0 2023-11-27T20:45:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.632+0000 7f076fec2640 1 -- 172.21.15.91:0/3462059269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0768068350 con 0x7f076806d0a0 2023-11-27T20:45:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.633+0000 7f075e7fc640 1 -- 172.21.15.91:0/3462059269 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0764013470 con 0x7f076806d0a0 2023-11-27T20:45:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.633+0000 7f075e7fc640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f074c06b1c0 0x7f074c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.634+0000 7f075e7fc640 1 -- 172.21.15.91:0/3462059269 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f0764089e60 con 0x7f076806d0a0 2023-11-27T20:45:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.634+0000 7f076d45d640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f074c06b1c0 0x7f074c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:42.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.634+0000 7f076d45d640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f074c06b1c0 0x7f074c06d680 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0758036000 tx=0x7f0758008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:42.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.638+0000 7f075e7fc640 1 -- 172.21.15.91:0/3462059269 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f07640547f0 con 0x7f076806d0a0 2023-11-27T20:45:42.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.826+0000 7f076fec2640 1 -- 172.21.15.91:0/3462059269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f076806d540 con 0x7f076806d0a0 2023-11-27T20:45:42.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.827+0000 7f075e7fc640 1 -- 172.21.15.91:0/3462059269 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v81) v1 ==== 101+0+11 (secure 0 0 0) 0x7f07640210a0 con 0x7f076806d0a0 2023-11-27T20:45:42.829 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:42.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.829+0000 7f076fec2640 1 -- 172.21.15.91:0/3462059269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f074c06b1c0 msgr2=0x7f074c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.829+0000 7f076fec2640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f074c06b1c0 0x7f074c06d680 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0758036000 tx=0x7f0758008030 comp rx=0 tx=0).stop 2023-11-27T20:45:42.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.830+0000 7f076fec2640 1 -- 172.21.15.91:0/3462059269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f076806d0a0 msgr2=0x7f07680bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:42.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.830+0000 7f076fec2640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f076806d0a0 0x7f07680bf360 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f076400e8a0 tx=0x7f076400ed60 comp rx=0 tx=0).stop 2023-11-27T20:45:42.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.830+0000 7f076fec2640 1 -- 172.21.15.91:0/3462059269 shutdown_connections 2023-11-27T20:45:42.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.830+0000 7f076fec2640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076814fd30 0x7f07681ede20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.830+0000 7f076fec2640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f074c06b1c0 0x7f074c06d680 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.830+0000 7f076fec2640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07680a5260 0x7f07681ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.830+0000 7f076fec2640 1 --2- 172.21.15.91:0/3462059269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f076806d0a0 0x7f07680bf360 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:42.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.830+0000 7f076fec2640 1 -- 172.21.15.91:0/3462059269 >> 172.21.15.91:0/3462059269 conn(0x7f076806a500 msgr2=0x7f076806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:42.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.830+0000 7f076fec2640 1 -- 172.21.15.91:0/3462059269 shutdown_connections 2023-11-27T20:45:42.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:42.830+0000 7f076fec2640 1 -- 172.21.15.91:0/3462059269 wait complete. 2023-11-27T20:45:42.849 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:45:43.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.051+0000 7ff671f00640 1 Processor -- start 2023-11-27T20:45:43.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.051+0000 7ff671f00640 1 -- start start 2023-11-27T20:45:43.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.052+0000 7ff671f00640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff66c155490 0x7ff66c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.052+0000 7ff671f00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66c0c1500 0x7ff66c0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.052+0000 7ff671f00640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c0c06c0 con 0x7ff66c0c4080 2023-11-27T20:45:43.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.052+0000 7ff671f00640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c0a5820 con 0x7ff66c155490 2023-11-27T20:45:43.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.052+0000 7ff671f00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0c1020 con 0x7ff66c0c1500 2023-11-27T20:45:43.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.053+0000 7ff66b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff66c155490 0x7ff66c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:43.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.053+0000 7ff66b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff66c155490 0x7ff66c0a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38874/0 (socket says 172.21.15.91:38874) 2023-11-27T20:45:43.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.053+0000 7ff66b7fe640 1 -- 172.21.15.91:0/2217293899 learned_addr learned my addr 172.21.15.91:0/2217293899 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:43.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.053+0000 7ff66b7fe640 1 -- 172.21.15.91:0/2217293899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66c0c1500 msgr2=0x7ff66c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:43.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.053+0000 7ff66b7fe640 1 --2- 172.21.15.91:0/2217293899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66c0c1500 0x7ff66c0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.053+0000 7ff66b7fe640 1 -- 172.21.15.91:0/2217293899 >> v1:172.21.15.91:6789/0 conn(0x7ff66c0c4080 legacy=0x7ff66c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.053+0000 7ff66b7fe640 1 -- 172.21.15.91:0/2217293899 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0c0910 con 0x7ff66c155490 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.054+0000 7ff66b7fe640 1 --2- 172.21.15.91:0/2217293899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c155490 0x7ff66c0a51b0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009870 tx=0x7ff65c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75134780b566282 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.054+0000 7ff66affd640 1 -- 172.21.15.91:0/2217293899 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0317c0 con 0x7ff66c155490 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.054+0000 7ff66affd640 1 -- 172.21.15.91:0/2217293899 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c031920 con 0x7ff66c155490 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.054+0000 7ff66affd640 1 -- 172.21.15.91:0/2217293899 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c031cb0 con 0x7ff66c155490 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.055+0000 7ff671f00640 1 -- 172.21.15.91:0/2217293899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c155490 msgr2=0x7ff66c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.055+0000 7ff671f00640 1 --2- 172.21.15.91:0/2217293899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c155490 0x7ff66c0a51b0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009870 tx=0x7ff65c02b860 comp rx=0 tx=0).stop 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.055+0000 7ff671f00640 1 -- 172.21.15.91:0/2217293899 shutdown_connections 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.055+0000 7ff671f00640 1 --2- 172.21.15.91:0/2217293899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66c0c1500 0x7ff66c0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.055+0000 7ff671f00640 1 --2- 172.21.15.91:0/2217293899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c155490 0x7ff66c0a51b0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.055+0000 7ff671f00640 1 -- 172.21.15.91:0/2217293899 >> 172.21.15.91:0/2217293899 conn(0x7ff66c06a500 msgr2=0x7ff66c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.055+0000 7ff671f00640 1 -- 172.21.15.91:0/2217293899 shutdown_connections 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.055+0000 7ff671f00640 1 -- 172.21.15.91:0/2217293899 wait complete. 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.057+0000 7ff671f00640 1 Processor -- start 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.057+0000 7ff671f00640 1 -- start start 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff671f00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff66c0c1500 0x7ff66c0bb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff671f00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c0c4080 0x7ff66c0bb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff671f00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66c155490 0x7ff66c1daf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff671f00640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0bbd90 con 0x7ff66c0c4080 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff671f00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c1deed0 con 0x7ff66c0c1500 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff671f00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c1508d0 con 0x7ff66c155490 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff663fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c0c4080 0x7ff66c0bb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:43.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff663fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c0c4080 0x7ff66c0bb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38880/0 (socket says 172.21.15.91:38880) 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff663fff640 1 -- 172.21.15.91:0/808531794 learned_addr learned my addr 172.21.15.91:0/808531794 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff663fff640 1 -- 172.21.15.91:0/808531794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66c155490 msgr2=0x7ff66c1daf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff663fff640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66c155490 0x7ff66c1daf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff663fff640 1 -- 172.21.15.91:0/808531794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff66c0c1500 msgr2=0x7ff66c0bb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff663fff640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff66c0c1500 0x7ff66c0bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.058+0000 7ff663fff640 1 -- 172.21.15.91:0/808531794 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0094d0 con 0x7ff66c0c4080 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.059+0000 7ff663fff640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c0c4080 0x7ff66c0bb850 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff65400b4a0 tx=0x7ff65400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.059+0000 7ff668ff9640 1 -- 172.21.15.91:0/808531794 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654010610 con 0x7ff66c0c4080 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.059+0000 7ff668ff9640 1 -- 172.21.15.91:0/808531794 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654010770 con 0x7ff66c0c4080 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.059+0000 7ff668ff9640 1 -- 172.21.15.91:0/808531794 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654010b20 con 0x7ff66c0c4080 2023-11-27T20:45:43.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.059+0000 7ff671f00640 1 -- 172.21.15.91:0/808531794 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c1de880 con 0x7ff66c0c4080 2023-11-27T20:45:43.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.059+0000 7ff671f00640 1 -- 172.21.15.91:0/808531794 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c0bced0 con 0x7ff66c0c4080 2023-11-27T20:45:43.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.060+0000 7ff671f00640 1 -- 172.21.15.91:0/808531794 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c068350 con 0x7ff66c0c4080 2023-11-27T20:45:43.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.061+0000 7ff668ff9640 1 -- 172.21.15.91:0/808531794 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff654010c80 con 0x7ff66c0c4080 2023-11-27T20:45:43.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.062+0000 7ff668ff9640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff64c06b1c0 0x7ff64c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.062+0000 7ff668ff9640 1 -- 172.21.15.91:0/808531794 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7ff654089a30 con 0x7ff66c0c4080 2023-11-27T20:45:43.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.062+0000 7ff66b7fe640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff64c06b1c0 0x7ff64c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:43.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.063+0000 7ff66b7fe640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff64c06b1c0 0x7ff64c06d680 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff65c036000 tx=0x7ff65c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:43.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.066+0000 7ff668ff9640 1 -- 172.21.15.91:0/808531794 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff6540543c0 con 0x7ff66c0c4080 2023-11-27T20:45:43.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.253+0000 7ff671f00640 1 -- 172.21.15.91:0/808531794 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff66c1df010 con 0x7ff66c0c4080 2023-11-27T20:45:43.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.254+0000 7ff668ff9640 1 -- 172.21.15.91:0/808531794 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff6540579e0 con 0x7ff66c0c4080 2023-11-27T20:45:43.255 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:45:43.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.256+0000 7ff671f00640 1 -- 172.21.15.91:0/808531794 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff64c06b1c0 msgr2=0x7ff64c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.256+0000 7ff671f00640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff64c06b1c0 0x7ff64c06d680 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff65c036000 tx=0x7ff65c030000 comp rx=0 tx=0).stop 2023-11-27T20:45:43.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.256+0000 7ff671f00640 1 -- 172.21.15.91:0/808531794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c0c4080 msgr2=0x7ff66c0bb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.256+0000 7ff671f00640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c0c4080 0x7ff66c0bb850 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff65400b4a0 tx=0x7ff65400b960 comp rx=0 tx=0).stop 2023-11-27T20:45:43.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.256+0000 7ff671f00640 1 -- 172.21.15.91:0/808531794 shutdown_connections 2023-11-27T20:45:43.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.256+0000 7ff671f00640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66c155490 0x7ff66c1daf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.256+0000 7ff671f00640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff66c0c4080 0x7ff66c0bb850 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.256+0000 7ff671f00640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff64c06b1c0 0x7ff64c06d680 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.256+0000 7ff671f00640 1 --2- 172.21.15.91:0/808531794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff66c0c1500 0x7ff66c0bb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.256+0000 7ff671f00640 1 -- 172.21.15.91:0/808531794 >> 172.21.15.91:0/808531794 conn(0x7ff66c06a500 msgr2=0x7ff66c0a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:43.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.257+0000 7ff671f00640 1 -- 172.21.15.91:0/808531794 shutdown_connections 2023-11-27T20:45:43.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.257+0000 7ff671f00640 1 -- 172.21.15.91:0/808531794 wait complete. 2023-11-27T20:45:43.276 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-27T20:45:43.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:43.277 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:43.428 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:45:43.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:43.429 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-27T20:45:43.479 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:43.480 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:43.519 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-27T20:45:43.519 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T20:45:43.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.692+0000 7f81c7fff640 1 Processor -- start 2023-11-27T20:45:43.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.692+0000 7f81c7fff640 1 -- start start 2023-11-27T20:45:43.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.694+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c814e7c0 0x7f81c80c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.694+0000 7f81c7fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f81c8154580 0x7f81c8154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.694+0000 7f81c7fff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c8158a60 con 0x7f81c80c4c00 2023-11-27T20:45:43.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.694+0000 7f81c7fff640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80c5b10 con 0x7f81c8154580 2023-11-27T20:45:43.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.694+0000 7f81c7fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8157ca0 con 0x7f81c814e7c0 2023-11-27T20:45:43.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.694+0000 7f81c77fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f81c8154580 0x7f81c8154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:43.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.694+0000 7f81c6ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c814e7c0 0x7f81c80c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:43.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.695+0000 7f81c6ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c814e7c0 0x7f81c80c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:52846/0 (socket says 172.21.15.91:52846) 2023-11-27T20:45:43.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.695+0000 7f81c6ffd640 1 -- 172.21.15.91:0/2769008041 learned_addr learned my addr 172.21.15.91:0/2769008041 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:43.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.695+0000 7f81c77fe640 1 -- 172.21.15.91:0/2769008041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c814e7c0 msgr2=0x7f81c80c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:43.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.695+0000 7f81c77fe640 1 --2- 172.21.15.91:0/2769008041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c814e7c0 0x7f81c80c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.695+0000 7f81c77fe640 1 -- 172.21.15.91:0/2769008041 >> v1:172.21.15.183:6789/0 conn(0x7f81c80c4c00 legacy=0x7f81c80ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.695+0000 7f81c77fe640 1 -- 172.21.15.91:0/2769008041 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8157f80 con 0x7f81c8154580 2023-11-27T20:45:43.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.697+0000 7f81c77fe640 1 --2- 172.21.15.91:0/2769008041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c8154580 0x7f81c8154a10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009d90 tx=0x7f81c002bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=707c1de4872e4d2d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:43.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.697+0000 7f81c67fc640 1 -- 172.21.15.91:0/2769008041 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c002cb40 con 0x7f81c8154580 2023-11-27T20:45:43.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.697+0000 7f81c67fc640 1 -- 172.21.15.91:0/2769008041 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c002cca0 con 0x7f81c8154580 2023-11-27T20:45:43.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.697+0000 7f81c67fc640 1 -- 172.21.15.91:0/2769008041 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0034660 con 0x7f81c8154580 2023-11-27T20:45:43.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.698+0000 7f81c7fff640 1 -- 172.21.15.91:0/2769008041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c8154580 msgr2=0x7f81c8154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.698+0000 7f81c7fff640 1 --2- 172.21.15.91:0/2769008041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c8154580 0x7f81c8154a10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009d90 tx=0x7f81c002bd90 comp rx=0 tx=0).stop 2023-11-27T20:45:43.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.698+0000 7f81c7fff640 1 -- 172.21.15.91:0/2769008041 shutdown_connections 2023-11-27T20:45:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.698+0000 7f81c7fff640 1 --2- 172.21.15.91:0/2769008041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c8154580 0x7f81c8154a10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.698+0000 7f81c7fff640 1 --2- 172.21.15.91:0/2769008041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c814e7c0 0x7f81c80c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.698+0000 7f81c7fff640 1 -- 172.21.15.91:0/2769008041 >> 172.21.15.91:0/2769008041 conn(0x7f81c80abf00 msgr2=0x7f81c80c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.698+0000 7f81c7fff640 1 -- 172.21.15.91:0/2769008041 shutdown_connections 2023-11-27T20:45:43.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.698+0000 7f81c7fff640 1 -- 172.21.15.91:0/2769008041 wait complete. 2023-11-27T20:45:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.700+0000 7f81c7fff640 1 Processor -- start 2023-11-27T20:45:43.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.700+0000 7f81c7fff640 1 -- start start 2023-11-27T20:45:43.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c80c4c00 0x7f81c8156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c814e7c0 0x7f81c8146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c8154580 0x7f81c8147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c7fff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8156730 con 0x7f81c8154580 2023-11-27T20:45:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c7fff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8147980 con 0x7f81c814e7c0 2023-11-27T20:45:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c7fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8155720 con 0x7f81c80c4c00 2023-11-27T20:45:43.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c77fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c8154580 0x7f81c8147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c77fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c8154580 0x7f81c8147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38894/0 (socket says 172.21.15.91:38894) 2023-11-27T20:45:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c77fe640 1 -- 172.21.15.91:0/1007668333 learned_addr learned my addr 172.21.15.91:0/1007668333 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c77fe640 1 -- 172.21.15.91:0/1007668333 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c80c4c00 msgr2=0x7f81c8156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c77fe640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c80c4c00 0x7f81c8156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c77fe640 1 -- 172.21.15.91:0/1007668333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c814e7c0 msgr2=0x7f81c8146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c77fe640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c814e7c0 0x7f81c8146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.701+0000 7f81c77fe640 1 -- 172.21.15.91:0/1007668333 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0009a70 con 0x7f81c8154580 2023-11-27T20:45:43.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.702+0000 7f81c77fe640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c8154580 0x7f81c8147440 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f81c002c3a0 tx=0x7f81c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:43.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.702+0000 7f81bf7fe640 1 -- 172.21.15.91:0/1007668333 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c003e610 con 0x7f81c8154580 2023-11-27T20:45:43.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.702+0000 7f81bf7fe640 1 -- 172.21.15.91:0/1007668333 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c003e790 con 0x7f81c8154580 2023-11-27T20:45:43.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.702+0000 7f81bf7fe640 1 -- 172.21.15.91:0/1007668333 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c003eb40 con 0x7f81c8154580 2023-11-27T20:45:43.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.702+0000 7f81c7fff640 1 -- 172.21.15.91:0/1007668333 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c80c3dc0 con 0x7f81c8154580 2023-11-27T20:45:43.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.702+0000 7f81c7fff640 1 -- 172.21.15.91:0/1007668333 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c8155c50 con 0x7f81c8154580 2023-11-27T20:45:43.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.703+0000 7f81c7fff640 1 -- 172.21.15.91:0/1007668333 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c804e840 con 0x7f81c8154580 2023-11-27T20:45:43.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.704+0000 7f81bf7fe640 1 -- 172.21.15.91:0/1007668333 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f81c003b050 con 0x7f81c8154580 2023-11-27T20:45:43.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.705+0000 7f81bf7fe640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f81a806b1f0 0x7f81a806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:43.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.705+0000 7f81bf7fe640 1 -- 172.21.15.91:0/1007668333 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f81c00ac6b0 con 0x7f81c8154580 2023-11-27T20:45:43.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.705+0000 7f81c6ffd640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f81a806b1f0 0x7f81a806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:43.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.706+0000 7f81c6ffd640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f81a806b1f0 0x7f81a806d6b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f81b8006f40 tx=0x7f81b8006e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:43.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.710+0000 7f81bf7fe640 1 -- 172.21.15.91:0/1007668333 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f81c0077040 con 0x7f81c8154580 2023-11-27T20:45:43.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.922+0000 7f81c7fff640 1 -- 172.21.15.91:0/1007668333 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f81c80c7c40 con 0x7f81c8154580 2023-11-27T20:45:43.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.923+0000 7f81bf7fe640 1 -- 172.21.15.91:0/1007668333 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7f81c0009450 con 0x7f81c8154580 2023-11-27T20:45:43.925 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T20:45:43.925 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-27T20:45:43.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 -- 172.21.15.91:0/1007668333 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f81a806b1f0 msgr2=0x7f81a806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f81a806b1f0 0x7f81a806d6b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f81b8006f40 tx=0x7f81b8006e90 comp rx=0 tx=0).stop 2023-11-27T20:45:43.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 -- 172.21.15.91:0/1007668333 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c8154580 msgr2=0x7f81c8147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:43.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c8154580 0x7f81c8147440 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f81c002c3a0 tx=0x7f81c0004a40 comp rx=0 tx=0).stop 2023-11-27T20:45:43.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 -- 172.21.15.91:0/1007668333 shutdown_connections 2023-11-27T20:45:43.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81c8154580 0x7f81c8147440 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f81a806b1f0 0x7f81a806d6b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c814e7c0 0x7f81c8146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 --2- 172.21.15.91:0/1007668333 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c80c4c00 0x7f81c8156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:43.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 -- 172.21.15.91:0/1007668333 >> 172.21.15.91:0/1007668333 conn(0x7f81c80abf00 msgr2=0x7f81c806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:43.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 -- 172.21.15.91:0/1007668333 shutdown_connections 2023-11-27T20:45:43.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:43.926+0000 7f81c7fff640 1 -- 172.21.15.91:0/1007668333 wait complete. 2023-11-27T20:45:43.944 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-27T20:45:43.945 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T20:45:43.945 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-27T20:45:43.945 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-27T20:45:43.945 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:43.945 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-27T20:45:43.945 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T20:45:43.945 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.VklaMpXsm0 2023-11-27T20:45:43.945 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-11-27T20:45:44.007 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.zdBvoX5DDe 2023-11-27T20:45:44.008 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /tmp/tmp.VklaMpXsm0 /tmp/tmp.zdBvoX5DDe 2023-11-27T20:45:44.109 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.zdBvoX5DDe 2023-11-27T20:45:44.268 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.zdBvoX5DDe is 226B 2023-11-27T20:45:44.328 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.zdBvoX5DDe 2023-11-27T20:45:44.380 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-27T20:45:44.380 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:45:44.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:44.380 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-27T20:45:44.432 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T20:45:44.433 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T20:45:44.433 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T20:45:44.433 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:44.434 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-27T20:45:44.434 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:44.434 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:44.434 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:44.434 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-27T20:45:44.434 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:44.434 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:44.435 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-27T20:45:44.435 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T20:45:44.435 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:44.435 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T20:45:44.435 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:44.435 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T20:45:44.435 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42114sec preferred_lft 42114sec 2023-11-27T20:45:44.435 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-27T20:45:44.436 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:44.436 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T20:45:44.436 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff 2023-11-27T20:45:44.436 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T20:45:44.436 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:44.436 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8479:57ff:fe06:e35b/64 scope link 2023-11-27T20:45:44.436 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:44.436 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T20:45:44.437 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 42:e4:26:7f:0e:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T20:45:44.437 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::40e4:26ff:fe7f:e25/64 scope link 2023-11-27T20:45:44.437 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-27T20:45:44.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:44.437 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T20:45:44.525 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-27T20:45:44.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:44.529 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-27T20:45:44.579 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-27T20:45:44.579 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T20:45:44.579 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T20:45:44.580 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T20:45:44.580 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T20:45:44.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:44.580 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-27T20:45:44.580 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-27T20:45:44.580 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T20:45:44.580 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T20:45:44.580 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T20:45:44.580 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-27T20:45:44.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:44.767 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-27T20:45:44.821 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-27T20:45:44.822 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:45:44.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:44.822 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-11-27T20:45:44.919 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:45:44.919 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:44.977 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-27T20:45:44.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T20:45:44.977 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:45.029 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:45.030 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/tmp/tmp.VklaMpXsm0 of=/dev/stdout 2023-11-27T20:45:45.083 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T20:45:45.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:45.083 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:45:45.215 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,secret=AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:45:45.215 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-27T20:45:45.215 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:45:45.215 INFO:teuthology.orchestra.run.smithi183.stdout:keyring.get_secret failed 2023-11-27T20:45:45.238 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,secret=AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:45:45.239 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-27T20:45:45.239 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:45:45.239 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:45:45.239 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:45:45.239 INFO:teuthology.orchestra.run.smithi183.stdout:keyring.get_secret failed 2023-11-27T20:45:45.266 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,secret=AQDt/2RlpEwHKBAA4qPRQHC+MGCSz/0EJNEFMQ==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-11-27T20:45:45.266 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-11-27T20:45:45.266 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-11-27T20:45:45.266 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-11-27T20:45:45.266 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T20:45:45.267 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-11-27T20:45:45.267 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.91:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-11-27T20:45:45.267 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=76812701-65a9-4deb-87af-ef00110d1601" will pass to kernel 2023-11-27T20:45:45.268 INFO:teuthology.orchestra.run.smithi183.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-27T20:45:45.268 INFO:teuthology.orchestra.run.smithi183.stdout: You just mounted a file system that supports labels which does not 2023-11-27T20:45:45.268 INFO:teuthology.orchestra.run.smithi183.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-27T20:45:45.268 INFO:teuthology.orchestra.run.smithi183.stdout: applications will generate AVC messages and not be allowed access to 2023-11-27T20:45:45.268 INFO:teuthology.orchestra.run.smithi183.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-27T20:45:45.274 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T20:45:45.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:45.274 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:45.361 INFO:teuthology.orchestra.run.smithi183.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-11-27T20:45:45.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:45:45.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:45.365 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T20:45:45.423 INFO:teuthology.orchestra.run.smithi183.stdout:client5464 2023-11-27T20:45:45.424 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:45.424 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:45.473 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-11-27T20:45:45.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:45.474 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-11-27T20:45:45.536 INFO:teuthology.orchestra.run.smithi091.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-11-27T20:45:45.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:45:45.538 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:45.538 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:45.593 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:45.593 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:45.649 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:45.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.857+0000 7f041b89b640 1 Processor -- start 2023-11-27T20:45:45.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.857+0000 7f041b89b640 1 -- start start 2023-11-27T20:45:45.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f041b89b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f041414fd30 0x7f0414152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:45.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f041b89b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041406d0a0 0x7f04140a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:45.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f041b89b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f04140a5260 0x7f04140c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:45.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f041b89b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04140c64a0 con 0x7f041414fd30 2023-11-27T20:45:45.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f041b89b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04140c5c00 con 0x7f04140a5260 2023-11-27T20:45:45.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f041b89b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04140c5ee0 con 0x7f041406d0a0 2023-11-27T20:45:45.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f0419637640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f041414fd30 0x7f0414152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:45.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f0419637640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f041414fd30 0x7f0414152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33874/0 (socket says 172.21.15.91:33874) 2023-11-27T20:45:45.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f0419637640 1 -- 172.21.15.91:0/3998058218 learned_addr learned my addr 172.21.15.91:0/3998058218 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:45.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f0419637640 1 -- 172.21.15.91:0/3998058218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041406d0a0 msgr2=0x7f04140a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:45.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f0419637640 1 --2- 172.21.15.91:0/3998058218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041406d0a0 0x7f04140a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:45.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f0419637640 1 -- 172.21.15.91:0/3998058218 >> v2:172.21.15.183:3300/0 conn(0x7f04140a5260 msgr2=0x7f04140c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:45.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.859+0000 7f0419637640 1 --2- 172.21.15.91:0/3998058218 >> v2:172.21.15.183:3300/0 conn(0x7f04140a5260 0x7f04140c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:45.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.860+0000 7f0419637640 1 -- 172.21.15.91:0/3998058218 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04140c61c0 con 0x7f041414fd30 2023-11-27T20:45:45.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.861+0000 7f0419637640 1 --2- 172.21.15.91:0/3998058218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f041414fd30 0x7f0414152f20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f041406d990 tx=0x7f041002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2421bb1db480d763 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:45.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.861+0000 7f040bfff640 1 -- 172.21.15.91:0/3998058218 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410031870 con 0x7f041414fd30 2023-11-27T20:45:45.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.861+0000 7f040bfff640 1 -- 172.21.15.91:0/3998058218 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04100319d0 con 0x7f041414fd30 2023-11-27T20:45:45.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.861+0000 7f040bfff640 1 -- 172.21.15.91:0/3998058218 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410031d60 con 0x7f041414fd30 2023-11-27T20:45:45.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.862+0000 7f041b89b640 1 -- 172.21.15.91:0/3998058218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f041414fd30 msgr2=0x7f0414152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:45.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.862+0000 7f041b89b640 1 --2- 172.21.15.91:0/3998058218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f041414fd30 0x7f0414152f20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f041406d990 tx=0x7f041002b910 comp rx=0 tx=0).stop 2023-11-27T20:45:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.862+0000 7f041b89b640 1 -- 172.21.15.91:0/3998058218 shutdown_connections 2023-11-27T20:45:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.862+0000 7f041b89b640 1 --2- 172.21.15.91:0/3998058218 >> v2:172.21.15.183:3300/0 conn(0x7f04140a5260 0x7f04140c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.862+0000 7f041b89b640 1 --2- 172.21.15.91:0/3998058218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041406d0a0 0x7f04140a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.862+0000 7f041b89b640 1 --2- 172.21.15.91:0/3998058218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f041414fd30 0x7f0414152f20 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.862+0000 7f041b89b640 1 -- 172.21.15.91:0/3998058218 >> 172.21.15.91:0/3998058218 conn(0x7f041406a500 msgr2=0x7f041406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.862+0000 7f041b89b640 1 -- 172.21.15.91:0/3998058218 shutdown_connections 2023-11-27T20:45:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.862+0000 7f041b89b640 1 -- 172.21.15.91:0/3998058218 wait complete. 2023-11-27T20:45:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.863+0000 7f041b89b640 1 Processor -- start 2023-11-27T20:45:45.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.864+0000 7f041b89b640 1 -- start start 2023-11-27T20:45:45.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.864+0000 7f041b89b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041406d0a0 0x7f04141ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:45.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.864+0000 7f041b89b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04140a5260 0x7f041414ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:45.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f041b89b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041414fd30 0x7f041414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:45.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f041b89b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041414ca10 con 0x7f04140a5260 2023-11-27T20:45:45.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f041b89b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04141ee2e0 con 0x7f041406d0a0 2023-11-27T20:45:45.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f041b89b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041414d520 con 0x7f041414fd30 2023-11-27T20:45:45.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f0418e36640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04140a5260 0x7f041414ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:45.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f0418e36640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04140a5260 0x7f041414ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33878/0 (socket says 172.21.15.91:33878) 2023-11-27T20:45:45.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f0418e36640 1 -- 172.21.15.91:0/1406025940 learned_addr learned my addr 172.21.15.91:0/1406025940 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:45.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f0418e36640 1 -- 172.21.15.91:0/1406025940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041414fd30 msgr2=0x7f041414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:45.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f0418e36640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041414fd30 0x7f041414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:45.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f0418e36640 1 -- 172.21.15.91:0/1406025940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041406d0a0 msgr2=0x7f04141ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:45.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f0418e36640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041406d0a0 0x7f04141ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:45.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f0418e36640 1 -- 172.21.15.91:0/1406025940 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100094d0 con 0x7f04140a5260 2023-11-27T20:45:45.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.865+0000 7f0418e36640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04140a5260 0x7f041414ac10 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f040400b480 tx=0x7f040400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:45.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.866+0000 7f0409ffb640 1 -- 172.21.15.91:0/1406025940 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404010870 con 0x7f04140a5260 2023-11-27T20:45:45.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.866+0000 7f0409ffb640 1 -- 172.21.15.91:0/1406025940 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04040109d0 con 0x7f04140a5260 2023-11-27T20:45:45.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.866+0000 7f041b89b640 1 -- 172.21.15.91:0/1406025940 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04141ee000 con 0x7f04140a5260 2023-11-27T20:45:45.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.866+0000 7f0409ffb640 1 -- 172.21.15.91:0/1406025940 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404010d80 con 0x7f04140a5260 2023-11-27T20:45:45.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.866+0000 7f041b89b640 1 -- 172.21.15.91:0/1406025940 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041414b690 con 0x7f04140a5260 2023-11-27T20:45:45.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.867+0000 7f041b89b640 1 -- 172.21.15.91:0/1406025940 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0414068350 con 0x7f04140a5260 2023-11-27T20:45:45.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.868+0000 7f0409ffb640 1 -- 172.21.15.91:0/1406025940 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f040400f3c0 con 0x7f04140a5260 2023-11-27T20:45:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.869+0000 7f0409ffb640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03f806b1c0 0x7f03f806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.869+0000 7f0409ffb640 1 -- 172.21.15.91:0/1406025940 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f0404089dd0 con 0x7f04140a5260 2023-11-27T20:45:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.869+0000 7f0419637640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03f806b1c0 0x7f03f806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.870+0000 7f0419637640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03f806b1c0 0x7f03f806d680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0410036000 tx=0x7f0410030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:45.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:45.873+0000 7f0409ffb640 1 -- 172.21.15.91:0/1406025940 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f04040581f0 con 0x7f04140a5260 2023-11-27T20:45:46.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.065+0000 7f041b89b640 1 -- 172.21.15.91:0/1406025940 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f041414d660 con 0x7f04140a5260 2023-11-27T20:45:46.070 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.069+0000 7f0409ffb640 1 -- 172.21.15.91:0/1406025940 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f0404014090 con 0x7f04140a5260 2023-11-27T20:45:46.071 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:46.071 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":81,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:23.334850+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:46.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 -- 172.21.15.91:0/1406025940 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03f806b1c0 msgr2=0x7f03f806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03f806b1c0 0x7f03f806d680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0410036000 tx=0x7f0410030000 comp rx=0 tx=0).stop 2023-11-27T20:45:46.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 -- 172.21.15.91:0/1406025940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04140a5260 msgr2=0x7f041414ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04140a5260 0x7f041414ac10 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f040400b480 tx=0x7f040400b940 comp rx=0 tx=0).stop 2023-11-27T20:45:46.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 -- 172.21.15.91:0/1406025940 shutdown_connections 2023-11-27T20:45:46.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041414fd30 0x7f041414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04140a5260 0x7f041414ac10 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f03f806b1c0 0x7f03f806d680 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 --2- 172.21.15.91:0/1406025940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041406d0a0 0x7f04141ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 -- 172.21.15.91:0/1406025940 >> 172.21.15.91:0/1406025940 conn(0x7f041406a500 msgr2=0x7f04140aa170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:46.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 -- 172.21.15.91:0/1406025940 shutdown_connections 2023-11-27T20:45:46.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.072+0000 7f041b89b640 1 -- 172.21.15.91:0/1406025940 wait complete. 2023-11-27T20:45:46.093 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:45:04.361620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:45:05.090674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:45:19.465319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:45:20.794821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:45:46.093 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:45:46.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.311+0000 7fedbf02b640 1 Processor -- start 2023-11-27T20:45:46.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.311+0000 7fedbf02b640 1 -- start start 2023-11-27T20:45:46.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.312+0000 7fedbf02b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fedb806d0a0 0x7fedb8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.312+0000 7fedbf02b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fedb80c3ea0 0x7fedb80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.312+0000 7fedbf02b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80c64a0 con 0x7fedb814fd30 2023-11-27T20:45:46.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.312+0000 7fedbf02b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb80c5c00 con 0x7fedb806d0a0 2023-11-27T20:45:46.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.312+0000 7fedbf02b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb80c5ee0 con 0x7fedb80c3ea0 2023-11-27T20:45:46.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.313+0000 7fedb7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fedb806d0a0 0x7fedb8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.313+0000 7fedb7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fedb806d0a0 0x7fedb8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33886/0 (socket says 172.21.15.91:33886) 2023-11-27T20:45:46.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.313+0000 7fedb7fff640 1 -- 172.21.15.91:0/2421127639 learned_addr learned my addr 172.21.15.91:0/2421127639 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:46.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.313+0000 7fedbd5c8640 1 --2- 172.21.15.91:0/2421127639 >> v2:172.21.15.183:3300/0 conn(0x7fedb80c3ea0 0x7fedb80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.313+0000 7fedb7fff640 1 -- 172.21.15.91:0/2421127639 >> v2:172.21.15.183:3300/0 conn(0x7fedb80c3ea0 msgr2=0x7fedb80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:46.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.313+0000 7fedb7fff640 1 --2- 172.21.15.91:0/2421127639 >> v2:172.21.15.183:3300/0 conn(0x7fedb80c3ea0 0x7fedb80c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.313+0000 7fedb7fff640 1 -- 172.21.15.91:0/2421127639 >> v1:172.21.15.91:6789/0 conn(0x7fedb814fd30 legacy=0x7fedb80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.313+0000 7fedb7fff640 1 -- 172.21.15.91:0/2421127639 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80c61c0 con 0x7fedb806d0a0 2023-11-27T20:45:46.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.313+0000 7fedbd5c8640 1 --2- 172.21.15.91:0/2421127639 >> v2:172.21.15.183:3300/0 conn(0x7fedb80c3ea0 0x7fedb80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:46.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.315+0000 7fedb7fff640 1 --2- 172.21.15.91:0/2421127639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb806d0a0 0x7fedb8152f20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fedb806e430 tx=0x7feda402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88456e24ebab54 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:46.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.315+0000 7fedb77fe640 1 -- 172.21.15.91:0/2421127639 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4030860 con 0x7fedb806d0a0 2023-11-27T20:45:46.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.315+0000 7fedb77fe640 1 -- 172.21.15.91:0/2421127639 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda40309c0 con 0x7fedb806d0a0 2023-11-27T20:45:46.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.315+0000 7fedb77fe640 1 -- 172.21.15.91:0/2421127639 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4030d50 con 0x7fedb806d0a0 2023-11-27T20:45:46.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.315+0000 7fedbf02b640 1 -- 172.21.15.91:0/2421127639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb806d0a0 msgr2=0x7fedb8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.315+0000 7fedbf02b640 1 --2- 172.21.15.91:0/2421127639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb806d0a0 0x7fedb8152f20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fedb806e430 tx=0x7feda402b9a0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.316+0000 7fedbf02b640 1 -- 172.21.15.91:0/2421127639 shutdown_connections 2023-11-27T20:45:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.316+0000 7fedbf02b640 1 --2- 172.21.15.91:0/2421127639 >> v2:172.21.15.183:3300/0 conn(0x7fedb80c3ea0 0x7fedb80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.316+0000 7fedbf02b640 1 --2- 172.21.15.91:0/2421127639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb806d0a0 0x7fedb8152f20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.316+0000 7fedbf02b640 1 -- 172.21.15.91:0/2421127639 >> 172.21.15.91:0/2421127639 conn(0x7fedb806a500 msgr2=0x7fedb806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.316+0000 7fedbf02b640 1 -- 172.21.15.91:0/2421127639 shutdown_connections 2023-11-27T20:45:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.316+0000 7fedbf02b640 1 -- 172.21.15.91:0/2421127639 wait complete. 2023-11-27T20:45:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.317+0000 7fedbf02b640 1 Processor -- start 2023-11-27T20:45:46.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.317+0000 7fedbf02b640 1 -- start start 2023-11-27T20:45:46.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.318+0000 7fedbf02b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedb806d0a0 0x7fedb81e8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.318+0000 7fedbf02b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb80c3ea0 0x7fedb80befd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.318+0000 7fedbf02b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb814fd30 0x7fedb8153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.318+0000 7fedbf02b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80bc670 con 0x7fedb814fd30 2023-11-27T20:45:46.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.318+0000 7fedbf02b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb814cc20 con 0x7fedb806d0a0 2023-11-27T20:45:46.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.318+0000 7fedbf02b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8152080 con 0x7fedb80c3ea0 2023-11-27T20:45:46.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedbd5c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb814fd30 0x7fedb8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedbd5c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb814fd30 0x7fedb8153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33892/0 (socket says 172.21.15.91:33892) 2023-11-27T20:45:46.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedbd5c8640 1 -- 172.21.15.91:0/350943042 learned_addr learned my addr 172.21.15.91:0/350943042 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:46.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedbcdc7640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedb806d0a0 0x7fedb81e8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedb7fff640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb80c3ea0 0x7fedb80befd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedbd5c8640 1 -- 172.21.15.91:0/350943042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb80c3ea0 msgr2=0x7fedb80befd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedbd5c8640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb80c3ea0 0x7fedb80befd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedbd5c8640 1 -- 172.21.15.91:0/350943042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedb806d0a0 msgr2=0x7fedb81e8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedbd5c8640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedb806d0a0 0x7fedb81e8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedbd5c8640 1 -- 172.21.15.91:0/350943042 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40094d0 con 0x7fedb814fd30 2023-11-27T20:45:46.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.319+0000 7fedb7fff640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb80c3ea0 0x7fedb80befd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:46.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.320+0000 7fedbd5c8640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb814fd30 0x7fedb8153860 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fedb000cef0 tx=0x7fedb000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:46.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.320+0000 7fedb57fa640 1 -- 172.21.15.91:0/350943042 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb000d840 con 0x7fedb814fd30 2023-11-27T20:45:46.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.320+0000 7fedb57fa640 1 -- 172.21.15.91:0/350943042 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb000d9c0 con 0x7fedb814fd30 2023-11-27T20:45:46.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.320+0000 7fedb57fa640 1 -- 172.21.15.91:0/350943042 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb000dd70 con 0x7fedb814fd30 2023-11-27T20:45:46.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.320+0000 7fedbf02b640 1 -- 172.21.15.91:0/350943042 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb80bf510 con 0x7fedb814fd30 2023-11-27T20:45:46.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.320+0000 7fedbf02b640 1 -- 172.21.15.91:0/350943042 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb80bfd40 con 0x7fedb814fd30 2023-11-27T20:45:46.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.321+0000 7fedbf02b640 1 -- 172.21.15.91:0/350943042 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb8068350 con 0x7fedb814fd30 2023-11-27T20:45:46.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.322+0000 7fedb57fa640 1 -- 172.21.15.91:0/350943042 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fedb001e3b0 con 0x7fedb814fd30 2023-11-27T20:45:46.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.323+0000 7fedb57fa640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fed9c06b1c0 0x7fed9c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.323+0000 7fedb57fa640 1 -- 172.21.15.91:0/350943042 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fedb008a7c0 con 0x7fedb814fd30 2023-11-27T20:45:46.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.323+0000 7fedbcdc7640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fed9c06b1c0 0x7fed9c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.324+0000 7fedbcdc7640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fed9c06b1c0 0x7fed9c06d680 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fedac000f60 tx=0x7fedac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:46.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.327+0000 7fedb57fa640 1 -- 172.21.15.91:0/350943042 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fedb0055180 con 0x7fedb814fd30 2023-11-27T20:45:46.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.524+0000 7fedbf02b640 1 -- 172.21.15.91:0/350943042 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedb80bf510 con 0x7fedb814fd30 2023-11-27T20:45:46.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.524+0000 7fedb57fa640 1 -- 172.21.15.91:0/350943042 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedb80bf510 con 0x7fedb814fd30 2023-11-27T20:45:46.526 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 -- 172.21.15.91:0/350943042 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fed9c06b1c0 msgr2=0x7fed9c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fed9c06b1c0 0x7fed9c06d680 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fedac000f60 tx=0x7fedac009040 comp rx=0 tx=0).stop 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 -- 172.21.15.91:0/350943042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb814fd30 msgr2=0x7fedb8153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb814fd30 0x7fedb8153860 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fedb000cef0 tx=0x7fedb000a710 comp rx=0 tx=0).stop 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 -- 172.21.15.91:0/350943042 shutdown_connections 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb814fd30 0x7fedb8153860 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb80c3ea0 0x7fedb80befd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fed9c06b1c0 0x7fed9c06d680 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 --2- 172.21.15.91:0/350943042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedb806d0a0 0x7fedb81e8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 -- 172.21.15.91:0/350943042 >> 172.21.15.91:0/350943042 conn(0x7fedb806a500 msgr2=0x7fedb80c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:46.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 -- 172.21.15.91:0/350943042 shutdown_connections 2023-11-27T20:45:46.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.527+0000 7fedbf02b640 1 -- 172.21.15.91:0/350943042 wait complete. 2023-11-27T20:45:46.547 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:45:46.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.761+0000 7f78823d0640 1 Processor -- start 2023-11-27T20:45:46.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.761+0000 7f78823d0640 1 -- start start 2023-11-27T20:45:46.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.762+0000 7f78823d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f787c14fd30 0x7f787c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.762+0000 7f78823d0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f787c06d0a0 0x7f787c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.762+0000 7f78823d0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c0c64a0 con 0x7f787c0a5260 2023-11-27T20:45:46.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.762+0000 7f78823d0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c0c5c00 con 0x7f787c06d0a0 2023-11-27T20:45:46.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.762+0000 7f78823d0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0c5ee0 con 0x7f787c14fd30 2023-11-27T20:45:46.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.763+0000 7f788096d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f787c0a5260 0x7f787c0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:52930/0 (socket says 172.21.15.91:52930) 2023-11-27T20:45:46.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.763+0000 7f788096d640 1 -- 172.21.15.91:0/1858471821 learned_addr learned my addr 172.21.15.91:0/1858471821 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:46.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.763+0000 7f787bfff640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f787c14fd30 0x7f787c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.763+0000 7f787b7fe640 1 --2- 172.21.15.91:0/1858471821 >> v2:172.21.15.183:3300/0 conn(0x7f787c06d0a0 0x7f787c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.763+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702238857 0 0) 0x7f787c0c64a0 con 0x7f787c0a5260 2023-11-27T20:45:46.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.763+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7864003520 con 0x7f787c0a5260 2023-11-27T20:45:46.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3057457417 0 0) 0x7f7864003520 con 0x7f787c0a5260 2023-11-27T20:45:46.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f787c14fd30 msgr2=0x7f787c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:46.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f787c14fd30 0x7f787c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 >> v2:172.21.15.183:3300/0 conn(0x7f787c06d0a0 msgr2=0x7f787c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:46.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 --2- 172.21.15.91:0/1858471821 >> v2:172.21.15.183:3300/0 conn(0x7f787c06d0a0 0x7f787c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0c61c0 con 0x7f787c0a5260 2023-11-27T20:45:46.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f78740019f0 con 0x7f787c0a5260 2023-11-27T20:45:46.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 >> v1:172.21.15.91:6789/0 conn(0x7f787c0a5260 legacy=0x7f787c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7864003970 0x7f7864003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f787c14fd30 0x7f78640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7864004d00 0x7f7864005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0c5c00 con 0x7f7864003970 2023-11-27T20:45:46.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0c5ee0 con 0x7f7864004d00 2023-11-27T20:45:46.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786400b980 con 0x7f787c14fd30 2023-11-27T20:45:46.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.764+0000 7f787bfff640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7864003970 0x7f7864003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.765+0000 7f787b7fe640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f787c14fd30 0x7f78640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.765+0000 7f787bfff640 1 -- 172.21.15.91:0/1858471821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f787c14fd30 msgr2=0x7f78640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:46.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.765+0000 7f787bfff640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f787c14fd30 0x7f78640047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.765+0000 7f787bfff640 1 -- 172.21.15.91:0/1858471821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7864004d00 msgr2=0x7f7864005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:46.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.765+0000 7f787bfff640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7864004d00 0x7f7864005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.765+0000 7f787bfff640 1 -- 172.21.15.91:0/1858471821 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7864003520 con 0x7f7864003970 2023-11-27T20:45:46.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.766+0000 7f787bfff640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7864003970 0x7f7864003d90 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f786c009ac0 tx=0x7f78640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbff1c1f234e77e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:46.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.766+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c02c6b0 con 0x7f7864003970 2023-11-27T20:45:46.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.766+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c02c810 con 0x7f7864003970 2023-11-27T20:45:46.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.766+0000 7f787affd640 1 -- 172.21.15.91:0/1858471821 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c02cba0 con 0x7f7864003970 2023-11-27T20:45:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.766+0000 7f78823d0640 1 -- 172.21.15.91:0/1858471821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7864003970 msgr2=0x7f7864003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.766+0000 7f78823d0640 1 --2- 172.21.15.91:0/1858471821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7864003970 0x7f7864003d90 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f786c009ac0 tx=0x7f78640057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.767+0000 7f788096d640 1 -- 172.21.15.91:0/1858471821 reap_dead start 2023-11-27T20:45:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.767+0000 7f78823d0640 1 -- 172.21.15.91:0/1858471821 shutdown_connections 2023-11-27T20:45:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.767+0000 7f78823d0640 1 -- 172.21.15.91:0/1858471821 >> 172.21.15.91:0/1858471821 conn(0x7f787c06a500 msgr2=0x7f787c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.767+0000 7f78823d0640 1 -- 172.21.15.91:0/1858471821 shutdown_connections 2023-11-27T20:45:46.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.767+0000 7f78823d0640 1 -- 172.21.15.91:0/1858471821 wait complete. 2023-11-27T20:45:46.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.768+0000 7f78823d0640 1 Processor -- start 2023-11-27T20:45:46.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.768+0000 7f78823d0640 1 -- start start 2023-11-27T20:45:46.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.769+0000 7f78823d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7864003970 0x7f787c0aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.769+0000 7f78823d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f787c0bf360 0x7f787c1dee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.769+0000 7f78823d0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f787c1df370 0x7f787c1ea390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.769+0000 7f78823d0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c155620 con 0x7f787c0bf360 2023-11-27T20:45:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.769+0000 7f78823d0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0aacf0 con 0x7f787c1df370 2023-11-27T20:45:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.769+0000 7f78823d0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c1563d0 con 0x7f7864003970 2023-11-27T20:45:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f787b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f787c0bf360 0x7f787c1dee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f787b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f787c0bf360 0x7f787c1dee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33906/0 (socket says 172.21.15.91:33906) 2023-11-27T20:45:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f787b7fe640 1 -- 172.21.15.91:0/3786046510 learned_addr learned my addr 172.21.15.91:0/3786046510 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f787bfff640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7864003970 0x7f787c0aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f788096d640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f787c1df370 0x7f787c1ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f787b7fe640 1 -- 172.21.15.91:0/3786046510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7864003970 msgr2=0x7f787c0aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f787b7fe640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7864003970 0x7f787c0aa6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f787b7fe640 1 -- 172.21.15.91:0/3786046510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f787c1df370 msgr2=0x7f787c1ea390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f787b7fe640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f787c1df370 0x7f787c1ea390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f787b7fe640 1 -- 172.21.15.91:0/3786046510 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c1ee860 con 0x7f787c0bf360 2023-11-27T20:45:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.770+0000 7f788096d640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f787c1df370 0x7f787c1ea390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.771+0000 7f787b7fe640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f787c0bf360 0x7f787c1dee30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f78700108f0 tx=0x7f7870010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.771+0000 7f7878ff9640 1 -- 172.21.15.91:0/3786046510 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870009630 con 0x7f787c0bf360 2023-11-27T20:45:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.771+0000 7f7878ff9640 1 -- 172.21.15.91:0/3786046510 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787000eb60 con 0x7f787c0bf360 2023-11-27T20:45:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.771+0000 7f7878ff9640 1 -- 172.21.15.91:0/3786046510 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787001c400 con 0x7f787c0bf360 2023-11-27T20:45:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.771+0000 7f78823d0640 1 -- 172.21.15.91:0/3786046510 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c1ee3d0 con 0x7f787c0bf360 2023-11-27T20:45:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.771+0000 7f78823d0640 1 -- 172.21.15.91:0/3786046510 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c1edd80 con 0x7f787c0bf360 2023-11-27T20:45:46.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.772+0000 7f78823d0640 1 -- 172.21.15.91:0/3786046510 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c1ee560 con 0x7f787c0bf360 2023-11-27T20:45:46.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.773+0000 7f7878ff9640 1 -- 172.21.15.91:0/3786046510 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f787001c560 con 0x7f787c0bf360 2023-11-27T20:45:46.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.775+0000 7f7878ff9640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f786806b1f0 0x7f786806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:46.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.775+0000 7f7878ff9640 1 -- 172.21.15.91:0/3786046510 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f787008a200 con 0x7f787c0bf360 2023-11-27T20:45:46.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.775+0000 7f787bfff640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f786806b1f0 0x7f786806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:46.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.776+0000 7f787bfff640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f786806b1f0 0x7f786806d6b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f786c036000 tx=0x7f786c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:46.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.779+0000 7f7878ff9640 1 -- 172.21.15.91:0/3786046510 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7870054ce0 con 0x7f787c0bf360 2023-11-27T20:45:46.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.969+0000 7f78823d0640 1 -- 172.21.15.91:0/3786046510 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f787c1df750 con 0x7f787c0bf360 2023-11-27T20:45:46.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.971+0000 7f7878ff9640 1 -- 172.21.15.91:0/3786046510 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7870058300 con 0x7f787c0bf360 2023-11-27T20:45:46.972 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:46.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.973+0000 7f78823d0640 1 -- 172.21.15.91:0/3786046510 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f786806b1f0 msgr2=0x7f786806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.973+0000 7f78823d0640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f786806b1f0 0x7f786806d6b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f786c036000 tx=0x7f786c030000 comp rx=0 tx=0).stop 2023-11-27T20:45:46.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.973+0000 7f78823d0640 1 -- 172.21.15.91:0/3786046510 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f787c0bf360 msgr2=0x7f787c1dee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:46.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.973+0000 7f78823d0640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f787c0bf360 0x7f787c1dee30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f78700108f0 tx=0x7f7870010db0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.973+0000 7f78823d0640 1 -- 172.21.15.91:0/3786046510 shutdown_connections 2023-11-27T20:45:46.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.973+0000 7f78823d0640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f786806b1f0 0x7f786806d6b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.973+0000 7f78823d0640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f787c1df370 0x7f787c1ea390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.973+0000 7f78823d0640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f787c0bf360 0x7f787c1dee30 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.973+0000 7f78823d0640 1 --2- 172.21.15.91:0/3786046510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7864003970 0x7f787c0aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:46.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.973+0000 7f78823d0640 1 -- 172.21.15.91:0/3786046510 >> 172.21.15.91:0/3786046510 conn(0x7f787c06a500 msgr2=0x7f787c0c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:46.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.974+0000 7f78823d0640 1 -- 172.21.15.91:0/3786046510 shutdown_connections 2023-11-27T20:45:46.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:46.974+0000 7f78823d0640 1 -- 172.21.15.91:0/3786046510 wait complete. 2023-11-27T20:45:46.994 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:45:47.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.212+0000 7fa0a2a48640 1 Processor -- start 2023-11-27T20:45:47.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.212+0000 7fa0a2a48640 1 -- start start 2023-11-27T20:45:47.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa0a2a48640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa09c14fd30 0x7fa09c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa0a2a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c06d0a0 0x7fa09c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa0a2a48640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c0c64a0 con 0x7fa09c0a5260 2023-11-27T20:45:47.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa0a2a48640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c0c5c00 con 0x7fa09c14fd30 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa0a2a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0c5ee0 con 0x7fa09c06d0a0 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa09bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa09c14fd30 0x7fa09c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa09bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa09c14fd30 0x7fa09c152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33922/0 (socket says 172.21.15.91:33922) 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa09bfff640 1 -- 172.21.15.91:0/495635507 learned_addr learned my addr 172.21.15.91:0/495635507 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa093fff640 1 --2- 172.21.15.91:0/495635507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c06d0a0 0x7fa09c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa09bfff640 1 -- 172.21.15.91:0/495635507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c06d0a0 msgr2=0x7fa09c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa09bfff640 1 --2- 172.21.15.91:0/495635507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c06d0a0 0x7fa09c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa09bfff640 1 -- 172.21.15.91:0/495635507 >> v1:172.21.15.91:6789/0 conn(0x7fa09c0a5260 legacy=0x7fa09c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.214+0000 7fa09bfff640 1 -- 172.21.15.91:0/495635507 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0c61c0 con 0x7fa09c14fd30 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.215+0000 7fa09bfff640 1 --2- 172.21.15.91:0/495635507 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c14fd30 0x7fa09c152f20 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009870 tx=0x7fa08c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a430946151fb3ca5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.215+0000 7fa09b7fe640 1 -- 172.21.15.91:0/495635507 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c030840 con 0x7fa09c14fd30 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.215+0000 7fa09b7fe640 1 -- 172.21.15.91:0/495635507 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c0309a0 con 0x7fa09c14fd30 2023-11-27T20:45:47.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.215+0000 7fa09b7fe640 1 -- 172.21.15.91:0/495635507 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c030d30 con 0x7fa09c14fd30 2023-11-27T20:45:47.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.216+0000 7fa0a2a48640 1 -- 172.21.15.91:0/495635507 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c14fd30 msgr2=0x7fa09c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.216+0000 7fa0a2a48640 1 --2- 172.21.15.91:0/495635507 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c14fd30 0x7fa09c152f20 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009870 tx=0x7fa08c02b980 comp rx=0 tx=0).stop 2023-11-27T20:45:47.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.216+0000 7fa0a2a48640 1 -- 172.21.15.91:0/495635507 shutdown_connections 2023-11-27T20:45:47.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.216+0000 7fa0a2a48640 1 --2- 172.21.15.91:0/495635507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c06d0a0 0x7fa09c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.216+0000 7fa0a2a48640 1 --2- 172.21.15.91:0/495635507 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c14fd30 0x7fa09c152f20 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.216+0000 7fa0a2a48640 1 -- 172.21.15.91:0/495635507 >> 172.21.15.91:0/495635507 conn(0x7fa09c06a500 msgr2=0x7fa09c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:47.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.216+0000 7fa0a2a48640 1 -- 172.21.15.91:0/495635507 shutdown_connections 2023-11-27T20:45:47.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.216+0000 7fa0a2a48640 1 -- 172.21.15.91:0/495635507 wait complete. 2023-11-27T20:45:47.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.218+0000 7fa0a2a48640 1 Processor -- start 2023-11-27T20:45:47.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.218+0000 7fa0a2a48640 1 -- start start 2023-11-27T20:45:47.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa0a2a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c06d0a0 0x7fa09c1ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa0a2a48640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c0a5260 0x7fa09c1edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa0a2a48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa09c14fd30 0x7fa09c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa0a2a48640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c071ef0 con 0x7fa09c0a5260 2023-11-27T20:45:47.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa0a2a48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c1ee1f0 con 0x7fa09c14fd30 2023-11-27T20:45:47.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa0a2a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c070f20 con 0x7fa09c06d0a0 2023-11-27T20:45:47.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa093fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c0a5260 0x7fa09c1edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa093fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c0a5260 0x7fa09c1edbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33932/0 (socket says 172.21.15.91:33932) 2023-11-27T20:45:47.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa093fff640 1 -- 172.21.15.91:0/1990329839 learned_addr learned my addr 172.21.15.91:0/1990329839 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:47.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa093fff640 1 -- 172.21.15.91:0/1990329839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c06d0a0 msgr2=0x7fa09c1ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa093fff640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c06d0a0 0x7fa09c1ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa093fff640 1 -- 172.21.15.91:0/1990329839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa09c14fd30 msgr2=0x7fa09c151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa093fff640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa09c14fd30 0x7fa09c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.219+0000 7fa093fff640 1 -- 172.21.15.91:0/1990329839 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c0094d0 con 0x7fa09c0a5260 2023-11-27T20:45:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.220+0000 7fa093fff640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c0a5260 0x7fa09c1edbf0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa08400d7d0 tx=0x7fa08400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.220+0000 7fa0997fa640 1 -- 172.21.15.91:0/1990329839 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400b6c0 con 0x7fa09c0a5260 2023-11-27T20:45:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.220+0000 7fa0997fa640 1 -- 172.21.15.91:0/1990329839 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08400b840 con 0x7fa09c0a5260 2023-11-27T20:45:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.220+0000 7fa0997fa640 1 -- 172.21.15.91:0/1990329839 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400bbf0 con 0x7fa09c0a5260 2023-11-27T20:45:47.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.220+0000 7fa0a2a48640 1 -- 172.21.15.91:0/1990329839 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c071200 con 0x7fa09c0a5260 2023-11-27T20:45:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.220+0000 7fa0a2a48640 1 -- 172.21.15.91:0/1990329839 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c070210 con 0x7fa09c0a5260 2023-11-27T20:45:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.221+0000 7fa0a2a48640 1 -- 172.21.15.91:0/1990329839 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c068350 con 0x7fa09c0a5260 2023-11-27T20:45:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.222+0000 7fa0997fa640 1 -- 172.21.15.91:0/1990329839 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa08400bd50 con 0x7fa09c0a5260 2023-11-27T20:45:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.223+0000 7fa0997fa640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07c06b1c0 0x7fa07c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.223+0000 7fa0997fa640 1 -- 172.21.15.91:0/1990329839 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fa08408a350 con 0x7fa09c0a5260 2023-11-27T20:45:47.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.223+0000 7fa09bfff640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07c06b1c0 0x7fa07c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.224+0000 7fa09bfff640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07c06b1c0 0x7fa07c06d680 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa08c036000 tx=0x7fa08c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:47.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.228+0000 7fa0997fa640 1 -- 172.21.15.91:0/1990329839 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa084054ce0 con 0x7fa09c0a5260 2023-11-27T20:45:47.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.416+0000 7fa0a2a48640 1 -- 172.21.15.91:0/1990329839 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa09c06d540 con 0x7fa09c0a5260 2023-11-27T20:45:47.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.418+0000 7fa0997fa640 1 -- 172.21.15.91:0/1990329839 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa084058300 con 0x7fa09c0a5260 2023-11-27T20:45:47.419 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 -- 172.21.15.91:0/1990329839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07c06b1c0 msgr2=0x7fa07c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07c06b1c0 0x7fa07c06d680 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa08c036000 tx=0x7fa08c03b040 comp rx=0 tx=0).stop 2023-11-27T20:45:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 -- 172.21.15.91:0/1990329839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c0a5260 msgr2=0x7fa09c1edbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c0a5260 0x7fa09c1edbf0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa08400d7d0 tx=0x7fa08400dc90 comp rx=0 tx=0).stop 2023-11-27T20:45:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 -- 172.21.15.91:0/1990329839 shutdown_connections 2023-11-27T20:45:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa07c06b1c0 0x7fa07c06d680 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa09c14fd30 0x7fa09c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa09c0a5260 0x7fa09c1edbf0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 --2- 172.21.15.91:0/1990329839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c06d0a0 0x7fa09c1ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 -- 172.21.15.91:0/1990329839 >> 172.21.15.91:0/1990329839 conn(0x7fa09c06a500 msgr2=0x7fa09c0a7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:47.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 -- 172.21.15.91:0/1990329839 shutdown_connections 2023-11-27T20:45:47.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.420+0000 7fa0a2a48640 1 -- 172.21.15.91:0/1990329839 wait complete. 2023-11-27T20:45:47.440 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:45:47.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.659+0000 7f9d4db3c640 1 Processor -- start 2023-11-27T20:45:47.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.659+0000 7f9d4db3c640 1 -- start start 2023-11-27T20:45:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.660+0000 7f9d4db3c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d4814c2e0 0x7f9d480c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.660+0000 7f9d4db3c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9d480c0440 0x7f9d48152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.660+0000 7f9d4db3c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9d48072310 0x7f9d480a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.660+0000 7f9d4db3c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d48071470 con 0x7f9d480c0440 2023-11-27T20:45:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.660+0000 7f9d4db3c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d48071e80 con 0x7f9d48072310 2023-11-27T20:45:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.660+0000 7f9d4db3c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4814c6c0 con 0x7f9d4814c2e0 2023-11-27T20:45:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d47fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9d480c0440 0x7f9d48152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d47fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9d480c0440 0x7f9d48152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33946/0 (socket says 172.21.15.91:33946) 2023-11-27T20:45:47.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d47fff640 1 -- 172.21.15.91:0/3460346136 learned_addr learned my addr 172.21.15.91:0/3460346136 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:47.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d4cb3a640 1 --2- 172.21.15.91:0/3460346136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d4814c2e0 0x7f9d480c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d4d33b640 1 --2- 172.21.15.91:0/3460346136 >> v2:172.21.15.183:3300/0 conn(0x7f9d48072310 0x7f9d480a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d47fff640 1 -- 172.21.15.91:0/3460346136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d4814c2e0 msgr2=0x7f9d480c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d47fff640 1 --2- 172.21.15.91:0/3460346136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d4814c2e0 0x7f9d480c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d47fff640 1 -- 172.21.15.91:0/3460346136 >> v2:172.21.15.183:3300/0 conn(0x7f9d48072310 msgr2=0x7f9d480a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d47fff640 1 --2- 172.21.15.91:0/3460346136 >> v2:172.21.15.183:3300/0 conn(0x7f9d48072310 0x7f9d480a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d47fff640 1 -- 172.21.15.91:0/3460346136 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48153180 con 0x7f9d480c0440 2023-11-27T20:45:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d4cb3a640 1 --2- 172.21.15.91:0/3460346136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d4814c2e0 0x7f9d480c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.661+0000 7f9d4d33b640 1 --2- 172.21.15.91:0/3460346136 >> v2:172.21.15.183:3300/0 conn(0x7f9d48072310 0x7f9d480a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.662+0000 7f9d47fff640 1 --2- 172.21.15.91:0/3460346136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 0x7f9d48152c40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f9d4806f680 tx=0x7f9d3402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fc5ded67057486 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:47.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.663+0000 7f9d477fe640 1 -- 172.21.15.91:0/3460346136 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34031740 con 0x7f9d480c0440 2023-11-27T20:45:47.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.663+0000 7f9d477fe640 1 -- 172.21.15.91:0/3460346136 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d340318a0 con 0x7f9d480c0440 2023-11-27T20:45:47.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.663+0000 7f9d477fe640 1 -- 172.21.15.91:0/3460346136 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34031c30 con 0x7f9d480c0440 2023-11-27T20:45:47.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.663+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3460346136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 msgr2=0x7f9d48152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.663+0000 7f9d4db3c640 1 --2- 172.21.15.91:0/3460346136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 0x7f9d48152c40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f9d4806f680 tx=0x7f9d3402b7e0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.664+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3460346136 shutdown_connections 2023-11-27T20:45:47.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.664+0000 7f9d4db3c640 1 --2- 172.21.15.91:0/3460346136 >> v2:172.21.15.183:3300/0 conn(0x7f9d48072310 0x7f9d480a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.664+0000 7f9d4db3c640 1 --2- 172.21.15.91:0/3460346136 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 0x7f9d48152c40 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.664+0000 7f9d4db3c640 1 --2- 172.21.15.91:0/3460346136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d4814c2e0 0x7f9d480c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.664+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3460346136 >> 172.21.15.91:0/3460346136 conn(0x7f9d480a77f0 msgr2=0x7f9d480a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:47.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.664+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3460346136 shutdown_connections 2023-11-27T20:45:47.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.664+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3460346136 wait complete. 2023-11-27T20:45:47.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.665+0000 7f9d4db3c640 1 Processor -- start 2023-11-27T20:45:47.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.665+0000 7f9d4db3c640 1 -- start start 2023-11-27T20:45:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.666+0000 7f9d4db3c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d48072310 0x7f9d4806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.666+0000 7f9d4db3c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 0x7f9d480a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.666+0000 7f9d4db3c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d4814c2e0 0x7f9d480a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.666+0000 7f9d4db3c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4814f4d0 con 0x7f9d480c0440 2023-11-27T20:45:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.666+0000 7f9d4db3c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4814e6e0 con 0x7f9d4814c2e0 2023-11-27T20:45:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.666+0000 7f9d4db3c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4814f1f0 con 0x7f9d48072310 2023-11-27T20:45:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.667+0000 7f9d47fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 0x7f9d480a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.667+0000 7f9d47fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 0x7f9d480a8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33956/0 (socket says 172.21.15.91:33956) 2023-11-27T20:45:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.667+0000 7f9d47fff640 1 -- 172.21.15.91:0/3622718423 learned_addr learned my addr 172.21.15.91:0/3622718423 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.667+0000 7f9d4d33b640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d4814c2e0 0x7f9d480a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.667+0000 7f9d47fff640 1 -- 172.21.15.91:0/3622718423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d48072310 msgr2=0x7f9d4806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.667+0000 7f9d4cb3a640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d48072310 0x7f9d4806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.667+0000 7f9d47fff640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d48072310 0x7f9d4806d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.667+0000 7f9d47fff640 1 -- 172.21.15.91:0/3622718423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d4814c2e0 msgr2=0x7f9d480a8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.667+0000 7f9d47fff640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d4814c2e0 0x7f9d480a8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.667+0000 7f9d47fff640 1 -- 172.21.15.91:0/3622718423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340094d0 con 0x7f9d480c0440 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.668+0000 7f9d47fff640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 0x7f9d480a8a30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f9d34000c00 tx=0x7f9d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.668+0000 7f9d457fa640 1 -- 172.21.15.91:0/3622718423 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34033d60 con 0x7f9d480c0440 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.668+0000 7f9d457fa640 1 -- 172.21.15.91:0/3622718423 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3403d470 con 0x7f9d480c0440 2023-11-27T20:45:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.668+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3622718423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4814e090 con 0x7f9d480c0440 2023-11-27T20:45:47.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.668+0000 7f9d457fa640 1 -- 172.21.15.91:0/3622718423 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3403d820 con 0x7f9d480c0440 2023-11-27T20:45:47.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.668+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3622718423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4806d6c0 con 0x7f9d480c0440 2023-11-27T20:45:47.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.669+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3622718423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d480a8750 con 0x7f9d480c0440 2023-11-27T20:45:47.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.670+0000 7f9d457fa640 1 -- 172.21.15.91:0/3622718423 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9d3403a040 con 0x7f9d480c0440 2023-11-27T20:45:47.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.671+0000 7f9d457fa640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d2c06b1c0 0x7f9d2c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:47.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.671+0000 7f9d457fa640 1 -- 172.21.15.91:0/3622718423 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f9d340abe10 con 0x7f9d480c0440 2023-11-27T20:45:47.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.671+0000 7f9d4cb3a640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d2c06b1c0 0x7f9d2c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:47.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.672+0000 7f9d4cb3a640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d2c06b1c0 0x7f9d2c06d680 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9d4806daa0 tx=0x7f9d3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:47.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.675+0000 7f9d457fa640 1 -- 172.21.15.91:0/3622718423 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9d480a8750 con 0x7f9d480c0440 2023-11-27T20:45:47.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.863+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3622718423 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d480a8750 con 0x7f9d480c0440 2023-11-27T20:45:47.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.864+0000 7f9d457fa640 1 -- 172.21.15.91:0/3622718423 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v81) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9d480a8750 con 0x7f9d480c0440 2023-11-27T20:45:47.865 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:47.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3622718423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d2c06b1c0 msgr2=0x7f9d2c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d2c06b1c0 0x7f9d2c06d680 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9d4806daa0 tx=0x7f9d3c008040 comp rx=0 tx=0).stop 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3622718423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 msgr2=0x7f9d480a8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 0x7f9d480a8a30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f9d34000c00 tx=0x7f9d340046c0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3622718423 shutdown_connections 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9d2c06b1c0 0x7f9d2c06d680 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d4814c2e0 0x7f9d480a8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d480c0440 0x7f9d480a8a30 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 --2- 172.21.15.91:0/3622718423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d48072310 0x7f9d4806d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3622718423 >> 172.21.15.91:0/3622718423 conn(0x7f9d480a77f0 msgr2=0x7f9d4814b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3622718423 shutdown_connections 2023-11-27T20:45:47.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:47.867+0000 7f9d4db3c640 1 -- 172.21.15.91:0/3622718423 wait complete. 2023-11-27T20:45:47.885 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:45:48.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.088+0000 7f3145a9b640 1 Processor -- start 2023-11-27T20:45:48.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.088+0000 7f3145a9b640 1 -- start start 2023-11-27T20:45:48.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.089+0000 7f3145a9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f31400c5ec0 0x7f31400c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.090+0000 7f3145a9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31400721a0 0x7f31400c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.090+0000 7f3145a9b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31400bfdc0 con 0x7f31400c45d0 2023-11-27T20:45:48.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.090+0000 7f3145a9b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314006e390 con 0x7f31400721a0 2023-11-27T20:45:48.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.090+0000 7f3145a9b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314006ddd0 con 0x7f31400c5ec0 2023-11-27T20:45:48.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.090+0000 7f313ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31400721a0 0x7f31400c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.090+0000 7f313ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31400721a0 0x7f31400c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33966/0 (socket says 172.21.15.91:33966) 2023-11-27T20:45:48.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.090+0000 7f313ffff640 1 -- 172.21.15.91:0/3967211123 learned_addr learned my addr 172.21.15.91:0/3967211123 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:48.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.090+0000 7f313f7fe640 1 --2- 172.21.15.91:0/3967211123 >> v2:172.21.15.183:3300/0 conn(0x7f31400c5ec0 0x7f31400c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.091+0000 7f313ffff640 1 -- 172.21.15.91:0/3967211123 >> v2:172.21.15.183:3300/0 conn(0x7f31400c5ec0 msgr2=0x7f31400c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:48.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.091+0000 7f313ffff640 1 --2- 172.21.15.91:0/3967211123 >> v2:172.21.15.183:3300/0 conn(0x7f31400c5ec0 0x7f31400c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.091+0000 7f313ffff640 1 -- 172.21.15.91:0/3967211123 >> v1:172.21.15.183:6789/0 conn(0x7f31400c45d0 legacy=0x7f3140155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:48.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.091+0000 7f313ffff640 1 -- 172.21.15.91:0/3967211123 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314006e0b0 con 0x7f31400721a0 2023-11-27T20:45:48.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.092+0000 7f313ffff640 1 --2- 172.21.15.91:0/3967211123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 0x7f31400c3170 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3138009e50 tx=0x7f313802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617186cac2cc423b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:48.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.092+0000 7f313effd640 1 -- 172.21.15.91:0/3967211123 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313802c960 con 0x7f31400721a0 2023-11-27T20:45:48.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.093+0000 7f313effd640 1 -- 172.21.15.91:0/3967211123 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313802cac0 con 0x7f31400721a0 2023-11-27T20:45:48.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.093+0000 7f313effd640 1 -- 172.21.15.91:0/3967211123 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313802ce50 con 0x7f31400721a0 2023-11-27T20:45:48.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.093+0000 7f3145a9b640 1 -- 172.21.15.91:0/3967211123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 msgr2=0x7f31400c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.093+0000 7f3145a9b640 1 --2- 172.21.15.91:0/3967211123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 0x7f31400c3170 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3138009e50 tx=0x7f313802bdc0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.093+0000 7f3145a9b640 1 -- 172.21.15.91:0/3967211123 shutdown_connections 2023-11-27T20:45:48.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.093+0000 7f3145a9b640 1 --2- 172.21.15.91:0/3967211123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 0x7f31400c3170 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.093+0000 7f3145a9b640 1 --2- 172.21.15.91:0/3967211123 >> v2:172.21.15.183:3300/0 conn(0x7f31400c5ec0 0x7f31400c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.093+0000 7f3145a9b640 1 -- 172.21.15.91:0/3967211123 >> 172.21.15.91:0/3967211123 conn(0x7f314006a500 msgr2=0x7f314006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:48.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.093+0000 7f3145a9b640 1 -- 172.21.15.91:0/3967211123 shutdown_connections 2023-11-27T20:45:48.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.093+0000 7f3145a9b640 1 -- 172.21.15.91:0/3967211123 wait complete. 2023-11-27T20:45:48.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.095+0000 7f3145a9b640 1 Processor -- start 2023-11-27T20:45:48.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.095+0000 7f3145a9b640 1 -- start start 2023-11-27T20:45:48.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.096+0000 7f3145a9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 0x7f3140150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.096+0000 7f3145a9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31400c45d0 0x7f3140155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.096+0000 7f3145a9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31400c5ec0 0x7f31401ed060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.096+0000 7f3145a9b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31401585b0 con 0x7f31400721a0 2023-11-27T20:45:48.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.096+0000 7f3145a9b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3140157180 con 0x7f31400c45d0 2023-11-27T20:45:48.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.096+0000 7f3145a9b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31401514b0 con 0x7f31400c5ec0 2023-11-27T20:45:48.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.096+0000 7f313f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 0x7f3140150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.096+0000 7f313f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 0x7f3140150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33978/0 (socket says 172.21.15.91:33978) 2023-11-27T20:45:48.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.096+0000 7f313f7fe640 1 -- 172.21.15.91:0/3169803477 learned_addr learned my addr 172.21.15.91:0/3169803477 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:48.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313ffff640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31400c5ec0 0x7f31401ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f3137fff640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31400c45d0 0x7f3140155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313f7fe640 1 -- 172.21.15.91:0/3169803477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31400c5ec0 msgr2=0x7f31401ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313f7fe640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31400c5ec0 0x7f31401ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313f7fe640 1 -- 172.21.15.91:0/3169803477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31400c45d0 msgr2=0x7f3140155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313f7fe640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31400c45d0 0x7f3140155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313f7fe640 1 -- 172.21.15.91:0/3169803477 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3138009b30 con 0x7f31400721a0 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313ffff640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31400c5ec0 0x7f31401ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313f7fe640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 0x7f3140150f70 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f313000d5f0 tx=0x7f313000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313cff9640 1 -- 172.21.15.91:0/3169803477 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31300125f0 con 0x7f31400721a0 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313cff9640 1 -- 172.21.15.91:0/3169803477 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130012750 con 0x7f31400721a0 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f313cff9640 1 -- 172.21.15.91:0/3169803477 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130012b00 con 0x7f31400721a0 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.097+0000 7f3145a9b640 1 -- 172.21.15.91:0/3169803477 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31401edba0 con 0x7f31400721a0 2023-11-27T20:45:48.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.098+0000 7f3145a9b640 1 -- 172.21.15.91:0/3169803477 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3140158090 con 0x7f31400721a0 2023-11-27T20:45:48.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.099+0000 7f3145a9b640 1 -- 172.21.15.91:0/3169803477 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3140068350 con 0x7f31400721a0 2023-11-27T20:45:48.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.099+0000 7f313cff9640 1 -- 172.21.15.91:0/3169803477 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3130012c60 con 0x7f31400721a0 2023-11-27T20:45:48.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.100+0000 7f313cff9640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f312006b1c0 0x7f312006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.100+0000 7f313cff9640 1 -- 172.21.15.91:0/3169803477 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f313008a290 con 0x7f31400721a0 2023-11-27T20:45:48.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.101+0000 7f3137fff640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f312006b1c0 0x7f312006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.101+0000 7f3137fff640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f312006b1c0 0x7f312006d680 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f31400ab150 tx=0x7f3128009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:48.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.105+0000 7f313cff9640 1 -- 172.21.15.91:0/3169803477 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3130054c20 con 0x7f31400721a0 2023-11-27T20:45:48.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.294+0000 7f3145a9b640 1 -- 172.21.15.91:0/3169803477 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f31400bfa00 con 0x7f31400721a0 2023-11-27T20:45:48.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.295+0000 7f313cff9640 1 -- 172.21.15.91:0/3169803477 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v81) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3130058240 con 0x7f31400721a0 2023-11-27T20:45:48.295 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:48.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.297+0000 7f3145a9b640 1 -- 172.21.15.91:0/3169803477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f312006b1c0 msgr2=0x7f312006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.297+0000 7f3145a9b640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f312006b1c0 0x7f312006d680 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f31400ab150 tx=0x7f3128009040 comp rx=0 tx=0).stop 2023-11-27T20:45:48.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.298+0000 7f3145a9b640 1 -- 172.21.15.91:0/3169803477 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 msgr2=0x7f3140150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.298+0000 7f3145a9b640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 0x7f3140150f70 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f313000d5f0 tx=0x7f313000dab0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.298+0000 7f3145a9b640 1 -- 172.21.15.91:0/3169803477 shutdown_connections 2023-11-27T20:45:48.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.298+0000 7f3145a9b640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31400c5ec0 0x7f31401ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.298+0000 7f3145a9b640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f312006b1c0 0x7f312006d680 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.298+0000 7f3145a9b640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31400c45d0 0x7f3140155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.298+0000 7f3145a9b640 1 --2- 172.21.15.91:0/3169803477 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31400721a0 0x7f3140150f70 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.298+0000 7f3145a9b640 1 -- 172.21.15.91:0/3169803477 >> 172.21.15.91:0/3169803477 conn(0x7f314006a500 msgr2=0x7f314006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:48.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.298+0000 7f3145a9b640 1 -- 172.21.15.91:0/3169803477 shutdown_connections 2023-11-27T20:45:48.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.298+0000 7f3145a9b640 1 -- 172.21.15.91:0/3169803477 wait complete. 2023-11-27T20:45:48.315 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:45:48.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.525+0000 7fdda6c9b640 1 Processor -- start 2023-11-27T20:45:48.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.525+0000 7fdda6c9b640 1 -- start start 2023-11-27T20:45:48.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.527+0000 7fdda6c9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda0157c50 0x7fdda006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.527+0000 7fdda6c9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdda0158030 0x7fdda01584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.527+0000 7fdda6c9b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda006aa40 con 0x7fdda0073a00 2023-11-27T20:45:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.527+0000 7fdda6c9b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda00c00d0 con 0x7fdda0158030 2023-11-27T20:45:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.527+0000 7fdda6c9b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c1e00 con 0x7fdda0157c50 2023-11-27T20:45:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.527+0000 7fdd9ffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fdda0073a00 0x7fdda00c0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:52948/0 (socket says 172.21.15.91:52948) 2023-11-27T20:45:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.527+0000 7fdd9ffff640 1 -- 172.21.15.91:0/2879944172 learned_addr learned my addr 172.21.15.91:0/2879944172 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:48.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdda5238640 1 --2- 172.21.15.91:0/2879944172 >> v2:172.21.15.183:3300/0 conn(0x7fdda0158030 0x7fdda01584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdda4a37640 1 --2- 172.21.15.91:0/2879944172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda0157c50 0x7fdda006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259993550 0 0) 0x7fdda006aa40 con 0x7fdda0073a00 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd8c003520 con 0x7fdda0073a00 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1969513240 0 0) 0x7fdd8c003520 con 0x7fdda0073a00 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda0157c50 msgr2=0x7fdda006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 --2- 172.21.15.91:0/2879944172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda0157c50 0x7fdda006a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 >> v2:172.21.15.183:3300/0 conn(0x7fdda0158030 msgr2=0x7fdda01584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 --2- 172.21.15.91:0/2879944172 >> v2:172.21.15.183:3300/0 conn(0x7fdda0158030 0x7fdda01584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00bfa80 con 0x7fdda0073a00 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fdd88001670 con 0x7fdda0073a00 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 >> v1:172.21.15.91:6789/0 conn(0x7fdda0073a00 legacy=0x7fdda00c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 --2- 172.21.15.91:0/2879944172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd8c003970 0x7fdd8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 --2- 172.21.15.91:0/2879944172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda0157c50 0x7fdd8c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 --2- 172.21.15.91:0/2879944172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd8c004d00 0x7fdd8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c00d0 con 0x7fdd8c003970 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c1e00 con 0x7fdd8c004d00 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c00ba30 con 0x7fdda0157c50 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdda5238640 1 --2- 172.21.15.91:0/2879944172 >> v2:172.21.15.183:3300/0 conn(0x7fdda0158030 0x7fdda01584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.528+0000 7fdda4a37640 1 --2- 172.21.15.91:0/2879944172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd8c003970 0x7fdd8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.529+0000 7fdda4a37640 1 -- 172.21.15.91:0/2879944172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda0157c50 msgr2=0x7fdd8c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.529+0000 7fdda4a37640 1 --2- 172.21.15.91:0/2879944172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda0157c50 0x7fdd8c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.529+0000 7fdda4a37640 1 -- 172.21.15.91:0/2879944172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd8c004d00 msgr2=0x7fdd8c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.529+0000 7fdda4a37640 1 --2- 172.21.15.91:0/2879944172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd8c004d00 0x7fdd8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.529+0000 7fdda4a37640 1 -- 172.21.15.91:0/2879944172 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c003520 con 0x7fdd8c003970 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.530+0000 7fdda4a37640 1 --2- 172.21.15.91:0/2879944172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd8c003970 0x7fdd8c003d90 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000ba60 tx=0x7fdd8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fec1618099790f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.530+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90032680 con 0x7fdd8c003970 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.530+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd900327e0 con 0x7fdd8c003970 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.530+0000 7fdd9f7fe640 1 -- 172.21.15.91:0/2879944172 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90032b70 con 0x7fdd8c003970 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.531+0000 7fdda6c9b640 1 -- 172.21.15.91:0/2879944172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd8c003970 msgr2=0x7fdd8c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.531+0000 7fdda6c9b640 1 --2- 172.21.15.91:0/2879944172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd8c003970 0x7fdd8c003d90 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000ba60 tx=0x7fdd8c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.531+0000 7fdda5238640 1 -- 172.21.15.91:0/2879944172 reap_dead start 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.531+0000 7fdda6c9b640 1 -- 172.21.15.91:0/2879944172 shutdown_connections 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.531+0000 7fdda6c9b640 1 -- 172.21.15.91:0/2879944172 >> 172.21.15.91:0/2879944172 conn(0x7fdda00c30b0 msgr2=0x7fdda00c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.531+0000 7fdda6c9b640 1 -- 172.21.15.91:0/2879944172 shutdown_connections 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.531+0000 7fdda6c9b640 1 -- 172.21.15.91:0/2879944172 wait complete. 2023-11-27T20:45:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.533+0000 7fdda6c9b640 1 Processor -- start 2023-11-27T20:45:48.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.533+0000 7fdda6c9b640 1 -- start start 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdda6c9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd8c003970 0x7fdda014f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdda6c9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdda01ead40 0x7fdda013fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdda6c9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda014a110 0x7fdda01403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdda6c9b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda0152d00 con 0x7fdda01ead40 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdda6c9b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda01eb240 con 0x7fdda014a110 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdda6c9b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00aad00 con 0x7fdd8c003970 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdda01ead40 0x7fdda013fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdda01ead40 0x7fdda013fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:33996/0 (socket says 172.21.15.91:33996) 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdd9ffff640 1 -- 172.21.15.91:0/4220550343 learned_addr learned my addr 172.21.15.91:0/4220550343 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdda4a37640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd8c003970 0x7fdda014f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdda5238640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda014a110 0x7fdda01403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdd9ffff640 1 -- 172.21.15.91:0/4220550343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd8c003970 msgr2=0x7fdda014f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdd9ffff640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd8c003970 0x7fdda014f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdd9ffff640 1 -- 172.21.15.91:0/4220550343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda014a110 msgr2=0x7fdda01403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdd9ffff640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda014a110 0x7fdda01403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.534+0000 7fdd9ffff640 1 -- 172.21.15.91:0/4220550343 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00aa3d0 con 0x7fdda01ead40 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.535+0000 7fdda5238640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda014a110 0x7fdda01403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.535+0000 7fdd9ffff640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdda01ead40 0x7fdda013fe80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800c730 tx=0x7fdd8800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.535+0000 7fdd9d7fa640 1 -- 172.21.15.91:0/4220550343 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd880074e0 con 0x7fdda01ead40 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.535+0000 7fdd9d7fa640 1 -- 172.21.15.91:0/4220550343 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd88007640 con 0x7fdda01ead40 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.535+0000 7fdd9d7fa640 1 -- 172.21.15.91:0/4220550343 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88004a20 con 0x7fdda01ead40 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.535+0000 7fdda6c9b640 1 -- 172.21.15.91:0/4220550343 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda00aa6b0 con 0x7fdda01ead40 2023-11-27T20:45:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.535+0000 7fdda6c9b640 1 -- 172.21.15.91:0/4220550343 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda014fd30 con 0x7fdda01ead40 2023-11-27T20:45:48.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.536+0000 7fdda6c9b640 1 -- 172.21.15.91:0/4220550343 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda0066b40 con 0x7fdda01ead40 2023-11-27T20:45:48.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.537+0000 7fdd9d7fa640 1 -- 172.21.15.91:0/4220550343 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdd88004b80 con 0x7fdda01ead40 2023-11-27T20:45:48.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.538+0000 7fdd9d7fa640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdd8006b1f0 0x7fdd8006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:48.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.538+0000 7fdd9d7fa640 1 -- 172.21.15.91:0/4220550343 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fdd88089070 con 0x7fdda01ead40 2023-11-27T20:45:48.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.538+0000 7fdda4a37640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdd8006b1f0 0x7fdd8006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:48.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.539+0000 7fdda4a37640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdd8006b1f0 0x7fdd8006d6b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000ba30 tx=0x7fdd9003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:48.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.542+0000 7fdd9d7fa640 1 -- 172.21.15.91:0/4220550343 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdd88053aa0 con 0x7fdda01ead40 2023-11-27T20:45:48.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.748+0000 7fdda6c9b640 1 -- 172.21.15.91:0/4220550343 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdda00aae70 con 0x7fdda01ead40 2023-11-27T20:45:48.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.749+0000 7fdd9d7fa640 1 -- 172.21.15.91:0/4220550343 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdd88018080 con 0x7fdda01ead40 2023-11-27T20:45:48.749 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:45:48.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 -- 172.21.15.91:0/4220550343 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdd8006b1f0 msgr2=0x7fdd8006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdd8006b1f0 0x7fdd8006d6b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000ba30 tx=0x7fdd9003d040 comp rx=0 tx=0).stop 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 -- 172.21.15.91:0/4220550343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdda01ead40 msgr2=0x7fdda013fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdda01ead40 0x7fdda013fe80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800c730 tx=0x7fdd8800cbf0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 -- 172.21.15.91:0/4220550343 shutdown_connections 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdd8006b1f0 0x7fdd8006d6b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda014a110 0x7fdda01403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdda01ead40 0x7fdda013fe80 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 --2- 172.21.15.91:0/4220550343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd8c003970 0x7fdda014f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 -- 172.21.15.91:0/4220550343 >> 172.21.15.91:0/4220550343 conn(0x7fdda00c30b0 msgr2=0x7fdda00c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 -- 172.21.15.91:0/4220550343 shutdown_connections 2023-11-27T20:45:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:48.752+0000 7fdda6c9b640 1 -- 172.21.15.91:0/4220550343 wait complete. 2023-11-27T20:45:48.770 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-11-27T20:45:48.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:48.771 DEBUG:teuthology.orchestra.run.smithi091:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-27T20:45:48.872 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:45:48.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:48.872 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-27T20:45:48.919 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:48.919 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:48.979 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:48.979 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:49.032 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:49.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.250+0000 7f925a121640 1 Processor -- start 2023-11-27T20:45:49.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.250+0000 7f925a121640 1 -- start start 2023-11-27T20:45:49.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.251+0000 7f925a121640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f925414e7f0 0x7f92540c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.251+0000 7f925a121640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f925406cd20 0x7f925415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.251+0000 7f925a121640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92540a8380 con 0x7f92540c52e0 2023-11-27T20:45:49.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.251+0000 7f925a121640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92541510b0 con 0x7f925414e7f0 2023-11-27T20:45:49.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.251+0000 7f925a121640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925406bf60 con 0x7f925406cd20 2023-11-27T20:45:49.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.252+0000 7f925911f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f925414e7f0 0x7f92540c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.252+0000 7f925911f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f925414e7f0 0x7f92540c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34006/0 (socket says 172.21.15.91:34006) 2023-11-27T20:45:49.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.252+0000 7f925911f640 1 -- 172.21.15.91:0/575154881 learned_addr learned my addr 172.21.15.91:0/575154881 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:49.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.252+0000 7f9259920640 1 --2- 172.21.15.91:0/575154881 >> v2:172.21.15.183:3300/0 conn(0x7f925406cd20 0x7f925415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.253+0000 7f925911f640 1 -- 172.21.15.91:0/575154881 >> v2:172.21.15.183:3300/0 conn(0x7f925406cd20 msgr2=0x7f925415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:49.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.253+0000 7f925911f640 1 --2- 172.21.15.91:0/575154881 >> v2:172.21.15.183:3300/0 conn(0x7f925406cd20 0x7f925415ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.253+0000 7f925911f640 1 -- 172.21.15.91:0/575154881 >> v1:172.21.15.183:6789/0 conn(0x7f92540c52e0 legacy=0x7f925406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:49.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.253+0000 7f925911f640 1 -- 172.21.15.91:0/575154881 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925406c240 con 0x7f925414e7f0 2023-11-27T20:45:49.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.254+0000 7f925911f640 1 --2- 172.21.15.91:0/575154881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925414e7f0 0x7f92540c0440 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f92540c1f50 tx=0x7f925002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde410f1989c9285 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:49.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.254+0000 7f924bfff640 1 -- 172.21.15.91:0/575154881 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250031870 con 0x7f925414e7f0 2023-11-27T20:45:49.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.255+0000 7f924bfff640 1 -- 172.21.15.91:0/575154881 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92500319d0 con 0x7f925414e7f0 2023-11-27T20:45:49.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.255+0000 7f924bfff640 1 -- 172.21.15.91:0/575154881 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250031d60 con 0x7f925414e7f0 2023-11-27T20:45:49.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.255+0000 7f925a121640 1 -- 172.21.15.91:0/575154881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925414e7f0 msgr2=0x7f92540c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.255+0000 7f925a121640 1 --2- 172.21.15.91:0/575154881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925414e7f0 0x7f92540c0440 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f92540c1f50 tx=0x7f925002b910 comp rx=0 tx=0).stop 2023-11-27T20:45:49.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.255+0000 7f925a121640 1 -- 172.21.15.91:0/575154881 shutdown_connections 2023-11-27T20:45:49.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.255+0000 7f925a121640 1 --2- 172.21.15.91:0/575154881 >> v2:172.21.15.183:3300/0 conn(0x7f925406cd20 0x7f925415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.255+0000 7f925a121640 1 --2- 172.21.15.91:0/575154881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925414e7f0 0x7f92540c0440 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.255+0000 7f925a121640 1 -- 172.21.15.91:0/575154881 >> 172.21.15.91:0/575154881 conn(0x7f92540a77f0 msgr2=0x7f92540a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:49.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.255+0000 7f925a121640 1 -- 172.21.15.91:0/575154881 shutdown_connections 2023-11-27T20:45:49.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.255+0000 7f925a121640 1 -- 172.21.15.91:0/575154881 wait complete. 2023-11-27T20:45:49.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.257+0000 7f925a121640 1 Processor -- start 2023-11-27T20:45:49.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.258+0000 7f925a121640 1 -- start start 2023-11-27T20:45:49.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.258+0000 7f925a121640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925406cd20 0x7f92540721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.258+0000 7f925a121640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92540c52e0 0x7f9254145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925a121640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f925414e7f0 0x7f9254145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925a121640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9254150870 con 0x7f925406cd20 2023-11-27T20:45:49.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925a121640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925414d9b0 con 0x7f925414e7f0 2023-11-27T20:45:49.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925a121640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925414df70 con 0x7f92540c52e0 2023-11-27T20:45:49.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925911f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925406cd20 0x7f92540721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925911f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925406cd20 0x7f92540721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34018/0 (socket says 172.21.15.91:34018) 2023-11-27T20:45:49.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925911f640 1 -- 172.21.15.91:0/3466033830 learned_addr learned my addr 172.21.15.91:0/3466033830 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:49.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f9259920640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f925414e7f0 0x7f9254145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925911f640 1 -- 172.21.15.91:0/3466033830 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92540c52e0 msgr2=0x7f9254145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925911f640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92540c52e0 0x7f9254145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925911f640 1 -- 172.21.15.91:0/3466033830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f925414e7f0 msgr2=0x7f9254145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925911f640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f925414e7f0 0x7f9254145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.259+0000 7f925911f640 1 -- 172.21.15.91:0/3466033830 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92500094d0 con 0x7f925406cd20 2023-11-27T20:45:49.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.260+0000 7f925911f640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925406cd20 0x7f92540721e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f9250000c00 tx=0x7f92500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:49.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.260+0000 7f9249ffb640 1 -- 172.21.15.91:0/3466033830 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925003ad30 con 0x7f925406cd20 2023-11-27T20:45:49.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.260+0000 7f9249ffb640 1 -- 172.21.15.91:0/3466033830 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925003ae90 con 0x7f925406cd20 2023-11-27T20:45:49.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.260+0000 7f925a121640 1 -- 172.21.15.91:0/3466033830 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9254150590 con 0x7f925406cd20 2023-11-27T20:45:49.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.260+0000 7f9249ffb640 1 -- 172.21.15.91:0/3466033830 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250044630 con 0x7f925406cd20 2023-11-27T20:45:49.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.260+0000 7f925a121640 1 -- 172.21.15.91:0/3466033830 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925414dc00 con 0x7f925406cd20 2023-11-27T20:45:49.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.261+0000 7f925a121640 1 -- 172.21.15.91:0/3466033830 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925404e840 con 0x7f925406cd20 2023-11-27T20:45:49.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.262+0000 7f9249ffb640 1 -- 172.21.15.91:0/3466033830 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9250044790 con 0x7f925406cd20 2023-11-27T20:45:49.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.263+0000 7f9249ffb640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f923806b1f0 0x7f923806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.264+0000 7f9249ffb640 1 -- 172.21.15.91:0/3466033830 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f925002d040 con 0x7f925406cd20 2023-11-27T20:45:49.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.264+0000 7f925891e640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f923806b1f0 0x7f923806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.264+0000 7f925891e640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f923806b1f0 0x7f923806d6b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9244000f60 tx=0x7f92440079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:49.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.268+0000 7f9249ffb640 1 -- 172.21.15.91:0/3466033830 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9250076e20 con 0x7f925406cd20 2023-11-27T20:45:49.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.462+0000 7f925a121640 1 -- 172.21.15.91:0/3466033830 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92540abdd0 con 0x7f925406cd20 2023-11-27T20:45:49.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.466+0000 7f9249ffb640 1 -- 172.21.15.91:0/3466033830 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20276 (secure 0 0 0) 0x7f9250035090 con 0x7f925406cd20 2023-11-27T20:45:49.467 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:49.467 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":81,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:23.334850+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:49.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.468+0000 7f925a121640 1 -- 172.21.15.91:0/3466033830 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f923806b1f0 msgr2=0x7f923806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.468+0000 7f925a121640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f923806b1f0 0x7f923806d6b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9244000f60 tx=0x7f92440079b0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.468+0000 7f925a121640 1 -- 172.21.15.91:0/3466033830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925406cd20 msgr2=0x7f92540721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.468+0000 7f925a121640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925406cd20 0x7f92540721e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f9250000c00 tx=0x7f92500046c0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.469+0000 7f925a121640 1 -- 172.21.15.91:0/3466033830 shutdown_connections 2023-11-27T20:45:49.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.469+0000 7f925a121640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f923806b1f0 0x7f923806d6b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.469+0000 7f925a121640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f925414e7f0 0x7f9254145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.469+0000 7f925a121640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92540c52e0 0x7f9254145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.469+0000 7f925a121640 1 --2- 172.21.15.91:0/3466033830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f925406cd20 0x7f92540721e0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.469+0000 7f925a121640 1 -- 172.21.15.91:0/3466033830 >> 172.21.15.91:0/3466033830 conn(0x7f92540a77f0 msgr2=0x7f92540c1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:49.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.469+0000 7f925a121640 1 -- 172.21.15.91:0/3466033830 shutdown_connections 2023-11-27T20:45:49.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.469+0000 7f925a121640 1 -- 172.21.15.91:0/3466033830 wait complete. 2023-11-27T20:45:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:45:04.361620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:45:05.090674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:45:19.465319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:45:20.794821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:45:49.491 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:45:49.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.708+0000 7fea4cc4f640 1 Processor -- start 2023-11-27T20:45:49.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.708+0000 7fea4cc4f640 1 -- start start 2023-11-27T20:45:49.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.710+0000 7fea4cc4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea480a9b40 0x7fea480a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.710+0000 7fea4cc4f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fea480c1500 0x7fea480c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.710+0000 7fea4cc4f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea480c06c0 con 0x7fea48155490 2023-11-27T20:45:49.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.710+0000 7fea4cc4f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480a5820 con 0x7fea480c1500 2023-11-27T20:45:49.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.710+0000 7fea4cc4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea480c1020 con 0x7fea480a9b40 2023-11-27T20:45:49.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.710+0000 7fea4659c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fea48155490 0x7fea480a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:52952/0 (socket says 172.21.15.91:52952) 2023-11-27T20:45:49.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.710+0000 7fea4659c640 1 -- 172.21.15.91:0/2882918085 learned_addr learned my addr 172.21.15.91:0/2882918085 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:49.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.710+0000 7fea3ffff640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea480a9b40 0x7fea480a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.710+0000 7fea46d9d640 1 --2- 172.21.15.91:0/2882918085 >> v2:172.21.15.183:3300/0 conn(0x7fea480c1500 0x7fea480c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935517929 0 0) 0x7fea480c06c0 con 0x7fea48155490 2023-11-27T20:45:49.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea34005730 con 0x7fea48155490 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3882603242 0 0) 0x7fea34005730 con 0x7fea48155490 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea480a9b40 msgr2=0x7fea480a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea480a9b40 0x7fea480a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 >> v2:172.21.15.183:3300/0 conn(0x7fea480c1500 msgr2=0x7fea480c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 --2- 172.21.15.91:0/2882918085 >> v2:172.21.15.183:3300/0 conn(0x7fea480c1500 0x7fea480c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480c0910 con 0x7fea48155490 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fea38001670 con 0x7fea48155490 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 >> v1:172.21.15.91:6789/0 conn(0x7fea48155490 legacy=0x7fea480a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea34005b80 0x7fea34005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea340069d0 0x7fea34006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea34007390 0x7fea3400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea480c1020 con 0x7fea340069d0 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea34006720 con 0x7fea34005b80 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3400e0d0 con 0x7fea34007390 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.711+0000 7fea3ffff640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea340069d0 0x7fea34006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.712+0000 7fea4659c640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea34005b80 0x7fea34005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.712+0000 7fea46d9d640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea34007390 0x7fea3400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.712+0000 7fea3ffff640 1 -- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea34007390 msgr2=0x7fea3400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.712+0000 7fea3ffff640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea34007390 0x7fea3400db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.712+0000 7fea3ffff640 1 -- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea34005b80 msgr2=0x7fea34005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.712+0000 7fea3ffff640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea34005b80 0x7fea34005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.712+0000 7fea3ffff640 1 -- 172.21.15.91:0/2882918085 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea34005730 con 0x7fea340069d0 2023-11-27T20:45:49.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.712+0000 7fea4659c640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea34005b80 0x7fea34005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:49.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.713+0000 7fea3ffff640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea340069d0 0x7fea34006e50 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fea30009ac0 tx=0x7fea34007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28aec1012f82723 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:49.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.713+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3002c6b0 con 0x7fea340069d0 2023-11-27T20:45:49.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.713+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3002c810 con 0x7fea340069d0 2023-11-27T20:45:49.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.713+0000 7fea45d9b640 1 -- 172.21.15.91:0/2882918085 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3002cba0 con 0x7fea340069d0 2023-11-27T20:45:49.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.714+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2882918085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea340069d0 msgr2=0x7fea34006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.714+0000 7fea4cc4f640 1 --2- 172.21.15.91:0/2882918085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea340069d0 0x7fea34006e50 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fea30009ac0 tx=0x7fea34007a00 comp rx=0 tx=0).stop 2023-11-27T20:45:49.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.714+0000 7fea46d9d640 1 -- 172.21.15.91:0/2882918085 reap_dead start 2023-11-27T20:45:49.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.714+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2882918085 shutdown_connections 2023-11-27T20:45:49.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.714+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2882918085 >> 172.21.15.91:0/2882918085 conn(0x7fea4806a500 msgr2=0x7fea4806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:49.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.714+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2882918085 shutdown_connections 2023-11-27T20:45:49.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.714+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2882918085 wait complete. 2023-11-27T20:45:49.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.716+0000 7fea4cc4f640 1 Processor -- start 2023-11-27T20:45:49.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.716+0000 7fea4cc4f640 1 -- start start 2023-11-27T20:45:49.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.717+0000 7fea4cc4f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea340069d0 0x7fea480a7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.717+0000 7fea4cc4f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea480a6d30 0x7fea481523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.717+0000 7fea4cc4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea4814ff80 0x7fea48150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.717+0000 7fea4cc4f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4809a8d0 con 0x7fea480a6d30 2023-11-27T20:45:49.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.717+0000 7fea4cc4f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea480aafb0 con 0x7fea340069d0 2023-11-27T20:45:49.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.717+0000 7fea4cc4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea48150940 con 0x7fea4814ff80 2023-11-27T20:45:49.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.717+0000 7fea3ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea480a6d30 0x7fea481523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.717+0000 7fea3ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea480a6d30 0x7fea481523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34036/0 (socket says 172.21.15.91:34036) 2023-11-27T20:45:49.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.717+0000 7fea3ffff640 1 -- 172.21.15.91:0/2601670483 learned_addr learned my addr 172.21.15.91:0/2601670483 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:49.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea3ffff640 1 -- 172.21.15.91:0/2601670483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea4814ff80 msgr2=0x7fea48150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea46d9d640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea4814ff80 0x7fea48150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea4659c640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea340069d0 0x7fea480a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea3ffff640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea4814ff80 0x7fea48150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea3ffff640 1 -- 172.21.15.91:0/2601670483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea340069d0 msgr2=0x7fea480a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea3ffff640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea340069d0 0x7fea480a7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea3ffff640 1 -- 172.21.15.91:0/2601670483 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480bd730 con 0x7fea480a6d30 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea3ffff640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea480a6d30 0x7fea481523b0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fea30037040 tx=0x7fea30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea3effd640 1 -- 172.21.15.91:0/2601670483 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30003810 con 0x7fea480a6d30 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea3effd640 1 -- 172.21.15.91:0/2601670483 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea30003970 con 0x7fea480a6d30 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea3effd640 1 -- 172.21.15.91:0/2601670483 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30003d00 con 0x7fea480a6d30 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2601670483 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea480bd980 con 0x7fea480a6d30 2023-11-27T20:45:49.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.718+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2601670483 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea480bdf40 con 0x7fea480a6d30 2023-11-27T20:45:49.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.719+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2601670483 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea48068350 con 0x7fea480a6d30 2023-11-27T20:45:49.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.720+0000 7fea3effd640 1 -- 172.21.15.91:0/2601670483 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fea30047450 con 0x7fea480a6d30 2023-11-27T20:45:49.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.721+0000 7fea3effd640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea2806b1c0 0x7fea2806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:49.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.721+0000 7fea3effd640 1 -- 172.21.15.91:0/2601670483 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fea300abfc0 con 0x7fea480a6d30 2023-11-27T20:45:49.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.722+0000 7fea4659c640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea2806b1c0 0x7fea2806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:49.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.722+0000 7fea4659c640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea2806b1c0 0x7fea2806d680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fea38001200 tx=0x7fea38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:49.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.728+0000 7fea3effd640 1 -- 172.21.15.91:0/2601670483 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fea30076a00 con 0x7fea480a6d30 2023-11-27T20:45:49.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.915+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2601670483 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea480675d0 con 0x7fea480a6d30 2023-11-27T20:45:49.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.916+0000 7fea3effd640 1 -- 172.21.15.91:0/2601670483 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea30003e60 con 0x7fea480a6d30 2023-11-27T20:45:49.917 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:45:49.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.918+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2601670483 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea2806b1c0 msgr2=0x7fea2806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.918+0000 7fea4cc4f640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea2806b1c0 0x7fea2806d680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fea38001200 tx=0x7fea38009040 comp rx=0 tx=0).stop 2023-11-27T20:45:49.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.918+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2601670483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea480a6d30 msgr2=0x7fea481523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:49.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.918+0000 7fea4cc4f640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea480a6d30 0x7fea481523b0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fea30037040 tx=0x7fea30004730 comp rx=0 tx=0).stop 2023-11-27T20:45:49.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.919+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2601670483 shutdown_connections 2023-11-27T20:45:49.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.919+0000 7fea4cc4f640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea4814ff80 0x7fea48150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.919+0000 7fea4cc4f640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea480a6d30 0x7fea481523b0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.919+0000 7fea4cc4f640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fea2806b1c0 0x7fea2806d680 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.919+0000 7fea4cc4f640 1 --2- 172.21.15.91:0/2601670483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea340069d0 0x7fea480a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:49.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.919+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2601670483 >> 172.21.15.91:0/2601670483 conn(0x7fea4806a500 msgr2=0x7fea4806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:49.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.919+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2601670483 shutdown_connections 2023-11-27T20:45:49.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:49.919+0000 7fea4cc4f640 1 -- 172.21.15.91:0/2601670483 wait complete. 2023-11-27T20:45:49.938 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:45:50.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.154+0000 7f9bbc35a640 1 Processor -- start 2023-11-27T20:45:50.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.155+0000 7f9bbc35a640 1 -- start start 2023-11-27T20:45:50.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.156+0000 7f9bbc35a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 0x7f9bb4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.156+0000 7f9bbc35a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9bb40c3ea0 0x7f9bb40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.156+0000 7f9bbc35a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40c64a0 con 0x7f9bb414fd30 2023-11-27T20:45:50.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.156+0000 7f9bbc35a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb40c5c00 con 0x7f9bb40c3ea0 2023-11-27T20:45:50.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.156+0000 7f9bbc35a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40c5ee0 con 0x7f9bb406d0a0 2023-11-27T20:45:50.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.157+0000 7f9bb98f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 0x7f9bb4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.157+0000 7f9bb98f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 0x7f9bb4152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59220/0 (socket says 172.21.15.91:59220) 2023-11-27T20:45:50.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.157+0000 7f9bb98f5640 1 -- 172.21.15.91:0/3640294329 learned_addr learned my addr 172.21.15.91:0/3640294329 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:50.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.157+0000 7f9bba8f7640 1 --2- 172.21.15.91:0/3640294329 >> v2:172.21.15.183:3300/0 conn(0x7f9bb40c3ea0 0x7f9bb40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.158+0000 7f9bb98f5640 1 -- 172.21.15.91:0/3640294329 >> v2:172.21.15.183:3300/0 conn(0x7f9bb40c3ea0 msgr2=0x7f9bb40c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:50.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.158+0000 7f9bb98f5640 1 --2- 172.21.15.91:0/3640294329 >> v2:172.21.15.183:3300/0 conn(0x7f9bb40c3ea0 0x7f9bb40c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.158+0000 7f9bb98f5640 1 -- 172.21.15.91:0/3640294329 >> v1:172.21.15.183:6789/0 conn(0x7f9bb414fd30 legacy=0x7f9bb40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.158+0000 7f9bb98f5640 1 -- 172.21.15.91:0/3640294329 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40c61c0 con 0x7f9bb406d0a0 2023-11-27T20:45:50.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.159+0000 7f9bb98f5640 1 --2- 172.21.15.91:0/3640294329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 0x7f9bb4152f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009870 tx=0x7f9ba802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dba83e10966815b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:50.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.160+0000 7f9bb90f4640 1 -- 172.21.15.91:0/3640294329 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8030840 con 0x7f9bb406d0a0 2023-11-27T20:45:50.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.160+0000 7f9bb90f4640 1 -- 172.21.15.91:0/3640294329 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba80309a0 con 0x7f9bb406d0a0 2023-11-27T20:45:50.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.160+0000 7f9bb90f4640 1 -- 172.21.15.91:0/3640294329 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8030d30 con 0x7f9bb406d0a0 2023-11-27T20:45:50.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.160+0000 7f9bbc35a640 1 -- 172.21.15.91:0/3640294329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 msgr2=0x7f9bb4152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.160+0000 7f9bbc35a640 1 --2- 172.21.15.91:0/3640294329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 0x7f9bb4152f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009870 tx=0x7f9ba802b980 comp rx=0 tx=0).stop 2023-11-27T20:45:50.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.160+0000 7f9bbc35a640 1 -- 172.21.15.91:0/3640294329 shutdown_connections 2023-11-27T20:45:50.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.160+0000 7f9bbc35a640 1 --2- 172.21.15.91:0/3640294329 >> v2:172.21.15.183:3300/0 conn(0x7f9bb40c3ea0 0x7f9bb40c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.160+0000 7f9bbc35a640 1 --2- 172.21.15.91:0/3640294329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 0x7f9bb4152f20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.160+0000 7f9bbc35a640 1 -- 172.21.15.91:0/3640294329 >> 172.21.15.91:0/3640294329 conn(0x7f9bb406a500 msgr2=0x7f9bb406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:50.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.160+0000 7f9bbc35a640 1 -- 172.21.15.91:0/3640294329 shutdown_connections 2023-11-27T20:45:50.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.161+0000 7f9bbc35a640 1 -- 172.21.15.91:0/3640294329 wait complete. 2023-11-27T20:45:50.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.162+0000 7f9bbc35a640 1 Processor -- start 2023-11-27T20:45:50.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.162+0000 7f9bbc35a640 1 -- start start 2023-11-27T20:45:50.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.163+0000 7f9bbc35a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 0x7f9bb40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.163+0000 7f9bbc35a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb40c3ea0 0x7f9bb40a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.163+0000 7f9bbc35a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bb414fd30 0x7f9bb40a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.163+0000 7f9bbc35a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4070740 con 0x7f9bb414fd30 2023-11-27T20:45:50.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.163+0000 7f9bbc35a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb414c020 con 0x7f9bb40c3ea0 2023-11-27T20:45:50.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.163+0000 7f9bbc35a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41519f0 con 0x7f9bb406d0a0 2023-11-27T20:45:50.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.163+0000 7f9bba8f7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bb414fd30 0x7f9bb40a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.164+0000 7f9bba8f7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bb414fd30 0x7f9bb40a90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34038/0 (socket says 172.21.15.91:34038) 2023-11-27T20:45:50.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.164+0000 7f9bba8f7640 1 -- 172.21.15.91:0/31605505 learned_addr learned my addr 172.21.15.91:0/31605505 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.164+0000 7f9bba0f6640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 0x7f9bb40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.164+0000 7f9bb98f5640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb40c3ea0 0x7f9bb40a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.164+0000 7f9bba8f7640 1 -- 172.21.15.91:0/31605505 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 msgr2=0x7f9bb40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.164+0000 7f9bba8f7640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 0x7f9bb40a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.164+0000 7f9bba8f7640 1 -- 172.21.15.91:0/31605505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb40c3ea0 msgr2=0x7f9bb40a8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.164+0000 7f9bba8f7640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb40c3ea0 0x7f9bb40a8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.164+0000 7f9bba8f7640 1 -- 172.21.15.91:0/31605505 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba80094d0 con 0x7f9bb414fd30 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.164+0000 7f9bba8f7640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bb414fd30 0x7f9bb40a90a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00efc0 tx=0x7f9bac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.165+0000 7f9ba6ffd640 1 -- 172.21.15.91:0/31605505 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac014480 con 0x7f9bb414fd30 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.165+0000 7f9ba6ffd640 1 -- 172.21.15.91:0/31605505 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00f040 con 0x7f9bb414fd30 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.165+0000 7f9ba6ffd640 1 -- 172.21.15.91:0/31605505 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac014820 con 0x7f9bb414fd30 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.165+0000 7f9bbc35a640 1 -- 172.21.15.91:0/31605505 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb4151cd0 con 0x7f9bb414fd30 2023-11-27T20:45:50.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.165+0000 7f9bbc35a640 1 -- 172.21.15.91:0/31605505 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb4152290 con 0x7f9bb414fd30 2023-11-27T20:45:50.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.166+0000 7f9bbc35a640 1 -- 172.21.15.91:0/31605505 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb40708b0 con 0x7f9bb414fd30 2023-11-27T20:45:50.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.167+0000 7f9ba6ffd640 1 -- 172.21.15.91:0/31605505 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9bac014980 con 0x7f9bb414fd30 2023-11-27T20:45:50.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.168+0000 7f9ba6ffd640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9b9806b1c0 0x7f9b9806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.168+0000 7f9ba6ffd640 1 -- 172.21.15.91:0/31605505 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f9bac08a990 con 0x7f9bb414fd30 2023-11-27T20:45:50.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.168+0000 7f9bba0f6640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9b9806b1c0 0x7f9b9806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.169+0000 7f9bba0f6640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9b9806b1c0 0x7f9b9806d680 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000f60 tx=0x7f9bb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:50.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.172+0000 7f9ba6ffd640 1 -- 172.21.15.91:0/31605505 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9bb40708b0 con 0x7f9bb414fd30 2023-11-27T20:45:50.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.358+0000 7f9bbc35a640 1 -- 172.21.15.91:0/31605505 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9bb4070880 con 0x7f9bb414fd30 2023-11-27T20:45:50.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.359+0000 7f9ba6ffd640 1 -- 172.21.15.91:0/31605505 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9bac055320 con 0x7f9bb414fd30 2023-11-27T20:45:50.359 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:50.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.361+0000 7f9bbc35a640 1 -- 172.21.15.91:0/31605505 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9b9806b1c0 msgr2=0x7f9b9806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.361+0000 7f9bbc35a640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9b9806b1c0 0x7f9b9806d680 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000f60 tx=0x7f9bb0009040 comp rx=0 tx=0).stop 2023-11-27T20:45:50.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.361+0000 7f9bbc35a640 1 -- 172.21.15.91:0/31605505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bb414fd30 msgr2=0x7f9bb40a90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.361+0000 7f9bbc35a640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bb414fd30 0x7f9bb40a90a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00efc0 tx=0x7f9bac00c490 comp rx=0 tx=0).stop 2023-11-27T20:45:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.361+0000 7f9bbc35a640 1 -- 172.21.15.91:0/31605505 shutdown_connections 2023-11-27T20:45:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.361+0000 7f9bbc35a640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bb414fd30 0x7f9bb40a90a0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.361+0000 7f9bbc35a640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f9b9806b1c0 0x7f9b9806d680 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.361+0000 7f9bbc35a640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb40c3ea0 0x7f9bb40a8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.361+0000 7f9bbc35a640 1 --2- 172.21.15.91:0/31605505 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bb406d0a0 0x7f9bb40a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.361+0000 7f9bbc35a640 1 -- 172.21.15.91:0/31605505 >> 172.21.15.91:0/31605505 conn(0x7f9bb406a500 msgr2=0x7f9bb40c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.362+0000 7f9bbc35a640 1 -- 172.21.15.91:0/31605505 shutdown_connections 2023-11-27T20:45:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.362+0000 7f9bbc35a640 1 -- 172.21.15.91:0/31605505 wait complete. 2023-11-27T20:45:50.380 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:45:50.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.587+0000 7fbed2e64640 1 Processor -- start 2023-11-27T20:45:50.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.587+0000 7fbed2e64640 1 -- start start 2023-11-27T20:45:50.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.589+0000 7fbed2e64640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc152f20 0x7fbecc0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.589+0000 7fbed2e64640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc0c64a0 con 0x7fbecc06d0a0 2023-11-27T20:45:50.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.589+0000 7fbed2e64640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc0c5c00 con 0x7fbecc14fd30 2023-11-27T20:45:50.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.589+0000 7fbed2e64640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0c5ee0 con 0x7fbecc152f20 2023-11-27T20:45:50.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.589+0000 7fbecbfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fbecc06d0a0 0x7fbecc0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:52968/0 (socket says 172.21.15.91:52968) 2023-11-27T20:45:50.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.589+0000 7fbecbfff640 1 -- 172.21.15.91:0/528292797 learned_addr learned my addr 172.21.15.91:0/528292797 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:50.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.589+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292258919 0 0) 0x7fbecc0c64a0 con 0x7fbecc06d0a0 2023-11-27T20:45:50.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.589+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbebc003520 con 0x7fbecc06d0a0 2023-11-27T20:45:50.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.589+0000 7fbed1401640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc152f20 0x7fbecc0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 789812849 0 0) 0x7fbebc003520 con 0x7fbecc06d0a0 2023-11-27T20:45:50.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc152f20 msgr2=0x7fbecc0c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:50.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc152f20 0x7fbecc0c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 >> v1:172.21.15.183:6789/0 conn(0x7fbecc14fd30 legacy=0x7fbecc0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0c61c0 con 0x7fbecc06d0a0 2023-11-27T20:45:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fbeb8001670 con 0x7fbecc06d0a0 2023-11-27T20:45:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 >> v1:172.21.15.91:6789/0 conn(0x7fbecc06d0a0 legacy=0x7fbecc0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbebc0039a0 0x7fbebc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbebc0047c0 0x7fbebc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc152f20 0x7fbebc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0c5ee0 con 0x7fbebc0039a0 2023-11-27T20:45:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc00bae0 con 0x7fbebc0047c0 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc00bca0 con 0x7fbecc152f20 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.590+0000 7fbed0c00640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbebc0039a0 0x7fbebc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.591+0000 7fbecbfff640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbebc0047c0 0x7fbebc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.591+0000 7fbed0c00640 1 -- 172.21.15.91:0/528292797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc152f20 msgr2=0x7fbebc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.591+0000 7fbed0c00640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc152f20 0x7fbebc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.591+0000 7fbed0c00640 1 -- 172.21.15.91:0/528292797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbebc0047c0 msgr2=0x7fbebc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.591+0000 7fbed0c00640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbebc0047c0 0x7fbebc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.591+0000 7fbed0c00640 1 -- 172.21.15.91:0/528292797 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc003520 con 0x7fbebc0039a0 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.592+0000 7fbed0c00640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbebc0039a0 0x7fbebc003dc0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fbec0001750 tx=0x7fbebc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7084d77c80ad3e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.592+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00052d0 con 0x7fbebc0039a0 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.592+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec002e050 con 0x7fbebc0039a0 2023-11-27T20:45:50.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.592+0000 7fbecb7fe640 1 -- 172.21.15.91:0/528292797 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00035f0 con 0x7fbebc0039a0 2023-11-27T20:45:50.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.593+0000 7fbed2e64640 1 -- 172.21.15.91:0/528292797 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbebc0039a0 msgr2=0x7fbebc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.593+0000 7fbed2e64640 1 --2- 172.21.15.91:0/528292797 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbebc0039a0 0x7fbebc003dc0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fbec0001750 tx=0x7fbebc0057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.593+0000 7fbed1401640 1 -- 172.21.15.91:0/528292797 reap_dead start 2023-11-27T20:45:50.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.593+0000 7fbed2e64640 1 -- 172.21.15.91:0/528292797 shutdown_connections 2023-11-27T20:45:50.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.593+0000 7fbed2e64640 1 -- 172.21.15.91:0/528292797 >> 172.21.15.91:0/528292797 conn(0x7fbecc06a500 msgr2=0x7fbecc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:50.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.593+0000 7fbed2e64640 1 -- 172.21.15.91:0/528292797 shutdown_connections 2023-11-27T20:45:50.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.593+0000 7fbed2e64640 1 -- 172.21.15.91:0/528292797 wait complete. 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.595+0000 7fbed2e64640 1 Processor -- start 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.595+0000 7fbed2e64640 1 -- start start 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.595+0000 7fbed2e64640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbebc0039a0 0x7fbecc0aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbed2e64640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbecc14f300 0x7fbecc1dbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbed2e64640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc14e770 0x7fbecc14ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbed2e64640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc14f130 con 0x7fbecc14f300 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbed2e64640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1ea0b0 con 0x7fbebc0039a0 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbed2e64640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1ea390 con 0x7fbecc14e770 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbecbfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbecc14f300 0x7fbecc1dbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbecbfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbecc14f300 0x7fbecc1dbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34056/0 (socket says 172.21.15.91:34056) 2023-11-27T20:45:50.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbecbfff640 1 -- 172.21.15.91:0/3391498684 learned_addr learned my addr 172.21.15.91:0/3391498684 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbecbfff640 1 -- 172.21.15.91:0/3391498684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc14e770 msgr2=0x7fbecc14ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbed1401640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc14e770 0x7fbecc14ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbecbfff640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc14e770 0x7fbecc14ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbecbfff640 1 -- 172.21.15.91:0/3391498684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbebc0039a0 msgr2=0x7fbecc0aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbecbfff640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbebc0039a0 0x7fbecc0aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.596+0000 7fbecbfff640 1 -- 172.21.15.91:0/3391498684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc1ea670 con 0x7fbecc14f300 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.597+0000 7fbecbfff640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbecc14f300 0x7fbecc1dbd40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800d7e0 tx=0x7fbeb800dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.597+0000 7fbec97fa640 1 -- 172.21.15.91:0/3391498684 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80074e0 con 0x7fbecc14f300 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.597+0000 7fbec97fa640 1 -- 172.21.15.91:0/3391498684 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb8007640 con 0x7fbecc14f300 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.597+0000 7fbed2e64640 1 -- 172.21.15.91:0/3391498684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc1ea950 con 0x7fbecc14f300 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.597+0000 7fbec97fa640 1 -- 172.21.15.91:0/3391498684 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80049e0 con 0x7fbecc14f300 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.597+0000 7fbed2e64640 1 -- 172.21.15.91:0/3391498684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc1dc280 con 0x7fbecc14f300 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.598+0000 7fbed2e64640 1 -- 172.21.15.91:0/3391498684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc068350 con 0x7fbecc14f300 2023-11-27T20:45:50.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.599+0000 7fbec97fa640 1 -- 172.21.15.91:0/3391498684 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbeb8004b40 con 0x7fbecc14f300 2023-11-27T20:45:50.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.600+0000 7fbec97fa640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbeb006b1c0 0x7fbeb006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:50.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.600+0000 7fbec97fa640 1 -- 172.21.15.91:0/3391498684 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fbeb8089a70 con 0x7fbecc14f300 2023-11-27T20:45:50.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.600+0000 7fbed0c00640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbeb006b1c0 0x7fbeb006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:50.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.601+0000 7fbed0c00640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbeb006b1c0 0x7fbeb006d680 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbec0033000 tx=0x7fbec002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:50.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.605+0000 7fbec97fa640 1 -- 172.21.15.91:0/3391498684 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbeb8054400 con 0x7fbecc14f300 2023-11-27T20:45:50.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.792+0000 7fbed2e64640 1 -- 172.21.15.91:0/3391498684 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbecc1ea4d0 con 0x7fbecc14f300 2023-11-27T20:45:50.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.793+0000 7fbec97fa640 1 -- 172.21.15.91:0/3391498684 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbeb8019020 con 0x7fbecc14f300 2023-11-27T20:45:50.794 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:50.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.795+0000 7fbed2e64640 1 -- 172.21.15.91:0/3391498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbeb006b1c0 msgr2=0x7fbeb006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.795+0000 7fbed2e64640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbeb006b1c0 0x7fbeb006d680 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbec0033000 tx=0x7fbec002f000 comp rx=0 tx=0).stop 2023-11-27T20:45:50.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.796+0000 7fbed2e64640 1 -- 172.21.15.91:0/3391498684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbecc14f300 msgr2=0x7fbecc1dbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:50.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.796+0000 7fbed2e64640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbecc14f300 0x7fbecc1dbd40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800d7e0 tx=0x7fbeb800dca0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.796+0000 7fbed2e64640 1 -- 172.21.15.91:0/3391498684 shutdown_connections 2023-11-27T20:45:50.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.796+0000 7fbed2e64640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbecc14e770 0x7fbecc14ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.796+0000 7fbed2e64640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbecc14f300 0x7fbecc1dbd40 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.796+0000 7fbed2e64640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fbeb006b1c0 0x7fbeb006d680 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.796+0000 7fbed2e64640 1 --2- 172.21.15.91:0/3391498684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbebc0039a0 0x7fbecc0aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:50.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.796+0000 7fbed2e64640 1 -- 172.21.15.91:0/3391498684 >> 172.21.15.91:0/3391498684 conn(0x7fbecc06a500 msgr2=0x7fbecc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:50.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.796+0000 7fbed2e64640 1 -- 172.21.15.91:0/3391498684 shutdown_connections 2023-11-27T20:45:50.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:50.796+0000 7fbed2e64640 1 -- 172.21.15.91:0/3391498684 wait complete. 2023-11-27T20:45:50.814 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:45:51.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.015+0000 7f3e86525640 1 Processor -- start 2023-11-27T20:45:51.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.015+0000 7f3e86525640 1 -- start start 2023-11-27T20:45:51.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.017+0000 7f3e86525640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 0x7f3e80152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.017+0000 7f3e86525640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3e800c3ea0 0x7f3e800c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.017+0000 7f3e86525640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e800c64a0 con 0x7f3e8006d0a0 2023-11-27T20:45:51.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.017+0000 7f3e86525640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e800c5c00 con 0x7f3e800c3ea0 2023-11-27T20:45:51.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.017+0000 7f3e86525640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800c5ee0 con 0x7f3e8014fd30 2023-11-27T20:45:51.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.018+0000 7f3e7ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 0x7f3e80152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.018+0000 7f3e7ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 0x7f3e80152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59270/0 (socket says 172.21.15.91:59270) 2023-11-27T20:45:51.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.018+0000 7f3e7ffff640 1 -- 172.21.15.91:0/3118437235 learned_addr learned my addr 172.21.15.91:0/3118437235 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:51.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.018+0000 7f3e84ac2640 1 --2- 172.21.15.91:0/3118437235 >> v2:172.21.15.183:3300/0 conn(0x7f3e800c3ea0 0x7f3e800c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.018+0000 7f3e7ffff640 1 -- 172.21.15.91:0/3118437235 >> v2:172.21.15.183:3300/0 conn(0x7f3e800c3ea0 msgr2=0x7f3e800c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:51.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.018+0000 7f3e7ffff640 1 --2- 172.21.15.91:0/3118437235 >> v2:172.21.15.183:3300/0 conn(0x7f3e800c3ea0 0x7f3e800c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.018+0000 7f3e7ffff640 1 -- 172.21.15.91:0/3118437235 >> v1:172.21.15.183:6789/0 conn(0x7f3e8006d0a0 legacy=0x7f3e800a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.018+0000 7f3e7ffff640 1 -- 172.21.15.91:0/3118437235 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e800c61c0 con 0x7f3e8014fd30 2023-11-27T20:45:51.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.020+0000 7f3e7ffff640 1 --2- 172.21.15.91:0/3118437235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 0x7f3e80152f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009870 tx=0x7f3e7002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df17a21694ca14fa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:51.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.020+0000 7f3e7f7fe640 1 -- 172.21.15.91:0/3118437235 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70030840 con 0x7f3e8014fd30 2023-11-27T20:45:51.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.020+0000 7f3e7f7fe640 1 -- 172.21.15.91:0/3118437235 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e700309a0 con 0x7f3e8014fd30 2023-11-27T20:45:51.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.020+0000 7f3e7f7fe640 1 -- 172.21.15.91:0/3118437235 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70030d30 con 0x7f3e8014fd30 2023-11-27T20:45:51.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.021+0000 7f3e86525640 1 -- 172.21.15.91:0/3118437235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 msgr2=0x7f3e80152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.021+0000 7f3e86525640 1 --2- 172.21.15.91:0/3118437235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 0x7f3e80152f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009870 tx=0x7f3e7002b980 comp rx=0 tx=0).stop 2023-11-27T20:45:51.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.021+0000 7f3e86525640 1 -- 172.21.15.91:0/3118437235 shutdown_connections 2023-11-27T20:45:51.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.021+0000 7f3e86525640 1 --2- 172.21.15.91:0/3118437235 >> v2:172.21.15.183:3300/0 conn(0x7f3e800c3ea0 0x7f3e800c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.021+0000 7f3e86525640 1 --2- 172.21.15.91:0/3118437235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 0x7f3e80152f20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.021+0000 7f3e86525640 1 -- 172.21.15.91:0/3118437235 >> 172.21.15.91:0/3118437235 conn(0x7f3e8006a500 msgr2=0x7f3e8006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:51.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.021+0000 7f3e86525640 1 -- 172.21.15.91:0/3118437235 shutdown_connections 2023-11-27T20:45:51.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.021+0000 7f3e86525640 1 -- 172.21.15.91:0/3118437235 wait complete. 2023-11-27T20:45:51.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.023+0000 7f3e86525640 1 Processor -- start 2023-11-27T20:45:51.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.023+0000 7f3e86525640 1 -- start start 2023-11-27T20:45:51.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.024+0000 7f3e86525640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8006d0a0 0x7f3e800bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.024+0000 7f3e86525640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800c3ea0 0x7f3e800a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e86525640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 0x7f3e80153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e86525640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e801edd70 con 0x7f3e800c3ea0 2023-11-27T20:45:51.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e86525640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e80156950 con 0x7f3e8006d0a0 2023-11-27T20:45:51.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e86525640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e80156670 con 0x7f3e8014fd30 2023-11-27T20:45:51.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e777fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800c3ea0 0x7f3e800a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e777fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800c3ea0 0x7f3e800a9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34062/0 (socket says 172.21.15.91:34062) 2023-11-27T20:45:51.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e777fe640 1 -- 172.21.15.91:0/3071648055 learned_addr learned my addr 172.21.15.91:0/3071648055 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:51.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e777fe640 1 -- 172.21.15.91:0/3071648055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 msgr2=0x7f3e80153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e777fe640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 0x7f3e80153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e777fe640 1 -- 172.21.15.91:0/3071648055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8006d0a0 msgr2=0x7f3e800bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e777fe640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8006d0a0 0x7f3e800bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.025+0000 7f3e777fe640 1 -- 172.21.15.91:0/3071648055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700094d0 con 0x7f3e800c3ea0 2023-11-27T20:45:51.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.026+0000 7f3e777fe640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800c3ea0 0x7f3e800a9d90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c3f0 tx=0x7f3e6800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:51.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.026+0000 7f3e7d7fa640 1 -- 172.21.15.91:0/3071648055 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e680052d0 con 0x7f3e800c3ea0 2023-11-27T20:45:51.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.026+0000 7f3e7d7fa640 1 -- 172.21.15.91:0/3071648055 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68005450 con 0x7f3e800c3ea0 2023-11-27T20:45:51.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.026+0000 7f3e86525640 1 -- 172.21.15.91:0/3071648055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e801ed6b0 con 0x7f3e800c3ea0 2023-11-27T20:45:51.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.026+0000 7f3e7d7fa640 1 -- 172.21.15.91:0/3071648055 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68003830 con 0x7f3e800c3ea0 2023-11-27T20:45:51.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.026+0000 7f3e86525640 1 -- 172.21.15.91:0/3071648055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e800bf8a0 con 0x7f3e800c3ea0 2023-11-27T20:45:51.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.027+0000 7f3e86525640 1 -- 172.21.15.91:0/3071648055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e801ed510 con 0x7f3e800c3ea0 2023-11-27T20:45:51.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.028+0000 7f3e7d7fa640 1 -- 172.21.15.91:0/3071648055 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3e68003990 con 0x7f3e800c3ea0 2023-11-27T20:45:51.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.029+0000 7f3e7d7fa640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e6406b1c0 0x7f3e6406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.029+0000 7f3e7d7fa640 1 -- 172.21.15.91:0/3071648055 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f3e680892b0 con 0x7f3e800c3ea0 2023-11-27T20:45:51.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.029+0000 7f3e7ffff640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e6406b1c0 0x7f3e6406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.030+0000 7f3e7ffff640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e6406b1c0 0x7f3e6406d680 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3e70036000 tx=0x7f3e7003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:51.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.033+0000 7f3e7d7fa640 1 -- 172.21.15.91:0/3071648055 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3e801ed510 con 0x7f3e800c3ea0 2023-11-27T20:45:51.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.224+0000 7f3e86525640 1 -- 172.21.15.91:0/3071648055 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e801ed510 con 0x7f3e800c3ea0 2023-11-27T20:45:51.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.224+0000 7f3e7d7fa640 1 -- 172.21.15.91:0/3071648055 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v81) v1 ==== 105+0+11 (secure 0 0 0) 0x7f3e801ed510 con 0x7f3e800c3ea0 2023-11-27T20:45:51.225 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:51.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.226+0000 7f3e86525640 1 -- 172.21.15.91:0/3071648055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e6406b1c0 msgr2=0x7f3e6406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e6406b1c0 0x7f3e6406d680 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3e70036000 tx=0x7f3e7003b040 comp rx=0 tx=0).stop 2023-11-27T20:45:51.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 -- 172.21.15.91:0/3071648055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800c3ea0 msgr2=0x7f3e800a9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800c3ea0 0x7f3e800a9d90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c3f0 tx=0x7f3e6800c8b0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 -- 172.21.15.91:0/3071648055 shutdown_connections 2023-11-27T20:45:51.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8014fd30 0x7f3e80153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e800c3ea0 0x7f3e800a9d90 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e6406b1c0 0x7f3e6406d680 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 --2- 172.21.15.91:0/3071648055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8006d0a0 0x7f3e800bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 -- 172.21.15.91:0/3071648055 >> 172.21.15.91:0/3071648055 conn(0x7f3e8006a500 msgr2=0x7f3e800c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:51.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 -- 172.21.15.91:0/3071648055 shutdown_connections 2023-11-27T20:45:51.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.227+0000 7f3e86525640 1 -- 172.21.15.91:0/3071648055 wait complete. 2023-11-27T20:45:51.249 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:45:51.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.459+0000 7fee5e8c2640 1 Processor -- start 2023-11-27T20:45:51.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.459+0000 7fee5e8c2640 1 -- start start 2023-11-27T20:45:51.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.461+0000 7fee5e8c2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fee580c5ec0 0x7fee580c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.461+0000 7fee5e8c2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580721a0 0x7fee580c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.461+0000 7fee5e8c2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee580bfdc0 con 0x7fee580c45d0 2023-11-27T20:45:51.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.461+0000 7fee5e8c2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5806e390 con 0x7fee580c5ec0 2023-11-27T20:45:51.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.461+0000 7fee5e8c2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5806ddd0 con 0x7fee580721a0 2023-11-27T20:45:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.461+0000 7fee5ce5f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580721a0 0x7fee580c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.462+0000 7fee5ce5f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580721a0 0x7fee580c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59288/0 (socket says 172.21.15.91:59288) 2023-11-27T20:45:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.462+0000 7fee5ce5f640 1 -- 172.21.15.91:0/340690007 learned_addr learned my addr 172.21.15.91:0/340690007 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:51.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.462+0000 7fee57fff640 1 --2- 172.21.15.91:0/340690007 >> v2:172.21.15.183:3300/0 conn(0x7fee580c5ec0 0x7fee580c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.462+0000 7fee5ce5f640 1 -- 172.21.15.91:0/340690007 >> v2:172.21.15.183:3300/0 conn(0x7fee580c5ec0 msgr2=0x7fee580c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:51.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.462+0000 7fee5ce5f640 1 --2- 172.21.15.91:0/340690007 >> v2:172.21.15.183:3300/0 conn(0x7fee580c5ec0 0x7fee580c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.462+0000 7fee5ce5f640 1 -- 172.21.15.91:0/340690007 >> v1:172.21.15.183:6789/0 conn(0x7fee580c45d0 legacy=0x7fee58155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.462+0000 7fee5ce5f640 1 -- 172.21.15.91:0/340690007 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5806e0b0 con 0x7fee580721a0 2023-11-27T20:45:51.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.462+0000 7fee57fff640 1 --2- 172.21.15.91:0/340690007 >> v2:172.21.15.183:3300/0 conn(0x7fee580c5ec0 0x7fee580c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:45:51.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.464+0000 7fee5ce5f640 1 --2- 172.21.15.91:0/340690007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580721a0 0x7fee580c3170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee50009e80 tx=0x7fee5002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaa80054ccbf18c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.464+0000 7fee56ffd640 1 -- 172.21.15.91:0/340690007 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5002c9c0 con 0x7fee580721a0 2023-11-27T20:45:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.464+0000 7fee56ffd640 1 -- 172.21.15.91:0/340690007 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5002cb20 con 0x7fee580721a0 2023-11-27T20:45:51.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.464+0000 7fee56ffd640 1 -- 172.21.15.91:0/340690007 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500343f0 con 0x7fee580721a0 2023-11-27T20:45:51.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.465+0000 7fee5e8c2640 1 -- 172.21.15.91:0/340690007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580721a0 msgr2=0x7fee580c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.465+0000 7fee5e8c2640 1 --2- 172.21.15.91:0/340690007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580721a0 0x7fee580c3170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee50009e80 tx=0x7fee5002be20 comp rx=0 tx=0).stop 2023-11-27T20:45:51.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.465+0000 7fee5e8c2640 1 -- 172.21.15.91:0/340690007 shutdown_connections 2023-11-27T20:45:51.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.465+0000 7fee5e8c2640 1 --2- 172.21.15.91:0/340690007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580721a0 0x7fee580c3170 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.465+0000 7fee5e8c2640 1 --2- 172.21.15.91:0/340690007 >> v2:172.21.15.183:3300/0 conn(0x7fee580c5ec0 0x7fee580c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.465+0000 7fee5e8c2640 1 -- 172.21.15.91:0/340690007 >> 172.21.15.91:0/340690007 conn(0x7fee5806a500 msgr2=0x7fee5806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.465+0000 7fee5e8c2640 1 -- 172.21.15.91:0/340690007 shutdown_connections 2023-11-27T20:45:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.465+0000 7fee5e8c2640 1 -- 172.21.15.91:0/340690007 wait complete. 2023-11-27T20:45:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.467+0000 7fee5e8c2640 1 Processor -- start 2023-11-27T20:45:51.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.467+0000 7fee5e8c2640 1 -- start start 2023-11-27T20:45:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.468+0000 7fee5e8c2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee580721a0 0x7fee58155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.468+0000 7fee5e8c2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580c45d0 0x7fee581501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.468+0000 7fee5e8c2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee580c5ec0 0x7fee5814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.468+0000 7fee5e8c2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee580a7b20 con 0x7fee580721a0 2023-11-27T20:45:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.468+0000 7fee5e8c2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee58156f90 con 0x7fee580c5ec0 2023-11-27T20:45:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.468+0000 7fee5e8c2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee58150e40 con 0x7fee580c45d0 2023-11-27T20:45:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.468+0000 7fee57fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee580721a0 0x7fee58155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.468+0000 7fee57fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee580721a0 0x7fee58155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34070/0 (socket says 172.21.15.91:34070) 2023-11-27T20:45:51.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.468+0000 7fee57fff640 1 -- 172.21.15.91:0/3618496933 learned_addr learned my addr 172.21.15.91:0/3618496933 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:51.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee577fe640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580c45d0 0x7fee581501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee5ce5f640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee580c5ec0 0x7fee5814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee57fff640 1 -- 172.21.15.91:0/3618496933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580c45d0 msgr2=0x7fee581501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee57fff640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580c45d0 0x7fee581501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee57fff640 1 -- 172.21.15.91:0/3618496933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee580c5ec0 msgr2=0x7fee5814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee57fff640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee580c5ec0 0x7fee5814e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee57fff640 1 -- 172.21.15.91:0/3618496933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48009400 con 0x7fee580721a0 2023-11-27T20:45:51.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee57fff640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee580721a0 0x7fee58155820 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fee4800e960 tx=0x7fee4800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:51.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee54ff9640 1 -- 172.21.15.91:0/3618496933 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800ca00 con 0x7fee580721a0 2023-11-27T20:45:51.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee54ff9640 1 -- 172.21.15.91:0/3618496933 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4800cb60 con 0x7fee580721a0 2023-11-27T20:45:51.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee54ff9640 1 -- 172.21.15.91:0/3618496933 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48013470 con 0x7fee580721a0 2023-11-27T20:45:51.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.469+0000 7fee5e8c2640 1 -- 172.21.15.91:0/3618496933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee50009b30 con 0x7fee580721a0 2023-11-27T20:45:51.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.470+0000 7fee5e8c2640 1 -- 172.21.15.91:0/3618496933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee58155f20 con 0x7fee580721a0 2023-11-27T20:45:51.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.471+0000 7fee5e8c2640 1 -- 172.21.15.91:0/3618496933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee58068350 con 0x7fee580721a0 2023-11-27T20:45:51.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.472+0000 7fee54ff9640 1 -- 172.21.15.91:0/3618496933 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fee480135d0 con 0x7fee580721a0 2023-11-27T20:45:51.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.473+0000 7fee54ff9640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee4406b1c0 0x7fee4406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.473+0000 7fee54ff9640 1 -- 172.21.15.91:0/3618496933 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fee48089ff0 con 0x7fee580721a0 2023-11-27T20:45:51.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.473+0000 7fee577fe640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee4406b1c0 0x7fee4406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.474+0000 7fee577fe640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee4406b1c0 0x7fee4406d680 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fee5806dc00 tx=0x7fee4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:51.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.477+0000 7fee54ff9640 1 -- 172.21.15.91:0/3618496933 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fee48054a20 con 0x7fee580721a0 2023-11-27T20:45:51.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.669+0000 7fee5e8c2640 1 -- 172.21.15.91:0/3618496933 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fee580bfa00 con 0x7fee580721a0 2023-11-27T20:45:51.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.670+0000 7fee54ff9640 1 -- 172.21.15.91:0/3618496933 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v81) v1 ==== 101+0+11 (secure 0 0 0) 0x7fee48058040 con 0x7fee580721a0 2023-11-27T20:45:51.670 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:51.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 -- 172.21.15.91:0/3618496933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee4406b1c0 msgr2=0x7fee4406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee4406b1c0 0x7fee4406d680 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fee5806dc00 tx=0x7fee4c009040 comp rx=0 tx=0).stop 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 -- 172.21.15.91:0/3618496933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee580721a0 msgr2=0x7fee58155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee580721a0 0x7fee58155820 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fee4800e960 tx=0x7fee4800ee20 comp rx=0 tx=0).stop 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 -- 172.21.15.91:0/3618496933 shutdown_connections 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fee4406b1c0 0x7fee4406d680 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee580c5ec0 0x7fee5814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee580c45d0 0x7fee581501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 --2- 172.21.15.91:0/3618496933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee580721a0 0x7fee58155820 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 -- 172.21.15.91:0/3618496933 >> 172.21.15.91:0/3618496933 conn(0x7fee5806a500 msgr2=0x7fee580c13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 -- 172.21.15.91:0/3618496933 shutdown_connections 2023-11-27T20:45:51.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.673+0000 7fee5e8c2640 1 -- 172.21.15.91:0/3618496933 wait complete. 2023-11-27T20:45:51.693 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T20:45:51.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.905+0000 7f09aebe5640 1 Processor -- start 2023-11-27T20:45:51.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.905+0000 7f09aebe5640 1 -- start start 2023-11-27T20:45:51.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.906+0000 7f09aebe5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f09a80c1ca0 0x7f09a80c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.906+0000 7f09aebe5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a8071e30 0x7f09a80c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.906+0000 7f09aebe5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a806d580 con 0x7f09a8155fc0 2023-11-27T20:45:51.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.906+0000 7f09aebe5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a806dd60 con 0x7f09a80c1ca0 2023-11-27T20:45:51.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.906+0000 7f09aebe5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80c6580 con 0x7f09a8071e30 2023-11-27T20:45:51.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.907+0000 7f09a7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f09a80c1ca0 0x7f09a80c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.907+0000 7f09a7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f09a80c1ca0 0x7f09a80c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34076/0 (socket says 172.21.15.91:34076) 2023-11-27T20:45:51.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.907+0000 7f09a7fff640 1 -- 172.21.15.91:0/1742714327 learned_addr learned my addr 172.21.15.91:0/1742714327 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:51.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.907+0000 7f09ad182640 1 --2- 172.21.15.91:0/1742714327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a8071e30 0x7f09a80c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.907+0000 7f09a7fff640 1 -- 172.21.15.91:0/1742714327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a8071e30 msgr2=0x7f09a80c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:51.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.907+0000 7f09a7fff640 1 --2- 172.21.15.91:0/1742714327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a8071e30 0x7f09a80c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.907+0000 7f09a7fff640 1 -- 172.21.15.91:0/1742714327 >> v1:172.21.15.183:6789/0 conn(0x7f09a8155fc0 legacy=0x7f09a8159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:51.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.907+0000 7f09a7fff640 1 -- 172.21.15.91:0/1742714327 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80726d0 con 0x7f09a80c1ca0 2023-11-27T20:45:51.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.909+0000 7f09a7fff640 1 --2- 172.21.15.91:0/1742714327 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 0x7f09a80c2750 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f09940098a0 tx=0x7f099402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1a1c91282c7c0d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:51.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.909+0000 7f09a77fe640 1 -- 172.21.15.91:0/1742714327 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994031520 con 0x7f09a80c1ca0 2023-11-27T20:45:51.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.909+0000 7f09a77fe640 1 -- 172.21.15.91:0/1742714327 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0994031680 con 0x7f09a80c1ca0 2023-11-27T20:45:51.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.909+0000 7f09a77fe640 1 -- 172.21.15.91:0/1742714327 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994031a10 con 0x7f09a80c1ca0 2023-11-27T20:45:51.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.910+0000 7f09aebe5640 1 -- 172.21.15.91:0/1742714327 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 msgr2=0x7f09a80c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.910+0000 7f09aebe5640 1 --2- 172.21.15.91:0/1742714327 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 0x7f09a80c2750 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f09940098a0 tx=0x7f099402b7c0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.910+0000 7f09aebe5640 1 -- 172.21.15.91:0/1742714327 shutdown_connections 2023-11-27T20:45:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.910+0000 7f09aebe5640 1 --2- 172.21.15.91:0/1742714327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a8071e30 0x7f09a80c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.910+0000 7f09aebe5640 1 --2- 172.21.15.91:0/1742714327 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 0x7f09a80c2750 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.910+0000 7f09aebe5640 1 -- 172.21.15.91:0/1742714327 >> 172.21.15.91:0/1742714327 conn(0x7f09a806a500 msgr2=0x7f09a806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.910+0000 7f09aebe5640 1 -- 172.21.15.91:0/1742714327 shutdown_connections 2023-11-27T20:45:51.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.910+0000 7f09aebe5640 1 -- 172.21.15.91:0/1742714327 wait complete. 2023-11-27T20:45:51.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.912+0000 7f09aebe5640 1 Processor -- start 2023-11-27T20:45:51.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.912+0000 7f09aebe5640 1 -- start start 2023-11-27T20:45:51.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09aebe5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a8071e30 0x7f09a81e2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09aebe5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 0x7f09a80a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09aebe5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09a8155fc0 0x7f09a8159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09aebe5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a815c1b0 con 0x7f09a80c1ca0 2023-11-27T20:45:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09aebe5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a815cad0 con 0x7f09a8155fc0 2023-11-27T20:45:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09aebe5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a81ef0b0 con 0x7f09a8071e30 2023-11-27T20:45:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09a7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 0x7f09a80a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09a7fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 0x7f09a80a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34090/0 (socket says 172.21.15.91:34090) 2023-11-27T20:45:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09a7fff640 1 -- 172.21.15.91:0/2700456916 learned_addr learned my addr 172.21.15.91:0/2700456916 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:51.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09ac981640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a8071e30 0x7f09a81e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09ad182640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09a8155fc0 0x7f09a8159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09a7fff640 1 -- 172.21.15.91:0/2700456916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a8071e30 msgr2=0x7f09a81e2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09a7fff640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a8071e30 0x7f09a81e2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09a7fff640 1 -- 172.21.15.91:0/2700456916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09a8155fc0 msgr2=0x7f09a8159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:51.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09a7fff640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09a8155fc0 0x7f09a8159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:51.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.913+0000 7f09a7fff640 1 -- 172.21.15.91:0/2700456916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940094d0 con 0x7f09a80c1ca0 2023-11-27T20:45:51.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.914+0000 7f09a7fff640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 0x7f09a80a46b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f0994000c00 tx=0x7f09940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:51.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.914+0000 7f09a57fa640 1 -- 172.21.15.91:0/2700456916 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994031520 con 0x7f09a80c1ca0 2023-11-27T20:45:51.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.914+0000 7f09a57fa640 1 -- 172.21.15.91:0/2700456916 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0994033c50 con 0x7f09a80c1ca0 2023-11-27T20:45:51.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.914+0000 7f09a57fa640 1 -- 172.21.15.91:0/2700456916 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099403c400 con 0x7f09a80c1ca0 2023-11-27T20:45:51.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.914+0000 7f09aebe5640 1 -- 172.21.15.91:0/2700456916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a815cd70 con 0x7f09a80c1ca0 2023-11-27T20:45:51.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.914+0000 7f09aebe5640 1 -- 172.21.15.91:0/2700456916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a80a4bf0 con 0x7f09a80c1ca0 2023-11-27T20:45:51.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.915+0000 7f09aebe5640 1 -- 172.21.15.91:0/2700456916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a815cf00 con 0x7f09a80c1ca0 2023-11-27T20:45:51.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.916+0000 7f09a57fa640 1 -- 172.21.15.91:0/2700456916 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f099403a040 con 0x7f09a80c1ca0 2023-11-27T20:45:51.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.917+0000 7f09a57fa640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f098c06b1c0 0x7f098c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:51.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.917+0000 7f09a57fa640 1 -- 172.21.15.91:0/2700456916 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f09940ab610 con 0x7f09a80c1ca0 2023-11-27T20:45:51.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.917+0000 7f09ac981640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f098c06b1c0 0x7f098c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:51.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.918+0000 7f09ac981640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f098c06b1c0 0x7f098c06d680 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f09a806adc0 tx=0x7f099c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:51.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:51.921+0000 7f09a57fa640 1 -- 172.21.15.91:0/2700456916 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0994076040 con 0x7f09a80c1ca0 2023-11-27T20:45:52.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.125+0000 7f09aebe5640 1 -- 172.21.15.91:0/2700456916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f09a80c0250 con 0x7f09a80c1ca0 2023-11-27T20:45:52.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.125+0000 7f09a57fa640 1 -- 172.21.15.91:0/2700456916 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0994079660 con 0x7f09a80c1ca0 2023-11-27T20:45:52.126 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-11-27T20:45:52.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 -- 172.21.15.91:0/2700456916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f098c06b1c0 msgr2=0x7f098c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:52.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f098c06b1c0 0x7f098c06d680 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f09a806adc0 tx=0x7f099c009040 comp rx=0 tx=0).stop 2023-11-27T20:45:52.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 -- 172.21.15.91:0/2700456916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 msgr2=0x7f09a80a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:52.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 0x7f09a80a46b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f0994000c00 tx=0x7f09940046c0 comp rx=0 tx=0).stop 2023-11-27T20:45:52.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 -- 172.21.15.91:0/2700456916 shutdown_connections 2023-11-27T20:45:52.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f098c06b1c0 0x7f098c06d680 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:52.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09a8155fc0 0x7f09a8159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:52.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09a80c1ca0 0x7f09a80a46b0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:52.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 --2- 172.21.15.91:0/2700456916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09a8071e30 0x7f09a81e2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:52.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 -- 172.21.15.91:0/2700456916 >> 172.21.15.91:0/2700456916 conn(0x7f09a806a500 msgr2=0x7f09a80c4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:52.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 -- 172.21.15.91:0/2700456916 shutdown_connections 2023-11-27T20:45:52.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.128+0000 7f09aebe5640 1 -- 172.21.15.91:0/2700456916 wait complete. 2023-11-27T20:45:52.147 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-11-27T20:45:52.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:52.147 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-27T20:45:52.261 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:45:52.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:45:52.262 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-27T20:45:52.314 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-27T20:45:52.314 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:45:52.441 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T20:45:52.572 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-27T20:45:52.573 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:45:52.573 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:52.631 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-27T20:45:52.632 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:45:52.632 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:45:52.695 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-27T20:45:52.695 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:45:52.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.914+0000 7f472ec64640 1 Processor -- start 2023-11-27T20:45:52.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.915+0000 7f472ec64640 1 -- start start 2023-11-27T20:45:52.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.916+0000 7f472ec64640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4728155fc0 0x7f4728159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:52.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.916+0000 7f472ec64640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f47280c2e60 0x7f4728163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:52.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.916+0000 7f472ec64640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472806d580 con 0x7f47280c1ca0 2023-11-27T20:45:52.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.916+0000 7f472ec64640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472806dd60 con 0x7f47280c2e60 2023-11-27T20:45:52.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.916+0000 7f472ec64640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47280c6580 con 0x7f4728155fc0 2023-11-27T20:45:52.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.917+0000 7f472ca00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4728155fc0 0x7f4728159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:52.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.917+0000 7f472ca00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4728155fc0 0x7f4728159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:59312/0 (socket says 172.21.15.91:59312) 2023-11-27T20:45:52.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.917+0000 7f472ca00640 1 -- 172.21.15.91:0/716143680 learned_addr learned my addr 172.21.15.91:0/716143680 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:52.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.917+0000 7f472d201640 1 --2- 172.21.15.91:0/716143680 >> v2:172.21.15.183:3300/0 conn(0x7f47280c2e60 0x7f4728163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:52.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.918+0000 7f472ca00640 1 -- 172.21.15.91:0/716143680 >> v2:172.21.15.183:3300/0 conn(0x7f47280c2e60 msgr2=0x7f4728163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:52.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.918+0000 7f472ca00640 1 --2- 172.21.15.91:0/716143680 >> v2:172.21.15.183:3300/0 conn(0x7f47280c2e60 0x7f4728163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:52.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.918+0000 7f472ca00640 1 -- 172.21.15.91:0/716143680 >> v1:172.21.15.183:6789/0 conn(0x7f47280c1ca0 legacy=0x7f47280c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:52.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.918+0000 7f472ca00640 1 -- 172.21.15.91:0/716143680 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280726d0 con 0x7f4728155fc0 2023-11-27T20:45:52.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.918+0000 7f472d201640 1 --2- 172.21.15.91:0/716143680 >> v2:172.21.15.183:3300/0 conn(0x7f47280c2e60 0x7f4728163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:45:52.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.919+0000 7f472ca00640 1 --2- 172.21.15.91:0/716143680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4728155fc0 0x7f4728159470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4718009e50 tx=0x7f471802be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a617bbac27e7fb47 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:52.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.920+0000 7f47277fe640 1 -- 172.21.15.91:0/716143680 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471802c9f0 con 0x7f4728155fc0 2023-11-27T20:45:52.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.920+0000 7f47277fe640 1 -- 172.21.15.91:0/716143680 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471802cb50 con 0x7f4728155fc0 2023-11-27T20:45:52.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.920+0000 7f47277fe640 1 -- 172.21.15.91:0/716143680 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47180343f0 con 0x7f4728155fc0 2023-11-27T20:45:52.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.920+0000 7f472ec64640 1 -- 172.21.15.91:0/716143680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4728155fc0 msgr2=0x7f4728159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:52.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.920+0000 7f472ec64640 1 --2- 172.21.15.91:0/716143680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4728155fc0 0x7f4728159470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4718009e50 tx=0x7f471802be50 comp rx=0 tx=0).stop 2023-11-27T20:45:52.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.921+0000 7f472ec64640 1 -- 172.21.15.91:0/716143680 shutdown_connections 2023-11-27T20:45:52.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.921+0000 7f472ec64640 1 --2- 172.21.15.91:0/716143680 >> v2:172.21.15.183:3300/0 conn(0x7f47280c2e60 0x7f4728163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:52.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.921+0000 7f472ec64640 1 --2- 172.21.15.91:0/716143680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4728155fc0 0x7f4728159470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:52.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.921+0000 7f472ec64640 1 -- 172.21.15.91:0/716143680 >> 172.21.15.91:0/716143680 conn(0x7f472806a500 msgr2=0x7f472806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:52.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.921+0000 7f472ec64640 1 -- 172.21.15.91:0/716143680 shutdown_connections 2023-11-27T20:45:52.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.921+0000 7f472ec64640 1 -- 172.21.15.91:0/716143680 wait complete. 2023-11-27T20:45:52.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.923+0000 7f472ec64640 1 Processor -- start 2023-11-27T20:45:52.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.923+0000 7f472ec64640 1 -- start start 2023-11-27T20:45:52.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.924+0000 7f472ec64640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47280c1ca0 0x7f47281ee500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:52.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.924+0000 7f472ec64640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47280c2e60 0x7f47280a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:52.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.924+0000 7f472ec64640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4728155fc0 0x7f4728147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:52.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.924+0000 7f472ec64640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472815a4a0 con 0x7f47280c2e60 2023-11-27T20:45:52.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.924+0000 7f472ec64640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47281eeb30 con 0x7f4728155fc0 2023-11-27T20:45:52.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.924+0000 7f472ec64640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47281eee10 con 0x7f47280c1ca0 2023-11-27T20:45:52.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.924+0000 7f4727fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47280c2e60 0x7f47280a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:52.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.924+0000 7f4727fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47280c2e60 0x7f47280a8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34102/0 (socket says 172.21.15.91:34102) 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.924+0000 7f4727fff640 1 -- 172.21.15.91:0/3275005387 learned_addr learned my addr 172.21.15.91:0/3275005387 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f472ca00640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47280c1ca0 0x7f47281ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f472d201640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4728155fc0 0x7f4728147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f4727fff640 1 -- 172.21.15.91:0/3275005387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47280c1ca0 msgr2=0x7f47281ee500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f4727fff640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47280c1ca0 0x7f47281ee500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f4727fff640 1 -- 172.21.15.91:0/3275005387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4728155fc0 msgr2=0x7f4728147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f4727fff640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4728155fc0 0x7f4728147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f4727fff640 1 -- 172.21.15.91:0/3275005387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720009400 con 0x7f47280c2e60 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f472d201640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4728155fc0 0x7f4728147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f4727fff640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47280c2e60 0x7f47280a8320 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f471000c400 tx=0x7f471000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f47257fa640 1 -- 172.21.15.91:0/3275005387 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47100052d0 con 0x7f47280c2e60 2023-11-27T20:45:52.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f47257fa640 1 -- 172.21.15.91:0/3275005387 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4710005450 con 0x7f47280c2e60 2023-11-27T20:45:52.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.925+0000 7f47257fa640 1 -- 172.21.15.91:0/3275005387 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710007260 con 0x7f47280c2e60 2023-11-27T20:45:52.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.926+0000 7f472ec64640 1 -- 172.21.15.91:0/3275005387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4718009b30 con 0x7f47280c2e60 2023-11-27T20:45:52.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.926+0000 7f472ec64640 1 -- 172.21.15.91:0/3275005387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47281ef3d0 con 0x7f47280c2e60 2023-11-27T20:45:52.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.927+0000 7f472ec64640 1 -- 172.21.15.91:0/3275005387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4728068350 con 0x7f47280c2e60 2023-11-27T20:45:52.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.928+0000 7f47257fa640 1 -- 172.21.15.91:0/3275005387 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f47100073c0 con 0x7f47280c2e60 2023-11-27T20:45:52.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.929+0000 7f47257fa640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f470806b1c0 0x7f470806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:52.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.929+0000 7f47257fa640 1 -- 172.21.15.91:0/3275005387 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f4710089150 con 0x7f47280c2e60 2023-11-27T20:45:52.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.929+0000 7f472ca00640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f470806b1c0 0x7f470806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:52.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.930+0000 7f472ca00640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f470806b1c0 0x7f470806d680 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4718035000 tx=0x7f4718030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:52.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:52.933+0000 7f47257fa640 1 -- 172.21.15.91:0/3275005387 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4710053b80 con 0x7f47280c2e60 2023-11-27T20:45:53.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.162+0000 7f472ec64640 1 -- 172.21.15.91:0/3275005387 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f472806df10 con 0x7f47280c2e60 2023-11-27T20:45:53.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.163+0000 7f47257fa640 1 -- 172.21.15.91:0/3275005387 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6140 (secure 0 0 0) 0x7f47100571a0 con 0x7f47280c2e60 2023-11-27T20:45:53.163 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:53.164 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:06.072742+0000","modified":"2023-11-27T20:45:09.133844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/2103536114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":2103536114},{"type":"v1","addr":"172.21.15.183:6835","nonce":2103536114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:21.787805+0000","modified":"2023-11-27T20:45:24.857169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/1761528163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1761528163},{"type":"v1","addr":"172.21.15.91:6837","nonce":1761528163}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-27T20:45:53.164 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 51 2023-11-27T20:45:53.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.165+0000 7f472ec64640 1 -- 172.21.15.91:0/3275005387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f470806b1c0 msgr2=0x7f470806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.165+0000 7f472ec64640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f470806b1c0 0x7f470806d680 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4718035000 tx=0x7f4718030000 comp rx=0 tx=0).stop 2023-11-27T20:45:53.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.165+0000 7f472ec64640 1 -- 172.21.15.91:0/3275005387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47280c2e60 msgr2=0x7f47280a8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.165+0000 7f472ec64640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47280c2e60 0x7f47280a8320 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f471000c400 tx=0x7f471000c8c0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.165+0000 7f472ec64640 1 -- 172.21.15.91:0/3275005387 shutdown_connections 2023-11-27T20:45:53.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.165+0000 7f472ec64640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f470806b1c0 0x7f470806d680 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.166+0000 7f472ec64640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4728155fc0 0x7f4728147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.166+0000 7f472ec64640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47280c2e60 0x7f47280a8320 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.166+0000 7f472ec64640 1 --2- 172.21.15.91:0/3275005387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47280c1ca0 0x7f47281ee500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.166+0000 7f472ec64640 1 -- 172.21.15.91:0/3275005387 >> 172.21.15.91:0/3275005387 conn(0x7f472806a500 msgr2=0x7f47280c2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:53.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.166+0000 7f472ec64640 1 -- 172.21.15.91:0/3275005387 shutdown_connections 2023-11-27T20:45:53.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.166+0000 7f472ec64640 1 -- 172.21.15.91:0/3275005387 wait complete. 2023-11-27T20:45:53.185 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:53.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.398+0000 7ff98be7c640 1 Processor -- start 2023-11-27T20:45:53.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.398+0000 7ff98be7c640 1 -- start start 2023-11-27T20:45:53.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.399+0000 7ff98be7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff984151cc0 0x7ff984155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.399+0000 7ff98be7c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff9840c4940 0x7ff9840c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.399+0000 7ff98be7c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9841556d0 con 0x7ff9840c7ec0 2023-11-27T20:45:53.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.399+0000 7ff98be7c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff984154740 con 0x7ff9840c4940 2023-11-27T20:45:53.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.399+0000 7ff98be7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98406c760 con 0x7ff984151cc0 2023-11-27T20:45:53.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.400+0000 7ff98a419640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff9840c4940 0x7ff9840c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:53.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.400+0000 7ff98a419640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff9840c4940 0x7ff9840c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34112/0 (socket says 172.21.15.91:34112) 2023-11-27T20:45:53.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.400+0000 7ff98a419640 1 -- 172.21.15.91:0/2467921899 learned_addr learned my addr 172.21.15.91:0/2467921899 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:53.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.400+0000 7ff989c18640 1 --2- 172.21.15.91:0/2467921899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff984151cc0 0x7ff984155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:53.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.400+0000 7ff98a419640 1 -- 172.21.15.91:0/2467921899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff984151cc0 msgr2=0x7ff984155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:53.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.400+0000 7ff98a419640 1 --2- 172.21.15.91:0/2467921899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff984151cc0 0x7ff984155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.400+0000 7ff98a419640 1 -- 172.21.15.91:0/2467921899 >> v1:172.21.15.183:6789/0 conn(0x7ff9840c7ec0 legacy=0x7ff984157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:53.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.400+0000 7ff98a419640 1 -- 172.21.15.91:0/2467921899 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840c8470 con 0x7ff9840c4940 2023-11-27T20:45:53.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.402+0000 7ff98a419640 1 --2- 172.21.15.91:0/2467921899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 0x7ff9840c4d50 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009e50 tx=0x7ff97c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9db6b1fa1799f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:53.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.402+0000 7ff988c16640 1 -- 172.21.15.91:0/2467921899 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c02cb00 con 0x7ff9840c4940 2023-11-27T20:45:53.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.402+0000 7ff988c16640 1 -- 172.21.15.91:0/2467921899 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c02cc60 con 0x7ff9840c4940 2023-11-27T20:45:53.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.402+0000 7ff988c16640 1 -- 172.21.15.91:0/2467921899 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c0343f0 con 0x7ff9840c4940 2023-11-27T20:45:53.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.403+0000 7ff98be7c640 1 -- 172.21.15.91:0/2467921899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 msgr2=0x7ff9840c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.403+0000 7ff98be7c640 1 --2- 172.21.15.91:0/2467921899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 0x7ff9840c4d50 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009e50 tx=0x7ff97c02bf60 comp rx=0 tx=0).stop 2023-11-27T20:45:53.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.403+0000 7ff98be7c640 1 -- 172.21.15.91:0/2467921899 shutdown_connections 2023-11-27T20:45:53.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.403+0000 7ff98be7c640 1 --2- 172.21.15.91:0/2467921899 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 0x7ff9840c4d50 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.403+0000 7ff98be7c640 1 --2- 172.21.15.91:0/2467921899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff984151cc0 0x7ff984155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.403+0000 7ff98be7c640 1 -- 172.21.15.91:0/2467921899 >> 172.21.15.91:0/2467921899 conn(0x7ff984071e10 msgr2=0x7ff984072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:53.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.403+0000 7ff98be7c640 1 -- 172.21.15.91:0/2467921899 shutdown_connections 2023-11-27T20:45:53.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.403+0000 7ff98be7c640 1 -- 172.21.15.91:0/2467921899 wait complete. 2023-11-27T20:45:53.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.404+0000 7ff98be7c640 1 Processor -- start 2023-11-27T20:45:53.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.405+0000 7ff98be7c640 1 -- start start 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.405+0000 7ff98be7c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 0x7ff9840aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.405+0000 7ff98be7c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9840c7ec0 0x7ff984148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.405+0000 7ff98be7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff984151cc0 0x7ff9841489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.405+0000 7ff98be7c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff984157700 con 0x7ff9840c4940 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.405+0000 7ff98be7c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9841eab90 con 0x7ff9840c7ec0 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.405+0000 7ff98be7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9840aa500 con 0x7ff984151cc0 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.406+0000 7ff989c18640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 0x7ff9840aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.406+0000 7ff989c18640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 0x7ff9840aa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34118/0 (socket says 172.21.15.91:34118) 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.406+0000 7ff989c18640 1 -- 172.21.15.91:0/2961932468 learned_addr learned my addr 172.21.15.91:0/2961932468 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.406+0000 7ff989c18640 1 -- 172.21.15.91:0/2961932468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff984151cc0 msgr2=0x7ff9841489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.406+0000 7ff989c18640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff984151cc0 0x7ff9841489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.406+0000 7ff989c18640 1 -- 172.21.15.91:0/2961932468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9840c7ec0 msgr2=0x7ff984148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.406+0000 7ff989c18640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9840c7ec0 0x7ff984148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.406+0000 7ff989c18640 1 -- 172.21.15.91:0/2961932468 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c009b30 con 0x7ff9840c4940 2023-11-27T20:45:53.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.406+0000 7ff989c18640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 0x7ff9840aa990 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff98000d620 tx=0x7ff98000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:53.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.407+0000 7ff97a7fc640 1 -- 172.21.15.91:0/2961932468 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000b620 con 0x7ff9840c4940 2023-11-27T20:45:53.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.407+0000 7ff97a7fc640 1 -- 172.21.15.91:0/2961932468 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98000b780 con 0x7ff9840c4940 2023-11-27T20:45:53.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.407+0000 7ff97a7fc640 1 -- 172.21.15.91:0/2961932468 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000bb30 con 0x7ff9840c4940 2023-11-27T20:45:53.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.407+0000 7ff98be7c640 1 -- 172.21.15.91:0/2961932468 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9841502a0 con 0x7ff9840c4940 2023-11-27T20:45:53.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.407+0000 7ff98be7c640 1 -- 172.21.15.91:0/2961932468 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff984150860 con 0x7ff9840c4940 2023-11-27T20:45:53.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.408+0000 7ff98be7c640 1 -- 172.21.15.91:0/2961932468 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff984068350 con 0x7ff9840c4940 2023-11-27T20:45:53.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.409+0000 7ff97a7fc640 1 -- 172.21.15.91:0/2961932468 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff98000bc90 con 0x7ff9840c4940 2023-11-27T20:45:53.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.410+0000 7ff97a7fc640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff96806b1c0 0x7ff96806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.410+0000 7ff97a7fc640 1 -- 172.21.15.91:0/2961932468 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7ff98008a2f0 con 0x7ff9840c4940 2023-11-27T20:45:53.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.410+0000 7ff989417640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff96806b1c0 0x7ff96806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:53.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.410+0000 7ff989417640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff96806b1c0 0x7ff96806d680 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff974000f60 tx=0x7ff9740079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:53.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.414+0000 7ff97a7fc640 1 -- 172.21.15.91:0/2961932468 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff980054bf0 con 0x7ff9840c4940 2023-11-27T20:45:53.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.594+0000 7ff98be7c640 1 -- 172.21.15.91:0/2961932468 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff98406c9c0 con 0x7ff9840c4940 2023-11-27T20:45:53.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.598+0000 7ff97a7fc640 1 -- 172.21.15.91:0/2961932468 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20276 (secure 0 0 0) 0x7ff980058210 con 0x7ff9840c4940 2023-11-27T20:45:53.599 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:53.599 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":81,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:23.334850+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:53.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 -- 172.21.15.91:0/2961932468 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff96806b1c0 msgr2=0x7ff96806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff96806b1c0 0x7ff96806d680 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff974000f60 tx=0x7ff9740079b0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 -- 172.21.15.91:0/2961932468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 msgr2=0x7ff9840aa990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 0x7ff9840aa990 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff98000d620 tx=0x7ff98000dae0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 -- 172.21.15.91:0/2961932468 shutdown_connections 2023-11-27T20:45:53.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff984151cc0 0x7ff9841489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff96806b1c0 0x7ff96806d680 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9840c7ec0 0x7ff984148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 --2- 172.21.15.91:0/2961932468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff9840c4940 0x7ff9840aa990 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 -- 172.21.15.91:0/2961932468 >> 172.21.15.91:0/2961932468 conn(0x7ff984071e10 msgr2=0x7ff98414ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:53.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 -- 172.21.15.91:0/2961932468 shutdown_connections 2023-11-27T20:45:53.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.601+0000 7ff98be7c640 1 -- 172.21.15.91:0/2961932468 wait complete. 2023-11-27T20:45:53.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T20:45:04.361620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T20:45:05.090674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:45:19.465319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:45:20.794821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:45:53.621 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:45:53.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.836+0000 7feaec40e640 1 Processor -- start 2023-11-27T20:45:53.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.836+0000 7feaec40e640 1 -- start start 2023-11-27T20:45:53.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.838+0000 7feaec40e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feae4152f20 0x7feae40c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.838+0000 7feaec40e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae40c64a0 con 0x7feae414fd30 2023-11-27T20:45:53.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.838+0000 7feaec40e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae40c5c00 con 0x7feae406d0a0 2023-11-27T20:45:53.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.838+0000 7feaec40e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae40c5ee0 con 0x7feae4152f20 2023-11-27T20:45:53.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.838+0000 7feaea1aa640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7feae414fd30 0x7feae40a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:52980/0 (socket says 172.21.15.91:52980) 2023-11-27T20:45:53.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.838+0000 7feaea1aa640 1 -- 172.21.15.91:0/690430891 learned_addr learned my addr 172.21.15.91:0/690430891 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:53.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.838+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698970672 0 0) 0x7feae40c64a0 con 0x7feae414fd30 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.838+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead0003520 con 0x7feae414fd30 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feaea9ab640 1 --2- 172.21.15.91:0/690430891 >> v2:172.21.15.183:3300/0 conn(0x7feae4152f20 0x7feae40c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827946513 0 0) 0x7fead0003520 con 0x7feae414fd30 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 >> v2:172.21.15.183:3300/0 conn(0x7feae4152f20 msgr2=0x7feae40c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 --2- 172.21.15.91:0/690430891 >> v2:172.21.15.183:3300/0 conn(0x7feae4152f20 0x7feae40c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 >> v1:172.21.15.183:6789/0 conn(0x7feae406d0a0 legacy=0x7feae40c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40c61c0 con 0x7feae414fd30 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7feae0001670 con 0x7feae414fd30 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 >> v1:172.21.15.91:6789/0 conn(0x7feae414fd30 legacy=0x7feae40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fead0003970 0x7fead0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead00047c0 0x7fead0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fead0005180 0x7fead000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae40c5ee0 con 0x7fead0005180 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead000c0d0 con 0x7fead00047c0 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead000c290 con 0x7fead0003970 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.839+0000 7feaea9ab640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fead0005180 0x7fead000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.840+0000 7feaea1aa640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fead0003970 0x7fead0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.840+0000 7feae99a9640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead00047c0 0x7fead0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.840+0000 7feaea9ab640 1 -- 172.21.15.91:0/690430891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fead0003970 msgr2=0x7fead0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.840+0000 7feaea9ab640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fead0003970 0x7fead0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.840+0000 7feaea9ab640 1 -- 172.21.15.91:0/690430891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead00047c0 msgr2=0x7fead0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.840+0000 7feaea9ab640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead00047c0 0x7fead0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.840+0000 7feaea9ab640 1 -- 172.21.15.91:0/690430891 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0003520 con 0x7fead0005180 2023-11-27T20:45:53.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.841+0000 7feaea9ab640 1 -- 172.21.15.91:0/690430891 reap_dead start 2023-11-27T20:45:53.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.841+0000 7feaea9ab640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fead0005180 0x7fead000b980 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7feadc007360 tx=0x7fead00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf1f7a185acbbc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:53.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.841+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc02ccf0 con 0x7fead0005180 2023-11-27T20:45:53.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.841+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc02ce50 con 0x7fead0005180 2023-11-27T20:45:53.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.841+0000 7feae91a8640 1 -- 172.21.15.91:0/690430891 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc003bd0 con 0x7fead0005180 2023-11-27T20:45:53.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.842+0000 7feaec40e640 1 -- 172.21.15.91:0/690430891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fead0005180 msgr2=0x7fead000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.842+0000 7feaec40e640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fead0005180 0x7fead000b980 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7feadc007360 tx=0x7fead00057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.842+0000 7feaec40e640 1 -- 172.21.15.91:0/690430891 shutdown_connections 2023-11-27T20:45:53.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.842+0000 7feaec40e640 1 --2- 172.21.15.91:0/690430891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fead0005180 0x7fead000b980 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.842+0000 7feaec40e640 1 -- 172.21.15.91:0/690430891 >> 172.21.15.91:0/690430891 conn(0x7feae406a500 msgr2=0x7feae406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:53.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.842+0000 7feaec40e640 1 -- 172.21.15.91:0/690430891 shutdown_connections 2023-11-27T20:45:53.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.842+0000 7feaec40e640 1 -- 172.21.15.91:0/690430891 wait complete. 2023-11-27T20:45:53.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.843+0000 7feaec40e640 1 Processor -- start 2023-11-27T20:45:53.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.843+0000 7feaec40e640 1 -- start start 2023-11-27T20:45:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.844+0000 7feaec40e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead0005180 0x7feae41eb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.844+0000 7feaec40e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feae41dbad0 0x7feae41ddc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.844+0000 7feaec40e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae41de170 0x7feae41548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.844+0000 7feaec40e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae41ebde0 con 0x7feae41de170 2023-11-27T20:45:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.844+0000 7feaec40e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae41dcbe0 con 0x7fead0005180 2023-11-27T20:45:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.844+0000 7feaec40e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae41dd200 con 0x7feae41dbad0 2023-11-27T20:45:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feaea9ab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae41de170 0x7feae41548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feaea9ab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae41de170 0x7feae41548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34138/0 (socket says 172.21.15.91:34138) 2023-11-27T20:45:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feaea9ab640 1 -- 172.21.15.91:0/722087573 learned_addr learned my addr 172.21.15.91:0/722087573 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feaea9ab640 1 -- 172.21.15.91:0/722087573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feae41dbad0 msgr2=0x7feae41ddc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feaea9ab640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feae41dbad0 0x7feae41ddc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feaea9ab640 1 -- 172.21.15.91:0/722087573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead0005180 msgr2=0x7feae41eb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feaea9ab640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead0005180 0x7feae41eb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feaea9ab640 1 -- 172.21.15.91:0/722087573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae41ebb00 con 0x7feae41de170 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feaea9ab640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae41de170 0x7feae41548b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7feadc02dfd0 tx=0x7feadc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feadaffd640 1 -- 172.21.15.91:0/722087573 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc039070 con 0x7feae41de170 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feadaffd640 1 -- 172.21.15.91:0/722087573 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc003e30 con 0x7feae41de170 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feaec40e640 1 -- 172.21.15.91:0/722087573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae41dd430 con 0x7feae41de170 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.845+0000 7feadaffd640 1 -- 172.21.15.91:0/722087573 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0044b0 con 0x7feae41de170 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.846+0000 7feaec40e640 1 -- 172.21.15.91:0/722087573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae41eb800 con 0x7feae41de170 2023-11-27T20:45:53.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.846+0000 7feaec40e640 1 -- 172.21.15.91:0/722087573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae41dd950 con 0x7feae41de170 2023-11-27T20:45:53.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.848+0000 7feadaffd640 1 -- 172.21.15.91:0/722087573 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7feadc03d070 con 0x7feae41de170 2023-11-27T20:45:53.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.848+0000 7feadaffd640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 0x7feac806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:53.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.849+0000 7feadaffd640 1 -- 172.21.15.91:0/722087573 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7feadc0ab1a0 con 0x7feae41de170 2023-11-27T20:45:53.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.849+0000 7feaea1aa640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 0x7feac806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:53.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.849+0000 7feaea1aa640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 0x7feac806d680 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7feae0005990 tx=0x7feae0001c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:53.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:53.853+0000 7feadaffd640 1 -- 172.21.15.91:0/722087573 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7feae41dd950 con 0x7feae41de170 2023-11-27T20:45:54.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.040+0000 7feaec40e640 1 -- 172.21.15.91:0/722087573 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feae41dd950 con 0x7feae41de170 2023-11-27T20:45:54.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.041+0000 7feadaffd640 1 -- 172.21.15.91:0/722087573 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7feae41dd950 con 0x7feae41de170 2023-11-27T20:45:54.042 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:45:54.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.044+0000 7feaec40e640 1 -- 172.21.15.91:0/722087573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 msgr2=0x7feac806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.044+0000 7feaec40e640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 0x7feac806d680 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7feae0005990 tx=0x7feae0001c10 comp rx=0 tx=0).stop 2023-11-27T20:45:54.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.044+0000 7feaec40e640 1 -- 172.21.15.91:0/722087573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae41de170 msgr2=0x7feae41548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.044+0000 7feaec40e640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae41de170 0x7feae41548b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7feadc02dfd0 tx=0x7feadc004ab0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.044+0000 7feaec40e640 1 -- 172.21.15.91:0/722087573 shutdown_connections 2023-11-27T20:45:54.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.044+0000 7feaec40e640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feae41de170 0x7feae41548b0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.044+0000 7feaec40e640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feae41dbad0 0x7feae41ddc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.044+0000 7feaec40e640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7feac806b1c0 0x7feac806d680 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.044+0000 7feaec40e640 1 --2- 172.21.15.91:0/722087573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead0005180 0x7feae41eb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.044+0000 7feaec40e640 1 -- 172.21.15.91:0/722087573 >> 172.21.15.91:0/722087573 conn(0x7feae406a500 msgr2=0x7feae406fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:54.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.045+0000 7feaec40e640 1 -- 172.21.15.91:0/722087573 shutdown_connections 2023-11-27T20:45:54.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.045+0000 7feaec40e640 1 -- 172.21.15.91:0/722087573 wait complete. 2023-11-27T20:45:54.063 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T20:45:54.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.268+0000 7f126b7a9640 1 Processor -- start 2023-11-27T20:45:54.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.268+0000 7f126b7a9640 1 -- start start 2023-11-27T20:45:54.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.270+0000 7f126b7a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12640c3210 0x7f12640c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.270+0000 7f126b7a9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f12640c16b0 0x7f12640c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.270+0000 7f126b7a9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12640c2830 con 0x7f12641555c0 2023-11-27T20:45:54.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.270+0000 7f126b7a9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12640c3d80 con 0x7f12640c16b0 2023-11-27T20:45:54.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.270+0000 7f126b7a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12640c1260 con 0x7f12640c3210 2023-11-27T20:45:54.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.270+0000 7f1269545640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f12641555c0 0x7f12640c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59834/0 (socket says 172.21.15.91:59834) 2023-11-27T20:45:54.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.270+0000 7f1269545640 1 -- 172.21.15.91:0/2054335046 learned_addr learned my addr 172.21.15.91:0/2054335046 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:54.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.270+0000 7f1268d44640 1 --2- 172.21.15.91:0/2054335046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12640c3210 0x7f12640c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.270+0000 7f1269d46640 1 --2- 172.21.15.91:0/2054335046 >> v2:172.21.15.183:3300/0 conn(0x7f12640c16b0 0x7f12640c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908899841 0 0) 0x7f12640c2830 con 0x7f12641555c0 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1250003520 con 0x7f12641555c0 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4203707711 0 0) 0x7f1250003520 con 0x7f12641555c0 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12640c3210 msgr2=0x7f12640c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 --2- 172.21.15.91:0/2054335046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12640c3210 0x7f12640c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 >> v2:172.21.15.183:3300/0 conn(0x7f12640c16b0 msgr2=0x7f12640c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 --2- 172.21.15.91:0/2054335046 >> v2:172.21.15.183:3300/0 conn(0x7f12640c16b0 0x7f12640c1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126406bbd0 con 0x7f12641555c0 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f1260001670 con 0x7f12641555c0 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 >> v1:172.21.15.91:6789/0 conn(0x7f12641555c0 legacy=0x7f12640c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 --2- 172.21.15.91:0/2054335046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1250003970 0x7f1250003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 --2- 172.21.15.91:0/2054335046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12640c3210 0x7f12500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 --2- 172.21.15.91:0/2054335046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1250004d00 0x7f1250005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12640c1260 con 0x7f1250003970 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125000b980 con 0x7f1250004d00 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125000bb10 con 0x7f12640c3210 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f1269d46640 1 --2- 172.21.15.91:0/2054335046 >> v2:172.21.15.183:3300/0 conn(0x7f12640c16b0 0x7f12640c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.271+0000 7f1269545640 1 --2- 172.21.15.91:0/2054335046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1250003970 0x7f1250003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.272+0000 7f1269545640 1 -- 172.21.15.91:0/2054335046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12640c3210 msgr2=0x7f12500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.272+0000 7f1269545640 1 --2- 172.21.15.91:0/2054335046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12640c3210 0x7f12500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.272+0000 7f1269545640 1 -- 172.21.15.91:0/2054335046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1250004d00 msgr2=0x7f1250005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.272+0000 7f1269545640 1 --2- 172.21.15.91:0/2054335046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1250004d00 0x7f1250005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.272+0000 7f1269545640 1 -- 172.21.15.91:0/2054335046 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126406bbd0 con 0x7f1250003970 2023-11-27T20:45:54.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.273+0000 7f1269545640 1 --2- 172.21.15.91:0/2054335046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1250003970 0x7f1250003d90 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f126000c370 tx=0x7f12500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca1913fb40cda1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:54.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.274+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126002cbb0 con 0x7f1250003970 2023-11-27T20:45:54.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.274+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126002cd30 con 0x7f1250003970 2023-11-27T20:45:54.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.274+0000 7f125bfff640 1 -- 172.21.15.91:0/2054335046 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126002cea0 con 0x7f1250003970 2023-11-27T20:45:54.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.274+0000 7f126b7a9640 1 -- 172.21.15.91:0/2054335046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1250003970 msgr2=0x7f1250003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.274+0000 7f126b7a9640 1 --2- 172.21.15.91:0/2054335046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1250003970 0x7f1250003d90 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f126000c370 tx=0x7f12500057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.274+0000 7f1269d46640 1 -- 172.21.15.91:0/2054335046 reap_dead start 2023-11-27T20:45:54.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.274+0000 7f126b7a9640 1 -- 172.21.15.91:0/2054335046 shutdown_connections 2023-11-27T20:45:54.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.274+0000 7f126b7a9640 1 -- 172.21.15.91:0/2054335046 >> 172.21.15.91:0/2054335046 conn(0x7f12640c7e30 msgr2=0x7f12640c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:54.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.275+0000 7f126b7a9640 1 -- 172.21.15.91:0/2054335046 shutdown_connections 2023-11-27T20:45:54.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.275+0000 7f126b7a9640 1 -- 172.21.15.91:0/2054335046 wait complete. 2023-11-27T20:45:54.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.277+0000 7f126b7a9640 1 Processor -- start 2023-11-27T20:45:54.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.277+0000 7f126b7a9640 1 -- start start 2023-11-27T20:45:54.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.278+0000 7f126b7a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1250003970 0x7f12640a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.278+0000 7f126b7a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12640a8990 0x7f1264157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.278+0000 7f126b7a9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12641581b0 0x7f126414a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.278+0000 7f126b7a9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1264147f20 con 0x7f12641581b0 2023-11-27T20:45:54.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.278+0000 7f126b7a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12641577e0 con 0x7f12640a8990 2023-11-27T20:45:54.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.278+0000 7f126b7a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1264158660 con 0x7f1250003970 2023-11-27T20:45:54.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.278+0000 7f1269d46640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12641581b0 0x7f126414a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.278+0000 7f1269d46640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12641581b0 0x7f126414a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57178/0 (socket says 172.21.15.91:57178) 2023-11-27T20:45:54.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.278+0000 7f1269d46640 1 -- 172.21.15.91:0/3760037497 learned_addr learned my addr 172.21.15.91:0/3760037497 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:54.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.278+0000 7f1269545640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1250003970 0x7f12640a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f1268d44640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12640a8990 0x7f1264157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f1269d46640 1 -- 172.21.15.91:0/3760037497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1250003970 msgr2=0x7f12640a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f1269d46640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1250003970 0x7f12640a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f1269d46640 1 -- 172.21.15.91:0/3760037497 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12640a8990 msgr2=0x7f1264157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f1269d46640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12640a8990 0x7f1264157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f1269d46640 1 -- 172.21.15.91:0/3760037497 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1264156ed0 con 0x7f12641581b0 2023-11-27T20:45:54.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f1269d46640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12641581b0 0x7f126414a760 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f126406b390 tx=0x7f125c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:54.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f1259ffb640 1 -- 172.21.15.91:0/3760037497 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c007e20 con 0x7f12641581b0 2023-11-27T20:45:54.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f1259ffb640 1 -- 172.21.15.91:0/3760037497 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c00f040 con 0x7f12641581b0 2023-11-27T20:45:54.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f1259ffb640 1 -- 172.21.15.91:0/3760037497 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c003bd0 con 0x7f12641581b0 2023-11-27T20:45:54.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.279+0000 7f126b7a9640 1 -- 172.21.15.91:0/3760037497 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12641eaae0 con 0x7f12641581b0 2023-11-27T20:45:54.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.280+0000 7f126b7a9640 1 -- 172.21.15.91:0/3760037497 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1264157470 con 0x7f12641581b0 2023-11-27T20:45:54.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.281+0000 7f126b7a9640 1 -- 172.21.15.91:0/3760037497 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1264157950 con 0x7f12641581b0 2023-11-27T20:45:54.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.282+0000 7f1259ffb640 1 -- 172.21.15.91:0/3760037497 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f125c003d30 con 0x7f12641581b0 2023-11-27T20:45:54.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.283+0000 7f1259ffb640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f124806b1f0 0x7f124806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.283+0000 7f1259ffb640 1 -- 172.21.15.91:0/3760037497 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f125c089bb0 con 0x7f12641581b0 2023-11-27T20:45:54.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.284+0000 7f1269545640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f124806b1f0 0x7f124806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.284+0000 7f1269545640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f124806b1f0 0x7f124806d6b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1260034000 tx=0x7f1260007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:54.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.288+0000 7f1259ffb640 1 -- 172.21.15.91:0/3760037497 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f125c0545e0 con 0x7f12641581b0 2023-11-27T20:45:54.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.483+0000 7f126b7a9640 1 -- 172.21.15.91:0/3760037497 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1264068350 con 0x7f12641581b0 2023-11-27T20:45:54.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.484+0000 7f1259ffb640 1 -- 172.21.15.91:0/3760037497 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f125c0890a0 con 0x7f12641581b0 2023-11-27T20:45:54.485 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:54.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 -- 172.21.15.91:0/3760037497 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f124806b1f0 msgr2=0x7f124806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f124806b1f0 0x7f124806d6b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1260034000 tx=0x7f1260007000 comp rx=0 tx=0).stop 2023-11-27T20:45:54.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 -- 172.21.15.91:0/3760037497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12641581b0 msgr2=0x7f126414a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12641581b0 0x7f126414a760 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f126406b390 tx=0x7f125c00d4a0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 -- 172.21.15.91:0/3760037497 shutdown_connections 2023-11-27T20:45:54.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12641581b0 0x7f126414a760 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f124806b1f0 0x7f124806d6b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12640a8990 0x7f1264157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 --2- 172.21.15.91:0/3760037497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1250003970 0x7f12640a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 -- 172.21.15.91:0/3760037497 >> 172.21.15.91:0/3760037497 conn(0x7f12640c7e30 msgr2=0x7f126406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:54.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 -- 172.21.15.91:0/3760037497 shutdown_connections 2023-11-27T20:45:54.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.487+0000 7f126b7a9640 1 -- 172.21.15.91:0/3760037497 wait complete. 2023-11-27T20:45:54.506 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T20:45:54.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.717+0000 7f3a0d648640 1 Processor -- start 2023-11-27T20:45:54.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.718+0000 7f3a0d648640 1 -- start start 2023-11-27T20:45:54.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.719+0000 7f3a0d648640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3a080a6bc0 0x7f3a080c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.719+0000 7f3a0d648640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080c4220 con 0x7f3a080c6680 2023-11-27T20:45:54.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.719+0000 7f3a0d648640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080c2ba0 con 0x7f3a080c7950 2023-11-27T20:45:54.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.719+0000 7f3a0d648640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a080c2e80 con 0x7f3a080a6bc0 2023-11-27T20:45:54.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.719+0000 7f3a06ffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f3a080c6680 0x7f3a080c15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59836/0 (socket says 172.21.15.91:59836) 2023-11-27T20:45:54.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.719+0000 7f3a06ffd640 1 -- 172.21.15.91:0/693506839 learned_addr learned my addr 172.21.15.91:0/693506839 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:54.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564478586 0 0) 0x7f39f8001490 con 0x7f3a080c6680 2023-11-27T20:45:54.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f4003520 con 0x7f3a080c6680 2023-11-27T20:45:54.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a067fc640 1 --2- 172.21.15.91:0/693506839 >> v2:172.21.15.183:3300/0 conn(0x7f3a080a6bc0 0x7f3a080c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2534938833 0 0) 0x7f39f4003520 con 0x7f3a080c6680 2023-11-27T20:45:54.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 >> v2:172.21.15.183:3300/0 conn(0x7f3a080a6bc0 msgr2=0x7f3a080c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:54.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 --2- 172.21.15.91:0/693506839 >> v2:172.21.15.183:3300/0 conn(0x7f3a080a6bc0 0x7f3a080c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 >> v1:172.21.15.183:6789/0 conn(0x7f3a080c7950 legacy=0x7f3a080c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080c32e0 con 0x7f3a080c6680 2023-11-27T20:45:54.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f39f8001b80 con 0x7f3a080c6680 2023-11-27T20:45:54.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 >> v1:172.21.15.91:6789/0 conn(0x7f3a080c6680 legacy=0x7f3a080c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 --2- 172.21.15.91:0/693506839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f39f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 --2- 172.21.15.91:0/693506839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39f40047c0 0x7f39f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 --2- 172.21.15.91:0/693506839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39f4005380 0x7f39f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f400c1e0 con 0x7f39f4003970 2023-11-27T20:45:54.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f400c350 con 0x7f39f4005380 2023-11-27T20:45:54.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f400c510 con 0x7f39f40047c0 2023-11-27T20:45:54.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a067fc640 1 --2- 172.21.15.91:0/693506839 >> v2:172.21.15.183:3300/0 conn(0x7f3a080a6bc0 0x7f3a080c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:45:54.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.720+0000 7f3a06ffd640 1 --2- 172.21.15.91:0/693506839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f39f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.721+0000 7f3a06ffd640 1 -- 172.21.15.91:0/693506839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39f40047c0 msgr2=0x7f39f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:54.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.721+0000 7f3a06ffd640 1 --2- 172.21.15.91:0/693506839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39f40047c0 0x7f39f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.721+0000 7f3a06ffd640 1 -- 172.21.15.91:0/693506839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39f4005380 msgr2=0x7f39f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:54.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.721+0000 7f3a077fe640 1 --2- 172.21.15.91:0/693506839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39f4005380 0x7f39f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.721+0000 7f3a06ffd640 1 --2- 172.21.15.91:0/693506839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39f4005380 0x7f39f400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.721+0000 7f3a06ffd640 1 -- 172.21.15.91:0/693506839 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f4003520 con 0x7f39f4003970 2023-11-27T20:45:54.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.721+0000 7f3a077fe640 1 -- 172.21.15.91:0/693506839 reap_dead start 2023-11-27T20:45:54.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.722+0000 7f3a06ffd640 1 --2- 172.21.15.91:0/693506839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f39f4003d90 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f39f800a830 tx=0x7f39f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45e7b897c89d873 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:54.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.722+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8034630 con 0x7f39f4003970 2023-11-27T20:45:54.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.722+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f802f070 con 0x7f39f4003970 2023-11-27T20:45:54.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.722+0000 7f3a05ffb640 1 -- 172.21.15.91:0/693506839 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8034a30 con 0x7f39f4003970 2023-11-27T20:45:54.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.723+0000 7f3a0d648640 1 -- 172.21.15.91:0/693506839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 msgr2=0x7f39f4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.723+0000 7f3a0d648640 1 --2- 172.21.15.91:0/693506839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f39f4003d90 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f39f800a830 tx=0x7f39f40057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.723+0000 7f3a0d648640 1 -- 172.21.15.91:0/693506839 shutdown_connections 2023-11-27T20:45:54.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.723+0000 7f3a0d648640 1 --2- 172.21.15.91:0/693506839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f39f4003d90 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.723+0000 7f3a0d648640 1 -- 172.21.15.91:0/693506839 >> 172.21.15.91:0/693506839 conn(0x7f3a080c7e30 msgr2=0x7f3a080c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:54.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.723+0000 7f3a0d648640 1 -- 172.21.15.91:0/693506839 shutdown_connections 2023-11-27T20:45:54.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.723+0000 7f3a0d648640 1 -- 172.21.15.91:0/693506839 wait complete. 2023-11-27T20:45:54.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.725+0000 7f3a0d648640 1 Processor -- start 2023-11-27T20:45:54.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.725+0000 7f3a0d648640 1 -- start start 2023-11-27T20:45:54.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a0d648640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f3a081eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a0d648640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a0814aa80 0x7f3a08149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a0d648640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a08149880 0x7f3a0806e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a0d648640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080ab540 con 0x7f39f4003970 2023-11-27T20:45:54.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a0d648640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080700c0 con 0x7f3a08149880 2023-11-27T20:45:54.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a0d648640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080aaca0 con 0x7f3a0814aa80 2023-11-27T20:45:54.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a06ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f3a081eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a06ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f3a081eda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57188/0 (socket says 172.21.15.91:57188) 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a06ffd640 1 -- 172.21.15.91:0/34023428 learned_addr learned my addr 172.21.15.91:0/34023428 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a067fc640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a0814aa80 0x7f3a08149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a06ffd640 1 -- 172.21.15.91:0/34023428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a0814aa80 msgr2=0x7f3a08149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a06ffd640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a0814aa80 0x7f3a08149340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a06ffd640 1 -- 172.21.15.91:0/34023428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a08149880 msgr2=0x7f3a0806e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a06ffd640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a08149880 0x7f3a0806e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.726+0000 7f3a06ffd640 1 -- 172.21.15.91:0/34023428 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080ab260 con 0x7f39f4003970 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.727+0000 7f3a06ffd640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f3a081eda10 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f39f800a0b0 tx=0x7f39f8001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.727+0000 7f39ff7fe640 1 -- 172.21.15.91:0/34023428 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8001460 con 0x7f39f4003970 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.727+0000 7f39ff7fe640 1 -- 172.21.15.91:0/34023428 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f8004b60 con 0x7f39f4003970 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.727+0000 7f39ff7fe640 1 -- 172.21.15.91:0/34023428 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8034430 con 0x7f39f4003970 2023-11-27T20:45:54.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.727+0000 7f3a0d648640 1 -- 172.21.15.91:0/34023428 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a081ee350 con 0x7f39f4003970 2023-11-27T20:45:54.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.727+0000 7f3a0d648640 1 -- 172.21.15.91:0/34023428 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a081570f0 con 0x7f39f4003970 2023-11-27T20:45:54.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.728+0000 7f3a0d648640 1 -- 172.21.15.91:0/34023428 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a08068350 con 0x7f39f4003970 2023-11-27T20:45:54.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.729+0000 7f39ff7fe640 1 -- 172.21.15.91:0/34023428 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f39f8031030 con 0x7f39f4003970 2023-11-27T20:45:54.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.730+0000 7f39ff7fe640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39e806b1f0 0x7f39e806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:54.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.730+0000 7f39ff7fe640 1 -- 172.21.15.91:0/34023428 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f39f80ab950 con 0x7f39f4003970 2023-11-27T20:45:54.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.730+0000 7f3a067fc640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39e806b1f0 0x7f39e806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:54.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.731+0000 7f3a067fc640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39e806b1f0 0x7f39e806d6b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3a080aabc0 tx=0x7f39f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:54.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.734+0000 7f39ff7fe640 1 -- 172.21.15.91:0/34023428 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f39f80762e0 con 0x7f39f4003970 2023-11-27T20:45:54.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.923+0000 7f3a0d648640 1 -- 172.21.15.91:0/34023428 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a080c4220 con 0x7f39f4003970 2023-11-27T20:45:54.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.924+0000 7f39ff7fe640 1 -- 172.21.15.91:0/34023428 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39f8041020 con 0x7f39f4003970 2023-11-27T20:45:54.925 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:54.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 -- 172.21.15.91:0/34023428 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39e806b1f0 msgr2=0x7f39e806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39e806b1f0 0x7f39e806d6b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3a080aabc0 tx=0x7f39f0008040 comp rx=0 tx=0).stop 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 -- 172.21.15.91:0/34023428 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 msgr2=0x7f3a081eda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f3a081eda10 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f39f800a0b0 tx=0x7f39f8001f10 comp rx=0 tx=0).stop 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 -- 172.21.15.91:0/34023428 shutdown_connections 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f39e806b1f0 0x7f39e806d6b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a08149880 0x7f3a0806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a0814aa80 0x7f3a08149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 --2- 172.21.15.91:0/34023428 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39f4003970 0x7f3a081eda10 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 -- 172.21.15.91:0/34023428 >> 172.21.15.91:0/34023428 conn(0x7f3a080c7e30 msgr2=0x7f3a0806cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 -- 172.21.15.91:0/34023428 shutdown_connections 2023-11-27T20:45:54.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:54.927+0000 7f3a0d648640 1 -- 172.21.15.91:0/34023428 wait complete. 2023-11-27T20:45:54.945 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:45:55.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.154+0000 7f0a35002640 1 Processor -- start 2023-11-27T20:45:55.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.154+0000 7f0a35002640 1 -- start start 2023-11-27T20:45:55.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a35002640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0a3014fd30 0x7f0a30152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a35002640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a3006d0a0 0x7f0a300a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a35002640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0a300a5260 0x7f0a300c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a35002640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a300c64a0 con 0x7f0a3014fd30 2023-11-27T20:45:55.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a35002640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a300c5c00 con 0x7f0a300a5260 2023-11-27T20:45:55.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a35002640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300c5ee0 con 0x7f0a3006d0a0 2023-11-27T20:45:55.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a2ed9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0a3014fd30 0x7f0a30152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a2ed9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0a3014fd30 0x7f0a30152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57200/0 (socket says 172.21.15.91:57200) 2023-11-27T20:45:55.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a2ed9d640 1 -- 172.21.15.91:0/3364143164 learned_addr learned my addr 172.21.15.91:0/3364143164 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:55.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a2e59c640 1 --2- 172.21.15.91:0/3364143164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a3006d0a0 0x7f0a300a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.156+0000 7f0a2f59e640 1 --2- 172.21.15.91:0/3364143164 >> v2:172.21.15.183:3300/0 conn(0x7f0a300a5260 0x7f0a300c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.157+0000 7f0a2ed9d640 1 -- 172.21.15.91:0/3364143164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a3006d0a0 msgr2=0x7f0a300a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:55.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.157+0000 7f0a2ed9d640 1 --2- 172.21.15.91:0/3364143164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a3006d0a0 0x7f0a300a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.157+0000 7f0a2ed9d640 1 -- 172.21.15.91:0/3364143164 >> v2:172.21.15.183:3300/0 conn(0x7f0a300a5260 msgr2=0x7f0a300c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:55.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.157+0000 7f0a2ed9d640 1 --2- 172.21.15.91:0/3364143164 >> v2:172.21.15.183:3300/0 conn(0x7f0a300a5260 0x7f0a300c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.157+0000 7f0a2ed9d640 1 -- 172.21.15.91:0/3364143164 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300c61c0 con 0x7f0a3014fd30 2023-11-27T20:45:55.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.158+0000 7f0a2ed9d640 1 --2- 172.21.15.91:0/3364143164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3014fd30 0x7f0a30152f20 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0a3006d990 tx=0x7f0a2002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967703d1e55df696 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:55.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.158+0000 7f0a2dd9b640 1 -- 172.21.15.91:0/3364143164 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20031870 con 0x7f0a3014fd30 2023-11-27T20:45:55.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.158+0000 7f0a2dd9b640 1 -- 172.21.15.91:0/3364143164 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a200319d0 con 0x7f0a3014fd30 2023-11-27T20:45:55.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.158+0000 7f0a2dd9b640 1 -- 172.21.15.91:0/3364143164 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20031d60 con 0x7f0a3014fd30 2023-11-27T20:45:55.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.159+0000 7f0a35002640 1 -- 172.21.15.91:0/3364143164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3014fd30 msgr2=0x7f0a30152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.159+0000 7f0a35002640 1 --2- 172.21.15.91:0/3364143164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3014fd30 0x7f0a30152f20 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0a3006d990 tx=0x7f0a2002b910 comp rx=0 tx=0).stop 2023-11-27T20:45:55.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.159+0000 7f0a35002640 1 -- 172.21.15.91:0/3364143164 shutdown_connections 2023-11-27T20:45:55.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.159+0000 7f0a35002640 1 --2- 172.21.15.91:0/3364143164 >> v2:172.21.15.183:3300/0 conn(0x7f0a300a5260 0x7f0a300c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.159+0000 7f0a35002640 1 --2- 172.21.15.91:0/3364143164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a3006d0a0 0x7f0a300a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.159+0000 7f0a35002640 1 --2- 172.21.15.91:0/3364143164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3014fd30 0x7f0a30152f20 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.159+0000 7f0a35002640 1 -- 172.21.15.91:0/3364143164 >> 172.21.15.91:0/3364143164 conn(0x7f0a3006a500 msgr2=0x7f0a3006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:55.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.159+0000 7f0a35002640 1 -- 172.21.15.91:0/3364143164 shutdown_connections 2023-11-27T20:45:55.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.159+0000 7f0a35002640 1 -- 172.21.15.91:0/3364143164 wait complete. 2023-11-27T20:45:55.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.161+0000 7f0a35002640 1 Processor -- start 2023-11-27T20:45:55.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.161+0000 7f0a35002640 1 -- start start 2023-11-27T20:45:55.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.162+0000 7f0a35002640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3006d0a0 0x7f0a300a8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.162+0000 7f0a35002640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a300a5260 0x7f0a301ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.162+0000 7f0a35002640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a3014fd30 0x7f0a301ee640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.162+0000 7f0a35002640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30153ac0 con 0x7f0a3006d0a0 2023-11-27T20:45:55.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.162+0000 7f0a35002640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a301567a0 con 0x7f0a300a5260 2023-11-27T20:45:55.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.162+0000 7f0a35002640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30150550 con 0x7f0a3014fd30 2023-11-27T20:45:55.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.162+0000 7f0a2ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3006d0a0 0x7f0a300a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.162+0000 7f0a2ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3006d0a0 0x7f0a300a8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57214/0 (socket says 172.21.15.91:57214) 2023-11-27T20:45:55.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.162+0000 7f0a2ed9d640 1 -- 172.21.15.91:0/3761973823 learned_addr learned my addr 172.21.15.91:0/3761973823 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:55.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a2f59e640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a3014fd30 0x7f0a301ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a2e59c640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a300a5260 0x7f0a301ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a2ed9d640 1 -- 172.21.15.91:0/3761973823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a3014fd30 msgr2=0x7f0a301ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a2ed9d640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a3014fd30 0x7f0a301ee640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a2ed9d640 1 -- 172.21.15.91:0/3761973823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a300a5260 msgr2=0x7f0a301ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a2ed9d640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a300a5260 0x7f0a301ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a2ed9d640 1 -- 172.21.15.91:0/3761973823 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a200094d0 con 0x7f0a3006d0a0 2023-11-27T20:45:55.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a2ed9d640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3006d0a0 0x7f0a300a8330 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f0a2002b950 tx=0x7f0a200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:55.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a177fe640 1 -- 172.21.15.91:0/3761973823 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2003ad30 con 0x7f0a3006d0a0 2023-11-27T20:45:55.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a177fe640 1 -- 172.21.15.91:0/3761973823 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a200443f0 con 0x7f0a3006d0a0 2023-11-27T20:45:55.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a177fe640 1 -- 172.21.15.91:0/3761973823 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200447a0 con 0x7f0a3006d0a0 2023-11-27T20:45:55.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.163+0000 7f0a35002640 1 -- 172.21.15.91:0/3761973823 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a301f25e0 con 0x7f0a3006d0a0 2023-11-27T20:45:55.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.164+0000 7f0a35002640 1 -- 172.21.15.91:0/3761973823 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a301f1b00 con 0x7f0a3006d0a0 2023-11-27T20:45:55.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.165+0000 7f0a35002640 1 -- 172.21.15.91:0/3761973823 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a300a4510 con 0x7f0a3006d0a0 2023-11-27T20:45:55.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.165+0000 7f0a177fe640 1 -- 172.21.15.91:0/3761973823 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0a2004d450 con 0x7f0a3006d0a0 2023-11-27T20:45:55.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.166+0000 7f0a177fe640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0a1c06b1c0 0x7f0a1c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.166+0000 7f0a177fe640 1 -- 172.21.15.91:0/3761973823 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f0a2002d040 con 0x7f0a3006d0a0 2023-11-27T20:45:55.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.167+0000 7f0a2e59c640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0a1c06b1c0 0x7f0a1c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.167+0000 7f0a2e59c640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0a1c06b1c0 0x7f0a1c06d680 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0a30150d40 tx=0x7f0a24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:55.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.171+0000 7f0a177fe640 1 -- 172.21.15.91:0/3761973823 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0a300a4510 con 0x7f0a3006d0a0 2023-11-27T20:45:55.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.359+0000 7f0a35002640 1 -- 172.21.15.91:0/3761973823 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a300a4510 con 0x7f0a3006d0a0 2023-11-27T20:45:55.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.360+0000 7f0a177fe640 1 -- 172.21.15.91:0/3761973823 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v81) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0a300a4510 con 0x7f0a3006d0a0 2023-11-27T20:45:55.361 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:45:55.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.362+0000 7f0a35002640 1 -- 172.21.15.91:0/3761973823 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0a1c06b1c0 msgr2=0x7f0a1c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.362+0000 7f0a35002640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0a1c06b1c0 0x7f0a1c06d680 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0a30150d40 tx=0x7f0a24008040 comp rx=0 tx=0).stop 2023-11-27T20:45:55.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.363+0000 7f0a35002640 1 -- 172.21.15.91:0/3761973823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3006d0a0 msgr2=0x7f0a300a8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.363+0000 7f0a35002640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3006d0a0 0x7f0a300a8330 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f0a2002b950 tx=0x7f0a200046c0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.363+0000 7f0a35002640 1 -- 172.21.15.91:0/3761973823 shutdown_connections 2023-11-27T20:45:55.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.363+0000 7f0a35002640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a3014fd30 0x7f0a301ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.363+0000 7f0a35002640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0a1c06b1c0 0x7f0a1c06d680 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.363+0000 7f0a35002640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a300a5260 0x7f0a301ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.363+0000 7f0a35002640 1 --2- 172.21.15.91:0/3761973823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a3006d0a0 0x7f0a300a8330 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.363+0000 7f0a35002640 1 -- 172.21.15.91:0/3761973823 >> 172.21.15.91:0/3761973823 conn(0x7f0a3006a500 msgr2=0x7f0a30151750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:55.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.363+0000 7f0a35002640 1 -- 172.21.15.91:0/3761973823 shutdown_connections 2023-11-27T20:45:55.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.363+0000 7f0a35002640 1 -- 172.21.15.91:0/3761973823 wait complete. 2023-11-27T20:45:55.383 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:45:55.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.600+0000 7f3e32e4f640 1 Processor -- start 2023-11-27T20:45:55.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.601+0000 7f3e32e4f640 1 -- start start 2023-11-27T20:45:55.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.602+0000 7f3e32e4f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3e2c06d0a0 0x7f3e2c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.602+0000 7f3e32e4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2c0c3ea0 0x7f3e2c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.602+0000 7f3e32e4f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c0c64a0 con 0x7f3e2c14fd30 2023-11-27T20:45:55.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.602+0000 7f3e32e4f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c0c5c00 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.602+0000 7f3e32e4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0c5ee0 con 0x7f3e2c0c3ea0 2023-11-27T20:45:55.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.602+0000 7f3e30beb640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f3e2c14fd30 0x7f3e2c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59846/0 (socket says 172.21.15.91:59846) 2023-11-27T20:45:55.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.602+0000 7f3e30beb640 1 -- 172.21.15.91:0/750242467 learned_addr learned my addr 172.21.15.91:0/750242467 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:55.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.603+0000 7f3e2bfff640 1 --2- 172.21.15.91:0/750242467 >> v2:172.21.15.91:3300/0 conn(0x7f3e2c06d0a0 0x7f3e2c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.603+0000 7f3e313ec640 1 --2- 172.21.15.91:0/750242467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2c0c3ea0 0x7f3e2c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.603+0000 7f3e2bfff640 1 -- 172.21.15.91:0/750242467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2c0c3ea0 msgr2=0x7f3e2c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:55.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.603+0000 7f3e2bfff640 1 --2- 172.21.15.91:0/750242467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2c0c3ea0 0x7f3e2c0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.603+0000 7f3e2bfff640 1 -- 172.21.15.91:0/750242467 >> v1:172.21.15.91:6789/0 conn(0x7f3e2c14fd30 legacy=0x7f3e2c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.603+0000 7f3e2bfff640 1 -- 172.21.15.91:0/750242467 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c0c61c0 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.604+0000 7f3e2bfff640 1 --2- 172.21.15.91:0/750242467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 0x7f3e2c152f20 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f3e140097a0 tx=0x7f3e1402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3025f789d8a5e094 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:55.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e2b7fe640 1 -- 172.21.15.91:0/750242467 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1402d040 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e2b7fe640 1 -- 172.21.15.91:0/750242467 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14031810 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e2b7fe640 1 -- 172.21.15.91:0/750242467 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14031ba0 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e32e4f640 1 -- 172.21.15.91:0/750242467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 msgr2=0x7f3e2c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e32e4f640 1 --2- 172.21.15.91:0/750242467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 0x7f3e2c152f20 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f3e140097a0 tx=0x7f3e1402b8b0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e32e4f640 1 -- 172.21.15.91:0/750242467 shutdown_connections 2023-11-27T20:45:55.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e32e4f640 1 --2- 172.21.15.91:0/750242467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2c0c3ea0 0x7f3e2c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e32e4f640 1 --2- 172.21.15.91:0/750242467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 0x7f3e2c152f20 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e32e4f640 1 -- 172.21.15.91:0/750242467 >> 172.21.15.91:0/750242467 conn(0x7f3e2c06a500 msgr2=0x7f3e2c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:55.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e32e4f640 1 -- 172.21.15.91:0/750242467 shutdown_connections 2023-11-27T20:45:55.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.605+0000 7f3e32e4f640 1 -- 172.21.15.91:0/750242467 wait complete. 2023-11-27T20:45:55.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.607+0000 7f3e32e4f640 1 Processor -- start 2023-11-27T20:45:55.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.607+0000 7f3e32e4f640 1 -- start start 2023-11-27T20:45:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.608+0000 7f3e32e4f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 0x7f3e2c1ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.608+0000 7f3e32e4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2c0c3ea0 0x7f3e2c0a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.608+0000 7f3e32e4f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e2c14fd30 0x7f3e2c0aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.608+0000 7f3e32e4f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c154ee0 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.608+0000 7f3e32e4f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c154350 con 0x7f3e2c14fd30 2023-11-27T20:45:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.608+0000 7f3e32e4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c153b40 con 0x7f3e2c0c3ea0 2023-11-27T20:45:55.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e30beb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 0x7f3e2c1ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e30beb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 0x7f3e2c1ed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57232/0 (socket says 172.21.15.91:57232) 2023-11-27T20:45:55.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e30beb640 1 -- 172.21.15.91:0/909367149 learned_addr learned my addr 172.21.15.91:0/909367149 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:55.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e2bfff640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2c0c3ea0 0x7f3e2c0a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e30beb640 1 -- 172.21.15.91:0/909367149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2c0c3ea0 msgr2=0x7f3e2c0a9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e30beb640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2c0c3ea0 0x7f3e2c0a9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e30beb640 1 -- 172.21.15.91:0/909367149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e2c14fd30 msgr2=0x7f3e2c0aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e30beb640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e2c14fd30 0x7f3e2c0aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e30beb640 1 -- 172.21.15.91:0/909367149 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e14009400 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e30beb640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 0x7f3e2c1ed710 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00cbd0 tx=0x7f3e1c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:55.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.609+0000 7f3e297fa640 1 -- 172.21.15.91:0/909367149 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00ace0 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.610+0000 7f3e297fa640 1 -- 172.21.15.91:0/909367149 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00ae40 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.610+0000 7f3e297fa640 1 -- 172.21.15.91:0/909367149 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c012600 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.610+0000 7f3e32e4f640 1 -- 172.21.15.91:0/909367149 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c1ee220 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.610+0000 7f3e32e4f640 1 -- 172.21.15.91:0/909367149 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c154070 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.611+0000 7f3e32e4f640 1 -- 172.21.15.91:0/909367149 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c068350 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.612+0000 7f3e297fa640 1 -- 172.21.15.91:0/909367149 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3e1c007070 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.612+0000 7f3e297fa640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e0c06b1f0 0x7f3e0c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:55.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.613+0000 7f3e297fa640 1 -- 172.21.15.91:0/909367149 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f3e1c089e40 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.613+0000 7f3e2bfff640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e0c06b1f0 0x7f3e0c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:55.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.614+0000 7f3e2bfff640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e0c06b1f0 0x7f3e0c06d6b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3e14036000 tx=0x7f3e1403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:55.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.618+0000 7f3e297fa640 1 -- 172.21.15.91:0/909367149 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3e1c054880 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.806+0000 7f3e32e4f640 1 -- 172.21.15.91:0/909367149 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3e2c06df80 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.807+0000 7f3e297fa640 1 -- 172.21.15.91:0/909367149 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v81) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3e1c017020 con 0x7f3e2c06d0a0 2023-11-27T20:45:55.808 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:45:55.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.809+0000 7f3e32e4f640 1 -- 172.21.15.91:0/909367149 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e0c06b1f0 msgr2=0x7f3e0c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.809+0000 7f3e32e4f640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e0c06b1f0 0x7f3e0c06d6b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3e14036000 tx=0x7f3e1403c040 comp rx=0 tx=0).stop 2023-11-27T20:45:55.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.809+0000 7f3e32e4f640 1 -- 172.21.15.91:0/909367149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 msgr2=0x7f3e2c1ed710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:55.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.810+0000 7f3e32e4f640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 0x7f3e2c1ed710 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00cbd0 tx=0x7f3e1c00a430 comp rx=0 tx=0).stop 2023-11-27T20:45:55.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.810+0000 7f3e32e4f640 1 -- 172.21.15.91:0/909367149 shutdown_connections 2023-11-27T20:45:55.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.810+0000 7f3e32e4f640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3e0c06b1f0 0x7f3e0c06d6b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.810+0000 7f3e32e4f640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e2c14fd30 0x7f3e2c0aa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.810+0000 7f3e32e4f640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2c0c3ea0 0x7f3e2c0a9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.810+0000 7f3e32e4f640 1 --2- 172.21.15.91:0/909367149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e2c06d0a0 0x7f3e2c1ed710 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:55.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.810+0000 7f3e32e4f640 1 -- 172.21.15.91:0/909367149 >> 172.21.15.91:0/909367149 conn(0x7f3e2c06a500 msgr2=0x7f3e2c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:55.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.810+0000 7f3e32e4f640 1 -- 172.21.15.91:0/909367149 shutdown_connections 2023-11-27T20:45:55.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:55.810+0000 7f3e32e4f640 1 -- 172.21.15.91:0/909367149 wait complete. 2023-11-27T20:45:55.828 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:45:56.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.044+0000 7f860b84f640 1 Processor -- start 2023-11-27T20:45:56.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.044+0000 7f860b84f640 1 -- start start 2023-11-27T20:45:56.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.046+0000 7f860b84f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f86040c5ec0 0x7f86040c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.046+0000 7f860b84f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f86040721a0 0x7f86040c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.046+0000 7f860b84f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86040bfdc0 con 0x7f86040c45d0 2023-11-27T20:45:56.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.046+0000 7f860b84f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860406e390 con 0x7f86040721a0 2023-11-27T20:45:56.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.046+0000 7f860b84f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860406ddd0 con 0x7f86040c5ec0 2023-11-27T20:45:56.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.046+0000 7f8608dea640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f86040c45d0 0x7f8604155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59862/0 (socket says 172.21.15.91:59862) 2023-11-27T20:45:56.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.046+0000 7f8608dea640 1 -- 172.21.15.91:0/2009867144 learned_addr learned my addr 172.21.15.91:0/2009867144 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:56.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.046+0000 7f8609dec640 1 --2- 172.21.15.91:0/2009867144 >> v2:172.21.15.91:3300/0 conn(0x7f86040721a0 0x7f86040c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.046+0000 7f86095eb640 1 --2- 172.21.15.91:0/2009867144 >> v2:172.21.15.183:3300/0 conn(0x7f86040c5ec0 0x7f86040c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.047+0000 7f8609dec640 1 -- 172.21.15.91:0/2009867144 >> v2:172.21.15.183:3300/0 conn(0x7f86040c5ec0 msgr2=0x7f86040c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:56.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.047+0000 7f8609dec640 1 --2- 172.21.15.91:0/2009867144 >> v2:172.21.15.183:3300/0 conn(0x7f86040c5ec0 0x7f86040c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.047+0000 7f8609dec640 1 -- 172.21.15.91:0/2009867144 >> v1:172.21.15.91:6789/0 conn(0x7f86040c45d0 legacy=0x7f8604155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.047+0000 7f8609dec640 1 -- 172.21.15.91:0/2009867144 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860406e0b0 con 0x7f86040721a0 2023-11-27T20:45:56.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.048+0000 7f8609dec640 1 --2- 172.21.15.91:0/2009867144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040721a0 0x7f86040c3170 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009d90 tx=0x7f85fc02bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c35bed38831bf00 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:56.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.048+0000 7f85fbfff640 1 -- 172.21.15.91:0/2009867144 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc02cb40 con 0x7f86040721a0 2023-11-27T20:45:56.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.048+0000 7f85fbfff640 1 -- 172.21.15.91:0/2009867144 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc02cca0 con 0x7f86040721a0 2023-11-27T20:45:56.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.048+0000 7f85fbfff640 1 -- 172.21.15.91:0/2009867144 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc034660 con 0x7f86040721a0 2023-11-27T20:45:56.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.049+0000 7f860b84f640 1 -- 172.21.15.91:0/2009867144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040721a0 msgr2=0x7f86040c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.049+0000 7f860b84f640 1 --2- 172.21.15.91:0/2009867144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040721a0 0x7f86040c3170 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009d90 tx=0x7f85fc02bd90 comp rx=0 tx=0).stop 2023-11-27T20:45:56.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.049+0000 7f860b84f640 1 -- 172.21.15.91:0/2009867144 shutdown_connections 2023-11-27T20:45:56.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.049+0000 7f860b84f640 1 --2- 172.21.15.91:0/2009867144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040721a0 0x7f86040c3170 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.049+0000 7f860b84f640 1 --2- 172.21.15.91:0/2009867144 >> v2:172.21.15.183:3300/0 conn(0x7f86040c5ec0 0x7f86040c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.049+0000 7f860b84f640 1 -- 172.21.15.91:0/2009867144 >> 172.21.15.91:0/2009867144 conn(0x7f860406a500 msgr2=0x7f860406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:56.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.049+0000 7f860b84f640 1 -- 172.21.15.91:0/2009867144 shutdown_connections 2023-11-27T20:45:56.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.049+0000 7f860b84f640 1 -- 172.21.15.91:0/2009867144 wait complete. 2023-11-27T20:45:56.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.051+0000 7f860b84f640 1 Processor -- start 2023-11-27T20:45:56.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.051+0000 7f860b84f640 1 -- start start 2023-11-27T20:45:56.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.052+0000 7f860b84f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86040721a0 0x7f8604158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.052+0000 7f860b84f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040c45d0 0x7f860414fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.052+0000 7f860b84f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86040c5ec0 0x7f860414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.052+0000 7f860b84f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604157840 con 0x7f86040c45d0 2023-11-27T20:45:56.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.052+0000 7f860b84f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604157e00 con 0x7f86040721a0 2023-11-27T20:45:56.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.052+0000 7f860b84f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8604150490 con 0x7f86040c5ec0 2023-11-27T20:45:56.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f8608dea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040c45d0 0x7f860414fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f8608dea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040c45d0 0x7f860414fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57248/0 (socket says 172.21.15.91:57248) 2023-11-27T20:45:56.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f8608dea640 1 -- 172.21.15.91:0/1895922997 learned_addr learned my addr 172.21.15.91:0/1895922997 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f86095eb640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86040721a0 0x7f8604158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f8609dec640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86040c5ec0 0x7f860414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f8608dea640 1 -- 172.21.15.91:0/1895922997 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86040c5ec0 msgr2=0x7f860414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f8608dea640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86040c5ec0 0x7f860414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f8608dea640 1 -- 172.21.15.91:0/1895922997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86040721a0 msgr2=0x7f8604158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f8608dea640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86040721a0 0x7f8604158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f8608dea640 1 -- 172.21.15.91:0/1895922997 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc009a70 con 0x7f86040c45d0 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.053+0000 7f8608dea640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040c45d0 0x7f860414fa10 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c530 tx=0x7f85f400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.054+0000 7f85f9ffb640 1 -- 172.21.15.91:0/1895922997 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4005ce0 con 0x7f86040c45d0 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.054+0000 7f85f9ffb640 1 -- 172.21.15.91:0/1895922997 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f4005e40 con 0x7f86040c45d0 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.054+0000 7f85f9ffb640 1 -- 172.21.15.91:0/1895922997 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4007270 con 0x7f86040c45d0 2023-11-27T20:45:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.054+0000 7f860b84f640 1 -- 172.21.15.91:0/1895922997 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8604155de0 con 0x7f86040c45d0 2023-11-27T20:45:56.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.054+0000 7f860b84f640 1 -- 172.21.15.91:0/1895922997 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8604157a90 con 0x7f86040c45d0 2023-11-27T20:45:56.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.055+0000 7f860b84f640 1 -- 172.21.15.91:0/1895922997 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8604157f70 con 0x7f86040c45d0 2023-11-27T20:45:56.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.056+0000 7f85f9ffb640 1 -- 172.21.15.91:0/1895922997 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f85f40073d0 con 0x7f86040c45d0 2023-11-27T20:45:56.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.057+0000 7f85f9ffb640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f85e806b1c0 0x7f85e806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.057+0000 7f85f9ffb640 1 -- 172.21.15.91:0/1895922997 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f85f4089220 con 0x7f86040c45d0 2023-11-27T20:45:56.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.058+0000 7f86095eb640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f85e806b1c0 0x7f85e806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.058+0000 7f86095eb640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f85e806b1c0 0x7f85e806d680 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8600006fd0 tx=0x7f8600008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:56.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.062+0000 7f85f9ffb640 1 -- 172.21.15.91:0/1895922997 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f85f4053c60 con 0x7f86040c45d0 2023-11-27T20:45:56.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.290+0000 7f860b84f640 1 -- 172.21.15.91:0/1895922997 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8604068350 con 0x7f86040c45d0 2023-11-27T20:45:56.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.291+0000 7f85f9ffb640 1 -- 172.21.15.91:0/1895922997 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6140 (secure 0 0 0) 0x7f85f4057280 con 0x7f86040c45d0 2023-11-27T20:45:56.292 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:56.292 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:06.072742+0000","modified":"2023-11-27T20:45:09.133844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/2103536114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":2103536114},{"type":"v1","addr":"172.21.15.183:6835","nonce":2103536114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:21.787805+0000","modified":"2023-11-27T20:45:24.857169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/1761528163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1761528163},{"type":"v1","addr":"172.21.15.91:6837","nonce":1761528163}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-27T20:45:56.292 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 51 2023-11-27T20:45:56.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 -- 172.21.15.91:0/1895922997 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f85e806b1c0 msgr2=0x7f85e806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f85e806b1c0 0x7f85e806d680 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8600006fd0 tx=0x7f8600008040 comp rx=0 tx=0).stop 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 -- 172.21.15.91:0/1895922997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040c45d0 msgr2=0x7f860414fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040c45d0 0x7f860414fa10 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c530 tx=0x7f85f400c9f0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 -- 172.21.15.91:0/1895922997 shutdown_connections 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86040c5ec0 0x7f860414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86040c45d0 0x7f860414fa10 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f85e806b1c0 0x7f85e806d680 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 --2- 172.21.15.91:0/1895922997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86040721a0 0x7f8604158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 -- 172.21.15.91:0/1895922997 >> 172.21.15.91:0/1895922997 conn(0x7f860406a500 msgr2=0x7f86040c2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 -- 172.21.15.91:0/1895922997 shutdown_connections 2023-11-27T20:45:56.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.294+0000 7f860b84f640 1 -- 172.21.15.91:0/1895922997 wait complete. 2023-11-27T20:45:56.314 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:56.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.523+0000 7fcb5d339640 1 Processor -- start 2023-11-27T20:45:56.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.523+0000 7fcb5d339640 1 -- start start 2023-11-27T20:45:56.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.524+0000 7fcb5d339640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb58155490 0x7fcb580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.524+0000 7fcb5d339640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcb580a9b40 0x7fcb580c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.524+0000 7fcb5d339640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb580c06c0 con 0x7fcb580c1500 2023-11-27T20:45:56.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.524+0000 7fcb5d339640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb580a5820 con 0x7fcb580a9b40 2023-11-27T20:45:56.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.524+0000 7fcb5d339640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580c1020 con 0x7fcb58155490 2023-11-27T20:45:56.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.525+0000 7fcb567fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fcb580c1500 0x7fcb580a9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59870/0 (socket says 172.21.15.91:59870) 2023-11-27T20:45:56.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.525+0000 7fcb567fc640 1 -- 172.21.15.91:0/1805420776 learned_addr learned my addr 172.21.15.91:0/1805420776 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:56.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.525+0000 7fcb56ffd640 1 --2- 172.21.15.91:0/1805420776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb58155490 0x7fcb580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.525+0000 7fcb577fe640 1 --2- 172.21.15.91:0/1805420776 >> v2:172.21.15.183:3300/0 conn(0x7fcb580a9b40 0x7fcb580c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.525+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457132916 0 0) 0x7fcb580c06c0 con 0x7fcb580c1500 2023-11-27T20:45:56.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.525+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb40003520 con 0x7fcb580c1500 2023-11-27T20:45:56.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.525+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2579700669 0 0) 0x7fcb40003520 con 0x7fcb580c1500 2023-11-27T20:45:56.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.525+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb58155490 msgr2=0x7fcb580a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:56.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.525+0000 7fcb55ffb640 1 --2- 172.21.15.91:0/1805420776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb58155490 0x7fcb580a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 >> v2:172.21.15.183:3300/0 conn(0x7fcb580a9b40 msgr2=0x7fcb580c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:56.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 --2- 172.21.15.91:0/1805420776 >> v2:172.21.15.183:3300/0 conn(0x7fcb580a9b40 0x7fcb580c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580c0910 con 0x7fcb580c1500 2023-11-27T20:45:56.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fcb4c001670 con 0x7fcb580c1500 2023-11-27T20:45:56.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 >> v1:172.21.15.91:6789/0 conn(0x7fcb580c1500 legacy=0x7fcb580a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 --2- 172.21.15.91:0/1805420776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb40003970 0x7fcb40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 --2- 172.21.15.91:0/1805420776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb400047c0 0x7fcb40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 --2- 172.21.15.91:0/1805420776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb58155490 0x7fcb40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580c1020 con 0x7fcb40003970 2023-11-27T20:45:56.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4000db90 con 0x7fcb400047c0 2023-11-27T20:45:56.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4000dcd0 con 0x7fcb58155490 2023-11-27T20:45:56.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb56ffd640 1 --2- 172.21.15.91:0/1805420776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb40003970 0x7fcb40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb56ffd640 1 -- 172.21.15.91:0/1805420776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb58155490 msgr2=0x7fcb40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:56.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb56ffd640 1 --2- 172.21.15.91:0/1805420776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb58155490 0x7fcb40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb56ffd640 1 -- 172.21.15.91:0/1805420776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb400047c0 msgr2=0x7fcb40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:56.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb56ffd640 1 --2- 172.21.15.91:0/1805420776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb400047c0 0x7fcb40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.526+0000 7fcb56ffd640 1 -- 172.21.15.91:0/1805420776 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40003520 con 0x7fcb40003970 2023-11-27T20:45:56.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.527+0000 7fcb56ffd640 1 --2- 172.21.15.91:0/1805420776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb40003970 0x7fcb40003d90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009ac0 tx=0x7fcb400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3f7ff6d4da353a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.528+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4802c710 con 0x7fcb40003970 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.528+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4802c870 con 0x7fcb40003970 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.528+0000 7fcb55ffb640 1 -- 172.21.15.91:0/1805420776 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4802cc00 con 0x7fcb40003970 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.528+0000 7fcb5d339640 1 -- 172.21.15.91:0/1805420776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb40003970 msgr2=0x7fcb40003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.528+0000 7fcb5d339640 1 --2- 172.21.15.91:0/1805420776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb40003970 0x7fcb40003d90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009ac0 tx=0x7fcb400057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.528+0000 7fcb577fe640 1 -- 172.21.15.91:0/1805420776 reap_dead start 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.528+0000 7fcb5d339640 1 -- 172.21.15.91:0/1805420776 shutdown_connections 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.528+0000 7fcb5d339640 1 -- 172.21.15.91:0/1805420776 >> 172.21.15.91:0/1805420776 conn(0x7fcb5806a500 msgr2=0x7fcb5806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.528+0000 7fcb5d339640 1 -- 172.21.15.91:0/1805420776 shutdown_connections 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.528+0000 7fcb5d339640 1 -- 172.21.15.91:0/1805420776 wait complete. 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.530+0000 7fcb5d339640 1 Processor -- start 2023-11-27T20:45:56.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.530+0000 7fcb5d339640 1 -- start start 2023-11-27T20:45:56.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.531+0000 7fcb5d339640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb40003970 0x7fcb580bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.531+0000 7fcb5d339640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb580bd8c0 0x7fcb5809a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.531+0000 7fcb5d339640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5809ab90 0x7fcb58150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.531+0000 7fcb5d339640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580be6d0 con 0x7fcb580bd8c0 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.531+0000 7fcb5d339640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580bde30 con 0x7fcb5809ab90 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.531+0000 7fcb5d339640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580be110 con 0x7fcb40003970 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.531+0000 7fcb567fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb580bd8c0 0x7fcb5809a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.531+0000 7fcb567fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb580bd8c0 0x7fcb5809a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57264/0 (socket says 172.21.15.91:57264) 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.531+0000 7fcb567fc640 1 -- 172.21.15.91:0/3416718840 learned_addr learned my addr 172.21.15.91:0/3416718840 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb567fc640 1 -- 172.21.15.91:0/3416718840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb40003970 msgr2=0x7fcb580bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb56ffd640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb40003970 0x7fcb580bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb567fc640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb40003970 0x7fcb580bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb567fc640 1 -- 172.21.15.91:0/3416718840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5809ab90 msgr2=0x7fcb58150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb577fe640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5809ab90 0x7fcb58150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb567fc640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5809ab90 0x7fcb58150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb567fc640 1 -- 172.21.15.91:0/3416718840 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580be3f0 con 0x7fcb580bd8c0 2023-11-27T20:45:56.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb577fe640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5809ab90 0x7fcb58150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:56.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb567fc640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb580bd8c0 0x7fcb5809a650 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00c7a0 tx=0x7fcb4c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:56.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb3f7fe640 1 -- 172.21.15.91:0/3416718840 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0074e0 con 0x7fcb580bd8c0 2023-11-27T20:45:56.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb3f7fe640 1 -- 172.21.15.91:0/3416718840 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c007660 con 0x7fcb580bd8c0 2023-11-27T20:45:56.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb3f7fe640 1 -- 172.21.15.91:0/3416718840 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c004a20 con 0x7fcb580bd8c0 2023-11-27T20:45:56.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.532+0000 7fcb5d339640 1 -- 172.21.15.91:0/3416718840 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5809a130 con 0x7fcb580bd8c0 2023-11-27T20:45:56.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.533+0000 7fcb5d339640 1 -- 172.21.15.91:0/3416718840 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb580beb00 con 0x7fcb580bd8c0 2023-11-27T20:45:56.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.534+0000 7fcb5d339640 1 -- 172.21.15.91:0/3416718840 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb58068350 con 0x7fcb580bd8c0 2023-11-27T20:45:56.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.535+0000 7fcb3f7fe640 1 -- 172.21.15.91:0/3416718840 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcb4c004b80 con 0x7fcb580bd8c0 2023-11-27T20:45:56.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.536+0000 7fcb3f7fe640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcb4406b1f0 0x7fcb4406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.536+0000 7fcb3f7fe640 1 -- 172.21.15.91:0/3416718840 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fcb4c0892b0 con 0x7fcb580bd8c0 2023-11-27T20:45:56.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.536+0000 7fcb56ffd640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcb4406b1f0 0x7fcb4406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.536+0000 7fcb56ffd640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcb4406b1f0 0x7fcb4406d6b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcb48036000 tx=0x7fcb48030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:56.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.540+0000 7fcb3f7fe640 1 -- 172.21.15.91:0/3416718840 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcb4c053c40 con 0x7fcb580bd8c0 2023-11-27T20:45:56.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.729+0000 7fcb5d339640 1 -- 172.21.15.91:0/3416718840 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb580ab270 con 0x7fcb580bd8c0 2023-11-27T20:45:56.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.733+0000 7fcb3f7fe640 1 -- 172.21.15.91:0/3416718840 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20276 (secure 0 0 0) 0x7fcb4c057260 con 0x7fcb580bd8c0 2023-11-27T20:45:56.734 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:56.734 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":81,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:23.334850+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:56.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 -- 172.21.15.91:0/3416718840 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcb4406b1f0 msgr2=0x7fcb4406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcb4406b1f0 0x7fcb4406d6b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcb48036000 tx=0x7fcb48030000 comp rx=0 tx=0).stop 2023-11-27T20:45:56.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 -- 172.21.15.91:0/3416718840 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb580bd8c0 msgr2=0x7fcb5809a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb580bd8c0 0x7fcb5809a650 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00c7a0 tx=0x7fcb4c00cc60 comp rx=0 tx=0).stop 2023-11-27T20:45:56.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 -- 172.21.15.91:0/3416718840 shutdown_connections 2023-11-27T20:45:56.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcb4406b1f0 0x7fcb4406d6b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb5809ab90 0x7fcb58150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb580bd8c0 0x7fcb5809a650 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 --2- 172.21.15.91:0/3416718840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb40003970 0x7fcb580bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 -- 172.21.15.91:0/3416718840 >> 172.21.15.91:0/3416718840 conn(0x7fcb5806a500 msgr2=0x7fcb580aa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:56.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 -- 172.21.15.91:0/3416718840 shutdown_connections 2023-11-27T20:45:56.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.736+0000 7fcb5d339640 1 -- 172.21.15.91:0/3416718840 wait complete. 2023-11-27T20:45:56.756 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-27T20:45:56.757 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:45:56.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.966+0000 7fdc3b3e5640 1 Processor -- start 2023-11-27T20:45:56.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.966+0000 7fdc3b3e5640 1 -- start start 2023-11-27T20:45:56.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.967+0000 7fdc3b3e5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdc34155490 0x7fdc340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.967+0000 7fdc3b3e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdc340c1500 0x7fdc340a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.967+0000 7fdc3b3e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc340c4080 0x7fdc340a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc3b3e5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc340a5820 con 0x7fdc34155490 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc3b3e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc340c06c0 con 0x7fdc340c1500 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc3b3e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340c1020 con 0x7fdc340c4080 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc39181640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdc34155490 0x7fdc340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc39181640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdc34155490 0x7fdc340a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57268/0 (socket says 172.21.15.91:57268) 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc39181640 1 -- 172.21.15.91:0/1865455630 learned_addr learned my addr 172.21.15.91:0/1865455630 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc39181640 1 -- 172.21.15.91:0/1865455630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc340c4080 msgr2=0x7fdc340a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc39181640 1 --2- 172.21.15.91:0/1865455630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc340c4080 0x7fdc340a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc39181640 1 -- 172.21.15.91:0/1865455630 >> v2:172.21.15.183:3300/0 conn(0x7fdc340c1500 msgr2=0x7fdc340a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:56.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc39181640 1 --2- 172.21.15.91:0/1865455630 >> v2:172.21.15.183:3300/0 conn(0x7fdc340c1500 0x7fdc340a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.968+0000 7fdc39181640 1 -- 172.21.15.91:0/1865455630 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340c0910 con 0x7fdc34155490 2023-11-27T20:45:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.969+0000 7fdc39181640 1 --2- 172.21.15.91:0/1865455630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc34155490 0x7fdc340a51b0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fdc340a5160 tx=0x7fdc3002da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1695032647aff572 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc2bfff640 1 -- 172.21.15.91:0/1865455630 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3002f850 con 0x7fdc34155490 2023-11-27T20:45:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc2bfff640 1 -- 172.21.15.91:0/1865455630 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3002f9b0 con 0x7fdc34155490 2023-11-27T20:45:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc2bfff640 1 -- 172.21.15.91:0/1865455630 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3002fd40 con 0x7fdc34155490 2023-11-27T20:45:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/1865455630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc34155490 msgr2=0x7fdc340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc3b3e5640 1 --2- 172.21.15.91:0/1865455630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc34155490 0x7fdc340a51b0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fdc340a5160 tx=0x7fdc3002da90 comp rx=0 tx=0).stop 2023-11-27T20:45:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/1865455630 shutdown_connections 2023-11-27T20:45:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc3b3e5640 1 --2- 172.21.15.91:0/1865455630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc340c4080 0x7fdc340a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc3b3e5640 1 --2- 172.21.15.91:0/1865455630 >> v2:172.21.15.183:3300/0 conn(0x7fdc340c1500 0x7fdc340a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc3b3e5640 1 --2- 172.21.15.91:0/1865455630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc34155490 0x7fdc340a51b0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/1865455630 >> 172.21.15.91:0/1865455630 conn(0x7fdc3406a500 msgr2=0x7fdc3406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:56.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/1865455630 shutdown_connections 2023-11-27T20:45:56.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.970+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/1865455630 wait complete. 2023-11-27T20:45:56.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.972+0000 7fdc3b3e5640 1 Processor -- start 2023-11-27T20:45:56.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.972+0000 7fdc3b3e5640 1 -- start start 2023-11-27T20:45:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.973+0000 7fdc3b3e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc340c1500 0x7fdc34070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.973+0000 7fdc3b3e5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc340c4080 0x7fdc34149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.973+0000 7fdc3b3e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc34155490 0x7fdc34149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.973+0000 7fdc3b3e5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3414a880 con 0x7fdc340c4080 2023-11-27T20:45:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.973+0000 7fdc3b3e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34151dc0 con 0x7fdc340c1500 2023-11-27T20:45:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.973+0000 7fdc3b3e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3414ab00 con 0x7fdc34155490 2023-11-27T20:45:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc38980640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc340c4080 0x7fdc34149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc38980640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc340c4080 0x7fdc34149a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57280/0 (socket says 172.21.15.91:57280) 2023-11-27T20:45:56.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc38980640 1 -- 172.21.15.91:0/3893509747 learned_addr learned my addr 172.21.15.91:0/3893509747 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:56.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc39181640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc340c1500 0x7fdc34070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc39982640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc34155490 0x7fdc34149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc38980640 1 -- 172.21.15.91:0/3893509747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc34155490 msgr2=0x7fdc34149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc38980640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc34155490 0x7fdc34149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc38980640 1 -- 172.21.15.91:0/3893509747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc340c1500 msgr2=0x7fdc34070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc38980640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc340c1500 0x7fdc34070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc38980640 1 -- 172.21.15.91:0/3893509747 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300094d0 con 0x7fdc340c4080 2023-11-27T20:45:56.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc39982640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc34155490 0x7fdc34149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:45:56.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc39181640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc340c1500 0x7fdc34070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:45:56.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.974+0000 7fdc38980640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc340c4080 0x7fdc34149a60 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400b4a0 tx=0x7fdc2400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:56.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.975+0000 7fdc29ffb640 1 -- 172.21.15.91:0/3893509747 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24010610 con 0x7fdc340c4080 2023-11-27T20:45:56.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.975+0000 7fdc29ffb640 1 -- 172.21.15.91:0/3893509747 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24010770 con 0x7fdc340c4080 2023-11-27T20:45:56.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.975+0000 7fdc29ffb640 1 -- 172.21.15.91:0/3893509747 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24010b20 con 0x7fdc340c4080 2023-11-27T20:45:56.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.975+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/3893509747 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc340a5590 con 0x7fdc340c4080 2023-11-27T20:45:56.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.975+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/3893509747 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3414f0c0 con 0x7fdc340c4080 2023-11-27T20:45:56.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.976+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/3893509747 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc34068350 con 0x7fdc340c4080 2023-11-27T20:45:56.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.977+0000 7fdc29ffb640 1 -- 172.21.15.91:0/3893509747 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdc24010c80 con 0x7fdc340c4080 2023-11-27T20:45:56.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.978+0000 7fdc29ffb640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc1806b1c0 0x7fdc1806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:56.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.978+0000 7fdc29ffb640 1 -- 172.21.15.91:0/3893509747 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fdc240897e0 con 0x7fdc340c4080 2023-11-27T20:45:56.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.978+0000 7fdc39181640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc1806b1c0 0x7fdc1806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:56.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.978+0000 7fdc39181640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc1806b1c0 0x7fdc1806d680 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdc30038000 tx=0x7fdc3003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:56.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:56.982+0000 7fdc29ffb640 1 -- 172.21.15.91:0/3893509747 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdc24054210 con 0x7fdc340c4080 2023-11-27T20:45:57.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.190+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/3893509747 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc340a5590 con 0x7fdc340c4080 2023-11-27T20:45:57.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.192+0000 7fdc29ffb640 1 -- 172.21.15.91:0/3893509747 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6140 (secure 0 0 0) 0x7fdc340a5590 con 0x7fdc340c4080 2023-11-27T20:45:57.193 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:57.193 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:06.072742+0000","modified":"2023-11-27T20:45:09.133844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/2103536114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":2103536114},{"type":"v1","addr":"172.21.15.183:6835","nonce":2103536114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:21.787805+0000","modified":"2023-11-27T20:45:24.857169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/1761528163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1761528163},{"type":"v1","addr":"172.21.15.91:6837","nonce":1761528163}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-27T20:45:57.193 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 51 2023-11-27T20:45:57.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.194+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/3893509747 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc1806b1c0 msgr2=0x7fdc1806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.194+0000 7fdc3b3e5640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc1806b1c0 0x7fdc1806d680 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdc30038000 tx=0x7fdc3003b040 comp rx=0 tx=0).stop 2023-11-27T20:45:57.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.194+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/3893509747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc340c4080 msgr2=0x7fdc34149a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.194+0000 7fdc3b3e5640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc340c4080 0x7fdc34149a60 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400b4a0 tx=0x7fdc2400b960 comp rx=0 tx=0).stop 2023-11-27T20:45:57.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.195+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/3893509747 shutdown_connections 2023-11-27T20:45:57.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.195+0000 7fdc3b3e5640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc34155490 0x7fdc34149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.195+0000 7fdc3b3e5640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc340c4080 0x7fdc34149a60 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.195+0000 7fdc3b3e5640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fdc1806b1c0 0x7fdc1806d680 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.195+0000 7fdc3b3e5640 1 --2- 172.21.15.91:0/3893509747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc340c1500 0x7fdc34070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.195+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/3893509747 >> 172.21.15.91:0/3893509747 conn(0x7fdc3406a500 msgr2=0x7fdc3406ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:57.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.195+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/3893509747 shutdown_connections 2023-11-27T20:45:57.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.195+0000 7fdc3b3e5640 1 -- 172.21.15.91:0/3893509747 wait complete. 2023-11-27T20:45:57.213 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:45:57.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.410+0000 7f1996ce7640 1 Processor -- start 2023-11-27T20:45:57.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.410+0000 7f1996ce7640 1 -- start start 2023-11-27T20:45:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.411+0000 7f1996ce7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 0x7f1990152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.411+0000 7f1996ce7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f19900c3ea0 0x7f19900c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.411+0000 7f1996ce7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19900c64a0 con 0x7f199006d0a0 2023-11-27T20:45:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.411+0000 7f1996ce7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19900c5c00 con 0x7f19900c3ea0 2023-11-27T20:45:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.411+0000 7f1996ce7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19900c5ee0 con 0x7f199014fd30 2023-11-27T20:45:57.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.412+0000 7f1994a83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 0x7f1990152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.412+0000 7f198ffff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f199006d0a0 0x7f19900a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:38798/0 (socket says 172.21.15.91:38798) 2023-11-27T20:45:57.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.412+0000 7f198ffff640 1 -- 172.21.15.91:0/3238914422 learned_addr learned my addr 172.21.15.91:0/3238914422 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:57.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.413+0000 7f1995284640 1 --2- 172.21.15.91:0/3238914422 >> v2:172.21.15.183:3300/0 conn(0x7f19900c3ea0 0x7f19900c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.413+0000 7f1994a83640 1 -- 172.21.15.91:0/3238914422 >> v2:172.21.15.183:3300/0 conn(0x7f19900c3ea0 msgr2=0x7f19900c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:57.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.413+0000 7f1994a83640 1 --2- 172.21.15.91:0/3238914422 >> v2:172.21.15.183:3300/0 conn(0x7f19900c3ea0 0x7f19900c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.413+0000 7f1994a83640 1 -- 172.21.15.91:0/3238914422 >> v1:172.21.15.183:6789/0 conn(0x7f199006d0a0 legacy=0x7f19900a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.413+0000 7f1994a83640 1 -- 172.21.15.91:0/3238914422 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900c61c0 con 0x7f199014fd30 2023-11-27T20:45:57.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.414+0000 7f1994a83640 1 --2- 172.21.15.91:0/3238914422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 0x7f1990152f20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19840097a0 tx=0x7f198402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=444734d62ca0147e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:57.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.415+0000 7f198f7fe640 1 -- 172.21.15.91:0/3238914422 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198402d040 con 0x7f199014fd30 2023-11-27T20:45:57.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.415+0000 7f198f7fe640 1 -- 172.21.15.91:0/3238914422 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1984031810 con 0x7f199014fd30 2023-11-27T20:45:57.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.415+0000 7f198f7fe640 1 -- 172.21.15.91:0/3238914422 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984031ba0 con 0x7f199014fd30 2023-11-27T20:45:57.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.416+0000 7f1996ce7640 1 -- 172.21.15.91:0/3238914422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 msgr2=0x7f1990152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.416+0000 7f1996ce7640 1 --2- 172.21.15.91:0/3238914422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 0x7f1990152f20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19840097a0 tx=0x7f198402b8b0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.416+0000 7f1996ce7640 1 -- 172.21.15.91:0/3238914422 shutdown_connections 2023-11-27T20:45:57.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.416+0000 7f1996ce7640 1 --2- 172.21.15.91:0/3238914422 >> v2:172.21.15.183:3300/0 conn(0x7f19900c3ea0 0x7f19900c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.416+0000 7f1996ce7640 1 --2- 172.21.15.91:0/3238914422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 0x7f1990152f20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.416+0000 7f1996ce7640 1 -- 172.21.15.91:0/3238914422 >> 172.21.15.91:0/3238914422 conn(0x7f199006a500 msgr2=0x7f199006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:57.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.416+0000 7f1996ce7640 1 -- 172.21.15.91:0/3238914422 shutdown_connections 2023-11-27T20:45:57.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.416+0000 7f1996ce7640 1 -- 172.21.15.91:0/3238914422 wait complete. 2023-11-27T20:45:57.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.418+0000 7f1996ce7640 1 Processor -- start 2023-11-27T20:45:57.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.418+0000 7f1996ce7640 1 -- start start 2023-11-27T20:45:57.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.419+0000 7f1996ce7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f199006d0a0 0x7f199014eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.419+0000 7f1996ce7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19900c3ea0 0x7f19900bf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.419+0000 7f1996ce7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 0x7f19901ea740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.419+0000 7f1996ce7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19901e09f0 con 0x7f19900c3ea0 2023-11-27T20:45:57.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.419+0000 7f1996ce7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199014f8a0 con 0x7f199006d0a0 2023-11-27T20:45:57.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.419+0000 7f1996ce7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199014f300 con 0x7f199014fd30 2023-11-27T20:45:57.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.419+0000 7f198ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19900c3ea0 0x7f19900bf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.419+0000 7f198ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19900c3ea0 0x7f19900bf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57282/0 (socket says 172.21.15.91:57282) 2023-11-27T20:45:57.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.419+0000 7f198ffff640 1 -- 172.21.15.91:0/2283569652 learned_addr learned my addr 172.21.15.91:0/2283569652 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:57.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.419+0000 7f1994a83640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f199006d0a0 0x7f199014eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f1995284640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 0x7f19901ea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f198ffff640 1 -- 172.21.15.91:0/2283569652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 msgr2=0x7f19901ea740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f198ffff640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 0x7f19901ea740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f198ffff640 1 -- 172.21.15.91:0/2283569652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f199006d0a0 msgr2=0x7f199014eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f198ffff640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f199006d0a0 0x7f199014eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f198ffff640 1 -- 172.21.15.91:0/2283569652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1984009400 con 0x7f19900c3ea0 2023-11-27T20:45:57.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f198ffff640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19900c3ea0 0x7f19900bf540 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f197c00c3c0 tx=0x7f197c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:57.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f198d7fa640 1 -- 172.21.15.91:0/2283569652 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c005ce0 con 0x7f19900c3ea0 2023-11-27T20:45:57.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f198d7fa640 1 -- 172.21.15.91:0/2283569652 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c005e40 con 0x7f19900c3ea0 2023-11-27T20:45:57.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f198d7fa640 1 -- 172.21.15.91:0/2283569652 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0072d0 con 0x7f19900c3ea0 2023-11-27T20:45:57.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f1996ce7640 1 -- 172.21.15.91:0/2283569652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19901ee3e0 con 0x7f19900c3ea0 2023-11-27T20:45:57.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.420+0000 7f1996ce7640 1 -- 172.21.15.91:0/2283569652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19901ea220 con 0x7f19900c3ea0 2023-11-27T20:45:57.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.421+0000 7f1996ce7640 1 -- 172.21.15.91:0/2283569652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19901ea080 con 0x7f19900c3ea0 2023-11-27T20:45:57.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.422+0000 7f198d7fa640 1 -- 172.21.15.91:0/2283569652 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f197c0074f0 con 0x7f19900c3ea0 2023-11-27T20:45:57.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.424+0000 7f198d7fa640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197406b1c0 0x7f197406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.424+0000 7f198d7fa640 1 -- 172.21.15.91:0/2283569652 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f197c089170 con 0x7f19900c3ea0 2023-11-27T20:45:57.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.424+0000 7f1994a83640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197406b1c0 0x7f197406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.425+0000 7f1994a83640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197406b1c0 0x7f197406d680 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1984036000 tx=0x7f198403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:57.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.428+0000 7f198d7fa640 1 -- 172.21.15.91:0/2283569652 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f19901ea080 con 0x7f19900c3ea0 2023-11-27T20:45:57.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.655+0000 7f1996ce7640 1 -- 172.21.15.91:0/2283569652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19901ea080 con 0x7f19900c3ea0 2023-11-27T20:45:57.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.656+0000 7f198d7fa640 1 -- 172.21.15.91:0/2283569652 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6140 (secure 0 0 0) 0x7f19901ea080 con 0x7f19900c3ea0 2023-11-27T20:45:57.657 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:57.657 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:06.072742+0000","modified":"2023-11-27T20:45:09.133844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/2103536114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":2103536114},{"type":"v1","addr":"172.21.15.183:6835","nonce":2103536114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:21.787805+0000","modified":"2023-11-27T20:45:24.857169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/1761528163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1761528163},{"type":"v1","addr":"172.21.15.91:6837","nonce":1761528163}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-27T20:45:57.657 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 51 2023-11-27T20:45:57.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 -- 172.21.15.91:0/2283569652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197406b1c0 msgr2=0x7f197406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197406b1c0 0x7f197406d680 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1984036000 tx=0x7f198403c040 comp rx=0 tx=0).stop 2023-11-27T20:45:57.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 -- 172.21.15.91:0/2283569652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19900c3ea0 msgr2=0x7f19900bf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19900c3ea0 0x7f19900bf540 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f197c00c3c0 tx=0x7f197c00c880 comp rx=0 tx=0).stop 2023-11-27T20:45:57.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 -- 172.21.15.91:0/2283569652 shutdown_connections 2023-11-27T20:45:57.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f199014fd30 0x7f19901ea740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19900c3ea0 0x7f19900bf540 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f197406b1c0 0x7f197406d680 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 --2- 172.21.15.91:0/2283569652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f199006d0a0 0x7f199014eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 -- 172.21.15.91:0/2283569652 >> 172.21.15.91:0/2283569652 conn(0x7f199006a500 msgr2=0x7f199006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:57.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 -- 172.21.15.91:0/2283569652 shutdown_connections 2023-11-27T20:45:57.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.659+0000 7f1996ce7640 1 -- 172.21.15.91:0/2283569652 wait complete. 2023-11-27T20:45:57.679 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:45:57.882 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:45:57.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.883+0000 7fe896b05640 1 Processor -- start 2023-11-27T20:45:57.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.883+0000 7fe896b05640 1 -- start start 2023-11-27T20:45:57.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.884+0000 7fe896b05640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe890155490 0x7fe8900a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.888 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:45:57.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.884+0000 7fe896b05640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe8900a9b40 0x7fe8900c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.884+0000 7fe896b05640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8900c06c0 con 0x7fe8900c1500 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.884+0000 7fe896b05640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8900a5820 con 0x7fe890155490 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.884+0000 7fe896b05640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8900c1020 con 0x7fe8900a9b40 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.884+0000 7fe8948a1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe890155490 0x7fe8900a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.884+0000 7fe8948a1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe890155490 0x7fe8900a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57298/0 (socket says 172.21.15.91:57298) 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.884+0000 7fe8948a1640 1 -- 172.21.15.91:0/3164147024 learned_addr learned my addr 172.21.15.91:0/3164147024 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.885+0000 7fe8948a1640 1 -- 172.21.15.91:0/3164147024 >> v2:172.21.15.183:3300/0 conn(0x7fe8900a9b40 msgr2=0x7fe8900c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.885+0000 7fe8948a1640 1 --2- 172.21.15.91:0/3164147024 >> v2:172.21.15.183:3300/0 conn(0x7fe8900a9b40 0x7fe8900c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.885+0000 7fe8948a1640 1 -- 172.21.15.91:0/3164147024 >> v1:172.21.15.183:6789/0 conn(0x7fe8900c1500 legacy=0x7fe8900a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.885+0000 7fe8948a1640 1 -- 172.21.15.91:0/3164147024 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8900c0910 con 0x7fe890155490 2023-11-27T20:45:57.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.886+0000 7fe8948a1640 1 --2- 172.21.15.91:0/3164147024 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe890155490 0x7fe8900a51b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fe890067220 tx=0x7fe88402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a318c00ecf964ff server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.886+0000 7fe88f7fe640 1 -- 172.21.15.91:0/3164147024 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884031870 con 0x7fe890155490 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.886+0000 7fe88f7fe640 1 -- 172.21.15.91:0/3164147024 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8840319d0 con 0x7fe890155490 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.886+0000 7fe88f7fe640 1 -- 172.21.15.91:0/3164147024 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884031d60 con 0x7fe890155490 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.887+0000 7fe896b05640 1 -- 172.21.15.91:0/3164147024 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe890155490 msgr2=0x7fe8900a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.887+0000 7fe896b05640 1 --2- 172.21.15.91:0/3164147024 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe890155490 0x7fe8900a51b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fe890067220 tx=0x7fe88402b910 comp rx=0 tx=0).stop 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.887+0000 7fe896b05640 1 -- 172.21.15.91:0/3164147024 shutdown_connections 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.887+0000 7fe896b05640 1 --2- 172.21.15.91:0/3164147024 >> v2:172.21.15.183:3300/0 conn(0x7fe8900a9b40 0x7fe8900c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.887+0000 7fe896b05640 1 --2- 172.21.15.91:0/3164147024 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe890155490 0x7fe8900a51b0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.887+0000 7fe896b05640 1 -- 172.21.15.91:0/3164147024 >> 172.21.15.91:0/3164147024 conn(0x7fe89006a500 msgr2=0x7fe89006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.887+0000 7fe896b05640 1 -- 172.21.15.91:0/3164147024 shutdown_connections 2023-11-27T20:45:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.887+0000 7fe896b05640 1 -- 172.21.15.91:0/3164147024 wait complete. 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.889+0000 7fe896b05640 1 Processor -- start 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.889+0000 7fe896b05640 1 -- start start 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.890+0000 7fe896b05640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8900c1500 0x7fe89014b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.890+0000 7fe896b05640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe890155490 0x7fe89014cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.890+0000 7fe896b05640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe89014be90 0x7fe89014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.890+0000 7fe896b05640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89014ea00 con 0x7fe89014be90 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.890+0000 7fe896b05640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe890153690 con 0x7fe8900c1500 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.890+0000 7fe896b05640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe890153970 con 0x7fe890155490 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.890+0000 7fe8950a2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe89014be90 0x7fe89014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.890+0000 7fe8950a2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe89014be90 0x7fe89014d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57308/0 (socket says 172.21.15.91:57308) 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.891+0000 7fe8950a2640 1 -- 172.21.15.91:0/3319608748 learned_addr learned my addr 172.21.15.91:0/3319608748 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.891+0000 7fe8948a1640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8900c1500 0x7fe89014b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.891+0000 7fe88ffff640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe890155490 0x7fe89014cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.891+0000 7fe8950a2640 1 -- 172.21.15.91:0/3319608748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe890155490 msgr2=0x7fe89014cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.891+0000 7fe8950a2640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe890155490 0x7fe89014cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.891+0000 7fe8950a2640 1 -- 172.21.15.91:0/3319608748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8900c1500 msgr2=0x7fe89014b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.891+0000 7fe8950a2640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8900c1500 0x7fe89014b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.891+0000 7fe8950a2640 1 -- 172.21.15.91:0/3319608748 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8840094d0 con 0x7fe89014be90 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.891+0000 7fe8950a2640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe89014be90 0x7fe89014d290 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fe88800b970 tx=0x7fe88800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.892+0000 7fe88d7fa640 1 -- 172.21.15.91:0/3319608748 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88800cb40 con 0x7fe89014be90 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.892+0000 7fe88d7fa640 1 -- 172.21.15.91:0/3319608748 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88800ccc0 con 0x7fe89014be90 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.892+0000 7fe896b05640 1 -- 172.21.15.91:0/3319608748 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe890153c50 con 0x7fe89014be90 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.892+0000 7fe88d7fa640 1 -- 172.21.15.91:0/3319608748 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888014680 con 0x7fe89014be90 2023-11-27T20:45:57.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.892+0000 7fe896b05640 1 -- 172.21.15.91:0/3319608748 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8901547d0 con 0x7fe89014be90 2023-11-27T20:45:57.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.893+0000 7fe896b05640 1 -- 172.21.15.91:0/3319608748 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe890068350 con 0x7fe89014be90 2023-11-27T20:45:57.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.894+0000 7fe88d7fa640 1 -- 172.21.15.91:0/3319608748 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe888007370 con 0x7fe89014be90 2023-11-27T20:45:57.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.895+0000 7fe88d7fa640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe87406b1f0 0x7fe87406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:57.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.895+0000 7fe88d7fa640 1 -- 172.21.15.91:0/3319608748 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fe888089cd0 con 0x7fe89014be90 2023-11-27T20:45:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.895+0000 7fe8948a1640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe87406b1f0 0x7fe87406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.896+0000 7fe8948a1640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe87406b1f0 0x7fe87406d6b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe884036000 tx=0x7fe88403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:57.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:57.899+0000 7fe88d7fa640 1 -- 172.21.15.91:0/3319608748 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe888054660 con 0x7fe89014be90 2023-11-27T20:45:58.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.090+0000 7fe896b05640 1 -- 172.21.15.91:0/3319608748 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8900c5800 con 0x7fe89014be90 2023-11-27T20:45:58.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.092+0000 7fe88d7fa640 1 -- 172.21.15.91:0/3319608748 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20276 (secure 0 0 0) 0x7fe888019020 con 0x7fe89014be90 2023-11-27T20:45:58.094 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:45:58.094 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":81,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:45:23.334850+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-27T20:45:04.361620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-27T20:45:05.090674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 -- 172.21.15.91:0/3319608748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe87406b1f0 msgr2=0x7fe87406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe87406b1f0 0x7fe87406d6b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe884036000 tx=0x7fe88403c040 comp rx=0 tx=0).stop 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 -- 172.21.15.91:0/3319608748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe89014be90 msgr2=0x7fe89014d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe89014be90 0x7fe89014d290 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fe88800b970 tx=0x7fe88800be30 comp rx=0 tx=0).stop 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 -- 172.21.15.91:0/3319608748 shutdown_connections 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe89014be90 0x7fe89014d290 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe890155490 0x7fe89014cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe87406b1f0 0x7fe87406d6b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 --2- 172.21.15.91:0/3319608748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8900c1500 0x7fe89014b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 -- 172.21.15.91:0/3319608748 >> 172.21.15.91:0/3319608748 conn(0x7fe89006a500 msgr2=0x7fe8900aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 -- 172.21.15.91:0/3319608748 shutdown_connections 2023-11-27T20:45:58.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.095+0000 7fe896b05640 1 -- 172.21.15.91:0/3319608748 wait complete. 2023-11-27T20:45:58.116 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-27T20:45:58.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.321+0000 7f2308026640 1 Processor -- start 2023-11-27T20:45:58.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.321+0000 7f2308026640 1 -- start start 2023-11-27T20:45:58.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.323+0000 7f2308026640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2300151fd0 0x7f230006e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.323+0000 7f2308026640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f23000c3400 0x7f230006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.323+0000 7f2308026640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2300071fd0 con 0x7f230006aa40 2023-11-27T20:45:58.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.323+0000 7f2308026640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230006ee50 con 0x7f23000c3400 2023-11-27T20:45:58.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.323+0000 7f2308026640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2300072220 con 0x7f2300151fd0 2023-11-27T20:45:58.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.323+0000 7f23055c1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f23000c3400 0x7f230006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:58.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.323+0000 7f23055c1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f23000c3400 0x7f230006a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57310/0 (socket says 172.21.15.91:57310) 2023-11-27T20:45:58.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.323+0000 7f23055c1640 1 -- 172.21.15.91:0/1357197509 learned_addr learned my addr 172.21.15.91:0/1357197509 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:58.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.324+0000 7f23055c1640 1 -- 172.21.15.91:0/1357197509 >> v2:172.21.15.183:3300/0 conn(0x7f2300151fd0 msgr2=0x7f230006e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:58.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.324+0000 7f2305dc2640 1 --2- 172.21.15.91:0/1357197509 >> v2:172.21.15.183:3300/0 conn(0x7f2300151fd0 0x7f230006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:58.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.324+0000 7f23055c1640 1 --2- 172.21.15.91:0/1357197509 >> v2:172.21.15.183:3300/0 conn(0x7f2300151fd0 0x7f230006e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.324+0000 7f23055c1640 1 -- 172.21.15.91:0/1357197509 >> v1:172.21.15.183:6789/0 conn(0x7f230006aa40 legacy=0x7f2300157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:58.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.324+0000 7f23055c1640 1 -- 172.21.15.91:0/1357197509 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230006e0d0 con 0x7f23000c3400 2023-11-27T20:45:58.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.325+0000 7f23055c1640 1 --2- 172.21.15.91:0/1357197509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 0x7f230006a500 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f23000c17b0 tx=0x7f22fc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc150a0a623bb8c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:58.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.325+0000 7f2304dc0640 1 -- 172.21.15.91:0/1357197509 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0317e0 con 0x7f23000c3400 2023-11-27T20:45:58.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.325+0000 7f2304dc0640 1 -- 172.21.15.91:0/1357197509 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc031940 con 0x7f23000c3400 2023-11-27T20:45:58.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.325+0000 7f2304dc0640 1 -- 172.21.15.91:0/1357197509 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc031cd0 con 0x7f23000c3400 2023-11-27T20:45:58.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.326+0000 7f2308026640 1 -- 172.21.15.91:0/1357197509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 msgr2=0x7f230006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.326+0000 7f2308026640 1 --2- 172.21.15.91:0/1357197509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 0x7f230006a500 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f23000c17b0 tx=0x7f22fc02b880 comp rx=0 tx=0).stop 2023-11-27T20:45:58.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.326+0000 7f2308026640 1 -- 172.21.15.91:0/1357197509 shutdown_connections 2023-11-27T20:45:58.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.326+0000 7f2308026640 1 --2- 172.21.15.91:0/1357197509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 0x7f230006a500 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.326+0000 7f2308026640 1 --2- 172.21.15.91:0/1357197509 >> v2:172.21.15.183:3300/0 conn(0x7f2300151fd0 0x7f230006e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.326+0000 7f2308026640 1 -- 172.21.15.91:0/1357197509 >> 172.21.15.91:0/1357197509 conn(0x7f23000c6ee0 msgr2=0x7f23000c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:58.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.326+0000 7f2308026640 1 -- 172.21.15.91:0/1357197509 shutdown_connections 2023-11-27T20:45:58.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.326+0000 7f2308026640 1 -- 172.21.15.91:0/1357197509 wait complete. 2023-11-27T20:45:58.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.328+0000 7f2308026640 1 Processor -- start 2023-11-27T20:45:58.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.328+0000 7f2308026640 1 -- start start 2023-11-27T20:45:58.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.329+0000 7f2308026640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f230006aa40 0x7f230014b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.329+0000 7f2308026640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 0x7f23001ea800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.329+0000 7f2308026640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2300151fd0 0x7f23001541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.329+0000 7f2308026640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2300155600 con 0x7f23000c3400 2023-11-27T20:45:58.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.329+0000 7f2308026640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230014be20 con 0x7f230006aa40 2023-11-27T20:45:58.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.329+0000 7f2308026640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230014bb60 con 0x7f2300151fd0 2023-11-27T20:45:58.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.329+0000 7f23055c1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 0x7f23001ea800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:58.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.329+0000 7f23055c1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 0x7f23001ea800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57312/0 (socket says 172.21.15.91:57312) 2023-11-27T20:45:58.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.329+0000 7f23055c1640 1 -- 172.21.15.91:0/2775010366 learned_addr learned my addr 172.21.15.91:0/2775010366 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:58.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.330+0000 7f23055c1640 1 -- 172.21.15.91:0/2775010366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2300151fd0 msgr2=0x7f23001541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.330+0000 7f23055c1640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2300151fd0 0x7f23001541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.330+0000 7f23055c1640 1 -- 172.21.15.91:0/2775010366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f230006aa40 msgr2=0x7f230014b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.330+0000 7f23055c1640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f230006aa40 0x7f230014b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.330+0000 7f23055c1640 1 -- 172.21.15.91:0/2775010366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0094d0 con 0x7f23000c3400 2023-11-27T20:45:58.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.330+0000 7f23055c1640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 0x7f23001ea800 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f22fc000c00 tx=0x7f22fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:58.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.330+0000 7f22f67fc640 1 -- 172.21.15.91:0/2775010366 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc032900 con 0x7f23000c3400 2023-11-27T20:45:58.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.330+0000 7f22f67fc640 1 -- 172.21.15.91:0/2775010366 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc032a60 con 0x7f23000c3400 2023-11-27T20:45:58.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.330+0000 7f2308026640 1 -- 172.21.15.91:0/2775010366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2300148e00 con 0x7f23000c3400 2023-11-27T20:45:58.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.330+0000 7f22f67fc640 1 -- 172.21.15.91:0/2775010366 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc032e10 con 0x7f23000c3400 2023-11-27T20:45:58.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.331+0000 7f2308026640 1 -- 172.21.15.91:0/2775010366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23001493c0 con 0x7f23000c3400 2023-11-27T20:45:58.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.332+0000 7f2308026640 1 -- 172.21.15.91:0/2775010366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2300068350 con 0x7f23000c3400 2023-11-27T20:45:58.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.333+0000 7f22f67fc640 1 -- 172.21.15.91:0/2775010366 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f22fc04e450 con 0x7f23000c3400 2023-11-27T20:45:58.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.334+0000 7f22f67fc640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22ec06b1c0 0x7f22ec06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.334+0000 7f22f67fc640 1 -- 172.21.15.91:0/2775010366 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f22fc0ac0c0 con 0x7f23000c3400 2023-11-27T20:45:58.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.334+0000 7f2305dc2640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22ec06b1c0 0x7f22ec06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:58.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.335+0000 7f2305dc2640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22ec06b1c0 0x7f22ec06d680 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f22f8007db0 tx=0x7f22f80072e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:58.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.339+0000 7f22f67fc640 1 -- 172.21.15.91:0/2775010366 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f22fc076b00 con 0x7f23000c3400 2023-11-27T20:45:58.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.562+0000 7f2308026640 1 -- 172.21.15.91:0/2775010366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f23000c7c60 con 0x7f23000c3400 2023-11-27T20:45:58.564 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-11-27T20:45:58.563+0000 7fb57696d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-27T20:45:58.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.566+0000 7f22f67fc640 1 -- 172.21.15.91:0/2775010366 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f22fc07a120 con 0x7f23000c3400 2023-11-27T20:45:58.568 INFO:teuthology.orchestra.run.smithi091.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T20:45:58.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.569+0000 7f2308026640 1 -- 172.21.15.91:0/2775010366 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22ec06b1c0 msgr2=0x7f22ec06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.569+0000 7f2308026640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22ec06b1c0 0x7f22ec06d680 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f22f8007db0 tx=0x7f22f80072e0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.569+0000 7f2308026640 1 -- 172.21.15.91:0/2775010366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 msgr2=0x7f23001ea800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.569+0000 7f2308026640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 0x7f23001ea800 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f22fc000c00 tx=0x7f22fc0046c0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.570+0000 7f2308026640 1 -- 172.21.15.91:0/2775010366 shutdown_connections 2023-11-27T20:45:58.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.570+0000 7f2308026640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2300151fd0 0x7f23001541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.570+0000 7f2308026640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f23000c3400 0x7f23001ea800 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.570+0000 7f2308026640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f22ec06b1c0 0x7f22ec06d680 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.570+0000 7f2308026640 1 --2- 172.21.15.91:0/2775010366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f230006aa40 0x7f230014b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.570+0000 7f2308026640 1 -- 172.21.15.91:0/2775010366 >> 172.21.15.91:0/2775010366 conn(0x7f23000c6ee0 msgr2=0x7f230014ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:58.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.570+0000 7f2308026640 1 -- 172.21.15.91:0/2775010366 shutdown_connections 2023-11-27T20:45:58.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.570+0000 7f2308026640 1 -- 172.21.15.91:0/2775010366 wait complete. 2023-11-27T20:45:58.590 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-27T20:45:58.605 INFO:tasks.ceph.mds.d.smithi183.stderr: -5463> 2023-11-27T20:45:12.597+0000 7fa8cfed0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:45:58.695 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-11-27T20:45:58.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.799+0000 7f8be80e5640 1 Processor -- start 2023-11-27T20:45:58.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.800+0000 7f8be80e5640 1 -- start start 2023-11-27T20:45:58.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.801+0000 7f8be80e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8be00c7ec0 0x7f8be0155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.801+0000 7f8be80e5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be01556d0 con 0x7f8be00c4940 2023-11-27T20:45:58.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.801+0000 7f8be80e5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be0154740 con 0x7f8be0151cc0 2023-11-27T20:45:58.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.801+0000 7f8be80e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be006c760 con 0x7f8be00c7ec0 2023-11-27T20:45:58.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.801+0000 7f8be6682640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f8be00c4940 0x7f8be015f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:59886/0 (socket says 172.21.15.91:59886) 2023-11-27T20:45:58.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.801+0000 7f8be6682640 1 -- 172.21.15.91:0/2763559531 learned_addr learned my addr 172.21.15.91:0/2763559531 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:58.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be5680640 1 --2- 172.21.15.91:0/2763559531 >> v2:172.21.15.183:3300/0 conn(0x7f8be00c7ec0 0x7f8be0155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:58.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279248611 0 0) 0x7f8bd8001110 con 0x7f8be00c4940 2023-11-27T20:45:58.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bd0003520 con 0x7f8be00c4940 2023-11-27T20:45:58.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3961316379 0 0) 0x7f8bd0003520 con 0x7f8be00c4940 2023-11-27T20:45:58.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 >> v2:172.21.15.183:3300/0 conn(0x7f8be00c7ec0 msgr2=0x7f8be0155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:58.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 --2- 172.21.15.91:0/2763559531 >> v2:172.21.15.183:3300/0 conn(0x7f8be00c7ec0 0x7f8be0155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 >> v1:172.21.15.183:6789/0 conn(0x7f8be0151cc0 legacy=0x7f8be0157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be00c8470 con 0x7f8be00c4940 2023-11-27T20:45:58.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f8bd8001800 con 0x7f8be00c4940 2023-11-27T20:45:58.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 >> v1:172.21.15.91:6789/0 conn(0x7f8be00c4940 legacy=0x7f8be015f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 --2- 172.21.15.91:0/2763559531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bd0003970 0x7f8bd0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 --2- 172.21.15.91:0/2763559531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bd00047c0 0x7f8bd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 --2- 172.21.15.91:0/2763559531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bd0005180 0x7f8bd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be006c760 con 0x7f8bd0005180 2023-11-27T20:45:58.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd000c020 con 0x7f8bd00047c0 2023-11-27T20:45:58.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.802+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd000c1e0 con 0x7f8bd0003970 2023-11-27T20:45:58.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.803+0000 7f8be6682640 1 --2- 172.21.15.91:0/2763559531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bd0005180 0x7f8bd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:58.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.803+0000 7f8be6682640 1 -- 172.21.15.91:0/2763559531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bd0003970 msgr2=0x7f8bd0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:58.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.803+0000 7f8be6682640 1 --2- 172.21.15.91:0/2763559531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bd0003970 0x7f8bd0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.803+0000 7f8be6682640 1 -- 172.21.15.91:0/2763559531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bd00047c0 msgr2=0x7f8bd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:58.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.803+0000 7f8be5680640 1 --2- 172.21.15.91:0/2763559531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bd00047c0 0x7f8bd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:58.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.803+0000 7f8be6682640 1 --2- 172.21.15.91:0/2763559531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bd00047c0 0x7f8bd0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.803+0000 7f8be6682640 1 -- 172.21.15.91:0/2763559531 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd0003520 con 0x7f8bd0005180 2023-11-27T20:45:58.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.804+0000 7f8be6682640 1 -- 172.21.15.91:0/2763559531 reap_dead start 2023-11-27T20:45:58.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.804+0000 7f8be6682640 1 --2- 172.21.15.91:0/2763559531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bd0005180 0x7f8bd000b980 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800c240 tx=0x7f8bd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b15f55370fb8ff server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.804+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8005ad0 con 0x7f8bd0005180 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.805+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd8005c50 con 0x7f8bd0005180 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.805+0000 7f8be4e7f640 1 -- 172.21.15.91:0/2763559531 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd802c8b0 con 0x7f8bd0005180 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.805+0000 7f8be80e5640 1 -- 172.21.15.91:0/2763559531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bd0005180 msgr2=0x7f8bd000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.805+0000 7f8be80e5640 1 --2- 172.21.15.91:0/2763559531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bd0005180 0x7f8bd000b980 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800c240 tx=0x7f8bd00057f0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.805+0000 7f8be80e5640 1 -- 172.21.15.91:0/2763559531 shutdown_connections 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.805+0000 7f8be80e5640 1 --2- 172.21.15.91:0/2763559531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8bd0005180 0x7f8bd000b980 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.805+0000 7f8be80e5640 1 -- 172.21.15.91:0/2763559531 >> 172.21.15.91:0/2763559531 conn(0x7f8be0071e10 msgr2=0x7f8be0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.805+0000 7f8be80e5640 1 -- 172.21.15.91:0/2763559531 shutdown_connections 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.805+0000 7f8be80e5640 1 -- 172.21.15.91:0/2763559531 wait complete. 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.807+0000 7f8be80e5640 1 Processor -- start 2023-11-27T20:45:58.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.807+0000 7f8be80e5640 1 -- start start 2023-11-27T20:45:58.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.808+0000 7f8be80e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bd0005180 0x7f8be00c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.808+0000 7f8be80e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8be01ed330 0x7f8be0150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.808+0000 7f8be80e5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8be00aac80 0x7f8be0147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.808+0000 7f8be80e5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be00c15d0 con 0x7f8be00aac80 2023-11-27T20:45:58.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.808+0000 7f8be80e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be00c3c40 con 0x7f8bd0005180 2023-11-27T20:45:58.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.808+0000 7f8be80e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be01514b0 con 0x7f8be01ed330 2023-11-27T20:45:58.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.808+0000 7f8be6682640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8be00aac80 0x7f8be0147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:58.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.808+0000 7f8be6682640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8be00aac80 0x7f8be0147f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57332/0 (socket says 172.21.15.91:57332) 2023-11-27T20:45:58.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.808+0000 7f8be6682640 1 -- 172.21.15.91:0/1153569511 learned_addr learned my addr 172.21.15.91:0/1153569511 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:58.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.809+0000 7f8be5680640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8be01ed330 0x7f8be0150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:58.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.809+0000 7f8be6682640 1 -- 172.21.15.91:0/1153569511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8be01ed330 msgr2=0x7f8be0150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.809+0000 7f8be6682640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8be01ed330 0x7f8be0150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.809+0000 7f8be6682640 1 -- 172.21.15.91:0/1153569511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bd0005180 msgr2=0x7f8be00c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:58.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.809+0000 7f8be6682640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bd0005180 0x7f8be00c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:58.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.809+0000 7f8be6682640 1 -- 172.21.15.91:0/1153569511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be014f4e0 con 0x7f8be00aac80 2023-11-27T20:45:58.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.809+0000 7f8be6682640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8be00aac80 0x7f8be0147f90 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f8bd802c520 tx=0x7f8bd8001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:58.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.809+0000 7f8bde7fc640 1 -- 172.21.15.91:0/1153569511 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd80049e0 con 0x7f8be00aac80 2023-11-27T20:45:58.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.810+0000 7f8bde7fc640 1 -- 172.21.15.91:0/1153569511 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd8004b40 con 0x7f8be00aac80 2023-11-27T20:45:58.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.810+0000 7f8bde7fc640 1 -- 172.21.15.91:0/1153569511 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8001110 con 0x7f8be00aac80 2023-11-27T20:45:58.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.810+0000 7f8be80e5640 1 -- 172.21.15.91:0/1153569511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be014f7c0 con 0x7f8be00aac80 2023-11-27T20:45:58.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.810+0000 7f8be80e5640 1 -- 172.21.15.91:0/1153569511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be014fd80 con 0x7f8be00aac80 2023-11-27T20:45:58.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.811+0000 7f8be80e5640 1 -- 172.21.15.91:0/1153569511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be0068350 con 0x7f8be00aac80 2023-11-27T20:45:58.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.812+0000 7f8bde7fc640 1 -- 172.21.15.91:0/1153569511 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8bd8032070 con 0x7f8be00aac80 2023-11-27T20:45:58.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.812+0000 7f8bde7fc640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8bc406b1f0 0x7f8bc406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:58.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.813+0000 7f8bde7fc640 1 -- 172.21.15.91:0/1153569511 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6709+0+0 (secure 0 0 0) 0x7f8bd803c070 con 0x7f8be00aac80 2023-11-27T20:45:58.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.813+0000 7f8be5e81640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8bc406b1f0 0x7f8bc406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:58.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.814+0000 7f8be5e81640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8bc406b1f0 0x7f8bc406d6b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4001d00 tx=0x7f8bd4007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:58.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:58.817+0000 7f8bde7fc640 1 -- 172.21.15.91:0/1153569511 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8bd80756c0 con 0x7f8be00aac80 2023-11-27T20:45:59.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.050+0000 7f8be80e5640 1 -- 172.21.15.91:0/1153569511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8be01556d0 con 0x7f8be00aac80 2023-11-27T20:45:59.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.570+0000 7f8bde7fc640 1 -- 172.21.15.91:0/1153569511 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8be01556d0 con 0x7f8be00aac80 2023-11-27T20:45:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.574+0000 7f8be80e5640 1 -- 172.21.15.91:0/1153569511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8bc406b1f0 msgr2=0x7f8bc406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.574+0000 7f8be80e5640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8bc406b1f0 0x7f8bc406d6b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4001d00 tx=0x7f8bd4007d10 comp rx=0 tx=0).stop 2023-11-27T20:45:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.574+0000 7f8be80e5640 1 -- 172.21.15.91:0/1153569511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8be00aac80 msgr2=0x7f8be0147f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.574+0000 7f8be80e5640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8be00aac80 0x7f8be0147f90 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f8bd802c520 tx=0x7f8bd8001b90 comp rx=0 tx=0).stop 2023-11-27T20:45:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.574+0000 7f8be80e5640 1 -- 172.21.15.91:0/1153569511 shutdown_connections 2023-11-27T20:45:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.574+0000 7f8be80e5640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8be00aac80 0x7f8be0147f90 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:59.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.574+0000 7f8be80e5640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8be01ed330 0x7f8be0150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:59.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.574+0000 7f8be80e5640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8bc406b1f0 0x7f8bc406d6b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:59.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.574+0000 7f8be80e5640 1 --2- 172.21.15.91:0/1153569511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bd0005180 0x7f8be00c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:59.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.574+0000 7f8be80e5640 1 -- 172.21.15.91:0/1153569511 >> 172.21.15.91:0/1153569511 conn(0x7f8be0071e10 msgr2=0x7f8be00c7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:59.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.575+0000 7f8be80e5640 1 -- 172.21.15.91:0/1153569511 shutdown_connections 2023-11-27T20:45:59.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.575+0000 7f8be80e5640 1 -- 172.21.15.91:0/1153569511 wait complete. 2023-11-27T20:45:59.596 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-27T20:45:59.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.810+0000 7f0d1c153640 1 Processor -- start 2023-11-27T20:45:59.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.810+0000 7f0d1c153640 1 -- start start 2023-11-27T20:45:59.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.811+0000 7f0d1c153640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0d1406e1c0 0x7f0d140c0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.811+0000 7f0d1c153640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 0x7f0d14155b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.811+0000 7f0d1c153640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1406d750 con 0x7f0d1414fd60 2023-11-27T20:45:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.811+0000 7f0d1c153640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1406c820 con 0x7f0d1406e1c0 2023-11-27T20:45:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.811+0000 7f0d1c153640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1406dda0 con 0x7f0d1406bd60 2023-11-27T20:45:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.812+0000 7f0d19eef640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f0d1414fd60 0x7f0d140c27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:38838/0 (socket says 172.21.15.91:38838) 2023-11-27T20:45:59.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.812+0000 7f0d19eef640 1 -- 172.21.15.91:0/990319741 learned_addr learned my addr 172.21.15.91:0/990319741 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:45:59.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.812+0000 7f0d1a6f0640 1 --2- 172.21.15.91:0/990319741 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 0x7f0d14155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:59.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.812+0000 7f0d196ee640 1 --2- 172.21.15.91:0/990319741 >> v2:172.21.15.183:3300/0 conn(0x7f0d1406e1c0 0x7f0d140c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:59.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.813+0000 7f0d18eed640 1 -- 172.21.15.91:0/990319741 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356767626 0 0) 0x7f0d1406d750 con 0x7f0d1414fd60 2023-11-27T20:45:59.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.813+0000 7f0d18eed640 1 -- 172.21.15.91:0/990319741 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d00003520 con 0x7f0d1414fd60 2023-11-27T20:45:59.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.813+0000 7f0d196ee640 1 -- 172.21.15.91:0/990319741 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 msgr2=0x7f0d14155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:45:59.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.813+0000 7f0d196ee640 1 --2- 172.21.15.91:0/990319741 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 0x7f0d14155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:59.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.813+0000 7f0d196ee640 1 -- 172.21.15.91:0/990319741 >> v1:172.21.15.183:6789/0 conn(0x7f0d1414fd60 legacy=0x7f0d140c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:59.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.813+0000 7f0d196ee640 1 -- 172.21.15.91:0/990319741 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d140c53d0 con 0x7f0d1406e1c0 2023-11-27T20:45:59.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.813+0000 7f0d1a6f0640 1 --2- 172.21.15.91:0/990319741 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 0x7f0d14155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:45:59.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.815+0000 7f0d196ee640 1 --2- 172.21.15.91:0/990319741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d1406e1c0 0x7f0d140c0730 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d080097a0 tx=0x7f0d0802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=931c34c3f529ef19 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:59.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.815+0000 7f0d18eed640 1 -- 172.21.15.91:0/990319741 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d080316f0 con 0x7f0d1406e1c0 2023-11-27T20:45:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.815+0000 7f0d18eed640 1 -- 172.21.15.91:0/990319741 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d08031850 con 0x7f0d1406e1c0 2023-11-27T20:45:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.815+0000 7f0d18eed640 1 -- 172.21.15.91:0/990319741 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08031be0 con 0x7f0d1406e1c0 2023-11-27T20:45:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.816+0000 7f0d1c153640 1 -- 172.21.15.91:0/990319741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d1406e1c0 msgr2=0x7f0d140c0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:59.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.816+0000 7f0d1c153640 1 --2- 172.21.15.91:0/990319741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d1406e1c0 0x7f0d140c0730 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d080097a0 tx=0x7f0d0802b790 comp rx=0 tx=0).stop 2023-11-27T20:45:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.816+0000 7f0d1c153640 1 -- 172.21.15.91:0/990319741 shutdown_connections 2023-11-27T20:45:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.816+0000 7f0d1c153640 1 --2- 172.21.15.91:0/990319741 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 0x7f0d14155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.816+0000 7f0d1c153640 1 --2- 172.21.15.91:0/990319741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d1406e1c0 0x7f0d140c0730 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.816+0000 7f0d1c153640 1 -- 172.21.15.91:0/990319741 >> 172.21.15.91:0/990319741 conn(0x7f0d140c5d30 msgr2=0x7f0d140c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:45:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.816+0000 7f0d1c153640 1 -- 172.21.15.91:0/990319741 shutdown_connections 2023-11-27T20:45:59.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.816+0000 7f0d1c153640 1 -- 172.21.15.91:0/990319741 wait complete. 2023-11-27T20:45:59.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.818+0000 7f0d1c153640 1 Processor -- start 2023-11-27T20:45:59.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.818+0000 7f0d1c153640 1 -- start start 2023-11-27T20:45:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d1c153640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 0x7f0d140bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d1c153640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0d1406e1c0 0x7f0d140a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d1c153640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d1414fd60 0x7f0d141e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d1c153640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140bba70 con 0x7f0d1406e1c0 2023-11-27T20:45:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d1c153640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d141ebd80 con 0x7f0d1414fd60 2023-11-27T20:45:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d1c153640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140bb4f0 con 0x7f0d1406bd60 2023-11-27T20:45:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d196ee640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0d1406e1c0 0x7f0d140a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d196ee640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0d1406e1c0 0x7f0d140a6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57336/0 (socket says 172.21.15.91:57336) 2023-11-27T20:45:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d196ee640 1 -- 172.21.15.91:0/2569207020 learned_addr learned my addr 172.21.15.91:0/2569207020 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:45:59.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d19eef640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 0x7f0d140bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:59.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d1a6f0640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d1414fd60 0x7f0d141e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:59.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d196ee640 1 -- 172.21.15.91:0/2569207020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 msgr2=0x7f0d140bafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:59.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d196ee640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 0x7f0d140bafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:59.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d196ee640 1 -- 172.21.15.91:0/2569207020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d1414fd60 msgr2=0x7f0d141e7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:45:59.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d196ee640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d1414fd60 0x7f0d141e7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:45:59.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.819+0000 7f0d196ee640 1 -- 172.21.15.91:0/2569207020 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c009a70 con 0x7f0d1406e1c0 2023-11-27T20:45:59.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.820+0000 7f0d196ee640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0d1406e1c0 0x7f0d140a6a20 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f0d080098c0 tx=0x7f0d080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:59.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.820+0000 7f0d067fc640 1 -- 172.21.15.91:0/2569207020 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08034680 con 0x7f0d1406e1c0 2023-11-27T20:45:59.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.820+0000 7f0d067fc640 1 -- 172.21.15.91:0/2569207020 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d08034820 con 0x7f0d1406e1c0 2023-11-27T20:45:59.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.820+0000 7f0d067fc640 1 -- 172.21.15.91:0/2569207020 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08034bd0 con 0x7f0d1406e1c0 2023-11-27T20:45:59.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.820+0000 7f0d1c153640 1 -- 172.21.15.91:0/2569207020 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d08009400 con 0x7f0d1406e1c0 2023-11-27T20:45:59.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.820+0000 7f0d1c153640 1 -- 172.21.15.91:0/2569207020 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d141eb6c0 con 0x7f0d1406e1c0 2023-11-27T20:45:59.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.821+0000 7f0d1c153640 1 -- 172.21.15.91:0/2569207020 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d141eb520 con 0x7f0d1406e1c0 2023-11-27T20:45:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.822+0000 7f0d067fc640 1 -- 172.21.15.91:0/2569207020 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0d0803b040 con 0x7f0d1406e1c0 2023-11-27T20:45:59.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.823+0000 7f0d067fc640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0cf806b1f0 0x7f0cf806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:45:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.823+0000 7f0d067fc640 1 -- 172.21.15.91:0/2569207020 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6709+0+0 (secure 0 0 0) 0x7f0d080ab650 con 0x7f0d1406e1c0 2023-11-27T20:45:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.823+0000 7f0d19eef640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0cf806b1f0 0x7f0cf806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:45:59.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.824+0000 7f0d19eef640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0cf806b1f0 0x7f0cf806d6b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0d100011e0 tx=0x7f0d10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:45:59.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:45:59.828+0000 7f0d067fc640 1 -- 172.21.15.91:0/2569207020 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0d141eb520 con 0x7f0d1406e1c0 2023-11-27T20:46:00.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.016+0000 7f0d1c153640 1 -- 172.21.15.91:0/2569207020 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0d141eb520 con 0x7f0d1406e1c0 2023-11-27T20:46:00.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.574+0000 7f0d067fc640 1 -- 172.21.15.91:0/2569207020 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0d141eb520 con 0x7f0d1406e1c0 2023-11-27T20:46:00.576 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' removed 2023-11-27T20:46:00.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 -- 172.21.15.91:0/2569207020 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0cf806b1f0 msgr2=0x7f0cf806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:00.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0cf806b1f0 0x7f0cf806d6b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0d100011e0 tx=0x7f0d10009040 comp rx=0 tx=0).stop 2023-11-27T20:46:00.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 -- 172.21.15.91:0/2569207020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0d1406e1c0 msgr2=0x7f0d140a6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:00.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0d1406e1c0 0x7f0d140a6a20 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f0d080098c0 tx=0x7f0d080046c0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 -- 172.21.15.91:0/2569207020 shutdown_connections 2023-11-27T20:46:00.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f0cf806b1f0 0x7f0cf806d6b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d1414fd60 0x7f0d141e7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0d1406e1c0 0x7f0d140a6a20 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 --2- 172.21.15.91:0/2569207020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d1406bd60 0x7f0d140bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 -- 172.21.15.91:0/2569207020 >> 172.21.15.91:0/2569207020 conn(0x7f0d140c5d30 msgr2=0x7f0d140c27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:00.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 -- 172.21.15.91:0/2569207020 shutdown_connections 2023-11-27T20:46:00.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.578+0000 7f0d1c153640 1 -- 172.21.15.91:0/2569207020 wait complete. 2023-11-27T20:46:00.606 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-27T20:46:00.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.816+0000 7fe8739c5640 1 Processor -- start 2023-11-27T20:46:00.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.817+0000 7fe8739c5640 1 -- start start 2023-11-27T20:46:00.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.818+0000 7fe8739c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 0x7fe86c06d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:00.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.818+0000 7fe8739c5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe86c071f70 0x7fe86c0c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:00.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.818+0000 7fe8739c5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86c0c0980 con 0x7fe86c072530 2023-11-27T20:46:00.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.818+0000 7fe8739c5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86c06d160 con 0x7fe86c071f70 2023-11-27T20:46:00.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.818+0000 7fe8739c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c06c070 con 0x7fe86c14fa80 2023-11-27T20:46:00.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.819+0000 7fe871f62640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe86c071f70 0x7fe86c0c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:00.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.819+0000 7fe871f62640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe86c071f70 0x7fe86c0c2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:38444/0 (socket says 172.21.15.91:38444) 2023-11-27T20:46:00.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.819+0000 7fe871f62640 1 -- 172.21.15.91:0/4159007419 learned_addr learned my addr 172.21.15.91:0/4159007419 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:00.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.820+0000 7fe871761640 1 --2- 172.21.15.91:0/4159007419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 0x7fe86c06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:00.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.820+0000 7fe871f62640 1 -- 172.21.15.91:0/4159007419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 msgr2=0x7fe86c06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:00.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.820+0000 7fe871f62640 1 --2- 172.21.15.91:0/4159007419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 0x7fe86c06d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.820+0000 7fe871f62640 1 -- 172.21.15.91:0/4159007419 >> v1:172.21.15.183:6789/0 conn(0x7fe86c072530 legacy=0x7fe86c0c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:00.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.820+0000 7fe871f62640 1 -- 172.21.15.91:0/4159007419 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c06dc70 con 0x7fe86c071f70 2023-11-27T20:46:00.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.820+0000 7fe863fff640 1 -- 172.21.15.91:0/4159007419 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018772169 0 0) 0x7fe86c0c0980 con 0x7fe86c072530 2023-11-27T20:46:00.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.820+0000 7fe871761640 1 --2- 172.21.15.91:0/4159007419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 0x7fe86c06d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:00.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.821+0000 7fe871f62640 1 --2- 172.21.15.91:0/4159007419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe86c071f70 0x7fe86c0c2610 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe864009e50 tx=0x7fe86402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=582e9b3856e828e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:00.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.822+0000 7fe863fff640 1 -- 172.21.15.91:0/4159007419 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86402ca70 con 0x7fe86c071f70 2023-11-27T20:46:00.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.822+0000 7fe863fff640 1 -- 172.21.15.91:0/4159007419 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86402cbd0 con 0x7fe86c071f70 2023-11-27T20:46:00.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.822+0000 7fe863fff640 1 -- 172.21.15.91:0/4159007419 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8640343f0 con 0x7fe86c071f70 2023-11-27T20:46:00.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.822+0000 7fe8739c5640 1 -- 172.21.15.91:0/4159007419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe86c071f70 msgr2=0x7fe86c0c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:00.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.822+0000 7fe8739c5640 1 --2- 172.21.15.91:0/4159007419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe86c071f70 0x7fe86c0c2610 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe864009e50 tx=0x7fe86402bed0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.823+0000 7fe8739c5640 1 -- 172.21.15.91:0/4159007419 shutdown_connections 2023-11-27T20:46:00.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.823+0000 7fe8739c5640 1 --2- 172.21.15.91:0/4159007419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe86c071f70 0x7fe86c0c2610 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.823+0000 7fe8739c5640 1 --2- 172.21.15.91:0/4159007419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 0x7fe86c06d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.823+0000 7fe8739c5640 1 -- 172.21.15.91:0/4159007419 >> 172.21.15.91:0/4159007419 conn(0x7fe86c0c5bc0 msgr2=0x7fe86c0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:00.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.823+0000 7fe8739c5640 1 -- 172.21.15.91:0/4159007419 shutdown_connections 2023-11-27T20:46:00.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.823+0000 7fe8739c5640 1 -- 172.21.15.91:0/4159007419 wait complete. 2023-11-27T20:46:00.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.824+0000 7fe8739c5640 1 Processor -- start 2023-11-27T20:46:00.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.825+0000 7fe8739c5640 1 -- start start 2023-11-27T20:46:00.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.825+0000 7fe8739c5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe86c071f70 0x7fe86c0a7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:00.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.825+0000 7fe8739c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe86c072530 0x7fe86c146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:00.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.825+0000 7fe8739c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 0x7fe86c1e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:00.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe8739c5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c0a6830 con 0x7fe86c071f70 2023-11-27T20:46:00.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe8739c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c0a7a90 con 0x7fe86c072530 2023-11-27T20:46:00.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe8739c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c0a7760 con 0x7fe86c14fa80 2023-11-27T20:46:00.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe871761640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe86c071f70 0x7fe86c0a7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:00.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe871761640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe86c071f70 0x7fe86c0a7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57342/0 (socket says 172.21.15.91:57342) 2023-11-27T20:46:00.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe871761640 1 -- 172.21.15.91:0/3389185740 learned_addr learned my addr 172.21.15.91:0/3389185740 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:00.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe870f60640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe86c072530 0x7fe86c146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:00.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe871f62640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 0x7fe86c1e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:00.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe871761640 1 -- 172.21.15.91:0/3389185740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 msgr2=0x7fe86c1e7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:00.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe871761640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 0x7fe86c1e7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe871761640 1 -- 172.21.15.91:0/3389185740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe86c072530 msgr2=0x7fe86c146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:00.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe871761640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe86c072530 0x7fe86c146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:00.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.826+0000 7fe871761640 1 -- 172.21.15.91:0/3389185740 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe864009b30 con 0x7fe86c071f70 2023-11-27T20:46:00.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.827+0000 7fe871761640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe86c071f70 0x7fe86c0a7f20 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c7f0 tx=0x7fe86800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:00.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.827+0000 7fe861ffb640 1 -- 172.21.15.91:0/3389185740 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868007a30 con 0x7fe86c071f70 2023-11-27T20:46:00.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.827+0000 7fe861ffb640 1 -- 172.21.15.91:0/3389185740 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868007b90 con 0x7fe86c071f70 2023-11-27T20:46:00.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.827+0000 7fe861ffb640 1 -- 172.21.15.91:0/3389185740 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800ce40 con 0x7fe86c071f70 2023-11-27T20:46:00.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.827+0000 7fe8739c5640 1 -- 172.21.15.91:0/3389185740 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86c0a5a80 con 0x7fe86c071f70 2023-11-27T20:46:00.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.827+0000 7fe8739c5640 1 -- 172.21.15.91:0/3389185740 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86c147220 con 0x7fe86c071f70 2023-11-27T20:46:00.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.828+0000 7fe8739c5640 1 -- 172.21.15.91:0/3389185740 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86c068350 con 0x7fe86c071f70 2023-11-27T20:46:00.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.829+0000 7fe861ffb640 1 -- 172.21.15.91:0/3389185740 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe8680113f0 con 0x7fe86c071f70 2023-11-27T20:46:00.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.830+0000 7fe861ffb640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe85006b1f0 0x7fe85006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:00.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.830+0000 7fe861ffb640 1 -- 172.21.15.91:0/3389185740 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6271+0+0 (secure 0 0 0) 0x7fe868089d10 con 0x7fe86c071f70 2023-11-27T20:46:00.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.830+0000 7fe870f60640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe85006b1f0 0x7fe85006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:00.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.831+0000 7fe870f60640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe85006b1f0 0x7fe85006d6b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe86c147a10 tx=0x7fe85c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:00.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:00.835+0000 7fe861ffb640 1 -- 172.21.15.91:0/3389185740 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe8680548a0 con 0x7fe86c071f70 2023-11-27T20:46:01.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.028+0000 7fe8739c5640 1 -- 172.21.15.91:0/3389185740 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe86c0c4fb0 con 0x7fe86c071f70 2023-11-27T20:46:01.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.587+0000 7fe861ffb640 1 -- 172.21.15.91:0/3389185740 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe86801f0d0 con 0x7fe86c071f70 2023-11-27T20:46:01.588 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' removed 2023-11-27T20:46:01.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.590+0000 7fe8739c5640 1 -- 172.21.15.91:0/3389185740 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe85006b1f0 msgr2=0x7fe85006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:01.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.590+0000 7fe8739c5640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe85006b1f0 0x7fe85006d6b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe86c147a10 tx=0x7fe85c009040 comp rx=0 tx=0).stop 2023-11-27T20:46:01.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.590+0000 7fe8739c5640 1 -- 172.21.15.91:0/3389185740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe86c071f70 msgr2=0x7fe86c0a7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:01.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.590+0000 7fe8739c5640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe86c071f70 0x7fe86c0a7f20 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c7f0 tx=0x7fe86800cbf0 comp rx=0 tx=0).stop 2023-11-27T20:46:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.591+0000 7fe8739c5640 1 -- 172.21.15.91:0/3389185740 shutdown_connections 2023-11-27T20:46:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.591+0000 7fe8739c5640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe86c14fa80 0x7fe86c1e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.591+0000 7fe8739c5640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fe85006b1f0 0x7fe85006d6b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.591+0000 7fe8739c5640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe86c072530 0x7fe86c146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.591+0000 7fe8739c5640 1 --2- 172.21.15.91:0/3389185740 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe86c071f70 0x7fe86c0a7f20 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.591+0000 7fe8739c5640 1 -- 172.21.15.91:0/3389185740 >> 172.21.15.91:0/3389185740 conn(0x7fe86c0c5bc0 msgr2=0x7fe86c0c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.591+0000 7fe8739c5640 1 -- 172.21.15.91:0/3389185740 shutdown_connections 2023-11-27T20:46:01.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.592+0000 7fe8739c5640 1 -- 172.21.15.91:0/3389185740 wait complete. 2023-11-27T20:46:01.619 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:46:01.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.805+0000 7f6942c75640 1 Processor -- start 2023-11-27T20:46:01.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.805+0000 7f6942c75640 1 -- start start 2023-11-27T20:46:01.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.806+0000 7f6942c75640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f693c155490 0x7f693c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:01.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.806+0000 7f6942c75640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f693c0c1500 0x7f693c0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:01.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.806+0000 7f6942c75640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c0c06c0 con 0x7f693c0c4080 2023-11-27T20:46:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.806+0000 7f6942c75640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c0a5820 con 0x7f693c0c1500 2023-11-27T20:46:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.806+0000 7f6942c75640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c0c1020 con 0x7f693c155490 2023-11-27T20:46:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.806+0000 7f693bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f693c0c1500 0x7f693c0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.806+0000 7f693bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f693c0c1500 0x7f693c0a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57358/0 (socket says 172.21.15.91:57358) 2023-11-27T20:46:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.806+0000 7f693bfff640 1 -- 172.21.15.91:0/758347383 learned_addr learned my addr 172.21.15.91:0/758347383 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.807+0000 7f6940a11640 1 --2- 172.21.15.91:0/758347383 >> v2:172.21.15.183:3300/0 conn(0x7f693c155490 0x7f693c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.807+0000 7f693bfff640 1 -- 172.21.15.91:0/758347383 >> v2:172.21.15.183:3300/0 conn(0x7f693c155490 msgr2=0x7f693c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.807+0000 7f693bfff640 1 --2- 172.21.15.91:0/758347383 >> v2:172.21.15.183:3300/0 conn(0x7f693c155490 0x7f693c0a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.807+0000 7f693bfff640 1 -- 172.21.15.91:0/758347383 >> v1:172.21.15.183:6789/0 conn(0x7f693c0c4080 legacy=0x7f693c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:01.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.807+0000 7f693bfff640 1 -- 172.21.15.91:0/758347383 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c0c0910 con 0x7f693c0c1500 2023-11-27T20:46:01.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.807+0000 7f6940a11640 1 --2- 172.21.15.91:0/758347383 >> v2:172.21.15.183:3300/0 conn(0x7f693c155490 0x7f693c0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:01.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.808+0000 7f693bfff640 1 --2- 172.21.15.91:0/758347383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c1500 0x7f693c0a9430 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f693c06dff0 tx=0x7f692402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bea3e7aefd3875 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:01.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.808+0000 7f693b7fe640 1 -- 172.21.15.91:0/758347383 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924031870 con 0x7f693c0c1500 2023-11-27T20:46:01.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.808+0000 7f693b7fe640 1 -- 172.21.15.91:0/758347383 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69240319d0 con 0x7f693c0c1500 2023-11-27T20:46:01.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.808+0000 7f693b7fe640 1 -- 172.21.15.91:0/758347383 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924031d60 con 0x7f693c0c1500 2023-11-27T20:46:01.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.809+0000 7f6942c75640 1 -- 172.21.15.91:0/758347383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c1500 msgr2=0x7f693c0a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:01.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.809+0000 7f6942c75640 1 --2- 172.21.15.91:0/758347383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c1500 0x7f693c0a9430 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f693c06dff0 tx=0x7f692402b910 comp rx=0 tx=0).stop 2023-11-27T20:46:01.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.809+0000 7f6942c75640 1 -- 172.21.15.91:0/758347383 shutdown_connections 2023-11-27T20:46:01.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.809+0000 7f6942c75640 1 --2- 172.21.15.91:0/758347383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c1500 0x7f693c0a9430 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:01.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.809+0000 7f6942c75640 1 --2- 172.21.15.91:0/758347383 >> v2:172.21.15.183:3300/0 conn(0x7f693c155490 0x7f693c0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:01.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.809+0000 7f6942c75640 1 -- 172.21.15.91:0/758347383 >> 172.21.15.91:0/758347383 conn(0x7f693c06a500 msgr2=0x7f693c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:01.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.809+0000 7f6942c75640 1 -- 172.21.15.91:0/758347383 shutdown_connections 2023-11-27T20:46:01.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.809+0000 7f6942c75640 1 -- 172.21.15.91:0/758347383 wait complete. 2023-11-27T20:46:01.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.811+0000 7f6942c75640 1 Processor -- start 2023-11-27T20:46:01.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.811+0000 7f6942c75640 1 -- start start 2023-11-27T20:46:01.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.812+0000 7f6942c75640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f693c0c1500 0x7f693c14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:01.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.812+0000 7f6942c75640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c4080 0x7f693c0a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:01.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.812+0000 7f6942c75640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f693c155490 0x7f693c1ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:01.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.812+0000 7f6942c75640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c1dc3c0 con 0x7f693c0c4080 2023-11-27T20:46:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.812+0000 7f6942c75640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0a71f0 con 0x7f693c155490 2023-11-27T20:46:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.812+0000 7f6942c75640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c1dba90 con 0x7f693c0c1500 2023-11-27T20:46:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.812+0000 7f693bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c4080 0x7f693c0a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.812+0000 7f693bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c4080 0x7f693c0a9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57374/0 (socket says 172.21.15.91:57374) 2023-11-27T20:46:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.812+0000 7f693bfff640 1 -- 172.21.15.91:0/3961261393 learned_addr learned my addr 172.21.15.91:0/3961261393 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f6940a11640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f693c0c1500 0x7f693c14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f6941212640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f693c155490 0x7f693c1ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f693bfff640 1 -- 172.21.15.91:0/3961261393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f693c0c1500 msgr2=0x7f693c14ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f693bfff640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f693c0c1500 0x7f693c14ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:01.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f693bfff640 1 -- 172.21.15.91:0/3961261393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f693c155490 msgr2=0x7f693c1ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:01.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f693bfff640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f693c155490 0x7f693c1ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:01.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f693bfff640 1 -- 172.21.15.91:0/3961261393 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240094d0 con 0x7f693c0c4080 2023-11-27T20:46:01.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f6941212640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f693c155490 0x7f693c1ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:01.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f693bfff640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c4080 0x7f693c0a9c40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f692402b950 tx=0x7f69240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f69397fa640 1 -- 172.21.15.91:0/3961261393 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924031840 con 0x7f693c0c4080 2023-11-27T20:46:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f69397fa640 1 -- 172.21.15.91:0/3961261393 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69240443f0 con 0x7f693c0c4080 2023-11-27T20:46:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f69397fa640 1 -- 172.21.15.91:0/3961261393 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240447a0 con 0x7f693c0c4080 2023-11-27T20:46:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.813+0000 7f6942c75640 1 -- 172.21.15.91:0/3961261393 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c1ea770 con 0x7f693c0c4080 2023-11-27T20:46:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.814+0000 7f6942c75640 1 -- 172.21.15.91:0/3961261393 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c0a50d0 con 0x7f693c0c4080 2023-11-27T20:46:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.815+0000 7f6942c75640 1 -- 172.21.15.91:0/3961261393 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c1ea5a0 con 0x7f693c0c4080 2023-11-27T20:46:01.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.816+0000 7f69397fa640 1 -- 172.21.15.91:0/3961261393 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6924044900 con 0x7f693c0c4080 2023-11-27T20:46:01.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.816+0000 7f69397fa640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f691c06b1c0 0x7f691c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:01.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.817+0000 7f69397fa640 1 -- 172.21.15.91:0/3961261393 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f692402d040 con 0x7f693c0c4080 2023-11-27T20:46:01.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.817+0000 7f6940a11640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f691c06b1c0 0x7f691c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:01.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.817+0000 7f6940a11640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f691c06b1c0 0x7f691c06d680 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f692c007510 tx=0x7f692c0074a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:01.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:01.821+0000 7f69397fa640 1 -- 172.21.15.91:0/3961261393 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f69240770a0 con 0x7f693c0c4080 2023-11-27T20:46:02.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.009+0000 7f6942c75640 1 -- 172.21.15.91:0/3961261393 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f693c1ea900 con 0x7f693c0c4080 2023-11-27T20:46:02.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.010+0000 7f69397fa640 1 -- 172.21.15.91:0/3961261393 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f692407a6c0 con 0x7f693c0c4080 2023-11-27T20:46:02.012 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:02.013 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":84,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:46:01.576027+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.183:6835/2103536114":"2023-11-28T20:45:58.564564+0000","172.21.15.183:6833/2103536114":"2023-11-28T20:45:58.564564+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:46:02.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 -- 172.21.15.91:0/3961261393 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f691c06b1c0 msgr2=0x7f691c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f691c06b1c0 0x7f691c06d680 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f692c007510 tx=0x7f692c0074a0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 -- 172.21.15.91:0/3961261393 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c4080 msgr2=0x7f693c0a9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c4080 0x7f693c0a9c40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f692402b950 tx=0x7f69240046c0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 -- 172.21.15.91:0/3961261393 shutdown_connections 2023-11-27T20:46:02.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f691c06b1c0 0x7f691c06d680 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f693c155490 0x7f693c1ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f693c0c4080 0x7f693c0a9c40 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 --2- 172.21.15.91:0/3961261393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f693c0c1500 0x7f693c14ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 -- 172.21.15.91:0/3961261393 >> 172.21.15.91:0/3961261393 conn(0x7f693c06a500 msgr2=0x7f693c0c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:02.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 -- 172.21.15.91:0/3961261393 shutdown_connections 2023-11-27T20:46:02.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.013+0000 7f6942c75640 1 -- 172.21.15.91:0/3961261393 wait complete. 2023-11-27T20:46:02.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T20:41:23.446680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-27T20:45:19.465319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-27T20:45:20.794821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T20:46:02.033 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T20:46:02.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.243+0000 7f3b3e997640 1 Processor -- start 2023-11-27T20:46:02.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.243+0000 7f3b3e997640 1 -- start start 2023-11-27T20:46:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3e997640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3b3814fd30 0x7f3b38152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3e997640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3b380c3ea0 0x7f3b380c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3e997640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b380c64a0 con 0x7f3b3806d0a0 2023-11-27T20:46:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3e997640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b380c5c00 con 0x7f3b380c3ea0 2023-11-27T20:46:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3e997640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b380c5ee0 con 0x7f3b3814fd30 2023-11-27T20:46:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3cf34640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3b380c3ea0 0x7f3b380c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3cf34640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3b380c3ea0 0x7f3b380c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57388/0 (socket says 172.21.15.91:57388) 2023-11-27T20:46:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3cf34640 1 -- 172.21.15.91:0/1509998467 learned_addr learned my addr 172.21.15.91:0/1509998467 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:02.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b37fff640 1 --2- 172.21.15.91:0/1509998467 >> v2:172.21.15.183:3300/0 conn(0x7f3b3814fd30 0x7f3b38152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:02.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3cf34640 1 -- 172.21.15.91:0/1509998467 >> v2:172.21.15.183:3300/0 conn(0x7f3b3814fd30 msgr2=0x7f3b38152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:02.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3cf34640 1 --2- 172.21.15.91:0/1509998467 >> v2:172.21.15.183:3300/0 conn(0x7f3b3814fd30 0x7f3b38152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3cf34640 1 -- 172.21.15.91:0/1509998467 >> v1:172.21.15.183:6789/0 conn(0x7f3b3806d0a0 legacy=0x7f3b380a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:02.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.245+0000 7f3b3cf34640 1 -- 172.21.15.91:0/1509998467 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b380c61c0 con 0x7f3b380c3ea0 2023-11-27T20:46:02.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.247+0000 7f3b3cf34640 1 --2- 172.21.15.91:0/1509998467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b380c3ea0 0x7f3b380c4330 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f3b3806b200 tx=0x7f3b3002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbd2291375ff5e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:02.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.247+0000 7f3b377fe640 1 -- 172.21.15.91:0/1509998467 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3002ca80 con 0x7f3b380c3ea0 2023-11-27T20:46:02.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.247+0000 7f3b377fe640 1 -- 172.21.15.91:0/1509998467 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3002cbe0 con 0x7f3b380c3ea0 2023-11-27T20:46:02.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.247+0000 7f3b377fe640 1 -- 172.21.15.91:0/1509998467 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300343f0 con 0x7f3b380c3ea0 2023-11-27T20:46:02.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.247+0000 7f3b3e997640 1 -- 172.21.15.91:0/1509998467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b380c3ea0 msgr2=0x7f3b380c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.248+0000 7f3b3e997640 1 --2- 172.21.15.91:0/1509998467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b380c3ea0 0x7f3b380c4330 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f3b3806b200 tx=0x7f3b3002bee0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.248+0000 7f3b3e997640 1 -- 172.21.15.91:0/1509998467 shutdown_connections 2023-11-27T20:46:02.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.248+0000 7f3b3e997640 1 --2- 172.21.15.91:0/1509998467 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b380c3ea0 0x7f3b380c4330 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.248+0000 7f3b3e997640 1 --2- 172.21.15.91:0/1509998467 >> v2:172.21.15.183:3300/0 conn(0x7f3b3814fd30 0x7f3b38152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.248+0000 7f3b3e997640 1 -- 172.21.15.91:0/1509998467 >> 172.21.15.91:0/1509998467 conn(0x7f3b3806a500 msgr2=0x7f3b3806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:02.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.248+0000 7f3b3e997640 1 -- 172.21.15.91:0/1509998467 shutdown_connections 2023-11-27T20:46:02.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.248+0000 7f3b3e997640 1 -- 172.21.15.91:0/1509998467 wait complete. 2023-11-27T20:46:02.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.249+0000 7f3b3e997640 1 Processor -- start 2023-11-27T20:46:02.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.250+0000 7f3b3e997640 1 -- start start 2023-11-27T20:46:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.250+0000 7f3b3e997640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b3806d0a0 0x7f3b381dbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.250+0000 7f3b3e997640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b380c3ea0 0x7f3b38070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.250+0000 7f3b3e997640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b3814fd30 0x7f3b380705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.250+0000 7f3b3e997640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380a5290 con 0x7f3b3806d0a0 2023-11-27T20:46:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.250+0000 7f3b3e997640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b381eb130 con 0x7f3b3814fd30 2023-11-27T20:46:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.250+0000 7f3b3e997640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b381ea5b0 con 0x7f3b380c3ea0 2023-11-27T20:46:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.251+0000 7f3b37fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b3806d0a0 0x7f3b381dbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:02.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.251+0000 7f3b37fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b3806d0a0 0x7f3b381dbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57398/0 (socket says 172.21.15.91:57398) 2023-11-27T20:46:02.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.251+0000 7f3b37fff640 1 -- 172.21.15.91:0/3469234133 learned_addr learned my addr 172.21.15.91:0/3469234133 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.251+0000 7f3b37fff640 1 -- 172.21.15.91:0/3469234133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b380c3ea0 msgr2=0x7f3b38070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.251+0000 7f3b37fff640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b380c3ea0 0x7f3b38070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.251+0000 7f3b37fff640 1 -- 172.21.15.91:0/3469234133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b3814fd30 msgr2=0x7f3b380705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.251+0000 7f3b3cf34640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b3814fd30 0x7f3b380705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.251+0000 7f3b37fff640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b3814fd30 0x7f3b380705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.251+0000 7f3b37fff640 1 -- 172.21.15.91:0/3469234133 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b30009b30 con 0x7f3b3806d0a0 2023-11-27T20:46:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.251+0000 7f3b37fff640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b3806d0a0 0x7f3b381dbf50 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800d800 tx=0x7f3b2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.252+0000 7f3b357fa640 1 -- 172.21.15.91:0/3469234133 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2800b6c0 con 0x7f3b3806d0a0 2023-11-27T20:46:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.252+0000 7f3b357fa640 1 -- 172.21.15.91:0/3469234133 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2800b840 con 0x7f3b3806d0a0 2023-11-27T20:46:02.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.252+0000 7f3b357fa640 1 -- 172.21.15.91:0/3469234133 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2800bbf0 con 0x7f3b3806d0a0 2023-11-27T20:46:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.252+0000 7f3b3e997640 1 -- 172.21.15.91:0/3469234133 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b381ea890 con 0x7f3b3806d0a0 2023-11-27T20:46:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.252+0000 7f3b3e997640 1 -- 172.21.15.91:0/3469234133 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b381eae50 con 0x7f3b3806d0a0 2023-11-27T20:46:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.253+0000 7f3b3e997640 1 -- 172.21.15.91:0/3469234133 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b38068350 con 0x7f3b3806d0a0 2023-11-27T20:46:02.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.254+0000 7f3b357fa640 1 -- 172.21.15.91:0/3469234133 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3b2800bd50 con 0x7f3b3806d0a0 2023-11-27T20:46:02.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.255+0000 7f3b357fa640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b1806b1c0 0x7f3b1806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.255+0000 7f3b357fa640 1 -- 172.21.15.91:0/3469234133 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f3b28089ff0 con 0x7f3b3806d0a0 2023-11-27T20:46:02.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.255+0000 7f3b2ffff640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b1806b1c0 0x7f3b1806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:02.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.256+0000 7f3b2ffff640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b1806b1c0 0x7f3b1806d680 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3b20006fd0 tx=0x7f3b20006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:02.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.259+0000 7f3b357fa640 1 -- 172.21.15.91:0/3469234133 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3b28054d10 con 0x7f3b3806d0a0 2023-11-27T20:46:02.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.444+0000 7f3b3e997640 1 -- 172.21.15.91:0/3469234133 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b3806d540 con 0x7f3b3806d0a0 2023-11-27T20:46:02.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.445+0000 7f3b357fa640 1 -- 172.21.15.91:0/3469234133 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b28058330 con 0x7f3b3806d0a0 2023-11-27T20:46:02.446 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-11-27T20:46:02.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 -- 172.21.15.91:0/3469234133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b1806b1c0 msgr2=0x7f3b1806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b1806b1c0 0x7f3b1806d680 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3b20006fd0 tx=0x7f3b20006bc0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 -- 172.21.15.91:0/3469234133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b3806d0a0 msgr2=0x7f3b381dbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b3806d0a0 0x7f3b381dbf50 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800d800 tx=0x7f3b2800dcc0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 -- 172.21.15.91:0/3469234133 shutdown_connections 2023-11-27T20:46:02.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f3b1806b1c0 0x7f3b1806d680 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b3814fd30 0x7f3b380705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b380c3ea0 0x7f3b38070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 --2- 172.21.15.91:0/3469234133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b3806d0a0 0x7f3b381dbf50 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 -- 172.21.15.91:0/3469234133 >> 172.21.15.91:0/3469234133 conn(0x7f3b3806a500 msgr2=0x7f3b380a6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:02.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.447+0000 7f3b3e997640 1 -- 172.21.15.91:0/3469234133 shutdown_connections 2023-11-27T20:46:02.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.448+0000 7f3b3e997640 1 -- 172.21.15.91:0/3469234133 wait complete. 2023-11-27T20:46:02.467 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-27T20:46:02.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.679+0000 7f692a426640 1 Processor -- start 2023-11-27T20:46:02.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.679+0000 7f692a426640 1 -- start start 2023-11-27T20:46:02.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.680+0000 7f692a426640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6924155490 0x7f69240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.680+0000 7f692a426640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240a9b40 0x7f69240c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.680+0000 7f692a426640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69240c06c0 con 0x7f69240c1500 2023-11-27T20:46:02.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.680+0000 7f692a426640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240a5820 con 0x7f6924155490 2023-11-27T20:46:02.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.680+0000 7f692a426640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c1020 con 0x7f69240a9b40 2023-11-27T20:46:02.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.681+0000 7f6923fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6924155490 0x7f69240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:02.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.681+0000 7f6923fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6924155490 0x7f69240a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57400/0 (socket says 172.21.15.91:57400) 2023-11-27T20:46:02.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.681+0000 7f6923fff640 1 -- 172.21.15.91:0/1429412226 learned_addr learned my addr 172.21.15.91:0/1429412226 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:02.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.681+0000 7f6923fff640 1 -- 172.21.15.91:0/1429412226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240a9b40 msgr2=0x7f69240c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:02.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.681+0000 7f6923fff640 1 --2- 172.21.15.91:0/1429412226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240a9b40 0x7f69240c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.681+0000 7f6923fff640 1 -- 172.21.15.91:0/1429412226 >> v1:172.21.15.183:6789/0 conn(0x7f69240c1500 legacy=0x7f69240a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:02.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.681+0000 7f6923fff640 1 -- 172.21.15.91:0/1429412226 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240c0910 con 0x7f6924155490 2023-11-27T20:46:02.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.682+0000 7f6923fff640 1 --2- 172.21.15.91:0/1429412226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6924155490 0x7f69240a51b0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6914009e50 tx=0x7f691402bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349f5daa43000c10 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:02.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.682+0000 7f69237fe640 1 -- 172.21.15.91:0/1429412226 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691402caa0 con 0x7f6924155490 2023-11-27T20:46:02.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.682+0000 7f69237fe640 1 -- 172.21.15.91:0/1429412226 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691402cc00 con 0x7f6924155490 2023-11-27T20:46:02.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.683+0000 7f69237fe640 1 -- 172.21.15.91:0/1429412226 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140343f0 con 0x7f6924155490 2023-11-27T20:46:02.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.683+0000 7f692a426640 1 -- 172.21.15.91:0/1429412226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6924155490 msgr2=0x7f69240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.683+0000 7f692a426640 1 --2- 172.21.15.91:0/1429412226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6924155490 0x7f69240a51b0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6914009e50 tx=0x7f691402bf00 comp rx=0 tx=0).stop 2023-11-27T20:46:02.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.683+0000 7f692a426640 1 -- 172.21.15.91:0/1429412226 shutdown_connections 2023-11-27T20:46:02.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.683+0000 7f692a426640 1 --2- 172.21.15.91:0/1429412226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240a9b40 0x7f69240c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.683+0000 7f692a426640 1 --2- 172.21.15.91:0/1429412226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6924155490 0x7f69240a51b0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.683+0000 7f692a426640 1 -- 172.21.15.91:0/1429412226 >> 172.21.15.91:0/1429412226 conn(0x7f692406a500 msgr2=0x7f692406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:02.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.683+0000 7f692a426640 1 -- 172.21.15.91:0/1429412226 shutdown_connections 2023-11-27T20:46:02.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.683+0000 7f692a426640 1 -- 172.21.15.91:0/1429412226 wait complete. 2023-11-27T20:46:02.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.685+0000 7f692a426640 1 Processor -- start 2023-11-27T20:46:02.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.685+0000 7f692a426640 1 -- start start 2023-11-27T20:46:02.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f692a426640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69240c1500 0x7f69241dee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f692a426640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6924155490 0x7f69241ed970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f692a426640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69241e9e40 0x7f69241edeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f692a426640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240bdff0 con 0x7f69241e9e40 2023-11-27T20:46:02.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f692a426640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240bdc10 con 0x7f69240c1500 2023-11-27T20:46:02.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f692a426640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69240bb340 con 0x7f6924155490 2023-11-27T20:46:02.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f69289c3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69241e9e40 0x7f69241edeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:02.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f69289c3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69241e9e40 0x7f69241edeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57414/0 (socket says 172.21.15.91:57414) 2023-11-27T20:46:02.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f69289c3640 1 -- 172.21.15.91:0/520055738 learned_addr learned my addr 172.21.15.91:0/520055738 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:02.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f691b7fe640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6924155490 0x7f69241ed970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:02.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f69289c3640 1 -- 172.21.15.91:0/520055738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6924155490 msgr2=0x7f69241ed970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f69289c3640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6924155490 0x7f69241ed970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f6923fff640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69240c1500 0x7f69241dee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:02.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.686+0000 7f69289c3640 1 -- 172.21.15.91:0/520055738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69240c1500 msgr2=0x7f69241dee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.687+0000 7f69289c3640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69240c1500 0x7f69241dee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.687+0000 7f69289c3640 1 -- 172.21.15.91:0/520055738 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6914009b30 con 0x7f69241e9e40 2023-11-27T20:46:02.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.687+0000 7f69289c3640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69241e9e40 0x7f69241edeb0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f691c00b3f0 tx=0x7f691c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:02.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.687+0000 7f69217fa640 1 -- 172.21.15.91:0/520055738 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c011830 con 0x7f69241e9e40 2023-11-27T20:46:02.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.687+0000 7f69217fa640 1 -- 172.21.15.91:0/520055738 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c0119b0 con 0x7f69241e9e40 2023-11-27T20:46:02.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.687+0000 7f69217fa640 1 -- 172.21.15.91:0/520055738 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c011d60 con 0x7f69241e9e40 2023-11-27T20:46:02.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.687+0000 7f692a426640 1 -- 172.21.15.91:0/520055738 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6924150950 con 0x7f69241e9e40 2023-11-27T20:46:02.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.687+0000 7f692a426640 1 -- 172.21.15.91:0/520055738 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69240bb060 con 0x7f69241e9e40 2023-11-27T20:46:02.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.689+0000 7f692a426640 1 -- 172.21.15.91:0/520055738 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6924068350 con 0x7f69241e9e40 2023-11-27T20:46:02.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.690+0000 7f69217fa640 1 -- 172.21.15.91:0/520055738 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f691c01a400 con 0x7f69241e9e40 2023-11-27T20:46:02.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.691+0000 7f69217fa640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f690406b1c0 0x7f690406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:02.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.691+0000 7f69217fa640 1 -- 172.21.15.91:0/520055738 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f691c089b90 con 0x7f69241e9e40 2023-11-27T20:46:02.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.691+0000 7f6923fff640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f690406b1c0 0x7f690406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:02.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.692+0000 7f6923fff640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f690406b1c0 0x7f690406d680 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6914035000 tx=0x7f6914030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:02.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.695+0000 7f69217fa640 1 -- 172.21.15.91:0/520055738 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f691c0548f0 con 0x7f69241e9e40 2023-11-27T20:46:02.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.883+0000 7f692a426640 1 -- 172.21.15.91:0/520055738 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6924154b10 con 0x7f69241e9e40 2023-11-27T20:46:02.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.884+0000 7f69217fa640 1 -- 172.21.15.91:0/520055738 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v84) v1 ==== 105+0+11 (secure 0 0 0) 0x7f691c015020 con 0x7f69241e9e40 2023-11-27T20:46:02.886 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-11-27T20:46:02.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.886+0000 7f692a426640 1 -- 172.21.15.91:0/520055738 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f690406b1c0 msgr2=0x7f690406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.886+0000 7f692a426640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f690406b1c0 0x7f690406d680 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6914035000 tx=0x7f6914030000 comp rx=0 tx=0).stop 2023-11-27T20:46:02.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.886+0000 7f692a426640 1 -- 172.21.15.91:0/520055738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69241e9e40 msgr2=0x7f69241edeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:02.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.886+0000 7f692a426640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69241e9e40 0x7f69241edeb0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f691c00b3f0 tx=0x7f691c00b8b0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.886+0000 7f692a426640 1 -- 172.21.15.91:0/520055738 shutdown_connections 2023-11-27T20:46:02.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.886+0000 7f692a426640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69241e9e40 0x7f69241edeb0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.886+0000 7f692a426640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6924155490 0x7f69241ed970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.886+0000 7f692a426640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f690406b1c0 0x7f690406d680 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.886+0000 7f692a426640 1 --2- 172.21.15.91:0/520055738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69240c1500 0x7f69241dee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:02.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.887+0000 7f692a426640 1 -- 172.21.15.91:0/520055738 >> 172.21.15.91:0/520055738 conn(0x7f692406a500 msgr2=0x7f69240a9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:02.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.887+0000 7f692a426640 1 -- 172.21.15.91:0/520055738 shutdown_connections 2023-11-27T20:46:02.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:02.887+0000 7f692a426640 1 -- 172.21.15.91:0/520055738 wait complete. 2023-11-27T20:46:02.906 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-27T20:46:03.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.114+0000 7f84970c2640 1 Processor -- start 2023-11-27T20:46:03.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.114+0000 7f84970c2640 1 -- start start 2023-11-27T20:46:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.115+0000 7f84970c2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8490151cc0 0x7f8490155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f84970c2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f84900c4940 0x7f84900c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f84970c2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84901556d0 con 0x7f84900c7ec0 2023-11-27T20:46:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f84970c2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8490154740 con 0x7f84900c4940 2023-11-27T20:46:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f84970c2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849006c760 con 0x7f8490151cc0 2023-11-27T20:46:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f849565f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f84900c4940 0x7f84900c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f849565f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f84900c4940 0x7f84900c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57430/0 (socket says 172.21.15.91:57430) 2023-11-27T20:46:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f849565f640 1 -- 172.21.15.91:0/1171561109 learned_addr learned my addr 172.21.15.91:0/1171561109 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:03.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f8494e5e640 1 --2- 172.21.15.91:0/1171561109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8490151cc0 0x7f8490155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f849565f640 1 -- 172.21.15.91:0/1171561109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8490151cc0 msgr2=0x7f8490155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f849565f640 1 --2- 172.21.15.91:0/1171561109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8490151cc0 0x7f8490155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f849565f640 1 -- 172.21.15.91:0/1171561109 >> v1:172.21.15.183:6789/0 conn(0x7f84900c7ec0 legacy=0x7f8490157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:03.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.116+0000 7f849565f640 1 -- 172.21.15.91:0/1171561109 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900c8470 con 0x7f84900c4940 2023-11-27T20:46:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.117+0000 7f849565f640 1 --2- 172.21.15.91:0/1171561109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84900c4940 0x7f84900c4d50 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f8488009e50 tx=0x7f848802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197735f3dd11d04e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.118+0000 7f848f7fe640 1 -- 172.21.15.91:0/1171561109 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848802ca70 con 0x7f84900c4940 2023-11-27T20:46:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.118+0000 7f848f7fe640 1 -- 172.21.15.91:0/1171561109 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848802cbd0 con 0x7f84900c4940 2023-11-27T20:46:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.118+0000 7f848f7fe640 1 -- 172.21.15.91:0/1171561109 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880343f0 con 0x7f84900c4940 2023-11-27T20:46:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.118+0000 7f84970c2640 1 -- 172.21.15.91:0/1171561109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84900c4940 msgr2=0x7f84900c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.118+0000 7f84970c2640 1 --2- 172.21.15.91:0/1171561109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84900c4940 0x7f84900c4d50 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f8488009e50 tx=0x7f848802bed0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.118+0000 7f84970c2640 1 -- 172.21.15.91:0/1171561109 shutdown_connections 2023-11-27T20:46:03.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.118+0000 7f84970c2640 1 --2- 172.21.15.91:0/1171561109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84900c4940 0x7f84900c4d50 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.118+0000 7f84970c2640 1 --2- 172.21.15.91:0/1171561109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8490151cc0 0x7f8490155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.118+0000 7f84970c2640 1 -- 172.21.15.91:0/1171561109 >> 172.21.15.91:0/1171561109 conn(0x7f8490071e10 msgr2=0x7f8490072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.119+0000 7f84970c2640 1 -- 172.21.15.91:0/1171561109 shutdown_connections 2023-11-27T20:46:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.119+0000 7f84970c2640 1 -- 172.21.15.91:0/1171561109 wait complete. 2023-11-27T20:46:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.120+0000 7f84970c2640 1 Processor -- start 2023-11-27T20:46:03.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.120+0000 7f84970c2640 1 -- start start 2023-11-27T20:46:03.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.121+0000 7f84970c2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84900c4940 0x7f84901ead40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.121+0000 7f84970c2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84900c7ec0 0x7f84900aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.121+0000 7f84970c2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8490151cc0 0x7f849014fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.121+0000 7f84970c2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900af590 con 0x7f8490151cc0 2023-11-27T20:46:03.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.121+0000 7f84970c2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900c4410 con 0x7f84900c7ec0 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.121+0000 7f84970c2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84901eb280 con 0x7f84900c4940 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.121+0000 7f849565f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8490151cc0 0x7f849014fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.121+0000 7f849565f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8490151cc0 0x7f849014fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57440/0 (socket says 172.21.15.91:57440) 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f849565f640 1 -- 172.21.15.91:0/2239236915 learned_addr learned my addr 172.21.15.91:0/2239236915 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f8494e5e640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84900c4940 0x7f84901ead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f848ffff640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84900c7ec0 0x7f84900aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f849565f640 1 -- 172.21.15.91:0/2239236915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84900c4940 msgr2=0x7f84901ead40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f849565f640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84900c4940 0x7f84901ead40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f849565f640 1 -- 172.21.15.91:0/2239236915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84900c7ec0 msgr2=0x7f84900aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f849565f640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84900c7ec0 0x7f84900aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f849565f640 1 -- 172.21.15.91:0/2239236915 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488009b30 con 0x7f8490151cc0 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f8494e5e640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84900c4940 0x7f84901ead40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:03.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f848ffff640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84900c7ec0 0x7f84900aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.122+0000 7f849565f640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8490151cc0 0x7f849014fc50 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f8488009e50 tx=0x7f8488004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.123+0000 7f848d7fa640 1 -- 172.21.15.91:0/2239236915 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848803e450 con 0x7f8490151cc0 2023-11-27T20:46:03.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.123+0000 7f848d7fa640 1 -- 172.21.15.91:0/2239236915 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848803e5d0 con 0x7f8490151cc0 2023-11-27T20:46:03.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.123+0000 7f848d7fa640 1 -- 172.21.15.91:0/2239236915 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848803e980 con 0x7f8490151cc0 2023-11-27T20:46:03.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.123+0000 7f84970c2640 1 -- 172.21.15.91:0/2239236915 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8490150b50 con 0x7f8490151cc0 2023-11-27T20:46:03.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.123+0000 7f84970c2640 1 -- 172.21.15.91:0/2239236915 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849014f4e0 con 0x7f8490151cc0 2023-11-27T20:46:03.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.124+0000 7f84970c2640 1 -- 172.21.15.91:0/2239236915 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8490067d50 con 0x7f8490151cc0 2023-11-27T20:46:03.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.125+0000 7f848d7fa640 1 -- 172.21.15.91:0/2239236915 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f848803eae0 con 0x7f8490151cc0 2023-11-27T20:46:03.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.126+0000 7f848d7fa640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f847406b1c0 0x7f847406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.126+0000 7f848d7fa640 1 -- 172.21.15.91:0/2239236915 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f84880ac620 con 0x7f8490151cc0 2023-11-27T20:46:03.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.126+0000 7f8494e5e640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f847406b1c0 0x7f847406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.127+0000 7f8494e5e640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f847406b1c0 0x7f847406d680 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f848400b820 tx=0x7f8484008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:03.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.130+0000 7f848d7fa640 1 -- 172.21.15.91:0/2239236915 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8488077380 con 0x7f8490151cc0 2023-11-27T20:46:03.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.324+0000 7f84970c2640 1 -- 172.21.15.91:0/2239236915 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f8490155670 con 0x7f8490151cc0 2023-11-27T20:46:03.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.325+0000 7f848d7fa640 1 -- 172.21.15.91:0/2239236915 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v84) v1 ==== 101+0+11 (secure 0 0 0) 0x7f848807a9a0 con 0x7f8490151cc0 2023-11-27T20:46:03.327 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-11-27T20:46:03.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 -- 172.21.15.91:0/2239236915 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f847406b1c0 msgr2=0x7f847406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:03.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f847406b1c0 0x7f847406d680 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f848400b820 tx=0x7f8484008040 comp rx=0 tx=0).stop 2023-11-27T20:46:03.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 -- 172.21.15.91:0/2239236915 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8490151cc0 msgr2=0x7f849014fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:03.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8490151cc0 0x7f849014fc50 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f8488009e50 tx=0x7f8488004a40 comp rx=0 tx=0).stop 2023-11-27T20:46:03.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 -- 172.21.15.91:0/2239236915 shutdown_connections 2023-11-27T20:46:03.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8490151cc0 0x7f849014fc50 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f847406b1c0 0x7f847406d680 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84900c7ec0 0x7f84900aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 --2- 172.21.15.91:0/2239236915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84900c4940 0x7f84901ead40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 -- 172.21.15.91:0/2239236915 >> 172.21.15.91:0/2239236915 conn(0x7f8490071e10 msgr2=0x7f84900abf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:03.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 -- 172.21.15.91:0/2239236915 shutdown_connections 2023-11-27T20:46:03.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.328+0000 7f84970c2640 1 -- 172.21.15.91:0/2239236915 wait complete. 2023-11-27T20:46:03.348 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:46:03.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.559+0000 7f36df6d3640 1 Processor -- start 2023-11-27T20:46:03.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.559+0000 7f36df6d3640 1 -- start start 2023-11-27T20:46:03.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.560+0000 7f36df6d3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f36d814fd30 0x7f36d8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.560+0000 7f36df6d3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d80c3ea0 0x7f36d80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36df6d3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d80c64a0 con 0x7f36d806d0a0 2023-11-27T20:46:03.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36df6d3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d80c5c00 con 0x7f36d814fd30 2023-11-27T20:46:03.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36df6d3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80c5ee0 con 0x7f36d80c3ea0 2023-11-27T20:46:03.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36dd46f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f36d814fd30 0x7f36d8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36dd46f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f36d814fd30 0x7f36d8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57448/0 (socket says 172.21.15.91:57448) 2023-11-27T20:46:03.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36dd46f640 1 -- 172.21.15.91:0/1527016242 learned_addr learned my addr 172.21.15.91:0/1527016242 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:03.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36ddc70640 1 --2- 172.21.15.91:0/1527016242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d80c3ea0 0x7f36d80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36dd46f640 1 -- 172.21.15.91:0/1527016242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d80c3ea0 msgr2=0x7f36d80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:03.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36dd46f640 1 --2- 172.21.15.91:0/1527016242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d80c3ea0 0x7f36d80c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36dd46f640 1 -- 172.21.15.91:0/1527016242 >> v1:172.21.15.183:6789/0 conn(0x7f36d806d0a0 legacy=0x7f36d80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:03.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36dd46f640 1 -- 172.21.15.91:0/1527016242 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d80c61c0 con 0x7f36d814fd30 2023-11-27T20:46:03.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.561+0000 7f36ddc70640 1 --2- 172.21.15.91:0/1527016242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d80c3ea0 0x7f36d80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:03.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.563+0000 7f36dd46f640 1 --2- 172.21.15.91:0/1527016242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d814fd30 0x7f36d8152f20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009870 tx=0x7f36d402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b411f08d3b54345 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:03.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.563+0000 7f36cffff640 1 -- 172.21.15.91:0/1527016242 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4031640 con 0x7f36d814fd30 2023-11-27T20:46:03.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.563+0000 7f36cffff640 1 -- 172.21.15.91:0/1527016242 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d40317a0 con 0x7f36d814fd30 2023-11-27T20:46:03.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.563+0000 7f36cffff640 1 -- 172.21.15.91:0/1527016242 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4031b30 con 0x7f36d814fd30 2023-11-27T20:46:03.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.563+0000 7f36df6d3640 1 -- 172.21.15.91:0/1527016242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d814fd30 msgr2=0x7f36d8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:03.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.563+0000 7f36df6d3640 1 --2- 172.21.15.91:0/1527016242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d814fd30 0x7f36d8152f20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009870 tx=0x7f36d402b8f0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.564+0000 7f36df6d3640 1 -- 172.21.15.91:0/1527016242 shutdown_connections 2023-11-27T20:46:03.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.564+0000 7f36df6d3640 1 --2- 172.21.15.91:0/1527016242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d80c3ea0 0x7f36d80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.564+0000 7f36df6d3640 1 --2- 172.21.15.91:0/1527016242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d814fd30 0x7f36d8152f20 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.564+0000 7f36df6d3640 1 -- 172.21.15.91:0/1527016242 >> 172.21.15.91:0/1527016242 conn(0x7f36d806a500 msgr2=0x7f36d806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:03.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.564+0000 7f36df6d3640 1 -- 172.21.15.91:0/1527016242 shutdown_connections 2023-11-27T20:46:03.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.564+0000 7f36df6d3640 1 -- 172.21.15.91:0/1527016242 wait complete. 2023-11-27T20:46:03.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.566+0000 7f36df6d3640 1 Processor -- start 2023-11-27T20:46:03.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.566+0000 7f36df6d3640 1 -- start start 2023-11-27T20:46:03.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.567+0000 7f36df6d3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d806d0a0 0x7f36d8153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.569 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.567+0000 7f36df6d3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d80c3ea0 0x7f36d8070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.567+0000 7f36df6d3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36d814fd30 0x7f36d81e89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.567+0000 7f36df6d3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80bba40 con 0x7f36d80c3ea0 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.567+0000 7f36df6d3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d81e8560 con 0x7f36d814fd30 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.567+0000 7f36df6d3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d81e8230 con 0x7f36d806d0a0 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.567+0000 7f36dcc6e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d80c3ea0 0x7f36d8070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.568+0000 7f36dcc6e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d80c3ea0 0x7f36d8070c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57452/0 (socket says 172.21.15.91:57452) 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.568+0000 7f36dcc6e640 1 -- 172.21.15.91:0/2720094838 learned_addr learned my addr 172.21.15.91:0/2720094838 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.568+0000 7f36dd46f640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d806d0a0 0x7f36d8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.568+0000 7f36ddc70640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36d814fd30 0x7f36d81e89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.568+0000 7f36dcc6e640 1 -- 172.21.15.91:0/2720094838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d806d0a0 msgr2=0x7f36d8153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:03.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.568+0000 7f36dcc6e640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d806d0a0 0x7f36d8153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.568+0000 7f36dcc6e640 1 -- 172.21.15.91:0/2720094838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36d814fd30 msgr2=0x7f36d81e89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:03.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.568+0000 7f36dcc6e640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36d814fd30 0x7f36d81e89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.568+0000 7f36dcc6e640 1 -- 172.21.15.91:0/2720094838 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d40094d0 con 0x7f36d80c3ea0 2023-11-27T20:46:03.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.568+0000 7f36dcc6e640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d80c3ea0 0x7f36d8070c70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f36c800b3c0 tx=0x7f36c800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:03.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.569+0000 7f36cdffb640 1 -- 172.21.15.91:0/2720094838 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8011830 con 0x7f36d80c3ea0 2023-11-27T20:46:03.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.569+0000 7f36cdffb640 1 -- 172.21.15.91:0/2720094838 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c8011990 con 0x7f36d80c3ea0 2023-11-27T20:46:03.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.569+0000 7f36cdffb640 1 -- 172.21.15.91:0/2720094838 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8011d40 con 0x7f36d80c3ea0 2023-11-27T20:46:03.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.569+0000 7f36df6d3640 1 -- 172.21.15.91:0/2720094838 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d81ec240 con 0x7f36d80c3ea0 2023-11-27T20:46:03.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.569+0000 7f36df6d3640 1 -- 172.21.15.91:0/2720094838 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d80711b0 con 0x7f36d80c3ea0 2023-11-27T20:46:03.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.570+0000 7f36df6d3640 1 -- 172.21.15.91:0/2720094838 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d81e86f0 con 0x7f36d80c3ea0 2023-11-27T20:46:03.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.571+0000 7f36cdffb640 1 -- 172.21.15.91:0/2720094838 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f36c801b460 con 0x7f36d80c3ea0 2023-11-27T20:46:03.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.572+0000 7f36cdffb640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36bc06b1c0 0x7f36bc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:03.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.572+0000 7f36cdffb640 1 -- 172.21.15.91:0/2720094838 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f36c8089650 con 0x7f36d80c3ea0 2023-11-27T20:46:03.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.572+0000 7f36dd46f640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36bc06b1c0 0x7f36bc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:03.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.573+0000 7f36dd46f640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36bc06b1c0 0x7f36bc06d680 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f36d4036000 tx=0x7f36d403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:03.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.576+0000 7f36cdffb640 1 -- 172.21.15.91:0/2720094838 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f36c8054280 con 0x7f36d80c3ea0 2023-11-27T20:46:03.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.806+0000 7f36df6d3640 1 -- 172.21.15.91:0/2720094838 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36d8068350 con 0x7f36d80c3ea0 2023-11-27T20:46:03.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.807+0000 7f36cdffb640 1 -- 172.21.15.91:0/2720094838 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f36c80578a0 con 0x7f36d80c3ea0 2023-11-27T20:46:03.809 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:03.809 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3277281414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3277281414},{"type":"v1","addr":"172.21.15.183:6835","nonce":3277281414}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:21.787805+0000","modified":"2023-11-27T20:45:24.857169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/1761528163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1761528163},{"type":"v1","addr":"172.21.15.91:6837","nonce":1761528163}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-27T20:46:03.809 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 53 2023-11-27T20:46:03.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 -- 172.21.15.91:0/2720094838 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36bc06b1c0 msgr2=0x7f36bc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36bc06b1c0 0x7f36bc06d680 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f36d4036000 tx=0x7f36d403c040 comp rx=0 tx=0).stop 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 -- 172.21.15.91:0/2720094838 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d80c3ea0 msgr2=0x7f36d8070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d80c3ea0 0x7f36d8070c70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f36c800b3c0 tx=0x7f36c800b880 comp rx=0 tx=0).stop 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 -- 172.21.15.91:0/2720094838 shutdown_connections 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f36bc06b1c0 0x7f36bc06d680 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36d814fd30 0x7f36d81e89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36d80c3ea0 0x7f36d8070c70 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 --2- 172.21.15.91:0/2720094838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d806d0a0 0x7f36d8153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 -- 172.21.15.91:0/2720094838 >> 172.21.15.91:0/2720094838 conn(0x7f36d806a500 msgr2=0x7f36d80702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 -- 172.21.15.91:0/2720094838 shutdown_connections 2023-11-27T20:46:03.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:03.810+0000 7f36df6d3640 1 -- 172.21.15.91:0/2720094838 wait complete. 2023-11-27T20:46:03.831 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:46:04.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.042+0000 7f7aacc36640 1 Processor -- start 2023-11-27T20:46:04.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.042+0000 7f7aacc36640 1 -- start start 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.043+0000 7f7aacc36640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7aa814fc20 0x7f7aa80c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.043+0000 7f7aacc36640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7aa8152560 0x7f7aa8152a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.043+0000 7f7aacc36640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa8150000 con 0x7f7aa8072320 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.043+0000 7f7aacc36640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa8156800 con 0x7f7aa814fc20 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.043+0000 7f7aacc36640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa8155bf0 con 0x7f7aa8152560 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.044+0000 7f7aa659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7aa814fc20 0x7f7aa80c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.044+0000 7f7aa659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7aa814fc20 0x7f7aa80c1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57732/0 (socket says 172.21.15.91:57732) 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.044+0000 7f7aa659c640 1 -- 172.21.15.91:0/3677265185 learned_addr learned my addr 172.21.15.91:0/3677265185 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.044+0000 7f7aa6d9d640 1 --2- 172.21.15.91:0/3677265185 >> v2:172.21.15.183:3300/0 conn(0x7f7aa8152560 0x7f7aa8152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.044+0000 7f7aa659c640 1 -- 172.21.15.91:0/3677265185 >> v2:172.21.15.183:3300/0 conn(0x7f7aa8152560 msgr2=0x7f7aa8152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:04.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.044+0000 7f7aa659c640 1 --2- 172.21.15.91:0/3677265185 >> v2:172.21.15.183:3300/0 conn(0x7f7aa8152560 0x7f7aa8152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.044+0000 7f7aa659c640 1 -- 172.21.15.91:0/3677265185 >> v1:172.21.15.183:6789/0 conn(0x7f7aa8072320 legacy=0x7f7aa806f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:04.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.044+0000 7f7aa659c640 1 -- 172.21.15.91:0/3677265185 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8155ed0 con 0x7f7aa814fc20 2023-11-27T20:46:04.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.045+0000 7f7aa659c640 1 --2- 172.21.15.91:0/3677265185 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 0x7f7aa80c1970 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80c4a80 tx=0x7f7a9802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7246ed3353e3a8da server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:04.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aa559a640 1 -- 172.21.15.91:0/3677265185 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9802c9f0 con 0x7f7aa814fc20 2023-11-27T20:46:04.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aa559a640 1 -- 172.21.15.91:0/3677265185 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9802cb50 con 0x7f7aa814fc20 2023-11-27T20:46:04.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aa559a640 1 -- 172.21.15.91:0/3677265185 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980343f0 con 0x7f7aa814fc20 2023-11-27T20:46:04.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aacc36640 1 -- 172.21.15.91:0/3677265185 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 msgr2=0x7f7aa80c1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aacc36640 1 --2- 172.21.15.91:0/3677265185 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 0x7f7aa80c1970 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80c4a80 tx=0x7f7a9802be50 comp rx=0 tx=0).stop 2023-11-27T20:46:04.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aacc36640 1 -- 172.21.15.91:0/3677265185 shutdown_connections 2023-11-27T20:46:04.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aacc36640 1 --2- 172.21.15.91:0/3677265185 >> v2:172.21.15.183:3300/0 conn(0x7f7aa8152560 0x7f7aa8152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aacc36640 1 --2- 172.21.15.91:0/3677265185 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 0x7f7aa80c1970 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aacc36640 1 -- 172.21.15.91:0/3677265185 >> 172.21.15.91:0/3677265185 conn(0x7f7aa80c39e0 msgr2=0x7f7aa80c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:04.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aacc36640 1 -- 172.21.15.91:0/3677265185 shutdown_connections 2023-11-27T20:46:04.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.046+0000 7f7aacc36640 1 -- 172.21.15.91:0/3677265185 wait complete. 2023-11-27T20:46:04.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.048+0000 7f7aacc36640 1 Processor -- start 2023-11-27T20:46:04.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.048+0000 7f7aacc36640 1 -- start start 2023-11-27T20:46:04.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.049+0000 7f7aacc36640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa8072320 0x7f7aa81ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.049+0000 7f7aacc36640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 0x7f7aa80c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.049+0000 7f7aacc36640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa8152560 0x7f7aa80c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.049+0000 7f7aacc36640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa81ee210 con 0x7f7aa814fc20 2023-11-27T20:46:04.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.049+0000 7f7aacc36640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa81edf30 con 0x7f7aa8152560 2023-11-27T20:46:04.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.049+0000 7f7aacc36640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa814db80 con 0x7f7aa8072320 2023-11-27T20:46:04.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.049+0000 7f7aa5d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 0x7f7aa80c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.049+0000 7f7aa5d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 0x7f7aa80c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57736/0 (socket says 172.21.15.91:57736) 2023-11-27T20:46:04.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.049+0000 7f7aa5d9b640 1 -- 172.21.15.91:0/3525497073 learned_addr learned my addr 172.21.15.91:0/3525497073 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7aa6d9d640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa8152560 0x7f7aa80c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7aa659c640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa8072320 0x7f7aa81ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7aa5d9b640 1 -- 172.21.15.91:0/3525497073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa8072320 msgr2=0x7f7aa81ed540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7aa5d9b640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa8072320 0x7f7aa81ed540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7aa5d9b640 1 -- 172.21.15.91:0/3525497073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa8152560 msgr2=0x7f7aa80c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7aa5d9b640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa8152560 0x7f7aa80c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7aa5d9b640 1 -- 172.21.15.91:0/3525497073 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98009b30 con 0x7f7aa814fc20 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7aa6d9d640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa8152560 0x7f7aa80c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7aa5d9b640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 0x7f7aa80c54e0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000b3e0 tx=0x7f7a9000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7a9effd640 1 -- 172.21.15.91:0/3525497073 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90011830 con 0x7f7aa814fc20 2023-11-27T20:46:04.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7a9effd640 1 -- 172.21.15.91:0/3525497073 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a900119b0 con 0x7f7aa814fc20 2023-11-27T20:46:04.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7a9effd640 1 -- 172.21.15.91:0/3525497073 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90011d60 con 0x7f7aa814fc20 2023-11-27T20:46:04.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.050+0000 7f7aacc36640 1 -- 172.21.15.91:0/3525497073 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa814de60 con 0x7f7aa814fc20 2023-11-27T20:46:04.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.051+0000 7f7aacc36640 1 -- 172.21.15.91:0/3525497073 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa814c220 con 0x7f7aa814fc20 2023-11-27T20:46:04.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.052+0000 7f7aacc36640 1 -- 172.21.15.91:0/3525497073 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa804e840 con 0x7f7aa814fc20 2023-11-27T20:46:04.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.053+0000 7f7a9effd640 1 -- 172.21.15.91:0/3525497073 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7a9001a400 con 0x7f7aa814fc20 2023-11-27T20:46:04.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.054+0000 7f7a9effd640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7a8806b1f0 0x7f7a8806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.054+0000 7f7a9effd640 1 -- 172.21.15.91:0/3525497073 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f7a90089be0 con 0x7f7aa814fc20 2023-11-27T20:46:04.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.054+0000 7f7aa659c640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7a8806b1f0 0x7f7a8806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.054+0000 7f7aa659c640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7a8806b1f0 0x7f7a8806d6b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7a98035000 tx=0x7f7a98030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:04.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.058+0000 7f7a9effd640 1 -- 172.21.15.91:0/3525497073 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7a90054940 con 0x7f7aa814fc20 2023-11-27T20:46:04.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.249+0000 7f7aacc36640 1 -- 172.21.15.91:0/3525497073 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aa814dff0 con 0x7f7aa814fc20 2023-11-27T20:46:04.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.251+0000 7f7a9effd640 1 -- 172.21.15.91:0/3525497073 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f7a90015020 con 0x7f7aa814fc20 2023-11-27T20:46:04.253 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:04.253 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":84,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:46:01.576027+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.183:6835/2103536114":"2023-11-28T20:45:58.564564+0000","172.21.15.183:6833/2103536114":"2023-11-28T20:45:58.564564+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 -- 172.21.15.91:0/3525497073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7a8806b1f0 msgr2=0x7f7a8806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7a8806b1f0 0x7f7a8806d6b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7a98035000 tx=0x7f7a98030000 comp rx=0 tx=0).stop 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 -- 172.21.15.91:0/3525497073 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 msgr2=0x7f7aa80c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 0x7f7aa80c54e0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000b3e0 tx=0x7f7a9000b8a0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 -- 172.21.15.91:0/3525497073 shutdown_connections 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f7a8806b1f0 0x7f7a8806d6b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa8152560 0x7f7aa80c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7aa814fc20 0x7f7aa80c54e0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 --2- 172.21.15.91:0/3525497073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa8072320 0x7f7aa81ed540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 -- 172.21.15.91:0/3525497073 >> 172.21.15.91:0/3525497073 conn(0x7f7aa80c39e0 msgr2=0x7f7aa80c3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:04.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 -- 172.21.15.91:0/3525497073 shutdown_connections 2023-11-27T20:46:04.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.254+0000 7f7aacc36640 1 -- 172.21.15.91:0/3525497073 wait complete. 2023-11-27T20:46:04.274 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-27T20:46:04.274 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:46:04.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.482+0000 7fca147c9640 1 Processor -- start 2023-11-27T20:46:04.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.482+0000 7fca147c9640 1 -- start start 2023-11-27T20:46:04.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.483+0000 7fca147c9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fca0c06d0a0 0x7fca0c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.483+0000 7fca147c9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c0c64a0 con 0x7fca0c14fd30 2023-11-27T20:46:04.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.483+0000 7fca147c9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c0c5c00 con 0x7fca0c0c3ea0 2023-11-27T20:46:04.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.483+0000 7fca147c9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c0c5ee0 con 0x7fca0c06d0a0 2023-11-27T20:46:04.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.484+0000 7fca12565640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fca0c14fd30 0x7fca0c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39020/0 (socket says 172.21.15.91:39020) 2023-11-27T20:46:04.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.484+0000 7fca11d64640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fca0c06d0a0 0x7fca0c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.484+0000 7fca12565640 1 -- 172.21.15.91:0/1862574144 learned_addr learned my addr 172.21.15.91:0/1862574144 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:04.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.484+0000 7fca11d64640 1 -- 172.21.15.91:0/1862574144 >> v1:172.21.15.183:6789/0 conn(0x7fca0c0c3ea0 legacy=0x7fca0c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:04.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.484+0000 7fca11d64640 1 -- 172.21.15.91:0/1862574144 >> v1:172.21.15.91:6789/0 conn(0x7fca0c14fd30 legacy=0x7fca0c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.484+0000 7fca11d64640 1 -- 172.21.15.91:0/1862574144 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c0c61c0 con 0x7fca0c06d0a0 2023-11-27T20:46:04.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.485+0000 7fca11d64640 1 --2- 172.21.15.91:0/1862574144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 0x7fca0c152f20 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0097a0 tx=0x7fc9fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8af8c3e77c0add server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:04.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.486+0000 7fca11563640 1 -- 172.21.15.91:0/1862574144 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc031830 con 0x7fca0c06d0a0 2023-11-27T20:46:04.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.486+0000 7fca11563640 1 -- 172.21.15.91:0/1862574144 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc031990 con 0x7fca0c06d0a0 2023-11-27T20:46:04.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.486+0000 7fca11563640 1 -- 172.21.15.91:0/1862574144 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc031d20 con 0x7fca0c06d0a0 2023-11-27T20:46:04.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.486+0000 7fca147c9640 1 -- 172.21.15.91:0/1862574144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 msgr2=0x7fca0c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.486+0000 7fca147c9640 1 --2- 172.21.15.91:0/1862574144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 0x7fca0c152f20 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0097a0 tx=0x7fc9fc02b8d0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.486+0000 7fca147c9640 1 -- 172.21.15.91:0/1862574144 shutdown_connections 2023-11-27T20:46:04.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.486+0000 7fca147c9640 1 --2- 172.21.15.91:0/1862574144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 0x7fca0c152f20 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.486+0000 7fca147c9640 1 -- 172.21.15.91:0/1862574144 >> 172.21.15.91:0/1862574144 conn(0x7fca0c06a500 msgr2=0x7fca0c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:04.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.487+0000 7fca147c9640 1 -- 172.21.15.91:0/1862574144 shutdown_connections 2023-11-27T20:46:04.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.487+0000 7fca147c9640 1 -- 172.21.15.91:0/1862574144 wait complete. 2023-11-27T20:46:04.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.488+0000 7fca147c9640 1 Processor -- start 2023-11-27T20:46:04.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.488+0000 7fca147c9640 1 -- start start 2023-11-27T20:46:04.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.489+0000 7fca147c9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 0x7fca0c1ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.489+0000 7fca147c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca0c0c3ea0 0x7fca0c151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.489+0000 7fca147c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca0c14fd30 0x7fca0c1edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.489+0000 7fca147c9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c154150 con 0x7fca0c06d0a0 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.489+0000 7fca147c9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c1eaf30 con 0x7fca0c14fd30 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.489+0000 7fca147c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c072060 con 0x7fca0c0c3ea0 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.489+0000 7fca12565640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 0x7fca0c1ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.489+0000 7fca12565640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 0x7fca0c1ea9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57762/0 (socket says 172.21.15.91:57762) 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.489+0000 7fca12565640 1 -- 172.21.15.91:0/673829378 learned_addr learned my addr 172.21.15.91:0/673829378 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca12d66640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca0c14fd30 0x7fca0c1edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca12565640 1 -- 172.21.15.91:0/673829378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca0c0c3ea0 msgr2=0x7fca0c151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca12565640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca0c0c3ea0 0x7fca0c151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca12565640 1 -- 172.21.15.91:0/673829378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca0c14fd30 msgr2=0x7fca0c1edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca12565640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca0c14fd30 0x7fca0c1edb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca12565640 1 -- 172.21.15.91:0/673829378 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc009400 con 0x7fca0c06d0a0 2023-11-27T20:46:04.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca12565640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 0x7fca0c1ea9f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fca0800c4a0 tx=0x7fca0800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:04.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca02ffd640 1 -- 172.21.15.91:0/673829378 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08005ce0 con 0x7fca0c06d0a0 2023-11-27T20:46:04.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca02ffd640 1 -- 172.21.15.91:0/673829378 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08005e40 con 0x7fca0c06d0a0 2023-11-27T20:46:04.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca02ffd640 1 -- 172.21.15.91:0/673829378 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08007270 con 0x7fca0c06d0a0 2023-11-27T20:46:04.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.490+0000 7fca147c9640 1 -- 172.21.15.91:0/673829378 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c0712d0 con 0x7fca0c06d0a0 2023-11-27T20:46:04.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.491+0000 7fca147c9640 1 -- 172.21.15.91:0/673829378 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c071d80 con 0x7fca0c06d0a0 2023-11-27T20:46:04.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.492+0000 7fca147c9640 1 -- 172.21.15.91:0/673829378 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c068350 con 0x7fca0c06d0a0 2023-11-27T20:46:04.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.493+0000 7fca02ffd640 1 -- 172.21.15.91:0/673829378 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fca08007490 con 0x7fca0c06d0a0 2023-11-27T20:46:04.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.493+0000 7fca02ffd640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc9f006b1c0 0x7fc9f006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.494+0000 7fca02ffd640 1 -- 172.21.15.91:0/673829378 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fca08088e30 con 0x7fca0c06d0a0 2023-11-27T20:46:04.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.494+0000 7fca11d64640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc9f006b1c0 0x7fc9f006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.494+0000 7fca11d64640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc9f006b1c0 0x7fc9f006d680 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc036000 tx=0x7fc9fc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:04.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.498+0000 7fca02ffd640 1 -- 172.21.15.91:0/673829378 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fca08053c40 con 0x7fca0c06d0a0 2023-11-27T20:46:04.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.724+0000 7fca147c9640 1 -- 172.21.15.91:0/673829378 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca0c066af0 con 0x7fca0c06d0a0 2023-11-27T20:46:04.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.725+0000 7fca02ffd640 1 -- 172.21.15.91:0/673829378 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fca0c066af0 con 0x7fca0c06d0a0 2023-11-27T20:46:04.727 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:04.727 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3277281414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3277281414},{"type":"v1","addr":"172.21.15.183:6835","nonce":3277281414}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:21.787805+0000","modified":"2023-11-27T20:45:24.857169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/1761528163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1761528163},{"type":"v1","addr":"172.21.15.91:6837","nonce":1761528163}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-27T20:46:04.727 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 53 2023-11-27T20:46:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 -- 172.21.15.91:0/673829378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc9f006b1c0 msgr2=0x7fc9f006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc9f006b1c0 0x7fc9f006d680 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc036000 tx=0x7fc9fc030000 comp rx=0 tx=0).stop 2023-11-27T20:46:04.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 -- 172.21.15.91:0/673829378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 msgr2=0x7fca0c1ea9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 0x7fca0c1ea9f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fca0800c4a0 tx=0x7fca0800c960 comp rx=0 tx=0).stop 2023-11-27T20:46:04.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 -- 172.21.15.91:0/673829378 shutdown_connections 2023-11-27T20:46:04.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc9f006b1c0 0x7fc9f006d680 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca0c14fd30 0x7fca0c1edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca0c0c3ea0 0x7fca0c151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 --2- 172.21.15.91:0/673829378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fca0c06d0a0 0x7fca0c1ea9f0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 -- 172.21.15.91:0/673829378 >> 172.21.15.91:0/673829378 conn(0x7fca0c06a500 msgr2=0x7fca0c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:04.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 -- 172.21.15.91:0/673829378 shutdown_connections 2023-11-27T20:46:04.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.728+0000 7fca147c9640 1 -- 172.21.15.91:0/673829378 wait complete. 2023-11-27T20:46:04.750 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:46:04.963 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.960+0000 7f5aab0e5640 1 Processor -- start 2023-11-27T20:46:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.961+0000 7f5aab0e5640 1 -- start start 2023-11-27T20:46:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.962+0000 7f5aab0e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5aa4071ee0 0x7f5aa40a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.962+0000 7f5aab0e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5aa40a5260 0x7f5aa4163f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.962+0000 7f5aab0e5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5aa4164480 0x7f5aa40c2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.962+0000 7f5aab0e5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa41648d0 con 0x7f5aa4164480 2023-11-27T20:46:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.962+0000 7f5aab0e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa406e050 con 0x7f5aa40a5260 2023-11-27T20:46:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.962+0000 7f5aab0e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa406e2a0 con 0x7f5aa4071ee0 2023-11-27T20:46:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.962+0000 7f5aa9682640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5aa4164480 0x7f5aa40c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.962+0000 7f5aa9682640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5aa4164480 0x7f5aa40c2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57764/0 (socket says 172.21.15.91:57764) 2023-11-27T20:46:04.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.962+0000 7f5aa9682640 1 -- 172.21.15.91:0/4102992528 learned_addr learned my addr 172.21.15.91:0/4102992528 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:04.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.963+0000 7f5aa8e81640 1 --2- 172.21.15.91:0/4102992528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5aa4071ee0 0x7f5aa40a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.963+0000 7f5aa3fff640 1 --2- 172.21.15.91:0/4102992528 >> v2:172.21.15.183:3300/0 conn(0x7f5aa40a5260 0x7f5aa4163f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.963+0000 7f5aa9682640 1 -- 172.21.15.91:0/4102992528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5aa4071ee0 msgr2=0x7f5aa40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.963+0000 7f5aa9682640 1 --2- 172.21.15.91:0/4102992528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5aa4071ee0 0x7f5aa40a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.963+0000 7f5aa9682640 1 -- 172.21.15.91:0/4102992528 >> v2:172.21.15.183:3300/0 conn(0x7f5aa40a5260 msgr2=0x7f5aa4163f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.963+0000 7f5aa9682640 1 --2- 172.21.15.91:0/4102992528 >> v2:172.21.15.183:3300/0 conn(0x7f5aa40a5260 0x7f5aa4163f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.963+0000 7f5aa9682640 1 -- 172.21.15.91:0/4102992528 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa406e580 con 0x7f5aa4164480 2023-11-27T20:46:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.963+0000 7f5aa3fff640 1 --2- 172.21.15.91:0/4102992528 >> v2:172.21.15.183:3300/0 conn(0x7f5aa40a5260 0x7f5aa4163f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.964+0000 7f5aa9682640 1 --2- 172.21.15.91:0/4102992528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 0x7f5aa40c2200 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5aa406b4e0 tx=0x7f5a9c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e106e5e993a8aaf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.964+0000 7f5aa37fe640 1 -- 172.21.15.91:0/4102992528 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c031870 con 0x7f5aa4164480 2023-11-27T20:46:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.964+0000 7f5aa37fe640 1 -- 172.21.15.91:0/4102992528 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c0319d0 con 0x7f5aa4164480 2023-11-27T20:46:04.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.964+0000 7f5aa37fe640 1 -- 172.21.15.91:0/4102992528 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c031d60 con 0x7f5aa4164480 2023-11-27T20:46:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.965+0000 7f5aab0e5640 1 -- 172.21.15.91:0/4102992528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 msgr2=0x7f5aa40c2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.965+0000 7f5aab0e5640 1 --2- 172.21.15.91:0/4102992528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 0x7f5aa40c2200 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5aa406b4e0 tx=0x7f5a9c02b910 comp rx=0 tx=0).stop 2023-11-27T20:46:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.965+0000 7f5aab0e5640 1 -- 172.21.15.91:0/4102992528 shutdown_connections 2023-11-27T20:46:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.965+0000 7f5aab0e5640 1 --2- 172.21.15.91:0/4102992528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 0x7f5aa40c2200 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.965+0000 7f5aab0e5640 1 --2- 172.21.15.91:0/4102992528 >> v2:172.21.15.183:3300/0 conn(0x7f5aa40a5260 0x7f5aa4163f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.965+0000 7f5aab0e5640 1 --2- 172.21.15.91:0/4102992528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5aa4071ee0 0x7f5aa40a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.965+0000 7f5aab0e5640 1 -- 172.21.15.91:0/4102992528 >> 172.21.15.91:0/4102992528 conn(0x7f5aa40c5cc0 msgr2=0x7f5aa40c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.965+0000 7f5aab0e5640 1 -- 172.21.15.91:0/4102992528 shutdown_connections 2023-11-27T20:46:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.965+0000 7f5aab0e5640 1 -- 172.21.15.91:0/4102992528 wait complete. 2023-11-27T20:46:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.967+0000 7f5aab0e5640 1 Processor -- start 2023-11-27T20:46:04.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.967+0000 7f5aab0e5640 1 -- start start 2023-11-27T20:46:04.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aab0e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5aa4071ee0 0x7f5aa40891f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aab0e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa40a5260 0x7f5aa4162410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aab0e5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 0x7f5aa4160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aab0e5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa4089730 con 0x7f5aa4164480 2023-11-27T20:46:04.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aab0e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa4163060 con 0x7f5aa40a5260 2023-11-27T20:46:04.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aab0e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa4087e70 con 0x7f5aa4071ee0 2023-11-27T20:46:04.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa9682640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 0x7f5aa4160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa9682640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 0x7f5aa4160560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57778/0 (socket says 172.21.15.91:57778) 2023-11-27T20:46:04.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa9682640 1 -- 172.21.15.91:0/1608839037 learned_addr learned my addr 172.21.15.91:0/1608839037 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:04.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa3fff640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa40a5260 0x7f5aa4162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa8e81640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5aa4071ee0 0x7f5aa40891f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa9682640 1 -- 172.21.15.91:0/1608839037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5aa4071ee0 msgr2=0x7f5aa40891f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa9682640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5aa4071ee0 0x7f5aa40891f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa9682640 1 -- 172.21.15.91:0/1608839037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa40a5260 msgr2=0x7f5aa4162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:04.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa9682640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa40a5260 0x7f5aa4162410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:04.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa9682640 1 -- 172.21.15.91:0/1608839037 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c0094d0 con 0x7f5aa4164480 2023-11-27T20:46:04.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.968+0000 7f5aa3fff640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa40a5260 0x7f5aa4162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:04.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.969+0000 7f5aa9682640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 0x7f5aa4160560 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0090b0 tx=0x7f5a9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:04.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.969+0000 7f5aa17fa640 1 -- 172.21.15.91:0/1608839037 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c031800 con 0x7f5aa4164480 2023-11-27T20:46:04.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.969+0000 7f5aa17fa640 1 -- 172.21.15.91:0/1608839037 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c0443f0 con 0x7f5aa4164480 2023-11-27T20:46:04.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.969+0000 7f5aa17fa640 1 -- 172.21.15.91:0/1608839037 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c0447a0 con 0x7f5aa4164480 2023-11-27T20:46:04.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.969+0000 7f5aab0e5640 1 -- 172.21.15.91:0/1608839037 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa4088150 con 0x7f5aa4164480 2023-11-27T20:46:04.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.969+0000 7f5aab0e5640 1 -- 172.21.15.91:0/1608839037 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa4088710 con 0x7f5aa4164480 2023-11-27T20:46:04.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.970+0000 7f5aab0e5640 1 -- 172.21.15.91:0/1608839037 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa4068350 con 0x7f5aa4164480 2023-11-27T20:46:04.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.971+0000 7f5aa17fa640 1 -- 172.21.15.91:0/1608839037 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5a9c044900 con 0x7f5aa4164480 2023-11-27T20:46:04.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.972+0000 7f5aa17fa640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5a8406b1c0 0x7f5a8406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:04.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.972+0000 7f5aa17fa640 1 -- 172.21.15.91:0/1608839037 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f5a9c02d040 con 0x7f5aa4164480 2023-11-27T20:46:04.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.972+0000 7f5aa8e81640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5a8406b1c0 0x7f5a8406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:04.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.973+0000 7f5aa8e81640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5a8406b1c0 0x7f5a8406d680 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5a94008e50 tx=0x7f5a940083a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:04.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:04.977+0000 7f5aa17fa640 1 -- 172.21.15.91:0/1608839037 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5a9c076f90 con 0x7f5aa4164480 2023-11-27T20:46:05.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.204+0000 7f5aab0e5640 1 -- 172.21.15.91:0/1608839037 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5aa406de30 con 0x7f5aa4164480 2023-11-27T20:46:05.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.205+0000 7f5aa17fa640 1 -- 172.21.15.91:0/1608839037 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f5a9c07a5b0 con 0x7f5aa4164480 2023-11-27T20:46:05.207 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:05.207 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3277281414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3277281414},{"type":"v1","addr":"172.21.15.183:6835","nonce":3277281414}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T20:45:21.787805+0000","modified":"2023-11-27T20:45:24.857169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/1761528163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1761528163},{"type":"v1","addr":"172.21.15.91:6837","nonce":1761528163}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-27T20:46:05.207 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 53 2023-11-27T20:46:05.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.207+0000 7f5aab0e5640 1 -- 172.21.15.91:0/1608839037 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5a8406b1c0 msgr2=0x7f5a8406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:05.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.207+0000 7f5aab0e5640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5a8406b1c0 0x7f5a8406d680 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5a94008e50 tx=0x7f5a940083a0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.207+0000 7f5aab0e5640 1 -- 172.21.15.91:0/1608839037 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 msgr2=0x7f5aa4160560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:05.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.207+0000 7f5aab0e5640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 0x7f5aa4160560 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0090b0 tx=0x7f5a9c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.208+0000 7f5aab0e5640 1 -- 172.21.15.91:0/1608839037 shutdown_connections 2023-11-27T20:46:05.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.208+0000 7f5aab0e5640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5aa4164480 0x7f5aa4160560 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.208+0000 7f5aab0e5640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f5a8406b1c0 0x7f5a8406d680 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.208+0000 7f5aab0e5640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5aa40a5260 0x7f5aa4162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.208+0000 7f5aab0e5640 1 --2- 172.21.15.91:0/1608839037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5aa4071ee0 0x7f5aa40891f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.208+0000 7f5aab0e5640 1 -- 172.21.15.91:0/1608839037 >> 172.21.15.91:0/1608839037 conn(0x7f5aa40c5cc0 msgr2=0x7f5aa40bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:05.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.208+0000 7f5aab0e5640 1 -- 172.21.15.91:0/1608839037 shutdown_connections 2023-11-27T20:46:05.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.208+0000 7f5aab0e5640 1 -- 172.21.15.91:0/1608839037 wait complete. 2023-11-27T20:46:05.229 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:46:05.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.440+0000 7fcceac83640 1 Processor -- start 2023-11-27T20:46:05.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.440+0000 7fcceac83640 1 -- start start 2023-11-27T20:46:05.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.441+0000 7fcceac83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce414fd30 0x7fcce4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.441+0000 7fcceac83640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcce406d0a0 0x7fcce40a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.441+0000 7fcceac83640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcce40a5260 0x7fcce40c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.441+0000 7fcceac83640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce40c64a0 con 0x7fcce406d0a0 2023-11-27T20:46:05.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.441+0000 7fcceac83640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce40c5c00 con 0x7fcce40a5260 2023-11-27T20:46:05.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.441+0000 7fcceac83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40c5ee0 con 0x7fcce414fd30 2023-11-27T20:46:05.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcce406d0a0 0x7fcce40a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcce406d0a0 0x7fcce40a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57792/0 (socket says 172.21.15.91:57792) 2023-11-27T20:46:05.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce3fff640 1 -- 172.21.15.91:0/3259357348 learned_addr learned my addr 172.21.15.91:0/3259357348 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:05.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce9220640 1 --2- 172.21.15.91:0/3259357348 >> v2:172.21.15.183:3300/0 conn(0x7fcce40a5260 0x7fcce40c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce8a1f640 1 --2- 172.21.15.91:0/3259357348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce414fd30 0x7fcce4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce3fff640 1 -- 172.21.15.91:0/3259357348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce414fd30 msgr2=0x7fcce4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:05.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce3fff640 1 --2- 172.21.15.91:0/3259357348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce414fd30 0x7fcce4152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce3fff640 1 -- 172.21.15.91:0/3259357348 >> v2:172.21.15.183:3300/0 conn(0x7fcce40a5260 msgr2=0x7fcce40c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:05.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce3fff640 1 --2- 172.21.15.91:0/3259357348 >> v2:172.21.15.183:3300/0 conn(0x7fcce40a5260 0x7fcce40c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce3fff640 1 -- 172.21.15.91:0/3259357348 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce40c61c0 con 0x7fcce406d0a0 2023-11-27T20:46:05.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.442+0000 7fcce9220640 1 --2- 172.21.15.91:0/3259357348 >> v2:172.21.15.183:3300/0 conn(0x7fcce40a5260 0x7fcce40c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:05.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.443+0000 7fcce3fff640 1 --2- 172.21.15.91:0/3259357348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 0x7fcce40a4d20 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fcce406d990 tx=0x7fccd802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c761143e4f89191 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:05.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcce37fe640 1 -- 172.21.15.91:0/3259357348 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd802ca70 con 0x7fcce406d0a0 2023-11-27T20:46:05.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcce37fe640 1 -- 172.21.15.91:0/3259357348 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd802cbd0 con 0x7fcce406d0a0 2023-11-27T20:46:05.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcce37fe640 1 -- 172.21.15.91:0/3259357348 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80343f0 con 0x7fcce406d0a0 2023-11-27T20:46:05.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcceac83640 1 -- 172.21.15.91:0/3259357348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 msgr2=0x7fcce40a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:05.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcceac83640 1 --2- 172.21.15.91:0/3259357348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 0x7fcce40a4d20 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fcce406d990 tx=0x7fccd802bed0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcceac83640 1 -- 172.21.15.91:0/3259357348 shutdown_connections 2023-11-27T20:46:05.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcceac83640 1 --2- 172.21.15.91:0/3259357348 >> v2:172.21.15.183:3300/0 conn(0x7fcce40a5260 0x7fcce40c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcceac83640 1 --2- 172.21.15.91:0/3259357348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 0x7fcce40a4d20 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcceac83640 1 --2- 172.21.15.91:0/3259357348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce414fd30 0x7fcce4152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcceac83640 1 -- 172.21.15.91:0/3259357348 >> 172.21.15.91:0/3259357348 conn(0x7fcce406a500 msgr2=0x7fcce406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:05.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcceac83640 1 -- 172.21.15.91:0/3259357348 shutdown_connections 2023-11-27T20:46:05.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.444+0000 7fcceac83640 1 -- 172.21.15.91:0/3259357348 wait complete. 2023-11-27T20:46:05.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.446+0000 7fcceac83640 1 Processor -- start 2023-11-27T20:46:05.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.446+0000 7fcceac83640 1 -- start start 2023-11-27T20:46:05.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.447+0000 7fcceac83640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 0x7fcce406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.447+0000 7fcceac83640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce40a5260 0x7fcce4071d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.447+0000 7fcceac83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce414fd30 0x7fcce4149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.447+0000 7fcceac83640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4150d00 con 0x7fcce406d0a0 2023-11-27T20:46:05.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.447+0000 7fcceac83640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40702e0 con 0x7fcce40a5260 2023-11-27T20:46:05.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.447+0000 7fcceac83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4070540 con 0x7fcce414fd30 2023-11-27T20:46:05.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.447+0000 7fcce8a1f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 0x7fcce406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.448+0000 7fcce8a1f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 0x7fcce406fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57796/0 (socket says 172.21.15.91:57796) 2023-11-27T20:46:05.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.448+0000 7fcce8a1f640 1 -- 172.21.15.91:0/1373975948 learned_addr learned my addr 172.21.15.91:0/1373975948 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:05.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.448+0000 7fcce3fff640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce40a5260 0x7fcce4071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.448+0000 7fcce8a1f640 1 -- 172.21.15.91:0/1373975948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce414fd30 msgr2=0x7fcce4149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.448+0000 7fcce9220640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce414fd30 0x7fcce4149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.448+0000 7fcce8a1f640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce414fd30 0x7fcce4149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.448+0000 7fcce8a1f640 1 -- 172.21.15.91:0/1373975948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce40a5260 msgr2=0x7fcce4071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.448+0000 7fcce8a1f640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce40a5260 0x7fcce4071d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.448+0000 7fcce8a1f640 1 -- 172.21.15.91:0/1373975948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd8009b30 con 0x7fcce406d0a0 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.448+0000 7fcce8a1f640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 0x7fcce406fda0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fccd400c820 tx=0x7fccd400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.449+0000 7fcce17fa640 1 -- 172.21.15.91:0/1373975948 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4004020 con 0x7fcce406d0a0 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.449+0000 7fcce17fa640 1 -- 172.21.15.91:0/1373975948 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd4004180 con 0x7fcce406d0a0 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.449+0000 7fcce17fa640 1 -- 172.21.15.91:0/1373975948 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4007830 con 0x7fcce406d0a0 2023-11-27T20:46:05.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.449+0000 7fcceac83640 1 -- 172.21.15.91:0/1373975948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce4150740 con 0x7fcce406d0a0 2023-11-27T20:46:05.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.449+0000 7fcceac83640 1 -- 172.21.15.91:0/1373975948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce41515a0 con 0x7fcce406d0a0 2023-11-27T20:46:05.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.450+0000 7fcceac83640 1 -- 172.21.15.91:0/1373975948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce40c38b0 con 0x7fcce406d0a0 2023-11-27T20:46:05.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.451+0000 7fcce17fa640 1 -- 172.21.15.91:0/1373975948 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fccd4007990 con 0x7fcce406d0a0 2023-11-27T20:46:05.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.452+0000 7fcce17fa640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccd006b1c0 0x7fccd006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.452+0000 7fcce17fa640 1 -- 172.21.15.91:0/1373975948 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fccd40896e0 con 0x7fcce406d0a0 2023-11-27T20:46:05.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.452+0000 7fcce3fff640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccd006b1c0 0x7fccd006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.453+0000 7fcce3fff640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccd006b1c0 0x7fccd006d680 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fccd8035000 tx=0x7fccd8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:05.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.457+0000 7fcce17fa640 1 -- 172.21.15.91:0/1373975948 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fccd4054440 con 0x7fcce406d0a0 2023-11-27T20:46:05.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.652+0000 7fcceac83640 1 -- 172.21.15.91:0/1373975948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcce4068350 con 0x7fcce406d0a0 2023-11-27T20:46:05.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.653+0000 7fcce17fa640 1 -- 172.21.15.91:0/1373975948 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16608 (secure 0 0 0) 0x7fccd4057a60 con 0x7fcce406d0a0 2023-11-27T20:46:05.655 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:05.655 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":84,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:46:01.576027+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-11-27T20:45:19.465319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-11-27T20:45:20.794821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.183:6835/2103536114":"2023-11-28T20:45:58.564564+0000","172.21.15.183:6833/2103536114":"2023-11-28T20:45:58.564564+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:46:05.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.656+0000 7fcceac83640 1 -- 172.21.15.91:0/1373975948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccd006b1c0 msgr2=0x7fccd006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:05.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.656+0000 7fcceac83640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccd006b1c0 0x7fccd006d680 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fccd8035000 tx=0x7fccd8030000 comp rx=0 tx=0).stop 2023-11-27T20:46:05.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.656+0000 7fcceac83640 1 -- 172.21.15.91:0/1373975948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 msgr2=0x7fcce406fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:05.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.656+0000 7fcceac83640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 0x7fcce406fda0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fccd400c820 tx=0x7fccd400cce0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.656+0000 7fcceac83640 1 -- 172.21.15.91:0/1373975948 shutdown_connections 2023-11-27T20:46:05.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.656+0000 7fcceac83640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcce414fd30 0x7fcce4149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.656+0000 7fcceac83640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fccd006b1c0 0x7fccd006d680 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.656+0000 7fcceac83640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce40a5260 0x7fcce4071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.656+0000 7fcceac83640 1 --2- 172.21.15.91:0/1373975948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcce406d0a0 0x7fcce406fda0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.656+0000 7fcceac83640 1 -- 172.21.15.91:0/1373975948 >> 172.21.15.91:0/1373975948 conn(0x7fcce406a500 msgr2=0x7fcce40bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:05.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.657+0000 7fcceac83640 1 -- 172.21.15.91:0/1373975948 shutdown_connections 2023-11-27T20:46:05.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.657+0000 7fcceac83640 1 -- 172.21.15.91:0/1373975948 wait complete. 2023-11-27T20:46:05.675 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-27T20:46:05.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.885+0000 7f81383b6640 1 Processor -- start 2023-11-27T20:46:05.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.886+0000 7f81383b6640 1 -- start start 2023-11-27T20:46:05.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.887+0000 7f81383b6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8130151af0 0x7f8130155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.887+0000 7f81383b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81300c1020 0x7f813006e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.887+0000 7f81383b6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f813006b510 0x7f813006b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.887+0000 7f81383b6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813006dd30 con 0x7f813006b510 2023-11-27T20:46:05.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.887+0000 7f81383b6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813006eed0 con 0x7f8130151af0 2023-11-27T20:46:05.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.887+0000 7f81383b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813006d770 con 0x7f81300c1020 2023-11-27T20:46:05.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.887+0000 7f8136953640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f813006b510 0x7f813006b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.887+0000 7f8136953640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f813006b510 0x7f813006b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57798/0 (socket says 172.21.15.91:57798) 2023-11-27T20:46:05.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.887+0000 7f8136953640 1 -- 172.21.15.91:0/351531829 learned_addr learned my addr 172.21.15.91:0/351531829 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:05.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.888+0000 7f8136152640 1 --2- 172.21.15.91:0/351531829 >> v2:172.21.15.183:3300/0 conn(0x7f8130151af0 0x7f8130155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.888+0000 7f8135951640 1 --2- 172.21.15.91:0/351531829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81300c1020 0x7f813006e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.888+0000 7f8136953640 1 -- 172.21.15.91:0/351531829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81300c1020 msgr2=0x7f813006e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:05.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.888+0000 7f8136953640 1 --2- 172.21.15.91:0/351531829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81300c1020 0x7f813006e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.888+0000 7f8136953640 1 -- 172.21.15.91:0/351531829 >> v2:172.21.15.183:3300/0 conn(0x7f8130151af0 msgr2=0x7f8130155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:05.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.888+0000 7f8136953640 1 --2- 172.21.15.91:0/351531829 >> v2:172.21.15.183:3300/0 conn(0x7f8130151af0 0x7f8130155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.888+0000 7f8136953640 1 -- 172.21.15.91:0/351531829 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813006da50 con 0x7f813006b510 2023-11-27T20:46:05.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.888+0000 7f8135951640 1 --2- 172.21.15.91:0/351531829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81300c1020 0x7f813006e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:05.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.889+0000 7f8136953640 1 --2- 172.21.15.91:0/351531829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f813006b510 0x7f813006b9c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f813006f250 tx=0x7f812802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4ad4bb4c804115 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:05.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.889+0000 7f8135150640 1 -- 172.21.15.91:0/351531829 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81280317e0 con 0x7f813006b510 2023-11-27T20:46:05.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.889+0000 7f8135150640 1 -- 172.21.15.91:0/351531829 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128031940 con 0x7f813006b510 2023-11-27T20:46:05.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.889+0000 7f8135150640 1 -- 172.21.15.91:0/351531829 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128031cd0 con 0x7f813006b510 2023-11-27T20:46:05.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.890+0000 7f81383b6640 1 -- 172.21.15.91:0/351531829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f813006b510 msgr2=0x7f813006b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:05.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.890+0000 7f81383b6640 1 --2- 172.21.15.91:0/351531829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f813006b510 0x7f813006b9c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f813006f250 tx=0x7f812802b880 comp rx=0 tx=0).stop 2023-11-27T20:46:05.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.890+0000 7f81383b6640 1 -- 172.21.15.91:0/351531829 shutdown_connections 2023-11-27T20:46:05.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.890+0000 7f81383b6640 1 --2- 172.21.15.91:0/351531829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f813006b510 0x7f813006b9c0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.890+0000 7f81383b6640 1 --2- 172.21.15.91:0/351531829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81300c1020 0x7f813006e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.890+0000 7f81383b6640 1 --2- 172.21.15.91:0/351531829 >> v2:172.21.15.183:3300/0 conn(0x7f8130151af0 0x7f8130155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.890+0000 7f81383b6640 1 -- 172.21.15.91:0/351531829 >> 172.21.15.91:0/351531829 conn(0x7f81300c3120 msgr2=0x7f81300c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:05.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.890+0000 7f81383b6640 1 -- 172.21.15.91:0/351531829 shutdown_connections 2023-11-27T20:46:05.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.890+0000 7f81383b6640 1 -- 172.21.15.91:0/351531829 wait complete. 2023-11-27T20:46:05.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.892+0000 7f81383b6640 1 Processor -- start 2023-11-27T20:46:05.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.892+0000 7f81383b6640 1 -- start start 2023-11-27T20:46:05.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.893+0000 7f81383b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f813006b510 0x7f81301eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.893+0000 7f81383b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81300c1020 0x7f81301ee450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.893+0000 7f81383b6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8130151af0 0x7f8130071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.893+0000 7f81383b6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81301ee990 con 0x7f8130151af0 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.893+0000 7f81383b6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81301eab00 con 0x7f81300c1020 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.893+0000 7f81383b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81301ea4d0 con 0x7f813006b510 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.893+0000 7f8136953640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8130151af0 0x7f8130071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.893+0000 7f8136953640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8130151af0 0x7f8130071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57810/0 (socket says 172.21.15.91:57810) 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.893+0000 7f8136953640 1 -- 172.21.15.91:0/2341799004 learned_addr learned my addr 172.21.15.91:0/2341799004 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f8135951640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81300c1020 0x7f81301ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f8136152640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f813006b510 0x7f81301eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f8136953640 1 -- 172.21.15.91:0/2341799004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f813006b510 msgr2=0x7f81301eaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:05.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f8136953640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f813006b510 0x7f81301eaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f8136953640 1 -- 172.21.15.91:0/2341799004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81300c1020 msgr2=0x7f81301ee450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:05.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f8136953640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81300c1020 0x7f81301ee450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:05.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f8136953640 1 -- 172.21.15.91:0/2341799004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280094d0 con 0x7f8130151af0 2023-11-27T20:46:05.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f8136953640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8130151af0 0x7f8130071fa0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f81280090b0 tx=0x7f81280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:05.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f812effd640 1 -- 172.21.15.91:0/2341799004 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128032880 con 0x7f8130151af0 2023-11-27T20:46:05.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f812effd640 1 -- 172.21.15.91:0/2341799004 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128032a20 con 0x7f8130151af0 2023-11-27T20:46:05.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f812effd640 1 -- 172.21.15.91:0/2341799004 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128032dd0 con 0x7f8130151af0 2023-11-27T20:46:05.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.894+0000 7f81383b6640 1 -- 172.21.15.91:0/2341799004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81300c5a30 con 0x7f8130151af0 2023-11-27T20:46:05.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.895+0000 7f81383b6640 1 -- 172.21.15.91:0/2341799004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81301ea790 con 0x7f8130151af0 2023-11-27T20:46:05.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.895+0000 7f81383b6640 1 -- 172.21.15.91:0/2341799004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81301eac90 con 0x7f8130151af0 2023-11-27T20:46:05.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.896+0000 7f812effd640 1 -- 172.21.15.91:0/2341799004 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f812804e450 con 0x7f8130151af0 2023-11-27T20:46:05.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.897+0000 7f812effd640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f811c06b1c0 0x7f811c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:05.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.897+0000 7f812effd640 1 -- 172.21.15.91:0/2341799004 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f81280abb30 con 0x7f8130151af0 2023-11-27T20:46:05.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.898+0000 7f8136152640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f811c06b1c0 0x7f811c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:05.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.898+0000 7f8136152640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f811c06b1c0 0x7f811c06d680 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8120009940 tx=0x7f8120003cd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:05.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:05.902+0000 7f812effd640 1 -- 172.21.15.91:0/2341799004 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8128076910 con 0x7f8130151af0 2023-11-27T20:46:06.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.131+0000 7f81383b6640 1 -- 172.21.15.91:0/2341799004 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f8130158730 con 0x7f8130151af0 2023-11-27T20:46:06.133 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-11-27T20:46:06.132+0000 7fb57696d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-27T20:46:06.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.136+0000 7f812effd640 1 -- 172.21.15.91:0/2341799004 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 163+0+0 (secure 0 0 0) 0x7f8128079f30 con 0x7f8130151af0 2023-11-27T20:46:06.138 INFO:teuthology.orchestra.run.smithi091.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T20:46:06.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.139+0000 7f81383b6640 1 -- 172.21.15.91:0/2341799004 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f811c06b1c0 msgr2=0x7f811c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.139+0000 7f81383b6640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f811c06b1c0 0x7f811c06d680 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8120009940 tx=0x7f8120003cd0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.139+0000 7f81383b6640 1 -- 172.21.15.91:0/2341799004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8130151af0 msgr2=0x7f8130071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.139+0000 7f81383b6640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8130151af0 0x7f8130071fa0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f81280090b0 tx=0x7f81280046c0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.139+0000 7f81383b6640 1 -- 172.21.15.91:0/2341799004 shutdown_connections 2023-11-27T20:46:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.139+0000 7f81383b6640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8130151af0 0x7f8130071fa0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.139+0000 7f81383b6640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f811c06b1c0 0x7f811c06d680 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.139+0000 7f81383b6640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81300c1020 0x7f81301ee450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.139+0000 7f81383b6640 1 --2- 172.21.15.91:0/2341799004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f813006b510 0x7f81301eaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.139+0000 7f81383b6640 1 -- 172.21.15.91:0/2341799004 >> 172.21.15.91:0/2341799004 conn(0x7f81300c3120 msgr2=0x7f8130150cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:06.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.140+0000 7f81383b6640 1 -- 172.21.15.91:0/2341799004 shutdown_connections 2023-11-27T20:46:06.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.140+0000 7f81383b6640 1 -- 172.21.15.91:0/2341799004 wait complete. 2023-11-27T20:46:06.164 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-27T20:46:06.173 INFO:tasks.ceph.mds.a.smithi091.stderr: -4711> 2023-11-27T20:45:27.594+0000 7f184422a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T20:46:06.238 INFO:tasks.ceph.mds.a.smithi091.stdout:starting mds.a at 2023-11-27T20:46:06.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.361+0000 7faf5b59e640 1 Processor -- start 2023-11-27T20:46:06.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.361+0000 7faf5b59e640 1 -- start start 2023-11-27T20:46:06.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.362+0000 7faf5b59e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faf5c151970 0x7faf5c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:06.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.362+0000 7faf5b59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c3d60 0x7faf5c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:06.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.362+0000 7faf5b59e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c0c0f70 con 0x7faf5c0c0600 2023-11-27T20:46:06.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.362+0000 7faf5b59e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c154430 con 0x7faf5c151970 2023-11-27T20:46:06.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.362+0000 7faf5b59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c155320 con 0x7faf5c0c3d60 2023-11-27T20:46:06.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.363+0000 7faf5a59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faf5c151970 0x7faf5c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:06.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.363+0000 7faf5a59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faf5c151970 0x7faf5c151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57814/0 (socket says 172.21.15.91:57814) 2023-11-27T20:46:06.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.363+0000 7faf5a59c640 1 -- 172.21.15.91:0/2157225092 learned_addr learned my addr 172.21.15.91:0/2157225092 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:06.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.363+0000 7faf5a59c640 1 -- 172.21.15.91:0/2157225092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c3d60 msgr2=0x7faf5c1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:06.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.363+0000 7faf5a59c640 1 --2- 172.21.15.91:0/2157225092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c3d60 0x7faf5c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.363+0000 7faf5a59c640 1 -- 172.21.15.91:0/2157225092 >> v1:172.21.15.183:6789/0 conn(0x7faf5c0c0600 legacy=0x7faf5c154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:06.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.363+0000 7faf5a59c640 1 -- 172.21.15.91:0/2157225092 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0c1210 con 0x7faf5c151970 2023-11-27T20:46:06.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.364+0000 7faf5a59c640 1 --2- 172.21.15.91:0/2157225092 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c151970 0x7faf5c151d50 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009870 tx=0x7faf4c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ccb2c860aa0a96 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:06.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.364+0000 7faf59d9b640 1 -- 172.21.15.91:0/2157225092 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c031740 con 0x7faf5c151970 2023-11-27T20:46:06.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.364+0000 7faf59d9b640 1 -- 172.21.15.91:0/2157225092 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c0318a0 con 0x7faf5c151970 2023-11-27T20:46:06.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.364+0000 7faf59d9b640 1 -- 172.21.15.91:0/2157225092 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c031c30 con 0x7faf5c151970 2023-11-27T20:46:06.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.365+0000 7faf5b59e640 1 -- 172.21.15.91:0/2157225092 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c151970 msgr2=0x7faf5c151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:06.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.365+0000 7faf5b59e640 1 --2- 172.21.15.91:0/2157225092 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c151970 0x7faf5c151d50 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009870 tx=0x7faf4c02b7e0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.365+0000 7faf5b59e640 1 -- 172.21.15.91:0/2157225092 shutdown_connections 2023-11-27T20:46:06.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.365+0000 7faf5b59e640 1 --2- 172.21.15.91:0/2157225092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c0c3d60 0x7faf5c1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.365+0000 7faf5b59e640 1 --2- 172.21.15.91:0/2157225092 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c151970 0x7faf5c151d50 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.365+0000 7faf5b59e640 1 -- 172.21.15.91:0/2157225092 >> 172.21.15.91:0/2157225092 conn(0x7faf5c0c5b50 msgr2=0x7faf5c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:06.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.365+0000 7faf5b59e640 1 -- 172.21.15.91:0/2157225092 shutdown_connections 2023-11-27T20:46:06.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.365+0000 7faf5b59e640 1 -- 172.21.15.91:0/2157225092 wait complete. 2023-11-27T20:46:06.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.367+0000 7faf5b59e640 1 Processor -- start 2023-11-27T20:46:06.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.367+0000 7faf5b59e640 1 -- start start 2023-11-27T20:46:06.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.368+0000 7faf5b59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c0600 0x7faf5c0a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:06.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.368+0000 7faf5b59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c3d60 0x7faf5c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:06.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.368+0000 7faf5b59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c151970 0x7faf5c072550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:06.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.368+0000 7faf5b59e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c14e5b0 con 0x7faf5c0c0600 2023-11-27T20:46:06.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.368+0000 7faf5b59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0a7500 con 0x7faf5c0c3d60 2023-11-27T20:46:06.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.368+0000 7faf5b59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0a6060 con 0x7faf5c151970 2023-11-27T20:46:06.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.368+0000 7faf5a59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c0600 0x7faf5c0a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:06.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.368+0000 7faf5a59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c0600 0x7faf5c0a6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57826/0 (socket says 172.21.15.91:57826) 2023-11-27T20:46:06.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.368+0000 7faf5a59c640 1 -- 172.21.15.91:0/234925458 learned_addr learned my addr 172.21.15.91:0/234925458 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:06.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf5ad9d640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c151970 0x7faf5c072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:06.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf53fff640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c3d60 0x7faf5c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:06.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf5a59c640 1 -- 172.21.15.91:0/234925458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c151970 msgr2=0x7faf5c072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:06.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf5a59c640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c151970 0x7faf5c072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf5a59c640 1 -- 172.21.15.91:0/234925458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c3d60 msgr2=0x7faf5c14e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:06.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf5a59c640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c3d60 0x7faf5c14e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:06.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf5a59c640 1 -- 172.21.15.91:0/234925458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0094d0 con 0x7faf5c0c0600 2023-11-27T20:46:06.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf5ad9d640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c151970 0x7faf5c072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:06.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf53fff640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c3d60 0x7faf5c14e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:06.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf5a59c640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c0600 0x7faf5c0a6c90 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009870 tx=0x7faf4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:06.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf52ffd640 1 -- 172.21.15.91:0/234925458 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c033c70 con 0x7faf5c0c0600 2023-11-27T20:46:06.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf52ffd640 1 -- 172.21.15.91:0/234925458 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c033dd0 con 0x7faf5c0c0600 2023-11-27T20:46:06.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf52ffd640 1 -- 172.21.15.91:0/234925458 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c03d6b0 con 0x7faf5c0c0600 2023-11-27T20:46:06.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.369+0000 7faf5b59e640 1 -- 172.21.15.91:0/234925458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c14dd90 con 0x7faf5c0c0600 2023-11-27T20:46:06.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.370+0000 7faf5b59e640 1 -- 172.21.15.91:0/234925458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c0a5cf0 con 0x7faf5c0c0600 2023-11-27T20:46:06.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.371+0000 7faf5b59e640 1 -- 172.21.15.91:0/234925458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c0c2560 con 0x7faf5c0c0600 2023-11-27T20:46:06.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.372+0000 7faf52ffd640 1 -- 172.21.15.91:0/234925458 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faf4c03a040 con 0x7faf5c0c0600 2023-11-27T20:46:06.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.373+0000 7faf52ffd640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf3c06b1c0 0x7faf3c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:06.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.373+0000 7faf52ffd640 1 -- 172.21.15.91:0/234925458 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5885+0+0 (secure 0 0 0) 0x7faf4c0aba30 con 0x7faf5c0c0600 2023-11-27T20:46:06.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.373+0000 7faf53fff640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf3c06b1c0 0x7faf3c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:06.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.374+0000 7faf53fff640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf3c06b1c0 0x7faf3c06d680 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faf44006fd0 tx=0x7faf44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:06.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.377+0000 7faf52ffd640 1 -- 172.21.15.91:0/234925458 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faf4c0766a0 con 0x7faf5c0c0600 2023-11-27T20:46:06.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:06.602+0000 7faf5b59e640 1 -- 172.21.15.91:0/234925458 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faf5c04e840 con 0x7faf5c0c0600 2023-11-27T20:46:07.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.139+0000 7faf52ffd640 1 -- 172.21.15.91:0/234925458 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 105+0+0 (secure 0 0 0) 0x7faf4c0380b0 con 0x7faf5c0c0600 2023-11-27T20:46:07.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 -- 172.21.15.91:0/234925458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf3c06b1c0 msgr2=0x7faf3c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:07.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf3c06b1c0 0x7faf3c06d680 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faf44006fd0 tx=0x7faf44008040 comp rx=0 tx=0).stop 2023-11-27T20:46:07.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 -- 172.21.15.91:0/234925458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c0600 msgr2=0x7faf5c0a6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:07.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c0600 0x7faf5c0a6c90 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009870 tx=0x7faf4c0046c0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 -- 172.21.15.91:0/234925458 shutdown_connections 2023-11-27T20:46:07.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5c151970 0x7faf5c072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7faf3c06b1c0 0x7faf3c06d680 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf5c0c3d60 0x7faf5c14e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 --2- 172.21.15.91:0/234925458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf5c0c0600 0x7faf5c0a6c90 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 -- 172.21.15.91:0/234925458 >> 172.21.15.91:0/234925458 conn(0x7faf5c0c5b50 msgr2=0x7faf5c153950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:07.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.143+0000 7faf5b59e640 1 -- 172.21.15.91:0/234925458 shutdown_connections 2023-11-27T20:46:07.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.144+0000 7faf5b59e640 1 -- 172.21.15.91:0/234925458 wait complete. 2023-11-27T20:46:07.166 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-27T20:46:07.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.379+0000 7f875f817640 1 Processor -- start 2023-11-27T20:46:07.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.380+0000 7f875f817640 1 -- start start 2023-11-27T20:46:07.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.381+0000 7f875f817640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a9410 0x7f87581594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:07.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.381+0000 7f875f817640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580a8f80 con 0x7f87580bffb0 2023-11-27T20:46:07.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.381+0000 7f875f817640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580c0e70 con 0x7f87580c5580 2023-11-27T20:46:07.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.381+0000 7f875f817640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87580c08b0 con 0x7f87580a9410 2023-11-27T20:46:07.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.381+0000 7f875ddb4640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f87580bffb0 0x7f87580c3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39026/0 (socket says 172.21.15.91:39026) 2023-11-27T20:46:07.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.381+0000 7f875ddb4640 1 -- 172.21.15.91:0/2898103153 learned_addr learned my addr 172.21.15.91:0/2898103153 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:07.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f875cdb2640 1 --2- 172.21.15.91:0/2898103153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a9410 0x7f87581594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:07.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853393668 0 0) 0x7f87580a8f80 con 0x7f87580bffb0 2023-11-27T20:46:07.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8744003520 con 0x7f87580bffb0 2023-11-27T20:46:07.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678836016 0 0) 0x7f8744003520 con 0x7f87580bffb0 2023-11-27T20:46:07.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a9410 msgr2=0x7f87581594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:07.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 --2- 172.21.15.91:0/2898103153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a9410 0x7f87581594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 >> v1:172.21.15.183:6789/0 conn(0x7f87580c5580 legacy=0x7f8758155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:07.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87580c0b90 con 0x7f87580bffb0 2023-11-27T20:46:07.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f87500019f0 con 0x7f87580bffb0 2023-11-27T20:46:07.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 >> v1:172.21.15.91:6789/0 conn(0x7f87580bffb0 legacy=0x7f87580c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:07.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 --2- 172.21.15.91:0/2898103153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 0x7f8744003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:07.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.382+0000 7f874bfff640 1 --2- 172.21.15.91:0/2898103153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87440047c0 0x7f8744004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:07.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.383+0000 7f874bfff640 1 --2- 172.21.15.91:0/2898103153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a9410 0x7f8744005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:07.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.383+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87580c08b0 con 0x7f87440039a0 2023-11-27T20:46:07.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.383+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874400bb40 con 0x7f87440047c0 2023-11-27T20:46:07.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.383+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874400bd00 con 0x7f87580a9410 2023-11-27T20:46:07.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.383+0000 7f875d5b3640 1 --2- 172.21.15.91:0/2898103153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 0x7f8744003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:07.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.383+0000 7f875d5b3640 1 -- 172.21.15.91:0/2898103153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a9410 msgr2=0x7f8744005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:07.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.383+0000 7f875d5b3640 1 --2- 172.21.15.91:0/2898103153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a9410 0x7f8744005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.383+0000 7f875d5b3640 1 -- 172.21.15.91:0/2898103153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87440047c0 msgr2=0x7f8744004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:07.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.383+0000 7f875d5b3640 1 --2- 172.21.15.91:0/2898103153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87440047c0 0x7f8744004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.383+0000 7f875d5b3640 1 -- 172.21.15.91:0/2898103153 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744003520 con 0x7f87440039a0 2023-11-27T20:46:07.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.384+0000 7f875d5b3640 1 --2- 172.21.15.91:0/2898103153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 0x7f8744003dc0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8754001750 tx=0x7f87440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10187ebd2fefabcb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:07.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.384+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540052d0 con 0x7f87440039a0 2023-11-27T20:46:07.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.385+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875402e050 con 0x7f87440039a0 2023-11-27T20:46:07.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.385+0000 7f874bfff640 1 -- 172.21.15.91:0/2898103153 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540035f0 con 0x7f87440039a0 2023-11-27T20:46:07.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.385+0000 7f875f817640 1 -- 172.21.15.91:0/2898103153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 msgr2=0x7f8744003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:07.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.385+0000 7f875f817640 1 --2- 172.21.15.91:0/2898103153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 0x7f8744003dc0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8754001750 tx=0x7f87440057f0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.385+0000 7f875ddb4640 1 -- 172.21.15.91:0/2898103153 reap_dead start 2023-11-27T20:46:07.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.385+0000 7f875f817640 1 -- 172.21.15.91:0/2898103153 shutdown_connections 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.385+0000 7f875f817640 1 -- 172.21.15.91:0/2898103153 >> 172.21.15.91:0/2898103153 conn(0x7f87580c5d30 msgr2=0x7f87580c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.385+0000 7f875f817640 1 -- 172.21.15.91:0/2898103153 shutdown_connections 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.385+0000 7f875f817640 1 -- 172.21.15.91:0/2898103153 wait complete. 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.387+0000 7f875f817640 1 Processor -- start 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.387+0000 7f875f817640 1 -- start start 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.388+0000 7f875f817640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 0x7f8758154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.388+0000 7f875f817640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8758151a10 0x7f87580a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.388+0000 7f875f817640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a7600 0x7f87581eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.388+0000 7f875f817640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8758154d50 con 0x7f87440039a0 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.388+0000 7f875f817640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8758155030 con 0x7f8758151a10 2023-11-27T20:46:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.388+0000 7f875f817640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87581ee2e0 con 0x7f87580a7600 2023-11-27T20:46:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.388+0000 7f875d5b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 0x7f8758154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.388+0000 7f875d5b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 0x7f8758154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57842/0 (socket says 172.21.15.91:57842) 2023-11-27T20:46:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.388+0000 7f875d5b3640 1 -- 172.21.15.91:0/3456896363 learned_addr learned my addr 172.21.15.91:0/3456896363 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f875cdb2640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8758151a10 0x7f87580a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f875ddb4640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a7600 0x7f87581eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f875d5b3640 1 -- 172.21.15.91:0/3456896363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a7600 msgr2=0x7f87581eeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f875d5b3640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a7600 0x7f87581eeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f875d5b3640 1 -- 172.21.15.91:0/3456896363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8758151a10 msgr2=0x7f87580a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f875d5b3640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8758151a10 0x7f87580a2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f875d5b3640 1 -- 172.21.15.91:0/3456896363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87581ee5c0 con 0x7f87440039a0 2023-11-27T20:46:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f875cdb2640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8758151a10 0x7f87580a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f875d5b3640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 0x7f8758154650 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f8754008fd0 tx=0x7f8754001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f8749ffb640 1 -- 172.21.15.91:0/3456896363 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540076c0 con 0x7f87440039a0 2023-11-27T20:46:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f8749ffb640 1 -- 172.21.15.91:0/3456896363 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8754007a30 con 0x7f87440039a0 2023-11-27T20:46:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f8749ffb640 1 -- 172.21.15.91:0/3456896363 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8754006be0 con 0x7f87440039a0 2023-11-27T20:46:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.389+0000 7f875f817640 1 -- 172.21.15.91:0/3456896363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87580a83f0 con 0x7f87440039a0 2023-11-27T20:46:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.390+0000 7f875f817640 1 -- 172.21.15.91:0/3456896363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87581ef020 con 0x7f87440039a0 2023-11-27T20:46:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.391+0000 7f875f817640 1 -- 172.21.15.91:0/3456896363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87581ee750 con 0x7f87440039a0 2023-11-27T20:46:07.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.392+0000 7f8749ffb640 1 -- 172.21.15.91:0/3456896363 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8754006d40 con 0x7f87440039a0 2023-11-27T20:46:07.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.392+0000 7f8749ffb640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f873c06b1f0 0x7f873c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:07.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.392+0000 7f8749ffb640 1 -- 172.21.15.91:0/3456896363 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f87540abbc0 con 0x7f87440039a0 2023-11-27T20:46:07.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.393+0000 7f875cdb2640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f873c06b1f0 0x7f873c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:07.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.393+0000 7f875cdb2640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f873c06b1f0 0x7f873c06d6b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f87580c63c0 tx=0x7f874c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:07.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.397+0000 7f8749ffb640 1 -- 172.21.15.91:0/3456896363 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f87540767a0 con 0x7f87440039a0 2023-11-27T20:46:07.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:07.588+0000 7f875f817640 1 -- 172.21.15.91:0/3456896363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87581ee420 con 0x7f87440039a0 2023-11-27T20:46:08.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.149+0000 7f8749ffb640 1 -- 172.21.15.91:0/3456896363 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v86) v1 ==== 184+0+0 (secure 0 0 0) 0x7f87581ee420 con 0x7f87440039a0 2023-11-27T20:46:08.151 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_metadata' removed 2023-11-27T20:46:08.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 -- 172.21.15.91:0/3456896363 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f873c06b1f0 msgr2=0x7f873c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:08.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f873c06b1f0 0x7f873c06d6b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f87580c63c0 tx=0x7f874c008040 comp rx=0 tx=0).stop 2023-11-27T20:46:08.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 -- 172.21.15.91:0/3456896363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 msgr2=0x7f8758154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:08.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 0x7f8758154650 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f8754008fd0 tx=0x7f8754001120 comp rx=0 tx=0).stop 2023-11-27T20:46:08.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 -- 172.21.15.91:0/3456896363 shutdown_connections 2023-11-27T20:46:08.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87580a7600 0x7f87581eeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:08.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f873c06b1f0 0x7f873c06d6b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:08.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8758151a10 0x7f87580a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:08.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 --2- 172.21.15.91:0/3456896363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87440039a0 0x7f8758154650 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:08.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 -- 172.21.15.91:0/3456896363 >> 172.21.15.91:0/3456896363 conn(0x7f87580c5d30 msgr2=0x7f87581588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:08.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.153+0000 7f875f817640 1 -- 172.21.15.91:0/3456896363 shutdown_connections 2023-11-27T20:46:08.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.154+0000 7f875f817640 1 -- 172.21.15.91:0/3456896363 wait complete. 2023-11-27T20:46:08.178 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-27T20:46:08.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.389+0000 7ff8a5763640 1 Processor -- start 2023-11-27T20:46:08.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.390+0000 7ff8a5763640 1 -- start start 2023-11-27T20:46:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.391+0000 7ff8a5763640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8a00c1f90 0x7ff8a0152d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.391+0000 7ff8a5763640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff8a006fd00 0x7ff8a0070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.391+0000 7ff8a5763640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a00a4f20 con 0x7ff8a00a5300 2023-11-27T20:46:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.391+0000 7ff8a5763640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a0153270 con 0x7ff8a00c1f90 2023-11-27T20:46:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.391+0000 7ff8a5763640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a01557f0 con 0x7ff8a006fd00 2023-11-27T20:46:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.391+0000 7ff89ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8a00c1f90 0x7ff8a0152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.391+0000 7ff89f7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff8a00a5300 0x7ff8a00c0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39030/0 (socket says 172.21.15.91:39030) 2023-11-27T20:46:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.391+0000 7ff89f7fe640 1 -- 172.21.15.91:0/2574650773 learned_addr learned my addr 172.21.15.91:0/2574650773 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.392+0000 7ff8a4f62640 1 --2- 172.21.15.91:0/2574650773 >> v2:172.21.15.183:3300/0 conn(0x7ff8a006fd00 0x7ff8a0070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.392+0000 7ff89ffff640 1 -- 172.21.15.91:0/2574650773 >> v2:172.21.15.183:3300/0 conn(0x7ff8a006fd00 msgr2=0x7ff8a0070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.392+0000 7ff89ffff640 1 --2- 172.21.15.91:0/2574650773 >> v2:172.21.15.183:3300/0 conn(0x7ff8a006fd00 0x7ff8a0070170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.392+0000 7ff89ffff640 1 -- 172.21.15.91:0/2574650773 >> v1:172.21.15.91:6789/0 conn(0x7ff8a00a5300 legacy=0x7ff8a00c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.392+0000 7ff89ffff640 1 -- 172.21.15.91:0/2574650773 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a0155a00 con 0x7ff8a00c1f90 2023-11-27T20:46:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.392+0000 7ff89effd640 1 -- 172.21.15.91:0/2574650773 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857267675 0 0) 0x7ff8a00a4f20 con 0x7ff8a00a5300 2023-11-27T20:46:08.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.393+0000 7ff89ffff640 1 --2- 172.21.15.91:0/2574650773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a00c1f90 0x7ff8a0152d30 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00c0070 tx=0x7ff89002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba31280479b2aafa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.393+0000 7ff89effd640 1 -- 172.21.15.91:0/2574650773 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89002e070 con 0x7ff8a00c1f90 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.393+0000 7ff89effd640 1 -- 172.21.15.91:0/2574650773 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8900315a0 con 0x7ff8a00c1f90 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.393+0000 7ff89effd640 1 -- 172.21.15.91:0/2574650773 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890031930 con 0x7ff8a00c1f90 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.394+0000 7ff8a5763640 1 -- 172.21.15.91:0/2574650773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a00c1f90 msgr2=0x7ff8a0152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.394+0000 7ff8a5763640 1 --2- 172.21.15.91:0/2574650773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a00c1f90 0x7ff8a0152d30 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00c0070 tx=0x7ff89002b840 comp rx=0 tx=0).stop 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.394+0000 7ff8a5763640 1 -- 172.21.15.91:0/2574650773 shutdown_connections 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.394+0000 7ff8a5763640 1 --2- 172.21.15.91:0/2574650773 >> v2:172.21.15.183:3300/0 conn(0x7ff8a006fd00 0x7ff8a0070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.394+0000 7ff8a5763640 1 --2- 172.21.15.91:0/2574650773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a00c1f90 0x7ff8a0152d30 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.394+0000 7ff8a5763640 1 -- 172.21.15.91:0/2574650773 >> 172.21.15.91:0/2574650773 conn(0x7ff8a00c2650 msgr2=0x7ff8a00c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.394+0000 7ff8a5763640 1 -- 172.21.15.91:0/2574650773 shutdown_connections 2023-11-27T20:46:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.394+0000 7ff8a5763640 1 -- 172.21.15.91:0/2574650773 wait complete. 2023-11-27T20:46:08.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.396+0000 7ff8a5763640 1 Processor -- start 2023-11-27T20:46:08.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.396+0000 7ff8a5763640 1 -- start start 2023-11-27T20:46:08.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.397+0000 7ff8a5763640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a006fd00 0x7ff8a00c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:08.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.397+0000 7ff8a5763640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8a00a5300 0x7ff8a014aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:08.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.397+0000 7ff8a5763640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a00c1f90 0x7ff8a014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:08.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.397+0000 7ff8a5763640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a01ee210 con 0x7ff8a006fd00 2023-11-27T20:46:08.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.397+0000 7ff8a5763640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a01edc90 con 0x7ff8a00c1f90 2023-11-27T20:46:08.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.397+0000 7ff8a5763640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a01edf30 con 0x7ff8a00a5300 2023-11-27T20:46:08.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.397+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a006fd00 0x7ff8a00c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:08.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.397+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a006fd00 0x7ff8a00c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57868/0 (socket says 172.21.15.91:57868) 2023-11-27T20:46:08.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.397+0000 7ff89ffff640 1 -- 172.21.15.91:0/3972705311 learned_addr learned my addr 172.21.15.91:0/3972705311 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:08.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89f7fe640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8a00a5300 0x7ff8a014aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:08.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89ffff640 1 -- 172.21.15.91:0/3972705311 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8a00a5300 msgr2=0x7ff8a014aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:08.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89ffff640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8a00a5300 0x7ff8a014aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:08.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89ffff640 1 -- 172.21.15.91:0/3972705311 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a00c1f90 msgr2=0x7ff8a014b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:08.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89ffff640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a00c1f90 0x7ff8a014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:08.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89ffff640 1 -- 172.21.15.91:0/3972705311 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff890009400 con 0x7ff8a006fd00 2023-11-27T20:46:08.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89f7fe640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8a00a5300 0x7ff8a014aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:08.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89ffff640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a006fd00 0x7ff8a00c4ad0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff890009890 tx=0x7ff8900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:08.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89cff9640 1 -- 172.21.15.91:0/3972705311 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890032900 con 0x7ff8a006fd00 2023-11-27T20:46:08.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89cff9640 1 -- 172.21.15.91:0/3972705311 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff890032a60 con 0x7ff8a006fd00 2023-11-27T20:46:08.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff89cff9640 1 -- 172.21.15.91:0/3972705311 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890032e10 con 0x7ff8a006fd00 2023-11-27T20:46:08.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff8a5763640 1 -- 172.21.15.91:0/3972705311 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a006be20 con 0x7ff8a006fd00 2023-11-27T20:46:08.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.398+0000 7ff8a5763640 1 -- 172.21.15.91:0/3972705311 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a006c3e0 con 0x7ff8a006fd00 2023-11-27T20:46:08.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.399+0000 7ff8a5763640 1 -- 172.21.15.91:0/3972705311 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a0070ef0 con 0x7ff8a006fd00 2023-11-27T20:46:08.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.400+0000 7ff89cff9640 1 -- 172.21.15.91:0/3972705311 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff89003b3f0 con 0x7ff8a006fd00 2023-11-27T20:46:08.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.401+0000 7ff89cff9640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff88c06b1c0 0x7ff88c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:08.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.401+0000 7ff89cff9640 1 -- 172.21.15.91:0/3972705311 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5445+0+0 (secure 0 0 0) 0x7ff8900ab9e0 con 0x7ff8a006fd00 2023-11-27T20:46:08.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.402+0000 7ff89f7fe640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff88c06b1c0 0x7ff88c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:08.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.402+0000 7ff89f7fe640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff88c06b1c0 0x7ff88c06d680 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00c0030 tx=0x7ff894009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:08.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.405+0000 7ff89cff9640 1 -- 172.21.15.91:0/3972705311 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff8900768a0 con 0x7ff8a006fd00 2023-11-27T20:46:08.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:08.602+0000 7ff8a5763640 1 -- 172.21.15.91:0/3972705311 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8a006c600 con 0x7ff8a006fd00 2023-11-27T20:46:09.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.153+0000 7ff89cff9640 1 -- 172.21.15.91:0/3972705311 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v87) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff890079ec0 con 0x7ff8a006fd00 2023-11-27T20:46:09.155 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs2_data' removed 2023-11-27T20:46:09.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.158+0000 7ff8a5763640 1 -- 172.21.15.91:0/3972705311 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff88c06b1c0 msgr2=0x7ff88c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.158+0000 7ff8a5763640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff88c06b1c0 0x7ff88c06d680 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00c0030 tx=0x7ff894009040 comp rx=0 tx=0).stop 2023-11-27T20:46:09.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.158+0000 7ff8a5763640 1 -- 172.21.15.91:0/3972705311 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a006fd00 msgr2=0x7ff8a00c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.158+0000 7ff8a5763640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a006fd00 0x7ff8a00c4ad0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff890009890 tx=0x7ff8900046c0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.158+0000 7ff8a5763640 1 -- 172.21.15.91:0/3972705311 shutdown_connections 2023-11-27T20:46:09.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.158+0000 7ff8a5763640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7ff88c06b1c0 0x7ff88c06d680 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.158+0000 7ff8a5763640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8a00c1f90 0x7ff8a014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.158+0000 7ff8a5763640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8a00a5300 0x7ff8a014aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.158+0000 7ff8a5763640 1 --2- 172.21.15.91:0/3972705311 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a006fd00 0x7ff8a00c4ad0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.158+0000 7ff8a5763640 1 -- 172.21.15.91:0/3972705311 >> 172.21.15.91:0/3972705311 conn(0x7ff8a00c2650 msgr2=0x7ff8a006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:09.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.163+0000 7ff8a5763640 1 -- 172.21.15.91:0/3972705311 shutdown_connections 2023-11-27T20:46:09.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.163+0000 7ff8a5763640 1 -- 172.21.15.91:0/3972705311 wait complete. 2023-11-27T20:46:09.191 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-27T20:46:09.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.379+0000 7f65ec30f640 1 Processor -- start 2023-11-27T20:46:09.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.379+0000 7f65ec30f640 1 -- start start 2023-11-27T20:46:09.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.381+0000 7f65ec30f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f65e406d0a0 0x7f65e4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.381+0000 7f65ec30f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e40c3ea0 0x7f65e40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.381+0000 7f65ec30f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e40c64a0 con 0x7f65e414fd30 2023-11-27T20:46:09.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.381+0000 7f65ec30f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e40c5c00 con 0x7f65e406d0a0 2023-11-27T20:46:09.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.381+0000 7f65ec30f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40c5ee0 con 0x7f65e40c3ea0 2023-11-27T20:46:09.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.381+0000 7f65e98aa640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f65e406d0a0 0x7f65e4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.381+0000 7f65e98aa640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f65e406d0a0 0x7f65e4152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57884/0 (socket says 172.21.15.91:57884) 2023-11-27T20:46:09.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.381+0000 7f65e98aa640 1 -- 172.21.15.91:0/357055145 learned_addr learned my addr 172.21.15.91:0/357055145 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:09.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.382+0000 7f65ea8ac640 1 --2- 172.21.15.91:0/357055145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e40c3ea0 0x7f65e40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.382+0000 7f65e98aa640 1 -- 172.21.15.91:0/357055145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e40c3ea0 msgr2=0x7f65e40c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:09.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.382+0000 7f65e98aa640 1 --2- 172.21.15.91:0/357055145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e40c3ea0 0x7f65e40c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.382+0000 7f65e98aa640 1 -- 172.21.15.91:0/357055145 >> v1:172.21.15.183:6789/0 conn(0x7f65e414fd30 legacy=0x7f65e40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:09.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.382+0000 7f65e98aa640 1 -- 172.21.15.91:0/357055145 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40c61c0 con 0x7f65e406d0a0 2023-11-27T20:46:09.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.383+0000 7f65e98aa640 1 --2- 172.21.15.91:0/357055145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 0x7f65e4152f20 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009870 tx=0x7f65d402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81dd3f4a41597a24 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:09.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.383+0000 7f65e90a9640 1 -- 172.21.15.91:0/357055145 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4031640 con 0x7f65e406d0a0 2023-11-27T20:46:09.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.383+0000 7f65e90a9640 1 -- 172.21.15.91:0/357055145 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d40317a0 con 0x7f65e406d0a0 2023-11-27T20:46:09.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.383+0000 7f65e90a9640 1 -- 172.21.15.91:0/357055145 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4031b30 con 0x7f65e406d0a0 2023-11-27T20:46:09.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.384+0000 7f65ec30f640 1 -- 172.21.15.91:0/357055145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 msgr2=0x7f65e4152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.384+0000 7f65ec30f640 1 --2- 172.21.15.91:0/357055145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 0x7f65e4152f20 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009870 tx=0x7f65d402b8f0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.384+0000 7f65ec30f640 1 -- 172.21.15.91:0/357055145 shutdown_connections 2023-11-27T20:46:09.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.384+0000 7f65ec30f640 1 --2- 172.21.15.91:0/357055145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e40c3ea0 0x7f65e40c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.384+0000 7f65ec30f640 1 --2- 172.21.15.91:0/357055145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 0x7f65e4152f20 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.384+0000 7f65ec30f640 1 -- 172.21.15.91:0/357055145 >> 172.21.15.91:0/357055145 conn(0x7f65e406a500 msgr2=0x7f65e406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:09.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.384+0000 7f65ec30f640 1 -- 172.21.15.91:0/357055145 shutdown_connections 2023-11-27T20:46:09.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.384+0000 7f65ec30f640 1 -- 172.21.15.91:0/357055145 wait complete. 2023-11-27T20:46:09.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.386+0000 7f65ec30f640 1 Processor -- start 2023-11-27T20:46:09.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.386+0000 7f65ec30f640 1 -- start start 2023-11-27T20:46:09.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ec30f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 0x7f65e41f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ec30f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e40c3ea0 0x7f65e41f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ec30f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e414fd30 0x7f65e414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ec30f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40aaf30 con 0x7f65e406d0a0 2023-11-27T20:46:09.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ec30f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4151330 con 0x7f65e414fd30 2023-11-27T20:46:09.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ec30f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40aac90 con 0x7f65e40c3ea0 2023-11-27T20:46:09.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ea0ab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 0x7f65e41f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ea0ab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 0x7f65e41f1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57890/0 (socket says 172.21.15.91:57890) 2023-11-27T20:46:09.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ea0ab640 1 -- 172.21.15.91:0/2412727916 learned_addr learned my addr 172.21.15.91:0/2412727916 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:09.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65e98aa640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e40c3ea0 0x7f65e41f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ea8ac640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e414fd30 0x7f65e414eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ea0ab640 1 -- 172.21.15.91:0/2412727916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e40c3ea0 msgr2=0x7f65e41f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ea0ab640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e40c3ea0 0x7f65e41f1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ea0ab640 1 -- 172.21.15.91:0/2412727916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e414fd30 msgr2=0x7f65e414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ea0ab640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e414fd30 0x7f65e414eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ea0ab640 1 -- 172.21.15.91:0/2412727916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d40094d0 con 0x7f65e406d0a0 2023-11-27T20:46:09.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.387+0000 7f65ea8ac640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e414fd30 0x7f65e414eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:09.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.388+0000 7f65ea0ab640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 0x7f65e41f1840 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c430 tx=0x7f65e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:09.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.388+0000 7f65daffd640 1 -- 172.21.15.91:0/2412727916 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0011790 con 0x7f65e406d0a0 2023-11-27T20:46:09.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.388+0000 7f65daffd640 1 -- 172.21.15.91:0/2412727916 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e00118f0 con 0x7f65e406d0a0 2023-11-27T20:46:09.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.388+0000 7f65daffd640 1 -- 172.21.15.91:0/2412727916 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0011ce0 con 0x7f65e406d0a0 2023-11-27T20:46:09.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.388+0000 7f65ec30f640 1 -- 172.21.15.91:0/2412727916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e4150d20 con 0x7f65e406d0a0 2023-11-27T20:46:09.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.388+0000 7f65ec30f640 1 -- 172.21.15.91:0/2412727916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e41f23f0 con 0x7f65e406d0a0 2023-11-27T20:46:09.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.389+0000 7f65ec30f640 1 -- 172.21.15.91:0/2412727916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e4068350 con 0x7f65e406d0a0 2023-11-27T20:46:09.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.390+0000 7f65daffd640 1 -- 172.21.15.91:0/2412727916 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f65e001c460 con 0x7f65e406d0a0 2023-11-27T20:46:09.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.391+0000 7f65daffd640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f65c806b1f0 0x7f65c806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.391+0000 7f65daffd640 1 -- 172.21.15.91:0/2412727916 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f65e0089730 con 0x7f65e406d0a0 2023-11-27T20:46:09.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.392+0000 7f65e98aa640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f65c806b1f0 0x7f65c806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.392+0000 7f65e98aa640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f65c806b1f0 0x7f65c806d6b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f65d4036000 tx=0x7f65d403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:09.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.396+0000 7f65daffd640 1 -- 172.21.15.91:0/2412727916 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f65e00546f0 con 0x7f65e406d0a0 2023-11-27T20:46:09.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.600+0000 7f65ec30f640 1 -- 172.21.15.91:0/2412727916 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f65e406d540 con 0x7f65e406d0a0 2023-11-27T20:46:09.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.607+0000 7f65daffd640 1 -- 172.21.15.91:0/2412727916 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f65e0057d10 con 0x7f65e406d0a0 2023-11-27T20:46:09.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 -- 172.21.15.91:0/2412727916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f65c806b1f0 msgr2=0x7f65c806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f65c806b1f0 0x7f65c806d6b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f65d4036000 tx=0x7f65d403c040 comp rx=0 tx=0).stop 2023-11-27T20:46:09.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 -- 172.21.15.91:0/2412727916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 msgr2=0x7f65e41f1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 0x7f65e41f1840 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c430 tx=0x7f65e000c8f0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 -- 172.21.15.91:0/2412727916 shutdown_connections 2023-11-27T20:46:09.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f65c806b1f0 0x7f65c806d6b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e414fd30 0x7f65e414eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e40c3ea0 0x7f65e41f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 --2- 172.21.15.91:0/2412727916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65e406d0a0 0x7f65e41f1840 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 -- 172.21.15.91:0/2412727916 >> 172.21.15.91:0/2412727916 conn(0x7f65e406a500 msgr2=0x7f65e40a61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:09.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 -- 172.21.15.91:0/2412727916 shutdown_connections 2023-11-27T20:46:09.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.610+0000 7f65ec30f640 1 -- 172.21.15.91:0/2412727916 wait complete. 2023-11-27T20:46:09.629 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-11-27T20:46:09.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.833+0000 7f66da7ae640 1 Processor -- start 2023-11-27T20:46:09.835 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.833+0000 7f66da7ae640 1 -- start start 2023-11-27T20:46:09.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.835+0000 7f66da7ae640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66d414e7f0 0x7f66d40c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.835+0000 7f66da7ae640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f66d40c52e0 0x7f66d406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.835+0000 7f66da7ae640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d40a8380 con 0x7f66d406cd20 2023-11-27T20:46:09.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.835+0000 7f66da7ae640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d41510b0 con 0x7f66d40c52e0 2023-11-27T20:46:09.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.835+0000 7f66da7ae640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d406bf60 con 0x7f66d414e7f0 2023-11-27T20:46:09.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.835+0000 7f66d9fad640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f66d406cd20 0x7f66d41546a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39034/0 (socket says 172.21.15.91:39034) 2023-11-27T20:46:09.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.835+0000 7f66d9fad640 1 -- 172.21.15.91:0/3776777006 learned_addr learned my addr 172.21.15.91:0/3776777006 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:09.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.835+0000 7f66d8fab640 1 --2- 172.21.15.91:0/3776777006 >> v2:172.21.15.183:3300/0 conn(0x7f66d40c52e0 0x7f66d406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.835+0000 7f66d97ac640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66d414e7f0 0x7f66d40c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278277630 0 0) 0x7f66d40a8380 con 0x7f66d406cd20 2023-11-27T20:46:09.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c0003520 con 0x7f66d406cd20 2023-11-27T20:46:09.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 363326357 0 0) 0x7f66c0003520 con 0x7f66d406cd20 2023-11-27T20:46:09.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66d414e7f0 msgr2=0x7f66d40c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:09.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66d414e7f0 0x7f66d40c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 >> v2:172.21.15.183:3300/0 conn(0x7f66d40c52e0 msgr2=0x7f66d406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:09.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 --2- 172.21.15.91:0/3776777006 >> v2:172.21.15.183:3300/0 conn(0x7f66d40c52e0 0x7f66d406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d406c240 con 0x7f66d406cd20 2023-11-27T20:46:09.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f66cc001670 con 0x7f66d406cd20 2023-11-27T20:46:09.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 >> v1:172.21.15.91:6789/0 conn(0x7f66d406cd20 legacy=0x7f66d41546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66c0003970 0x7f66c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c00047c0 0x7f66c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66d414e7f0 0x7f66c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d41510b0 con 0x7f66c0003970 2023-11-27T20:46:09.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d406bf60 con 0x7f66c00047c0 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c000b980 con 0x7f66d414e7f0 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.836+0000 7f66d97ac640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66c0003970 0x7f66c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.837+0000 7f66d9fad640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66d414e7f0 0x7f66c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.837+0000 7f66d8fab640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c00047c0 0x7f66c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.837+0000 7f66d97ac640 1 -- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66d414e7f0 msgr2=0x7f66c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.837+0000 7f66d97ac640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66d414e7f0 0x7f66c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.837+0000 7f66d97ac640 1 -- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c00047c0 msgr2=0x7f66c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.837+0000 7f66d97ac640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c00047c0 0x7f66c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.837+0000 7f66d97ac640 1 -- 172.21.15.91:0/3776777006 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0003520 con 0x7f66c0003970 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.837+0000 7f66d9fad640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66d414e7f0 0x7f66c0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:09.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.837+0000 7f66d8fab640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c00047c0 0x7f66c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:09.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.838+0000 7f66d97ac640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66c0003970 0x7f66c0003d90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f66d000e170 tx=0x7f66c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9939414b16f8a964 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:09.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.838+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d002cbf0 con 0x7f66c0003970 2023-11-27T20:46:09.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.838+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d000f040 con 0x7f66c0003970 2023-11-27T20:46:09.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.838+0000 7f66cbfff640 1 -- 172.21.15.91:0/3776777006 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0034440 con 0x7f66c0003970 2023-11-27T20:46:09.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.839+0000 7f66da7ae640 1 -- 172.21.15.91:0/3776777006 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66c0003970 msgr2=0x7f66c0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.839+0000 7f66da7ae640 1 --2- 172.21.15.91:0/3776777006 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66c0003970 0x7f66c0003d90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f66d000e170 tx=0x7f66c00057f0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.839+0000 7f66d9fad640 1 -- 172.21.15.91:0/3776777006 reap_dead start 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.839+0000 7f66da7ae640 1 -- 172.21.15.91:0/3776777006 shutdown_connections 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.839+0000 7f66da7ae640 1 -- 172.21.15.91:0/3776777006 >> 172.21.15.91:0/3776777006 conn(0x7f66d40a77f0 msgr2=0x7f66d40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.839+0000 7f66da7ae640 1 -- 172.21.15.91:0/3776777006 shutdown_connections 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.839+0000 7f66da7ae640 1 -- 172.21.15.91:0/3776777006 wait complete. 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.841+0000 7f66da7ae640 1 Processor -- start 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.841+0000 7f66da7ae640 1 -- start start 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66da7ae640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66c0003970 0x7f66d41455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66da7ae640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66d41eade0 0x7f66d414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66da7ae640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66d413f600 0x7f66d414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66da7ae640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d413b9b0 con 0x7f66d413f600 2023-11-27T20:46:09.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66da7ae640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d41ea0f0 con 0x7f66d41eade0 2023-11-27T20:46:09.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66da7ae640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d41ea950 con 0x7f66c0003970 2023-11-27T20:46:09.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66d9fad640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66d413f600 0x7f66d414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66d9fad640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66d413f600 0x7f66d414f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57918/0 (socket says 172.21.15.91:57918) 2023-11-27T20:46:09.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66d9fad640 1 -- 172.21.15.91:0/1930477053 learned_addr learned my addr 172.21.15.91:0/1930477053 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:09.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66d97ac640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66c0003970 0x7f66d41455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66d8fab640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66d41eade0 0x7f66d414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.842+0000 7f66d9fad640 1 -- 172.21.15.91:0/1930477053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66c0003970 msgr2=0x7f66d41455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.843+0000 7f66d9fad640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66c0003970 0x7f66d41455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.843+0000 7f66d9fad640 1 -- 172.21.15.91:0/1930477053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66d41eade0 msgr2=0x7f66d414ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:09.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.843+0000 7f66d9fad640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66d41eade0 0x7f66d414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:09.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.843+0000 7f66d9fad640 1 -- 172.21.15.91:0/1930477053 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d41ed790 con 0x7f66d413f600 2023-11-27T20:46:09.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.843+0000 7f66d9fad640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66d413f600 0x7f66d414f460 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000fb0 tx=0x7f66cc00d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:09.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.843+0000 7f66c9ffb640 1 -- 172.21.15.91:0/1930477053 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc007440 con 0x7f66d413f600 2023-11-27T20:46:09.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.843+0000 7f66c9ffb640 1 -- 172.21.15.91:0/1930477053 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc0075a0 con 0x7f66d413f600 2023-11-27T20:46:09.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.843+0000 7f66c9ffb640 1 -- 172.21.15.91:0/1930477053 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc004a20 con 0x7f66d413f600 2023-11-27T20:46:09.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.843+0000 7f66da7ae640 1 -- 172.21.15.91:0/1930477053 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d41ea300 con 0x7f66d413f600 2023-11-27T20:46:09.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.843+0000 7f66da7ae640 1 -- 172.21.15.91:0/1930477053 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d4145b00 con 0x7f66d413f600 2023-11-27T20:46:09.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.845+0000 7f66da7ae640 1 -- 172.21.15.91:0/1930477053 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d41eaac0 con 0x7f66d413f600 2023-11-27T20:46:09.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.845+0000 7f66c9ffb640 1 -- 172.21.15.91:0/1930477053 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f66cc004b80 con 0x7f66d413f600 2023-11-27T20:46:09.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.846+0000 7f66c9ffb640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f66b806b210 0x7f66b806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:09.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.846+0000 7f66c9ffb640 1 -- 172.21.15.91:0/1930477053 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f66cc089120 con 0x7f66d413f600 2023-11-27T20:46:09.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.846+0000 7f66d97ac640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f66b806b210 0x7f66b806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:09.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.847+0000 7f66d97ac640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f66b806b210 0x7f66b806d6d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f66d0036000 tx=0x7f66d002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:09.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:09.851+0000 7f66c9ffb640 1 -- 172.21.15.91:0/1930477053 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f66cc0541d0 con 0x7f66d413f600 2023-11-27T20:46:10.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.108+0000 7f66da7ae640 1 -- 172.21.15.91:0/1930477053 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f66d404e840 con 0x7f66d413f600 2023-11-27T20:46:10.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.170+0000 7f66c9ffb640 1 -- 172.21.15.91:0/1930477053 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v281) v1 ==== 159+0+0 (secure 0 0 0) 0x7f66cc0577f0 con 0x7f66d413f600 2023-11-27T20:46:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.172+0000 7f66da7ae640 1 -- 172.21.15.91:0/1930477053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f66b806b210 msgr2=0x7f66b806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f66b806b210 0x7f66b806d6d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f66d0036000 tx=0x7f66d002e000 comp rx=0 tx=0).stop 2023-11-27T20:46:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 -- 172.21.15.91:0/1930477053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66d413f600 msgr2=0x7f66d414f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66d413f600 0x7f66d414f460 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000fb0 tx=0x7f66cc00d900 comp rx=0 tx=0).stop 2023-11-27T20:46:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 -- 172.21.15.91:0/1930477053 shutdown_connections 2023-11-27T20:46:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66d413f600 0x7f66d414f460 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f66b806b210 0x7f66b806d6d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66d41eade0 0x7f66d414ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:10.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 --2- 172.21.15.91:0/1930477053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f66c0003970 0x7f66d41455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:10.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 -- 172.21.15.91:0/1930477053 >> 172.21.15.91:0/1930477053 conn(0x7f66d40a77f0 msgr2=0x7f66d40bee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:10.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 -- 172.21.15.91:0/1930477053 shutdown_connections 2023-11-27T20:46:10.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:10.173+0000 7f66da7ae640 1 -- 172.21.15.91:0/1930477053 wait complete. 2023-11-27T20:46:10.193 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-11-27T20:46:10.194 INFO:tasks.cephfs_test_runner: 2023-11-27T20:46:10.194 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-27T20:46:10.194 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-27T20:46:10.194 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-27T20:46:10.194 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-27T20:46:10.194 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-11-27T20:46:10.194 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-11-27T20:46:10.194 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-11-27T20:46:10.194 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-27T20:46:10.195 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi091 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner: 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner:Ran 3 tests in 242.626s 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner: 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner: 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-11-27T20:46:10.196 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-27T20:46:10.197 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-27T20:46:10.198 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-27T20:46:10.198 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi091 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-11-27T20:46:10.198 INFO:tasks.cephfs_test_runner: 2023-11-27T20:46:10.198 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-27T20:46:11.932 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a0fae48366274a3ba80a40a7157d8b45 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-27T20:46:11.934 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-27T20:46:11.943 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-27T20:46:12.027 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-27T20:46:12.027 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-27T20:46:12.028 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:46:12.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-27T20:46:12.100 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-27T20:46:12.100 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T20:46:12.162 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-27T20:46:12.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:46:12.162 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-27T20:46:12.223 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T20:46:12.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:46:12.224 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T20:46:12.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:46:12.319 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link delete ceph-brx 2023-11-27T20:46:12.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:46:12.461 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-27T20:46:12.520 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-27T20:46:12.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:46:12.521 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T20:46:12.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T20:46:12.617 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2023-11-27T20:46:12.738 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-27T20:46:12.747 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-27T20:46:12.748 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:46:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.974+0000 7f494f59e640 1 Processor -- start 2023-11-27T20:46:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.975+0000 7f494f59e640 1 -- start start 2023-11-27T20:46:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.976+0000 7f494f59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f49500c0440 0x7f49500c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.976+0000 7f494f59e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4950071e80 con 0x7f495014c2e0 2023-11-27T20:46:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.976+0000 7f494f59e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495014c6c0 con 0x7f4950072310 2023-11-27T20:46:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.976+0000 7f494f59e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4950071470 con 0x7f49500c0440 2023-11-27T20:46:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.976+0000 7f494e59c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f495014c2e0 0x7f4950152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:39050/0 (socket says 172.21.15.91:39050) 2023-11-27T20:46:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.976+0000 7f494e59c640 1 -- 172.21.15.91:0/3987070675 learned_addr learned my addr 172.21.15.91:0/3987070675 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f4947fff640 1 --2- 172.21.15.91:0/3987070675 >> v2:172.21.15.183:3300/0 conn(0x7f49500c0440 0x7f49500c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902696628 0 0) 0x7f4950071e80 con 0x7f495014c2e0 2023-11-27T20:46:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f493c003520 con 0x7f495014c2e0 2023-11-27T20:46:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2452879729 0 0) 0x7f493c003520 con 0x7f495014c2e0 2023-11-27T20:46:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 >> v2:172.21.15.183:3300/0 conn(0x7f49500c0440 msgr2=0x7f49500c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 --2- 172.21.15.91:0/3987070675 >> v2:172.21.15.183:3300/0 conn(0x7f49500c0440 0x7f49500c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 >> v1:172.21.15.183:6789/0 conn(0x7f4950072310 legacy=0x7f49500a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495006fdc0 con 0x7f495014c2e0 2023-11-27T20:46:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f4940001670 con 0x7f495014c2e0 2023-11-27T20:46:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 >> v1:172.21.15.91:6789/0 conn(0x7f495014c2e0 legacy=0x7f4950152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 --2- 172.21.15.91:0/3987070675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f493c003970 0x7f493c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 --2- 172.21.15.91:0/3987070675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f493c0047c0 0x7f493c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 --2- 172.21.15.91:0/3987070675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f493c005380 0x7f493c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c00c1e0 con 0x7f493c0047c0 2023-11-27T20:46:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c00c350 con 0x7f493c003970 2023-11-27T20:46:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.977+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c00c510 con 0x7f493c005380 2023-11-27T20:46:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.978+0000 7f4947fff640 1 --2- 172.21.15.91:0/3987070675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f493c0047c0 0x7f493c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.978+0000 7f494e59c640 1 --2- 172.21.15.91:0/3987070675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f493c003970 0x7f493c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.978+0000 7f4947fff640 1 -- 172.21.15.91:0/3987070675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f493c005380 msgr2=0x7f493c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.978+0000 7f4947fff640 1 --2- 172.21.15.91:0/3987070675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f493c005380 0x7f493c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.978+0000 7f4947fff640 1 -- 172.21.15.91:0/3987070675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f493c003970 msgr2=0x7f493c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.978+0000 7f4947fff640 1 --2- 172.21.15.91:0/3987070675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f493c003970 0x7f493c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.978+0000 7f4947fff640 1 -- 172.21.15.91:0/3987070675 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c003520 con 0x7f493c0047c0 2023-11-27T20:46:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.978+0000 7f494ed9d640 1 -- 172.21.15.91:0/3987070675 reap_dead start 2023-11-27T20:46:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.979+0000 7f4947fff640 1 --2- 172.21.15.91:0/3987070675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f493c0047c0 0x7f493c004c40 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f493800ba30 tx=0x7f493c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f30de0ac6048a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.979+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4938032660 con 0x7f493c0047c0 2023-11-27T20:46:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.979+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49380327c0 con 0x7f493c0047c0 2023-11-27T20:46:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.979+0000 7f494dd9b640 1 -- 172.21.15.91:0/3987070675 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4938032b50 con 0x7f493c0047c0 2023-11-27T20:46:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.980+0000 7f494f59e640 1 -- 172.21.15.91:0/3987070675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f493c0047c0 msgr2=0x7f493c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.980+0000 7f494f59e640 1 --2- 172.21.15.91:0/3987070675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f493c0047c0 0x7f493c004c40 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f493800ba30 tx=0x7f493c0057f0 comp rx=0 tx=0).stop 2023-11-27T20:46:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.980+0000 7f494f59e640 1 -- 172.21.15.91:0/3987070675 shutdown_connections 2023-11-27T20:46:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.980+0000 7f494f59e640 1 --2- 172.21.15.91:0/3987070675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f493c0047c0 0x7f493c004c40 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.980+0000 7f494f59e640 1 -- 172.21.15.91:0/3987070675 >> 172.21.15.91:0/3987070675 conn(0x7f49500a77f0 msgr2=0x7f49500a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.980+0000 7f494f59e640 1 -- 172.21.15.91:0/3987070675 shutdown_connections 2023-11-27T20:46:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.980+0000 7f494f59e640 1 -- 172.21.15.91:0/3987070675 wait complete. 2023-11-27T20:46:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.982+0000 7f494f59e640 1 Processor -- start 2023-11-27T20:46:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.982+0000 7f494f59e640 1 -- start start 2023-11-27T20:46:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.983+0000 7f494f59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f495014e750 0x7f49501452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.983+0000 7f494f59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f495006bec0 0x7f495014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.983+0000 7f494f59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f495014eb30 0x7f49501ed390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.983+0000 7f494f59e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495014d930 con 0x7f495006bec0 2023-11-27T20:46:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.983+0000 7f494f59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49501eab80 con 0x7f495014eb30 2023-11-27T20:46:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.983+0000 7f494f59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4950144d70 con 0x7f495014e750 2023-11-27T20:46:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.983+0000 7f4947fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f495006bec0 0x7f495014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.983+0000 7f4947fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f495006bec0 0x7f495014c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57946/0 (socket says 172.21.15.91:57946) 2023-11-27T20:46:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.983+0000 7f4947fff640 1 -- 172.21.15.91:0/1998190049 learned_addr learned my addr 172.21.15.91:0/1998190049 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.984+0000 7f494e59c640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f495014e750 0x7f49501452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.984+0000 7f494ed9d640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f495014eb30 0x7f49501ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.984+0000 7f4947fff640 1 -- 172.21.15.91:0/1998190049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f495014e750 msgr2=0x7f49501452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.984+0000 7f4947fff640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f495014e750 0x7f49501452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.984+0000 7f4947fff640 1 -- 172.21.15.91:0/1998190049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f495014eb30 msgr2=0x7f49501ed390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.984+0000 7f4947fff640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f495014eb30 0x7f49501ed390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.984+0000 7f4947fff640 1 -- 172.21.15.91:0/1998190049 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49501ea8a0 con 0x7f495006bec0 2023-11-27T20:46:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.984+0000 7f494e59c640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f495014e750 0x7f49501452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.984+0000 7f4947fff640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f495006bec0 0x7f495014c8e0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f493800bb20 tx=0x7f4938004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.984+0000 7f4946ffd640 1 -- 172.21.15.91:0/1998190049 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493803c9c0 con 0x7f495006bec0 2023-11-27T20:46:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.985+0000 7f4946ffd640 1 -- 172.21.15.91:0/1998190049 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493803cb20 con 0x7f495006bec0 2023-11-27T20:46:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.985+0000 7f4946ffd640 1 -- 172.21.15.91:0/1998190049 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4938047450 con 0x7f495006bec0 2023-11-27T20:46:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.985+0000 7f494f59e640 1 -- 172.21.15.91:0/1998190049 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4950144fc0 con 0x7f495006bec0 2023-11-27T20:46:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.985+0000 7f494f59e640 1 -- 172.21.15.91:0/1998190049 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495014f910 con 0x7f495006bec0 2023-11-27T20:46:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.986+0000 7f494f59e640 1 -- 172.21.15.91:0/1998190049 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49501ead30 con 0x7f495006bec0 2023-11-27T20:46:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.987+0000 7f4946ffd640 1 -- 172.21.15.91:0/1998190049 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f49380475b0 con 0x7f495006bec0 2023-11-27T20:46:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.987+0000 7f4946ffd640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1c0 0x7f493006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.988+0000 7f4946ffd640 1 -- 172.21.15.91:0/1998190049 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f49380ac450 con 0x7f495006bec0 2023-11-27T20:46:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.988+0000 7f494e59c640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1c0 0x7f493006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.988+0000 7f494e59c640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1c0 0x7f493006d680 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4940001c80 tx=0x7f4940001e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:12.992+0000 7f4946ffd640 1 -- 172.21.15.91:0/1998190049 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f49501ead30 con 0x7f495006bec0 2023-11-27T20:46:13.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.178+0000 7f494f59e640 1 -- 172.21.15.91:0/1998190049 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4950067dc0 con 0x7f493006b1c0 2023-11-27T20:46:13.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.181+0000 7f4946ffd640 1 -- 172.21.15.91:0/1998190049 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48381 (secure 0 0 0) 0x7f4950067dc0 con 0x7f493006b1c0 2023-11-27T20:46:13.184 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:13.184 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:46:13.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 -- 172.21.15.91:0/1998190049 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1c0 msgr2=0x7f493006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1c0 0x7f493006d680 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4940001c80 tx=0x7f4940001e70 comp rx=0 tx=0).stop 2023-11-27T20:46:13.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 -- 172.21.15.91:0/1998190049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f495006bec0 msgr2=0x7f495014c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f495006bec0 0x7f495014c8e0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f493800bb20 tx=0x7f4938004730 comp rx=0 tx=0).stop 2023-11-27T20:46:13.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 -- 172.21.15.91:0/1998190049 shutdown_connections 2023-11-27T20:46:13.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f493006b1c0 0x7f493006d680 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f495014eb30 0x7f49501ed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f495006bec0 0x7f495014c8e0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 --2- 172.21.15.91:0/1998190049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f495014e750 0x7f49501452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 -- 172.21.15.91:0/1998190049 >> 172.21.15.91:0/1998190049 conn(0x7f49500a77f0 msgr2=0x7f4950149e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:13.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 -- 172.21.15.91:0/1998190049 shutdown_connections 2023-11-27T20:46:13.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.184+0000 7f494f59e640 1 -- 172.21.15.91:0/1998190049 wait complete. 2023-11-27T20:46:13.205 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2023-11-27T20:46:11.468356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258936,"kb_used_data":9488,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715784,"statfs":{"total":773094113280,"available":772828962816,"internally_reserved":0,"allocated":9715712,"data_stored":5039462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001647"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-27T20:46:06.395474+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:46:06.395474+0000","last_peered":"2023-11-27T20:46:06.395474+0000","last_clean":"2023-11-27T20:46:06.395474+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:46:06.395474+0000","last_undegraded":"2023-11-27T20:46:06.395474+0000","last_fullsized":"2023-11-27T20:46:06.395474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1662976,"data_stored":1074278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.121,"15min":1.151},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.635,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.415},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.22,"15min":1.234},"min":{"1min":0.82299999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7430000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.93400000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.167,"15min":1.2170000000000001},"min":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.657},{"interface":"front","average":{"1min":1.159,"5min":1.1719999999999999,"15min":1.2110000000000001},"min":{"1min":0.68999999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.81100000000000005}]},{"osd":2,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.198,"15min":1.28},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8360000000000001,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2030000000000001,"15min":1.244},"min":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3200000000000001,"5min":1.909,"15min":1.909},"last":1.2170000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3089999999999999,"15min":1.379},"min":{"1min":0.91500000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.9930000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4039999999999999,"15min":1.474},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8400000000000001,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.5800000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3420000000000001,"15min":1.3999999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.036},{"interface":"front","average":{"1min":1.351,"5min":1.4339999999999999,"15min":1.5680000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.105,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.3380000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4350000000000001,"15min":1.4910000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":1.71},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.502,"15min":1.5720000000000001},"min":{"1min":0.626,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.1720000000000002,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.5289999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.609,"15min":1.661},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6020000000000001,"15min":1.6759999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":6.2190000000000003,"5min":6.2190000000000003,"15min":6.2190000000000003},"last":1.4770000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1069056,"data_stored":483910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.198,"15min":1.262},"min":{"1min":0.67300000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7130000000000001,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.244,"15min":1.3100000000000001},"min":{"1min":0.81999999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.613,"5min":2.581,"15min":2.581},"last":1.466}]},{"osd":1,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1879999999999999,"15min":1.2549999999999999},"min":{"1min":0.65700000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6060000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.127,"15min":1.159},"min":{"1min":0.77400000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.798,"5min":2.823,"15min":2.823},"last":1.288}]},{"osd":2,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.073,"15min":1.0800000000000001},"min":{"1min":0.76100000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.573,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.173,"5min":1.2789999999999999,"15min":1.373},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.8720000000000001,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.5009999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.268,"15min":1.3600000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.77,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.214},{"interface":"front","average":{"1min":1.327,"5min":1.2989999999999999,"15min":1.3420000000000001},"min":{"1min":0.97099999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8149999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2450000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4710000000000001,"15min":1.587},"min":{"1min":0.84999999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.9470000000000001,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.615},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.512,"15min":1.6259999999999999},"min":{"1min":0.84099999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.863,"5min":3.536,"15min":3.536},"last":1.5900000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3500000000000001,"15min":1.3939999999999999},"min":{"1min":0.98499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7,"5min":2.355,"15min":2.355},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.536,"15min":1.6419999999999999},"min":{"1min":1.0900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.76,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.5589999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.5289999999999999,"15min":1.651},"min":{"1min":1.238,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9550000000000001,"5min":3.645,"15min":3.645},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5149999999999999,"15min":1.571},"min":{"1min":1.2290000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6910000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.5249999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":477887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0840000000000001,"15min":1.145},"min":{"1min":0.63,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.361,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.173},"min":{"1min":0.79000000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.47,"5min":2.04,"15min":2.04},"last":0.92600000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1459999999999999,"15min":1.1930000000000001},"min":{"1min":0.68999999999999995,"5min":0.379,"15min":0.379},"max":{"1min":1.6479999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.1659999999999999,"15min":1.169},"min":{"1min":0.93100000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5580000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.28}]},{"osd":2,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2150000000000001,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.621,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.157,"15min":1.2010000000000001},"min":{"1min":0.72899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.599,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.0049999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.321,"15min":1.3839999999999999},"min":{"1min":0.89700000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7270000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.3069999999999999,"15min":1.429},"min":{"1min":0.66400000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.52,"5min":4.016,"15min":4.016},"last":1.091}]},{"osd":4,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.256,"15min":1.3580000000000001},"min":{"1min":0.69799999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5529999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.115},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.462,"15min":1.593},"min":{"1min":0.72399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.855,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.044}]},{"osd":6,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.452,"15min":1.6160000000000001},"min":{"1min":0.72999999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.756,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.476},{"interface":"front","average":{"1min":1.329,"5min":1.4630000000000001,"15min":1.575},"min":{"1min":0.76200000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.764,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.4059999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.536,"15min":1.6479999999999999},"min":{"1min":0.83299999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.99,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.554,"15min":1.708},"min":{"1min":0.86799999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.915,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.5349999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":489389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0229999999999999,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.997},{"interface":"front","average":{"1min":1.089,"5min":1.109,"15min":1.0900000000000001},"min":{"1min":0.74099999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.579,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.119,"15min":1.036},"min":{"1min":0.72799999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.583,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2450000000000001,"15min":1.2270000000000001},"min":{"1min":0.877,"5min":0.628,"15min":0.628},"max":{"1min":1.472,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.5840000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.2050000000000001,"15min":1.2070000000000001},"min":{"1min":0.81499999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.51,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.84099999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4690000000000001,"5min":1.792,"15min":1.792},"last":1.4259999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1359999999999999,"15min":1.165},"min":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.105},{"interface":"front","average":{"1min":1.373,"5min":1.3620000000000001,"15min":1.3440000000000001},"min":{"1min":1.04,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.6140000000000001,"5min":2.097,"15min":2.097},"last":1.6930000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.202,"15min":1.262},"min":{"1min":0.86699999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.635},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3779999999999999,"15min":1.415},"min":{"1min":0.95999999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8120000000000001,"5min":1.992,"15min":1.992},"last":1.9610000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.337,"15min":1.3620000000000001},"min":{"1min":1.077,"5min":0.63,"15min":0.63},"max":{"1min":1.5800000000000001,"5min":2.157,"15min":2.157},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.524,"5min":1.544,"15min":1.5880000000000001},"min":{"1min":1.2589999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.754,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":2.0659999999999998}]},{"osd":7,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.482,"15min":1.492},"min":{"1min":1.2350000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6930000000000001,"5min":2.202,"15min":2.202},"last":1.867},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.635,"15min":1.653},"min":{"1min":1.3069999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.9099999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":2.2229999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":489287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.88200000000000001,"15min":0.999},"min":{"1min":0.41799999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.226,"5min":3.641,"15min":3.641},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90800000000000003,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.474,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.1910000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.89400000000000002,"15min":0.93400000000000005},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.393,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0209999999999999,"15min":1.0960000000000001},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.246,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.80900000000000005}]},{"osd":2,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0449999999999999,"15min":1.1000000000000001},"min":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.8100000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.056,"15min":1.1140000000000001},"min":{"1min":0.53400000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5209999999999999,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.78600000000000003}]},{"osd":4,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.282,"15min":1.3300000000000001},"min":{"1min":0.94099999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7050000000000001,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.421},{"interface":"front","average":{"1min":1.248,"5min":1.2929999999999999,"15min":1.377},"min":{"1min":0.82099999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.679,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.087}]},{"osd":5,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.333,"15min":1.409},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.8129999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.23},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.3759999999999999,"15min":1.4570000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6399999999999999,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.292}]},{"osd":6,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.4279999999999999,"15min":1.514},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.7390000000000001,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.345},{"interface":"front","average":{"1min":1.327,"5min":1.417,"15min":1.4970000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.873,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.5860000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.458,"15min":1.5369999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0470000000000002,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":2.0169999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4319999999999999,"15min":1.482},"min":{"1min":1.008,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8320000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.272}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":477989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.86499999999999999,"15min":0.91800000000000004},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.585,"5min":1.972,"15min":1.972},"last":1.2749999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.89900000000000002,"15min":0.98699999999999999},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.23,"5min":1.522,"15min":1.522},"last":0.995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.97799999999999998},"min":{"1min":0.46899999999999997,"5min":0.442,"15min":0.442},"max":{"1min":1.486,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.96299999999999997}]},{"osd":3,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.91300000000000003,"15min":0.95099999999999996},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.1120000000000001,"5min":1.794,"15min":1.794},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.04,"15min":1.0900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.405,"5min":1.75,"15min":1.75},"last":1.1759999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.141,"15min":1.1950000000000001},"min":{"1min":0.69199999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.452,"5min":1.669,"15min":1.669},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.196,"5min":1.3080000000000001,"15min":1.3700000000000001},"min":{"1min":0.71199999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.796,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.9330000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.23,"15min":1.302},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4259999999999999,"5min":2.48,"15min":2.48},"last":1.23},{"interface":"front","average":{"1min":1.194,"5min":1.3600000000000001,"15min":1.4630000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.871,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.341}]},{"osd":6,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3340000000000001,"15min":1.371},"min":{"1min":0.80700000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0510000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":2.0179999999999998},{"interface":"front","average":{"1min":1.212,"5min":1.395,"15min":1.5049999999999999},"min":{"1min":0.78000000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.96,"5min":3.302,"15min":3.302},"last":1.496}]},{"osd":7,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.385,"15min":1.4710000000000001},"min":{"1min":0.79200000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.944,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":2.157},{"interface":"front","average":{"1min":1.163,"5min":1.3340000000000001,"15min":1.448},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.593,"5min":2.73,"15min":2.73},"last":1.968}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":477955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.304,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.371}]},{"osd":2,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":0.96399999999999997},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.169,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0229999999999999,"15min":1.0409999999999999},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5309999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.242}]},{"osd":3,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0389999999999999,"15min":1.03},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4910000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.337},{"interface":"front","average":{"1min":0.85199999999999998,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.258,"5min":2.044,"15min":2.044},"last":0.88300000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.9410000000000001,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3520000000000001,"15min":1.3500000000000001},"min":{"1min":0.82199999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.831,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.5129999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.264,"15min":1.238},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.4750000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.296},{"interface":"front","average":{"1min":1.131,"5min":1.256,"15min":1.2350000000000001},"min":{"1min":0.80700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7769999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.03}]},{"osd":6,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3420000000000001,"15min":1.3200000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7529999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.327,"15min":1.351},"min":{"1min":0.83199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.877,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.97599999999999998}]},{"osd":7,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.427,"15min":1.462},"min":{"1min":0.91800000000000004,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.7370000000000001,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.583},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.665,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.4730000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1650688,"data_stored":1068767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.2909999999999999,"5min":1.901,"15min":1.901},"last":0.63},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88,"15min":0.85099999999999998},"min":{"1min":0.51600000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2390000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.01}]},{"osd":2,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89700000000000002,"15min":0.84999999999999998},"min":{"1min":0.46700000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.96899999999999997,"15min":0.95899999999999996},"min":{"1min":0.44700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.855,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.91200000000000003,"15min":0.89600000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.526,"5min":1.875,"15min":1.875},"last":1.135},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.083,"15min":1.0600000000000001},"min":{"1min":0.59699999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.6519999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.88200000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.24,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5229999999999999,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.194},"min":{"1min":0.67400000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7629999999999999,"5min":2.391,"15min":2.391},"last":1.6599999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.335,"15min":1.3500000000000001},"min":{"1min":0.78400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.9350000000000001,"5min":3.028,"15min":3.028},"last":1.099},{"interface":"front","average":{"1min":1.21,"5min":1.302,"15min":1.306},"min":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7629999999999999,"5min":2.718,"15min":2.718},"last":1.252}]},{"osd":6,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.272,"15min":1.3},"min":{"1min":0.78100000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5069999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.7989999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.4039999999999999,"15min":1.4179999999999999},"min":{"1min":0.996,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.837,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.204}]},{"osd":7,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3420000000000001,"15min":1.351},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.756,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3340000000000001,"15min":1.3520000000000001},"min":{"1min":0.78800000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.673,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.895}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:46:13.209 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:46:13.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.413+0000 7f4bd66d3640 1 Processor -- start 2023-11-27T20:46:13.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.413+0000 7f4bd66d3640 1 -- start start 2023-11-27T20:46:13.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.414+0000 7f4bd66d3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4bd00c5ec0 0x7f4bd00c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.414+0000 7f4bd66d3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4bd00c45d0 0x7f4bd00c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.415+0000 7f4bd66d3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd00bfdc0 con 0x7f4bd00721a0 2023-11-27T20:46:13.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.415+0000 7f4bd66d3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd006e390 con 0x7f4bd00c45d0 2023-11-27T20:46:13.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.415+0000 7f4bd66d3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd006ddd0 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.415+0000 7f4bcf7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4bd00c45d0 0x7f4bd00c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:13.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.415+0000 7f4bcf7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4bd00c45d0 0x7f4bd00c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57952/0 (socket says 172.21.15.91:57952) 2023-11-27T20:46:13.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.415+0000 7f4bcf7fe640 1 -- 172.21.15.91:0/615437719 learned_addr learned my addr 172.21.15.91:0/615437719 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:13.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.415+0000 7f4bcffff640 1 --2- 172.21.15.91:0/615437719 >> v2:172.21.15.183:3300/0 conn(0x7f4bd00c5ec0 0x7f4bd00c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:13.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.416+0000 7f4bcf7fe640 1 -- 172.21.15.91:0/615437719 >> v2:172.21.15.183:3300/0 conn(0x7f4bd00c5ec0 msgr2=0x7f4bd00c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:13.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.416+0000 7f4bcf7fe640 1 --2- 172.21.15.91:0/615437719 >> v2:172.21.15.183:3300/0 conn(0x7f4bd00c5ec0 0x7f4bd00c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.416+0000 7f4bcf7fe640 1 -- 172.21.15.91:0/615437719 >> v1:172.21.15.183:6789/0 conn(0x7f4bd00721a0 legacy=0x7f4bd0155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.416+0000 7f4bcf7fe640 1 -- 172.21.15.91:0/615437719 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd006e0b0 con 0x7f4bd00c45d0 2023-11-27T20:46:13.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.416+0000 7f4bcffff640 1 --2- 172.21.15.91:0/615437719 >> v2:172.21.15.183:3300/0 conn(0x7f4bd00c5ec0 0x7f4bd00c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:46:13.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.417+0000 7f4bcf7fe640 1 --2- 172.21.15.91:0/615437719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c45d0 0x7f4bd00c3170 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f4bd006b250 tx=0x7f4bb802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6cff685c37c360 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:13.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.417+0000 7f4bceffd640 1 -- 172.21.15.91:0/615437719 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb802c9f0 con 0x7f4bd00c45d0 2023-11-27T20:46:13.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.417+0000 7f4bceffd640 1 -- 172.21.15.91:0/615437719 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb802cb50 con 0x7f4bd00c45d0 2023-11-27T20:46:13.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.417+0000 7f4bceffd640 1 -- 172.21.15.91:0/615437719 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb80343f0 con 0x7f4bd00c45d0 2023-11-27T20:46:13.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.418+0000 7f4bd66d3640 1 -- 172.21.15.91:0/615437719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c45d0 msgr2=0x7f4bd00c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.418+0000 7f4bd66d3640 1 --2- 172.21.15.91:0/615437719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c45d0 0x7f4bd00c3170 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f4bd006b250 tx=0x7f4bb802be50 comp rx=0 tx=0).stop 2023-11-27T20:46:13.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.418+0000 7f4bd66d3640 1 -- 172.21.15.91:0/615437719 shutdown_connections 2023-11-27T20:46:13.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.418+0000 7f4bd66d3640 1 --2- 172.21.15.91:0/615437719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c45d0 0x7f4bd00c3170 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.418+0000 7f4bd66d3640 1 --2- 172.21.15.91:0/615437719 >> v2:172.21.15.183:3300/0 conn(0x7f4bd00c5ec0 0x7f4bd00c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.418+0000 7f4bd66d3640 1 -- 172.21.15.91:0/615437719 >> 172.21.15.91:0/615437719 conn(0x7f4bd006a500 msgr2=0x7f4bd006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:13.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.418+0000 7f4bd66d3640 1 -- 172.21.15.91:0/615437719 shutdown_connections 2023-11-27T20:46:13.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.418+0000 7f4bd66d3640 1 -- 172.21.15.91:0/615437719 wait complete. 2023-11-27T20:46:13.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.420+0000 7f4bd66d3640 1 Processor -- start 2023-11-27T20:46:13.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.420+0000 7f4bd66d3640 1 -- start start 2023-11-27T20:46:13.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd66d3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bd00721a0 0x7f4bd014c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd66d3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bd00c45d0 0x7f4bd014eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd66d3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c5ec0 0x7f4bd00a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd66d3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd01e7bc0 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd66d3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00a7aa0 con 0x7f4bd00721a0 2023-11-27T20:46:13.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd66d3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd014b440 con 0x7f4bd00c45d0 2023-11-27T20:46:13.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd4c70640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c5ec0 0x7f4bd00a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:13.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd4c70640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c5ec0 0x7f4bd00a7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57954/0 (socket says 172.21.15.91:57954) 2023-11-27T20:46:13.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd4c70640 1 -- 172.21.15.91:0/3054450587 learned_addr learned my addr 172.21.15.91:0/3054450587 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:13.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bcf7fe640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bd00c45d0 0x7f4bd014eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:13.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bcffff640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bd00721a0 0x7f4bd014c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:13.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd4c70640 1 -- 172.21.15.91:0/3054450587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bd00c45d0 msgr2=0x7f4bd014eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd4c70640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bd00c45d0 0x7f4bd014eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd4c70640 1 -- 172.21.15.91:0/3054450587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bd00721a0 msgr2=0x7f4bd014c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd4c70640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bd00721a0 0x7f4bd014c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bd4c70640 1 -- 172.21.15.91:0/3054450587 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8009b30 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.421+0000 7f4bcf7fe640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bd00c45d0 0x7f4bd014eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.422+0000 7f4bd4c70640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c5ec0 0x7f4bd00a7f30 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8001eb0 tx=0x7f4bc800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.422+0000 7f4bccff9640 1 -- 172.21.15.91:0/3054450587 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80052d0 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.422+0000 7f4bccff9640 1 -- 172.21.15.91:0/3054450587 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8005430 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.422+0000 7f4bd66d3640 1 -- 172.21.15.91:0/3054450587 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd014b720 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.422+0000 7f4bccff9640 1 -- 172.21.15.91:0/3054450587 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8003810 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.422+0000 7f4bd66d3640 1 -- 172.21.15.91:0/3054450587 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd014f2e0 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.423+0000 7f4bd66d3640 1 -- 172.21.15.91:0/3054450587 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd014bc40 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.424+0000 7f4bccff9640 1 -- 172.21.15.91:0/3054450587 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4bc8003970 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.425+0000 7f4bccff9640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4bb006b1f0 0x7f4bb006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.425+0000 7f4bccff9640 1 -- 172.21.15.91:0/3054450587 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4bc8088c70 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.425+0000 7f4bcffff640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4bb006b1f0 0x7f4bb006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:13.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.426+0000 7f4bcffff640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4bb006b1f0 0x7f4bb006d6b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00096d0 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:13.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.430+0000 7f4bccff9640 1 -- 172.21.15.91:0/3054450587 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4bd014bc40 con 0x7f4bd00c5ec0 2023-11-27T20:46:13.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.621+0000 7f4bd66d3640 1 -- 172.21.15.91:0/3054450587 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4bd006d800 con 0x7f4bb006b1f0 2023-11-27T20:46:13.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.627+0000 7f4bccff9640 1 -- 172.21.15.91:0/3054450587 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48434 (secure 0 0 0) 0x7f4bd006d800 con 0x7f4bb006b1f0 2023-11-27T20:46:13.629 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:13.629 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:46:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 -- 172.21.15.91:0/3054450587 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4bb006b1f0 msgr2=0x7f4bb006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4bb006b1f0 0x7f4bb006d6b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00096d0 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2023-11-27T20:46:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 -- 172.21.15.91:0/3054450587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c5ec0 msgr2=0x7f4bd00a7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c5ec0 0x7f4bd00a7f30 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8001eb0 tx=0x7f4bc800c890 comp rx=0 tx=0).stop 2023-11-27T20:46:13.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 -- 172.21.15.91:0/3054450587 shutdown_connections 2023-11-27T20:46:13.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4bd00c5ec0 0x7f4bd00a7f30 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bd00c45d0 0x7f4bd014eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f4bb006b1f0 0x7f4bb006d6b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 --2- 172.21.15.91:0/3054450587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bd00721a0 0x7f4bd014c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 -- 172.21.15.91:0/3054450587 >> 172.21.15.91:0/3054450587 conn(0x7f4bd006a500 msgr2=0x7f4bd00c1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:13.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 -- 172.21.15.91:0/3054450587 shutdown_connections 2023-11-27T20:46:13.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.630+0000 7f4bd66d3640 1 -- 172.21.15.91:0/3054450587 wait complete. 2023-11-27T20:46:13.651 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2023-11-27T20:46:13.468980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":258988,"kb_used_data":9540,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715732,"statfs":{"total":773094113280,"available":772828909568,"internally_reserved":0,"allocated":9768960,"data_stored":5062644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.329517"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-27T20:46:06.395474+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:46:06.395474+0000","last_peered":"2023-11-27T20:46:06.395474+0000","last_clean":"2023-11-27T20:46:06.395474+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:46:06.395474+0000","last_undegraded":"2023-11-27T20:46:06.395474+0000","last_fullsized":"2023-11-27T20:46:06.395474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1662976,"data_stored":1074278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.121,"15min":1.151},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.635,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.415},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.22,"15min":1.234},"min":{"1min":0.82299999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7430000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.93400000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.167,"15min":1.2170000000000001},"min":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.657},{"interface":"front","average":{"1min":1.159,"5min":1.1719999999999999,"15min":1.2110000000000001},"min":{"1min":0.68999999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.81100000000000005}]},{"osd":2,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.198,"15min":1.28},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8360000000000001,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2030000000000001,"15min":1.244},"min":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3200000000000001,"5min":1.909,"15min":1.909},"last":1.2170000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3089999999999999,"15min":1.379},"min":{"1min":0.91500000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.9930000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4039999999999999,"15min":1.474},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8400000000000001,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.5800000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3420000000000001,"15min":1.3999999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.036},{"interface":"front","average":{"1min":1.351,"5min":1.4339999999999999,"15min":1.5680000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.105,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.3380000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4350000000000001,"15min":1.4910000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":1.71},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.502,"15min":1.5720000000000001},"min":{"1min":0.626,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.1720000000000002,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.5289999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.609,"15min":1.661},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6020000000000001,"15min":1.6759999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":6.2190000000000003,"5min":6.2190000000000003,"15min":6.2190000000000003},"last":1.4770000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1069056,"data_stored":483910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.198,"15min":1.262},"min":{"1min":0.67300000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7130000000000001,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.244,"15min":1.3100000000000001},"min":{"1min":0.81999999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.613,"5min":2.581,"15min":2.581},"last":1.466}]},{"osd":1,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1879999999999999,"15min":1.2549999999999999},"min":{"1min":0.65700000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6060000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.127,"15min":1.159},"min":{"1min":0.77400000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.798,"5min":2.823,"15min":2.823},"last":1.288}]},{"osd":2,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.073,"15min":1.0800000000000001},"min":{"1min":0.76100000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.573,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.173,"5min":1.2789999999999999,"15min":1.373},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.8720000000000001,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.5009999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.268,"15min":1.3600000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.77,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.214},{"interface":"front","average":{"1min":1.327,"5min":1.2989999999999999,"15min":1.3420000000000001},"min":{"1min":0.97099999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8149999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2450000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4710000000000001,"15min":1.587},"min":{"1min":0.84999999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.9470000000000001,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.615},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.512,"15min":1.6259999999999999},"min":{"1min":0.84099999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.863,"5min":3.536,"15min":3.536},"last":1.5900000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3500000000000001,"15min":1.3939999999999999},"min":{"1min":0.98499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7,"5min":2.355,"15min":2.355},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.536,"15min":1.6419999999999999},"min":{"1min":1.0900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.76,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.5589999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.5289999999999999,"15min":1.651},"min":{"1min":1.238,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9550000000000001,"5min":3.645,"15min":3.645},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5149999999999999,"15min":1.571},"min":{"1min":1.2290000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6910000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.5249999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":477887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0840000000000001,"15min":1.145},"min":{"1min":0.63,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.361,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.173},"min":{"1min":0.79000000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.47,"5min":2.04,"15min":2.04},"last":0.92600000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1459999999999999,"15min":1.1930000000000001},"min":{"1min":0.68999999999999995,"5min":0.379,"15min":0.379},"max":{"1min":1.6479999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.1659999999999999,"15min":1.169},"min":{"1min":0.93100000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5580000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.28}]},{"osd":2,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2150000000000001,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.621,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.157,"15min":1.2010000000000001},"min":{"1min":0.72899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.599,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.0049999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.321,"15min":1.3839999999999999},"min":{"1min":0.89700000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7270000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.3069999999999999,"15min":1.429},"min":{"1min":0.66400000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.52,"5min":4.016,"15min":4.016},"last":1.091}]},{"osd":4,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.256,"15min":1.3580000000000001},"min":{"1min":0.69799999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5529999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.115},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.462,"15min":1.593},"min":{"1min":0.72399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.855,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.044}]},{"osd":6,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.452,"15min":1.6160000000000001},"min":{"1min":0.72999999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.756,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.476},{"interface":"front","average":{"1min":1.329,"5min":1.4630000000000001,"15min":1.575},"min":{"1min":0.76200000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.764,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.4059999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.536,"15min":1.6479999999999999},"min":{"1min":0.83299999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.99,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.554,"15min":1.708},"min":{"1min":0.86799999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.915,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.5349999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":489389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0229999999999999,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.997},{"interface":"front","average":{"1min":1.089,"5min":1.109,"15min":1.0900000000000001},"min":{"1min":0.74099999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.579,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.119,"15min":1.036},"min":{"1min":0.72799999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.583,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2450000000000001,"15min":1.2270000000000001},"min":{"1min":0.877,"5min":0.628,"15min":0.628},"max":{"1min":1.472,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.5840000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.2050000000000001,"15min":1.2070000000000001},"min":{"1min":0.81499999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.51,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.84099999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4690000000000001,"5min":1.792,"15min":1.792},"last":1.4259999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1359999999999999,"15min":1.165},"min":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.105},{"interface":"front","average":{"1min":1.373,"5min":1.3620000000000001,"15min":1.3440000000000001},"min":{"1min":1.04,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.6140000000000001,"5min":2.097,"15min":2.097},"last":1.6930000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.202,"15min":1.262},"min":{"1min":0.86699999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.635},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3779999999999999,"15min":1.415},"min":{"1min":0.95999999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8120000000000001,"5min":1.992,"15min":1.992},"last":1.9610000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.337,"15min":1.3620000000000001},"min":{"1min":1.077,"5min":0.63,"15min":0.63},"max":{"1min":1.5800000000000001,"5min":2.157,"15min":2.157},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.524,"5min":1.544,"15min":1.5880000000000001},"min":{"1min":1.2589999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.754,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":2.0659999999999998}]},{"osd":7,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.482,"15min":1.492},"min":{"1min":1.2350000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6930000000000001,"5min":2.202,"15min":2.202},"last":1.867},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.635,"15min":1.653},"min":{"1min":1.3069999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.9099999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":2.2229999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":489287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.88200000000000001,"15min":0.999},"min":{"1min":0.41799999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.226,"5min":3.641,"15min":3.641},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90800000000000003,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.474,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.1910000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.89400000000000002,"15min":0.93400000000000005},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.393,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0209999999999999,"15min":1.0960000000000001},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.246,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.80900000000000005}]},{"osd":2,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0449999999999999,"15min":1.1000000000000001},"min":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.8100000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.056,"15min":1.1140000000000001},"min":{"1min":0.53400000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5209999999999999,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.78600000000000003}]},{"osd":4,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.282,"15min":1.3300000000000001},"min":{"1min":0.94099999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7050000000000001,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.421},{"interface":"front","average":{"1min":1.248,"5min":1.2929999999999999,"15min":1.377},"min":{"1min":0.82099999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.679,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.087}]},{"osd":5,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.333,"15min":1.409},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.8129999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.23},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.3759999999999999,"15min":1.4570000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6399999999999999,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.292}]},{"osd":6,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.4279999999999999,"15min":1.514},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.7390000000000001,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.345},{"interface":"front","average":{"1min":1.327,"5min":1.417,"15min":1.4970000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.873,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.5860000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.458,"15min":1.5369999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0470000000000002,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":2.0169999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4319999999999999,"15min":1.482},"min":{"1min":1.008,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8320000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.272}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.746},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.86499999999999999,"15min":0.91800000000000004},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.585,"5min":1.972,"15min":1.972},"last":0.84999999999999998}]},{"osd":1,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.89900000000000002,"15min":0.98699999999999999},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.23,"5min":1.522,"15min":1.522},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.97799999999999998},"min":{"1min":0.46899999999999997,"5min":0.442,"15min":0.442},"max":{"1min":1.486,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.78200000000000003}]},{"osd":3,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.91300000000000003,"15min":0.95099999999999996},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.1120000000000001,"5min":1.794,"15min":1.794},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.04,"15min":1.0900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.405,"5min":1.75,"15min":1.75},"last":0.71799999999999997}]},{"osd":4,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.141,"15min":1.1950000000000001},"min":{"1min":0.69199999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.452,"5min":1.669,"15min":1.669},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.3080000000000001,"15min":1.3700000000000001},"min":{"1min":0.71199999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.796,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.0469999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.23,"15min":1.302},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4259999999999999,"5min":2.48,"15min":2.48},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.3600000000000001,"15min":1.4630000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.871,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.296}]},{"osd":6,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3340000000000001,"15min":1.371},"min":{"1min":0.80700000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0510000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.101},{"interface":"front","average":{"1min":1.212,"5min":1.395,"15min":1.5049999999999999},"min":{"1min":0.78000000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.96,"5min":3.302,"15min":3.302},"last":1.218}]},{"osd":7,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.385,"15min":1.4710000000000001},"min":{"1min":0.79200000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.944,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.3340000000000001,"15min":1.448},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.593,"5min":2.73,"15min":2.73},"last":1.2470000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.304,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0609999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":0.96399999999999997},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.169,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0229999999999999,"15min":1.0409999999999999},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5309999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0389999999999999,"15min":1.03},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4910000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.629},{"interface":"front","average":{"1min":0.85199999999999998,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.258,"5min":2.044,"15min":2.044},"last":0.83599999999999997}]},{"osd":4,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.9410000000000001,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.216},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3520000000000001,"15min":1.3500000000000001},"min":{"1min":0.82199999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.831,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.91300000000000003}]},{"osd":5,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.264,"15min":1.238},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.4750000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.367},{"interface":"front","average":{"1min":1.131,"5min":1.256,"15min":1.2350000000000001},"min":{"1min":0.80700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7769999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.097}]},{"osd":6,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3420000000000001,"15min":1.3200000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7529999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.327,"15min":1.351},"min":{"1min":0.83199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.877,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.2669999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.427,"15min":1.462},"min":{"1min":0.91800000000000004,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.7370000000000001,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.665,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.4139999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1650688,"data_stored":1068767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.2909999999999999,"5min":1.901,"15min":1.901},"last":0.63},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88,"15min":0.85099999999999998},"min":{"1min":0.51600000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2390000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.01}]},{"osd":2,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89700000000000002,"15min":0.84999999999999998},"min":{"1min":0.46700000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.96899999999999997,"15min":0.95899999999999996},"min":{"1min":0.44700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.855,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.91200000000000003,"15min":0.89600000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.526,"5min":1.875,"15min":1.875},"last":1.135},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.083,"15min":1.0600000000000001},"min":{"1min":0.59699999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.6519999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.88200000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.24,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5229999999999999,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.194},"min":{"1min":0.67400000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7629999999999999,"5min":2.391,"15min":2.391},"last":1.6599999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.335,"15min":1.3500000000000001},"min":{"1min":0.78400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.9350000000000001,"5min":3.028,"15min":3.028},"last":1.099},{"interface":"front","average":{"1min":1.21,"5min":1.302,"15min":1.306},"min":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7629999999999999,"5min":2.718,"15min":2.718},"last":1.252}]},{"osd":6,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.272,"15min":1.3},"min":{"1min":0.78100000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5069999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.7989999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.4039999999999999,"15min":1.4179999999999999},"min":{"1min":0.996,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.837,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.204}]},{"osd":7,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3420000000000001,"15min":1.351},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.756,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3340000000000001,"15min":1.3520000000000001},"min":{"1min":0.78800000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.673,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.895}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:46:13.652 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-27T20:46:13.653 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:46:13.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.865+0000 7fd6f7325640 1 Processor -- start 2023-11-27T20:46:13.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.865+0000 7fd6f7325640 1 -- start start 2023-11-27T20:46:13.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.866+0000 7fd6f7325640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd6f014fd30 0x7fd6f0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.866+0000 7fd6f7325640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6f006d0a0 0x7fd6f00a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.866+0000 7fd6f7325640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f00c64a0 con 0x7fd6f00a5260 2023-11-27T20:46:13.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.867+0000 7fd6f7325640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f00c5c00 con 0x7fd6f014fd30 2023-11-27T20:46:13.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.867+0000 7fd6f7325640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00c5ee0 con 0x7fd6f006d0a0 2023-11-27T20:46:13.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.867+0000 7fd6f50c1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd6f014fd30 0x7fd6f0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:13.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.867+0000 7fd6f50c1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd6f014fd30 0x7fd6f0152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55396/0 (socket says 172.21.15.91:55396) 2023-11-27T20:46:13.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.867+0000 7fd6f50c1640 1 -- 172.21.15.91:0/1632247748 learned_addr learned my addr 172.21.15.91:0/1632247748 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:13.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.867+0000 7fd6f50c1640 1 -- 172.21.15.91:0/1632247748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6f006d0a0 msgr2=0x7fd6f00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:13.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.867+0000 7fd6f50c1640 1 --2- 172.21.15.91:0/1632247748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6f006d0a0 0x7fd6f00a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.867+0000 7fd6f50c1640 1 -- 172.21.15.91:0/1632247748 >> v1:172.21.15.91:6789/0 conn(0x7fd6f00a5260 legacy=0x7fd6f00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.867+0000 7fd6f50c1640 1 -- 172.21.15.91:0/1632247748 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00c61c0 con 0x7fd6f014fd30 2023-11-27T20:46:13.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.867+0000 7fd6e7fff640 1 -- 172.21.15.91:0/1632247748 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022460934 0 0) 0x7fd6f00c64a0 con 0x7fd6f00a5260 2023-11-27T20:46:13.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.868+0000 7fd6f50c1640 1 --2- 172.21.15.91:0/1632247748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f014fd30 0x7fd6f0152f20 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009870 tx=0x7fd6ec02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6212ce2ffb3309 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:13.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.869+0000 7fd6e7fff640 1 -- 172.21.15.91:0/1632247748 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec030840 con 0x7fd6f014fd30 2023-11-27T20:46:13.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.869+0000 7fd6e7fff640 1 -- 172.21.15.91:0/1632247748 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec0309a0 con 0x7fd6f014fd30 2023-11-27T20:46:13.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.869+0000 7fd6e7fff640 1 -- 172.21.15.91:0/1632247748 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec030d30 con 0x7fd6f014fd30 2023-11-27T20:46:13.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.869+0000 7fd6f7325640 1 -- 172.21.15.91:0/1632247748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f014fd30 msgr2=0x7fd6f0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.869+0000 7fd6f7325640 1 --2- 172.21.15.91:0/1632247748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f014fd30 0x7fd6f0152f20 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009870 tx=0x7fd6ec02b980 comp rx=0 tx=0).stop 2023-11-27T20:46:13.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.870+0000 7fd6f7325640 1 -- 172.21.15.91:0/1632247748 shutdown_connections 2023-11-27T20:46:13.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.870+0000 7fd6f7325640 1 --2- 172.21.15.91:0/1632247748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6f006d0a0 0x7fd6f00a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.870+0000 7fd6f7325640 1 --2- 172.21.15.91:0/1632247748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f014fd30 0x7fd6f0152f20 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.870+0000 7fd6f7325640 1 -- 172.21.15.91:0/1632247748 >> 172.21.15.91:0/1632247748 conn(0x7fd6f006a500 msgr2=0x7fd6f006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:13.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.870+0000 7fd6f7325640 1 -- 172.21.15.91:0/1632247748 shutdown_connections 2023-11-27T20:46:13.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.870+0000 7fd6f7325640 1 -- 172.21.15.91:0/1632247748 wait complete. 2023-11-27T20:46:13.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.871+0000 7fd6f7325640 1 Processor -- start 2023-11-27T20:46:13.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.871+0000 7fd6f7325640 1 -- start start 2023-11-27T20:46:13.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.872+0000 7fd6f7325640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6f006d0a0 0x7fd6f0156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.872+0000 7fd6f7325640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f00a5260 0x7fd6f0099c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.872+0000 7fd6f7325640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6f014fd30 0x7fd6f014f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.872+0000 7fd6f7325640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0071a70 con 0x7fd6f00a5260 2023-11-27T20:46:13.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.872+0000 7fd6f7325640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f009a4c0 con 0x7fd6f014fd30 2023-11-27T20:46:13.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.872+0000 7fd6f7325640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01eb100 con 0x7fd6f006d0a0 2023-11-27T20:46:13.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.872+0000 7fd6f48c0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f00a5260 0x7fd6f0099c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:13.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.873+0000 7fd6f48c0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f00a5260 0x7fd6f0099c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55402/0 (socket says 172.21.15.91:55402) 2023-11-27T20:46:13.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.873+0000 7fd6f48c0640 1 -- 172.21.15.91:0/2663781991 learned_addr learned my addr 172.21.15.91:0/2663781991 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:13.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.873+0000 7fd6f48c0640 1 -- 172.21.15.91:0/2663781991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6f006d0a0 msgr2=0x7fd6f0156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.873+0000 7fd6f48c0640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6f006d0a0 0x7fd6f0156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.873+0000 7fd6f48c0640 1 -- 172.21.15.91:0/2663781991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6f014fd30 msgr2=0x7fd6f014f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:13.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.873+0000 7fd6f58c2640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6f014fd30 0x7fd6f014f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:13.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.873+0000 7fd6f48c0640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6f014fd30 0x7fd6f014f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:13.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.873+0000 7fd6f48c0640 1 -- 172.21.15.91:0/2663781991 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0094d0 con 0x7fd6f00a5260 2023-11-27T20:46:13.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.873+0000 7fd6f48c0640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f00a5260 0x7fd6f0099c70 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000b450 tx=0x7fd6e000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:13.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.874+0000 7fd6e5ffb640 1 -- 172.21.15.91:0/2663781991 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0011890 con 0x7fd6f00a5260 2023-11-27T20:46:13.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.874+0000 7fd6e5ffb640 1 -- 172.21.15.91:0/2663781991 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e00119f0 con 0x7fd6f00a5260 2023-11-27T20:46:13.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.874+0000 7fd6e5ffb640 1 -- 172.21.15.91:0/2663781991 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0011da0 con 0x7fd6f00a5260 2023-11-27T20:46:13.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.874+0000 7fd6f7325640 1 -- 172.21.15.91:0/2663781991 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f01eb3e0 con 0x7fd6f00a5260 2023-11-27T20:46:13.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.874+0000 7fd6f7325640 1 -- 172.21.15.91:0/2663781991 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f01eb9a0 con 0x7fd6f00a5260 2023-11-27T20:46:13.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.875+0000 7fd6f7325640 1 -- 172.21.15.91:0/2663781991 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f0068350 con 0x7fd6f00a5260 2023-11-27T20:46:13.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.876+0000 7fd6e5ffb640 1 -- 172.21.15.91:0/2663781991 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd6e001a400 con 0x7fd6f00a5260 2023-11-27T20:46:13.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.877+0000 7fd6e5ffb640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd6d406b1c0 0x7fd6d406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:13.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.877+0000 7fd6e5ffb640 1 -- 172.21.15.91:0/2663781991 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd6e0089c80 con 0x7fd6f00a5260 2023-11-27T20:46:13.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.877+0000 7fd6f50c1640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd6d406b1c0 0x7fd6d406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:13.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.878+0000 7fd6f50c1640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd6d406b1c0 0x7fd6d406d680 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec036000 tx=0x7fd6ec03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:13.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:13.882+0000 7fd6e5ffb640 1 -- 172.21.15.91:0/2663781991 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd6e0054b20 con 0x7fd6f00a5260 2023-11-27T20:46:14.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.068+0000 7fd6f7325640 1 -- 172.21.15.91:0/2663781991 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6f00c04b0 con 0x7fd6d406b1c0 2023-11-27T20:46:14.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.071+0000 7fd6e5ffb640 1 -- 172.21.15.91:0/2663781991 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48434 (secure 0 0 0) 0x7fd6f00c04b0 con 0x7fd6d406b1c0 2023-11-27T20:46:14.074 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:14.075 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:46:14.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 -- 172.21.15.91:0/2663781991 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd6d406b1c0 msgr2=0x7fd6d406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:14.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd6d406b1c0 0x7fd6d406d680 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec036000 tx=0x7fd6ec03b040 comp rx=0 tx=0).stop 2023-11-27T20:46:14.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 -- 172.21.15.91:0/2663781991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f00a5260 msgr2=0x7fd6f0099c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:14.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f00a5260 0x7fd6f0099c70 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000b450 tx=0x7fd6e000b910 comp rx=0 tx=0).stop 2023-11-27T20:46:14.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 -- 172.21.15.91:0/2663781991 shutdown_connections 2023-11-27T20:46:14.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd6d406b1c0 0x7fd6d406d680 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6f014fd30 0x7fd6f014f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6f00a5260 0x7fd6f0099c70 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 --2- 172.21.15.91:0/2663781991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6f006d0a0 0x7fd6f0156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 -- 172.21.15.91:0/2663781991 >> 172.21.15.91:0/2663781991 conn(0x7fd6f006a500 msgr2=0x7fd6f00c28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:14.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.074+0000 7fd6f7325640 1 -- 172.21.15.91:0/2663781991 shutdown_connections 2023-11-27T20:46:14.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.075+0000 7fd6f7325640 1 -- 172.21.15.91:0/2663781991 wait complete. 2023-11-27T20:46:14.094 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2023-11-27T20:46:13.468980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":258988,"kb_used_data":9540,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715732,"statfs":{"total":773094113280,"available":772828909568,"internally_reserved":0,"allocated":9768960,"data_stored":5062644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.329517"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-27T20:46:06.395474+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:46:06.395474+0000","last_peered":"2023-11-27T20:46:06.395474+0000","last_clean":"2023-11-27T20:46:06.395474+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:46:06.395474+0000","last_undegraded":"2023-11-27T20:46:06.395474+0000","last_fullsized":"2023-11-27T20:46:06.395474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1662976,"data_stored":1074278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.121,"15min":1.151},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.635,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.415},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.22,"15min":1.234},"min":{"1min":0.82299999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7430000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.93400000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.167,"15min":1.2170000000000001},"min":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.657},{"interface":"front","average":{"1min":1.159,"5min":1.1719999999999999,"15min":1.2110000000000001},"min":{"1min":0.68999999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.81100000000000005}]},{"osd":2,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.198,"15min":1.28},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8360000000000001,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2030000000000001,"15min":1.244},"min":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3200000000000001,"5min":1.909,"15min":1.909},"last":1.2170000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3089999999999999,"15min":1.379},"min":{"1min":0.91500000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.9930000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4039999999999999,"15min":1.474},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8400000000000001,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.5800000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3420000000000001,"15min":1.3999999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.036},{"interface":"front","average":{"1min":1.351,"5min":1.4339999999999999,"15min":1.5680000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.105,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.3380000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4350000000000001,"15min":1.4910000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":1.71},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.502,"15min":1.5720000000000001},"min":{"1min":0.626,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.1720000000000002,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.5289999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.609,"15min":1.661},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6020000000000001,"15min":1.6759999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":6.2190000000000003,"5min":6.2190000000000003,"15min":6.2190000000000003},"last":1.4770000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1069056,"data_stored":483910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.198,"15min":1.262},"min":{"1min":0.67300000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7130000000000001,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.244,"15min":1.3100000000000001},"min":{"1min":0.81999999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.613,"5min":2.581,"15min":2.581},"last":1.466}]},{"osd":1,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1879999999999999,"15min":1.2549999999999999},"min":{"1min":0.65700000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6060000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.127,"15min":1.159},"min":{"1min":0.77400000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.798,"5min":2.823,"15min":2.823},"last":1.288}]},{"osd":2,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.073,"15min":1.0800000000000001},"min":{"1min":0.76100000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.573,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.173,"5min":1.2789999999999999,"15min":1.373},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.8720000000000001,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.5009999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.268,"15min":1.3600000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.77,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.214},{"interface":"front","average":{"1min":1.327,"5min":1.2989999999999999,"15min":1.3420000000000001},"min":{"1min":0.97099999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8149999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2450000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4710000000000001,"15min":1.587},"min":{"1min":0.84999999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.9470000000000001,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.615},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.512,"15min":1.6259999999999999},"min":{"1min":0.84099999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.863,"5min":3.536,"15min":3.536},"last":1.5900000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3500000000000001,"15min":1.3939999999999999},"min":{"1min":0.98499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7,"5min":2.355,"15min":2.355},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.536,"15min":1.6419999999999999},"min":{"1min":1.0900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.76,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.5589999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.5289999999999999,"15min":1.651},"min":{"1min":1.238,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9550000000000001,"5min":3.645,"15min":3.645},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5149999999999999,"15min":1.571},"min":{"1min":1.2290000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6910000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.5249999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":477887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0840000000000001,"15min":1.145},"min":{"1min":0.63,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.361,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.173},"min":{"1min":0.79000000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.47,"5min":2.04,"15min":2.04},"last":0.92600000000000005}]},{"osd":1,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1459999999999999,"15min":1.1930000000000001},"min":{"1min":0.68999999999999995,"5min":0.379,"15min":0.379},"max":{"1min":1.6479999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.1659999999999999,"15min":1.169},"min":{"1min":0.93100000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5580000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.28}]},{"osd":2,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2150000000000001,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.621,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.157,"15min":1.2010000000000001},"min":{"1min":0.72899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.599,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.0049999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.321,"15min":1.3839999999999999},"min":{"1min":0.89700000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7270000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.3069999999999999,"15min":1.429},"min":{"1min":0.66400000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.52,"5min":4.016,"15min":4.016},"last":1.091}]},{"osd":4,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.256,"15min":1.3580000000000001},"min":{"1min":0.69799999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5529999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.115},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.462,"15min":1.593},"min":{"1min":0.72399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.855,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.044}]},{"osd":6,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.452,"15min":1.6160000000000001},"min":{"1min":0.72999999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.756,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.476},{"interface":"front","average":{"1min":1.329,"5min":1.4630000000000001,"15min":1.575},"min":{"1min":0.76200000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.764,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.4059999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.536,"15min":1.6479999999999999},"min":{"1min":0.83299999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.99,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.554,"15min":1.708},"min":{"1min":0.86799999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.915,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.5349999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":489389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0229999999999999,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.997},{"interface":"front","average":{"1min":1.089,"5min":1.109,"15min":1.0900000000000001},"min":{"1min":0.74099999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.579,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.119,"15min":1.036},"min":{"1min":0.72799999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.583,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2450000000000001,"15min":1.2270000000000001},"min":{"1min":0.877,"5min":0.628,"15min":0.628},"max":{"1min":1.472,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.5840000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.2050000000000001,"15min":1.2070000000000001},"min":{"1min":0.81499999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.51,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.84099999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4690000000000001,"5min":1.792,"15min":1.792},"last":1.4259999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1359999999999999,"15min":1.165},"min":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.105},{"interface":"front","average":{"1min":1.373,"5min":1.3620000000000001,"15min":1.3440000000000001},"min":{"1min":1.04,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.6140000000000001,"5min":2.097,"15min":2.097},"last":1.6930000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.202,"15min":1.262},"min":{"1min":0.86699999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.635},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3779999999999999,"15min":1.415},"min":{"1min":0.95999999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8120000000000001,"5min":1.992,"15min":1.992},"last":1.9610000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.337,"15min":1.3620000000000001},"min":{"1min":1.077,"5min":0.63,"15min":0.63},"max":{"1min":1.5800000000000001,"5min":2.157,"15min":2.157},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.524,"5min":1.544,"15min":1.5880000000000001},"min":{"1min":1.2589999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.754,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":2.0659999999999998}]},{"osd":7,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.482,"15min":1.492},"min":{"1min":1.2350000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6930000000000001,"5min":2.202,"15min":2.202},"last":1.867},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.635,"15min":1.653},"min":{"1min":1.3069999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.9099999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":2.2229999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":489287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.88200000000000001,"15min":0.999},"min":{"1min":0.41799999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.226,"5min":3.641,"15min":3.641},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90800000000000003,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.474,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.1910000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.89400000000000002,"15min":0.93400000000000005},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.393,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0209999999999999,"15min":1.0960000000000001},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.246,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.80900000000000005}]},{"osd":2,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0449999999999999,"15min":1.1000000000000001},"min":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.8100000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.056,"15min":1.1140000000000001},"min":{"1min":0.53400000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5209999999999999,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.78600000000000003}]},{"osd":4,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.282,"15min":1.3300000000000001},"min":{"1min":0.94099999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7050000000000001,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.421},{"interface":"front","average":{"1min":1.248,"5min":1.2929999999999999,"15min":1.377},"min":{"1min":0.82099999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.679,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.087}]},{"osd":5,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.333,"15min":1.409},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.8129999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.23},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.3759999999999999,"15min":1.4570000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6399999999999999,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.292}]},{"osd":6,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.4279999999999999,"15min":1.514},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.7390000000000001,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.345},{"interface":"front","average":{"1min":1.327,"5min":1.417,"15min":1.4970000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.873,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.5860000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.458,"15min":1.5369999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0470000000000002,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":2.0169999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4319999999999999,"15min":1.482},"min":{"1min":1.008,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8320000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.272}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.746},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.86499999999999999,"15min":0.91800000000000004},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.585,"5min":1.972,"15min":1.972},"last":0.84999999999999998}]},{"osd":1,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.89900000000000002,"15min":0.98699999999999999},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.23,"5min":1.522,"15min":1.522},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.97799999999999998},"min":{"1min":0.46899999999999997,"5min":0.442,"15min":0.442},"max":{"1min":1.486,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.78200000000000003}]},{"osd":3,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.91300000000000003,"15min":0.95099999999999996},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.1120000000000001,"5min":1.794,"15min":1.794},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.04,"15min":1.0900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.405,"5min":1.75,"15min":1.75},"last":0.71799999999999997}]},{"osd":4,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.141,"15min":1.1950000000000001},"min":{"1min":0.69199999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.452,"5min":1.669,"15min":1.669},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.3080000000000001,"15min":1.3700000000000001},"min":{"1min":0.71199999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.796,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.0469999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.23,"15min":1.302},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4259999999999999,"5min":2.48,"15min":2.48},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.3600000000000001,"15min":1.4630000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.871,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.296}]},{"osd":6,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3340000000000001,"15min":1.371},"min":{"1min":0.80700000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0510000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.101},{"interface":"front","average":{"1min":1.212,"5min":1.395,"15min":1.5049999999999999},"min":{"1min":0.78000000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.96,"5min":3.302,"15min":3.302},"last":1.218}]},{"osd":7,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.385,"15min":1.4710000000000001},"min":{"1min":0.79200000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.944,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.3340000000000001,"15min":1.448},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.593,"5min":2.73,"15min":2.73},"last":1.2470000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.304,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0609999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":0.96399999999999997},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.169,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0229999999999999,"15min":1.0409999999999999},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5309999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0389999999999999,"15min":1.03},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4910000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.629},{"interface":"front","average":{"1min":0.85199999999999998,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.258,"5min":2.044,"15min":2.044},"last":0.83599999999999997}]},{"osd":4,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.9410000000000001,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.216},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3520000000000001,"15min":1.3500000000000001},"min":{"1min":0.82199999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.831,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.91300000000000003}]},{"osd":5,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.264,"15min":1.238},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.4750000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.367},{"interface":"front","average":{"1min":1.131,"5min":1.256,"15min":1.2350000000000001},"min":{"1min":0.80700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7769999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.097}]},{"osd":6,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3420000000000001,"15min":1.3200000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7529999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.327,"15min":1.351},"min":{"1min":0.83199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.877,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.2669999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.427,"15min":1.462},"min":{"1min":0.91800000000000004,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.7370000000000001,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.665,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.4139999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1650688,"data_stored":1068767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.2909999999999999,"5min":1.901,"15min":1.901},"last":0.63},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88,"15min":0.85099999999999998},"min":{"1min":0.51600000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2390000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.01}]},{"osd":2,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89700000000000002,"15min":0.84999999999999998},"min":{"1min":0.46700000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.96899999999999997,"15min":0.95899999999999996},"min":{"1min":0.44700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.855,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.91200000000000003,"15min":0.89600000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.526,"5min":1.875,"15min":1.875},"last":1.135},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.083,"15min":1.0600000000000001},"min":{"1min":0.59699999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.6519999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.88200000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.24,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5229999999999999,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.194},"min":{"1min":0.67400000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7629999999999999,"5min":2.391,"15min":2.391},"last":1.6599999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.335,"15min":1.3500000000000001},"min":{"1min":0.78400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.9350000000000001,"5min":3.028,"15min":3.028},"last":1.099},{"interface":"front","average":{"1min":1.21,"5min":1.302,"15min":1.306},"min":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7629999999999999,"5min":2.718,"15min":2.718},"last":1.252}]},{"osd":6,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.272,"15min":1.3},"min":{"1min":0.78100000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5069999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.7989999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.4039999999999999,"15min":1.4179999999999999},"min":{"1min":0.996,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.837,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.204}]},{"osd":7,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3420000000000001,"15min":1.351},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.756,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3340000000000001,"15min":1.3520000000000001},"min":{"1min":0.78800000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.673,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.895}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:46:14.096 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T20:46:14.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.308+0000 7fb65b002640 1 Processor -- start 2023-11-27T20:46:14.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.308+0000 7fb65b002640 1 -- start start 2023-11-27T20:46:14.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.309+0000 7fb65b002640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6540c52e0 0x7fb65406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:14.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.309+0000 7fb65b002640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6540a8380 con 0x7fb65406cd20 2023-11-27T20:46:14.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.309+0000 7fb65b002640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6541510b0 con 0x7fb65414e7f0 2023-11-27T20:46:14.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.309+0000 7fb65b002640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65406bf60 con 0x7fb6540c52e0 2023-11-27T20:46:14.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.310+0000 7fb65a801640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb65406cd20 0x7fb65415ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:60086/0 (socket says 172.21.15.91:60086) 2023-11-27T20:46:14.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.310+0000 7fb65a801640 1 -- 172.21.15.91:0/618186577 learned_addr learned my addr 172.21.15.91:0/618186577 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:14.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.310+0000 7fb6597ff640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6540c52e0 0x7fb65406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:14.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.310+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389651564 0 0) 0x7fb6540a8380 con 0x7fb65406cd20 2023-11-27T20:46:14.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.310+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb640003520 con 0x7fb65406cd20 2023-11-27T20:46:14.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924634166 0 0) 0x7fb640003520 con 0x7fb65406cd20 2023-11-27T20:46:14.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6540c52e0 msgr2=0x7fb65406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:14.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6540c52e0 0x7fb65406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 >> v1:172.21.15.183:6789/0 conn(0x7fb65414e7f0 legacy=0x7fb6540c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:14.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65406c240 con 0x7fb65406cd20 2023-11-27T20:46:14.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7fb64c0019f0 con 0x7fb65406cd20 2023-11-27T20:46:14.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 >> v1:172.21.15.91:6789/0 conn(0x7fb65406cd20 legacy=0x7fb65415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:14.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6540c52e0 0x7fb6400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:14.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 0x7fb6400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:14.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb640004d00 0x7fb640005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:14.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65406bf60 con 0x7fb640003f20 2023-11-27T20:46:14.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64000dcd0 con 0x7fb640004d00 2023-11-27T20:46:14.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64000de90 con 0x7fb6540c52e0 2023-11-27T20:46:14.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.311+0000 7fb6597ff640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 0x7fb6400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:14.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.312+0000 7fb65a801640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb640004d00 0x7fb640005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:14.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.312+0000 7fb65a000640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6540c52e0 0x7fb6400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:14.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.312+0000 7fb6597ff640 1 -- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6540c52e0 msgr2=0x7fb6400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:14.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.312+0000 7fb6597ff640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6540c52e0 0x7fb6400039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.312+0000 7fb6597ff640 1 -- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb640004d00 msgr2=0x7fb640005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:14.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.312+0000 7fb6597ff640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb640004d00 0x7fb640005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.312+0000 7fb6597ff640 1 -- 172.21.15.91:0/618186577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65406c240 con 0x7fb640003f20 2023-11-27T20:46:14.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.312+0000 7fb65a801640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb640004d00 0x7fb640005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:14.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.313+0000 7fb6597ff640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 0x7fb6400047c0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb644009ac0 tx=0x7fb6400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b4b260f186f2d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:14.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.313+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64402c600 con 0x7fb640003f20 2023-11-27T20:46:14.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.313+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64402c760 con 0x7fb640003f20 2023-11-27T20:46:14.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.313+0000 7fb658ffe640 1 -- 172.21.15.91:0/618186577 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64402caf0 con 0x7fb640003f20 2023-11-27T20:46:14.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.314+0000 7fb65b002640 1 -- 172.21.15.91:0/618186577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 msgr2=0x7fb6400047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:14.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.314+0000 7fb65b002640 1 --2- 172.21.15.91:0/618186577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 0x7fb6400047c0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb644009ac0 tx=0x7fb6400057f0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.314+0000 7fb65a801640 1 -- 172.21.15.91:0/618186577 reap_dead start 2023-11-27T20:46:14.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.314+0000 7fb65b002640 1 -- 172.21.15.91:0/618186577 shutdown_connections 2023-11-27T20:46:14.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.314+0000 7fb65b002640 1 -- 172.21.15.91:0/618186577 >> 172.21.15.91:0/618186577 conn(0x7fb6540a77f0 msgr2=0x7fb6540a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:14.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.314+0000 7fb65b002640 1 -- 172.21.15.91:0/618186577 shutdown_connections 2023-11-27T20:46:14.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.314+0000 7fb65b002640 1 -- 172.21.15.91:0/618186577 wait complete. 2023-11-27T20:46:14.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.315+0000 7fb65b002640 1 Processor -- start 2023-11-27T20:46:14.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.316+0000 7fb65b002640 1 -- start start 2023-11-27T20:46:14.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.316+0000 7fb65b002640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 0x7fb65413f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:14.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65b002640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb654143dd0 0x7fb654144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:14.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65b002640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb654144840 0x7fb65414f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:14.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65b002640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6541ee420 con 0x7fb640003f20 2023-11-27T20:46:14.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65b002640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6541ee700 con 0x7fb654144840 2023-11-27T20:46:14.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65b002640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6541504e0 con 0x7fb654143dd0 2023-11-27T20:46:14.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65a000640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 0x7fb65413f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:14.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65a000640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 0x7fb65413f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55420/0 (socket says 172.21.15.91:55420) 2023-11-27T20:46:14.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65a000640 1 -- 172.21.15.91:0/241066226 learned_addr learned my addr 172.21.15.91:0/241066226 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:14.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65a000640 1 -- 172.21.15.91:0/241066226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb654143dd0 msgr2=0x7fb654144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:14.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65a000640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb654143dd0 0x7fb654144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65a000640 1 -- 172.21.15.91:0/241066226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb654144840 msgr2=0x7fb65414f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:14.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65a000640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb654144840 0x7fb65414f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65a000640 1 -- 172.21.15.91:0/241066226 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6541507c0 con 0x7fb640003f20 2023-11-27T20:46:14.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.317+0000 7fb65a000640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 0x7fb65413f120 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb65000d570 tx=0x7fb65000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:14.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.318+0000 7fb64a7fc640 1 -- 172.21.15.91:0/241066226 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650005480 con 0x7fb640003f20 2023-11-27T20:46:14.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.318+0000 7fb64a7fc640 1 -- 172.21.15.91:0/241066226 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb650003610 con 0x7fb640003f20 2023-11-27T20:46:14.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.318+0000 7fb64a7fc640 1 -- 172.21.15.91:0/241066226 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650003980 con 0x7fb640003f20 2023-11-27T20:46:14.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.318+0000 7fb65b002640 1 -- 172.21.15.91:0/241066226 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6540abb20 con 0x7fb640003f20 2023-11-27T20:46:14.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.318+0000 7fb65b002640 1 -- 172.21.15.91:0/241066226 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb654144ea0 con 0x7fb640003f20 2023-11-27T20:46:14.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.319+0000 7fb65b002640 1 -- 172.21.15.91:0/241066226 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb654150950 con 0x7fb640003f20 2023-11-27T20:46:14.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.320+0000 7fb64a7fc640 1 -- 172.21.15.91:0/241066226 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb650003ae0 con 0x7fb640003f20 2023-11-27T20:46:14.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.321+0000 7fb64a7fc640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb63806b1c0 0x7fb63806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:14.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.321+0000 7fb64a7fc640 1 -- 172.21.15.91:0/241066226 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb6500896f0 con 0x7fb640003f20 2023-11-27T20:46:14.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.321+0000 7fb6597ff640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb63806b1c0 0x7fb63806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:14.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.322+0000 7fb6597ff640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb63806b1c0 0x7fb63806d680 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb644036000 tx=0x7fb64402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:14.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.326+0000 7fb64a7fc640 1 -- 172.21.15.91:0/241066226 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb6500546b0 con 0x7fb640003f20 2023-11-27T20:46:14.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.516+0000 7fb65b002640 1 -- 172.21.15.91:0/241066226 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb654150ce0 con 0x7fb640003f20 2023-11-27T20:46:14.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.518+0000 7fb64a7fc640 1 -- 172.21.15.91:0/241066226 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+13084 (secure 0 0 0) 0x7fb650001230 con 0x7fb640003f20 2023-11-27T20:46:14.520 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:14.520 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":87,"fsid":"76812701-65a9-4deb-87af-ef00110d1601","created":"2023-11-27T20:41:10.389045+0000","modified":"2023-11-27T20:46:09.150519+0000","last_up_change":"2023-11-27T20:41:22.704500+0000","last_in_change":"2023-11-27T20:41:13.753096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T20:41:23.446680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4830b68-3ba3-48d6-a726-baa4c1cfa2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6801","nonce":941562544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6803","nonce":941562544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6807","nonce":941562544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":941562544},{"type":"v1","addr":"172.21.15.91:6805","nonce":941562544}]},"public_addr":"172.21.15.91:6801/941562544","cluster_addr":"172.21.15.91:6803/941562544","heartbeat_back_addr":"172.21.15.91:6807/941562544","heartbeat_front_addr":"172.21.15.91:6805/941562544","state":["exists","up"]},{"osd":1,"uuid":"5f279b59-b626-4a73-a622-f0480bc028a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6809","nonce":906632887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6811","nonce":906632887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6816","nonce":906632887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":906632887},{"type":"v1","addr":"172.21.15.91:6813","nonce":906632887}]},"public_addr":"172.21.15.91:6809/906632887","cluster_addr":"172.21.15.91:6811/906632887","heartbeat_back_addr":"172.21.15.91:6816/906632887","heartbeat_front_addr":"172.21.15.91:6813/906632887","state":["exists","up"]},{"osd":2,"uuid":"a7ca606e-55f4-485e-bc2a-f43fe0ca007d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6821","nonce":3602897358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6823","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6824","nonce":3602897358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6830","nonce":3602897358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6825","nonce":3602897358},{"type":"v1","addr":"172.21.15.91:6827","nonce":3602897358}]},"public_addr":"172.21.15.91:6821/3602897358","cluster_addr":"172.21.15.91:6824/3602897358","heartbeat_back_addr":"172.21.15.91:6830/3602897358","heartbeat_front_addr":"172.21.15.91:6827/3602897358","state":["exists","up"]},{"osd":3,"uuid":"ff789988-5150-4465-9807-30ece471b6fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6817","nonce":367212639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6819","nonce":367212639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6829","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6831","nonce":367212639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":367212639},{"type":"v1","addr":"172.21.15.91:6826","nonce":367212639}]},"public_addr":"172.21.15.91:6817/367212639","cluster_addr":"172.21.15.91:6819/367212639","heartbeat_back_addr":"172.21.15.91:6831/367212639","heartbeat_front_addr":"172.21.15.91:6826/367212639","state":["exists","up"]},{"osd":4,"uuid":"b22a07a4-05e6-48d2-a771-6cae06f48ab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6817","nonce":3858237641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6819","nonce":3858237641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6825","nonce":3858237641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":3858237641},{"type":"v1","addr":"172.21.15.183:6821","nonce":3858237641}]},"public_addr":"172.21.15.183:6817/3858237641","cluster_addr":"172.21.15.183:6819/3858237641","heartbeat_back_addr":"172.21.15.183:6825/3858237641","heartbeat_front_addr":"172.21.15.183:6821/3858237641","state":["exists","up"]},{"osd":5,"uuid":"7d558e4f-c27d-49af-91d5-9b1630c826ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6809","nonce":1862351799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6811","nonce":1862351799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6815","nonce":1862351799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1862351799},{"type":"v1","addr":"172.21.15.183:6813","nonce":1862351799}]},"public_addr":"172.21.15.183:6809/1862351799","cluster_addr":"172.21.15.183:6811/1862351799","heartbeat_back_addr":"172.21.15.183:6815/1862351799","heartbeat_front_addr":"172.21.15.183:6813/1862351799","state":["exists","up"]},{"osd":6,"uuid":"23006010-5a4b-4539-8929-35cdb2adc13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6801","nonce":953643252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6803","nonce":953643252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6807","nonce":953643252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":953643252},{"type":"v1","addr":"172.21.15.183:6805","nonce":953643252}]},"public_addr":"172.21.15.183:6801/953643252","cluster_addr":"172.21.15.183:6803/953643252","heartbeat_back_addr":"172.21.15.183:6807/953643252","heartbeat_front_addr":"172.21.15.183:6805/953643252","state":["exists","up"]},{"osd":7,"uuid":"44925a71-114e-4533-a076-0725235f9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6824","nonce":3877780549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6827","nonce":3877780549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6831","nonce":3877780549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3877780549},{"type":"v1","addr":"172.21.15.183:6829","nonce":3877780549}]},"public_addr":"172.21.15.183:6824/3877780549","cluster_addr":"172.21.15.183:6827/3877780549","heartbeat_back_addr":"172.21.15.183:6831/3877780549","heartbeat_front_addr":"172.21.15.183:6829/3877780549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.349473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.070104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.087473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.098847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.090180+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.303394+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.071348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T20:41:19.384101+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.91:6837/1761528163":"2023-11-28T20:46:06.133130+0000","172.21.15.91:6835/1761528163":"2023-11-28T20:46:06.133130+0000","172.21.15.183:6835/2103536114":"2023-11-28T20:45:58.564564+0000","172.21.15.183:6833/2103536114":"2023-11-28T20:45:58.564564+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T20:46:14.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.520+0000 7fb65b002640 1 -- 172.21.15.91:0/241066226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb63806b1c0 msgr2=0x7fb63806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:14.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.520+0000 7fb65b002640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb63806b1c0 0x7fb63806d680 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb644036000 tx=0x7fb64402e000 comp rx=0 tx=0).stop 2023-11-27T20:46:14.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.520+0000 7fb65b002640 1 -- 172.21.15.91:0/241066226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 msgr2=0x7fb65413f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:14.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.520+0000 7fb65b002640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 0x7fb65413f120 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb65000d570 tx=0x7fb65000da30 comp rx=0 tx=0).stop 2023-11-27T20:46:14.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.521+0000 7fb65b002640 1 -- 172.21.15.91:0/241066226 shutdown_connections 2023-11-27T20:46:14.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.521+0000 7fb65b002640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb63806b1c0 0x7fb63806d680 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.521+0000 7fb65b002640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb654144840 0x7fb65414f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.521+0000 7fb65b002640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb654143dd0 0x7fb654144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.521+0000 7fb65b002640 1 --2- 172.21.15.91:0/241066226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb640003f20 0x7fb65413f120 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:14.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.521+0000 7fb65b002640 1 -- 172.21.15.91:0/241066226 >> 172.21.15.91:0/241066226 conn(0x7fb6540a77f0 msgr2=0x7fb6540c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:14.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.521+0000 7fb65b002640 1 -- 172.21.15.91:0/241066226 shutdown_connections 2023-11-27T20:46:14.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:14.521+0000 7fb65b002640 1 -- 172.21.15.91:0/241066226 wait complete. 2023-11-27T20:46:15.541 INFO:tasks.ceph:Scrubbing osd.0 2023-11-27T20:46:15.541 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-27T20:46:15.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.777+0000 7f41f671d640 1 Processor -- start 2023-11-27T20:46:15.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.777+0000 7f41f671d640 1 -- start start 2023-11-27T20:46:15.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.778+0000 7f41f671d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f41f00c80b0 0x7f41f00c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:15.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.778+0000 7f41f671d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f41f0157e80 0x7f41f0158290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:15.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.778+0000 7f41f671d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f006c7c0 con 0x7f41f0151e20 2023-11-27T20:46:15.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.779+0000 7f41f671d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f00c57b0 con 0x7f41f00c80b0 2023-11-27T20:46:15.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.779+0000 7f41f671d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f00ac860 con 0x7f41f0157e80 2023-11-27T20:46:15.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.779+0000 7f41ef7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f41f00c80b0 0x7f41f00c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:15.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.779+0000 7f41ef7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f41f00c80b0 0x7f41f00c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55434/0 (socket says 172.21.15.91:55434) 2023-11-27T20:46:15.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.779+0000 7f41ef7fe640 1 -- 172.21.15.91:0/2792089408 learned_addr learned my addr 172.21.15.91:0/2792089408 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:15.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.779+0000 7f41f4cba640 1 --2- 172.21.15.91:0/2792089408 >> v2:172.21.15.183:3300/0 conn(0x7f41f0157e80 0x7f41f0158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:15.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.779+0000 7f41ef7fe640 1 -- 172.21.15.91:0/2792089408 >> v2:172.21.15.183:3300/0 conn(0x7f41f0157e80 msgr2=0x7f41f0158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:15.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.779+0000 7f41ef7fe640 1 --2- 172.21.15.91:0/2792089408 >> v2:172.21.15.183:3300/0 conn(0x7f41f0157e80 0x7f41f0158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:15.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.779+0000 7f41ef7fe640 1 -- 172.21.15.91:0/2792089408 >> v1:172.21.15.183:6789/0 conn(0x7f41f0151e20 legacy=0x7f41f00abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:15.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.779+0000 7f41ef7fe640 1 -- 172.21.15.91:0/2792089408 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00ac600 con 0x7f41f00c80b0 2023-11-27T20:46:15.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.780+0000 7f41ef7fe640 1 --2- 172.21.15.91:0/2792089408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41f00c80b0 0x7f41f00c8540 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f41f00c0ff0 tx=0x7f41d802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa8340a274282a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:15.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.781+0000 7f41eeffd640 1 -- 172.21.15.91:0/2792089408 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8031750 con 0x7f41f00c80b0 2023-11-27T20:46:15.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.781+0000 7f41eeffd640 1 -- 172.21.15.91:0/2792089408 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d80318b0 con 0x7f41f00c80b0 2023-11-27T20:46:15.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.781+0000 7f41eeffd640 1 -- 172.21.15.91:0/2792089408 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8031c40 con 0x7f41f00c80b0 2023-11-27T20:46:15.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.781+0000 7f41f671d640 1 -- 172.21.15.91:0/2792089408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41f00c80b0 msgr2=0x7f41f00c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:15.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.781+0000 7f41f671d640 1 --2- 172.21.15.91:0/2792089408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41f00c80b0 0x7f41f00c8540 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f41f00c0ff0 tx=0x7f41d802b7f0 comp rx=0 tx=0).stop 2023-11-27T20:46:15.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.781+0000 7f41f671d640 1 -- 172.21.15.91:0/2792089408 shutdown_connections 2023-11-27T20:46:15.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.781+0000 7f41f671d640 1 --2- 172.21.15.91:0/2792089408 >> v2:172.21.15.183:3300/0 conn(0x7f41f0157e80 0x7f41f0158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:15.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.781+0000 7f41f671d640 1 --2- 172.21.15.91:0/2792089408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41f00c80b0 0x7f41f00c8540 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:15.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.782+0000 7f41f671d640 1 -- 172.21.15.91:0/2792089408 >> 172.21.15.91:0/2792089408 conn(0x7f41f0071e10 msgr2=0x7f41f0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:15.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.782+0000 7f41f671d640 1 -- 172.21.15.91:0/2792089408 shutdown_connections 2023-11-27T20:46:15.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.782+0000 7f41f671d640 1 -- 172.21.15.91:0/2792089408 wait complete. 2023-11-27T20:46:15.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.783+0000 7f41f671d640 1 Processor -- start 2023-11-27T20:46:15.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.783+0000 7f41f671d640 1 -- start start 2023-11-27T20:46:15.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.784+0000 7f41f671d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41f00c80b0 0x7f41f0157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:15.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.784+0000 7f41f671d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41f0151e20 0x7f41f014c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:15.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.784+0000 7f41f671d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41f0157e80 0x7f41f01410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:15.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.784+0000 7f41f671d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f01ee400 con 0x7f41f0157e80 2023-11-27T20:46:15.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.784+0000 7f41f671d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f01ee930 con 0x7f41f00c80b0 2023-11-27T20:46:15.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.784+0000 7f41f671d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f01eac70 con 0x7f41f0151e20 2023-11-27T20:46:15.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.784+0000 7f41f4cba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41f0157e80 0x7f41f01410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:15.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41f4cba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41f0157e80 0x7f41f01410a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55438/0 (socket says 172.21.15.91:55438) 2023-11-27T20:46:15.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41f4cba640 1 -- 172.21.15.91:0/992918310 learned_addr learned my addr 172.21.15.91:0/992918310 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:15.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41ef7fe640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41f0151e20 0x7f41f014c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:15.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41f4cba640 1 -- 172.21.15.91:0/992918310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41f0151e20 msgr2=0x7f41f014c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:15.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41effff640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41f00c80b0 0x7f41f0157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:15.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41f4cba640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41f0151e20 0x7f41f014c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:15.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41f4cba640 1 -- 172.21.15.91:0/992918310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41f00c80b0 msgr2=0x7f41f0157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:15.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41f4cba640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41f00c80b0 0x7f41f0157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:15.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41f4cba640 1 -- 172.21.15.91:0/992918310 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d80094d0 con 0x7f41f0157e80 2023-11-27T20:46:15.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41f4cba640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41f0157e80 0x7f41f01410a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f41e8007e60 tx=0x7f41e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:15.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41ecff9640 1 -- 172.21.15.91:0/992918310 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8014420 con 0x7f41f0157e80 2023-11-27T20:46:15.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.785+0000 7f41ecff9640 1 -- 172.21.15.91:0/992918310 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e80145a0 con 0x7f41f0157e80 2023-11-27T20:46:15.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.786+0000 7f41ecff9640 1 -- 172.21.15.91:0/992918310 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8014950 con 0x7f41f0157e80 2023-11-27T20:46:15.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.786+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f01ee650 con 0x7f41f0157e80 2023-11-27T20:46:15.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.786+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f01ea900 con 0x7f41f0157e80 2023-11-27T20:46:15.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.786+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41f00c9000 con 0x7f41f0157e80 2023-11-27T20:46:15.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.788+0000 7f41ecff9640 1 -- 172.21.15.91:0/992918310 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f41e8014ab0 con 0x7f41f0157e80 2023-11-27T20:46:15.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.788+0000 7f41ecff9640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41d006b1f0 0x7f41d006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:15.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.789+0000 7f41ecff9640 1 -- 172.21.15.91:0/992918310 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f41e808a180 con 0x7f41f0157e80 2023-11-27T20:46:15.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.789+0000 7f41effff640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41d006b1f0 0x7f41d006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:15.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.789+0000 7f41ecff9640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] conn(0x7f41d00710f0 0x7f41d0073510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:15.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.789+0000 7f41ecff9640 1 -- 172.21.15.91:0/992918310 --> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41d0073bc0 con 0x7f41d00710f0 2023-11-27T20:46:15.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.789+0000 7f41ecff9640 1 -- 172.21.15.91:0/992918310 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41e808c760 con 0x7f41f0157e80 2023-11-27T20:46:15.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.789+0000 7f41ef7fe640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] conn(0x7f41d00710f0 0x7f41d0073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:15.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.789+0000 7f41effff640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41d006b1f0 0x7f41d006d6b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f41e0003d90 tx=0x7f41e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:15.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.790+0000 7f41ef7fe640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] conn(0x7f41d00710f0 0x7f41d0073510 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:15.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.790+0000 7f41ecff9640 1 -- 172.21.15.91:0/992918310 <== osd.0 v2:172.21.15.91:6800/941562544 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f41d0073bc0 con 0x7f41d00710f0 2023-11-27T20:46:15.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.805+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 --> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f41f00c9ae0 con 0x7f41d00710f0 2023-11-27T20:46:15.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.805+0000 7f41ecff9640 1 -- 172.21.15.91:0/992918310 <== osd.0 v2:172.21.15.91:6800/941562544 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f41d8031b20 con 0x7f41d00710f0 2023-11-27T20:46:15.807 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:46:15.807 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T20:46:15.808 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:46:15.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.805+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] conn(0x7f41d00710f0 msgr2=0x7f41d0073510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:15.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.805+0000 7f41f671d640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:6800/941562544,v1:172.21.15.91:6801/941562544] conn(0x7f41d00710f0 0x7f41d0073510 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:15.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.806+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41d006b1f0 msgr2=0x7f41d006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:15.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.806+0000 7f41f671d640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f41d006b1f0 0x7f41d006d6b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f41e0003d90 tx=0x7f41e0009040 comp rx=0 tx=0).stop 2023-11-27T20:46:15.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.806+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41f0157e80 msgr2=0x7f41f01410a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:15.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.806+0000 7f41f671d640 1 --2- 172.21.15.91:0/992918310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41f0157e80 0x7f41f01410a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f41e8007e60 tx=0x7f41e800e4b0 comp rx=0 tx=0).stop 2023-11-27T20:46:15.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.806+0000 7f41f4cba640 1 -- 172.21.15.91:0/992918310 reap_dead start 2023-11-27T20:46:15.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.806+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 shutdown_connections 2023-11-27T20:46:15.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.806+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 >> 172.21.15.91:0/992918310 conn(0x7f41f0071e10 msgr2=0x7f41f00abef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:15.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.806+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 shutdown_connections 2023-11-27T20:46:15.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:15.806+0000 7f41f671d640 1 -- 172.21.15.91:0/992918310 wait complete. 2023-11-27T20:46:15.825 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-27T20:46:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.031+0000 7f6afcc9b640 1 Processor -- start 2023-11-27T20:46:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.031+0000 7f6afcc9b640 1 -- start start 2023-11-27T20:46:16.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.033+0000 7f6afcc9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6af814fd30 0x7f6af8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.033+0000 7f6afcc9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 0x7f6af80a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.033+0000 7f6afcc9b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af80c64a0 con 0x7f6af80a5260 2023-11-27T20:46:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.033+0000 7f6afcc9b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af80c5c00 con 0x7f6af814fd30 2023-11-27T20:46:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.033+0000 7f6afcc9b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af80c5ee0 con 0x7f6af806d0a0 2023-11-27T20:46:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.034+0000 7f6af659c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6af814fd30 0x7f6af8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.034+0000 7f6aeffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 0x7f6af80a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.034+0000 7f6aeffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 0x7f6af80a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.91:55028/0 (socket says 172.21.15.91:55028) 2023-11-27T20:46:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.034+0000 7f6af659c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6af814fd30 0x7f6af8152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.91:33396/0 (socket says 172.21.15.91:33396) 2023-11-27T20:46:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.034+0000 7f6af6d9d640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f6af80a5260 0x7f6af80c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.91:33056/0 (socket says 172.21.15.91:33056) 2023-11-27T20:46:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.034+0000 7f6aeffff640 1 -- 172.21.15.91:0/148400632 learned_addr learned my addr 172.21.15.91:0/148400632 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:16.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.035+0000 7f6af659c640 1 -- 172.21.15.91:0/148400632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 msgr2=0x7f6af80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:16.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.035+0000 7f6af659c640 1 --2- 172.21.15.91:0/148400632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 0x7f6af80a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.035+0000 7f6af659c640 1 -- 172.21.15.91:0/148400632 >> v1:172.21.15.183:6789/0 conn(0x7f6af80a5260 legacy=0x7f6af80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.035+0000 7f6af659c640 1 -- 172.21.15.91:0/148400632 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af80c61c0 con 0x7f6af814fd30 2023-11-27T20:46:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.035+0000 7f6aeffff640 1 --2- 172.21.15.91:0/148400632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 0x7f6af80a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T20:46:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.037+0000 7f6af659c640 1 --2- 172.21.15.91:0/148400632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af814fd30 0x7f6af8152f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80097a0 tx=0x7f6ae802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9d97b6d830a8892 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.038+0000 7f6af5d9b640 1 -- 172.21.15.91:0/148400632 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae802d040 con 0x7f6af814fd30 2023-11-27T20:46:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.038+0000 7f6af5d9b640 1 -- 172.21.15.91:0/148400632 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae8031810 con 0x7f6af814fd30 2023-11-27T20:46:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.038+0000 7f6af5d9b640 1 -- 172.21.15.91:0/148400632 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8031ba0 con 0x7f6af814fd30 2023-11-27T20:46:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.038+0000 7f6afcc9b640 1 -- 172.21.15.91:0/148400632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af814fd30 msgr2=0x7f6af8152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.038+0000 7f6afcc9b640 1 --2- 172.21.15.91:0/148400632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af814fd30 0x7f6af8152f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80097a0 tx=0x7f6ae802b8b0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.038+0000 7f6afcc9b640 1 -- 172.21.15.91:0/148400632 shutdown_connections 2023-11-27T20:46:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.038+0000 7f6afcc9b640 1 --2- 172.21.15.91:0/148400632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 0x7f6af80a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.038+0000 7f6afcc9b640 1 --2- 172.21.15.91:0/148400632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af814fd30 0x7f6af8152f20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.038+0000 7f6afcc9b640 1 -- 172.21.15.91:0/148400632 >> 172.21.15.91:0/148400632 conn(0x7f6af806a500 msgr2=0x7f6af806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.039+0000 7f6afcc9b640 1 -- 172.21.15.91:0/148400632 shutdown_connections 2023-11-27T20:46:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.039+0000 7f6afcc9b640 1 -- 172.21.15.91:0/148400632 wait complete. 2023-11-27T20:46:16.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.041+0000 7f6afcc9b640 1 Processor -- start 2023-11-27T20:46:16.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.041+0000 7f6afcc9b640 1 -- start start 2023-11-27T20:46:16.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.042+0000 7f6afcc9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 0x7f6af8151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.042+0000 7f6afcc9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6af80a5260 0x7f6af814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.042+0000 7f6afcc9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af814fd30 0x7f6af814f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.042+0000 7f6afcc9b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af8156170 con 0x7f6af80a5260 2023-11-27T20:46:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.042+0000 7f6afcc9b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af8155e90 con 0x7f6af814fd30 2023-11-27T20:46:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.042+0000 7f6afcc9b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af81dc2f0 con 0x7f6af806d0a0 2023-11-27T20:46:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.042+0000 7f6aeffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6af80a5260 0x7f6af814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.043+0000 7f6aeffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6af80a5260 0x7f6af814f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55448/0 (socket says 172.21.15.91:55448) 2023-11-27T20:46:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.043+0000 7f6aeffff640 1 -- 172.21.15.91:0/3437479730 learned_addr learned my addr 172.21.15.91:0/3437479730 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.043+0000 7f6af659c640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 0x7f6af8151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.043+0000 7f6af6d9d640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af814fd30 0x7f6af814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.043+0000 7f6aeffff640 1 -- 172.21.15.91:0/3437479730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 msgr2=0x7f6af8151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.043+0000 7f6aeffff640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 0x7f6af8151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.043+0000 7f6aeffff640 1 -- 172.21.15.91:0/3437479730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af814fd30 msgr2=0x7f6af814f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.043+0000 7f6aeffff640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af814fd30 0x7f6af814f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.043+0000 7f6aeffff640 1 -- 172.21.15.91:0/3437479730 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00094d0 con 0x7f6af80a5260 2023-11-27T20:46:16.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.043+0000 7f6aeffff640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6af80a5260 0x7f6af814f030 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000e9a0 tx=0x7f6ae000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:16.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.044+0000 7f6aeeffd640 1 -- 172.21.15.91:0/3437479730 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000ca00 con 0x7f6af80a5260 2023-11-27T20:46:16.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.044+0000 7f6aeeffd640 1 -- 172.21.15.91:0/3437479730 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae000cb60 con 0x7f6af80a5260 2023-11-27T20:46:16.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.044+0000 7f6afcc9b640 1 -- 172.21.15.91:0/3437479730 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae8009400 con 0x7f6af80a5260 2023-11-27T20:46:16.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.044+0000 7f6aeeffd640 1 -- 172.21.15.91:0/3437479730 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0013470 con 0x7f6af80a5260 2023-11-27T20:46:16.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.044+0000 7f6afcc9b640 1 -- 172.21.15.91:0/3437479730 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af81dc8b0 con 0x7f6af80a5260 2023-11-27T20:46:16.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.045+0000 7f6afcc9b640 1 -- 172.21.15.91:0/3437479730 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af8068350 con 0x7f6af80a5260 2023-11-27T20:46:16.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.047+0000 7f6aeeffd640 1 -- 172.21.15.91:0/3437479730 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6ae00135d0 con 0x7f6af80a5260 2023-11-27T20:46:16.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.048+0000 7f6aeeffd640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad806b1c0 0x7f6ad806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.048+0000 7f6aeeffd640 1 -- 172.21.15.91:0/3437479730 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6ae0089aa0 con 0x7f6af80a5260 2023-11-27T20:46:16.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.048+0000 7f6af659c640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad806b1c0 0x7f6ad806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.049+0000 7f6af659c640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad806b1c0 0x7f6ad806d680 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8036000 tx=0x7f6ae803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:16.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.053+0000 7f6aeeffd640 1 -- 172.21.15.91:0/3437479730 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6ae0054a70 con 0x7f6af80a5260 2023-11-27T20:46:16.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.242+0000 7f6afcc9b640 1 -- 172.21.15.91:0/3437479730 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6af8153020 con 0x7f6ad806b1c0 2023-11-27T20:46:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.243+0000 7f6aeeffd640 1 -- 172.21.15.91:0/3437479730 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6af8153020 con 0x7f6ad806b1c0 2023-11-27T20:46:16.244 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 0 to deep-scrub 2023-11-27T20:46:16.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.245+0000 7f6afcc9b640 1 -- 172.21.15.91:0/3437479730 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad806b1c0 msgr2=0x7f6ad806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.245+0000 7f6afcc9b640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad806b1c0 0x7f6ad806d680 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8036000 tx=0x7f6ae803c040 comp rx=0 tx=0).stop 2023-11-27T20:46:16.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.245+0000 7f6afcc9b640 1 -- 172.21.15.91:0/3437479730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6af80a5260 msgr2=0x7f6af814f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.245+0000 7f6afcc9b640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6af80a5260 0x7f6af814f030 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000e9a0 tx=0x7f6ae000ee60 comp rx=0 tx=0).stop 2023-11-27T20:46:16.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.245+0000 7f6afcc9b640 1 -- 172.21.15.91:0/3437479730 shutdown_connections 2023-11-27T20:46:16.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.245+0000 7f6afcc9b640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f6ad806b1c0 0x7f6ad806d680 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.245+0000 7f6afcc9b640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af814fd30 0x7f6af814f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.245+0000 7f6afcc9b640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6af80a5260 0x7f6af814f030 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.245+0000 7f6afcc9b640 1 --2- 172.21.15.91:0/3437479730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af806d0a0 0x7f6af8151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.245+0000 7f6afcc9b640 1 -- 172.21.15.91:0/3437479730 >> 172.21.15.91:0/3437479730 conn(0x7f6af806a500 msgr2=0x7f6af80bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:16.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.246+0000 7f6afcc9b640 1 -- 172.21.15.91:0/3437479730 shutdown_connections 2023-11-27T20:46:16.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.246+0000 7f6afcc9b640 1 -- 172.21.15.91:0/3437479730 wait complete. 2023-11-27T20:46:16.266 INFO:tasks.ceph:Scrubbing osd.1 2023-11-27T20:46:16.266 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-27T20:46:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.479+0000 7f31eb59e640 1 Processor -- start 2023-11-27T20:46:16.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.480+0000 7f31eb59e640 1 -- start start 2023-11-27T20:46:16.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.481+0000 7f31eb59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f31ec1551c0 0x7f31ec06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.481+0000 7f31eb59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31ec0c2ea0 0x7f31ec0c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.481+0000 7f31eb59e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31ec0c58a0 0x7f31ec0bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.481+0000 7f31eb59e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ec0c6310 con 0x7f31ec0c58a0 2023-11-27T20:46:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.481+0000 7f31eb59e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ec06aee0 con 0x7f31ec1551c0 2023-11-27T20:46:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.481+0000 7f31eb59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0c4bd0 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.481+0000 7f31ead9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31ec0c58a0 0x7f31ec0bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.481+0000 7f31ead9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31ec0c58a0 0x7f31ec0bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55450/0 (socket says 172.21.15.91:55450) 2023-11-27T20:46:16.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.481+0000 7f31ead9d640 1 -- 172.21.15.91:0/3145757405 learned_addr learned my addr 172.21.15.91:0/3145757405 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:16.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.482+0000 7f31e9d9b640 1 --2- 172.21.15.91:0/3145757405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31ec0c2ea0 0x7f31ec0c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.482+0000 7f31ea59c640 1 --2- 172.21.15.91:0/3145757405 >> v2:172.21.15.183:3300/0 conn(0x7f31ec1551c0 0x7f31ec06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.482+0000 7f31ead9d640 1 -- 172.21.15.91:0/3145757405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31ec0c2ea0 msgr2=0x7f31ec0c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:16.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.482+0000 7f31ead9d640 1 --2- 172.21.15.91:0/3145757405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31ec0c2ea0 0x7f31ec0c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.482+0000 7f31ead9d640 1 -- 172.21.15.91:0/3145757405 >> v2:172.21.15.183:3300/0 conn(0x7f31ec1551c0 msgr2=0x7f31ec06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:16.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.482+0000 7f31ead9d640 1 --2- 172.21.15.91:0/3145757405 >> v2:172.21.15.183:3300/0 conn(0x7f31ec1551c0 0x7f31ec06a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.482+0000 7f31ead9d640 1 -- 172.21.15.91:0/3145757405 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec071400 con 0x7f31ec0c58a0 2023-11-27T20:46:16.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.483+0000 7f31ead9d640 1 --2- 172.21.15.91:0/3145757405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31ec0c58a0 0x7f31ec0bfef0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f31ec071010 tx=0x7f31e402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8be9a7750274c45 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:16.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.483+0000 7f31e959a640 1 -- 172.21.15.91:0/3145757405 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4031640 con 0x7f31ec0c58a0 2023-11-27T20:46:16.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.484+0000 7f31e959a640 1 -- 172.21.15.91:0/3145757405 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e40317a0 con 0x7f31ec0c58a0 2023-11-27T20:46:16.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.484+0000 7f31e959a640 1 -- 172.21.15.91:0/3145757405 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4031b30 con 0x7f31ec0c58a0 2023-11-27T20:46:16.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.484+0000 7f31eb59e640 1 -- 172.21.15.91:0/3145757405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31ec0c58a0 msgr2=0x7f31ec0bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.484+0000 7f31eb59e640 1 --2- 172.21.15.91:0/3145757405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31ec0c58a0 0x7f31ec0bfef0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f31ec071010 tx=0x7f31e402b8f0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.484+0000 7f31eb59e640 1 -- 172.21.15.91:0/3145757405 shutdown_connections 2023-11-27T20:46:16.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.484+0000 7f31eb59e640 1 --2- 172.21.15.91:0/3145757405 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31ec0c58a0 0x7f31ec0bfef0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.484+0000 7f31eb59e640 1 --2- 172.21.15.91:0/3145757405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31ec0c2ea0 0x7f31ec0c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.484+0000 7f31eb59e640 1 --2- 172.21.15.91:0/3145757405 >> v2:172.21.15.183:3300/0 conn(0x7f31ec1551c0 0x7f31ec06a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.484+0000 7f31eb59e640 1 -- 172.21.15.91:0/3145757405 >> 172.21.15.91:0/3145757405 conn(0x7f31ec0a8870 msgr2=0x7f31ec0a8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:16.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.485+0000 7f31eb59e640 1 -- 172.21.15.91:0/3145757405 shutdown_connections 2023-11-27T20:46:16.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.485+0000 7f31eb59e640 1 -- 172.21.15.91:0/3145757405 wait complete. 2023-11-27T20:46:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.487+0000 7f31eb59e640 1 Processor -- start 2023-11-27T20:46:16.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.487+0000 7f31eb59e640 1 -- start start 2023-11-27T20:46:16.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.488+0000 7f31eb59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31ec0c2ea0 0x7f31ec06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.488+0000 7f31eb59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31ec0c58a0 0x7f31ec0ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.488+0000 7f31eb59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31ec1551c0 0x7f31ec1ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.488+0000 7f31eb59e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec06dd40 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.488+0000 7f31eb59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0a9c80 con 0x7f31ec1551c0 2023-11-27T20:46:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.488+0000 7f31eb59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0a9f60 con 0x7f31ec0c58a0 2023-11-27T20:46:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.488+0000 7f31ea59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31ec0c2ea0 0x7f31ec06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.488+0000 7f31ea59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31ec0c2ea0 0x7f31ec06e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55464/0 (socket says 172.21.15.91:55464) 2023-11-27T20:46:16.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.488+0000 7f31ea59c640 1 -- 172.21.15.91:0/3285682934 learned_addr learned my addr 172.21.15.91:0/3285682934 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.489+0000 7f31e9d9b640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31ec0c58a0 0x7f31ec0ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.489+0000 7f31ead9d640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31ec1551c0 0x7f31ec1ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.489+0000 7f31ea59c640 1 -- 172.21.15.91:0/3285682934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31ec0c58a0 msgr2=0x7f31ec0ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.489+0000 7f31ea59c640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31ec0c58a0 0x7f31ec0ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.489+0000 7f31ea59c640 1 -- 172.21.15.91:0/3285682934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31ec1551c0 msgr2=0x7f31ec1ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.489+0000 7f31ea59c640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31ec1551c0 0x7f31ec1ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.489+0000 7f31ea59c640 1 -- 172.21.15.91:0/3285682934 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40094d0 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.489+0000 7f31ea59c640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31ec0c2ea0 0x7f31ec06e160 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007ef0 tx=0x7f31dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:16.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.489+0000 7f31e2ffd640 1 -- 172.21.15.91:0/3285682934 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc014620 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.490+0000 7f31e2ffd640 1 -- 172.21.15.91:0/3285682934 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc014780 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.490+0000 7f31e2ffd640 1 -- 172.21.15.91:0/3285682934 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc014b30 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.490+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec0aa240 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.490+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec0a9940 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.491+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31ec067dc0 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.492+0000 7f31e2ffd640 1 -- 172.21.15.91:0/3285682934 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f31dc014c90 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.493+0000 7f31e2ffd640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31cc06b1c0 0x7f31cc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.493+0000 7f31e2ffd640 1 -- 172.21.15.91:0/3285682934 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f31dc08aee0 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.493+0000 7f31e2ffd640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] conn(0x7f31cc0710c0 0x7f31cc0734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.493+0000 7f31e9d9b640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31cc06b1c0 0x7f31cc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.493+0000 7f31e2ffd640 1 -- 172.21.15.91:0/3285682934 --> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31cc073b90 con 0x7f31cc0710c0 2023-11-27T20:46:16.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.493+0000 7f31e2ffd640 1 -- 172.21.15.91:0/3285682934 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31dc08b330 con 0x7f31ec0c2ea0 2023-11-27T20:46:16.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.493+0000 7f31ead9d640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] conn(0x7f31cc0710c0 0x7f31cc0734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.494+0000 7f31e9d9b640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31cc06b1c0 0x7f31cc06d680 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f31d4006fd0 tx=0x7f31d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:16.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.494+0000 7f31ead9d640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] conn(0x7f31cc0710c0 0x7f31cc0734e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:16.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.495+0000 7f31e2ffd640 1 -- 172.21.15.91:0/3285682934 <== osd.1 v2:172.21.15.91:6808/906632887 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f31cc073b90 con 0x7f31cc0710c0 2023-11-27T20:46:16.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.509+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 --> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f31ec071980 con 0x7f31cc0710c0 2023-11-27T20:46:16.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.510+0000 7f31e2ffd640 1 -- 172.21.15.91:0/3285682934 <== osd.1 v2:172.21.15.91:6808/906632887 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f31e4031910 con 0x7f31cc0710c0 2023-11-27T20:46:16.511 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:46:16.512 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T20:46:16.512 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:46:16.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.510+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] conn(0x7f31cc0710c0 msgr2=0x7f31cc0734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.510+0000 7f31eb59e640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:6808/906632887,v1:172.21.15.91:6809/906632887] conn(0x7f31cc0710c0 0x7f31cc0734e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.510+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31cc06b1c0 msgr2=0x7f31cc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.510+0000 7f31eb59e640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f31cc06b1c0 0x7f31cc06d680 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f31d4006fd0 tx=0x7f31d4008040 comp rx=0 tx=0).stop 2023-11-27T20:46:16.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.510+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31ec0c2ea0 msgr2=0x7f31ec06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.510+0000 7f31eb59e640 1 --2- 172.21.15.91:0/3285682934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31ec0c2ea0 0x7f31ec06e160 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007ef0 tx=0x7f31dc00e4b0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.511+0000 7f31ead9d640 1 -- 172.21.15.91:0/3285682934 reap_dead start 2023-11-27T20:46:16.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.511+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 shutdown_connections 2023-11-27T20:46:16.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.511+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 >> 172.21.15.91:0/3285682934 conn(0x7f31ec0a8870 msgr2=0x7f31ec0c23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:16.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.511+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 shutdown_connections 2023-11-27T20:46:16.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.511+0000 7f31eb59e640 1 -- 172.21.15.91:0/3285682934 wait complete. 2023-11-27T20:46:16.528 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-27T20:46:16.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.738+0000 7f3313256640 1 Processor -- start 2023-11-27T20:46:16.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.738+0000 7f3313256640 1 -- start start 2023-11-27T20:46:16.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.739+0000 7f3313256640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f330c14fd30 0x7f330c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.739+0000 7f3313256640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f330c06d0a0 0x7f330c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.739+0000 7f3313256640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c0c64a0 con 0x7f330c0a5260 2023-11-27T20:46:16.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.739+0000 7f3313256640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c0c5c00 con 0x7f330c06d0a0 2023-11-27T20:46:16.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.739+0000 7f3313256640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c0c5ee0 con 0x7f330c14fd30 2023-11-27T20:46:16.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.739+0000 7f330bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f330c06d0a0 0x7f330c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.739+0000 7f330bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f330c06d0a0 0x7f330c0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55476/0 (socket says 172.21.15.91:55476) 2023-11-27T20:46:16.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.739+0000 7f33117f3640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f330c0a5260 0x7f330c0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:60094/0 (socket says 172.21.15.91:60094) 2023-11-27T20:46:16.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.739+0000 7f330bfff640 1 -- 172.21.15.91:0/2290790386 learned_addr learned my addr 172.21.15.91:0/2290790386 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:16.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.740+0000 7f3310ff2640 1 --2- 172.21.15.91:0/2290790386 >> v2:172.21.15.183:3300/0 conn(0x7f330c14fd30 0x7f330c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.740+0000 7f330bfff640 1 -- 172.21.15.91:0/2290790386 >> v2:172.21.15.183:3300/0 conn(0x7f330c14fd30 msgr2=0x7f330c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:16.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.740+0000 7f330bfff640 1 --2- 172.21.15.91:0/2290790386 >> v2:172.21.15.183:3300/0 conn(0x7f330c14fd30 0x7f330c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.740+0000 7f330bfff640 1 -- 172.21.15.91:0/2290790386 >> v1:172.21.15.91:6789/0 conn(0x7f330c0a5260 legacy=0x7f330c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.740+0000 7f330bfff640 1 -- 172.21.15.91:0/2290790386 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c0c61c0 con 0x7f330c06d0a0 2023-11-27T20:46:16.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.740+0000 7f330b7fe640 1 -- 172.21.15.91:0/2290790386 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424677980 0 0) 0x7f330c0c64a0 con 0x7f330c0a5260 2023-11-27T20:46:16.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.741+0000 7f330bfff640 1 --2- 172.21.15.91:0/2290790386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 0x7f330c0a4d20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f330c06b200 tx=0x7f32f802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad4af399726b889 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:16.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.741+0000 7f330b7fe640 1 -- 172.21.15.91:0/2290790386 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8030860 con 0x7f330c06d0a0 2023-11-27T20:46:16.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.741+0000 7f330b7fe640 1 -- 172.21.15.91:0/2290790386 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f80309c0 con 0x7f330c06d0a0 2023-11-27T20:46:16.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.741+0000 7f330b7fe640 1 -- 172.21.15.91:0/2290790386 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8030d50 con 0x7f330c06d0a0 2023-11-27T20:46:16.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.742+0000 7f3313256640 1 -- 172.21.15.91:0/2290790386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 msgr2=0x7f330c0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.742+0000 7f3313256640 1 --2- 172.21.15.91:0/2290790386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 0x7f330c0a4d20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f330c06b200 tx=0x7f32f802b9a0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.742+0000 7f3313256640 1 -- 172.21.15.91:0/2290790386 shutdown_connections 2023-11-27T20:46:16.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.742+0000 7f3313256640 1 --2- 172.21.15.91:0/2290790386 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 0x7f330c0a4d20 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.742+0000 7f3313256640 1 --2- 172.21.15.91:0/2290790386 >> v2:172.21.15.183:3300/0 conn(0x7f330c14fd30 0x7f330c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.742+0000 7f3313256640 1 -- 172.21.15.91:0/2290790386 >> 172.21.15.91:0/2290790386 conn(0x7f330c06a500 msgr2=0x7f330c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:16.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.742+0000 7f3313256640 1 -- 172.21.15.91:0/2290790386 shutdown_connections 2023-11-27T20:46:16.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.742+0000 7f3313256640 1 -- 172.21.15.91:0/2290790386 wait complete. 2023-11-27T20:46:16.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.744+0000 7f3313256640 1 Processor -- start 2023-11-27T20:46:16.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.744+0000 7f3313256640 1 -- start start 2023-11-27T20:46:16.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3313256640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 0x7f330c1ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3313256640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f330c0a5260 0x7f330c0bfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3313256640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f330c14fd30 0x7f330c0a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3313256640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c1edfa0 con 0x7f330c06d0a0 2023-11-27T20:46:16.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3313256640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0bc140 con 0x7f330c0a5260 2023-11-27T20:46:16.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3313256640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0bced0 con 0x7f330c14fd30 2023-11-27T20:46:16.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3310ff2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 0x7f330c1ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3310ff2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 0x7f330c1ee3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55480/0 (socket says 172.21.15.91:55480) 2023-11-27T20:46:16.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3310ff2640 1 -- 172.21.15.91:0/919119935 learned_addr learned my addr 172.21.15.91:0/919119935 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:16.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3310ff2640 1 -- 172.21.15.91:0/919119935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f330c14fd30 msgr2=0x7f330c0a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3310ff2640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f330c14fd30 0x7f330c0a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3310ff2640 1 -- 172.21.15.91:0/919119935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f330c0a5260 msgr2=0x7f330c0bfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3310ff2640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f330c0a5260 0x7f330c0bfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.745+0000 7f3310ff2640 1 -- 172.21.15.91:0/919119935 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80094d0 con 0x7f330c06d0a0 2023-11-27T20:46:16.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.746+0000 7f3310ff2640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 0x7f330c1ee3c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f330000d650 tx=0x7f330000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:16.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.746+0000 7f33097fa640 1 -- 172.21.15.91:0/919119935 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330000b660 con 0x7f330c06d0a0 2023-11-27T20:46:16.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.746+0000 7f33097fa640 1 -- 172.21.15.91:0/919119935 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330000b7c0 con 0x7f330c06d0a0 2023-11-27T20:46:16.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.746+0000 7f33097fa640 1 -- 172.21.15.91:0/919119935 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330000bb50 con 0x7f330c06d0a0 2023-11-27T20:46:16.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.746+0000 7f3313256640 1 -- 172.21.15.91:0/919119935 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c1568e0 con 0x7f330c06d0a0 2023-11-27T20:46:16.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.746+0000 7f3313256640 1 -- 172.21.15.91:0/919119935 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c1ed8e0 con 0x7f330c06d0a0 2023-11-27T20:46:16.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.747+0000 7f3313256640 1 -- 172.21.15.91:0/919119935 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c068350 con 0x7f330c06d0a0 2023-11-27T20:46:16.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.748+0000 7f33097fa640 1 -- 172.21.15.91:0/919119935 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f330000bcb0 con 0x7f330c06d0a0 2023-11-27T20:46:16.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.749+0000 7f33097fa640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f32f006b210 0x7f32f006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:16.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.749+0000 7f33097fa640 1 -- 172.21.15.91:0/919119935 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3300089bb0 con 0x7f330c06d0a0 2023-11-27T20:46:16.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.749+0000 7f330bfff640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f32f006b210 0x7f32f006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:16.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.750+0000 7f330bfff640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f32f006b210 0x7f32f006d6d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f32f8036000 tx=0x7f32f803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:16.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.754+0000 7f33097fa640 1 -- 172.21.15.91:0/919119935 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3300054bf0 con 0x7f330c06d0a0 2023-11-27T20:46:16.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.940+0000 7f3313256640 1 -- 172.21.15.91:0/919119935 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f330c0c45b0 con 0x7f32f006b210 2023-11-27T20:46:16.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.941+0000 7f33097fa640 1 -- 172.21.15.91:0/919119935 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f32f8030bb0 con 0x7f32f006b210 2023-11-27T20:46:16.943 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 1 to deep-scrub 2023-11-27T20:46:16.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 -- 172.21.15.91:0/919119935 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f32f006b210 msgr2=0x7f32f006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f32f006b210 0x7f32f006d6d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f32f8036000 tx=0x7f32f803b040 comp rx=0 tx=0).stop 2023-11-27T20:46:16.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 -- 172.21.15.91:0/919119935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 msgr2=0x7f330c1ee3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:16.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 0x7f330c1ee3c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f330000d650 tx=0x7f330000db10 comp rx=0 tx=0).stop 2023-11-27T20:46:16.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 -- 172.21.15.91:0/919119935 shutdown_connections 2023-11-27T20:46:16.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f330c14fd30 0x7f330c0a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f32f006b210 0x7f32f006d6d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f330c0a5260 0x7f330c0bfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 --2- 172.21.15.91:0/919119935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f330c06d0a0 0x7f330c1ee3c0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:16.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 -- 172.21.15.91:0/919119935 >> 172.21.15.91:0/919119935 conn(0x7f330c06a500 msgr2=0x7f330c0a6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:16.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 -- 172.21.15.91:0/919119935 shutdown_connections 2023-11-27T20:46:16.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:16.944+0000 7f3313256640 1 -- 172.21.15.91:0/919119935 wait complete. 2023-11-27T20:46:16.966 INFO:tasks.ceph:Scrubbing osd.2 2023-11-27T20:46:16.966 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-27T20:46:17.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.183+0000 7efe40b97640 1 Processor -- start 2023-11-27T20:46:17.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.183+0000 7efe40b97640 1 -- start start 2023-11-27T20:46:17.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.184+0000 7efe40b97640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efe3c14fa80 0x7efe3c06d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.184+0000 7efe40b97640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c0c0980 con 0x7efe3c071f70 2023-11-27T20:46:17.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.184+0000 7efe40b97640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c06c070 con 0x7efe3c072530 2023-11-27T20:46:17.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.184+0000 7efe40b97640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c06d160 con 0x7efe3c14fa80 2023-11-27T20:46:17.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.185+0000 7efe3ad9d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7efe3c071f70 0x7efe3c0c2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:60110/0 (socket says 172.21.15.91:60110) 2023-11-27T20:46:17.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.185+0000 7efe3ad9d640 1 -- 172.21.15.91:0/234988924 learned_addr learned my addr 172.21.15.91:0/234988924 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:17.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.185+0000 7efe3a59c640 1 --2- 172.21.15.91:0/234988924 >> v2:172.21.15.183:3300/0 conn(0x7efe3c14fa80 0x7efe3c06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.185+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144876509 0 0) 0x7efe3c0c0980 con 0x7efe3c071f70 2023-11-27T20:46:17.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.185+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe28003520 con 0x7efe3c071f70 2023-11-27T20:46:17.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476063169 0 0) 0x7efe28003520 con 0x7efe3c071f70 2023-11-27T20:46:17.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 >> v2:172.21.15.183:3300/0 conn(0x7efe3c14fa80 msgr2=0x7efe3c06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:17.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 --2- 172.21.15.91:0/234988924 >> v2:172.21.15.183:3300/0 conn(0x7efe3c14fa80 0x7efe3c06d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 >> v1:172.21.15.183:6789/0 conn(0x7efe3c072530 legacy=0x7efe3c0c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:17.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c06dc70 con 0x7efe3c071f70 2023-11-27T20:46:17.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7efe340019f0 con 0x7efe3c071f70 2023-11-27T20:46:17.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 >> v1:172.21.15.91:6789/0 conn(0x7efe3c071f70 legacy=0x7efe3c0c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe28003970 0x7efe28003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe280047c0 0x7efe28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe28005180 0x7efe2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c06d160 con 0x7efe28003970 2023-11-27T20:46:17.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2800c0b0 con 0x7efe280047c0 2023-11-27T20:46:17.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2800c270 con 0x7efe28005180 2023-11-27T20:46:17.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe3a59c640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe28003970 0x7efe28003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe3a59c640 1 -- 172.21.15.91:0/234988924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe28005180 msgr2=0x7efe2800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:17.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe3ad9d640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe28005180 0x7efe2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.186+0000 7efe33fff640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe280047c0 0x7efe28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.187+0000 7efe3a59c640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe28005180 0x7efe2800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.187+0000 7efe3a59c640 1 -- 172.21.15.91:0/234988924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe280047c0 msgr2=0x7efe28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.187+0000 7efe3a59c640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe280047c0 0x7efe28004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.187+0000 7efe3a59c640 1 -- 172.21.15.91:0/234988924 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28003520 con 0x7efe28003970 2023-11-27T20:46:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.187+0000 7efe3ad9d640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe28005180 0x7efe2800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.187+0000 7efe33fff640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe280047c0 0x7efe28004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:17.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.187+0000 7efe3ad9d640 1 -- 172.21.15.91:0/234988924 reap_dead start 2023-11-27T20:46:17.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.188+0000 7efe3a59c640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe28003970 0x7efe28003d70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009ac0 tx=0x7efe280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddf95084be63751 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.188+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c02c6b0 con 0x7efe28003970 2023-11-27T20:46:17.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.188+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c02c810 con 0x7efe28003970 2023-11-27T20:46:17.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.188+0000 7efe39d9b640 1 -- 172.21.15.91:0/234988924 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c02cba0 con 0x7efe28003970 2023-11-27T20:46:17.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.188+0000 7efe40b97640 1 -- 172.21.15.91:0/234988924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe28003970 msgr2=0x7efe28003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.188+0000 7efe40b97640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe28003970 0x7efe28003d70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009ac0 tx=0x7efe280057f0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.189+0000 7efe40b97640 1 -- 172.21.15.91:0/234988924 shutdown_connections 2023-11-27T20:46:17.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.189+0000 7efe40b97640 1 --2- 172.21.15.91:0/234988924 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe28003970 0x7efe28003d70 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.189+0000 7efe40b97640 1 -- 172.21.15.91:0/234988924 >> 172.21.15.91:0/234988924 conn(0x7efe3c0c5bc0 msgr2=0x7efe3c0c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:17.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.189+0000 7efe40b97640 1 -- 172.21.15.91:0/234988924 shutdown_connections 2023-11-27T20:46:17.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.189+0000 7efe40b97640 1 -- 172.21.15.91:0/234988924 wait complete. 2023-11-27T20:46:17.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.190+0000 7efe40b97640 1 Processor -- start 2023-11-27T20:46:17.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.191+0000 7efe40b97640 1 -- start start 2023-11-27T20:46:17.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.191+0000 7efe40b97640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe28003970 0x7efe3c1e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.191+0000 7efe40b97640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe3c149f90 0x7efe3c070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.191+0000 7efe40b97640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe3c070790 0x7efe3c1eb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.191+0000 7efe40b97640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c142b40 con 0x7efe3c070790 2023-11-27T20:46:17.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.191+0000 7efe40b97640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1e90c0 con 0x7efe28003970 2023-11-27T20:46:17.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.191+0000 7efe40b97640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c06fdc0 con 0x7efe3c149f90 2023-11-27T20:46:17.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.192+0000 7efe3ad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe3c070790 0x7efe3c1eb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.192+0000 7efe3ad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe3c070790 0x7efe3c1eb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55488/0 (socket says 172.21.15.91:55488) 2023-11-27T20:46:17.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.192+0000 7efe3ad9d640 1 -- 172.21.15.91:0/3883541617 learned_addr learned my addr 172.21.15.91:0/3883541617 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:17.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.192+0000 7efe3ad9d640 1 -- 172.21.15.91:0/3883541617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe3c149f90 msgr2=0x7efe3c070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.192+0000 7efe3ad9d640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe3c149f90 0x7efe3c070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.192+0000 7efe3ad9d640 1 -- 172.21.15.91:0/3883541617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe28003970 msgr2=0x7efe3c1e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.192+0000 7efe3ad9d640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe28003970 0x7efe3c1e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.192+0000 7efe3ad9d640 1 -- 172.21.15.91:0/3883541617 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c14bbe0 con 0x7efe3c070790 2023-11-27T20:46:17.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.192+0000 7efe3ad9d640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe3c070790 0x7efe3c1eb670 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7efe3c071f00 tx=0x7efe3400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.193+0000 7efe32ffd640 1 -- 172.21.15.91:0/3883541617 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34001990 con 0x7efe3c070790 2023-11-27T20:46:17.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.193+0000 7efe32ffd640 1 -- 172.21.15.91:0/3883541617 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400bb30 con 0x7efe3c070790 2023-11-27T20:46:17.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.193+0000 7efe32ffd640 1 -- 172.21.15.91:0/3883541617 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400bee0 con 0x7efe3c070790 2023-11-27T20:46:17.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.193+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c14bec0 con 0x7efe3c070790 2023-11-27T20:46:17.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.193+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c14c480 con 0x7efe3c070790 2023-11-27T20:46:17.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.194+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe3c149260 con 0x7efe3c070790 2023-11-27T20:46:17.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.195+0000 7efe32ffd640 1 -- 172.21.15.91:0/3883541617 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efe34007070 con 0x7efe3c070790 2023-11-27T20:46:17.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.196+0000 7efe32ffd640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe1c06b1c0 0x7efe1c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.196+0000 7efe32ffd640 1 -- 172.21.15.91:0/3883541617 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7efe34089ac0 con 0x7efe3c070790 2023-11-27T20:46:17.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.196+0000 7efe32ffd640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] conn(0x7efe1c0710c0 0x7efe1c0734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.196+0000 7efe32ffd640 1 -- 172.21.15.91:0/3883541617 --> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe1c073b90 con 0x7efe1c0710c0 2023-11-27T20:46:17.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.196+0000 7efe32ffd640 1 -- 172.21.15.91:0/3883541617 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe3408e2a0 con 0x7efe3c070790 2023-11-27T20:46:17.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.196+0000 7efe3a59c640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe1c06b1c0 0x7efe1c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.196+0000 7efe33fff640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] conn(0x7efe1c0710c0 0x7efe1c0734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.197+0000 7efe3a59c640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe1c06b1c0 0x7efe1c06d680 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efe2c036000 tx=0x7efe2c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.197+0000 7efe33fff640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] conn(0x7efe1c0710c0 0x7efe1c0734e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.198+0000 7efe32ffd640 1 -- 172.21.15.91:0/3883541617 <== osd.2 v2:172.21.15.91:6820/3602897358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efe1c073b90 con 0x7efe1c0710c0 2023-11-27T20:46:17.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.212+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 --> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efe3c06bd00 con 0x7efe1c0710c0 2023-11-27T20:46:17.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.213+0000 7efe32ffd640 1 -- 172.21.15.91:0/3883541617 <== osd.2 v2:172.21.15.91:6820/3602897358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efe240050e0 con 0x7efe1c0710c0 2023-11-27T20:46:17.214 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:46:17.215 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T20:46:17.215 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:46:17.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.213+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] conn(0x7efe1c0710c0 msgr2=0x7efe1c0734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.213+0000 7efe40b97640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:6820/3602897358,v1:172.21.15.91:6821/3602897358] conn(0x7efe1c0710c0 0x7efe1c0734e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.213+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe1c06b1c0 msgr2=0x7efe1c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.213+0000 7efe40b97640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efe1c06b1c0 0x7efe1c06d680 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efe2c036000 tx=0x7efe2c02e000 comp rx=0 tx=0).stop 2023-11-27T20:46:17.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.213+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe3c070790 msgr2=0x7efe3c1eb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.213+0000 7efe40b97640 1 --2- 172.21.15.91:0/3883541617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe3c070790 0x7efe3c1eb670 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7efe3c071f00 tx=0x7efe3400b4a0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.213+0000 7efe3ad9d640 1 -- 172.21.15.91:0/3883541617 reap_dead start 2023-11-27T20:46:17.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.213+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 shutdown_connections 2023-11-27T20:46:17.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.213+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 >> 172.21.15.91:0/3883541617 conn(0x7efe3c0c5bc0 msgr2=0x7efe3c149600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:17.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.214+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 shutdown_connections 2023-11-27T20:46:17.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.214+0000 7efe40b97640 1 -- 172.21.15.91:0/3883541617 wait complete. 2023-11-27T20:46:17.233 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-27T20:46:17.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.440+0000 7f95da9d0640 1 Processor -- start 2023-11-27T20:46:17.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.441+0000 7f95da9d0640 1 -- start start 2023-11-27T20:46:17.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.442+0000 7f95da9d0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f95d414fd30 0x7f95d4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.442+0000 7f95da9d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d406d0a0 0x7f95d40a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.442+0000 7f95da9d0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f95d40a5260 0x7f95d40c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.442+0000 7f95da9d0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d40c64a0 con 0x7f95d414fd30 2023-11-27T20:46:17.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.442+0000 7f95da9d0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d40c5c00 con 0x7f95d40a5260 2023-11-27T20:46:17.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.442+0000 7f95da9d0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40c5ee0 con 0x7f95d406d0a0 2023-11-27T20:46:17.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.442+0000 7f95d3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f95d414fd30 0x7f95d4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.442+0000 7f95d3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f95d414fd30 0x7f95d4152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55504/0 (socket says 172.21.15.91:55504) 2023-11-27T20:46:17.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.442+0000 7f95d3fff640 1 -- 172.21.15.91:0/3038870582 learned_addr learned my addr 172.21.15.91:0/3038870582 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.443+0000 7f95d37fe640 1 --2- 172.21.15.91:0/3038870582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d406d0a0 0x7f95d40a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.443+0000 7f95d8f6d640 1 --2- 172.21.15.91:0/3038870582 >> v2:172.21.15.183:3300/0 conn(0x7f95d40a5260 0x7f95d40c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.443+0000 7f95d3fff640 1 -- 172.21.15.91:0/3038870582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d406d0a0 msgr2=0x7f95d40a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.443+0000 7f95d3fff640 1 --2- 172.21.15.91:0/3038870582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d406d0a0 0x7f95d40a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.443+0000 7f95d3fff640 1 -- 172.21.15.91:0/3038870582 >> v2:172.21.15.183:3300/0 conn(0x7f95d40a5260 msgr2=0x7f95d40c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.443+0000 7f95d3fff640 1 --2- 172.21.15.91:0/3038870582 >> v2:172.21.15.183:3300/0 conn(0x7f95d40a5260 0x7f95d40c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.443+0000 7f95d3fff640 1 -- 172.21.15.91:0/3038870582 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d40c61c0 con 0x7f95d414fd30 2023-11-27T20:46:17.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.443+0000 7f95d8f6d640 1 --2- 172.21.15.91:0/3038870582 >> v2:172.21.15.183:3300/0 conn(0x7f95d40a5260 0x7f95d40c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:17.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.444+0000 7f95d3fff640 1 --2- 172.21.15.91:0/3038870582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 0x7f95d4152f20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f95d406d990 tx=0x7f95c402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4392cb9d26a17e4b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.444+0000 7f95d2ffd640 1 -- 172.21.15.91:0/3038870582 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c402ca80 con 0x7f95d414fd30 2023-11-27T20:46:17.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.444+0000 7f95d2ffd640 1 -- 172.21.15.91:0/3038870582 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c402cbe0 con 0x7f95d414fd30 2023-11-27T20:46:17.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.444+0000 7f95d2ffd640 1 -- 172.21.15.91:0/3038870582 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c40343f0 con 0x7f95d414fd30 2023-11-27T20:46:17.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.445+0000 7f95da9d0640 1 -- 172.21.15.91:0/3038870582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 msgr2=0x7f95d4152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.445+0000 7f95da9d0640 1 --2- 172.21.15.91:0/3038870582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 0x7f95d4152f20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f95d406d990 tx=0x7f95c402bee0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.445+0000 7f95da9d0640 1 -- 172.21.15.91:0/3038870582 shutdown_connections 2023-11-27T20:46:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.445+0000 7f95da9d0640 1 --2- 172.21.15.91:0/3038870582 >> v2:172.21.15.183:3300/0 conn(0x7f95d40a5260 0x7f95d40c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.445+0000 7f95da9d0640 1 --2- 172.21.15.91:0/3038870582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d406d0a0 0x7f95d40a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.445+0000 7f95da9d0640 1 --2- 172.21.15.91:0/3038870582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 0x7f95d4152f20 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.445+0000 7f95da9d0640 1 -- 172.21.15.91:0/3038870582 >> 172.21.15.91:0/3038870582 conn(0x7f95d406a500 msgr2=0x7f95d406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.445+0000 7f95da9d0640 1 -- 172.21.15.91:0/3038870582 shutdown_connections 2023-11-27T20:46:17.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.445+0000 7f95da9d0640 1 -- 172.21.15.91:0/3038870582 wait complete. 2023-11-27T20:46:17.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.447+0000 7f95da9d0640 1 Processor -- start 2023-11-27T20:46:17.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.447+0000 7f95da9d0640 1 -- start start 2023-11-27T20:46:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.448+0000 7f95da9d0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d406d0a0 0x7f95d4155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.448+0000 7f95da9d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d40a5260 0x7f95d41edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.448+0000 7f95da9d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 0x7f95d4151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.448+0000 7f95da9d0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d41ed7d0 con 0x7f95d414fd30 2023-11-27T20:46:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.448+0000 7f95da9d0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4156790 con 0x7f95d406d0a0 2023-11-27T20:46:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.448+0000 7f95da9d0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4151650 con 0x7f95d40a5260 2023-11-27T20:46:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.448+0000 7f95d8f6d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 0x7f95d4151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.448+0000 7f95d8f6d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 0x7f95d4151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55518/0 (socket says 172.21.15.91:55518) 2023-11-27T20:46:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.448+0000 7f95d8f6d640 1 -- 172.21.15.91:0/2477883195 learned_addr learned my addr 172.21.15.91:0/2477883195 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.449+0000 7f95d3fff640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d406d0a0 0x7f95d4155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.449+0000 7f95d37fe640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d40a5260 0x7f95d41edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.449+0000 7f95d8f6d640 1 -- 172.21.15.91:0/2477883195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d40a5260 msgr2=0x7f95d41edc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.449+0000 7f95d8f6d640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d40a5260 0x7f95d41edc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.449+0000 7f95d8f6d640 1 -- 172.21.15.91:0/2477883195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d406d0a0 msgr2=0x7f95d4155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.449+0000 7f95d8f6d640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d406d0a0 0x7f95d4155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.449+0000 7f95d8f6d640 1 -- 172.21.15.91:0/2477883195 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c4009b30 con 0x7f95d414fd30 2023-11-27T20:46:17.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.449+0000 7f95d37fe640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d40a5260 0x7f95d41edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:17.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.449+0000 7f95d8f6d640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 0x7f95d4151e50 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c7f0 tx=0x7f95cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.449+0000 7f95d0ff9640 1 -- 172.21.15.91:0/2477883195 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc007820 con 0x7f95d414fd30 2023-11-27T20:46:17.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.450+0000 7f95d0ff9640 1 -- 172.21.15.91:0/2477883195 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc007980 con 0x7f95d414fd30 2023-11-27T20:46:17.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.450+0000 7f95d0ff9640 1 -- 172.21.15.91:0/2477883195 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc007d70 con 0x7f95d414fd30 2023-11-27T20:46:17.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.450+0000 7f95da9d0640 1 -- 172.21.15.91:0/2477883195 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d41561d0 con 0x7f95d414fd30 2023-11-27T20:46:17.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.450+0000 7f95da9d0640 1 -- 172.21.15.91:0/2477883195 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d41ed460 con 0x7f95d414fd30 2023-11-27T20:46:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.451+0000 7f95da9d0640 1 -- 172.21.15.91:0/2477883195 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d41ed940 con 0x7f95d414fd30 2023-11-27T20:46:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.452+0000 7f95d0ff9640 1 -- 172.21.15.91:0/2477883195 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f95cc0113f0 con 0x7f95d414fd30 2023-11-27T20:46:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.453+0000 7f95d0ff9640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95b406b1c0 0x7f95b406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.453+0000 7f95d0ff9640 1 -- 172.21.15.91:0/2477883195 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f95cc089b50 con 0x7f95d414fd30 2023-11-27T20:46:17.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.453+0000 7f95d3fff640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95b406b1c0 0x7f95b406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.454+0000 7f95d3fff640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95b406b1c0 0x7f95b406d680 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f95c4035000 tx=0x7f95c4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.458+0000 7f95d0ff9640 1 -- 172.21.15.91:0/2477883195 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f95cc054a80 con 0x7f95d414fd30 2023-11-27T20:46:17.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.645+0000 7f95da9d0640 1 -- 172.21.15.91:0/2477883195 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f95d40c43e0 con 0x7f95b406b1c0 2023-11-27T20:46:17.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.646+0000 7f95d0ff9640 1 -- 172.21.15.91:0/2477883195 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f95c4034470 con 0x7f95b406b1c0 2023-11-27T20:46:17.648 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 2 to deep-scrub 2023-11-27T20:46:17.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 -- 172.21.15.91:0/2477883195 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95b406b1c0 msgr2=0x7f95b406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95b406b1c0 0x7f95b406d680 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f95c4035000 tx=0x7f95c4030000 comp rx=0 tx=0).stop 2023-11-27T20:46:17.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 -- 172.21.15.91:0/2477883195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 msgr2=0x7f95d4151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 0x7f95d4151e50 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c7f0 tx=0x7f95cc00ccb0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 -- 172.21.15.91:0/2477883195 shutdown_connections 2023-11-27T20:46:17.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f95d414fd30 0x7f95d4151e50 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d40a5260 0x7f95d41edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f95b406b1c0 0x7f95b406d680 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 --2- 172.21.15.91:0/2477883195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d406d0a0 0x7f95d4155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 -- 172.21.15.91:0/2477883195 >> 172.21.15.91:0/2477883195 conn(0x7f95d406a500 msgr2=0x7f95d40c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:17.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 -- 172.21.15.91:0/2477883195 shutdown_connections 2023-11-27T20:46:17.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.649+0000 7f95da9d0640 1 -- 172.21.15.91:0/2477883195 wait complete. 2023-11-27T20:46:17.670 INFO:tasks.ceph:Scrubbing osd.3 2023-11-27T20:46:17.671 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-27T20:46:17.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.887+0000 7fb8d4fb7640 1 Processor -- start 2023-11-27T20:46:17.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.887+0000 7fb8d4fb7640 1 -- start start 2023-11-27T20:46:17.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.888+0000 7fb8d4fb7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb8d006ec80 0x7fb8d00c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.888+0000 7fb8d4fb7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8d006a500 0x7fb8d006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.888+0000 7fb8d4fb7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d0158900 con 0x7fb8d0151d40 2023-11-27T20:46:17.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.888+0000 7fb8d4fb7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d006d9b0 con 0x7fb8d006ec80 2023-11-27T20:46:17.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.888+0000 7fb8d4fb7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00c0f60 con 0x7fb8d006a500 2023-11-27T20:46:17.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8cdd9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb8d006ec80 0x7fb8d00c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8cdd9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb8d006ec80 0x7fb8d00c0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55532/0 (socket says 172.21.15.91:55532) 2023-11-27T20:46:17.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8cdd9b640 1 -- 172.21.15.91:0/1335231519 learned_addr learned my addr 172.21.15.91:0/1335231519 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:17.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8ce59c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb8d0151d40 0x7fb8d00c0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:60120/0 (socket says 172.21.15.91:60120) 2023-11-27T20:46:17.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8cdd9b640 1 -- 172.21.15.91:0/1335231519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8d006a500 msgr2=0x7fb8d006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:17.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8ced9d640 1 --2- 172.21.15.91:0/1335231519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8d006a500 0x7fb8d006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8cdd9b640 1 --2- 172.21.15.91:0/1335231519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8d006a500 0x7fb8d006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8cdd9b640 1 -- 172.21.15.91:0/1335231519 >> v1:172.21.15.91:6789/0 conn(0x7fb8d0151d40 legacy=0x7fb8d00c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8cdd9b640 1 -- 172.21.15.91:0/1335231519 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d0157cf0 con 0x7fb8d006ec80 2023-11-27T20:46:17.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8cd59a640 1 -- 172.21.15.91:0/1335231519 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219941169 0 0) 0x7fb8d0158900 con 0x7fb8d0151d40 2023-11-27T20:46:17.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.889+0000 7fb8ced9d640 1 --2- 172.21.15.91:0/1335231519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8d006a500 0x7fb8d006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:17.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.890+0000 7fb8cdd9b640 1 --2- 172.21.15.91:0/1335231519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8d006ec80 0x7fb8d00c0a20 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009870 tx=0x7fb8b802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2725082f441c7a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8cd59a640 1 -- 172.21.15.91:0/1335231519 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8030840 con 0x7fb8d006ec80 2023-11-27T20:46:17.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8cd59a640 1 -- 172.21.15.91:0/1335231519 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b80309a0 con 0x7fb8d006ec80 2023-11-27T20:46:17.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8cd59a640 1 -- 172.21.15.91:0/1335231519 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8030d30 con 0x7fb8d006ec80 2023-11-27T20:46:17.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/1335231519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8d006ec80 msgr2=0x7fb8d00c0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8d4fb7640 1 --2- 172.21.15.91:0/1335231519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8d006ec80 0x7fb8d00c0a20 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009870 tx=0x7fb8b802b980 comp rx=0 tx=0).stop 2023-11-27T20:46:17.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/1335231519 shutdown_connections 2023-11-27T20:46:17.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8d4fb7640 1 --2- 172.21.15.91:0/1335231519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8d006a500 0x7fb8d006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8d4fb7640 1 --2- 172.21.15.91:0/1335231519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8d006ec80 0x7fb8d00c0a20 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/1335231519 >> 172.21.15.91:0/1335231519 conn(0x7fb8d00c39e0 msgr2=0x7fb8d00c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:17.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/1335231519 shutdown_connections 2023-11-27T20:46:17.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.891+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/1335231519 wait complete. 2023-11-27T20:46:17.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.893+0000 7fb8d4fb7640 1 Processor -- start 2023-11-27T20:46:17.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.893+0000 7fb8d4fb7640 1 -- start start 2023-11-27T20:46:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.894+0000 7fb8d4fb7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8d006a500 0x7fb8d00c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.894+0000 7fb8d4fb7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8d006ec80 0x7fb8d01ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.894+0000 7fb8d4fb7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8d0151d40 0x7fb8d01e74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.894+0000 7fb8d4fb7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d01e9e90 con 0x7fb8d006a500 2023-11-27T20:46:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.894+0000 7fb8d4fb7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d0152cf0 con 0x7fb8d0151d40 2023-11-27T20:46:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.894+0000 7fb8d4fb7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d0152730 con 0x7fb8d006ec80 2023-11-27T20:46:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.894+0000 7fb8ce59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8d006a500 0x7fb8d00c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8ce59c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8d006a500 0x7fb8d00c17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55548/0 (socket says 172.21.15.91:55548) 2023-11-27T20:46:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8ce59c640 1 -- 172.21.15.91:0/3308164470 learned_addr learned my addr 172.21.15.91:0/3308164470 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8ced9d640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8d0151d40 0x7fb8d01e74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8cdd9b640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8d006ec80 0x7fb8d01ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8ce59c640 1 -- 172.21.15.91:0/3308164470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8d006ec80 msgr2=0x7fb8d01ea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8ce59c640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8d006ec80 0x7fb8d01ea8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8ce59c640 1 -- 172.21.15.91:0/3308164470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8d0151d40 msgr2=0x7fb8d01e74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8ce59c640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8d0151d40 0x7fb8d01e74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8ce59c640 1 -- 172.21.15.91:0/3308164470 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b80094d0 con 0x7fb8d006a500 2023-11-27T20:46:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8ced9d640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8d0151d40 0x7fb8d01e74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8ce59c640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8d006a500 0x7fb8d00c17e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c430 tx=0x7fb8c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.895+0000 7fb8c6ffd640 1 -- 172.21.15.91:0/3308164470 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00074e0 con 0x7fb8d006a500 2023-11-27T20:46:17.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.896+0000 7fb8c6ffd640 1 -- 172.21.15.91:0/3308164470 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0007660 con 0x7fb8d006a500 2023-11-27T20:46:17.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.896+0000 7fb8c6ffd640 1 -- 172.21.15.91:0/3308164470 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0004a20 con 0x7fb8d006a500 2023-11-27T20:46:17.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.896+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d0152a10 con 0x7fb8d006a500 2023-11-27T20:46:17.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.896+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d01ea380 con 0x7fb8d006a500 2023-11-27T20:46:17.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.897+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8d0067430 con 0x7fb8d006a500 2023-11-27T20:46:17.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.898+0000 7fb8c6ffd640 1 -- 172.21.15.91:0/3308164470 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb8c0004b80 con 0x7fb8d006a500 2023-11-27T20:46:17.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.899+0000 7fb8c6ffd640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb8b006b1f0 0x7fb8b006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.899+0000 7fb8c6ffd640 1 -- 172.21.15.91:0/3308164470 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb8c0089600 con 0x7fb8d006a500 2023-11-27T20:46:17.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.899+0000 7fb8cdd9b640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb8b006b1f0 0x7fb8b006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.899+0000 7fb8c6ffd640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] conn(0x7fb8b00710f0 0x7fb8b0073510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:17.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.899+0000 7fb8c6ffd640 1 -- 172.21.15.91:0/3308164470 --> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8b0073bc0 con 0x7fb8b00710f0 2023-11-27T20:46:17.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.899+0000 7fb8c6ffd640 1 -- 172.21.15.91:0/3308164470 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8c008bb80 con 0x7fb8d006a500 2023-11-27T20:46:17.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.899+0000 7fb8ced9d640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] conn(0x7fb8b00710f0 0x7fb8b0073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:17.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.900+0000 7fb8cdd9b640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb8b006b1f0 0x7fb8b006d6b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8036000 tx=0x7fb8b803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.900+0000 7fb8ced9d640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] conn(0x7fb8b00710f0 0x7fb8b0073510 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:17.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.901+0000 7fb8c6ffd640 1 -- 172.21.15.91:0/3308164470 <== osd.3 v2:172.21.15.91:6815/367212639 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb8b0073bc0 con 0x7fb8b00710f0 2023-11-27T20:46:17.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.915+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 --> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb8d0158590 con 0x7fb8b00710f0 2023-11-27T20:46:17.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.915+0000 7fb8c6ffd640 1 -- 172.21.15.91:0/3308164470 <== osd.3 v2:172.21.15.91:6815/367212639 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb8c800d510 con 0x7fb8b00710f0 2023-11-27T20:46:17.917 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:46:17.918 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T20:46:17.918 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:46:17.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] conn(0x7fb8b00710f0 msgr2=0x7fb8b0073510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8d4fb7640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:6815/367212639,v1:172.21.15.91:6817/367212639] conn(0x7fb8b00710f0 0x7fb8b0073510 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb8b006b1f0 msgr2=0x7fb8b006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8d4fb7640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fb8b006b1f0 0x7fb8b006d6b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8036000 tx=0x7fb8b803b040 comp rx=0 tx=0).stop 2023-11-27T20:46:17.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8d006a500 msgr2=0x7fb8d00c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:17.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8d4fb7640 1 --2- 172.21.15.91:0/3308164470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8d006a500 0x7fb8d00c17e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c430 tx=0x7fb8c000c8f0 comp rx=0 tx=0).stop 2023-11-27T20:46:17.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8ced9d640 1 -- 172.21.15.91:0/3308164470 reap_dead start 2023-11-27T20:46:17.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 shutdown_connections 2023-11-27T20:46:17.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 >> 172.21.15.91:0/3308164470 conn(0x7fb8d00c39e0 msgr2=0x7fb8d014b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:17.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 shutdown_connections 2023-11-27T20:46:17.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:17.916+0000 7fb8d4fb7640 1 -- 172.21.15.91:0/3308164470 wait complete. 2023-11-27T20:46:17.934 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-27T20:46:18.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.144+0000 7f86ce71d640 1 Processor -- start 2023-11-27T20:46:18.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.144+0000 7f86ce71d640 1 -- start start 2023-11-27T20:46:18.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.145+0000 7f86ce71d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f86c814fd30 0x7f86c8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.146+0000 7f86ce71d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c80c3ea0 0x7f86c80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.146+0000 7f86ce71d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c80c64a0 con 0x7f86c806d0a0 2023-11-27T20:46:18.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.146+0000 7f86ce71d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80c5c00 con 0x7f86c814fd30 2023-11-27T20:46:18.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.146+0000 7f86ce71d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80c5ee0 con 0x7f86c80c3ea0 2023-11-27T20:46:18.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.146+0000 7f86c77fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f86c806d0a0 0x7f86c80a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:60132/0 (socket says 172.21.15.91:60132) 2023-11-27T20:46:18.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.146+0000 7f86c77fe640 1 -- 172.21.15.91:0/3775474722 learned_addr learned my addr 172.21.15.91:0/3775474722 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:18.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.146+0000 7f86cccba640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c80c3ea0 0x7f86c80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.146+0000 7f86c7fff640 1 --2- 172.21.15.91:0/3775474722 >> v2:172.21.15.183:3300/0 conn(0x7f86c814fd30 0x7f86c8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.146+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500289905 0 0) 0x7f86c80c64a0 con 0x7f86c806d0a0 2023-11-27T20:46:18.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.146+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b0003520 con 0x7f86c806d0a0 2023-11-27T20:46:18.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3052932470 0 0) 0x7f86b0003520 con 0x7f86c806d0a0 2023-11-27T20:46:18.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c80c3ea0 msgr2=0x7f86c80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:18.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c80c3ea0 0x7f86c80c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 >> v2:172.21.15.183:3300/0 conn(0x7f86c814fd30 msgr2=0x7f86c8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:18.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 --2- 172.21.15.91:0/3775474722 >> v2:172.21.15.183:3300/0 conn(0x7f86c814fd30 0x7f86c8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80c61c0 con 0x7f86c806d0a0 2023-11-27T20:46:18.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f86bc001670 con 0x7f86c806d0a0 2023-11-27T20:46:18.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 >> v1:172.21.15.91:6789/0 conn(0x7f86c806d0a0 legacy=0x7f86c80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86b0003970 0x7f86b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86b00047c0 0x7f86b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c80c3ea0 0x7f86b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80c5c00 con 0x7f86b00047c0 2023-11-27T20:46:18.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80c5ee0 con 0x7f86b0003970 2023-11-27T20:46:18.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b000b980 con 0x7f86c80c3ea0 2023-11-27T20:46:18.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.147+0000 7f86c77fe640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86b00047c0 0x7f86b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.148+0000 7f86c7fff640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86b0003970 0x7f86b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.148+0000 7f86cccba640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c80c3ea0 0x7f86b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.148+0000 7f86c77fe640 1 -- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c80c3ea0 msgr2=0x7f86b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:18.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.148+0000 7f86c77fe640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c80c3ea0 0x7f86b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.148+0000 7f86c77fe640 1 -- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86b0003970 msgr2=0x7f86b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:18.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.148+0000 7f86c77fe640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86b0003970 0x7f86b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.148+0000 7f86c77fe640 1 -- 172.21.15.91:0/3775474722 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b0003520 con 0x7f86b00047c0 2023-11-27T20:46:18.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.148+0000 7f86cccba640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c80c3ea0 0x7f86b0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:18.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.148+0000 7f86c7fff640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86b0003970 0x7f86b0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:18.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.149+0000 7f86c77fe640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86b00047c0 0x7f86b0004c40 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c210 tx=0x7f86b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f132a91b25317c59 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:18.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.149+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc005ad0 con 0x7f86b00047c0 2023-11-27T20:46:18.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.149+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc005c30 con 0x7f86b00047c0 2023-11-27T20:46:18.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.149+0000 7f86c6ffd640 1 -- 172.21.15.91:0/3775474722 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc02c8d0 con 0x7f86b00047c0 2023-11-27T20:46:18.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.149+0000 7f86ce71d640 1 -- 172.21.15.91:0/3775474722 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86b00047c0 msgr2=0x7f86b0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.149+0000 7f86ce71d640 1 --2- 172.21.15.91:0/3775474722 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86b00047c0 0x7f86b0004c40 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c210 tx=0x7f86b00057f0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.150+0000 7f86cccba640 1 -- 172.21.15.91:0/3775474722 reap_dead start 2023-11-27T20:46:18.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.150+0000 7f86ce71d640 1 -- 172.21.15.91:0/3775474722 shutdown_connections 2023-11-27T20:46:18.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.150+0000 7f86ce71d640 1 -- 172.21.15.91:0/3775474722 >> 172.21.15.91:0/3775474722 conn(0x7f86c806a500 msgr2=0x7f86c806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:18.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.150+0000 7f86ce71d640 1 -- 172.21.15.91:0/3775474722 shutdown_connections 2023-11-27T20:46:18.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.150+0000 7f86ce71d640 1 -- 172.21.15.91:0/3775474722 wait complete. 2023-11-27T20:46:18.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.151+0000 7f86ce71d640 1 Processor -- start 2023-11-27T20:46:18.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.152+0000 7f86ce71d640 1 -- start start 2023-11-27T20:46:18.162 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86ce71d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86b00047c0 0x7f86c8071720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86ce71d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c81de5a0 0x7f86c81dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86ce71d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86c8151b40 0x7f86c81dd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86ce71d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c81edeb0 con 0x7f86c8151b40 2023-11-27T20:46:18.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86ce71d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c81ee3e0 con 0x7f86b00047c0 2023-11-27T20:46:18.163 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86ce71d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c81dbc60 con 0x7f86c81de5a0 2023-11-27T20:46:18.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86cccba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86c8151b40 0x7f86c81dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86cccba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86c8151b40 0x7f86c81dd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55576/0 (socket says 172.21.15.91:55576) 2023-11-27T20:46:18.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86cccba640 1 -- 172.21.15.91:0/1479078597 learned_addr learned my addr 172.21.15.91:0/1479078597 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:18.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86c7fff640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86b00047c0 0x7f86c8071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86cccba640 1 -- 172.21.15.91:0/1479078597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c81de5a0 msgr2=0x7f86c81dd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86cccba640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c81de5a0 0x7f86c81dd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86cccba640 1 -- 172.21.15.91:0/1479078597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86b00047c0 msgr2=0x7f86c8071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86cccba640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86b00047c0 0x7f86c8071720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.153+0000 7f86cccba640 1 -- 172.21.15.91:0/1479078597 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c81ee100 con 0x7f86c8151b40 2023-11-27T20:46:18.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.154+0000 7f86cccba640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86c8151b40 0x7f86c81dd900 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f86c806b320 tx=0x7f86c000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:18.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.154+0000 7f86c4ff9640 1 -- 172.21.15.91:0/1479078597 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0017400 con 0x7f86c8151b40 2023-11-27T20:46:18.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.154+0000 7f86c4ff9640 1 -- 172.21.15.91:0/1479078597 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c0011040 con 0x7f86c8151b40 2023-11-27T20:46:18.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.154+0000 7f86c4ff9640 1 -- 172.21.15.91:0/1479078597 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0017780 con 0x7f86c8151b40 2023-11-27T20:46:18.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.154+0000 7f86ce71d640 1 -- 172.21.15.91:0/1479078597 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80a8ca0 con 0x7f86c8151b40 2023-11-27T20:46:18.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.154+0000 7f86ce71d640 1 -- 172.21.15.91:0/1479078597 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c8071c60 con 0x7f86c8151b40 2023-11-27T20:46:18.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.155+0000 7f86ce71d640 1 -- 172.21.15.91:0/1479078597 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c8068350 con 0x7f86c8151b40 2023-11-27T20:46:18.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.156+0000 7f86c4ff9640 1 -- 172.21.15.91:0/1479078597 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f86c00203b0 con 0x7f86c8151b40 2023-11-27T20:46:18.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.157+0000 7f86c4ff9640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86b406b1c0 0x7f86b406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.157+0000 7f86c4ff9640 1 -- 172.21.15.91:0/1479078597 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f86c0089990 con 0x7f86c8151b40 2023-11-27T20:46:18.167 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.157+0000 7f86c7fff640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86b406b1c0 0x7f86b406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.158+0000 7f86c7fff640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86b406b1c0 0x7f86b406d680 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009a40 tx=0x7f86b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:18.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.162+0000 7f86c4ff9640 1 -- 172.21.15.91:0/1479078597 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f86c00549f0 con 0x7f86c8151b40 2023-11-27T20:46:18.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.353+0000 7f86ce71d640 1 -- 172.21.15.91:0/1479078597 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f86c81dd1c0 con 0x7f86b406b1c0 2023-11-27T20:46:18.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.354+0000 7f86c4ff9640 1 -- 172.21.15.91:0/1479078597 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f86c81dd1c0 con 0x7f86b406b1c0 2023-11-27T20:46:18.357 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 3 to deep-scrub 2023-11-27T20:46:18.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 -- 172.21.15.91:0/1479078597 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86b406b1c0 msgr2=0x7f86b406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86b406b1c0 0x7f86b406d680 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009a40 tx=0x7f86b8008040 comp rx=0 tx=0).stop 2023-11-27T20:46:18.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 -- 172.21.15.91:0/1479078597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86c8151b40 msgr2=0x7f86c81dd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86c8151b40 0x7f86c81dd900 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f86c806b320 tx=0x7f86c000f4a0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 -- 172.21.15.91:0/1479078597 shutdown_connections 2023-11-27T20:46:18.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86c8151b40 0x7f86c81dd900 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86c81de5a0 0x7f86c81dd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f86b406b1c0 0x7f86b406d680 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 --2- 172.21.15.91:0/1479078597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86b00047c0 0x7f86c8071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 -- 172.21.15.91:0/1479078597 >> 172.21.15.91:0/1479078597 conn(0x7f86c806a500 msgr2=0x7f86c81e0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:18.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 -- 172.21.15.91:0/1479078597 shutdown_connections 2023-11-27T20:46:18.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.357+0000 7f86ce71d640 1 -- 172.21.15.91:0/1479078597 wait complete. 2023-11-27T20:46:18.378 INFO:tasks.ceph:Scrubbing osd.4 2023-11-27T20:46:18.378 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-27T20:46:18.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.598+0000 7fa53b417640 1 Processor -- start 2023-11-27T20:46:18.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.599+0000 7fa53b417640 1 -- start start 2023-11-27T20:46:18.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.600+0000 7fa53b417640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa5340aa940 0x7fa534071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.600+0000 7fa53b417640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa5340c4180 0x7fa5340aad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.600+0000 7fa53b417640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5340a9560 con 0x7fa5340c4660 2023-11-27T20:46:18.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.600+0000 7fa53b417640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5340c3120 con 0x7fa5340c4180 2023-11-27T20:46:18.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.600+0000 7fa53b417640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5340a9820 con 0x7fa5340aa940 2023-11-27T20:46:18.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.601+0000 7fa5399b4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa5340c4180 0x7fa5340aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.601+0000 7fa5399b4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa5340c4180 0x7fa5340aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55580/0 (socket says 172.21.15.91:55580) 2023-11-27T20:46:18.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.601+0000 7fa5399b4640 1 -- 172.21.15.91:0/758773416 learned_addr learned my addr 172.21.15.91:0/758773416 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:18.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.601+0000 7fa5399b4640 1 -- 172.21.15.91:0/758773416 >> v2:172.21.15.183:3300/0 conn(0x7fa5340aa940 msgr2=0x7fa534071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:18.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.601+0000 7fa5399b4640 1 --2- 172.21.15.91:0/758773416 >> v2:172.21.15.183:3300/0 conn(0x7fa5340aa940 0x7fa534071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.601+0000 7fa5399b4640 1 -- 172.21.15.91:0/758773416 >> v1:172.21.15.183:6789/0 conn(0x7fa5340c4660 legacy=0x7fa5340a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:18.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.601+0000 7fa5399b4640 1 -- 172.21.15.91:0/758773416 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5340c4b50 con 0x7fa5340c4180 2023-11-27T20:46:18.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.603+0000 7fa5399b4640 1 --2- 172.21.15.91:0/758773416 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5340c4180 0x7fa5340aad20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fa5340c3c20 tx=0x7fa52c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddba9d2916611e6d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:18.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.603+0000 7fa52bfff640 1 -- 172.21.15.91:0/758773416 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c02c9f0 con 0x7fa5340c4180 2023-11-27T20:46:18.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.603+0000 7fa52bfff640 1 -- 172.21.15.91:0/758773416 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c02cb50 con 0x7fa5340c4180 2023-11-27T20:46:18.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.603+0000 7fa52bfff640 1 -- 172.21.15.91:0/758773416 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0343f0 con 0x7fa5340c4180 2023-11-27T20:46:18.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.604+0000 7fa53b417640 1 -- 172.21.15.91:0/758773416 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5340c4180 msgr2=0x7fa5340aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.604+0000 7fa53b417640 1 --2- 172.21.15.91:0/758773416 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5340c4180 0x7fa5340aad20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fa5340c3c20 tx=0x7fa52c02be50 comp rx=0 tx=0).stop 2023-11-27T20:46:18.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.604+0000 7fa53b417640 1 -- 172.21.15.91:0/758773416 shutdown_connections 2023-11-27T20:46:18.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.604+0000 7fa53b417640 1 --2- 172.21.15.91:0/758773416 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5340c4180 0x7fa5340aad20 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.604+0000 7fa53b417640 1 --2- 172.21.15.91:0/758773416 >> v2:172.21.15.183:3300/0 conn(0x7fa5340aa940 0x7fa534071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.604+0000 7fa53b417640 1 -- 172.21.15.91:0/758773416 >> 172.21.15.91:0/758773416 conn(0x7fa5340c5bc0 msgr2=0x7fa5340c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:18.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.604+0000 7fa53b417640 1 -- 172.21.15.91:0/758773416 shutdown_connections 2023-11-27T20:46:18.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.604+0000 7fa53b417640 1 -- 172.21.15.91:0/758773416 wait complete. 2023-11-27T20:46:18.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.606+0000 7fa53b417640 1 Processor -- start 2023-11-27T20:46:18.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.606+0000 7fa53b417640 1 -- start start 2023-11-27T20:46:18.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.607+0000 7fa53b417640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5340aa940 0x7fa5341ddd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.607+0000 7fa53b417640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5340c4180 0x7fa5340711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.607+0000 7fa53b417640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5340c4660 0x7fa5341ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.607+0000 7fa53b417640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5341e9e60 con 0x7fa5340aa940 2023-11-27T20:46:18.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.607+0000 7fa53b417640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5341dd330 con 0x7fa5340c4180 2023-11-27T20:46:18.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.607+0000 7fa53b417640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5341dd610 con 0x7fa5340c4660 2023-11-27T20:46:18.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.607+0000 7fa5391b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5340aa940 0x7fa5341ddd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.607+0000 7fa5391b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5340aa940 0x7fa5341ddd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55588/0 (socket says 172.21.15.91:55588) 2023-11-27T20:46:18.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.607+0000 7fa5391b3640 1 -- 172.21.15.91:0/1533519495 learned_addr learned my addr 172.21.15.91:0/1533519495 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:18.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa5399b4640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5340c4660 0x7fa5341ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa5389b2640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5340c4180 0x7fa5340711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa5391b3640 1 -- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5340c4660 msgr2=0x7fa5341ea360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa5391b3640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5340c4660 0x7fa5341ea360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa5391b3640 1 -- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5340c4180 msgr2=0x7fa5340711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa5391b3640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5340c4180 0x7fa5340711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa5391b3640 1 -- 172.21.15.91:0/1533519495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c009b30 con 0x7fa5340aa940 2023-11-27T20:46:18.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa5389b2640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5340c4180 0x7fa5340711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:18.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa5391b3640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5340aa940 0x7fa5341ddd50 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fa53000b410 tx=0x7fa53000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:18.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa529ffb640 1 -- 172.21.15.91:0/1533519495 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530011830 con 0x7fa5340aa940 2023-11-27T20:46:18.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa529ffb640 1 -- 172.21.15.91:0/1533519495 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5300119b0 con 0x7fa5340aa940 2023-11-27T20:46:18.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa529ffb640 1 -- 172.21.15.91:0/1533519495 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530011d60 con 0x7fa5340aa940 2023-11-27T20:46:18.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.608+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5341dd8f0 con 0x7fa5340aa940 2023-11-27T20:46:18.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.609+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5340716f0 con 0x7fa5340aa940 2023-11-27T20:46:18.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.609+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5340a9180 con 0x7fa5340aa940 2023-11-27T20:46:18.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.611+0000 7fa529ffb640 1 -- 172.21.15.91:0/1533519495 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa53001a400 con 0x7fa5340aa940 2023-11-27T20:46:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.611+0000 7fa529ffb640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa51806b1c0 0x7fa51806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.612+0000 7fa529ffb640 1 -- 172.21.15.91:0/1533519495 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa530089910 con 0x7fa5340aa940 2023-11-27T20:46:18.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.612+0000 7fa5389b2640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa51806b1c0 0x7fa51806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.612+0000 7fa529ffb640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] conn(0x7fa5180710c0 0x7fa5180734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.612+0000 7fa529ffb640 1 -- 172.21.15.91:0/1533519495 --> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa518073b90 con 0x7fa5180710c0 2023-11-27T20:46:18.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.612+0000 7fa529ffb640 1 -- 172.21.15.91:0/1533519495 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa53008e2a0 con 0x7fa5340aa940 2023-11-27T20:46:18.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.612+0000 7fa5389b2640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa51806b1c0 0x7fa51806d680 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa524007fd0 tx=0x7fa524009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:18.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.613+0000 7fa5399b4640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] conn(0x7fa5180710c0 0x7fa5180734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.615+0000 7fa5399b4640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] conn(0x7fa5180710c0 0x7fa5180734e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:18.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.617+0000 7fa529ffb640 1 -- 172.21.15.91:0/1533519495 <== osd.4 v2:172.21.15.183:6816/3858237641 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa518073b90 con 0x7fa5180710c0 2023-11-27T20:46:18.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.631+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 --> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5340c2e40 con 0x7fa5180710c0 2023-11-27T20:46:18.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.632+0000 7fa529ffb640 1 -- 172.21.15.91:0/1533519495 <== osd.4 v2:172.21.15.183:6816/3858237641 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa52c03e400 con 0x7fa5180710c0 2023-11-27T20:46:18.634 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:46:18.634 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T20:46:18.634 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:46:18.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] conn(0x7fa5180710c0 msgr2=0x7fa5180734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa53b417640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.183:6816/3858237641,v1:172.21.15.183:6817/3858237641] conn(0x7fa5180710c0 0x7fa5180734e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa51806b1c0 msgr2=0x7fa51806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa53b417640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fa51806b1c0 0x7fa51806d680 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa524007fd0 tx=0x7fa524009040 comp rx=0 tx=0).stop 2023-11-27T20:46:18.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5340aa940 msgr2=0x7fa5341ddd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa53b417640 1 --2- 172.21.15.91:0/1533519495 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5340aa940 0x7fa5341ddd50 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fa53000b410 tx=0x7fa53000b8d0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa5399b4640 1 -- 172.21.15.91:0/1533519495 reap_dead start 2023-11-27T20:46:18.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 shutdown_connections 2023-11-27T20:46:18.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 >> 172.21.15.91:0/1533519495 conn(0x7fa5340c5bc0 msgr2=0x7fa5341d93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:18.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 shutdown_connections 2023-11-27T20:46:18.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.633+0000 7fa53b417640 1 -- 172.21.15.91:0/1533519495 wait complete. 2023-11-27T20:46:18.653 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-27T20:46:18.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.862+0000 7fcfb85d7640 1 Processor -- start 2023-11-27T20:46:18.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.863+0000 7fcfb85d7640 1 -- start start 2023-11-27T20:46:18.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.864+0000 7fcfb85d7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcfb014fd30 0x7fcfb0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.864+0000 7fcfb85d7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcfb006d0a0 0x7fcfb00a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.864+0000 7fcfb85d7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00c64a0 con 0x7fcfb00a5260 2023-11-27T20:46:18.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.864+0000 7fcfb85d7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00c5c00 con 0x7fcfb014fd30 2023-11-27T20:46:18.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.864+0000 7fcfb85d7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00c5ee0 con 0x7fcfb006d0a0 2023-11-27T20:46:18.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.864+0000 7fcfb6373640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcfb014fd30 0x7fcfb0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.864+0000 7fcfb6373640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcfb014fd30 0x7fcfb0152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55600/0 (socket says 172.21.15.91:55600) 2023-11-27T20:46:18.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.864+0000 7fcfb6373640 1 -- 172.21.15.91:0/1142390911 learned_addr learned my addr 172.21.15.91:0/1142390911 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:18.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.864+0000 7fcfb6b74640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fcfb00a5260 0x7fcfb00c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:60136/0 (socket says 172.21.15.91:60136) 2023-11-27T20:46:18.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.865+0000 7fcfb5b72640 1 --2- 172.21.15.91:0/1142390911 >> v2:172.21.15.183:3300/0 conn(0x7fcfb006d0a0 0x7fcfb00a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.865+0000 7fcfb6373640 1 -- 172.21.15.91:0/1142390911 >> v2:172.21.15.183:3300/0 conn(0x7fcfb006d0a0 msgr2=0x7fcfb00a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:18.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.865+0000 7fcfb6373640 1 --2- 172.21.15.91:0/1142390911 >> v2:172.21.15.183:3300/0 conn(0x7fcfb006d0a0 0x7fcfb00a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.865+0000 7fcfb6373640 1 -- 172.21.15.91:0/1142390911 >> v1:172.21.15.91:6789/0 conn(0x7fcfb00a5260 legacy=0x7fcfb00c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.865+0000 7fcfb5371640 1 -- 172.21.15.91:0/1142390911 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845051007 0 0) 0x7fcfb00c64a0 con 0x7fcfb00a5260 2023-11-27T20:46:18.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.865+0000 7fcfb6373640 1 -- 172.21.15.91:0/1142390911 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb00c61c0 con 0x7fcfb014fd30 2023-11-27T20:46:18.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.866+0000 7fcfb6373640 1 --2- 172.21.15.91:0/1142390911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb014fd30 0x7fcfb0152f20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fcfb006b460 tx=0x7fcfac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a340c415555d87 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:18.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.866+0000 7fcfb5371640 1 -- 172.21.15.91:0/1142390911 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac030860 con 0x7fcfb014fd30 2023-11-27T20:46:18.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.866+0000 7fcfb5371640 1 -- 172.21.15.91:0/1142390911 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac0309c0 con 0x7fcfb014fd30 2023-11-27T20:46:18.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.866+0000 7fcfb5371640 1 -- 172.21.15.91:0/1142390911 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac030d50 con 0x7fcfb014fd30 2023-11-27T20:46:18.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.867+0000 7fcfb85d7640 1 -- 172.21.15.91:0/1142390911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb014fd30 msgr2=0x7fcfb0152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.867+0000 7fcfb85d7640 1 --2- 172.21.15.91:0/1142390911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb014fd30 0x7fcfb0152f20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fcfb006b460 tx=0x7fcfac02b9a0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.867+0000 7fcfb85d7640 1 -- 172.21.15.91:0/1142390911 shutdown_connections 2023-11-27T20:46:18.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.867+0000 7fcfb85d7640 1 --2- 172.21.15.91:0/1142390911 >> v2:172.21.15.183:3300/0 conn(0x7fcfb006d0a0 0x7fcfb00a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.867+0000 7fcfb85d7640 1 --2- 172.21.15.91:0/1142390911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb014fd30 0x7fcfb0152f20 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.867+0000 7fcfb85d7640 1 -- 172.21.15.91:0/1142390911 >> 172.21.15.91:0/1142390911 conn(0x7fcfb006a500 msgr2=0x7fcfb006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:18.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.867+0000 7fcfb85d7640 1 -- 172.21.15.91:0/1142390911 shutdown_connections 2023-11-27T20:46:18.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.867+0000 7fcfb85d7640 1 -- 172.21.15.91:0/1142390911 wait complete. 2023-11-27T20:46:18.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.868+0000 7fcfb85d7640 1 Processor -- start 2023-11-27T20:46:18.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.869+0000 7fcfb85d7640 1 -- start start 2023-11-27T20:46:18.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.869+0000 7fcfb85d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb006d0a0 0x7fcfb014e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.869+0000 7fcfb85d7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcfb00a5260 0x7fcfb01edf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.869+0000 7fcfb85d7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfb014fd30 0x7fcfb0151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.869+0000 7fcfb85d7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00a8c50 con 0x7fcfb006d0a0 2023-11-27T20:46:18.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb85d7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb01dd010 con 0x7fcfb014fd30 2023-11-27T20:46:18.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb85d7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb01dd3c0 con 0x7fcfb00a5260 2023-11-27T20:46:18.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb6373640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb006d0a0 0x7fcfb014e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb6373640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb006d0a0 0x7fcfb014e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55602/0 (socket says 172.21.15.91:55602) 2023-11-27T20:46:18.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb6373640 1 -- 172.21.15.91:0/240553748 learned_addr learned my addr 172.21.15.91:0/240553748 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:18.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb6373640 1 -- 172.21.15.91:0/240553748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcfb00a5260 msgr2=0x7fcfb01edf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb6373640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcfb00a5260 0x7fcfb01edf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb6373640 1 -- 172.21.15.91:0/240553748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfb014fd30 msgr2=0x7fcfb0151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:18.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb6373640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfb014fd30 0x7fcfb0151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:18.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb6373640 1 -- 172.21.15.91:0/240553748 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac0094d0 con 0x7fcfb006d0a0 2023-11-27T20:46:18.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.870+0000 7fcfb6373640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb006d0a0 0x7fcfb014e9f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fcfac000c00 tx=0x7fcfac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:18.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.871+0000 7fcfa6ffd640 1 -- 172.21.15.91:0/240553748 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac039b60 con 0x7fcfb006d0a0 2023-11-27T20:46:18.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.871+0000 7fcfa6ffd640 1 -- 172.21.15.91:0/240553748 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac039ce0 con 0x7fcfb006d0a0 2023-11-27T20:46:18.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.871+0000 7fcfb85d7640 1 -- 172.21.15.91:0/240553748 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb00a8900 con 0x7fcfb006d0a0 2023-11-27T20:46:18.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.871+0000 7fcfa6ffd640 1 -- 172.21.15.91:0/240553748 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac043650 con 0x7fcfb006d0a0 2023-11-27T20:46:18.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.871+0000 7fcfb85d7640 1 -- 172.21.15.91:0/240553748 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb01dbce0 con 0x7fcfb006d0a0 2023-11-27T20:46:18.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.872+0000 7fcfb85d7640 1 -- 172.21.15.91:0/240553748 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb01dbed0 con 0x7fcfb006d0a0 2023-11-27T20:46:18.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.873+0000 7fcfa6ffd640 1 -- 172.21.15.91:0/240553748 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcfac04c3b0 con 0x7fcfb006d0a0 2023-11-27T20:46:18.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.874+0000 7fcfa6ffd640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf9406b1c0 0x7fcf9406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:18.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.874+0000 7fcfa6ffd640 1 -- 172.21.15.91:0/240553748 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcfac0abe30 con 0x7fcfb006d0a0 2023-11-27T20:46:18.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.874+0000 7fcfb5b72640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf9406b1c0 0x7fcf9406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:18.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.875+0000 7fcfb5b72640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf9406b1c0 0x7fcf9406d680 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcfb006ae40 tx=0x7fcfa0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:18.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:18.879+0000 7fcfa6ffd640 1 -- 172.21.15.91:0/240553748 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcfac076df0 con 0x7fcfb006d0a0 2023-11-27T20:46:19.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.073+0000 7fcfb85d7640 1 -- 172.21.15.91:0/240553748 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfb00c45b0 con 0x7fcf9406b1c0 2023-11-27T20:46:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.073+0000 7fcfa6ffd640 1 -- 172.21.15.91:0/240553748 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcfa0009e40 con 0x7fcf9406b1c0 2023-11-27T20:46:19.079 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 4 to deep-scrub 2023-11-27T20:46:19.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 -- 172.21.15.91:0/240553748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf9406b1c0 msgr2=0x7fcf9406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf9406b1c0 0x7fcf9406d680 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcfb006ae40 tx=0x7fcfa0008040 comp rx=0 tx=0).stop 2023-11-27T20:46:19.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 -- 172.21.15.91:0/240553748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb006d0a0 msgr2=0x7fcfb014e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb006d0a0 0x7fcfb014e9f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fcfac000c00 tx=0x7fcfac004730 comp rx=0 tx=0).stop 2023-11-27T20:46:19.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 -- 172.21.15.91:0/240553748 shutdown_connections 2023-11-27T20:46:19.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fcf9406b1c0 0x7fcf9406d680 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfb014fd30 0x7fcfb0151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcfb00a5260 0x7fcfb01edf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 --2- 172.21.15.91:0/240553748 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcfb006d0a0 0x7fcfb014e9f0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 -- 172.21.15.91:0/240553748 >> 172.21.15.91:0/240553748 conn(0x7fcfb006a500 msgr2=0x7fcfb00c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:19.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 -- 172.21.15.91:0/240553748 shutdown_connections 2023-11-27T20:46:19.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.076+0000 7fcfb85d7640 1 -- 172.21.15.91:0/240553748 wait complete. 2023-11-27T20:46:19.097 INFO:tasks.ceph:Scrubbing osd.5 2023-11-27T20:46:19.097 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-27T20:46:19.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.313+0000 7f32b2d21640 1 Processor -- start 2023-11-27T20:46:19.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.314+0000 7f32b2d21640 1 -- start start 2023-11-27T20:46:19.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.315+0000 7f32b2d21640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32ac0c7d40 0x7f32ac06b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.315+0000 7f32b2d21640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32ac06b7d0 0x7f32ac15eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.315+0000 7f32b2d21640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac06c650 con 0x7f32ac151cd0 2023-11-27T20:46:19.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.315+0000 7f32b2d21640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac1520b0 con 0x7f32ac0c7d40 2023-11-27T20:46:19.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.315+0000 7f32b2d21640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0c85f0 con 0x7f32ac06b7d0 2023-11-27T20:46:19.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.315+0000 7f32b151e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32ac0c7d40 0x7f32ac06b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.315+0000 7f32b151e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32ac0c7d40 0x7f32ac06b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55610/0 (socket says 172.21.15.91:55610) 2023-11-27T20:46:19.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.315+0000 7f32b151e640 1 -- 172.21.15.91:0/746416058 learned_addr learned my addr 172.21.15.91:0/746416058 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:19.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.316+0000 7f32b151e640 1 -- 172.21.15.91:0/746416058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32ac06b7d0 msgr2=0x7f32ac15eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:19.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.316+0000 7f32b151e640 1 --2- 172.21.15.91:0/746416058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32ac06b7d0 0x7f32ac15eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.316+0000 7f32b151e640 1 -- 172.21.15.91:0/746416058 >> v1:172.21.15.183:6789/0 conn(0x7f32ac151cd0 legacy=0x7f32ac0c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:19.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.316+0000 7f32b151e640 1 -- 172.21.15.91:0/746416058 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac157cd0 con 0x7f32ac0c7d40 2023-11-27T20:46:19.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.317+0000 7f32b151e640 1 --2- 172.21.15.91:0/746416058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32ac0c7d40 0x7f32ac06b290 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009870 tx=0x7f32a002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac23c0da0e3f6ee server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.317+0000 7f32b0d1d640 1 -- 172.21.15.91:0/746416058 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00317c0 con 0x7f32ac0c7d40 2023-11-27T20:46:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.317+0000 7f32b0d1d640 1 -- 172.21.15.91:0/746416058 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a0031920 con 0x7f32ac0c7d40 2023-11-27T20:46:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.317+0000 7f32b0d1d640 1 -- 172.21.15.91:0/746416058 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0031cb0 con 0x7f32ac0c7d40 2023-11-27T20:46:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.318+0000 7f32b2d21640 1 -- 172.21.15.91:0/746416058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32ac0c7d40 msgr2=0x7f32ac06b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.318+0000 7f32b2d21640 1 --2- 172.21.15.91:0/746416058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32ac0c7d40 0x7f32ac06b290 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009870 tx=0x7f32a002b860 comp rx=0 tx=0).stop 2023-11-27T20:46:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.318+0000 7f32b2d21640 1 -- 172.21.15.91:0/746416058 shutdown_connections 2023-11-27T20:46:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.318+0000 7f32b2d21640 1 --2- 172.21.15.91:0/746416058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32ac06b7d0 0x7f32ac15eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.318+0000 7f32b2d21640 1 --2- 172.21.15.91:0/746416058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32ac0c7d40 0x7f32ac06b290 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.318+0000 7f32b2d21640 1 -- 172.21.15.91:0/746416058 >> 172.21.15.91:0/746416058 conn(0x7f32ac0abbd0 msgr2=0x7f32ac0abfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.318+0000 7f32b2d21640 1 -- 172.21.15.91:0/746416058 shutdown_connections 2023-11-27T20:46:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.318+0000 7f32b2d21640 1 -- 172.21.15.91:0/746416058 wait complete. 2023-11-27T20:46:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.320+0000 7f32b2d21640 1 Processor -- start 2023-11-27T20:46:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.320+0000 7f32b2d21640 1 -- start start 2023-11-27T20:46:19.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b2d21640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32ac06b7d0 0x7f32ac0add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b2d21640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ac0c7d40 0x7f32ac14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b2d21640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32ac151cd0 0x7f32ac1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b2d21640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0afb60 con 0x7f32ac151cd0 2023-11-27T20:46:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b2d21640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0ae240 con 0x7f32ac0c7d40 2023-11-27T20:46:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b2d21640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac14a680 con 0x7f32ac06b7d0 2023-11-27T20:46:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b2520640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32ac151cd0 0x7f32ac1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b2520640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32ac151cd0 0x7f32ac1496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55618/0 (socket says 172.21.15.91:55618) 2023-11-27T20:46:19.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b2520640 1 -- 172.21.15.91:0/3045479930 learned_addr learned my addr 172.21.15.91:0/3045479930 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b151e640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ac0c7d40 0x7f32ac14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32b2520640 1 -- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32ac06b7d0 msgr2=0x7f32ac0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.321+0000 7f32b1d1f640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32ac06b7d0 0x7f32ac0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32b2520640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32ac06b7d0 0x7f32ac0add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32b2520640 1 -- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ac0c7d40 msgr2=0x7f32ac14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32b2520640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ac0c7d40 0x7f32ac14df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32b2520640 1 -- 172.21.15.91:0/3045479930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a00094d0 con 0x7f32ac151cd0 2023-11-27T20:46:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32b151e640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ac0c7d40 0x7f32ac14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:19.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32b1d1f640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f32ac06b7d0 0x7f32ac0add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32b2520640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32ac151cd0 0x7f32ac1496a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f32a400b970 tx=0x7f32a400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32aa7fc640 1 -- 172.21.15.91:0/3045479930 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400cb40 con 0x7f32ac151cd0 2023-11-27T20:46:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32aa7fc640 1 -- 172.21.15.91:0/3045479930 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a400ccc0 con 0x7f32ac151cd0 2023-11-27T20:46:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32aa7fc640 1 -- 172.21.15.91:0/3045479930 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4014680 con 0x7f32ac151cd0 2023-11-27T20:46:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac14a960 con 0x7f32ac151cd0 2023-11-27T20:46:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.322+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac0ad7e0 con 0x7f32ac151cd0 2023-11-27T20:46:19.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.323+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f32ac14b490 con 0x7f32ac151cd0 2023-11-27T20:46:19.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.325+0000 7f32aa7fc640 1 -- 172.21.15.91:0/3045479930 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f32a401d3b0 con 0x7f32ac151cd0 2023-11-27T20:46:19.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.325+0000 7f32aa7fc640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f329806b1f0 0x7f329806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.326+0000 7f32aa7fc640 1 -- 172.21.15.91:0/3045479930 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f32a4089eb0 con 0x7f32ac151cd0 2023-11-27T20:46:19.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.326+0000 7f32aa7fc640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] conn(0x7f32980710f0 0x7f3298073510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.326+0000 7f32aa7fc640 1 -- 172.21.15.91:0/3045479930 --> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3298073bc0 con 0x7f32980710f0 2023-11-27T20:46:19.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.326+0000 7f32b1d1f640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f329806b1f0 0x7f329806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.326+0000 7f32aa7fc640 1 -- 172.21.15.91:0/3045479930 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32a408a220 con 0x7f32ac151cd0 2023-11-27T20:46:19.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.326+0000 7f32b1d1f640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f329806b1f0 0x7f329806d6b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f329c00a830 tx=0x7f329c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:19.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.327+0000 7f32b151e640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] conn(0x7f32980710f0 0x7f3298073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.329+0000 7f32b151e640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] conn(0x7f32980710f0 0x7f3298073510 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:19.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.331+0000 7f32aa7fc640 1 -- 172.21.15.91:0/3045479930 <== osd.5 v2:172.21.15.183:6808/1862351799 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3298073bc0 con 0x7f32980710f0 2023-11-27T20:46:19.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.346+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 --> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f32ac0c6e70 con 0x7f32980710f0 2023-11-27T20:46:19.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.347+0000 7f32aa7fc640 1 -- 172.21.15.91:0/3045479930 <== osd.5 v2:172.21.15.183:6808/1862351799 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f32ac0c6e70 con 0x7f32980710f0 2023-11-27T20:46:19.349 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:46:19.349 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T20:46:19.350 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:46:19.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.347+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] conn(0x7f32980710f0 msgr2=0x7f3298073510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.347+0000 7f32b2d21640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.183:6808/1862351799,v1:172.21.15.183:6809/1862351799] conn(0x7f32980710f0 0x7f3298073510 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.347+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f329806b1f0 msgr2=0x7f329806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.347+0000 7f32b2d21640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f329806b1f0 0x7f329806d6b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f329c00a830 tx=0x7f329c008040 comp rx=0 tx=0).stop 2023-11-27T20:46:19.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.347+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32ac151cd0 msgr2=0x7f32ac1496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.347+0000 7f32b2d21640 1 --2- 172.21.15.91:0/3045479930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32ac151cd0 0x7f32ac1496a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f32a400b970 tx=0x7f32a400be30 comp rx=0 tx=0).stop 2023-11-27T20:46:19.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.347+0000 7f32b2520640 1 -- 172.21.15.91:0/3045479930 reap_dead start 2023-11-27T20:46:19.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.348+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 shutdown_connections 2023-11-27T20:46:19.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.348+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 >> 172.21.15.91:0/3045479930 conn(0x7f32ac0abbd0 msgr2=0x7f32ac0ab130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:19.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.348+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 shutdown_connections 2023-11-27T20:46:19.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.348+0000 7f32b2d21640 1 -- 172.21.15.91:0/3045479930 wait complete. 2023-11-27T20:46:19.367 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-27T20:46:19.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.578+0000 7f76f10f3640 1 Processor -- start 2023-11-27T20:46:19.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.579+0000 7f76f10f3640 1 -- start start 2023-11-27T20:46:19.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.580+0000 7f76f10f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76ec152f20 0x7f76ec0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.580+0000 7f76f10f3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0c64a0 con 0x7f76ec06d0a0 2023-11-27T20:46:19.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.580+0000 7f76f10f3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0c5c00 con 0x7f76ec14fd30 2023-11-27T20:46:19.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.580+0000 7f76f10f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0c5ee0 con 0x7f76ec152f20 2023-11-27T20:46:19.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.580+0000 7f76e3fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f76ec06d0a0 0x7f76ec0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:60148/0 (socket says 172.21.15.91:60148) 2023-11-27T20:46:19.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.580+0000 7f76e3fff640 1 -- 172.21.15.91:0/2144371332 learned_addr learned my addr 172.21.15.91:0/2144371332 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:19.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76eb59e640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76ec152f20 0x7f76ec0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45818364 0 0) 0x7f76ec0c64a0 con 0x7f76ec06d0a0 2023-11-27T20:46:19.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d8003520 con 0x7f76ec06d0a0 2023-11-27T20:46:19.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2575837884 0 0) 0x7f76d8003520 con 0x7f76ec06d0a0 2023-11-27T20:46:19.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76ec152f20 msgr2=0x7f76ec0c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:19.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76ec152f20 0x7f76ec0c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 >> v1:172.21.15.183:6789/0 conn(0x7f76ec14fd30 legacy=0x7f76ec0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0c61c0 con 0x7f76ec06d0a0 2023-11-27T20:46:19.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f76d4001670 con 0x7f76ec06d0a0 2023-11-27T20:46:19.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 >> v1:172.21.15.91:6789/0 conn(0x7f76ec06d0a0 legacy=0x7f76ec0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76ec152f20 0x7f76d80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.581+0000 7f76ea59c640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76d8003f20 0x7f76d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76ea59c640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76d8004d00 0x7f76d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0c5ee0 con 0x7f76d8004d00 2023-11-27T20:46:19.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d800ba60 con 0x7f76d8003f20 2023-11-27T20:46:19.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d800bc20 con 0x7f76ec152f20 2023-11-27T20:46:19.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76eb59e640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76d8004d00 0x7f76d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76ead9d640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76ec152f20 0x7f76d80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76eb59e640 1 -- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76ec152f20 msgr2=0x7f76d80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:19.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76eb59e640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76ec152f20 0x7f76d80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76eb59e640 1 -- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76d8003f20 msgr2=0x7f76d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:19.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76e3fff640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76d8003f20 0x7f76d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76eb59e640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76d8003f20 0x7f76d80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76eb59e640 1 -- 172.21.15.91:0/2144371332 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8003520 con 0x7f76d8004d00 2023-11-27T20:46:19.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.582+0000 7f76ead9d640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76ec152f20 0x7f76d80039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:19.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.583+0000 7f76eb59e640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76d8004d00 0x7f76d8005180 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009fc0 tx=0x7f76d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245c10479ef1f3c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:19.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.584+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e402cbf0 con 0x7f76d8004d00 2023-11-27T20:46:19.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.584+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e400f040 con 0x7f76d8004d00 2023-11-27T20:46:19.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.584+0000 7f76ea59c640 1 -- 172.21.15.91:0/2144371332 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4034440 con 0x7f76d8004d00 2023-11-27T20:46:19.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.584+0000 7f76f10f3640 1 -- 172.21.15.91:0/2144371332 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76d8004d00 msgr2=0x7f76d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.584+0000 7f76f10f3640 1 --2- 172.21.15.91:0/2144371332 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76d8004d00 0x7f76d8005180 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009fc0 tx=0x7f76d80057f0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.584+0000 7f76eb59e640 1 -- 172.21.15.91:0/2144371332 reap_dead start 2023-11-27T20:46:19.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.584+0000 7f76f10f3640 1 -- 172.21.15.91:0/2144371332 shutdown_connections 2023-11-27T20:46:19.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.584+0000 7f76f10f3640 1 -- 172.21.15.91:0/2144371332 >> 172.21.15.91:0/2144371332 conn(0x7f76ec06a500 msgr2=0x7f76ec06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:19.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.584+0000 7f76f10f3640 1 -- 172.21.15.91:0/2144371332 shutdown_connections 2023-11-27T20:46:19.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.584+0000 7f76f10f3640 1 -- 172.21.15.91:0/2144371332 wait complete. 2023-11-27T20:46:19.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.586+0000 7f76f10f3640 1 Processor -- start 2023-11-27T20:46:19.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.586+0000 7f76f10f3640 1 -- start start 2023-11-27T20:46:19.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.587+0000 7f76f10f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76d8004d00 0x7f76ec1e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.587+0000 7f76f10f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76ec1564e0 0x7f76ec14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.587+0000 7f76f10f3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76ec1e2b40 0x7f76ec1e2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.587+0000 7f76f10f3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0721a0 con 0x7f76ec1e2b40 2023-11-27T20:46:19.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.587+0000 7f76f10f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec1e3500 con 0x7f76ec1564e0 2023-11-27T20:46:19.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.587+0000 7f76f10f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec071be0 con 0x7f76d8004d00 2023-11-27T20:46:19.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.587+0000 7f76eb59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76ec1e2b40 0x7f76ec1e2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.587+0000 7f76eb59e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76ec1e2b40 0x7f76ec1e2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55636/0 (socket says 172.21.15.91:55636) 2023-11-27T20:46:19.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.587+0000 7f76eb59e640 1 -- 172.21.15.91:0/4197979635 learned_addr learned my addr 172.21.15.91:0/4197979635 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:19.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76ead9d640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76d8004d00 0x7f76ec1e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76e3fff640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76ec1564e0 0x7f76ec14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76eb59e640 1 -- 172.21.15.91:0/4197979635 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76d8004d00 msgr2=0x7f76ec1e62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76eb59e640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76d8004d00 0x7f76ec1e62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76eb59e640 1 -- 172.21.15.91:0/4197979635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76ec1564e0 msgr2=0x7f76ec14e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76eb59e640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76ec1564e0 0x7f76ec14e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76eb59e640 1 -- 172.21.15.91:0/4197979635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec071ec0 con 0x7f76ec1e2b40 2023-11-27T20:46:19.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76eb59e640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76ec1e2b40 0x7f76ec1e2fc0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f76e4002230 tx=0x7f76e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:19.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76e37fe640 1 -- 172.21.15.91:0/4197979635 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4043070 con 0x7f76ec1e2b40 2023-11-27T20:46:19.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76e37fe640 1 -- 172.21.15.91:0/4197979635 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e402de80 con 0x7f76ec1e2b40 2023-11-27T20:46:19.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76e37fe640 1 -- 172.21.15.91:0/4197979635 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4034d10 con 0x7f76ec1e2b40 2023-11-27T20:46:19.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.588+0000 7f76f10f3640 1 -- 172.21.15.91:0/4197979635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec071070 con 0x7f76ec1e2b40 2023-11-27T20:46:19.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.589+0000 7f76f10f3640 1 -- 172.21.15.91:0/4197979635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec0725f0 con 0x7f76ec1e2b40 2023-11-27T20:46:19.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.590+0000 7f76f10f3640 1 -- 172.21.15.91:0/4197979635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ec1568c0 con 0x7f76ec1e2b40 2023-11-27T20:46:19.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.591+0000 7f76e37fe640 1 -- 172.21.15.91:0/4197979635 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f76e403e440 con 0x7f76ec1e2b40 2023-11-27T20:46:19.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.591+0000 7f76e37fe640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f76cc06b1f0 0x7f76cc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:19.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.592+0000 7f76e37fe640 1 -- 172.21.15.91:0/4197979635 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f76e40ab2f0 con 0x7f76ec1e2b40 2023-11-27T20:46:19.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.592+0000 7f76ead9d640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f76cc06b1f0 0x7f76cc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:19.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.592+0000 7f76ead9d640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f76cc06b1f0 0x7f76cc06d6b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f76dc001750 tx=0x7f76dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:19.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.596+0000 7f76e37fe640 1 -- 172.21.15.91:0/4197979635 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f76e4076350 con 0x7f76ec1e2b40 2023-11-27T20:46:19.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.783+0000 7f76f10f3640 1 -- 172.21.15.91:0/4197979635 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f76ec072980 con 0x7f76cc06b1f0 2023-11-27T20:46:19.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.784+0000 7f76e37fe640 1 -- 172.21.15.91:0/4197979635 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f76dc00d050 con 0x7f76cc06b1f0 2023-11-27T20:46:19.786 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 5 to deep-scrub 2023-11-27T20:46:19.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.786+0000 7f76f10f3640 1 -- 172.21.15.91:0/4197979635 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f76cc06b1f0 msgr2=0x7f76cc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.786+0000 7f76f10f3640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f76cc06b1f0 0x7f76cc06d6b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f76dc001750 tx=0x7f76dc009040 comp rx=0 tx=0).stop 2023-11-27T20:46:19.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.786+0000 7f76f10f3640 1 -- 172.21.15.91:0/4197979635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76ec1e2b40 msgr2=0x7f76ec1e2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:19.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.786+0000 7f76f10f3640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76ec1e2b40 0x7f76ec1e2fc0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f76e4002230 tx=0x7f76e4009750 comp rx=0 tx=0).stop 2023-11-27T20:46:19.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.787+0000 7f76f10f3640 1 -- 172.21.15.91:0/4197979635 shutdown_connections 2023-11-27T20:46:19.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.787+0000 7f76f10f3640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f76ec1e2b40 0x7f76ec1e2fc0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.787+0000 7f76f10f3640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f76cc06b1f0 0x7f76cc06d6b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.787+0000 7f76f10f3640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76ec1564e0 0x7f76ec14e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.787+0000 7f76f10f3640 1 --2- 172.21.15.91:0/4197979635 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76d8004d00 0x7f76ec1e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:19.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.787+0000 7f76f10f3640 1 -- 172.21.15.91:0/4197979635 >> 172.21.15.91:0/4197979635 conn(0x7f76ec06a500 msgr2=0x7f76ec0a67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:19.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.787+0000 7f76f10f3640 1 -- 172.21.15.91:0/4197979635 shutdown_connections 2023-11-27T20:46:19.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:19.787+0000 7f76f10f3640 1 -- 172.21.15.91:0/4197979635 wait complete. 2023-11-27T20:46:19.807 INFO:tasks.ceph:Scrubbing osd.6 2023-11-27T20:46:19.808 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-27T20:46:20.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.021+0000 7fc54b997640 1 Processor -- start 2023-11-27T20:46:20.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.021+0000 7fc54b997640 1 -- start start 2023-11-27T20:46:20.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.022+0000 7fc54b997640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5440a8c70 0x7fc54406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.022+0000 7fc54b997640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc5440c1210 0x7fc54406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.022+0000 7fc54b997640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5440a5750 con 0x7fc5440a5370 2023-11-27T20:46:20.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.023+0000 7fc54b997640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5440c3380 con 0x7fc5440c1210 2023-11-27T20:46:20.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.023+0000 7fc54b997640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54406c570 con 0x7fc5440a8c70 2023-11-27T20:46:20.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.023+0000 7fc549f34640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc5440c1210 0x7fc54406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.023+0000 7fc549f34640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc5440c1210 0x7fc54406d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55642/0 (socket says 172.21.15.91:55642) 2023-11-27T20:46:20.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.023+0000 7fc549f34640 1 -- 172.21.15.91:0/359286682 learned_addr learned my addr 172.21.15.91:0/359286682 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:20.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.023+0000 7fc548f32640 1 --2- 172.21.15.91:0/359286682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5440a8c70 0x7fc54406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.023+0000 7fc549f34640 1 -- 172.21.15.91:0/359286682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5440a8c70 msgr2=0x7fc54406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:20.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.023+0000 7fc549f34640 1 --2- 172.21.15.91:0/359286682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5440a8c70 0x7fc54406d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.023+0000 7fc549f34640 1 -- 172.21.15.91:0/359286682 >> v1:172.21.15.183:6789/0 conn(0x7fc5440a5370 legacy=0x7fc5440c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:20.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.023+0000 7fc549f34640 1 -- 172.21.15.91:0/359286682 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54406c850 con 0x7fc5440c1210 2023-11-27T20:46:20.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.024+0000 7fc549f34640 1 --2- 172.21.15.91:0/359286682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5440c1210 0x7fc54406d870 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009e50 tx=0x7fc53c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3863184a8213e22c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.025+0000 7fc53bfff640 1 -- 172.21.15.91:0/359286682 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c02c9e0 con 0x7fc5440c1210 2023-11-27T20:46:20.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.025+0000 7fc53bfff640 1 -- 172.21.15.91:0/359286682 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c02cb40 con 0x7fc5440c1210 2023-11-27T20:46:20.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.025+0000 7fc53bfff640 1 -- 172.21.15.91:0/359286682 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0343f0 con 0x7fc5440c1210 2023-11-27T20:46:20.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.025+0000 7fc54b997640 1 -- 172.21.15.91:0/359286682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5440c1210 msgr2=0x7fc54406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.025+0000 7fc54b997640 1 --2- 172.21.15.91:0/359286682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5440c1210 0x7fc54406d870 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009e50 tx=0x7fc53c02be40 comp rx=0 tx=0).stop 2023-11-27T20:46:20.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.025+0000 7fc54b997640 1 -- 172.21.15.91:0/359286682 shutdown_connections 2023-11-27T20:46:20.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.025+0000 7fc54b997640 1 --2- 172.21.15.91:0/359286682 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5440c1210 0x7fc54406d870 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.025+0000 7fc54b997640 1 --2- 172.21.15.91:0/359286682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5440a8c70 0x7fc54406d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.025+0000 7fc54b997640 1 -- 172.21.15.91:0/359286682 >> 172.21.15.91:0/359286682 conn(0x7fc5440c5bc0 msgr2=0x7fc5440c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:20.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.026+0000 7fc54b997640 1 -- 172.21.15.91:0/359286682 shutdown_connections 2023-11-27T20:46:20.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.026+0000 7fc54b997640 1 -- 172.21.15.91:0/359286682 wait complete. 2023-11-27T20:46:20.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.027+0000 7fc54b997640 1 Processor -- start 2023-11-27T20:46:20.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.027+0000 7fc54b997640 1 -- start start 2023-11-27T20:46:20.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.028+0000 7fc54b997640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5440a5370 0x7fc5441eb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.028+0000 7fc54b997640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5440a8c70 0x7fc544150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.028+0000 7fc54b997640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5440c1210 0x7fc544150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.028+0000 7fc54b997640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc544153e70 con 0x7fc5440a8c70 2023-11-27T20:46:20.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.028+0000 7fc54b997640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc544153560 con 0x7fc5440a5370 2023-11-27T20:46:20.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.028+0000 7fc54b997640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54414e010 con 0x7fc5440c1210 2023-11-27T20:46:20.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.029+0000 7fc548f32640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5440a8c70 0x7fc544150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.029+0000 7fc548f32640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5440a8c70 0x7fc544150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55658/0 (socket says 172.21.15.91:55658) 2023-11-27T20:46:20.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.029+0000 7fc548f32640 1 -- 172.21.15.91:0/3439804521 learned_addr learned my addr 172.21.15.91:0/3439804521 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:20.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.029+0000 7fc548f32640 1 -- 172.21.15.91:0/3439804521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5440c1210 msgr2=0x7fc544150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.029+0000 7fc548f32640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5440c1210 0x7fc544150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.029+0000 7fc548f32640 1 -- 172.21.15.91:0/3439804521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5440a5370 msgr2=0x7fc5441eb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.029+0000 7fc548f32640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5440a5370 0x7fc5441eb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.029+0000 7fc548f32640 1 -- 172.21.15.91:0/3439804521 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c009b30 con 0x7fc5440a8c70 2023-11-27T20:46:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.029+0000 7fc548f32640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5440a8c70 0x7fc544150790 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c7f0 tx=0x7fc53400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.030+0000 7fc539ffb640 1 -- 172.21.15.91:0/3439804521 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534004220 con 0x7fc5440a8c70 2023-11-27T20:46:20.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.030+0000 7fc539ffb640 1 -- 172.21.15.91:0/3439804521 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc534004380 con 0x7fc5440a8c70 2023-11-27T20:46:20.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.030+0000 7fc539ffb640 1 -- 172.21.15.91:0/3439804521 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534007840 con 0x7fc5440a8c70 2023-11-27T20:46:20.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.030+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5441ec0e0 con 0x7fc5440a8c70 2023-11-27T20:46:20.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.030+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc544153a90 con 0x7fc5440a8c70 2023-11-27T20:46:20.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.031+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc54406bca0 con 0x7fc5440a8c70 2023-11-27T20:46:20.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.032+0000 7fc539ffb640 1 -- 172.21.15.91:0/3439804521 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc534007bb0 con 0x7fc5440a8c70 2023-11-27T20:46:20.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.033+0000 7fc539ffb640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc52806b1c0 0x7fc52806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.035 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.033+0000 7fc539ffb640 1 -- 172.21.15.91:0/3439804521 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc534089780 con 0x7fc5440a8c70 2023-11-27T20:46:20.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.033+0000 7fc549733640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc52806b1c0 0x7fc52806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.033+0000 7fc539ffb640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] conn(0x7fc5280710c0 0x7fc5280734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.033+0000 7fc539ffb640 1 -- 172.21.15.91:0/3439804521 --> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc528073b90 con 0x7fc5280710c0 2023-11-27T20:46:20.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.033+0000 7fc539ffb640 1 -- 172.21.15.91:0/3439804521 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc53408bd60 con 0x7fc5440a8c70 2023-11-27T20:46:20.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.034+0000 7fc549733640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc52806b1c0 0x7fc52806d680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc540006fd0 tx=0x7fc540006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.034+0000 7fc549f34640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] conn(0x7fc5280710c0 0x7fc5280734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.035+0000 7fc549f34640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] conn(0x7fc5280710c0 0x7fc5280734e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.037+0000 7fc539ffb640 1 -- 172.21.15.91:0/3439804521 <== osd.6 v2:172.21.15.183:6800/953643252 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc528073b90 con 0x7fc5280710c0 2023-11-27T20:46:20.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.051+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 --> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc5440c3010 con 0x7fc5280710c0 2023-11-27T20:46:20.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.052+0000 7fc539ffb640 1 -- 172.21.15.91:0/3439804521 <== osd.6 v2:172.21.15.183:6800/953643252 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc53c02c8b0 con 0x7fc5280710c0 2023-11-27T20:46:20.054 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:46:20.054 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T20:46:20.054 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:46:20.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.053+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 >> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] conn(0x7fc5280710c0 msgr2=0x7fc5280734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.053+0000 7fc54b997640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.183:6800/953643252,v1:172.21.15.183:6801/953643252] conn(0x7fc5280710c0 0x7fc5280734e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.053+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc52806b1c0 msgr2=0x7fc52806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.053+0000 7fc54b997640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fc52806b1c0 0x7fc52806d680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc540006fd0 tx=0x7fc540006bc0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.053+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5440a8c70 msgr2=0x7fc544150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.053+0000 7fc54b997640 1 --2- 172.21.15.91:0/3439804521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5440a8c70 0x7fc544150790 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c7f0 tx=0x7fc53400ccb0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.053+0000 7fc549f34640 1 -- 172.21.15.91:0/3439804521 reap_dead start 2023-11-27T20:46:20.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.053+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 shutdown_connections 2023-11-27T20:46:20.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.053+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 >> 172.21.15.91:0/3439804521 conn(0x7fc5440c5bc0 msgr2=0x7fc5440c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:20.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.053+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 shutdown_connections 2023-11-27T20:46:20.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.054+0000 7fc54b997640 1 -- 172.21.15.91:0/3439804521 wait complete. 2023-11-27T20:46:20.071 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-27T20:46:20.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.283+0000 7f8d957f1640 1 Processor -- start 2023-11-27T20:46:20.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.284+0000 7f8d957f1640 1 -- start start 2023-11-27T20:46:20.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.285+0000 7f8d957f1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8d9006d0a0 0x7f8d90152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.285+0000 7f8d957f1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8d900c3ea0 0x7f8d900c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.285+0000 7f8d957f1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d900c64a0 con 0x7f8d9014fd30 2023-11-27T20:46:20.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.285+0000 7f8d957f1640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d900c5c00 con 0x7f8d9006d0a0 2023-11-27T20:46:20.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.285+0000 7f8d957f1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d900c5ee0 con 0x7f8d900c3ea0 2023-11-27T20:46:20.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.285+0000 7f8d87fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8d9006d0a0 0x7f8d90152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.285+0000 7f8d87fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8d9006d0a0 0x7f8d90152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55672/0 (socket says 172.21.15.91:55672) 2023-11-27T20:46:20.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.285+0000 7f8d87fff640 1 -- 172.21.15.91:0/1142048184 learned_addr learned my addr 172.21.15.91:0/1142048184 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:20.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.286+0000 7f8d8f7fe640 1 --2- 172.21.15.91:0/1142048184 >> v2:172.21.15.183:3300/0 conn(0x7f8d900c3ea0 0x7f8d900c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.286+0000 7f8d87fff640 1 -- 172.21.15.91:0/1142048184 >> v2:172.21.15.183:3300/0 conn(0x7f8d900c3ea0 msgr2=0x7f8d900c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:20.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.286+0000 7f8d87fff640 1 --2- 172.21.15.91:0/1142048184 >> v2:172.21.15.183:3300/0 conn(0x7f8d900c3ea0 0x7f8d900c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.286+0000 7f8d87fff640 1 -- 172.21.15.91:0/1142048184 >> v1:172.21.15.91:6789/0 conn(0x7f8d9014fd30 legacy=0x7f8d900a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.286+0000 7f8d87fff640 1 -- 172.21.15.91:0/1142048184 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d900c61c0 con 0x7f8d9006d0a0 2023-11-27T20:46:20.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.287+0000 7f8d87fff640 1 --2- 172.21.15.91:0/1142048184 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 0x7f8d90152f20 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8d9006e430 tx=0x7f8d7802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2880e9acacd77e35 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.289+0000 7f8d8e7fc640 1 -- 172.21.15.91:0/1142048184 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d78030870 con 0x7f8d9006d0a0 2023-11-27T20:46:20.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.289+0000 7f8d8e7fc640 1 -- 172.21.15.91:0/1142048184 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d780309d0 con 0x7f8d9006d0a0 2023-11-27T20:46:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.289+0000 7f8d8e7fc640 1 -- 172.21.15.91:0/1142048184 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d78030d60 con 0x7f8d9006d0a0 2023-11-27T20:46:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.290+0000 7f8d957f1640 1 -- 172.21.15.91:0/1142048184 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 msgr2=0x7f8d90152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.290+0000 7f8d957f1640 1 --2- 172.21.15.91:0/1142048184 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 0x7f8d90152f20 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8d9006e430 tx=0x7f8d7802b9b0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.290+0000 7f8d957f1640 1 -- 172.21.15.91:0/1142048184 shutdown_connections 2023-11-27T20:46:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.290+0000 7f8d957f1640 1 --2- 172.21.15.91:0/1142048184 >> v2:172.21.15.183:3300/0 conn(0x7f8d900c3ea0 0x7f8d900c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.290+0000 7f8d957f1640 1 --2- 172.21.15.91:0/1142048184 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 0x7f8d90152f20 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.290+0000 7f8d957f1640 1 -- 172.21.15.91:0/1142048184 >> 172.21.15.91:0/1142048184 conn(0x7f8d9006a500 msgr2=0x7f8d9006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:20.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.290+0000 7f8d957f1640 1 -- 172.21.15.91:0/1142048184 shutdown_connections 2023-11-27T20:46:20.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.290+0000 7f8d957f1640 1 -- 172.21.15.91:0/1142048184 wait complete. 2023-11-27T20:46:20.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.292+0000 7f8d957f1640 1 Processor -- start 2023-11-27T20:46:20.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.292+0000 7f8d957f1640 1 -- start start 2023-11-27T20:46:20.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.293+0000 7f8d957f1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 0x7f8d901e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.293+0000 7f8d957f1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d900c3ea0 0x7f8d900a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.293+0000 7f8d957f1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d9014fd30 0x7f8d901edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.293+0000 7f8d957f1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90154ce0 con 0x7f8d9006d0a0 2023-11-27T20:46:20.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.293+0000 7f8d957f1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90156220 con 0x7f8d9014fd30 2023-11-27T20:46:20.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.293+0000 7f8d957f1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90156500 con 0x7f8d900c3ea0 2023-11-27T20:46:20.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.294+0000 7f8d8effd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 0x7f8d901e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.294+0000 7f8d8effd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 0x7f8d901e9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55684/0 (socket says 172.21.15.91:55684) 2023-11-27T20:46:20.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.294+0000 7f8d8effd640 1 -- 172.21.15.91:0/4289040367 learned_addr learned my addr 172.21.15.91:0/4289040367 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:20.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.294+0000 7f8d8effd640 1 -- 172.21.15.91:0/4289040367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d900c3ea0 msgr2=0x7f8d900a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.294+0000 7f8d8effd640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d900c3ea0 0x7f8d900a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.294+0000 7f8d8effd640 1 -- 172.21.15.91:0/4289040367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d9014fd30 msgr2=0x7f8d901edc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.294+0000 7f8d8effd640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d9014fd30 0x7f8d901edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.294+0000 7f8d8effd640 1 -- 172.21.15.91:0/4289040367 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d780094d0 con 0x7f8d9006d0a0 2023-11-27T20:46:20.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.295+0000 7f8d8effd640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 0x7f8d901e9f10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c450 tx=0x7f8d8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.295+0000 7f8d877fe640 1 -- 172.21.15.91:0/4289040367 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800052d0 con 0x7f8d9006d0a0 2023-11-27T20:46:20.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.295+0000 7f8d877fe640 1 -- 172.21.15.91:0/4289040367 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d80005430 con 0x7f8d9006d0a0 2023-11-27T20:46:20.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.295+0000 7f8d877fe640 1 -- 172.21.15.91:0/4289040367 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80012870 con 0x7f8d9006d0a0 2023-11-27T20:46:20.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.295+0000 7f8d957f1640 1 -- 172.21.15.91:0/4289040367 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d901567e0 con 0x7f8d9006d0a0 2023-11-27T20:46:20.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.295+0000 7f8d957f1640 1 -- 172.21.15.91:0/4289040367 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d901ed760 con 0x7f8d9006d0a0 2023-11-27T20:46:20.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.296+0000 7f8d957f1640 1 -- 172.21.15.91:0/4289040367 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d90068350 con 0x7f8d9006d0a0 2023-11-27T20:46:20.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.297+0000 7f8d877fe640 1 -- 172.21.15.91:0/4289040367 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8d800129d0 con 0x7f8d9006d0a0 2023-11-27T20:46:20.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.298+0000 7f8d877fe640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8d7006b1c0 0x7f8d7006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.298+0000 7f8d877fe640 1 -- 172.21.15.91:0/4289040367 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8d800892c0 con 0x7f8d9006d0a0 2023-11-27T20:46:20.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.298+0000 7f8d87fff640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8d7006b1c0 0x7f8d7006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.299+0000 7f8d87fff640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8d7006b1c0 0x7f8d7006d680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8d78036000 tx=0x7f8d7803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.303+0000 7f8d877fe640 1 -- 172.21.15.91:0/4289040367 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8d80054290 con 0x7f8d9006d0a0 2023-11-27T20:46:20.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.491+0000 7f8d957f1640 1 -- 172.21.15.91:0/4289040367 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d90072980 con 0x7f8d7006b1c0 2023-11-27T20:46:20.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.492+0000 7f8d877fe640 1 -- 172.21.15.91:0/4289040367 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8d78030bc0 con 0x7f8d7006b1c0 2023-11-27T20:46:20.494 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 6 to deep-scrub 2023-11-27T20:46:20.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 -- 172.21.15.91:0/4289040367 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8d7006b1c0 msgr2=0x7f8d7006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8d7006b1c0 0x7f8d7006d680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8d78036000 tx=0x7f8d7803b040 comp rx=0 tx=0).stop 2023-11-27T20:46:20.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 -- 172.21.15.91:0/4289040367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 msgr2=0x7f8d901e9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 0x7f8d901e9f10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c450 tx=0x7f8d8000c910 comp rx=0 tx=0).stop 2023-11-27T20:46:20.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 -- 172.21.15.91:0/4289040367 shutdown_connections 2023-11-27T20:46:20.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8d7006b1c0 0x7f8d7006d680 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d9014fd30 0x7f8d901edc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d900c3ea0 0x7f8d900a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 --2- 172.21.15.91:0/4289040367 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d9006d0a0 0x7f8d901e9f10 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 -- 172.21.15.91:0/4289040367 >> 172.21.15.91:0/4289040367 conn(0x7f8d9006a500 msgr2=0x7f8d900c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:20.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 -- 172.21.15.91:0/4289040367 shutdown_connections 2023-11-27T20:46:20.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.495+0000 7f8d957f1640 1 -- 172.21.15.91:0/4289040367 wait complete. 2023-11-27T20:46:20.515 INFO:tasks.ceph:Scrubbing osd.7 2023-11-27T20:46:20.516 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-27T20:46:20.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.732+0000 7f99f6e4f640 1 Processor -- start 2023-11-27T20:46:20.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.732+0000 7f99f6e4f640 1 -- start start 2023-11-27T20:46:20.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.733+0000 7f99f6e4f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99f014fa80 0x7f99f006d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.733+0000 7f99f6e4f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f00c0980 con 0x7f99f0072530 2023-11-27T20:46:20.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.733+0000 7f99f6e4f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f006c070 con 0x7f99f0071f70 2023-11-27T20:46:20.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.733+0000 7f99f6e4f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f006d160 con 0x7f99f014fa80 2023-11-27T20:46:20.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.734+0000 7f99effff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f99f0072530 0x7f99f00c5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:60156/0 (socket says 172.21.15.91:60156) 2023-11-27T20:46:20.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.734+0000 7f99effff640 1 -- 172.21.15.91:0/481766371 learned_addr learned my addr 172.21.15.91:0/481766371 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:20.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.734+0000 7f99f4beb640 1 --2- 172.21.15.91:0/481766371 >> v2:172.21.15.183:3300/0 conn(0x7f99f014fa80 0x7f99f006d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.734+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485514233 0 0) 0x7f99f00c0980 con 0x7f99f0072530 2023-11-27T20:46:20.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.734+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e0003520 con 0x7f99f0072530 2023-11-27T20:46:20.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622938934 0 0) 0x7f99e0003520 con 0x7f99f0072530 2023-11-27T20:46:20.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 >> v2:172.21.15.183:3300/0 conn(0x7f99f014fa80 msgr2=0x7f99f006d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:20.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 --2- 172.21.15.91:0/481766371 >> v2:172.21.15.183:3300/0 conn(0x7f99f014fa80 0x7f99f006d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 >> v1:172.21.15.183:6789/0 conn(0x7f99f0071f70 legacy=0x7f99f00c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f006dc70 con 0x7f99f0072530 2023-11-27T20:46:20.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3480171806 0 0) 0x7f99dc001670 con 0x7f99f0072530 2023-11-27T20:46:20.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 >> v1:172.21.15.91:6789/0 conn(0x7f99f0072530 legacy=0x7f99f00c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99e0003970 0x7f99e0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99e00047c0 0x7f99e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e00051f0 0x7f99e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f006d160 con 0x7f99e00047c0 2023-11-27T20:46:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e000c150 con 0x7f99e00051f0 2023-11-27T20:46:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e000c310 con 0x7f99e0003970 2023-11-27T20:46:20.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99effff640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99e00047c0 0x7f99e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99f4beb640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99e0003970 0x7f99e0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.735+0000 7f99f53ec640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e00051f0 0x7f99e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.736+0000 7f99effff640 1 -- 172.21.15.91:0/481766371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99e0003970 msgr2=0x7f99e0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:20.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.736+0000 7f99effff640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99e0003970 0x7f99e0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.736+0000 7f99effff640 1 -- 172.21.15.91:0/481766371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e00051f0 msgr2=0x7f99e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:20.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.736+0000 7f99effff640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e00051f0 0x7f99e000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.736+0000 7f99effff640 1 -- 172.21.15.91:0/481766371 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0003520 con 0x7f99e00047c0 2023-11-27T20:46:20.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.736+0000 7f99f53ec640 1 -- 172.21.15.91:0/481766371 reap_dead start 2023-11-27T20:46:20.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.737+0000 7f99effff640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99e00047c0 0x7f99e0004c40 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c160 tx=0x7f99e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d188a6817ecf236 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.737+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc005ad0 con 0x7f99e00047c0 2023-11-27T20:46:20.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.737+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc005c30 con 0x7f99e00047c0 2023-11-27T20:46:20.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.737+0000 7f99ef7fe640 1 -- 172.21.15.91:0/481766371 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc02c7c0 con 0x7f99e00047c0 2023-11-27T20:46:20.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.738+0000 7f99f6e4f640 1 -- 172.21.15.91:0/481766371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99e00047c0 msgr2=0x7f99e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.738+0000 7f99f6e4f640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99e00047c0 0x7f99e0004c40 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c160 tx=0x7f99e00057f0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.738+0000 7f99f6e4f640 1 -- 172.21.15.91:0/481766371 shutdown_connections 2023-11-27T20:46:20.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.738+0000 7f99f6e4f640 1 --2- 172.21.15.91:0/481766371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99e00047c0 0x7f99e0004c40 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.738+0000 7f99f6e4f640 1 -- 172.21.15.91:0/481766371 >> 172.21.15.91:0/481766371 conn(0x7f99f00c5bc0 msgr2=0x7f99f00c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:20.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.738+0000 7f99f6e4f640 1 -- 172.21.15.91:0/481766371 shutdown_connections 2023-11-27T20:46:20.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.738+0000 7f99f6e4f640 1 -- 172.21.15.91:0/481766371 wait complete. 2023-11-27T20:46:20.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.740+0000 7f99f6e4f640 1 Processor -- start 2023-11-27T20:46:20.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.740+0000 7f99f6e4f640 1 -- start start 2023-11-27T20:46:20.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.741+0000 7f99f6e4f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e00047c0 0x7f99f01e8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.741+0000 7f99f6e4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99f01e8c40 0x7f99f0148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.741+0000 7f99f6e4f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f0153a50 0x7f99f01eb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.741+0000 7f99f6e4f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f0154ee0 con 0x7f99f0153a50 2023-11-27T20:46:20.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.741+0000 7f99f6e4f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f014ca20 con 0x7f99e00047c0 2023-11-27T20:46:20.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.741+0000 7f99f6e4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f014cd00 con 0x7f99f01e8c40 2023-11-27T20:46:20.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.741+0000 7f99f53ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f0153a50 0x7f99f01eb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.741+0000 7f99f53ec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f0153a50 0x7f99f01eb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55712/0 (socket says 172.21.15.91:55712) 2023-11-27T20:46:20.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.741+0000 7f99f53ec640 1 -- 172.21.15.91:0/3158897486 learned_addr learned my addr 172.21.15.91:0/3158897486 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:20.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.741+0000 7f99effff640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99f01e8c40 0x7f99f0148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99f4beb640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e00047c0 0x7f99f01e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99f53ec640 1 -- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99f01e8c40 msgr2=0x7f99f0148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99f53ec640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99f01e8c40 0x7f99f0148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99f53ec640 1 -- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e00047c0 msgr2=0x7f99f01e8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99f53ec640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e00047c0 0x7f99f01e8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99f53ec640 1 -- 172.21.15.91:0/3158897486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f01eaec0 con 0x7f99f0153a50 2023-11-27T20:46:20.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99f4beb640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e00047c0 0x7f99f01e8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T20:46:20.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99f53ec640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f0153a50 0x7f99f01eb3e0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f99f006ce00 tx=0x7f99e800fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99ed7fa640 1 -- 172.21.15.91:0/3158897486 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8006e20 con 0x7f99f0153a50 2023-11-27T20:46:20.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99ed7fa640 1 -- 172.21.15.91:0/3158897486 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e8003970 con 0x7f99f0153a50 2023-11-27T20:46:20.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.742+0000 7f99ed7fa640 1 -- 172.21.15.91:0/3158897486 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8003d00 con 0x7f99f0153a50 2023-11-27T20:46:20.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.743+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f0148b50 con 0x7f99f0153a50 2023-11-27T20:46:20.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.743+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f01eb920 con 0x7f99f0153a50 2023-11-27T20:46:20.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.744+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99f014cb90 con 0x7f99f0153a50 2023-11-27T20:46:20.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.745+0000 7f99ed7fa640 1 -- 172.21.15.91:0/3158897486 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f99e8005030 con 0x7f99f0153a50 2023-11-27T20:46:20.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.746+0000 7f99ed7fa640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99d406b1c0 0x7f99d406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.746+0000 7f99ed7fa640 1 -- 172.21.15.91:0/3158897486 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f99e80887f0 con 0x7f99f0153a50 2023-11-27T20:46:20.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.746+0000 7f99ed7fa640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] conn(0x7f99d40710c0 0x7f99d40734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.746+0000 7f99ed7fa640 1 -- 172.21.15.91:0/3158897486 --> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99d4073b90 con 0x7f99d40710c0 2023-11-27T20:46:20.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.746+0000 7f99ed7fa640 1 -- 172.21.15.91:0/3158897486 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99e808d2c0 con 0x7f99f0153a50 2023-11-27T20:46:20.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.746+0000 7f99f4beb640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99d406b1c0 0x7f99d406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.747+0000 7f99effff640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] conn(0x7f99d40710c0 0x7f99d40734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.747+0000 7f99f4beb640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99d406b1c0 0x7f99d406d680 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f99f00681b0 tx=0x7f99e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.747+0000 7f99effff640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] conn(0x7f99d40710c0 0x7f99d40734e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.748+0000 7f99ed7fa640 1 -- 172.21.15.91:0/3158897486 <== osd.7 v2:172.21.15.183:6822/3877780549 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f99d4073b90 con 0x7f99d40710c0 2023-11-27T20:46:20.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.763+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 --> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f99f01545c0 con 0x7f99d40710c0 2023-11-27T20:46:20.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.764+0000 7f99ed7fa640 1 -- 172.21.15.91:0/3158897486 <== osd.7 v2:172.21.15.183:6822/3877780549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f99dc03d040 con 0x7f99d40710c0 2023-11-27T20:46:20.765 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-27T20:46:20.766 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-27T20:46:20.766 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-27T20:46:20.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.764+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] conn(0x7f99d40710c0 msgr2=0x7f99d40734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.764+0000 7f99f6e4f640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.183:6822/3877780549,v1:172.21.15.183:6824/3877780549] conn(0x7f99d40710c0 0x7f99d40734e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.764+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99d406b1c0 msgr2=0x7f99d406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.764+0000 7f99f6e4f640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f99d406b1c0 0x7f99d406d680 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f99f00681b0 tx=0x7f99e4008040 comp rx=0 tx=0).stop 2023-11-27T20:46:20.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.764+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f0153a50 msgr2=0x7f99f01eb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.764+0000 7f99f6e4f640 1 --2- 172.21.15.91:0/3158897486 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f0153a50 0x7f99f01eb3e0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f99f006ce00 tx=0x7f99e800fd40 comp rx=0 tx=0).stop 2023-11-27T20:46:20.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.765+0000 7f99f53ec640 1 -- 172.21.15.91:0/3158897486 reap_dead start 2023-11-27T20:46:20.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.765+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 shutdown_connections 2023-11-27T20:46:20.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.765+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 >> 172.21.15.91:0/3158897486 conn(0x7f99f00c5bc0 msgr2=0x7f99f00c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:20.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.765+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 shutdown_connections 2023-11-27T20:46:20.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.765+0000 7f99f6e4f640 1 -- 172.21.15.91:0/3158897486 wait complete. 2023-11-27T20:46:20.782 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-27T20:46:20.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.989+0000 7f8e2ea17640 1 Processor -- start 2023-11-27T20:46:20.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.989+0000 7f8e2ea17640 1 -- start start 2023-11-27T20:46:20.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.991+0000 7f8e2ea17640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8e280c3400 0x7f8e2806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.991+0000 7f8e2ea17640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8e28157fe0 0x7f8e28158430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:20.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.991+0000 7f8e2ea17640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e28071fd0 con 0x7f8e28151fd0 2023-11-27T20:46:20.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.991+0000 7f8e2ea17640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2806ee50 con 0x7f8e28157fe0 2023-11-27T20:46:20.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.991+0000 7f8e2ea17640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e28072220 con 0x7f8e280c3400 2023-11-27T20:46:20.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.991+0000 7f8e2cfb4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8e28157fe0 0x7f8e28158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.992+0000 7f8e2cfb4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8e28157fe0 0x7f8e28158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55720/0 (socket says 172.21.15.91:55720) 2023-11-27T20:46:20.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.992+0000 7f8e2cfb4640 1 -- 172.21.15.91:0/2148795962 learned_addr learned my addr 172.21.15.91:0/2148795962 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:20.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.992+0000 7f8e277fe640 1 --2- 172.21.15.91:0/2148795962 >> v2:172.21.15.183:3300/0 conn(0x7f8e280c3400 0x7f8e2806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:20.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.992+0000 7f8e2cfb4640 1 -- 172.21.15.91:0/2148795962 >> v2:172.21.15.183:3300/0 conn(0x7f8e280c3400 msgr2=0x7f8e2806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:20.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.992+0000 7f8e2cfb4640 1 --2- 172.21.15.91:0/2148795962 >> v2:172.21.15.183:3300/0 conn(0x7f8e280c3400 0x7f8e2806e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.992+0000 7f8e2cfb4640 1 -- 172.21.15.91:0/2148795962 >> v1:172.21.15.183:6789/0 conn(0x7f8e28151fd0 legacy=0x7f8e2806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:20.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.992+0000 7f8e2cfb4640 1 -- 172.21.15.91:0/2148795962 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2806e0d0 con 0x7f8e28157fe0 2023-11-27T20:46:20.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.993+0000 7f8e2cfb4640 1 --2- 172.21.15.91:0/2148795962 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e28157fe0 0x7f8e28158430 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f8e2806ddb0 tx=0x7f8e2002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a8834f15ea2542 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:20.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.994+0000 7f8e26ffd640 1 -- 172.21.15.91:0/2148795962 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200317e0 con 0x7f8e28157fe0 2023-11-27T20:46:20.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.994+0000 7f8e26ffd640 1 -- 172.21.15.91:0/2148795962 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e20031940 con 0x7f8e28157fe0 2023-11-27T20:46:20.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.994+0000 7f8e26ffd640 1 -- 172.21.15.91:0/2148795962 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20031cd0 con 0x7f8e28157fe0 2023-11-27T20:46:20.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.994+0000 7f8e2ea17640 1 -- 172.21.15.91:0/2148795962 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e28157fe0 msgr2=0x7f8e28158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:20.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.994+0000 7f8e2ea17640 1 --2- 172.21.15.91:0/2148795962 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e28157fe0 0x7f8e28158430 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f8e2806ddb0 tx=0x7f8e2002b880 comp rx=0 tx=0).stop 2023-11-27T20:46:20.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.995+0000 7f8e2ea17640 1 -- 172.21.15.91:0/2148795962 shutdown_connections 2023-11-27T20:46:20.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.995+0000 7f8e2ea17640 1 --2- 172.21.15.91:0/2148795962 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e28157fe0 0x7f8e28158430 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.995+0000 7f8e2ea17640 1 --2- 172.21.15.91:0/2148795962 >> v2:172.21.15.183:3300/0 conn(0x7f8e280c3400 0x7f8e2806e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:20.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.995+0000 7f8e2ea17640 1 -- 172.21.15.91:0/2148795962 >> 172.21.15.91:0/2148795962 conn(0x7f8e280c6ee0 msgr2=0x7f8e280c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:20.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.995+0000 7f8e2ea17640 1 -- 172.21.15.91:0/2148795962 shutdown_connections 2023-11-27T20:46:20.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.995+0000 7f8e2ea17640 1 -- 172.21.15.91:0/2148795962 wait complete. 2023-11-27T20:46:20.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.996+0000 7f8e2ea17640 1 Processor -- start 2023-11-27T20:46:20.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.997+0000 7f8e2ea17640 1 -- start start 2023-11-27T20:46:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.997+0000 7f8e2ea17640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e280c3400 0x7f8e280c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.997+0000 7f8e2ea17640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e28151fd0 0x7f8e281ea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.997+0000 7f8e2ea17640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e28157fe0 0x7f8e281412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.997+0000 7f8e2ea17640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28149140 con 0x7f8e280c3400 2023-11-27T20:46:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.997+0000 7f8e2ea17640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28146090 con 0x7f8e28151fd0 2023-11-27T20:46:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.997+0000 7f8e2ea17640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2814db40 con 0x7f8e28157fe0 2023-11-27T20:46:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.998+0000 7f8e27fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e280c3400 0x7f8e280c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:21.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.998+0000 7f8e27fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e280c3400 0x7f8e280c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55726/0 (socket says 172.21.15.91:55726) 2023-11-27T20:46:21.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.998+0000 7f8e27fff640 1 -- 172.21.15.91:0/4099888001 learned_addr learned my addr 172.21.15.91:0/4099888001 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:21.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.998+0000 7f8e27fff640 1 -- 172.21.15.91:0/4099888001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e28157fe0 msgr2=0x7f8e281412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:21.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.998+0000 7f8e27fff640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e28157fe0 0x7f8e281412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.998+0000 7f8e27fff640 1 -- 172.21.15.91:0/4099888001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e28151fd0 msgr2=0x7f8e281ea3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:21.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.998+0000 7f8e27fff640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e28151fd0 0x7f8e281ea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.998+0000 7f8e27fff640 1 -- 172.21.15.91:0/4099888001 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200094d0 con 0x7f8e280c3400 2023-11-27T20:46:21.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.998+0000 7f8e27fff640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e280c3400 0x7f8e280c63d0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c7a0 tx=0x7f8e1800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:21.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.999+0000 7f8e24ff9640 1 -- 172.21.15.91:0/4099888001 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18003d80 con 0x7f8e280c3400 2023-11-27T20:46:21.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.999+0000 7f8e24ff9640 1 -- 172.21.15.91:0/4099888001 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e18005070 con 0x7f8e280c3400 2023-11-27T20:46:21.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.999+0000 7f8e24ff9640 1 -- 172.21.15.91:0/4099888001 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18005420 con 0x7f8e280c3400 2023-11-27T20:46:21.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.999+0000 7f8e2ea17640 1 -- 172.21.15.91:0/4099888001 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e280c2260 con 0x7f8e280c3400 2023-11-27T20:46:21.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:20.999+0000 7f8e2ea17640 1 -- 172.21.15.91:0/4099888001 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2814d4f0 con 0x7f8e280c3400 2023-11-27T20:46:21.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.000+0000 7f8e2ea17640 1 -- 172.21.15.91:0/4099888001 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e28068350 con 0x7f8e280c3400 2023-11-27T20:46:21.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.001+0000 7f8e24ff9640 1 -- 172.21.15.91:0/4099888001 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8e18005580 con 0x7f8e280c3400 2023-11-27T20:46:21.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.002+0000 7f8e24ff9640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1406b1c0 0x7f8e1406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:21.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.003+0000 7f8e24ff9640 1 -- 172.21.15.91:0/4099888001 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8e18088c40 con 0x7f8e280c3400 2023-11-27T20:46:21.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.003+0000 7f8e277fe640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1406b1c0 0x7f8e1406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:21.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.003+0000 7f8e277fe640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1406b1c0 0x7f8e1406d680 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8e280ac5b0 tx=0x7f8e1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:21.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.007+0000 7f8e24ff9640 1 -- 172.21.15.91:0/4099888001 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8e18053c00 con 0x7f8e280c3400 2023-11-27T20:46:21.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.198+0000 7f8e2ea17640 1 -- 172.21.15.91:0/4099888001 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e2806e690 con 0x7f8e1406b1c0 2023-11-27T20:46:21.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.199+0000 7f8e24ff9640 1 -- 172.21.15.91:0/4099888001 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8e1c00d7b0 con 0x7f8e1406b1c0 2023-11-27T20:46:21.200 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 7 to deep-scrub 2023-11-27T20:46:21.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 -- 172.21.15.91:0/4099888001 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1406b1c0 msgr2=0x7f8e1406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:21.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1406b1c0 0x7f8e1406d680 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8e280ac5b0 tx=0x7f8e1c008040 comp rx=0 tx=0).stop 2023-11-27T20:46:21.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 -- 172.21.15.91:0/4099888001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e280c3400 msgr2=0x7f8e280c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:21.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e280c3400 0x7f8e280c63d0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c7a0 tx=0x7f8e1800cc60 comp rx=0 tx=0).stop 2023-11-27T20:46:21.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 -- 172.21.15.91:0/4099888001 shutdown_connections 2023-11-27T20:46:21.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e28157fe0 0x7f8e281412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8e1406b1c0 0x7f8e1406d680 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e28151fd0 0x7f8e281ea3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 --2- 172.21.15.91:0/4099888001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e280c3400 0x7f8e280c63d0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 -- 172.21.15.91:0/4099888001 >> 172.21.15.91:0/4099888001 conn(0x7f8e280c6ee0 msgr2=0x7f8e280c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:21.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 -- 172.21.15.91:0/4099888001 shutdown_connections 2023-11-27T20:46:21.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.201+0000 7f8e2ea17640 1 -- 172.21.15.91:0/4099888001 wait complete. 2023-11-27T20:46:21.221 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:46:21.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.436+0000 7efd95c96640 1 Processor -- start 2023-11-27T20:46:21.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.436+0000 7efd95c96640 1 -- start start 2023-11-27T20:46:21.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.437+0000 7efd95c96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd90155490 0x7efd900a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:21.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.437+0000 7efd95c96640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efd900a9b40 0x7efd900c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:21.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.437+0000 7efd95c96640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd900c06c0 con 0x7efd900c1500 2023-11-27T20:46:21.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.437+0000 7efd95c96640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd900a5820 con 0x7efd900a9b40 2023-11-27T20:46:21.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.437+0000 7efd95c96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd900c1020 con 0x7efd90155490 2023-11-27T20:46:21.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.438+0000 7efd8ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efd900a9b40 0x7efd900c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:21.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.438+0000 7efd8ffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efd900a9b40 0x7efd900c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55742/0 (socket says 172.21.15.91:55742) 2023-11-27T20:46:21.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.438+0000 7efd8ffff640 1 -- 172.21.15.91:0/3959267223 learned_addr learned my addr 172.21.15.91:0/3959267223 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:21.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.438+0000 7efd8f7fe640 1 --2- 172.21.15.91:0/3959267223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd90155490 0x7efd900a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:21.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.438+0000 7efd8ffff640 1 -- 172.21.15.91:0/3959267223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd90155490 msgr2=0x7efd900a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:21.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.438+0000 7efd8ffff640 1 --2- 172.21.15.91:0/3959267223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd90155490 0x7efd900a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.438+0000 7efd8ffff640 1 -- 172.21.15.91:0/3959267223 >> v1:172.21.15.183:6789/0 conn(0x7efd900c1500 legacy=0x7efd900a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:21.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.438+0000 7efd8ffff640 1 -- 172.21.15.91:0/3959267223 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd900c0910 con 0x7efd900a9b40 2023-11-27T20:46:21.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.439+0000 7efd8ffff640 1 --2- 172.21.15.91:0/3959267223 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd900a9b40 0x7efd900c24d0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7efd88009870 tx=0x7efd8802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbcf04abf93ecfad server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:21.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.439+0000 7efd8e7fc640 1 -- 172.21.15.91:0/3959267223 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88031640 con 0x7efd900a9b40 2023-11-27T20:46:21.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.439+0000 7efd8e7fc640 1 -- 172.21.15.91:0/3959267223 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd880317a0 con 0x7efd900a9b40 2023-11-27T20:46:21.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.439+0000 7efd8e7fc640 1 -- 172.21.15.91:0/3959267223 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88031b30 con 0x7efd900a9b40 2023-11-27T20:46:21.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.440+0000 7efd95c96640 1 -- 172.21.15.91:0/3959267223 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd900a9b40 msgr2=0x7efd900c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:21.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.440+0000 7efd95c96640 1 --2- 172.21.15.91:0/3959267223 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd900a9b40 0x7efd900c24d0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7efd88009870 tx=0x7efd8802b8f0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.440+0000 7efd95c96640 1 -- 172.21.15.91:0/3959267223 shutdown_connections 2023-11-27T20:46:21.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.440+0000 7efd95c96640 1 --2- 172.21.15.91:0/3959267223 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd900a9b40 0x7efd900c24d0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.440+0000 7efd95c96640 1 --2- 172.21.15.91:0/3959267223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd90155490 0x7efd900a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.440+0000 7efd95c96640 1 -- 172.21.15.91:0/3959267223 >> 172.21.15.91:0/3959267223 conn(0x7efd9006a500 msgr2=0x7efd9006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:21.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.440+0000 7efd95c96640 1 -- 172.21.15.91:0/3959267223 shutdown_connections 2023-11-27T20:46:21.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.440+0000 7efd95c96640 1 -- 172.21.15.91:0/3959267223 wait complete. 2023-11-27T20:46:21.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.442+0000 7efd95c96640 1 Processor -- start 2023-11-27T20:46:21.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.442+0000 7efd95c96640 1 -- start start 2023-11-27T20:46:21.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.443+0000 7efd95c96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd900c1500 0x7efd90156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:21.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.443+0000 7efd95c96640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd90155490 0x7efd901526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:21.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.443+0000 7efd95c96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd90157720 0x7efd900a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:21.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.443+0000 7efd95c96640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd90158250 con 0x7efd90155490 2023-11-27T20:46:21.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.443+0000 7efd95c96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd901572c0 con 0x7efd900c1500 2023-11-27T20:46:21.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.443+0000 7efd95c96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd90152c30 con 0x7efd90157720 2023-11-27T20:46:21.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.443+0000 7efd8effd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd90155490 0x7efd901526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:21.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.443+0000 7efd8effd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd90155490 0x7efd901526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:55754/0 (socket says 172.21.15.91:55754) 2023-11-27T20:46:21.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.443+0000 7efd8effd640 1 -- 172.21.15.91:0/1291634789 learned_addr learned my addr 172.21.15.91:0/1291634789 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:21.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.444+0000 7efd8ffff640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd90157720 0x7efd900a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:21.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.444+0000 7efd8f7fe640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd900c1500 0x7efd90156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:21.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.444+0000 7efd8effd640 1 -- 172.21.15.91:0/1291634789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd90157720 msgr2=0x7efd900a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:21.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.444+0000 7efd8effd640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd90157720 0x7efd900a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.444+0000 7efd8effd640 1 -- 172.21.15.91:0/1291634789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd900c1500 msgr2=0x7efd90156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:21.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.444+0000 7efd8effd640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd900c1500 0x7efd90156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.444+0000 7efd8effd640 1 -- 172.21.15.91:0/1291634789 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd880094d0 con 0x7efd90155490 2023-11-27T20:46:21.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.444+0000 7efd8effd640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd90155490 0x7efd901526f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c430 tx=0x7efd7800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:21.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.444+0000 7efd87fff640 1 -- 172.21.15.91:0/1291634789 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78011790 con 0x7efd90155490 2023-11-27T20:46:21.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.445+0000 7efd87fff640 1 -- 172.21.15.91:0/1291634789 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd780118f0 con 0x7efd90155490 2023-11-27T20:46:21.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.445+0000 7efd87fff640 1 -- 172.21.15.91:0/1291634789 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78011ce0 con 0x7efd90155490 2023-11-27T20:46:21.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.445+0000 7efd95c96640 1 -- 172.21.15.91:0/1291634789 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd901ee380 con 0x7efd90155490 2023-11-27T20:46:21.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.445+0000 7efd95c96640 1 -- 172.21.15.91:0/1291634789 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9015bd60 con 0x7efd90155490 2023-11-27T20:46:21.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.446+0000 7efd95c96640 1 -- 172.21.15.91:0/1291634789 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd90068350 con 0x7efd90155490 2023-11-27T20:46:21.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.447+0000 7efd87fff640 1 -- 172.21.15.91:0/1291634789 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efd7801c460 con 0x7efd90155490 2023-11-27T20:46:21.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.448+0000 7efd87fff640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd7006b1f0 0x7efd7006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:21.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.448+0000 7efd87fff640 1 -- 172.21.15.91:0/1291634789 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7efd78089720 con 0x7efd90155490 2023-11-27T20:46:21.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.448+0000 7efd8f7fe640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd7006b1f0 0x7efd7006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:21.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.449+0000 7efd8f7fe640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd7006b1f0 0x7efd7006d6b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efd80008e50 tx=0x7efd800083a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:21.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.453+0000 7efd87fff640 1 -- 172.21.15.91:0/1291634789 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efd780546e0 con 0x7efd90155490 2023-11-27T20:46:21.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.644+0000 7efd95c96640 1 -- 172.21.15.91:0/1291634789 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd90155870 con 0x7efd7006b1f0 2023-11-27T20:46:21.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.649+0000 7efd87fff640 1 -- 172.21.15.91:0/1291634789 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48368 (secure 0 0 0) 0x7efd8000ddf0 con 0x7efd7006b1f0 2023-11-27T20:46:21.652 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:21.652 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:46:21.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.652+0000 7efd95c96640 1 -- 172.21.15.91:0/1291634789 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd7006b1f0 msgr2=0x7efd7006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:21.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.652+0000 7efd95c96640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd7006b1f0 0x7efd7006d6b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efd80008e50 tx=0x7efd800083a0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.652+0000 7efd95c96640 1 -- 172.21.15.91:0/1291634789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd90155490 msgr2=0x7efd901526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:21.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.652+0000 7efd95c96640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd90155490 0x7efd901526f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c430 tx=0x7efd7800c8f0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.653+0000 7efd95c96640 1 -- 172.21.15.91:0/1291634789 shutdown_connections 2023-11-27T20:46:21.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.653+0000 7efd95c96640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd90157720 0x7efd900a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.653+0000 7efd95c96640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd90155490 0x7efd901526f0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.653+0000 7efd95c96640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7efd7006b1f0 0x7efd7006d6b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.653+0000 7efd95c96640 1 --2- 172.21.15.91:0/1291634789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd900c1500 0x7efd90156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:21.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.653+0000 7efd95c96640 1 -- 172.21.15.91:0/1291634789 >> 172.21.15.91:0/1291634789 conn(0x7efd9006a500 msgr2=0x7efd900aab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:21.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.653+0000 7efd95c96640 1 -- 172.21.15.91:0/1291634789 shutdown_connections 2023-11-27T20:46:21.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:21.653+0000 7efd95c96640 1 -- 172.21.15.91:0/1291634789 wait complete. 2023-11-27T20:46:21.674 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2023-11-27T20:46:21.471125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259088,"kb_used_data":9640,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715632,"statfs":{"total":773094113280,"available":772828807168,"internally_reserved":0,"allocated":9871360,"data_stored":5097240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003340"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-11-27T20:46:08.156613+0000","last_change":"2023-11-27T20:41:25.337823+0000","last_active":"2023-11-27T20:46:08.156613+0000","last_peered":"2023-11-27T20:46:08.156613+0000","last_clean":"2023-11-27T20:46:08.156613+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:46:08.156613+0000","last_undegraded":"2023-11-27T20:46:08.156613+0000","last_fullsized":"2023-11-27T20:46:08.156613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T20:41:23.728669+0000","last_clean_scrub_stamp":"2023-11-27T20:41:23.728669+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:37:03.209816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1679360,"data_stored":1079931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.121,"15min":1.151},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.635,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.22,"15min":1.234},"min":{"1min":0.82299999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7430000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.1819999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.167,"15min":1.2170000000000001},"min":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.1719999999999999,"15min":1.2110000000000001},"min":{"1min":0.68999999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.99199999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.198,"15min":1.28},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8360000000000001,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.2030000000000001,"15min":1.244},"min":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3200000000000001,"5min":1.909,"15min":1.909},"last":1.327}]},{"osd":3,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3089999999999999,"15min":1.379},"min":{"1min":0.91500000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.9930000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4039999999999999,"15min":1.474},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8400000000000001,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.4379999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3420000000000001,"15min":1.3999999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.4339999999999999,"15min":1.5680000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.105,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":0.94599999999999995}]},{"osd":5,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.4350000000000001,"15min":1.4910000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":1.508},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.502,"15min":1.5720000000000001},"min":{"1min":0.626,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.1720000000000002,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":1.2829999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.609,"15min":1.661},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6020000000000001,"15min":1.6759999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":6.2190000000000003,"5min":6.2190000000000003,"15min":6.2190000000000003},"last":1.236}]}]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.198,"15min":1.262},"min":{"1min":0.67300000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7130000000000001,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.244,"15min":1.3100000000000001},"min":{"1min":0.81999999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.613,"5min":2.581,"15min":2.581},"last":1.131}]},{"osd":1,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1879999999999999,"15min":1.2549999999999999},"min":{"1min":0.65700000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6060000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.127,"15min":1.159},"min":{"1min":0.77400000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.798,"5min":2.823,"15min":2.823},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.073,"15min":1.0800000000000001},"min":{"1min":0.76100000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.573,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.226},{"interface":"front","average":{"1min":1.173,"5min":1.2789999999999999,"15min":1.373},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.8720000000000001,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.79500000000000004}]},{"osd":3,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.268,"15min":1.3600000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.77,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.327,"5min":1.2989999999999999,"15min":1.3420000000000001},"min":{"1min":0.97099999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8149999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3520000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4710000000000001,"15min":1.587},"min":{"1min":0.84999999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.9470000000000001,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.512,"15min":1.6259999999999999},"min":{"1min":0.84099999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.863,"5min":3.536,"15min":3.536},"last":1.3899999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3500000000000001,"15min":1.3939999999999999},"min":{"1min":0.98499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7,"5min":2.355,"15min":2.355},"last":1.419},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.536,"15min":1.6419999999999999},"min":{"1min":1.0900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.76,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.1850000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.5289999999999999,"15min":1.651},"min":{"1min":1.238,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9550000000000001,"5min":3.645,"15min":3.645},"last":1.575},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5149999999999999,"15min":1.571},"min":{"1min":1.2290000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6910000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.4770000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0840000000000001,"15min":1.145},"min":{"1min":0.63,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.361,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.161},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.173},"min":{"1min":0.79000000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.47,"5min":2.04,"15min":2.04},"last":1.2110000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1459999999999999,"15min":1.1930000000000001},"min":{"1min":0.68999999999999995,"5min":0.379,"15min":0.379},"max":{"1min":1.6479999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.1659999999999999,"15min":1.169},"min":{"1min":0.93100000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5580000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.94699999999999995}]},{"osd":2,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2150000000000001,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.621,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.012},{"interface":"front","average":{"1min":1.109,"5min":1.157,"15min":1.2010000000000001},"min":{"1min":0.72899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.599,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.4450000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.321,"15min":1.3839999999999999},"min":{"1min":0.89700000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7270000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.3069999999999999,"15min":1.429},"min":{"1min":0.66400000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.52,"5min":4.016,"15min":4.016},"last":1.343}]},{"osd":4,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.256,"15min":1.3580000000000001},"min":{"1min":0.69799999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5529999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.7430000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.462,"15min":1.593},"min":{"1min":0.72399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.855,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":2.0409999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.452,"15min":1.6160000000000001},"min":{"1min":0.72999999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.756,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.548},{"interface":"front","average":{"1min":1.329,"5min":1.4630000000000001,"15min":1.575},"min":{"1min":0.76200000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.764,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.897}]},{"osd":7,"last update":"Mon Nov 27 20:45:36 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.536,"15min":1.6479999999999999},"min":{"1min":0.83299999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.99,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":2.129},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.554,"15min":1.708},"min":{"1min":0.86799999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.915,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.7130000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0229999999999999,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.391},{"interface":"front","average":{"1min":1.089,"5min":1.109,"15min":1.0900000000000001},"min":{"1min":0.74099999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.579,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.119,"15min":1.036},"min":{"1min":0.72799999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.583,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2450000000000001,"15min":1.2270000000000001},"min":{"1min":0.877,"5min":0.628,"15min":0.628},"max":{"1min":1.472,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.0089999999999999}]},{"osd":2,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.2050000000000001,"15min":1.2070000000000001},"min":{"1min":0.81499999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.51,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.84099999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4690000000000001,"5min":1.792,"15min":1.792},"last":1.163}]},{"osd":3,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1359999999999999,"15min":1.165},"min":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.3620000000000001,"15min":1.3440000000000001},"min":{"1min":1.04,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.6140000000000001,"5min":2.097,"15min":2.097},"last":1.3460000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.202,"15min":1.262},"min":{"1min":0.86699999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3779999999999999,"15min":1.415},"min":{"1min":0.95999999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8120000000000001,"5min":1.992,"15min":1.992},"last":1.4450000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.337,"15min":1.3620000000000001},"min":{"1min":1.077,"5min":0.63,"15min":0.63},"max":{"1min":1.5800000000000001,"5min":2.157,"15min":2.157},"last":1.198},{"interface":"front","average":{"1min":1.524,"5min":1.544,"15min":1.5880000000000001},"min":{"1min":1.2589999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.754,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":1.2370000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:45:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.482,"15min":1.492},"min":{"1min":1.2350000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6930000000000001,"5min":2.202,"15min":2.202},"last":1.552},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.635,"15min":1.653},"min":{"1min":1.3069999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.9099999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.502}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.88200000000000001,"15min":0.999},"min":{"1min":0.41799999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.226,"5min":3.641,"15min":3.641},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90800000000000003,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.474,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.78400000000000003}]},{"osd":1,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.89400000000000002,"15min":0.93400000000000005},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.393,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0209999999999999,"15min":1.0960000000000001},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.246,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0449999999999999,"15min":1.1000000000000001},"min":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.8100000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.056,"15min":1.1140000000000001},"min":{"1min":0.53400000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5209999999999999,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.282,"15min":1.3300000000000001},"min":{"1min":0.94099999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7050000000000001,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.2929999999999999,"15min":1.377},"min":{"1min":0.82099999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.679,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.071}]},{"osd":5,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.333,"15min":1.409},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.8129999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.3759999999999999,"15min":1.4570000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6399999999999999,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.87}]},{"osd":6,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.4279999999999999,"15min":1.514},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.7390000000000001,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.327,"5min":1.417,"15min":1.4970000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.873,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.165}]},{"osd":7,"last update":"Mon Nov 27 20:45:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.458,"15min":1.5369999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0470000000000002,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4319999999999999,"15min":1.482},"min":{"1min":1.008,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8320000000000001,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":0.89900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.073},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.86499999999999999,"15min":0.91800000000000004},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.585,"5min":1.972,"15min":1.972},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.89900000000000002,"15min":0.98699999999999999},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.23,"5min":1.522,"15min":1.522},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.97799999999999998},"min":{"1min":0.46899999999999997,"5min":0.442,"15min":0.442},"max":{"1min":1.486,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.133}]},{"osd":3,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.91300000000000003,"15min":0.95099999999999996},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.1120000000000001,"5min":1.794,"15min":1.794},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.04,"15min":1.0900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.405,"5min":1.75,"15min":1.75},"last":1.024}]},{"osd":4,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.141,"15min":1.1950000000000001},"min":{"1min":0.69199999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.452,"5min":1.669,"15min":1.669},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.3080000000000001,"15min":1.3700000000000001},"min":{"1min":0.71199999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.796,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.82999999999999996}]},{"osd":5,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.23,"15min":1.302},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4259999999999999,"5min":2.48,"15min":2.48},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.3600000000000001,"15min":1.4630000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.871,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.91900000000000004}]},{"osd":6,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3340000000000001,"15min":1.371},"min":{"1min":0.80700000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0510000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.395,"15min":1.5049999999999999},"min":{"1min":0.78000000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.96,"5min":3.302,"15min":3.302},"last":1.1899999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:45:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.385,"15min":1.4710000000000001},"min":{"1min":0.79200000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.944,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.3340000000000001,"15min":1.448},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.593,"5min":2.73,"15min":2.73},"last":1.292}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.304,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.80100000000000005}]},{"osd":2,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.89400000000000002,"15min":0.96399999999999997},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.169,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0229999999999999,"15min":1.0409999999999999},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5309999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.004}]},{"osd":3,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0389999999999999,"15min":1.03},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4910000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":1.032,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.258,"5min":2.044,"15min":2.044},"last":0.71099999999999997}]},{"osd":4,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.9410000000000001,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.018},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3520000000000001,"15min":1.3500000000000001},"min":{"1min":0.82199999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.831,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.0409999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.264,"15min":1.238},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.4750000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.093},{"interface":"front","average":{"1min":1.131,"5min":1.256,"15min":1.2350000000000001},"min":{"1min":0.80700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7769999999999999,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3420000000000001,"15min":1.3200000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7529999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.327,"15min":1.351},"min":{"1min":0.83199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.877,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.91800000000000004}]},{"osd":7,"last update":"Mon Nov 27 20:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.427,"15min":1.462},"min":{"1min":0.91800000000000004,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.7370000000000001,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.665,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.236}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1679360,"data_stored":1079931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.2909999999999999,"5min":1.901,"15min":1.901},"last":0.872},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88,"15min":0.85099999999999998},"min":{"1min":0.51600000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2390000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.84699999999999998}]},{"osd":2,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89700000000000002,"15min":0.84999999999999998},"min":{"1min":0.46700000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.96899999999999997,"15min":0.95899999999999996},"min":{"1min":0.44700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.855,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.91200000000000003,"15min":0.89600000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.526,"5min":1.875,"15min":1.875},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.083,"15min":1.0600000000000001},"min":{"1min":0.59699999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.6519999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.75900000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.24,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5229999999999999,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.194},"min":{"1min":0.67400000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7629999999999999,"5min":2.391,"15min":2.391},"last":0.997}]},{"osd":5,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.335,"15min":1.3500000000000001},"min":{"1min":0.78400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.9350000000000001,"5min":3.028,"15min":3.028},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.21,"5min":1.302,"15min":1.306},"min":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7629999999999999,"5min":2.718,"15min":2.718},"last":1.171}]},{"osd":6,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.272,"15min":1.3},"min":{"1min":0.78100000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5069999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.095},{"interface":"front","average":{"1min":1.395,"5min":1.4039999999999999,"15min":1.4179999999999999},"min":{"1min":0.996,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.837,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.0609999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:45:29 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3420000000000001,"15min":1.351},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.756,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3340000000000001,"15min":1.3520000000000001},"min":{"1min":0.78800000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.673,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.038}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:46:21.678 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-27T20:41:23.728669+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=41, tm_sec=23, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=20, tm_min=46, tm_sec=14, tm_wday=0, tm_yday=331, tm_isdst=0) 2023-11-27T20:46:21.678 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-27T20:46:28.031 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:28.041 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:41.679 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T20:46:41.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.898+0000 7f8fdc29b640 1 Processor -- start 2023-11-27T20:46:41.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.898+0000 7f8fdc29b640 1 -- start start 2023-11-27T20:46:41.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.899+0000 7f8fdc29b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8fd40c5ec0 0x7f8fd40c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:41.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.899+0000 7f8fdc29b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8fd40c45d0 0x7f8fd40c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:41.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.899+0000 7f8fdc29b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd40bfdc0 con 0x7f8fd40721a0 2023-11-27T20:46:41.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.899+0000 7f8fdc29b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd406e390 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.899+0000 7f8fdc29b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd406ddd0 con 0x7f8fd40c45d0 2023-11-27T20:46:41.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.900+0000 7f8fda037640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8fd40c5ec0 0x7f8fd40c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:41.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.900+0000 7f8fda037640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8fd40c5ec0 0x7f8fd40c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46076/0 (socket says 172.21.15.91:46076) 2023-11-27T20:46:41.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.900+0000 7f8fda037640 1 -- 172.21.15.91:0/1173110812 learned_addr learned my addr 172.21.15.91:0/1173110812 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:41.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.900+0000 7f8fd9836640 1 --2- 172.21.15.91:0/1173110812 >> v2:172.21.15.183:3300/0 conn(0x7f8fd40c45d0 0x7f8fd40c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:41.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.900+0000 7f8fda037640 1 -- 172.21.15.91:0/1173110812 >> v2:172.21.15.183:3300/0 conn(0x7f8fd40c45d0 msgr2=0x7f8fd40c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:41.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.900+0000 7f8fda037640 1 --2- 172.21.15.91:0/1173110812 >> v2:172.21.15.183:3300/0 conn(0x7f8fd40c45d0 0x7f8fd40c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:41.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.900+0000 7f8fda037640 1 -- 172.21.15.91:0/1173110812 >> v1:172.21.15.183:6789/0 conn(0x7f8fd40721a0 legacy=0x7f8fd4155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:41.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.900+0000 7f8fda037640 1 -- 172.21.15.91:0/1173110812 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd406e0b0 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.900+0000 7f8fd9836640 1 --2- 172.21.15.91:0/1173110812 >> v2:172.21.15.183:3300/0 conn(0x7f8fd40c45d0 0x7f8fd40c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:41.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.901+0000 7f8fda037640 1 --2- 172.21.15.91:0/1173110812 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 0x7f8fd40c2c30 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f8fd406b430 tx=0x7f8fd002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6373ae55f1a7d378 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:41.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.902+0000 7f8fd9035640 1 -- 172.21.15.91:0/1173110812 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0031750 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.902+0000 7f8fd9035640 1 -- 172.21.15.91:0/1173110812 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd00318b0 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.902+0000 7f8fd9035640 1 -- 172.21.15.91:0/1173110812 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0031c40 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.902+0000 7f8fdc29b640 1 -- 172.21.15.91:0/1173110812 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 msgr2=0x7f8fd40c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:41.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.902+0000 7f8fdc29b640 1 --2- 172.21.15.91:0/1173110812 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 0x7f8fd40c2c30 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f8fd406b430 tx=0x7f8fd002b7f0 comp rx=0 tx=0).stop 2023-11-27T20:46:41.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.902+0000 7f8fdc29b640 1 -- 172.21.15.91:0/1173110812 shutdown_connections 2023-11-27T20:46:41.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.902+0000 7f8fdc29b640 1 --2- 172.21.15.91:0/1173110812 >> v2:172.21.15.183:3300/0 conn(0x7f8fd40c45d0 0x7f8fd40c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:41.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.902+0000 7f8fdc29b640 1 --2- 172.21.15.91:0/1173110812 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 0x7f8fd40c2c30 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:41.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.902+0000 7f8fdc29b640 1 -- 172.21.15.91:0/1173110812 >> 172.21.15.91:0/1173110812 conn(0x7f8fd406a500 msgr2=0x7f8fd406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:41.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.903+0000 7f8fdc29b640 1 -- 172.21.15.91:0/1173110812 shutdown_connections 2023-11-27T20:46:41.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.903+0000 7f8fdc29b640 1 -- 172.21.15.91:0/1173110812 wait complete. 2023-11-27T20:46:41.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.904+0000 7f8fdc29b640 1 Processor -- start 2023-11-27T20:46:41.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.904+0000 7f8fdc29b640 1 -- start start 2023-11-27T20:46:41.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.905+0000 7f8fdc29b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd40721a0 0x7f8fd4158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:41.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.905+0000 7f8fdc29b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd40c45d0 0x7f8fd41e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:41.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.905+0000 7f8fdc29b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 0x7f8fd40a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:41.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.905+0000 7f8fdc29b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd41ea870 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.905+0000 7f8fdc29b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd41eada0 con 0x7f8fd40c45d0 2023-11-27T20:46:41.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.905+0000 7f8fdc29b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd41e7a40 con 0x7f8fd40721a0 2023-11-27T20:46:41.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.905+0000 7f8fda838640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 0x7f8fd40a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:41.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fda838640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 0x7f8fd40a77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46088/0 (socket says 172.21.15.91:46088) 2023-11-27T20:46:41.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fda838640 1 -- 172.21.15.91:0/582589031 learned_addr learned my addr 172.21.15.91:0/582589031 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:41.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fda838640 1 -- 172.21.15.91:0/582589031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd40721a0 msgr2=0x7f8fd4158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:41.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fda838640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd40721a0 0x7f8fd4158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:41.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fda838640 1 -- 172.21.15.91:0/582589031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd40c45d0 msgr2=0x7f8fd41e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:41.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fda838640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd40c45d0 0x7f8fd41e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:41.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fda838640 1 -- 172.21.15.91:0/582589031 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00094d0 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fda838640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 0x7f8fd40a77d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00c7b0 tx=0x7f8fcc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:41.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fcaffd640 1 -- 172.21.15.91:0/582589031 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc003d80 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fcaffd640 1 -- 172.21.15.91:0/582589031 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc005070 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fcaffd640 1 -- 172.21.15.91:0/582589031 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc005420 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.906+0000 7f8fdc29b640 1 -- 172.21.15.91:0/582589031 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd41eaac0 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.907+0000 7f8fdc29b640 1 -- 172.21.15.91:0/582589031 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd4157a50 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.908+0000 7f8fdc29b640 1 -- 172.21.15.91:0/582589031 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd41575b0 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.909+0000 7f8fcaffd640 1 -- 172.21.15.91:0/582589031 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8fcc005580 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.910+0000 7f8fcaffd640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fb806b1c0 0x7f8fb806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:41.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.910+0000 7f8fcaffd640 1 -- 172.21.15.91:0/582589031 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8fcc088bb0 con 0x7f8fd40c5ec0 2023-11-27T20:46:41.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.910+0000 7f8fda037640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fb806b1c0 0x7f8fb806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:41.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.911+0000 7f8fda037640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fb806b1c0 0x7f8fb806d680 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0035000 tx=0x7f8fd0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:41.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:41.915+0000 7f8fcaffd640 1 -- 172.21.15.91:0/582589031 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8fcc053c10 con 0x7f8fd40c5ec0 2023-11-27T20:46:42.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.099+0000 7f8fdc29b640 1 -- 172.21.15.91:0/582589031 --> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fd40c62a0 con 0x7f8fb806b1c0 2023-11-27T20:46:42.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.106+0000 7f8fcaffd640 1 -- 172.21.15.91:0/582589031 <== mgr.4107 v2:172.21.15.91:6832/70399081 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48351 (secure 0 0 0) 0x7f8fd0031aa0 con 0x7f8fb806b1c0 2023-11-27T20:46:42.108 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:42.108 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-11-27T20:46:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 -- 172.21.15.91:0/582589031 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fb806b1c0 msgr2=0x7f8fb806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fb806b1c0 0x7f8fb806d680 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0035000 tx=0x7f8fd0030000 comp rx=0 tx=0).stop 2023-11-27T20:46:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 -- 172.21.15.91:0/582589031 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 msgr2=0x7f8fd40a77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 0x7f8fd40a77d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00c7b0 tx=0x7f8fcc00cc70 comp rx=0 tx=0).stop 2023-11-27T20:46:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 -- 172.21.15.91:0/582589031 shutdown_connections 2023-11-27T20:46:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fd40c5ec0 0x7f8fd40a77d0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f8fb806b1c0 0x7f8fb806d680 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd40c45d0 0x7f8fd41e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 --2- 172.21.15.91:0/582589031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd40721a0 0x7f8fd4158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 -- 172.21.15.91:0/582589031 >> 172.21.15.91:0/582589031 conn(0x7f8fd406a500 msgr2=0x7f8fd4070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:42.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.108+0000 7f8fdc29b640 1 -- 172.21.15.91:0/582589031 shutdown_connections 2023-11-27T20:46:42.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.109+0000 7f8fdc29b640 1 -- 172.21.15.91:0/582589031 wait complete. 2023-11-27T20:46:42.129 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-11-27T20:46:41.476491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259072,"kb_used_data":9640,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715648,"statfs":{"total":773094113280,"available":772828823552,"internally_reserved":0,"allocated":9871360,"data_stored":5097240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003386"},"pg_stats":[{"pgid":"1.0","version":"87'119","reported_seq":239,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-11-27T20:46:23.535048+0000","last_change":"2023-11-27T20:46:23.535175+0000","last_active":"2023-11-27T20:46:23.535048+0000","last_peered":"2023-11-27T20:46:23.535048+0000","last_clean":"2023-11-27T20:46:23.535048+0000","last_became_active":"2023-11-27T20:41:25.335291+0000","last_became_peered":"2023-11-27T20:41:25.335291+0000","last_unstale":"2023-11-27T20:46:23.535048+0000","last_undegraded":"2023-11-27T20:46:23.535048+0000","last_fullsized":"2023-11-27T20:46:23.535048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'119","last_scrub_stamp":"2023-11-27T20:46:23.534808+0000","last_deep_scrub":"87'119","last_deep_scrub_stamp":"2023-11-27T20:46:23.534808+0000","last_clean_scrub_stamp":"2023-11-27T20:46:23.534808+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:11:57.384120+0000","scrub_duration":0.012484406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32816,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339024,"statfs":{"total":96636764160,"available":96603160576,"internally_reserved":0,"allocated":1679360,"data_stored":1079931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:46:35 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.1020000000000001,"15min":1.1439999999999999},"min":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5569999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.091},{"interface":"front","average":{"1min":1.133,"5min":1.198,"15min":1.226},"min":{"1min":0.69099999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7370000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.3320000000000001}]},{"osd":1,"last update":"Mon Nov 27 20:46:35 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.167,"15min":1.2170000000000001},"min":{"1min":0.85499999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.657,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.129,"5min":1.1519999999999999,"15min":1.204},"min":{"1min":0.78800000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5229999999999999,"5min":2.052,"15min":2.052},"last":1.1850000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:46:35 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1439999999999999,"15min":1.262},"min":{"1min":0.79300000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4590000000000001,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1919999999999999,"15min":1.24},"min":{"1min":0.72199999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.4930000000000001,"5min":1.909,"15min":1.909},"last":1.288}]},{"osd":3,"last update":"Mon Nov 27 20:46:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2549999999999999,"15min":1.361},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.5129999999999999,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":1.137},{"interface":"front","average":{"1min":1.369,"5min":1.3759999999999999,"15min":1.4650000000000001},"min":{"1min":0.98399999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6220000000000001,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.4219999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:46:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2929999999999999,"15min":1.3839999999999999},"min":{"1min":0.88300000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5700000000000001,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.456},{"interface":"front","average":{"1min":1.274,"5min":1.3620000000000001,"15min":1.544},"min":{"1min":0.94599999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.675,"5min":3.4079999999999999,"15min":3.4079999999999999},"last":1.024}]},{"osd":5,"last update":"Mon Nov 27 20:46:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4139999999999999,"15min":1.484},"min":{"1min":1.046,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.796,"5min":2.371,"15min":2.371},"last":1.494},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.474,"15min":1.5629999999999999},"min":{"1min":1.206,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.637,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:46:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.5740000000000001,"15min":1.6499999999999999},"min":{"1min":1.1319999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.72,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.272},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.532,"15min":1.653},"min":{"1min":1.0109999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.8049999999999999,"5min":6.2190000000000003,"15min":6.2190000000000003},"last":1.371}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1699999999999999,"15min":1.252},"min":{"1min":0.63700000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.5860000000000001,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.2270000000000001,"15min":1.3049999999999999},"min":{"1min":0.80000000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5700000000000001,"5min":2.581,"15min":2.581},"last":1.2669999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1319999999999999,"15min":1.236},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.173,"5min":1.1259999999999999,"15min":1.1579999999999999},"min":{"1min":0.69899999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.637,"5min":2.823,"15min":2.823},"last":1.575}]},{"osd":2,"last update":"Mon Nov 27 20:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0620000000000001,"15min":1.0760000000000001},"min":{"1min":0.71299999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3400000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.145},{"interface":"front","average":{"1min":1.161,"5min":1.2270000000000001,"15min":1.3560000000000001},"min":{"1min":0.79500000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5009999999999999,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.2050000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2470000000000001,"15min":1.353},"min":{"1min":0.80600000000000005,"5min":0.747,"15min":0.747},"max":{"1min":1.6850000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.286,"15min":1.3380000000000001},"min":{"1min":1.0600000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.587,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.518}]},{"osd":4,"last update":"Mon Nov 27 20:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4079999999999999,"15min":1.5660000000000001},"min":{"1min":0.94999999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7210000000000001,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.4810000000000001,"15min":1.615},"min":{"1min":1.0700000000000001,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.835,"5min":3.536,"15min":3.536},"last":1.476}]},{"osd":5,"last update":"Mon Nov 27 20:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3180000000000001,"15min":1.383},"min":{"1min":0.88100000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.639,"5min":2.355,"15min":2.355},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.48,"15min":1.6240000000000001},"min":{"1min":1.129,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6899999999999999,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":1.4419999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:46:29 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.47,"15min":1.6319999999999999},"min":{"1min":0.96099999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7809999999999999,"5min":3.645,"15min":3.645},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.474,"15min":1.5569999999999999},"min":{"1min":1.022,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.655,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.6739999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:46:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.54000000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5009999999999999,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.115,"15min":1.1699999999999999},"min":{"1min":0.65300000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6910000000000001,"5min":2.04,"15min":2.04},"last":1.153}]},{"osd":1,"last update":"Mon Nov 27 20:46:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.143,"15min":1.1919999999999999},"min":{"1min":0.88,"5min":0.379,"15min":0.379},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.157,"15min":1.1659999999999999},"min":{"1min":0.56499999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.3180000000000001}]},{"osd":2,"last update":"Mon Nov 27 20:46:37 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.194,"15min":1.2689999999999999},"min":{"1min":0.88200000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.7270000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.286},{"interface":"front","average":{"1min":1.23,"5min":1.1579999999999999,"15min":1.202},"min":{"1min":0.73799999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.722,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.7130000000000001}]},{"osd":3,"last update":"Mon Nov 27 20:46:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.298,"15min":1.3759999999999999},"min":{"1min":0.96599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.641,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.395},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2609999999999999,"15min":1.4139999999999999},"min":{"1min":0.83899999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.903,"5min":4.016,"15min":4.016},"last":1.903}]},{"osd":4,"last update":"Mon Nov 27 20:46:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2110000000000001,"15min":1.343},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7430000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.212},{"interface":"front","average":{"1min":1.294,"5min":1.389,"15min":1.569},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.0409999999999999,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.5069999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:46:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.399,"15min":1.5980000000000001},"min":{"1min":0.68300000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.8089999999999999,"5min":4.2149999999999999,"15min":4.2149999999999999},"last":1.8089999999999999},{"interface":"front","average":{"1min":1.458,"5min":1.4279999999999999,"15min":1.5640000000000001},"min":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.901,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.5620000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:46:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4890000000000001,"15min":1.6319999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.129,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5129999999999999,"15min":1.6950000000000001},"min":{"1min":0.73999999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.9970000000000001,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.9970000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.034,"15min":1.014},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.786,"5min":2.786,"15min":2.786},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.111,"5min":1.115,"15min":1.0920000000000001},"min":{"1min":0.77700000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.671,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.2549999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.135,"15min":1.0409999999999999},"min":{"1min":0.73599999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6040000000000001,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.351},{"interface":"front","average":{"1min":1.155,"5min":1.232,"15min":1.2230000000000001},"min":{"1min":0.69999999999999996,"5min":0.628,"15min":0.628},"max":{"1min":2.1019999999999999,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.196}]},{"osd":2,"last update":"Mon Nov 27 20:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.206,"15min":1.208},"min":{"1min":0.71199999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.615,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.157},{"interface":"front","average":{"1min":1.224,"5min":1.2709999999999999,"15min":1.2869999999999999},"min":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6839999999999999,"5min":1.792,"15min":1.792},"last":1.4239999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.127,"15min":1.1619999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.034},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.371,"15min":1.347},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.004,"5min":2.097,"15min":2.097},"last":1.375}]},{"osd":5,"last update":"Mon Nov 27 20:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.2070000000000001,"15min":1.264},"min":{"1min":0.78800000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.407},{"interface":"front","average":{"1min":1.629,"5min":1.417,"15min":1.4279999999999999},"min":{"1min":0.81699999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":5.8179999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":1.0860000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3380000000000001,"15min":1.3620000000000001},"min":{"1min":0.87,"5min":0.63,"15min":0.63},"max":{"1min":2.0449999999999999,"5min":2.157,"15min":2.157},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.5509999999999999,"15min":1.591},"min":{"1min":0.64400000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":5.9299999999999997,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.3240000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.4990000000000001,"15min":1.4970000000000001},"min":{"1min":1.0349999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.464},{"interface":"front","average":{"1min":1.657,"5min":1.6339999999999999,"15min":1.6519999999999999},"min":{"1min":1.02,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":1.4950000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.81100000000000005,"15min":0.97499999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.105,"5min":3.641,"15min":3.641},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88100000000000001,"15min":0.98299999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.5620000000000001,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.73899999999999999}]},{"osd":1,"last update":"Mon Nov 27 20:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.86199999999999999,"15min":0.92300000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2949999999999999,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.96799999999999997,"15min":1.0780000000000001},"min":{"1min":0.44600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4890000000000001,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.046}]},{"osd":2,"last update":"Mon Nov 27 20:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.0900000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.677,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":1.008,"15min":1.0980000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.3899999999999999,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.89100000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:46:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2509999999999999,"15min":1.3200000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9530000000000001,"5min":3.8050000000000002,"15min":3.8050000000000002},"last":1.218},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2490000000000001,"15min":1.363},"min":{"1min":0.79400000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.7729999999999999,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":1.327}]},{"osd":5,"last update":"Mon Nov 27 20:46:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2849999999999999,"15min":1.393},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.8200000000000001,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.3220000000000001,"15min":1.4390000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.905,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.474}]},{"osd":6,"last update":"Mon Nov 27 20:46:31 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.375,"15min":1.496},"min":{"1min":0.80700000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8200000000000001,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":1.409},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3720000000000001,"15min":1.482},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.0230000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":1.3680000000000001}]},{"osd":7,"last update":"Mon Nov 27 20:46:31 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.413,"15min":1.522},"min":{"1min":0.88,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.1419999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":1.504},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3959999999999999,"15min":1.47},"min":{"1min":0.83099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.0259999999999998,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.1839999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77600000000000002,"15min":0.80400000000000005},"min":{"1min":0.56499999999999995,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.083,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.86499999999999999,"15min":0.91800000000000004},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.5,"5min":1.972,"15min":1.972},"last":0.91800000000000004}]},{"osd":1,"last update":"Mon Nov 27 20:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.98099999999999998},"min":{"1min":0.64600000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3819999999999999,"5min":1.522,"15min":1.522},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.94599999999999995,"15min":0.98199999999999998},"min":{"1min":0.51400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.6619999999999999,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.516}]},{"osd":3,"last update":"Mon Nov 27 20:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.90400000000000003,"15min":0.94799999999999995},"min":{"1min":0.496,"5min":0.44,"15min":0.44},"max":{"1min":1.4890000000000001,"5min":1.794,"15min":1.794},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.0489999999999999,"15min":1.093},"min":{"1min":0.55300000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.623,"5min":1.75,"15min":1.75},"last":1.254}]},{"osd":4,"last update":"Mon Nov 27 20:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1339999999999999,"15min":1.1930000000000001},"min":{"1min":0.80600000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5309999999999999,"5min":1.669,"15min":1.669},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.3620000000000001},"min":{"1min":0.82999999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9330000000000001,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.1779999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2130000000000001,"15min":1.2969999999999999},"min":{"1min":0.86399999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.661,"5min":2.48,"15min":2.48},"last":1.341},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3160000000000001,"15min":1.448},"min":{"1min":0.91900000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6399999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.3069999999999999}]},{"osd":6,"last update":"Mon Nov 27 20:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.341,"15min":1.373},"min":{"1min":0.84799999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0179999999999998,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.369},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3560000000000001,"15min":1.492},"min":{"1min":1.0029999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.72,"5min":3.302,"15min":3.302},"last":1.3959999999999999}]},{"osd":7,"last update":"Mon Nov 27 20:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.369,"15min":1.4650000000000001},"min":{"1min":0.78900000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.157,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.319,"15min":1.4430000000000001},"min":{"1min":0.94299999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.968,"5min":2.73,"15min":2.73},"last":1.0409999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":489563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 20:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.33200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86699999999999999,"15min":0.871},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.371,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.194}]},{"osd":2,"last update":"Mon Nov 27 20:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86799999999999999,"15min":0.95599999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.226,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.03,"15min":1.0429999999999999},"min":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.0109999999999999}]},{"osd":3,"last update":"Mon Nov 27 20:46:32 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.03,"15min":1.0269999999999999},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4399999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0049999999999999,"15min":1.0609999999999999},"min":{"1min":0.437,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.472,"5min":2.044,"15min":2.044},"last":1.0529999999999999}]},{"osd":4,"last update":"Mon Nov 27 20:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1850000000000001,"15min":1.1910000000000001},"min":{"1min":0.77700000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.629,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3460000000000001,"15min":1.3480000000000001},"min":{"1min":0.90900000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.605,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.5629999999999999}]},{"osd":5,"last update":"Mon Nov 27 20:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2669999999999999,"15min":1.2390000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4890000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.131},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2669999999999999,"15min":1.2390000000000001},"min":{"1min":0.70399999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.714,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.091}]},{"osd":6,"last update":"Mon Nov 27 20:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.331,"15min":1.3160000000000001},"min":{"1min":0.77000000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.609,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.272},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.304,"15min":1.3440000000000001},"min":{"1min":0.91000000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.78,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.169}]},{"osd":7,"last update":"Mon Nov 27 20:46:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.405,"15min":1.4550000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.71,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.472,"15min":1.546},"min":{"1min":0.89000000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.669,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":1.359}]}]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32816,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339024,"statfs":{"total":96636764160,"available":96603160576,"internally_reserved":0,"allocated":1679360,"data_stored":1079931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 20:46:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.32200000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.464,"5min":1.901,"15min":1.901},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.88200000000000001,"15min":0.85199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.379,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.448}]},{"osd":2,"last update":"Mon Nov 27 20:46:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90900000000000003,"15min":0.85399999999999998},"min":{"1min":0.48799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3700000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4670000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.96199999999999997}]},{"osd":3,"last update":"Mon Nov 27 20:46:33 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90900000000000003,"15min":0.89500000000000002},"min":{"1min":0.46800000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4199999999999999,"5min":1.875,"15min":1.875},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.085,"15min":1.0609999999999999},"min":{"1min":0.56599999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.8140000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.1890000000000001}]},{"osd":4,"last update":"Mon Nov 27 20:46:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.222,"15min":1.238},"min":{"1min":0.66600000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5840000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.1950000000000001,"15min":1.1910000000000001},"min":{"1min":0.72899999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6599999999999999,"5min":2.391,"15min":2.391},"last":1.2230000000000001}]},{"osd":5,"last update":"Mon Nov 27 20:46:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3029999999999999,"15min":1.339},"min":{"1min":0.72399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5680000000000001,"5min":3.028,"15min":3.028},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2789999999999999,"15min":1.2989999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5029999999999999,"5min":2.718,"15min":2.718},"last":1.3580000000000001}]},{"osd":6,"last update":"Mon Nov 27 20:46:33 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.254,"15min":1.294},"min":{"1min":0.86799999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7989999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3799999999999999,"15min":1.4099999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7170000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":1.492}]},{"osd":7,"last update":"Mon Nov 27 20:46:33 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3320000000000001,"15min":1.3480000000000001},"min":{"1min":0.90900000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6240000000000001,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.252},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.3180000000000001,"15min":1.347},"min":{"1min":0.84499999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.895,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3340000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T20:46:42.132 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-27T20:46:42.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.335+0000 7fd2e7890640 1 Processor -- start 2023-11-27T20:46:42.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.335+0000 7fd2e7890640 1 -- start start 2023-11-27T20:46:42.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.336+0000 7fd2e7890640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd2e00c5ec0 0x7fd2e00c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.336+0000 7fd2e7890640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e00c45d0 0x7fd2e00c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.336+0000 7fd2e7890640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd2e00721a0 0x7fd2e0155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.336+0000 7fd2e7890640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e006e390 con 0x7fd2e00c5ec0 2023-11-27T20:46:42.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.336+0000 7fd2e7890640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e00bfdc0 con 0x7fd2e00721a0 2023-11-27T20:46:42.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.336+0000 7fd2e7890640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e006ddd0 con 0x7fd2e00c45d0 2023-11-27T20:46:42.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.337+0000 7fd2e562c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd2e00c5ec0 0x7fd2e00c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:42.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.337+0000 7fd2e562c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd2e00c5ec0 0x7fd2e00c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46090/0 (socket says 172.21.15.91:46090) 2023-11-27T20:46:42.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.337+0000 7fd2e562c640 1 -- 172.21.15.91:0/1874047023 learned_addr learned my addr 172.21.15.91:0/1874047023 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:42.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.337+0000 7fd2e562c640 1 -- 172.21.15.91:0/1874047023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e00c45d0 msgr2=0x7fd2e00c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:42.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.337+0000 7fd2e562c640 1 --2- 172.21.15.91:0/1874047023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e00c45d0 0x7fd2e00c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.337+0000 7fd2e562c640 1 -- 172.21.15.91:0/1874047023 >> v2:172.21.15.183:3300/0 conn(0x7fd2e00721a0 msgr2=0x7fd2e0155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:42.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.337+0000 7fd2e562c640 1 --2- 172.21.15.91:0/1874047023 >> v2:172.21.15.183:3300/0 conn(0x7fd2e00721a0 0x7fd2e0155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.337+0000 7fd2e562c640 1 -- 172.21.15.91:0/1874047023 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e006e0b0 con 0x7fd2e00c5ec0 2023-11-27T20:46:42.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.338+0000 7fd2e562c640 1 --2- 172.21.15.91:0/1874047023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c5ec0 0x7fd2e00c2c30 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009870 tx=0x7fd2dc02b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be411dda511d060 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:42.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.338+0000 7fd2d7fff640 1 -- 172.21.15.91:0/1874047023 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc033620 con 0x7fd2e00c5ec0 2023-11-27T20:46:42.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.338+0000 7fd2d7fff640 1 -- 172.21.15.91:0/1874047023 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc033780 con 0x7fd2e00c5ec0 2023-11-27T20:46:42.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.338+0000 7fd2d7fff640 1 -- 172.21.15.91:0/1874047023 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc033b10 con 0x7fd2e00c5ec0 2023-11-27T20:46:42.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.339+0000 7fd2e7890640 1 -- 172.21.15.91:0/1874047023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c5ec0 msgr2=0x7fd2e00c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.339+0000 7fd2e7890640 1 --2- 172.21.15.91:0/1874047023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c5ec0 0x7fd2e00c2c30 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009870 tx=0x7fd2dc02b7d0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.339+0000 7fd2e7890640 1 -- 172.21.15.91:0/1874047023 shutdown_connections 2023-11-27T20:46:42.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.339+0000 7fd2e7890640 1 --2- 172.21.15.91:0/1874047023 >> v2:172.21.15.183:3300/0 conn(0x7fd2e00721a0 0x7fd2e0155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.339+0000 7fd2e7890640 1 --2- 172.21.15.91:0/1874047023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e00c45d0 0x7fd2e00c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.339+0000 7fd2e7890640 1 --2- 172.21.15.91:0/1874047023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c5ec0 0x7fd2e00c2c30 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.339+0000 7fd2e7890640 1 -- 172.21.15.91:0/1874047023 >> 172.21.15.91:0/1874047023 conn(0x7fd2e006a500 msgr2=0x7fd2e006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:42.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.339+0000 7fd2e7890640 1 -- 172.21.15.91:0/1874047023 shutdown_connections 2023-11-27T20:46:42.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.339+0000 7fd2e7890640 1 -- 172.21.15.91:0/1874047023 wait complete. 2023-11-27T20:46:42.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.341+0000 7fd2e7890640 1 Processor -- start 2023-11-27T20:46:42.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.341+0000 7fd2e7890640 1 -- start start 2023-11-27T20:46:42.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e7890640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2e00721a0 0x7fd2e01ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e7890640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c45d0 0x7fd2e014e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e7890640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e00c5ec0 0x7fd2e014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e7890640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00a6790 con 0x7fd2e00c45d0 2023-11-27T20:46:42.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e7890640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e014eba0 con 0x7fd2e00721a0 2023-11-27T20:46:42.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e7890640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e01eaac0 con 0x7fd2e00c5ec0 2023-11-27T20:46:42.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e4e2b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c45d0 0x7fd2e014e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:42.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e4e2b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c45d0 0x7fd2e014e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46102/0 (socket says 172.21.15.91:46102) 2023-11-27T20:46:42.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e4e2b640 1 -- 172.21.15.91:0/3108363348 learned_addr learned my addr 172.21.15.91:0/3108363348 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:42.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e562c640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2e00721a0 0x7fd2e01ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:42.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.342+0000 7fd2e5e2d640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e00c5ec0 0x7fd2e014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:42.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2e4e2b640 1 -- 172.21.15.91:0/3108363348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e00c5ec0 msgr2=0x7fd2e014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.346 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2e4e2b640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e00c5ec0 0x7fd2e014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2e4e2b640 1 -- 172.21.15.91:0/3108363348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2e00721a0 msgr2=0x7fd2e01ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2e4e2b640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2e00721a0 0x7fd2e01ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2e4e2b640 1 -- 172.21.15.91:0/3108363348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc0094d0 con 0x7fd2e00c45d0 2023-11-27T20:46:42.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2e4e2b640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c45d0 0x7fd2e014e120 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000b4d0 tx=0x7fd2d000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:42.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2d5ffb640 1 -- 172.21.15.91:0/3108363348 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0010870 con 0x7fd2e00c45d0 2023-11-27T20:46:42.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2d5ffb640 1 -- 172.21.15.91:0/3108363348 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d00109d0 con 0x7fd2e00c45d0 2023-11-27T20:46:42.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2e7890640 1 -- 172.21.15.91:0/3108363348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e0158b00 con 0x7fd2e00c45d0 2023-11-27T20:46:42.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2d5ffb640 1 -- 172.21.15.91:0/3108363348 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0010d80 con 0x7fd2e00c45d0 2023-11-27T20:46:42.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.343+0000 7fd2e7890640 1 -- 172.21.15.91:0/3108363348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e0158820 con 0x7fd2e00c45d0 2023-11-27T20:46:42.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.345+0000 7fd2e7890640 1 -- 172.21.15.91:0/3108363348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e0068350 con 0x7fd2e00c45d0 2023-11-27T20:46:42.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.345+0000 7fd2d5ffb640 1 -- 172.21.15.91:0/3108363348 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd2d000f3c0 con 0x7fd2e00c45d0 2023-11-27T20:46:42.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.346+0000 7fd2d5ffb640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd2c406b1c0 0x7fd2c406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.346+0000 7fd2d5ffb640 1 -- 172.21.15.91:0/3108363348 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd2d00896b0 con 0x7fd2e00c45d0 2023-11-27T20:46:42.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.347+0000 7fd2e562c640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd2c406b1c0 0x7fd2c406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:42.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.348+0000 7fd2e562c640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd2c406b1c0 0x7fd2c406d680 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc035000 tx=0x7fd2dc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:42.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.351+0000 7fd2d5ffb640 1 -- 172.21.15.91:0/3108363348 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd2d0054710 con 0x7fd2e00c45d0 2023-11-27T20:46:42.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.542+0000 7fd2e7890640 1 -- 172.21.15.91:0/3108363348 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fd2e00bfa00 con 0x7fd2e00c45d0 2023-11-27T20:46:42.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.549+0000 7fd2d5ffb640 1 -- 172.21.15.91:0/3108363348 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd2d0057d30 con 0x7fd2e00c45d0 2023-11-27T20:46:42.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.551+0000 7fd2d5ffb640 1 -- 172.21.15.91:0/3108363348 <== mon.0 v2:172.21.15.91:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd2d0054710 con 0x7fd2e00c45d0 2023-11-27T20:46:42.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.553+0000 7fd2e7890640 1 -- 172.21.15.91:0/3108363348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd2c406b1c0 msgr2=0x7fd2c406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.553+0000 7fd2e7890640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd2c406b1c0 0x7fd2c406d680 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc035000 tx=0x7fd2dc008030 comp rx=0 tx=0).stop 2023-11-27T20:46:42.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.553+0000 7fd2e7890640 1 -- 172.21.15.91:0/3108363348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c45d0 msgr2=0x7fd2e014e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.553+0000 7fd2e7890640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c45d0 0x7fd2e014e120 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000b4d0 tx=0x7fd2d000b990 comp rx=0 tx=0).stop 2023-11-27T20:46:42.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.553+0000 7fd2e7890640 1 -- 172.21.15.91:0/3108363348 shutdown_connections 2023-11-27T20:46:42.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.553+0000 7fd2e7890640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e00c5ec0 0x7fd2e014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.553+0000 7fd2e7890640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd2e00c45d0 0x7fd2e014e120 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.553+0000 7fd2e7890640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7fd2c406b1c0 0x7fd2c406d680 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.553+0000 7fd2e7890640 1 --2- 172.21.15.91:0/3108363348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2e00721a0 0x7fd2e01ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.553+0000 7fd2e7890640 1 -- 172.21.15.91:0/3108363348 >> 172.21.15.91:0/3108363348 conn(0x7fd2e006a500 msgr2=0x7fd2e0070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:42.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.554+0000 7fd2e7890640 1 -- 172.21.15.91:0/3108363348 shutdown_connections 2023-11-27T20:46:42.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.554+0000 7fd2e7890640 1 -- 172.21.15.91:0/3108363348 wait complete. 2023-11-27T20:46:42.575 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-27T20:46:42.575 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T20:46:42.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.774+0000 7f69bf26e640 1 Processor -- start 2023-11-27T20:46:42.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.774+0000 7f69bf26e640 1 -- start start 2023-11-27T20:46:42.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.775+0000 7f69bf26e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f69b80c0440 0x7f69b80c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.775+0000 7f69bf26e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b8071e80 con 0x7f69b8072310 2023-11-27T20:46:42.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.775+0000 7f69bf26e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b814c6c0 con 0x7f69b814c2e0 2023-11-27T20:46:42.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.775+0000 7f69bf26e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b8071470 con 0x7f69b80c0440 2023-11-27T20:46:42.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.776+0000 7f69bda6b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f69b80c0440 0x7f69b80c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:42.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.776+0000 7f69bea6d640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f69b8072310 0x7f69b80a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:48780/0 (socket says 172.21.15.91:48780) 2023-11-27T20:46:42.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.776+0000 7f69bea6d640 1 -- 172.21.15.91:0/3500035363 learned_addr learned my addr 172.21.15.91:0/3500035363 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-27T20:46:42.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.776+0000 7f69bda6b640 1 -- 172.21.15.91:0/3500035363 >> v1:172.21.15.183:6789/0 conn(0x7f69b814c2e0 legacy=0x7f69b8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T20:46:42.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.776+0000 7f69bda6b640 1 -- 172.21.15.91:0/3500035363 >> v1:172.21.15.91:6789/0 conn(0x7f69b8072310 legacy=0x7f69b80a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.776+0000 7f69bda6b640 1 -- 172.21.15.91:0/3500035363 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b806fdc0 con 0x7f69b80c0440 2023-11-27T20:46:42.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.777+0000 7f69bda6b640 1 --2- 172.21.15.91:0/3500035363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b80c0440 0x7f69b80c0c80 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f69a80097a0 tx=0x7f69a802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06a96ddaa064a63 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:42.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.777+0000 7f69bd26a640 1 -- 172.21.15.91:0/3500035363 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a802f050 con 0x7f69b80c0440 2023-11-27T20:46:42.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.777+0000 7f69bd26a640 1 -- 172.21.15.91:0/3500035363 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f69a8031700 con 0x7f69b80c0440 2023-11-27T20:46:42.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.777+0000 7f69bd26a640 1 -- 172.21.15.91:0/3500035363 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8031ab0 con 0x7f69b80c0440 2023-11-27T20:46:42.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.778+0000 7f69bf26e640 1 -- 172.21.15.91:0/3500035363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b80c0440 msgr2=0x7f69b80c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.778+0000 7f69bf26e640 1 --2- 172.21.15.91:0/3500035363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b80c0440 0x7f69b80c0c80 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f69a80097a0 tx=0x7f69a802b7a0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.778+0000 7f69bf26e640 1 -- 172.21.15.91:0/3500035363 shutdown_connections 2023-11-27T20:46:42.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.778+0000 7f69bf26e640 1 --2- 172.21.15.91:0/3500035363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b80c0440 0x7f69b80c0c80 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.778+0000 7f69bf26e640 1 -- 172.21.15.91:0/3500035363 >> 172.21.15.91:0/3500035363 conn(0x7f69b80a77f0 msgr2=0x7f69b80a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:42.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.778+0000 7f69bf26e640 1 -- 172.21.15.91:0/3500035363 shutdown_connections 2023-11-27T20:46:42.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.778+0000 7f69bf26e640 1 -- 172.21.15.91:0/3500035363 wait complete. 2023-11-27T20:46:42.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.780+0000 7f69bf26e640 1 Processor -- start 2023-11-27T20:46:42.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.780+0000 7f69bf26e640 1 -- start start 2023-11-27T20:46:42.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.781+0000 7f69bf26e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b8072310 0x7f69b80aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.781+0000 7f69bf26e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b80c0440 0x7f69b81467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.781+0000 7f69bf26e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b814c2e0 0x7f69b814aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.781+0000 7f69bf26e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b8156250 con 0x7f69b8072310 2023-11-27T20:46:42.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.781+0000 7f69bf26e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b81ed370 con 0x7f69b814c2e0 2023-11-27T20:46:42.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.781+0000 7f69bf26e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b81ed650 con 0x7f69b80c0440 2023-11-27T20:46:42.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.781+0000 7f69be26c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b8072310 0x7f69b80aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:42.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.781+0000 7f69be26c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b8072310 0x7f69b80aab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:46124/0 (socket says 172.21.15.91:46124) 2023-11-27T20:46:42.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.781+0000 7f69be26c640 1 -- 172.21.15.91:0/233608654 learned_addr learned my addr 172.21.15.91:0/233608654 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-27T20:46:42.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69be26c640 1 -- 172.21.15.91:0/233608654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b80c0440 msgr2=0x7f69b81467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69be26c640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b80c0440 0x7f69b81467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69be26c640 1 -- 172.21.15.91:0/233608654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b814c2e0 msgr2=0x7f69b814aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:42.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69bea6d640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b814c2e0 0x7f69b814aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:42.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69be26c640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b814c2e0 0x7f69b814aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:42.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69be26c640 1 -- 172.21.15.91:0/233608654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a8009400 con 0x7f69b8072310 2023-11-27T20:46:42.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69bea6d640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b814c2e0 0x7f69b814aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T20:46:42.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69be26c640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b8072310 0x7f69b80aab80 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f69b400b3f0 tx=0x7f69b400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:42.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69aeffd640 1 -- 172.21.15.91:0/233608654 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4011830 con 0x7f69b8072310 2023-11-27T20:46:42.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69aeffd640 1 -- 172.21.15.91:0/233608654 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f69b4011990 con 0x7f69b8072310 2023-11-27T20:46:42.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69aeffd640 1 -- 172.21.15.91:0/233608654 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4011d60 con 0x7f69b8072310 2023-11-27T20:46:42.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69bf26e640 1 -- 172.21.15.91:0/233608654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b81ed930 con 0x7f69b8072310 2023-11-27T20:46:42.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.782+0000 7f69bf26e640 1 -- 172.21.15.91:0/233608654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b81edef0 con 0x7f69b8072310 2023-11-27T20:46:42.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.783+0000 7f69bf26e640 1 -- 172.21.15.91:0/233608654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b81ee0e0 con 0x7f69b8072310 2023-11-27T20:46:42.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.784+0000 7f69aeffd640 1 -- 172.21.15.91:0/233608654 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f69b401a400 con 0x7f69b8072310 2023-11-27T20:46:42.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.785+0000 7f69aeffd640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f699c06b1c0 0x7f699c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T20:46:42.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.785+0000 7f69aeffd640 1 -- 172.21.15.91:0/233608654 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f69b40895e0 con 0x7f69b8072310 2023-11-27T20:46:42.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.786+0000 7f69bda6b640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f699c06b1c0 0x7f699c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T20:46:42.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.786+0000 7f69bda6b640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f699c06b1c0 0x7f699c06d680 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f69a8035000 tx=0x7f69a8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T20:46:42.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:42.790+0000 7f69aeffd640 1 -- 172.21.15.91:0/233608654 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f69b40545a0 con 0x7f69b8072310 2023-11-27T20:46:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.019+0000 7f69bf26e640 1 -- 172.21.15.91:0/233608654 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69b804e840 con 0x7f69b8072310 2023-11-27T20:46:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.020+0000 7f69aeffd640 1 -- 172.21.15.91:0/233608654 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f69b4015e90 con 0x7f69b8072310 2023-11-27T20:46:43.021 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-27T20:46:43.022 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1477264105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1477264105},{"type":"v1","addr":"172.21.15.183:6834","nonce":1477264105}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3277281414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3277281414},{"type":"v1","addr":"172.21.15.183:6835","nonce":3277281414}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6519,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/1422044337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1422044337},{"type":"v1","addr":"172.21.15.91:6836","nonce":1422044337}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1116645537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":1116645537},{"type":"v1","addr":"172.21.15.91:6837","nonce":1116645537}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[]} 2023-11-27T20:46:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 55 2023-11-27T20:46:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 -- 172.21.15.91:0/233608654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f699c06b1c0 msgr2=0x7f699c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f699c06b1c0 0x7f699c06d680 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f69a8035000 tx=0x7f69a8030000 comp rx=0 tx=0).stop 2023-11-27T20:46:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 -- 172.21.15.91:0/233608654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b8072310 msgr2=0x7f69b80aab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T20:46:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b8072310 0x7f69b80aab80 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f69b400b3f0 tx=0x7f69b400b8b0 comp rx=0 tx=0).stop 2023-11-27T20:46:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 -- 172.21.15.91:0/233608654 shutdown_connections 2023-11-27T20:46:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.91:6832/70399081,v1:172.21.15.91:6833/70399081] conn(0x7f699c06b1c0 0x7f699c06d680 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b814c2e0 0x7f69b814aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b80c0440 0x7f69b81467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 --2- 172.21.15.91:0/233608654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69b8072310 0x7f69b80aab80 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T20:46:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 -- 172.21.15.91:0/233608654 >> 172.21.15.91:0/233608654 conn(0x7f69b80a77f0 msgr2=0x7f69b81528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T20:46:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 -- 172.21.15.91:0/233608654 shutdown_connections 2023-11-27T20:46:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-27T20:46:43.023+0000 7f69bf26e640 1 -- 172.21.15.91:0/233608654 wait complete. 2023-11-27T20:46:43.042 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-27T20:46:43.043 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-27T20:46:43.043 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-27T20:46:43.043 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.061 INFO:tasks.ceph.mds.a:Stopped 2023-11-27T20:46:43.061 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-27T20:46:43.062 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.131 INFO:tasks.ceph.mds.c:Stopped 2023-11-27T20:46:43.131 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-27T20:46:43.131 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.158 INFO:tasks.ceph.mds.b:Stopped 2023-11-27T20:46:43.159 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-27T20:46:43.159 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.223 INFO:tasks.ceph.mds.d:Stopped 2023-11-27T20:46:43.223 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-27T20:46:43.223 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-27T20:46:43.223 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.282 INFO:tasks.ceph.osd.0:Stopped 2023-11-27T20:46:43.282 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-27T20:46:43.283 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.356 INFO:tasks.ceph.osd.1:Stopped 2023-11-27T20:46:43.357 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-27T20:46:43.357 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.428 INFO:tasks.ceph.osd.2:Stopped 2023-11-27T20:46:43.429 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-27T20:46:43.429 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.479 INFO:tasks.ceph.osd.3:Stopped 2023-11-27T20:46:43.480 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-27T20:46:43.480 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.557 INFO:tasks.ceph.osd.4:Stopped 2023-11-27T20:46:43.557 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-27T20:46:43.557 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.626 INFO:tasks.ceph.osd.5:Stopped 2023-11-27T20:46:43.626 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-27T20:46:43.626 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.694 INFO:tasks.ceph.osd.6:Stopped 2023-11-27T20:46:43.694 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-27T20:46:43.694 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.768 INFO:tasks.ceph.osd.7:Stopped 2023-11-27T20:46:43.768 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-27T20:46:43.768 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-27T20:46:43.768 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.865 INFO:tasks.ceph.mgr.y:Stopped 2023-11-27T20:46:43.866 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-27T20:46:43.866 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.941 INFO:tasks.ceph.mgr.x:Stopped 2023-11-27T20:46:43.941 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-27T20:46:43.941 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-27T20:46:43.942 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:43.986 INFO:tasks.ceph.mon.a:Stopped 2023-11-27T20:46:43.986 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-27T20:46:43.986 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:44.023 INFO:tasks.ceph.mon.b:Stopped 2023-11-27T20:46:44.023 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-27T20:46:44.023 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T20:46:44.111 INFO:tasks.ceph.mon.c:Stopped 2023-11-27T20:46:44.111 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-27T20:46:44.112 DEBUG:teuthology.orchestra.run.smithi091:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-27T20:46:44.219 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:46:44.219 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-27T20:46:44.459 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:46:44.459 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-27T20:46:44.620 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:46:44.620 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-27T20:46:44.775 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:46:44.775 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-27T20:46:44.938 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:46:44.939 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-27T20:46:45.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:46:45.215 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-27T20:46:45.372 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:46:45.372 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-27T20:46:45.501 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:46:45.501 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-27T20:46:45.645 INFO:tasks.ceph:Archiving mon data... 2023-11-27T20:46:45.646 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095/data/mon.a.tgz 2023-11-27T20:46:45.647 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-27T20:46:45.708 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.JqEMLgezmm 2023-11-27T20:46:45.709 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JqEMLgezmm 2023-11-27T20:46:45.929 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.JqEMLgezmm 2023-11-27T20:46:46.082 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.JqEMLgezmm is 478KB 2023-11-27T20:46:46.193 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.JqEMLgezmm 2023-11-27T20:46:46.252 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095/data/mon.b.tgz 2023-11-27T20:46:46.252 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-11-27T20:46:46.311 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.JhW51VKstA 2023-11-27T20:46:46.311 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.JhW51VKstA 2023-11-27T20:46:46.561 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.JhW51VKstA 2023-11-27T20:46:46.714 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.JhW51VKstA is 620KB 2023-11-27T20:46:46.829 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.JhW51VKstA 2023-11-27T20:46:46.888 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095/data/mon.c.tgz 2023-11-27T20:46:46.888 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-11-27T20:46:46.939 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.EXhwUPeEqY 2023-11-27T20:46:46.941 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.EXhwUPeEqY 2023-11-27T20:46:47.175 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.EXhwUPeEqY 2023-11-27T20:46:47.332 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.EXhwUPeEqY is 620KB 2023-11-27T20:46:47.444 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.EXhwUPeEqY 2023-11-27T20:46:47.503 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-27T20:46:47.504 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-27T20:46:47.513 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-27T20:46:47.612 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-27T20:46:47.612 DEBUG:teuthology.orchestra.run.smithi091:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-27T20:46:47.621 DEBUG:teuthology.orchestra.run.smithi183:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-27T20:46:47.719 INFO:teuthology.orchestra.run.smithi091.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-27T20:46:47.724 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-27T20:46:47.737 INFO:tasks.ceph:Archiving crash dumps... 2023-11-27T20:46:47.739 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095/remote/smithi091/crash 2023-11-27T20:46:47.741 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-27T20:46:47.827 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095/remote/smithi183/crash 2023-11-27T20:46:47.828 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-27T20:46:47.922 INFO:tasks.ceph:Shutting down logrotate 2023-11-27T20:46:47.923 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:47.932 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:48.077 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:48.178 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:48.279 INFO:tasks.ceph:Compressing logs... 2023-11-27T20:46:48.279 DEBUG:teuthology.orchestra.run.smithi091:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-27T20:46:48.288 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-27T20:46:48.374 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108894.log 2023-11-27T20:46:48.375 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100579.log 2023-11-27T20:46:48.376 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102818.log 2023-11-27T20:46:48.377 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108894.log.gz 2023-11-27T20:46:48.377 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104055.log 2023-11-27T20:46:48.378 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100579.log.gz 2023-11-27T20:46:48.378 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103574.log 2023-11-27T20:46:48.379 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102818.log.gz 2023-11-27T20:46:48.380 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104055.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104055.log.gz 2023-11-27T20:46:48.380 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109687.log 2023-11-27T20:46:48.381 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114186.log 2023-11-27T20:46:48.381 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103574.log.gz 2023-11-27T20:46:48.382 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96057.log 2023-11-27T20:46:48.382 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109687.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.109687.log.gz 2023-11-27T20:46:48.382 INFO:teuthology.orchestra.run.smithi091.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111404.log 2023-11-27T20:46:48.384 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-27T20:46:48.384 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.96057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96057.log.gz 2023-11-27T20:46:48.384 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88630.log 2023-11-27T20:46:48.385 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105336.log 2023-11-27T20:46:48.385 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114186.log.gz 2023-11-27T20:46:48.385 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111404.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111404.log.gz 2023-11-27T20:46:48.385 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110012.log 2023-11-27T20:46:48.386 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107004.log 2023-11-27T20:46:48.388 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105336.log.gz 2023-11-27T20:46:48.388 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106482.log 2023-11-27T20:46:48.388 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110012.log.gz 2023-11-27T20:46:48.389 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107004.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107004.log.gz 2023-11-27T20:46:48.389 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-27T20:46:48.390 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88379.log 2023-11-27T20:46:48.391 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88630.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.88630.log.gz -- 2023-11-27T20:46:48.391 INFO:teuthology.orchestra.run.smithi183.stderr: /var/log/ceph/ceph-client.admin.88500.log 2023-11-27T20:46:48.391 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88590.log 2023-11-27T20:46:48.391 INFO:teuthology.orchestra.run.smithi183.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88379.log.gz 2023-11-27T20:46:48.391 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96053.log 2023-11-27T20:46:48.392 INFO:teuthology.orchestra.run.smithi183.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88500.log.gz 2023-11-27T20:46:48.392 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.96875.log 2023-11-27T20:46:48.392 INFO:teuthology.orchestra.run.smithi183.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88590.log.gz 2023-11-27T20:46:48.392 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.96053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96053.log.gz 2023-11-27T20:46:48.392 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88671.log 2023-11-27T20:46:48.392 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.testuser.96875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.96875.log.gz 2023-11-27T20:46:48.406 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95272.log 2023-11-27T20:46:48.411 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88671.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-27T20:46:48.411 INFO:teuthology.orchestra.run.smithi183.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88671.log.gz 2023-11-27T20:46:48.411 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.95272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95272.log.gz 2023-11-27T20:46:48.411 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-27T20:46:48.412 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95600.log 2023-11-27T20:46:48.412 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-27T20:46:48.412 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.95600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95600.log.gz 2023-11-27T20:46:48.412 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94466.log 2023-11-27T20:46:48.412 INFO:teuthology.orchestra.run.smithi183.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-27T20:46:48.412 INFO:teuthology.orchestra.run.smithi183.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-27T20:46:48.412 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94772.log 2023-11-27T20:46:48.412 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.94466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94466.log.gz 2023-11-27T20:46:48.413 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88548.log 2023-11-27T20:46:48.413 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.94772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94772.log.gz 2023-11-27T20:46:48.413 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-27T20:46:48.413 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88548.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88548.log.gz 2023-11-27T20:46:48.413 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-27T20:46:48.413 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96385.log 2023-11-27T20:46:48.413 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94462.log 2023-11-27T20:46:48.413 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.96385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96385.log.gz 2023-11-27T20:46:48.414 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95596.log 2023-11-27T20:46:48.421 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.94462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94462.log.gz 2023-11-27T20:46:48.422 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93917.log 2023-11-27T20:46:48.422 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.95596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95596.log.gz 2023-11-27T20:46:48.422 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-27T20:46:48.422 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.93917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.93917.log.gz 2023-11-27T20:46:48.422 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95268.log 2023-11-27T20:46:48.422 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-27T20:46:48.422 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.95268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95268.log.gz 2023-11-27T20:46:48.423 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96381.log 2023-11-27T20:46:48.423 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94776.log 2023-11-27T20:46:48.423 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.96381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96381.log.gz 2023-11-27T20:46:48.423 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-27T20:46:48.423 INFO:teuthology.orchestra.run.smithi183.stderr: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-27T20:46:48.423 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.94776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94776.log.gz 2023-11-27T20:46:48.423 INFO:teuthology.orchestra.run.smithi183.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-27T20:46:48.423 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88460.log 2023-11-27T20:46:48.424 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.96871.log 2023-11-27T20:46:48.426 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88460.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-27T20:46:48.426 INFO:teuthology.orchestra.run.smithi183.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88460.log.gz 2023-11-27T20:46:48.426 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.testuser.96871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.96871.log.gz 2023-11-27T20:46:48.427 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88419.log 2023-11-27T20:46:48.427 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93926.log 2023-11-27T20:46:48.428 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96176.log 2023-11-27T20:46:48.428 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106482.log.gz 2023-11-27T20:46:48.428 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95990.log 2023-11-27T20:46:48.428 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98027.log 2023-11-27T20:46:48.429 INFO:teuthology.orchestra.run.smithi091.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.96176.log.gz 2023-11-27T20:46:48.429 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95906.log 2023-11-27T20:46:48.429 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95990.log.gz 2023-11-27T20:46:48.429 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98027.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98027.log.gz 2023-11-27T20:46:48.429 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97376.log 2023-11-27T20:46:48.429 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112104.log 2023-11-27T20:46:48.430 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95906.log.gz 2023-11-27T20:46:48.430 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97376.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97376.log.gz 2023-11-27T20:46:48.430 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113525.log 2023-11-27T20:46:48.430 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111232.log 2023-11-27T20:46:48.430 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112104.log.gz 2023-11-27T20:46:48.431 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113525.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113525.log.gz 2023-11-27T20:46:48.431 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115897.log 2023-11-27T20:46:48.431 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111232.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111232.log.gz 2023-11-27T20:46:48.431 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99597.log 2023-11-27T20:46:48.431 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97292.log 2023-11-27T20:46:48.432 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115897.log.gz 2023-11-27T20:46:48.432 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99597.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99597.log.gz 2023-11-27T20:46:48.432 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114606.log 2023-11-27T20:46:48.432 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99681.log 2023-11-27T20:46:48.432 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97292.log.gz 2023-11-27T20:46:48.432 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114606.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114606.log.gzgzip 2023-11-27T20:46:48.432 INFO:teuthology.orchestra.run.smithi091.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.107236.log 2023-11-27T20:46:48.432 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99681.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99681.log.gz 2023-11-27T20:46:48.433 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101349.log 2023-11-27T20:46:48.433 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104758.log 2023-11-27T20:46:48.433 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107236.log.gz 2023-11-27T20:46:48.433 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101349.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101349.log.gz 2023-11-27T20:46:48.433 INFO:teuthology.orchestra.run.smithi091.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.93884.log 2023-11-27T20:46:48.433 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102650.log 2023-11-27T20:46:48.433 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104758.log.gz 2023-11-27T20:46:48.433 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.93884.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93884.log.gz 2023-11-27T20:46:48.433 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116275.log 2023-11-27T20:46:48.434 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94056.log 2023-11-27T20:46:48.434 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102650.log.gz 2023-11-27T20:46:48.434 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116275.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116275.log.gz 2023-11-27T20:46:48.434 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110226.log 2023-11-27T20:46:48.434 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110688.log 2023-11-27T20:46:48.434 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94056.log.gz 2023-11-27T20:46:48.434 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110226.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.98363.log 2023-11-27T20:46:48.434 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110226.log.gz 2023-11-27T20:46:48.435 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110310.log 2023-11-27T20:46:48.435 INFO:teuthology.orchestra.run.smithi091.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.110688.log.gz 2023-11-27T20:46:48.435 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108623.log 2023-11-27T20:46:48.435 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98363.log.gz 2023-11-27T20:46:48.435 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110310.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110310.log.gz 2023-11-27T20:46:48.435 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95948.log 2023-11-27T20:46:48.435 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97166.log 2023-11-27T20:46:48.435 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108623.log.gz 2023-11-27T20:46:48.435 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95948.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95948.log.gz 2023-11-27T20:46:48.436 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109062.log 2023-11-27T20:46:48.436 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105922.log 2023-11-27T20:46:48.436 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97166.log.gz 2023-11-27T20:46:48.436 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109062.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109062.log.gz 2023-11-27T20:46:48.436 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105294.log 2023-11-27T20:46:48.436 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103154.log 2023-11-27T20:46:48.436 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105922.log.gz 2023-11-27T20:46:48.436 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105294.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105294.log.gz 2023-11-27T20:46:48.437 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113098.log 2023-11-27T20:46:48.438 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88419.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88419.log.gz 2023-11-27T20:46:48.439 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.93926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.93926.log.gz 2023-11-27T20:46:48.439 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-27T20:46:48.442 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105796.log 2023-11-27T20:46:48.442 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103154.log.gz 2023-11-27T20:46:48.442 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113098.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113098.log.gz 2023-11-27T20:46:48.443 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109146.log 2023-11-27T20:46:48.443 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103406.log 2023-11-27T20:46:48.443 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105796.log.gz 2023-11-27T20:46:48.443 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109146.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109146.log.gz 2023-11-27T20:46:48.443 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114396.log 2023-11-27T20:46:48.443 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103406.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103406.log.gz 2023-11-27T20:46:48.443 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104590.log 2023-11-27T20:46:48.443 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114396.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82511.log 2023-11-27T20:46:48.444 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114396.log.gz 2023-11-27T20:46:48.444 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104590.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104590.log.gz 2023-11-27T20:46:48.444 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111190.log 2023-11-27T20:46:48.444 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.tmp-client.admin.82511.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82511.log.gz 2023-11-27T20:46:48.444 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102001.log 2023-11-27T20:46:48.444 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115044.log 2023-11-27T20:46:48.444 INFO:teuthology.orchestra.run.smithi091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111190.log.gz 2023-11-27T20:46:48.444 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102001.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102001.log.gz 2023-11-27T20:46:48.445 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105126.log 2023-11-27T20:46:48.445 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113609.log 2023-11-27T20:46:48.445 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115044.log.gz 2023-11-27T20:46:48.445 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105126.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105126.log.gz 2023-11-27T20:46:48.445 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113182.log 2023-11-27T20:46:48.447 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109417.log 2023-11-27T20:46:48.447 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113609.log.gz 2023-11-27T20:46:48.447 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113182.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113182.log.gz 2023-11-27T20:46:48.447 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116149.log 2023-11-27T20:46:48.447 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112495.log 2023-11-27T20:46:48.447 INFO:teuthology.orchestra.run.smithi091.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109417.log.gz 2023-11-27T20:46:48.448 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116149.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116149.log.gz 2023-11-27T20:46:48.448 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104181.log 2023-11-27T20:46:48.449 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114834.log 2023-11-27T20:46:48.449 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112495.log.gz 2023-11-27T20:46:48.449 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104181.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104181.log.gz 2023-11-27T20:46:48.449 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101959.log 2023-11-27T20:46:48.450 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97823.log 2023-11-27T20:46:48.450 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114834.log.gz 2023-11-27T20:46:48.451 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101959.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101959.log.gz 2023-11-27T20:46:48.451 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98069.log 2023-11-27T20:46:48.452 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106524.log 2023-11-27T20:46:48.452 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97823.log.gz 2023-11-27T20:46:48.453 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98069.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98069.log.gz 2023-11-27T20:46:48.454 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100537.log 2023-11-27T20:46:48.455 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106524.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106524.log.gz 2023-11-27T20:46:48.455 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110754.log 2023-11-27T20:46:48.456 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100537.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.113350.log -- replaced with /var/log/ceph/ceph-client.admin.100537.log.gz 2023-11-27T20:46:48.456 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-11-27T20:46:48.457 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110754.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.110754.log.gz 2023-11-27T20:46:48.457 INFO:teuthology.orchestra.run.smithi091.stderr: --verbose -- /var/log/ceph/ceph-client.admin.113308.log 2023-11-27T20:46:48.458 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113350.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113350.log.gz 2023-11-27T20:46:48.459 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115212.log 2023-11-27T20:46:48.459 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113308.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113308.log.gz 2023-11-27T20:46:48.460 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113855.log 2023-11-27T20:46:48.460 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98615.log 2023-11-27T20:46:48.460 INFO:teuthology.orchestra.run.smithi091.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115212.log.gz 2023-11-27T20:46:48.461 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113855.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113855.log.gz 2023-11-27T20:46:48.462 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104956.log 2023-11-27T20:46:48.463 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108936.log 2023-11-27T20:46:48.463 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98615.log.gz 2023-11-27T20:46:48.463 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104956.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104956.log.gz 2023-11-27T20:46:48.464 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97502.log 2023-11-27T20:46:48.465 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97781.log 2023-11-27T20:46:48.465 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108936.log.gz 2023-11-27T20:46:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97502.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97502.log.gz 2023-11-27T20:46:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97670.log 2023-11-27T20:46:48.467 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99807.log 2023-11-27T20:46:48.467 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97781.log.gz 2023-11-27T20:46:48.468 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97670.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97670.log.gz 2023-11-27T20:46:48.468 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106902.log 2023-11-27T20:46:48.469 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88494.log 2023-11-27T20:46:48.469 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99807.log.gz 2023-11-27T20:46:48.470 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106902.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106902.log.gz 2023-11-27T20:46:48.470 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95224.log 2023-11-27T20:46:48.471 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.88494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110182.log 2023-11-27T20:46:48.471 INFO:teuthology.orchestra.run.smithi091.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.88494.log.gz 2023-11-27T20:46:48.472 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95224.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95224.log.gz 2023-11-27T20:46:48.472 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96956.log 2023-11-27T20:46:48.474 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113140.log 2023-11-27T20:46:48.474 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110182.log.gz 2023-11-27T20:46:48.475 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96956.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96956.log.gz 2023-11-27T20:46:48.475 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101643.log 2023-11-27T20:46:48.476 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116107.log 2023-11-27T20:46:48.476 INFO:teuthology.orchestra.run.smithi091.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113140.log.gz 2023-11-27T20:46:48.477 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93715.log 2023-11-27T20:46:48.477 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101643.log.gz 2023-11-27T20:46:48.478 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96788.log 2023-11-27T20:46:48.478 INFO:teuthology.orchestra.run.smithi091.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116107.log.gz 2023-11-27T20:46:48.479 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.93715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94974.log 2023-11-27T20:46:48.479 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93715.log.gz 2023-11-27T20:46:48.480 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99383.log 2023-11-27T20:46:48.480 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96788.log.gz 2023-11-27T20:46:48.481 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94974.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.94974.log.gz 2023-11-27T20:46:48.481 INFO:teuthology.orchestra.run.smithi091.stderr: /var/log/ceph/ceph-client.admin.103028.log 2023-11-27T20:46:48.482 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108539.log 2023-11-27T20:46:48.482 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99383.log.gz 2023-11-27T20:46:48.483 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103028.log: gzip -5 88.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.103028.log.gz -- 2023-11-27T20:46:48.483 INFO:teuthology.orchestra.run.smithi091.stderr: /var/log/ceph/ceph-client.admin.113813.log 2023-11-27T20:46:48.484 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106050.log 2023-11-27T20:46:48.484 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108539.log.gz 2023-11-27T20:46:48.485 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113813.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113813.log.gz -5 2023-11-27T20:46:48.485 INFO:teuthology.orchestra.run.smithi091.stderr: --verbose -- /var/log/ceph/ceph-client.admin.111274.log 2023-11-27T20:46:48.486 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115603.log 2023-11-27T20:46:48.486 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106050.log.gz 2023-11-27T20:46:48.487 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96617.log 88.6% 2023-11-27T20:46:48.487 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111274.log.gz 2023-11-27T20:46:48.488 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115603.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115603.log.gz 2023-11-27T20:46:48.488 INFO:teuthology.orchestra.run.smithi091.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100791.log 2023-11-27T20:46:48.489 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.0.96617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96617.log.gz 2023-11-27T20:46:48.489 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103448.log 2023-11-27T20:46:48.490 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113651.log 2023-11-27T20:46:48.490 INFO:teuthology.orchestra.run.smithi091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100791.log.gz 2023-11-27T20:46:48.491 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103448.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103448.log.gz 2023-11-27T20:46:48.491 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108497.log 2023-11-27T20:46:48.492 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113651.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.113651.log.gz 2023-11-27T20:46:48.492 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108077.log 2023-11-27T20:46:48.493 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108497.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108497.log.gz 2023-11-27T20:46:48.493 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115170.log 2023-11-27T20:46:48.495 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108077.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108077.log.gz 2023-11-27T20:46:48.495 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114270.log 2023-11-27T20:46:48.495 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115170.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115170.log.gz 2023-11-27T20:46:48.496 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93538.log 2023-11-27T20:46:48.497 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114270.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114270.log.gz 2023-11-27T20:46:48.497 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105084.log 2023-11-27T20:46:48.498 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.93538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109645.log 2023-11-27T20:46:48.498 INFO:teuthology.orchestra.run.smithi091.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93538.log.gz 2023-11-27T20:46:48.499 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105084.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105084.log.gz 2023-11-27T20:46:48.499 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101559.log 2023-11-27T20:46:48.500 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115315.log 2023-11-27T20:46:48.500 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109645.log.gz 2023-11-27T20:46:48.502 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101559.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101559.log.gz 2023-11-27T20:46:48.502 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101265.log 2023-11-27T20:46:48.503 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97949.log 2023-11-27T20:46:48.503 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115315.log.gz 2023-11-27T20:46:48.504 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101265.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101265.log.gz 2023-11-27T20:46:48.505 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115441.log 2023-11-27T20:46:48.506 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97949.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97949.log.gz 2023-11-27T20:46:48.506 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104428.log 2023-11-27T20:46:48.507 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115441.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115441.log.gz 2023-11-27T20:46:48.507 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116023.log 2023-11-27T20:46:48.508 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100971.log 2023-11-27T20:46:48.508 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104428.log.gz 2023-11-27T20:46:48.509 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116023.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116023.log.gz 2023-11-27T20:46:48.509 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104307.log 2023-11-27T20:46:48.510 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95290.log 2023-11-27T20:46:48.511 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100971.log.gz 2023-11-27T20:46:48.511 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104307.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104307.log.gz 2023-11-27T20:46:48.512 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.113022.log 2023-11-27T20:46:48.513 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95290.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95290.log.gz 2023-11-27T20:46:48.513 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96998.log 2023-11-27T20:46:48.514 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.testuser.113022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.113022.log.gz 2023-11-27T20:46:48.514 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94995.log 2023-11-27T20:46:48.515 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96998.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96998.log.gz 2023-11-27T20:46:48.515 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105754.log 2023-11-27T20:46:48.516 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114228.log 2023-11-27T20:46:48.517 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94995.log.gz 2023-11-27T20:46:48.517 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105754.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105754.log.gz 2023-11-27T20:46:48.518 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112146.log 2023-11-27T20:46:48.518 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110646.log 2023-11-27T20:46:48.519 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114228.log.gz 2023-11-27T20:46:48.519 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112146.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112146.log.gz 2023-11-27T20:46:48.520 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116463.log 2023-11-27T20:46:48.521 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100705.log 2023-11-27T20:46:48.521 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110646.log.gz 2023-11-27T20:46:48.522 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116463.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116463.log.gz 2023-11-27T20:46:48.522 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102221.log 2023-11-27T20:46:48.523 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106272.log 2023-11-27T20:46:48.523 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100705.log.gz 2023-11-27T20:46:48.524 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102221.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102221.log.gz 2023-11-27T20:46:48.525 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100453.log 2023-11-27T20:46:48.525 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98279.log 2023-11-27T20:46:48.526 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106272.log.gz 2023-11-27T20:46:48.526 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115002.log 2023-11-27T20:46:48.527 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100453.log.gz 2023-11-27T20:46:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98279.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98279.log.gz 2023-11-27T20:46:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116065.log 2023-11-27T20:46:48.529 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112715.log 2023-11-27T20:46:48.529 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115002.log.gz 2023-11-27T20:46:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116065.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116065.log.gz 2023-11-27T20:46:48.530 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108161.log 2023-11-27T20:46:48.531 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115771.log 2023-11-27T20:46:48.531 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112715.log.gz 2023-11-27T20:46:48.532 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108161.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108161.log.gz 2023-11-27T20:46:48.532 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115855.log 2023-11-27T20:46:48.533 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100017.log 2023-11-27T20:46:48.533 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115771.log.gz 2023-11-27T20:46:48.534 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115855.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115855.log.gz 2023-11-27T20:46:48.534 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95654.log 2023-11-27T20:46:48.535 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94642.log 2023-11-27T20:46:48.535 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100017.log.gz 2023-11-27T20:46:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95654.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95654.log.gz 2023-11-27T20:46:48.536 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103490.log 2023-11-27T20:46:48.537 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110394.log 2023-11-27T20:46:48.537 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94642.log.gz 2023-11-27T20:46:48.538 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103490.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103490.log.gz 2023-11-27T20:46:48.538 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97586.log 2023-11-27T20:46:48.539 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107088.log 2023-11-27T20:46:48.540 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110394.log.gz 2023-11-27T20:46:48.540 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115729.log 88.5% 2023-11-27T20:46:48.540 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97586.log.gz 2023-11-27T20:46:48.542 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100885.log 2023-11-27T20:46:48.542 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107088.log.gz 2023-11-27T20:46:48.542 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mon.c.log: 93.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-27T20:46:48.543 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115729.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115729.log.gz 2023-11-27T20:46:48.543 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101727.log 2023-11-27T20:46:48.544 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102692.log 2023-11-27T20:46:48.544 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100885.log.gz 2023-11-27T20:46:48.545 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101727.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101727.log.gz 2023-11-27T20:46:48.545 INFO:teuthology.orchestra.run.smithi091.stderr: -5 --verbose -- /var/log/ceph/ceph-client.testuser.102524.log 2023-11-27T20:46:48.546 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102692.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102692.log.gz 2023-11-27T20:46:48.546 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108581.log 2023-11-27T20:46:48.547 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.testuser.102524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.102524.log.gz 2023-11-27T20:46:48.547 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106186.log 2023-11-27T20:46:48.548 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108581.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.108581.log.gz 2023-11-27T20:46:48.548 INFO:teuthology.orchestra.run.smithi091.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.112537.log 2023-11-27T20:46:48.549 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113693.log 2023-11-27T20:46:48.549 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106186.log.gz 2023-11-27T20:46:48.550 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101601.log 2023-11-27T20:46:48.550 INFO:teuthology.orchestra.run.smithi091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112537.log.gz 2023-11-27T20:46:48.551 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106734.log 2023-11-27T20:46:48.551 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113693.log.gz 2023-11-27T20:46:48.552 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100495.log 2023-11-27T20:46:48.552 INFO:teuthology.orchestra.run.smithi091.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101601.log.gz 2023-11-27T20:46:48.553 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106734.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.106734.log.gz 2023-11-27T20:46:48.553 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-27T20:46:48.554 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96746.log 2023-11-27T20:46:48.554 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100495.log.gz 2023-11-27T20:46:48.556 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99047.log 2023-11-27T20:46:48.557 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102085.log 2023-11-27T20:46:48.557 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96746.log.gz 2023-11-27T20:46:48.557 INFO:teuthology.orchestra.run.smithi091.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-27T20:46:48.558 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100358.log 2023-11-27T20:46:48.558 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99047.log.gz 2023-11-27T20:46:48.559 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102085.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102085.log.gz 2023-11-27T20:46:48.559 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104674.log 2023-11-27T20:46:48.559 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.0.100358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100358.log.gz 2023-11-27T20:46:48.560 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115645.log 2023-11-27T20:46:48.561 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106818.log 2023-11-27T20:46:48.561 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104674.log.gz 2023-11-27T20:46:48.562 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97418.log 2023-11-27T20:46:48.562 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115645.log.gz 2023-11-27T20:46:48.563 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114876.log 2023-11-27T20:46:48.563 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106818.log.gz 2023-11-27T20:46:48.564 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97418.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97418.log.gz 2023-11-27T20:46:48.564 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109332.log 2023-11-27T20:46:48.565 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108329.log 2023-11-27T20:46:48.565 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114876.log.gz 2023-11-27T20:46:48.566 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109332.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109332.log.gz 2023-11-27T20:46:48.566 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108287.log 2023-11-27T20:46:48.568 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106440.log 2023-11-27T20:46:48.568 INFO:teuthology.orchestra.run.smithi091.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108329.log.gz 2023-11-27T20:46:48.569 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108287.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108287.log.gz 2023-11-27T20:46:48.569 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105880.log 2023-11-27T20:46:48.570 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101769.log 2023-11-27T20:46:48.570 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106440.log.gz 2023-11-27T20:46:48.571 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98963.log 2023-11-27T20:46:48.572 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105880.log.gz 2023-11-27T20:46:48.573 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101769.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101769.log.gz 2023-11-27T20:46:48.573 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99933.log 2023-11-27T20:46:48.574 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111316.log 2023-11-27T20:46:48.574 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98963.log.gz 2023-11-27T20:46:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94657.log 2023-11-27T20:46:48.575 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99933.log.gz 2023-11-27T20:46:48.576 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111316.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111316.log.gz 2023-11-27T20:46:48.576 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115272.log 2023-11-27T20:46:48.577 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101517.log 2023-11-27T20:46:48.578 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94657.log.gz 2023-11-27T20:46:48.579 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115272.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115272.log.gz 2023-11-27T20:46:48.579 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102944.log 2023-11-27T20:46:48.580 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101517.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101517.log.gz -5 2023-11-27T20:46:48.580 INFO:teuthology.orchestra.run.smithi091.stderr: --verbose -- /var/log/ceph/ceph-client.admin.98489.log 2023-11-27T20:46:48.581 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95696.log 2023-11-27T20:46:48.581 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102944.log.gz 2023-11-27T20:46:48.582 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98489.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98489.log.gz 2023-11-27T20:46:48.583 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94392.log 2023-11-27T20:46:48.584 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108810.log 2023-11-27T20:46:48.584 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95696.log.gz 2023-11-27T20:46:48.585 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94392.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94392.log.gz 2023-11-27T20:46:48.585 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100927.log 2023-11-27T20:46:48.586 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111708.log 2023-11-27T20:46:48.586 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108810.log.gz 2023-11-27T20:46:48.587 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105252.log 2023-11-27T20:46:48.587 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100927.log.gz 2023-11-27T20:46:48.588 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96127.log 2023-11-27T20:46:48.588 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111708.log.gz 2023-11-27T20:46:48.589 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105252.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105252.log.gz 2023-11-27T20:46:48.590 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111022.log 2023-11-27T20:46:48.591 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109501.log 2023-11-27T20:46:48.591 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96127.log.gz 2023-11-27T20:46:48.591 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114438.log 2023-11-27T20:46:48.592 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111022.log.gz 2023-11-27T20:46:48.593 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99723.log 2023-11-27T20:46:48.593 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109501.log.gz 2023-11-27T20:46:48.594 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103238.log 2023-11-27T20:46:48.594 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114438.log.gz 2023-11-27T20:46:48.595 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99723.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99723.log.gz 2023-11-27T20:46:48.595 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95864.log 2023-11-27T20:46:48.596 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109188.log 2023-11-27T20:46:48.596 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103238.log.gz 2023-11-27T20:46:48.597 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95864.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95864.log.gz 2023-11-27T20:46:48.597 INFO:teuthology.orchestra.run.smithi091.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.115813.log 2023-11-27T20:46:48.598 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112579.log 2023-11-27T20:46:48.598 INFO:teuthology.orchestra.run.smithi091.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109188.log.gz 2023-11-27T20:46:48.599 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101685.log 2023-11-27T20:46:48.599 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115813.log.gz 2023-11-27T20:46:48.600 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111538.log 2023-11-27T20:46:48.601 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112579.log.gz 2023-11-27T20:46:48.601 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94990.log 2023-11-27T20:46:48.601 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101685.log.gz 2023-11-27T20:46:48.602 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114750.log 2023-11-27T20:46:48.602 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111538.log.gz 2023-11-27T20:46:48.604 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112263.log 2023-11-27T20:46:48.604 INFO:teuthology.orchestra.run.smithi091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94990.log.gz 2023-11-27T20:46:48.605 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103700.log 2023-11-27T20:46:48.605 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114750.log.gz 2023-11-27T20:46:48.605 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111792.log 2023-11-27T20:46:48.606 INFO:teuthology.orchestra.run.smithi091.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112263.log.gz 2023-11-27T20:46:48.606 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99891.log 2023-11-27T20:46:48.607 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103700.log.gz 2023-11-27T20:46:48.607 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100663.log 2023-11-27T20:46:48.607 INFO:teuthology.orchestra.run.smithi091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111792.log.gz 2023-11-27T20:46:48.608 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116191.log 2023-11-27T20:46:48.608 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99891.log.gz 2023-11-27T20:46:48.609 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103826.log 2023-11-27T20:46:48.609 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100663.log.gz 2023-11-27T20:46:48.614 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94098.log 2023-11-27T20:46:48.614 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116191.log.gz 2023-11-27T20:46:48.619 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103658.log 2023-11-27T20:46:48.620 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103826.log.gz 2023-11-27T20:46:48.620 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98321.log 2023-11-27T20:46:48.620 INFO:teuthology.orchestra.run.smithi091.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94098.log.gz 2023-11-27T20:46:48.620 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107320.log 2023-11-27T20:46:48.620 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103658.log.gz 2023-11-27T20:46:48.621 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108455.log 2023-11-27T20:46:48.621 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98321.log.gz 2023-11-27T20:46:48.621 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116233.log 2023-11-27T20:46:48.621 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107320.log.gz 2023-11-27T20:46:48.621 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109459.log 2023-11-27T20:46:48.622 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108455.log.gz 2023-11-27T20:46:48.622 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113392.log 2023-11-27T20:46:48.622 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116233.log.gz 2023-11-27T20:46:48.622 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98573.log 2023-11-27T20:46:48.623 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109459.log.gz 2023-11-27T20:46:48.626 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113392.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.113392.log.gz 2023-11-27T20:46:48.626 INFO:teuthology.orchestra.run.smithi091.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111624.log 2023-11-27T20:46:48.626 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111666.log 2023-11-27T20:46:48.626 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98573.log.gz 2023-11-27T20:46:48.627 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111624.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.111624.log.gz 2023-11-27T20:46:48.627 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-27T20:46:48.627 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109766.log 2023-11-27T20:46:48.627 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111666.log.gz 2023-11-27T20:46:48.627 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99131.log 2023-11-27T20:46:48.627 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114354.log 2023-11-27T20:46:48.628 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109766.log.gz 2023-11-27T20:46:48.628 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99131.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99131.log.gz 2023-11-27T20:46:48.629 INFO:teuthology.orchestra.run.smithi091.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.104223.log 2023-11-27T20:46:48.629 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114354.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114354.log.gz -5 2023-11-27T20:46:48.629 INFO:teuthology.orchestra.run.smithi091.stderr: --verbose -- /var/log/ceph/ceph-client.admin.102734.log 2023-11-27T20:46:48.630 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104223.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104223.log.gz 2023-11-27T20:46:48.630 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108978.log 2023-11-27T20:46:48.630 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97865.log 2023-11-27T20:46:48.631 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102734.log.gz 2023-11-27T20:46:48.631 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108978.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108978.log.gz 2023-11-27T20:46:48.632 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106650.log 2023-11-27T20:46:48.632 INFO:teuthology.orchestra.run.smithi183.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-27T20:46:48.633 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104800.log 2023-11-27T20:46:48.633 INFO:teuthology.orchestra.run.smithi091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97865.log.gz 2023-11-27T20:46:48.634 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100167.log 2023-11-27T20:46:48.634 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106650.log.gz 2023-11-27T20:46:48.635 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95738.log 2023-11-27T20:46:48.635 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104800.log.gz 2023-11-27T20:46:48.636 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93757.log 2023-11-27T20:46:48.636 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100167.log.gz 2023-11-27T20:46:48.637 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112062.log 2023-11-27T20:46:48.638 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95738.log.gz 2023-11-27T20:46:48.638 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.93757.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93757.log.gz 2023-11-27T20:46:48.639 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114522.log 2023-11-27T20:46:48.640 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96830.log 2023-11-27T20:46:48.640 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112062.log.gz 2023-11-27T20:46:48.641 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114522.log: gzip -5 89.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.114522.log.gz -- 2023-11-27T20:46:48.641 INFO:teuthology.orchestra.run.smithi091.stderr: /var/log/ceph/ceph-client.admin.99555.log 2023-11-27T20:46:48.642 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100354.log 2023-11-27T20:46:48.642 INFO:teuthology.orchestra.run.smithi091.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96830.log.gz 2023-11-27T20:46:48.643 INFO:teuthology.orchestra.run.smithi183.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-27T20:46:48.644 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99427.log 2023-11-27T20:46:48.644 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99555.log.gz 2023-11-27T20:46:48.644 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.0.100354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100354.log.gz 2023-11-27T20:46:48.645 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96872.log 2023-11-27T20:46:48.646 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109927.log 2023-11-27T20:46:48.646 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99427.log.gz 2023-11-27T20:46:48.647 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115939.log 2023-11-27T20:46:48.647 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96872.log.gz 2023-11-27T20:46:48.648 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114918.log 2023-11-27T20:46:48.648 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109927.log.gz 2023-11-27T20:46:48.649 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115939.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115939.log.gz 2023-11-27T20:46:48.649 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98405.log 2023-11-27T20:46:48.650 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111360.log 2023-11-27T20:46:48.651 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114918.log.gz 2023-11-27T20:46:48.652 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98405.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98405.log.gz 2023-11-27T20:46:48.652 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94140.log 2023-11-27T20:46:48.653 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110941.log 2023-11-27T20:46:48.654 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111360.log.gz 2023-11-27T20:46:48.654 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94140.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94140.log.gz 2023-11-27T20:46:48.655 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113939.log 2023-11-27T20:46:48.656 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.0.110941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110941.log.gz 2023-11-27T20:46:48.656 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105838.log 2023-11-27T20:46:48.657 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113939.log: gzip -5 88.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.113939.log.gz -- 2023-11-27T20:46:48.657 INFO:teuthology.orchestra.run.smithi091.stderr: /var/log/ceph/ceph-client.admin.106944.log 2023-11-27T20:46:48.658 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98447.log 2023-11-27T20:46:48.659 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105838.log.gz 2023-11-27T20:46:48.659 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106944.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106944.log.gz 2023-11-27T20:46:48.660 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112411.log 2023-11-27T20:46:48.661 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111852.log 2023-11-27T20:46:48.661 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98447.log.gz 2023-11-27T20:46:48.662 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112411.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112411.log.gz 2023-11-27T20:46:48.662 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99639.log 2023-11-27T20:46:48.663 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98801.log 2023-11-27T20:46:48.664 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111852.log.gz 2023-11-27T20:46:48.665 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99639.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99639.log.gz 2023-11-27T20:46:48.665 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95325.log 2023-11-27T20:46:48.666 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103532.log 2023-11-27T20:46:48.666 INFO:teuthology.orchestra.run.smithi091.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98801.log.gz 2023-11-27T20:46:48.667 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95325.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95325.log.gz 2023-11-27T20:46:48.668 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88748.log 2023-11-27T20:46:48.669 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99341.log 2023-11-27T20:46:48.669 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103532.log.gz 2023-11-27T20:46:48.670 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.88748.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.88748.log.gz 2023-11-27T20:46:48.670 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106692.log 2023-11-27T20:46:48.672 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104844.log 2023-11-27T20:46:48.672 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99341.log.gz 2023-11-27T20:46:48.673 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106692.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106692.log.gz 2023-11-27T20:46:48.673 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96278.log 2023-11-27T20:46:48.674 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94308.log 2023-11-27T20:46:48.675 INFO:teuthology.orchestra.run.smithi091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104844.log.gz 2023-11-27T20:46:48.675 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96278.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96278.log.gz 2023-11-27T20:46:48.676 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115128.log 2023-11-27T20:46:48.677 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94991.log 2023-11-27T20:46:48.677 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94308.log.gz 2023-11-27T20:46:48.678 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115128.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115128.log.gz 2023-11-27T20:46:48.679 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98195.log 2023-11-27T20:46:48.680 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114144.log 2023-11-27T20:46:48.680 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94991.log.gz 2023-11-27T20:46:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98195.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98195.log.gz 2023-11-27T20:46:48.681 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114023.log 2023-11-27T20:46:48.682 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93970.log 2023-11-27T20:46:48.683 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114144.log.gz 2023-11-27T20:46:48.684 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114023.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114023.log.gz 2023-11-27T20:46:48.684 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99765.log 2023-11-27T20:46:48.685 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.93970.log: gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.95332.log -- replaced with /var/log/ceph/ceph-client.admin.93970.log.gz 2023-11-27T20:46:48.685 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-11-27T20:46:48.686 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114666.log 2023-11-27T20:46:48.686 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99765.log.gz 2023-11-27T20:46:48.687 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95332.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95332.log.gz 2023-11-27T20:46:48.688 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115561.log 2023-11-27T20:46:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94224.log 2023-11-27T20:46:48.689 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114666.log.gz 2023-11-27T20:46:48.690 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115561.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115561.log.gz 2023-11-27T20:46:48.690 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102590.log 2023-11-27T20:46:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104097.log 2023-11-27T20:46:48.691 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94224.log.gz 2023-11-27T20:46:48.692 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102590.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102590.log.gz 2023-11-27T20:46:48.693 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-27T20:46:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115357.log 2023-11-27T20:46:48.694 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104097.log.gz 2023-11-27T20:46:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95528.log 2023-11-27T20:46:48.697 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115357.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115357.log.gz 2023-11-27T20:46:48.697 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97040.log 2023-11-27T20:46:48.698 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99215.log 2023-11-27T20:46:48.698 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95528.log.gz 2023-11-27T20:46:48.699 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97040.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97040.log.gz 2023-11-27T20:46:48.700 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.113018.log 2023-11-27T20:46:48.701 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107951.log 2023-11-27T20:46:48.701 INFO:teuthology.orchestra.run.smithi091.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.99215.log.gz 2023-11-27T20:46:48.702 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.testuser.113018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.113018.log.gz 2023-11-27T20:46:48.702 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102776.log 2023-11-27T20:46:48.703 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95570.log 2023-11-27T20:46:48.704 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107951.log.gz 2023-11-27T20:46:48.705 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102776.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102776.log.gz 2023-11-27T20:46:48.705 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98657.log 2023-11-27T20:46:48.706 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95287.log 2023-11-27T20:46:48.706 INFO:teuthology.orchestra.run.smithi091.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95570.log.gz 2023-11-27T20:46:48.707 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98657.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98657.log.gz 2023-11-27T20:46:48.707 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101391.log 2023-11-27T20:46:48.709 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103364.log 2023-11-27T20:46:48.709 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95287.log.gz 2023-11-27T20:46:48.710 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101391.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101391.log.gz 2023-11-27T20:46:48.710 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106230.log 2023-11-27T20:46:48.711 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102986.log 2023-11-27T20:46:48.712 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103364.log.gz 2023-11-27T20:46:48.713 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106230.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106230.log.gz 2023-11-27T20:46:48.713 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113981.log 2023-11-27T20:46:48.714 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.107847.log 2023-11-27T20:46:48.714 INFO:teuthology.orchestra.run.smithi091.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102986.log.gz 2023-11-27T20:46:48.715 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113981.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113981.log.gz 2023-11-27T20:46:48.715 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114312.log 2023-11-27T20:46:48.717 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.testuser.107847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101013.log 2023-11-27T20:46:48.717 INFO:teuthology.orchestra.run.smithi091.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.107847.log.gz 2023-11-27T20:46:48.718 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114312.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114312.log.gz 2023-11-27T20:46:48.718 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99975.log 2023-11-27T20:46:48.719 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97082.log 2023-11-27T20:46:48.720 INFO:teuthology.orchestra.run.smithi091.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101013.log.gz 2023-11-27T20:46:48.721 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99975.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99975.log.gz 2023-11-27T20:46:48.721 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112020.log 2023-11-27T20:46:48.722 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102127.log 2023-11-27T20:46:48.722 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97082.log.gz 2023-11-27T20:46:48.723 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112020.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112020.log.gz 2023-11-27T20:46:48.724 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105631.log 2023-11-27T20:46:48.724 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101181.log 2023-11-27T20:46:48.725 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102127.log.gz 2023-11-27T20:46:48.726 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.0.105631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105631.log.gz 2023-11-27T20:46:48.726 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111496.log 2023-11-27T20:46:48.727 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98717.log 2023-11-27T20:46:48.728 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101181.log.gz 2023-11-27T20:46:48.728 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111496.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111496.log.gz 2023-11-27T20:46:48.729 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94984.log 2023-11-27T20:46:48.730 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97124.log 2023-11-27T20:46:48.730 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98717.log.gz 2023-11-27T20:46:48.731 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94984.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94984.log.gz 2023-11-27T20:46:48.732 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106566.log 2023-11-27T20:46:48.733 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97124.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97124.log.gz 2023-11-27T20:46:48.733 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100835.log 2023-11-27T20:46:48.734 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106566.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106566.log.gz 2023-11-27T20:46:48.735 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95822.log 2023-11-27T20:46:48.736 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94653.log 2023-11-27T20:46:48.736 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100835.log.gz 2023-11-27T20:46:48.737 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95822.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95822.log.gz 2023-11-27T20:46:48.737 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107046.log 2023-11-27T20:46:48.738 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94653.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94653.log.gz 2023-11-27T20:46:48.739 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110478.log 2023-11-27T20:46:48.740 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94434.log 2023-11-27T20:46:48.740 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107046.log.gz 2023-11-27T20:46:48.741 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110478.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110478.log.gz 2023-11-27T20:46:48.742 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105378.log 2023-11-27T20:46:48.742 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94434.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94434.log.gz 2023-11-27T20:46:48.743 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111106.log 2023-11-27T20:46:48.744 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104265.log 2023-11-27T20:46:48.745 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111106.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.105378.log.gz 2023-11-27T20:46:48.745 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111106.log.gz 2023-11-27T20:46:48.746 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110054.log 2023-11-27T20:46:48.747 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99089.log 2023-11-27T20:46:48.747 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104265.log.gz 2023-11-27T20:46:48.748 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110054.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110054.log.gz 2023-11-27T20:46:48.748 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101875.log 2023-11-27T20:46:48.750 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113735.log 2023-11-27T20:46:48.750 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99089.log.gz 2023-11-27T20:46:48.751 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94643.log 2023-11-27T20:46:48.752 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101875.log.gz 2023-11-27T20:46:48.752 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113735.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113735.log.gz 2023-11-27T20:46:48.753 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111750.log 2023-11-27T20:46:48.754 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101097.log 2023-11-27T20:46:48.754 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94643.log.gz 2023-11-27T20:46:48.755 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111750.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111750.log.gz 2023-11-27T20:46:48.756 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105712.log 2023-11-27T20:46:48.756 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101097.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.101097.log.gz 2023-11-27T20:46:48.757 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107278.log 2023-11-27T20:46:48.758 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114708.log 2023-11-27T20:46:48.758 INFO:teuthology.orchestra.run.smithi091.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105712.log.gz 2023-11-27T20:46:48.759 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107278.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107278.log.gz 2023-11-27T20:46:48.760 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113897.log 2023-11-27T20:46:48.761 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114708.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114708.log.gz 2023-11-27T20:46:48.761 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94660.log 2023-11-27T20:46:48.762 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97208.log 2023-11-27T20:46:48.763 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113897.log.gz 2023-11-27T20:46:48.763 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94660.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94660.log.gz 2023-11-27T20:46:48.764 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108119.log 2023-11-27T20:46:48.765 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97208.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97208.log.gz 2023-11-27T20:46:48.765 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99173.log 2023-11-27T20:46:48.766 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95780.log 2023-11-27T20:46:48.767 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108119.log.gz 2023-11-27T20:46:48.768 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99173.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99173.log.gz 2023-11-27T20:46:48.768 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97460.log 2023-11-27T20:46:48.769 INFO:teuthology.orchestra.run.smithi183.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-27T20:46:48.769 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95780.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95780.log.gz 2023-11-27T20:46:48.770 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107909.log 2023-11-27T20:46:48.770 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106314.log 2023-11-27T20:46:48.771 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97460.log.gz 2023-11-27T20:46:48.772 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107909.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107909.log.gz 2023-11-27T20:46:48.772 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114564.log 2023-11-27T20:46:48.773 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106314.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106314.log.gz 2023-11-27T20:46:48.774 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94654.log 2023-11-27T20:46:48.775 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94994.log 2023-11-27T20:46:48.775 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114564.log.gz 2023-11-27T20:46:48.776 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94654.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94654.log.gz 2023-11-27T20:46:48.776 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93842.log 2023-11-27T20:46:48.777 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94994.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94994.log.gz 2023-11-27T20:46:48.778 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106144.log 2023-11-27T20:46:48.779 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.93842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104998.log 2023-11-27T20:46:48.779 INFO:teuthology.orchestra.run.smithi091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93842.log.gz 2023-11-27T20:46:48.780 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106144.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106144.log.gz 2023-11-27T20:46:48.780 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93926.log 2023-11-27T20:46:48.782 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104998.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104998.log.gz 2023-11-27T20:46:48.782 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-27T20:46:48.783 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.93926.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93926.log.gz 2023-11-27T20:46:48.784 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110520.log 2023-11-27T20:46:48.823 INFO:teuthology.orchestra.run.smithi183.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-27T20:46:48.823 INFO:teuthology.orchestra.run.smithi183.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-27T20:46:48.830 INFO:teuthology.orchestra.run.smithi183.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-27T20:46:48.831 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107446.log 2023-11-27T20:46:48.832 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108665.log 2023-11-27T20:46:48.832 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110520.log.gz 2023-11-27T20:46:48.832 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116359.log 2023-11-27T20:46:48.832 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107446.log.gz 2023-11-27T20:46:48.832 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100059.log 2023-11-27T20:46:48.832 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108665.log.gz 2023-11-27T20:46:48.832 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108707.log 2023-11-27T20:46:48.832 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116359.log.gz 2023-11-27T20:46:48.833 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103196.log 2023-11-27T20:46:48.833 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100059.log.gz 2023-11-27T20:46:48.833 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109603.log 2023-11-27T20:46:48.833 INFO:teuthology.orchestra.run.smithi091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108707.log.gz 2023-11-27T20:46:48.833 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99257.log 2023-11-27T20:46:48.833 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103196.log.gz 2023-11-27T20:46:48.833 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111454.log 2023-11-27T20:46:48.833 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109603.log.gz 2023-11-27T20:46:48.834 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111582.log 2023-11-27T20:46:48.834 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99257.log.gz 2023-11-27T20:46:48.834 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111454.log: gzip -5 --verbose 88.3% -- /var/log/ceph/ceph-client.admin.94266.log -- replaced with /var/log/ceph/ceph-client.admin.111454.log.gz 2023-11-27T20:46:48.834 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-11-27T20:46:48.834 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109230.log 2023-11-27T20:46:48.834 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111582.log.gz 2023-11-27T20:46:48.834 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103280.log 2023-11-27T20:46:48.835 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94266.log.gz 2023-11-27T20:46:48.835 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101917.log 2023-11-27T20:46:48.835 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109230.log.gz 2023-11-27T20:46:48.835 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111978.log 2023-11-27T20:46:48.835 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103280.log.gz 2023-11-27T20:46:48.835 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110096.log 2023-11-27T20:46:48.835 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101917.log.gz 2023-11-27T20:46:48.835 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99849.log 2023-11-27T20:46:48.835 INFO:teuthology.orchestra.run.smithi091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111978.log.gz 2023-11-27T20:46:48.836 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.102528.log 2023-11-27T20:46:48.836 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110096.log.gz 2023-11-27T20:46:48.836 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111064.log 2023-11-27T20:46:48.836 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99849.log.gz 2023-11-27T20:46:48.836 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.testuser.102528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.102528.log.gz 2023-11-27T20:46:48.836 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105042.log 2023-11-27T20:46:48.836 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107194.log 2023-11-27T20:46:48.836 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111064.log.gz 2023-11-27T20:46:48.837 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96914.log 2023-11-27T20:46:48.837 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105042.log.gz 2023-11-27T20:46:48.837 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112221.log 2023-11-27T20:46:48.837 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107194.log.gz 2023-11-27T20:46:48.837 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102902.log 2023-11-27T20:46:48.837 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96914.log.gz 2023-11-27T20:46:48.837 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102860.log 2023-11-27T20:46:48.837 INFO:teuthology.orchestra.run.smithi091.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112221.log.gz 2023-11-27T20:46:48.838 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98237.log 2023-11-27T20:46:48.838 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102902.log.gz 2023-11-27T20:46:48.838 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102860.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102860.log.gz 2023-11-27T20:46:48.838 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102043.log 2023-11-27T20:46:48.838 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101223.log 2023-11-27T20:46:48.838 INFO:teuthology.orchestra.run.smithi091.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98237.log.gz 2023-11-27T20:46:48.838 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.102043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110945.log 2023-11-27T20:46:48.838 INFO:teuthology.orchestra.run.smithi091.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102043.log.gz 2023-11-27T20:46:48.839 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108371.log 88.5% 2023-11-27T20:46:48.839 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101223.log.gz 2023-11-27T20:46:48.839 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.0.110945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110945.log.gz 2023-11-27T20:46:48.839 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97250.log 2023-11-27T20:46:48.841 INFO:teuthology.orchestra.run.smithi183.stderr: 2023-11-27T20:46:48.841 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m0.488s 2023-11-27T20:46:48.841 INFO:teuthology.orchestra.run.smithi183.stderr:user 0m2.017s 2023-11-27T20:46:48.841 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m0.330s 2023-11-27T20:46:48.843 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101307.log 2023-11-27T20:46:48.843 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108371.log.gz 2023-11-27T20:46:48.844 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97250.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97250.log.gz 2023-11-27T20:46:48.844 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106094.log 2023-11-27T20:46:48.844 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104888.log 2023-11-27T20:46:48.844 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101307.log.gz 2023-11-27T20:46:48.844 INFO:teuthology.orchestra.run.smithi091.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-27T20:46:48.844 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106094.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106094.log.gz 2023-11-27T20:46:48.844 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94477.log 2023-11-27T20:46:48.844 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106776.log 2023-11-27T20:46:48.845 INFO:teuthology.orchestra.run.smithi091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104888.log.gz 2023-11-27T20:46:48.845 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94477.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94477.log.gz 2023-11-27T20:46:48.845 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-27T20:46:48.845 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106776.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106776.log.gz 2023-11-27T20:46:48.845 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94182.log 2023-11-27T20:46:48.845 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105444.log 2023-11-27T20:46:48.846 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94182.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94182.log.gz 2023-11-27T20:46:48.847 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103784.log 2023-11-27T20:46:48.847 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98881.log 2023-11-27T20:46:48.847 INFO:teuthology.orchestra.run.smithi091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105444.log.gz 2023-11-27T20:46:48.847 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103784.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103784.log.gz 2023-11-27T20:46:48.847 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103616.log 2023-11-27T20:46:48.848 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94014.log 2023-11-27T20:46:48.848 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98881.log.gz 2023-11-27T20:46:48.849 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109969.log 88.1% 2023-11-27T20:46:48.849 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103616.log.gz 2023-11-27T20:46:48.851 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94014.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94014.log.gz 2023-11-27T20:46:48.851 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93634.log 2023-11-27T20:46:48.852 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109969.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109969.log.gz -5 2023-11-27T20:46:48.852 INFO:teuthology.orchestra.run.smithi091.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104508.log 2023-11-27T20:46:48.854 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.93634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103742.log 2023-11-27T20:46:48.854 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93634.log.gz 2023-11-27T20:46:48.855 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105168.log 2023-11-27T20:46:48.856 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104508.log.gz 2023-11-27T20:46:48.857 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100621.log 2023-11-27T20:46:48.857 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103742.log.gz 2023-11-27T20:46:48.859 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116545.log 2023-11-27T20:46:48.931 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105168.log.gz 2023-11-27T20:46:48.947 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113567.log 2023-11-27T20:46:48.947 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100621.log.gz 2023-11-27T20:46:48.947 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104139.log 2023-11-27T20:46:48.947 INFO:teuthology.orchestra.run.smithi091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116545.log.gz 2023-11-27T20:46:48.947 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106006.log 2023-11-27T20:46:48.948 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113567.log.gz 2023-11-27T20:46:48.948 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110562.log 2023-11-27T20:46:48.948 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104139.log.gz 2023-11-27T20:46:48.948 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106006.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106006.log.gz 2023-11-27T20:46:48.948 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104632.log 2023-11-27T20:46:48.948 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110562.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-27T20:46:48.948 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110562.log.gz 2023-11-27T20:46:48.948 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104632.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104632.log.gz 2023-11-27T20:46:48.949 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99471.log 2023-11-27T20:46:48.949 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108035.log 2023-11-27T20:46:48.949 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99471.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99471.log.gz 2023-11-27T20:46:48.949 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101475.log 2023-11-27T20:46:48.949 INFO:teuthology.orchestra.run.smithi091.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-27T20:46:48.949 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115086.log 2023-11-27T20:46:48.949 INFO:teuthology.orchestra.run.smithi091.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108035.log.gz 2023-11-27T20:46:48.949 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101475.log: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-27T20:46:48.949 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101475.log.gz 2023-11-27T20:46:48.950 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110352.log 2023-11-27T20:46:48.950 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106608.log 2023-11-27T20:46:48.950 INFO:teuthology.orchestra.run.smithi091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115086.log.gz 2023-11-27T20:46:48.950 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110352.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110352.log.gz 2023-11-27T20:46:48.950 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110138.log 2023-11-27T20:46:48.950 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111894.log 2023-11-27T20:46:48.950 INFO:teuthology.orchestra.run.smithi091.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.106608.log.gz 2023-11-27T20:46:48.950 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110138.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110138.log.gz 2023-11-27T20:46:48.951 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96608.log 2023-11-27T20:46:48.951 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97628.log 2023-11-27T20:46:48.951 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111894.log.gz 2023-11-27T20:46:48.951 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.0.96608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96608.log.gz 2023-11-27T20:46:48.951 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-27T20:46:48.951 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97628.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97628.log.gz 2023-11-27T20:46:48.951 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108767.log 2023-11-27T20:46:48.951 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96074.log 2023-11-27T20:46:48.952 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108767.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108767.log.gz 2023-11-27T20:46:48.952 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98531.log 2023-11-27T20:46:48.952 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109104.log 88.1% 2023-11-27T20:46:48.952 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96074.log.gz 2023-11-27T20:46:48.952 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103952.log 2023-11-27T20:46:48.952 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98531.log.gz 2023-11-27T20:46:48.952 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95326.log 2023-11-27T20:46:48.952 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109104.log.gz 2023-11-27T20:46:48.953 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116503.log 2023-11-27T20:46:48.953 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103952.log.gz 2023-11-27T20:46:48.953 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115687.log 2023-11-27T20:46:48.953 INFO:teuthology.orchestra.run.smithi091.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95326.log.gz 2023-11-27T20:46:48.953 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116503.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-27T20:46:48.953 INFO:teuthology.orchestra.run.smithi091.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116503.log.gz 2023-11-27T20:46:48.953 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101055.log 2023-11-27T20:46:48.953 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115687.log.gz 2023-11-27T20:46:48.953 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98111.log 2023-11-27T20:46:48.954 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95612.log 2023-11-27T20:46:48.954 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101055.log.gz 2023-11-27T20:46:48.954 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88878.log 2023-11-27T20:46:48.954 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98111.log.gz 2023-11-27T20:46:48.954 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113483.log 2023-11-27T20:46:48.954 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95612.log.gz 2023-11-27T20:46:48.954 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.88878.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88878.log.gz 2023-11-27T20:46:48.954 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105210.log 2023-11-27T20:46:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101139.log 2023-11-27T20:46:48.955 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113483.log.gz 2023-11-27T20:46:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103112.log 2023-11-27T20:46:48.955 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105210.log.gz 2023-11-27T20:46:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106398.log 2023-11-27T20:46:48.955 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101139.log.gz 2023-11-27T20:46:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103112.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103112.log.gz 2023-11-27T20:46:48.955 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99299.log 2023-11-27T20:46:48.956 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106398.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106398.log.gz 2023-11-27T20:46:48.956 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99005.log 2023-11-27T20:46:48.956 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99299.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108413.log 2023-11-27T20:46:48.956 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99299.log.gz 2023-11-27T20:46:48.956 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.107843.log 2023-11-27T20:46:48.956 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99005.log.gz 2023-11-27T20:46:48.956 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109020.log 2023-11-27T20:46:48.956 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108413.log.gz 2023-11-27T20:46:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.testuser.107843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.107843.log.gz 2023-11-27T20:46:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109846.log 2023-11-27T20:46:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105635.log 2023-11-27T20:46:48.957 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109020.log.gz 2023-11-27T20:46:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94658.log 2023-11-27T20:46:48.957 INFO:teuthology.orchestra.run.smithi091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109846.log.gz 2023-11-27T20:46:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.0.105635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105635.log.gz 2023-11-27T20:46:48.957 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100101.log 2023-11-27T20:46:48.958 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94985.log 2023-11-27T20:46:48.958 INFO:teuthology.orchestra.run.smithi091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94658.log.gz 2023-11-27T20:46:48.958 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103868.log 2023-11-27T20:46:48.958 INFO:teuthology.orchestra.run.smithi091.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.100101.log.gz 2023-11-27T20:46:48.958 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101433.log 2023-11-27T20:46:48.958 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94985.log.gz 2023-11-27T20:46:48.958 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97334.log 2023-11-27T20:46:48.958 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103868.log.gz 2023-11-27T20:46:48.959 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.101433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110436.log 2023-11-27T20:46:48.959 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101433.log.gz 2023-11-27T20:46:48.959 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109272.log 88.9% 2023-11-27T20:46:48.959 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97334.log.gz 2023-11-27T20:46:48.959 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94350.log 2023-11-27T20:46:48.959 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110436.log.gz 2023-11-27T20:46:48.959 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109272.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.109272.log.gz --verbose 2023-11-27T20:46:48.959 INFO:teuthology.orchestra.run.smithi091.stderr: -- /var/log/ceph/ceph-client.admin.97907.log 2023-11-27T20:46:48.959 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104349.log 2023-11-27T20:46:48.960 INFO:teuthology.orchestra.run.smithi091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94350.log.gz 2023-11-27T20:46:48.960 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104716.log 2023-11-27T20:46:48.960 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97907.log.gz 2023-11-27T20:46:48.960 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107362.log 2023-11-27T20:46:48.960 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104349.log.gz 2023-11-27T20:46:48.960 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104716.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104716.log.gz 2023-11-27T20:46:48.960 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112621.log 2023-11-27T20:46:48.960 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107362.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107362.log.gz 2023-11-27T20:46:48.961 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99513.log 2023-11-27T20:46:48.961 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112621.log.gz 2023-11-27T20:46:48.961 INFO:teuthology.orchestra.run.smithi091.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-27T20:46:48.961 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94647.log 2023-11-27T20:46:48.961 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.99513.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99513.log.gz 2023-11-27T20:46:48.961 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103910.log 2023-11-27T20:46:48.961 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113266.log 2023-11-27T20:46:48.961 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94647.log.gz 2023-11-27T20:46:48.962 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103910.log.gz 2023-11-27T20:46:48.962 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109375.log 2023-11-27T20:46:48.966 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113266.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113266.log.gz 2023-11-27T20:46:48.966 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112369.log 2023-11-27T20:46:48.966 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110604.log 2023-11-27T20:46:48.966 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109375.log.gz 2023-11-27T20:46:48.966 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112369.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112369.log.gz 2023-11-27T20:46:48.966 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114792.log 2023-11-27T20:46:48.967 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110604.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110604.log.gz 2023-11-27T20:46:48.967 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116317.log 2023-11-27T20:46:48.967 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98153.log 2023-11-27T20:46:48.967 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114792.log.gz 2023-11-27T20:46:48.967 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116317.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.116317.log.gz --verbose 2023-11-27T20:46:48.967 INFO:teuthology.orchestra.run.smithi091.stderr: -- /var/log/ceph/ceph-client.admin.107540.log 2023-11-27T20:46:48.967 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98153.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98153.log.gz 2023-11-27T20:46:48.967 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94996.log 2023-11-27T20:46:48.967 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96032.log 2023-11-27T20:46:48.968 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107540.log.gz 2023-11-27T20:46:48.968 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.94996.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94996.log.gz 2023-11-27T20:46:48.968 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108203.log 2023-11-27T20:46:48.968 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.96032.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96032.log.gz 2023-11-27T20:46:48.968 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103322.log 2023-11-27T20:46:48.968 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108203.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108203.log.gz 2023-11-27T20:46:48.968 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103070.log 2023-11-27T20:46:48.968 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116401.log 2023-11-27T20:46:48.969 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103322.log.gz 2023-11-27T20:46:48.969 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.103070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98759.log 2023-11-27T20:46:48.969 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103070.log.gz 2023-11-27T20:46:48.970 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.116401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114065.log 2023-11-27T20:46:48.970 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116401.log.gz 2023-11-27T20:46:48.970 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.98759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110268.log 2023-11-27T20:46:48.971 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98759.log.gz 2023-11-27T20:46:48.971 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95327.log 2023-11-27T20:46:48.971 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114065.log.gz 2023-11-27T20:46:48.972 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.110268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113224.log 2023-11-27T20:46:48.972 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110268.log.gz 2023-11-27T20:46:48.973 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112453.log 2023-11-27T20:46:48.973 INFO:teuthology.orchestra.run.smithi091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95327.log.gz 2023-11-27T20:46:48.974 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.113224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95331.log 2023-11-27T20:46:48.975 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113224.log.gz 2023-11-27T20:46:48.976 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.112453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93446.log 2023-11-27T20:46:48.976 INFO:teuthology.orchestra.run.smithi091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112453.log.gz 2023-11-27T20:46:48.977 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.95331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115399.log 2023-11-27T20:46:48.978 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95331.log.gz 2023-11-27T20:46:48.979 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.93446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100747.log 2023-11-27T20:46:48.979 INFO:teuthology.orchestra.run.smithi091.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93446.log.gz 2023-11-27T20:46:48.981 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108245.log 2023-11-27T20:46:48.981 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115399.log.gz 2023-11-27T20:46:48.982 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.100747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107404.log 2023-11-27T20:46:48.982 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100747.log.gz 2023-11-27T20:46:48.984 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108852.log 2023-11-27T20:46:48.984 INFO:teuthology.orchestra.run.smithi091.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108245.log.gz 2023-11-27T20:46:48.985 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104012.log 2023-11-27T20:46:48.985 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107404.log.gz 2023-11-27T20:46:48.986 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.108852.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108852.log.gz 2023-11-27T20:46:48.987 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-27T20:46:48.988 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.104012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106356.log 2023-11-27T20:46:48.988 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104012.log.gz 2023-11-27T20:46:48.990 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114960.log 2023-11-27T20:46:48.991 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106860.log 2023-11-27T20:46:48.991 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106356.log.gz 2023-11-27T20:46:48.993 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111148.log 2023-11-27T20:46:48.993 INFO:teuthology.orchestra.run.smithi091.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114960.log.gz 2023-11-27T20:46:48.994 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.106860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109561.log 2023-11-27T20:46:48.994 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106860.log.gz 2023-11-27T20:46:48.996 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115981.log 2023-11-27T20:46:48.996 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111148.log.gz 2023-11-27T20:46:48.997 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.109561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107993.log 2023-11-27T20:46:48.997 INFO:teuthology.orchestra.run.smithi091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109561.log.gz 2023-11-27T20:46:48.999 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.115981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105964.log 2023-11-27T20:46:48.999 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115981.log.gz 2023-11-27T20:46:49.000 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.107993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93800.log 2023-11-27T20:46:49.000 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107993.log.gz 2023-11-27T20:46:49.001 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.105964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111936.log 2023-11-27T20:46:49.002 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105964.log.gz 2023-11-27T20:46:49.003 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.93800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114480.log 2023-11-27T20:46:49.003 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93800.log.gz 2023-11-27T20:46:49.004 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.111936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97544.log 2023-11-27T20:46:49.005 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111936.log.gz 2023-11-27T20:46:49.005 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.114480.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114480.log.gz 2023-11-27T20:46:49.007 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.97544.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97544.log.gz 2023-11-27T20:46:49.034 INFO:teuthology.orchestra.run.smithi091.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-27T20:46:49.064 INFO:teuthology.orchestra.run.smithi091.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-27T20:46:49.111 INFO:teuthology.orchestra.run.smithi091.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-27T20:46:49.248 INFO:teuthology.orchestra.run.smithi091.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-27T20:46:49.259 INFO:teuthology.orchestra.run.smithi091.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-27T20:46:49.265 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-11-27T20:46:49.265 INFO:teuthology.orchestra.run.smithi091.stderr:real 0m0.930s 2023-11-27T20:46:49.265 INFO:teuthology.orchestra.run.smithi091.stderr:user 0m2.267s 2023-11-27T20:46:49.266 INFO:teuthology.orchestra.run.smithi091.stderr:sys 0m1.512s 2023-11-27T20:46:49.267 INFO:tasks.ceph:Archiving logs... 2023-11-27T20:46:49.267 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095/remote/smithi091/log 2023-11-27T20:46:49.268 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-27T20:46:50.016 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095/remote/smithi183/log 2023-11-27T20:46:50.017 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-27T20:46:50.374 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-27T20:46:50.388 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-27T20:46:50.389 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-27T20:46:50.400 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-27T20:46:50.553 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-27T20:46:50.563 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-27T20:46:50.564 DEBUG:teuthology.orchestra.run.smithi091:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T20:46:50.573 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T20:46:50.622 INFO:teuthology.orchestra.run.smithi091.stderr:bash: line 1: ntpq: command not found 2023-11-27T20:46:50.631 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2023-11-27T20:46:50.632 INFO:teuthology.orchestra.run.smithi091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T20:46:50.633 INFO:teuthology.orchestra.run.smithi091.stdout:=============================================================================== 2023-11-27T20:46:50.633 INFO:teuthology.orchestra.run.smithi091.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +946us[ +946us] +/- 69ms 2023-11-27T20:46:50.633 INFO:teuthology.orchestra.run.smithi091.stdout:^* hv02.front.sepia.ceph.com 3 6 377 53 -426us[ -426us] +/- 57ms 2023-11-27T20:46:50.633 INFO:teuthology.orchestra.run.smithi091.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -292us[ -292us] +/- 76ms 2023-11-27T20:46:50.633 INFO:teuthology.orchestra.run.smithi091.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:46:50.641 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T20:46:50.641 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-11-27T20:46:50.641 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +918us[ +970us] +/- 69ms 2023-11-27T20:46:50.642 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -445us[ -392us] +/- 57ms 2023-11-27T20:46:50.642 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv03.front.sepia.ceph.com 3 6 377 53 -307us[ -254us] +/- 76ms 2023-11-27T20:46:50.642 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T20:46:50.643 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-27T20:46:50.658 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-27T20:46:50.659 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-27T20:46:50.685 DEBUG:teuthology.orchestra.run.smithi091:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-27T20:46:50.951 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-27T20:46:51.212 DEBUG:teuthology.orchestra.run.smithi091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T20:46:51.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:46:51.318 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T20:46:51.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:46:51.429 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-27T20:46:51.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-27T20:46:51.467 INFO:teuthology.task.internal:Duration was 1107.338026 seconds 2023-11-27T20:46:51.468 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-27T20:46:51.524 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-27T20:46:51.524 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-27T20:46:51.531 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-27T20:46:51.652 INFO:teuthology.orchestra.run.smithi091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T20:46:51.696 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T20:46:52.112 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-27T20:46:52.113 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi091.front.sepia.ceph.com 2023-11-27T20:46:52.114 DEBUG:teuthology.orchestra.run.smithi091:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-27T20:46:52.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2023-11-27T20:46:52.175 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-27T20:46:52.254 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-27T20:46:52.255 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-27T20:46:52.263 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-27T20:46:52.352 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-27T20:46:52.352 DEBUG:teuthology.orchestra.run.smithi091:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-27T20:46:52.357 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-27T20:46:52.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-27T20:46:52.546 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-27T20:46:52.546 DEBUG:teuthology.orchestra.run.smithi091:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-27T20:46:52.621 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-27T20:46:52.726 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-27T20:46:52.737 DEBUG:teuthology.orchestra.run.smithi091:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-27T20:46:52.745 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-27T20:46:52.841 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = core 2023-11-27T20:46:52.856 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2023-11-27T20:46:52.908 DEBUG:teuthology.orchestra.run.smithi091:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-27T20:46:52.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:46:52.959 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-27T20:46:53.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T20:46:53.015 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-27T20:46:53.025 INFO:teuthology.task.internal:Transferring archived files... 2023-11-27T20:46:53.026 DEBUG:teuthology.misc:Transferring archived files from smithi091:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095/remote/smithi091 2023-11-27T20:46:53.026 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-27T20:46:53.141 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095/remote/smithi183 2023-11-27T20:46:53.142 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-27T20:46:53.252 INFO:teuthology.task.internal:Removing archive directory... 2023-11-27T20:46:53.253 DEBUG:teuthology.orchestra.run.smithi091:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-27T20:46:53.262 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-27T20:46:53.322 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-27T20:46:53.336 INFO:teuthology.task.internal:Not uploading archives. 2023-11-27T20:46:53.336 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-27T20:46:53.369 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-27T20:46:53.370 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-27T20:46:53.378 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-27T20:46:53.428 INFO:teuthology.orchestra.run.smithi091.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 27 20:46 /home/ubuntu/cephtest 2023-11-27T20:46:53.438 INFO:teuthology.orchestra.run.smithi183.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 27 20:46 /home/ubuntu/cephtest 2023-11-27T20:46:53.441 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-27T20:46:53.453 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-27T20:46:53.561 INFO:teuthology.nuke:Checking targets against current locks 2023-11-27T20:46:53.586 DEBUG:teuthology.nuke:shortname: smithi091 2023-11-27T20:46:53.587 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T20:46:53.611 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 20:18:23.394811', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB+aDIgyZeykydm9A9IY8KEPxFaJTJ8U9RFQ0TkOX8xkFhmbk8EZArlIfGFd1GGFr5a+7I1/leBcH/V0ZsRznPQ='} 2023-11-27T20:46:53.616 DEBUG:teuthology.nuke:shortname: smithi183 2023-11-27T20:46:53.616 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T20:46:53.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468095', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 20:18:23.393037', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMk7sAoQg+/QFBG4CYfDi5njJ3fAiSX5DNIES7pEEhrAcS6aFaA/E64lzy/gdGHlXBSIYcSYoqCMRyS3WvywXg='} 2023-11-27T20:46:53.668 INFO:teuthology.orchestra.console.smithi091:Power off 2023-11-27T20:46:53.668 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T20:46:53.692 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off 2023-11-27T20:46:53.692 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T20:46:53.710 INFO:teuthology.orchestra.console.smithi183:Power off 2023-11-27T20:46:53.711 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T20:46:53.721 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-11-27T20:46:53.735 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-11-27T20:46:53.735 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T20:46:53.759 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-11-27T20:46:57.722 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T20:46:57.760 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T20:46:57.833 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-11-27T20:46:57.871 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-11-27T20:47:01.836 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T20:47:01.872 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T20:47:01.946 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-11-27T20:47:01.983 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-11-27T20:47:02.084 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-11-27T20:47:05.948 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T20:47:06.059 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off 2023-11-27T20:47:06.160 INFO:teuthology.orchestra.console.smithi091:Power off completed 2023-11-27T20:47:06.266 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1107.3380262851715 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a0fae48366274a3ba80a40a7157d8b45 status: fail success: false 2023-11-27T20:47:06.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T20:47:06.348 INFO:teuthology.run:FAIL